2023-10-19T12:12:03.372 INFO:root:teuthology version: 0.0.1.dev201+g202b180 2023-10-19T12:12:03.373 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/pdonnell-2023-10-19_12:04:12-fs-wip-batrick-testing-20231016.203825-distro-default-smithi/7432284 --verbose --name pdonnell-2023-10-19_12:04:12-fs-wip-batrick-testing-20231016.203825-distro-default-smithi --owner scheduled_pdonnell@teuthology --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-workunit/postgres}} -- /home/teuthworker/archive/pdonnell-2023-10-19_12:04:12-fs-wip-batrick-testing-20231016.203825-distro-default-smithi/7432284/orig.config.yaml 2023-10-19T12:12:03.431 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T12:12:03.524 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2023-10-19_12:04:12-fs-wip-batrick-testing-20231016.203825-distro-default-smithi/7432284 branch: wip-batrick-testing-20231016.203825 description: fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-workunit/postgres}} email: pdonnell@redhat.com first_in_suite: false job_id: '7432284' kernel: client: branch: testing kdb: true sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2023-10-19_12:04:12-fs-wip-batrick-testing-20231016.203825-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: wip-batrick-testing-20231016.203825 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 5 session_timeout: 300 standby_replay: true cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: global: ms die on skipped message: false mds: mds_bal_replicate_threshold: 1 mgr: cephsqlite lock renewal timeout: 900000 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - slow metadata IO - SLOW_OPS - slow request sha1: f7420d7f8e55ceea786dcbf536c338ce920c21eb subvols: create: 2 subvol_options: --namespace-isolated ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mntopts: - context=system_u:object_r:postgresql_db_t:s0 mount_subvol_num: 0 mountpoint: /tmp/cephfs check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt install: ceph: flavor: default sha1: f7420d7f8e55ceea786dcbf536c338ce920c21eb kclient: client.0: mntopts: - context=system_u:object_r:postgresql_db_t:s0 mount_subvol_num: 1 mountpoint: /tmp/cephfs mntopts: - ms_mode=legacy - wsync syntax: v2 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-batrick-testing-20231016.203825 sha1: f7420d7f8e55ceea786dcbf536c338ce920c21eb owner: scheduled_pdonnell@teuthology priority: 65 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 7703 sha1: f7420d7f8e55ceea786dcbf536c338ce920c21eb sleep_before_teardown: 0 subset: 153/256 suite: fs suite_branch: wip-batrick-testing-20231016.203825 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_f7420d7f8e55ceea786dcbf536c338ce920c21eb/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: f7420d7f8e55ceea786dcbf536c338ce920c21eb syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi046.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= smithi157.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= smithi195.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= tasks: - pexec: all: - sudo cp /etc/containers/registries.conf /etc/containers/registries.conf.backup - sudo dnf -y module reset container-tools - sudo dnf -y module install container-tools:rhel8 --allowerasing --nobest - sudo cp /etc/containers/registries.conf.backup /etc/containers/registries.conf - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - kclient: null - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - exec: client.0: - sudo ls -l /tmp/cephfs/ && sudo df -h /tmp/cephfs/ - sudo mkdir -m 755 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres && sudo chown postgres:postgres /tmp/cephfs/postgres - sudo -u postgres -- mkdir -m 700 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres/data - sudo semanage fcontext -a -t postgresql_db_t "/tmp/cephfs/postgres(/.*)?" - sudo grep -i postgresql /etc/selinux/targeted/contexts/files/file_contexts.local - sudo restorecon -R -v /tmp/cephfs/postgres - sudo ls -lZaR /tmp/cephfs/postgres/ - sudo mkdir -p /etc/systemd/system/postgresql.service.d/ && printf '[Service]\nEnvironment=PGDATA=/tmp/cephfs/postgres/data\nEnvironment=PGLOG=/tmp/cephfs/postgres/pgstartup.log\n' | sudo tee /etc/systemd/system/postgresql.service.d/env.conf - sudo -u postgres -- postgresql-setup --initdb - sudo ls -lZaR /tmp/cephfs/postgres/ - sudo systemctl start postgresql - sudo -u postgres -- pgbench -s 32 -i - sudo -u postgres -- pgbench -c 100 -j 4 --progress=5 --time=900 - sudo systemctl stop postgresql - sudo ls -lZaR /tmp/cephfs/postgres/ teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 202b180cb047e798fb131047314a862593f45403 timestamp: 2023-10-19_12:04:12 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-19T12:12:03.524 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_f7420d7f8e55ceea786dcbf536c338ce920c21eb/qa; will attempt to use it 2023-10-19T12:12:03.525 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_f7420d7f8e55ceea786dcbf536c338ce920c21eb/qa/tasks 2023-10-19T12:12:03.525 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-19T12:12:03.527 INFO:teuthology.task.internal:Checking packages... 2023-10-19T12:12:03.551 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash 'f7420d7f8e55ceea786dcbf536c338ce920c21eb' 2023-10-19T12:12:03.551 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-19T12:12:03.551 INFO:teuthology.packaging:ref: None 2023-10-19T12:12:03.552 INFO:teuthology.packaging:tag: None 2023-10-19T12:12:03.552 INFO:teuthology.packaging:branch: wip-batrick-testing-20231016.203825 2023-10-19T12:12:03.552 INFO:teuthology.packaging:sha1: f7420d7f8e55ceea786dcbf536c338ce920c21eb 2023-10-19T12:12:03.553 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-batrick-testing-20231016.203825 2023-10-19T12:12:03.855 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-6786.gf7420d7f 2023-10-19T12:12:03.855 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-19T12:12:03.863 INFO:teuthology.task.internal:no buildpackages task found 2023-10-19T12:12:03.864 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-19T12:12:03.872 INFO:teuthology.task.internal:Saving configuration 2023-10-19T12:12:03.894 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-19T12:12:03.900 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-19T12:12:03.925 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi046.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-10-19_12:04:12-fs-wip-batrick-testing-20231016.203825-distro-default-smithi/7432284', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-19 12:06:56.544824', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-19T12:12:03.947 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi157.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-10-19_12:04:12-fs-wip-batrick-testing-20231016.203825-distro-default-smithi/7432284', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-19 12:06:56.546259', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-19T12:12:03.968 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi195.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-10-19_12:04:12-fs-wip-batrick-testing-20231016.203825-distro-default-smithi/7432284', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-19 12:06:56.547989', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-19T12:12:03.968 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-19T12:12:03.976 INFO:teuthology.task.internal:roles: ubuntu@smithi046.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2023-10-19T12:12:03.976 INFO:teuthology.task.internal:roles: ubuntu@smithi157.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2023-10-19T12:12:03.977 INFO:teuthology.task.internal:roles: ubuntu@smithi195.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2023-10-19T12:12:03.977 INFO:teuthology.run_tasks:Running task console_log... 2023-10-19T12:12:04.078 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f08010b7ca0>, signals=[15]) 2023-10-19T12:12:04.080 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-19T12:12:04.085 INFO:teuthology.task.internal:Opening connections... 2023-10-19T12:12:04.086 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi046.front.sepia.ceph.com 2023-10-19T12:12:04.087 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T12:12:04.157 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi157.front.sepia.ceph.com 2023-10-19T12:12:04.158 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T12:12:04.224 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi195.front.sepia.ceph.com 2023-10-19T12:12:04.225 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T12:12:04.291 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-19T12:12:04.297 DEBUG:teuthology.orchestra.run.smithi046:> uname -m 2023-10-19T12:12:04.319 INFO:teuthology.orchestra.run.smithi046.stdout:x86_64 2023-10-19T12:12:04.319 DEBUG:teuthology.orchestra.run.smithi046:> cat /etc/os-release 2023-10-19T12:12:04.378 INFO:teuthology.orchestra.run.smithi046.stdout:NAME="Red Hat Enterprise Linux" 2023-10-19T12:12:04.379 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION="8.6 (Ootpa)" 2023-10-19T12:12:04.379 INFO:teuthology.orchestra.run.smithi046.stdout:ID="rhel" 2023-10-19T12:12:04.379 INFO:teuthology.orchestra.run.smithi046.stdout:ID_LIKE="fedora" 2023-10-19T12:12:04.379 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION_ID="8.6" 2023-10-19T12:12:04.380 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM_ID="platform:el8" 2023-10-19T12:12:04.380 INFO:teuthology.orchestra.run.smithi046.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-19T12:12:04.380 INFO:teuthology.orchestra.run.smithi046.stdout:ANSI_COLOR="0;31" 2023-10-19T12:12:04.380 INFO:teuthology.orchestra.run.smithi046.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-19T12:12:04.380 INFO:teuthology.orchestra.run.smithi046.stdout:HOME_URL="https://www.redhat.com/" 2023-10-19T12:12:04.381 INFO:teuthology.orchestra.run.smithi046.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-19T12:12:04.381 INFO:teuthology.orchestra.run.smithi046.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-19T12:12:04.381 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:12:04.381 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-19T12:12:04.381 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-19T12:12:04.382 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-19T12:12:04.382 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-19T12:12:04.383 INFO:teuthology.lock.ops:Updating smithi046.front.sepia.ceph.com on lock server 2023-10-19T12:12:04.410 DEBUG:teuthology.orchestra.run.smithi157:> uname -m 2023-10-19T12:12:04.430 INFO:teuthology.orchestra.run.smithi157.stdout:x86_64 2023-10-19T12:12:04.431 DEBUG:teuthology.orchestra.run.smithi157:> cat /etc/os-release 2023-10-19T12:12:04.489 INFO:teuthology.orchestra.run.smithi157.stdout:NAME="Red Hat Enterprise Linux" 2023-10-19T12:12:04.490 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION="8.6 (Ootpa)" 2023-10-19T12:12:04.490 INFO:teuthology.orchestra.run.smithi157.stdout:ID="rhel" 2023-10-19T12:12:04.490 INFO:teuthology.orchestra.run.smithi157.stdout:ID_LIKE="fedora" 2023-10-19T12:12:04.490 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_ID="8.6" 2023-10-19T12:12:04.491 INFO:teuthology.orchestra.run.smithi157.stdout:PLATFORM_ID="platform:el8" 2023-10-19T12:12:04.491 INFO:teuthology.orchestra.run.smithi157.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-19T12:12:04.491 INFO:teuthology.orchestra.run.smithi157.stdout:ANSI_COLOR="0;31" 2023-10-19T12:12:04.491 INFO:teuthology.orchestra.run.smithi157.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-19T12:12:04.491 INFO:teuthology.orchestra.run.smithi157.stdout:HOME_URL="https://www.redhat.com/" 2023-10-19T12:12:04.492 INFO:teuthology.orchestra.run.smithi157.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-19T12:12:04.492 INFO:teuthology.orchestra.run.smithi157.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-19T12:12:04.492 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-19T12:12:04.492 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-19T12:12:04.492 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-19T12:12:04.492 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-19T12:12:04.493 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-19T12:12:04.493 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server 2023-10-19T12:12:04.526 DEBUG:teuthology.orchestra.run.smithi195:> uname -m 2023-10-19T12:12:04.548 INFO:teuthology.orchestra.run.smithi195.stdout:x86_64 2023-10-19T12:12:04.548 DEBUG:teuthology.orchestra.run.smithi195:> cat /etc/os-release 2023-10-19T12:12:04.607 INFO:teuthology.orchestra.run.smithi195.stdout:NAME="Red Hat Enterprise Linux" 2023-10-19T12:12:04.608 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION="8.6 (Ootpa)" 2023-10-19T12:12:04.608 INFO:teuthology.orchestra.run.smithi195.stdout:ID="rhel" 2023-10-19T12:12:04.608 INFO:teuthology.orchestra.run.smithi195.stdout:ID_LIKE="fedora" 2023-10-19T12:12:04.608 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_ID="8.6" 2023-10-19T12:12:04.609 INFO:teuthology.orchestra.run.smithi195.stdout:PLATFORM_ID="platform:el8" 2023-10-19T12:12:04.609 INFO:teuthology.orchestra.run.smithi195.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-19T12:12:04.609 INFO:teuthology.orchestra.run.smithi195.stdout:ANSI_COLOR="0;31" 2023-10-19T12:12:04.609 INFO:teuthology.orchestra.run.smithi195.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-19T12:12:04.609 INFO:teuthology.orchestra.run.smithi195.stdout:HOME_URL="https://www.redhat.com/" 2023-10-19T12:12:04.610 INFO:teuthology.orchestra.run.smithi195.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-19T12:12:04.610 INFO:teuthology.orchestra.run.smithi195.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-19T12:12:04.610 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-10-19T12:12:04.610 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-19T12:12:04.611 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-19T12:12:04.611 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-19T12:12:04.611 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-19T12:12:04.611 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server 2023-10-19T12:12:04.635 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-19T12:12:04.645 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-19T12:12:04.652 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-19T12:12:04.653 DEBUG:teuthology.orchestra.run.smithi046:> test '!' -e /home/ubuntu/cephtest 2023-10-19T12:12:04.656 DEBUG:teuthology.orchestra.run.smithi157:> test '!' -e /home/ubuntu/cephtest 2023-10-19T12:12:04.658 DEBUG:teuthology.orchestra.run.smithi195:> test '!' -e /home/ubuntu/cephtest 2023-10-19T12:12:04.677 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-19T12:12:04.684 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-19T12:12:04.684 DEBUG:teuthology.orchestra.run.smithi046:> test -z $(ls -A /var/lib/ceph) 2023-10-19T12:12:04.715 DEBUG:teuthology.orchestra.run.smithi157:> test -z $(ls -A /var/lib/ceph) 2023-10-19T12:12:04.718 DEBUG:teuthology.orchestra.run.smithi195:> test -z $(ls -A /var/lib/ceph) 2023-10-19T12:12:04.796 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-19T12:12:04.873 INFO:teuthology.run_tasks:Running task kernel... 2023-10-19T12:12:04.889 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'} 2023-10-19T12:12:04.889 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2023-10-19T12:12:04.890 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2023-10-19T12:12:04.890 DEBUG:teuthology.orchestra.run.smithi046:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-19T12:12:04.909 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-19T12:12:04.910 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&ref=testing 2023-10-19T12:12:05.075 DEBUG:teuthology.task.kernel:sha1 for client.0 is 47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-19T12:12:05.075 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "47672119149b103ec7cec2cc65c063ccbb001ac7"... 2023-10-19T12:12:05.076 DEBUG:teuthology.orchestra.run.smithi046:> uname -r 2023-10-19T12:12:05.096 INFO:teuthology.orchestra.run.smithi046.stdout:4.18.0-372.9.1.el8.x86_64 2023-10-19T12:12:05.096 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-372.9.1.el8.x86_64 vs 47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-19T12:12:05.096 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-10-19T12:12:05.097 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum upgrade -y linux-firmware 2023-10-19T12:12:06.343 INFO:teuthology.orchestra.run.smithi046.stdout:Updating Subscription Management repositories. 2023-10-19T12:12:06.343 INFO:teuthology.orchestra.run.smithi046.stdout:Unable to read consumer identity 2023-10-19T12:12:08.220 INFO:teuthology.orchestra.run.smithi046.stdout:Copr repo for python3-asyncssh owned by ceph 5.9 kB/s | 3.5 kB 00:00 2023-10-19T12:12:10.954 INFO:teuthology.orchestra.run.smithi046.stdout:Extra Packages for Enterprise Linux 5.9 MB/s | 16 MB 00:02 2023-10-19T12:12:14.696 INFO:teuthology.orchestra.run.smithi046.stdout:lab-extras 497 kB/s | 24 kB 00:00 2023-10-19T12:12:15.443 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2023-10-19T12:12:15.444 INFO:teuthology.orchestra.run.smithi046.stdout:Nothing to do. 2023-10-19T12:12:15.445 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2023-10-19T12:12:15.595 INFO:teuthology.task.kernel:Downloading kernel 47672119149b103ec7cec2cc65c063ccbb001ac7 on client.0... 2023-10-19T12:12:15.595 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-19T12:12:15.921 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/47672119149b103ec7cec2cc65c063ccbb001ac7/centos/8/flavors/default/x86_64/ 2023-10-19T12:12:15.921 DEBUG:teuthology.orchestra.run.smithi046:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.6.0_rc5_g47672119149b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/47672119149b103ec7cec2cc65c063ccbb001ac7/centos/8/flavors/default/x86_64/ --input-file=- 2023-10-19T12:12:15.924 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi046.front.sepia.ceph.com to complete... 2023-10-19T12:12:28.819 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19 12:12:28 URL:https://3.chacra.ceph.com/r/kernel/testing/47672119149b103ec7cec2cc65c063ccbb001ac7/centos/8/flavors/default/x86_64/kernel-6.6.0_rc5_g47672119149b-1.x86_64.rpm [383161052/383161052] -> "/tmp/kernel.x86_64.rpm" [1] 2023-10-19T12:12:28.820 INFO:teuthology.orchestra.run.smithi046.stderr:FINISHED --2023-10-19 12:12:28-- 2023-10-19T12:12:28.820 INFO:teuthology.orchestra.run.smithi046.stderr:Total wall clock time: 13s 2023-10-19T12:12:28.820 INFO:teuthology.orchestra.run.smithi046.stderr:Downloaded: 1 files, 365M in 13s (28.9 MB/s) 2023-10-19T12:12:28.821 INFO:teuthology.task.kernel:Installing kernel 47672119149b103ec7cec2cc65c063ccbb001ac7 on client.0... 2023-10-19T12:12:28.822 DEBUG:teuthology.orchestra.run.smithi046:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-10-19T12:12:30.485 INFO:teuthology.orchestra.run.smithi046.stdout:Verifying... ######################################## 2023-10-19T12:12:30.536 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing... ######################################## 2023-10-19T12:12:30.626 INFO:teuthology.orchestra.run.smithi046.stdout:Updating / installing... 2023-10-19T12:13:11.717 INFO:teuthology.orchestra.run.smithi046.stdout:kernel-6.6.0_rc5_g47672119149b-1 ######################################## 2023-10-19T12:13:13.305 INFO:teuthology.orchestra.run.smithi046.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2023-10-19T12:13:35.761 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi046.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-10-19T12:13:35.761 DEBUG:teuthology.orchestra.run.smithi046:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-10-19T12:13:35.823 INFO:teuthology.orchestra.run.smithi046.stdout:/boot/System.map-6.6.0-rc5-g47672119149b 2023-10-19T12:13:35.823 INFO:teuthology.orchestra.run.smithi046.stdout:/boot/config-6.6.0-rc5-g47672119149b 2023-10-19T12:13:35.823 INFO:teuthology.orchestra.run.smithi046.stdout:/boot/vmlinuz-6.6.0-rc5-g47672119149b 2023-10-19T12:13:35.824 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b 2023-10-19T12:13:35.824 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel 2023-10-19T12:13:35.824 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch 2023-10-19T12:13:35.824 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86 2023-10-19T12:13:35.824 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto 2023-10-19T12:13:35.825 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-10-19T12:13:35.825 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-10-19T12:13:35.825 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-10-19T12:13:35.825 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-10-19T12:13:35.825 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-10-19T12:13:35.825 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-10-19T12:13:35.826 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-10-19T12:13:35.826 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/crc32c-intel.ko 2023-10-19T12:13:35.826 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-10-19T12:13:35.826 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-10-19T12:13:35.827 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-10-19T12:13:35.827 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-10-19T12:13:35.827 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/serpent-avx2.ko 2023-10-19T12:13:35.827 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-10-19T12:13:35.827 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-10-19T12:13:35.828 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-10-19T12:13:35.828 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-10-19T12:13:35.828 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-10-19T12:13:35.828 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-10-19T12:13:35.828 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-10-19T12:13:35.828 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel 2023-10-19T12:13:35.829 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpu 2023-10-19T12:13:35.829 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpu/mce 2023-10-19T12:13:35.829 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-10-19T12:13:35.829 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm 2023-10-19T12:13:35.829 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/kvm-amd.ko 2023-10-19T12:13:35.830 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/kvm-intel.ko 2023-10-19T12:13:35.830 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/kvm.ko 2023-10-19T12:13:35.830 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto 2023-10-19T12:13:35.830 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/ansi_cprng.ko 2023-10-19T12:13:35.830 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/anubis.ko 2023-10-19T12:13:35.831 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/arc4.ko 2023-10-19T12:13:35.831 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx 2023-10-19T12:13:35.831 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_memcpy.ko 2023-10-19T12:13:35.831 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_pq.ko 2023-10-19T12:13:35.831 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_raid6_recov.ko 2023-10-19T12:13:35.832 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_tx.ko 2023-10-19T12:13:35.832 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_xor.ko 2023-10-19T12:13:35.832 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/raid6test.ko 2023-10-19T12:13:35.832 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/authenc.ko 2023-10-19T12:13:35.832 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/authencesn.ko 2023-10-19T12:13:35.833 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/blake2b_generic.ko 2023-10-19T12:13:35.833 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/blowfish_common.ko 2023-10-19T12:13:35.833 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/blowfish_generic.ko 2023-10-19T12:13:35.833 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/camellia_generic.ko 2023-10-19T12:13:35.833 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cast5_generic.ko 2023-10-19T12:13:35.834 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cast6_generic.ko 2023-10-19T12:13:35.834 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cast_common.ko 2023-10-19T12:13:35.834 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/ccm.ko 2023-10-19T12:13:35.834 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cmac.ko 2023-10-19T12:13:35.835 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crc32_generic.ko 2023-10-19T12:13:35.835 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crypto_engine.ko 2023-10-19T12:13:35.835 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crypto_user.ko 2023-10-19T12:13:35.835 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cts.ko 2023-10-19T12:13:35.835 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/des_generic.ko 2023-10-19T12:13:35.835 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/dh_generic.ko 2023-10-19T12:13:35.836 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/echainiv.ko 2023-10-19T12:13:35.836 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/essiv.ko 2023-10-19T12:13:35.836 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/fcrypt.ko 2023-10-19T12:13:35.836 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/khazad.ko 2023-10-19T12:13:35.836 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/lz4.ko 2023-10-19T12:13:35.837 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/lz4hc.ko 2023-10-19T12:13:35.837 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/md4.ko 2023-10-19T12:13:35.837 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/michael_mic.ko 2023-10-19T12:13:35.837 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/pcbc.ko 2023-10-19T12:13:35.837 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/pcrypt.ko 2023-10-19T12:13:35.838 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/rmd160.ko 2023-10-19T12:13:35.838 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/seed.ko 2023-10-19T12:13:35.838 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/serpent_generic.ko 2023-10-19T12:13:35.838 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/tcrypt.ko 2023-10-19T12:13:35.838 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/tea.ko 2023-10-19T12:13:35.839 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/twofish_common.ko 2023-10-19T12:13:35.839 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/twofish_generic.ko 2023-10-19T12:13:35.839 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/vmac.ko 2023-10-19T12:13:35.839 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/wp512.ko 2023-10-19T12:13:35.839 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xcbc.ko 2023-10-19T12:13:35.840 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xor.ko 2023-10-19T12:13:35.840 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xxhash_generic.ko 2023-10-19T12:13:35.840 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers 2023-10-19T12:13:35.840 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi 2023-10-19T12:13:35.840 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/acpi_ipmi.ko 2023-10-19T12:13:35.841 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/acpi_pad.ko 2023-10-19T12:13:35.841 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/custom_method.ko 2023-10-19T12:13:35.841 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/ec_sys.ko 2023-10-19T12:13:35.841 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/platform_profile.ko 2023-10-19T12:13:35.841 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/sbs.ko 2023-10-19T12:13:35.842 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/sbshc.ko 2023-10-19T12:13:35.842 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/video.ko 2023-10-19T12:13:35.842 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata 2023-10-19T12:13:35.842 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/acard-ahci.ko 2023-10-19T12:13:35.842 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/ahci_platform.ko 2023-10-19T12:13:35.843 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/ata_generic.ko 2023-10-19T12:13:35.843 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/libahci_platform.ko 2023-10-19T12:13:35.843 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_acpi.ko 2023-10-19T12:13:35.843 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ali.ko 2023-10-19T12:13:35.843 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_amd.ko 2023-10-19T12:13:35.843 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_artop.ko 2023-10-19T12:13:35.844 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_atiixp.ko 2023-10-19T12:13:35.844 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_atp867x.ko 2023-10-19T12:13:35.844 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_cmd640.ko 2023-10-19T12:13:35.844 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_cmd64x.ko 2023-10-19T12:13:35.844 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_cypress.ko 2023-10-19T12:13:35.845 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_efar.ko 2023-10-19T12:13:35.845 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt366.ko 2023-10-19T12:13:35.845 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt37x.ko 2023-10-19T12:13:35.845 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt3x2n.ko 2023-10-19T12:13:35.845 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt3x3.ko 2023-10-19T12:13:35.846 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_it8213.ko 2023-10-19T12:13:35.846 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_it821x.ko 2023-10-19T12:13:35.846 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_jmicron.ko 2023-10-19T12:13:35.846 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_marvell.ko 2023-10-19T12:13:35.846 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_mpiix.ko 2023-10-19T12:13:35.847 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_netcell.ko 2023-10-19T12:13:35.847 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ninja32.ko 2023-10-19T12:13:35.847 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ns87410.ko 2023-10-19T12:13:35.847 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ns87415.ko 2023-10-19T12:13:35.847 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_oldpiix.ko 2023-10-19T12:13:35.848 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_opti.ko 2023-10-19T12:13:35.848 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_optidma.ko 2023-10-19T12:13:35.848 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_pcmcia.ko 2023-10-19T12:13:35.848 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_pdc2027x.ko 2023-10-19T12:13:35.848 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-10-19T12:13:35.849 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_piccolo.ko 2023-10-19T12:13:35.849 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_rdc.ko 2023-10-19T12:13:35.849 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sch.ko 2023-10-19T12:13:35.849 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_serverworks.ko 2023-10-19T12:13:35.849 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sil680.ko 2023-10-19T12:13:35.850 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sis.ko 2023-10-19T12:13:35.850 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sl82c105.ko 2023-10-19T12:13:35.850 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_triflex.ko 2023-10-19T12:13:35.850 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_via.ko 2023-10-19T12:13:35.850 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pdc_adma.ko 2023-10-19T12:13:35.851 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_inic162x.ko 2023-10-19T12:13:35.851 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_mv.ko 2023-10-19T12:13:35.851 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_nv.ko 2023-10-19T12:13:35.851 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_promise.ko 2023-10-19T12:13:35.851 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_qstor.ko 2023-10-19T12:13:35.851 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sil.ko 2023-10-19T12:13:35.852 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sil24.ko 2023-10-19T12:13:35.852 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sis.ko 2023-10-19T12:13:35.852 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_svw.ko 2023-10-19T12:13:35.852 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sx4.ko 2023-10-19T12:13:35.852 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_uli.ko 2023-10-19T12:13:35.853 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_via.ko 2023-10-19T12:13:35.853 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_vsc.ko 2023-10-19T12:13:35.853 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/auxdisplay 2023-10-19T12:13:35.853 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/auxdisplay/ks0108.ko 2023-10-19T12:13:35.853 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/base 2023-10-19T12:13:35.854 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/base/regmap 2023-10-19T12:13:35.854 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/base/regmap/regmap-i2c.ko 2023-10-19T12:13:35.854 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/base/regmap/regmap-mmio.ko 2023-10-19T12:13:35.854 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/bcma 2023-10-19T12:13:35.854 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/bcma/bcma.ko 2023-10-19T12:13:35.855 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block 2023-10-19T12:13:35.855 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/aoe 2023-10-19T12:13:35.855 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/aoe/aoe.ko 2023-10-19T12:13:35.855 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/brd.ko 2023-10-19T12:13:35.855 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/drbd 2023-10-19T12:13:35.856 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/drbd/drbd.ko 2023-10-19T12:13:35.856 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/floppy.ko 2023-10-19T12:13:35.856 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/loop.ko 2023-10-19T12:13:35.856 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/mtip32xx 2023-10-19T12:13:35.856 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-10-19T12:13:35.857 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/nbd.ko 2023-10-19T12:13:35.857 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/null_blk 2023-10-19T12:13:35.857 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/null_blk/null_blk.ko 2023-10-19T12:13:35.857 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/pktcdvd.ko 2023-10-19T12:13:35.857 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/rbd.ko 2023-10-19T12:13:35.858 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/virtio_blk.ko 2023-10-19T12:13:35.858 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/xen-blkback 2023-10-19T12:13:35.858 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-10-19T12:13:35.858 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/xen-blkfront.ko 2023-10-19T12:13:35.858 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/zram 2023-10-19T12:13:35.859 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/zram/zram.ko 2023-10-19T12:13:35.859 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char 2023-10-19T12:13:35.859 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hangcheck-timer.ko 2023-10-19T12:13:35.859 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random 2023-10-19T12:13:35.859 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/amd-rng.ko 2023-10-19T12:13:35.860 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/intel-rng.ko 2023-10-19T12:13:35.860 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-10-19T12:13:35.860 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/via-rng.ko 2023-10-19T12:13:35.860 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/virtio-rng.ko 2023-10-19T12:13:35.860 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi 2023-10-19T12:13:35.861 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-10-19T12:13:35.861 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-10-19T12:13:35.861 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-10-19T12:13:35.861 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_si.ko 2023-10-19T12:13:35.861 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-10-19T12:13:35.862 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-10-19T12:13:35.862 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/lp.ko 2023-10-19T12:13:35.862 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/mwave 2023-10-19T12:13:35.862 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/mwave/mwave.ko 2023-10-19T12:13:35.862 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ppdev.ko 2023-10-19T12:13:35.863 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tlclk.ko 2023-10-19T12:13:35.863 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm 2023-10-19T12:13:35.863 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm.ko 2023-10-19T12:13:35.863 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_atmel.ko 2023-10-19T12:13:35.863 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_infineon.ko 2023-10-19T12:13:35.864 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_nsc.ko 2023-10-19T12:13:35.864 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_tis.ko 2023-10-19T12:13:35.864 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-10-19T12:13:35.864 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/uv_mmtimer.ko 2023-10-19T12:13:35.864 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/virtio_console.ko 2023-10-19T12:13:35.864 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq 2023-10-19T12:13:35.865 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-10-19T12:13:35.865 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-10-19T12:13:35.865 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/p4-clockmod.ko 2023-10-19T12:13:35.865 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-10-19T12:13:35.865 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/powernow-k8.ko 2023-10-19T12:13:35.866 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/speedstep-lib.ko 2023-10-19T12:13:35.866 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto 2023-10-19T12:13:35.866 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ccp 2023-10-19T12:13:35.866 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-10-19T12:13:35.866 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ccp/ccp.ko 2023-10-19T12:13:35.867 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel 2023-10-19T12:13:35.867 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat 2023-10-19T12:13:35.867 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_common 2023-10-19T12:13:35.867 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-10-19T12:13:35.867 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-10-19T12:13:35.868 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-10-19T12:13:35.868 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/padlock-aes.ko 2023-10-19T12:13:35.868 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/padlock-sha.ko 2023-10-19T12:13:35.868 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/virtio 2023-10-19T12:13:35.868 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-10-19T12:13:35.869 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dca 2023-10-19T12:13:35.869 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dca/dca.ko 2023-10-19T12:13:35.869 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/devfreq 2023-10-19T12:13:35.869 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-10-19T12:13:35.869 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma 2023-10-19T12:13:35.870 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/dw 2023-10-19T12:13:35.870 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/dw/dw_dmac.ko 2023-10-19T12:13:35.870 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/ioat 2023-10-19T12:13:35.870 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/ioat/ioatdma.ko 2023-10-19T12:13:35.871 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac 2023-10-19T12:13:35.871 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/amd64_edac.ko 2023-10-19T12:13:35.871 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/e752x_edac.ko 2023-10-19T12:13:35.871 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/edac_mce_amd.ko 2023-10-19T12:13:35.871 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i3000_edac.ko 2023-10-19T12:13:35.871 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i3200_edac.ko 2023-10-19T12:13:35.872 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i5100_edac.ko 2023-10-19T12:13:35.872 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i5400_edac.ko 2023-10-19T12:13:35.872 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i7300_edac.ko 2023-10-19T12:13:35.872 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i7core_edac.ko 2023-10-19T12:13:35.872 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i82975x_edac.ko 2023-10-19T12:13:35.873 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/ie31200_edac.ko 2023-10-19T12:13:35.873 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/sb_edac.ko 2023-10-19T12:13:35.873 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/x38_edac.ko 2023-10-19T12:13:35.873 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware 2023-10-19T12:13:35.873 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware/edd.ko 2023-10-19T12:13:35.874 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware/iscsi_ibft.ko 2023-10-19T12:13:35.874 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio 2023-10-19T12:13:35.874 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-ich.ko 2023-10-19T12:13:35.874 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-viperboard.ko 2023-10-19T12:13:35.874 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid 2023-10-19T12:13:35.875 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-appleir.ko 2023-10-19T12:13:35.875 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-aureal.ko 2023-10-19T12:13:35.875 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-axff.ko 2023-10-19T12:13:35.875 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-dr.ko 2023-10-19T12:13:35.875 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-elecom.ko 2023-10-19T12:13:35.875 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-elo.ko 2023-10-19T12:13:35.876 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-emsff.ko 2023-10-19T12:13:35.876 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-gaff.ko 2023-10-19T12:13:35.876 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-gt683r.ko 2023-10-19T12:13:35.876 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-gyration.ko 2023-10-19T12:13:35.876 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-holtek-kbd.ko 2023-10-19T12:13:35.877 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-holtek-mouse.ko 2023-10-19T12:13:35.877 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-holtekff.ko 2023-10-19T12:13:35.877 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-hyperv.ko 2023-10-19T12:13:35.877 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-icade.ko 2023-10-19T12:13:35.877 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-keytouch.ko 2023-10-19T12:13:35.878 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-kye.ko 2023-10-19T12:13:35.878 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-lcpower.ko 2023-10-19T12:13:35.878 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-led.ko 2023-10-19T12:13:35.878 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-lenovo.ko 2023-10-19T12:13:35.878 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-logitech-dj.ko 2023-10-19T12:13:35.879 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-10-19T12:13:35.879 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-multitouch.ko 2023-10-19T12:13:35.879 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-ortek.ko 2023-10-19T12:13:35.879 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-penmount.ko 2023-10-19T12:13:35.879 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-petalynx.ko 2023-10-19T12:13:35.880 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-picolcd.ko 2023-10-19T12:13:35.880 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-pl.ko 2023-10-19T12:13:35.880 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-plantronics.ko 2023-10-19T12:13:35.880 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-primax.ko 2023-10-19T12:13:35.880 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-rmi.ko 2023-10-19T12:13:35.881 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-arvo.ko 2023-10-19T12:13:35.881 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-common.ko 2023-10-19T12:13:35.881 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-isku.ko 2023-10-19T12:13:35.881 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-kone.ko 2023-10-19T12:13:35.881 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-10-19T12:13:35.881 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-konepure.ko 2023-10-19T12:13:35.882 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-10-19T12:13:35.882 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-lua.ko 2023-10-19T12:13:35.882 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-pyra.ko 2023-10-19T12:13:35.882 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-ryos.ko 2023-10-19T12:13:35.882 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-savu.ko 2023-10-19T12:13:35.883 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat.ko 2023-10-19T12:13:35.883 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-saitek.ko 2023-10-19T12:13:35.883 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-samsung.ko 2023-10-19T12:13:35.883 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sensor-hub.ko 2023-10-19T12:13:35.883 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sjoy.ko 2023-10-19T12:13:35.884 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sony.ko 2023-10-19T12:13:35.884 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-speedlink.ko 2023-10-19T12:13:35.884 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-steelseries.ko 2023-10-19T12:13:35.884 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sunplus.ko 2023-10-19T12:13:35.884 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-thrustmaster.ko 2023-10-19T12:13:35.885 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-tivo.ko 2023-10-19T12:13:35.885 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-tmff.ko 2023-10-19T12:13:35.885 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-topseed.ko 2023-10-19T12:13:35.885 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-twinhan.ko 2023-10-19T12:13:35.885 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-uclogic.ko 2023-10-19T12:13:35.886 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-waltop.ko 2023-10-19T12:13:35.886 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-wiimote.ko 2023-10-19T12:13:35.886 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-xinmo.ko 2023-10-19T12:13:35.886 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-zpff.ko 2023-10-19T12:13:35.886 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-zydacron.ko 2023-10-19T12:13:35.887 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/uhid.ko 2023-10-19T12:13:35.887 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/wacom.ko 2023-10-19T12:13:35.887 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv 2023-10-19T12:13:35.887 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/hv_balloon.ko 2023-10-19T12:13:35.887 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/hv_utils.ko 2023-10-19T12:13:35.888 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/hv_vmbus.ko 2023-10-19T12:13:35.888 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon 2023-10-19T12:13:35.888 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/abituguru.ko 2023-10-19T12:13:35.888 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/abituguru3.ko 2023-10-19T12:13:35.888 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/acpi_power_meter.ko 2023-10-19T12:13:35.889 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ad7414.ko 2023-10-19T12:13:35.889 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ad7418.ko 2023-10-19T12:13:35.889 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adc128d818.ko 2023-10-19T12:13:35.889 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1025.ko 2023-10-19T12:13:35.889 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1026.ko 2023-10-19T12:13:35.890 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1029.ko 2023-10-19T12:13:35.890 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1031.ko 2023-10-19T12:13:35.890 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm9240.ko 2023-10-19T12:13:35.890 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ads7828.ko 2023-10-19T12:13:35.890 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7410.ko 2023-10-19T12:13:35.891 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7411.ko 2023-10-19T12:13:35.891 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7462.ko 2023-10-19T12:13:35.891 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7470.ko 2023-10-19T12:13:35.891 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7475.ko 2023-10-19T12:13:35.891 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7x10.ko 2023-10-19T12:13:35.892 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/amc6821.ko 2023-10-19T12:13:35.892 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/applesmc.ko 2023-10-19T12:13:35.892 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/asb100.ko 2023-10-19T12:13:35.892 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/asc7621.ko 2023-10-19T12:13:35.892 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/asus_atk0110.ko 2023-10-19T12:13:35.892 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/atxp1.ko 2023-10-19T12:13:35.893 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/coretemp.ko 2023-10-19T12:13:35.893 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-10-19T12:13:35.893 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/dme1737.ko 2023-10-19T12:13:35.893 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ds1621.ko 2023-10-19T12:13:35.893 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ds620.ko 2023-10-19T12:13:35.894 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/emc1403.ko 2023-10-19T12:13:35.894 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/emc6w201.ko 2023-10-19T12:13:35.894 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/f71805f.ko 2023-10-19T12:13:35.894 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/f71882fg.ko 2023-10-19T12:13:35.894 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/f75375s.ko 2023-10-19T12:13:35.895 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/fam15h_power.ko 2023-10-19T12:13:35.895 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/fschmd.ko 2023-10-19T12:13:35.895 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/g760a.ko 2023-10-19T12:13:35.895 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/g762.ko 2023-10-19T12:13:35.895 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/gl518sm.ko 2023-10-19T12:13:35.896 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/gl520sm.ko 2023-10-19T12:13:35.896 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/hwmon-vid.ko 2023-10-19T12:13:35.896 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/i5500_temp.ko 2023-10-19T12:13:35.896 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/i5k_amb.ko 2023-10-19T12:13:35.896 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ibmaem.ko 2023-10-19T12:13:35.897 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ibmpex.ko 2023-10-19T12:13:35.897 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ina209.ko 2023-10-19T12:13:35.897 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ina2xx.ko 2023-10-19T12:13:35.897 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/it87.ko 2023-10-19T12:13:35.897 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/k10temp.ko 2023-10-19T12:13:35.898 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/k8temp.ko 2023-10-19T12:13:35.898 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lineage-pem.ko 2023-10-19T12:13:35.898 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm63.ko 2023-10-19T12:13:35.898 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm73.ko 2023-10-19T12:13:35.898 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm75.ko 2023-10-19T12:13:35.899 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm77.ko 2023-10-19T12:13:35.899 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm78.ko 2023-10-19T12:13:35.899 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm80.ko 2023-10-19T12:13:35.899 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm83.ko 2023-10-19T12:13:35.899 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm85.ko 2023-10-19T12:13:35.900 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm87.ko 2023-10-19T12:13:35.900 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm90.ko 2023-10-19T12:13:35.900 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm92.ko 2023-10-19T12:13:35.900 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm93.ko 2023-10-19T12:13:35.900 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm95234.ko 2023-10-19T12:13:35.901 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm95241.ko 2023-10-19T12:13:35.901 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm95245.ko 2023-10-19T12:13:35.901 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc2945.ko 2023-10-19T12:13:35.901 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4151.ko 2023-10-19T12:13:35.901 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4215.ko 2023-10-19T12:13:35.902 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4222.ko 2023-10-19T12:13:35.902 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4245.ko 2023-10-19T12:13:35.902 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4260.ko 2023-10-19T12:13:35.902 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4261.ko 2023-10-19T12:13:35.902 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max16065.ko 2023-10-19T12:13:35.903 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max1619.ko 2023-10-19T12:13:35.903 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max1668.ko 2023-10-19T12:13:35.903 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max197.ko 2023-10-19T12:13:35.903 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max6639.ko 2023-10-19T12:13:35.903 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max6650.ko 2023-10-19T12:13:35.904 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max6697.ko 2023-10-19T12:13:35.904 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/mcp3021.ko 2023-10-19T12:13:35.904 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct6683.ko 2023-10-19T12:13:35.904 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct6775-core.ko 2023-10-19T12:13:35.904 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct6775.ko 2023-10-19T12:13:35.904 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct7802.ko 2023-10-19T12:13:35.905 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pc87360.ko 2023-10-19T12:13:35.905 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pc87427.ko 2023-10-19T12:13:35.905 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pcf8591.ko 2023-10-19T12:13:35.905 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus 2023-10-19T12:13:35.905 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-10-19T12:13:35.906 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-10-19T12:13:35.906 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-10-19T12:13:35.906 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/max16064.ko 2023-10-19T12:13:35.906 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/max34440.ko 2023-10-19T12:13:35.906 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/max8688.ko 2023-10-19T12:13:35.907 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-10-19T12:13:35.907 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-10-19T12:13:35.907 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-10-19T12:13:35.907 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-10-19T12:13:35.907 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-10-19T12:13:35.908 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-10-19T12:13:35.908 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/powr1220.ko 2023-10-19T12:13:35.908 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sch5627.ko 2023-10-19T12:13:35.908 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sch5636.ko 2023-10-19T12:13:35.908 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sch56xx-common.ko 2023-10-19T12:13:35.908 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sht15.ko 2023-10-19T12:13:35.909 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sht21.ko 2023-10-19T12:13:35.909 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/shtc1.ko 2023-10-19T12:13:35.909 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sis5595.ko 2023-10-19T12:13:35.909 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/smsc47b397.ko 2023-10-19T12:13:35.909 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/smsc47m1.ko 2023-10-19T12:13:35.910 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/smsc47m192.ko 2023-10-19T12:13:35.910 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/thmc50.ko 2023-10-19T12:13:35.910 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp102.ko 2023-10-19T12:13:35.910 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp103.ko 2023-10-19T12:13:35.910 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp401.ko 2023-10-19T12:13:35.911 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp421.ko 2023-10-19T12:13:35.911 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/via-cputemp.ko 2023-10-19T12:13:35.911 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/via686a.ko 2023-10-19T12:13:35.911 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/vt1211.ko 2023-10-19T12:13:35.911 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/vt8231.ko 2023-10-19T12:13:35.912 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83627ehf.ko 2023-10-19T12:13:35.912 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83627hf.ko 2023-10-19T12:13:35.912 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83781d.ko 2023-10-19T12:13:35.912 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83791d.ko 2023-10-19T12:13:35.912 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83792d.ko 2023-10-19T12:13:35.912 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83793.ko 2023-10-19T12:13:35.913 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83795.ko 2023-10-19T12:13:35.913 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83l785ts.ko 2023-10-19T12:13:35.913 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83l786ng.ko 2023-10-19T12:13:35.913 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c 2023-10-19T12:13:35.913 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/algos 2023-10-19T12:13:35.914 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-10-19T12:13:35.914 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-10-19T12:13:35.914 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses 2023-10-19T12:13:35.914 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-10-19T12:13:35.914 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-10-19T12:13:35.915 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-10-19T12:13:35.915 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-10-19T12:13:35.915 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-10-19T12:13:35.915 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-10-19T12:13:35.915 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-10-19T12:13:35.916 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-10-19T12:13:35.916 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-i801.ko 2023-10-19T12:13:35.916 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-isch.ko 2023-10-19T12:13:35.916 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-10-19T12:13:35.916 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-10-19T12:13:35.917 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-10-19T12:13:35.917 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-parport.ko 2023-10-19T12:13:35.917 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-10-19T12:13:35.917 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-10-19T12:13:35.917 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-10-19T12:13:35.917 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-10-19T12:13:35.918 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-10-19T12:13:35.918 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-10-19T12:13:35.918 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-via.ko 2023-10-19T12:13:35.918 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-10-19T12:13:35.918 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-10-19T12:13:35.919 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-dev.ko 2023-10-19T12:13:35.919 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-mux.ko 2023-10-19T12:13:35.919 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-10-19T12:13:35.919 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-smbus.ko 2023-10-19T12:13:35.919 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-stub.ko 2023-10-19T12:13:35.920 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband 2023-10-19T12:13:35.920 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core 2023-10-19T12:13:35.920 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_cm.ko 2023-10-19T12:13:35.920 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_core.ko 2023-10-19T12:13:35.920 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_umad.ko 2023-10-19T12:13:35.921 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-10-19T12:13:35.921 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/iw_cm.ko 2023-10-19T12:13:35.921 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/rdma_cm.ko 2023-10-19T12:13:35.921 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-10-19T12:13:35.921 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw 2023-10-19T12:13:35.921 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/cxgb4 2023-10-19T12:13:35.922 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-10-19T12:13:35.922 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx4 2023-10-19T12:13:35.922 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-10-19T12:13:35.922 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx5 2023-10-19T12:13:35.922 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-10-19T12:13:35.923 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mthca 2023-10-19T12:13:35.923 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-10-19T12:13:35.923 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp 2023-10-19T12:13:35.923 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/ipoib 2023-10-19T12:13:35.923 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-10-19T12:13:35.924 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/iser 2023-10-19T12:13:35.924 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-10-19T12:13:35.924 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/isert 2023-10-19T12:13:35.924 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-10-19T12:13:35.924 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srp 2023-10-19T12:13:35.924 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-10-19T12:13:35.925 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srpt 2023-10-19T12:13:35.925 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-10-19T12:13:35.925 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input 2023-10-19T12:13:35.925 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport 2023-10-19T12:13:35.925 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-10-19T12:13:35.926 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/fm801-gp.ko 2023-10-19T12:13:35.926 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/gameport.ko 2023-10-19T12:13:35.926 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/joydev.ko 2023-10-19T12:13:35.926 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard 2023-10-19T12:13:35.926 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/gpio_keys.ko 2023-10-19T12:13:35.927 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse 2023-10-19T12:13:35.927 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/appletouch.ko 2023-10-19T12:13:35.927 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/bcm5974.ko 2023-10-19T12:13:35.927 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/cyapatp.ko 2023-10-19T12:13:35.927 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/elan_i2c.ko 2023-10-19T12:13:35.928 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/sermouse.ko 2023-10-19T12:13:35.928 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-10-19T12:13:35.928 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/synaptics_usb.ko 2023-10-19T12:13:35.928 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/vsxxxaa.ko 2023-10-19T12:13:35.928 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/rmi4 2023-10-19T12:13:35.929 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/rmi4/rmi_core.ko 2023-10-19T12:13:35.929 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio 2023-10-19T12:13:35.929 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/altera_ps2.ko 2023-10-19T12:13:35.929 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/arc_ps2.ko 2023-10-19T12:13:35.929 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-10-19T12:13:35.930 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/serio_raw.ko 2023-10-19T12:13:35.930 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/sparse-keymap.ko 2023-10-19T12:13:35.930 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/iommu 2023-10-19T12:13:35.930 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/iommu/amd 2023-10-19T12:13:35.930 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/iommu/amd/iommu_v2.ko 2023-10-19T12:13:35.931 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds 2023-10-19T12:13:35.931 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-blinkm.ko 2023-10-19T12:13:35.931 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lm3530.ko 2023-10-19T12:13:35.931 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lp3944.ko 2023-10-19T12:13:35.931 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-ss4200.ko 2023-10-19T12:13:35.932 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger 2023-10-19T12:13:35.932 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-10-19T12:13:35.932 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-10-19T12:13:35.932 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-10-19T12:13:35.932 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-10-19T12:13:35.933 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-10-19T12:13:35.933 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-10-19T12:13:35.933 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-10-19T12:13:35.933 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-10-19T12:13:35.933 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md 2023-10-19T12:13:35.934 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/bcache 2023-10-19T12:13:35.934 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/bcache/bcache.ko 2023-10-19T12:13:35.934 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-bio-prison.ko 2023-10-19T12:13:35.934 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-cache-smq.ko 2023-10-19T12:13:35.934 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-cache.ko 2023-10-19T12:13:35.935 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-crypt.ko 2023-10-19T12:13:35.935 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-delay.ko 2023-10-19T12:13:35.935 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-flakey.ko 2023-10-19T12:13:35.935 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-log-userspace.ko 2023-10-19T12:13:35.935 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-multipath.ko 2023-10-19T12:13:35.936 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-queue-length.ko 2023-10-19T12:13:35.936 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-raid.ko 2023-10-19T12:13:35.936 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-round-robin.ko 2023-10-19T12:13:35.936 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-service-time.ko 2023-10-19T12:13:35.936 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-switch.ko 2023-10-19T12:13:35.937 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-thin-pool.ko 2023-10-19T12:13:35.937 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-verity.ko 2023-10-19T12:13:35.937 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/faulty.ko 2023-10-19T12:13:35.937 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/linear.ko 2023-10-19T12:13:35.937 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/multipath.ko 2023-10-19T12:13:35.937 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/persistent-data 2023-10-19T12:13:35.938 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-10-19T12:13:35.938 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid0.ko 2023-10-19T12:13:35.938 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid1.ko 2023-10-19T12:13:35.938 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid10.ko 2023-10-19T12:13:35.939 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid456.ko 2023-10-19T12:13:35.939 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message 2023-10-19T12:13:35.939 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion 2023-10-19T12:13:35.939 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptbase.ko 2023-10-19T12:13:35.939 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptctl.ko 2023-10-19T12:13:35.939 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptfc.ko 2023-10-19T12:13:35.940 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptlan.ko 2023-10-19T12:13:35.940 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptsas.ko 2023-10-19T12:13:35.940 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptscsih.ko 2023-10-19T12:13:35.940 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptspi.ko 2023-10-19T12:13:35.940 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd 2023-10-19T12:13:35.941 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/lpc_ich.ko 2023-10-19T12:13:35.941 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/lpc_sch.ko 2023-10-19T12:13:35.941 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/mfd-core.ko 2023-10-19T12:13:35.941 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/sm501.ko 2023-10-19T12:13:35.941 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/viperboard.ko 2023-10-19T12:13:35.942 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/vx855.ko 2023-10-19T12:13:35.942 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/wl1273-core.ko 2023-10-19T12:13:35.942 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc 2023-10-19T12:13:35.942 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/altera-stapl 2023-10-19T12:13:35.942 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-10-19T12:13:35.943 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/apds9802als.ko 2023-10-19T12:13:35.943 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/apds990x.ko 2023-10-19T12:13:35.943 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/bh1770glc.ko 2023-10-19T12:13:35.943 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/cb710 2023-10-19T12:13:35.943 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/cb710/cb710.ko 2023-10-19T12:13:35.943 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom 2023-10-19T12:13:35.944 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/at24.ko 2023-10-19T12:13:35.944 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/eeprom.ko 2023-10-19T12:13:35.944 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-10-19T12:13:35.944 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/max6875.ko 2023-10-19T12:13:35.944 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/enclosure.ko 2023-10-19T12:13:35.945 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/hpilo.ko 2023-10-19T12:13:35.945 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/isl29003.ko 2023-10-19T12:13:35.945 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/isl29020.ko 2023-10-19T12:13:35.945 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/lis3lv02d 2023-10-19T12:13:35.945 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-10-19T12:13:35.946 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-10-19T12:13:35.946 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei 2023-10-19T12:13:35.946 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/mei-me.ko 2023-10-19T12:13:35.946 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/mei-txe.ko 2023-10-19T12:13:35.946 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/mei.ko 2023-10-19T12:13:35.947 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-gru 2023-10-19T12:13:35.947 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-gru/gru.ko 2023-10-19T12:13:35.947 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-xp 2023-10-19T12:13:35.947 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-xp/xp.ko 2023-10-19T12:13:35.947 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-xp/xpc.ko 2023-10-19T12:13:35.948 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-10-19T12:13:35.948 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/tifm_7xx1.ko 2023-10-19T12:13:35.948 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/tifm_core.ko 2023-10-19T12:13:35.948 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/tsl2550.ko 2023-10-19T12:13:35.948 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/vmw_balloon.ko 2023-10-19T12:13:35.948 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/vmw_vmci 2023-10-19T12:13:35.949 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-10-19T12:13:35.949 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net 2023-10-19T12:13:35.949 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/bonding 2023-10-19T12:13:35.949 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/bonding/bonding.ko 2023-10-19T12:13:35.949 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa 2023-10-19T12:13:35.950 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/b53 2023-10-19T12:13:35.950 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/b53/b53_common.ko 2023-10-19T12:13:35.950 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/bcm-sf2.ko 2023-10-19T12:13:35.950 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/mv88e6060.ko 2023-10-19T12:13:35.950 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/mv88e6xxx 2023-10-19T12:13:35.951 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-10-19T12:13:35.951 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dummy.ko 2023-10-19T12:13:35.951 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/eql.ko 2023-10-19T12:13:35.951 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet 2023-10-19T12:13:35.951 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com 2023-10-19T12:13:35.952 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-10-19T12:13:35.952 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-10-19T12:13:35.952 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-10-19T12:13:35.952 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-10-19T12:13:35.952 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390 2023-10-19T12:13:35.952 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/8390.ko 2023-10-19T12:13:35.953 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-10-19T12:13:35.953 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-10-19T12:13:35.953 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-10-19T12:13:35.953 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/adaptec 2023-10-19T12:13:35.953 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-10-19T12:13:35.954 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/agere 2023-10-19T12:13:35.954 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/agere/et131x.ko 2023-10-19T12:13:35.954 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/alteon 2023-10-19T12:13:35.954 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-10-19T12:13:35.954 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/altera 2023-10-19T12:13:35.955 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-10-19T12:13:35.955 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd 2023-10-19T12:13:35.955 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-10-19T12:13:35.955 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-10-19T12:13:35.955 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-10-19T12:13:35.956 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros 2023-10-19T12:13:35.956 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/alx 2023-10-19T12:13:35.956 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-10-19T12:13:35.956 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1c 2023-10-19T12:13:35.956 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-10-19T12:13:35.957 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1e 2023-10-19T12:13:35.957 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-10-19T12:13:35.957 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atlx 2023-10-19T12:13:35.957 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-10-19T12:13:35.957 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-10-19T12:13:35.957 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom 2023-10-19T12:13:35.958 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-10-19T12:13:35.958 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-10-19T12:13:35.958 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-10-19T12:13:35.958 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-10-19T12:13:35.959 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-10-19T12:13:35.959 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/genet 2023-10-19T12:13:35.959 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-10-19T12:13:35.959 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-10-19T12:13:35.959 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/brocade 2023-10-19T12:13:35.959 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/brocade/bna 2023-10-19T12:13:35.960 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-10-19T12:13:35.960 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio 2023-10-19T12:13:35.960 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb 2023-10-19T12:13:35.960 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-10-19T12:13:35.960 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-10-19T12:13:35.961 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-10-19T12:13:35.961 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-10-19T12:13:35.961 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-10-19T12:13:35.961 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-10-19T12:13:35.961 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-10-19T12:13:35.962 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-10-19T12:13:35.962 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-10-19T12:13:35.962 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/cisco 2023-10-19T12:13:35.962 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/cisco/enic 2023-10-19T12:13:35.962 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-10-19T12:13:35.963 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec 2023-10-19T12:13:35.963 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip 2023-10-19T12:13:35.963 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-10-19T12:13:35.963 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-10-19T12:13:35.963 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-10-19T12:13:35.964 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-10-19T12:13:35.964 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-10-19T12:13:35.964 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-10-19T12:13:35.964 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dlink 2023-10-19T12:13:35.964 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-10-19T12:13:35.964 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-10-19T12:13:35.965 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dnet.ko 2023-10-19T12:13:35.965 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/emulex 2023-10-19T12:13:35.965 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/emulex/benet 2023-10-19T12:13:35.965 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-10-19T12:13:35.965 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ethoc.ko 2023-10-19T12:13:35.966 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/fealnx.ko 2023-10-19T12:13:35.966 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel 2023-10-19T12:13:35.966 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e100.ko 2023-10-19T12:13:35.966 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000 2023-10-19T12:13:35.966 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-10-19T12:13:35.967 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000e 2023-10-19T12:13:35.967 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-10-19T12:13:35.967 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/fm10k 2023-10-19T12:13:35.967 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-10-19T12:13:35.967 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/i40e 2023-10-19T12:13:35.968 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-10-19T12:13:35.968 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/iavf 2023-10-19T12:13:35.968 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-10-19T12:13:35.968 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igb 2023-10-19T12:13:35.968 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-10-19T12:13:35.968 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igbvf 2023-10-19T12:13:35.969 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-10-19T12:13:35.969 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbe 2023-10-19T12:13:35.969 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-10-19T12:13:35.969 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbevf 2023-10-19T12:13:35.969 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-10-19T12:13:35.970 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/jme.ko 2023-10-19T12:13:35.970 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell 2023-10-19T12:13:35.970 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-10-19T12:13:35.970 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/skge.ko 2023-10-19T12:13:35.970 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-10-19T12:13:35.971 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox 2023-10-19T12:13:35.971 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx4 2023-10-19T12:13:35.971 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-10-19T12:13:35.971 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-10-19T12:13:35.971 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx5 2023-10-19T12:13:35.972 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-10-19T12:13:35.972 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-10-19T12:13:35.972 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/micrel 2023-10-19T12:13:35.972 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-10-19T12:13:35.972 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/myricom 2023-10-19T12:13:35.973 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/myricom/myri10ge 2023-10-19T12:13:35.973 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-10-19T12:13:35.973 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/natsemi 2023-10-19T12:13:35.973 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-10-19T12:13:35.973 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-10-19T12:13:35.973 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/neterion 2023-10-19T12:13:35.974 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-10-19T12:13:35.974 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/nvidia 2023-10-19T12:13:35.974 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-10-19T12:13:35.974 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/packetengines 2023-10-19T12:13:35.974 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-10-19T12:13:35.975 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-10-19T12:13:35.975 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic 2023-10-19T12:13:35.975 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/netxen 2023-10-19T12:13:35.975 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-10-19T12:13:35.975 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-10-19T12:13:35.976 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-10-19T12:13:35.976 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-10-19T12:13:35.976 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rdc 2023-10-19T12:13:35.976 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-10-19T12:13:35.976 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek 2023-10-19T12:13:35.976 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-10-19T12:13:35.977 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-10-19T12:13:35.977 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/atp.ko 2023-10-19T12:13:35.977 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-10-19T12:13:35.977 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rocker 2023-10-19T12:13:35.977 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-10-19T12:13:35.978 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sfc 2023-10-19T12:13:35.978 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-10-19T12:13:35.978 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/silan 2023-10-19T12:13:35.978 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-10-19T12:13:35.978 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sis 2023-10-19T12:13:35.979 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sis/sis190.ko 2023-10-19T12:13:35.979 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sis/sis900.ko 2023-10-19T12:13:35.979 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc 2023-10-19T12:13:35.979 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-10-19T12:13:35.979 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-10-19T12:13:35.980 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-10-19T12:13:35.980 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-10-19T12:13:35.980 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro 2023-10-19T12:13:35.980 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac 2023-10-19T12:13:35.980 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-10-19T12:13:35.981 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-10-19T12:13:35.981 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun 2023-10-19T12:13:35.981 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/cassini.ko 2023-10-19T12:13:35.981 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/niu.ko 2023-10-19T12:13:35.981 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/sungem.ko 2023-10-19T12:13:35.982 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-10-19T12:13:35.982 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/tehuti 2023-10-19T12:13:35.982 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-10-19T12:13:35.982 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ti 2023-10-19T12:13:35.982 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ti/tlan.ko 2023-10-19T12:13:35.982 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/via 2023-10-19T12:13:35.983 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-10-19T12:13:35.983 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-10-19T12:13:35.983 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/wiznet 2023-10-19T12:13:35.983 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-10-19T12:13:35.983 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-10-19T12:13:35.984 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/xircom 2023-10-19T12:13:35.984 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-10-19T12:13:35.984 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/geneve.ko 2023-10-19T12:13:35.984 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/hyperv 2023-10-19T12:13:35.984 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-10-19T12:13:35.985 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ieee802154 2023-10-19T12:13:35.985 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ieee802154/fakelb.ko 2023-10-19T12:13:35.985 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ifb.ko 2023-10-19T12:13:35.985 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ipvlan 2023-10-19T12:13:35.985 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ipvlan/ipvlan.ko 2023-10-19T12:13:35.986 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/macvlan.ko 2023-10-19T12:13:35.986 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/macvtap.ko 2023-10-19T12:13:35.986 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio 2023-10-19T12:13:35.986 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio.ko 2023-10-19T12:13:35.986 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-10-19T12:13:35.987 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-10-19T12:13:35.987 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-regmap.ko 2023-10-19T12:13:35.987 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mii.ko 2023-10-19T12:13:35.987 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/net_failover.ko 2023-10-19T12:13:35.987 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/netconsole.ko 2023-10-19T12:13:35.987 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/nlmon.ko 2023-10-19T12:13:35.988 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/pcs 2023-10-19T12:13:35.988 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/pcs/pcs-lynx.ko 2023-10-19T12:13:35.988 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-10-19T12:13:35.988 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy 2023-10-19T12:13:35.988 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/amd.ko 2023-10-19T12:13:35.989 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-10-19T12:13:35.989 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-10-19T12:13:35.989 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm7xxx.ko 2023-10-19T12:13:35.989 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm87xx.ko 2023-10-19T12:13:35.989 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/broadcom.ko 2023-10-19T12:13:35.990 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/cicada.ko 2023-10-19T12:13:35.990 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/davicom.ko 2023-10-19T12:13:35.990 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/dp83640.ko 2023-10-19T12:13:35.990 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/et1011c.ko 2023-10-19T12:13:35.990 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/icplus.ko 2023-10-19T12:13:35.991 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/lxt.ko 2023-10-19T12:13:35.991 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/marvell.ko 2023-10-19T12:13:35.991 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/micrel.ko 2023-10-19T12:13:35.991 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/national.ko 2023-10-19T12:13:35.991 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/phylink.ko 2023-10-19T12:13:35.991 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/qsemi.ko 2023-10-19T12:13:35.992 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/realtek.ko 2023-10-19T12:13:35.992 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/smsc.ko 2023-10-19T12:13:35.992 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/ste10Xp.ko 2023-10-19T12:13:35.992 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/vitesse.ko 2023-10-19T12:13:35.992 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp 2023-10-19T12:13:35.993 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/bsd_comp.ko 2023-10-19T12:13:35.993 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_async.ko 2023-10-19T12:13:35.993 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_deflate.ko 2023-10-19T12:13:35.993 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_generic.ko 2023-10-19T12:13:35.994 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_mppe.ko 2023-10-19T12:13:35.994 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_synctty.ko 2023-10-19T12:13:35.994 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/pppoe.ko 2023-10-19T12:13:35.994 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/pppox.ko 2023-10-19T12:13:35.994 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/pptp.ko 2023-10-19T12:13:35.995 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/slip 2023-10-19T12:13:35.995 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/slip/slhc.ko 2023-10-19T12:13:35.995 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/slip/slip.ko 2023-10-19T12:13:35.995 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/sungem_phy.ko 2023-10-19T12:13:35.995 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/tap.ko 2023-10-19T12:13:35.995 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team 2023-10-19T12:13:35.996 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team.ko 2023-10-19T12:13:35.996 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_activebackup.ko 2023-10-19T12:13:35.996 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_broadcast.ko 2023-10-19T12:13:35.996 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-10-19T12:13:35.996 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_random.ko 2023-10-19T12:13:35.997 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-10-19T12:13:35.997 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/tun.ko 2023-10-19T12:13:35.997 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/veth.ko 2023-10-19T12:13:35.997 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/virtio_net.ko 2023-10-19T12:13:35.997 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vmxnet3 2023-10-19T12:13:35.998 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-10-19T12:13:35.998 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vxlan 2023-10-19T12:13:35.998 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vxlan/vxlan.ko 2023-10-19T12:13:35.998 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/xen-netback 2023-10-19T12:13:35.998 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/xen-netback/xen-netback.ko 2023-10-19T12:13:35.999 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/xen-netfront.ko 2023-10-19T12:13:35.999 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ntb 2023-10-19T12:13:35.999 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ntb/ntb.ko 2023-10-19T12:13:35.999 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme 2023-10-19T12:13:35.999 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/host 2023-10-19T12:13:35.999 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/host/nvme-core.ko 2023-10-19T12:13:36.000 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/host/nvme.ko 2023-10-19T12:13:36.000 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport 2023-10-19T12:13:36.000 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport.ko 2023-10-19T12:13:36.000 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport_cs.ko 2023-10-19T12:13:36.000 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport_pc.ko 2023-10-19T12:13:36.001 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport_serial.ko 2023-10-19T12:13:36.001 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci 2023-10-19T12:13:36.001 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/hotplug 2023-10-19T12:13:36.001 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-10-19T12:13:36.001 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/pcie 2023-10-19T12:13:36.002 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/pcie/aer_inject.ko 2023-10-19T12:13:36.002 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/xen-pcifront.ko 2023-10-19T12:13:36.002 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia 2023-10-19T12:13:36.002 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/i82092.ko 2023-10-19T12:13:36.002 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/pd6729.ko 2023-10-19T12:13:36.003 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/yenta_socket.ko 2023-10-19T12:13:36.003 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pinctrl 2023-10-19T12:13:36.003 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pinctrl/intel 2023-10-19T12:13:36.003 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-10-19T12:13:36.003 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform 2023-10-19T12:13:36.003 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86 2023-10-19T12:13:36.004 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/acer-wmi.ko 2023-10-19T12:13:36.004 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/acerhdf.ko 2023-10-19T12:13:36.004 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/apple-gmux.ko 2023-10-19T12:13:36.004 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/asus-laptop.ko 2023-10-19T12:13:36.004 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-10-19T12:13:36.005 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/asus-wmi.ko 2023-10-19T12:13:36.005 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/classmate-laptop.ko 2023-10-19T12:13:36.005 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-10-19T12:13:36.005 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-10-19T12:13:36.005 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-10-19T12:13:36.006 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-10-19T12:13:36.006 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/hdaps.ko 2023-10-19T12:13:36.006 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel 2023-10-19T12:13:36.006 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-10-19T12:13:36.006 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel_ips.ko 2023-10-19T12:13:36.006 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/msi-wmi.ko 2023-10-19T12:13:36.007 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/mxm-wmi.ko 2023-10-19T12:13:36.007 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-10-19T12:13:36.007 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/samsung-laptop.ko 2023-10-19T12:13:36.007 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/samsung-q10.ko 2023-10-19T12:13:36.007 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/topstar-laptop.ko 2023-10-19T12:13:36.008 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-10-19T12:13:36.008 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/toshiba_haps.ko 2023-10-19T12:13:36.008 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/wmi-bmof.ko 2023-10-19T12:13:36.008 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/wmi.ko 2023-10-19T12:13:36.008 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/powercap 2023-10-19T12:13:36.008 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/powercap/intel_rapl_common.ko 2023-10-19T12:13:36.009 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/powercap/intel_rapl_msr.ko 2023-10-19T12:13:36.009 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps 2023-10-19T12:13:36.009 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients 2023-10-19T12:13:36.009 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/pps-gpio.ko 2023-10-19T12:13:36.009 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/pps-ldisc.ko 2023-10-19T12:13:36.010 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/pps_parport.ko 2023-10-19T12:13:36.010 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/pps_core.ko 2023-10-19T12:13:36.010 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ptp 2023-10-19T12:13:36.010 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ptp/ptp.ko 2023-10-19T12:13:36.010 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ptp/ptp_kvm.ko 2023-10-19T12:13:36.011 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc 2023-10-19T12:13:36.011 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-bq32k.ko 2023-10-19T12:13:36.011 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1286.ko 2023-10-19T12:13:36.013 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1307.ko 2023-10-19T12:13:36.013 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1374.ko 2023-10-19T12:13:36.013 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1511.ko 2023-10-19T12:13:36.013 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1553.ko 2023-10-19T12:13:36.013 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1672.ko 2023-10-19T12:13:36.014 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1742.ko 2023-10-19T12:13:36.014 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds2404.ko 2023-10-19T12:13:36.014 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds3232.ko 2023-10-19T12:13:36.014 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-em3027.ko 2023-10-19T12:13:36.014 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-fm3130.ko 2023-10-19T12:13:36.015 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-isl12022.ko 2023-10-19T12:13:36.015 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-isl1208.ko 2023-10-19T12:13:36.015 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m41t80.ko 2023-10-19T12:13:36.015 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m48t35.ko 2023-10-19T12:13:36.015 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m48t59.ko 2023-10-19T12:13:36.015 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-max6900.ko 2023-10-19T12:13:36.016 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-msm6242.ko 2023-10-19T12:13:36.016 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf2127.ko 2023-10-19T12:13:36.016 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf85063.ko 2023-10-19T12:13:36.016 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf8523.ko 2023-10-19T12:13:36.016 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf8563.ko 2023-10-19T12:13:36.017 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf8583.ko 2023-10-19T12:13:36.017 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rp5c01.ko 2023-10-19T12:13:36.017 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rs5c372.ko 2023-10-19T12:13:36.017 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-10-19T12:13:36.017 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rx8025.ko 2023-10-19T12:13:36.018 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rx8581.ko 2023-10-19T12:13:36.018 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-10-19T12:13:36.018 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-x1205.ko 2023-10-19T12:13:36.018 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi 2023-10-19T12:13:36.018 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/3w-9xxx.ko 2023-10-19T12:13:36.018 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/3w-sas.ko 2023-10-19T12:13:36.019 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/3w-xxxx.ko 2023-10-19T12:13:36.019 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/BusLogic.ko 2023-10-19T12:13:36.019 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/a100u2w.ko 2023-10-19T12:13:36.019 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aacraid 2023-10-19T12:13:36.019 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aacraid/aacraid.ko 2023-10-19T12:13:36.020 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/advansys.ko 2023-10-19T12:13:36.020 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic7xxx 2023-10-19T12:13:36.020 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-10-19T12:13:36.020 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-10-19T12:13:36.020 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/am53c974.ko 2023-10-19T12:13:36.020 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/arcmsr 2023-10-19T12:13:36.021 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-10-19T12:13:36.021 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/atp870u.ko 2023-10-19T12:13:36.021 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/be2iscsi 2023-10-19T12:13:36.021 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-10-19T12:13:36.021 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bfa 2023-10-19T12:13:36.022 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bfa/bfa.ko 2023-10-19T12:13:36.022 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2fc 2023-10-19T12:13:36.022 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-10-19T12:13:36.022 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2i 2023-10-19T12:13:36.022 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-10-19T12:13:36.022 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ch.ko 2023-10-19T12:13:36.023 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/csiostor 2023-10-19T12:13:36.023 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/csiostor/csiostor.ko 2023-10-19T12:13:36.023 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi 2023-10-19T12:13:36.023 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb3i 2023-10-19T12:13:36.023 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-10-19T12:13:36.024 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb4i 2023-10-19T12:13:36.024 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-10-19T12:13:36.024 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-10-19T12:13:36.024 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/dc395x.ko 2023-10-19T12:13:36.024 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler 2023-10-19T12:13:36.024 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-10-19T12:13:36.025 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-10-19T12:13:36.025 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-10-19T12:13:36.025 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-10-19T12:13:36.025 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/dmx3191d.ko 2023-10-19T12:13:36.025 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/esas2r 2023-10-19T12:13:36.026 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/esas2r/esas2r.ko 2023-10-19T12:13:36.026 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/esp_scsi.ko 2023-10-19T12:13:36.026 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fcoe 2023-10-19T12:13:36.026 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fcoe/fcoe.ko 2023-10-19T12:13:36.026 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-10-19T12:13:36.027 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fnic 2023-10-19T12:13:36.027 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fnic/fnic.ko 2023-10-19T12:13:36.027 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/hpsa.ko 2023-10-19T12:13:36.027 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/hptiop.ko 2023-10-19T12:13:36.027 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/hv_storvsc.ko 2023-10-19T12:13:36.027 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/initio.ko 2023-10-19T12:13:36.028 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ipr.ko 2023-10-19T12:13:36.028 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ips.ko 2023-10-19T12:13:36.028 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/isci 2023-10-19T12:13:36.028 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/isci/isci.ko 2023-10-19T12:13:36.028 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-10-19T12:13:36.029 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/iscsi_tcp.ko 2023-10-19T12:13:36.029 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libfc 2023-10-19T12:13:36.029 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libfc/libfc.ko 2023-10-19T12:13:36.029 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libiscsi.ko 2023-10-19T12:13:36.029 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libiscsi_tcp.ko 2023-10-19T12:13:36.029 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libsas 2023-10-19T12:13:36.030 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libsas/libsas.ko 2023-10-19T12:13:36.030 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/lpfc 2023-10-19T12:13:36.030 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/lpfc/lpfc.ko 2023-10-19T12:13:36.030 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid 2023-10-19T12:13:36.030 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid.ko 2023-10-19T12:13:36.031 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-10-19T12:13:36.031 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-10-19T12:13:36.031 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-10-19T12:13:36.031 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mpt3sas 2023-10-19T12:13:36.031 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-10-19T12:13:36.032 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mvsas 2023-10-19T12:13:36.032 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mvsas/mvsas.ko 2023-10-19T12:13:36.032 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mvumi.ko 2023-10-19T12:13:36.032 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pm8001 2023-10-19T12:13:36.032 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-10-19T12:13:36.033 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pmcraid.ko 2023-10-19T12:13:36.033 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla1280.ko 2023-10-19T12:13:36.033 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla2xxx 2023-10-19T12:13:36.033 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-10-19T12:13:36.033 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-10-19T12:13:36.033 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla4xxx 2023-10-19T12:13:36.034 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-10-19T12:13:36.034 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/raid_class.ko 2023-10-19T12:13:36.034 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_debug.ko 2023-10-19T12:13:36.034 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_fc.ko 2023-10-19T12:13:36.034 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-10-19T12:13:36.035 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_sas.ko 2023-10-19T12:13:36.035 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_spi.ko 2023-10-19T12:13:36.035 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_srp.ko 2023-10-19T12:13:36.035 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ses.ko 2023-10-19T12:13:36.035 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/st.ko 2023-10-19T12:13:36.036 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/stex.ko 2023-10-19T12:13:36.036 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/sym53c8xx_2 2023-10-19T12:13:36.036 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-10-19T12:13:36.036 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/virtio_scsi.ko 2023-10-19T12:13:36.036 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/vmw_pvscsi.ko 2023-10-19T12:13:36.036 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/wd719x.ko 2023-10-19T12:13:36.037 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ssb 2023-10-19T12:13:36.037 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ssb/ssb.ko 2023-10-19T12:13:36.037 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target 2023-10-19T12:13:36.037 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/iscsi 2023-10-19T12:13:36.037 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-10-19T12:13:36.038 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/loopback 2023-10-19T12:13:36.038 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/loopback/tcm_loop.ko 2023-10-19T12:13:36.038 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_file.ko 2023-10-19T12:13:36.038 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_iblock.ko 2023-10-19T12:13:36.038 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_mod.ko 2023-10-19T12:13:36.038 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_pscsi.ko 2023-10-19T12:13:36.039 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_user.ko 2023-10-19T12:13:36.039 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/tcm_fc 2023-10-19T12:13:36.039 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-10-19T12:13:36.039 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal 2023-10-19T12:13:36.039 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel 2023-10-19T12:13:36.040 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal 2023-10-19T12:13:36.040 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-10-19T12:13:36.040 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-10-19T12:13:36.040 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-10-19T12:13:36.040 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-10-19T12:13:36.040 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-10-19T12:13:36.041 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-10-19T12:13:36.041 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-10-19T12:13:36.041 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-10-19T12:13:36.041 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-10-19T12:13:36.041 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-10-19T12:13:36.042 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-10-19T12:13:36.042 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-10-19T12:13:36.042 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-10-19T12:13:36.042 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-10-19T12:13:36.042 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-10-19T12:13:36.043 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty 2023-10-19T12:13:36.043 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/ipwireless 2023-10-19T12:13:36.043 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-10-19T12:13:36.043 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/n_gsm.ko 2023-10-19T12:13:36.043 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/n_hdlc.ko 2023-10-19T12:13:36.043 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/nozomi.ko 2023-10-19T12:13:36.044 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial 2023-10-19T12:13:36.044 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/8250 2023-10-19T12:13:36.044 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-10-19T12:13:36.044 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/arc_uart.ko 2023-10-19T12:13:36.044 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/jsm 2023-10-19T12:13:36.045 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/jsm/jsm.ko 2023-10-19T12:13:36.045 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs 2023-10-19T12:13:36.045 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/core 2023-10-19T12:13:36.045 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/core/ufshcd-core.ko 2023-10-19T12:13:36.045 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/host 2023-10-19T12:13:36.045 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-10-19T12:13:36.046 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio 2023-10-19T12:13:36.046 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio.ko 2023-10-19T12:13:36.046 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_aec.ko 2023-10-19T12:13:36.046 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_cif.ko 2023-10-19T12:13:36.046 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_pci_generic.ko 2023-10-19T12:13:36.047 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_sercos3.ko 2023-10-19T12:13:36.047 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb 2023-10-19T12:13:36.047 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class 2023-10-19T12:13:36.047 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/cdc-acm.ko 2023-10-19T12:13:36.047 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/cdc-wdm.ko 2023-10-19T12:13:36.048 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/usblp.ko 2023-10-19T12:13:36.048 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/usbtmc.ko 2023-10-19T12:13:36.048 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host 2023-10-19T12:13:36.048 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/sl811-hcd.ko 2023-10-19T12:13:36.048 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/image 2023-10-19T12:13:36.048 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/image/mdc800.ko 2023-10-19T12:13:36.049 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/image/microtek.ko 2023-10-19T12:13:36.049 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc 2023-10-19T12:13:36.049 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/adutux.ko 2023-10-19T12:13:36.049 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/appledisplay.ko 2023-10-19T12:13:36.049 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/emi26.ko 2023-10-19T12:13:36.050 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/emi62.ko 2023-10-19T12:13:36.050 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/ezusb.ko 2023-10-19T12:13:36.050 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/idmouse.ko 2023-10-19T12:13:36.051 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/iowarrior.ko 2023-10-19T12:13:36.051 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/isight_firmware.ko 2023-10-19T12:13:36.051 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/ldusb.ko 2023-10-19T12:13:36.051 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/legousbtower.ko 2023-10-19T12:13:36.051 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/sisusbvga 2023-10-19T12:13:36.051 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-10-19T12:13:36.052 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/trancevibrator.ko 2023-10-19T12:13:36.052 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usb3503.ko 2023-10-19T12:13:36.052 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usblcd.ko 2023-10-19T12:13:36.052 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usbsevseg.ko 2023-10-19T12:13:36.052 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/uss720.ko 2023-10-19T12:13:36.053 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/yurex.ko 2023-10-19T12:13:36.053 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/phy 2023-10-19T12:13:36.053 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/phy/phy-generic.ko 2023-10-19T12:13:36.053 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial 2023-10-19T12:13:36.053 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/aircable.ko 2023-10-19T12:13:36.053 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ark3116.ko 2023-10-19T12:13:36.054 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/belkin_sa.ko 2023-10-19T12:13:36.054 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ch341.ko 2023-10-19T12:13:36.054 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/cp210x.ko 2023-10-19T12:13:36.054 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/cyberjack.ko 2023-10-19T12:13:36.054 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/cypress_m8.ko 2023-10-19T12:13:36.055 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/digi_acceleport.ko 2023-10-19T12:13:36.055 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/empeg.ko 2023-10-19T12:13:36.055 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ftdi_sio.ko 2023-10-19T12:13:36.055 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/garmin_gps.ko 2023-10-19T12:13:36.055 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/io_edgeport.ko 2023-10-19T12:13:36.056 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/io_ti.ko 2023-10-19T12:13:36.056 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ipaq.ko 2023-10-19T12:13:36.056 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ipw.ko 2023-10-19T12:13:36.056 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ir-usb.ko 2023-10-19T12:13:36.056 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-10-19T12:13:36.056 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/keyspan.ko 2023-10-19T12:13:36.057 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/keyspan_pda.ko 2023-10-19T12:13:36.057 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/kl5kusb105.ko 2023-10-19T12:13:36.057 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/kobil_sct.ko 2023-10-19T12:13:36.057 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mct_u232.ko 2023-10-19T12:13:36.057 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mos7720.ko 2023-10-19T12:13:36.058 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mos7840.ko 2023-10-19T12:13:36.058 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/navman.ko 2023-10-19T12:13:36.058 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/omninet.ko 2023-10-19T12:13:36.058 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/opticon.ko 2023-10-19T12:13:36.058 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/option.ko 2023-10-19T12:13:36.059 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/oti6858.ko 2023-10-19T12:13:36.059 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/pl2303.ko 2023-10-19T12:13:36.059 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/qcaux.ko 2023-10-19T12:13:36.059 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/qcserial.ko 2023-10-19T12:13:36.059 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/quatech2.ko 2023-10-19T12:13:36.059 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/safe_serial.ko 2023-10-19T12:13:36.060 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/sierra.ko 2023-10-19T12:13:36.060 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/spcp8x5.ko 2023-10-19T12:13:36.060 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ssu100.ko 2023-10-19T12:13:36.060 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/symbolserial.ko 2023-10-19T12:13:36.060 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-10-19T12:13:36.061 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-10-19T12:13:36.061 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usb_debug.ko 2023-10-19T12:13:36.061 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usb_wwan.ko 2023-10-19T12:13:36.061 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/visor.ko 2023-10-19T12:13:36.061 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/whiteheat.ko 2023-10-19T12:13:36.062 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/xsens_mt.ko 2023-10-19T12:13:36.062 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage 2023-10-19T12:13:36.062 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/uas.ko 2023-10-19T12:13:36.062 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-alauda.ko 2023-10-19T12:13:36.062 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-cypress.ko 2023-10-19T12:13:36.062 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-datafab.ko 2023-10-19T12:13:36.063 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-10-19T12:13:36.063 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-freecom.ko 2023-10-19T12:13:36.063 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-isd200.ko 2023-10-19T12:13:36.063 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-10-19T12:13:36.063 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-karma.ko 2023-10-19T12:13:36.064 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-onetouch.ko 2023-10-19T12:13:36.064 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-realtek.ko 2023-10-19T12:13:36.064 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-sddr09.ko 2023-10-19T12:13:36.064 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-sddr55.ko 2023-10-19T12:13:36.064 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-usbat.ko 2023-10-19T12:13:36.065 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/usb-storage.ko 2023-10-19T12:13:36.065 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip 2023-10-19T12:13:36.065 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/usbip-core.ko 2023-10-19T12:13:36.065 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/usbip-host.ko 2023-10-19T12:13:36.065 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-10-19T12:13:36.065 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio 2023-10-19T12:13:36.066 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/pci 2023-10-19T12:13:36.066 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-10-19T12:13:36.066 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/pci/vfio-pci.ko 2023-10-19T12:13:36.066 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/vfio.ko 2023-10-19T12:13:36.066 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-10-19T12:13:36.067 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost 2023-10-19T12:13:36.067 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost.ko 2023-10-19T12:13:36.067 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost_iotlb.ko 2023-10-19T12:13:36.067 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost_net.ko 2023-10-19T12:13:36.067 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost_scsi.ko 2023-10-19T12:13:36.068 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video 2023-10-19T12:13:36.068 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight 2023-10-19T12:13:36.068 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/apple_bl.ko 2023-10-19T12:13:36.068 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/lcd.ko 2023-10-19T12:13:36.068 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/platform_lcd.ko 2023-10-19T12:13:36.069 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio 2023-10-19T12:13:36.069 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio.ko 2023-10-19T12:13:36.069 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_balloon.ko 2023-10-19T12:13:36.069 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_mmio.ko 2023-10-19T12:13:36.069 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_pci.ko 2023-10-19T12:13:36.070 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-10-19T12:13:36.070 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-10-19T12:13:36.070 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_ring.ko 2023-10-19T12:13:36.070 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1 2023-10-19T12:13:36.070 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters 2023-10-19T12:13:36.070 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters/ds2482.ko 2023-10-19T12:13:36.071 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters/ds2490.ko 2023-10-19T12:13:36.071 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves 2023-10-19T12:13:36.071 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-10-19T12:13:36.071 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-10-19T12:13:36.071 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-10-19T12:13:36.072 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-10-19T12:13:36.072 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-10-19T12:13:36.072 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-10-19T12:13:36.072 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-10-19T12:13:36.072 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-10-19T12:13:36.073 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-10-19T12:13:36.073 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_smem.ko 2023-10-19T12:13:36.073 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_therm.ko 2023-10-19T12:13:36.073 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/wire.ko 2023-10-19T12:13:36.073 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog 2023-10-19T12:13:36.073 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/alim1535_wdt.ko 2023-10-19T12:13:36.074 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/alim7101_wdt.ko 2023-10-19T12:13:36.074 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/f71808e_wdt.ko 2023-10-19T12:13:36.074 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/hpwdt.ko 2023-10-19T12:13:36.074 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/i6300esb.ko 2023-10-19T12:13:36.074 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-10-19T12:13:36.075 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/iTCO_wdt.ko 2023-10-19T12:13:36.075 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ib700wdt.ko 2023-10-19T12:13:36.075 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ibmasr.ko 2023-10-19T12:13:36.075 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-10-19T12:13:36.075 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/it8712f_wdt.ko 2023-10-19T12:13:36.075 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/it87_wdt.ko 2023-10-19T12:13:36.076 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/machzwd.ko 2023-10-19T12:13:36.076 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/nv_tco.ko 2023-10-19T12:13:36.076 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/pcwd_pci.ko 2023-10-19T12:13:36.076 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/pcwd_usb.ko 2023-10-19T12:13:36.076 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-10-19T12:13:36.077 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sch311x_wdt.ko 2023-10-19T12:13:36.077 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/softdog.ko 2023-10-19T12:13:36.077 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sp5100_tco.ko 2023-10-19T12:13:36.077 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/via_wdt.ko 2023-10-19T12:13:36.077 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-10-19T12:13:36.078 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/w83877f_wdt.ko 2023-10-19T12:13:36.078 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/w83977f_wdt.ko 2023-10-19T12:13:36.078 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/wdt_pci.ko 2023-10-19T12:13:36.078 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/xen_wdt.ko 2023-10-19T12:13:36.078 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen 2023-10-19T12:13:36.079 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-acpi-processor.ko 2023-10-19T12:13:36.079 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-evtchn.ko 2023-10-19T12:13:36.079 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-gntalloc.ko 2023-10-19T12:13:36.079 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-gntdev.ko 2023-10-19T12:13:36.079 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-pciback 2023-10-19T12:13:36.080 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-10-19T12:13:36.080 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-privcmd.ko 2023-10-19T12:13:36.080 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xenfs 2023-10-19T12:13:36.080 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xenfs/xenfs.ko 2023-10-19T12:13:36.080 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs 2023-10-19T12:13:36.080 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/9p 2023-10-19T12:13:36.081 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/9p/9p.ko 2023-10-19T12:13:36.081 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/affs 2023-10-19T12:13:36.081 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/affs/affs.ko 2023-10-19T12:13:36.081 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/befs 2023-10-19T12:13:36.081 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/befs/befs.ko 2023-10-19T12:13:36.082 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/binfmt_misc.ko 2023-10-19T12:13:36.082 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/btrfs 2023-10-19T12:13:36.082 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/btrfs/btrfs.ko 2023-10-19T12:13:36.082 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cachefiles 2023-10-19T12:13:36.082 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cachefiles/cachefiles.ko 2023-10-19T12:13:36.082 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ceph 2023-10-19T12:13:36.083 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ceph/ceph.ko 2023-10-19T12:13:36.083 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/coda 2023-10-19T12:13:36.083 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/coda/coda.ko 2023-10-19T12:13:36.083 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cramfs 2023-10-19T12:13:36.083 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cramfs/cramfs.ko 2023-10-19T12:13:36.084 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/dlm 2023-10-19T12:13:36.084 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/dlm/dlm.ko 2023-10-19T12:13:36.084 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ecryptfs 2023-10-19T12:13:36.084 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ecryptfs/ecryptfs.ko 2023-10-19T12:13:36.084 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/f2fs 2023-10-19T12:13:36.085 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/f2fs/f2fs.ko 2023-10-19T12:13:36.085 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat 2023-10-19T12:13:36.085 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat/fat.ko 2023-10-19T12:13:36.085 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat/msdos.ko 2023-10-19T12:13:36.085 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat/vfat.ko 2023-10-19T12:13:36.085 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fscache 2023-10-19T12:13:36.086 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fscache/fscache.ko 2023-10-19T12:13:36.086 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fuse 2023-10-19T12:13:36.086 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fuse/cuse.ko 2023-10-19T12:13:36.086 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fuse/fuse.ko 2023-10-19T12:13:36.086 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/gfs2 2023-10-19T12:13:36.087 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/gfs2/gfs2.ko 2023-10-19T12:13:36.087 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfs 2023-10-19T12:13:36.087 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfs/hfs.ko 2023-10-19T12:13:36.087 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfsplus 2023-10-19T12:13:36.087 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfsplus/hfsplus.ko 2023-10-19T12:13:36.088 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/isofs 2023-10-19T12:13:36.088 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/isofs/isofs.ko 2023-10-19T12:13:36.088 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/jfs 2023-10-19T12:13:36.088 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/jfs/jfs.ko 2023-10-19T12:13:36.088 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/lockd 2023-10-19T12:13:36.089 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/lockd/lockd.ko 2023-10-19T12:13:36.089 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/minix 2023-10-19T12:13:36.089 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/minix/minix.ko 2023-10-19T12:13:36.089 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/netfs 2023-10-19T12:13:36.089 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/netfs/netfs.ko 2023-10-19T12:13:36.089 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs 2023-10-19T12:13:36.090 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/blocklayout 2023-10-19T12:13:36.090 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-10-19T12:13:36.090 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/filelayout 2023-10-19T12:13:36.090 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-10-19T12:13:36.090 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/flexfilelayout 2023-10-19T12:13:36.091 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-10-19T12:13:36.091 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfs.ko 2023-10-19T12:13:36.091 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfsv3.ko 2023-10-19T12:13:36.091 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfsv4.ko 2023-10-19T12:13:36.091 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs_common 2023-10-19T12:13:36.091 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs_common/grace.ko 2023-10-19T12:13:36.092 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs_common/nfs_acl.ko 2023-10-19T12:13:36.092 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfsd 2023-10-19T12:13:36.092 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfsd/nfsd.ko 2023-10-19T12:13:36.092 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nilfs2 2023-10-19T12:13:36.092 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nilfs2/nilfs2.ko 2023-10-19T12:13:36.093 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls 2023-10-19T12:13:36.093 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-celtic.ko 2023-10-19T12:13:36.093 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-centeuro.ko 2023-10-19T12:13:36.093 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-croatian.ko 2023-10-19T12:13:36.093 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-cyrillic.ko 2023-10-19T12:13:36.094 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-gaelic.ko 2023-10-19T12:13:36.094 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-greek.ko 2023-10-19T12:13:36.094 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-iceland.ko 2023-10-19T12:13:36.094 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-inuit.ko 2023-10-19T12:13:36.094 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-roman.ko 2023-10-19T12:13:36.094 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-romanian.ko 2023-10-19T12:13:36.095 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-turkish.ko 2023-10-19T12:13:36.095 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp1250.ko 2023-10-19T12:13:36.095 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp1251.ko 2023-10-19T12:13:36.095 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp1255.ko 2023-10-19T12:13:36.095 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp737.ko 2023-10-19T12:13:36.096 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp775.ko 2023-10-19T12:13:36.096 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp850.ko 2023-10-19T12:13:36.096 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp852.ko 2023-10-19T12:13:36.096 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp855.ko 2023-10-19T12:13:36.096 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp857.ko 2023-10-19T12:13:36.097 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp860.ko 2023-10-19T12:13:36.097 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp861.ko 2023-10-19T12:13:36.097 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp862.ko 2023-10-19T12:13:36.097 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp863.ko 2023-10-19T12:13:36.097 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp864.ko 2023-10-19T12:13:36.097 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp865.ko 2023-10-19T12:13:36.098 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp866.ko 2023-10-19T12:13:36.098 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp869.ko 2023-10-19T12:13:36.098 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp874.ko 2023-10-19T12:13:36.098 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp932.ko 2023-10-19T12:13:36.098 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp936.ko 2023-10-19T12:13:36.099 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp949.ko 2023-10-19T12:13:36.099 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp950.ko 2023-10-19T12:13:36.099 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_euc-jp.ko 2023-10-19T12:13:36.099 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-1.ko 2023-10-19T12:13:36.099 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-13.ko 2023-10-19T12:13:36.100 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-14.ko 2023-10-19T12:13:36.100 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-15.ko 2023-10-19T12:13:36.100 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-2.ko 2023-10-19T12:13:36.100 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-3.ko 2023-10-19T12:13:36.100 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-4.ko 2023-10-19T12:13:36.101 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-5.ko 2023-10-19T12:13:36.101 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-6.ko 2023-10-19T12:13:36.101 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-7.ko 2023-10-19T12:13:36.101 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-9.ko 2023-10-19T12:13:36.101 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_koi8-r.ko 2023-10-19T12:13:36.101 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_koi8-ru.ko 2023-10-19T12:13:36.102 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_koi8-u.ko 2023-10-19T12:13:36.102 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_ucs2_utils.ko 2023-10-19T12:13:36.102 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_utf8.ko 2023-10-19T12:13:36.102 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2 2023-10-19T12:13:36.102 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/cluster 2023-10-19T12:13:36.103 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-10-19T12:13:36.103 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlm 2023-10-19T12:13:36.103 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-10-19T12:13:36.103 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlmfs 2023-10-19T12:13:36.103 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-10-19T12:13:36.104 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2.ko 2023-10-19T12:13:36.104 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-10-19T12:13:36.104 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-10-19T12:13:36.104 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-10-19T12:13:36.104 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/overlayfs 2023-10-19T12:13:36.104 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/overlayfs/overlay.ko 2023-10-19T12:13:36.105 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/pstore 2023-10-19T12:13:36.105 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/pstore/ramoops.ko 2023-10-19T12:13:36.105 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/reiserfs 2023-10-19T12:13:36.105 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/reiserfs/reiserfs.ko 2023-10-19T12:13:36.105 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/romfs 2023-10-19T12:13:36.106 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/romfs/romfs.ko 2023-10-19T12:13:36.106 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb 2023-10-19T12:13:36.106 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/client 2023-10-19T12:13:36.106 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/client/cifs.ko 2023-10-19T12:13:36.106 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/common 2023-10-19T12:13:36.107 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/common/cifs_arc4.ko 2023-10-19T12:13:36.107 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/common/cifs_md4.ko 2023-10-19T12:13:36.107 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/squashfs 2023-10-19T12:13:36.107 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/squashfs/squashfs.ko 2023-10-19T12:13:36.107 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/sysv 2023-10-19T12:13:36.107 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/sysv/sysv.ko 2023-10-19T12:13:36.108 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/udf 2023-10-19T12:13:36.108 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/udf/udf.ko 2023-10-19T12:13:36.108 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ufs 2023-10-19T12:13:36.108 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ufs/ufs.ko 2023-10-19T12:13:36.108 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/xfs 2023-10-19T12:13:36.109 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/xfs/xfs.ko 2023-10-19T12:13:36.109 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel 2023-10-19T12:13:36.109 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/rcu 2023-10-19T12:13:36.109 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/rcu/rcutorture.ko 2023-10-19T12:13:36.109 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/torture.ko 2023-10-19T12:13:36.110 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/trace 2023-10-19T12:13:36.110 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-10-19T12:13:36.110 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib 2023-10-19T12:13:36.110 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/asn1_encoder.ko 2023-10-19T12:13:36.110 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crc-itu-t.ko 2023-10-19T12:13:36.111 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crc8.ko 2023-10-19T12:13:36.111 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crypto 2023-10-19T12:13:36.111 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crypto/libarc4.ko 2023-10-19T12:13:36.111 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crypto/libdes.ko 2023-10-19T12:13:36.111 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/libcrc32c.ko 2023-10-19T12:13:36.112 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lru_cache.ko 2023-10-19T12:13:36.112 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lz4 2023-10-19T12:13:36.112 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lz4/lz4_compress.ko 2023-10-19T12:13:36.112 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lz4/lz4hc_compress.ko 2023-10-19T12:13:36.112 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/math 2023-10-19T12:13:36.113 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/math/cordic.ko 2023-10-19T12:13:36.113 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/raid6 2023-10-19T12:13:36.113 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/raid6/raid6_pq.ko 2023-10-19T12:13:36.113 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/reed_solomon 2023-10-19T12:13:36.113 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/reed_solomon/reed_solomon.ko 2023-10-19T12:13:36.114 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ts_bm.ko 2023-10-19T12:13:36.114 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ts_fsm.ko 2023-10-19T12:13:36.114 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ts_kmp.ko 2023-10-19T12:13:36.114 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/zstd 2023-10-19T12:13:36.114 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/zstd/zstd_compress.ko 2023-10-19T12:13:36.114 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/mm 2023-10-19T12:13:36.115 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/mm/hwpoison-inject.ko 2023-10-19T12:13:36.115 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net 2023-10-19T12:13:36.115 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan 2023-10-19T12:13:36.115 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/6lowpan.ko 2023-10-19T12:13:36.116 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_dest.ko 2023-10-19T12:13:36.116 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_fragment.ko 2023-10-19T12:13:36.116 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_hop.ko 2023-10-19T12:13:36.116 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_ipv6.ko 2023-10-19T12:13:36.116 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_mobility.ko 2023-10-19T12:13:36.117 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_routing.ko 2023-10-19T12:13:36.117 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_udp.ko 2023-10-19T12:13:36.117 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802 2023-10-19T12:13:36.117 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/garp.ko 2023-10-19T12:13:36.117 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/mrp.ko 2023-10-19T12:13:36.117 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/p8022.ko 2023-10-19T12:13:36.118 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/psnap.ko 2023-10-19T12:13:36.118 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/stp.ko 2023-10-19T12:13:36.118 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/8021q 2023-10-19T12:13:36.118 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/8021q/8021q.ko 2023-10-19T12:13:36.118 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p 2023-10-19T12:13:36.119 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet.ko 2023-10-19T12:13:36.119 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet_fd.ko 2023-10-19T12:13:36.119 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet_rdma.ko 2023-10-19T12:13:36.119 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet_virtio.ko 2023-10-19T12:13:36.119 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/batman-adv 2023-10-19T12:13:36.119 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/batman-adv/batman-adv.ko 2023-10-19T12:13:36.120 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge 2023-10-19T12:13:36.120 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/br_netfilter.ko 2023-10-19T12:13:36.120 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/bridge.ko 2023-10-19T12:13:36.120 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter 2023-10-19T12:13:36.120 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-10-19T12:13:36.121 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_among.ko 2023-10-19T12:13:36.121 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_arp.ko 2023-10-19T12:13:36.121 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-10-19T12:13:36.121 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-10-19T12:13:36.121 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_ip.ko 2023-10-19T12:13:36.121 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-10-19T12:13:36.122 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_limit.ko 2023-10-19T12:13:36.122 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_log.ko 2023-10-19T12:13:36.122 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_mark.ko 2023-10-19T12:13:36.122 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-10-19T12:13:36.122 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-10-19T12:13:36.123 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-10-19T12:13:36.123 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-10-19T12:13:36.123 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_snat.ko 2023-10-19T12:13:36.123 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_stp.ko 2023-10-19T12:13:36.123 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-10-19T12:13:36.124 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-10-19T12:13:36.124 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-10-19T12:13:36.124 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-10-19T12:13:36.124 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtables.ko 2023-10-19T12:13:36.124 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-10-19T12:13:36.124 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-10-19T12:13:36.125 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-10-19T12:13:36.125 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ceph 2023-10-19T12:13:36.125 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ceph/libceph.ko 2023-10-19T12:13:36.125 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/core 2023-10-19T12:13:36.125 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/core/failover.ko 2023-10-19T12:13:36.126 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/core/pktgen.ko 2023-10-19T12:13:36.126 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp 2023-10-19T12:13:36.126 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp.ko 2023-10-19T12:13:36.126 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp_diag.ko 2023-10-19T12:13:36.126 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp_ipv4.ko 2023-10-19T12:13:36.127 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp_ipv6.ko 2023-10-19T12:13:36.127 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dns_resolver 2023-10-19T12:13:36.127 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dns_resolver/dns_resolver.ko 2023-10-19T12:13:36.127 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa 2023-10-19T12:13:36.127 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/dsa_core.ko 2023-10-19T12:13:36.127 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_brcm.ko 2023-10-19T12:13:36.128 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_dsa.ko 2023-10-19T12:13:36.128 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_none.ko 2023-10-19T12:13:36.128 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_trailer.ko 2023-10-19T12:13:36.128 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154 2023-10-19T12:13:36.128 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/6lowpan 2023-10-19T12:13:36.129 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-10-19T12:13:36.129 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/ieee802154.ko 2023-10-19T12:13:36.129 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/ieee802154_socket.ko 2023-10-19T12:13:36.129 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4 2023-10-19T12:13:36.129 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ah4.ko 2023-10-19T12:13:36.129 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/esp4.ko 2023-10-19T12:13:36.130 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/fou.ko 2023-10-19T12:13:36.130 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/gre.ko 2023-10-19T12:13:36.130 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/inet_diag.ko 2023-10-19T12:13:36.130 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ip_gre.ko 2023-10-19T12:13:36.130 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ip_tunnel.ko 2023-10-19T12:13:36.131 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ip_vti.ko 2023-10-19T12:13:36.131 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ipcomp.ko 2023-10-19T12:13:36.131 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ipip.ko 2023-10-19T12:13:36.131 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter 2023-10-19T12:13:36.131 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/arp_tables.ko 2023-10-19T12:13:36.131 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-10-19T12:13:36.132 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-10-19T12:13:36.132 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-10-19T12:13:36.132 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-10-19T12:13:36.132 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-10-19T12:13:36.132 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-10-19T12:13:36.133 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-10-19T12:13:36.133 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-10-19T12:13:36.133 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-10-19T12:13:36.133 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_security.ko 2023-10-19T12:13:36.133 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-10-19T12:13:36.133 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-10-19T12:13:36.134 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-10-19T12:13:36.134 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-10-19T12:13:36.134 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-10-19T12:13:36.134 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-10-19T12:13:36.134 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-10-19T12:13:36.135 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-10-19T12:13:36.135 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-10-19T12:13:36.135 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-10-19T12:13:36.135 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_bic.ko 2023-10-19T12:13:36.135 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_dctcp.ko 2023-10-19T12:13:36.136 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_diag.ko 2023-10-19T12:13:36.136 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_highspeed.ko 2023-10-19T12:13:36.136 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_htcp.ko 2023-10-19T12:13:36.136 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_hybla.ko 2023-10-19T12:13:36.136 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_illinois.ko 2023-10-19T12:13:36.136 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_lp.ko 2023-10-19T12:13:36.137 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_scalable.ko 2023-10-19T12:13:36.137 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_vegas.ko 2023-10-19T12:13:36.137 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_veno.ko 2023-10-19T12:13:36.137 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_westwood.ko 2023-10-19T12:13:36.137 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_yeah.ko 2023-10-19T12:13:36.138 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tunnel4.ko 2023-10-19T12:13:36.138 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/udp_diag.ko 2023-10-19T12:13:36.138 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/udp_tunnel.ko 2023-10-19T12:13:36.138 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/xfrm4_tunnel.ko 2023-10-19T12:13:36.138 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6 2023-10-19T12:13:36.139 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ah6.ko 2023-10-19T12:13:36.139 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/esp6.ko 2023-10-19T12:13:36.139 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/fou6.ko 2023-10-19T12:13:36.139 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_tunnel.ko 2023-10-19T12:13:36.139 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-10-19T12:13:36.139 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_vti.ko 2023-10-19T12:13:36.140 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ipcomp6.ko 2023-10-19T12:13:36.140 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter 2023-10-19T12:13:36.140 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-10-19T12:13:36.140 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-10-19T12:13:36.140 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-10-19T12:13:36.141 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-10-19T12:13:36.141 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-10-19T12:13:36.141 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-10-19T12:13:36.141 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-10-19T12:13:36.141 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-10-19T12:13:36.141 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-10-19T12:13:36.142 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-10-19T12:13:36.142 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-10-19T12:13:36.142 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-10-19T12:13:36.142 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-10-19T12:13:36.142 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-10-19T12:13:36.143 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-10-19T12:13:36.143 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-10-19T12:13:36.143 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-10-19T12:13:36.143 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-10-19T12:13:36.143 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-10-19T12:13:36.143 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-10-19T12:13:36.144 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-10-19T12:13:36.144 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-10-19T12:13:36.144 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-10-19T12:13:36.144 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-10-19T12:13:36.144 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/sit.ko 2023-10-19T12:13:36.145 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/tunnel6.ko 2023-10-19T12:13:36.145 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/xfrm6_tunnel.ko 2023-10-19T12:13:36.145 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/key 2023-10-19T12:13:36.145 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/key/af_key.ko 2023-10-19T12:13:36.145 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp 2023-10-19T12:13:36.146 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_core.ko 2023-10-19T12:13:36.146 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_debugfs.ko 2023-10-19T12:13:36.146 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_eth.ko 2023-10-19T12:13:36.146 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_ip.ko 2023-10-19T12:13:36.146 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_ip6.ko 2023-10-19T12:13:36.147 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_netlink.ko 2023-10-19T12:13:36.147 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_ppp.ko 2023-10-19T12:13:36.147 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/llc 2023-10-19T12:13:36.147 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/llc/llc.ko 2023-10-19T12:13:36.147 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mac802154 2023-10-19T12:13:36.147 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mac802154/mac802154.ko 2023-10-19T12:13:36.148 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mpls 2023-10-19T12:13:36.148 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mpls/mpls_gso.ko 2023-10-19T12:13:36.148 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter 2023-10-19T12:13:36.148 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset 2023-10-19T12:13:36.148 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set.ko 2023-10-19T12:13:36.149 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-10-19T12:13:36.149 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-10-19T12:13:36.149 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-10-19T12:13:36.149 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-10-19T12:13:36.149 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-10-19T12:13:36.150 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-10-19T12:13:36.150 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-10-19T12:13:36.150 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-10-19T12:13:36.150 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-10-19T12:13:36.150 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-10-19T12:13:36.151 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-10-19T12:13:36.151 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-10-19T12:13:36.151 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-10-19T12:13:36.151 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-10-19T12:13:36.151 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-10-19T12:13:36.151 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs 2023-10-19T12:13:36.152 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs.ko 2023-10-19T12:13:36.152 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-10-19T12:13:36.152 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-10-19T12:13:36.152 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-10-19T12:13:36.152 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-10-19T12:13:36.153 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-10-19T12:13:36.153 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-10-19T12:13:36.153 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-10-19T12:13:36.153 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-10-19T12:13:36.153 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-10-19T12:13:36.153 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-10-19T12:13:36.154 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-10-19T12:13:36.154 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-10-19T12:13:36.154 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-10-19T12:13:36.154 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conncount.ko 2023-10-19T12:13:36.154 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack.ko 2023-10-19T12:13:36.155 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-10-19T12:13:36.155 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-10-19T12:13:36.155 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-10-19T12:13:36.155 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_h323.ko 2023-10-19T12:13:36.155 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_irc.ko 2023-10-19T12:13:36.156 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-10-19T12:13:36.156 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-10-19T12:13:36.156 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-10-19T12:13:36.156 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_sane.ko 2023-10-19T12:13:36.156 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_sip.ko 2023-10-19T12:13:36.157 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-10-19T12:13:36.157 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-10-19T12:13:36.157 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_dup_netdev.ko 2023-10-19T12:13:36.157 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_flow_table.ko 2023-10-19T12:13:36.157 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_flow_table_inet.ko 2023-10-19T12:13:36.157 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_log_syslog.ko 2023-10-19T12:13:36.158 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat.ko 2023-10-19T12:13:36.158 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_amanda.ko 2023-10-19T12:13:36.158 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_ftp.ko 2023-10-19T12:13:36.158 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_irc.ko 2023-10-19T12:13:36.158 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_sip.ko 2023-10-19T12:13:36.159 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_tftp.ko 2023-10-19T12:13:36.159 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_synproxy_core.ko 2023-10-19T12:13:36.159 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_tables.ko 2023-10-19T12:13:36.159 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink.ko 2023-10-19T12:13:36.159 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_acct.ko 2023-10-19T12:13:36.160 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_log.ko 2023-10-19T12:13:36.160 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_osf.ko 2023-10-19T12:13:36.160 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_queue.ko 2023-10-19T12:13:36.160 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_chain_nat.ko 2023-10-19T12:13:36.160 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_compat.ko 2023-10-19T12:13:36.160 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_ct.ko 2023-10-19T12:13:36.161 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_dup_netdev.ko 2023-10-19T12:13:36.161 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_fib.ko 2023-10-19T12:13:36.161 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_fwd_netdev.ko 2023-10-19T12:13:36.161 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_hash.ko 2023-10-19T12:13:36.161 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_limit.ko 2023-10-19T12:13:36.162 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_log.ko 2023-10-19T12:13:36.162 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_masq.ko 2023-10-19T12:13:36.162 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_nat.ko 2023-10-19T12:13:36.162 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_numgen.ko 2023-10-19T12:13:36.162 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_queue.ko 2023-10-19T12:13:36.163 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_quota.ko 2023-10-19T12:13:36.163 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_redir.ko 2023-10-19T12:13:36.163 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_reject.ko 2023-10-19T12:13:36.163 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_reject_inet.ko 2023-10-19T12:13:36.163 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_socket.ko 2023-10-19T12:13:36.164 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_tunnel.ko 2023-10-19T12:13:36.164 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_AUDIT.ko 2023-10-19T12:13:36.164 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CHECKSUM.ko 2023-10-19T12:13:36.164 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CLASSIFY.ko 2023-10-19T12:13:36.164 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-10-19T12:13:36.164 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CT.ko 2023-10-19T12:13:36.165 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_DSCP.ko 2023-10-19T12:13:36.165 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_HL.ko 2023-10-19T12:13:36.165 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_HMARK.ko 2023-10-19T12:13:36.165 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_IDLETIMER.ko 2023-10-19T12:13:36.165 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_LED.ko 2023-10-19T12:13:36.166 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_LOG.ko 2023-10-19T12:13:36.166 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_MASQUERADE.ko 2023-10-19T12:13:36.166 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_NETMAP.ko 2023-10-19T12:13:36.166 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_NFLOG.ko 2023-10-19T12:13:36.166 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_NFQUEUE.ko 2023-10-19T12:13:36.166 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_RATEEST.ko 2023-10-19T12:13:36.167 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_REDIRECT.ko 2023-10-19T12:13:36.167 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_SECMARK.ko 2023-10-19T12:13:36.167 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TCPMSS.ko 2023-10-19T12:13:36.167 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-10-19T12:13:36.167 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TEE.ko 2023-10-19T12:13:36.168 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TPROXY.ko 2023-10-19T12:13:36.168 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TRACE.ko 2023-10-19T12:13:36.168 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_addrtype.ko 2023-10-19T12:13:36.168 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_bpf.ko 2023-10-19T12:13:36.168 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_cgroup.ko 2023-10-19T12:13:36.169 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_cluster.ko 2023-10-19T12:13:36.169 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_comment.ko 2023-10-19T12:13:36.169 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connbytes.ko 2023-10-19T12:13:36.169 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connlabel.ko 2023-10-19T12:13:36.169 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connlimit.ko 2023-10-19T12:13:36.170 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connmark.ko 2023-10-19T12:13:36.170 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_conntrack.ko 2023-10-19T12:13:36.170 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_cpu.ko 2023-10-19T12:13:36.170 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_dccp.ko 2023-10-19T12:13:36.170 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_devgroup.ko 2023-10-19T12:13:36.171 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_dscp.ko 2023-10-19T12:13:36.171 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_ecn.ko 2023-10-19T12:13:36.171 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_esp.ko 2023-10-19T12:13:36.171 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_hashlimit.ko 2023-10-19T12:13:36.171 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_helper.ko 2023-10-19T12:13:36.171 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_hl.ko 2023-10-19T12:13:36.172 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_ipcomp.ko 2023-10-19T12:13:36.172 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_iprange.ko 2023-10-19T12:13:36.172 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_ipvs.ko 2023-10-19T12:13:36.172 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_l2tp.ko 2023-10-19T12:13:36.172 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_length.ko 2023-10-19T12:13:36.173 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_limit.ko 2023-10-19T12:13:36.173 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_mac.ko 2023-10-19T12:13:36.173 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_mark.ko 2023-10-19T12:13:36.173 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_multiport.ko 2023-10-19T12:13:36.173 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_nat.ko 2023-10-19T12:13:36.174 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_nfacct.ko 2023-10-19T12:13:36.174 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_osf.ko 2023-10-19T12:13:36.174 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_owner.ko 2023-10-19T12:13:36.174 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_physdev.ko 2023-10-19T12:13:36.174 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_pkttype.ko 2023-10-19T12:13:36.174 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_policy.ko 2023-10-19T12:13:36.175 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_quota.ko 2023-10-19T12:13:36.175 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_rateest.ko 2023-10-19T12:13:36.175 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_realm.ko 2023-10-19T12:13:36.175 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_recent.ko 2023-10-19T12:13:36.175 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_sctp.ko 2023-10-19T12:13:36.176 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_set.ko 2023-10-19T12:13:36.176 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_socket.ko 2023-10-19T12:13:36.176 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_state.ko 2023-10-19T12:13:36.176 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_statistic.ko 2023-10-19T12:13:36.176 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_string.ko 2023-10-19T12:13:36.176 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_tcpmss.ko 2023-10-19T12:13:36.177 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_time.ko 2023-10-19T12:13:36.177 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_u32.ko 2023-10-19T12:13:36.177 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netlink 2023-10-19T12:13:36.177 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netlink/netlink_diag.ko 2023-10-19T12:13:36.177 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/nsh 2023-10-19T12:13:36.178 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/nsh/nsh.ko 2023-10-19T12:13:36.178 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch 2023-10-19T12:13:36.178 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/openvswitch.ko 2023-10-19T12:13:36.178 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/vport-geneve.ko 2023-10-19T12:13:36.178 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/vport-gre.ko 2023-10-19T12:13:36.179 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/vport-vxlan.ko 2023-10-19T12:13:36.179 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/packet 2023-10-19T12:13:36.179 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/packet/af_packet_diag.ko 2023-10-19T12:13:36.179 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds 2023-10-19T12:13:36.179 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/rds.ko 2023-10-19T12:13:36.179 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/rds_rdma.ko 2023-10-19T12:13:36.180 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/rds_tcp.ko 2023-10-19T12:13:36.180 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched 2023-10-19T12:13:36.180 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_csum.ko 2023-10-19T12:13:36.180 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_gact.ko 2023-10-19T12:13:36.180 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_ipt.ko 2023-10-19T12:13:36.181 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_mirred.ko 2023-10-19T12:13:36.181 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_nat.ko 2023-10-19T12:13:36.181 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_pedit.ko 2023-10-19T12:13:36.181 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_police.ko 2023-10-19T12:13:36.181 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_simple.ko 2023-10-19T12:13:36.182 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_skbedit.ko 2023-10-19T12:13:36.182 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_vlan.ko 2023-10-19T12:13:36.182 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_basic.ko 2023-10-19T12:13:36.182 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_bpf.ko 2023-10-19T12:13:36.182 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_flow.ko 2023-10-19T12:13:36.182 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_fw.ko 2023-10-19T12:13:36.183 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_route.ko 2023-10-19T12:13:36.183 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_u32.ko 2023-10-19T12:13:36.183 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_cmp.ko 2023-10-19T12:13:36.183 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_ipset.ko 2023-10-19T12:13:36.183 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_meta.ko 2023-10-19T12:13:36.184 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_nbyte.ko 2023-10-19T12:13:36.184 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_text.ko 2023-10-19T12:13:36.184 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_u32.ko 2023-10-19T12:13:36.184 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_choke.ko 2023-10-19T12:13:36.184 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_codel.ko 2023-10-19T12:13:36.185 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_drr.ko 2023-10-19T12:13:36.185 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_fq.ko 2023-10-19T12:13:36.185 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_gred.ko 2023-10-19T12:13:36.185 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_hfsc.ko 2023-10-19T12:13:36.185 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_hhf.ko 2023-10-19T12:13:36.185 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_htb.ko 2023-10-19T12:13:36.186 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_ingress.ko 2023-10-19T12:13:36.186 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_mqprio.ko 2023-10-19T12:13:36.186 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_mqprio_lib.ko 2023-10-19T12:13:36.186 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_multiq.ko 2023-10-19T12:13:36.186 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_netem.ko 2023-10-19T12:13:36.187 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_pie.ko 2023-10-19T12:13:36.187 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_plug.ko 2023-10-19T12:13:36.187 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_prio.ko 2023-10-19T12:13:36.187 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_qfq.ko 2023-10-19T12:13:36.187 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_red.ko 2023-10-19T12:13:36.188 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_sfb.ko 2023-10-19T12:13:36.188 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_sfq.ko 2023-10-19T12:13:36.188 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_tbf.ko 2023-10-19T12:13:36.188 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_teql.ko 2023-10-19T12:13:36.188 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sctp 2023-10-19T12:13:36.189 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sctp/sctp.ko 2023-10-19T12:13:36.189 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sctp/sctp_diag.ko 2023-10-19T12:13:36.189 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc 2023-10-19T12:13:36.189 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/auth_gss 2023-10-19T12:13:36.189 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-10-19T12:13:36.189 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-10-19T12:13:36.190 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/sunrpc.ko 2023-10-19T12:13:36.190 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/xprtrdma 2023-10-19T12:13:36.190 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-10-19T12:13:36.190 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/tipc 2023-10-19T12:13:36.190 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/tipc/diag.ko 2023-10-19T12:13:36.191 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/tipc/tipc.ko 2023-10-19T12:13:36.191 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/unix 2023-10-19T12:13:36.191 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/unix/unix_diag.ko 2023-10-19T12:13:36.191 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock 2023-10-19T12:13:36.191 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-10-19T12:13:36.192 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-10-19T12:13:36.192 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vsock.ko 2023-10-19T12:13:36.192 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vsock_diag.ko 2023-10-19T12:13:36.192 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vsock_loopback.ko 2023-10-19T12:13:36.192 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/xfrm 2023-10-19T12:13:36.192 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/xfrm/xfrm_ipcomp.ko 2023-10-19T12:13:36.193 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security 2023-10-19T12:13:36.193 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys 2023-10-19T12:13:36.193 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys/encrypted-keys 2023-10-19T12:13:36.193 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-10-19T12:13:36.193 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys/trusted-keys 2023-10-19T12:13:36.194 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys/trusted-keys/trusted.ko 2023-10-19T12:13:36.194 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/virt 2023-10-19T12:13:36.194 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/virt/lib 2023-10-19T12:13:36.194 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/virt/lib/irqbypass.ko 2023-10-19T12:13:36.194 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.alias 2023-10-19T12:13:36.194 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.alias.bin 2023-10-19T12:13:36.195 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.builtin 2023-10-19T12:13:36.195 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.builtin.bin 2023-10-19T12:13:36.195 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.builtin.modinfo 2023-10-19T12:13:36.195 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.dep 2023-10-19T12:13:36.195 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.dep.bin 2023-10-19T12:13:36.196 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.devname 2023-10-19T12:13:36.196 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.order 2023-10-19T12:13:36.196 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.softdep 2023-10-19T12:13:36.196 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.symbols 2023-10-19T12:13:36.196 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.symbols.bin 2023-10-19T12:13:36.197 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-rc5-g47672119149b 2023-10-19T12:13:36.197 DEBUG:teuthology.orchestra.run.smithi046:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-10-19T12:13:36.226 INFO:teuthology.orchestra.run.smithi046.stdout:postinstall scriptlet (using /bin/sh): 2023-10-19T12:13:36.226 INFO:teuthology.orchestra.run.smithi046.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.6.0-rc5-g47672119149b -a -r /boot/System.map-6.6.0-rc5-g47672119149b ]; then 2023-10-19T12:13:36.226 INFO:teuthology.orchestra.run.smithi046.stdout:cp /boot/vmlinuz-6.6.0-rc5-g47672119149b /boot/.vmlinuz-6.6.0-rc5-g47672119149b-rpm 2023-10-19T12:13:36.226 INFO:teuthology.orchestra.run.smithi046.stdout:cp /boot/System.map-6.6.0-rc5-g47672119149b /boot/.System.map-6.6.0-rc5-g47672119149b-rpm 2023-10-19T12:13:36.227 INFO:teuthology.orchestra.run.smithi046.stdout:rm -f /boot/vmlinuz-6.6.0-rc5-g47672119149b /boot/System.map-6.6.0-rc5-g47672119149b 2023-10-19T12:13:36.227 INFO:teuthology.orchestra.run.smithi046.stdout:/sbin/installkernel 6.6.0-rc5-g47672119149b /boot/.vmlinuz-6.6.0-rc5-g47672119149b-rpm /boot/.System.map-6.6.0-rc5-g47672119149b-rpm 2023-10-19T12:13:36.227 INFO:teuthology.orchestra.run.smithi046.stdout:rm -f /boot/.vmlinuz-6.6.0-rc5-g47672119149b-rpm /boot/.System.map-6.6.0-rc5-g47672119149b-rpm 2023-10-19T12:13:36.227 INFO:teuthology.orchestra.run.smithi046.stdout:fi 2023-10-19T12:13:36.228 INFO:teuthology.orchestra.run.smithi046.stdout:preuninstall scriptlet (using /bin/sh): 2023-10-19T12:13:36.228 INFO:teuthology.orchestra.run.smithi046.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-10-19T12:13:36.228 INFO:teuthology.orchestra.run.smithi046.stdout:new-kernel-pkg --remove 6.6.0-rc5-g47672119149b --rminitrd --initrdfile=/boot/initramfs-6.6.0-rc5-g47672119149b.img 2023-10-19T12:13:36.228 INFO:teuthology.orchestra.run.smithi046.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-10-19T12:13:36.228 INFO:teuthology.orchestra.run.smithi046.stdout:kernel-install remove 6.6.0-rc5-g47672119149b 2023-10-19T12:13:36.228 INFO:teuthology.orchestra.run.smithi046.stdout:fi 2023-10-19T12:13:36.229 INFO:teuthology.orchestra.run.smithi046.stdout:postuninstall scriptlet (using /bin/sh): 2023-10-19T12:13:36.229 INFO:teuthology.orchestra.run.smithi046.stdout:if [ -x /sbin/update-bootloader ]; then 2023-10-19T12:13:36.229 INFO:teuthology.orchestra.run.smithi046.stdout:/sbin/update-bootloader --remove 6.6.0-rc5-g47672119149b 2023-10-19T12:13:36.229 INFO:teuthology.orchestra.run.smithi046.stdout:fi 2023-10-19T12:13:36.230 DEBUG:teuthology.orchestra.run.smithi046:> sudo rpm -qi grub2-tools 2023-10-19T12:13:36.310 INFO:teuthology.orchestra.run.smithi046.stdout:Name : grub2-tools 2023-10-19T12:13:36.310 INFO:teuthology.orchestra.run.smithi046.stdout:Epoch : 1 2023-10-19T12:13:36.310 INFO:teuthology.orchestra.run.smithi046.stdout:Version : 2.02 2023-10-19T12:13:36.311 INFO:teuthology.orchestra.run.smithi046.stdout:Release : 123.el8 2023-10-19T12:13:36.311 INFO:teuthology.orchestra.run.smithi046.stdout:Architecture: x86_64 2023-10-19T12:13:36.311 INFO:teuthology.orchestra.run.smithi046.stdout:Install Date: Thu 14 Jul 2022 06:22:19 PM UTC 2023-10-19T12:13:36.311 INFO:teuthology.orchestra.run.smithi046.stdout:Group : System Environment/Base 2023-10-19T12:13:36.311 INFO:teuthology.orchestra.run.smithi046.stdout:Size : 9265450 2023-10-19T12:13:36.312 INFO:teuthology.orchestra.run.smithi046.stdout:License : GPLv3+ 2023-10-19T12:13:36.312 INFO:teuthology.orchestra.run.smithi046.stdout:Signature : RSA/SHA256, Thu 31 Mar 2022 07:24:35 PM UTC, Key ID 199e2f91fd431d51 2023-10-19T12:13:36.312 INFO:teuthology.orchestra.run.smithi046.stdout:Source RPM : grub2-2.02-123.el8.src.rpm 2023-10-19T12:13:36.312 INFO:teuthology.orchestra.run.smithi046.stdout:Build Date : Mon 28 Mar 2022 02:12:09 PM UTC 2023-10-19T12:13:36.312 INFO:teuthology.orchestra.run.smithi046.stdout:Build Host : x86-vm-09.build.eng.bos.redhat.com 2023-10-19T12:13:36.313 INFO:teuthology.orchestra.run.smithi046.stdout:Relocations : (not relocatable) 2023-10-19T12:13:36.313 INFO:teuthology.orchestra.run.smithi046.stdout:Packager : Red Hat, Inc. 2023-10-19T12:13:36.313 INFO:teuthology.orchestra.run.smithi046.stdout:Vendor : Red Hat, Inc. 2023-10-19T12:13:36.313 INFO:teuthology.orchestra.run.smithi046.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-19T12:13:36.313 INFO:teuthology.orchestra.run.smithi046.stdout:Summary : Support tools for GRUB. 2023-10-19T12:13:36.313 INFO:teuthology.orchestra.run.smithi046.stdout:Description : 2023-10-19T12:13:36.314 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:13:36.314 INFO:teuthology.orchestra.run.smithi046.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-19T12:13:36.314 INFO:teuthology.orchestra.run.smithi046.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-19T12:13:36.314 INFO:teuthology.orchestra.run.smithi046.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-19T12:13:36.314 INFO:teuthology.orchestra.run.smithi046.stdout:hardware devices. 2023-10-19T12:13:36.315 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:13:36.315 INFO:teuthology.orchestra.run.smithi046.stdout:This subpackage provides tools for support of all platforms. 2023-10-19T12:13:36.316 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-19T12:13:36.316 INFO:teuthology.task.kernel:Updating grub on smithi046 to boot 6.6.0-rc5-g47672119149b 2023-10-19T12:13:36.316 DEBUG:teuthology.orchestra.run.smithi046:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-19T12:13:39.856 INFO:teuthology.orchestra.run.smithi046.stderr:Generating grub configuration file ... 2023-10-19T12:13:41.622 INFO:teuthology.orchestra.run.smithi046.stderr:done 2023-10-19T12:13:41.624 DEBUG:teuthology.orchestra.run.smithi046:> mktemp 2023-10-19T12:13:41.644 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/tmp.0Sx5flS1se 2023-10-19T12:13:41.644 DEBUG:teuthology.orchestra.run.smithi046:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.0Sx5flS1se 2023-10-19T12:13:41.715 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 0666 /tmp/tmp.0Sx5flS1se 2023-10-19T12:13:41.858 DEBUG:teuthology.orchestra.remote:smithi046:/tmp/tmp.0Sx5flS1se is 6KB 2023-10-19T12:13:41.907 DEBUG:teuthology.orchestra.run.smithi046:> rm -fr /tmp/tmp.0Sx5flS1se 2023-10-19T12:13:41.923 DEBUG:teuthology.orchestra.run.smithi046:> sudo /bin/ls /boot/loader/entries || true 2023-10-19T12:13:42.007 INFO:teuthology.orchestra.run.smithi046.stdout:5a84457b7b52416e95d47d02e2e4a60f-0-rescue.conf 2023-10-19T12:13:42.007 INFO:teuthology.orchestra.run.smithi046.stdout:5a84457b7b52416e95d47d02e2e4a60f-4.18.0-372.9.1.el8.x86_64.conf 2023-10-19T12:13:42.007 INFO:teuthology.orchestra.run.smithi046.stdout:5a84457b7b52416e95d47d02e2e4a60f-6.6.0-rc5-g47672119149b.conf 2023-10-19T12:13:42.008 DEBUG:teuthology.orchestra.run.smithi046:> sudo grub2-set-default 5a84457b7b52416e95d47d02e2e4a60f-6.6.0-rc5-g47672119149b 2023-10-19T12:13:42.122 DEBUG:teuthology.orchestra.run.smithi046:> sudo shutdown -r now 2023-10-19T12:14:12.125 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-10-19T12:14:12.126 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2023-10-19T12:14:12.128 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T12:14:30.522 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.46 2023-10-19T12:14:39.524 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2023-10-19T12:14:39.525 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T12:14:42.590 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.46 2023-10-19T12:14:54.591 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2023-10-19T12:14:54.592 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T12:15:13.018 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.46 2023-10-19T12:15:28.020 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2023-10-19T12:15:28.021 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T12:15:31.098 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.46 2023-10-19T12:15:49.099 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2023-10-19T12:15:49.101 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T12:15:49.474 DEBUG:teuthology.orchestra.run.smithi046:> true 2023-10-19T12:15:49.940 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi046.front.sepia.ceph.com' 2023-10-19T12:15:49.941 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.6.0-rc5-g47672119149b"... 2023-10-19T12:15:49.941 DEBUG:teuthology.orchestra.run.smithi046:> uname -r 2023-10-19T12:15:49.984 INFO:teuthology.orchestra.run.smithi046.stdout:6.6.0-rc5-g47672119149b 2023-10-19T12:15:49.985 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-rc5-g47672119149b vs 6.6.0-rc5-g47672119149b 2023-10-19T12:15:49.985 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-19T12:15:49.985 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-10-19T12:15:50.987 DEBUG:teuthology.parallel:result is None 2023-10-19T12:15:50.987 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-19T12:15:50.996 INFO:teuthology.task.internal:Creating test directory... 2023-10-19T12:15:50.996 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-19T12:15:51.001 DEBUG:teuthology.orchestra.run.smithi157:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-19T12:15:51.005 DEBUG:teuthology.orchestra.run.smithi195:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-19T12:15:51.045 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-19T12:15:51.052 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-19T12:15:51.064 INFO:teuthology.task.internal:Creating archive directory... 2023-10-19T12:15:51.065 DEBUG:teuthology.orchestra.run.smithi046:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-19T12:15:51.070 DEBUG:teuthology.orchestra.run.smithi157:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-19T12:15:51.072 DEBUG:teuthology.orchestra.run.smithi195:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-19T12:15:51.419 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-19T12:15:51.426 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-19T12:15:51.427 DEBUG:teuthology.orchestra.run.smithi157:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-19T12:15:51.446 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-19T12:15:51.447 DEBUG:teuthology.orchestra.run.smithi195:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-19T12:15:51.465 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-19T12:15:51.466 DEBUG:teuthology.orchestra.run.smithi046:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-19T12:15:51.474 DEBUG:teuthology.orchestra.run.smithi157:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-19T12:15:51.490 DEBUG:teuthology.orchestra.run.smithi195:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-19T12:15:51.529 INFO:teuthology.orchestra.run.smithi157.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-19T12:15:51.548 INFO:teuthology.orchestra.run.smithi157.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-19T12:15:51.574 INFO:teuthology.orchestra.run.smithi195.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-19T12:15:51.590 INFO:teuthology.orchestra.run.smithi195.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-19T12:15:51.617 INFO:teuthology.orchestra.run.smithi046.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-19T12:15:51.656 INFO:teuthology.orchestra.run.smithi046.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-19T12:15:51.660 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-19T12:15:51.667 INFO:teuthology.task.internal:Configuring sudo... 2023-10-19T12:15:51.668 DEBUG:teuthology.orchestra.run.smithi046:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-19T12:15:51.672 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-19T12:15:51.675 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-19T12:15:51.739 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-19T12:15:51.749 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-19T12:15:51.749 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-19T12:15:51.754 DEBUG:teuthology.orchestra.run.smithi157:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-19T12:15:51.757 DEBUG:teuthology.orchestra.run.smithi195:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-19T12:15:51.793 DEBUG:teuthology.orchestra.run.smithi046:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-19T12:15:51.907 DEBUG:teuthology.orchestra.run.smithi046:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-19T12:15:51.978 DEBUG:teuthology.orchestra.run.smithi046:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-19T12:15:52.052 DEBUG:teuthology.orchestra.run.smithi046:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-19T12:15:52.121 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-10-19T12:15:52.121 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-19T12:15:52.191 DEBUG:teuthology.orchestra.run.smithi157:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-19T12:15:52.237 DEBUG:teuthology.orchestra.run.smithi157:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-19T12:15:52.300 DEBUG:teuthology.orchestra.run.smithi157:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-19T12:15:52.346 DEBUG:teuthology.orchestra.run.smithi157:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-19T12:15:52.390 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-10-19T12:15:52.390 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-19T12:15:52.459 DEBUG:teuthology.orchestra.run.smithi195:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-19T12:15:52.505 DEBUG:teuthology.orchestra.run.smithi195:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-19T12:15:52.566 DEBUG:teuthology.orchestra.run.smithi195:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-19T12:15:52.613 DEBUG:teuthology.orchestra.run.smithi195:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-19T12:15:52.656 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2023-10-19T12:15:52.656 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-19T12:15:52.724 DEBUG:teuthology.orchestra.run.smithi046:> sudo service rsyslog restart 2023-10-19T12:15:52.729 DEBUG:teuthology.orchestra.run.smithi157:> sudo service rsyslog restart 2023-10-19T12:15:52.731 DEBUG:teuthology.orchestra.run.smithi195:> sudo service rsyslog restart 2023-10-19T12:15:52.793 INFO:teuthology.orchestra.run.smithi157.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-19T12:15:52.823 INFO:teuthology.orchestra.run.smithi195.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-19T12:15:52.846 INFO:teuthology.orchestra.run.smithi046.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-19T12:15:53.273 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-19T12:15:53.281 INFO:teuthology.task.internal:Starting timer... 2023-10-19T12:15:53.281 INFO:teuthology.run_tasks:Running task pcp... 2023-10-19T12:15:53.293 INFO:teuthology.run_tasks:Running task selinux... 2023-10-19T12:15:53.302 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-10-19T12:15:53.302 DEBUG:teuthology.orchestra.run.smithi046:> sudo service auditd rotate 2023-10-19T12:15:53.411 INFO:teuthology.orchestra.run.smithi046.stdout:Rotating logs: 2023-10-19T12:15:53.415 DEBUG:teuthology.orchestra.run.smithi157:> sudo service auditd rotate 2023-10-19T12:15:53.475 INFO:teuthology.orchestra.run.smithi157.stdout:Rotating logs: 2023-10-19T12:15:53.477 DEBUG:teuthology.orchestra.run.smithi195:> sudo service auditd rotate 2023-10-19T12:15:53.542 INFO:teuthology.orchestra.run.smithi195.stdout:Rotating logs: 2023-10-19T12:15:53.543 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-19T12:15:53.544 DEBUG:teuthology.orchestra.run.smithi046:> /usr/sbin/getenforce 2023-10-19T12:15:53.603 INFO:teuthology.orchestra.run.smithi046.stdout:Permissive 2023-10-19T12:15:53.603 DEBUG:teuthology.orchestra.run.smithi157:> /usr/sbin/getenforce 2023-10-19T12:15:53.631 INFO:teuthology.orchestra.run.smithi157.stdout:Permissive 2023-10-19T12:15:53.632 DEBUG:teuthology.orchestra.run.smithi195:> /usr/sbin/getenforce 2023-10-19T12:15:53.657 INFO:teuthology.orchestra.run.smithi195.stdout:Permissive 2023-10-19T12:15:53.657 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi046.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi157.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi195.front.sepia.ceph.com': 'permissive'} 2023-10-19T12:15:53.658 DEBUG:teuthology.orchestra.run.smithi046:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-19T12:15:53.733 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-19T12:15:53.735 DEBUG:teuthology.orchestra.run.smithi157:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-19T12:15:53.762 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-19T12:15:53.763 DEBUG:teuthology.orchestra.run.smithi195:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-19T12:15:53.789 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-19T12:15:53.790 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-19T12:15:53.791 DEBUG:teuthology.orchestra.run.smithi046:> sudo /usr/sbin/setenforce permissive 2023-10-19T12:15:53.874 DEBUG:teuthology.orchestra.run.smithi157:> sudo /usr/sbin/setenforce permissive 2023-10-19T12:15:53.901 DEBUG:teuthology.orchestra.run.smithi195:> sudo /usr/sbin/setenforce permissive 2023-10-19T12:15:53.928 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-19T12:15:53.938 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-10-19T12:15:53.939 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-19T12:15:53.957 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-19T12:15:53.959 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi046.front.sepia.ceph.com,smithi157.front.sepia.ceph.com,smithi195.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-19T12:29:39.724 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi046.front.sepia.ceph.com'), Remote(name='ubuntu@smithi157.front.sepia.ceph.com'), Remote(name='ubuntu@smithi195.front.sepia.ceph.com')] 2023-10-19T12:29:39.726 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2023-10-19T12:29:39.727 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T12:29:39.817 DEBUG:teuthology.orchestra.run.smithi046:> true 2023-10-19T12:29:39.933 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi046.front.sepia.ceph.com' 2023-10-19T12:29:39.934 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2023-10-19T12:29:39.935 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T12:29:40.003 DEBUG:teuthology.orchestra.run.smithi157:> true 2023-10-19T12:29:40.072 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi157.front.sepia.ceph.com' 2023-10-19T12:29:40.072 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2023-10-19T12:29:40.073 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T12:29:40.141 DEBUG:teuthology.orchestra.run.smithi195:> true 2023-10-19T12:29:40.211 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi195.front.sepia.ceph.com' 2023-10-19T12:29:40.212 INFO:teuthology.run_tasks:Running task clock... 2023-10-19T12:29:40.223 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-19T12:29:40.223 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-19T12:29:40.224 DEBUG:teuthology.orchestra.run.smithi046:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-19T12:29:40.229 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-19T12:29:40.229 DEBUG:teuthology.orchestra.run.smithi157:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-19T12:29:40.231 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-19T12:29:40.232 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-19T12:29:40.264 INFO:teuthology.orchestra.run.smithi157.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-19T12:29:40.279 INFO:teuthology.orchestra.run.smithi157.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-19T12:29:40.284 INFO:teuthology.orchestra.run.smithi195.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-19T12:29:40.299 INFO:teuthology.orchestra.run.smithi195.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-19T12:29:40.300 INFO:teuthology.orchestra.run.smithi046.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-19T12:29:40.335 INFO:teuthology.orchestra.run.smithi046.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-19T12:29:40.347 INFO:teuthology.orchestra.run.smithi157.stderr:sudo: ntpd: command not found 2023-10-19T12:29:40.359 INFO:teuthology.orchestra.run.smithi157.stdout:506 Cannot talk to daemon 2023-10-19T12:29:40.365 INFO:teuthology.orchestra.run.smithi195.stderr:sudo: ntpd: command not found 2023-10-19T12:29:40.374 INFO:teuthology.orchestra.run.smithi157.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-19T12:29:40.377 INFO:teuthology.orchestra.run.smithi195.stdout:506 Cannot talk to daemon 2023-10-19T12:29:40.388 INFO:teuthology.orchestra.run.smithi157.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-19T12:29:40.391 INFO:teuthology.orchestra.run.smithi195.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-19T12:29:40.406 INFO:teuthology.orchestra.run.smithi195.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-19T12:29:40.432 INFO:teuthology.orchestra.run.smithi046.stderr:sudo: ntpd: command not found 2023-10-19T12:29:40.462 INFO:teuthology.orchestra.run.smithi046.stdout:506 Cannot talk to daemon 2023-10-19T12:29:40.468 INFO:teuthology.orchestra.run.smithi157.stderr:bash: ntpq: command not found 2023-10-19T12:29:40.472 INFO:teuthology.orchestra.run.smithi157.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-19T12:29:40.472 INFO:teuthology.orchestra.run.smithi157.stdout:=============================================================================== 2023-10-19T12:29:40.473 INFO:teuthology.orchestra.run.smithi157.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-19T12:29:40.473 INFO:teuthology.orchestra.run.smithi157.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-19T12:29:40.473 INFO:teuthology.orchestra.run.smithi157.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-19T12:29:40.473 INFO:teuthology.orchestra.run.smithi157.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-19T12:29:40.495 INFO:teuthology.orchestra.run.smithi195.stderr:bash: ntpq: command not found 2023-10-19T12:29:40.498 INFO:teuthology.orchestra.run.smithi046.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-19T12:29:40.498 INFO:teuthology.orchestra.run.smithi195.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-19T12:29:40.499 INFO:teuthology.orchestra.run.smithi195.stdout:=============================================================================== 2023-10-19T12:29:40.499 INFO:teuthology.orchestra.run.smithi195.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-19T12:29:40.499 INFO:teuthology.orchestra.run.smithi195.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-19T12:29:40.499 INFO:teuthology.orchestra.run.smithi195.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-19T12:29:40.500 INFO:teuthology.orchestra.run.smithi195.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-19T12:29:40.533 INFO:teuthology.orchestra.run.smithi046.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-19T12:29:40.630 INFO:teuthology.orchestra.run.smithi046.stderr:bash: ntpq: command not found 2023-10-19T12:29:40.638 INFO:teuthology.orchestra.run.smithi046.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-19T12:29:40.638 INFO:teuthology.orchestra.run.smithi046.stdout:=============================================================================== 2023-10-19T12:29:40.639 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-19T12:29:40.639 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-19T12:29:40.639 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-19T12:29:40.639 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-19T12:29:40.641 INFO:teuthology.run_tasks:Running task pexec... 2023-10-19T12:29:40.650 INFO:teuthology.task.pexec:Executing custom commands... 2023-10-19T12:29:40.651 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi046.front.sepia.ceph.com 2023-10-19T12:29:40.651 DEBUG:teuthology.orchestra.run.smithi046:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-10-19T12:29:40.652 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi157.front.sepia.ceph.com 2023-10-19T12:29:40.652 DEBUG:teuthology.orchestra.run.smithi157:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-10-19T12:29:40.652 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi195.front.sepia.ceph.com 2023-10-19T12:29:40.653 DEBUG:teuthology.orchestra.run.smithi195:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-10-19T12:29:41.025 INFO:teuthology.orchestra.run.smithi195.stdout:Updating Subscription Management repositories. 2023-10-19T12:29:41.026 INFO:teuthology.orchestra.run.smithi157.stdout:Updating Subscription Management repositories. 2023-10-19T12:29:41.167 INFO:teuthology.orchestra.run.smithi046.stdout:Updating Subscription Management repositories. 2023-10-19T12:29:41.889 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:05:35 ago on Thu 19 Oct 2023 12:24:06 PM UTC. 2023-10-19T12:29:41.914 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:05:35 ago on Thu 19 Oct 2023 12:24:06 PM UTC. 2023-10-19T12:29:42.148 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:01:48 ago on Thu 19 Oct 2023 12:27:53 PM UTC. 2023-10-19T12:29:43.636 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2023-10-19T12:29:43.637 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2023-10-19T12:29:43.638 INFO:teuthology.orchestra.run.smithi157.stdout: Package Architecture Version Repository Size 2023-10-19T12:29:43.638 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2023-10-19T12:29:43.638 INFO:teuthology.orchestra.run.smithi157.stdout:Resetting modules: 2023-10-19T12:29:43.638 INFO:teuthology.orchestra.run.smithi157.stdout: container-tools 2023-10-19T12:29:43.638 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-19T12:29:43.639 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2023-10-19T12:29:43.639 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2023-10-19T12:29:43.639 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-19T12:29:43.764 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2023-10-19T12:29:43.765 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2023-10-19T12:29:43.766 INFO:teuthology.orchestra.run.smithi195.stdout: Package Architecture Version Repository Size 2023-10-19T12:29:43.766 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2023-10-19T12:29:43.766 INFO:teuthology.orchestra.run.smithi195.stdout:Resetting modules: 2023-10-19T12:29:43.766 INFO:teuthology.orchestra.run.smithi195.stdout: container-tools 2023-10-19T12:29:43.766 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-10-19T12:29:43.767 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2023-10-19T12:29:43.767 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2023-10-19T12:29:43.767 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-10-19T12:29:44.142 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2023-10-19T12:29:44.143 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2023-10-19T12:29:44.144 INFO:teuthology.orchestra.run.smithi046.stdout: Package Architecture Version Repository Size 2023-10-19T12:29:44.144 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2023-10-19T12:29:44.144 INFO:teuthology.orchestra.run.smithi046.stdout:Resetting modules: 2023-10-19T12:29:44.144 INFO:teuthology.orchestra.run.smithi046.stdout: container-tools 2023-10-19T12:29:44.144 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:29:44.144 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2023-10-19T12:29:44.145 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2023-10-19T12:29:44.145 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:29:44.616 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:05:38 ago on Thu 19 Oct 2023 12:24:06 PM UTC. 2023-10-19T12:29:44.725 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:05:38 ago on Thu 19 Oct 2023 12:24:06 PM UTC. 2023-10-19T12:29:45.426 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:01:51 ago on Thu 19 Oct 2023 12:27:53 PM UTC. 2023-10-19T12:29:47.168 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2023-10-19T12:29:47.309 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2023-10-19T12:29:47.644 INFO:teuthology.orchestra.run.smithi157.stdout:Updating Subscription Management repositories. 2023-10-19T12:29:47.777 INFO:teuthology.orchestra.run.smithi195.stdout:Updating Subscription Management repositories. 2023-10-19T12:29:47.938 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2023-10-19T12:29:48.464 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:05:42 ago on Thu 19 Oct 2023 12:24:06 PM UTC. 2023-10-19T12:29:48.559 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:05:42 ago on Thu 19 Oct 2023 12:24:06 PM UTC. 2023-10-19T12:29:48.560 INFO:teuthology.orchestra.run.smithi046.stdout:Updating Subscription Management repositories. 2023-10-19T12:29:49.533 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:01:55 ago on Thu 19 Oct 2023 12:27:53 PM UTC. 2023-10-19T12:29:50.195 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2023-10-19T12:29:50.289 INFO:teuthology.orchestra.run.smithi157.stdout:============================================================================================================ 2023-10-19T12:29:50.290 INFO:teuthology.orchestra.run.smithi157.stdout: Package Arch Version Repository Size 2023-10-19T12:29:50.290 INFO:teuthology.orchestra.run.smithi157.stdout:============================================================================================================ 2023-10-19T12:29:50.290 INFO:teuthology.orchestra.run.smithi157.stdout:Installing group/module packages: 2023-10-19T12:29:50.291 INFO:teuthology.orchestra.run.smithi157.stdout: buildah x86_64 1:1.26.2-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 8.0 M 2023-10-19T12:29:50.291 INFO:teuthology.orchestra.run.smithi157.stdout: cockpit-podman noarch 49.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 524 k 2023-10-19T12:29:50.291 INFO:teuthology.orchestra.run.smithi157.stdout: crun x86_64 1.5-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 213 k 2023-10-19T12:29:50.291 INFO:teuthology.orchestra.run.smithi157.stdout: python3-podman noarch 4.0.1-1.module+el8.6.0+16837+85b82211 rhel-8-for-x86_64-appstream-rpms 149 k 2023-10-19T12:29:50.291 INFO:teuthology.orchestra.run.smithi157.stdout: skopeo x86_64 2:1.9.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 7.0 M 2023-10-19T12:29:50.292 INFO:teuthology.orchestra.run.smithi157.stdout: toolbox x86_64 0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 2.2 M 2023-10-19T12:29:50.292 INFO:teuthology.orchestra.run.smithi157.stdout: udica noarch 0.2.6-4.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 49 k 2023-10-19T12:29:50.292 INFO:teuthology.orchestra.run.smithi157.stdout:Installing dependencies: 2023-10-19T12:29:50.292 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-10-19T12:29:50.292 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-10-19T12:29:50.292 INFO:teuthology.orchestra.run.smithi157.stdout: yajl x86_64 2.1.0-10.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-10-19T12:29:50.293 INFO:teuthology.orchestra.run.smithi157.stdout:Installing module profiles: 2023-10-19T12:29:50.293 INFO:teuthology.orchestra.run.smithi157.stdout: container-tools/common 2023-10-19T12:29:50.293 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-19T12:29:50.293 INFO:teuthology.orchestra.run.smithi157.stdout:Enabling module streams: 2023-10-19T12:29:50.293 INFO:teuthology.orchestra.run.smithi157.stdout: container-tools rhel8 2023-10-19T12:29:50.293 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-19T12:29:50.294 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2023-10-19T12:29:50.294 INFO:teuthology.orchestra.run.smithi157.stdout:============================================================================================================ 2023-10-19T12:29:50.294 INFO:teuthology.orchestra.run.smithi157.stdout:Install 10 Packages 2023-10-19T12:29:50.294 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-19T12:29:50.295 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 18 M 2023-10-19T12:29:50.295 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 65 M 2023-10-19T12:29:50.295 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2023-10-19T12:29:50.362 INFO:teuthology.orchestra.run.smithi157.stdout:(1/10): python3-pyxdg-0.25-16.el8.noarch.rpm 1.3 MB/s | 94 kB 00:00 2023-10-19T12:29:50.387 INFO:teuthology.orchestra.run.smithi157.stdout:(2/10): python3-pytoml-0.1.14-5.git7dea353.el8. 260 kB/s | 25 kB 00:00 2023-10-19T12:29:50.404 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2023-10-19T12:29:50.413 INFO:teuthology.orchestra.run.smithi157.stdout:(3/10): yajl-2.1.0-10.el8.x86_64.rpm 338 kB/s | 41 kB 00:00 2023-10-19T12:29:50.438 INFO:teuthology.orchestra.run.smithi157.stdout:(4/10): udica-0.2.6-4.module+el8.6.0+16771+28df 654 kB/s | 49 kB 00:00 2023-10-19T12:29:50.472 INFO:teuthology.orchestra.run.smithi157.stdout:(5/10): cockpit-podman-49.1-1.module+el8.6.0+16 6.1 MB/s | 524 kB 00:00 2023-10-19T12:29:50.497 INFO:teuthology.orchestra.run.smithi157.stdout:(6/10): python3-podman-4.0.1-1.module+el8.6.0+1 2.5 MB/s | 149 kB 00:00 2023-10-19T12:29:50.497 INFO:teuthology.orchestra.run.smithi195.stdout:============================================================================================================ 2023-10-19T12:29:50.497 INFO:teuthology.orchestra.run.smithi195.stdout: Package Arch Version Repository Size 2023-10-19T12:29:50.498 INFO:teuthology.orchestra.run.smithi195.stdout:============================================================================================================ 2023-10-19T12:29:50.498 INFO:teuthology.orchestra.run.smithi195.stdout:Installing group/module packages: 2023-10-19T12:29:50.498 INFO:teuthology.orchestra.run.smithi195.stdout: buildah x86_64 1:1.26.2-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 8.0 M 2023-10-19T12:29:50.498 INFO:teuthology.orchestra.run.smithi195.stdout: cockpit-podman noarch 49.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 524 k 2023-10-19T12:29:50.499 INFO:teuthology.orchestra.run.smithi195.stdout: crun x86_64 1.5-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 213 k 2023-10-19T12:29:50.499 INFO:teuthology.orchestra.run.smithi195.stdout: python3-podman noarch 4.0.1-1.module+el8.6.0+16837+85b82211 rhel-8-for-x86_64-appstream-rpms 149 k 2023-10-19T12:29:50.499 INFO:teuthology.orchestra.run.smithi195.stdout: skopeo x86_64 2:1.9.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 7.0 M 2023-10-19T12:29:50.499 INFO:teuthology.orchestra.run.smithi195.stdout: toolbox x86_64 0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 2.2 M 2023-10-19T12:29:50.499 INFO:teuthology.orchestra.run.smithi195.stdout: udica noarch 0.2.6-4.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 49 k 2023-10-19T12:29:50.500 INFO:teuthology.orchestra.run.smithi195.stdout:Installing dependencies: 2023-10-19T12:29:50.500 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-10-19T12:29:50.500 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-10-19T12:29:50.500 INFO:teuthology.orchestra.run.smithi195.stdout: yajl x86_64 2.1.0-10.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-10-19T12:29:50.500 INFO:teuthology.orchestra.run.smithi195.stdout:Installing module profiles: 2023-10-19T12:29:50.501 INFO:teuthology.orchestra.run.smithi195.stdout: container-tools/common 2023-10-19T12:29:50.501 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-10-19T12:29:50.501 INFO:teuthology.orchestra.run.smithi195.stdout:Enabling module streams: 2023-10-19T12:29:50.501 INFO:teuthology.orchestra.run.smithi195.stdout: container-tools rhel8 2023-10-19T12:29:50.502 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-10-19T12:29:50.502 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2023-10-19T12:29:50.502 INFO:teuthology.orchestra.run.smithi195.stdout:============================================================================================================ 2023-10-19T12:29:50.503 INFO:teuthology.orchestra.run.smithi195.stdout:Install 10 Packages 2023-10-19T12:29:50.503 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-10-19T12:29:50.504 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 18 M 2023-10-19T12:29:50.505 INFO:teuthology.orchestra.run.smithi195.stdout:Installed size: 65 M 2023-10-19T12:29:50.505 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2023-10-19T12:29:50.522 INFO:teuthology.orchestra.run.smithi157.stdout:(7/10): crun-1.5-1.module+el8.6.0+16771+28dfca7 4.1 MB/s | 213 kB 00:00 2023-10-19T12:29:50.580 INFO:teuthology.orchestra.run.smithi195.stdout:(1/10): yajl-2.1.0-10.el8.x86_64.rpm 512 kB/s | 41 kB 00:00 2023-10-19T12:29:50.597 INFO:teuthology.orchestra.run.smithi195.stdout:(2/10): python3-pytoml-0.1.14-5.git7dea353.el8. 257 kB/s | 25 kB 00:00 2023-10-19T12:29:50.614 INFO:teuthology.orchestra.run.smithi195.stdout:(3/10): udica-0.2.6-4.module+el8.6.0+16771+28df 1.4 MB/s | 49 kB 00:00 2023-10-19T12:29:50.639 INFO:teuthology.orchestra.run.smithi157.stdout:(8/10): toolbox-0.0.99.3-0.6.module+el8.6.0+167 19 MB/s | 2.2 MB 00:00 2023-10-19T12:29:50.640 INFO:teuthology.orchestra.run.smithi195.stdout:(4/10): python3-pyxdg-0.25-16.el8.noarch.rpm 675 kB/s | 94 kB 00:00 2023-10-19T12:29:50.672 INFO:teuthology.orchestra.run.smithi195.stdout:(5/10): cockpit-podman-49.1-1.module+el8.6.0+16 6.8 MB/s | 524 kB 00:00 2023-10-19T12:29:50.698 INFO:teuthology.orchestra.run.smithi195.stdout:(6/10): python3-podman-4.0.1-1.module+el8.6.0+1 2.5 MB/s | 149 kB 00:00 2023-10-19T12:29:50.723 INFO:teuthology.orchestra.run.smithi195.stdout:(7/10): crun-1.5-1.module+el8.6.0+16771+28dfca7 4.1 MB/s | 213 kB 00:00 2023-10-19T12:29:50.756 INFO:teuthology.orchestra.run.smithi157.stdout:(9/10): skopeo-1.9.1-1.module+el8.6.0+16771+28d 27 MB/s | 7.0 MB 00:00 2023-10-19T12:29:50.848 INFO:teuthology.orchestra.run.smithi157.stdout:(10/10): buildah-1.26.2-1.module+el8.6.0+16771+ 18 MB/s | 8.0 MB 00:00 2023-10-19T12:29:50.849 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2023-10-19T12:29:50.849 INFO:teuthology.orchestra.run.smithi157.stdout:Total 33 MB/s | 18 MB 00:00 2023-10-19T12:29:50.916 INFO:teuthology.orchestra.run.smithi195.stdout:(8/10): toolbox-0.0.99.3-0.6.module+el8.6.0+167 11 MB/s | 2.2 MB 00:00 2023-10-19T12:29:51.024 INFO:teuthology.orchestra.run.smithi195.stdout:(9/10): skopeo-1.9.1-1.module+el8.6.0+16771+28d 22 MB/s | 7.0 MB 00:00 2023-10-19T12:29:51.048 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2023-10-19T12:29:51.067 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2023-10-19T12:29:51.068 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2023-10-19T12:29:51.115 INFO:teuthology.orchestra.run.smithi195.stdout:(10/10): buildah-1.26.2-1.module+el8.6.0+16771+ 16 MB/s | 8.0 MB 00:00 2023-10-19T12:29:51.116 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2023-10-19T12:29:51.116 INFO:teuthology.orchestra.run.smithi195.stdout:Total 30 MB/s | 18 MB 00:00 2023-10-19T12:29:51.252 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2023-10-19T12:29:51.256 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2023-10-19T12:29:51.317 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2023-10-19T12:29:51.336 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2023-10-19T12:29:51.336 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2023-10-19T12:29:51.519 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2023-10-19T12:29:51.523 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2023-10-19T12:29:51.535 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2023-10-19T12:29:51.641 INFO:teuthology.orchestra.run.smithi046.stdout:============================================================================================================ 2023-10-19T12:29:51.642 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repository Size 2023-10-19T12:29:51.642 INFO:teuthology.orchestra.run.smithi046.stdout:============================================================================================================ 2023-10-19T12:29:51.642 INFO:teuthology.orchestra.run.smithi046.stdout:Installing group/module packages: 2023-10-19T12:29:51.643 INFO:teuthology.orchestra.run.smithi046.stdout: buildah x86_64 1:1.26.2-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 8.0 M 2023-10-19T12:29:51.643 INFO:teuthology.orchestra.run.smithi046.stdout: cockpit-podman noarch 49.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 524 k 2023-10-19T12:29:51.643 INFO:teuthology.orchestra.run.smithi046.stdout: crun x86_64 1.5-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 213 k 2023-10-19T12:29:51.643 INFO:teuthology.orchestra.run.smithi046.stdout: python3-podman noarch 4.0.1-1.module+el8.6.0+16837+85b82211 rhel-8-for-x86_64-appstream-rpms 149 k 2023-10-19T12:29:51.644 INFO:teuthology.orchestra.run.smithi046.stdout: skopeo x86_64 2:1.9.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 7.0 M 2023-10-19T12:29:51.644 INFO:teuthology.orchestra.run.smithi046.stdout: toolbox x86_64 0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 2.2 M 2023-10-19T12:29:51.644 INFO:teuthology.orchestra.run.smithi046.stdout: udica noarch 0.2.6-4.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 49 k 2023-10-19T12:29:51.644 INFO:teuthology.orchestra.run.smithi046.stdout:Installing dependencies: 2023-10-19T12:29:51.644 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-10-19T12:29:51.645 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-10-19T12:29:51.645 INFO:teuthology.orchestra.run.smithi046.stdout: yajl x86_64 2.1.0-10.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-10-19T12:29:51.645 INFO:teuthology.orchestra.run.smithi046.stdout:Installing module profiles: 2023-10-19T12:29:51.645 INFO:teuthology.orchestra.run.smithi046.stdout: container-tools/common 2023-10-19T12:29:51.646 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:29:51.646 INFO:teuthology.orchestra.run.smithi046.stdout:Enabling module streams: 2023-10-19T12:29:51.646 INFO:teuthology.orchestra.run.smithi046.stdout: container-tools rhel8 2023-10-19T12:29:51.646 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:29:51.647 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2023-10-19T12:29:51.647 INFO:teuthology.orchestra.run.smithi046.stdout:============================================================================================================ 2023-10-19T12:29:51.647 INFO:teuthology.orchestra.run.smithi046.stdout:Install 10 Packages 2023-10-19T12:29:51.647 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:29:51.648 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 18 M 2023-10-19T12:29:51.648 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 65 M 2023-10-19T12:29:51.648 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2023-10-19T12:29:51.720 INFO:teuthology.orchestra.run.smithi046.stdout:(1/10): python3-pyxdg-0.25-16.el8.noarch.rpm 1.2 MB/s | 94 kB 00:00 2023-10-19T12:29:51.745 INFO:teuthology.orchestra.run.smithi046.stdout:(2/10): python3-pytoml-0.1.14-5.git7dea353.el8. 247 kB/s | 25 kB 00:00 2023-10-19T12:29:51.771 INFO:teuthology.orchestra.run.smithi046.stdout:(3/10): yajl-2.1.0-10.el8.x86_64.rpm 325 kB/s | 41 kB 00:00 2023-10-19T12:29:51.786 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2023-10-19T12:29:51.819 INFO:teuthology.orchestra.run.smithi046.stdout:(4/10): udica-0.2.6-4.module+el8.6.0+16771+28df 502 kB/s | 49 kB 00:00 2023-10-19T12:29:51.863 INFO:teuthology.orchestra.run.smithi046.stdout:(5/10): cockpit-podman-49.1-1.module+el8.6.0+16 4.4 MB/s | 524 kB 00:00 2023-10-19T12:29:51.888 INFO:teuthology.orchestra.run.smithi046.stdout:(6/10): python3-podman-4.0.1-1.module+el8.6.0+1 2.1 MB/s | 149 kB 00:00 2023-10-19T12:29:51.914 INFO:teuthology.orchestra.run.smithi046.stdout:(7/10): crun-1.5-1.module+el8.6.0+16771+28dfca7 4.1 MB/s | 213 kB 00:00 2023-10-19T12:29:51.951 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/10 2023-10-19T12:29:52.022 INFO:teuthology.orchestra.run.smithi046.stdout:(8/10): toolbox-0.0.99.3-0.6.module+el8.6.0+167 20 MB/s | 2.2 MB 00:00 2023-10-19T12:29:52.064 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2023-10-19T12:29:52.119 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : yajl-2.1.0-10.el8.x86_64 2/10 2023-10-19T12:29:52.172 INFO:teuthology.orchestra.run.smithi046.stdout:(9/10): skopeo-1.9.1-1.module+el8.6.0+16771+28d 25 MB/s | 7.0 MB 00:00 2023-10-19T12:29:52.242 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/10 2023-10-19T12:29:52.264 INFO:teuthology.orchestra.run.smithi046.stdout:(10/10): buildah-1.26.2-1.module+el8.6.0+16771+ 16 MB/s | 8.0 MB 00:00 2023-10-19T12:29:52.265 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2023-10-19T12:29:52.265 INFO:teuthology.orchestra.run.smithi046.stdout:Total 29 MB/s | 18 MB 00:00 2023-10-19T12:29:52.314 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/10 2023-10-19T12:29:52.421 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : yajl-2.1.0-10.el8.x86_64 2/10 2023-10-19T12:29:52.514 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 4/10 2023-10-19T12:29:52.612 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2023-10-19T12:29:52.624 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/10 2023-10-19T12:29:52.636 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2023-10-19T12:29:52.637 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2023-10-19T12:29:52.831 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 4/10 2023-10-19T12:29:52.889 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 5/10 2023-10-19T12:29:53.163 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2023-10-19T12:29:53.168 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2023-10-19T12:29:53.192 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 5/10 2023-10-19T12:29:53.659 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 6/10 2023-10-19T12:29:53.731 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2023-10-19T12:29:53.945 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/10 2023-10-19T12:29:53.954 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 6/10 2023-10-19T12:29:54.128 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : yajl-2.1.0-10.el8.x86_64 2/10 2023-10-19T12:29:54.349 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/10 2023-10-19T12:29:54.559 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 4/10 2023-10-19T12:29:54.559 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 7/10 2023-10-19T12:29:54.792 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 8/10 2023-10-19T12:29:54.829 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 7/10 2023-10-19T12:29:54.977 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 9/10 2023-10-19T12:29:54.982 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 5/10 2023-10-19T12:29:55.043 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 8/10 2023-10-19T12:29:55.178 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-10-19T12:29:55.211 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 9/10 2023-10-19T12:29:55.380 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-10-19T12:29:55.428 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-10-19T12:29:55.429 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 1/10 2023-10-19T12:29:55.429 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 2/10 2023-10-19T12:29:55.429 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/10 2023-10-19T12:29:55.429 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 4/10 2023-10-19T12:29:55.429 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 5/10 2023-10-19T12:29:55.430 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 6/10 2023-10-19T12:29:55.430 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 7/10 2023-10-19T12:29:55.430 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 8/10 2023-10-19T12:29:55.430 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 9/10 2023-10-19T12:29:55.637 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-10-19T12:29:55.637 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 1/10 2023-10-19T12:29:55.637 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 2/10 2023-10-19T12:29:55.638 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/10 2023-10-19T12:29:55.638 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 4/10 2023-10-19T12:29:55.638 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 5/10 2023-10-19T12:29:55.638 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 6/10 2023-10-19T12:29:55.638 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 7/10 2023-10-19T12:29:55.639 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 8/10 2023-10-19T12:29:55.639 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 9/10 2023-10-19T12:29:55.833 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 6/10 2023-10-19T12:29:56.829 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 7/10 2023-10-19T12:29:56.841 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 10/10 2023-10-19T12:29:56.841 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:05:50 ago on Thu 19 Oct 2023 12:24:06 PM UTC. 2023-10-19T12:29:56.842 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 10/10 2023-10-19T12:29:56.842 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:05:50 ago on Thu 19 Oct 2023 12:24:06 PM UTC. 2023-10-19T12:29:57.071 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 8/10 2023-10-19T12:29:57.233 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 9/10 2023-10-19T12:29:57.406 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-10-19T12:29:57.803 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-10-19T12:29:57.803 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 1/10 2023-10-19T12:29:57.803 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 2/10 2023-10-19T12:29:57.803 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/10 2023-10-19T12:29:57.804 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 4/10 2023-10-19T12:29:57.804 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 5/10 2023-10-19T12:29:57.804 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 6/10 2023-10-19T12:29:57.804 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 7/10 2023-10-19T12:29:57.804 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 8/10 2023-10-19T12:29:57.805 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 9/10 2023-10-19T12:29:59.253 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 10/10 2023-10-19T12:29:59.253 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:02:05 ago on Thu 19 Oct 2023 12:27:53 PM UTC. 2023-10-19T12:30:00.124 INFO:teuthology.orchestra.run.smithi157.stdout:Installed products updated. 2023-10-19T12:30:00.164 INFO:teuthology.orchestra.run.smithi195.stdout:Installed products updated. 2023-10-19T12:30:00.331 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-19T12:30:00.332 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2023-10-19T12:30:00.332 INFO:teuthology.orchestra.run.smithi157.stdout: buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-19T12:30:00.332 INFO:teuthology.orchestra.run.smithi157.stdout: cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca77.noarch 2023-10-19T12:30:00.333 INFO:teuthology.orchestra.run.smithi157.stdout: crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-19T12:30:00.333 INFO:teuthology.orchestra.run.smithi157.stdout: python3-podman-4.0.1-1.module+el8.6.0+16837+85b82211.noarch 2023-10-19T12:30:00.333 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-10-19T12:30:00.334 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-10-19T12:30:00.334 INFO:teuthology.orchestra.run.smithi157.stdout: skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-19T12:30:00.334 INFO:teuthology.orchestra.run.smithi157.stdout: toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77.x86_64 2023-10-19T12:30:00.335 INFO:teuthology.orchestra.run.smithi157.stdout: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 2023-10-19T12:30:00.335 INFO:teuthology.orchestra.run.smithi157.stdout: yajl-2.1.0-10.el8.x86_64 2023-10-19T12:30:00.335 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-19T12:30:00.336 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2023-10-19T12:30:00.365 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-10-19T12:30:00.366 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2023-10-19T12:30:00.366 INFO:teuthology.orchestra.run.smithi195.stdout: buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-19T12:30:00.366 INFO:teuthology.orchestra.run.smithi195.stdout: cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca77.noarch 2023-10-19T12:30:00.366 INFO:teuthology.orchestra.run.smithi195.stdout: crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-19T12:30:00.366 INFO:teuthology.orchestra.run.smithi195.stdout: python3-podman-4.0.1-1.module+el8.6.0+16837+85b82211.noarch 2023-10-19T12:30:00.367 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-10-19T12:30:00.367 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-10-19T12:30:00.367 INFO:teuthology.orchestra.run.smithi195.stdout: skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-19T12:30:00.367 INFO:teuthology.orchestra.run.smithi195.stdout: toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77.x86_64 2023-10-19T12:30:00.367 INFO:teuthology.orchestra.run.smithi195.stdout: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 2023-10-19T12:30:00.368 INFO:teuthology.orchestra.run.smithi195.stdout: yajl-2.1.0-10.el8.x86_64 2023-10-19T12:30:00.368 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-10-19T12:30:00.368 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2023-10-19T12:30:00.525 DEBUG:teuthology.parallel:result is None 2023-10-19T12:30:00.605 DEBUG:teuthology.parallel:result is None 2023-10-19T12:30:02.132 INFO:teuthology.orchestra.run.smithi046.stdout:Installed products updated. 2023-10-19T12:30:02.352 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:30:02.352 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2023-10-19T12:30:02.352 INFO:teuthology.orchestra.run.smithi046.stdout: buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-19T12:30:02.353 INFO:teuthology.orchestra.run.smithi046.stdout: cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca77.noarch 2023-10-19T12:30:02.353 INFO:teuthology.orchestra.run.smithi046.stdout: crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-19T12:30:02.353 INFO:teuthology.orchestra.run.smithi046.stdout: python3-podman-4.0.1-1.module+el8.6.0+16837+85b82211.noarch 2023-10-19T12:30:02.353 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-10-19T12:30:02.353 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-10-19T12:30:02.354 INFO:teuthology.orchestra.run.smithi046.stdout: skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-19T12:30:02.354 INFO:teuthology.orchestra.run.smithi046.stdout: toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77.x86_64 2023-10-19T12:30:02.354 INFO:teuthology.orchestra.run.smithi046.stdout: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 2023-10-19T12:30:02.354 INFO:teuthology.orchestra.run.smithi046.stdout: yajl-2.1.0-10.el8.x86_64 2023-10-19T12:30:02.354 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:30:02.355 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2023-10-19T12:30:02.562 DEBUG:teuthology.parallel:result is None 2023-10-19T12:30:02.563 INFO:teuthology.run_tasks:Running task install... 2023-10-19T12:30:02.572 DEBUG:teuthology.task.install:project ceph 2023-10-19T12:30:02.572 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'f7420d7f8e55ceea786dcbf536c338ce920c21eb'}} 2023-10-19T12:30:02.573 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'f7420d7f8e55ceea786dcbf536c338ce920c21eb'} 2023-10-19T12:30:02.573 INFO:teuthology.task.install:Using flavor: default 2023-10-19T12:30:02.579 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-19T12:30:02.579 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-10-19T12:30:02.580 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'f7420d7f8e55ceea786dcbf536c338ce920c21eb', 'tag': None, 'wait_for_package': False} 2023-10-19T12:30:02.580 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=f7420d7f8e55ceea786dcbf536c338ce920c21eb 2023-10-19T12:30:02.582 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'f7420d7f8e55ceea786dcbf536c338ce920c21eb', 'tag': None, 'wait_for_package': False} 2023-10-19T12:30:02.583 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=f7420d7f8e55ceea786dcbf536c338ce920c21eb 2023-10-19T12:30:02.584 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'f7420d7f8e55ceea786dcbf536c338ce920c21eb', 'tag': None, 'wait_for_package': False} 2023-10-19T12:30:02.584 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=f7420d7f8e55ceea786dcbf536c338ce920c21eb 2023-10-19T12:30:02.738 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-batrick-testing-20231016.203825/f7420d7f8e55ceea786dcbf536c338ce920c21eb/centos/8/flavors/default/ 2023-10-19T12:30:02.738 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6786.gf7420d7f 2023-10-19T12:30:02.809 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-batrick-testing-20231016.203825/f7420d7f8e55ceea786dcbf536c338ce920c21eb/centos/8/flavors/default/ 2023-10-19T12:30:02.810 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6786.gf7420d7f 2023-10-19T12:30:02.815 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-batrick-testing-20231016.203825/f7420d7f8e55ceea786dcbf536c338ce920c21eb/centos/8/flavors/default/ 2023-10-19T12:30:02.816 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6786.gf7420d7f 2023-10-19T12:30:02.915 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-batrick-testing-20231016.203825/f7420d7f8e55ceea786dcbf536c338ce920c21eb/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-batrick-testing-20231016.203825/f7420d7f8e55ceea786dcbf536c338ce920c21eb/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-batrick-testing-20231016.203825/f7420d7f8e55ceea786dcbf536c338ce920c21eb/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-19T12:30:02.915 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-10-19T12:30:02.915 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-19T12:30:02.943 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-10-19T12:30:02.943 DEBUG:teuthology.orchestra.run.smithi157:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/f7420d7f8e55ceea786dcbf536c338ce920c21eb/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-19T12:30:02.990 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-batrick-testing-20231016.203825/f7420d7f8e55ceea786dcbf536c338ce920c21eb/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-batrick-testing-20231016.203825/f7420d7f8e55ceea786dcbf536c338ce920c21eb/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-batrick-testing-20231016.203825/f7420d7f8e55ceea786dcbf536c338ce920c21eb/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-19T12:30:02.990 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2023-10-19T12:30:02.991 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-19T12:30:02.993 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-batrick-testing-20231016.203825/f7420d7f8e55ceea786dcbf536c338ce920c21eb/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-batrick-testing-20231016.203825/f7420d7f8e55ceea786dcbf536c338ce920c21eb/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-batrick-testing-20231016.203825/f7420d7f8e55ceea786dcbf536c338ce920c21eb/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-19T12:30:02.993 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-10-19T12:30:02.993 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-19T12:30:03.011 DEBUG:teuthology.orchestra.run.smithi157:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-19T12:30:03.022 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-10-19T12:30:03.022 DEBUG:teuthology.orchestra.run.smithi195:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/f7420d7f8e55ceea786dcbf536c338ce920c21eb/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-19T12:30:03.065 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-10-19T12:30:03.065 DEBUG:teuthology.orchestra.run.smithi046:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/f7420d7f8e55ceea786dcbf536c338ce920c21eb/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-19T12:30:03.088 DEBUG:teuthology.orchestra.run.smithi157:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-19T12:30:03.089 DEBUG:teuthology.orchestra.run.smithi195:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-19T12:30:03.153 INFO:teuthology.orchestra.run.smithi157.stdout:check_obsoletes = 1 2023-10-19T12:30:03.155 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum clean all 2023-10-19T12:30:03.166 DEBUG:teuthology.orchestra.run.smithi195:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-19T12:30:03.177 DEBUG:teuthology.orchestra.run.smithi046:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-19T12:30:03.232 INFO:teuthology.orchestra.run.smithi195.stdout:check_obsoletes = 1 2023-10-19T12:30:03.234 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum clean all 2023-10-19T12:30:03.275 DEBUG:teuthology.orchestra.run.smithi046:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-19T12:30:03.345 INFO:teuthology.orchestra.run.smithi046.stdout:check_obsoletes = 1 2023-10-19T12:30:03.348 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum clean all 2023-10-19T12:30:03.558 INFO:teuthology.orchestra.run.smithi157.stdout:Updating Subscription Management repositories. 2023-10-19T12:30:03.628 INFO:teuthology.orchestra.run.smithi195.stdout:Updating Subscription Management repositories. 2023-10-19T12:30:03.835 INFO:teuthology.orchestra.run.smithi046.stdout:Updating Subscription Management repositories. 2023-10-19T12:30:04.006 INFO:teuthology.orchestra.run.smithi157.stdout:44 files removed 2023-10-19T12:30:04.062 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-10-19T12:30:04.131 INFO:teuthology.orchestra.run.smithi195.stdout:44 files removed 2023-10-19T12:30:04.186 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-10-19T12:30:04.259 INFO:teuthology.orchestra.run.smithi046.stdout:44 files removed 2023-10-19T12:30:04.315 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-10-19T12:30:04.467 INFO:teuthology.orchestra.run.smithi157.stdout:Updating Subscription Management repositories. 2023-10-19T12:30:04.537 INFO:teuthology.orchestra.run.smithi195.stdout:Updating Subscription Management repositories. 2023-10-19T12:30:04.793 INFO:teuthology.orchestra.run.smithi046.stdout:Updating Subscription Management repositories. 2023-10-19T12:30:05.239 INFO:teuthology.orchestra.run.smithi157.stdout:ceph packages for x86_64 232 kB/s | 81 kB 00:00 2023-10-19T12:30:05.299 INFO:teuthology.orchestra.run.smithi195.stdout:ceph packages for x86_64 225 kB/s | 81 kB 00:00 2023-10-19T12:30:05.556 INFO:teuthology.orchestra.run.smithi157.stdout:ceph noarch packages 33 kB/s | 9.4 kB 00:00 2023-10-19T12:30:05.608 INFO:teuthology.orchestra.run.smithi195.stdout:ceph noarch packages 35 kB/s | 9.4 kB 00:00 2023-10-19T12:30:05.743 INFO:teuthology.orchestra.run.smithi046.stdout:ceph packages for x86_64 188 kB/s | 81 kB 00:00 2023-10-19T12:30:05.849 INFO:teuthology.orchestra.run.smithi157.stdout:ceph source packages 5.5 kB/s | 1.5 kB 00:00 2023-10-19T12:30:05.893 INFO:teuthology.orchestra.run.smithi195.stdout:ceph source packages 5.7 kB/s | 1.5 kB 00:00 2023-10-19T12:30:06.000 INFO:teuthology.orchestra.run.smithi157.stdout:Copr repo for python3-asyncssh owned by ceph 27 kB/s | 3.5 kB 00:00 2023-10-19T12:30:06.043 INFO:teuthology.orchestra.run.smithi195.stdout:Copr repo for python3-asyncssh owned by ceph 27 kB/s | 3.5 kB 00:00 2023-10-19T12:30:06.110 INFO:teuthology.orchestra.run.smithi046.stdout:ceph noarch packages 29 kB/s | 9.4 kB 00:00 2023-10-19T12:30:06.503 INFO:teuthology.orchestra.run.smithi046.stdout:ceph source packages 4.1 kB/s | 1.5 kB 00:00 2023-10-19T12:30:06.679 INFO:teuthology.orchestra.run.smithi046.stdout:Copr repo for python3-asyncssh owned by ceph 23 kB/s | 3.5 kB 00:00 2023-10-19T12:30:06.725 INFO:teuthology.orchestra.run.smithi157.stdout:Extra Packages for Enterprise Linux 23 MB/s | 16 MB 00:00 2023-10-19T12:30:07.530 INFO:teuthology.orchestra.run.smithi195.stdout:Extra Packages for Enterprise Linux 11 MB/s | 16 MB 00:01 2023-10-19T12:30:07.696 INFO:teuthology.orchestra.run.smithi046.stdout:Extra Packages for Enterprise Linux 16 MB/s | 16 MB 00:00 2023-10-19T12:30:10.556 INFO:teuthology.orchestra.run.smithi157.stdout:lab-extras 417 kB/s | 24 kB 00:00 2023-10-19T12:30:11.254 INFO:teuthology.orchestra.run.smithi195.stdout:lab-extras 374 kB/s | 24 kB 00:00 2023-10-19T12:30:11.556 INFO:teuthology.orchestra.run.smithi157.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 51 MB/s | 47 MB 00:00 2023-10-19T12:30:12.130 INFO:teuthology.orchestra.run.smithi046.stdout:lab-extras 385 kB/s | 24 kB 00:00 2023-10-19T12:30:12.181 INFO:teuthology.orchestra.run.smithi195.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 62 MB/s | 53 MB 00:00 2023-10-19T12:30:13.190 INFO:teuthology.orchestra.run.smithi046.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 48 MB/s | 47 MB 00:00 2023-10-19T12:30:19.506 INFO:teuthology.orchestra.run.smithi157.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 58 MB/s | 53 MB 00:00 2023-10-19T12:30:20.282 INFO:teuthology.orchestra.run.smithi195.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 56 MB/s | 47 MB 00:00 2023-10-19T12:30:22.551 INFO:teuthology.orchestra.run.smithi046.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 48 MB/s | 53 MB 00:01 2023-10-19T12:30:30.599 INFO:teuthology.orchestra.run.smithi157.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-19T12:30:30.600 INFO:teuthology.orchestra.run.smithi157.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-19T12:30:30.614 INFO:teuthology.orchestra.run.smithi157.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-10-19T12:30:30.615 INFO:teuthology.orchestra.run.smithi157.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-10-19T12:30:30.616 INFO:teuthology.orchestra.run.smithi157.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-10-19T12:30:30.617 INFO:teuthology.orchestra.run.smithi157.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-19T12:30:30.619 INFO:teuthology.orchestra.run.smithi157.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-19T12:30:30.623 INFO:teuthology.orchestra.run.smithi157.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-10-19T12:30:30.623 INFO:teuthology.orchestra.run.smithi157.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-10-19T12:30:30.757 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2023-10-19T12:30:30.770 INFO:teuthology.orchestra.run.smithi157.stdout:=========================================================================================================================== 2023-10-19T12:30:30.770 INFO:teuthology.orchestra.run.smithi157.stdout: Package Arch Version Repository Size 2023-10-19T12:30:30.770 INFO:teuthology.orchestra.run.smithi157.stdout:=========================================================================================================================== 2023-10-19T12:30:30.771 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2023-10-19T12:30:30.771 INFO:teuthology.orchestra.run.smithi157.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-10-19T12:30:30.771 INFO:teuthology.orchestra.run.smithi157.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-19T12:30:30.772 INFO:teuthology.orchestra.run.smithi157.stdout: ceph x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 6.4 k 2023-10-19T12:30:30.772 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-base x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 5.4 M 2023-10-19T12:30:30.772 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-fuse x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 919 k 2023-10-19T12:30:30.773 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 167 k 2023-10-19T12:30:30.773 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 1.6 M 2023-10-19T12:30:30.773 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6786.gf7420d7f.el8 ceph-noarch 132 k 2023-10-19T12:30:30.774 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6786.gf7420d7f.el8 ceph-noarch 1.8 M 2023-10-19T12:30:30.774 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6786.gf7420d7f.el8 ceph-noarch 7.4 M 2023-10-19T12:30:30.774 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-rook noarch 2:18.0.0-6786.gf7420d7f.el8 ceph-noarch 47 k 2023-10-19T12:30:30.775 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-radosgw x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 14 M 2023-10-19T12:30:30.775 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-test x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 49 M 2023-10-19T12:30:30.775 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-volume noarch 2:18.0.0-6786.gf7420d7f.el8 ceph-noarch 261 k 2023-10-19T12:30:30.776 INFO:teuthology.orchestra.run.smithi157.stdout: cephadm noarch 2:18.0.0-6786.gf7420d7f.el8 ceph-noarch 192 k 2023-10-19T12:30:30.776 INFO:teuthology.orchestra.run.smithi157.stdout: cephfs-mirror x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 261 k 2023-10-19T12:30:30.776 INFO:teuthology.orchestra.run.smithi157.stdout: cephfs-top noarch 2:18.0.0-6786.gf7420d7f.el8 ceph-noarch 18 k 2023-10-19T12:30:30.776 INFO:teuthology.orchestra.run.smithi157.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-10-19T12:30:30.777 INFO:teuthology.orchestra.run.smithi157.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-19T12:30:30.777 INFO:teuthology.orchestra.run.smithi157.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-19T12:30:30.777 INFO:teuthology.orchestra.run.smithi157.stdout: libcephfs-devel x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 31 k 2023-10-19T12:30:30.777 INFO:teuthology.orchestra.run.smithi157.stdout: libcephfs2 x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 840 k 2023-10-19T12:30:30.777 INFO:teuthology.orchestra.run.smithi157.stdout: librados-devel x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 139 k 2023-10-19T12:30:30.778 INFO:teuthology.orchestra.run.smithi157.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-19T12:30:30.778 INFO:teuthology.orchestra.run.smithi157.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-10-19T12:30:30.778 INFO:teuthology.orchestra.run.smithi157.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-19T12:30:30.778 INFO:teuthology.orchestra.run.smithi157.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-10-19T12:30:30.778 INFO:teuthology.orchestra.run.smithi157.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-10-19T12:30:30.779 INFO:teuthology.orchestra.run.smithi157.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-10-19T12:30:30.779 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cephfs x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 196 k 2023-10-19T12:30:30.779 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rados x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 370 k 2023-10-19T12:30:30.779 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rbd x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 364 k 2023-10-19T12:30:30.780 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rgw x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 107 k 2023-10-19T12:30:30.780 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-fuse x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 94 k 2023-10-19T12:30:30.780 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-mirror x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 3.6 M 2023-10-19T12:30:30.781 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-nbd x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 178 k 2023-10-19T12:30:30.781 INFO:teuthology.orchestra.run.smithi157.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-10-19T12:30:30.782 INFO:teuthology.orchestra.run.smithi157.stdout:Upgrading: 2023-10-19T12:30:30.782 INFO:teuthology.orchestra.run.smithi157.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-10-19T12:30:30.782 INFO:teuthology.orchestra.run.smithi157.stdout: librados2 x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 3.7 M 2023-10-19T12:30:30.782 INFO:teuthology.orchestra.run.smithi157.stdout: librbd1 x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 3.7 M 2023-10-19T12:30:30.782 INFO:teuthology.orchestra.run.smithi157.stdout:Installing dependencies: 2023-10-19T12:30:30.783 INFO:teuthology.orchestra.run.smithi157.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-19T12:30:30.783 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-common x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 23 M 2023-10-19T12:30:30.783 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6786.gf7420d7f.el8 ceph-noarch 23 k 2023-10-19T12:30:30.784 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mds x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 2.3 M 2023-10-19T12:30:30.784 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6786.gf7420d7f.el8 ceph-noarch 242 k 2023-10-19T12:30:30.784 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mon x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 4.6 M 2023-10-19T12:30:30.785 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-osd x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 18 M 2023-10-19T12:30:30.785 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6786.gf7420d7f.el8 ceph-noarch 15 k 2023-10-19T12:30:30.785 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-selinux x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 24 k 2023-10-19T12:30:30.786 INFO:teuthology.orchestra.run.smithi157.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-19T12:30:30.786 INFO:teuthology.orchestra.run.smithi157.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-19T12:30:30.787 INFO:teuthology.orchestra.run.smithi157.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-10-19T12:30:30.787 INFO:teuthology.orchestra.run.smithi157.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-19T12:30:30.787 INFO:teuthology.orchestra.run.smithi157.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-10-19T12:30:30.788 INFO:teuthology.orchestra.run.smithi157.stdout: libcephsqlite x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 185 k 2023-10-19T12:30:30.788 INFO:teuthology.orchestra.run.smithi157.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-10-19T12:30:30.788 INFO:teuthology.orchestra.run.smithi157.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-10-19T12:30:30.788 INFO:teuthology.orchestra.run.smithi157.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-19T12:30:30.789 INFO:teuthology.orchestra.run.smithi157.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-10-19T12:30:30.789 INFO:teuthology.orchestra.run.smithi157.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-10-19T12:30:30.789 INFO:teuthology.orchestra.run.smithi157.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-19T12:30:30.789 INFO:teuthology.orchestra.run.smithi157.stdout: libradosstriper1 x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 518 k 2023-10-19T12:30:30.789 INFO:teuthology.orchestra.run.smithi157.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-10-19T12:30:30.790 INFO:teuthology.orchestra.run.smithi157.stdout: librgw2 x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 6.9 M 2023-10-19T12:30:30.790 INFO:teuthology.orchestra.run.smithi157.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-19T12:30:30.790 INFO:teuthology.orchestra.run.smithi157.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-10-19T12:30:30.790 INFO:teuthology.orchestra.run.smithi157.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-19T12:30:30.790 INFO:teuthology.orchestra.run.smithi157.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-19T12:30:30.791 INFO:teuthology.orchestra.run.smithi157.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-19T12:30:30.791 INFO:teuthology.orchestra.run.smithi157.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-19T12:30:30.791 INFO:teuthology.orchestra.run.smithi157.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-19T12:30:30.791 INFO:teuthology.orchestra.run.smithi157.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-10-19T12:30:30.791 INFO:teuthology.orchestra.run.smithi157.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-19T12:30:30.791 INFO:teuthology.orchestra.run.smithi157.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-19T12:30:30.792 INFO:teuthology.orchestra.run.smithi157.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-19T12:30:30.792 INFO:teuthology.orchestra.run.smithi157.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-19T12:30:30.792 INFO:teuthology.orchestra.run.smithi157.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-19T12:30:30.792 INFO:teuthology.orchestra.run.smithi157.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-19T12:30:30.792 INFO:teuthology.orchestra.run.smithi157.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-19T12:30:30.793 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-19T12:30:30.793 INFO:teuthology.orchestra.run.smithi157.stdout: python3-ceph-argparse x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 45 k 2023-10-19T12:30:30.793 INFO:teuthology.orchestra.run.smithi157.stdout: python3-ceph-common x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 125 k 2023-10-19T12:30:30.793 INFO:teuthology.orchestra.run.smithi157.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-19T12:30:30.793 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-10-19T12:30:30.793 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-19T12:30:30.794 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-19T12:30:30.794 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-19T12:30:30.794 INFO:teuthology.orchestra.run.smithi157.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-19T12:30:30.794 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-19T12:30:30.794 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-19T12:30:30.795 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-19T12:30:30.795 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-19T12:30:30.795 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-19T12:30:30.795 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-19T12:30:30.795 INFO:teuthology.orchestra.run.smithi157.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-19T12:30:30.795 INFO:teuthology.orchestra.run.smithi157.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-19T12:30:30.796 INFO:teuthology.orchestra.run.smithi157.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-19T12:30:30.796 INFO:teuthology.orchestra.run.smithi157.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-19T12:30:30.796 INFO:teuthology.orchestra.run.smithi157.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-19T12:30:30.796 INFO:teuthology.orchestra.run.smithi157.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-19T12:30:30.796 INFO:teuthology.orchestra.run.smithi157.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-19T12:30:30.796 INFO:teuthology.orchestra.run.smithi157.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-19T12:30:30.797 INFO:teuthology.orchestra.run.smithi157.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-19T12:30:30.797 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-19T12:30:30.797 INFO:teuthology.orchestra.run.smithi157.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-19T12:30:30.797 INFO:teuthology.orchestra.run.smithi157.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-19T12:30:30.797 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-10-19T12:30:30.798 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-19T12:30:30.798 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-19T12:30:30.798 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-10-19T12:30:30.798 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-19T12:30:30.798 INFO:teuthology.orchestra.run.smithi157.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-19T12:30:30.799 INFO:teuthology.orchestra.run.smithi157.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-19T12:30:30.799 INFO:teuthology.orchestra.run.smithi157.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-19T12:30:30.799 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-19T12:30:30.799 INFO:teuthology.orchestra.run.smithi157.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-10-19T12:30:30.799 INFO:teuthology.orchestra.run.smithi157.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-19T12:30:30.800 INFO:teuthology.orchestra.run.smithi157.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-19T12:30:30.800 INFO:teuthology.orchestra.run.smithi157.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-19T12:30:30.800 INFO:teuthology.orchestra.run.smithi157.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-19T12:30:30.800 INFO:teuthology.orchestra.run.smithi157.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-19T12:30:30.800 INFO:teuthology.orchestra.run.smithi157.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-19T12:30:30.800 INFO:teuthology.orchestra.run.smithi157.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-19T12:30:30.801 INFO:teuthology.orchestra.run.smithi157.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-19T12:30:30.801 INFO:teuthology.orchestra.run.smithi157.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-19T12:30:30.801 INFO:teuthology.orchestra.run.smithi157.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-19T12:30:30.801 INFO:teuthology.orchestra.run.smithi157.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-10-19T12:30:30.801 INFO:teuthology.orchestra.run.smithi157.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-19T12:30:30.801 INFO:teuthology.orchestra.run.smithi157.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-10-19T12:30:30.802 INFO:teuthology.orchestra.run.smithi157.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-19T12:30:30.802 INFO:teuthology.orchestra.run.smithi157.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-19T12:30:30.802 INFO:teuthology.orchestra.run.smithi157.stdout:Enabling module streams: 2023-10-19T12:30:30.802 INFO:teuthology.orchestra.run.smithi157.stdout: postgresql 10 2023-10-19T12:30:30.802 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-19T12:30:30.803 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2023-10-19T12:30:30.803 INFO:teuthology.orchestra.run.smithi157.stdout:=========================================================================================================================== 2023-10-19T12:30:30.803 INFO:teuthology.orchestra.run.smithi157.stdout:Install 128 Packages 2023-10-19T12:30:30.803 INFO:teuthology.orchestra.run.smithi157.stdout:Upgrade 3 Packages 2023-10-19T12:30:30.803 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-19T12:30:30.804 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 209 M 2023-10-19T12:30:30.804 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2023-10-19T12:30:30.999 INFO:teuthology.orchestra.run.smithi157.stdout:(1/131): ceph-18.0.0-6786.gf7420d7f.el8.x86_64. 44 kB/s | 6.4 kB 00:00 2023-10-19T12:30:31.164 INFO:teuthology.orchestra.run.smithi195.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-19T12:30:31.165 INFO:teuthology.orchestra.run.smithi195.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-19T12:30:31.180 INFO:teuthology.orchestra.run.smithi195.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-10-19T12:30:31.181 INFO:teuthology.orchestra.run.smithi195.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-10-19T12:30:31.182 INFO:teuthology.orchestra.run.smithi195.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-10-19T12:30:31.183 INFO:teuthology.orchestra.run.smithi195.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-19T12:30:31.185 INFO:teuthology.orchestra.run.smithi195.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-19T12:30:31.188 INFO:teuthology.orchestra.run.smithi195.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-10-19T12:30:31.189 INFO:teuthology.orchestra.run.smithi195.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-10-19T12:30:31.321 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2023-10-19T12:30:31.334 INFO:teuthology.orchestra.run.smithi195.stdout:=========================================================================================================================== 2023-10-19T12:30:31.334 INFO:teuthology.orchestra.run.smithi195.stdout: Package Arch Version Repository Size 2023-10-19T12:30:31.334 INFO:teuthology.orchestra.run.smithi195.stdout:=========================================================================================================================== 2023-10-19T12:30:31.334 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2023-10-19T12:30:31.335 INFO:teuthology.orchestra.run.smithi195.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-10-19T12:30:31.335 INFO:teuthology.orchestra.run.smithi195.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-19T12:30:31.335 INFO:teuthology.orchestra.run.smithi195.stdout: ceph x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 6.4 k 2023-10-19T12:30:31.335 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-base x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 5.4 M 2023-10-19T12:30:31.335 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-fuse x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 919 k 2023-10-19T12:30:31.336 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 167 k 2023-10-19T12:30:31.336 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 1.6 M 2023-10-19T12:30:31.336 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6786.gf7420d7f.el8 ceph-noarch 132 k 2023-10-19T12:30:31.336 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6786.gf7420d7f.el8 ceph-noarch 1.8 M 2023-10-19T12:30:31.336 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6786.gf7420d7f.el8 ceph-noarch 7.4 M 2023-10-19T12:30:31.337 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-rook noarch 2:18.0.0-6786.gf7420d7f.el8 ceph-noarch 47 k 2023-10-19T12:30:31.337 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-radosgw x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 14 M 2023-10-19T12:30:31.337 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-test x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 49 M 2023-10-19T12:30:31.337 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-volume noarch 2:18.0.0-6786.gf7420d7f.el8 ceph-noarch 261 k 2023-10-19T12:30:31.337 INFO:teuthology.orchestra.run.smithi195.stdout: cephadm noarch 2:18.0.0-6786.gf7420d7f.el8 ceph-noarch 192 k 2023-10-19T12:30:31.338 INFO:teuthology.orchestra.run.smithi195.stdout: cephfs-mirror x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 261 k 2023-10-19T12:30:31.338 INFO:teuthology.orchestra.run.smithi195.stdout: cephfs-top noarch 2:18.0.0-6786.gf7420d7f.el8 ceph-noarch 18 k 2023-10-19T12:30:31.338 INFO:teuthology.orchestra.run.smithi195.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-10-19T12:30:31.338 INFO:teuthology.orchestra.run.smithi195.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-19T12:30:31.339 INFO:teuthology.orchestra.run.smithi195.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-19T12:30:31.339 INFO:teuthology.orchestra.run.smithi195.stdout: libcephfs-devel x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 31 k 2023-10-19T12:30:31.339 INFO:teuthology.orchestra.run.smithi195.stdout: libcephfs2 x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 840 k 2023-10-19T12:30:31.339 INFO:teuthology.orchestra.run.smithi195.stdout: librados-devel x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 139 k 2023-10-19T12:30:31.340 INFO:teuthology.orchestra.run.smithi195.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-19T12:30:31.340 INFO:teuthology.orchestra.run.smithi195.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-10-19T12:30:31.340 INFO:teuthology.orchestra.run.smithi195.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-19T12:30:31.340 INFO:teuthology.orchestra.run.smithi195.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-10-19T12:30:31.340 INFO:teuthology.orchestra.run.smithi195.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-10-19T12:30:31.341 INFO:teuthology.orchestra.run.smithi195.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-10-19T12:30:31.341 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cephfs x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 196 k 2023-10-19T12:30:31.341 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rados x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 370 k 2023-10-19T12:30:31.341 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rbd x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 364 k 2023-10-19T12:30:31.341 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rgw x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 107 k 2023-10-19T12:30:31.342 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-fuse x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 94 k 2023-10-19T12:30:31.342 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-mirror x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 3.6 M 2023-10-19T12:30:31.342 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-nbd x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 178 k 2023-10-19T12:30:31.342 INFO:teuthology.orchestra.run.smithi195.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-10-19T12:30:31.342 INFO:teuthology.orchestra.run.smithi195.stdout:Upgrading: 2023-10-19T12:30:31.343 INFO:teuthology.orchestra.run.smithi195.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-10-19T12:30:31.343 INFO:teuthology.orchestra.run.smithi195.stdout: librados2 x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 3.7 M 2023-10-19T12:30:31.343 INFO:teuthology.orchestra.run.smithi195.stdout: librbd1 x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 3.7 M 2023-10-19T12:30:31.343 INFO:teuthology.orchestra.run.smithi195.stdout:Installing dependencies: 2023-10-19T12:30:31.343 INFO:teuthology.orchestra.run.smithi195.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-19T12:30:31.344 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-common x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 23 M 2023-10-19T12:30:31.344 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6786.gf7420d7f.el8 ceph-noarch 23 k 2023-10-19T12:30:31.344 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mds x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 2.3 M 2023-10-19T12:30:31.344 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6786.gf7420d7f.el8 ceph-noarch 242 k 2023-10-19T12:30:31.344 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mon x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 4.6 M 2023-10-19T12:30:31.345 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-osd x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 18 M 2023-10-19T12:30:31.345 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6786.gf7420d7f.el8 ceph-noarch 15 k 2023-10-19T12:30:31.345 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-selinux x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 24 k 2023-10-19T12:30:31.345 INFO:teuthology.orchestra.run.smithi195.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-19T12:30:31.346 INFO:teuthology.orchestra.run.smithi195.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-19T12:30:31.346 INFO:teuthology.orchestra.run.smithi195.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-10-19T12:30:31.346 INFO:teuthology.orchestra.run.smithi195.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-19T12:30:31.346 INFO:teuthology.orchestra.run.smithi195.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-10-19T12:30:31.346 INFO:teuthology.orchestra.run.smithi195.stdout: libcephsqlite x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 185 k 2023-10-19T12:30:31.347 INFO:teuthology.orchestra.run.smithi195.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-10-19T12:30:31.347 INFO:teuthology.orchestra.run.smithi195.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-10-19T12:30:31.347 INFO:teuthology.orchestra.run.smithi195.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-19T12:30:31.347 INFO:teuthology.orchestra.run.smithi195.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-10-19T12:30:31.347 INFO:teuthology.orchestra.run.smithi195.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-10-19T12:30:31.348 INFO:teuthology.orchestra.run.smithi195.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-19T12:30:31.348 INFO:teuthology.orchestra.run.smithi195.stdout: libradosstriper1 x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 518 k 2023-10-19T12:30:31.348 INFO:teuthology.orchestra.run.smithi195.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-10-19T12:30:31.348 INFO:teuthology.orchestra.run.smithi195.stdout: librgw2 x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 6.9 M 2023-10-19T12:30:31.349 INFO:teuthology.orchestra.run.smithi195.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-19T12:30:31.349 INFO:teuthology.orchestra.run.smithi195.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-10-19T12:30:31.349 INFO:teuthology.orchestra.run.smithi195.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-19T12:30:31.349 INFO:teuthology.orchestra.run.smithi195.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-19T12:30:31.350 INFO:teuthology.orchestra.run.smithi195.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-19T12:30:31.350 INFO:teuthology.orchestra.run.smithi195.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-19T12:30:31.350 INFO:teuthology.orchestra.run.smithi195.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-19T12:30:31.350 INFO:teuthology.orchestra.run.smithi195.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-10-19T12:30:31.350 INFO:teuthology.orchestra.run.smithi195.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-19T12:30:31.351 INFO:teuthology.orchestra.run.smithi195.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-19T12:30:31.351 INFO:teuthology.orchestra.run.smithi195.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-19T12:30:31.351 INFO:teuthology.orchestra.run.smithi195.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-19T12:30:31.351 INFO:teuthology.orchestra.run.smithi195.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-19T12:30:31.351 INFO:teuthology.orchestra.run.smithi195.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-19T12:30:31.352 INFO:teuthology.orchestra.run.smithi195.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-19T12:30:31.352 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-19T12:30:31.352 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ceph-argparse x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 45 k 2023-10-19T12:30:31.352 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ceph-common x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 125 k 2023-10-19T12:30:31.352 INFO:teuthology.orchestra.run.smithi195.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-19T12:30:31.353 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-10-19T12:30:31.353 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-19T12:30:31.353 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-19T12:30:31.353 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-19T12:30:31.353 INFO:teuthology.orchestra.run.smithi195.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-19T12:30:31.354 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-19T12:30:31.354 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-19T12:30:31.354 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-19T12:30:31.354 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-19T12:30:31.355 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-19T12:30:31.355 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-19T12:30:31.355 INFO:teuthology.orchestra.run.smithi195.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-19T12:30:31.355 INFO:teuthology.orchestra.run.smithi195.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-19T12:30:31.356 INFO:teuthology.orchestra.run.smithi195.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-19T12:30:31.356 INFO:teuthology.orchestra.run.smithi195.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-19T12:30:31.356 INFO:teuthology.orchestra.run.smithi195.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-19T12:30:31.356 INFO:teuthology.orchestra.run.smithi195.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-19T12:30:31.356 INFO:teuthology.orchestra.run.smithi195.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-19T12:30:31.357 INFO:teuthology.orchestra.run.smithi195.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-19T12:30:31.357 INFO:teuthology.orchestra.run.smithi195.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-19T12:30:31.357 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-19T12:30:31.357 INFO:teuthology.orchestra.run.smithi195.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-19T12:30:31.358 INFO:teuthology.orchestra.run.smithi195.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-19T12:30:31.358 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-10-19T12:30:31.358 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-19T12:30:31.358 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-19T12:30:31.358 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-10-19T12:30:31.359 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-19T12:30:31.359 INFO:teuthology.orchestra.run.smithi195.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-19T12:30:31.359 INFO:teuthology.orchestra.run.smithi195.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-19T12:30:31.359 INFO:teuthology.orchestra.run.smithi195.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-19T12:30:31.360 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-19T12:30:31.360 INFO:teuthology.orchestra.run.smithi195.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-10-19T12:30:31.360 INFO:teuthology.orchestra.run.smithi195.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-19T12:30:31.360 INFO:teuthology.orchestra.run.smithi195.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-19T12:30:31.360 INFO:teuthology.orchestra.run.smithi195.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-19T12:30:31.361 INFO:teuthology.orchestra.run.smithi195.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-19T12:30:31.361 INFO:teuthology.orchestra.run.smithi195.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-19T12:30:31.361 INFO:teuthology.orchestra.run.smithi195.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-19T12:30:31.361 INFO:teuthology.orchestra.run.smithi195.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-19T12:30:31.361 INFO:teuthology.orchestra.run.smithi195.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-19T12:30:31.362 INFO:teuthology.orchestra.run.smithi195.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-19T12:30:31.362 INFO:teuthology.orchestra.run.smithi195.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-19T12:30:31.362 INFO:teuthology.orchestra.run.smithi195.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-10-19T12:30:31.362 INFO:teuthology.orchestra.run.smithi195.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-19T12:30:31.363 INFO:teuthology.orchestra.run.smithi195.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-10-19T12:30:31.363 INFO:teuthology.orchestra.run.smithi195.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-19T12:30:31.363 INFO:teuthology.orchestra.run.smithi195.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-19T12:30:31.363 INFO:teuthology.orchestra.run.smithi195.stdout:Enabling module streams: 2023-10-19T12:30:31.364 INFO:teuthology.orchestra.run.smithi195.stdout: postgresql 10 2023-10-19T12:30:31.364 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-10-19T12:30:31.364 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2023-10-19T12:30:31.364 INFO:teuthology.orchestra.run.smithi195.stdout:=========================================================================================================================== 2023-10-19T12:30:31.364 INFO:teuthology.orchestra.run.smithi195.stdout:Install 128 Packages 2023-10-19T12:30:31.365 INFO:teuthology.orchestra.run.smithi195.stdout:Upgrade 3 Packages 2023-10-19T12:30:31.365 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-10-19T12:30:31.365 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 209 M 2023-10-19T12:30:31.366 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2023-10-19T12:30:31.466 INFO:teuthology.orchestra.run.smithi157.stdout:(2/131): ceph-base-18.0.0-6786.gf7420d7f.el8.x8 8.8 MB/s | 5.4 MB 00:00 2023-10-19T12:30:31.508 INFO:teuthology.orchestra.run.smithi157.stdout:(3/131): ceph-fuse-18.0.0-6786.gf7420d7f.el8.x8 1.8 MB/s | 919 kB 00:00 2023-10-19T12:30:31.533 INFO:teuthology.orchestra.run.smithi157.stdout:(4/131): ceph-immutable-object-cache-18.0.0-678 2.4 MB/s | 167 kB 00:00 2023-10-19T12:30:31.600 INFO:teuthology.orchestra.run.smithi195.stdout:(1/131): ceph-18.0.0-6786.gf7420d7f.el8.x86_64. 29 kB/s | 6.4 kB 00:00 2023-10-19T12:30:31.784 INFO:teuthology.orchestra.run.smithi157.stdout:(5/131): ceph-mgr-18.0.0-6786.gf7420d7f.el8.x86 6.5 MB/s | 1.6 MB 00:00 2023-10-19T12:30:32.167 INFO:teuthology.orchestra.run.smithi157.stdout:(6/131): ceph-mds-18.0.0-6786.gf7420d7f.el8.x86 3.5 MB/s | 2.3 MB 00:00 2023-10-19T12:30:32.417 INFO:teuthology.orchestra.run.smithi195.stdout:(2/131): ceph-fuse-18.0.0-6786.gf7420d7f.el8.x8 1.1 MB/s | 919 kB 00:00 2023-10-19T12:30:32.509 INFO:teuthology.orchestra.run.smithi157.stdout:(7/131): ceph-mon-18.0.0-6786.gf7420d7f.el8.x86 6.4 MB/s | 4.6 MB 00:00 2023-10-19T12:30:32.517 INFO:teuthology.orchestra.run.smithi195.stdout:(3/131): ceph-immutable-object-cache-18.0.0-678 1.6 MB/s | 167 kB 00:00 2023-10-19T12:30:32.718 INFO:teuthology.orchestra.run.smithi157.stdout:(8/131): ceph-common-18.0.0-6786.gf7420d7f.el8. 12 MB/s | 23 MB 00:01 2023-10-19T12:30:32.785 INFO:teuthology.orchestra.run.smithi157.stdout:(9/131): ceph-selinux-18.0.0-6786.gf7420d7f.el8 366 kB/s | 24 kB 00:00 2023-10-19T12:30:33.317 INFO:teuthology.orchestra.run.smithi195.stdout:(4/131): ceph-mds-18.0.0-6786.gf7420d7f.el8.x86 2.9 MB/s | 2.3 MB 00:00 2023-10-19T12:30:33.876 INFO:teuthology.orchestra.run.smithi195.stdout:(5/131): ceph-mgr-18.0.0-6786.gf7420d7f.el8.x86 2.9 MB/s | 1.6 MB 00:00 2023-10-19T12:30:33.951 INFO:teuthology.orchestra.run.smithi195.stdout:(6/131): ceph-base-18.0.0-6786.gf7420d7f.el8.x8 2.1 MB/s | 5.4 MB 00:02 2023-10-19T12:30:34.859 INFO:teuthology.orchestra.run.smithi195.stdout:(7/131): ceph-mon-18.0.0-6786.gf7420d7f.el8.x86 4.7 MB/s | 4.6 MB 00:00 2023-10-19T12:30:34.893 INFO:teuthology.orchestra.run.smithi157.stdout:(10/131): ceph-radosgw-18.0.0-6786.gf7420d7f.el 5.8 MB/s | 14 MB 00:02 2023-10-19T12:30:34.956 INFO:teuthology.orchestra.run.smithi046.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-19T12:30:34.957 INFO:teuthology.orchestra.run.smithi046.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-19T12:30:34.973 INFO:teuthology.orchestra.run.smithi046.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-10-19T12:30:34.974 INFO:teuthology.orchestra.run.smithi046.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-10-19T12:30:34.975 INFO:teuthology.orchestra.run.smithi046.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-10-19T12:30:34.976 INFO:teuthology.orchestra.run.smithi046.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-19T12:30:34.979 INFO:teuthology.orchestra.run.smithi046.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-19T12:30:34.982 INFO:teuthology.orchestra.run.smithi046.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-10-19T12:30:34.984 INFO:teuthology.orchestra.run.smithi046.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-10-19T12:30:35.002 INFO:teuthology.orchestra.run.smithi157.stdout:(11/131): cephfs-mirror-18.0.0-6786.gf7420d7f.e 2.4 MB/s | 261 kB 00:00 2023-10-19T12:30:35.093 INFO:teuthology.orchestra.run.smithi157.stdout:(12/131): libcephfs-devel-18.0.0-6786.gf7420d7f 339 kB/s | 31 kB 00:00 2023-10-19T12:30:35.137 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2023-10-19T12:30:35.151 INFO:teuthology.orchestra.run.smithi046.stdout:=========================================================================================================================== 2023-10-19T12:30:35.151 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repository Size 2023-10-19T12:30:35.151 INFO:teuthology.orchestra.run.smithi046.stdout:=========================================================================================================================== 2023-10-19T12:30:35.151 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2023-10-19T12:30:35.152 INFO:teuthology.orchestra.run.smithi046.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-10-19T12:30:35.152 INFO:teuthology.orchestra.run.smithi046.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-19T12:30:35.152 INFO:teuthology.orchestra.run.smithi046.stdout: ceph x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 6.4 k 2023-10-19T12:30:35.152 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-base x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 5.4 M 2023-10-19T12:30:35.152 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-fuse x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 919 k 2023-10-19T12:30:35.153 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 167 k 2023-10-19T12:30:35.153 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 1.6 M 2023-10-19T12:30:35.153 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6786.gf7420d7f.el8 ceph-noarch 132 k 2023-10-19T12:30:35.153 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6786.gf7420d7f.el8 ceph-noarch 1.8 M 2023-10-19T12:30:35.153 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6786.gf7420d7f.el8 ceph-noarch 7.4 M 2023-10-19T12:30:35.154 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-rook noarch 2:18.0.0-6786.gf7420d7f.el8 ceph-noarch 47 k 2023-10-19T12:30:35.154 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-radosgw x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 14 M 2023-10-19T12:30:35.154 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-test x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 49 M 2023-10-19T12:30:35.154 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-volume noarch 2:18.0.0-6786.gf7420d7f.el8 ceph-noarch 261 k 2023-10-19T12:30:35.154 INFO:teuthology.orchestra.run.smithi046.stdout: cephadm noarch 2:18.0.0-6786.gf7420d7f.el8 ceph-noarch 192 k 2023-10-19T12:30:35.155 INFO:teuthology.orchestra.run.smithi046.stdout: cephfs-mirror x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 261 k 2023-10-19T12:30:35.155 INFO:teuthology.orchestra.run.smithi046.stdout: cephfs-top noarch 2:18.0.0-6786.gf7420d7f.el8 ceph-noarch 18 k 2023-10-19T12:30:35.155 INFO:teuthology.orchestra.run.smithi046.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-10-19T12:30:35.155 INFO:teuthology.orchestra.run.smithi046.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-19T12:30:35.155 INFO:teuthology.orchestra.run.smithi046.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-19T12:30:35.156 INFO:teuthology.orchestra.run.smithi046.stdout: libcephfs-devel x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 31 k 2023-10-19T12:30:35.156 INFO:teuthology.orchestra.run.smithi046.stdout: libcephfs2 x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 840 k 2023-10-19T12:30:35.156 INFO:teuthology.orchestra.run.smithi046.stdout: librados-devel x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 139 k 2023-10-19T12:30:35.156 INFO:teuthology.orchestra.run.smithi046.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-19T12:30:35.156 INFO:teuthology.orchestra.run.smithi046.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-10-19T12:30:35.157 INFO:teuthology.orchestra.run.smithi046.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-19T12:30:35.157 INFO:teuthology.orchestra.run.smithi046.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-10-19T12:30:35.157 INFO:teuthology.orchestra.run.smithi046.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-10-19T12:30:35.157 INFO:teuthology.orchestra.run.smithi046.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-10-19T12:30:35.157 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cephfs x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 196 k 2023-10-19T12:30:35.158 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rados x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 370 k 2023-10-19T12:30:35.158 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rbd x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 364 k 2023-10-19T12:30:35.158 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rgw x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 107 k 2023-10-19T12:30:35.158 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-fuse x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 94 k 2023-10-19T12:30:35.158 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-mirror x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 3.6 M 2023-10-19T12:30:35.159 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-nbd x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 178 k 2023-10-19T12:30:35.159 INFO:teuthology.orchestra.run.smithi046.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-10-19T12:30:35.159 INFO:teuthology.orchestra.run.smithi046.stdout:Upgrading: 2023-10-19T12:30:35.159 INFO:teuthology.orchestra.run.smithi046.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-10-19T12:30:35.159 INFO:teuthology.orchestra.run.smithi046.stdout: librados2 x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 3.7 M 2023-10-19T12:30:35.160 INFO:teuthology.orchestra.run.smithi046.stdout: librbd1 x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 3.7 M 2023-10-19T12:30:35.160 INFO:teuthology.orchestra.run.smithi046.stdout:Installing dependencies: 2023-10-19T12:30:35.160 INFO:teuthology.orchestra.run.smithi046.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-19T12:30:35.160 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-common x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 23 M 2023-10-19T12:30:35.160 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6786.gf7420d7f.el8 ceph-noarch 23 k 2023-10-19T12:30:35.161 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mds x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 2.3 M 2023-10-19T12:30:35.161 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6786.gf7420d7f.el8 ceph-noarch 242 k 2023-10-19T12:30:35.161 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mon x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 4.6 M 2023-10-19T12:30:35.161 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-osd x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 18 M 2023-10-19T12:30:35.161 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6786.gf7420d7f.el8 ceph-noarch 15 k 2023-10-19T12:30:35.162 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-selinux x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 24 k 2023-10-19T12:30:35.162 INFO:teuthology.orchestra.run.smithi046.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-19T12:30:35.162 INFO:teuthology.orchestra.run.smithi046.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-19T12:30:35.162 INFO:teuthology.orchestra.run.smithi046.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-10-19T12:30:35.162 INFO:teuthology.orchestra.run.smithi046.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-19T12:30:35.163 INFO:teuthology.orchestra.run.smithi046.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-10-19T12:30:35.163 INFO:teuthology.orchestra.run.smithi046.stdout: libcephsqlite x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 185 k 2023-10-19T12:30:35.163 INFO:teuthology.orchestra.run.smithi046.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-10-19T12:30:35.163 INFO:teuthology.orchestra.run.smithi046.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-10-19T12:30:35.163 INFO:teuthology.orchestra.run.smithi046.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-19T12:30:35.164 INFO:teuthology.orchestra.run.smithi046.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-10-19T12:30:35.164 INFO:teuthology.orchestra.run.smithi046.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-10-19T12:30:35.164 INFO:teuthology.orchestra.run.smithi046.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-19T12:30:35.164 INFO:teuthology.orchestra.run.smithi046.stdout: libradosstriper1 x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 518 k 2023-10-19T12:30:35.165 INFO:teuthology.orchestra.run.smithi046.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-10-19T12:30:35.165 INFO:teuthology.orchestra.run.smithi046.stdout: librgw2 x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 6.9 M 2023-10-19T12:30:35.165 INFO:teuthology.orchestra.run.smithi046.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-19T12:30:35.165 INFO:teuthology.orchestra.run.smithi046.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-10-19T12:30:35.165 INFO:teuthology.orchestra.run.smithi046.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-19T12:30:35.166 INFO:teuthology.orchestra.run.smithi046.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-19T12:30:35.166 INFO:teuthology.orchestra.run.smithi046.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-19T12:30:35.166 INFO:teuthology.orchestra.run.smithi046.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-19T12:30:35.166 INFO:teuthology.orchestra.run.smithi046.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-19T12:30:35.166 INFO:teuthology.orchestra.run.smithi046.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-10-19T12:30:35.167 INFO:teuthology.orchestra.run.smithi046.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-19T12:30:35.167 INFO:teuthology.orchestra.run.smithi046.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-19T12:30:35.167 INFO:teuthology.orchestra.run.smithi046.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-19T12:30:35.167 INFO:teuthology.orchestra.run.smithi046.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-19T12:30:35.167 INFO:teuthology.orchestra.run.smithi046.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-19T12:30:35.168 INFO:teuthology.orchestra.run.smithi046.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-19T12:30:35.168 INFO:teuthology.orchestra.run.smithi046.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-19T12:30:35.168 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-19T12:30:35.168 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ceph-argparse x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 45 k 2023-10-19T12:30:35.168 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ceph-common x86_64 2:18.0.0-6786.gf7420d7f.el8 ceph 125 k 2023-10-19T12:30:35.169 INFO:teuthology.orchestra.run.smithi046.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-19T12:30:35.169 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-10-19T12:30:35.169 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-19T12:30:35.169 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-19T12:30:35.170 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-19T12:30:35.170 INFO:teuthology.orchestra.run.smithi046.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-19T12:30:35.170 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-19T12:30:35.170 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-19T12:30:35.171 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-19T12:30:35.171 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-19T12:30:35.171 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-19T12:30:35.171 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-19T12:30:35.171 INFO:teuthology.orchestra.run.smithi046.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-19T12:30:35.172 INFO:teuthology.orchestra.run.smithi046.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-19T12:30:35.172 INFO:teuthology.orchestra.run.smithi046.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-19T12:30:35.172 INFO:teuthology.orchestra.run.smithi046.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-19T12:30:35.172 INFO:teuthology.orchestra.run.smithi046.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-19T12:30:35.172 INFO:teuthology.orchestra.run.smithi046.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-19T12:30:35.172 INFO:teuthology.orchestra.run.smithi046.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-19T12:30:35.173 INFO:teuthology.orchestra.run.smithi046.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-19T12:30:35.173 INFO:teuthology.orchestra.run.smithi046.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-19T12:30:35.173 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-19T12:30:35.173 INFO:teuthology.orchestra.run.smithi046.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-19T12:30:35.173 INFO:teuthology.orchestra.run.smithi046.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-19T12:30:35.174 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-10-19T12:30:35.174 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-19T12:30:35.174 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-19T12:30:35.174 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-10-19T12:30:35.174 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-19T12:30:35.175 INFO:teuthology.orchestra.run.smithi046.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-19T12:30:35.175 INFO:teuthology.orchestra.run.smithi046.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-19T12:30:35.175 INFO:teuthology.orchestra.run.smithi046.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-19T12:30:35.175 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-19T12:30:35.175 INFO:teuthology.orchestra.run.smithi046.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-10-19T12:30:35.176 INFO:teuthology.orchestra.run.smithi046.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-19T12:30:35.176 INFO:teuthology.orchestra.run.smithi046.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-19T12:30:35.176 INFO:teuthology.orchestra.run.smithi046.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-19T12:30:35.176 INFO:teuthology.orchestra.run.smithi046.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-19T12:30:35.176 INFO:teuthology.orchestra.run.smithi046.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-19T12:30:35.177 INFO:teuthology.orchestra.run.smithi046.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-19T12:30:35.177 INFO:teuthology.orchestra.run.smithi046.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-19T12:30:35.177 INFO:teuthology.orchestra.run.smithi046.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-19T12:30:35.177 INFO:teuthology.orchestra.run.smithi046.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-19T12:30:35.177 INFO:teuthology.orchestra.run.smithi046.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-19T12:30:35.177 INFO:teuthology.orchestra.run.smithi046.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-10-19T12:30:35.178 INFO:teuthology.orchestra.run.smithi046.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-19T12:30:35.178 INFO:teuthology.orchestra.run.smithi046.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-10-19T12:30:35.178 INFO:teuthology.orchestra.run.smithi046.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-19T12:30:35.178 INFO:teuthology.orchestra.run.smithi046.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-19T12:30:35.178 INFO:teuthology.orchestra.run.smithi046.stdout:Enabling module streams: 2023-10-19T12:30:35.179 INFO:teuthology.orchestra.run.smithi046.stdout: postgresql 10 2023-10-19T12:30:35.179 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:30:35.179 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2023-10-19T12:30:35.179 INFO:teuthology.orchestra.run.smithi046.stdout:=========================================================================================================================== 2023-10-19T12:30:35.179 INFO:teuthology.orchestra.run.smithi046.stdout:Install 128 Packages 2023-10-19T12:30:35.179 INFO:teuthology.orchestra.run.smithi046.stdout:Upgrade 3 Packages 2023-10-19T12:30:35.180 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:30:35.180 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 209 M 2023-10-19T12:30:35.181 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2023-10-19T12:30:35.360 INFO:teuthology.orchestra.run.smithi157.stdout:(13/131): libcephfs2-18.0.0-6786.gf7420d7f.el8. 3.1 MB/s | 840 kB 00:00 2023-10-19T12:30:35.452 INFO:teuthology.orchestra.run.smithi157.stdout:(14/131): libcephsqlite-18.0.0-6786.gf7420d7f.e 2.0 MB/s | 185 kB 00:00 2023-10-19T12:30:35.536 INFO:teuthology.orchestra.run.smithi157.stdout:(15/131): librados-devel-18.0.0-6786.gf7420d7f. 1.6 MB/s | 139 kB 00:00 2023-10-19T12:30:35.802 INFO:teuthology.orchestra.run.smithi046.stdout:(1/131): ceph-18.0.0-6786.gf7420d7f.el8.x86_64. 24 kB/s | 6.4 kB 00:00 2023-10-19T12:30:35.853 INFO:teuthology.orchestra.run.smithi157.stdout:(16/131): ceph-osd-18.0.0-6786.gf7420d7f.el8.x8 4.9 MB/s | 18 MB 00:03 2023-10-19T12:30:35.887 INFO:teuthology.orchestra.run.smithi157.stdout:(17/131): libradosstriper1-18.0.0-6786.gf7420d7 1.4 MB/s | 518 kB 00:00 2023-10-19T12:30:35.995 INFO:teuthology.orchestra.run.smithi157.stdout:(18/131): python3-ceph-argparse-18.0.0-6786.gf7 412 kB/s | 45 kB 00:00 2023-10-19T12:30:36.104 INFO:teuthology.orchestra.run.smithi157.stdout:(19/131): python3-ceph-common-18.0.0-6786.gf742 1.1 MB/s | 125 kB 00:00 2023-10-19T12:30:36.221 INFO:teuthology.orchestra.run.smithi157.stdout:(20/131): python3-cephfs-18.0.0-6786.gf7420d7f. 1.6 MB/s | 196 kB 00:00 2023-10-19T12:30:36.396 INFO:teuthology.orchestra.run.smithi157.stdout:(21/131): python3-rados-18.0.0-6786.gf7420d7f.e 2.1 MB/s | 370 kB 00:00 2023-10-19T12:30:36.554 INFO:teuthology.orchestra.run.smithi157.stdout:(22/131): python3-rbd-18.0.0-6786.gf7420d7f.el8 2.2 MB/s | 364 kB 00:00 2023-10-19T12:30:36.646 INFO:teuthology.orchestra.run.smithi157.stdout:(23/131): python3-rgw-18.0.0-6786.gf7420d7f.el8 1.1 MB/s | 107 kB 00:00 2023-10-19T12:30:36.722 INFO:teuthology.orchestra.run.smithi157.stdout:(24/131): rbd-fuse-18.0.0-6786.gf7420d7f.el8.x8 1.2 MB/s | 94 kB 00:00 2023-10-19T12:30:36.769 INFO:teuthology.orchestra.run.smithi046.stdout:(2/131): ceph-fuse-18.0.0-6786.gf7420d7f.el8.x8 951 kB/s | 919 kB 00:00 2023-10-19T12:30:36.826 INFO:teuthology.orchestra.run.smithi195.stdout:(8/131): ceph-radosgw-18.0.0-6786.gf7420d7f.el8 7.1 MB/s | 14 MB 00:01 2023-10-19T12:30:36.918 INFO:teuthology.orchestra.run.smithi195.stdout:(9/131): ceph-selinux-18.0.0-6786.gf7420d7f.el8 266 kB/s | 24 kB 00:00 2023-10-19T12:30:36.994 INFO:teuthology.orchestra.run.smithi046.stdout:(3/131): ceph-base-18.0.0-6786.gf7420d7f.el8.x8 3.7 MB/s | 5.4 MB 00:01 2023-10-19T12:30:37.019 INFO:teuthology.orchestra.run.smithi046.stdout:(4/131): ceph-immutable-object-cache-18.0.0-678 670 kB/s | 167 kB 00:00 2023-10-19T12:30:37.453 INFO:teuthology.orchestra.run.smithi046.stdout:(5/131): ceph-mds-18.0.0-6786.gf7420d7f.el8.x86 5.1 MB/s | 2.3 MB 00:00 2023-10-19T12:30:37.864 INFO:teuthology.orchestra.run.smithi157.stdout:(25/131): rbd-mirror-18.0.0-6786.gf7420d7f.el8. 3.1 MB/s | 3.6 MB 00:01 2023-10-19T12:30:38.014 INFO:teuthology.orchestra.run.smithi157.stdout:(26/131): rbd-nbd-18.0.0-6786.gf7420d7f.el8.x86 1.2 MB/s | 178 kB 00:00 2023-10-19T12:30:38.114 INFO:teuthology.orchestra.run.smithi157.stdout:(27/131): ceph-grafana-dashboards-18.0.0-6786.g 231 kB/s | 23 kB 00:00 2023-10-19T12:30:38.120 INFO:teuthology.orchestra.run.smithi046.stdout:(6/131): ceph-mon-18.0.0-6786.gf7420d7f.el8.x86 6.9 MB/s | 4.6 MB 00:00 2023-10-19T12:30:38.182 INFO:teuthology.orchestra.run.smithi157.stdout:(28/131): ceph-mgr-cephadm-18.0.0-6786.gf7420d7 1.9 MB/s | 132 kB 00:00 2023-10-19T12:30:38.295 INFO:teuthology.orchestra.run.smithi046.stdout:(7/131): ceph-mgr-18.0.0-6786.gf7420d7f.el8.x86 1.3 MB/s | 1.6 MB 00:01 2023-10-19T12:30:38.382 INFO:teuthology.orchestra.run.smithi157.stdout:(29/131): librgw2-18.0.0-6786.gf7420d7f.el8.x86 2.7 MB/s | 6.9 MB 00:02 2023-10-19T12:30:39.282 INFO:teuthology.orchestra.run.smithi157.stdout:(30/131): ceph-test-18.0.0-6786.gf7420d7f.el8.x 7.5 MB/s | 49 MB 00:06 2023-10-19T12:30:39.324 INFO:teuthology.orchestra.run.smithi157.stdout:(31/131): ceph-mgr-dashboard-18.0.0-6786.gf7420 1.5 MB/s | 1.8 MB 00:01 2023-10-19T12:30:39.424 INFO:teuthology.orchestra.run.smithi157.stdout:(32/131): ceph-mgr-rook-18.0.0-6786.gf7420d7f.e 475 kB/s | 47 kB 00:00 2023-10-19T12:30:39.449 INFO:teuthology.orchestra.run.smithi157.stdout:(33/131): ceph-mgr-modules-core-18.0.0-6786.gf7 1.4 MB/s | 242 kB 00:00 2023-10-19T12:30:39.500 INFO:teuthology.orchestra.run.smithi157.stdout:(34/131): ceph-prometheus-alerts-18.0.0-6786.gf 199 kB/s | 15 kB 00:00 2023-10-19T12:30:39.533 INFO:teuthology.orchestra.run.smithi157.stdout:(35/131): ceph-volume-18.0.0-6786.gf7420d7f.el8 3.1 MB/s | 261 kB 00:00 2023-10-19T12:30:39.659 INFO:teuthology.orchestra.run.smithi157.stdout:(36/131): cephfs-top-18.0.0-6786.gf7420d7f.el8. 145 kB/s | 18 kB 00:00 2023-10-19T12:30:39.684 INFO:teuthology.orchestra.run.smithi157.stdout:(37/131): cephadm-18.0.0-6786.gf7420d7f.el8.noa 1.0 MB/s | 192 kB 00:00 2023-10-19T12:30:40.042 INFO:teuthology.orchestra.run.smithi157.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 164 kB/s | 59 kB 00:00 2023-10-19T12:30:40.187 INFO:teuthology.orchestra.run.smithi046.stdout:(8/131): ceph-osd-18.0.0-6786.gf7420d7f.el8.x86 8.7 MB/s | 18 MB 00:02 2023-10-19T12:30:40.201 INFO:teuthology.orchestra.run.smithi157.stdout:(39/131): gperftools-libs-2.7-9.el8.x86_64.rpm 565 kB/s | 306 kB 00:00 2023-10-19T12:30:40.227 INFO:teuthology.orchestra.run.smithi157.stdout:(40/131): libunwind-1.3.1-3.el8.x86_64.rpm 409 kB/s | 75 kB 00:00 2023-10-19T12:30:40.237 INFO:teuthology.orchestra.run.smithi046.stdout:(9/131): ceph-selinux-18.0.0-6786.gf7420d7f.el8 490 kB/s | 24 kB 00:00 2023-10-19T12:30:40.344 INFO:teuthology.orchestra.run.smithi157.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 374 kB/s | 44 kB 00:00 2023-10-19T12:30:40.429 INFO:teuthology.orchestra.run.smithi157.stdout:(42/131): python3-asyncssh-2.7.0-2.el8.noarch.r 2.0 MB/s | 476 kB 00:00 2023-10-19T12:30:40.527 INFO:teuthology.orchestra.run.smithi157.stdout:(43/131): python3-beautifulsoup4-4.6.3-2.el8.1. 1.0 MB/s | 185 kB 00:00 2023-10-19T12:30:40.544 INFO:teuthology.orchestra.run.smithi157.stdout:(44/131): python3-cachetools-3.1.1-4.el8.noarch 286 kB/s | 33 kB 00:00 2023-10-19T12:30:40.636 INFO:teuthology.orchestra.run.smithi157.stdout:(45/131): python3-certifi-2018.10.15-7.el8.noar 150 kB/s | 16 kB 00:00 2023-10-19T12:30:40.662 INFO:teuthology.orchestra.run.smithi157.stdout:(46/131): python3-cheroot-8.5.2-1.el8.noarch.rp 1.4 MB/s | 173 kB 00:00 2023-10-19T12:30:40.762 INFO:teuthology.orchestra.run.smithi157.stdout:(47/131): python3-google-auth-1.1.1-10.el8.noar 813 kB/s | 81 kB 00:00 2023-10-19T12:30:40.837 INFO:teuthology.orchestra.run.smithi157.stdout:(48/131): python3-cherrypy-18.4.0-1.el8.noarch. 1.9 MB/s | 384 kB 00:00 2023-10-19T12:30:40.854 INFO:teuthology.orchestra.run.smithi157.stdout:(49/131): python3-jaraco-6.2-6.el8.noarch.rpm 121 kB/s | 11 kB 00:00 2023-10-19T12:30:40.901 INFO:teuthology.orchestra.run.smithi195.stdout:(10/131): ceph-common-18.0.0-6786.gf7420d7f.el8 2.4 MB/s | 23 MB 00:09 2023-10-19T12:30:40.929 INFO:teuthology.orchestra.run.smithi157.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 191 kB/s | 18 kB 00:00 2023-10-19T12:30:41.063 INFO:teuthology.orchestra.run.smithi157.stdout:(51/131): ceph-mgr-diskprediction-local-18.0.0- 2.8 MB/s | 7.4 MB 00:02 2023-10-19T12:30:41.080 INFO:teuthology.orchestra.run.smithi157.stdout:(52/131): python3-logutils-0.3.5-11.el8.noarch. 324 kB/s | 49 kB 00:00 2023-10-19T12:30:41.122 INFO:teuthology.orchestra.run.smithi157.stdout:(53/131): python3-kubernetes-11.0.0-6.el8.noarc 4.4 MB/s | 1.2 MB 00:00 2023-10-19T12:30:41.135 INFO:teuthology.orchestra.run.smithi195.stdout:(11/131): cephfs-mirror-18.0.0-6786.gf7420d7f.e 1.1 MB/s | 261 kB 00:00 2023-10-19T12:30:41.211 INFO:teuthology.orchestra.run.smithi157.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 460 kB/s | 60 kB 00:00 2023-10-19T12:30:41.218 INFO:teuthology.orchestra.run.smithi195.stdout:(12/131): libcephfs-devel-18.0.0-6786.gf7420d7f 373 kB/s | 31 kB 00:00 2023-10-19T12:30:41.248 INFO:teuthology.orchestra.run.smithi157.stdout:(55/131): python3-pecan-1.3.2-9.el8.noarch.rpm 2.2 MB/s | 283 kB 00:00 2023-10-19T12:30:41.306 INFO:teuthology.orchestra.run.smithi157.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 164 kB/s | 16 kB 00:00 2023-10-19T12:30:41.340 INFO:teuthology.orchestra.run.smithi157.stdout:(57/131): python3-repoze-lru-0.7-6.el8.noarch.r 366 kB/s | 34 kB 00:00 2023-10-19T12:30:41.407 INFO:teuthology.orchestra.run.smithi157.stdout:(58/131): python3-more-itertools-7.2.0-3.el8.no 171 kB/s | 59 kB 00:00 2023-10-19T12:30:41.432 INFO:teuthology.orchestra.run.smithi157.stdout:(59/131): python3-routes-2.4.1-12.el8.noarch.rp 1.5 MB/s | 196 kB 00:00 2023-10-19T12:30:41.457 INFO:teuthology.orchestra.run.smithi157.stdout:(60/131): python3-rsa-4.9-2.el8.noarch.rpm 547 kB/s | 64 kB 00:00 2023-10-19T12:30:41.469 INFO:teuthology.orchestra.run.smithi195.stdout:(13/131): ceph-osd-18.0.0-6786.gf7420d7f.el8.x8 2.4 MB/s | 18 MB 00:07 2023-10-19T12:30:41.533 INFO:teuthology.orchestra.run.smithi157.stdout:(61/131): python3-simplegeneric-0.8.1-17.el8.no 149 kB/s | 19 kB 00:00 2023-10-19T12:30:41.558 INFO:teuthology.orchestra.run.smithi157.stdout:(62/131): python3-singledispatch-3.4.0.3-18.el8 190 kB/s | 24 kB 00:00 2023-10-19T12:30:41.594 INFO:teuthology.orchestra.run.smithi195.stdout:(14/131): libcephsqlite-18.0.0-6786.gf7420d7f.e 1.4 MB/s | 185 kB 00:00 2023-10-19T12:30:41.615 INFO:teuthology.orchestra.run.smithi157.stdout:(63/131): python3-tempora-1.14.1-5.el8.noarch.r 186 kB/s | 29 kB 00:00 2023-10-19T12:30:41.653 INFO:teuthology.orchestra.run.smithi195.stdout:(15/131): libcephfs2-18.0.0-6786.gf7420d7f.el8. 1.9 MB/s | 840 kB 00:00 2023-10-19T12:30:41.658 INFO:teuthology.orchestra.run.smithi157.stdout:(64/131): python3-trustme-0.6.0-4.el8.noarch.rp 219 kB/s | 27 kB 00:00 2023-10-19T12:30:41.678 INFO:teuthology.orchestra.run.smithi195.stdout:(16/131): librados-devel-18.0.0-6786.gf7420d7f. 1.6 MB/s | 139 kB 00:00 2023-10-19T12:30:41.717 INFO:teuthology.orchestra.run.smithi157.stdout:(65/131): python3-webob-1.8.5-1.el8.1.noarch.rp 2.4 MB/s | 251 kB 00:00 2023-10-19T12:30:41.742 INFO:teuthology.orchestra.run.smithi157.stdout:(66/131): python3-waitress-1.4.3-1.el8.noarch.r 2.0 MB/s | 255 kB 00:00 2023-10-19T12:30:41.809 INFO:teuthology.orchestra.run.smithi157.stdout:(67/131): python3-websocket-client-0.56.0-5.el8 407 kB/s | 61 kB 00:00 2023-10-19T12:30:41.834 INFO:teuthology.orchestra.run.smithi157.stdout:(68/131): python3-webtest-2.0.33-1.el8.noarch.r 729 kB/s | 85 kB 00:00 2023-10-19T12:30:41.860 INFO:teuthology.orchestra.run.smithi157.stdout:(69/131): python3-zc-lockfile-2.0-2.el8.noarch. 196 kB/s | 23 kB 00:00 2023-10-19T12:30:41.878 INFO:teuthology.orchestra.run.smithi195.stdout:(17/131): libradosstriper1-18.0.0-6786.gf7420d7 2.2 MB/s | 518 kB 00:00 2023-10-19T12:30:41.885 INFO:teuthology.orchestra.run.smithi157.stdout:(70/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.4 MB/s | 70 kB 00:00 2023-10-19T12:30:41.952 INFO:teuthology.orchestra.run.smithi157.stdout:(71/131): python3-pyasn1-modules-0.3.7-6.el8.no 1.8 MB/s | 110 kB 00:00 2023-10-19T12:30:41.953 INFO:teuthology.orchestra.run.smithi195.stdout:(18/131): python3-ceph-argparse-18.0.0-6786.gf7 597 kB/s | 45 kB 00:00 2023-10-19T12:30:42.027 INFO:teuthology.orchestra.run.smithi157.stdout:(72/131): python3-pytz-2017.2-9.el8.noarch.rpm 722 kB/s | 54 kB 00:00 2023-10-19T12:30:42.045 INFO:teuthology.orchestra.run.smithi195.stdout:(19/131): python3-ceph-common-18.0.0-6786.gf742 1.3 MB/s | 125 kB 00:00 2023-10-19T12:30:42.069 INFO:teuthology.orchestra.run.smithi157.stdout:(73/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 6.1 MB/s | 259 kB 00:00 2023-10-19T12:30:42.119 INFO:teuthology.orchestra.run.smithi157.stdout:(74/131): socat-1.7.4.1-1.el8.x86_64.rpm 6.3 MB/s | 323 kB 00:00 2023-10-19T12:30:42.161 INFO:teuthology.orchestra.run.smithi157.stdout:(75/131): python3-markupsafe-0.23-19.el8.x86_64 933 kB/s | 39 kB 00:00 2023-10-19T12:30:42.196 INFO:teuthology.orchestra.run.smithi195.stdout:(20/131): python3-cephfs-18.0.0-6786.gf7420d7f. 1.3 MB/s | 196 kB 00:00 2023-10-19T12:30:42.220 INFO:teuthology.orchestra.run.smithi157.stdout:(76/131): bison-3.0.4-10.el8.x86_64.rpm 12 MB/s | 688 kB 00:00 2023-10-19T12:30:42.270 INFO:teuthology.orchestra.run.smithi157.stdout:(77/131): python3-jinja2-2.10.1-3.el8.noarch.rp 11 MB/s | 538 kB 00:00 2023-10-19T12:30:42.304 INFO:teuthology.orchestra.run.smithi157.stdout:(78/131): thrift-0.13.0-2.el8.x86_64.rpm 3.5 MB/s | 1.7 MB 00:00 2023-10-19T12:30:42.329 INFO:teuthology.orchestra.run.smithi157.stdout:(79/131): python3-mako-1.0.6-13.el8.noarch.rpm 2.6 MB/s | 157 kB 00:00 2023-10-19T12:30:42.363 INFO:teuthology.orchestra.run.smithi195.stdout:(21/131): python3-rados-18.0.0-6786.gf7420d7f.e 2.2 MB/s | 370 kB 00:00 2023-10-19T12:30:42.406 INFO:teuthology.orchestra.run.smithi157.stdout:(80/131): oniguruma-6.8.2-2.el8.x86_64.rpm 1.8 MB/s | 187 kB 00:00 2023-10-19T12:30:42.513 INFO:teuthology.orchestra.run.smithi157.stdout:(81/131): automake-1.16.1-7.el8.noarch.rpm 3.9 MB/s | 713 kB 00:00 2023-10-19T12:30:42.680 INFO:teuthology.orchestra.run.smithi195.stdout:(22/131): python3-rbd-18.0.0-6786.gf7420d7f.el8 1.1 MB/s | 364 kB 00:00 2023-10-19T12:30:42.755 INFO:teuthology.orchestra.run.smithi157.stdout:(82/131): python3-scipy-1.0.0-21.module+el8.5.0 15 MB/s | 14 MB 00:00 2023-10-19T12:30:42.805 INFO:teuthology.orchestra.run.smithi195.stdout:(23/131): python3-rgw-18.0.0-6786.gf7420d7f.el8 856 kB/s | 107 kB 00:00 2023-10-19T12:30:42.814 INFO:teuthology.orchestra.run.smithi157.stdout:(83/131): python3-jsonpatch-1.21-2.el8.noarch.r 88 kB/s | 27 kB 00:00 2023-10-19T12:30:42.848 INFO:teuthology.orchestra.run.smithi157.stdout:(84/131): flex-2.6.1-9.el8.x86_64.rpm 3.4 MB/s | 320 kB 00:00 2023-10-19T12:30:42.873 INFO:teuthology.orchestra.run.smithi157.stdout:(85/131): python3-prettytable-0.7.2-14.el8.noar 752 kB/s | 44 kB 00:00 2023-10-19T12:30:42.897 INFO:teuthology.orchestra.run.smithi195.stdout:(24/131): rbd-fuse-18.0.0-6786.gf7420d7f.el8.x8 1.0 MB/s | 94 kB 00:00 2023-10-19T12:30:42.923 INFO:teuthology.orchestra.run.smithi157.stdout:(86/131): python3-werkzeug-0.12.2-4.el8.noarch. 9.0 MB/s | 457 kB 00:00 2023-10-19T12:30:42.965 INFO:teuthology.orchestra.run.smithi157.stdout:(87/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 5.3 MB/s | 225 kB 00:00 2023-10-19T12:30:43.007 INFO:teuthology.orchestra.run.smithi157.stdout:(88/131): uuid-1.6.2-43.el8.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2023-10-19T12:30:43.082 INFO:teuthology.orchestra.run.smithi157.stdout:(89/131): python3-babel-2.5.1-7.el8.noarch.rpm 7.1 MB/s | 4.8 MB 00:00 2023-10-19T12:30:43.107 INFO:teuthology.orchestra.run.smithi157.stdout:(90/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.2 MB/s | 126 kB 00:00 2023-10-19T12:30:43.133 INFO:teuthology.orchestra.run.smithi157.stdout:(91/131): python3-jsonpointer-1.10-11.el8.noarc 398 kB/s | 20 kB 00:00 2023-10-19T12:30:43.216 INFO:teuthology.orchestra.run.smithi157.stdout:(92/131): python3-numpy-1.14.3-10.el8.x86_64.rp 10 MB/s | 3.7 MB 00:00 2023-10-19T12:30:43.242 INFO:teuthology.orchestra.run.smithi157.stdout:(93/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 773 kB/s | 103 kB 00:00 2023-10-19T12:30:43.284 INFO:teuthology.orchestra.run.smithi157.stdout:(94/131): libtool-2.4.6-25.el8.x86_64.rpm 4.6 MB/s | 709 kB 00:00 2023-10-19T12:30:43.309 INFO:teuthology.orchestra.run.smithi157.stdout:(95/131): libpq-13.5-1.el8.x86_64.rpm 2.9 MB/s | 198 kB 00:00 2023-10-19T12:30:43.351 INFO:teuthology.orchestra.run.smithi157.stdout:(96/131): jq-1.6-3.el8.x86_64.rpm 4.7 MB/s | 202 kB 00:00 2023-10-19T12:30:43.401 INFO:teuthology.orchestra.run.smithi157.stdout:(97/131): librdkafka-0.11.4-3.el8.x86_64.rpm 6.9 MB/s | 354 kB 00:00 2023-10-19T12:30:43.493 INFO:teuthology.orchestra.run.smithi157.stdout:(98/131): openblas-threads-0.3.15-3.el8.x86_64. 18 MB/s | 4.9 MB 00:00 2023-10-19T12:30:43.592 INFO:teuthology.orchestra.run.smithi157.stdout:(99/131): openblas-0.3.15-3.el8.x86_64.rpm 15 MB/s | 4.7 MB 00:00 2023-10-19T12:30:43.644 INFO:teuthology.orchestra.run.smithi157.stdout:(100/131): postgresql-contrib-10.21-2.module+el 5.3 MB/s | 808 kB 00:00 2023-10-19T12:30:43.677 INFO:teuthology.orchestra.run.smithi157.stdout:(101/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2023-10-19T12:30:43.719 INFO:teuthology.orchestra.run.smithi157.stdout:(102/131): postgresql-10.21-2.module+el8.6.0+15 12 MB/s | 1.5 MB 00:00 2023-10-19T12:30:43.745 INFO:teuthology.orchestra.run.smithi157.stdout:(103/131): libselinux-devel-2.9-5.el8.x86_64.rp 2.9 MB/s | 200 kB 00:00 2023-10-19T12:30:43.761 INFO:teuthology.orchestra.run.smithi157.stdout:(104/131): python3-jwt-1.6.1-2.el8.noarch.rpm 1.0 MB/s | 43 kB 00:00 2023-10-19T12:30:43.787 INFO:teuthology.orchestra.run.smithi157.stdout:(105/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 5.2 MB/s | 220 kB 00:00 2023-10-19T12:30:43.812 INFO:teuthology.orchestra.run.smithi157.stdout:(106/131): keyutils-libs-devel-1.5.10-9.el8.x86 958 kB/s | 48 kB 00:00 2023-10-19T12:30:43.837 INFO:teuthology.orchestra.run.smithi157.stdout:(107/131): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2023-10-19T12:30:43.863 INFO:teuthology.orchestra.run.smithi157.stdout:(108/131): python3-requests-oauthlib-1.0.0-1.el 850 kB/s | 43 kB 00:00 2023-10-19T12:30:43.872 INFO:teuthology.orchestra.run.smithi195.stdout:(25/131): librgw2-18.0.0-6786.gf7420d7f.el8.x86 3.2 MB/s | 6.9 MB 00:02 2023-10-19T12:30:43.889 INFO:teuthology.orchestra.run.smithi157.stdout:(109/131): python3-pycparser-2.14-14.el8.noarch 2.1 MB/s | 109 kB 00:00 2023-10-19T12:30:43.913 INFO:teuthology.orchestra.run.smithi157.stdout:(110/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 4.4 MB/s | 229 kB 00:00 2023-10-19T12:30:43.972 INFO:teuthology.orchestra.run.smithi195.stdout:(26/131): rbd-nbd-18.0.0-6786.gf7420d7f.el8.x86 1.8 MB/s | 178 kB 00:00 2023-10-19T12:30:44.022 INFO:teuthology.orchestra.run.smithi157.stdout:(111/131): postgresql-server-10.21-2.module+el8 8.2 MB/s | 5.1 MB 00:00 2023-10-19T12:30:44.039 INFO:teuthology.orchestra.run.smithi195.stdout:(27/131): ceph-grafana-dashboards-18.0.0-6786.g 346 kB/s | 23 kB 00:00 2023-10-19T12:30:44.047 INFO:teuthology.orchestra.run.smithi157.stdout:(112/131): libaio-devel-0.3.112-1.el8.x86_64.rp 140 kB/s | 19 kB 00:00 2023-10-19T12:30:44.073 INFO:teuthology.orchestra.run.smithi157.stdout:(113/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 3.0 MB/s | 560 kB 00:00 2023-10-19T12:30:44.106 INFO:teuthology.orchestra.run.smithi195.stdout:(28/131): ceph-mgr-cephadm-18.0.0-6786.gf7420d7 1.9 MB/s | 132 kB 00:00 2023-10-19T12:30:44.107 INFO:teuthology.orchestra.run.smithi157.stdout:(114/131): python3-oauthlib-2.1.0-1.el8.noarch. 1.8 MB/s | 155 kB 00:00 2023-10-19T12:30:44.131 INFO:teuthology.orchestra.run.smithi157.stdout:(115/131): libverto-devel-0.3.0-5.el8.x86_64.rp 305 kB/s | 18 kB 00:00 2023-10-19T12:30:44.137 INFO:teuthology.orchestra.run.smithi046.stdout:(10/131): ceph-radosgw-18.0.0-6786.gf7420d7f.el 2.4 MB/s | 14 MB 00:05 2023-10-19T12:30:44.173 INFO:teuthology.orchestra.run.smithi157.stdout:(116/131): python3-cryptography-3.2.1-5.el8.x86 4.3 MB/s | 559 kB 00:00 2023-10-19T12:30:44.207 INFO:teuthology.orchestra.run.smithi157.stdout:(117/131): pcre2-devel-10.32-2.el8.x86_64.rpm 5.9 MB/s | 605 kB 00:00 2023-10-19T12:30:44.223 INFO:teuthology.orchestra.run.smithi195.stdout:(29/131): rbd-mirror-18.0.0-6786.gf7420d7f.el8. 2.7 MB/s | 3.6 MB 00:01 2023-10-19T12:30:44.232 INFO:teuthology.orchestra.run.smithi157.stdout:(118/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 2.3 MB/s | 238 kB 00:00 2023-10-19T12:30:44.250 INFO:teuthology.orchestra.run.smithi157.stdout:(119/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 1.7 MB/s | 72 kB 00:00 2023-10-19T12:30:44.266 INFO:teuthology.orchestra.run.smithi157.stdout:(120/131): fuse-2.9.7-15.el8.x86_64.rpm 2.4 MB/s | 83 kB 00:00 2023-10-19T12:30:44.292 INFO:teuthology.orchestra.run.smithi157.stdout:(121/131): elfutils-libelf-devel-0.186-1.el8.x8 1.4 MB/s | 60 kB 00:00 2023-10-19T12:30:44.317 INFO:teuthology.orchestra.run.smithi157.stdout:(122/131): libuuid-devel-2.32.1-35.el8.x86_64.r 1.9 MB/s | 98 kB 00:00 2023-10-19T12:30:44.342 INFO:teuthology.orchestra.run.smithi157.stdout:(123/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 1.1 MB/s | 58 kB 00:00 2023-10-19T12:30:44.395 INFO:teuthology.orchestra.run.smithi157.stdout:(124/131): libcom_err-devel-1.45.6-4.el8.x86_64 494 kB/s | 39 kB 00:00 2023-10-19T12:30:44.415 INFO:teuthology.orchestra.run.smithi195.stdout:(30/131): ceph-mgr-dashboard-18.0.0-6786.gf7420 5.7 MB/s | 1.8 MB 00:00 2023-10-19T12:30:44.443 INFO:teuthology.orchestra.run.smithi157.stdout:(125/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 6.3 MB/s | 644 kB 00:00 2023-10-19T12:30:44.468 INFO:teuthology.orchestra.run.smithi157.stdout:(126/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 2.3 MB/s | 171 kB 00:00 2023-10-19T12:30:44.493 INFO:teuthology.orchestra.run.smithi157.stdout:(127/131): NetworkManager-initscripts-updown-1. 2.7 MB/s | 138 kB 00:00 2023-10-19T12:30:44.552 INFO:teuthology.orchestra.run.smithi157.stdout:(128/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 6.1 MB/s | 2.3 MB 00:00 2023-10-19T12:30:44.579 INFO:teuthology.orchestra.run.smithi046.stdout:(11/131): ceph-test-18.0.0-6786.gf7420d7f.el8.x 11 MB/s | 49 MB 00:04 2023-10-19T12:30:44.604 INFO:teuthology.orchestra.run.smithi046.stdout:(12/131): cephfs-mirror-18.0.0-6786.gf7420d7f.e 560 kB/s | 261 kB 00:00 2023-10-19T12:30:44.619 INFO:teuthology.orchestra.run.smithi157.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 12 MB/s | 798 kB 00:00 2023-10-19T12:30:44.630 INFO:teuthology.orchestra.run.smithi046.stdout:(13/131): libcephfs-devel-18.0.0-6786.gf7420d7f 620 kB/s | 31 kB 00:00 2023-10-19T12:30:44.705 INFO:teuthology.orchestra.run.smithi046.stdout:(14/131): libcephsqlite-18.0.0-6786.gf7420d7f.e 2.4 MB/s | 185 kB 00:00 2023-10-19T12:30:44.764 INFO:teuthology.orchestra.run.smithi046.stdout:(15/131): librados-devel-18.0.0-6786.gf7420d7f. 2.3 MB/s | 139 kB 00:00 2023-10-19T12:30:44.797 INFO:teuthology.orchestra.run.smithi046.stdout:(16/131): libcephfs2-18.0.0-6786.gf7420d7f.el8. 4.3 MB/s | 840 kB 00:00 2023-10-19T12:30:44.848 INFO:teuthology.orchestra.run.smithi046.stdout:(17/131): libradosstriper1-18.0.0-6786.gf7420d7 6.1 MB/s | 518 kB 00:00 2023-10-19T12:30:44.891 INFO:teuthology.orchestra.run.smithi195.stdout:(31/131): ceph-test-18.0.0-6786.gf7420d7f.el8.x 6.1 MB/s | 49 MB 00:07 2023-10-19T12:30:44.898 INFO:teuthology.orchestra.run.smithi046.stdout:(18/131): python3-ceph-argparse-18.0.0-6786.gf7 903 kB/s | 45 kB 00:00 2023-10-19T12:30:44.917 INFO:teuthology.orchestra.run.smithi195.stdout:(32/131): ceph-mgr-modules-core-18.0.0-6786.gf7 485 kB/s | 242 kB 00:00 2023-10-19T12:30:44.941 INFO:teuthology.orchestra.run.smithi195.stdout:(33/131): ceph-mgr-rook-18.0.0-6786.gf7420d7f.e 950 kB/s | 47 kB 00:00 2023-10-19T12:30:44.965 INFO:teuthology.orchestra.run.smithi046.stdout:(19/131): python3-ceph-common-18.0.0-6786.gf742 1.8 MB/s | 125 kB 00:00 2023-10-19T12:30:44.974 INFO:teuthology.orchestra.run.smithi195.stdout:(34/131): ceph-prometheus-alerts-18.0.0-6786.gf 256 kB/s | 15 kB 00:00 2023-10-19T12:30:45.023 INFO:teuthology.orchestra.run.smithi046.stdout:(20/131): python3-cephfs-18.0.0-6786.gf7420d7f. 3.3 MB/s | 196 kB 00:00 2023-10-19T12:30:45.041 INFO:teuthology.orchestra.run.smithi195.stdout:(35/131): ceph-volume-18.0.0-6786.gf7420d7f.el8 2.6 MB/s | 261 kB 00:00 2023-10-19T12:30:45.099 INFO:teuthology.orchestra.run.smithi046.stdout:(21/131): python3-rados-18.0.0-6786.gf7420d7f.e 4.8 MB/s | 370 kB 00:00 2023-10-19T12:30:45.108 INFO:teuthology.orchestra.run.smithi195.stdout:(36/131): cephfs-top-18.0.0-6786.gf7420d7f.el8. 271 kB/s | 18 kB 00:00 2023-10-19T12:30:45.134 INFO:teuthology.orchestra.run.smithi195.stdout:(37/131): cephadm-18.0.0-6786.gf7420d7f.el8.noa 1.2 MB/s | 192 kB 00:00 2023-10-19T12:30:45.144 INFO:teuthology.orchestra.run.smithi157.stdout:(130/131): librados2-18.0.0-6786.gf7420d7f.el8. 5.5 MB/s | 3.7 MB 00:00 2023-10-19T12:30:45.157 INFO:teuthology.orchestra.run.smithi046.stdout:(22/131): python3-rbd-18.0.0-6786.gf7420d7f.el8 6.1 MB/s | 364 kB 00:00 2023-10-19T12:30:45.208 INFO:teuthology.orchestra.run.smithi046.stdout:(23/131): python3-rgw-18.0.0-6786.gf7420d7f.el8 2.1 MB/s | 107 kB 00:00 2023-10-19T12:30:45.219 INFO:teuthology.orchestra.run.smithi157.stdout:(131/131): librbd1-18.0.0-6786.gf7420d7f.el8.x8 5.1 MB/s | 3.7 MB 00:00 2023-10-19T12:30:45.221 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2023-10-19T12:30:45.222 INFO:teuthology.orchestra.run.smithi157.stdout:Total 14 MB/s | 209 MB 00:14 2023-10-19T12:30:45.258 INFO:teuthology.orchestra.run.smithi046.stdout:(24/131): rbd-fuse-18.0.0-6786.gf7420d7f.el8.x8 1.8 MB/s | 94 kB 00:00 2023-10-19T12:30:45.409 INFO:teuthology.orchestra.run.smithi195.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 214 kB/s | 59 kB 00:00 2023-10-19T12:30:45.509 INFO:teuthology.orchestra.run.smithi195.stdout:(39/131): libunwind-1.3.1-3.el8.x86_64.rpm 751 kB/s | 75 kB 00:00 2023-10-19T12:30:45.535 INFO:teuthology.orchestra.run.smithi195.stdout:(40/131): gperftools-libs-2.7-9.el8.x86_64.rpm 719 kB/s | 306 kB 00:00 2023-10-19T12:30:45.550 INFO:teuthology.orchestra.run.smithi046.stdout:(25/131): rbd-mirror-18.0.0-6786.gf7420d7f.el8. 12 MB/s | 3.6 MB 00:00 2023-10-19T12:30:45.600 INFO:teuthology.orchestra.run.smithi046.stdout:(26/131): rbd-nbd-18.0.0-6786.gf7420d7f.el8.x86 3.5 MB/s | 178 kB 00:00 2023-10-19T12:30:45.626 INFO:teuthology.orchestra.run.smithi195.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 476 kB/s | 44 kB 00:00 2023-10-19T12:30:45.642 INFO:teuthology.orchestra.run.smithi046.stdout:(27/131): ceph-grafana-dashboards-18.0.0-6786.g 556 kB/s | 23 kB 00:00 2023-10-19T12:30:45.692 INFO:teuthology.orchestra.run.smithi046.stdout:(28/131): ceph-mgr-cephadm-18.0.0-6786.gf7420d7 2.6 MB/s | 132 kB 00:00 2023-10-19T12:30:45.719 INFO:teuthology.orchestra.run.smithi195.stdout:(42/131): python3-asyncssh-2.7.0-2.el8.noarch.r 2.2 MB/s | 476 kB 00:00 2023-10-19T12:30:45.744 INFO:teuthology.orchestra.run.smithi195.stdout:(43/131): python3-beautifulsoup4-4.6.3-2.el8.1. 1.5 MB/s | 185 kB 00:00 2023-10-19T12:30:45.786 INFO:teuthology.orchestra.run.smithi195.stdout:(44/131): python3-cachetools-3.1.1-4.el8.noarch 493 kB/s | 33 kB 00:00 2023-10-19T12:30:45.811 INFO:teuthology.orchestra.run.smithi195.stdout:(45/131): python3-certifi-2018.10.15-7.el8.noar 243 kB/s | 16 kB 00:00 2023-10-19T12:30:45.851 INFO:teuthology.orchestra.run.smithi046.stdout:(29/131): ceph-mgr-dashboard-18.0.0-6786.gf7420 11 MB/s | 1.8 MB 00:00 2023-10-19T12:30:45.870 INFO:teuthology.orchestra.run.smithi195.stdout:(46/131): python3-cheroot-8.5.2-1.el8.noarch.rp 2.0 MB/s | 173 kB 00:00 2023-10-19T12:30:45.929 INFO:teuthology.orchestra.run.smithi195.stdout:(47/131): python3-cherrypy-18.4.0-1.el8.noarch. 3.2 MB/s | 384 kB 00:00 2023-10-19T12:30:45.954 INFO:teuthology.orchestra.run.smithi195.stdout:(48/131): python3-google-auth-1.1.1-10.el8.noar 975 kB/s | 81 kB 00:00 2023-10-19T12:30:46.004 INFO:teuthology.orchestra.run.smithi195.stdout:(49/131): python3-jaraco-6.2-6.el8.noarch.rpm 148 kB/s | 11 kB 00:00 2023-10-19T12:30:46.029 INFO:teuthology.orchestra.run.smithi195.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 234 kB/s | 18 kB 00:00 2023-10-19T12:30:46.083 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2023-10-19T12:30:46.113 INFO:teuthology.orchestra.run.smithi195.stdout:(51/131): ceph-mgr-diskprediction-local-18.0.0- 3.9 MB/s | 7.4 MB 00:01 2023-10-19T12:30:46.138 INFO:teuthology.orchestra.run.smithi195.stdout:(52/131): python3-logutils-0.3.5-11.el8.noarch. 449 kB/s | 49 kB 00:00 2023-10-19T12:30:46.180 INFO:teuthology.orchestra.run.smithi195.stdout:(53/131): python3-kubernetes-11.0.0-6.el8.noarc 6.6 MB/s | 1.2 MB 00:00 2023-10-19T12:30:46.203 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2023-10-19T12:30:46.203 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2023-10-19T12:30:46.214 INFO:teuthology.orchestra.run.smithi195.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 801 kB/s | 60 kB 00:00 2023-10-19T12:30:46.264 INFO:teuthology.orchestra.run.smithi195.stdout:(55/131): python3-pecan-1.3.2-9.el8.noarch.rpm 3.5 MB/s | 283 kB 00:00 2023-10-19T12:30:46.289 INFO:teuthology.orchestra.run.smithi195.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 207 kB/s | 16 kB 00:00 2023-10-19T12:30:46.326 INFO:teuthology.orchestra.run.smithi046.stdout:(30/131): librgw2-18.0.0-6786.gf7420d7f.el8.x86 4.5 MB/s | 6.9 MB 00:01 2023-10-19T12:30:46.340 INFO:teuthology.orchestra.run.smithi195.stdout:(57/131): python3-repoze-lru-0.7-6.el8.noarch.r 447 kB/s | 34 kB 00:00 2023-10-19T12:30:46.382 INFO:teuthology.orchestra.run.smithi195.stdout:(58/131): python3-routes-2.4.1-12.el8.noarch.rp 2.1 MB/s | 196 kB 00:00 2023-10-19T12:30:46.407 INFO:teuthology.orchestra.run.smithi195.stdout:(59/131): python3-more-itertools-7.2.0-3.el8.no 200 kB/s | 59 kB 00:00 2023-10-19T12:30:46.432 INFO:teuthology.orchestra.run.smithi195.stdout:(60/131): python3-rsa-4.9-2.el8.noarch.rpm 698 kB/s | 64 kB 00:00 2023-10-19T12:30:46.458 INFO:teuthology.orchestra.run.smithi195.stdout:(61/131): python3-simplegeneric-0.8.1-17.el8.no 248 kB/s | 19 kB 00:00 2023-10-19T12:30:46.460 INFO:teuthology.orchestra.run.smithi046.stdout:(31/131): ceph-mgr-diskprediction-local-18.0.0- 12 MB/s | 7.4 MB 00:00 2023-10-19T12:30:46.485 INFO:teuthology.orchestra.run.smithi046.stdout:(32/131): ceph-mgr-modules-core-18.0.0-6786.gf7 1.5 MB/s | 242 kB 00:00 2023-10-19T12:30:46.491 INFO:teuthology.orchestra.run.smithi195.stdout:(62/131): python3-singledispatch-3.4.0.3-18.el8 286 kB/s | 24 kB 00:00 2023-10-19T12:30:46.510 INFO:teuthology.orchestra.run.smithi046.stdout:(33/131): ceph-mgr-rook-18.0.0-6786.gf7420d7f.e 950 kB/s | 47 kB 00:00 2023-10-19T12:30:46.516 INFO:teuthology.orchestra.run.smithi195.stdout:(63/131): python3-tempora-1.14.1-5.el8.noarch.r 349 kB/s | 29 kB 00:00 2023-10-19T12:30:46.536 INFO:teuthology.orchestra.run.smithi046.stdout:(34/131): ceph-prometheus-alerts-18.0.0-6786.gf 299 kB/s | 15 kB 00:00 2023-10-19T12:30:46.550 INFO:teuthology.orchestra.run.smithi195.stdout:(64/131): python3-trustme-0.6.0-4.el8.noarch.rp 299 kB/s | 27 kB 00:00 2023-10-19T12:30:46.586 INFO:teuthology.orchestra.run.smithi046.stdout:(35/131): ceph-volume-18.0.0-6786.gf7420d7f.el8 3.4 MB/s | 261 kB 00:00 2023-10-19T12:30:46.612 INFO:teuthology.orchestra.run.smithi046.stdout:(36/131): cephadm-18.0.0-6786.gf7420d7f.el8.noa 2.5 MB/s | 192 kB 00:00 2023-10-19T12:30:46.617 INFO:teuthology.orchestra.run.smithi195.stdout:(65/131): python3-webob-1.8.5-1.el8.1.noarch.rp 2.4 MB/s | 251 kB 00:00 2023-10-19T12:30:46.637 INFO:teuthology.orchestra.run.smithi046.stdout:(37/131): cephfs-top-18.0.0-6786.gf7420d7f.el8. 361 kB/s | 18 kB 00:00 2023-10-19T12:30:46.642 INFO:teuthology.orchestra.run.smithi195.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 668 kB/s | 61 kB 00:00 2023-10-19T12:30:46.693 INFO:teuthology.orchestra.run.smithi195.stdout:(67/131): python3-webtest-2.0.33-1.el8.noarch.r 1.1 MB/s | 85 kB 00:00 2023-10-19T12:30:46.718 INFO:teuthology.orchestra.run.smithi195.stdout:(68/131): python3-zc-lockfile-2.0-2.el8.noarch. 304 kB/s | 23 kB 00:00 2023-10-19T12:30:46.737 INFO:teuthology.orchestra.run.smithi046.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 591 kB/s | 59 kB 00:00 2023-10-19T12:30:46.743 INFO:teuthology.orchestra.run.smithi195.stdout:(69/131): python3-waitress-1.4.3-1.el8.noarch.r 1.0 MB/s | 255 kB 00:00 2023-10-19T12:30:46.768 INFO:teuthology.orchestra.run.smithi195.stdout:(70/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.4 MB/s | 70 kB 00:00 2023-10-19T12:30:46.787 INFO:teuthology.orchestra.run.smithi046.stdout:(39/131): gperftools-libs-2.7-9.el8.x86_64.rpm 1.7 MB/s | 306 kB 00:00 2023-10-19T12:30:46.813 INFO:teuthology.orchestra.run.smithi046.stdout:(40/131): libunwind-1.3.1-3.el8.x86_64.rpm 999 kB/s | 75 kB 00:00 2023-10-19T12:30:46.827 INFO:teuthology.orchestra.run.smithi195.stdout:(71/131): thrift-0.13.0-2.el8.x86_64.rpm 13 MB/s | 1.7 MB 00:00 2023-10-19T12:30:46.855 INFO:teuthology.orchestra.run.smithi046.stdout:(41/131): python3-asyncssh-2.7.0-2.el8.noarch.r 7.0 MB/s | 476 kB 00:00 2023-10-19T12:30:46.861 INFO:teuthology.orchestra.run.smithi195.stdout:(72/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 399 kB/s | 47 kB 00:00 2023-10-19T12:30:46.880 INFO:teuthology.orchestra.run.smithi046.stdout:(42/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 654 kB/s | 44 kB 00:00 2023-10-19T12:30:46.911 INFO:teuthology.orchestra.run.smithi195.stdout:(73/131): libselinux-devel-2.9-5.el8.x86_64.rpm 1.4 MB/s | 200 kB 00:00 2023-10-19T12:30:46.930 INFO:teuthology.orchestra.run.smithi046.stdout:(43/131): python3-beautifulsoup4-4.6.3-2.el8.1. 2.4 MB/s | 185 kB 00:00 2023-10-19T12:30:46.936 INFO:teuthology.orchestra.run.smithi195.stdout:(74/131): python3-jwt-1.6.1-2.el8.noarch.rpm 413 kB/s | 43 kB 00:00 2023-10-19T12:30:46.962 INFO:teuthology.orchestra.run.smithi195.stdout:(75/131): keyutils-libs-devel-1.5.10-9.el8.x86_ 962 kB/s | 48 kB 00:00 2023-10-19T12:30:46.987 INFO:teuthology.orchestra.run.smithi195.stdout:(76/131): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2023-10-19T12:30:47.012 INFO:teuthology.orchestra.run.smithi195.stdout:(77/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 1.5 MB/s | 220 kB 00:00 2023-10-19T12:30:47.037 INFO:teuthology.orchestra.run.smithi195.stdout:(78/131): python3-requests-oauthlib-1.0.0-1.el8 566 kB/s | 43 kB 00:00 2023-10-19T12:30:47.062 INFO:teuthology.orchestra.run.smithi195.stdout:(79/131): python3-pycparser-2.14-14.el8.noarch. 1.4 MB/s | 109 kB 00:00 2023-10-19T12:30:47.079 INFO:teuthology.orchestra.run.smithi195.stdout:(80/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 3.3 MB/s | 229 kB 00:00 2023-10-19T12:30:47.096 INFO:teuthology.orchestra.run.smithi195.stdout:(81/131): libaio-devel-0.3.112-1.el8.x86_64.rpm 558 kB/s | 19 kB 00:00 2023-10-19T12:30:47.122 INFO:teuthology.orchestra.run.smithi195.stdout:(82/131): python3-oauthlib-2.1.0-1.el8.noarch.r 3.6 MB/s | 155 kB 00:00 2023-10-19T12:30:47.147 INFO:teuthology.orchestra.run.smithi195.stdout:(83/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 5.0 MB/s | 560 kB 00:00 2023-10-19T12:30:47.147 INFO:teuthology.orchestra.run.smithi046.stdout:(44/131): ceph-common-18.0.0-6786.gf7420d7f.el8 1.9 MB/s | 23 MB 00:11 2023-10-19T12:30:47.165 INFO:teuthology.orchestra.run.smithi195.stdout:(84/131): libverto-devel-0.3.0-5.el8.x86_64.rpm 431 kB/s | 18 kB 00:00 2023-10-19T12:30:47.173 INFO:teuthology.orchestra.run.smithi046.stdout:(45/131): python3-cachetools-3.1.1-4.el8.noarch 113 kB/s | 33 kB 00:00 2023-10-19T12:30:47.197 INFO:teuthology.orchestra.run.smithi195.stdout:(85/131): python3-cryptography-3.2.1-5.el8.x86_ 5.4 MB/s | 559 kB 00:00 2023-10-19T12:30:47.198 INFO:teuthology.orchestra.run.smithi046.stdout:(46/131): python3-certifi-2018.10.15-7.el8.noar 61 kB/s | 16 kB 00:00 2023-10-19T12:30:47.223 INFO:teuthology.orchestra.run.smithi195.stdout:(86/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 4.0 MB/s | 238 kB 00:00 2023-10-19T12:30:47.257 INFO:teuthology.orchestra.run.smithi195.stdout:(87/131): pcre2-devel-10.32-2.el8.x86_64.rpm 5.4 MB/s | 605 kB 00:00 2023-10-19T12:30:47.264 INFO:teuthology.orchestra.run.smithi046.stdout:(47/131): python3-cherrypy-18.4.0-1.el8.noarch. 5.7 MB/s | 384 kB 00:00 2023-10-19T12:30:47.282 INFO:teuthology.orchestra.run.smithi195.stdout:(88/131): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 1.2 MB/s | 72 kB 00:00 2023-10-19T12:30:47.290 INFO:teuthology.orchestra.run.smithi046.stdout:(48/131): python3-google-auth-1.1.1-10.el8.noar 888 kB/s | 81 kB 00:00 2023-10-19T12:30:47.307 INFO:teuthology.orchestra.run.smithi195.stdout:(89/131): fuse-2.9.7-15.el8.x86_64.rpm 1.6 MB/s | 83 kB 00:00 2023-10-19T12:30:47.324 INFO:teuthology.orchestra.run.smithi046.stdout:(49/131): python3-jaraco-6.2-6.el8.noarch.rpm 189 kB/s | 11 kB 00:00 2023-10-19T12:30:47.332 INFO:teuthology.orchestra.run.smithi195.stdout:(90/131): elfutils-libelf-devel-0.186-1.el8.x86 1.2 MB/s | 60 kB 00:00 2023-10-19T12:30:47.335 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2023-10-19T12:30:47.340 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2023-10-19T12:30:47.349 INFO:teuthology.orchestra.run.smithi046.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 299 kB/s | 18 kB 00:00 2023-10-19T12:30:47.374 INFO:teuthology.orchestra.run.smithi195.stdout:(91/131): libuuid-devel-2.32.1-35.el8.x86_64.rp 1.4 MB/s | 98 kB 00:00 2023-10-19T12:30:47.391 INFO:teuthology.orchestra.run.smithi046.stdout:(51/131): python3-cheroot-8.5.2-1.el8.noarch.rp 710 kB/s | 173 kB 00:00 2023-10-19T12:30:47.399 INFO:teuthology.orchestra.run.smithi195.stdout:(92/131): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 862 kB/s | 58 kB 00:00 2023-10-19T12:30:47.416 INFO:teuthology.orchestra.run.smithi046.stdout:(52/131): python3-logutils-0.3.5-11.el8.noarch. 734 kB/s | 49 kB 00:00 2023-10-19T12:30:47.425 INFO:teuthology.orchestra.run.smithi195.stdout:(93/131): libcom_err-devel-1.45.6-4.el8.x86_64. 769 kB/s | 39 kB 00:00 2023-10-19T12:30:47.442 INFO:teuthology.orchestra.run.smithi046.stdout:(53/131): python3-more-itertools-7.2.0-3.el8.no 1.1 MB/s | 59 kB 00:00 2023-10-19T12:30:47.466 INFO:teuthology.orchestra.run.smithi195.stdout:(94/131): openssl-devel-1.1.1k-7.el8_6.x86_64.r 8.7 MB/s | 2.3 MB 00:00 2023-10-19T12:30:47.467 INFO:teuthology.orchestra.run.smithi046.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 1.2 MB/s | 60 kB 00:00 2023-10-19T12:30:47.492 INFO:teuthology.orchestra.run.smithi195.stdout:(95/131): libquadmath-8.5.0-10.1.el8_6.x86_64.r 2.5 MB/s | 171 kB 00:00 2023-10-19T12:30:47.492 INFO:teuthology.orchestra.run.smithi046.stdout:(55/131): python3-pecan-1.3.2-9.el8.noarch.rpm 5.5 MB/s | 283 kB 00:00 2023-10-19T12:30:47.517 INFO:teuthology.orchestra.run.smithi046.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 311 kB/s | 16 kB 00:00 2023-10-19T12:30:47.525 INFO:teuthology.orchestra.run.smithi195.stdout:(96/131): libgfortran-8.5.0-10.1.el8_6.x86_64.r 5.0 MB/s | 644 kB 00:00 2023-10-19T12:30:47.534 INFO:teuthology.orchestra.run.smithi046.stdout:(57/131): python3-repoze-lru-0.7-6.el8.noarch.r 811 kB/s | 34 kB 00:00 2023-10-19T12:30:47.551 INFO:teuthology.orchestra.run.smithi195.stdout:(97/131): NetworkManager-initscripts-updown-1.3 1.6 MB/s | 138 kB 00:00 2023-10-19T12:30:47.568 INFO:teuthology.orchestra.run.smithi046.stdout:(58/131): python3-kubernetes-11.0.0-6.el8.noarc 4.8 MB/s | 1.2 MB 00:00 2023-10-19T12:30:47.576 INFO:teuthology.orchestra.run.smithi195.stdout:(98/131): python3-pyasn1-modules-0.3.7-6.el8.no 2.1 MB/s | 110 kB 00:00 2023-10-19T12:30:47.610 INFO:teuthology.orchestra.run.smithi195.stdout:(99/131): python3-pytz-2017.2-9.el8.noarch.rpm 929 kB/s | 54 kB 00:00 2023-10-19T12:30:47.626 INFO:teuthology.orchestra.run.smithi046.stdout:(59/131): python3-rsa-4.9-2.el8.noarch.rpm 702 kB/s | 64 kB 00:00 2023-10-19T12:30:47.635 INFO:teuthology.orchestra.run.smithi195.stdout:(100/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 4.3 MB/s | 259 kB 00:00 2023-10-19T12:30:47.652 INFO:teuthology.orchestra.run.smithi046.stdout:(60/131): python3-simplegeneric-0.8.1-17.el8.no 224 kB/s | 19 kB 00:00 2023-10-19T12:30:47.669 INFO:teuthology.orchestra.run.smithi046.stdout:(61/131): python3-singledispatch-3.4.0.3-18.el8 568 kB/s | 24 kB 00:00 2023-10-19T12:30:47.669 INFO:teuthology.orchestra.run.smithi195.stdout:(101/131): socat-1.7.4.1-1.el8.x86_64.rpm 5.4 MB/s | 323 kB 00:00 2023-10-19T12:30:47.694 INFO:teuthology.orchestra.run.smithi195.stdout:(102/131): python3-markupsafe-0.23-19.el8.x86_6 661 kB/s | 39 kB 00:00 2023-10-19T12:30:47.695 INFO:teuthology.orchestra.run.smithi046.stdout:(62/131): python3-routes-2.4.1-12.el8.noarch.rp 1.1 MB/s | 196 kB 00:00 2023-10-19T12:30:47.711 INFO:teuthology.orchestra.run.smithi046.stdout:(63/131): python3-tempora-1.14.1-5.el8.noarch.r 497 kB/s | 29 kB 00:00 2023-10-19T12:30:47.728 INFO:teuthology.orchestra.run.smithi195.stdout:(103/131): bison-3.0.4-10.el8.x86_64.rpm 11 MB/s | 688 kB 00:00 2023-10-19T12:30:47.728 INFO:teuthology.orchestra.run.smithi046.stdout:(64/131): python3-trustme-0.6.0-4.el8.noarch.rp 470 kB/s | 27 kB 00:00 2023-10-19T12:30:47.753 INFO:teuthology.orchestra.run.smithi046.stdout:(65/131): python3-waitress-1.4.3-1.el8.noarch.r 4.3 MB/s | 255 kB 00:00 2023-10-19T12:30:47.761 INFO:teuthology.orchestra.run.smithi195.stdout:(104/131): python3-jinja2-2.10.1-3.el8.noarch.r 7.9 MB/s | 538 kB 00:00 2023-10-19T12:30:47.770 INFO:teuthology.orchestra.run.smithi046.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 1.4 MB/s | 61 kB 00:00 2023-10-19T12:30:47.787 INFO:teuthology.orchestra.run.smithi195.stdout:(105/131): python3-mako-1.0.6-13.el8.noarch.rpm 2.6 MB/s | 157 kB 00:00 2023-10-19T12:30:47.796 INFO:teuthology.orchestra.run.smithi046.stdout:(67/131): python3-webob-1.8.5-1.el8.1.noarch.rp 3.7 MB/s | 251 kB 00:00 2023-10-19T12:30:47.812 INFO:teuthology.orchestra.run.smithi195.stdout:(106/131): oniguruma-6.8.2-2.el8.x86_64.rpm 3.6 MB/s | 187 kB 00:00 2023-10-19T12:30:47.812 INFO:teuthology.orchestra.run.smithi046.stdout:(68/131): python3-zc-lockfile-2.0-2.el8.noarch. 549 kB/s | 23 kB 00:00 2023-10-19T12:30:47.838 INFO:teuthology.orchestra.run.smithi046.stdout:(69/131): python3-webtest-2.0.33-1.el8.noarch.r 1.0 MB/s | 85 kB 00:00 2023-10-19T12:30:47.845 INFO:teuthology.orchestra.run.smithi195.stdout:(107/131): automake-1.16.1-7.el8.noarch.rpm 12 MB/s | 713 kB 00:00 2023-10-19T12:30:47.863 INFO:teuthology.orchestra.run.smithi046.stdout:(70/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.4 MB/s | 70 kB 00:00 2023-10-19T12:30:47.896 INFO:teuthology.orchestra.run.smithi195.stdout:(108/131): python3-jsonpatch-1.21-2.el8.noarch. 531 kB/s | 27 kB 00:00 2023-10-19T12:30:47.913 INFO:teuthology.orchestra.run.smithi046.stdout:(71/131): thrift-0.13.0-2.el8.x86_64.rpm 15 MB/s | 1.7 MB 00:00 2023-10-19T12:30:47.954 INFO:teuthology.orchestra.run.smithi195.stdout:(109/131): flex-2.6.1-9.el8.x86_64.rpm 5.4 MB/s | 320 kB 00:00 2023-10-19T12:30:47.997 INFO:teuthology.orchestra.run.smithi046.stdout:(72/131): python3-pyasn1-modules-0.3.7-6.el8.no 881 kB/s | 110 kB 00:00 2023-10-19T12:30:48.022 INFO:teuthology.orchestra.run.smithi046.stdout:(73/131): python3-pytz-2017.2-9.el8.noarch.rpm 541 kB/s | 54 kB 00:00 2023-10-19T12:30:48.030 INFO:teuthology.orchestra.run.smithi195.stdout:(110/131): python3-babel-2.5.1-7.el8.noarch.rpm 22 MB/s | 4.8 MB 00:00 2023-10-19T12:30:48.055 INFO:teuthology.orchestra.run.smithi195.stdout:(111/131): python3-prettytable-0.7.2-14.el8.noa 438 kB/s | 44 kB 00:00 2023-10-19T12:30:48.056 INFO:teuthology.orchestra.run.smithi046.stdout:(74/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 4.3 MB/s | 259 kB 00:00 2023-10-19T12:30:48.089 INFO:teuthology.orchestra.run.smithi046.stdout:(75/131): socat-1.7.4.1-1.el8.x86_64.rpm 4.7 MB/s | 323 kB 00:00 2023-10-19T12:30:48.131 INFO:teuthology.orchestra.run.smithi046.stdout:(76/131): python3-markupsafe-0.23-19.el8.x86_64 518 kB/s | 39 kB 00:00 2023-10-19T12:30:48.182 INFO:teuthology.orchestra.run.smithi046.stdout:(77/131): bison-3.0.4-10.el8.x86_64.rpm 7.3 MB/s | 688 kB 00:00 2023-10-19T12:30:48.224 INFO:teuthology.orchestra.run.smithi046.stdout:(78/131): python3-jinja2-2.10.1-3.el8.noarch.rp 5.7 MB/s | 538 kB 00:00 2023-10-19T12:30:48.249 INFO:teuthology.orchestra.run.smithi046.stdout:(79/131): python3-mako-1.0.6-13.el8.noarch.rpm 2.3 MB/s | 157 kB 00:00 2023-10-19T12:30:48.256 INFO:teuthology.orchestra.run.smithi195.stdout:(112/131): python3-numpy-1.14.3-10.el8.x86_64.r 17 MB/s | 3.7 MB 00:00 2023-10-19T12:30:48.289 INFO:teuthology.orchestra.run.smithi195.stdout:(113/131): python3-werkzeug-0.12.2-4.el8.noarch 1.9 MB/s | 457 kB 00:00 2023-10-19T12:30:48.332 INFO:teuthology.orchestra.run.smithi046.stdout:(80/131): oniguruma-6.8.2-2.el8.x86_64.rpm 1.7 MB/s | 187 kB 00:00 2023-10-19T12:30:48.383 INFO:teuthology.orchestra.run.smithi046.stdout:(81/131): automake-1.16.1-7.el8.noarch.rpm 5.2 MB/s | 713 kB 00:00 2023-10-19T12:30:48.423 INFO:teuthology.orchestra.run.smithi195.stdout:(114/131): python3-scipy-1.0.0-21.module+el8.5. 15 MB/s | 14 MB 00:00 2023-10-19T12:30:48.433 INFO:teuthology.orchestra.run.smithi046.stdout:(82/131): python3-jsonpatch-1.21-2.el8.noarch.r 531 kB/s | 27 kB 00:00 2023-10-19T12:30:48.448 INFO:teuthology.orchestra.run.smithi195.stdout:(115/131): python3-numpy-f2py-1.14.3-10.el8.x86 1.1 MB/s | 225 kB 00:00 2023-10-19T12:30:48.465 INFO:teuthology.orchestra.run.smithi195.stdout:(116/131): uuid-1.6.2-43.el8.x86_64.rpm 365 kB/s | 64 kB 00:00 2023-10-19T12:30:48.490 INFO:teuthology.orchestra.run.smithi195.stdout:(117/131): python3-pyasn1-0.3.7-6.el8.noarch.rp 1.8 MB/s | 126 kB 00:00 2023-10-19T12:30:48.492 INFO:teuthology.orchestra.run.smithi046.stdout:(83/131): flex-2.6.1-9.el8.x86_64.rpm 5.4 MB/s | 320 kB 00:00 2023-10-19T12:30:48.507 INFO:teuthology.orchestra.run.smithi195.stdout:(118/131): python3-jsonpointer-1.10-11.el8.noar 339 kB/s | 20 kB 00:00 2023-10-19T12:30:48.540 INFO:teuthology.orchestra.run.smithi195.stdout:(119/131): python3-pyOpenSSL-19.0.0-1.el8.noarc 1.3 MB/s | 103 kB 00:00 2023-10-19T12:30:48.559 INFO:teuthology.orchestra.run.smithi046.stdout:(84/131): python3-prettytable-0.7.2-14.el8.noar 660 kB/s | 44 kB 00:00 2023-10-19T12:30:48.574 INFO:teuthology.orchestra.run.smithi195.stdout:(120/131): libtool-2.4.6-25.el8.x86_64.rpm 8.2 MB/s | 709 kB 00:00 2023-10-19T12:30:48.599 INFO:teuthology.orchestra.run.smithi195.stdout:(121/131): libpq-13.5-1.el8.x86_64.rpm 3.3 MB/s | 198 kB 00:00 2023-10-19T12:30:48.634 INFO:teuthology.orchestra.run.smithi046.stdout:(85/131): python3-babel-2.5.1-7.el8.noarch.rpm 16 MB/s | 4.8 MB 00:00 2023-10-19T12:30:48.650 INFO:teuthology.orchestra.run.smithi195.stdout:(122/131): jq-1.6-3.el8.x86_64.rpm 4.0 MB/s | 202 kB 00:00 2023-10-19T12:30:48.692 INFO:teuthology.orchestra.run.smithi195.stdout:(123/131): librdkafka-0.11.4-3.el8.x86_64.rpm 8.3 MB/s | 354 kB 00:00 2023-10-19T12:30:48.767 INFO:teuthology.orchestra.run.smithi195.stdout:(124/131): openblas-threads-0.3.15-3.el8.x86_64 19 MB/s | 4.9 MB 00:00 2023-10-19T12:30:48.793 INFO:teuthology.orchestra.run.smithi046.stdout:(86/131): python3-scipy-1.0.0-21.module+el8.5.0 14 MB/s | 14 MB 00:00 2023-10-19T12:30:48.826 INFO:teuthology.orchestra.run.smithi046.stdout:(87/131): python3-werkzeug-0.12.2-4.el8.noarch. 2.3 MB/s | 457 kB 00:00 2023-10-19T12:30:48.842 INFO:teuthology.orchestra.run.smithi195.stdout:(125/131): openblas-0.3.15-3.el8.x86_64.rpm 18 MB/s | 4.7 MB 00:00 2023-10-19T12:30:48.860 INFO:teuthology.orchestra.run.smithi046.stdout:(88/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 3.3 MB/s | 225 kB 00:00 2023-10-19T12:30:48.876 INFO:teuthology.orchestra.run.smithi195.stdout:(126/131): postgresql-contrib-10.21-2.module+el 7.3 MB/s | 808 kB 00:00 2023-10-19T12:30:48.885 INFO:teuthology.orchestra.run.smithi046.stdout:(89/131): uuid-1.6.2-43.el8.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2023-10-19T12:30:48.911 INFO:teuthology.orchestra.run.smithi046.stdout:(90/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 2.5 MB/s | 126 kB 00:00 2023-10-19T12:30:48.935 INFO:teuthology.orchestra.run.smithi195.stdout:(127/131): postgresql-10.21-2.module+el8.6.0+15 16 MB/s | 1.5 MB 00:00 2023-10-19T12:30:48.936 INFO:teuthology.orchestra.run.smithi046.stdout:(91/131): python3-jsonpointer-1.10-11.el8.noarc 397 kB/s | 20 kB 00:00 2023-10-19T12:30:48.961 INFO:teuthology.orchestra.run.smithi046.stdout:(92/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 2.0 MB/s | 103 kB 00:00 2023-10-19T12:30:49.010 INFO:teuthology.orchestra.run.smithi195.stdout:(128/131): postgresql-server-10.21-2.module+el8 16 MB/s | 5.1 MB 00:00 2023-10-19T12:30:49.035 INFO:teuthology.orchestra.run.smithi046.stdout:(93/131): libtool-2.4.6-25.el8.x86_64.rpm 7.0 MB/s | 709 kB 00:00 2023-10-19T12:30:49.060 INFO:teuthology.orchestra.run.smithi195.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 16 MB/s | 798 kB 00:00 2023-10-19T12:30:49.103 INFO:teuthology.orchestra.run.smithi046.stdout:(94/131): libpq-13.5-1.el8.x86_64.rpm 2.9 MB/s | 198 kB 00:00 2023-10-19T12:30:49.162 INFO:teuthology.orchestra.run.smithi046.stdout:(95/131): python3-numpy-1.14.3-10.el8.x86_64.rp 6.2 MB/s | 3.7 MB 00:00 2023-10-19T12:30:49.212 INFO:teuthology.orchestra.run.smithi046.stdout:(96/131): jq-1.6-3.el8.x86_64.rpm 4.0 MB/s | 202 kB 00:00 2023-10-19T12:30:49.262 INFO:teuthology.orchestra.run.smithi046.stdout:(97/131): librdkafka-0.11.4-3.el8.x86_64.rpm 7.0 MB/s | 354 kB 00:00 2023-10-19T12:30:49.335 INFO:teuthology.orchestra.run.smithi195.stdout:(130/131): librados2-18.0.0-6786.gf7420d7f.el8. 8.2 MB/s | 3.7 MB 00:00 2023-10-19T12:30:49.363 INFO:teuthology.orchestra.run.smithi046.stdout:(98/131): openblas-threads-0.3.15-3.el8.x86_64. 12 MB/s | 4.9 MB 00:00 2023-10-19T12:30:49.447 INFO:teuthology.orchestra.run.smithi046.stdout:(99/131): openblas-0.3.15-3.el8.x86_64.rpm 14 MB/s | 4.7 MB 00:00 2023-10-19T12:30:49.497 INFO:teuthology.orchestra.run.smithi046.stdout:(100/131): postgresql-contrib-10.21-2.module+el 5.9 MB/s | 808 kB 00:00 2023-10-19T12:30:49.530 INFO:teuthology.orchestra.run.smithi046.stdout:(101/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2023-10-19T12:30:49.544 INFO:teuthology.orchestra.run.smithi195.stdout:(131/131): librbd1-18.0.0-6786.gf7420d7f.el8.x8 6.1 MB/s | 3.7 MB 00:00 2023-10-19T12:30:49.547 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2023-10-19T12:30:49.547 INFO:teuthology.orchestra.run.smithi195.stdout:Total 11 MB/s | 209 MB 00:18 2023-10-19T12:30:49.589 INFO:teuthology.orchestra.run.smithi046.stdout:(102/131): postgresql-10.21-2.module+el8.6.0+15 11 MB/s | 1.5 MB 00:00 2023-10-19T12:30:49.614 INFO:teuthology.orchestra.run.smithi046.stdout:(103/131): libselinux-devel-2.9-5.el8.x86_64.rp 2.3 MB/s | 200 kB 00:00 2023-10-19T12:30:49.633 INFO:teuthology.orchestra.run.smithi046.stdout:(104/131): python3-jwt-1.6.1-2.el8.noarch.rpm 1.0 MB/s | 43 kB 00:00 2023-10-19T12:30:49.665 INFO:teuthology.orchestra.run.smithi046.stdout:(105/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 4.3 MB/s | 220 kB 00:00 2023-10-19T12:30:49.690 INFO:teuthology.orchestra.run.smithi046.stdout:(106/131): keyutils-libs-devel-1.5.10-9.el8.x86 822 kB/s | 48 kB 00:00 2023-10-19T12:30:49.738 INFO:teuthology.orchestra.run.smithi046.stdout:(107/131): libsepol-devel-2.9-3.el8.x86_64.rpm 1.2 MB/s | 87 kB 00:00 2023-10-19T12:30:49.766 INFO:teuthology.orchestra.run.smithi046.stdout:(108/131): python3-requests-oauthlib-1.0.0-1.el 565 kB/s | 43 kB 00:00 2023-10-19T12:30:49.791 INFO:teuthology.orchestra.run.smithi046.stdout:(109/131): python3-pycparser-2.14-14.el8.noarch 2.0 MB/s | 109 kB 00:00 2023-10-19T12:30:49.825 INFO:teuthology.orchestra.run.smithi046.stdout:(110/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 3.8 MB/s | 229 kB 00:00 2023-10-19T12:30:49.892 INFO:teuthology.orchestra.run.smithi046.stdout:(111/131): postgresql-server-10.21-2.module+el8 8.1 MB/s | 5.1 MB 00:00 2023-10-19T12:30:49.917 INFO:teuthology.orchestra.run.smithi046.stdout:(112/131): libaio-devel-0.3.112-1.el8.x86_64.rp 204 kB/s | 19 kB 00:00 2023-10-19T12:30:49.942 INFO:teuthology.orchestra.run.smithi046.stdout:(113/131): python3-oauthlib-2.1.0-1.el8.noarch. 3.0 MB/s | 155 kB 00:00 2023-10-19T12:30:49.976 INFO:teuthology.orchestra.run.smithi046.stdout:(114/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 3.0 MB/s | 560 kB 00:00 2023-10-19T12:30:50.001 INFO:teuthology.orchestra.run.smithi046.stdout:(115/131): libverto-devel-0.3.0-5.el8.x86_64.rp 306 kB/s | 18 kB 00:00 2023-10-19T12:30:50.035 INFO:teuthology.orchestra.run.smithi046.stdout:(116/131): python3-cryptography-3.2.1-5.el8.x86 4.6 MB/s | 559 kB 00:00 2023-10-19T12:30:50.069 INFO:teuthology.orchestra.run.smithi046.stdout:(117/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 3.5 MB/s | 238 kB 00:00 2023-10-19T12:30:50.102 INFO:teuthology.orchestra.run.smithi046.stdout:(118/131): pcre2-devel-10.32-2.el8.x86_64.rpm 4.7 MB/s | 605 kB 00:00 2023-10-19T12:30:50.127 INFO:teuthology.orchestra.run.smithi046.stdout:(119/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 1.2 MB/s | 72 kB 00:00 2023-10-19T12:30:50.152 INFO:teuthology.orchestra.run.smithi046.stdout:(120/131): fuse-2.9.7-15.el8.x86_64.rpm 1.6 MB/s | 83 kB 00:00 2023-10-19T12:30:50.178 INFO:teuthology.orchestra.run.smithi046.stdout:(121/131): elfutils-libelf-devel-0.186-1.el8.x8 1.2 MB/s | 60 kB 00:00 2023-10-19T12:30:50.203 INFO:teuthology.orchestra.run.smithi046.stdout:(122/131): libuuid-devel-2.32.1-35.el8.x86_64.r 1.9 MB/s | 98 kB 00:00 2023-10-19T12:30:50.229 INFO:teuthology.orchestra.run.smithi046.stdout:(123/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 1.1 MB/s | 58 kB 00:00 2023-10-19T12:30:50.254 INFO:teuthology.orchestra.run.smithi046.stdout:(124/131): libcom_err-devel-1.45.6-4.el8.x86_64 765 kB/s | 39 kB 00:00 2023-10-19T12:30:50.296 INFO:teuthology.orchestra.run.smithi046.stdout:(125/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 9.5 MB/s | 644 kB 00:00 2023-10-19T12:30:50.321 INFO:teuthology.orchestra.run.smithi046.stdout:(126/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 2.5 MB/s | 171 kB 00:00 2023-10-19T12:30:50.346 INFO:teuthology.orchestra.run.smithi046.stdout:(127/131): NetworkManager-initscripts-updown-1. 2.7 MB/s | 138 kB 00:00 2023-10-19T12:30:50.393 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2023-10-19T12:30:50.405 INFO:teuthology.orchestra.run.smithi046.stdout:(128/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 6.3 MB/s | 2.3 MB 00:00 2023-10-19T12:30:50.472 INFO:teuthology.orchestra.run.smithi046.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 12 MB/s | 798 kB 00:00 2023-10-19T12:30:50.513 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2023-10-19T12:30:50.513 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2023-10-19T12:30:50.689 INFO:teuthology.orchestra.run.smithi046.stdout:(130/131): librbd1-18.0.0-6786.gf7420d7f.el8.x8 11 MB/s | 3.7 MB 00:00 2023-10-19T12:30:50.972 INFO:teuthology.orchestra.run.smithi046.stdout:(131/131): librados2-18.0.0-6786.gf7420d7f.el8. 5.8 MB/s | 3.7 MB 00:00 2023-10-19T12:30:50.975 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2023-10-19T12:30:50.975 INFO:teuthology.orchestra.run.smithi046.stdout:Total 13 MB/s | 209 MB 00:15 2023-10-19T12:30:51.645 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2023-10-19T12:30:51.649 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2023-10-19T12:30:52.617 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2023-10-19T12:30:52.689 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2023-10-19T12:30:52.819 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-10-19T12:30:52.835 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2023-10-19T12:30:52.835 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2023-10-19T12:30:52.953 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-10-19T12:30:53.203 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-10-19T12:30:53.355 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-10-19T12:30:53.467 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-10-19T12:30:53.797 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-10-19T12:30:54.244 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-10-19T12:30:54.438 INFO:teuthology.orchestra.run.smithi157.stdout: Upgrading : librados2-2:18.0.0-6786.gf7420d7f.el8.x86_64 6/134 2023-10-19T12:30:54.481 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2023-10-19T12:30:54.486 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2023-10-19T12:30:54.853 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: librados2-2:18.0.0-6786.gf7420d7f.el8.x86_64 6/134 2023-10-19T12:30:55.088 INFO:teuthology.orchestra.run.smithi157.stdout: Upgrading : librbd1-2:18.0.0-6786.gf7420d7f.el8.x86_64 7/134 2023-10-19T12:30:55.225 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: librbd1-2:18.0.0-6786.gf7420d7f.el8.x86_64 7/134 2023-10-19T12:30:55.463 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libcephfs2-2:18.0.0-6786.gf7420d7f.el8.x86_64 8/134 2023-10-19T12:30:55.558 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: libcephfs2-2:18.0.0-6786.gf7420d7f.el8.x86_64 8/134 2023-10-19T12:30:55.722 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-rados-2:18.0.0-6786.gf7420d7f.el8.x86_64 9/134 2023-10-19T12:30:55.976 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-10-19T12:30:56.174 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-10-19T12:30:56.600 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-10-19T12:30:56.741 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2023-10-19T12:30:56.845 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-10-19T12:30:56.922 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-10-19T12:30:57.029 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libcephsqlite-2:18.0.0-6786.gf7420d7f.el8.x86_64 14/134 2023-10-19T12:30:57.105 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-10-19T12:30:57.127 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6786.gf7420d7f.el8.x86_64 14/134 2023-10-19T12:30:57.279 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libradosstriper1-2:18.0.0-6786.gf7420d7f.el8.x86 15/134 2023-10-19T12:30:57.290 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 3/134 2023-10-19T12:30:57.376 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6786.gf7420d7f.el8.x86 15/134 2023-10-19T12:30:57.389 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 3/134 2023-10-19T12:30:57.537 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-10-19T12:30:57.599 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-10-19T12:30:57.678 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-10-19T12:30:57.871 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-10-19T12:30:57.988 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-10-19T12:30:58.190 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : librados2-2:18.0.0-6786.gf7420d7f.el8.x86_64 5/134 2023-10-19T12:30:58.488 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-10-19T12:30:58.598 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librados2-2:18.0.0-6786.gf7420d7f.el8.x86_64 5/134 2023-10-19T12:30:58.695 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-10-19T12:30:58.773 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : librbd1-2:18.0.0-6786.gf7420d7f.el8.x86_64 6/134 2023-10-19T12:30:58.908 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librbd1-2:18.0.0-6786.gf7420d7f.el8.x86_64 6/134 2023-10-19T12:30:59.282 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-10-19T12:30:59.462 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-10-19T12:30:59.565 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libcephfs2-2:18.0.0-6786.gf7420d7f.el8.x86_64 7/134 2023-10-19T12:30:59.655 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2023-10-19T12:30:59.673 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libcephfs2-2:18.0.0-6786.gf7420d7f.el8.x86_64 7/134 2023-10-19T12:30:59.832 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-10-19T12:30:59.846 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-rados-2:18.0.0-6786.gf7420d7f.el8.x86_64 8/134 2023-10-19T12:31:00.017 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-10-19T12:31:00.025 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/134 2023-10-19T12:31:00.154 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-10-19T12:31:00.244 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-10-19T12:31:00.267 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-10-19T12:31:00.450 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-10-19T12:31:00.452 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-10-19T12:31:00.478 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-10-19T12:31:00.588 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-10-19T12:31:00.704 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-10-19T12:31:00.808 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-10-19T12:31:00.862 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-10-19T12:31:00.916 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-10-19T12:31:01.122 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-10-19T12:31:01.126 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-10-19T12:31:01.256 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libcephsqlite-2:18.0.0-6786.gf7420d7f.el8.x86_64 14/134 2023-10-19T12:31:01.307 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-10-19T12:31:01.318 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-10-19T12:31:01.366 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6786.gf7420d7f.el8.x86_64 14/134 2023-10-19T12:31:01.523 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libradosstriper1-2:18.0.0-6786.gf7420d7f.el8.x86 15/134 2023-10-19T12:31:01.525 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : librados2-2:18.0.0-6786.gf7420d7f.el8.x86_64 6/134 2023-10-19T12:31:01.582 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-10-19T12:31:01.684 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6786.gf7420d7f.el8.x86 15/134 2023-10-19T12:31:01.793 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-ceph-common-2:18.0.0-6786.gf7420d7f.el8. 26/134 2023-10-19T12:31:01.910 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 16/134 2023-10-19T12:31:01.915 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-ceph-argparse-2:18.0.0-6786.gf7420d7f.el 27/134 2023-10-19T12:31:02.112 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 17/134 2023-10-19T12:31:02.194 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librados2-2:18.0.0-6786.gf7420d7f.el8.x86_64 6/134 2023-10-19T12:31:02.333 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 18/134 2023-10-19T12:31:02.383 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : librbd1-2:18.0.0-6786.gf7420d7f.el8.x86_64 7/134 2023-10-19T12:31:02.481 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-10-19T12:31:02.565 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librbd1-2:18.0.0-6786.gf7420d7f.el8.x86_64 7/134 2023-10-19T12:31:02.630 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-10-19T12:31:02.766 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libcephfs2-2:18.0.0-6786.gf7420d7f.el8.x86_64 8/134 2023-10-19T12:31:02.772 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-10-19T12:31:02.820 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-cephfs-2:18.0.0-6786.gf7420d7f.el8.x86_6 28/134 2023-10-19T12:31:02.885 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libcephfs2-2:18.0.0-6786.gf7420d7f.el8.x86_64 8/134 2023-10-19T12:31:03.088 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rados-2:18.0.0-6786.gf7420d7f.el8.x86_64 9/134 2023-10-19T12:31:03.151 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-10-19T12:31:03.368 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-10-19T12:31:03.380 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-10-19T12:31:03.438 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-10-19T12:31:03.564 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-10-19T12:31:03.572 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-10-19T12:31:03.690 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-10-19T12:31:03.911 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-10-19T12:31:04.006 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-10-19T12:31:04.169 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-10-19T12:31:04.242 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-10-19T12:31:04.347 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : openblas-0.3.15-3.el8.x86_64 22/134 2023-10-19T12:31:04.408 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libcephsqlite-2:18.0.0-6786.gf7420d7f.el8.x86_64 14/134 2023-10-19T12:31:04.529 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6786.gf7420d7f.el8.x86_64 14/134 2023-10-19T12:31:04.749 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libradosstriper1-2:18.0.0-6786.gf7420d7f.el8.x86 15/134 2023-10-19T12:31:04.849 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6786.gf7420d7f.el8.x86 15/134 2023-10-19T12:31:04.991 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-10-19T12:31:05.035 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 22/134 2023-10-19T12:31:05.162 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-10-19T12:31:05.279 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/134 2023-10-19T12:31:05.357 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-10-19T12:31:05.478 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 24/134 2023-10-19T12:31:05.686 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-10-19T12:31:05.716 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-10-19T12:31:05.895 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-ceph-common-2:18.0.0-6786.gf7420d7f.el8. 26/134 2023-10-19T12:31:06.021 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-10-19T12:31:06.033 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-ceph-argparse-2:18.0.0-6786.gf7420d7f.el 27/134 2023-10-19T12:31:06.084 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-10-19T12:31:06.256 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-10-19T12:31:06.276 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cephfs-2:18.0.0-6786.gf7420d7f.el8.x86_6 28/134 2023-10-19T12:31:06.282 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-10-19T12:31:06.421 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-10-19T12:31:06.480 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-10-19T12:31:06.658 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-rbd-2:18.0.0-6786.gf7420d7f.el8.x86_64 36/134 2023-10-19T12:31:06.815 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : librados-devel-2:18.0.0-6786.gf7420d7f.el8.x86_6 37/134 2023-10-19T12:31:06.990 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-10-19T12:31:07.010 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-10-19T12:31:07.162 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-10-19T12:31:07.190 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-10-19T12:31:07.380 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-10-19T12:31:07.523 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-10-19T12:31:07.778 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-10-19T12:31:07.968 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-10-19T12:31:08.043 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-10-19T12:31:08.244 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-10-19T12:31:08.364 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-10-19T12:31:08.365 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-10-19T12:31:08.614 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-10-19T12:31:08.706 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-10-19T12:31:08.848 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-10-19T12:31:08.954 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-10-19T12:31:09.076 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-10-19T12:31:09.173 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-10-19T12:31:09.256 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 30/134 2023-10-19T12:31:09.315 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-10-19T12:31:09.440 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-10-19T12:31:09.570 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/134 2023-10-19T12:31:09.583 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-10-19T12:31:09.740 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-ceph-common-2:18.0.0-6786.gf7420d7f.el8. 26/134 2023-10-19T12:31:09.761 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-10-19T12:31:09.849 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/134 2023-10-19T12:31:09.888 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-ceph-argparse-2:18.0.0-6786.gf7420d7f.el 27/134 2023-10-19T12:31:09.977 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-10-19T12:31:10.102 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/134 2023-10-19T12:31:10.214 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-10-19T12:31:10.333 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-10-19T12:31:10.425 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-10-19T12:31:10.548 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-10-19T12:31:10.640 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-10-19T12:31:10.735 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-rbd-2:18.0.0-6786.gf7420d7f.el8.x86_64 36/134 2023-10-19T12:31:10.802 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-10-19T12:31:10.920 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : librados-devel-2:18.0.0-6786.gf7420d7f.el8.x86_6 37/134 2023-10-19T12:31:10.964 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cephfs-2:18.0.0-6786.gf7420d7f.el8.x86_6 28/134 2023-10-19T12:31:11.070 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 38/134 2023-10-19T12:31:11.169 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-10-19T12:31:11.206 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 39/134 2023-10-19T12:31:11.353 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-10-19T12:31:11.421 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : uuid-1.6.2-43.el8.x86_64 40/134 2023-10-19T12:31:11.450 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-10-19T12:31:11.496 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 40/134 2023-10-19T12:31:11.625 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-10-19T12:31:11.649 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-10-19T12:31:11.726 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 41/134 2023-10-19T12:31:11.892 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-10-19T12:31:11.941 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : automake-1.16.1-7.el8.noarch 42/134 2023-10-19T12:31:11.948 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-10-19T12:31:12.059 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-10-19T12:31:12.096 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 43/134 2023-10-19T12:31:12.132 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-10-19T12:31:12.174 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 43/134 2023-10-19T12:31:12.236 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-10-19T12:31:12.375 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : jq-1.6-3.el8.x86_64 44/134 2023-10-19T12:31:12.384 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-10-19T12:31:12.454 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-10-19T12:31:12.583 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 45/134 2023-10-19T12:31:12.724 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-10-19T12:31:12.761 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 46/134 2023-10-19T12:31:12.948 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 47/134 2023-10-19T12:31:12.976 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-10-19T12:31:13.110 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-10-19T12:31:13.115 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : fuse-2.9.7-15.el8.x86_64 48/134 2023-10-19T12:31:13.191 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-10-19T12:31:13.249 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 49/134 2023-10-19T12:31:13.406 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-10-19T12:31:13.451 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 50/134 2023-10-19T12:31:13.544 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-10-19T12:31:13.649 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 51/134 2023-10-19T12:31:13.726 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-10-19T12:31:13.896 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-10-19T12:31:14.036 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 52/134 2023-10-19T12:31:14.195 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-10-19T12:31:14.301 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-10-19T12:31:14.322 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 53/134 2023-10-19T12:31:14.425 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-10-19T12:31:14.548 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 54/134 2023-10-19T12:31:14.606 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-10-19T12:31:14.650 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-10-19T12:31:14.755 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-10-19T12:31:14.757 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 55/134 2023-10-19T12:31:14.880 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-10-19T12:31:14.979 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-10-19T12:31:14.983 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 56/134 2023-10-19T12:31:15.047 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-10-19T12:31:15.182 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-10-19T12:31:15.302 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 57/134 2023-10-19T12:31:15.381 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rbd-2:18.0.0-6786.gf7420d7f.el8.x86_64 36/134 2023-10-19T12:31:15.397 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-10-19T12:31:15.495 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 58/134 2023-10-19T12:31:15.554 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-10-19T12:31:15.587 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librados-devel-2:18.0.0-6786.gf7420d7f.el8.x86_6 37/134 2023-10-19T12:31:15.705 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-10-19T12:31:15.714 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 59/134 2023-10-19T12:31:15.750 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-10-19T12:31:15.932 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-10-19T12:31:15.933 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-10-19T12:31:15.950 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 60/134 2023-10-19T12:31:16.124 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 61/134 2023-10-19T12:31:16.151 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-10-19T12:31:16.214 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-10-19T12:31:16.297 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-10-19T12:31:16.307 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 62/134 2023-10-19T12:31:16.390 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-10-19T12:31:16.516 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-10-19T12:31:16.644 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 63/134 2023-10-19T12:31:16.658 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-10-19T12:31:16.742 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-10-19T12:31:16.859 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-10-19T12:31:16.910 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 64/134 2023-10-19T12:31:17.059 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-10-19T12:31:17.141 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 65/134 2023-10-19T12:31:17.162 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-10-19T12:31:17.286 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-10-19T12:31:17.363 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 66/134 2023-10-19T12:31:17.498 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-10-19T12:31:17.511 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-10-19T12:31:17.698 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-10-19T12:31:17.706 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-10-19T12:31:17.956 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-10-19T12:31:17.988 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-10-19T12:31:18.219 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-10-19T12:31:18.226 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-10-19T12:31:18.366 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-10-19T12:31:18.397 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-10-19T12:31:18.539 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-10-19T12:31:18.581 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-10-19T12:31:18.696 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-10-19T12:31:18.728 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-10-19T12:31:18.833 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-10-19T12:31:18.914 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-10-19T12:31:18.984 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-10-19T12:31:19.071 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-10-19T12:31:19.134 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-10-19T12:31:19.293 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-10-19T12:31:19.304 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-10-19T12:31:19.323 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-10-19T12:31:19.459 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-10-19T12:31:19.490 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-10-19T12:31:19.583 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-10-19T12:31:19.679 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-10-19T12:31:19.693 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-10-19T12:31:19.810 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-10-19T12:31:19.933 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-10-19T12:31:20.029 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-10-19T12:31:20.134 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-10-19T12:31:20.343 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-10-19T12:31:20.400 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-10-19T12:31:20.603 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-10-19T12:31:20.633 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-10-19T12:31:20.640 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-10-19T12:31:20.786 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-10-19T12:31:20.800 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : librgw2-2:18.0.0-6786.gf7420d7f.el8.x86_64 92/134 2023-10-19T12:31:20.873 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-10-19T12:31:20.899 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: librgw2-2:18.0.0-6786.gf7420d7f.el8.x86_64 92/134 2023-10-19T12:31:21.004 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-10-19T12:31:21.074 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-10-19T12:31:21.117 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-rgw-2:18.0.0-6786.gf7420d7f.el8.x86_64 93/134 2023-10-19T12:31:21.252 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-10-19T12:31:21.439 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-10-19T12:31:21.534 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-10-19T12:31:21.796 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-10-19T12:31:22.038 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-10-19T12:31:22.097 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-10-19T12:31:22.214 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-10-19T12:31:22.320 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-10-19T12:31:22.398 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-10-19T12:31:22.574 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-10-19T12:31:22.653 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-10-19T12:31:22.767 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-10-19T12:31:22.924 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-10-19T12:31:22.945 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-10-19T12:31:23.133 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-10-19T12:31:23.262 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-10-19T12:31:23.422 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-10-19T12:31:23.478 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-10-19T12:31:23.639 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-10-19T12:31:23.803 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-10-19T12:31:23.996 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-10-19T12:31:24.226 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-10-19T12:31:24.269 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-10-19T12:31:24.436 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : librgw2-2:18.0.0-6786.gf7420d7f.el8.x86_64 92/134 2023-10-19T12:31:24.442 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-10-19T12:31:24.508 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librgw2-2:18.0.0-6786.gf7420d7f.el8.x86_64 92/134 2023-10-19T12:31:24.666 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-10-19T12:31:24.694 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-rgw-2:18.0.0-6786.gf7420d7f.el8.x86_64 93/134 2023-10-19T12:31:24.835 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-10-19T12:31:24.888 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-common-2:18.0.0-6786.gf7420d7f.el8.x86_64 94/134 2023-10-19T12:31:24.989 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-10-19T12:31:25.227 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-10-19T12:31:25.480 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-10-19T12:31:25.575 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-common-2:18.0.0-6786.gf7420d7f.el8.x86_64 94/134 2023-10-19T12:31:25.680 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-10-19T12:31:25.978 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-10-19T12:31:26.181 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-common-2:18.0.0-6786.gf7420d7f.el8.x86_64 94/134 2023-10-19T12:31:26.249 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-10-19T12:31:26.443 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-10-19T12:31:26.500 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-base-2:18.0.0-6786.gf7420d7f.el8.x86_64 95/134 2023-10-19T12:31:26.605 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-base-2:18.0.0-6786.gf7420d7f.el8.x86_64 95/134 2023-10-19T12:31:26.670 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-10-19T12:31:26.782 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-selinux-2:18.0.0-6786.gf7420d7f.el8.x86_64 96/134 2023-10-19T12:31:28.108 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-10-19T12:31:28.434 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-common-2:18.0.0-6786.gf7420d7f.el8.x86_64 94/134 2023-10-19T12:31:28.435 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-10-19T12:31:28.653 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-common-2:18.0.0-6786.gf7420d7f.el8.x86_64 94/134 2023-10-19T12:31:28.687 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-10-19T12:31:29.071 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-10-19T12:31:29.233 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-common-2:18.0.0-6786.gf7420d7f.el8.x86_64 94/134 2023-10-19T12:31:29.355 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-10-19T12:31:29.515 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-base-2:18.0.0-6786.gf7420d7f.el8.x86_64 95/134 2023-10-19T12:31:29.601 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-base-2:18.0.0-6786.gf7420d7f.el8.x86_64 95/134 2023-10-19T12:31:29.601 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-10-19T12:31:29.743 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-selinux-2:18.0.0-6786.gf7420d7f.el8.x86_64 96/134 2023-10-19T12:31:30.526 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-10-19T12:31:30.729 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librgw2-2:18.0.0-6786.gf7420d7f.el8.x86_64 92/134 2023-10-19T12:31:30.830 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librgw2-2:18.0.0-6786.gf7420d7f.el8.x86_64 92/134 2023-10-19T12:31:31.038 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rgw-2:18.0.0-6786.gf7420d7f.el8.x86_64 93/134 2023-10-19T12:31:36.609 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-common-2:18.0.0-6786.gf7420d7f.el8.x86_64 94/134 2023-10-19T12:31:36.862 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-common-2:18.0.0-6786.gf7420d7f.el8.x86_64 94/134 2023-10-19T12:31:37.591 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-common-2:18.0.0-6786.gf7420d7f.el8.x86_64 94/134 2023-10-19T12:31:38.455 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-base-2:18.0.0-6786.gf7420d7f.el8.x86_64 95/134 2023-10-19T12:31:38.617 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-base-2:18.0.0-6786.gf7420d7f.el8.x86_64 95/134 2023-10-19T12:31:38.762 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-selinux-2:18.0.0-6786.gf7420d7f.el8.x86_64 96/134 2023-10-19T12:31:45.614 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6786.gf7420d7f.el8.x86_64 96/134 2023-10-19T12:31:45.614 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /sys 2023-10-19T12:31:45.615 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /proc 2023-10-19T12:31:45.615 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /dev 2023-10-19T12:31:45.615 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /run 2023-10-19T12:31:45.615 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /mnt 2023-10-19T12:31:45.615 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /var/tmp 2023-10-19T12:31:45.616 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /home 2023-10-19T12:31:45.616 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /tmp 2023-10-19T12:31:45.616 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /dev 2023-10-19T12:31:45.616 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-19T12:31:45.997 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-volume-2:18.0.0-6786.gf7420d7f.el8.noarch 97/134 2023-10-19T12:31:47.601 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-volume-2:18.0.0-6786.gf7420d7f.el8.noarch 97/134 2023-10-19T12:31:47.763 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-osd-2:18.0.0-6786.gf7420d7f.el8.x86_64 98/134 2023-10-19T12:31:47.985 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-osd-2:18.0.0-6786.gf7420d7f.el8.x86_64 98/134 2023-10-19T12:31:48.154 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mds-2:18.0.0-6786.gf7420d7f.el8.x86_64 99/134 2023-10-19T12:31:48.522 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6786.gf7420d7f.el8.x86_64 96/134 2023-10-19T12:31:48.522 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /sys 2023-10-19T12:31:48.523 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /proc 2023-10-19T12:31:48.523 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /dev 2023-10-19T12:31:48.523 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /run 2023-10-19T12:31:48.523 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /mnt 2023-10-19T12:31:48.523 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /var/tmp 2023-10-19T12:31:48.524 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /home 2023-10-19T12:31:48.524 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /tmp 2023-10-19T12:31:48.524 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /dev 2023-10-19T12:31:48.524 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-10-19T12:31:48.629 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mds-2:18.0.0-6786.gf7420d7f.el8.x86_64 99/134 2023-10-19T12:31:48.771 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mon-2:18.0.0-6786.gf7420d7f.el8.x86_64 100/134 2023-10-19T12:31:48.788 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mon-2:18.0.0-6786.gf7420d7f.el8.x86_64 100/134 2023-10-19T12:31:48.891 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-volume-2:18.0.0-6786.gf7420d7f.el8.noarch 97/134 2023-10-19T12:31:50.486 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-volume-2:18.0.0-6786.gf7420d7f.el8.noarch 97/134 2023-10-19T12:31:50.520 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: cephadm-2:18.0.0-6786.gf7420d7f.el8.noarch 101/134 2023-10-19T12:31:50.645 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-osd-2:18.0.0-6786.gf7420d7f.el8.x86_64 98/134 2023-10-19T12:31:50.715 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : cephadm-2:18.0.0-6786.gf7420d7f.el8.noarch 101/134 2023-10-19T12:31:50.826 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6786.gf7420d7f.e 102/134 2023-10-19T12:31:50.866 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-osd-2:18.0.0-6786.gf7420d7f.el8.x86_64 98/134 2023-10-19T12:31:51.054 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6786.gf7420d7f. 103/134 2023-10-19T12:31:51.057 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mds-2:18.0.0-6786.gf7420d7f.el8.x86_64 99/134 2023-10-19T12:31:51.220 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6786.gf7420d7f.el8.noa 104/134 2023-10-19T12:31:51.444 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6786.gf7420d7f.el8.noa 104/134 2023-10-19T12:31:51.522 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mds-2:18.0.0-6786.gf7420d7f.el8.x86_64 99/134 2023-10-19T12:31:51.674 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mon-2:18.0.0-6786.gf7420d7f.el8.x86_64 100/134 2023-10-19T12:31:51.691 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mon-2:18.0.0-6786.gf7420d7f.el8.x86_64 100/134 2023-10-19T12:31:51.728 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6786.gf7420d7f.el8.n 105/134 2023-10-19T12:31:52.694 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6786.gf7420d7f.el8.n 105/134 2023-10-19T12:31:52.870 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6786.gf74 106/134 2023-10-19T12:31:52.962 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6786.gf74 106/134 2023-10-19T12:31:53.313 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6786.gf7420d7f.el 107/134 2023-10-19T12:31:53.408 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: cephadm-2:18.0.0-6786.gf7420d7f.el8.noarch 101/134 2023-10-19T12:31:53.532 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mgr-2:18.0.0-6786.gf7420d7f.el8.x86_64 108/134 2023-10-19T12:31:53.568 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6786.gf7420d7f.el8.x86_64 108/134 2023-10-19T12:31:53.589 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : cephadm-2:18.0.0-6786.gf7420d7f.el8.noarch 101/134 2023-10-19T12:31:53.695 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mgr-rook-2:18.0.0-6786.gf7420d7f.el8.noarch 109/134 2023-10-19T12:31:53.707 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6786.gf7420d7f.el8.noarch 109/134 2023-10-19T12:31:53.722 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6786.gf7420d7f.e 102/134 2023-10-19T12:31:53.914 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6786.gf7420d7f. 103/134 2023-10-19T12:31:54.123 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6786.gf7420d7f.el8.noa 104/134 2023-10-19T12:31:54.345 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6786.gf7420d7f.el8.noa 104/134 2023-10-19T12:31:54.628 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6786.gf7420d7f.el8.n 105/134 2023-10-19T12:31:55.060 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-2:18.0.0-6786.gf7420d7f.el8.x86_64 110/134 2023-10-19T12:31:55.239 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-radosgw-2:18.0.0-6786.gf7420d7f.el8.x86_64 111/134 2023-10-19T12:31:55.274 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6786.gf7420d7f.el8.x86_64 111/134 2023-10-19T12:31:55.461 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6786.gf7420 112/134 2023-10-19T12:31:55.504 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6786.gf7420 112/134 2023-10-19T12:31:55.586 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6786.gf7420d7f.el8.n 105/134 2023-10-19T12:31:55.653 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : cephfs-mirror-2:18.0.0-6786.gf7420d7f.el8.x86_64 113/134 2023-10-19T12:31:55.781 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6786.gf74 106/134 2023-10-19T12:31:55.872 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6786.gf74 106/134 2023-10-19T12:31:56.014 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6786.gf7420d7f.el8.x86_64 113/134 2023-10-19T12:31:56.203 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6786.gf7420d7f.el 107/134 2023-10-19T12:31:56.203 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : rbd-mirror-2:18.0.0-6786.gf7420d7f.el8.x86_64 114/134 2023-10-19T12:31:56.411 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-2:18.0.0-6786.gf7420d7f.el8.x86_64 108/134 2023-10-19T12:31:56.446 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6786.gf7420d7f.el8.x86_64 108/134 2023-10-19T12:31:56.639 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-rook-2:18.0.0-6786.gf7420d7f.el8.noarch 109/134 2023-10-19T12:31:56.651 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6786.gf7420d7f.el8.noarch 109/134 2023-10-19T12:31:58.004 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-2:18.0.0-6786.gf7420d7f.el8.x86_64 110/134 2023-10-19T12:31:58.202 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-radosgw-2:18.0.0-6786.gf7420d7f.el8.x86_64 111/134 2023-10-19T12:31:58.236 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6786.gf7420d7f.el8.x86_64 111/134 2023-10-19T12:31:58.390 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6786.gf7420 112/134 2023-10-19T12:31:58.432 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6786.gf7420 112/134 2023-10-19T12:31:58.573 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : cephfs-mirror-2:18.0.0-6786.gf7420d7f.el8.x86_64 113/134 2023-10-19T12:31:58.932 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6786.gf7420d7f.el8.x86_64 113/134 2023-10-19T12:31:59.123 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : rbd-mirror-2:18.0.0-6786.gf7420d7f.el8.x86_64 114/134 2023-10-19T12:31:59.887 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6786.gf7420d7f.el8.x86_64 96/134 2023-10-19T12:31:59.887 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /sys 2023-10-19T12:31:59.887 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /proc 2023-10-19T12:31:59.887 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /dev 2023-10-19T12:31:59.888 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /run 2023-10-19T12:31:59.888 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /mnt 2023-10-19T12:31:59.888 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /var/tmp 2023-10-19T12:31:59.888 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /home 2023-10-19T12:31:59.888 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /tmp 2023-10-19T12:31:59.888 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /dev 2023-10-19T12:31:59.889 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:32:00.310 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-volume-2:18.0.0-6786.gf7420d7f.el8.noarch 97/134 2023-10-19T12:32:00.879 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6786.gf7420d7f.el8.x86_64 114/134 2023-10-19T12:32:01.160 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-test-2:18.0.0-6786.gf7420d7f.el8.x86_64 115/134 2023-10-19T12:32:01.343 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-10-19T12:32:01.537 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-10-19T12:32:02.156 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-volume-2:18.0.0-6786.gf7420d7f.el8.noarch 97/134 2023-10-19T12:32:02.344 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-osd-2:18.0.0-6786.gf7420d7f.el8.x86_64 98/134 2023-10-19T12:32:02.467 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-10-19T12:32:02.626 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-osd-2:18.0.0-6786.gf7420d7f.el8.x86_64 98/134 2023-10-19T12:32:02.793 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mds-2:18.0.0-6786.gf7420d7f.el8.x86_64 99/134 2023-10-19T12:32:02.864 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-10-19T12:32:03.080 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-fuse-2:18.0.0-6786.gf7420d7f.el8.x86_64 119/134 2023-10-19T12:32:03.289 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-10-19T12:32:03.345 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mds-2:18.0.0-6786.gf7420d7f.el8.x86_64 99/134 2023-10-19T12:32:03.447 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libcephfs-devel-2:18.0.0-6786.gf7420d7f.el8.x86_ 121/134 2023-10-19T12:32:03.517 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mon-2:18.0.0-6786.gf7420d7f.el8.x86_64 100/134 2023-10-19T12:32:03.561 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mon-2:18.0.0-6786.gf7420d7f.el8.x86_64 100/134 2023-10-19T12:32:03.602 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-19T12:32:03.764 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6786.gf7420d7f.el8.x86_64 114/134 2023-10-19T12:32:04.631 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-test-2:18.0.0-6786.gf7420d7f.el8.x86_64 115/134 2023-10-19T12:32:04.941 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 116/134 2023-10-19T12:32:05.107 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-fuse-2:18.0.0-6786.gf7420d7f.el8.x86_64 117/134 2023-10-19T12:32:05.346 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 118/134 2023-10-19T12:32:05.530 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/134 2023-10-19T12:32:05.721 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/134 2023-10-19T12:32:05.836 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-19T12:32:05.959 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 120/134 2023-10-19T12:32:06.101 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-19T12:32:06.120 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-19T12:32:06.134 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libcephfs-devel-2:18.0.0-6786.gf7420d7f.el8.x86_ 121/134 2023-10-19T12:32:06.260 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : cephfs-top-2:18.0.0-6786.gf7420d7f.el8.noarch 124/134 2023-10-19T12:32:06.272 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-19T12:32:06.584 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : rbd-fuse-2:18.0.0-6786.gf7420d7f.el8.x86_64 125/134 2023-10-19T12:32:06.621 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: cephadm-2:18.0.0-6786.gf7420d7f.el8.noarch 101/134 2023-10-19T12:32:06.813 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : cephadm-2:18.0.0-6786.gf7420d7f.el8.noarch 101/134 2023-10-19T12:32:06.903 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : rbd-nbd-2:18.0.0-6786.gf7420d7f.el8.x86_64 126/134 2023-10-19T12:32:06.917 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6786.gf7420d7f.e 102/134 2023-10-19T12:32:07.158 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6786.gf7420d7f. 103/134 2023-10-19T12:32:07.236 INFO:teuthology.orchestra.run.smithi157.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-10-19T12:32:07.350 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6786.gf7420d7f.el8.noa 104/134 2023-10-19T12:32:07.359 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-19T12:32:07.368 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-19T12:32:07.591 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-10-19T12:32:07.626 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6786.gf7420d7f.el8.noa 104/134 2023-10-19T12:32:07.809 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-10-19T12:32:07.842 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6786.gf7420d7f.el8.n 105/134 2023-10-19T12:32:07.904 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-10-19T12:32:08.159 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-10-19T12:32:08.172 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-10-19T12:32:08.172 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-19T12:32:08.395 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-19T12:32:08.395 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-19T12:32:08.479 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-19T12:32:08.622 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-19T12:32:08.738 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-19T12:32:08.756 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-19T12:32:08.849 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-19T12:32:08.916 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : cephfs-top-2:18.0.0-6786.gf7420d7f.el8.noarch 124/134 2023-10-19T12:32:08.999 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6786.gf7420d7f.el8.n 105/134 2023-10-19T12:32:09.191 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6786.gf74 106/134 2023-10-19T12:32:09.229 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : rbd-fuse-2:18.0.0-6786.gf7420d7f.el8.x86_64 125/134 2023-10-19T12:32:09.326 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6786.gf74 106/134 2023-10-19T12:32:09.347 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-10-19T12:32:09.347 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-2:18.0.0-6786.gf7420d7f.el8.x86_64 1/134 2023-10-19T12:32:09.349 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-base-2:18.0.0-6786.gf7420d7f.el8.x86_64 2/134 2023-10-19T12:32:09.349 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-common-2:18.0.0-6786.gf7420d7f.el8.x86_64 3/134 2023-10-19T12:32:09.349 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-fuse-2:18.0.0-6786.gf7420d7f.el8.x86_64 4/134 2023-10-19T12:32:09.350 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6786.gf7420 5/134 2023-10-19T12:32:09.350 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mds-2:18.0.0-6786.gf7420d7f.el8.x86_64 6/134 2023-10-19T12:32:09.350 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mgr-2:18.0.0-6786.gf7420d7f.el8.x86_64 7/134 2023-10-19T12:32:09.350 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mon-2:18.0.0-6786.gf7420d7f.el8.x86_64 8/134 2023-10-19T12:32:09.351 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-osd-2:18.0.0-6786.gf7420d7f.el8.x86_64 9/134 2023-10-19T12:32:09.351 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-radosgw-2:18.0.0-6786.gf7420d7f.el8.x86_64 10/134 2023-10-19T12:32:09.351 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-selinux-2:18.0.0-6786.gf7420d7f.el8.x86_64 11/134 2023-10-19T12:32:09.351 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-test-2:18.0.0-6786.gf7420d7f.el8.x86_64 12/134 2023-10-19T12:32:09.351 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : cephfs-mirror-2:18.0.0-6786.gf7420d7f.el8.x86_64 13/134 2023-10-19T12:32:09.352 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libcephfs-devel-2:18.0.0-6786.gf7420d7f.el8.x86_ 14/134 2023-10-19T12:32:09.352 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libcephfs2-2:18.0.0-6786.gf7420d7f.el8.x86_64 15/134 2023-10-19T12:32:09.352 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libcephsqlite-2:18.0.0-6786.gf7420d7f.el8.x86_64 16/134 2023-10-19T12:32:09.352 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librados-devel-2:18.0.0-6786.gf7420d7f.el8.x86_6 17/134 2023-10-19T12:32:09.352 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libradosstriper1-2:18.0.0-6786.gf7420d7f.el8.x86 18/134 2023-10-19T12:32:09.353 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librgw2-2:18.0.0-6786.gf7420d7f.el8.x86_64 19/134 2023-10-19T12:32:09.353 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6786.gf7420d7f.el 20/134 2023-10-19T12:32:09.353 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-ceph-common-2:18.0.0-6786.gf7420d7f.el8. 21/134 2023-10-19T12:32:09.353 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cephfs-2:18.0.0-6786.gf7420d7f.el8.x86_6 22/134 2023-10-19T12:32:09.353 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-rados-2:18.0.0-6786.gf7420d7f.el8.x86_64 23/134 2023-10-19T12:32:09.354 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-rbd-2:18.0.0-6786.gf7420d7f.el8.x86_64 24/134 2023-10-19T12:32:09.354 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-rgw-2:18.0.0-6786.gf7420d7f.el8.x86_64 25/134 2023-10-19T12:32:09.354 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : rbd-fuse-2:18.0.0-6786.gf7420d7f.el8.x86_64 26/134 2023-10-19T12:32:09.354 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : rbd-mirror-2:18.0.0-6786.gf7420d7f.el8.x86_64 27/134 2023-10-19T12:32:09.354 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : rbd-nbd-2:18.0.0-6786.gf7420d7f.el8.x86_64 28/134 2023-10-19T12:32:09.355 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6786.gf7420d7f. 29/134 2023-10-19T12:32:09.355 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6786.gf7420d7f.el8.noa 30/134 2023-10-19T12:32:09.355 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6786.gf7420d7f.el8.n 31/134 2023-10-19T12:32:09.355 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6786.gf74 32/134 2023-10-19T12:32:09.355 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6786.gf7420d7f.el 33/134 2023-10-19T12:32:09.356 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6786.gf7420d7f.el8.noarch 34/134 2023-10-19T12:32:09.356 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6786.gf7420d7f.e 35/134 2023-10-19T12:32:09.356 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-volume-2:18.0.0-6786.gf7420d7f.el8.noarch 36/134 2023-10-19T12:32:09.356 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : cephadm-2:18.0.0-6786.gf7420d7f.el8.noarch 37/134 2023-10-19T12:32:09.356 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : cephfs-top-2:18.0.0-6786.gf7420d7f.el8.noarch 38/134 2023-10-19T12:32:09.357 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-10-19T12:32:09.357 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-10-19T12:32:09.357 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-10-19T12:32:09.357 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-10-19T12:32:09.357 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-10-19T12:32:09.358 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-10-19T12:32:09.358 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-10-19T12:32:09.358 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-10-19T12:32:09.358 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-10-19T12:32:09.358 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-10-19T12:32:09.359 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-10-19T12:32:09.359 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-10-19T12:32:09.359 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-10-19T12:32:09.359 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-10-19T12:32:09.359 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-10-19T12:32:09.360 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-10-19T12:32:09.360 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-10-19T12:32:09.360 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-10-19T12:32:09.360 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-10-19T12:32:09.360 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-10-19T12:32:09.361 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-10-19T12:32:09.361 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-10-19T12:32:09.361 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-10-19T12:32:09.361 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-10-19T12:32:09.361 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-10-19T12:32:09.362 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-10-19T12:32:09.362 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-10-19T12:32:09.362 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-10-19T12:32:09.362 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-10-19T12:32:09.363 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-10-19T12:32:09.363 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-10-19T12:32:09.363 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-10-19T12:32:09.363 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-10-19T12:32:09.363 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-10-19T12:32:09.364 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-10-19T12:32:09.364 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-10-19T12:32:09.364 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-10-19T12:32:09.364 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-10-19T12:32:09.364 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-10-19T12:32:09.365 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-10-19T12:32:09.365 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-10-19T12:32:09.365 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-10-19T12:32:09.365 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-10-19T12:32:09.365 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-10-19T12:32:09.366 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-10-19T12:32:09.366 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-10-19T12:32:09.366 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-10-19T12:32:09.366 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-10-19T12:32:09.366 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-10-19T12:32:09.367 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-10-19T12:32:09.367 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-10-19T12:32:09.367 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-10-19T12:32:09.367 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-10-19T12:32:09.368 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-10-19T12:32:09.368 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-10-19T12:32:09.368 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-10-19T12:32:09.368 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-10-19T12:32:09.368 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-10-19T12:32:09.368 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-10-19T12:32:09.369 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-10-19T12:32:09.369 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-10-19T12:32:09.369 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-10-19T12:32:09.369 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-10-19T12:32:09.370 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-10-19T12:32:09.370 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-10-19T12:32:09.370 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-10-19T12:32:09.370 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-10-19T12:32:09.370 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-10-19T12:32:09.371 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-10-19T12:32:09.371 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-10-19T12:32:09.371 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-10-19T12:32:09.371 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-10-19T12:32:09.371 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-10-19T12:32:09.372 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-10-19T12:32:09.372 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-10-19T12:32:09.372 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-10-19T12:32:09.372 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-10-19T12:32:09.372 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-10-19T12:32:09.373 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-10-19T12:32:09.373 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-10-19T12:32:09.373 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-10-19T12:32:09.373 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-10-19T12:32:09.373 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-10-19T12:32:09.374 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-19T12:32:09.374 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-10-19T12:32:09.374 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-10-19T12:32:09.374 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-10-19T12:32:09.374 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-10-19T12:32:09.374 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-10-19T12:32:09.375 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-19T12:32:09.375 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librados2-2:18.0.0-6786.gf7420d7f.el8.x86_64 129/134 2023-10-19T12:32:09.375 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-10-19T12:32:09.375 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librbd1-2:18.0.0-6786.gf7420d7f.el8.x86_64 131/134 2023-10-19T12:32:09.375 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-19T12:32:09.376 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-10-19T12:32:09.541 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : rbd-nbd-2:18.0.0-6786.gf7420d7f.el8.x86_64 126/134 2023-10-19T12:32:09.690 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6786.gf7420d7f.el 107/134 2023-10-19T12:32:09.879 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-10-19T12:32:09.948 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-2:18.0.0-6786.gf7420d7f.el8.x86_64 108/134 2023-10-19T12:32:10.016 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6786.gf7420d7f.el8.x86_64 108/134 2023-10-19T12:32:10.045 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : flex-2.6.1-9.el8.x86_64 128/134 2023-10-19T12:32:10.131 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 128/134 2023-10-19T12:32:10.216 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-rook-2:18.0.0-6786.gf7420d7f.el8.noarch 109/134 2023-10-19T12:32:10.246 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6786.gf7420d7f.el8.noarch 109/134 2023-10-19T12:32:10.338 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : bison-3.0.4-10.el8.x86_64 129/134 2023-10-19T12:32:10.350 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 129/134 2023-10-19T12:32:10.512 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-10-19T12:32:10.520 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-10-19T12:32:10.698 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/134 2023-10-19T12:32:10.698 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-19T12:32:10.898 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-19T12:32:10.899 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-19T12:32:11.126 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-19T12:32:11.320 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-19T12:32:11.760 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-2:18.0.0-6786.gf7420d7f.el8.x86_64 110/134 2023-10-19T12:32:11.808 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-10-19T12:32:11.808 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-2:18.0.0-6786.gf7420d7f.el8.x86_64 1/134 2023-10-19T12:32:11.809 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-base-2:18.0.0-6786.gf7420d7f.el8.x86_64 2/134 2023-10-19T12:32:11.809 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-common-2:18.0.0-6786.gf7420d7f.el8.x86_64 3/134 2023-10-19T12:32:11.809 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-fuse-2:18.0.0-6786.gf7420d7f.el8.x86_64 4/134 2023-10-19T12:32:11.809 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6786.gf7420 5/134 2023-10-19T12:32:11.809 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mds-2:18.0.0-6786.gf7420d7f.el8.x86_64 6/134 2023-10-19T12:32:11.810 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-2:18.0.0-6786.gf7420d7f.el8.x86_64 7/134 2023-10-19T12:32:11.810 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mon-2:18.0.0-6786.gf7420d7f.el8.x86_64 8/134 2023-10-19T12:32:11.810 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-osd-2:18.0.0-6786.gf7420d7f.el8.x86_64 9/134 2023-10-19T12:32:11.810 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-radosgw-2:18.0.0-6786.gf7420d7f.el8.x86_64 10/134 2023-10-19T12:32:11.810 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-selinux-2:18.0.0-6786.gf7420d7f.el8.x86_64 11/134 2023-10-19T12:32:11.811 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-test-2:18.0.0-6786.gf7420d7f.el8.x86_64 12/134 2023-10-19T12:32:11.811 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : cephfs-mirror-2:18.0.0-6786.gf7420d7f.el8.x86_64 13/134 2023-10-19T12:32:11.811 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libcephfs-devel-2:18.0.0-6786.gf7420d7f.el8.x86_ 14/134 2023-10-19T12:32:11.811 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libcephfs2-2:18.0.0-6786.gf7420d7f.el8.x86_64 15/134 2023-10-19T12:32:11.811 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libcephsqlite-2:18.0.0-6786.gf7420d7f.el8.x86_64 16/134 2023-10-19T12:32:11.812 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librados-devel-2:18.0.0-6786.gf7420d7f.el8.x86_6 17/134 2023-10-19T12:32:11.812 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libradosstriper1-2:18.0.0-6786.gf7420d7f.el8.x86 18/134 2023-10-19T12:32:11.812 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librgw2-2:18.0.0-6786.gf7420d7f.el8.x86_64 19/134 2023-10-19T12:32:11.812 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6786.gf7420d7f.el 20/134 2023-10-19T12:32:11.812 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-ceph-common-2:18.0.0-6786.gf7420d7f.el8. 21/134 2023-10-19T12:32:11.813 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cephfs-2:18.0.0-6786.gf7420d7f.el8.x86_6 22/134 2023-10-19T12:32:11.813 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-rados-2:18.0.0-6786.gf7420d7f.el8.x86_64 23/134 2023-10-19T12:32:11.813 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-rbd-2:18.0.0-6786.gf7420d7f.el8.x86_64 24/134 2023-10-19T12:32:11.813 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-rgw-2:18.0.0-6786.gf7420d7f.el8.x86_64 25/134 2023-10-19T12:32:11.814 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : rbd-fuse-2:18.0.0-6786.gf7420d7f.el8.x86_64 26/134 2023-10-19T12:32:11.814 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : rbd-mirror-2:18.0.0-6786.gf7420d7f.el8.x86_64 27/134 2023-10-19T12:32:11.814 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : rbd-nbd-2:18.0.0-6786.gf7420d7f.el8.x86_64 28/134 2023-10-19T12:32:11.814 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6786.gf7420d7f. 29/134 2023-10-19T12:32:11.824 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6786.gf7420d7f.el8.noa 30/134 2023-10-19T12:32:11.824 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6786.gf7420d7f.el8.n 31/134 2023-10-19T12:32:11.824 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6786.gf74 32/134 2023-10-19T12:32:11.824 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6786.gf7420d7f.el 33/134 2023-10-19T12:32:11.824 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6786.gf7420d7f.el8.noarch 34/134 2023-10-19T12:32:11.825 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6786.gf7420d7f.e 35/134 2023-10-19T12:32:11.825 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-volume-2:18.0.0-6786.gf7420d7f.el8.noarch 36/134 2023-10-19T12:32:11.825 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : cephadm-2:18.0.0-6786.gf7420d7f.el8.noarch 37/134 2023-10-19T12:32:11.825 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : cephfs-top-2:18.0.0-6786.gf7420d7f.el8.noarch 38/134 2023-10-19T12:32:11.826 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-10-19T12:32:11.826 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-10-19T12:32:11.826 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-10-19T12:32:11.826 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-10-19T12:32:11.826 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-10-19T12:32:11.827 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-10-19T12:32:11.827 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-10-19T12:32:11.827 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-10-19T12:32:11.827 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-10-19T12:32:11.827 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-10-19T12:32:11.827 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-10-19T12:32:11.828 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-10-19T12:32:11.828 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-10-19T12:32:11.828 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-10-19T12:32:11.828 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-10-19T12:32:11.828 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-10-19T12:32:11.829 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-10-19T12:32:11.829 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-10-19T12:32:11.829 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-10-19T12:32:11.829 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-10-19T12:32:11.829 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-10-19T12:32:11.830 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-10-19T12:32:11.830 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-10-19T12:32:11.830 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-10-19T12:32:11.830 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-10-19T12:32:11.831 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-10-19T12:32:11.831 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-10-19T12:32:11.831 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-10-19T12:32:11.831 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-10-19T12:32:11.831 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-10-19T12:32:11.832 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-10-19T12:32:11.832 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-10-19T12:32:11.832 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-10-19T12:32:11.832 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 72/134 2023-10-19T12:32:11.832 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 73/134 2023-10-19T12:32:11.833 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/134 2023-10-19T12:32:11.833 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/134 2023-10-19T12:32:11.833 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 76/134 2023-10-19T12:32:11.833 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 77/134 2023-10-19T12:32:11.833 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/134 2023-10-19T12:32:11.834 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 79/134 2023-10-19T12:32:11.834 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/134 2023-10-19T12:32:11.834 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 81/134 2023-10-19T12:32:11.834 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 82/134 2023-10-19T12:32:11.834 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 83/134 2023-10-19T12:32:11.835 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 84/134 2023-10-19T12:32:11.835 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 85/134 2023-10-19T12:32:11.835 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 86/134 2023-10-19T12:32:11.835 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 87/134 2023-10-19T12:32:11.836 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 88/134 2023-10-19T12:32:11.836 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 89/134 2023-10-19T12:32:11.836 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 90/134 2023-10-19T12:32:11.836 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 91/134 2023-10-19T12:32:11.836 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 92/134 2023-10-19T12:32:11.837 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 93/134 2023-10-19T12:32:11.837 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 94/134 2023-10-19T12:32:11.837 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 95/134 2023-10-19T12:32:11.837 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 96/134 2023-10-19T12:32:11.838 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 97/134 2023-10-19T12:32:11.838 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 98/134 2023-10-19T12:32:11.838 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 99/134 2023-10-19T12:32:11.838 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 100/134 2023-10-19T12:32:11.838 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 101/134 2023-10-19T12:32:11.839 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 102/134 2023-10-19T12:32:11.839 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 103/134 2023-10-19T12:32:11.839 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : bison-3.0.4-10.el8.x86_64 104/134 2023-10-19T12:32:11.839 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 105/134 2023-10-19T12:32:11.839 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 106/134 2023-10-19T12:32:11.840 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/134 2023-10-19T12:32:11.840 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : automake-1.16.1-7.el8.noarch 108/134 2023-10-19T12:32:11.840 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 109/134 2023-10-19T12:32:11.840 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 110/134 2023-10-19T12:32:11.840 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : flex-2.6.1-9.el8.x86_64 111/134 2023-10-19T12:32:11.841 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 112/134 2023-10-19T12:32:11.841 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 113/134 2023-10-19T12:32:11.841 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 114/134 2023-10-19T12:32:11.841 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 115/134 2023-10-19T12:32:11.841 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 116/134 2023-10-19T12:32:11.841 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 117/134 2023-10-19T12:32:11.842 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 118/134 2023-10-19T12:32:11.842 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 119/134 2023-10-19T12:32:11.842 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 120/134 2023-10-19T12:32:11.842 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 121/134 2023-10-19T12:32:11.842 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libpq-13.5-1.el8.x86_64 122/134 2023-10-19T12:32:11.843 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 123/134 2023-10-19T12:32:11.843 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : jq-1.6-3.el8.x86_64 124/134 2023-10-19T12:32:11.843 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 125/134 2023-10-19T12:32:11.843 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 126/134 2023-10-19T12:32:11.843 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 127/134 2023-10-19T12:32:11.844 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 128/134 2023-10-19T12:32:11.844 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librados2-2:18.0.0-6786.gf7420d7f.el8.x86_64 129/134 2023-10-19T12:32:11.844 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-10-19T12:32:11.844 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librbd1-2:18.0.0-6786.gf7420d7f.el8.x86_64 131/134 2023-10-19T12:32:11.844 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-19T12:32:11.845 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-10-19T12:32:11.968 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-radosgw-2:18.0.0-6786.gf7420d7f.el8.x86_64 111/134 2023-10-19T12:32:12.002 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-19T12:32:12.002 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:01:52 ago on Thu 19 Oct 2023 12:30:19 PM UTC. 2023-10-19T12:32:12.031 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6786.gf7420d7f.el8.x86_64 111/134 2023-10-19T12:32:12.191 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6786.gf7420 112/134 2023-10-19T12:32:12.272 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6786.gf7420 112/134 2023-10-19T12:32:12.449 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : cephfs-mirror-2:18.0.0-6786.gf7420d7f.el8.x86_64 113/134 2023-10-19T12:32:12.892 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6786.gf7420d7f.el8.x86_64 113/134 2023-10-19T12:32:13.058 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : rbd-mirror-2:18.0.0-6786.gf7420d7f.el8.x86_64 114/134 2023-10-19T12:32:14.344 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-19T12:32:14.344 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:01:55 ago on Thu 19 Oct 2023 12:30:19 PM UTC. 2023-10-19T12:32:14.551 INFO:teuthology.orchestra.run.smithi157.stdout:Installed products updated. 2023-10-19T12:32:14.763 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-19T12:32:14.764 INFO:teuthology.orchestra.run.smithi157.stdout:Upgraded: 2023-10-19T12:32:14.764 INFO:teuthology.orchestra.run.smithi157.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-10-19T12:32:14.764 INFO:teuthology.orchestra.run.smithi157.stdout: librados2-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-19T12:32:14.764 INFO:teuthology.orchestra.run.smithi157.stdout: librbd1-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-19T12:32:14.765 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2023-10-19T12:32:14.765 INFO:teuthology.orchestra.run.smithi157.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-10-19T12:32:14.765 INFO:teuthology.orchestra.run.smithi157.stdout: automake-1.16.1-7.el8.noarch 2023-10-19T12:32:14.765 INFO:teuthology.orchestra.run.smithi157.stdout: bison-3.0.4-10.el8.x86_64 2023-10-19T12:32:14.766 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-19T12:32:14.766 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-base-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-19T12:32:14.766 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-common-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-19T12:32:14.766 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-fuse-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-19T12:32:14.767 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-grafana-dashboards-2:18.0.0-6786.gf7420d7f.el8.noarch 2023-10-19T12:32:14.767 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-immutable-object-cache-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-19T12:32:14.767 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mds-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-19T12:32:14.767 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-19T12:32:14.767 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-cephadm-2:18.0.0-6786.gf7420d7f.el8.noarch 2023-10-19T12:32:14.768 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-dashboard-2:18.0.0-6786.gf7420d7f.el8.noarch 2023-10-19T12:32:14.768 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6786.gf7420d7f.el8.noarch 2023-10-19T12:32:14.768 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-modules-core-2:18.0.0-6786.gf7420d7f.el8.noarch 2023-10-19T12:32:14.768 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-rook-2:18.0.0-6786.gf7420d7f.el8.noarch 2023-10-19T12:32:14.769 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mon-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-19T12:32:14.769 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-osd-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-19T12:32:14.769 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-prometheus-alerts-2:18.0.0-6786.gf7420d7f.el8.noarch 2023-10-19T12:32:14.769 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-radosgw-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-19T12:32:14.770 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-selinux-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-19T12:32:14.770 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-test-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-19T12:32:14.770 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-volume-2:18.0.0-6786.gf7420d7f.el8.noarch 2023-10-19T12:32:14.770 INFO:teuthology.orchestra.run.smithi157.stdout: cephadm-2:18.0.0-6786.gf7420d7f.el8.noarch 2023-10-19T12:32:14.770 INFO:teuthology.orchestra.run.smithi157.stdout: cephfs-mirror-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-19T12:32:14.771 INFO:teuthology.orchestra.run.smithi157.stdout: cephfs-top-2:18.0.0-6786.gf7420d7f.el8.noarch 2023-10-19T12:32:14.771 INFO:teuthology.orchestra.run.smithi157.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-10-19T12:32:14.771 INFO:teuthology.orchestra.run.smithi157.stdout: flex-2.6.1-9.el8.x86_64 2023-10-19T12:32:14.771 INFO:teuthology.orchestra.run.smithi157.stdout: fuse-2.9.7-15.el8.x86_64 2023-10-19T12:32:14.771 INFO:teuthology.orchestra.run.smithi157.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-19T12:32:14.772 INFO:teuthology.orchestra.run.smithi157.stdout: jq-1.6-3.el8.x86_64 2023-10-19T12:32:14.772 INFO:teuthology.orchestra.run.smithi157.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-10-19T12:32:14.772 INFO:teuthology.orchestra.run.smithi157.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-10-19T12:32:14.772 INFO:teuthology.orchestra.run.smithi157.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-19T12:32:14.772 INFO:teuthology.orchestra.run.smithi157.stdout: libcephfs-devel-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-19T12:32:14.773 INFO:teuthology.orchestra.run.smithi157.stdout: libcephfs2-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-19T12:32:14.773 INFO:teuthology.orchestra.run.smithi157.stdout: libcephsqlite-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-19T12:32:14.773 INFO:teuthology.orchestra.run.smithi157.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-10-19T12:32:14.773 INFO:teuthology.orchestra.run.smithi157.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-10-19T12:32:14.773 INFO:teuthology.orchestra.run.smithi157.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-19T12:32:14.774 INFO:teuthology.orchestra.run.smithi157.stdout: libpq-13.5-1.el8.x86_64 2023-10-19T12:32:14.774 INFO:teuthology.orchestra.run.smithi157.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-10-19T12:32:14.774 INFO:teuthology.orchestra.run.smithi157.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-19T12:32:14.775 INFO:teuthology.orchestra.run.smithi157.stdout: librados-devel-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-19T12:32:14.775 INFO:teuthology.orchestra.run.smithi157.stdout: libradosstriper1-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-19T12:32:14.775 INFO:teuthology.orchestra.run.smithi157.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-19T12:32:14.775 INFO:teuthology.orchestra.run.smithi157.stdout: librgw2-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-19T12:32:14.775 INFO:teuthology.orchestra.run.smithi157.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-19T12:32:14.776 INFO:teuthology.orchestra.run.smithi157.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-10-19T12:32:14.776 INFO:teuthology.orchestra.run.smithi157.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-19T12:32:14.776 INFO:teuthology.orchestra.run.smithi157.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-19T12:32:14.776 INFO:teuthology.orchestra.run.smithi157.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-10-19T12:32:14.776 INFO:teuthology.orchestra.run.smithi157.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-19T12:32:14.777 INFO:teuthology.orchestra.run.smithi157.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-19T12:32:14.777 INFO:teuthology.orchestra.run.smithi157.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-19T12:32:14.777 INFO:teuthology.orchestra.run.smithi157.stdout: openblas-0.3.15-3.el8.x86_64 2023-10-19T12:32:14.777 INFO:teuthology.orchestra.run.smithi157.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-10-19T12:32:14.778 INFO:teuthology.orchestra.run.smithi157.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-10-19T12:32:14.778 INFO:teuthology.orchestra.run.smithi157.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-19T12:32:14.778 INFO:teuthology.orchestra.run.smithi157.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-19T12:32:14.778 INFO:teuthology.orchestra.run.smithi157.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-19T12:32:14.779 INFO:teuthology.orchestra.run.smithi157.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-19T12:32:14.779 INFO:teuthology.orchestra.run.smithi157.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-19T12:32:14.779 INFO:teuthology.orchestra.run.smithi157.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-19T12:32:14.779 INFO:teuthology.orchestra.run.smithi157.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-19T12:32:14.780 INFO:teuthology.orchestra.run.smithi157.stdout: python3-babel-2.5.1-7.el8.noarch 2023-10-19T12:32:14.780 INFO:teuthology.orchestra.run.smithi157.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-19T12:32:14.780 INFO:teuthology.orchestra.run.smithi157.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-19T12:32:14.780 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-19T12:32:14.780 INFO:teuthology.orchestra.run.smithi157.stdout: python3-ceph-argparse-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-19T12:32:14.781 INFO:teuthology.orchestra.run.smithi157.stdout: python3-ceph-common-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-19T12:32:14.781 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cephfs-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-19T12:32:14.781 INFO:teuthology.orchestra.run.smithi157.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-19T12:32:14.781 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-10-19T12:32:14.782 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-19T12:32:14.782 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-19T12:32:14.782 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-10-19T12:32:14.782 INFO:teuthology.orchestra.run.smithi157.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-19T12:32:14.782 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-19T12:32:14.783 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-19T12:32:14.783 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-10-19T12:32:14.783 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-19T12:32:14.783 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-19T12:32:14.783 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-19T12:32:14.783 INFO:teuthology.orchestra.run.smithi157.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-19T12:32:14.784 INFO:teuthology.orchestra.run.smithi157.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-19T12:32:14.784 INFO:teuthology.orchestra.run.smithi157.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-19T12:32:14.784 INFO:teuthology.orchestra.run.smithi157.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-19T12:32:14.784 INFO:teuthology.orchestra.run.smithi157.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-19T12:32:14.784 INFO:teuthology.orchestra.run.smithi157.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-19T12:32:14.785 INFO:teuthology.orchestra.run.smithi157.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-19T12:32:14.785 INFO:teuthology.orchestra.run.smithi157.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-19T12:32:14.785 INFO:teuthology.orchestra.run.smithi157.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-19T12:32:14.785 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-19T12:32:14.786 INFO:teuthology.orchestra.run.smithi157.stdout: python3-portend-2.6-1.el8.noarch 2023-10-19T12:32:14.786 INFO:teuthology.orchestra.run.smithi157.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-19T12:32:14.786 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-19T12:32:14.786 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-19T12:32:14.786 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-19T12:32:14.787 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-19T12:32:14.787 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-19T12:32:14.787 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rados-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-19T12:32:14.787 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rbd-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-19T12:32:14.787 INFO:teuthology.orchestra.run.smithi157.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-19T12:32:14.788 INFO:teuthology.orchestra.run.smithi157.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-19T12:32:14.788 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rgw-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-19T12:32:14.788 INFO:teuthology.orchestra.run.smithi157.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-19T12:32:14.788 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-19T12:32:14.788 INFO:teuthology.orchestra.run.smithi157.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-10-19T12:32:14.789 INFO:teuthology.orchestra.run.smithi157.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-19T12:32:14.789 INFO:teuthology.orchestra.run.smithi157.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-19T12:32:14.789 INFO:teuthology.orchestra.run.smithi157.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-19T12:32:14.789 INFO:teuthology.orchestra.run.smithi157.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-19T12:32:14.789 INFO:teuthology.orchestra.run.smithi157.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-19T12:32:14.790 INFO:teuthology.orchestra.run.smithi157.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-19T12:32:14.790 INFO:teuthology.orchestra.run.smithi157.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-19T12:32:14.790 INFO:teuthology.orchestra.run.smithi157.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-19T12:32:14.790 INFO:teuthology.orchestra.run.smithi157.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-19T12:32:14.790 INFO:teuthology.orchestra.run.smithi157.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-19T12:32:14.791 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-fuse-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-19T12:32:14.791 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-mirror-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-19T12:32:14.791 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-nbd-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-19T12:32:14.791 INFO:teuthology.orchestra.run.smithi157.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-19T12:32:14.791 INFO:teuthology.orchestra.run.smithi157.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-19T12:32:14.792 INFO:teuthology.orchestra.run.smithi157.stdout: uuid-1.6.2-43.el8.x86_64 2023-10-19T12:32:14.792 INFO:teuthology.orchestra.run.smithi157.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-10-19T12:32:14.792 INFO:teuthology.orchestra.run.smithi157.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-19T12:32:14.793 INFO:teuthology.orchestra.run.smithi157.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-10-19T12:32:14.793 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-19T12:32:14.793 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2023-10-19T12:32:14.927 DEBUG:teuthology.parallel:result is None 2023-10-19T12:32:16.918 INFO:teuthology.orchestra.run.smithi195.stdout:Installed products updated. 2023-10-19T12:32:17.130 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-10-19T12:32:17.130 INFO:teuthology.orchestra.run.smithi195.stdout:Upgraded: 2023-10-19T12:32:17.131 INFO:teuthology.orchestra.run.smithi195.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-10-19T12:32:17.131 INFO:teuthology.orchestra.run.smithi195.stdout: librados2-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-19T12:32:17.131 INFO:teuthology.orchestra.run.smithi195.stdout: librbd1-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-19T12:32:17.131 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2023-10-19T12:32:17.131 INFO:teuthology.orchestra.run.smithi195.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-10-19T12:32:17.132 INFO:teuthology.orchestra.run.smithi195.stdout: automake-1.16.1-7.el8.noarch 2023-10-19T12:32:17.132 INFO:teuthology.orchestra.run.smithi195.stdout: bison-3.0.4-10.el8.x86_64 2023-10-19T12:32:17.132 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-19T12:32:17.132 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-base-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-19T12:32:17.133 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-common-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-19T12:32:17.133 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-fuse-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-19T12:32:17.133 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-grafana-dashboards-2:18.0.0-6786.gf7420d7f.el8.noarch 2023-10-19T12:32:17.133 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-immutable-object-cache-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-19T12:32:17.134 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mds-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-19T12:32:17.134 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-19T12:32:17.134 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-cephadm-2:18.0.0-6786.gf7420d7f.el8.noarch 2023-10-19T12:32:17.134 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-dashboard-2:18.0.0-6786.gf7420d7f.el8.noarch 2023-10-19T12:32:17.134 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6786.gf7420d7f.el8.noarch 2023-10-19T12:32:17.135 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-modules-core-2:18.0.0-6786.gf7420d7f.el8.noarch 2023-10-19T12:32:17.135 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-rook-2:18.0.0-6786.gf7420d7f.el8.noarch 2023-10-19T12:32:17.135 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mon-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-19T12:32:17.135 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-osd-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-19T12:32:17.136 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-prometheus-alerts-2:18.0.0-6786.gf7420d7f.el8.noarch 2023-10-19T12:32:17.136 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-radosgw-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-19T12:32:17.136 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-selinux-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-19T12:32:17.136 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-test-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-19T12:32:17.136 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-volume-2:18.0.0-6786.gf7420d7f.el8.noarch 2023-10-19T12:32:17.137 INFO:teuthology.orchestra.run.smithi195.stdout: cephadm-2:18.0.0-6786.gf7420d7f.el8.noarch 2023-10-19T12:32:17.137 INFO:teuthology.orchestra.run.smithi195.stdout: cephfs-mirror-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-19T12:32:17.137 INFO:teuthology.orchestra.run.smithi195.stdout: cephfs-top-2:18.0.0-6786.gf7420d7f.el8.noarch 2023-10-19T12:32:17.137 INFO:teuthology.orchestra.run.smithi195.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-10-19T12:32:17.137 INFO:teuthology.orchestra.run.smithi195.stdout: flex-2.6.1-9.el8.x86_64 2023-10-19T12:32:17.138 INFO:teuthology.orchestra.run.smithi195.stdout: fuse-2.9.7-15.el8.x86_64 2023-10-19T12:32:17.138 INFO:teuthology.orchestra.run.smithi195.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-19T12:32:17.138 INFO:teuthology.orchestra.run.smithi195.stdout: jq-1.6-3.el8.x86_64 2023-10-19T12:32:17.138 INFO:teuthology.orchestra.run.smithi195.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-10-19T12:32:17.139 INFO:teuthology.orchestra.run.smithi195.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-10-19T12:32:17.139 INFO:teuthology.orchestra.run.smithi195.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-19T12:32:17.139 INFO:teuthology.orchestra.run.smithi195.stdout: libcephfs-devel-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-19T12:32:17.139 INFO:teuthology.orchestra.run.smithi195.stdout: libcephfs2-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-19T12:32:17.139 INFO:teuthology.orchestra.run.smithi195.stdout: libcephsqlite-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-19T12:32:17.139 INFO:teuthology.orchestra.run.smithi195.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-10-19T12:32:17.140 INFO:teuthology.orchestra.run.smithi195.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-10-19T12:32:17.140 INFO:teuthology.orchestra.run.smithi195.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-19T12:32:17.140 INFO:teuthology.orchestra.run.smithi195.stdout: libpq-13.5-1.el8.x86_64 2023-10-19T12:32:17.140 INFO:teuthology.orchestra.run.smithi195.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-10-19T12:32:17.140 INFO:teuthology.orchestra.run.smithi195.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-19T12:32:17.141 INFO:teuthology.orchestra.run.smithi195.stdout: librados-devel-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-19T12:32:17.141 INFO:teuthology.orchestra.run.smithi195.stdout: libradosstriper1-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-19T12:32:17.141 INFO:teuthology.orchestra.run.smithi195.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-19T12:32:17.141 INFO:teuthology.orchestra.run.smithi195.stdout: librgw2-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-19T12:32:17.141 INFO:teuthology.orchestra.run.smithi195.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-19T12:32:17.141 INFO:teuthology.orchestra.run.smithi195.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-10-19T12:32:17.142 INFO:teuthology.orchestra.run.smithi195.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-19T12:32:17.142 INFO:teuthology.orchestra.run.smithi195.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-19T12:32:17.142 INFO:teuthology.orchestra.run.smithi195.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-10-19T12:32:17.142 INFO:teuthology.orchestra.run.smithi195.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-19T12:32:17.142 INFO:teuthology.orchestra.run.smithi195.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-19T12:32:17.143 INFO:teuthology.orchestra.run.smithi195.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-19T12:32:17.143 INFO:teuthology.orchestra.run.smithi195.stdout: openblas-0.3.15-3.el8.x86_64 2023-10-19T12:32:17.143 INFO:teuthology.orchestra.run.smithi195.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-10-19T12:32:17.143 INFO:teuthology.orchestra.run.smithi195.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-10-19T12:32:17.144 INFO:teuthology.orchestra.run.smithi195.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-19T12:32:17.144 INFO:teuthology.orchestra.run.smithi195.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-19T12:32:17.144 INFO:teuthology.orchestra.run.smithi195.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-19T12:32:17.144 INFO:teuthology.orchestra.run.smithi195.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-19T12:32:17.144 INFO:teuthology.orchestra.run.smithi195.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-19T12:32:17.145 INFO:teuthology.orchestra.run.smithi195.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-19T12:32:17.145 INFO:teuthology.orchestra.run.smithi195.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-19T12:32:17.145 INFO:teuthology.orchestra.run.smithi195.stdout: python3-babel-2.5.1-7.el8.noarch 2023-10-19T12:32:17.145 INFO:teuthology.orchestra.run.smithi195.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-19T12:32:17.145 INFO:teuthology.orchestra.run.smithi195.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-19T12:32:17.146 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-19T12:32:17.146 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ceph-argparse-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-19T12:32:17.146 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ceph-common-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-19T12:32:17.146 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cephfs-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-19T12:32:17.146 INFO:teuthology.orchestra.run.smithi195.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-19T12:32:17.147 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-10-19T12:32:17.147 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-19T12:32:17.147 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-19T12:32:17.147 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-10-19T12:32:17.147 INFO:teuthology.orchestra.run.smithi195.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-19T12:32:17.147 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-19T12:32:17.148 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-19T12:32:17.148 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-10-19T12:32:17.148 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-19T12:32:17.148 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-19T12:32:17.148 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-19T12:32:17.149 INFO:teuthology.orchestra.run.smithi195.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-19T12:32:17.149 INFO:teuthology.orchestra.run.smithi195.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-19T12:32:17.149 INFO:teuthology.orchestra.run.smithi195.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-19T12:32:17.149 INFO:teuthology.orchestra.run.smithi195.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-19T12:32:17.150 INFO:teuthology.orchestra.run.smithi195.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-19T12:32:17.150 INFO:teuthology.orchestra.run.smithi195.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-19T12:32:17.150 INFO:teuthology.orchestra.run.smithi195.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-19T12:32:17.150 INFO:teuthology.orchestra.run.smithi195.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-19T12:32:17.150 INFO:teuthology.orchestra.run.smithi195.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-19T12:32:17.151 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-19T12:32:17.151 INFO:teuthology.orchestra.run.smithi195.stdout: python3-portend-2.6-1.el8.noarch 2023-10-19T12:32:17.151 INFO:teuthology.orchestra.run.smithi195.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-19T12:32:17.151 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-19T12:32:17.151 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-19T12:32:17.152 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-19T12:32:17.152 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-19T12:32:17.152 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-19T12:32:17.152 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rados-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-19T12:32:17.153 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rbd-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-19T12:32:17.153 INFO:teuthology.orchestra.run.smithi195.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-19T12:32:17.153 INFO:teuthology.orchestra.run.smithi195.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-19T12:32:17.153 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rgw-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-19T12:32:17.153 INFO:teuthology.orchestra.run.smithi195.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-19T12:32:17.154 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-19T12:32:17.154 INFO:teuthology.orchestra.run.smithi195.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-10-19T12:32:17.154 INFO:teuthology.orchestra.run.smithi195.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-19T12:32:17.154 INFO:teuthology.orchestra.run.smithi195.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-19T12:32:17.154 INFO:teuthology.orchestra.run.smithi195.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-19T12:32:17.155 INFO:teuthology.orchestra.run.smithi195.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-19T12:32:17.155 INFO:teuthology.orchestra.run.smithi195.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-19T12:32:17.155 INFO:teuthology.orchestra.run.smithi195.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-19T12:32:17.155 INFO:teuthology.orchestra.run.smithi195.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-19T12:32:17.155 INFO:teuthology.orchestra.run.smithi195.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-19T12:32:17.156 INFO:teuthology.orchestra.run.smithi195.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-19T12:32:17.156 INFO:teuthology.orchestra.run.smithi195.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-19T12:32:17.156 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-fuse-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-19T12:32:17.156 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-mirror-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-19T12:32:17.156 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-nbd-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-19T12:32:17.157 INFO:teuthology.orchestra.run.smithi195.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-19T12:32:17.157 INFO:teuthology.orchestra.run.smithi195.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-19T12:32:17.157 INFO:teuthology.orchestra.run.smithi195.stdout: uuid-1.6.2-43.el8.x86_64 2023-10-19T12:32:17.157 INFO:teuthology.orchestra.run.smithi195.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-10-19T12:32:17.157 INFO:teuthology.orchestra.run.smithi195.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-19T12:32:17.158 INFO:teuthology.orchestra.run.smithi195.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-10-19T12:32:17.158 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-10-19T12:32:17.158 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2023-10-19T12:32:17.328 DEBUG:teuthology.parallel:result is None 2023-10-19T12:32:18.446 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6786.gf7420d7f.el8.x86_64 114/134 2023-10-19T12:32:18.748 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-test-2:18.0.0-6786.gf7420d7f.el8.x86_64 115/134 2023-10-19T12:32:19.023 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-10-19T12:32:19.291 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-10-19T12:32:20.618 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-10-19T12:32:21.089 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-10-19T12:32:21.330 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-fuse-2:18.0.0-6786.gf7420d7f.el8.x86_64 119/134 2023-10-19T12:32:21.545 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-10-19T12:32:21.745 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libcephfs-devel-2:18.0.0-6786.gf7420d7f.el8.x86_ 121/134 2023-10-19T12:32:21.908 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-19T12:32:25.582 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-19T12:32:25.873 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-19T12:32:25.912 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-19T12:32:26.116 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : cephfs-top-2:18.0.0-6786.gf7420d7f.el8.noarch 124/134 2023-10-19T12:32:26.366 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : rbd-fuse-2:18.0.0-6786.gf7420d7f.el8.x86_64 125/134 2023-10-19T12:32:26.734 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : rbd-nbd-2:18.0.0-6786.gf7420d7f.el8.x86_64 126/134 2023-10-19T12:32:27.058 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-10-19T12:32:27.239 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-19T12:32:27.263 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-19T12:32:27.491 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-10-19T12:32:27.697 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-10-19T12:32:27.809 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-10-19T12:32:28.022 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-10-19T12:32:28.052 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-10-19T12:32:28.052 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-19T12:32:28.279 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-19T12:32:28.279 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-19T12:32:28.605 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-19T12:32:28.856 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-19T12:32:29.118 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-10-19T12:32:29.118 INFO:teuthology.orchestra.run.smithi046.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-10-19T12:32:29.119 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:32:29.798 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-2:18.0.0-6786.gf7420d7f.el8.x86_64 1/134 2023-10-19T12:32:29.799 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-base-2:18.0.0-6786.gf7420d7f.el8.x86_64 2/134 2023-10-19T12:32:29.799 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-common-2:18.0.0-6786.gf7420d7f.el8.x86_64 3/134 2023-10-19T12:32:29.799 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-fuse-2:18.0.0-6786.gf7420d7f.el8.x86_64 4/134 2023-10-19T12:32:29.799 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6786.gf7420 5/134 2023-10-19T12:32:29.799 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mds-2:18.0.0-6786.gf7420d7f.el8.x86_64 6/134 2023-10-19T12:32:29.800 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-2:18.0.0-6786.gf7420d7f.el8.x86_64 7/134 2023-10-19T12:32:29.800 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mon-2:18.0.0-6786.gf7420d7f.el8.x86_64 8/134 2023-10-19T12:32:29.800 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-osd-2:18.0.0-6786.gf7420d7f.el8.x86_64 9/134 2023-10-19T12:32:29.800 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-radosgw-2:18.0.0-6786.gf7420d7f.el8.x86_64 10/134 2023-10-19T12:32:29.800 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-selinux-2:18.0.0-6786.gf7420d7f.el8.x86_64 11/134 2023-10-19T12:32:29.800 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-test-2:18.0.0-6786.gf7420d7f.el8.x86_64 12/134 2023-10-19T12:32:29.801 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : cephfs-mirror-2:18.0.0-6786.gf7420d7f.el8.x86_64 13/134 2023-10-19T12:32:29.801 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libcephfs-devel-2:18.0.0-6786.gf7420d7f.el8.x86_ 14/134 2023-10-19T12:32:29.801 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libcephfs2-2:18.0.0-6786.gf7420d7f.el8.x86_64 15/134 2023-10-19T12:32:29.801 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libcephsqlite-2:18.0.0-6786.gf7420d7f.el8.x86_64 16/134 2023-10-19T12:32:29.801 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librados-devel-2:18.0.0-6786.gf7420d7f.el8.x86_6 17/134 2023-10-19T12:32:29.802 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libradosstriper1-2:18.0.0-6786.gf7420d7f.el8.x86 18/134 2023-10-19T12:32:29.802 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librgw2-2:18.0.0-6786.gf7420d7f.el8.x86_64 19/134 2023-10-19T12:32:29.802 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6786.gf7420d7f.el 20/134 2023-10-19T12:32:29.802 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-ceph-common-2:18.0.0-6786.gf7420d7f.el8. 21/134 2023-10-19T12:32:29.802 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cephfs-2:18.0.0-6786.gf7420d7f.el8.x86_6 22/134 2023-10-19T12:32:29.803 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rados-2:18.0.0-6786.gf7420d7f.el8.x86_64 23/134 2023-10-19T12:32:29.803 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rbd-2:18.0.0-6786.gf7420d7f.el8.x86_64 24/134 2023-10-19T12:32:29.803 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rgw-2:18.0.0-6786.gf7420d7f.el8.x86_64 25/134 2023-10-19T12:32:29.803 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : rbd-fuse-2:18.0.0-6786.gf7420d7f.el8.x86_64 26/134 2023-10-19T12:32:29.803 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : rbd-mirror-2:18.0.0-6786.gf7420d7f.el8.x86_64 27/134 2023-10-19T12:32:29.803 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : rbd-nbd-2:18.0.0-6786.gf7420d7f.el8.x86_64 28/134 2023-10-19T12:32:29.804 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6786.gf7420d7f. 29/134 2023-10-19T12:32:29.804 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6786.gf7420d7f.el8.noa 30/134 2023-10-19T12:32:29.804 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6786.gf7420d7f.el8.n 31/134 2023-10-19T12:32:29.804 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6786.gf74 32/134 2023-10-19T12:32:29.804 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6786.gf7420d7f.el 33/134 2023-10-19T12:32:29.804 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6786.gf7420d7f.el8.noarch 34/134 2023-10-19T12:32:29.805 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6786.gf7420d7f.e 35/134 2023-10-19T12:32:29.805 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-volume-2:18.0.0-6786.gf7420d7f.el8.noarch 36/134 2023-10-19T12:32:29.805 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : cephadm-2:18.0.0-6786.gf7420d7f.el8.noarch 37/134 2023-10-19T12:32:29.805 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : cephfs-top-2:18.0.0-6786.gf7420d7f.el8.noarch 38/134 2023-10-19T12:32:29.805 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-10-19T12:32:29.806 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-10-19T12:32:29.806 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-10-19T12:32:29.806 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-10-19T12:32:29.807 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-10-19T12:32:29.807 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-10-19T12:32:29.807 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-10-19T12:32:29.807 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-10-19T12:32:29.807 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-10-19T12:32:29.808 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-10-19T12:32:29.808 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-10-19T12:32:29.808 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-10-19T12:32:29.808 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-10-19T12:32:29.809 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-10-19T12:32:29.809 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-10-19T12:32:29.809 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-10-19T12:32:29.810 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-10-19T12:32:29.810 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-10-19T12:32:29.810 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-10-19T12:32:29.811 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-10-19T12:32:29.811 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-10-19T12:32:29.811 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-10-19T12:32:29.812 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-10-19T12:32:29.812 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-10-19T12:32:29.812 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-10-19T12:32:29.812 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-10-19T12:32:29.813 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-10-19T12:32:29.813 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-10-19T12:32:29.813 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-10-19T12:32:29.813 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-10-19T12:32:29.814 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-10-19T12:32:29.814 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-10-19T12:32:29.814 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-10-19T12:32:29.815 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-10-19T12:32:29.815 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-10-19T12:32:29.815 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-10-19T12:32:29.815 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-10-19T12:32:29.816 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-10-19T12:32:29.816 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-10-19T12:32:29.816 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-10-19T12:32:29.817 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-10-19T12:32:29.817 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-10-19T12:32:29.817 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-10-19T12:32:29.818 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-10-19T12:32:29.818 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-10-19T12:32:29.818 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-10-19T12:32:29.818 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-10-19T12:32:29.819 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-10-19T12:32:29.819 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-10-19T12:32:29.819 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-10-19T12:32:29.820 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-10-19T12:32:29.820 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-10-19T12:32:29.820 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-10-19T12:32:29.820 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-10-19T12:32:29.821 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-10-19T12:32:29.821 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-10-19T12:32:29.821 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-10-19T12:32:29.822 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-10-19T12:32:29.822 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-10-19T12:32:29.822 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-10-19T12:32:29.823 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-10-19T12:32:29.823 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-10-19T12:32:29.823 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-10-19T12:32:29.823 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-10-19T12:32:29.824 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-10-19T12:32:29.824 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-10-19T12:32:29.824 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-10-19T12:32:29.825 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-10-19T12:32:29.825 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-10-19T12:32:29.826 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-10-19T12:32:29.826 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-10-19T12:32:29.826 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-10-19T12:32:29.827 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-10-19T12:32:29.827 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-10-19T12:32:29.827 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-10-19T12:32:29.828 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-10-19T12:32:29.828 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-10-19T12:32:29.829 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-10-19T12:32:29.829 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-10-19T12:32:29.829 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-10-19T12:32:29.830 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-10-19T12:32:29.830 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-10-19T12:32:29.830 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-10-19T12:32:29.831 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-19T12:32:29.831 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-10-19T12:32:29.831 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-10-19T12:32:29.832 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-10-19T12:32:29.832 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-10-19T12:32:29.833 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-10-19T12:32:29.833 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-19T12:32:29.833 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librados2-2:18.0.0-6786.gf7420d7f.el8.x86_64 129/134 2023-10-19T12:32:29.834 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-10-19T12:32:29.834 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librbd1-2:18.0.0-6786.gf7420d7f.el8.x86_64 131/134 2023-10-19T12:32:29.834 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-19T12:32:29.835 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-10-19T12:32:32.443 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-19T12:32:32.443 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:02:10 ago on Thu 19 Oct 2023 12:30:22 PM UTC. 2023-10-19T12:32:35.611 INFO:teuthology.orchestra.run.smithi046.stdout:Installed products updated. 2023-10-19T12:32:35.854 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:32:35.854 INFO:teuthology.orchestra.run.smithi046.stdout:Upgraded: 2023-10-19T12:32:35.855 INFO:teuthology.orchestra.run.smithi046.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-10-19T12:32:35.855 INFO:teuthology.orchestra.run.smithi046.stdout: librados2-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-19T12:32:35.855 INFO:teuthology.orchestra.run.smithi046.stdout: librbd1-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-19T12:32:35.855 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2023-10-19T12:32:35.855 INFO:teuthology.orchestra.run.smithi046.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-10-19T12:32:35.855 INFO:teuthology.orchestra.run.smithi046.stdout: automake-1.16.1-7.el8.noarch 2023-10-19T12:32:35.856 INFO:teuthology.orchestra.run.smithi046.stdout: bison-3.0.4-10.el8.x86_64 2023-10-19T12:32:35.856 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-19T12:32:35.856 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-base-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-19T12:32:35.856 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-common-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-19T12:32:35.856 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-fuse-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-19T12:32:35.857 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-grafana-dashboards-2:18.0.0-6786.gf7420d7f.el8.noarch 2023-10-19T12:32:35.857 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-immutable-object-cache-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-19T12:32:35.857 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mds-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-19T12:32:35.857 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-19T12:32:35.857 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-cephadm-2:18.0.0-6786.gf7420d7f.el8.noarch 2023-10-19T12:32:35.858 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-dashboard-2:18.0.0-6786.gf7420d7f.el8.noarch 2023-10-19T12:32:35.858 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6786.gf7420d7f.el8.noarch 2023-10-19T12:32:35.858 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-modules-core-2:18.0.0-6786.gf7420d7f.el8.noarch 2023-10-19T12:32:35.858 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-rook-2:18.0.0-6786.gf7420d7f.el8.noarch 2023-10-19T12:32:35.858 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mon-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-19T12:32:35.859 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-osd-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-19T12:32:35.859 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-prometheus-alerts-2:18.0.0-6786.gf7420d7f.el8.noarch 2023-10-19T12:32:35.859 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-radosgw-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-19T12:32:35.859 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-selinux-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-19T12:32:35.859 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-test-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-19T12:32:35.859 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-volume-2:18.0.0-6786.gf7420d7f.el8.noarch 2023-10-19T12:32:35.860 INFO:teuthology.orchestra.run.smithi046.stdout: cephadm-2:18.0.0-6786.gf7420d7f.el8.noarch 2023-10-19T12:32:35.860 INFO:teuthology.orchestra.run.smithi046.stdout: cephfs-mirror-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-19T12:32:35.860 INFO:teuthology.orchestra.run.smithi046.stdout: cephfs-top-2:18.0.0-6786.gf7420d7f.el8.noarch 2023-10-19T12:32:35.860 INFO:teuthology.orchestra.run.smithi046.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-10-19T12:32:35.860 INFO:teuthology.orchestra.run.smithi046.stdout: flex-2.6.1-9.el8.x86_64 2023-10-19T12:32:35.860 INFO:teuthology.orchestra.run.smithi046.stdout: fuse-2.9.7-15.el8.x86_64 2023-10-19T12:32:35.861 INFO:teuthology.orchestra.run.smithi046.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-19T12:32:35.861 INFO:teuthology.orchestra.run.smithi046.stdout: jq-1.6-3.el8.x86_64 2023-10-19T12:32:35.861 INFO:teuthology.orchestra.run.smithi046.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-10-19T12:32:35.861 INFO:teuthology.orchestra.run.smithi046.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-10-19T12:32:35.861 INFO:teuthology.orchestra.run.smithi046.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-19T12:32:35.862 INFO:teuthology.orchestra.run.smithi046.stdout: libcephfs-devel-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-19T12:32:35.862 INFO:teuthology.orchestra.run.smithi046.stdout: libcephfs2-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-19T12:32:35.862 INFO:teuthology.orchestra.run.smithi046.stdout: libcephsqlite-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-19T12:32:35.862 INFO:teuthology.orchestra.run.smithi046.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-10-19T12:32:35.862 INFO:teuthology.orchestra.run.smithi046.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-10-19T12:32:35.862 INFO:teuthology.orchestra.run.smithi046.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-19T12:32:35.863 INFO:teuthology.orchestra.run.smithi046.stdout: libpq-13.5-1.el8.x86_64 2023-10-19T12:32:35.863 INFO:teuthology.orchestra.run.smithi046.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-10-19T12:32:35.863 INFO:teuthology.orchestra.run.smithi046.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-19T12:32:35.863 INFO:teuthology.orchestra.run.smithi046.stdout: librados-devel-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-19T12:32:35.863 INFO:teuthology.orchestra.run.smithi046.stdout: libradosstriper1-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-19T12:32:35.864 INFO:teuthology.orchestra.run.smithi046.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-19T12:32:35.864 INFO:teuthology.orchestra.run.smithi046.stdout: librgw2-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-19T12:32:35.864 INFO:teuthology.orchestra.run.smithi046.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-19T12:32:35.864 INFO:teuthology.orchestra.run.smithi046.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-10-19T12:32:35.864 INFO:teuthology.orchestra.run.smithi046.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-19T12:32:35.864 INFO:teuthology.orchestra.run.smithi046.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-19T12:32:35.865 INFO:teuthology.orchestra.run.smithi046.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-10-19T12:32:35.865 INFO:teuthology.orchestra.run.smithi046.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-19T12:32:35.865 INFO:teuthology.orchestra.run.smithi046.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-19T12:32:35.865 INFO:teuthology.orchestra.run.smithi046.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-19T12:32:35.865 INFO:teuthology.orchestra.run.smithi046.stdout: openblas-0.3.15-3.el8.x86_64 2023-10-19T12:32:35.866 INFO:teuthology.orchestra.run.smithi046.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-10-19T12:32:35.866 INFO:teuthology.orchestra.run.smithi046.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-10-19T12:32:35.866 INFO:teuthology.orchestra.run.smithi046.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-19T12:32:35.866 INFO:teuthology.orchestra.run.smithi046.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-19T12:32:35.866 INFO:teuthology.orchestra.run.smithi046.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-19T12:32:35.867 INFO:teuthology.orchestra.run.smithi046.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-19T12:32:35.867 INFO:teuthology.orchestra.run.smithi046.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-19T12:32:35.867 INFO:teuthology.orchestra.run.smithi046.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-19T12:32:35.867 INFO:teuthology.orchestra.run.smithi046.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-19T12:32:35.867 INFO:teuthology.orchestra.run.smithi046.stdout: python3-babel-2.5.1-7.el8.noarch 2023-10-19T12:32:35.867 INFO:teuthology.orchestra.run.smithi046.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-19T12:32:35.868 INFO:teuthology.orchestra.run.smithi046.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-19T12:32:35.868 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-19T12:32:35.868 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ceph-argparse-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-19T12:32:35.868 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ceph-common-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-19T12:32:35.868 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cephfs-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-19T12:32:35.869 INFO:teuthology.orchestra.run.smithi046.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-19T12:32:35.869 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-10-19T12:32:35.869 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-19T12:32:35.869 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-19T12:32:35.869 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-10-19T12:32:35.870 INFO:teuthology.orchestra.run.smithi046.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-19T12:32:35.870 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-19T12:32:35.870 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-19T12:32:35.870 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-10-19T12:32:35.870 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-19T12:32:35.871 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-19T12:32:35.871 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-19T12:32:35.871 INFO:teuthology.orchestra.run.smithi046.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-19T12:32:35.871 INFO:teuthology.orchestra.run.smithi046.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-19T12:32:35.871 INFO:teuthology.orchestra.run.smithi046.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-19T12:32:35.871 INFO:teuthology.orchestra.run.smithi046.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-19T12:32:35.872 INFO:teuthology.orchestra.run.smithi046.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-19T12:32:35.872 INFO:teuthology.orchestra.run.smithi046.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-19T12:32:35.872 INFO:teuthology.orchestra.run.smithi046.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-19T12:32:35.872 INFO:teuthology.orchestra.run.smithi046.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-19T12:32:35.872 INFO:teuthology.orchestra.run.smithi046.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-19T12:32:35.873 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-19T12:32:35.873 INFO:teuthology.orchestra.run.smithi046.stdout: python3-portend-2.6-1.el8.noarch 2023-10-19T12:32:35.873 INFO:teuthology.orchestra.run.smithi046.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-19T12:32:35.873 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-19T12:32:35.873 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-19T12:32:35.873 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-19T12:32:35.874 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-19T12:32:35.874 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-19T12:32:35.874 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rados-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-19T12:32:35.874 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rbd-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-19T12:32:35.874 INFO:teuthology.orchestra.run.smithi046.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-19T12:32:35.874 INFO:teuthology.orchestra.run.smithi046.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-19T12:32:35.875 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rgw-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-19T12:32:35.875 INFO:teuthology.orchestra.run.smithi046.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-19T12:32:35.875 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-19T12:32:35.875 INFO:teuthology.orchestra.run.smithi046.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-10-19T12:32:35.875 INFO:teuthology.orchestra.run.smithi046.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-19T12:32:35.876 INFO:teuthology.orchestra.run.smithi046.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-19T12:32:35.876 INFO:teuthology.orchestra.run.smithi046.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-19T12:32:35.876 INFO:teuthology.orchestra.run.smithi046.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-19T12:32:35.876 INFO:teuthology.orchestra.run.smithi046.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-19T12:32:35.876 INFO:teuthology.orchestra.run.smithi046.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-19T12:32:35.876 INFO:teuthology.orchestra.run.smithi046.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-19T12:32:35.877 INFO:teuthology.orchestra.run.smithi046.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-19T12:32:35.877 INFO:teuthology.orchestra.run.smithi046.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-19T12:32:35.877 INFO:teuthology.orchestra.run.smithi046.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-19T12:32:35.877 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-fuse-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-19T12:32:35.877 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-mirror-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-19T12:32:35.878 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-nbd-2:18.0.0-6786.gf7420d7f.el8.x86_64 2023-10-19T12:32:35.878 INFO:teuthology.orchestra.run.smithi046.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-19T12:32:35.878 INFO:teuthology.orchestra.run.smithi046.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-19T12:32:35.878 INFO:teuthology.orchestra.run.smithi046.stdout: uuid-1.6.2-43.el8.x86_64 2023-10-19T12:32:35.878 INFO:teuthology.orchestra.run.smithi046.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-10-19T12:32:35.879 INFO:teuthology.orchestra.run.smithi046.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-19T12:32:35.879 INFO:teuthology.orchestra.run.smithi046.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-10-19T12:32:35.879 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:32:35.880 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2023-10-19T12:32:36.173 DEBUG:teuthology.parallel:result is None 2023-10-19T12:32:36.174 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=f7420d7f8e55ceea786dcbf536c338ce920c21eb 2023-10-19T12:32:36.327 DEBUG:teuthology.orchestra.run.smithi046:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-19T12:32:36.383 INFO:teuthology.orchestra.run.smithi046.stdout:18.0.0-6786.gf7420d7f.el8 2023-10-19T12:32:36.384 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6786.gf7420d7f.el8 2023-10-19T12:32:36.384 INFO:teuthology.task.install:The correct ceph version 18.0.0-6786.gf7420d7f is installed. 2023-10-19T12:32:36.385 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=f7420d7f8e55ceea786dcbf536c338ce920c21eb 2023-10-19T12:32:36.539 DEBUG:teuthology.orchestra.run.smithi157:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-19T12:32:36.567 INFO:teuthology.orchestra.run.smithi157.stdout:18.0.0-6786.gf7420d7f.el8 2023-10-19T12:32:36.567 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6786.gf7420d7f.el8 2023-10-19T12:32:36.568 INFO:teuthology.task.install:The correct ceph version 18.0.0-6786.gf7420d7f is installed. 2023-10-19T12:32:36.568 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=f7420d7f8e55ceea786dcbf536c338ce920c21eb 2023-10-19T12:32:36.714 DEBUG:teuthology.orchestra.run.smithi195:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-19T12:32:36.743 INFO:teuthology.orchestra.run.smithi195.stdout:18.0.0-6786.gf7420d7f.el8 2023-10-19T12:32:36.743 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6786.gf7420d7f.el8 2023-10-19T12:32:36.743 INFO:teuthology.task.install:The correct ceph version 18.0.0-6786.gf7420d7f is installed. 2023-10-19T12:32:36.744 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-19T12:32:36.744 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-10-19T12:32:36.745 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-19T12:32:36.837 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-10-19T12:32:36.838 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-19T12:32:36.886 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2023-10-19T12:32:36.886 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-19T12:32:37.017 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-19T12:32:37.017 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-10-19T12:32:37.018 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/usr/bin/daemon-helper 2023-10-19T12:32:37.090 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-19T12:32:37.202 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-10-19T12:32:37.202 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/usr/bin/daemon-helper 2023-10-19T12:32:37.236 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-19T12:32:37.306 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2023-10-19T12:32:37.306 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/usr/bin/daemon-helper 2023-10-19T12:32:37.339 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-19T12:32:37.411 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-19T12:32:37.411 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-10-19T12:32:37.412 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-19T12:32:37.483 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-19T12:32:37.596 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-10-19T12:32:37.596 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-19T12:32:37.628 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-19T12:32:37.698 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2023-10-19T12:32:37.699 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-19T12:32:37.731 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-19T12:32:37.802 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-19T12:32:37.802 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-10-19T12:32:37.803 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/usr/bin/stdin-killer 2023-10-19T12:32:37.872 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-19T12:32:37.982 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-10-19T12:32:37.982 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/usr/bin/stdin-killer 2023-10-19T12:32:38.013 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-19T12:32:38.083 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2023-10-19T12:32:38.084 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/usr/bin/stdin-killer 2023-10-19T12:32:38.115 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-19T12:32:38.185 INFO:teuthology.run_tasks:Running task cephadm... 2023-10-19T12:32:38.272 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'global': {'ms die on skipped message': False}, 'mds': {'mds_bal_replicate_threshold': 1}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': 'f7420d7f8e55ceea786dcbf536c338ce920c21eb', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2023-10-19T12:32:38.273 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb 2023-10-19T12:32:38.273 INFO:tasks.cephadm:Cluster fsid is 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 2023-10-19T12:32:38.274 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2023-10-19T12:32:38.274 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.46', 'mon.b': '172.21.15.157', 'mon.c': '172.21.15.195'} 2023-10-19T12:32:38.275 INFO:tasks.cephadm:First mon is mon.a on smithi046 2023-10-19T12:32:38.275 INFO:tasks.cephadm:First mgr is x 2023-10-19T12:32:38.275 INFO:tasks.cephadm:Normalizing hostnames... 2023-10-19T12:32:38.276 DEBUG:teuthology.orchestra.run.smithi046:> sudo hostname $(hostname -s) 2023-10-19T12:32:38.348 DEBUG:teuthology.orchestra.run.smithi157:> sudo hostname $(hostname -s) 2023-10-19T12:32:38.383 DEBUG:teuthology.orchestra.run.smithi195:> sudo hostname $(hostname -s) 2023-10-19T12:32:38.416 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2023-10-19T12:32:38.416 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=f7420d7f8e55ceea786dcbf536c338ce920c21eb 2023-10-19T12:32:38.638 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'f7420d7f8e55ceea786dcbf536c338ce920c21eb', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic/73406/', 'root_build_cause': 'SCMTRIGGER', 'version': '18.0.0-6786-gf7420d7f', 'node_name': '172.21.2.7+braggi07', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic', 'package_manager_version': '18.0.0-6786.gf7420d7f'}, 'url': 'https://3.chacra.ceph.com/r/ceph/wip-batrick-testing-20231016.203825/f7420d7f8e55ceea786dcbf536c338ce920c21eb/centos/8/flavors/default/', 'distro_codename': None, 'modified': '2023-10-16 23:26:05.686958', 'distro_version': '8', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-batrick-testing-20231016.203825', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/wip-batrick-testing-20231016.203825/f7420d7f8e55ceea786dcbf536c338ce920c21eb/centos/8/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2023-10-19T12:32:38.898 INFO:tasks.util.chacra:got chacra host 3.chacra.ceph.com, ref wip-batrick-testing-20231016.203825, sha1 f7420d7f8e55ceea786dcbf536c338ce920c21eb from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F8%2Fx86_64&flavor=default&sha1=f7420d7f8e55ceea786dcbf536c338ce920c21eb 2023-10-19T12:32:38.899 INFO:tasks.cephadm:Discovered cachra url: https://3.chacra.ceph.com/binaries/ceph/wip-batrick-testing-20231016.203825/f7420d7f8e55ceea786dcbf536c338ce920c21eb/centos/8/x86_64/flavors/default/cephadm 2023-10-19T12:32:38.899 DEBUG:teuthology.orchestra.run.smithi046:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-batrick-testing-20231016.203825/f7420d7f8e55ceea786dcbf536c338ce920c21eb/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-10-19T12:32:39.513 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-rw-r--. 1 ubuntu ubuntu 793356 Oct 19 12:32 /home/ubuntu/cephtest/cephadm 2023-10-19T12:32:39.514 DEBUG:teuthology.orchestra.run.smithi157:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-batrick-testing-20231016.203825/f7420d7f8e55ceea786dcbf536c338ce920c21eb/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-10-19T12:32:40.119 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-rw-r--. 1 ubuntu ubuntu 793356 Oct 19 12:32 /home/ubuntu/cephtest/cephadm 2023-10-19T12:32:40.119 DEBUG:teuthology.orchestra.run.smithi195:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-batrick-testing-20231016.203825/f7420d7f8e55ceea786dcbf536c338ce920c21eb/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-10-19T12:32:40.536 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-rw-r--. 1 ubuntu ubuntu 793356 Oct 19 12:32 /home/ubuntu/cephtest/cephadm 2023-10-19T12:32:40.537 DEBUG:teuthology.orchestra.run.smithi046:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-10-19T12:32:40.589 DEBUG:teuthology.orchestra.run.smithi157:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-10-19T12:32:40.611 DEBUG:teuthology.orchestra.run.smithi195:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-10-19T12:32:40.647 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb on all hosts... 2023-10-19T12:32:40.648 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb pull 2023-10-19T12:32:40.653 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb pull 2023-10-19T12:32:40.655 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb pull 2023-10-19T12:32:42.330 INFO:teuthology.orchestra.run.smithi157.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb... 2023-10-19T12:32:42.615 INFO:teuthology.orchestra.run.smithi195.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb... 2023-10-19T12:32:44.722 INFO:teuthology.orchestra.run.smithi046.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb... 2023-10-19T12:33:11.115 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2023-10-19T12:33:11.116 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph_version": "ceph version 18.0.0-6786-gf7420d7f (f7420d7f8e55ceea786dcbf536c338ce920c21eb) reef (dev)", 2023-10-19T12:33:11.116 INFO:teuthology.orchestra.run.smithi157.stdout: "image_id": "34f3475ed6c6b39cd122896e26d95104b6c809dcc4158afee48f92e1da145120", 2023-10-19T12:33:11.116 INFO:teuthology.orchestra.run.smithi157.stdout: "repo_digests": [ 2023-10-19T12:33:11.116 INFO:teuthology.orchestra.run.smithi157.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:70b60cde6693b3225f0a93b57dd34fe281c6ae755adca32bcc00f7ca131ec348" 2023-10-19T12:33:11.116 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2023-10-19T12:33:11.117 INFO:teuthology.orchestra.run.smithi157.stdout:} 2023-10-19T12:33:11.604 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2023-10-19T12:33:11.605 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_version": "ceph version 18.0.0-6786-gf7420d7f (f7420d7f8e55ceea786dcbf536c338ce920c21eb) reef (dev)", 2023-10-19T12:33:11.605 INFO:teuthology.orchestra.run.smithi195.stdout: "image_id": "34f3475ed6c6b39cd122896e26d95104b6c809dcc4158afee48f92e1da145120", 2023-10-19T12:33:11.605 INFO:teuthology.orchestra.run.smithi195.stdout: "repo_digests": [ 2023-10-19T12:33:11.605 INFO:teuthology.orchestra.run.smithi195.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:70b60cde6693b3225f0a93b57dd34fe281c6ae755adca32bcc00f7ca131ec348" 2023-10-19T12:33:11.605 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2023-10-19T12:33:11.606 INFO:teuthology.orchestra.run.smithi195.stdout:} 2023-10-19T12:33:16.398 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-10-19T12:33:16.399 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph_version": "ceph version 18.0.0-6786-gf7420d7f (f7420d7f8e55ceea786dcbf536c338ce920c21eb) reef (dev)", 2023-10-19T12:33:16.399 INFO:teuthology.orchestra.run.smithi046.stdout: "image_id": "34f3475ed6c6b39cd122896e26d95104b6c809dcc4158afee48f92e1da145120", 2023-10-19T12:33:16.399 INFO:teuthology.orchestra.run.smithi046.stdout: "repo_digests": [ 2023-10-19T12:33:16.399 INFO:teuthology.orchestra.run.smithi046.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:70b60cde6693b3225f0a93b57dd34fe281c6ae755adca32bcc00f7ca131ec348" 2023-10-19T12:33:16.399 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2023-10-19T12:33:16.400 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-10-19T12:33:16.426 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /etc/ceph 2023-10-19T12:33:16.500 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /etc/ceph 2023-10-19T12:33:16.537 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /etc/ceph 2023-10-19T12:33:16.574 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 777 /etc/ceph 2023-10-19T12:33:16.644 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 777 /etc/ceph 2023-10-19T12:33:16.675 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 777 /etc/ceph 2023-10-19T12:33:16.705 INFO:tasks.cephadm:Writing seed config... 2023-10-19T12:33:16.707 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2023-10-19T12:33:16.707 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2023-10-19T12:33:16.707 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2023-10-19T12:33:16.708 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2023-10-19T12:33:16.708 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2023-10-19T12:33:16.708 INFO:tasks.cephadm: override: [mon] debug mon = 20 2023-10-19T12:33:16.708 INFO:tasks.cephadm: override: [mon] debug ms = 1 2023-10-19T12:33:16.709 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2023-10-19T12:33:16.709 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2023-10-19T12:33:16.709 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2023-10-19T12:33:16.710 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2023-10-19T12:33:16.710 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2023-10-19T12:33:16.710 INFO:tasks.cephadm: override: [osd] debug ms = 1 2023-10-19T12:33:16.710 INFO:tasks.cephadm: override: [osd] debug osd = 20 2023-10-19T12:33:16.711 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2023-10-19T12:33:16.711 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2023-10-19T12:33:16.711 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2023-10-19T12:33:16.711 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2023-10-19T12:33:16.712 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2023-10-19T12:33:16.712 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2023-10-19T12:33:16.712 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2023-10-19T12:33:16.713 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2023-10-19T12:33:16.713 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-10-19T12:33:16.714 DEBUG:teuthology.orchestra.run.smithi046:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2023-10-19T12:33:16.758 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [mds] mds_bal_replicate_threshold = 1 2023-10-19T12:33:16.758 DEBUG:teuthology.orchestra.run.smithi046:mon.a> sudo journalctl -f -n 0 -u ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@mon.a.service 2023-10-19T12:33:16.803 DEBUG:teuthology.orchestra.run.smithi046:mgr.x> sudo journalctl -f -n 0 -u ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@mgr.x.service 2023-10-19T12:33:16.848 INFO:tasks.cephadm:Bootstrapping... 2023-10-19T12:33:16.849 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb -v bootstrap --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.46 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2023-10-19T12:33:16.871 INFO:journalctl@ceph.mon.a.smithi046.stdout:-- Logs begin at Thu 2023-10-19 12:15:13 UTC. -- 2023-10-19T12:33:16.918 INFO:journalctl@ceph.mgr.x.smithi046.stdout:-- Logs begin at Thu 2023-10-19 12:15:13 UTC. -- 2023-10-19T12:33:17.086 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2023-10-19T12:33:17.086 INFO:teuthology.orchestra.run.smithi046.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb', '-v', 'bootstrap', '--fsid', '96a8be3c-6e7b-11ee-8db6-212e2dc638e7', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.46', '--skip-admin-label'] 2023-10-19T12:33:17.261 INFO:teuthology.orchestra.run.smithi046.stdout:/bin/podman: stdout 4.1.1 2023-10-19T12:33:17.262 INFO:teuthology.orchestra.run.smithi046.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2023-10-19T12:33:17.262 INFO:teuthology.orchestra.run.smithi046.stdout:Verifying podman|docker is present... 2023-10-19T12:33:17.435 INFO:teuthology.orchestra.run.smithi046.stdout:/bin/podman: stdout 4.1.1 2023-10-19T12:33:17.435 INFO:teuthology.orchestra.run.smithi046.stdout:Verifying lvm2 is present... 2023-10-19T12:33:17.435 INFO:teuthology.orchestra.run.smithi046.stdout:Verifying time synchronization is in place... 2023-10-19T12:33:17.450 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-10-19T12:33:17.450 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-10-19T12:33:17.463 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-10-19T12:33:17.463 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout inactive 2023-10-19T12:33:17.477 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout enabled 2023-10-19T12:33:17.490 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout active 2023-10-19T12:33:17.490 INFO:teuthology.orchestra.run.smithi046.stdout:Unit chronyd.service is enabled and running 2023-10-19T12:33:17.491 INFO:teuthology.orchestra.run.smithi046.stdout:Repeating the final host check... 2023-10-19T12:33:17.663 INFO:teuthology.orchestra.run.smithi046.stdout:/bin/podman: stdout 4.1.1 2023-10-19T12:33:17.664 INFO:teuthology.orchestra.run.smithi046.stdout:podman (/bin/podman) version 4.1.1 is present 2023-10-19T12:33:17.664 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl is present 2023-10-19T12:33:17.664 INFO:teuthology.orchestra.run.smithi046.stdout:lvcreate is present 2023-10-19T12:33:17.677 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-10-19T12:33:17.678 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-10-19T12:33:17.691 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-10-19T12:33:17.691 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout inactive 2023-10-19T12:33:17.705 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout enabled 2023-10-19T12:33:17.718 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout active 2023-10-19T12:33:17.719 INFO:teuthology.orchestra.run.smithi046.stdout:Unit chronyd.service is enabled and running 2023-10-19T12:33:17.719 INFO:teuthology.orchestra.run.smithi046.stdout:Host looks OK 2023-10-19T12:33:17.719 INFO:teuthology.orchestra.run.smithi046.stdout:Cluster fsid: 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 2023-10-19T12:33:17.719 INFO:teuthology.orchestra.run.smithi046.stdout:Acquiring lock 140076637104616 on /run/cephadm/96a8be3c-6e7b-11ee-8db6-212e2dc638e7.lock 2023-10-19T12:33:17.720 INFO:teuthology.orchestra.run.smithi046.stdout:Lock 140076637104616 acquired on /run/cephadm/96a8be3c-6e7b-11ee-8db6-212e2dc638e7.lock 2023-10-19T12:33:17.720 INFO:teuthology.orchestra.run.smithi046.stdout:Verifying IP 172.21.15.46 port 3300 ... 2023-10-19T12:33:17.721 INFO:teuthology.orchestra.run.smithi046.stdout:Verifying IP 172.21.15.46 port 6789 ... 2023-10-19T12:33:17.721 INFO:teuthology.orchestra.run.smithi046.stdout:Base mon IP(s) is [172.21.15.46:3300, 172.21.15.46:6789], mon addrv is [v2:172.21.15.46:3300,v1:172.21.15.46:6789] 2023-10-19T12:33:17.728 INFO:teuthology.orchestra.run.smithi046.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp metric 100 2023-10-19T12:33:17.728 INFO:teuthology.orchestra.run.smithi046.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.46 metric 100 2023-10-19T12:33:17.735 INFO:teuthology.orchestra.run.smithi046.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2023-10-19T12:33:17.735 INFO:teuthology.orchestra.run.smithi046.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2023-10-19T12:33:17.735 INFO:teuthology.orchestra.run.smithi046.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1798sec hoplimit 64 pref medium 2023-10-19T12:33:17.741 INFO:teuthology.orchestra.run.smithi046.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2023-10-19T12:33:17.742 INFO:teuthology.orchestra.run.smithi046.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2023-10-19T12:33:17.742 INFO:teuthology.orchestra.run.smithi046.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-10-19T12:33:17.742 INFO:teuthology.orchestra.run.smithi046.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2023-10-19T12:33:17.742 INFO:teuthology.orchestra.run.smithi046.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:15f8/64 scope link 2023-10-19T12:33:17.742 INFO:teuthology.orchestra.run.smithi046.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-10-19T12:33:17.743 INFO:teuthology.orchestra.run.smithi046.stdout:Mon IP `172.21.15.46` is in CIDR network `172.21.0.0/20` 2023-10-19T12:33:17.744 INFO:teuthology.orchestra.run.smithi046.stdout:Mon IP `172.21.15.46` is in CIDR network `172.21.0.0/20` 2023-10-19T12:33:17.744 INFO:teuthology.orchestra.run.smithi046.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2023-10-19T12:33:17.744 INFO:teuthology.orchestra.run.smithi046.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2023-10-19T12:33:17.744 INFO:teuthology.orchestra.run.smithi046.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb... 2023-10-19T12:33:18.220 INFO:teuthology.orchestra.run.smithi046.stdout:/bin/podman: stdout 34f3475ed6c6b39cd122896e26d95104b6c809dcc4158afee48f92e1da145120 2023-10-19T12:33:18.220 INFO:teuthology.orchestra.run.smithi046.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb... 2023-10-19T12:33:18.220 INFO:teuthology.orchestra.run.smithi046.stdout:/bin/podman: stderr Getting image source signatures 2023-10-19T12:33:18.221 INFO:teuthology.orchestra.run.smithi046.stdout:/bin/podman: stderr Copying blob sha256:bde102e0dc1fccb96f1164f2fe1ba9d3f5d7242e22d2b672b1db3aedff4d056f 2023-10-19T12:33:18.221 INFO:teuthology.orchestra.run.smithi046.stdout:/bin/podman: stderr Copying blob sha256:8ed15414cb45b8b895a21f106743ceee45272cee0d9e7e5b1f49bd1e877e4a11 2023-10-19T12:33:18.221 INFO:teuthology.orchestra.run.smithi046.stdout:/bin/podman: stderr Copying config sha256:34f3475ed6c6b39cd122896e26d95104b6c809dcc4158afee48f92e1da145120 2023-10-19T12:33:18.221 INFO:teuthology.orchestra.run.smithi046.stdout:/bin/podman: stderr Writing manifest to image destination 2023-10-19T12:33:18.221 INFO:teuthology.orchestra.run.smithi046.stdout:/bin/podman: stderr Storing signatures 2023-10-19T12:33:19.097 INFO:teuthology.orchestra.run.smithi046.stdout:ceph: stdout ceph version 18.0.0-6786-gf7420d7f (f7420d7f8e55ceea786dcbf536c338ce920c21eb) reef (dev) 2023-10-19T12:33:19.098 INFO:teuthology.orchestra.run.smithi046.stdout:Ceph version: ceph version 18.0.0-6786-gf7420d7f (f7420d7f8e55ceea786dcbf536c338ce920c21eb) reef (dev) 2023-10-19T12:33:19.098 INFO:teuthology.orchestra.run.smithi046.stdout:Extracting ceph user uid/gid from container image... 2023-10-19T12:33:19.873 INFO:teuthology.orchestra.run.smithi046.stdout:stat: stdout 167 167 2023-10-19T12:33:19.873 INFO:teuthology.orchestra.run.smithi046.stdout:Creating initial keys... 2023-10-19T12:33:20.654 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph-authtool: stdout AQAQIjFlddndERAAIrDAsPV5EVbugTMUAQ81Dw== 2023-10-19T12:33:21.532 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph-authtool: stdout AQARIjFlVWZxAxAAWC2bCHxeLlcjdtzDXR3W0A== 2023-10-19T12:33:22.308 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph-authtool: stdout AQARIjFlPuEROBAAzJ3/potXUHAZpTK9WWDpBw== 2023-10-19T12:33:22.309 INFO:teuthology.orchestra.run.smithi046.stdout:Creating initial monmap... 2023-10-19T12:33:23.094 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2023-10-19T12:33:23.095 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = pacific 2023-10-19T12:33:23.095 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 2023-10-19T12:33:23.095 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-10-19T12:33:23.095 INFO:teuthology.orchestra.run.smithi046.stdout:monmaptool for a [v2:172.21.15.46:3300,v1:172.21.15.46:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2023-10-19T12:33:23.096 INFO:teuthology.orchestra.run.smithi046.stdout:setting min_mon_release = pacific 2023-10-19T12:33:23.096 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/monmaptool: set fsid to 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 2023-10-19T12:33:23.096 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-10-19T12:33:23.096 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:33:23.096 INFO:teuthology.orchestra.run.smithi046.stdout:Creating mon... 2023-10-19T12:33:23.875 INFO:teuthology.orchestra.run.smithi046.stdout:create mon.a on 2023-10-19T12:33:24.384 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stderr Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2023-10-19T12:33:24.590 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2023-10-19T12:33:24.837 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7.target → /etc/systemd/system/ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7.target. 2023-10-19T12:33:24.838 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7.target → /etc/systemd/system/ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7.target. 2023-10-19T12:33:25.228 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@mon.a 2023-10-19T12:33:25.228 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stderr Failed to reset failed state of unit ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@mon.a.service: Unit ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@mon.a.service not loaded. 2023-10-19T12:33:25.433 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7.target.wants/ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@mon.a.service → /etc/systemd/system/ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@.service. 2023-10-19T12:33:25.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:25 smithi046 systemd[1]: Starting Ceph mon.a for 96a8be3c-6e7b-11ee-8db6-212e2dc638e7... 2023-10-19T12:33:26.150 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-10-19T12:33:26.151 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout disabled 2023-10-19T12:33:26.168 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-10-19T12:33:26.168 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout inactive 2023-10-19T12:33:26.169 INFO:teuthology.orchestra.run.smithi046.stdout:firewalld.service is not enabled 2023-10-19T12:33:26.169 INFO:teuthology.orchestra.run.smithi046.stdout:Not possible to enable service . firewalld.service is not available 2023-10-19T12:33:26.169 INFO:teuthology.orchestra.run.smithi046.stdout:Waiting for mon to start... 2023-10-19T12:33:26.170 INFO:teuthology.orchestra.run.smithi046.stdout:Waiting for mon... 2023-10-19T12:33:26.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:25 smithi046 podman[97965]: 2023-10-19T12:33:26.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:26 smithi046 bash[97965]: 21cf1b135415342e190d14645942aea9a87a3c3562527e80e92f72e7e690c2cb 2023-10-19T12:33:26.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:26 smithi046 systemd[1]: Started Ceph mon.a for 96a8be3c-6e7b-11ee-8db6-212e2dc638e7. 2023-10-19T12:33:26.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:26 smithi046 ceph-mon[98005]: mkfs 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 2023-10-19T12:33:26.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:26 smithi046 ceph-mon[98005]: mon.a is new leader, mons a in quorum (ranks 0) 2023-10-19T12:33:27.250 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout cluster: 2023-10-19T12:33:27.252 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout id: 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 2023-10-19T12:33:27.253 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2023-10-19T12:33:27.253 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 2023-10-19T12:33:27.253 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout services: 2023-10-19T12:33:27.253 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.647943s) 2023-10-19T12:33:27.254 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2023-10-19T12:33:27.254 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2023-10-19T12:33:27.254 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 2023-10-19T12:33:27.254 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout data: 2023-10-19T12:33:27.254 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2023-10-19T12:33:27.255 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2023-10-19T12:33:27.255 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2023-10-19T12:33:27.255 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout pgs: 2023-10-19T12:33:27.255 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 2023-10-19T12:33:27.256 INFO:teuthology.orchestra.run.smithi046.stdout:mon is available 2023-10-19T12:33:27.256 INFO:teuthology.orchestra.run.smithi046.stdout:Assimilating anything we can from ceph.conf... 2023-10-19T12:33:27.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:27 smithi046 ceph-mon[98005]: mon.a is new leader, mons a in quorum (ranks 0) 2023-10-19T12:33:27.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:27 smithi046 ceph-mon[98005]: monmap e1: 1 mons at {a=[v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-10-19T12:33:27.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:27 smithi046 ceph-mon[98005]: fsmap 2023-10-19T12:33:27.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:27 smithi046 ceph-mon[98005]: osdmap e1: 0 total, 0 up, 0 in 2023-10-19T12:33:27.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:27 smithi046 ceph-mon[98005]: mgrmap e1: no daemons active 2023-10-19T12:33:27.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:27 smithi046 ceph-mon[98005]: from='client.? 172.21.15.46:0/446069691' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2023-10-19T12:33:28.234 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 2023-10-19T12:33:28.234 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout [global] 2023-10-19T12:33:28.235 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout fsid = 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 2023-10-19T12:33:28.235 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.46:3300,v1:172.21.15.46:6789] 2023-10-19T12:33:28.235 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-10-19T12:33:28.235 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-10-19T12:33:28.235 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-10-19T12:33:28.236 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-10-19T12:33:28.236 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 2023-10-19T12:33:28.236 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout [mgr] 2023-10-19T12:33:28.236 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-10-19T12:33:28.236 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 2023-10-19T12:33:28.237 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout [osd] 2023-10-19T12:33:28.237 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2023-10-19T12:33:28.237 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2023-10-19T12:33:28.237 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2023-10-19T12:33:28.237 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-10-19T12:33:28.238 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-10-19T12:33:28.238 INFO:teuthology.orchestra.run.smithi046.stdout:Generating new minimal ceph.conf... 2023-10-19T12:33:28.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:28 smithi046 ceph-mon[98005]: from='client.? 172.21.15.46:0/4210614497' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-10-19T12:33:28.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:28 smithi046 ceph-mon[98005]: from='client.? 172.21.15.46:0/4210614497' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2023-10-19T12:33:29.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:29 smithi046 ceph-mon[98005]: from='client.? 172.21.15.46:0/166127696' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:33:30.718 INFO:teuthology.orchestra.run.smithi046.stdout:Restarting the monitor... 2023-10-19T12:33:30.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:30 smithi046 systemd[1]: Stopping Ceph mon.a for 96a8be3c-6e7b-11ee-8db6-212e2dc638e7... 2023-10-19T12:33:31.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:31 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mon-a[97981]: 2023-10-19T12:33:31.180+0000 7f1be00b2700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-10-19T12:33:31.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:31 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mon-a[97981]: 2023-10-19T12:33:31.180+0000 7f1be00b2700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-10-19T12:33:31.818 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:31 smithi046 bash[98345]: ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mon-a 2023-10-19T12:33:32.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:31 smithi046 systemd[1]: ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@mon.a.service: Succeeded. 2023-10-19T12:33:32.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:31 smithi046 systemd[1]: Stopped Ceph mon.a for 96a8be3c-6e7b-11ee-8db6-212e2dc638e7. 2023-10-19T12:33:32.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:31 smithi046 systemd[1]: Starting Ceph mon.a for 96a8be3c-6e7b-11ee-8db6-212e2dc638e7... 2023-10-19T12:33:32.556 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 podman[98469]: 2023-10-19T12:33:32.557 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 bash[98469]: 3a02a7e82f1967341c857e7862624b7345a7bc4263790671bcb0596e18600dd9 2023-10-19T12:33:32.557 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: set uid:gid to 167:167 (ceph:ceph) 2023-10-19T12:33:32.567 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: ceph version 18.0.0-6786-gf7420d7f (f7420d7f8e55ceea786dcbf536c338ce920c21eb) reef (dev), process ceph-mon, pid 7 2023-10-19T12:33:32.567 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: pidfile_write: ignore empty --pid-file 2023-10-19T12:33:32.567 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: load: jerasure load: lrc 2023-10-19T12:33:32.567 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: RocksDB version: 7.9.2 2023-10-19T12:33:32.568 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Git sha 0 2023-10-19T12:33:32.568 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Compile date 2023-10-16 22:08:19 2023-10-19T12:33:32.568 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: DB SUMMARY 2023-10-19T12:33:32.568 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: DB Session ID: DS0BVU17DFP9USP1U6TO 2023-10-19T12:33:32.568 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: CURRENT file: CURRENT 2023-10-19T12:33:32.569 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: IDENTITY file: IDENTITY 2023-10-19T12:33:32.608 INFO:teuthology.orchestra.run.smithi046.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2023-10-19T12:33:32.869 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2023-10-19T12:33:32.870 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2023-10-19T12:33:32.870 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 89275 ; 2023-10-19T12:33:32.870 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.error_if_exists: 0 2023-10-19T12:33:32.870 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.create_if_missing: 0 2023-10-19T12:33:32.871 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.paranoid_checks: 1 2023-10-19T12:33:32.871 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.flush_verify_memtable_count: 1 2023-10-19T12:33:32.871 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-10-19T12:33:32.871 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-10-19T12:33:32.871 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.env: 0x55d8de17fda0 2023-10-19T12:33:32.872 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.fs: PosixFileSystem 2023-10-19T12:33:32.872 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.info_log: 0x55d8def376a0 2023-10-19T12:33:32.872 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.max_file_opening_threads: 16 2023-10-19T12:33:32.872 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.statistics: (nil) 2023-10-19T12:33:32.872 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.use_fsync: 0 2023-10-19T12:33:32.873 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.max_log_file_size: 0 2023-10-19T12:33:32.873 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-10-19T12:33:32.873 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.log_file_time_to_roll: 0 2023-10-19T12:33:32.873 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.keep_log_file_num: 1000 2023-10-19T12:33:32.873 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.recycle_log_file_num: 0 2023-10-19T12:33:32.874 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.allow_fallocate: 1 2023-10-19T12:33:32.874 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.allow_mmap_reads: 0 2023-10-19T12:33:32.874 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.allow_mmap_writes: 0 2023-10-19T12:33:32.874 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.use_direct_reads: 0 2023-10-19T12:33:32.874 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-10-19T12:33:32.875 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.create_missing_column_families: 0 2023-10-19T12:33:32.875 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.db_log_dir: 2023-10-19T12:33:32.875 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.wal_dir: 2023-10-19T12:33:32.875 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.table_cache_numshardbits: 6 2023-10-19T12:33:32.875 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.WAL_ttl_seconds: 0 2023-10-19T12:33:32.876 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.WAL_size_limit_MB: 0 2023-10-19T12:33:32.876 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-10-19T12:33:32.876 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-10-19T12:33:32.876 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.is_fd_close_on_exec: 1 2023-10-19T12:33:32.876 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.advise_random_on_open: 1 2023-10-19T12:33:32.876 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.db_write_buffer_size: 0 2023-10-19T12:33:32.877 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.write_buffer_manager: 0x55d8deeef360 2023-10-19T12:33:32.877 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-10-19T12:33:32.877 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-10-19T12:33:32.877 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.use_adaptive_mutex: 0 2023-10-19T12:33:32.877 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.rate_limiter: (nil) 2023-10-19T12:33:32.878 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-10-19T12:33:32.878 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.wal_recovery_mode: 2 2023-10-19T12:33:32.878 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.enable_thread_tracking: 0 2023-10-19T12:33:32.878 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.enable_pipelined_write: 0 2023-10-19T12:33:32.878 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.unordered_write: 0 2023-10-19T12:33:32.879 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-10-19T12:33:32.879 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-10-19T12:33:32.879 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-10-19T12:33:32.879 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-10-19T12:33:32.879 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.row_cache: None 2023-10-19T12:33:32.880 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.wal_filter: None 2023-10-19T12:33:32.880 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-10-19T12:33:32.880 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.allow_ingest_behind: 0 2023-10-19T12:33:32.880 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.two_write_queues: 0 2023-10-19T12:33:32.880 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.manual_wal_flush: 0 2023-10-19T12:33:32.881 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.wal_compression: 0 2023-10-19T12:33:32.881 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.atomic_flush: 0 2023-10-19T12:33:32.881 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-10-19T12:33:32.881 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.persist_stats_to_disk: 0 2023-10-19T12:33:32.881 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.write_dbid_to_manifest: 0 2023-10-19T12:33:32.882 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.log_readahead_size: 0 2023-10-19T12:33:32.882 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-10-19T12:33:32.882 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.best_efforts_recovery: 0 2023-10-19T12:33:32.882 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-10-19T12:33:32.882 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-10-19T12:33:32.883 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.allow_data_in_errors: 0 2023-10-19T12:33:32.883 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.db_host_id: __hostname__ 2023-10-19T12:33:32.883 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.enforce_single_del_contracts: true 2023-10-19T12:33:32.883 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.max_background_jobs: 2 2023-10-19T12:33:32.883 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.max_background_compactions: -1 2023-10-19T12:33:32.883 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.max_subcompactions: 1 2023-10-19T12:33:32.884 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-10-19T12:33:32.884 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-10-19T12:33:32.884 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.delayed_write_rate : 16777216 2023-10-19T12:33:32.884 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.max_total_wal_size: 0 2023-10-19T12:33:32.884 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-10-19T12:33:32.885 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.stats_dump_period_sec: 600 2023-10-19T12:33:32.885 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.stats_persist_period_sec: 600 2023-10-19T12:33:32.885 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-10-19T12:33:32.885 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.max_open_files: -1 2023-10-19T12:33:32.885 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.bytes_per_sync: 0 2023-10-19T12:33:32.886 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.wal_bytes_per_sync: 0 2023-10-19T12:33:32.886 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.strict_bytes_per_sync: 0 2023-10-19T12:33:32.886 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.compaction_readahead_size: 0 2023-10-19T12:33:32.886 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.max_background_flushes: -1 2023-10-19T12:33:32.886 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Compression algorithms supported: 2023-10-19T12:33:32.887 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-10-19T12:33:32.887 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: kZSTD supported: 0 2023-10-19T12:33:32.887 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: kXpressCompression supported: 0 2023-10-19T12:33:32.887 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: kLZ4HCCompression supported: 1 2023-10-19T12:33:32.887 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: kZlibCompression supported: 1 2023-10-19T12:33:32.887 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: kSnappyCompression supported: 1 2023-10-19T12:33:32.888 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: kLZ4Compression supported: 1 2023-10-19T12:33:32.888 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: kBZip2Compression supported: 0 2023-10-19T12:33:32.888 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Fast CRC32 supported: Supported on x86 2023-10-19T12:33:32.888 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: DMutex implementation: pthread_mutex_t 2023-10-19T12:33:32.889 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-10-19T12:33:32.889 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-10-19T12:33:32.889 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-10-19T12:33:32.889 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.merge_operator: 2023-10-19T12:33:32.889 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.compaction_filter: None 2023-10-19T12:33:32.890 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.compaction_filter_factory: None 2023-10-19T12:33:32.890 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.sst_partitioner_factory: None 2023-10-19T12:33:32.890 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.memtable_factory: SkipListFactory 2023-10-19T12:33:32.890 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.table_factory: BlockBasedTable 2023-10-19T12:33:32.890 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55d8def377a0) 2023-10-19T12:33:32.890 INFO:journalctl@ceph.mon.a.smithi046.stdout: cache_index_and_filter_blocks: 1 2023-10-19T12:33:32.891 INFO:journalctl@ceph.mon.a.smithi046.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-10-19T12:33:32.891 INFO:journalctl@ceph.mon.a.smithi046.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-10-19T12:33:32.891 INFO:journalctl@ceph.mon.a.smithi046.stdout: pin_top_level_index_and_filter: 1 2023-10-19T12:33:32.891 INFO:journalctl@ceph.mon.a.smithi046.stdout: index_type: 0 2023-10-19T12:33:32.891 INFO:journalctl@ceph.mon.a.smithi046.stdout: data_block_index_type: 0 2023-10-19T12:33:32.891 INFO:journalctl@ceph.mon.a.smithi046.stdout: index_shortening: 1 2023-10-19T12:33:32.892 INFO:journalctl@ceph.mon.a.smithi046.stdout: data_block_hash_table_util_ratio: 0.750000 2023-10-19T12:33:32.892 INFO:journalctl@ceph.mon.a.smithi046.stdout: checksum: 4 2023-10-19T12:33:32.892 INFO:journalctl@ceph.mon.a.smithi046.stdout: no_block_cache: 0 2023-10-19T12:33:32.892 INFO:journalctl@ceph.mon.a.smithi046.stdout: block_cache: 0x55d8def8d1f0 2023-10-19T12:33:32.892 INFO:journalctl@ceph.mon.a.smithi046.stdout: block_cache_name: BinnedLRUCache 2023-10-19T12:33:32.892 INFO:journalctl@ceph.mon.a.smithi046.stdout: block_cache_options: 2023-10-19T12:33:32.893 INFO:journalctl@ceph.mon.a.smithi046.stdout: capacity : 536870912 2023-10-19T12:33:32.893 INFO:journalctl@ceph.mon.a.smithi046.stdout: num_shard_bits : 4 2023-10-19T12:33:32.894 INFO:journalctl@ceph.mon.a.smithi046.stdout: strict_capacity_limit : 0 2023-10-19T12:33:32.894 INFO:journalctl@ceph.mon.a.smithi046.stdout: high_pri_pool_ratio: 0.000 2023-10-19T12:33:32.895 INFO:journalctl@ceph.mon.a.smithi046.stdout: block_cache_compressed: (nil) 2023-10-19T12:33:32.895 INFO:journalctl@ceph.mon.a.smithi046.stdout: persistent_cache: (nil) 2023-10-19T12:33:32.895 INFO:journalctl@ceph.mon.a.smithi046.stdout: block_size: 4096 2023-10-19T12:33:32.895 INFO:journalctl@ceph.mon.a.smithi046.stdout: block_size_deviation: 10 2023-10-19T12:33:32.895 INFO:journalctl@ceph.mon.a.smithi046.stdout: block_restart_interval: 16 2023-10-19T12:33:32.896 INFO:journalctl@ceph.mon.a.smithi046.stdout: index_block_restart_interval: 1 2023-10-19T12:33:32.896 INFO:journalctl@ceph.mon.a.smithi046.stdout: metadata_block_size: 4096 2023-10-19T12:33:32.896 INFO:journalctl@ceph.mon.a.smithi046.stdout: partition_filters: 0 2023-10-19T12:33:32.896 INFO:journalctl@ceph.mon.a.smithi046.stdout: use_delta_encoding: 1 2023-10-19T12:33:32.896 INFO:journalctl@ceph.mon.a.smithi046.stdout: filter_policy: bloomfilter 2023-10-19T12:33:32.897 INFO:journalctl@ceph.mon.a.smithi046.stdout: whole_key_filtering: 1 2023-10-19T12:33:32.897 INFO:journalctl@ceph.mon.a.smithi046.stdout: verify_compression: 0 2023-10-19T12:33:32.897 INFO:journalctl@ceph.mon.a.smithi046.stdout: read_amp_bytes_per_bit: 0 2023-10-19T12:33:32.897 INFO:journalctl@ceph.mon.a.smithi046.stdout: format_version: 5 2023-10-19T12:33:32.897 INFO:journalctl@ceph.mon.a.smithi046.stdout: enable_index_compression: 1 2023-10-19T12:33:32.897 INFO:journalctl@ceph.mon.a.smithi046.stdout: block_align: 0 2023-10-19T12:33:32.898 INFO:journalctl@ceph.mon.a.smithi046.stdout: max_auto_readahead_size: 262144 2023-10-19T12:33:32.898 INFO:journalctl@ceph.mon.a.smithi046.stdout: prepopulate_block_cache: 0 2023-10-19T12:33:32.898 INFO:journalctl@ceph.mon.a.smithi046.stdout: initial_auto_readahead_size: 8192 2023-10-19T12:33:32.898 INFO:journalctl@ceph.mon.a.smithi046.stdout: num_file_reads_for_auto_readahead: 2 2023-10-19T12:33:32.898 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.write_buffer_size: 33554432 2023-10-19T12:33:32.899 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.max_write_buffer_number: 2 2023-10-19T12:33:32.899 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.compression: NoCompression 2023-10-19T12:33:32.899 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.bottommost_compression: Disabled 2023-10-19T12:33:32.899 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.prefix_extractor: nullptr 2023-10-19T12:33:32.899 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-10-19T12:33:32.900 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.num_levels: 7 2023-10-19T12:33:32.900 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-10-19T12:33:32.900 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-10-19T12:33:32.900 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-10-19T12:33:32.900 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-10-19T12:33:32.901 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-10-19T12:33:32.901 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-10-19T12:33:32.901 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-10-19T12:33:32.901 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-10-19T12:33:32.901 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-10-19T12:33:32.901 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-10-19T12:33:32.902 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-10-19T12:33:32.902 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-10-19T12:33:32.902 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.compression_opts.window_bits: -14 2023-10-19T12:33:32.902 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.compression_opts.level: 32767 2023-10-19T12:33:32.902 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.compression_opts.strategy: 0 2023-10-19T12:33:32.903 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-10-19T12:33:32.903 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-10-19T12:33:32.903 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-10-19T12:33:32.903 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-10-19T12:33:32.903 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.compression_opts.enabled: false 2023-10-19T12:33:32.904 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-10-19T12:33:32.904 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-10-19T12:33:32.904 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-10-19T12:33:32.904 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-10-19T12:33:32.904 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.target_file_size_base: 67108864 2023-10-19T12:33:32.905 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.target_file_size_multiplier: 1 2023-10-19T12:33:32.905 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-10-19T12:33:32.905 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-10-19T12:33:32.905 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-10-19T12:33:32.905 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-10-19T12:33:32.906 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-10-19T12:33:32.906 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-10-19T12:33:32.906 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-10-19T12:33:32.906 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-10-19T12:33:32.906 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-10-19T12:33:32.907 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-10-19T12:33:32.907 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-10-19T12:33:32.907 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-10-19T12:33:32.907 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-10-19T12:33:32.907 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.arena_block_size: 1048576 2023-10-19T12:33:32.907 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-10-19T12:33:32.908 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-10-19T12:33:32.908 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.disable_auto_compactions: 0 2023-10-19T12:33:32.908 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-10-19T12:33:32.908 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-10-19T12:33:32.908 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-10-19T12:33:32.909 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-10-19T12:33:32.909 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-10-19T12:33:32.909 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-10-19T12:33:32.909 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-10-19T12:33:32.909 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-10-19T12:33:32.910 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-10-19T12:33:32.910 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-10-19T12:33:32.910 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.table_properties_collectors: 2023-10-19T12:33:32.910 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.inplace_update_support: 0 2023-10-19T12:33:32.910 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.inplace_update_num_locks: 10000 2023-10-19T12:33:32.911 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-10-19T12:33:32.911 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-10-19T12:33:32.911 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.memtable_huge_page_size: 0 2023-10-19T12:33:32.911 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.bloom_locality: 0 2023-10-19T12:33:32.911 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.max_successive_merges: 0 2023-10-19T12:33:32.912 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.optimize_filters_for_hits: 0 2023-10-19T12:33:32.912 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.paranoid_file_checks: 0 2023-10-19T12:33:32.912 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.force_consistency_checks: 1 2023-10-19T12:33:32.912 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.report_bg_io_stats: 0 2023-10-19T12:33:32.912 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.ttl: 2592000 2023-10-19T12:33:32.912 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.periodic_compaction_seconds: 0 2023-10-19T12:33:32.913 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-10-19T12:33:32.913 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-10-19T12:33:32.913 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.enable_blob_files: false 2023-10-19T12:33:32.913 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.min_blob_size: 0 2023-10-19T12:33:32.913 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.blob_file_size: 268435456 2023-10-19T12:33:32.913 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.blob_compression_type: NoCompression 2023-10-19T12:33:32.914 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.enable_blob_garbage_collection: false 2023-10-19T12:33:32.914 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-10-19T12:33:32.914 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-10-19T12:33:32.914 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-10-19T12:33:32.914 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.blob_file_starting_level: 0 2023-10-19T12:33:32.915 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-10-19T12:33:32.915 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2023-10-19T12:33:32.915 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2023-10-19T12:33:32.915 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: e6c48f1d-7bde-4a19-8af2-bcfd6e73b4d2 2023-10-19T12:33:32.915 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: EVENT_LOG_v1 {"time_micros": 1697718812564232, "job": 1, "event": "recovery_started", "wal_files": [9]} 2023-10-19T12:33:32.916 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2023-10-19T12:33:32.916 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: EVENT_LOG_v1 {"time_micros": 1697718812565980, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 85271, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 279, "table_properties": {"data_size": 83445, "index_size": 236, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 581, "raw_key_size": 11116, "raw_average_key_size": 48, "raw_value_size": 77156, "raw_average_value_size": 335, "num_data_blocks": 10, "num_entries": 230, "num_filter_entries": 230, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1697718812, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "e6c48f1d-7bde-4a19-8af2-bcfd6e73b4d2", "db_session_id": "DS0BVU17DFP9USP1U6TO", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2023-10-19T12:33:32.916 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: EVENT_LOG_v1 {"time_micros": 1697718812566142, "job": 1, "event": "recovery_finished"} 2023-10-19T12:33:32.916 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2023-10-19T12:33:32.916 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-10-19T12:33:32.916 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55d8df02a000 2023-10-19T12:33:32.917 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: DB pointer 0x55d8df016000 2023-10-19T12:33:32.917 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-10-19T12:33:32.917 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-10-19T12:33:32.917 INFO:journalctl@ceph.mon.a.smithi046.stdout: ** DB Stats ** 2023-10-19T12:33:32.917 INFO:journalctl@ceph.mon.a.smithi046.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-10-19T12:33:32.918 INFO:journalctl@ceph.mon.a.smithi046.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-10-19T12:33:32.918 INFO:journalctl@ceph.mon.a.smithi046.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-10-19T12:33:32.918 INFO:journalctl@ceph.mon.a.smithi046.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-10-19T12:33:32.918 INFO:journalctl@ceph.mon.a.smithi046.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-10-19T12:33:32.918 INFO:journalctl@ceph.mon.a.smithi046.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-10-19T12:33:32.919 INFO:journalctl@ceph.mon.a.smithi046.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-10-19T12:33:32.919 INFO:journalctl@ceph.mon.a.smithi046.stdout: 2023-10-19T12:33:32.919 INFO:journalctl@ceph.mon.a.smithi046.stdout: ** Compaction Stats [default] ** 2023-10-19T12:33:32.919 INFO:journalctl@ceph.mon.a.smithi046.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-10-19T12:33:32.919 INFO:journalctl@ceph.mon.a.smithi046.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-10-19T12:33:32.919 INFO:journalctl@ceph.mon.a.smithi046.stdout: L0 2/0 85.11 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 73.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-10-19T12:33:32.920 INFO:journalctl@ceph.mon.a.smithi046.stdout: Sum 2/0 85.11 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 73.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-10-19T12:33:32.920 INFO:journalctl@ceph.mon.a.smithi046.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 73.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-10-19T12:33:32.920 INFO:journalctl@ceph.mon.a.smithi046.stdout: 2023-10-19T12:33:32.920 INFO:journalctl@ceph.mon.a.smithi046.stdout: ** Compaction Stats [default] ** 2023-10-19T12:33:32.920 INFO:journalctl@ceph.mon.a.smithi046.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-10-19T12:33:32.920 INFO:journalctl@ceph.mon.a.smithi046.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-10-19T12:33:32.921 INFO:journalctl@ceph.mon.a.smithi046.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 73.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-10-19T12:33:32.921 INFO:journalctl@ceph.mon.a.smithi046.stdout: 2023-10-19T12:33:32.921 INFO:journalctl@ceph.mon.a.smithi046.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-10-19T12:33:32.921 INFO:journalctl@ceph.mon.a.smithi046.stdout: 2023-10-19T12:33:32.921 INFO:journalctl@ceph.mon.a.smithi046.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-10-19T12:33:32.921 INFO:journalctl@ceph.mon.a.smithi046.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-10-19T12:33:32.922 INFO:journalctl@ceph.mon.a.smithi046.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-10-19T12:33:32.922 INFO:journalctl@ceph.mon.a.smithi046.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-10-19T12:33:32.922 INFO:journalctl@ceph.mon.a.smithi046.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-10-19T12:33:32.922 INFO:journalctl@ceph.mon.a.smithi046.stdout: AddFile(Keys): cumulative 0, interval 0 2023-10-19T12:33:32.922 INFO:journalctl@ceph.mon.a.smithi046.stdout: Cumulative compaction: 0.00 GB write, 10.83 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-19T12:33:32.923 INFO:journalctl@ceph.mon.a.smithi046.stdout: Interval compaction: 0.00 GB write, 10.83 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-19T12:33:32.923 INFO:journalctl@ceph.mon.a.smithi046.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-10-19T12:33:32.923 INFO:journalctl@ceph.mon.a.smithi046.stdout: Block cache BinnedLRUCache@0x55d8def8d1f0#7 capacity: 512.00 MB usage: 1.19 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2023-10-19T12:33:32.923 INFO:journalctl@ceph.mon.a.smithi046.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.77 KB,0.000146031%) IndexBlock(2,0.42 KB,8.04663e-05%) Misc(1,0.00 KB,0%) 2023-10-19T12:33:32.923 INFO:journalctl@ceph.mon.a.smithi046.stdout: 2023-10-19T12:33:32.923 INFO:journalctl@ceph.mon.a.smithi046.stdout: ** File Read Latency Histogram By Level [default] ** 2023-10-19T12:33:32.924 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: starting mon.a rank 0 at public addrs [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] at bind addrs [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 2023-10-19T12:33:32.924 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: mon.a@-1(???) e1 preinit fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 2023-10-19T12:33:32.924 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: mon.a@-1(???).mds e1 new map 2023-10-19T12:33:32.924 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: mon.a@-1(???).mds e1 print_map 2023-10-19T12:33:32.924 INFO:journalctl@ceph.mon.a.smithi046.stdout: e1 2023-10-19T12:33:32.924 INFO:journalctl@ceph.mon.a.smithi046.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-10-19T12:33:32.925 INFO:journalctl@ceph.mon.a.smithi046.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-10-19T12:33:32.925 INFO:journalctl@ceph.mon.a.smithi046.stdout: legacy client fscid: -1 2023-10-19T12:33:32.925 INFO:journalctl@ceph.mon.a.smithi046.stdout: 2023-10-19T12:33:32.925 INFO:journalctl@ceph.mon.a.smithi046.stdout: No filesystems configured 2023-10-19T12:33:32.925 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2023-10-19T12:33:32.926 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-10-19T12:33:32.926 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-10-19T12:33:32.926 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-10-19T12:33:32.926 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2023-10-19T12:33:32.926 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 systemd[1]: Started Ceph mon.a for 96a8be3c-6e7b-11ee-8db6-212e2dc638e7. 2023-10-19T12:33:32.927 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: mon.a is new leader, mons a in quorum (ranks 0) 2023-10-19T12:33:32.927 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: monmap e1: 1 mons at {a=[v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-10-19T12:33:32.927 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: fsmap 2023-10-19T12:33:32.927 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: osdmap e1: 0 total, 0 up, 0 in 2023-10-19T12:33:32.927 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:32 smithi046 ceph-mon[98509]: mgrmap e1: no daemons active 2023-10-19T12:33:33.591 INFO:teuthology.orchestra.run.smithi046.stdout:Wrote config to /etc/ceph/ceph.conf 2023-10-19T12:33:33.612 INFO:teuthology.orchestra.run.smithi046.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2023-10-19T12:33:33.612 INFO:teuthology.orchestra.run.smithi046.stdout:Creating mgr... 2023-10-19T12:33:33.612 INFO:teuthology.orchestra.run.smithi046.stdout:Verifying port 0.0.0.0:9283 ... 2023-10-19T12:33:33.613 INFO:teuthology.orchestra.run.smithi046.stdout:Verifying port 0.0.0.0:8765 ... 2023-10-19T12:33:33.969 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@mgr.x 2023-10-19T12:33:33.970 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stderr Failed to reset failed state of unit ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@mgr.x.service: Unit ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@mgr.x.service not loaded. 2023-10-19T12:33:34.182 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7.target.wants/ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@mgr.x.service → /etc/systemd/system/ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@.service. 2023-10-19T12:33:34.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:34 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/184672603' entity='client.admin' 2023-10-19T12:33:34.480 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:33:34 smithi046 systemd[1]: Starting Ceph mgr.x for 96a8be3c-6e7b-11ee-8db6-212e2dc638e7... 2023-10-19T12:33:34.979 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:33:34 smithi046 podman[98744]: 2023-10-19T12:33:34.979 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:33:34 smithi046 bash[98744]: e8035e7006c77d377980f2ac35dc546469c15d92f64a9ec738a5b06d8d1c0ffc 2023-10-19T12:33:35.004 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-10-19T12:33:35.005 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout disabled 2023-10-19T12:33:35.022 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-10-19T12:33:35.022 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout inactive 2023-10-19T12:33:35.022 INFO:teuthology.orchestra.run.smithi046.stdout:firewalld.service is not enabled 2023-10-19T12:33:35.022 INFO:teuthology.orchestra.run.smithi046.stdout:Not possible to enable service . firewalld.service is not available 2023-10-19T12:33:35.040 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-10-19T12:33:35.040 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout disabled 2023-10-19T12:33:35.057 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-10-19T12:33:35.057 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout inactive 2023-10-19T12:33:35.058 INFO:teuthology.orchestra.run.smithi046.stdout:firewalld.service is not enabled 2023-10-19T12:33:35.058 INFO:teuthology.orchestra.run.smithi046.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2023-10-19T12:33:35.058 INFO:teuthology.orchestra.run.smithi046.stdout:Waiting for mgr to start... 2023-10-19T12:33:35.058 INFO:teuthology.orchestra.run.smithi046.stdout:Waiting for mgr... 2023-10-19T12:33:35.337 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:33:34 smithi046 systemd[1]: Started Ceph mgr.x for 96a8be3c-6e7b-11ee-8db6-212e2dc638e7. 2023-10-19T12:33:35.338 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:33:35 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: 2023-10-19T12:33:35.089+0000 7f26b00b2200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-19T12:33:35.338 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:33:35 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: 2023-10-19T12:33:35.209+0000 7f26b00b2200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-19T12:33:35.338 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:33:35 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: 2023-10-19T12:33:35.333+0000 7f26b00b2200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-19T12:33:35.727 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:33:35 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: 2023-10-19T12:33:35.483+0000 7f26b00b2200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-19T12:33:35.727 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:33:35 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: 2023-10-19T12:33:35.723+0000 7f26b00b2200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-19T12:33:35.978 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:35 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/541092249' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-10-19T12:33:36.152 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 2023-10-19T12:33:36.157 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout { 2023-10-19T12:33:36.157 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "fsid": "96a8be3c-6e7b-11ee-8db6-212e2dc638e7", 2023-10-19T12:33:36.157 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "health": { 2023-10-19T12:33:36.157 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-10-19T12:33:36.158 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-10-19T12:33:36.158 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-10-19T12:33:36.158 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2023-10-19T12:33:36.158 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-10-19T12:33:36.158 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-10-19T12:33:36.159 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 0 2023-10-19T12:33:36.159 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout ], 2023-10-19T12:33:36.159 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-10-19T12:33:36.159 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "a" 2023-10-19T12:33:36.159 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout ], 2023-10-19T12:33:36.159 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2023-10-19T12:33:36.160 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "monmap": { 2023-10-19T12:33:36.160 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-19T12:33:36.160 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-10-19T12:33:36.160 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-10-19T12:33:36.160 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2023-10-19T12:33:36.161 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-10-19T12:33:36.161 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-19T12:33:36.161 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-10-19T12:33:36.161 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-10-19T12:33:36.161 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-10-19T12:33:36.162 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-10-19T12:33:36.162 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-10-19T12:33:36.162 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-10-19T12:33:36.162 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2023-10-19T12:33:36.163 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-10-19T12:33:36.163 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-10-19T12:33:36.163 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-10-19T12:33:36.163 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-10-19T12:33:36.163 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-10-19T12:33:36.163 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-10-19T12:33:36.164 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-10-19T12:33:36.164 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-10-19T12:33:36.164 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-10-19T12:33:36.164 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2023-10-19T12:33:36.164 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-10-19T12:33:36.165 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-19T12:33:36.165 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-10-19T12:33:36.167 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-10-19T12:33:36.167 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2023-10-19T12:33:36.167 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-10-19T12:33:36.168 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "available": false, 2023-10-19T12:33:36.168 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-10-19T12:33:36.168 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "modules": [ 2023-10-19T12:33:36.168 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "iostat", 2023-10-19T12:33:36.168 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "nfs", 2023-10-19T12:33:36.169 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "restful" 2023-10-19T12:33:36.169 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout ], 2023-10-19T12:33:36.169 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-19T12:33:36.169 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2023-10-19T12:33:36.169 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-10-19T12:33:36.170 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-19T12:33:36.170 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "modified": "2023-10-19T12:33:26.149315+0000", 2023-10-19T12:33:36.170 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-19T12:33:36.170 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2023-10-19T12:33:36.170 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-10-19T12:33:36.171 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout } 2023-10-19T12:33:36.171 INFO:teuthology.orchestra.run.smithi046.stdout:mgr not available, waiting (1/15)... 2023-10-19T12:33:36.479 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:33:36 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: 2023-10-19T12:33:36.246+0000 7f26b00b2200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-19T12:33:36.479 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:33:36 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: 2023-10-19T12:33:36.415+0000 7f26b00b2200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-19T12:33:36.979 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:33:36 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: 2023-10-19T12:33:36.536+0000 7f26b00b2200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-19T12:33:36.979 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:33:36 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: 2023-10-19T12:33:36.667+0000 7f26b00b2200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-19T12:33:37.729 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:33:37 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: 2023-10-19T12:33:37.245+0000 7f26b00b2200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-19T12:33:38.446 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:33:38 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: 2023-10-19T12:33:38.178+0000 7f26b00b2200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-19T12:33:38.446 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:33:38 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: 2023-10-19T12:33:38.309+0000 7f26b00b2200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-19T12:33:39.208 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:38 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/1784274424' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-10-19T12:33:39.266 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 2023-10-19T12:33:39.266 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout { 2023-10-19T12:33:39.266 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "fsid": "96a8be3c-6e7b-11ee-8db6-212e2dc638e7", 2023-10-19T12:33:39.267 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "health": { 2023-10-19T12:33:39.267 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-10-19T12:33:39.267 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-10-19T12:33:39.267 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-10-19T12:33:39.267 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2023-10-19T12:33:39.268 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-10-19T12:33:39.268 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-10-19T12:33:39.268 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 0 2023-10-19T12:33:39.268 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout ], 2023-10-19T12:33:39.268 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-10-19T12:33:39.268 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "a" 2023-10-19T12:33:39.269 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout ], 2023-10-19T12:33:39.269 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2023-10-19T12:33:39.269 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "monmap": { 2023-10-19T12:33:39.269 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-19T12:33:39.269 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-10-19T12:33:39.270 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-10-19T12:33:39.270 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2023-10-19T12:33:39.270 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-10-19T12:33:39.270 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-19T12:33:39.270 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-10-19T12:33:39.271 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-10-19T12:33:39.271 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-10-19T12:33:39.271 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-10-19T12:33:39.274 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-10-19T12:33:39.274 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-10-19T12:33:39.275 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2023-10-19T12:33:39.275 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-10-19T12:33:39.275 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-10-19T12:33:39.275 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-10-19T12:33:39.275 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-10-19T12:33:39.276 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-10-19T12:33:39.276 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-10-19T12:33:39.276 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-10-19T12:33:39.276 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-10-19T12:33:39.276 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-10-19T12:33:39.277 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2023-10-19T12:33:39.277 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-10-19T12:33:39.277 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-19T12:33:39.277 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-10-19T12:33:39.277 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-10-19T12:33:39.278 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2023-10-19T12:33:39.278 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-10-19T12:33:39.278 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "available": false, 2023-10-19T12:33:39.278 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-10-19T12:33:39.278 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "modules": [ 2023-10-19T12:33:39.279 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "iostat", 2023-10-19T12:33:39.279 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "nfs", 2023-10-19T12:33:39.279 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "restful" 2023-10-19T12:33:39.279 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout ], 2023-10-19T12:33:39.279 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-19T12:33:39.280 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2023-10-19T12:33:39.280 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-10-19T12:33:39.280 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-19T12:33:39.280 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "modified": "2023-10-19T12:33:26.149315+0000", 2023-10-19T12:33:39.280 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-19T12:33:39.281 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2023-10-19T12:33:39.281 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-10-19T12:33:39.281 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout } 2023-10-19T12:33:39.281 INFO:teuthology.orchestra.run.smithi046.stdout:mgr not available, waiting (2/15)... 2023-10-19T12:33:39.469 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:33:39 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: 2023-10-19T12:33:39.341+0000 7f26b00b2200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-19T12:33:39.729 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:33:39 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: 2023-10-19T12:33:39.466+0000 7f26b00b2200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-19T12:33:39.729 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:33:39 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: 2023-10-19T12:33:39.700+0000 7f26b00b2200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-19T12:33:40.389 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:33:40 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: 2023-10-19T12:33:40.081+0000 7f26b00b2200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-19T12:33:40.729 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:33:40 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: 2023-10-19T12:33:40.385+0000 7f26b00b2200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-19T12:33:40.729 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:33:40 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: 2023-10-19T12:33:40.588+0000 7f26b00b2200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-19T12:33:41.229 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:33:40 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: 2023-10-19T12:33:40.946+0000 7f26b00b2200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-19T12:33:42.229 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:33:41 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: 2023-10-19T12:33:41.921+0000 7f26b00b2200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-19T12:33:42.229 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:33:42 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: 2023-10-19T12:33:42.102+0000 7f26b00b2200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-19T12:33:42.728 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:33:42 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: 2023-10-19T12:33:42.364+0000 7f26b00b2200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-19T12:33:42.729 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:33:42 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: 2023-10-19T12:33:42.516+0000 7f26b00b2200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-19T12:33:43.229 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:33:42 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: 2023-10-19T12:33:42.807+0000 7f26b00b2200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-19T12:33:44.229 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:33:43 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: 2023-10-19T12:33:43.932+0000 7f26b00b2200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-19T12:33:44.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:43 smithi046 ceph-mon[98509]: Activating manager daemon x 2023-10-19T12:33:44.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:43 smithi046 ceph-mon[98509]: mgrmap e2: x(active, starting, since 0.00407191s) 2023-10-19T12:33:44.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:43 smithi046 ceph-mon[98509]: from='mgr.14100 172.21.15.46:0/1707576305' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-10-19T12:33:44.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:43 smithi046 ceph-mon[98509]: from='mgr.14100 172.21.15.46:0/1707576305' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-10-19T12:33:44.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:43 smithi046 ceph-mon[98509]: from='mgr.14100 172.21.15.46:0/1707576305' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-10-19T12:33:44.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:43 smithi046 ceph-mon[98509]: from='mgr.14100 172.21.15.46:0/1707576305' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-19T12:33:44.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:43 smithi046 ceph-mon[98509]: from='mgr.14100 172.21.15.46:0/1707576305' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-10-19T12:33:44.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:43 smithi046 ceph-mon[98509]: Manager daemon x is now available 2023-10-19T12:33:44.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:43 smithi046 ceph-mon[98509]: from='mgr.14100 172.21.15.46:0/1707576305' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-10-19T12:33:44.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:43 smithi046 ceph-mon[98509]: from='mgr.14100 172.21.15.46:0/1707576305' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-10-19T12:33:44.232 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:43 smithi046 ceph-mon[98509]: from='mgr.14100 172.21.15.46:0/1707576305' entity='mgr.x' 2023-10-19T12:33:44.232 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:43 smithi046 ceph-mon[98509]: from='mgr.14100 172.21.15.46:0/1707576305' entity='mgr.x' 2023-10-19T12:33:44.232 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:43 smithi046 ceph-mon[98509]: from='mgr.14100 172.21.15.46:0/1707576305' entity='mgr.x' 2023-10-19T12:33:46.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:45 smithi046 ceph-mon[98509]: mgrmap e3: x(active, since 1.00999s) 2023-10-19T12:33:47.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:46 smithi046 ceph-mon[98509]: mgrmap e4: x(active, since 2s) 2023-10-19T12:33:48.978 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:48 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/4173897427' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-10-19T12:33:49.176 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 2023-10-19T12:33:49.176 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout { 2023-10-19T12:33:49.176 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "fsid": "96a8be3c-6e7b-11ee-8db6-212e2dc638e7", 2023-10-19T12:33:49.177 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "health": { 2023-10-19T12:33:49.177 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-10-19T12:33:49.177 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-10-19T12:33:49.177 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-10-19T12:33:49.177 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2023-10-19T12:33:49.178 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-10-19T12:33:49.178 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-10-19T12:33:49.178 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 0 2023-10-19T12:33:49.178 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout ], 2023-10-19T12:33:49.178 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-10-19T12:33:49.179 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "a" 2023-10-19T12:33:49.179 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout ], 2023-10-19T12:33:49.179 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "quorum_age": 16, 2023-10-19T12:33:49.179 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "monmap": { 2023-10-19T12:33:49.179 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-19T12:33:49.180 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-10-19T12:33:49.180 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-10-19T12:33:49.180 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2023-10-19T12:33:49.180 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-10-19T12:33:49.180 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-19T12:33:49.180 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-10-19T12:33:49.181 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-10-19T12:33:49.181 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-10-19T12:33:49.181 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-10-19T12:33:49.184 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-10-19T12:33:49.185 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-10-19T12:33:49.185 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2023-10-19T12:33:49.185 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-10-19T12:33:49.185 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-10-19T12:33:49.185 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-10-19T12:33:49.186 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-10-19T12:33:49.186 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-10-19T12:33:49.186 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-10-19T12:33:49.186 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-10-19T12:33:49.186 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-10-19T12:33:49.187 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-10-19T12:33:49.187 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2023-10-19T12:33:49.187 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-10-19T12:33:49.187 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-19T12:33:49.187 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-10-19T12:33:49.188 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-10-19T12:33:49.188 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2023-10-19T12:33:49.188 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-10-19T12:33:49.188 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "available": true, 2023-10-19T12:33:49.188 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-10-19T12:33:49.188 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "modules": [ 2023-10-19T12:33:49.189 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "iostat", 2023-10-19T12:33:49.189 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "nfs", 2023-10-19T12:33:49.189 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "restful" 2023-10-19T12:33:49.189 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout ], 2023-10-19T12:33:49.189 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-19T12:33:49.190 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2023-10-19T12:33:49.190 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-10-19T12:33:49.190 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-19T12:33:49.190 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "modified": "2023-10-19T12:33:26.149315+0000", 2023-10-19T12:33:49.190 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-19T12:33:49.191 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2023-10-19T12:33:49.191 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-10-19T12:33:49.191 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout } 2023-10-19T12:33:49.191 INFO:teuthology.orchestra.run.smithi046.stdout:mgr is available 2023-10-19T12:33:50.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:49 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/1528699142' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-10-19T12:33:50.359 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 2023-10-19T12:33:50.360 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout [global] 2023-10-19T12:33:50.360 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout fsid = 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 2023-10-19T12:33:50.360 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-10-19T12:33:50.360 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-10-19T12:33:50.360 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-10-19T12:33:50.361 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-10-19T12:33:50.361 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 2023-10-19T12:33:50.361 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout [mgr] 2023-10-19T12:33:50.361 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-10-19T12:33:50.361 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 2023-10-19T12:33:50.361 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout [osd] 2023-10-19T12:33:50.362 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2023-10-19T12:33:50.362 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2023-10-19T12:33:50.362 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2023-10-19T12:33:50.362 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-10-19T12:33:50.363 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-10-19T12:33:50.363 INFO:teuthology.orchestra.run.smithi046.stdout:Enabling cephadm module... 2023-10-19T12:33:51.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:51 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/3764116848' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2023-10-19T12:33:51.479 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:33:51 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: ignoring --setuser ceph since I am not root 2023-10-19T12:33:51.480 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:33:51 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: ignoring --setgroup ceph since I am not root 2023-10-19T12:33:51.844 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:33:51 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: 2023-10-19T12:33:51.475+0000 7fd63c746200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-19T12:33:51.844 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:33:51 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: 2023-10-19T12:33:51.587+0000 7fd63c746200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-19T12:33:51.845 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:33:51 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: 2023-10-19T12:33:51.714+0000 7fd63c746200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-19T12:33:52.217 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:33:51 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: 2023-10-19T12:33:51.841+0000 7fd63c746200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-19T12:33:52.217 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:33:52 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: 2023-10-19T12:33:52.086+0000 7fd63c746200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-19T12:33:52.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:52 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/3764116848' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2023-10-19T12:33:52.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:52 smithi046 ceph-mon[98509]: mgrmap e5: x(active, since 7s) 2023-10-19T12:33:52.754 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:33:52 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: 2023-10-19T12:33:52.576+0000 7fd63c746200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-19T12:33:52.917 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout { 2023-10-19T12:33:52.917 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 5, 2023-10-19T12:33:52.917 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "available": true, 2023-10-19T12:33:52.918 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "active_name": "x", 2023-10-19T12:33:52.918 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-10-19T12:33:52.918 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout } 2023-10-19T12:33:52.918 INFO:teuthology.orchestra.run.smithi046.stdout:Waiting for the mgr to restart... 2023-10-19T12:33:52.918 INFO:teuthology.orchestra.run.smithi046.stdout:Waiting for mgr epoch 5... 2023-10-19T12:33:53.016 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:33:52 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: 2023-10-19T12:33:52.751+0000 7fd63c746200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-19T12:33:53.017 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:33:52 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: 2023-10-19T12:33:52.874+0000 7fd63c746200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-19T12:33:53.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:33:53 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/3350000845' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-10-19T12:33:53.479 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:33:53 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: 2023-10-19T12:33:53.013+0000 7fd63c746200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-19T12:33:53.979 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:33:53 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: 2023-10-19T12:33:53.589+0000 7fd63c746200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-19T12:33:54.729 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:33:54 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: 2023-10-19T12:33:54.471+0000 7fd63c746200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-19T12:33:54.729 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:33:54 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: 2023-10-19T12:33:54.581+0000 7fd63c746200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-19T12:33:55.942 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:33:55 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: 2023-10-19T12:33:55.581+0000 7fd63c746200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-19T12:33:55.943 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:33:55 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: 2023-10-19T12:33:55.705+0000 7fd63c746200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-19T12:33:55.943 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:33:55 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: 2023-10-19T12:33:55.939+0000 7fd63c746200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-19T12:33:56.608 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:33:56 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: 2023-10-19T12:33:56.318+0000 7fd63c746200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-19T12:33:56.979 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:33:56 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: 2023-10-19T12:33:56.605+0000 7fd63c746200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-19T12:33:56.979 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:33:56 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: 2023-10-19T12:33:56.806+0000 7fd63c746200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-19T12:33:57.479 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:33:57 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: 2023-10-19T12:33:57.164+0000 7fd63c746200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-19T12:33:58.479 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:33:58 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: 2023-10-19T12:33:58.133+0000 7fd63c746200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-19T12:33:58.479 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:33:58 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: 2023-10-19T12:33:58.314+0000 7fd63c746200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-19T12:33:58.979 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:33:58 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: 2023-10-19T12:33:58.572+0000 7fd63c746200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-19T12:33:58.979 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:33:58 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: 2023-10-19T12:33:58.722+0000 7fd63c746200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-19T12:33:59.479 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:33:59 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: 2023-10-19T12:33:59.011+0000 7fd63c746200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-19T12:34:00.479 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:34:00 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: 2023-10-19T12:34:00.132+0000 7fd63c746200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-19T12:34:00.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:00 smithi046 ceph-mon[98509]: Active manager daemon x restarted 2023-10-19T12:34:00.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:00 smithi046 ceph-mon[98509]: Activating manager daemon x 2023-10-19T12:34:00.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:00 smithi046 ceph-mon[98509]: osdmap e2: 0 total, 0 up, 0 in 2023-10-19T12:34:00.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:00 smithi046 ceph-mon[98509]: mgrmap e6: x(active, starting, since 0.00350295s) 2023-10-19T12:34:00.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:00 smithi046 ceph-mon[98509]: from='mgr.14118 172.21.15.46:0/286323576' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-19T12:34:00.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:00 smithi046 ceph-mon[98509]: from='mgr.14118 172.21.15.46:0/286323576' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-10-19T12:34:00.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:00 smithi046 ceph-mon[98509]: from='mgr.14118 172.21.15.46:0/286323576' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-10-19T12:34:00.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:00 smithi046 ceph-mon[98509]: from='mgr.14118 172.21.15.46:0/286323576' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-10-19T12:34:00.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:00 smithi046 ceph-mon[98509]: from='mgr.14118 172.21.15.46:0/286323576' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-10-19T12:34:00.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:00 smithi046 ceph-mon[98509]: Manager daemon x is now available 2023-10-19T12:34:00.482 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:00 smithi046 ceph-mon[98509]: from='mgr.14118 172.21.15.46:0/286323576' entity='mgr.x' 2023-10-19T12:34:00.482 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:00 smithi046 ceph-mon[98509]: from='mgr.14118 172.21.15.46:0/286323576' entity='mgr.x' 2023-10-19T12:34:00.482 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:00 smithi046 ceph-mon[98509]: from='mgr.14118 172.21.15.46:0/286323576' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:34:00.482 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:00 smithi046 ceph-mon[98509]: from='mgr.14118 172.21.15.46:0/286323576' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:34:01.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:01 smithi046 ceph-mon[98509]: Found migration_current of "None". Setting to last migration. 2023-10-19T12:34:01.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:01 smithi046 ceph-mon[98509]: from='mgr.14118 172.21.15.46:0/286323576' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:34:01.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:01 smithi046 ceph-mon[98509]: from='mgr.14118 172.21.15.46:0/286323576' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-10-19T12:34:01.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:01 smithi046 ceph-mon[98509]: from='mgr.14118 172.21.15.46:0/286323576' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-10-19T12:34:01.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:01 smithi046 ceph-mon[98509]: from='mgr.14118 172.21.15.46:0/286323576' entity='mgr.x' 2023-10-19T12:34:01.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:01 smithi046 ceph-mon[98509]: from='mgr.14118 172.21.15.46:0/286323576' entity='mgr.x' 2023-10-19T12:34:01.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:01 smithi046 ceph-mon[98509]: mgrmap e7: x(active, since 1.00656s) 2023-10-19T12:34:01.611 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout { 2023-10-19T12:34:01.611 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2023-10-19T12:34:01.611 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "initialized": true 2023-10-19T12:34:01.611 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout } 2023-10-19T12:34:01.612 INFO:teuthology.orchestra.run.smithi046.stdout:mgr epoch 5 is available 2023-10-19T12:34:01.612 INFO:teuthology.orchestra.run.smithi046.stdout:Setting orchestrator backend to cephadm... 2023-10-19T12:34:02.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:02 smithi046 ceph-mon[98509]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-10-19T12:34:02.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:02 smithi046 ceph-mon[98509]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-10-19T12:34:02.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:02 smithi046 ceph-mon[98509]: [19/Oct/2023:12:34:01] ENGINE Bus STARTING 2023-10-19T12:34:02.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:02 smithi046 ceph-mon[98509]: from='mgr.14118 172.21.15.46:0/286323576' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:34:03.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:03 smithi046 ceph-mon[98509]: [19/Oct/2023:12:34:01] ENGINE Serving on https://172.21.15.46:7150 2023-10-19T12:34:03.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:03 smithi046 ceph-mon[98509]: [19/Oct/2023:12:34:01] ENGINE Serving on http://172.21.15.46:8765 2023-10-19T12:34:03.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:03 smithi046 ceph-mon[98509]: [19/Oct/2023:12:34:01] ENGINE Bus STARTED 2023-10-19T12:34:03.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:03 smithi046 ceph-mon[98509]: mgrmap e8: x(active, since 2s) 2023-10-19T12:34:03.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:03 smithi046 ceph-mon[98509]: from='mgr.14118 172.21.15.46:0/286323576' entity='mgr.x' 2023-10-19T12:34:03.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:03 smithi046 ceph-mon[98509]: from='mgr.14118 172.21.15.46:0/286323576' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:34:03.966 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout value unchanged 2023-10-19T12:34:03.967 INFO:teuthology.orchestra.run.smithi046.stdout:Generating ssh key... 2023-10-19T12:34:04.265 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:04 smithi046 ceph-mon[98509]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2023-10-19T12:34:05.196 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:34:04 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: Generating public/private rsa key pair. 2023-10-19T12:34:05.196 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:34:04 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: Your identification has been saved in /tmp/tmp16kfsph3/key. 2023-10-19T12:34:05.197 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:34:04 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: Your public key has been saved in /tmp/tmp16kfsph3/key.pub. 2023-10-19T12:34:05.197 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:34:04 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: The key fingerprint is: 2023-10-19T12:34:05.197 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:34:04 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: SHA256:gf/t92A/N5UXDi7Jj9CJbNM9sFGPzBk9FdObJ3sPJXM ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7 2023-10-19T12:34:05.197 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:34:04 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: The key's randomart image is: 2023-10-19T12:34:05.197 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:34:04 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: +---[RSA 3072]----+ 2023-10-19T12:34:05.198 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:34:04 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: | .o=| 2023-10-19T12:34:05.198 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:34:04 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: | . o oo| 2023-10-19T12:34:05.198 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:34:04 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: | . . + = +| 2023-10-19T12:34:05.198 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:34:04 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: | . . o *+=E| 2023-10-19T12:34:05.198 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:34:04 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: | S = O oB+| 2023-10-19T12:34:05.199 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:34:04 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: | B X +oo+| 2023-10-19T12:34:05.199 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:34:04 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: | . + = +o+| 2023-10-19T12:34:05.199 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:34:04 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: | o o.=o| 2023-10-19T12:34:05.199 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:34:04 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: | .. .*| 2023-10-19T12:34:05.199 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:34:04 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: +----[SHA256]-----+ 2023-10-19T12:34:05.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:05 smithi046 ceph-mon[98509]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2023-10-19T12:34:05.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:05 smithi046 ceph-mon[98509]: from='mgr.14118 172.21.15.46:0/286323576' entity='mgr.x' 2023-10-19T12:34:05.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:05 smithi046 ceph-mon[98509]: from='mgr.14118 172.21.15.46:0/286323576' entity='mgr.x' 2023-10-19T12:34:06.420 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:06 smithi046 ceph-mon[98509]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2023-10-19T12:34:06.421 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:06 smithi046 ceph-mon[98509]: Generating ssh key... 2023-10-19T12:34:06.421 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCr1lZc2HpXjHEUb2NfK7g8GvswYp4UlO2iOJhFjDICb2mG4F7/cRJrsGdNji5hWcW3sA96Krk2d9hlPT8uLBIShu9HLnnFQpB2r+bhWjvvNafsz2iX8/Ro1MZuHCrOPirhbZctKUgpkGXYYkpcqVmvuEfjwaWzHWWD45juXOSRzPzQLeV5g/sWIILvUtc6oj5WJMNSpJ8xROv3zK1e8ZNtBgj4G3Oq3dIKhY+4J0N13G/uc3NIxeep+ZsUh8jBrkUtyQdgYKrXVFU8ui7BqKpvguAPSIrxQYm+3rAesJwiCzTYpT5MVd8/3n3Kz3qhTeOvKOUOrYXlxVQbzqSx6VETfu8Iv38EqAdJ0pjUmmoriUSxovkj47BxnosJkd7B9TZh35L8z7IA8QKvg9G3GkozSoISt+DSKF5Jnk2WzcloC7rkrKaFJZldoh6WGlQSL+ur2bmHlP8mOV3IvTAAvcgmffvbzZcY7umBNEkqrPIY7aVcJl7dJJOC6IFawrRjbIE= ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7 2023-10-19T12:34:06.422 INFO:teuthology.orchestra.run.smithi046.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2023-10-19T12:34:06.422 INFO:teuthology.orchestra.run.smithi046.stdout:Adding key to root@localhost authorized_keys... 2023-10-19T12:34:06.423 INFO:teuthology.orchestra.run.smithi046.stdout:Adding host smithi046... 2023-10-19T12:34:07.456 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:07 smithi046 ceph-mon[98509]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2023-10-19T12:34:08.348 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:08 smithi046 ceph-mon[98509]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi046", "addr": "172.21.15.46", "target": ["mon-mgr", ""]}]: dispatch 2023-10-19T12:34:09.478 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:09 smithi046 ceph-mon[98509]: Deploying cephadm binary to smithi046 2023-10-19T12:34:11.010 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout Added host 'smithi046' with addr '172.21.15.46' 2023-10-19T12:34:11.011 INFO:teuthology.orchestra.run.smithi046.stdout:Deploying unmanaged mon service... 2023-10-19T12:34:11.910 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:11 smithi046 ceph-mon[98509]: from='mgr.14118 172.21.15.46:0/286323576' entity='mgr.x' 2023-10-19T12:34:11.910 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:11 smithi046 ceph-mon[98509]: Added host smithi046 2023-10-19T12:34:11.910 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:11 smithi046 ceph-mon[98509]: from='mgr.14118 172.21.15.46:0/286323576' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:34:12.387 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2023-10-19T12:34:12.387 INFO:teuthology.orchestra.run.smithi046.stdout:Deploying unmanaged mgr service... 2023-10-19T12:34:12.959 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:12 smithi046 ceph-mon[98509]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2023-10-19T12:34:12.959 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:12 smithi046 ceph-mon[98509]: Saving service mon spec with placement count:5 2023-10-19T12:34:12.960 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:12 smithi046 ceph-mon[98509]: from='mgr.14118 172.21.15.46:0/286323576' entity='mgr.x' 2023-10-19T12:34:13.623 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2023-10-19T12:34:14.526 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:14 smithi046 ceph-mon[98509]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2023-10-19T12:34:14.527 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:14 smithi046 ceph-mon[98509]: Saving service mgr spec with placement count:2 2023-10-19T12:34:14.527 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:14 smithi046 ceph-mon[98509]: from='mgr.14118 172.21.15.46:0/286323576' entity='mgr.x' 2023-10-19T12:34:14.527 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:14 smithi046 ceph-mon[98509]: from='mgr.14118 172.21.15.46:0/286323576' entity='mgr.x' 2023-10-19T12:34:14.527 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:14 smithi046 ceph-mon[98509]: from='mgr.14118 172.21.15.46:0/286323576' entity='mgr.x' 2023-10-19T12:34:15.612 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:15 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/2114196441' entity='client.admin' 2023-10-19T12:34:16.088 INFO:teuthology.orchestra.run.smithi046.stdout:Enabling the dashboard module... 2023-10-19T12:34:16.648 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:16 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/1433386028' entity='client.admin' 2023-10-19T12:34:16.648 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:16 smithi046 ceph-mon[98509]: from='mgr.14118 172.21.15.46:0/286323576' entity='mgr.x' 2023-10-19T12:34:17.902 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:17 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/1235594386' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2023-10-19T12:34:17.902 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:34:17 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: ignoring --setuser ceph since I am not root 2023-10-19T12:34:17.902 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:34:17 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: ignoring --setgroup ceph since I am not root 2023-10-19T12:34:17.903 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:34:17 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: 2023-10-19T12:34:17.898+0000 7ff4c4ae3200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-19T12:34:18.229 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:34:18 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: 2023-10-19T12:34:18.006+0000 7ff4c4ae3200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-19T12:34:18.229 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:34:18 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: 2023-10-19T12:34:18.128+0000 7ff4c4ae3200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-19T12:34:18.589 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:34:18 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: 2023-10-19T12:34:18.257+0000 7ff4c4ae3200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-19T12:34:18.589 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:34:18 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: 2023-10-19T12:34:18.503+0000 7ff4c4ae3200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-19T12:34:18.935 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:18 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/1235594386' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2023-10-19T12:34:18.935 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:18 smithi046 ceph-mon[98509]: mgrmap e9: x(active, since 17s) 2023-10-19T12:34:19.229 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:34:18 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: 2023-10-19T12:34:18.987+0000 7ff4c4ae3200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-19T12:34:19.229 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:34:19 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: 2023-10-19T12:34:19.168+0000 7ff4c4ae3200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-19T12:34:19.365 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout { 2023-10-19T12:34:19.365 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 9, 2023-10-19T12:34:19.366 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "available": true, 2023-10-19T12:34:19.366 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "active_name": "x", 2023-10-19T12:34:19.366 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-10-19T12:34:19.366 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout } 2023-10-19T12:34:19.367 INFO:teuthology.orchestra.run.smithi046.stdout:Waiting for the mgr to restart... 2023-10-19T12:34:19.367 INFO:teuthology.orchestra.run.smithi046.stdout:Waiting for mgr epoch 9... 2023-10-19T12:34:19.589 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:34:19 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: 2023-10-19T12:34:19.290+0000 7ff4c4ae3200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-19T12:34:19.589 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:34:19 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: 2023-10-19T12:34:19.425+0000 7ff4c4ae3200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-19T12:34:19.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:19 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/4122873572' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-10-19T12:34:20.479 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:34:20 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: 2023-10-19T12:34:20.024+0000 7ff4c4ae3200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-19T12:34:21.228 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:34:20 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: 2023-10-19T12:34:20.899+0000 7ff4c4ae3200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-19T12:34:21.229 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:34:21 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: 2023-10-19T12:34:21.007+0000 7ff4c4ae3200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-19T12:34:22.363 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:34:22 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: 2023-10-19T12:34:22.003+0000 7ff4c4ae3200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-19T12:34:22.364 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:34:22 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: 2023-10-19T12:34:22.126+0000 7ff4c4ae3200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-19T12:34:22.729 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:34:22 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: 2023-10-19T12:34:22.360+0000 7ff4c4ae3200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-19T12:34:23.030 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:34:22 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: 2023-10-19T12:34:22.741+0000 7ff4c4ae3200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-19T12:34:23.479 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:34:23 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: 2023-10-19T12:34:23.027+0000 7ff4c4ae3200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-19T12:34:23.479 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:34:23 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: 2023-10-19T12:34:23.228+0000 7ff4c4ae3200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-19T12:34:23.979 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:34:23 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: 2023-10-19T12:34:23.586+0000 7ff4c4ae3200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-19T12:34:24.979 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:34:24 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: 2023-10-19T12:34:24.551+0000 7ff4c4ae3200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-19T12:34:24.979 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:34:24 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: 2023-10-19T12:34:24.731+0000 7ff4c4ae3200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-19T12:34:25.435 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:34:24 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: 2023-10-19T12:34:24.990+0000 7ff4c4ae3200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-19T12:34:25.436 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:34:25 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: 2023-10-19T12:34:25.142+0000 7ff4c4ae3200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-19T12:34:25.729 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:34:25 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: 2023-10-19T12:34:25.432+0000 7ff4c4ae3200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-19T12:34:26.979 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:34:26 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: 2023-10-19T12:34:26.549+0000 7ff4c4ae3200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-19T12:34:26.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:26 smithi046 ceph-mon[98509]: Active manager daemon x restarted 2023-10-19T12:34:26.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:26 smithi046 ceph-mon[98509]: Activating manager daemon x 2023-10-19T12:34:26.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:26 smithi046 ceph-mon[98509]: osdmap e3: 0 total, 0 up, 0 in 2023-10-19T12:34:26.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:26 smithi046 ceph-mon[98509]: mgrmap e10: x(active, starting, since 0.0038101s) 2023-10-19T12:34:26.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:26 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-19T12:34:26.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:26 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-10-19T12:34:26.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:26 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-10-19T12:34:26.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:26 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-10-19T12:34:26.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:26 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-10-19T12:34:26.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:26 smithi046 ceph-mon[98509]: Manager daemon x is now available 2023-10-19T12:34:26.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:26 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:34:26.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:26 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:34:27.960 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout { 2023-10-19T12:34:27.961 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2023-10-19T12:34:27.961 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "initialized": true 2023-10-19T12:34:27.961 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout } 2023-10-19T12:34:27.962 INFO:teuthology.orchestra.run.smithi046.stdout:mgr epoch 9 is available 2023-10-19T12:34:27.962 INFO:teuthology.orchestra.run.smithi046.stdout:Generating a dashboard self-signed certificate... 2023-10-19T12:34:27.978 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:27 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-10-19T12:34:27.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:27 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-10-19T12:34:27.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:27 smithi046 ceph-mon[98509]: mgrmap e11: x(active, since 1.00688s) 2023-10-19T12:34:28.955 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:28 smithi046 ceph-mon[98509]: [19/Oct/2023:12:34:27] ENGINE Bus STARTING 2023-10-19T12:34:28.955 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:28 smithi046 ceph-mon[98509]: [19/Oct/2023:12:34:27] ENGINE Serving on https://172.21.15.46:7150 2023-10-19T12:34:28.956 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:28 smithi046 ceph-mon[98509]: [19/Oct/2023:12:34:27] ENGINE Serving on http://172.21.15.46:8765 2023-10-19T12:34:28.956 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:28 smithi046 ceph-mon[98509]: [19/Oct/2023:12:34:27] ENGINE Bus STARTED 2023-10-19T12:34:28.956 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:28 smithi046 ceph-mon[98509]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-10-19T12:34:28.956 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:28 smithi046 ceph-mon[98509]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-10-19T12:34:29.344 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2023-10-19T12:34:29.344 INFO:teuthology.orchestra.run.smithi046.stdout:Creating initial admin user... 2023-10-19T12:34:29.627 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:29 smithi046 ceph-mon[98509]: mgrmap e12: x(active, since 2s) 2023-10-19T12:34:29.627 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:29 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:34:29.627 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:29 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:34:29.628 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:29 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:34:30.827 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$JMPvHRhf38PWeK//ZmXc7e2hk5ptFf8zKmgCwvev8qjuEsOamggGi", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1697718870, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2023-10-19T12:34:30.828 INFO:teuthology.orchestra.run.smithi046.stdout:Fetching dashboard port number... 2023-10-19T12:34:30.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:30 smithi046 ceph-mon[98509]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2023-10-19T12:34:30.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:30 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:34:30.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:30 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:34:31.972 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:31 smithi046 ceph-mon[98509]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2023-10-19T12:34:31.972 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:31 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/3162894285' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2023-10-19T12:34:32.108 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 8443 2023-10-19T12:34:32.129 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-10-19T12:34:32.129 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout disabled 2023-10-19T12:34:32.147 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-10-19T12:34:32.148 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout inactive 2023-10-19T12:34:32.148 INFO:teuthology.orchestra.run.smithi046.stdout:firewalld.service is not enabled 2023-10-19T12:34:32.148 INFO:teuthology.orchestra.run.smithi046.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2023-10-19T12:34:32.151 INFO:teuthology.orchestra.run.smithi046.stdout:Ceph Dashboard is now available at: 2023-10-19T12:34:32.151 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:34:32.151 INFO:teuthology.orchestra.run.smithi046.stdout: URL: https://smithi046.front.sepia.ceph.com:8443/ 2023-10-19T12:34:32.152 INFO:teuthology.orchestra.run.smithi046.stdout: User: admin 2023-10-19T12:34:32.152 INFO:teuthology.orchestra.run.smithi046.stdout: Password: xilz3apysq 2023-10-19T12:34:32.152 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:34:32.153 INFO:teuthology.orchestra.run.smithi046.stdout:Saving cluster configuration to /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/config directory 2023-10-19T12:34:32.153 INFO:teuthology.orchestra.run.smithi046.stdout:Enabling autotune for osd_memory_target 2023-10-19T12:34:33.861 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:33 smithi046 ceph-mon[98509]: mgrmap e13: x(active, since 6s) 2023-10-19T12:34:34.816 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2023-10-19T12:34:34.817 INFO:teuthology.orchestra.run.smithi046.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2023-10-19T12:34:34.817 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:34:34.817 INFO:teuthology.orchestra.run.smithi046.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2023-10-19T12:34:34.817 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:34:34.818 INFO:teuthology.orchestra.run.smithi046.stdout:Or, if you are only running a single cluster on this host: 2023-10-19T12:34:34.818 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:34:34.818 INFO:teuthology.orchestra.run.smithi046.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2023-10-19T12:34:34.818 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:34:34.818 INFO:teuthology.orchestra.run.smithi046.stdout:Please consider enabling telemetry to help improve Ceph: 2023-10-19T12:34:34.819 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:34:34.819 INFO:teuthology.orchestra.run.smithi046.stdout: ceph telemetry on 2023-10-19T12:34:34.819 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:34:34.819 INFO:teuthology.orchestra.run.smithi046.stdout:For more information see: 2023-10-19T12:34:34.819 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:34:34.819 INFO:teuthology.orchestra.run.smithi046.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2023-10-19T12:34:34.820 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:34:34.820 INFO:teuthology.orchestra.run.smithi046.stdout:Bootstrap complete. 2023-10-19T12:34:34.879 INFO:tasks.cephadm:Fetching config... 2023-10-19T12:34:34.880 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-10-19T12:34:34.880 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2023-10-19T12:34:34.925 INFO:tasks.cephadm:Fetching client.admin keyring... 2023-10-19T12:34:34.925 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-10-19T12:34:34.926 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2023-10-19T12:34:35.011 INFO:tasks.cephadm:Fetching mon keyring... 2023-10-19T12:34:35.011 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-10-19T12:34:35.012 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.a/keyring of=/dev/stdout 2023-10-19T12:34:35.124 INFO:tasks.cephadm:Fetching pub ssh key... 2023-10-19T12:34:35.124 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-10-19T12:34:35.124 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2023-10-19T12:34:35.214 INFO:tasks.cephadm:Installing pub ssh key for root users... 2023-10-19T12:34:35.215 DEBUG:teuthology.orchestra.run.smithi046:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCr1lZc2HpXjHEUb2NfK7g8GvswYp4UlO2iOJhFjDICb2mG4F7/cRJrsGdNji5hWcW3sA96Krk2d9hlPT8uLBIShu9HLnnFQpB2r+bhWjvvNafsz2iX8/Ro1MZuHCrOPirhbZctKUgpkGXYYkpcqVmvuEfjwaWzHWWD45juXOSRzPzQLeV5g/sWIILvUtc6oj5WJMNSpJ8xROv3zK1e8ZNtBgj4G3Oq3dIKhY+4J0N13G/uc3NIxeep+ZsUh8jBrkUtyQdgYKrXVFU8ui7BqKpvguAPSIrxQYm+3rAesJwiCzTYpT5MVd8/3n3Kz3qhTeOvKOUOrYXlxVQbzqSx6VETfu8Iv38EqAdJ0pjUmmoriUSxovkj47BxnosJkd7B9TZh35L8z7IA8QKvg9G3GkozSoISt+DSKF5Jnk2WzcloC7rkrKaFJZldoh6WGlQSL+ur2bmHlP8mOV3IvTAAvcgmffvbzZcY7umBNEkqrPIY7aVcJl7dJJOC6IFawrRjbIE= ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-10-19T12:34:35.359 INFO:teuthology.orchestra.run.smithi046.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCr1lZc2HpXjHEUb2NfK7g8GvswYp4UlO2iOJhFjDICb2mG4F7/cRJrsGdNji5hWcW3sA96Krk2d9hlPT8uLBIShu9HLnnFQpB2r+bhWjvvNafsz2iX8/Ro1MZuHCrOPirhbZctKUgpkGXYYkpcqVmvuEfjwaWzHWWD45juXOSRzPzQLeV5g/sWIILvUtc6oj5WJMNSpJ8xROv3zK1e8ZNtBgj4G3Oq3dIKhY+4J0N13G/uc3NIxeep+ZsUh8jBrkUtyQdgYKrXVFU8ui7BqKpvguAPSIrxQYm+3rAesJwiCzTYpT5MVd8/3n3Kz3qhTeOvKOUOrYXlxVQbzqSx6VETfu8Iv38EqAdJ0pjUmmoriUSxovkj47BxnosJkd7B9TZh35L8z7IA8QKvg9G3GkozSoISt+DSKF5Jnk2WzcloC7rkrKaFJZldoh6WGlQSL+ur2bmHlP8mOV3IvTAAvcgmffvbzZcY7umBNEkqrPIY7aVcJl7dJJOC6IFawrRjbIE= ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7 2023-10-19T12:34:35.393 DEBUG:teuthology.orchestra.run.smithi157:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCr1lZc2HpXjHEUb2NfK7g8GvswYp4UlO2iOJhFjDICb2mG4F7/cRJrsGdNji5hWcW3sA96Krk2d9hlPT8uLBIShu9HLnnFQpB2r+bhWjvvNafsz2iX8/Ro1MZuHCrOPirhbZctKUgpkGXYYkpcqVmvuEfjwaWzHWWD45juXOSRzPzQLeV5g/sWIILvUtc6oj5WJMNSpJ8xROv3zK1e8ZNtBgj4G3Oq3dIKhY+4J0N13G/uc3NIxeep+ZsUh8jBrkUtyQdgYKrXVFU8ui7BqKpvguAPSIrxQYm+3rAesJwiCzTYpT5MVd8/3n3Kz3qhTeOvKOUOrYXlxVQbzqSx6VETfu8Iv38EqAdJ0pjUmmoriUSxovkj47BxnosJkd7B9TZh35L8z7IA8QKvg9G3GkozSoISt+DSKF5Jnk2WzcloC7rkrKaFJZldoh6WGlQSL+ur2bmHlP8mOV3IvTAAvcgmffvbzZcY7umBNEkqrPIY7aVcJl7dJJOC6IFawrRjbIE= ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-10-19T12:34:35.438 INFO:teuthology.orchestra.run.smithi157.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCr1lZc2HpXjHEUb2NfK7g8GvswYp4UlO2iOJhFjDICb2mG4F7/cRJrsGdNji5hWcW3sA96Krk2d9hlPT8uLBIShu9HLnnFQpB2r+bhWjvvNafsz2iX8/Ro1MZuHCrOPirhbZctKUgpkGXYYkpcqVmvuEfjwaWzHWWD45juXOSRzPzQLeV5g/sWIILvUtc6oj5WJMNSpJ8xROv3zK1e8ZNtBgj4G3Oq3dIKhY+4J0N13G/uc3NIxeep+ZsUh8jBrkUtyQdgYKrXVFU8ui7BqKpvguAPSIrxQYm+3rAesJwiCzTYpT5MVd8/3n3Kz3qhTeOvKOUOrYXlxVQbzqSx6VETfu8Iv38EqAdJ0pjUmmoriUSxovkj47BxnosJkd7B9TZh35L8z7IA8QKvg9G3GkozSoISt+DSKF5Jnk2WzcloC7rkrKaFJZldoh6WGlQSL+ur2bmHlP8mOV3IvTAAvcgmffvbzZcY7umBNEkqrPIY7aVcJl7dJJOC6IFawrRjbIE= ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7 2023-10-19T12:34:35.450 DEBUG:teuthology.orchestra.run.smithi195:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCr1lZc2HpXjHEUb2NfK7g8GvswYp4UlO2iOJhFjDICb2mG4F7/cRJrsGdNji5hWcW3sA96Krk2d9hlPT8uLBIShu9HLnnFQpB2r+bhWjvvNafsz2iX8/Ro1MZuHCrOPirhbZctKUgpkGXYYkpcqVmvuEfjwaWzHWWD45juXOSRzPzQLeV5g/sWIILvUtc6oj5WJMNSpJ8xROv3zK1e8ZNtBgj4G3Oq3dIKhY+4J0N13G/uc3NIxeep+ZsUh8jBrkUtyQdgYKrXVFU8ui7BqKpvguAPSIrxQYm+3rAesJwiCzTYpT5MVd8/3n3Kz3qhTeOvKOUOrYXlxVQbzqSx6VETfu8Iv38EqAdJ0pjUmmoriUSxovkj47BxnosJkd7B9TZh35L8z7IA8QKvg9G3GkozSoISt+DSKF5Jnk2WzcloC7rkrKaFJZldoh6WGlQSL+ur2bmHlP8mOV3IvTAAvcgmffvbzZcY7umBNEkqrPIY7aVcJl7dJJOC6IFawrRjbIE= ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-10-19T12:34:35.495 INFO:teuthology.orchestra.run.smithi195.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCr1lZc2HpXjHEUb2NfK7g8GvswYp4UlO2iOJhFjDICb2mG4F7/cRJrsGdNji5hWcW3sA96Krk2d9hlPT8uLBIShu9HLnnFQpB2r+bhWjvvNafsz2iX8/Ro1MZuHCrOPirhbZctKUgpkGXYYkpcqVmvuEfjwaWzHWWD45juXOSRzPzQLeV5g/sWIILvUtc6oj5WJMNSpJ8xROv3zK1e8ZNtBgj4G3Oq3dIKhY+4J0N13G/uc3NIxeep+ZsUh8jBrkUtyQdgYKrXVFU8ui7BqKpvguAPSIrxQYm+3rAesJwiCzTYpT5MVd8/3n3Kz3qhTeOvKOUOrYXlxVQbzqSx6VETfu8Iv38EqAdJ0pjUmmoriUSxovkj47BxnosJkd7B9TZh35L8z7IA8QKvg9G3GkozSoISt+DSKF5Jnk2WzcloC7rkrKaFJZldoh6WGlQSL+ur2bmHlP8mOV3IvTAAvcgmffvbzZcY7umBNEkqrPIY7aVcJl7dJJOC6IFawrRjbIE= ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7 2023-10-19T12:34:35.508 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2023-10-19T12:34:35.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:35 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/2715816057' entity='client.admin' 2023-10-19T12:34:36.261 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-19T12:34:38.713 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:38 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:34:38.713 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:38 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:34:38.713 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:38 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi046", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:34:38.713 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:38 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:34:38.714 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:38 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:34:38.714 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:38 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:34:38.714 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:38 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/1050325338' entity='client.admin' 2023-10-19T12:34:38.714 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:38 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:34:38.714 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:38 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:34:38.756 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2023-10-19T12:34:38.756 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph orch client-keyring set client.admin '*' --mode 0755 2023-10-19T12:34:39.506 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-19T12:34:41.688 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi157 2023-10-19T12:34:41.689 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-10-19T12:34:41.689 DEBUG:teuthology.orchestra.run.smithi157:> dd of=/etc/ceph/ceph.conf 2023-10-19T12:34:41.709 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-10-19T12:34:41.710 DEBUG:teuthology.orchestra.run.smithi157:> dd of=/etc/ceph/ceph.client.admin.keyring 2023-10-19T12:34:41.769 INFO:tasks.cephadm:Adding host smithi157 to orchestrator... 2023-10-19T12:34:41.770 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph orch host add smithi157 2023-10-19T12:34:42.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:42 smithi046 ceph-mon[98509]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2023-10-19T12:34:42.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:42 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:34:42.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:42 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:34:42.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:42 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:34:42.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:42 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:34:42.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:42 smithi046 ceph-mon[98509]: Updating smithi046:/etc/ceph/ceph.conf 2023-10-19T12:34:42.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:42 smithi046 ceph-mon[98509]: Updating smithi046:/var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/config/ceph.conf 2023-10-19T12:34:42.539 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-19T12:34:43.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:43 smithi046 ceph-mon[98509]: Updating smithi046:/etc/ceph/ceph.client.admin.keyring 2023-10-19T12:34:43.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:43 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:34:43.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:43 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:34:43.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:43 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:34:44.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:44 smithi046 ceph-mon[98509]: Updating smithi046:/var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-19T12:34:45.978 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:45 smithi046 ceph-mon[98509]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi157", "target": ["mon-mgr", ""]}]: dispatch 2023-10-19T12:34:46.760 INFO:teuthology.orchestra.run.smithi046.stdout:Added host 'smithi157' with addr '172.21.15.157' 2023-10-19T12:34:46.896 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:46 smithi046 ceph-mon[98509]: Deploying cephadm binary to smithi157 2023-10-19T12:34:47.236 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph orch host ls --format=json 2023-10-19T12:34:47.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:47 smithi046 ceph-mon[98509]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:34:47.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:47 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:34:47.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:47 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:34:47.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:47 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:34:47.980 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-19T12:34:48.804 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:48 smithi046 ceph-mon[98509]: Added host smithi157 2023-10-19T12:34:48.805 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:48 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:34:49.614 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:34:49.615 INFO:teuthology.orchestra.run.smithi046.stdout:[{"addr": "172.21.15.46", "hostname": "smithi046", "labels": [], "status": ""}, {"addr": "172.21.15.157", "hostname": "smithi157", "labels": [], "status": ""}] 2023-10-19T12:34:49.978 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:49 smithi046 ceph-mon[98509]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:34:49.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:49 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:34:50.061 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi195 2023-10-19T12:34:50.062 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2023-10-19T12:34:50.062 DEBUG:teuthology.orchestra.run.smithi195:> dd of=/etc/ceph/ceph.conf 2023-10-19T12:34:50.083 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2023-10-19T12:34:50.083 DEBUG:teuthology.orchestra.run.smithi195:> dd of=/etc/ceph/ceph.client.admin.keyring 2023-10-19T12:34:50.143 INFO:tasks.cephadm:Adding host smithi195 to orchestrator... 2023-10-19T12:34:50.144 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph orch host add smithi195 2023-10-19T12:34:50.886 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-19T12:34:50.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:50 smithi046 ceph-mon[98509]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-19T12:34:51.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:51 smithi046 ceph-mon[98509]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:34:53.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:52 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:34:53.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:52 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:34:53.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:52 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:34:53.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:52 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:34:53.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:52 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi157", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:34:53.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:52 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:34:53.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:52 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:34:53.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:52 smithi046 ceph-mon[98509]: Updating smithi157:/etc/ceph/ceph.conf 2023-10-19T12:34:53.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:52 smithi046 ceph-mon[98509]: Updating smithi157:/var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/config/ceph.conf 2023-10-19T12:34:53.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:52 smithi046 ceph-mon[98509]: Updating smithi157:/etc/ceph/ceph.client.admin.keyring 2023-10-19T12:34:53.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:52 smithi046 ceph-mon[98509]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:34:53.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:52 smithi046 ceph-mon[98509]: Updating smithi157:/var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-19T12:34:53.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:52 smithi046 ceph-mon[98509]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi195", "target": ["mon-mgr", ""]}]: dispatch 2023-10-19T12:34:53.232 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:52 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:34:53.232 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:52 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:34:53.232 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:52 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:34:54.228 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:53 smithi046 ceph-mon[98509]: Deploying cephadm binary to smithi195 2023-10-19T12:34:55.124 INFO:teuthology.orchestra.run.smithi046.stdout:Added host 'smithi195' with addr '172.21.15.195' 2023-10-19T12:34:55.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:54 smithi046 ceph-mon[98509]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:34:55.578 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph orch host ls --format=json 2023-10-19T12:34:56.322 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-19T12:34:56.478 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:56 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:34:56.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:56 smithi046 ceph-mon[98509]: Added host smithi195 2023-10-19T12:34:56.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:56 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:34:56.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:56 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:34:57.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:57 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:34:57.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:57 smithi046 ceph-mon[98509]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:34:58.061 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:34:58.062 INFO:teuthology.orchestra.run.smithi046.stdout:[{"addr": "172.21.15.46", "hostname": "smithi046", "labels": [], "status": ""}, {"addr": "172.21.15.157", "hostname": "smithi157", "labels": [], "status": ""}, {"addr": "172.21.15.195", "hostname": "smithi195", "labels": [], "status": ""}] 2023-10-19T12:34:58.609 INFO:tasks.cephadm:Setting crush tunables to default 2023-10-19T12:34:58.609 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph osd crush tunables default 2023-10-19T12:34:58.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:58 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:34:59.352 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-19T12:34:59.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:59 smithi046 ceph-mon[98509]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-19T12:34:59.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:34:59 smithi046 ceph-mon[98509]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:01.249 INFO:teuthology.orchestra.run.smithi046.stderr:adjusted tunables profile to default 2023-10-19T12:35:01.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:01 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:01.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:01 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:01.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:01 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:01.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:01 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:01.730 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:01 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi195", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:35:01.730 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:01 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:35:01.730 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:01 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:35:01.730 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:01 smithi046 ceph-mon[98509]: Updating smithi195:/etc/ceph/ceph.conf 2023-10-19T12:35:01.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:01 smithi046 ceph-mon[98509]: Updating smithi195:/var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/config/ceph.conf 2023-10-19T12:35:01.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:01 smithi046 ceph-mon[98509]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:01.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:01 smithi046 ceph-mon[98509]: Updating smithi195:/etc/ceph/ceph.client.admin.keyring 2023-10-19T12:35:01.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:01 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/646194624' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-10-19T12:35:01.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:01 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:01.732 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:01 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:01.732 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:01 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:01.733 INFO:tasks.cephadm:Adding mon.a on smithi046 2023-10-19T12:35:01.733 INFO:tasks.cephadm:Adding mon.b on smithi157 2023-10-19T12:35:01.734 INFO:tasks.cephadm:Adding mon.c on smithi195 2023-10-19T12:35:01.734 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph orch apply mon '3;smithi046:172.21.15.46=a;smithi157:172.21.15.157=b;smithi195:172.21.15.195=c' 2023-10-19T12:35:02.309 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/config/ceph.conf 2023-10-19T12:35:02.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:02 smithi046 ceph-mon[98509]: Updating smithi195:/var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-19T12:35:02.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:02 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/646194624' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-10-19T12:35:02.730 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:02 smithi046 ceph-mon[98509]: osdmap e4: 0 total, 0 up, 0 in 2023-10-19T12:35:03.884 INFO:teuthology.orchestra.run.smithi195.stdout:Scheduled mon update... 2023-10-19T12:35:03.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:03 smithi046 ceph-mon[98509]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:04.269 DEBUG:teuthology.orchestra.run.smithi157:mon.b> sudo journalctl -f -n 0 -u ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@mon.b.service 2023-10-19T12:35:04.271 DEBUG:teuthology.orchestra.run.smithi195:mon.c> sudo journalctl -f -n 0 -u ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@mon.c.service 2023-10-19T12:35:04.274 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-10-19T12:35:04.274 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph mon dump -f json 2023-10-19T12:35:04.303 INFO:journalctl@ceph.mon.c.smithi195.stdout:-- Logs begin at Thu 2023-10-19 12:10:53 UTC. -- 2023-10-19T12:35:04.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:-- Logs begin at Thu 2023-10-19 12:11:40 UTC. -- 2023-10-19T12:35:05.150 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/config/ceph.conf 2023-10-19T12:35:05.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:04 smithi046 ceph-mon[98509]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi046:172.21.15.46=a;smithi157:172.21.15.157=b;smithi195:172.21.15.195=c", "target": ["mon-mgr", ""]}]: dispatch 2023-10-19T12:35:05.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:04 smithi046 ceph-mon[98509]: Saving service mon spec with placement smithi046:172.21.15.46=a;smithi157:172.21.15.157=b;smithi195:172.21.15.195=c;count:3 2023-10-19T12:35:05.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:04 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:05.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:04 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:35:05.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:04 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:35:05.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:04 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:35:05.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:04 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:05.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:04 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-19T12:35:05.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:04 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:35:05.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:04 smithi046 ceph-mon[98509]: Deploying daemon mon.c on smithi195 2023-10-19T12:35:05.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:04 smithi046 ceph-mon[98509]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:07.177 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-10-19T12:35:07.178 INFO:teuthology.orchestra.run.smithi195.stdout:{"epoch":1,"fsid":"96a8be3c-6e7b-11ee-8db6-212e2dc638e7","modified":"2023-10-19T12:33:22.688296Z","created":"2023-10-19T12:33:22.688296Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-10-19T12:35:07.181 INFO:teuthology.orchestra.run.smithi195.stderr:dumped monmap epoch 1 2023-10-19T12:35:07.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:07 smithi195 systemd[1]: Started Ceph mon.c for 96a8be3c-6e7b-11ee-8db6-212e2dc638e7. 2023-10-19T12:35:07.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:07 smithi195 ceph-mon[134493]: mon.c@-1(synchronizing).mds e1 new map 2023-10-19T12:35:07.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:07 smithi195 ceph-mon[134493]: mon.c@-1(synchronizing).mds e1 print_map 2023-10-19T12:35:07.382 INFO:journalctl@ceph.mon.c.smithi195.stdout: e1 2023-10-19T12:35:07.382 INFO:journalctl@ceph.mon.c.smithi195.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-10-19T12:35:07.382 INFO:journalctl@ceph.mon.c.smithi195.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-10-19T12:35:07.382 INFO:journalctl@ceph.mon.c.smithi195.stdout: legacy client fscid: -1 2023-10-19T12:35:07.383 INFO:journalctl@ceph.mon.c.smithi195.stdout: 2023-10-19T12:35:07.383 INFO:journalctl@ceph.mon.c.smithi195.stdout: No filesystems configured 2023-10-19T12:35:07.383 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:07 smithi195 ceph-mon[134493]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2023-10-19T12:35:07.384 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:07 smithi195 ceph-mon[134493]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2023-10-19T12:35:07.384 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:07 smithi195 ceph-mon[134493]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2023-10-19T12:35:07.384 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:07 smithi195 ceph-mon[134493]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2023-10-19T12:35:07.384 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:07 smithi195 ceph-mon[134493]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2023-10-19T12:35:07.384 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:07 smithi195 ceph-mon[134493]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2023-10-19T12:35:07.385 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:07 smithi195 ceph-mon[134493]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2023-10-19T12:35:07.385 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:07 smithi195 ceph-mon[134493]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-10-19T12:35:07.385 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:07 smithi195 ceph-mon[134493]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-10-19T12:35:07.385 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:07 smithi195 ceph-mon[134493]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-10-19T12:35:07.385 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:07 smithi195 ceph-mon[134493]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:07.386 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:07 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:07.386 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:07 smithi195 ceph-mon[134493]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-19T12:35:07.386 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:07 smithi195 ceph-mon[134493]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:07.386 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:07 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:07.387 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:07 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:07.387 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:07 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:07.387 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:07 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:07.387 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:07 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi157", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:35:07.387 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:07 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:35:07.388 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:07 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:35:07.388 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:07 smithi195 ceph-mon[134493]: Updating smithi157:/etc/ceph/ceph.conf 2023-10-19T12:35:07.388 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:07 smithi195 ceph-mon[134493]: Updating smithi157:/var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/config/ceph.conf 2023-10-19T12:35:07.388 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:07 smithi195 ceph-mon[134493]: Updating smithi157:/etc/ceph/ceph.client.admin.keyring 2023-10-19T12:35:07.388 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:07 smithi195 ceph-mon[134493]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:07.389 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:07 smithi195 ceph-mon[134493]: Updating smithi157:/var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-19T12:35:07.389 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:07 smithi195 ceph-mon[134493]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi195", "target": ["mon-mgr", ""]}]: dispatch 2023-10-19T12:35:07.389 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:07 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:07.389 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:07 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:07.389 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:07 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:07.390 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:07 smithi195 ceph-mon[134493]: Deploying cephadm binary to smithi195 2023-10-19T12:35:07.390 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:07 smithi195 ceph-mon[134493]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:07.390 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:07 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:07.390 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:07 smithi195 ceph-mon[134493]: Added host smithi195 2023-10-19T12:35:07.390 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:07 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:35:07.391 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:07 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:07.391 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:07 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:07.391 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:07 smithi195 ceph-mon[134493]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:07.391 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:07 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:07.391 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:07 smithi195 ceph-mon[134493]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-19T12:35:07.392 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:07 smithi195 ceph-mon[134493]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:07.392 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:07 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:07.392 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:07 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:07.392 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:07 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:07.392 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:07 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:07.393 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:07 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi195", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:35:07.393 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:07 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:35:07.393 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:07 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:35:07.393 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:07 smithi195 ceph-mon[134493]: Updating smithi195:/etc/ceph/ceph.conf 2023-10-19T12:35:07.393 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:07 smithi195 ceph-mon[134493]: Updating smithi195:/var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/config/ceph.conf 2023-10-19T12:35:07.394 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:07 smithi195 ceph-mon[134493]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:07.394 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:07 smithi195 ceph-mon[134493]: Updating smithi195:/etc/ceph/ceph.client.admin.keyring 2023-10-19T12:35:07.394 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:07 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/646194624' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-10-19T12:35:07.394 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:07 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:07.395 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:07 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:07.395 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:07 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:07.395 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:07 smithi195 ceph-mon[134493]: Updating smithi195:/var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-19T12:35:07.395 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:07 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/646194624' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-10-19T12:35:07.395 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:07 smithi195 ceph-mon[134493]: osdmap e4: 0 total, 0 up, 0 in 2023-10-19T12:35:07.395 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:07 smithi195 ceph-mon[134493]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:07.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:07 smithi195 ceph-mon[134493]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi046:172.21.15.46=a;smithi157:172.21.15.157=b;smithi195:172.21.15.195=c", "target": ["mon-mgr", ""]}]: dispatch 2023-10-19T12:35:07.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:07 smithi195 ceph-mon[134493]: Saving service mon spec with placement smithi046:172.21.15.46=a;smithi157:172.21.15.157=b;smithi195:172.21.15.195=c;count:3 2023-10-19T12:35:07.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:07 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:07.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:07 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:35:07.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:07 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:35:07.397 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:07 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:35:07.397 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:07 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:07.398 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:07 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-19T12:35:07.398 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:07 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:35:07.398 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:07 smithi195 ceph-mon[134493]: Deploying daemon mon.c on smithi195 2023-10-19T12:35:07.398 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:07 smithi195 ceph-mon[134493]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:07.398 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:07 smithi195 ceph-mon[134493]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2023-10-19T12:35:08.719 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-10-19T12:35:08.720 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph mon dump -f json 2023-10-19T12:35:09.283 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.c/config 2023-10-19T12:35:12.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:12 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-19T12:35:12.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:12 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-19T12:35:12.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:12 smithi195 ceph-mon[134493]: mon.a calling monitor election 2023-10-19T12:35:12.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:12 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-19T12:35:12.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:12 smithi195 ceph-mon[134493]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:12.632 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:12 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-19T12:35:12.632 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:12 smithi195 ceph-mon[134493]: mon.c calling monitor election 2023-10-19T12:35:12.632 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:12 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-19T12:35:12.632 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:12 smithi195 ceph-mon[134493]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:12.632 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:12 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-19T12:35:12.633 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:12 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-19T12:35:12.633 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:12 smithi195 ceph-mon[134493]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-10-19T12:35:12.633 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:12 smithi195 ceph-mon[134493]: monmap e2: 2 mons at {a=[v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0],c=[v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-10-19T12:35:12.634 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:12 smithi195 ceph-mon[134493]: fsmap 2023-10-19T12:35:12.634 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:12 smithi195 ceph-mon[134493]: osdmap e4: 0 total, 0 up, 0 in 2023-10-19T12:35:12.634 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:12 smithi195 ceph-mon[134493]: mgrmap e13: x(active, since 45s) 2023-10-19T12:35:12.635 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:12 smithi195 ceph-mon[134493]: overall HEALTH_OK 2023-10-19T12:35:12.635 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:12 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:12.636 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:12 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:12.636 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:12 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:12.636 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:12 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-19T12:35:12.636 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:12 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:35:12.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:12 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-19T12:35:12.730 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:12 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-19T12:35:12.730 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:12 smithi046 ceph-mon[98509]: mon.a calling monitor election 2023-10-19T12:35:12.730 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:12 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-19T12:35:12.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:12 smithi046 ceph-mon[98509]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:12.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:12 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-19T12:35:12.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:12 smithi046 ceph-mon[98509]: mon.c calling monitor election 2023-10-19T12:35:12.732 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:12 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-19T12:35:12.732 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:12 smithi046 ceph-mon[98509]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:12.732 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:12 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-19T12:35:12.733 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:12 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-19T12:35:12.733 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:12 smithi046 ceph-mon[98509]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-10-19T12:35:12.733 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:12 smithi046 ceph-mon[98509]: monmap e2: 2 mons at {a=[v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0],c=[v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-10-19T12:35:12.734 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:12 smithi046 ceph-mon[98509]: fsmap 2023-10-19T12:35:12.734 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:12 smithi046 ceph-mon[98509]: osdmap e4: 0 total, 0 up, 0 in 2023-10-19T12:35:12.735 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:12 smithi046 ceph-mon[98509]: mgrmap e13: x(active, since 45s) 2023-10-19T12:35:12.735 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:12 smithi046 ceph-mon[98509]: overall HEALTH_OK 2023-10-19T12:35:12.735 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:12 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:12.736 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:12 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:12.736 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:12 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:12.736 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:12 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-19T12:35:12.736 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:12 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:35:13.765 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-10-19T12:35:13.766 INFO:teuthology.orchestra.run.smithi195.stdout:{"epoch":2,"fsid":"96a8be3c-6e7b-11ee-8db6-212e2dc638e7","modified":"2023-10-19T12:35:07.273980Z","created":"2023-10-19T12:33:22.688296Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:3300","nonce":0},{"type":"v1","addr":"172.21.15.195:6789","nonce":0}]},"addr":"172.21.15.195:6789/0","public_addr":"172.21.15.195:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2023-10-19T12:35:13.768 INFO:teuthology.orchestra.run.smithi195.stderr:dumped monmap epoch 2 2023-10-19T12:35:13.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:13 smithi195 ceph-mon[134493]: Deploying daemon mon.b on smithi157 2023-10-19T12:35:13.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:13 smithi195 ceph-mon[134493]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:13.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:13 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-19T12:35:13.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:13 smithi046 ceph-mon[98509]: Deploying daemon mon.b on smithi157 2023-10-19T12:35:13.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:13 smithi046 ceph-mon[98509]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:13.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:13 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-19T12:35:14.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:14 smithi195 ceph-mon[134493]: from='client.? 172.21.15.195:0/519544361' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-19T12:35:14.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:14 smithi046 ceph-mon[98509]: from='client.? 172.21.15.195:0/519544361' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-19T12:35:15.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:14 smithi157 systemd[1]: Starting Ceph mon.b for 96a8be3c-6e7b-11ee-8db6-212e2dc638e7... 2023-10-19T12:35:15.149 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-10-19T12:35:15.150 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph mon dump -f json 2023-10-19T12:35:15.453 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 podman[134070]: 2023-10-19T12:35:15.454 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: set uid:gid to 167:167 (ceph:ceph) 2023-10-19T12:35:15.454 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: ceph version 18.0.0-6786-gf7420d7f (f7420d7f8e55ceea786dcbf536c338ce920c21eb) reef (dev), process ceph-mon, pid 7 2023-10-19T12:35:15.454 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 bash[134070]: 46dcfd43ad438f2b781946526a43757ce74de11ca9fc95e4584eb27e687984b6 2023-10-19T12:35:15.454 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: pidfile_write: ignore empty --pid-file 2023-10-19T12:35:15.455 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: load: jerasure load: lrc 2023-10-19T12:35:15.455 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: RocksDB version: 7.9.2 2023-10-19T12:35:15.455 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Git sha 0 2023-10-19T12:35:15.455 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Compile date 2023-10-16 22:08:19 2023-10-19T12:35:15.455 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: DB SUMMARY 2023-10-19T12:35:15.456 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: DB Session ID: YE1OD8ORFKT8JM6CV0ML 2023-10-19T12:35:15.456 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: CURRENT file: CURRENT 2023-10-19T12:35:15.456 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: IDENTITY file: IDENTITY 2023-10-19T12:35:15.456 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2023-10-19T12:35:15.456 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2023-10-19T12:35:15.457 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2023-10-19T12:35:15.457 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.error_if_exists: 0 2023-10-19T12:35:15.457 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.create_if_missing: 0 2023-10-19T12:35:15.457 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.paranoid_checks: 1 2023-10-19T12:35:15.458 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.flush_verify_memtable_count: 1 2023-10-19T12:35:15.458 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-10-19T12:35:15.458 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-10-19T12:35:15.458 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.env: 0x55e8bdb68da0 2023-10-19T12:35:15.458 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.fs: PosixFileSystem 2023-10-19T12:35:15.459 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.info_log: 0x55e8bf725660 2023-10-19T12:35:15.459 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.max_file_opening_threads: 16 2023-10-19T12:35:15.459 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.statistics: (nil) 2023-10-19T12:35:15.459 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.use_fsync: 0 2023-10-19T12:35:15.459 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.max_log_file_size: 0 2023-10-19T12:35:15.460 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-10-19T12:35:15.460 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.log_file_time_to_roll: 0 2023-10-19T12:35:15.460 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.keep_log_file_num: 1000 2023-10-19T12:35:15.460 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.recycle_log_file_num: 0 2023-10-19T12:35:15.460 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.allow_fallocate: 1 2023-10-19T12:35:15.461 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.allow_mmap_reads: 0 2023-10-19T12:35:15.461 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.allow_mmap_writes: 0 2023-10-19T12:35:15.461 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.use_direct_reads: 0 2023-10-19T12:35:15.461 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-10-19T12:35:15.461 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.create_missing_column_families: 0 2023-10-19T12:35:15.462 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.db_log_dir: 2023-10-19T12:35:15.462 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.wal_dir: 2023-10-19T12:35:15.462 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.table_cache_numshardbits: 6 2023-10-19T12:35:15.462 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.WAL_ttl_seconds: 0 2023-10-19T12:35:15.462 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.WAL_size_limit_MB: 0 2023-10-19T12:35:15.463 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-10-19T12:35:15.463 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-10-19T12:35:15.463 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.is_fd_close_on_exec: 1 2023-10-19T12:35:15.463 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.advise_random_on_open: 1 2023-10-19T12:35:15.463 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.db_write_buffer_size: 0 2023-10-19T12:35:15.464 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.write_buffer_manager: 0x55e8bf6dd360 2023-10-19T12:35:15.464 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-10-19T12:35:15.464 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-10-19T12:35:15.464 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.use_adaptive_mutex: 0 2023-10-19T12:35:15.464 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.rate_limiter: (nil) 2023-10-19T12:35:15.465 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-10-19T12:35:15.465 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.wal_recovery_mode: 2 2023-10-19T12:35:15.465 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.enable_thread_tracking: 0 2023-10-19T12:35:15.465 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.enable_pipelined_write: 0 2023-10-19T12:35:15.465 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.unordered_write: 0 2023-10-19T12:35:15.465 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-10-19T12:35:15.466 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-10-19T12:35:15.466 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-10-19T12:35:15.466 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-10-19T12:35:15.466 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.row_cache: None 2023-10-19T12:35:15.467 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.wal_filter: None 2023-10-19T12:35:15.467 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-10-19T12:35:15.467 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.allow_ingest_behind: 0 2023-10-19T12:35:15.467 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.two_write_queues: 0 2023-10-19T12:35:15.467 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.manual_wal_flush: 0 2023-10-19T12:35:15.467 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.wal_compression: 0 2023-10-19T12:35:15.468 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.atomic_flush: 0 2023-10-19T12:35:15.468 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-10-19T12:35:15.468 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.persist_stats_to_disk: 0 2023-10-19T12:35:15.468 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.write_dbid_to_manifest: 0 2023-10-19T12:35:15.468 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.log_readahead_size: 0 2023-10-19T12:35:15.469 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-10-19T12:35:15.469 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.best_efforts_recovery: 0 2023-10-19T12:35:15.469 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-10-19T12:35:15.469 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-10-19T12:35:15.471 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.allow_data_in_errors: 0 2023-10-19T12:35:15.471 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.db_host_id: __hostname__ 2023-10-19T12:35:15.471 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.enforce_single_del_contracts: true 2023-10-19T12:35:15.471 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.max_background_jobs: 2 2023-10-19T12:35:15.472 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.max_background_compactions: -1 2023-10-19T12:35:15.472 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.max_subcompactions: 1 2023-10-19T12:35:15.472 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-10-19T12:35:15.472 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-10-19T12:35:15.472 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.delayed_write_rate : 16777216 2023-10-19T12:35:15.473 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.max_total_wal_size: 0 2023-10-19T12:35:15.473 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-10-19T12:35:15.473 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.stats_dump_period_sec: 600 2023-10-19T12:35:15.474 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.stats_persist_period_sec: 600 2023-10-19T12:35:15.474 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-10-19T12:35:15.474 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.max_open_files: -1 2023-10-19T12:35:15.475 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.bytes_per_sync: 0 2023-10-19T12:35:15.475 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.wal_bytes_per_sync: 0 2023-10-19T12:35:15.475 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.strict_bytes_per_sync: 0 2023-10-19T12:35:15.476 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.compaction_readahead_size: 0 2023-10-19T12:35:15.476 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.max_background_flushes: -1 2023-10-19T12:35:15.476 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Compression algorithms supported: 2023-10-19T12:35:15.477 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-10-19T12:35:15.477 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: kZSTD supported: 0 2023-10-19T12:35:15.477 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: kXpressCompression supported: 0 2023-10-19T12:35:15.478 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: kLZ4HCCompression supported: 1 2023-10-19T12:35:15.478 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: kZlibCompression supported: 1 2023-10-19T12:35:15.478 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: kSnappyCompression supported: 1 2023-10-19T12:35:15.479 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: kLZ4Compression supported: 1 2023-10-19T12:35:15.479 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: kBZip2Compression supported: 0 2023-10-19T12:35:15.479 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Fast CRC32 supported: Supported on x86 2023-10-19T12:35:15.480 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: DMutex implementation: pthread_mutex_t 2023-10-19T12:35:15.480 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2023-10-19T12:35:15.480 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-10-19T12:35:15.481 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-10-19T12:35:15.481 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.merge_operator: 2023-10-19T12:35:15.481 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.compaction_filter: None 2023-10-19T12:35:15.482 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.compaction_filter_factory: None 2023-10-19T12:35:15.482 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.sst_partitioner_factory: None 2023-10-19T12:35:15.482 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.memtable_factory: SkipListFactory 2023-10-19T12:35:15.483 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.table_factory: BlockBasedTable 2023-10-19T12:35:15.483 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55e8bf725760) 2023-10-19T12:35:15.483 INFO:journalctl@ceph.mon.b.smithi157.stdout: cache_index_and_filter_blocks: 1 2023-10-19T12:35:15.483 INFO:journalctl@ceph.mon.b.smithi157.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-10-19T12:35:15.484 INFO:journalctl@ceph.mon.b.smithi157.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-10-19T12:35:15.484 INFO:journalctl@ceph.mon.b.smithi157.stdout: pin_top_level_index_and_filter: 1 2023-10-19T12:35:15.484 INFO:journalctl@ceph.mon.b.smithi157.stdout: index_type: 0 2023-10-19T12:35:15.484 INFO:journalctl@ceph.mon.b.smithi157.stdout: data_block_index_type: 0 2023-10-19T12:35:15.485 INFO:journalctl@ceph.mon.b.smithi157.stdout: index_shortening: 1 2023-10-19T12:35:15.485 INFO:journalctl@ceph.mon.b.smithi157.stdout: data_block_hash_table_util_ratio: 0.750000 2023-10-19T12:35:15.485 INFO:journalctl@ceph.mon.b.smithi157.stdout: checksum: 4 2023-10-19T12:35:15.485 INFO:journalctl@ceph.mon.b.smithi157.stdout: no_block_cache: 0 2023-10-19T12:35:15.485 INFO:journalctl@ceph.mon.b.smithi157.stdout: block_cache: 0x55e8bf77b1f0 2023-10-19T12:35:15.486 INFO:journalctl@ceph.mon.b.smithi157.stdout: block_cache_name: BinnedLRUCache 2023-10-19T12:35:15.486 INFO:journalctl@ceph.mon.b.smithi157.stdout: block_cache_options: 2023-10-19T12:35:15.486 INFO:journalctl@ceph.mon.b.smithi157.stdout: capacity : 536870912 2023-10-19T12:35:15.486 INFO:journalctl@ceph.mon.b.smithi157.stdout: num_shard_bits : 4 2023-10-19T12:35:15.487 INFO:journalctl@ceph.mon.b.smithi157.stdout: strict_capacity_limit : 0 2023-10-19T12:35:15.487 INFO:journalctl@ceph.mon.b.smithi157.stdout: high_pri_pool_ratio: 0.000 2023-10-19T12:35:15.487 INFO:journalctl@ceph.mon.b.smithi157.stdout: block_cache_compressed: (nil) 2023-10-19T12:35:15.487 INFO:journalctl@ceph.mon.b.smithi157.stdout: persistent_cache: (nil) 2023-10-19T12:35:15.487 INFO:journalctl@ceph.mon.b.smithi157.stdout: block_size: 4096 2023-10-19T12:35:15.488 INFO:journalctl@ceph.mon.b.smithi157.stdout: block_size_deviation: 10 2023-10-19T12:35:15.488 INFO:journalctl@ceph.mon.b.smithi157.stdout: block_restart_interval: 16 2023-10-19T12:35:15.488 INFO:journalctl@ceph.mon.b.smithi157.stdout: index_block_restart_interval: 1 2023-10-19T12:35:15.488 INFO:journalctl@ceph.mon.b.smithi157.stdout: metadata_block_size: 4096 2023-10-19T12:35:15.488 INFO:journalctl@ceph.mon.b.smithi157.stdout: partition_filters: 0 2023-10-19T12:35:15.489 INFO:journalctl@ceph.mon.b.smithi157.stdout: use_delta_encoding: 1 2023-10-19T12:35:15.489 INFO:journalctl@ceph.mon.b.smithi157.stdout: filter_policy: bloomfilter 2023-10-19T12:35:15.489 INFO:journalctl@ceph.mon.b.smithi157.stdout: whole_key_filtering: 1 2023-10-19T12:35:15.489 INFO:journalctl@ceph.mon.b.smithi157.stdout: verify_compression: 0 2023-10-19T12:35:15.489 INFO:journalctl@ceph.mon.b.smithi157.stdout: read_amp_bytes_per_bit: 0 2023-10-19T12:35:15.490 INFO:journalctl@ceph.mon.b.smithi157.stdout: format_version: 5 2023-10-19T12:35:15.490 INFO:journalctl@ceph.mon.b.smithi157.stdout: enable_index_compression: 1 2023-10-19T12:35:15.490 INFO:journalctl@ceph.mon.b.smithi157.stdout: block_align: 0 2023-10-19T12:35:15.490 INFO:journalctl@ceph.mon.b.smithi157.stdout: max_auto_readahead_size: 262144 2023-10-19T12:35:15.490 INFO:journalctl@ceph.mon.b.smithi157.stdout: prepopulate_block_cache: 0 2023-10-19T12:35:15.491 INFO:journalctl@ceph.mon.b.smithi157.stdout: initial_auto_readahead_size: 8192 2023-10-19T12:35:15.491 INFO:journalctl@ceph.mon.b.smithi157.stdout: num_file_reads_for_auto_readahead: 2 2023-10-19T12:35:15.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.write_buffer_size: 33554432 2023-10-19T12:35:15.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.max_write_buffer_number: 2 2023-10-19T12:35:15.491 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.compression: NoCompression 2023-10-19T12:35:15.492 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.bottommost_compression: Disabled 2023-10-19T12:35:15.492 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.prefix_extractor: nullptr 2023-10-19T12:35:15.492 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-10-19T12:35:15.492 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.num_levels: 7 2023-10-19T12:35:15.493 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-10-19T12:35:15.493 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-10-19T12:35:15.493 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-10-19T12:35:15.493 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-10-19T12:35:15.493 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-10-19T12:35:15.494 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-10-19T12:35:15.494 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-10-19T12:35:15.494 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-10-19T12:35:15.495 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-10-19T12:35:15.495 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-10-19T12:35:15.495 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-10-19T12:35:15.495 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-10-19T12:35:15.495 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.compression_opts.window_bits: -14 2023-10-19T12:35:15.496 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.compression_opts.level: 32767 2023-10-19T12:35:15.496 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.compression_opts.strategy: 0 2023-10-19T12:35:15.496 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-10-19T12:35:15.496 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-10-19T12:35:15.496 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-10-19T12:35:15.497 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-10-19T12:35:15.497 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.compression_opts.enabled: false 2023-10-19T12:35:15.497 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-10-19T12:35:15.497 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-10-19T12:35:15.497 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-10-19T12:35:15.498 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-10-19T12:35:15.498 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.target_file_size_base: 67108864 2023-10-19T12:35:15.498 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.target_file_size_multiplier: 1 2023-10-19T12:35:15.498 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-10-19T12:35:15.498 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-10-19T12:35:15.499 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-10-19T12:35:15.499 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-10-19T12:35:15.499 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-10-19T12:35:15.499 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-10-19T12:35:15.499 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-10-19T12:35:15.500 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-10-19T12:35:15.500 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-10-19T12:35:15.500 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-10-19T12:35:15.500 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-10-19T12:35:15.500 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-10-19T12:35:15.501 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-10-19T12:35:15.501 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.arena_block_size: 1048576 2023-10-19T12:35:15.501 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-10-19T12:35:15.501 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-10-19T12:35:15.501 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.disable_auto_compactions: 0 2023-10-19T12:35:15.501 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-10-19T12:35:15.502 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-10-19T12:35:15.502 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-10-19T12:35:15.502 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-10-19T12:35:15.502 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-10-19T12:35:15.502 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-10-19T12:35:15.503 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-10-19T12:35:15.503 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-10-19T12:35:15.503 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-10-19T12:35:15.503 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-10-19T12:35:15.503 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.table_properties_collectors: 2023-10-19T12:35:15.504 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.inplace_update_support: 0 2023-10-19T12:35:15.504 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.inplace_update_num_locks: 10000 2023-10-19T12:35:15.504 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-10-19T12:35:15.504 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-10-19T12:35:15.504 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.memtable_huge_page_size: 0 2023-10-19T12:35:15.504 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.bloom_locality: 0 2023-10-19T12:35:15.505 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.max_successive_merges: 0 2023-10-19T12:35:15.505 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.optimize_filters_for_hits: 0 2023-10-19T12:35:15.505 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.paranoid_file_checks: 0 2023-10-19T12:35:15.505 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.force_consistency_checks: 1 2023-10-19T12:35:15.505 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.report_bg_io_stats: 0 2023-10-19T12:35:15.505 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.ttl: 2592000 2023-10-19T12:35:15.506 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.periodic_compaction_seconds: 0 2023-10-19T12:35:15.506 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-10-19T12:35:15.506 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-10-19T12:35:15.506 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.enable_blob_files: false 2023-10-19T12:35:15.507 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.min_blob_size: 0 2023-10-19T12:35:15.507 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.blob_file_size: 268435456 2023-10-19T12:35:15.507 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.blob_compression_type: NoCompression 2023-10-19T12:35:15.507 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.enable_blob_garbage_collection: false 2023-10-19T12:35:15.507 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-10-19T12:35:15.508 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-10-19T12:35:15.508 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-10-19T12:35:15.508 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.blob_file_starting_level: 0 2023-10-19T12:35:15.508 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-10-19T12:35:15.508 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-10-19T12:35:15.509 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2023-10-19T12:35:15.509 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: f1fa9cb1-c8c2-4f87-bc0e-a0aa97c98769 2023-10-19T12:35:15.509 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: EVENT_LOG_v1 {"time_micros": 1697718915389018, "job": 1, "event": "recovery_started", "wal_files": [4]} 2023-10-19T12:35:15.509 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2023-10-19T12:35:15.509 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: EVENT_LOG_v1 {"time_micros": 1697718915389415, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1747, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1697718915, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "f1fa9cb1-c8c2-4f87-bc0e-a0aa97c98769", "db_session_id": "YE1OD8ORFKT8JM6CV0ML", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2023-10-19T12:35:15.509 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: EVENT_LOG_v1 {"time_micros": 1697718915389481, "job": 1, "event": "recovery_finished"} 2023-10-19T12:35:15.510 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2023-10-19T12:35:15.510 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-10-19T12:35:15.510 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55e8bf818000 2023-10-19T12:35:15.510 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: DB pointer 0x55e8bf804000 2023-10-19T12:35:15.511 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-10-19T12:35:15.511 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-10-19T12:35:15.511 INFO:journalctl@ceph.mon.b.smithi157.stdout: ** DB Stats ** 2023-10-19T12:35:15.511 INFO:journalctl@ceph.mon.b.smithi157.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-10-19T12:35:15.511 INFO:journalctl@ceph.mon.b.smithi157.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-10-19T12:35:15.511 INFO:journalctl@ceph.mon.b.smithi157.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-10-19T12:35:15.512 INFO:journalctl@ceph.mon.b.smithi157.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-10-19T12:35:15.512 INFO:journalctl@ceph.mon.b.smithi157.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-10-19T12:35:15.512 INFO:journalctl@ceph.mon.b.smithi157.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-10-19T12:35:15.512 INFO:journalctl@ceph.mon.b.smithi157.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-10-19T12:35:15.512 INFO:journalctl@ceph.mon.b.smithi157.stdout: 2023-10-19T12:35:15.512 INFO:journalctl@ceph.mon.b.smithi157.stdout: ** Compaction Stats [default] ** 2023-10-19T12:35:15.513 INFO:journalctl@ceph.mon.b.smithi157.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-10-19T12:35:15.513 INFO:journalctl@ceph.mon.b.smithi157.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-10-19T12:35:15.513 INFO:journalctl@ceph.mon.b.smithi157.stdout: L0 1/0 1.71 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.3 0.00 0.00 1 0.000 0 0 0.0 0.0 2023-10-19T12:35:15.513 INFO:journalctl@ceph.mon.b.smithi157.stdout: Sum 1/0 1.71 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.3 0.00 0.00 1 0.000 0 0 0.0 0.0 2023-10-19T12:35:15.513 INFO:journalctl@ceph.mon.b.smithi157.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.3 0.00 0.00 1 0.000 0 0 0.0 0.0 2023-10-19T12:35:15.514 INFO:journalctl@ceph.mon.b.smithi157.stdout: 2023-10-19T12:35:15.514 INFO:journalctl@ceph.mon.b.smithi157.stdout: ** Compaction Stats [default] ** 2023-10-19T12:35:15.514 INFO:journalctl@ceph.mon.b.smithi157.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-10-19T12:35:15.514 INFO:journalctl@ceph.mon.b.smithi157.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-10-19T12:35:15.515 INFO:journalctl@ceph.mon.b.smithi157.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.3 0.00 0.00 1 0.000 0 0 0.0 0.0 2023-10-19T12:35:15.515 INFO:journalctl@ceph.mon.b.smithi157.stdout: 2023-10-19T12:35:15.515 INFO:journalctl@ceph.mon.b.smithi157.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-10-19T12:35:15.515 INFO:journalctl@ceph.mon.b.smithi157.stdout: 2023-10-19T12:35:15.515 INFO:journalctl@ceph.mon.b.smithi157.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-10-19T12:35:15.516 INFO:journalctl@ceph.mon.b.smithi157.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-10-19T12:35:15.516 INFO:journalctl@ceph.mon.b.smithi157.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-10-19T12:35:15.516 INFO:journalctl@ceph.mon.b.smithi157.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-10-19T12:35:15.516 INFO:journalctl@ceph.mon.b.smithi157.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-10-19T12:35:15.516 INFO:journalctl@ceph.mon.b.smithi157.stdout: AddFile(Keys): cumulative 0, interval 0 2023-10-19T12:35:15.516 INFO:journalctl@ceph.mon.b.smithi157.stdout: Cumulative compaction: 0.00 GB write, 0.69 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-19T12:35:15.517 INFO:journalctl@ceph.mon.b.smithi157.stdout: Interval compaction: 0.00 GB write, 0.69 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-19T12:35:15.517 INFO:journalctl@ceph.mon.b.smithi157.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-10-19T12:35:15.517 INFO:journalctl@ceph.mon.b.smithi157.stdout: Block cache BinnedLRUCache@0x55e8bf77b1f0#7 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2023-10-19T12:35:15.517 INFO:journalctl@ceph.mon.b.smithi157.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2023-10-19T12:35:15.517 INFO:journalctl@ceph.mon.b.smithi157.stdout: 2023-10-19T12:35:15.518 INFO:journalctl@ceph.mon.b.smithi157.stdout: ** File Read Latency Histogram By Level [default] ** 2023-10-19T12:35:15.518 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: mon.b does not exist in monmap, will attempt to join an existing cluster 2023-10-19T12:35:15.518 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: using public_addr v2:172.21.15.157:0/0 -> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2023-10-19T12:35:15.518 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: starting mon.b rank -1 at public addrs [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] at bind addrs [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 2023-10-19T12:35:15.519 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: mon.b@-1(???) e0 preinit fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 2023-10-19T12:35:15.519 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: mon.b@-1(synchronizing).mds e1 new map 2023-10-19T12:35:15.519 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: mon.b@-1(synchronizing).mds e1 print_map 2023-10-19T12:35:15.519 INFO:journalctl@ceph.mon.b.smithi157.stdout: e1 2023-10-19T12:35:15.519 INFO:journalctl@ceph.mon.b.smithi157.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-10-19T12:35:15.519 INFO:journalctl@ceph.mon.b.smithi157.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-10-19T12:35:15.520 INFO:journalctl@ceph.mon.b.smithi157.stdout: legacy client fscid: -1 2023-10-19T12:35:15.520 INFO:journalctl@ceph.mon.b.smithi157.stdout: 2023-10-19T12:35:15.520 INFO:journalctl@ceph.mon.b.smithi157.stdout: No filesystems configured 2023-10-19T12:35:15.520 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2023-10-19T12:35:15.520 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2023-10-19T12:35:15.521 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2023-10-19T12:35:15.521 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2023-10-19T12:35:15.521 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2023-10-19T12:35:15.521 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2023-10-19T12:35:15.521 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2023-10-19T12:35:15.522 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-10-19T12:35:15.522 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-10-19T12:35:15.522 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-10-19T12:35:15.522 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:15.522 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:15.523 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-19T12:35:15.523 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:15.523 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:15.523 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:15.523 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:15.523 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:15.524 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi157", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:35:15.524 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:35:15.524 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:35:15.524 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: Updating smithi157:/etc/ceph/ceph.conf 2023-10-19T12:35:15.524 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: Updating smithi157:/var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/config/ceph.conf 2023-10-19T12:35:15.524 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: Updating smithi157:/etc/ceph/ceph.client.admin.keyring 2023-10-19T12:35:15.525 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:15.525 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: Updating smithi157:/var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-19T12:35:15.525 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi195", "target": ["mon-mgr", ""]}]: dispatch 2023-10-19T12:35:15.525 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:15.525 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:15.526 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:15.526 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: Deploying cephadm binary to smithi195 2023-10-19T12:35:15.526 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:15.526 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:15.526 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: Added host smithi195 2023-10-19T12:35:15.527 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:35:15.527 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:15.527 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:15.527 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:15.527 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:15.528 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-19T12:35:15.528 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:15.528 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:15.528 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:15.528 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:15.528 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:15.529 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi195", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:35:15.529 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:35:15.529 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:35:15.529 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: Updating smithi195:/etc/ceph/ceph.conf 2023-10-19T12:35:15.529 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: Updating smithi195:/var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/config/ceph.conf 2023-10-19T12:35:15.529 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:15.530 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: Updating smithi195:/etc/ceph/ceph.client.admin.keyring 2023-10-19T12:35:15.530 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/646194624' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-10-19T12:35:15.530 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:15.530 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:15.530 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:15.531 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: Updating smithi195:/var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-19T12:35:15.531 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/646194624' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-10-19T12:35:15.531 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: osdmap e4: 0 total, 0 up, 0 in 2023-10-19T12:35:15.531 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:15.531 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi046:172.21.15.46=a;smithi157:172.21.15.157=b;smithi195:172.21.15.195=c", "target": ["mon-mgr", ""]}]: dispatch 2023-10-19T12:35:15.532 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: Saving service mon spec with placement smithi046:172.21.15.46=a;smithi157:172.21.15.157=b;smithi195:172.21.15.195=c;count:3 2023-10-19T12:35:15.532 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:15.532 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:35:15.532 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:35:15.532 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:35:15.532 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:15.533 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-19T12:35:15.533 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:35:15.533 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: Deploying daemon mon.c on smithi195 2023-10-19T12:35:15.533 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:15.533 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-19T12:35:15.533 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-19T12:35:15.534 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: mon.a calling monitor election 2023-10-19T12:35:15.534 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-19T12:35:15.534 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:15.534 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-19T12:35:15.534 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: mon.c calling monitor election 2023-10-19T12:35:15.535 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-19T12:35:15.535 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:15.535 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-19T12:35:15.535 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-19T12:35:15.535 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-10-19T12:35:15.535 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: monmap e2: 2 mons at {a=[v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0],c=[v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-10-19T12:35:15.536 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: fsmap 2023-10-19T12:35:15.536 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: osdmap e4: 0 total, 0 up, 0 in 2023-10-19T12:35:15.536 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: mgrmap e13: x(active, since 45s) 2023-10-19T12:35:15.536 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: overall HEALTH_OK 2023-10-19T12:35:15.536 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:15.536 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:15.537 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:15.537 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-19T12:35:15.537 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:35:15.537 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: Deploying daemon mon.b on smithi157 2023-10-19T12:35:15.537 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:15.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-19T12:35:15.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: from='client.? 172.21.15.195:0/519544361' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-19T12:35:15.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 ceph-mon[134109]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2023-10-19T12:35:15.538 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:15 smithi157 systemd[1]: Started Ceph mon.b for 96a8be3c-6e7b-11ee-8db6-212e2dc638e7. 2023-10-19T12:35:15.718 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.c/config 2023-10-19T12:35:20.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:20 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-19T12:35:20.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:20 smithi046 ceph-mon[98509]: mon.c calling monitor election 2023-10-19T12:35:20.730 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:20 smithi046 ceph-mon[98509]: mon.a calling monitor election 2023-10-19T12:35:20.730 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:20 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-19T12:35:20.730 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:20 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-19T12:35:20.730 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:20 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-19T12:35:20.730 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:20 smithi046 ceph-mon[98509]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:20.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:20 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-19T12:35:20.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:20 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-19T12:35:20.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:20 smithi046 ceph-mon[98509]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:20.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:20 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-19T12:35:20.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:20 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-19T12:35:20.732 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:20 smithi046 ceph-mon[98509]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-10-19T12:35:20.732 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:20 smithi046 ceph-mon[98509]: monmap e3: 3 mons at {a=[v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0],b=[v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0],c=[v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-10-19T12:35:20.732 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:20 smithi046 ceph-mon[98509]: fsmap 2023-10-19T12:35:20.732 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:20 smithi046 ceph-mon[98509]: osdmap e4: 0 total, 0 up, 0 in 2023-10-19T12:35:20.732 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:20 smithi046 ceph-mon[98509]: mgrmap e13: x(active, since 53s) 2023-10-19T12:35:20.733 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:20 smithi046 ceph-mon[98509]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2023-10-19T12:35:20.733 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:20 smithi046 ceph-mon[98509]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2023-10-19T12:35:20.733 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:20 smithi046 ceph-mon[98509]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2023-10-19T12:35:20.733 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:20 smithi046 ceph-mon[98509]: mon.b (rank 2) addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] is down (out of quorum) 2023-10-19T12:35:20.733 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:20 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:20.734 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:20 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:20.734 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:20 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:20.734 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:20 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:20.832 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-10-19T12:35:20.832 INFO:teuthology.orchestra.run.smithi195.stdout:{"epoch":3,"fsid":"96a8be3c-6e7b-11ee-8db6-212e2dc638e7","modified":"2023-10-19T12:35:15.412852Z","created":"2023-10-19T12:33:22.688296Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:3300","nonce":0},{"type":"v1","addr":"172.21.15.195:6789","nonce":0}]},"addr":"172.21.15.195:6789/0","public_addr":"172.21.15.195:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2023-10-19T12:35:20.834 INFO:teuthology.orchestra.run.smithi195.stderr:dumped monmap epoch 3 2023-10-19T12:35:20.860 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:20 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-19T12:35:20.860 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:20 smithi195 ceph-mon[134493]: mon.c calling monitor election 2023-10-19T12:35:20.861 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:20 smithi195 ceph-mon[134493]: mon.a calling monitor election 2023-10-19T12:35:20.861 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:20 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-19T12:35:20.861 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:20 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-19T12:35:20.861 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:20 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-19T12:35:20.861 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:20 smithi195 ceph-mon[134493]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:20.862 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:20 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-19T12:35:20.862 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:20 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-19T12:35:20.862 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:20 smithi195 ceph-mon[134493]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:20.862 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:20 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-19T12:35:20.862 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:20 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-19T12:35:20.863 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:20 smithi195 ceph-mon[134493]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-10-19T12:35:20.863 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:20 smithi195 ceph-mon[134493]: monmap e3: 3 mons at {a=[v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0],b=[v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0],c=[v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-10-19T12:35:20.863 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:20 smithi195 ceph-mon[134493]: fsmap 2023-10-19T12:35:20.863 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:20 smithi195 ceph-mon[134493]: osdmap e4: 0 total, 0 up, 0 in 2023-10-19T12:35:20.863 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:20 smithi195 ceph-mon[134493]: mgrmap e13: x(active, since 53s) 2023-10-19T12:35:20.864 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:20 smithi195 ceph-mon[134493]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2023-10-19T12:35:20.864 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:20 smithi195 ceph-mon[134493]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2023-10-19T12:35:20.864 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:20 smithi195 ceph-mon[134493]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2023-10-19T12:35:20.864 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:20 smithi195 ceph-mon[134493]: mon.b (rank 2) addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] is down (out of quorum) 2023-10-19T12:35:20.864 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:20 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:20.865 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:20 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:20.865 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:20 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:20.865 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:20 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:21.167 INFO:tasks.cephadm:Generating final ceph.conf file... 2023-10-19T12:35:21.167 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph config generate-minimal-conf 2023-10-19T12:35:21.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:21 smithi046 ceph-mon[98509]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:21.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:21 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:35:21.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:21 smithi046 ceph-mon[98509]: from='client.? 172.21.15.195:0/933502180' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-19T12:35:21.730 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:21 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-19T12:35:21.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:21 smithi195 ceph-mon[134493]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:21.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:21 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:35:21.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:21 smithi195 ceph-mon[134493]: from='client.? 172.21.15.195:0/933502180' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-19T12:35:21.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:21 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-19T12:35:21.927 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-19T12:35:22.838 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:22 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-19T12:35:22.838 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:22 smithi157 ceph-mon[134109]: mon.c calling monitor election 2023-10-19T12:35:22.838 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:22 smithi157 ceph-mon[134109]: mon.a calling monitor election 2023-10-19T12:35:22.839 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:22 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-19T12:35:22.839 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:22 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-19T12:35:22.839 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:22 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-19T12:35:22.839 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:22 smithi157 ceph-mon[134109]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:22.839 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:22 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-19T12:35:22.840 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:22 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-19T12:35:22.840 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:22 smithi157 ceph-mon[134109]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:22.840 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:22 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-19T12:35:22.840 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:22 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-19T12:35:22.840 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:22 smithi157 ceph-mon[134109]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-10-19T12:35:22.841 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:22 smithi157 ceph-mon[134109]: monmap e3: 3 mons at {a=[v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0],b=[v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0],c=[v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-10-19T12:35:22.841 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:22 smithi157 ceph-mon[134109]: fsmap 2023-10-19T12:35:22.841 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:22 smithi157 ceph-mon[134109]: osdmap e4: 0 total, 0 up, 0 in 2023-10-19T12:35:22.841 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:22 smithi157 ceph-mon[134109]: mgrmap e13: x(active, since 53s) 2023-10-19T12:35:22.841 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:22 smithi157 ceph-mon[134109]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2023-10-19T12:35:22.842 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:22 smithi157 ceph-mon[134109]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2023-10-19T12:35:22.842 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:22 smithi157 ceph-mon[134109]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2023-10-19T12:35:22.842 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:22 smithi157 ceph-mon[134109]: mon.b (rank 2) addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] is down (out of quorum) 2023-10-19T12:35:22.843 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:22 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:22.843 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:22 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:22.843 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:22 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:22.843 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:22 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:22.843 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:22 smithi157 ceph-mon[134109]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:22.844 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:22 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:35:22.844 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:22 smithi157 ceph-mon[134109]: from='client.? 172.21.15.195:0/933502180' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-19T12:35:22.844 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:22 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-19T12:35:23.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:23 smithi046 ceph-mon[98509]: mon.b calling monitor election 2023-10-19T12:35:23.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:23 smithi046 ceph-mon[98509]: Updating smithi046:/etc/ceph/ceph.conf 2023-10-19T12:35:23.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:23 smithi046 ceph-mon[98509]: Updating smithi157:/etc/ceph/ceph.conf 2023-10-19T12:35:23.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:23 smithi046 ceph-mon[98509]: Updating smithi195:/etc/ceph/ceph.conf 2023-10-19T12:35:23.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:23 smithi046 ceph-mon[98509]: Updating smithi157:/var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/config/ceph.conf 2023-10-19T12:35:23.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:23 smithi046 ceph-mon[98509]: Updating smithi195:/var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/config/ceph.conf 2023-10-19T12:35:23.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:23 smithi046 ceph-mon[98509]: mon.b calling monitor election 2023-10-19T12:35:23.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:23 smithi046 ceph-mon[98509]: mon.c calling monitor election 2023-10-19T12:35:23.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:23 smithi046 ceph-mon[98509]: mon.a calling monitor election 2023-10-19T12:35:23.482 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:23 smithi046 ceph-mon[98509]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-10-19T12:35:23.482 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:23 smithi046 ceph-mon[98509]: monmap e3: 3 mons at {a=[v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0],b=[v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0],c=[v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-10-19T12:35:23.482 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:23 smithi046 ceph-mon[98509]: fsmap 2023-10-19T12:35:23.483 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:23 smithi046 ceph-mon[98509]: osdmap e4: 0 total, 0 up, 0 in 2023-10-19T12:35:23.483 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:23 smithi046 ceph-mon[98509]: mgrmap e13: x(active, since 55s) 2023-10-19T12:35:23.483 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:23 smithi046 ceph-mon[98509]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2023-10-19T12:35:23.484 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:23 smithi046 ceph-mon[98509]: Cluster is now healthy 2023-10-19T12:35:23.484 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:23 smithi046 ceph-mon[98509]: overall HEALTH_OK 2023-10-19T12:35:23.484 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:23 smithi046 ceph-mon[98509]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:23.485 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:23 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:23.485 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:23 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:23.485 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:23 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:23.486 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:23 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:23.486 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:23 smithi046 ceph-mon[98509]: Updating smithi046:/var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/config/ceph.conf 2023-10-19T12:35:23.487 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:23 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:23.487 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:23 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:23.487 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:23 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:23.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:23 smithi157 ceph-mon[134109]: mon.b calling monitor election 2023-10-19T12:35:23.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:23 smithi157 ceph-mon[134109]: Updating smithi046:/etc/ceph/ceph.conf 2023-10-19T12:35:23.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:23 smithi157 ceph-mon[134109]: Updating smithi157:/etc/ceph/ceph.conf 2023-10-19T12:35:23.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:23 smithi157 ceph-mon[134109]: Updating smithi195:/etc/ceph/ceph.conf 2023-10-19T12:35:23.589 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:23 smithi157 ceph-mon[134109]: Updating smithi157:/var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/config/ceph.conf 2023-10-19T12:35:23.589 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:23 smithi157 ceph-mon[134109]: Updating smithi195:/var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/config/ceph.conf 2023-10-19T12:35:23.589 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:23 smithi157 ceph-mon[134109]: mon.b calling monitor election 2023-10-19T12:35:23.589 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:23 smithi157 ceph-mon[134109]: mon.c calling monitor election 2023-10-19T12:35:23.589 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:23 smithi157 ceph-mon[134109]: mon.a calling monitor election 2023-10-19T12:35:23.590 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:23 smithi157 ceph-mon[134109]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-10-19T12:35:23.590 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:23 smithi157 ceph-mon[134109]: monmap e3: 3 mons at {a=[v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0],b=[v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0],c=[v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-10-19T12:35:23.590 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:23 smithi157 ceph-mon[134109]: fsmap 2023-10-19T12:35:23.590 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:23 smithi157 ceph-mon[134109]: osdmap e4: 0 total, 0 up, 0 in 2023-10-19T12:35:23.591 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:23 smithi157 ceph-mon[134109]: mgrmap e13: x(active, since 55s) 2023-10-19T12:35:23.591 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:23 smithi157 ceph-mon[134109]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2023-10-19T12:35:23.591 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:23 smithi157 ceph-mon[134109]: Cluster is now healthy 2023-10-19T12:35:23.591 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:23 smithi157 ceph-mon[134109]: overall HEALTH_OK 2023-10-19T12:35:23.591 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:23 smithi157 ceph-mon[134109]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:23.591 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:23 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:23.592 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:23 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:23.592 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:23 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:23.592 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:23 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:23.592 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:23 smithi157 ceph-mon[134109]: Updating smithi046:/var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/config/ceph.conf 2023-10-19T12:35:23.592 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:23 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:23.593 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:23 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:23.593 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:23 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:23.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:23 smithi195 ceph-mon[134493]: mon.b calling monitor election 2023-10-19T12:35:23.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:23 smithi195 ceph-mon[134493]: Updating smithi046:/etc/ceph/ceph.conf 2023-10-19T12:35:23.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:23 smithi195 ceph-mon[134493]: Updating smithi157:/etc/ceph/ceph.conf 2023-10-19T12:35:23.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:23 smithi195 ceph-mon[134493]: Updating smithi195:/etc/ceph/ceph.conf 2023-10-19T12:35:23.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:23 smithi195 ceph-mon[134493]: Updating smithi157:/var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/config/ceph.conf 2023-10-19T12:35:23.632 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:23 smithi195 ceph-mon[134493]: Updating smithi195:/var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/config/ceph.conf 2023-10-19T12:35:23.632 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:23 smithi195 ceph-mon[134493]: mon.b calling monitor election 2023-10-19T12:35:23.632 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:23 smithi195 ceph-mon[134493]: mon.c calling monitor election 2023-10-19T12:35:23.632 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:23 smithi195 ceph-mon[134493]: mon.a calling monitor election 2023-10-19T12:35:23.632 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:23 smithi195 ceph-mon[134493]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-10-19T12:35:23.633 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:23 smithi195 ceph-mon[134493]: monmap e3: 3 mons at {a=[v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0],b=[v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0],c=[v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-10-19T12:35:23.633 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:23 smithi195 ceph-mon[134493]: fsmap 2023-10-19T12:35:23.633 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:23 smithi195 ceph-mon[134493]: osdmap e4: 0 total, 0 up, 0 in 2023-10-19T12:35:23.633 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:23 smithi195 ceph-mon[134493]: mgrmap e13: x(active, since 55s) 2023-10-19T12:35:23.633 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:23 smithi195 ceph-mon[134493]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2023-10-19T12:35:23.634 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:23 smithi195 ceph-mon[134493]: Cluster is now healthy 2023-10-19T12:35:23.634 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:23 smithi195 ceph-mon[134493]: overall HEALTH_OK 2023-10-19T12:35:23.634 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:23 smithi195 ceph-mon[134493]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:23.634 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:23 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:23.634 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:23 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:23.635 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:23 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:23.635 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:23 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:23.635 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:23 smithi195 ceph-mon[134493]: Updating smithi046:/var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/config/ceph.conf 2023-10-19T12:35:23.635 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:23 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:23.635 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:23 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:23.635 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:23 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:23.667 INFO:teuthology.orchestra.run.smithi046.stdout:# minimal ceph.conf for 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 2023-10-19T12:35:23.667 INFO:teuthology.orchestra.run.smithi046.stdout:[global] 2023-10-19T12:35:23.668 INFO:teuthology.orchestra.run.smithi046.stdout: fsid = 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 2023-10-19T12:35:23.668 INFO:teuthology.orchestra.run.smithi046.stdout: mon_host = [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] 2023-10-19T12:35:24.119 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2023-10-19T12:35:24.120 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-10-19T12:35:24.120 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/etc/ceph/ceph.conf 2023-10-19T12:35:24.194 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-10-19T12:35:24.195 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-10-19T12:35:24.312 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-10-19T12:35:24.312 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/ceph/ceph.conf 2023-10-19T12:35:24.350 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-10-19T12:35:24.351 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-10-19T12:35:24.422 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2023-10-19T12:35:24.422 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/etc/ceph/ceph.conf 2023-10-19T12:35:24.459 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2023-10-19T12:35:24.459 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-10-19T12:35:24.464 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:24 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-19T12:35:24.464 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:24 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:24.464 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:24 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:24.464 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:24 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:24.464 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:24 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:24.465 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:24 smithi046 ceph-mon[98509]: Reconfiguring mon.a (unknown last config time)... 2023-10-19T12:35:24.465 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:24 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-19T12:35:24.465 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:24 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-19T12:35:24.465 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:24 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:35:24.465 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:24 smithi046 ceph-mon[98509]: Reconfiguring daemon mon.a on smithi046 2023-10-19T12:35:24.466 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:24 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/519516037' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:35:24.525 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:24 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-19T12:35:24.525 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:24 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:24.526 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:24 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:24.526 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:24 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:24.526 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:24 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:24.526 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:24 smithi195 ceph-mon[134493]: Reconfiguring mon.a (unknown last config time)... 2023-10-19T12:35:24.526 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:24 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-19T12:35:24.527 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:24 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-19T12:35:24.527 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:24 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:35:24.527 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:24 smithi195 ceph-mon[134493]: Reconfiguring daemon mon.a on smithi046 2023-10-19T12:35:24.527 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:24 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/519516037' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:35:24.529 INFO:tasks.cephadm:Adding mgr.x on smithi046 2023-10-19T12:35:24.529 INFO:tasks.cephadm:Adding mgr.y on smithi157 2023-10-19T12:35:24.530 INFO:tasks.cephadm:Adding mgr.z on smithi195 2023-10-19T12:35:24.530 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph orch apply mgr '3;smithi046=x;smithi157=y;smithi195=z' 2023-10-19T12:35:24.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:24 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-19T12:35:24.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:24 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:24.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:24 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:24.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:24 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:24.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:24 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:24.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:24 smithi157 ceph-mon[134109]: Reconfiguring mon.a (unknown last config time)... 2023-10-19T12:35:24.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:24 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-19T12:35:24.589 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:24 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-19T12:35:24.589 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:24 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:35:24.589 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:24 smithi157 ceph-mon[134109]: Reconfiguring daemon mon.a on smithi046 2023-10-19T12:35:24.589 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:24 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/519516037' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:35:25.130 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.c/config 2023-10-19T12:35:25.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:25 smithi046 ceph-mon[98509]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:25.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:25 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:25.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:25 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:25.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:25 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-19T12:35:25.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:25 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-19T12:35:25.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:25 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:35:25.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:25 smithi157 ceph-mon[134109]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:25.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:25 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:25.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:25 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:25.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:25 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-19T12:35:25.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:25 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-19T12:35:25.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:25 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:35:25.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:25 smithi195 ceph-mon[134493]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:25.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:25 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:25.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:25 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:25.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:25 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-19T12:35:25.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:25 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-19T12:35:25.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:25 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:35:26.332 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:26 smithi195 ceph-mon[134493]: Reconfiguring mon.b (monmap changed)... 2023-10-19T12:35:26.333 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:26 smithi195 ceph-mon[134493]: Reconfiguring daemon mon.b on smithi157 2023-10-19T12:35:26.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:26 smithi157 ceph-mon[134109]: Reconfiguring mon.b (monmap changed)... 2023-10-19T12:35:26.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:26 smithi157 ceph-mon[134109]: Reconfiguring daemon mon.b on smithi157 2023-10-19T12:35:26.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:26 smithi046 ceph-mon[98509]: Reconfiguring mon.b (monmap changed)... 2023-10-19T12:35:26.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:26 smithi046 ceph-mon[98509]: Reconfiguring daemon mon.b on smithi157 2023-10-19T12:35:26.780 INFO:teuthology.orchestra.run.smithi195.stdout:Scheduled mgr update... 2023-10-19T12:35:27.286 DEBUG:teuthology.orchestra.run.smithi157:mgr.y> sudo journalctl -f -n 0 -u ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@mgr.y.service 2023-10-19T12:35:27.289 DEBUG:teuthology.orchestra.run.smithi195:mgr.z> sudo journalctl -f -n 0 -u ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@mgr.z.service 2023-10-19T12:35:27.291 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2023-10-19T12:35:27.291 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph config set client client_mount_timeout 600 2023-10-19T12:35:27.296 INFO:tasks.cephadm:setting config [client] debug_client = 20 2023-10-19T12:35:27.297 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph config set client debug_client 20 2023-10-19T12:35:27.321 INFO:journalctl@ceph.mgr.z.smithi195.stdout:-- Logs begin at Thu 2023-10-19 12:10:53 UTC. -- 2023-10-19T12:35:27.323 INFO:journalctl@ceph.mgr.y.smithi157.stdout:-- Logs begin at Thu 2023-10-19 12:11:40 UTC. -- 2023-10-19T12:35:27.343 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2023-10-19T12:35:27.343 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph config set client debug_ms 1 2023-10-19T12:35:27.389 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2023-10-19T12:35:27.389 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph config set client rados_mon_op_timeout 900 2023-10-19T12:35:27.400 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:27 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:27.401 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:27 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:27.401 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:27 smithi195 ceph-mon[134493]: Reconfiguring mon.c (monmap changed)... 2023-10-19T12:35:27.401 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:27 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-19T12:35:27.401 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:27 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-19T12:35:27.402 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:27 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:35:27.402 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:27 smithi195 ceph-mon[134493]: Reconfiguring daemon mon.c on smithi195 2023-10-19T12:35:27.402 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:27 smithi195 ceph-mon[134493]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:27.402 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:27 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:27.434 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2023-10-19T12:35:27.434 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph config set client rados_osd_op_timeout 900 2023-10-19T12:35:27.480 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2023-10-19T12:35:27.481 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph config set mds debug_mds 20 2023-10-19T12:35:27.528 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2023-10-19T12:35:27.528 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph config set mds debug_mds_balancer 20 2023-10-19T12:35:27.576 INFO:tasks.cephadm:setting config [mds] debug_ms = 1 2023-10-19T12:35:27.577 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph config set mds debug_ms 1 2023-10-19T12:35:27.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:27 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:27.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:27 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:27.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:27 smithi157 ceph-mon[134109]: Reconfiguring mon.c (monmap changed)... 2023-10-19T12:35:27.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:27 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-19T12:35:27.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:27 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-19T12:35:27.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:27 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:35:27.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:27 smithi157 ceph-mon[134109]: Reconfiguring daemon mon.c on smithi195 2023-10-19T12:35:27.589 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:27 smithi157 ceph-mon[134109]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:27.589 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:27 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:27.614 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:27 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:27.614 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:27 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:27.614 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:27 smithi046 ceph-mon[98509]: Reconfiguring mon.c (monmap changed)... 2023-10-19T12:35:27.617 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:27 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-19T12:35:27.617 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:27 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-19T12:35:27.618 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:27 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:35:27.618 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:27 smithi046 ceph-mon[98509]: Reconfiguring daemon mon.c on smithi195 2023-10-19T12:35:27.618 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:27 smithi046 ceph-mon[98509]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:27.618 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:27 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:27.620 INFO:tasks.cephadm:setting config [mds] mds_bal_fragment_size_max = 10000 2023-10-19T12:35:27.621 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph config set mds mds_bal_fragment_size_max 10000 2023-10-19T12:35:27.675 INFO:tasks.cephadm:setting config [mds] mds_bal_merge_size = 5 2023-10-19T12:35:27.675 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph config set mds mds_bal_merge_size 5 2023-10-19T12:35:27.733 INFO:tasks.cephadm:setting config [mds] mds_bal_split_bits = 3 2023-10-19T12:35:27.733 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph config set mds mds_bal_split_bits 3 2023-10-19T12:35:27.782 INFO:tasks.cephadm:setting config [mds] mds_bal_split_size = 100 2023-10-19T12:35:27.782 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph config set mds mds_bal_split_size 100 2023-10-19T12:35:27.842 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2023-10-19T12:35:27.843 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph config set mds mds_debug_frag True 2023-10-19T12:35:27.896 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2023-10-19T12:35:27.897 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph config set mds mds_debug_scatterstat True 2023-10-19T12:35:27.957 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2023-10-19T12:35:27.958 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph config set mds mds_op_complaint_time 180 2023-10-19T12:35:28.011 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2023-10-19T12:35:28.012 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph config set mds mds_verify_scatter True 2023-10-19T12:35:28.066 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2023-10-19T12:35:28.066 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph config set mds osd_op_complaint_time 180 2023-10-19T12:35:28.118 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2023-10-19T12:35:28.119 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph config set mds rados_mon_op_timeout 900 2023-10-19T12:35:28.174 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2023-10-19T12:35:28.174 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph config set mds rados_osd_op_timeout 900 2023-10-19T12:35:28.238 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2023-10-19T12:35:28.239 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph config set mon mon_op_complaint_time 120 2023-10-19T12:35:28.301 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2023-10-19T12:35:28.301 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph config set osd osd_op_complaint_time 180 2023-10-19T12:35:28.366 DEBUG:tasks.cephadm:set 21 configs 2023-10-19T12:35:28.367 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '96a8be3c-6e7b-11ee-8db6-212e2dc638e7', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi046') 2023-10-19T12:35:28.681 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-19T12:35:28.704 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:28 smithi046 ceph-mon[98509]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi046=x;smithi157=y;smithi195=z", "target": ["mon-mgr", ""]}]: dispatch 2023-10-19T12:35:28.705 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:28 smithi046 ceph-mon[98509]: Saving service mgr spec with placement smithi046=x;smithi157=y;smithi195=z;count:3 2023-10-19T12:35:28.705 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:28 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:28.705 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:28 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:28.705 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:28 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:35:28.705 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:28 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:35:28.706 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:28 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:35:28.706 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:28 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:28.706 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:28 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-19T12:35:28.706 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:28 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-10-19T12:35:28.707 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:28 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-19T12:35:28.707 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:28 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:35:28.732 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-19T12:35:28.915 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-19T12:35:28.996 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:28 smithi195 ceph-mon[134493]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi046=x;smithi157=y;smithi195=z", "target": ["mon-mgr", ""]}]: dispatch 2023-10-19T12:35:28.996 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:28 smithi195 ceph-mon[134493]: Saving service mgr spec with placement smithi046=x;smithi157=y;smithi195=z;count:3 2023-10-19T12:35:28.996 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:28 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:28.996 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:28 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:28.997 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:28 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:35:28.997 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:28 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:35:28.997 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:28 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:35:28.997 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:28 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:28.998 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:28 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-19T12:35:28.998 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:28 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-10-19T12:35:28.998 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:28 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-19T12:35:28.998 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:28 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:35:29.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:28 smithi157 ceph-mon[134109]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi046=x;smithi157=y;smithi195=z", "target": ["mon-mgr", ""]}]: dispatch 2023-10-19T12:35:29.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:28 smithi157 ceph-mon[134109]: Saving service mgr spec with placement smithi046=x;smithi157=y;smithi195=z;count:3 2023-10-19T12:35:29.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:28 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:29.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:28 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:29.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:28 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:35:29.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:28 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:35:29.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:28 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:35:29.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:28 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:29.090 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:28 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-19T12:35:29.090 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:28 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-10-19T12:35:29.090 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:28 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-19T12:35:29.090 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:28 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:35:29.105 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-19T12:35:29.317 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-19T12:35:29.380 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Oct 19 12:35:29 smithi195 systemd[1]: Starting Ceph mgr.z for 96a8be3c-6e7b-11ee-8db6-212e2dc638e7... 2023-10-19T12:35:29.413 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-19T12:35:29.803 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:29 smithi195 ceph-mon[134493]: Deploying daemon mgr.z on smithi195 2023-10-19T12:35:29.803 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:29 smithi195 ceph-mon[134493]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:29.803 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Oct 19 12:35:29 smithi195 podman[136341]: 2023-10-19T12:35:29.804 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Oct 19 12:35:29 smithi195 bash[136341]: 4993a77183c98bf16aee5bf5e3820216706061a21c501f5470f8ef3e3bd338d0 2023-10-19T12:35:29.962 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:29 smithi046 ceph-mon[98509]: Deploying daemon mgr.z on smithi195 2023-10-19T12:35:29.963 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:29 smithi046 ceph-mon[98509]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:30.063 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-19T12:35:30.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:29 smithi157 ceph-mon[134109]: Deploying daemon mgr.z on smithi195 2023-10-19T12:35:30.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:29 smithi157 ceph-mon[134109]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:30.124 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-19T12:35:30.130 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Oct 19 12:35:29 smithi195 systemd[1]: Started Ceph mgr.z for 96a8be3c-6e7b-11ee-8db6-212e2dc638e7. 2023-10-19T12:35:30.130 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Oct 19 12:35:29 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-z[136357]: 2023-10-19T12:35:29.872+0000 7fa45bc0d200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-19T12:35:30.131 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Oct 19 12:35:29 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-z[136357]: 2023-10-19T12:35:29.953+0000 7fa45bc0d200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-19T12:35:30.131 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Oct 19 12:35:30 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-z[136357]: 2023-10-19T12:35:30.040+0000 7fa45bc0d200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-19T12:35:30.630 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Oct 19 12:35:30 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-z[136357]: 2023-10-19T12:35:30.133+0000 7fa45bc0d200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-19T12:35:30.630 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Oct 19 12:35:30 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-z[136357]: 2023-10-19T12:35:30.303+0000 7fa45bc0d200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-19T12:35:30.959 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:30 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:30.959 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:30 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:30.959 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:30 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:30.959 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:30 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-19T12:35:30.960 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:30 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-10-19T12:35:30.960 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:30 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-19T12:35:30.960 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:30 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:35:30.960 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:30 smithi046 ceph-mon[98509]: Deploying daemon mgr.y on smithi157 2023-10-19T12:35:30.961 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:30 smithi046 ceph-mon[98509]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:30.982 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:30 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:30.982 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:30 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:30.982 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:30 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:30.983 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:30 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-19T12:35:30.983 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:30 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-10-19T12:35:30.983 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:30 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-19T12:35:30.983 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:30 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:35:30.983 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:30 smithi195 ceph-mon[134493]: Deploying daemon mgr.y on smithi157 2023-10-19T12:35:30.984 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:30 smithi195 ceph-mon[134493]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:30.984 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Oct 19 12:35:30 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-z[136357]: 2023-10-19T12:35:30.667+0000 7fa45bc0d200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-19T12:35:30.984 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Oct 19 12:35:30 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-z[136357]: 2023-10-19T12:35:30.796+0000 7fa45bc0d200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-19T12:35:30.984 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Oct 19 12:35:30 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-z[136357]: 2023-10-19T12:35:30.884+0000 7fa45bc0d200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-19T12:35:30.985 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Oct 19 12:35:30 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-z[136357]: 2023-10-19T12:35:30.978+0000 7fa45bc0d200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-19T12:35:31.092 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:30 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:31.093 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:30 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:31.093 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:30 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:31.093 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:30 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-19T12:35:31.093 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:30 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-10-19T12:35:31.093 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:30 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-19T12:35:31.094 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:30 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:35:31.094 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:30 smithi157 ceph-mon[134109]: Deploying daemon mgr.y on smithi157 2023-10-19T12:35:31.094 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:30 smithi157 ceph-mon[134109]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:31.175 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-19T12:35:31.720 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-19T12:35:31.725 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-19T12:35:31.728 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-19T12:35:31.735 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-19T12:35:31.756 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 19 12:35:31 smithi157 systemd[1]: Starting Ceph mgr.y for 96a8be3c-6e7b-11ee-8db6-212e2dc638e7... 2023-10-19T12:35:31.880 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Oct 19 12:35:31 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-z[136357]: 2023-10-19T12:35:31.398+0000 7fa45bc0d200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-19T12:35:32.007 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 19 12:35:31 smithi157 podman[135277]: 2023-10-19T12:35:32.307 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 19 12:35:32 smithi157 bash[135277]: eaec17f64043f0c0d2ecd99aef725610b6b9caf45362c1f98ab47d3e6340740e 2023-10-19T12:35:32.307 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 19 12:35:32 smithi157 ceph-mgr[135317]: -- 172.21.15.157:0/2995647445 <== mon.2 v2:172.21.15.157:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55eaff95d1e0 con 0x55eaff932c00 2023-10-19T12:35:32.308 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 19 12:35:32 smithi157 systemd[1]: Started Ceph mgr.y for 96a8be3c-6e7b-11ee-8db6-212e2dc638e7. 2023-10-19T12:35:32.308 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 19 12:35:32 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-y[135293]: 2023-10-19T12:35:32.132+0000 7fc021df3200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-19T12:35:32.308 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 19 12:35:32 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-y[135293]: 2023-10-19T12:35:32.211+0000 7fc021df3200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-19T12:35:32.308 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 19 12:35:32 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-y[135293]: 2023-10-19T12:35:32.303+0000 7fc021df3200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-19T12:35:32.380 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Oct 19 12:35:32 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-z[136357]: 2023-10-19T12:35:32.063+0000 7fa45bc0d200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-19T12:35:32.380 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Oct 19 12:35:32 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-z[136357]: 2023-10-19T12:35:32.145+0000 7fa45bc0d200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-19T12:35:32.587 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 19 12:35:32 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-y[135293]: 2023-10-19T12:35:32.400+0000 7fc021df3200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-19T12:35:32.973 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 19 12:35:32 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-y[135293]: 2023-10-19T12:35:32.584+0000 7fc021df3200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-19T12:35:33.233 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-19T12:35:33.242 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Oct 19 12:35:32 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-z[136357]: 2023-10-19T12:35:32.948+0000 7fa45bc0d200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-19T12:35:33.243 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Oct 19 12:35:33 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-z[136357]: 2023-10-19T12:35:33.052+0000 7fa45bc0d200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-19T12:35:33.243 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:33 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:33.243 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:33 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:33.243 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:33 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:33.244 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:33 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:33.244 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:33 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:35:33.244 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:33 smithi195 ceph-mon[134493]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:33.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:33 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:33.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:33 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:33.309 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:33 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:33.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:33 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:33.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:33 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:35:33.310 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:33 smithi157 ceph-mon[134109]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:33.310 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 19 12:35:32 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-y[135293]: 2023-10-19T12:35:32.969+0000 7fc021df3200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-19T12:35:33.311 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 19 12:35:33 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-y[135293]: 2023-10-19T12:35:33.106+0000 7fc021df3200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-19T12:35:33.311 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 19 12:35:33 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-y[135293]: 2023-10-19T12:35:33.207+0000 7fc021df3200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-19T12:35:33.368 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:33 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:33.369 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:33 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:33.369 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:33 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:33.369 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:33 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:33.369 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:33 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:35:33.369 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:33 smithi046 ceph-mon[98509]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:33.555 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Oct 19 12:35:33 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-z[136357]: 2023-10-19T12:35:33.239+0000 7fa45bc0d200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-19T12:35:33.815 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Oct 19 12:35:33 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-z[136357]: 2023-10-19T12:35:33.550+0000 7fa45bc0d200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-19T12:35:34.087 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 19 12:35:33 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-y[135293]: 2023-10-19T12:35:33.305+0000 7fc021df3200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-19T12:35:34.088 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 19 12:35:33 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-y[135293]: 2023-10-19T12:35:33.750+0000 7fc021df3200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-19T12:35:34.130 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Oct 19 12:35:33 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-z[136357]: 2023-10-19T12:35:33.811+0000 7fa45bc0d200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-19T12:35:34.130 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Oct 19 12:35:33 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-z[136357]: 2023-10-19T12:35:33.964+0000 7fa45bc0d200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-19T12:35:34.630 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Oct 19 12:35:34 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-z[136357]: 2023-10-19T12:35:34.233+0000 7fa45bc0d200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-19T12:35:34.837 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 19 12:35:34 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-y[135293]: 2023-10-19T12:35:34.433+0000 7fc021df3200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-19T12:35:34.837 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 19 12:35:34 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-y[135293]: 2023-10-19T12:35:34.514+0000 7fc021df3200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-19T12:35:35.130 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Oct 19 12:35:34 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-z[136357]: 2023-10-19T12:35:34.945+0000 7fa45bc0d200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-19T12:35:35.130 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Oct 19 12:35:35 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-z[136357]: 2023-10-19T12:35:35.077+0000 7fa45bc0d200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-19T12:35:35.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:34 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:35.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:34 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:35.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:34 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:35.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:34 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:35.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:34 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:35:35.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:34 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:35:35.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:34 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:35.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:34 smithi195 ceph-mon[134493]: Reconfiguring mgr.x (unknown last config time)... 2023-10-19T12:35:35.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:34 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-19T12:35:35.133 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:34 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-19T12:35:35.133 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:34 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:35:35.133 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:34 smithi195 ceph-mon[134493]: Reconfiguring daemon mgr.x on smithi046 2023-10-19T12:35:35.133 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:34 smithi195 ceph-mon[134493]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:35.133 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:34 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/1826870014' entity='client.admin' 2023-10-19T12:35:35.148 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:34 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:35.148 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:34 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:35.148 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:34 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:35.148 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:34 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:35.149 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:34 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:35:35.149 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:34 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:35:35.149 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:34 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:35.149 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:34 smithi046 ceph-mon[98509]: Reconfiguring mgr.x (unknown last config time)... 2023-10-19T12:35:35.149 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:34 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-19T12:35:35.150 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:34 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-19T12:35:35.150 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:34 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:35:35.150 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:34 smithi046 ceph-mon[98509]: Reconfiguring daemon mgr.x on smithi046 2023-10-19T12:35:35.150 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:34 smithi046 ceph-mon[98509]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:35.150 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:34 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/1826870014' entity='client.admin' 2023-10-19T12:35:35.291 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:34 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:35.292 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:34 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:35.292 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:34 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:35.292 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:34 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:35.293 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:34 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:35:35.293 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:34 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:35:35.293 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:34 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:35.293 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:34 smithi157 ceph-mon[134109]: Reconfiguring mgr.x (unknown last config time)... 2023-10-19T12:35:35.293 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:34 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-19T12:35:35.294 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:34 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-19T12:35:35.294 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:34 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:35:35.294 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:34 smithi157 ceph-mon[134109]: Reconfiguring daemon mgr.x on smithi046 2023-10-19T12:35:35.294 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:34 smithi157 ceph-mon[134109]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:35.294 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:34 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/1826870014' entity='client.admin' 2023-10-19T12:35:35.553 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 19 12:35:35 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-y[135293]: 2023-10-19T12:35:35.287+0000 7fc021df3200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-19T12:35:35.554 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 19 12:35:35 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-y[135293]: 2023-10-19T12:35:35.378+0000 7fc021df3200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-19T12:35:35.607 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Oct 19 12:35:35 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-z[136357]: 2023-10-19T12:35:35.272+0000 7fa45bc0d200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-19T12:35:35.607 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Oct 19 12:35:35 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-z[136357]: 2023-10-19T12:35:35.386+0000 7fa45bc0d200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-19T12:35:35.810 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-19T12:35:35.833 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 19 12:35:35 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-y[135293]: 2023-10-19T12:35:35.550+0000 7fc021df3200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-19T12:35:35.880 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Oct 19 12:35:35 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-z[136357]: 2023-10-19T12:35:35.603+0000 7fa45bc0d200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-19T12:35:36.087 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 19 12:35:35 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-y[135293]: 2023-10-19T12:35:35.829+0000 7fc021df3200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-19T12:35:36.088 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 19 12:35:36 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-y[135293]: 2023-10-19T12:35:36.058+0000 7fc021df3200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-19T12:35:36.342 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-19T12:35:36.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:36 smithi195 ceph-mon[134493]: from='client.? ' entity='client.admin' 2023-10-19T12:35:36.410 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:36 smithi046 ceph-mon[98509]: from='client.? ' entity='client.admin' 2023-10-19T12:35:36.470 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:36 smithi157 ceph-mon[134109]: from='client.? ' entity='client.admin' 2023-10-19T12:35:36.471 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 19 12:35:36 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-y[135293]: 2023-10-19T12:35:36.206+0000 7fc021df3200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-19T12:35:36.837 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 19 12:35:36 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-y[135293]: 2023-10-19T12:35:36.467+0000 7fc021df3200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-19T12:35:36.880 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Oct 19 12:35:36 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-z[136357]: 2023-10-19T12:35:36.468+0000 7fa45bc0d200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-19T12:35:37.332 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:37 smithi046 ceph-mon[98509]: Standby manager daemon z started 2023-10-19T12:35:37.333 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:37 smithi046 ceph-mon[98509]: from='mgr.? 172.21.15.195:0/2277338379' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-10-19T12:35:37.333 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:37 smithi046 ceph-mon[98509]: from='mgr.? 172.21.15.195:0/2277338379' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-19T12:35:37.333 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:37 smithi046 ceph-mon[98509]: from='mgr.? 172.21.15.195:0/2277338379' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-10-19T12:35:37.333 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:37 smithi046 ceph-mon[98509]: from='mgr.? 172.21.15.195:0/2277338379' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-19T12:35:37.333 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:37 smithi046 ceph-mon[98509]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:37.334 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:37 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:37.334 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:37 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/4138092152' entity='client.admin' 2023-10-19T12:35:37.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:37 smithi195 ceph-mon[134493]: Standby manager daemon z started 2023-10-19T12:35:37.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:37 smithi195 ceph-mon[134493]: from='mgr.? 172.21.15.195:0/2277338379' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-10-19T12:35:37.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:37 smithi195 ceph-mon[134493]: from='mgr.? 172.21.15.195:0/2277338379' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-19T12:35:37.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:37 smithi195 ceph-mon[134493]: from='mgr.? 172.21.15.195:0/2277338379' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-10-19T12:35:37.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:37 smithi195 ceph-mon[134493]: from='mgr.? 172.21.15.195:0/2277338379' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-19T12:35:37.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:37 smithi195 ceph-mon[134493]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:37.382 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:37 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:37.382 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:37 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/4138092152' entity='client.admin' 2023-10-19T12:35:37.500 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 19 12:35:37 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-y[135293]: 2023-10-19T12:35:37.172+0000 7fc021df3200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-19T12:35:37.500 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 19 12:35:37 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-y[135293]: 2023-10-19T12:35:37.304+0000 7fc021df3200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-19T12:35:37.501 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:37 smithi157 ceph-mon[134109]: Standby manager daemon z started 2023-10-19T12:35:37.501 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:37 smithi157 ceph-mon[134109]: from='mgr.? 172.21.15.195:0/2277338379' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-10-19T12:35:37.501 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:37 smithi157 ceph-mon[134109]: from='mgr.? 172.21.15.195:0/2277338379' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-19T12:35:37.501 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:37 smithi157 ceph-mon[134109]: from='mgr.? 172.21.15.195:0/2277338379' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-10-19T12:35:37.502 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:37 smithi157 ceph-mon[134109]: from='mgr.? 172.21.15.195:0/2277338379' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-19T12:35:37.502 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:37 smithi157 ceph-mon[134109]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:37.502 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:37 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:37.502 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:37 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/4138092152' entity='client.admin' 2023-10-19T12:35:37.685 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-19T12:35:37.830 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 19 12:35:37 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-y[135293]: 2023-10-19T12:35:37.496+0000 7fc021df3200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-19T12:35:37.831 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 19 12:35:37 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-y[135293]: 2023-10-19T12:35:37.610+0000 7fc021df3200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-19T12:35:38.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:38 smithi195 ceph-mon[134493]: mgrmap e14: x(active, since 70s), standbys: z 2023-10-19T12:35:38.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:38 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-10-19T12:35:38.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:38 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/1778720285' entity='client.admin' 2023-10-19T12:35:38.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:38 smithi046 ceph-mon[98509]: mgrmap e14: x(active, since 70s), standbys: z 2023-10-19T12:35:38.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:38 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-10-19T12:35:38.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:38 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/1778720285' entity='client.admin' 2023-10-19T12:35:38.587 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 19 12:35:37 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-y[135293]: 2023-10-19T12:35:37.826+0000 7fc021df3200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-19T12:35:38.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:38 smithi157 ceph-mon[134109]: mgrmap e14: x(active, since 70s), standbys: z 2023-10-19T12:35:38.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:38 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-10-19T12:35:38.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:38 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/1778720285' entity='client.admin' 2023-10-19T12:35:38.726 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:38.723+0000 7efdb67fc700 1 -- 172.21.15.46:0/3525624499 <== mon.2 v2:172.21.15.157:3300/0 8 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v14)=0 v14) v1 ==== 109+0+0 (secure 0 0 0) 0x7efdb8059630 con 0x7efdc0108710 2023-10-19T12:35:38.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:38.726+0000 7efdc75e5700 1 -- 172.21.15.46:0/3525624499 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7efdac06cf70 msgr2=0x7efdac06f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:35:38.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:38.726+0000 7efdc75e5700 1 --2- 172.21.15.46:0/3525624499 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7efdac06cf70 0x7efdac06f430 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7efdc0074c00 tx=0x7efdbc009260 comp rx=0 tx=0).stop 2023-10-19T12:35:38.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:38.726+0000 7efdc75e5700 1 -- 172.21.15.46:0/3525624499 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efdc0108710 msgr2=0x7efdc019fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:35:38.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:38.726+0000 7efdc75e5700 1 --2- 172.21.15.46:0/3525624499 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efdc0108710 0x7efdc019fd70 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7efdb800c370 tx=0x7efdb800c680 comp rx=0 tx=0).stop 2023-10-19T12:35:38.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:38.727+0000 7efdc75e5700 1 -- 172.21.15.46:0/3525624499 shutdown_connections 2023-10-19T12:35:38.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:38.727+0000 7efdc75e5700 1 --2- 172.21.15.46:0/3525624499 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efdc0108710 0x7efdc019fd70 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:38.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:38.727+0000 7efdc75e5700 1 --2- 172.21.15.46:0/3525624499 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7efdac06cf70 0x7efdac06f430 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:38.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:38.727+0000 7efdc75e5700 1 --2- 172.21.15.46:0/3525624499 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efdc0073250 0x7efdc0198800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:38.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:38.727+0000 7efdc75e5700 1 --2- 172.21.15.46:0/3525624499 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efdc0074820 0x7efdc0198d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:38.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:38.727+0000 7efdc75e5700 1 -- 172.21.15.46:0/3525624499 >> 172.21.15.46:0/3525624499 conn(0x7efdc00fbe00 msgr2=0x7efdc00fe1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:35:38.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:38.727+0000 7efdc75e5700 1 -- 172.21.15.46:0/3525624499 shutdown_connections 2023-10-19T12:35:38.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:38.727+0000 7efdc75e5700 1 -- 172.21.15.46:0/3525624499 wait complete. 2023-10-19T12:35:38.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:38.855+0000 7f14eaa73700 1 -- 172.21.15.46:0/4015689491 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f14e40ffa70 msgr2=0x7f14e40ffef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:35:38.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:38.855+0000 7f14eaa73700 1 --2- 172.21.15.46:0/4015689491 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f14e40ffa70 0x7f14e40ffef0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f14d4009990 tx=0x7f14d4009ca0 comp rx=0 tx=0).stop 2023-10-19T12:35:38.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:38.856+0000 7f14eaa73700 1 -- 172.21.15.46:0/4015689491 shutdown_connections 2023-10-19T12:35:38.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:38.856+0000 7f14eaa73700 1 --2- 172.21.15.46:0/4015689491 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f14e4100430 0x7f14e41008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:38.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:38.856+0000 7f14eaa73700 1 --2- 172.21.15.46:0/4015689491 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f14e40ff110 0x7f14e40ff530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:38.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:38.856+0000 7f14eaa73700 1 --2- 172.21.15.46:0/4015689491 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f14e40ffa70 0x7f14e40ffef0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:38.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:38.856+0000 7f14eaa73700 1 -- 172.21.15.46:0/4015689491 >> 172.21.15.46:0/4015689491 conn(0x7f14e40facf0 msgr2=0x7f14e40fd110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:35:38.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:38.856+0000 7f14eaa73700 1 -- 172.21.15.46:0/4015689491 shutdown_connections 2023-10-19T12:35:38.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:38.856+0000 7f14eaa73700 1 -- 172.21.15.46:0/4015689491 wait complete. 2023-10-19T12:35:38.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:38.857+0000 7f14eaa73700 1 Processor -- start 2023-10-19T12:35:38.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:38.858+0000 7f14eaa73700 1 -- start start 2023-10-19T12:35:38.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:38.858+0000 7f14eaa73700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f14e40ff110 0x7f14e41987d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:35:38.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:38.858+0000 7f14eaa73700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f14e40ffa70 0x7f14e4198d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:35:38.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:38.859+0000 7f14e880f700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f14e40ff110 0x7f14e41987d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:35:38.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:38.859+0000 7f14eaa73700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f14e4100430 0x7f14e419fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:35:38.864 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:38.859+0000 7f14e880f700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f14e40ff110 0x7f14e41987d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:58984/0 (socket says 172.21.15.46:58984) 2023-10-19T12:35:38.864 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:38.859+0000 7f14e880f700 1 -- 172.21.15.46:0/892167835 learned_addr learned my addr 172.21.15.46:0/892167835 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:35:38.864 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:38.859+0000 7f14eaa73700 1 -- 172.21.15.46:0/892167835 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14e41a02c0 con 0x7f14e40ffa70 2023-10-19T12:35:38.864 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:38.859+0000 7f14eaa73700 1 -- 172.21.15.46:0/892167835 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14e41a0400 con 0x7f14e40ff110 2023-10-19T12:35:38.865 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:38.859+0000 7f14eaa73700 1 -- 172.21.15.46:0/892167835 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14e41a0590 con 0x7f14e4100430 2023-10-19T12:35:38.865 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:38.859+0000 7f14e3fff700 1 --2- 172.21.15.46:0/892167835 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f14e40ffa70 0x7f14e4198d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:35:38.865 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:38.859+0000 7f14e9010700 1 --2- 172.21.15.46:0/892167835 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f14e4100430 0x7f14e419fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:35:38.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:38.860+0000 7f14e880f700 1 -- 172.21.15.46:0/892167835 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f14e4100430 msgr2=0x7f14e419fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:35:38.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:38.860+0000 7f14e880f700 1 --2- 172.21.15.46:0/892167835 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f14e4100430 0x7f14e419fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:38.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:38.860+0000 7f14e880f700 1 -- 172.21.15.46:0/892167835 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f14e40ffa70 msgr2=0x7f14e4198d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:35:38.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:38.860+0000 7f14e880f700 1 --2- 172.21.15.46:0/892167835 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f14e40ffa70 0x7f14e4198d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:38.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:38.860+0000 7f14e880f700 1 -- 172.21.15.46:0/892167835 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14d40095f0 con 0x7f14e40ff110 2023-10-19T12:35:38.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:38.860+0000 7f14e880f700 1 --2- 172.21.15.46:0/892167835 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f14e40ff110 0x7f14e41987d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f14d800e9a0 tx=0x7f14d800ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:35:38.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:38.860+0000 7f14e1ffb700 1 -- 172.21.15.46:0/892167835 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d8009790 con 0x7f14e40ff110 2023-10-19T12:35:38.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:38.860+0000 7f14e1ffb700 1 -- 172.21.15.46:0/892167835 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(24 keys) v1 ==== 1043+0+0 (secure 0 0 0) 0x7f14d800cbd0 con 0x7f14e40ff110 2023-10-19T12:35:38.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:38.860+0000 7f14e1ffb700 1 -- 172.21.15.46:0/892167835 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d8018420 con 0x7f14e40ff110 2023-10-19T12:35:38.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:38.861+0000 7f14eaa73700 1 -- 172.21.15.46:0/892167835 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14e41a0870 con 0x7f14e40ff110 2023-10-19T12:35:38.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:38.861+0000 7f14eaa73700 1 -- 172.21.15.46:0/892167835 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14e41a0d20 con 0x7f14e40ff110 2023-10-19T12:35:38.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:38.863+0000 7f14eaa73700 1 -- 172.21.15.46:0/892167835 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14e4109ef0 con 0x7f14e40ff110 2023-10-19T12:35:38.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:38.864+0000 7f14e1ffb700 1 -- 172.21.15.46:0/892167835 <== mon.2 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 14) v1 ==== 90791+0+0 (secure 0 0 0) 0x7f14d8010430 con 0x7f14e40ff110 2023-10-19T12:35:38.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:38.865+0000 7f14e1ffb700 1 --2- 172.21.15.46:0/892167835 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f14cc06cf70 0x7f14cc06f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:35:38.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:38.865+0000 7f14e1ffb700 1 -- 172.21.15.46:0/892167835 <== mon.2 v2:172.21.15.157:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f14d8014070 con 0x7f14e40ff110 2023-10-19T12:35:38.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:38.866+0000 7f14e3fff700 1 --2- 172.21.15.46:0/892167835 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f14cc06cf70 0x7f14cc06f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:35:38.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:38.866+0000 7f14e3fff700 1 --2- 172.21.15.46:0/892167835 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f14cc06cf70 0x7f14cc06f430 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f14d40098e0 tx=0x7f14d400b260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:35:38.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:38.869+0000 7f14e1ffb700 1 -- 172.21.15.46:0/892167835 <== mon.2 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f14d8056a60 con 0x7f14e40ff110 2023-10-19T12:35:39.087 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 19 12:35:38 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-y[135293]: 2023-10-19T12:35:38.715+0000 7fc021df3200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-19T12:35:39.185 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.181+0000 7f14eaa73700 1 -- 172.21.15.46:0/892167835 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) v1 -- 0x7f14e404e4c0 con 0x7f14e40ff110 2023-10-19T12:35:39.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.186+0000 7f14e1ffb700 1 -- 172.21.15.46:0/892167835 <== mon.2 v2:172.21.15.157:3300/0 7 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f14d8056a60 con 0x7f14e40ff110 2023-10-19T12:35:39.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.186+0000 7f14e1ffb700 1 -- 172.21.15.46:0/892167835 <== mon.2 v2:172.21.15.157:3300/0 8 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v15)=0 v15) v1 ==== 123+0+0 (secure 0 0 0) 0x7f14d805a080 con 0x7f14e40ff110 2023-10-19T12:35:39.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.189+0000 7f14eaa73700 1 -- 172.21.15.46:0/892167835 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f14cc06cf70 msgr2=0x7f14cc06f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:35:39.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.189+0000 7f14eaa73700 1 --2- 172.21.15.46:0/892167835 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f14cc06cf70 0x7f14cc06f430 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f14d40098e0 tx=0x7f14d400b260 comp rx=0 tx=0).stop 2023-10-19T12:35:39.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.189+0000 7f14eaa73700 1 -- 172.21.15.46:0/892167835 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f14e40ff110 msgr2=0x7f14e41987d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:35:39.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.189+0000 7f14eaa73700 1 --2- 172.21.15.46:0/892167835 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f14e40ff110 0x7f14e41987d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f14d800e9a0 tx=0x7f14d800ecb0 comp rx=0 tx=0).stop 2023-10-19T12:35:39.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.189+0000 7f14eaa73700 1 -- 172.21.15.46:0/892167835 shutdown_connections 2023-10-19T12:35:39.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.189+0000 7f14eaa73700 1 --2- 172.21.15.46:0/892167835 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f14cc06cf70 0x7f14cc06f430 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:39.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.189+0000 7f14eaa73700 1 --2- 172.21.15.46:0/892167835 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f14e4100430 0x7f14e419fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:39.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.189+0000 7f14eaa73700 1 --2- 172.21.15.46:0/892167835 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f14e40ff110 0x7f14e41987d0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:39.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.189+0000 7f14eaa73700 1 --2- 172.21.15.46:0/892167835 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f14e40ffa70 0x7f14e4198d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:39.195 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.189+0000 7f14eaa73700 1 -- 172.21.15.46:0/892167835 >> 172.21.15.46:0/892167835 conn(0x7f14e40facf0 msgr2=0x7f14e40fc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:35:39.195 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.189+0000 7f14eaa73700 1 -- 172.21.15.46:0/892167835 shutdown_connections 2023-10-19T12:35:39.195 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.189+0000 7f14eaa73700 1 -- 172.21.15.46:0/892167835 wait complete. 2023-10-19T12:35:39.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.307+0000 7f62e97a1700 1 -- 172.21.15.46:0/494459859 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f62e4103c50 msgr2=0x7f62e4106040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:35:39.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.307+0000 7f62e97a1700 1 --2- 172.21.15.46:0/494459859 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f62e4103c50 0x7f62e4106040 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f62d80098f0 tx=0x7f62d8009c00 comp rx=0 tx=0).stop 2023-10-19T12:35:39.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.307+0000 7f62e97a1700 1 -- 172.21.15.46:0/494459859 shutdown_connections 2023-10-19T12:35:39.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.307+0000 7f62e97a1700 1 --2- 172.21.15.46:0/494459859 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f62e4106580 0x7f62e4108990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:39.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.307+0000 7f62e97a1700 1 --2- 172.21.15.46:0/494459859 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62e4101320 0x7f62e4103710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:39.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.307+0000 7f62e97a1700 1 --2- 172.21.15.46:0/494459859 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f62e4103c50 0x7f62e4106040 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:39.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.307+0000 7f62e97a1700 1 -- 172.21.15.46:0/494459859 >> 172.21.15.46:0/494459859 conn(0x7f62e40facf0 msgr2=0x7f62e40fd110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:35:39.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.307+0000 7f62e97a1700 1 -- 172.21.15.46:0/494459859 shutdown_connections 2023-10-19T12:35:39.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.307+0000 7f62e97a1700 1 -- 172.21.15.46:0/494459859 wait complete. 2023-10-19T12:35:39.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.308+0000 7f62e97a1700 1 Processor -- start 2023-10-19T12:35:39.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.308+0000 7f62e97a1700 1 -- start start 2023-10-19T12:35:39.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.308+0000 7f62e97a1700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62e4101320 0x7f62e4100be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:35:39.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.308+0000 7f62e97a1700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f62e4103c50 0x7f62e40ff2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:35:39.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.308+0000 7f62e97a1700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f62e4106580 0x7f62e40ff810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:35:39.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.308+0000 7f62e97a1700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e40ffef0 con 0x7f62e4101320 2023-10-19T12:35:39.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.308+0000 7f62e97a1700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e4100060 con 0x7f62e4106580 2023-10-19T12:35:39.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.308+0000 7f62e97a1700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e41a0780 con 0x7f62e4103c50 2023-10-19T12:35:39.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.309+0000 7f62e2ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62e4101320 0x7f62e4100be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:35:39.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.309+0000 7f62e27fc700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f62e4103c50 0x7f62e40ff2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:35:39.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.309+0000 7f62e2ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62e4101320 0x7f62e4100be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53430/0 (socket says 172.21.15.46:53430) 2023-10-19T12:35:39.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.309+0000 7f62e27fc700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f62e4103c50 0x7f62e40ff2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:47234/0 (socket says 172.21.15.46:47234) 2023-10-19T12:35:39.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.309+0000 7f62e2ffd700 1 -- 172.21.15.46:0/53915261 learned_addr learned my addr 172.21.15.46:0/53915261 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:35:39.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.309+0000 7f62e37fe700 1 --2- 172.21.15.46:0/53915261 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f62e4106580 0x7f62e40ff810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:35:39.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.309+0000 7f62e27fc700 1 -- 172.21.15.46:0/53915261 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f62e4106580 msgr2=0x7f62e40ff810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:35:39.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.309+0000 7f62e27fc700 1 --2- 172.21.15.46:0/53915261 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f62e4106580 0x7f62e40ff810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:39.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.309+0000 7f62e27fc700 1 -- 172.21.15.46:0/53915261 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62e4101320 msgr2=0x7f62e4100be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:35:39.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.309+0000 7f62e27fc700 1 --2- 172.21.15.46:0/53915261 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62e4101320 0x7f62e4100be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:39.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.309+0000 7f62e27fc700 1 -- 172.21.15.46:0/53915261 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62d40095f0 con 0x7f62e4103c50 2023-10-19T12:35:39.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.309+0000 7f62e2ffd700 1 --2- 172.21.15.46:0/53915261 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62e4101320 0x7f62e4100be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:35:39.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.309+0000 7f62e37fe700 1 --2- 172.21.15.46:0/53915261 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f62e4106580 0x7f62e40ff810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T12:35:39.437 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.309+0000 7f62e27fc700 1 --2- 172.21.15.46:0/53915261 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f62e4103c50 0x7f62e40ff2d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f62d8009230 tx=0x7f62d800b560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:35:39.437 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.310+0000 7f62cbfff700 1 -- 172.21.15.46:0/53915261 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62d801c070 con 0x7f62e4103c50 2023-10-19T12:35:39.437 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.310+0000 7f62cbfff700 1 -- 172.21.15.46:0/53915261 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f62d800ba10 con 0x7f62e4103c50 2023-10-19T12:35:39.437 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.310+0000 7f62e97a1700 1 -- 172.21.15.46:0/53915261 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62d8009520 con 0x7f62e4103c50 2023-10-19T12:35:39.437 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.310+0000 7f62cbfff700 1 -- 172.21.15.46:0/53915261 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62d8003c20 con 0x7f62e4103c50 2023-10-19T12:35:39.437 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.310+0000 7f62e97a1700 1 -- 172.21.15.46:0/53915261 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62e41a0c00 con 0x7f62e4103c50 2023-10-19T12:35:39.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.311+0000 7f62e97a1700 1 -- 172.21.15.46:0/53915261 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62e40fc870 con 0x7f62e4103c50 2023-10-19T12:35:39.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.312+0000 7f62cbfff700 1 -- 172.21.15.46:0/53915261 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 14) v1 ==== 90791+0+0 (secure 0 0 0) 0x7f62d8005040 con 0x7f62e4103c50 2023-10-19T12:35:39.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.313+0000 7f62cbfff700 1 --2- 172.21.15.46:0/53915261 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f62cc06cf70 0x7f62cc06f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:35:39.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.313+0000 7f62cbfff700 1 -- 172.21.15.46:0/53915261 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f62d808c050 con 0x7f62e4103c50 2023-10-19T12:35:39.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.314+0000 7f62e2ffd700 1 --2- 172.21.15.46:0/53915261 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f62cc06cf70 0x7f62cc06f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:35:39.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.314+0000 7f62e2ffd700 1 --2- 172.21.15.46:0/53915261 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f62cc06cf70 0x7f62cc06f430 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f62d4005d10 tx=0x7f62d4009310 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:35:39.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.318+0000 7f62cbfff700 1 -- 172.21.15.46:0/53915261 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f62d80574b0 con 0x7f62e4103c50 2023-10-19T12:35:39.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.573+0000 7f62e97a1700 1 -- 172.21.15.46:0/53915261 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) v1 -- 0x7f62e402cf80 con 0x7f62e4103c50 2023-10-19T12:35:39.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.578+0000 7f62cbfff700 1 -- 172.21.15.46:0/53915261 <== mon.1 v2:172.21.15.195:3300/0 7 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f62d808b840 con 0x7f62e4103c50 2023-10-19T12:35:39.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.578+0000 7f62cbfff700 1 -- 172.21.15.46:0/53915261 <== mon.1 v2:172.21.15.195:3300/0 8 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v16)=0 v16) v1 ==== 123+0+0 (secure 0 0 0) 0x7f62d805aad0 con 0x7f62e4103c50 2023-10-19T12:35:39.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.581+0000 7f62e97a1700 1 -- 172.21.15.46:0/53915261 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f62cc06cf70 msgr2=0x7f62cc06f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:35:39.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.581+0000 7f62e97a1700 1 --2- 172.21.15.46:0/53915261 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f62cc06cf70 0x7f62cc06f430 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f62d4005d10 tx=0x7f62d4009310 comp rx=0 tx=0).stop 2023-10-19T12:35:39.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.581+0000 7f62e97a1700 1 -- 172.21.15.46:0/53915261 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f62e4103c50 msgr2=0x7f62e40ff2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:35:39.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.581+0000 7f62e97a1700 1 --2- 172.21.15.46:0/53915261 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f62e4103c50 0x7f62e40ff2d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f62d8009230 tx=0x7f62d800b560 comp rx=0 tx=0).stop 2023-10-19T12:35:39.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.581+0000 7f62e97a1700 1 -- 172.21.15.46:0/53915261 shutdown_connections 2023-10-19T12:35:39.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.581+0000 7f62e97a1700 1 --2- 172.21.15.46:0/53915261 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f62e4106580 0x7f62e40ff810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:39.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.581+0000 7f62e97a1700 1 --2- 172.21.15.46:0/53915261 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62e4101320 0x7f62e4100be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:39.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.581+0000 7f62e97a1700 1 --2- 172.21.15.46:0/53915261 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f62cc06cf70 0x7f62cc06f430 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:39.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.581+0000 7f62e97a1700 1 --2- 172.21.15.46:0/53915261 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f62e4103c50 0x7f62e40ff2d0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:39.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.581+0000 7f62e97a1700 1 -- 172.21.15.46:0/53915261 >> 172.21.15.46:0/53915261 conn(0x7f62e40facf0 msgr2=0x7f62e4101d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:35:39.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.582+0000 7f62e97a1700 1 -- 172.21.15.46:0/53915261 shutdown_connections 2023-10-19T12:35:39.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.582+0000 7f62e97a1700 1 -- 172.21.15.46:0/53915261 wait complete. 2023-10-19T12:35:39.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.730+0000 7fa60e3ee700 1 -- 172.21.15.46:0/3851768341 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa6080731f0 msgr2=0x7fa608073670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:35:39.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.730+0000 7fa60e3ee700 1 --2- 172.21.15.46:0/3851768341 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa6080731f0 0x7fa608073670 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc009990 tx=0x7fa5fc009ca0 comp rx=0 tx=0).stop 2023-10-19T12:35:39.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.730+0000 7fa60e3ee700 1 -- 172.21.15.46:0/3851768341 shutdown_connections 2023-10-19T12:35:39.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.730+0000 7fa60e3ee700 1 --2- 172.21.15.46:0/3851768341 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa608108700 0x7fa60810ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:39.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.730+0000 7fa60e3ee700 1 --2- 172.21.15.46:0/3851768341 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa6080747c0 0x7fa608072c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:39.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.730+0000 7fa60e3ee700 1 --2- 172.21.15.46:0/3851768341 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa6080731f0 0x7fa608073670 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:39.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.730+0000 7fa60e3ee700 1 -- 172.21.15.46:0/3851768341 >> 172.21.15.46:0/3851768341 conn(0x7fa6080fbdc0 msgr2=0x7fa6080fe200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:35:39.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.731+0000 7fa60e3ee700 1 -- 172.21.15.46:0/3851768341 shutdown_connections 2023-10-19T12:35:39.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.731+0000 7fa60e3ee700 1 -- 172.21.15.46:0/3851768341 wait complete. 2023-10-19T12:35:39.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.733+0000 7fa60e3ee700 1 Processor -- start 2023-10-19T12:35:39.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.734+0000 7fa60e3ee700 1 -- start start 2023-10-19T12:35:39.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.734+0000 7fa60e3ee700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa6080731f0 0x7fa608198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:35:39.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.734+0000 7fa60e3ee700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa6080747c0 0x7fa608198eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:35:39.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.734+0000 7fa60e3ee700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa608108700 0x7fa60819fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:35:39.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.734+0000 7fa60e3ee700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6081a04b0 con 0x7fa6080731f0 2023-10-19T12:35:39.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.734+0000 7fa60e3ee700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6081a05f0 con 0x7fa6080747c0 2023-10-19T12:35:39.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.734+0000 7fa60e3ee700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6081a0780 con 0x7fa608108700 2023-10-19T12:35:39.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.735+0000 7fa6077fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa6080747c0 0x7fa608198eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:35:39.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.735+0000 7fa6077fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa6080747c0 0x7fa608198eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:59028/0 (socket says 172.21.15.46:59028) 2023-10-19T12:35:39.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.735+0000 7fa6077fe700 1 -- 172.21.15.46:0/2217698548 learned_addr learned my addr 172.21.15.46:0/2217698548 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:35:39.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.735+0000 7fa607fff700 1 --2- 172.21.15.46:0/2217698548 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa6080731f0 0x7fa608198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:35:39.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.735+0000 7fa60c98b700 1 --2- 172.21.15.46:0/2217698548 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa608108700 0x7fa60819fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:35:39.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.736+0000 7fa60c98b700 1 -- 172.21.15.46:0/2217698548 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa6080747c0 msgr2=0x7fa608198eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:35:39.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.736+0000 7fa60c98b700 1 --2- 172.21.15.46:0/2217698548 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa6080747c0 0x7fa608198eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:39.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.736+0000 7fa60c98b700 1 -- 172.21.15.46:0/2217698548 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa6080731f0 msgr2=0x7fa608198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:35:39.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.736+0000 7fa60c98b700 1 --2- 172.21.15.46:0/2217698548 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa6080731f0 0x7fa608198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:39.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.736+0000 7fa60c98b700 1 -- 172.21.15.46:0/2217698548 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5fc0095f0 con 0x7fa608108700 2023-10-19T12:35:39.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.736+0000 7fa607fff700 1 --2- 172.21.15.46:0/2217698548 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa6080731f0 0x7fa608198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:35:39.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.736+0000 7fa60c98b700 1 --2- 172.21.15.46:0/2217698548 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa608108700 0x7fa60819fee0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa600009f60 tx=0x7fa600009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:35:39.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.737+0000 7fa6057fa700 1 -- 172.21.15.46:0/2217698548 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa600018070 con 0x7fa608108700 2023-10-19T12:35:39.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.737+0000 7fa6057fa700 1 -- 172.21.15.46:0/2217698548 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa60000f040 con 0x7fa608108700 2023-10-19T12:35:39.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.737+0000 7fa6057fa700 1 -- 172.21.15.46:0/2217698548 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa60000ccc0 con 0x7fa608108700 2023-10-19T12:35:39.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.737+0000 7fa60e3ee700 1 -- 172.21.15.46:0/2217698548 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa608100240 con 0x7fa608108700 2023-10-19T12:35:39.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.737+0000 7fa60e3ee700 1 -- 172.21.15.46:0/2217698548 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6081006f0 con 0x7fa608108700 2023-10-19T12:35:39.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.738+0000 7fa60e3ee700 1 -- 172.21.15.46:0/2217698548 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa608107510 con 0x7fa608108700 2023-10-19T12:35:39.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.740+0000 7fa6057fa700 1 -- 172.21.15.46:0/2217698548 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 15) v1 ==== 135947+0+0 (secure 0 0 0) 0x7fa600003a00 con 0x7fa608108700 2023-10-19T12:35:39.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.741+0000 7fa6057fa700 1 --2- 172.21.15.46:0/2217698548 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fa5f00a1470 0x7fa5f00a3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:35:39.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.742+0000 7fa6057fa700 1 -- 172.21.15.46:0/2217698548 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fa6000cab20 con 0x7fa608108700 2023-10-19T12:35:39.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.742+0000 7fa607fff700 1 --2- 172.21.15.46:0/2217698548 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fa5f00a1470 0x7fa5f00a3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:35:39.746 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.742+0000 7fa607fff700 1 --2- 172.21.15.46:0/2217698548 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fa5f00a1470 0x7fa5f00a3930 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa5f8005950 tx=0x7fa5f800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:35:39.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.745+0000 7fa6057fa700 1 -- 172.21.15.46:0/2217698548 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa600095e50 con 0x7fa608108700 2023-10-19T12:35:39.972 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.969+0000 7fa60e3ee700 1 -- 172.21.15.46:0/2217698548 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) v1 -- 0x7fa608106ef0 con 0x7fa608108700 2023-10-19T12:35:39.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.975+0000 7fa6057fa700 1 -- 172.21.15.46:0/2217698548 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v17)=0 v17) v1 ==== 108+0+0 (secure 0 0 0) 0x7fa600099470 con 0x7fa608108700 2023-10-19T12:35:39.978 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:39 smithi046 ceph-mon[98509]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:39.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:39 smithi046 ceph-mon[98509]: from='client.? ' entity='client.admin' 2023-10-19T12:35:39.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:39 smithi046 ceph-mon[98509]: Standby manager daemon y started 2023-10-19T12:35:39.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:39 smithi046 ceph-mon[98509]: from='mgr.? 172.21.15.157:0/3281082817' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-10-19T12:35:39.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:39 smithi046 ceph-mon[98509]: from='mgr.? 172.21.15.157:0/3281082817' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-19T12:35:39.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:39 smithi046 ceph-mon[98509]: from='mgr.? 172.21.15.157:0/3281082817' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-10-19T12:35:39.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:39 smithi046 ceph-mon[98509]: from='mgr.? 172.21.15.157:0/3281082817' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-19T12:35:39.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:39 smithi046 ceph-mon[98509]: from='client.? ' entity='client.admin' 2023-10-19T12:35:39.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:39 smithi046 ceph-mon[98509]: from='client.? ' entity='client.admin' 2023-10-19T12:35:39.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.978+0000 7fa60e3ee700 1 -- 172.21.15.46:0/2217698548 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fa5f00a1470 msgr2=0x7fa5f00a3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:35:39.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.978+0000 7fa60e3ee700 1 --2- 172.21.15.46:0/2217698548 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fa5f00a1470 0x7fa5f00a3930 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa5f8005950 tx=0x7fa5f800b410 comp rx=0 tx=0).stop 2023-10-19T12:35:39.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.978+0000 7fa60e3ee700 1 -- 172.21.15.46:0/2217698548 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa608108700 msgr2=0x7fa60819fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:35:39.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.978+0000 7fa60e3ee700 1 --2- 172.21.15.46:0/2217698548 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa608108700 0x7fa60819fee0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa600009f60 tx=0x7fa600009f90 comp rx=0 tx=0).stop 2023-10-19T12:35:39.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.978+0000 7fa60e3ee700 1 -- 172.21.15.46:0/2217698548 shutdown_connections 2023-10-19T12:35:39.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.978+0000 7fa60e3ee700 1 --2- 172.21.15.46:0/2217698548 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fa5f00a1470 0x7fa5f00a3930 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:39.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.978+0000 7fa60e3ee700 1 --2- 172.21.15.46:0/2217698548 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa608108700 0x7fa60819fee0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:39.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.978+0000 7fa60e3ee700 1 --2- 172.21.15.46:0/2217698548 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa6080731f0 0x7fa608198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:39.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.978+0000 7fa60e3ee700 1 --2- 172.21.15.46:0/2217698548 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa6080747c0 0x7fa608198eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:39.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.978+0000 7fa60e3ee700 1 -- 172.21.15.46:0/2217698548 >> 172.21.15.46:0/2217698548 conn(0x7fa6080fbdc0 msgr2=0x7fa608104650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:35:39.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.978+0000 7fa60e3ee700 1 -- 172.21.15.46:0/2217698548 shutdown_connections 2023-10-19T12:35:39.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:39.978+0000 7fa60e3ee700 1 -- 172.21.15.46:0/2217698548 wait complete. 2023-10-19T12:35:40.085 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '96a8be3c-6e7b-11ee-8db6-212e2dc638e7', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi046') 2023-10-19T12:35:40.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:39 smithi157 ceph-mon[134109]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:40.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:39 smithi157 ceph-mon[134109]: from='client.? ' entity='client.admin' 2023-10-19T12:35:40.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:39 smithi157 ceph-mon[134109]: Standby manager daemon y started 2023-10-19T12:35:40.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:39 smithi157 ceph-mon[134109]: from='mgr.? 172.21.15.157:0/3281082817' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-10-19T12:35:40.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:39 smithi157 ceph-mon[134109]: from='mgr.? 172.21.15.157:0/3281082817' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-19T12:35:40.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:39 smithi157 ceph-mon[134109]: from='mgr.? 172.21.15.157:0/3281082817' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-10-19T12:35:40.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:39 smithi157 ceph-mon[134109]: from='mgr.? 172.21.15.157:0/3281082817' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-19T12:35:40.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:39 smithi157 ceph-mon[134109]: from='client.? ' entity='client.admin' 2023-10-19T12:35:40.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:39 smithi157 ceph-mon[134109]: from='client.? ' entity='client.admin' 2023-10-19T12:35:40.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:39 smithi195 ceph-mon[134493]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:40.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:39 smithi195 ceph-mon[134493]: from='client.? ' entity='client.admin' 2023-10-19T12:35:40.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:39 smithi195 ceph-mon[134493]: Standby manager daemon y started 2023-10-19T12:35:40.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:39 smithi195 ceph-mon[134493]: from='mgr.? 172.21.15.157:0/3281082817' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-10-19T12:35:40.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:39 smithi195 ceph-mon[134493]: from='mgr.? 172.21.15.157:0/3281082817' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-19T12:35:40.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:39 smithi195 ceph-mon[134493]: from='mgr.? 172.21.15.157:0/3281082817' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-10-19T12:35:40.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:39 smithi195 ceph-mon[134493]: from='mgr.? 172.21.15.157:0/3281082817' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-19T12:35:40.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:39 smithi195 ceph-mon[134493]: from='client.? ' entity='client.admin' 2023-10-19T12:35:40.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:39 smithi195 ceph-mon[134493]: from='client.? ' entity='client.admin' 2023-10-19T12:35:40.823 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:40 smithi046 ceph-mon[98509]: mgrmap e15: x(active, since 73s), standbys: z, y 2023-10-19T12:35:40.823 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:40 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-10-19T12:35:40.824 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:40 smithi046 ceph-mon[98509]: from='client.? ' entity='client.admin' 2023-10-19T12:35:40.929 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:40.843+0000 7f0ce3f77700 1 -- 172.21.15.46:0/959279878 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0cdc100820 msgr2=0x7f0cdc100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:35:40.930 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:40.843+0000 7f0ce3f77700 1 --2- 172.21.15.46:0/959279878 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0cdc100820 0x7f0cdc100c40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0cd80099c0 tx=0x7f0cd8009cd0 comp rx=0 tx=0).stop 2023-10-19T12:35:40.930 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:40.843+0000 7f0ce3f77700 1 -- 172.21.15.46:0/959279878 shutdown_connections 2023-10-19T12:35:40.930 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:40.843+0000 7f0ce3f77700 1 --2- 172.21.15.46:0/959279878 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0cdc1023c0 0x7f0cdc108c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:40.930 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:40.843+0000 7f0ce3f77700 1 --2- 172.21.15.46:0/959279878 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0cdc100820 0x7f0cdc100c40 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:40.931 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:40.843+0000 7f0ce3f77700 1 --2- 172.21.15.46:0/959279878 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0cdc101a20 0x7f0cdc101e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:40.931 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:40.843+0000 7f0ce3f77700 1 -- 172.21.15.46:0/959279878 >> 172.21.15.46:0/959279878 conn(0x7f0cdc0fbdc0 msgr2=0x7f0cdc0fe200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:35:40.931 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:40.843+0000 7f0ce3f77700 1 -- 172.21.15.46:0/959279878 shutdown_connections 2023-10-19T12:35:40.931 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:40.843+0000 7f0ce3f77700 1 -- 172.21.15.46:0/959279878 wait complete. 2023-10-19T12:35:40.931 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:40.844+0000 7f0ce3f77700 1 Processor -- start 2023-10-19T12:35:40.932 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:40.845+0000 7f0ce3f77700 1 -- start start 2023-10-19T12:35:40.932 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:40.845+0000 7f0ce3f77700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0cdc100820 0x7f0cdc198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:35:40.932 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:40.845+0000 7f0ce3f77700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0cdc101a20 0x7f0cdc198ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:35:40.932 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:40.845+0000 7f0ce3f77700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0cdc1023c0 0x7f0cdc19fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:35:40.932 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:40.845+0000 7f0ce3f77700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cdc1a04c0 con 0x7f0cdc100820 2023-10-19T12:35:40.933 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:40.845+0000 7f0ce3f77700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cdc1a0600 con 0x7f0cdc1023c0 2023-10-19T12:35:40.933 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:40.845+0000 7f0ce3f77700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cdc1a0790 con 0x7f0cdc101a20 2023-10-19T12:35:40.933 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:40.845+0000 7f0ce1d13700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0cdc100820 0x7f0cdc198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:35:40.933 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:40.845+0000 7f0ce1d13700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0cdc100820 0x7f0cdc198980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53480/0 (socket says 172.21.15.46:53480) 2023-10-19T12:35:40.933 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:40.845+0000 7f0ce1d13700 1 -- 172.21.15.46:0/4203317711 learned_addr learned my addr 172.21.15.46:0/4203317711 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:35:40.934 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:40.845+0000 7f0ce2514700 1 --2- 172.21.15.46:0/4203317711 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0cdc1023c0 0x7f0cdc19fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:35:40.934 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:40.845+0000 7f0ce1512700 1 --2- 172.21.15.46:0/4203317711 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0cdc101a20 0x7f0cdc198ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:35:40.934 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:40.845+0000 7f0ce1d13700 1 -- 172.21.15.46:0/4203317711 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0cdc101a20 msgr2=0x7f0cdc198ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:35:40.934 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:40.846+0000 7f0ce1d13700 1 --2- 172.21.15.46:0/4203317711 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0cdc101a20 0x7f0cdc198ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:40.934 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:40.846+0000 7f0ce1d13700 1 -- 172.21.15.46:0/4203317711 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0cdc1023c0 msgr2=0x7f0cdc19fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:35:40.935 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:40.846+0000 7f0ce1d13700 1 --2- 172.21.15.46:0/4203317711 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0cdc1023c0 0x7f0cdc19fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:40.935 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:40.846+0000 7f0ce1d13700 1 -- 172.21.15.46:0/4203317711 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cd80095f0 con 0x7f0cdc100820 2023-10-19T12:35:40.935 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:40.846+0000 7f0ce1512700 1 --2- 172.21.15.46:0/4203317711 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0cdc101a20 0x7f0cdc198ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T12:35:40.935 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:40.846+0000 7f0ce2514700 1 --2- 172.21.15.46:0/4203317711 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0cdc1023c0 0x7f0cdc19fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:35:40.935 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:40.846+0000 7f0ce1d13700 1 --2- 172.21.15.46:0/4203317711 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0cdc100820 0x7f0cdc198980 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0cd8009fd0 tx=0x7f0cd800f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:35:40.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:40.846+0000 7f0cd2ffd700 1 -- 172.21.15.46:0/4203317711 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd801d070 con 0x7f0cdc100820 2023-10-19T12:35:40.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:40.846+0000 7f0cd2ffd700 1 -- 172.21.15.46:0/4203317711 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0cd8005050 con 0x7f0cdc100820 2023-10-19T12:35:40.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:40.846+0000 7f0cd2ffd700 1 -- 172.21.15.46:0/4203317711 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd8004b10 con 0x7f0cdc100820 2023-10-19T12:35:40.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:40.846+0000 7f0ce3f77700 1 -- 172.21.15.46:0/4203317711 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cdc1a0a10 con 0x7f0cdc100820 2023-10-19T12:35:40.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:40.846+0000 7f0ce3f77700 1 -- 172.21.15.46:0/4203317711 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cdc1a0dd0 con 0x7f0cdc100820 2023-10-19T12:35:40.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:40.848+0000 7f0ce3f77700 1 -- 172.21.15.46:0/4203317711 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cdc04e4c0 con 0x7f0cdc100820 2023-10-19T12:35:40.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:40.850+0000 7f0cd2ffd700 1 -- 172.21.15.46:0/4203317711 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 15) v1 ==== 135947+0+0 (secure 0 0 0) 0x7f0cd80051c0 con 0x7f0cdc100820 2023-10-19T12:35:40.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:40.851+0000 7f0cd2ffd700 1 --2- 172.21.15.46:0/4203317711 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f0cc80a13f0 0x7f0cc80a38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:35:40.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:40.851+0000 7f0cd2ffd700 1 -- 172.21.15.46:0/4203317711 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f0cd80cbee0 con 0x7f0cdc100820 2023-10-19T12:35:40.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:40.851+0000 7f0ce1512700 1 --2- 172.21.15.46:0/4203317711 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f0cc80a13f0 0x7f0cc80a38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:35:40.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:40.852+0000 7f0ce1512700 1 --2- 172.21.15.46:0/4203317711 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f0cc80a13f0 0x7f0cc80a38b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc009cb0 tx=0x7f0ccc009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:35:40.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:40.855+0000 7f0cd2ffd700 1 -- 172.21.15.46:0/4203317711 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0cd8097200 con 0x7f0cdc100820 2023-10-19T12:35:41.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:40 smithi157 ceph-mon[134109]: mgrmap e15: x(active, since 73s), standbys: z, y 2023-10-19T12:35:41.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:40 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-10-19T12:35:41.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:40 smithi157 ceph-mon[134109]: from='client.? ' entity='client.admin' 2023-10-19T12:35:41.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:40 smithi195 ceph-mon[134493]: mgrmap e15: x(active, since 73s), standbys: z, y 2023-10-19T12:35:41.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:40 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-10-19T12:35:41.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:40 smithi195 ceph-mon[134493]: from='client.? ' entity='client.admin' 2023-10-19T12:35:41.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:41.129+0000 7f0ce3f77700 1 -- 172.21.15.46:0/4203317711 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) v1 -- 0x7f0cdc10c070 con 0x7f0cdc100820 2023-10-19T12:35:41.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:41.133+0000 7f0cd2ffd700 1 -- 172.21.15.46:0/4203317711 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v18)=0 v18) v1 ==== 119+0+0 (secure 0 0 0) 0x7f0cd809a820 con 0x7f0cdc100820 2023-10-19T12:35:41.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:41.135+0000 7f0ce3f77700 1 -- 172.21.15.46:0/4203317711 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f0cc80a13f0 msgr2=0x7f0cc80a38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:35:41.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:41.135+0000 7f0ce3f77700 1 --2- 172.21.15.46:0/4203317711 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f0cc80a13f0 0x7f0cc80a38b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc009cb0 tx=0x7f0ccc009260 comp rx=0 tx=0).stop 2023-10-19T12:35:41.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:41.135+0000 7f0ce3f77700 1 -- 172.21.15.46:0/4203317711 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0cdc100820 msgr2=0x7f0cdc198980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:35:41.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:41.135+0000 7f0ce3f77700 1 --2- 172.21.15.46:0/4203317711 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0cdc100820 0x7f0cdc198980 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0cd8009fd0 tx=0x7f0cd800f690 comp rx=0 tx=0).stop 2023-10-19T12:35:41.140 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:41.136+0000 7f0ce3f77700 1 -- 172.21.15.46:0/4203317711 shutdown_connections 2023-10-19T12:35:41.140 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:41.136+0000 7f0ce3f77700 1 --2- 172.21.15.46:0/4203317711 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0cdc1023c0 0x7f0cdc19fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:41.140 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:41.136+0000 7f0ce3f77700 1 --2- 172.21.15.46:0/4203317711 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0cdc100820 0x7f0cdc198980 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:41.140 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:41.136+0000 7f0ce3f77700 1 --2- 172.21.15.46:0/4203317711 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f0cc80a13f0 0x7f0cc80a38b0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:41.140 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:41.136+0000 7f0ce3f77700 1 --2- 172.21.15.46:0/4203317711 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0cdc101a20 0x7f0cdc198ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:41.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:41.136+0000 7f0ce3f77700 1 -- 172.21.15.46:0/4203317711 >> 172.21.15.46:0/4203317711 conn(0x7f0cdc0fbdc0 msgr2=0x7f0cdc107210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:35:41.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:41.136+0000 7f0ce3f77700 1 -- 172.21.15.46:0/4203317711 shutdown_connections 2023-10-19T12:35:41.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:41.136+0000 7f0ce3f77700 1 -- 172.21.15.46:0/4203317711 wait complete. 2023-10-19T12:35:41.346 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '96a8be3c-6e7b-11ee-8db6-212e2dc638e7', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi046') 2023-10-19T12:35:41.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:41.200+0000 7f8faa3ca700 1 -- 172.21.15.46:0/3949376417 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8fa4108700 msgr2=0x7f8fa410ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:35:41.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:41.200+0000 7f8faa3ca700 1 --2- 172.21.15.46:0/3949376417 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8fa4108700 0x7f8fa410ab90 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8f94009990 tx=0x7f8f94009ca0 comp rx=0 tx=0).stop 2023-10-19T12:35:41.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:41.200+0000 7f8faa3ca700 1 -- 172.21.15.46:0/3949376417 shutdown_connections 2023-10-19T12:35:41.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:41.200+0000 7f8faa3ca700 1 --2- 172.21.15.46:0/3949376417 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8fa4108700 0x7f8fa410ab90 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:41.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:41.200+0000 7f8faa3ca700 1 --2- 172.21.15.46:0/3949376417 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8fa40747c0 0x7f8fa4072c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:41.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:41.200+0000 7f8faa3ca700 1 --2- 172.21.15.46:0/3949376417 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8fa40731f0 0x7f8fa4073670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:41.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:41.200+0000 7f8faa3ca700 1 -- 172.21.15.46:0/3949376417 >> 172.21.15.46:0/3949376417 conn(0x7f8fa40fbdc0 msgr2=0x7f8fa40fe200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:35:41.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:41.200+0000 7f8faa3ca700 1 -- 172.21.15.46:0/3949376417 shutdown_connections 2023-10-19T12:35:41.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:41.200+0000 7f8faa3ca700 1 -- 172.21.15.46:0/3949376417 wait complete. 2023-10-19T12:35:41.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:41.201+0000 7f8faa3ca700 1 Processor -- start 2023-10-19T12:35:41.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:41.201+0000 7f8faa3ca700 1 -- start start 2023-10-19T12:35:41.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:41.202+0000 7f8faa3ca700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8fa40731f0 0x7f8fa41988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:35:41.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:41.202+0000 7f8faa3ca700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8fa40747c0 0x7f8fa4198e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:35:41.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:41.202+0000 7f8faa3ca700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8fa4108700 0x7f8fa419fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:35:41.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:41.202+0000 7f8faa3ca700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa41a0420 con 0x7f8fa4108700 2023-10-19T12:35:41.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:41.202+0000 7f8faa3ca700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa41a0560 con 0x7f8fa40747c0 2023-10-19T12:35:41.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:41.202+0000 7f8faa3ca700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa41a06f0 con 0x7f8fa40731f0 2023-10-19T12:35:41.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:41.202+0000 7f8fa8967700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8fa4108700 0x7f8fa419fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:35:41.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:41.202+0000 7f8fa8967700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8fa4108700 0x7f8fa419fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53494/0 (socket says 172.21.15.46:53494) 2023-10-19T12:35:41.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:41.202+0000 7f8fa8967700 1 -- 172.21.15.46:0/1508974632 learned_addr learned my addr 172.21.15.46:0/1508974632 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:35:41.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:41.202+0000 7f8fa3fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8fa40731f0 0x7f8fa41988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:35:41.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:41.202+0000 7f8fa37fe700 1 --2- 172.21.15.46:0/1508974632 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8fa40747c0 0x7f8fa4198e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:35:41.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:41.202+0000 7f8fa8967700 1 -- 172.21.15.46:0/1508974632 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8fa40731f0 msgr2=0x7f8fa41988e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:35:41.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:41.202+0000 7f8fa8967700 1 --2- 172.21.15.46:0/1508974632 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8fa40731f0 0x7f8fa41988e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:41.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:41.202+0000 7f8fa8967700 1 -- 172.21.15.46:0/1508974632 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8fa40747c0 msgr2=0x7f8fa4198e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:35:41.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:41.202+0000 7f8fa8967700 1 --2- 172.21.15.46:0/1508974632 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8fa40747c0 0x7f8fa4198e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:41.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:41.203+0000 7f8fa8967700 1 -- 172.21.15.46:0/1508974632 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f940095f0 con 0x7f8fa4108700 2023-10-19T12:35:41.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:41.203+0000 7f8fa8967700 1 --2- 172.21.15.46:0/1508974632 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8fa4108700 0x7f8fa419fe50 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8f94005910 tx=0x7f8f94005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:35:41.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:41.203+0000 7f8fa17fa700 1 -- 172.21.15.46:0/1508974632 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f9401d070 con 0x7f8fa4108700 2023-10-19T12:35:41.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:41.203+0000 7f8fa17fa700 1 -- 172.21.15.46:0/1508974632 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8f94022470 con 0x7f8fa4108700 2023-10-19T12:35:41.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:41.203+0000 7f8fa17fa700 1 -- 172.21.15.46:0/1508974632 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f94017650 con 0x7f8fa4108700 2023-10-19T12:35:41.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:41.203+0000 7f8faa3ca700 1 -- 172.21.15.46:0/1508974632 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fa41a0970 con 0x7f8fa4108700 2023-10-19T12:35:41.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:41.203+0000 7f8faa3ca700 1 -- 172.21.15.46:0/1508974632 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fa41a0d80 con 0x7f8fa4108700 2023-10-19T12:35:41.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:41.204+0000 7f8faa3ca700 1 -- 172.21.15.46:0/1508974632 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fa4107510 con 0x7f8fa4108700 2023-10-19T12:35:41.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:41.206+0000 7f8fa17fa700 1 -- 172.21.15.46:0/1508974632 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 15) v1 ==== 135947+0+0 (secure 0 0 0) 0x7f8f940225e0 con 0x7f8fa4108700 2023-10-19T12:35:41.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:41.207+0000 7f8fa17fa700 1 --2- 172.21.15.46:0/1508974632 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f8f900a1470 0x7f8f900a3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:35:41.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:41.208+0000 7f8fa3fff700 1 --2- 172.21.15.46:0/1508974632 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f8f900a1470 0x7f8f900a3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:35:41.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:41.208+0000 7f8fa17fa700 1 -- 172.21.15.46:0/1508974632 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f8f940cc330 con 0x7f8fa4108700 2023-10-19T12:35:41.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:41.208+0000 7f8fa3fff700 1 --2- 172.21.15.46:0/1508974632 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f8f900a1470 0x7f8f900a3930 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c00f540 tx=0x7f8f9c00b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:35:41.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:41.212+0000 7f8fa17fa700 1 -- 172.21.15.46:0/1508974632 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f8f94097650 con 0x7f8fa4108700 2023-10-19T12:35:41.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:41.444+0000 7f8faa3ca700 1 -- 172.21.15.46:0/1508974632 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) v1 -- 0x7f8fa404e4c0 con 0x7f8fa4108700 2023-10-19T12:35:41.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:41.448+0000 7f8fa17fa700 1 -- 172.21.15.46:0/1508974632 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v19)=0 v19) v1 ==== 116+0+0 (secure 0 0 0) 0x7f8f9409ac70 con 0x7f8fa4108700 2023-10-19T12:35:41.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:41.450+0000 7f8faa3ca700 1 -- 172.21.15.46:0/1508974632 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f8f900a1470 msgr2=0x7f8f900a3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:35:41.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:41.450+0000 7f8faa3ca700 1 --2- 172.21.15.46:0/1508974632 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f8f900a1470 0x7f8f900a3930 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c00f540 tx=0x7f8f9c00b040 comp rx=0 tx=0).stop 2023-10-19T12:35:41.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:41.450+0000 7f8faa3ca700 1 -- 172.21.15.46:0/1508974632 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8fa4108700 msgr2=0x7f8fa419fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:35:41.539 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:41.450+0000 7f8faa3ca700 1 --2- 172.21.15.46:0/1508974632 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8fa4108700 0x7f8fa419fe50 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8f94005910 tx=0x7f8f94005740 comp rx=0 tx=0).stop 2023-10-19T12:35:41.539 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:41.451+0000 7f8faa3ca700 1 -- 172.21.15.46:0/1508974632 shutdown_connections 2023-10-19T12:35:41.539 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:41.451+0000 7f8faa3ca700 1 --2- 172.21.15.46:0/1508974632 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8fa4108700 0x7f8fa419fe50 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:41.539 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:41.451+0000 7f8faa3ca700 1 --2- 172.21.15.46:0/1508974632 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f8f900a1470 0x7f8f900a3930 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:41.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:41.451+0000 7f8faa3ca700 1 --2- 172.21.15.46:0/1508974632 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8fa40731f0 0x7f8fa41988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:41.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:41.451+0000 7f8faa3ca700 1 --2- 172.21.15.46:0/1508974632 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8fa40747c0 0x7f8fa4198e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:41.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:41.451+0000 7f8faa3ca700 1 -- 172.21.15.46:0/1508974632 >> 172.21.15.46:0/1508974632 conn(0x7f8fa40fbdc0 msgr2=0x7f8fa4104650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:35:41.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:41.451+0000 7f8faa3ca700 1 -- 172.21.15.46:0/1508974632 shutdown_connections 2023-10-19T12:35:41.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:41.451+0000 7f8faa3ca700 1 -- 172.21.15.46:0/1508974632 wait complete. 2023-10-19T12:35:42.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:41 smithi157 ceph-mon[134109]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:42.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:41 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/4203317711' entity='client.admin' 2023-10-19T12:35:42.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:41 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/1508974632' entity='client.admin' 2023-10-19T12:35:42.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:41 smithi195 ceph-mon[134493]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:42.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:41 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/4203317711' entity='client.admin' 2023-10-19T12:35:42.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:41 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/1508974632' entity='client.admin' 2023-10-19T12:35:42.145 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:41 smithi046 ceph-mon[98509]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:42.145 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:41 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/4203317711' entity='client.admin' 2023-10-19T12:35:42.145 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:41 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/1508974632' entity='client.admin' 2023-10-19T12:35:42.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.221+0000 7f2ccdfb7700 1 -- 172.21.15.46:0/3734017142 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2cc8103cb0 msgr2=0x7f2cc81060a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:35:42.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.221+0000 7f2ccdfb7700 1 --2- 172.21.15.46:0/3734017142 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2cc8103cb0 0x7f2cc81060a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc0098f0 tx=0x7f2cbc009c00 comp rx=0 tx=0).stop 2023-10-19T12:35:42.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.221+0000 7f2ccdfb7700 1 -- 172.21.15.46:0/3734017142 shutdown_connections 2023-10-19T12:35:42.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.221+0000 7f2ccdfb7700 1 --2- 172.21.15.46:0/3734017142 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2cc81065e0 0x7f2cc81089d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:42.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.221+0000 7f2ccdfb7700 1 --2- 172.21.15.46:0/3734017142 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2cc8101380 0x7f2cc8103770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:42.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.221+0000 7f2ccdfb7700 1 --2- 172.21.15.46:0/3734017142 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2cc8103cb0 0x7f2cc81060a0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:42.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.221+0000 7f2ccdfb7700 1 -- 172.21.15.46:0/3734017142 >> 172.21.15.46:0/3734017142 conn(0x7f2cc80facf0 msgr2=0x7f2cc80fd110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:35:42.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.222+0000 7f2ccdfb7700 1 -- 172.21.15.46:0/3734017142 shutdown_connections 2023-10-19T12:35:42.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.222+0000 7f2ccdfb7700 1 -- 172.21.15.46:0/3734017142 wait complete. 2023-10-19T12:35:42.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.223+0000 7f2ccdfb7700 1 Processor -- start 2023-10-19T12:35:42.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.223+0000 7f2ccdfb7700 1 -- start start 2023-10-19T12:35:42.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.224+0000 7f2ccdfb7700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2cc8101380 0x7f2cc81967a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:35:42.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.224+0000 7f2ccdfb7700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2cc8103cb0 0x7f2cc8196ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:35:42.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.224+0000 7f2ccdfb7700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2cc81065e0 0x7f2cc819dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:35:42.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.224+0000 7f2ccdfb7700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc819e2e0 con 0x7f2cc8103cb0 2023-10-19T12:35:42.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.224+0000 7f2ccdfb7700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc819e420 con 0x7f2cc8101380 2023-10-19T12:35:42.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.224+0000 7f2ccdfb7700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc819e5b0 con 0x7f2cc81065e0 2023-10-19T12:35:42.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.224+0000 7f2cc6ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2cc8103cb0 0x7f2cc8196ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:35:42.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.224+0000 7f2cc6ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2cc8103cb0 0x7f2cc8196ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53520/0 (socket says 172.21.15.46:53520) 2023-10-19T12:35:42.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.224+0000 7f2cc6ffd700 1 -- 172.21.15.46:0/3426145400 learned_addr learned my addr 172.21.15.46:0/3426145400 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:35:42.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.224+0000 7f2cc7fff700 1 --2- 172.21.15.46:0/3426145400 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2cc81065e0 0x7f2cc819dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:35:42.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.224+0000 7f2cc77fe700 1 --2- 172.21.15.46:0/3426145400 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2cc8101380 0x7f2cc81967a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:35:42.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.225+0000 7f2cc7fff700 1 -- 172.21.15.46:0/3426145400 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2cc8101380 msgr2=0x7f2cc81967a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:35:42.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.225+0000 7f2cc7fff700 1 --2- 172.21.15.46:0/3426145400 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2cc8101380 0x7f2cc81967a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:42.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.225+0000 7f2cc7fff700 1 -- 172.21.15.46:0/3426145400 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2cc8103cb0 msgr2=0x7f2cc8196ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:35:42.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.225+0000 7f2cc7fff700 1 --2- 172.21.15.46:0/3426145400 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2cc8103cb0 0x7f2cc8196ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:42.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.225+0000 7f2cc7fff700 1 -- 172.21.15.46:0/3426145400 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cbc009520 con 0x7f2cc81065e0 2023-10-19T12:35:42.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.225+0000 7f2cc6ffd700 1 --2- 172.21.15.46:0/3426145400 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2cc8103cb0 0x7f2cc8196ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:35:42.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.225+0000 7f2cc7fff700 1 --2- 172.21.15.46:0/3426145400 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2cc81065e0 0x7f2cc819dd10 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2cc0007f40 tx=0x7f2cc000d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:35:42.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.225+0000 7f2cc4ff9700 1 -- 172.21.15.46:0/3426145400 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc0004bb0 con 0x7f2cc81065e0 2023-10-19T12:35:42.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.225+0000 7f2cc4ff9700 1 -- 172.21.15.46:0/3426145400 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2cc000f040 con 0x7f2cc81065e0 2023-10-19T12:35:42.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.225+0000 7f2ccdfb7700 1 -- 172.21.15.46:0/3426145400 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cc819e890 con 0x7f2cc81065e0 2023-10-19T12:35:42.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.225+0000 7f2cc4ff9700 1 -- 172.21.15.46:0/3426145400 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc0005900 con 0x7f2cc81065e0 2023-10-19T12:35:42.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.225+0000 7f2ccdfb7700 1 -- 172.21.15.46:0/3426145400 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cc819ed40 con 0x7f2cc81065e0 2023-10-19T12:35:42.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.227+0000 7f2ccdfb7700 1 -- 172.21.15.46:0/3426145400 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cc80fc870 con 0x7f2cc81065e0 2023-10-19T12:35:42.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.229+0000 7f2cc4ff9700 1 -- 172.21.15.46:0/3426145400 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 15) v1 ==== 135947+0+0 (secure 0 0 0) 0x7f2cc0005020 con 0x7f2cc81065e0 2023-10-19T12:35:42.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.231+0000 7f2cc4ff9700 1 --2- 172.21.15.46:0/3426145400 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f2cb00a13f0 0x7f2cb00a38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:35:42.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.231+0000 7f2cc4ff9700 1 -- 172.21.15.46:0/3426145400 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f2cc00ca8c0 con 0x7f2cc81065e0 2023-10-19T12:35:42.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.231+0000 7f2cc77fe700 1 --2- 172.21.15.46:0/3426145400 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f2cb00a13f0 0x7f2cb00a38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:35:42.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.232+0000 7f2cc77fe700 1 --2- 172.21.15.46:0/3426145400 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f2cb00a13f0 0x7f2cb00a38b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2cb8005fd0 tx=0x7f2cb8009310 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:35:42.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.234+0000 7f2cc4ff9700 1 -- 172.21.15.46:0/3426145400 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f2cc004f100 con 0x7f2cc81065e0 2023-10-19T12:35:42.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.527+0000 7f2ccdfb7700 1 -- 172.21.15.46:0/3426145400 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command([{prefix=config set, name=mds_bal_fragment_size_max}] v 0) v1 -- 0x7f2cc810c2e0 con 0x7f2cc81065e0 2023-10-19T12:35:42.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.532+0000 7f2cc4ff9700 1 -- 172.21.15.46:0/3426145400 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_fragment_size_max}]=0 v20)=0 v20) v1 ==== 127+0+0 (secure 0 0 0) 0x7f2cc0095b50 con 0x7f2cc81065e0 2023-10-19T12:35:42.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.535+0000 7f2ccdfb7700 1 -- 172.21.15.46:0/3426145400 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f2cb00a13f0 msgr2=0x7f2cb00a38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:35:42.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.535+0000 7f2ccdfb7700 1 --2- 172.21.15.46:0/3426145400 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f2cb00a13f0 0x7f2cb00a38b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2cb8005fd0 tx=0x7f2cb8009310 comp rx=0 tx=0).stop 2023-10-19T12:35:42.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.535+0000 7f2ccdfb7700 1 -- 172.21.15.46:0/3426145400 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2cc81065e0 msgr2=0x7f2cc819dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:35:42.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.535+0000 7f2ccdfb7700 1 --2- 172.21.15.46:0/3426145400 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2cc81065e0 0x7f2cc819dd10 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2cc0007f40 tx=0x7f2cc000d3b0 comp rx=0 tx=0).stop 2023-10-19T12:35:42.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.535+0000 7f2ccdfb7700 1 -- 172.21.15.46:0/3426145400 shutdown_connections 2023-10-19T12:35:42.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.535+0000 7f2ccdfb7700 1 --2- 172.21.15.46:0/3426145400 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f2cb00a13f0 0x7f2cb00a38b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:42.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.535+0000 7f2ccdfb7700 1 --2- 172.21.15.46:0/3426145400 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2cc81065e0 0x7f2cc819dd10 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:42.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.535+0000 7f2ccdfb7700 1 --2- 172.21.15.46:0/3426145400 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2cc8101380 0x7f2cc81967a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:42.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.535+0000 7f2ccdfb7700 1 --2- 172.21.15.46:0/3426145400 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2cc8103cb0 0x7f2cc8196ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:42.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.535+0000 7f2ccdfb7700 1 -- 172.21.15.46:0/3426145400 >> 172.21.15.46:0/3426145400 conn(0x7f2cc80facf0 msgr2=0x7f2cc8101ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:35:42.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.535+0000 7f2ccdfb7700 1 -- 172.21.15.46:0/3426145400 shutdown_connections 2023-10-19T12:35:42.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.536+0000 7f2ccdfb7700 1 -- 172.21.15.46:0/3426145400 wait complete. 2023-10-19T12:35:42.957 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-19T12:35:43.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.293+0000 7f7364714700 1 -- 172.21.15.46:0/2458694748 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f735c0ff0f0 msgr2=0x7f735c0ff510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:35:43.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.293+0000 7f7364714700 1 --2- 172.21.15.46:0/2458694748 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f735c0ff0f0 0x7f735c0ff510 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7358009990 tx=0x7f7358009ca0 comp rx=0 tx=0).stop 2023-10-19T12:35:43.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.294+0000 7f7364714700 1 -- 172.21.15.46:0/2458694748 shutdown_connections 2023-10-19T12:35:43.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.294+0000 7f7364714700 1 --2- 172.21.15.46:0/2458694748 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f735c100410 0x7f735c100890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:43.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.294+0000 7f7364714700 1 --2- 172.21.15.46:0/2458694748 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f735c0ff0f0 0x7f735c0ff510 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:43.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.294+0000 7f7364714700 1 --2- 172.21.15.46:0/2458694748 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f735c0ffa50 0x7f735c0ffed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:43.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.294+0000 7f7364714700 1 -- 172.21.15.46:0/2458694748 >> 172.21.15.46:0/2458694748 conn(0x7f735c0facf0 msgr2=0x7f735c0fd110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:35:43.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.294+0000 7f7364714700 1 -- 172.21.15.46:0/2458694748 shutdown_connections 2023-10-19T12:35:43.640 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.294+0000 7f7364714700 1 -- 172.21.15.46:0/2458694748 wait complete. 2023-10-19T12:35:43.640 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.295+0000 7f7364714700 1 Processor -- start 2023-10-19T12:35:43.640 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.295+0000 7f7364714700 1 -- start start 2023-10-19T12:35:43.640 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.296+0000 7f7364714700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f735c0ff0f0 0x7f735c198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:35:43.640 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.296+0000 7f7364714700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f735c0ffa50 0x7f735c198ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:35:43.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.296+0000 7f7364714700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f735c100410 0x7f735c19fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:35:43.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.296+0000 7f7364714700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f735c1a04c0 con 0x7f735c0ffa50 2023-10-19T12:35:43.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.296+0000 7f7364714700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f735c1a0600 con 0x7f735c100410 2023-10-19T12:35:43.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.296+0000 7f7364714700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f735c1a0790 con 0x7f735c0ff0f0 2023-10-19T12:35:43.642 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.296+0000 7f7361caf700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f735c0ffa50 0x7f735c198ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:35:43.642 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.296+0000 7f7361caf700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f735c0ffa50 0x7f735c198ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53530/0 (socket says 172.21.15.46:53530) 2023-10-19T12:35:43.642 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.296+0000 7f7361caf700 1 -- 172.21.15.46:0/3620062164 learned_addr learned my addr 172.21.15.46:0/3620062164 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:35:43.642 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.296+0000 7f7362cb1700 1 --2- 172.21.15.46:0/3620062164 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f735c100410 0x7f735c19fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:35:43.642 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.297+0000 7f7361caf700 1 -- 172.21.15.46:0/3620062164 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f735c0ff0f0 msgr2=0x7f735c198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:35:43.643 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.297+0000 7f7361caf700 1 --2- 172.21.15.46:0/3620062164 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f735c0ff0f0 0x7f735c198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:43.643 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.297+0000 7f7361caf700 1 -- 172.21.15.46:0/3620062164 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f735c100410 msgr2=0x7f735c19fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:35:43.643 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.297+0000 7f7361caf700 1 --2- 172.21.15.46:0/3620062164 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f735c100410 0x7f735c19fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:43.643 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.297+0000 7f7361caf700 1 -- 172.21.15.46:0/3620062164 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73580095f0 con 0x7f735c0ffa50 2023-10-19T12:35:43.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.297+0000 7f7361caf700 1 --2- 172.21.15.46:0/3620062164 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f735c0ffa50 0x7f735c198ec0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f734c00e9d0 tx=0x7f734c00ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:35:43.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.297+0000 7f73537fe700 1 -- 172.21.15.46:0/3620062164 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f734c009790 con 0x7f735c0ffa50 2023-10-19T12:35:43.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.297+0000 7f7364714700 1 -- 172.21.15.46:0/3620062164 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f735c1a0a70 con 0x7f735c0ffa50 2023-10-19T12:35:43.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.297+0000 7f73537fe700 1 -- 172.21.15.46:0/3620062164 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f734c00cbd0 con 0x7f735c0ffa50 2023-10-19T12:35:43.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.297+0000 7f7364714700 1 -- 172.21.15.46:0/3620062164 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f735c1a0fc0 con 0x7f735c0ffa50 2023-10-19T12:35:43.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.297+0000 7f73537fe700 1 -- 172.21.15.46:0/3620062164 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f734c018680 con 0x7f735c0ffa50 2023-10-19T12:35:43.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.299+0000 7f7364714700 1 -- 172.21.15.46:0/3620062164 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7340005320 con 0x7f735c0ffa50 2023-10-19T12:35:43.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.302+0000 7f73537fe700 1 -- 172.21.15.46:0/3620062164 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 15) v1 ==== 135947+0+0 (secure 0 0 0) 0x7f734c00cd40 con 0x7f735c0ffa50 2023-10-19T12:35:43.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.303+0000 7f73537fe700 1 --2- 172.21.15.46:0/3620062164 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f73480a1470 0x7f73480a3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:35:43.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.303+0000 7f73537fe700 1 -- 172.21.15.46:0/3620062164 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f734c014070 con 0x7f735c0ffa50 2023-10-19T12:35:43.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.304+0000 7f73624b0700 1 --2- 172.21.15.46:0/3620062164 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f73480a1470 0x7f73480a3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:35:43.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.304+0000 7f73624b0700 1 --2- 172.21.15.46:0/3620062164 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f73480a1470 0x7f73480a3930 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f73580095c0 tx=0x7f7358009530 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:35:43.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.310+0000 7f73537fe700 1 -- 172.21.15.46:0/3620062164 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f734c096b50 con 0x7f735c0ffa50 2023-10-19T12:35:43.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.574+0000 7f7364714700 1 -- 172.21.15.46:0/3620062164 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) v1 -- 0x7f7340005190 con 0x7f735c0ffa50 2023-10-19T12:35:43.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.578+0000 7f73537fe700 1 -- 172.21.15.46:0/3620062164 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v21)=0 v21) v1 ==== 116+0+0 (secure 0 0 0) 0x7f734c09a170 con 0x7f735c0ffa50 2023-10-19T12:35:43.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.580+0000 7f7364714700 1 -- 172.21.15.46:0/3620062164 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f73480a1470 msgr2=0x7f73480a3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:35:43.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.580+0000 7f7364714700 1 --2- 172.21.15.46:0/3620062164 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f73480a1470 0x7f73480a3930 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f73580095c0 tx=0x7f7358009530 comp rx=0 tx=0).stop 2023-10-19T12:35:43.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.580+0000 7f7364714700 1 -- 172.21.15.46:0/3620062164 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f735c0ffa50 msgr2=0x7f735c198ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:35:43.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.580+0000 7f7364714700 1 --2- 172.21.15.46:0/3620062164 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f735c0ffa50 0x7f735c198ec0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f734c00e9d0 tx=0x7f734c00ece0 comp rx=0 tx=0).stop 2023-10-19T12:35:43.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.580+0000 7f7364714700 1 -- 172.21.15.46:0/3620062164 shutdown_connections 2023-10-19T12:35:43.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.580+0000 7f7364714700 1 --2- 172.21.15.46:0/3620062164 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f735c100410 0x7f735c19fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:43.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.581+0000 7f7364714700 1 --2- 172.21.15.46:0/3620062164 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f73480a1470 0x7f73480a3930 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:43.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.581+0000 7f7364714700 1 --2- 172.21.15.46:0/3620062164 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f735c0ff0f0 0x7f735c198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:43.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.581+0000 7f7364714700 1 --2- 172.21.15.46:0/3620062164 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f735c0ffa50 0x7f735c198ec0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:43.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.581+0000 7f7364714700 1 -- 172.21.15.46:0/3620062164 >> 172.21.15.46:0/3620062164 conn(0x7f735c0facf0 msgr2=0x7f735c0fc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:35:43.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.581+0000 7f7364714700 1 -- 172.21.15.46:0/3620062164 shutdown_connections 2023-10-19T12:35:43.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:42.581+0000 7f7364714700 1 -- 172.21.15.46:0/3620062164 wait complete. 2023-10-19T12:35:43.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:43 smithi046 ceph-mon[98509]: from='client.? ' entity='client.admin' 2023-10-19T12:35:43.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:43 smithi046 ceph-mon[98509]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:43.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:43 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/3620062164' entity='client.admin' 2023-10-19T12:35:43.837 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:43 smithi157 ceph-mon[134109]: from='client.? ' entity='client.admin' 2023-10-19T12:35:43.838 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:43 smithi157 ceph-mon[134109]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:43.838 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:43 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/3620062164' entity='client.admin' 2023-10-19T12:35:43.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:43 smithi195 ceph-mon[134493]: from='client.? ' entity='client.admin' 2023-10-19T12:35:43.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:43 smithi195 ceph-mon[134493]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:43.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:43 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/3620062164' entity='client.admin' 2023-10-19T12:35:44.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:43.958+0000 7f238f04d700 1 -- 172.21.15.46:0/74043298 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2388100840 msgr2=0x7f2388100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:35:44.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:43.958+0000 7f238f04d700 1 --2- 172.21.15.46:0/74043298 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2388100840 0x7f2388100c60 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f237c0099c0 tx=0x7f237c009cd0 comp rx=0 tx=0).stop 2023-10-19T12:35:44.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:43.959+0000 7f238f04d700 1 -- 172.21.15.46:0/74043298 shutdown_connections 2023-10-19T12:35:44.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:43.959+0000 7f238f04d700 1 --2- 172.21.15.46:0/74043298 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f23881023e0 0x7f2388108c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:44.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:43.959+0000 7f238f04d700 1 --2- 172.21.15.46:0/74043298 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2388100840 0x7f2388100c60 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:44.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:43.959+0000 7f238f04d700 1 --2- 172.21.15.46:0/74043298 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2388101a40 0x7f2388101ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:44.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:43.959+0000 7f238f04d700 1 -- 172.21.15.46:0/74043298 >> 172.21.15.46:0/74043298 conn(0x7f23880fbe00 msgr2=0x7f23880fe220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:35:44.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:43.959+0000 7f238f04d700 1 -- 172.21.15.46:0/74043298 shutdown_connections 2023-10-19T12:35:44.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:43.959+0000 7f238f04d700 1 -- 172.21.15.46:0/74043298 wait complete. 2023-10-19T12:35:44.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:43.960+0000 7f238f04d700 1 Processor -- start 2023-10-19T12:35:44.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:43.960+0000 7f238f04d700 1 -- start start 2023-10-19T12:35:44.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:43.960+0000 7f238f04d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2388100840 0x7f2388074540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:35:44.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:43.960+0000 7f238f04d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2388101a40 0x7f2388072be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:35:44.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:43.960+0000 7f238f04d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f23881023e0 0x7f2388073120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:35:44.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:43.960+0000 7f238f04d700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23880738c0 con 0x7f2388100840 2023-10-19T12:35:44.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:43.960+0000 7f238f04d700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2388073a30 con 0x7f23881023e0 2023-10-19T12:35:44.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:43.960+0000 7f238f04d700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23881a0810 con 0x7f2388101a40 2023-10-19T12:35:44.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:43.960+0000 7f238cde9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2388100840 0x7f2388074540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:35:44.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:43.960+0000 7f238cde9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2388100840 0x7f2388074540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49016/0 (socket says 172.21.15.46:49016) 2023-10-19T12:35:44.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:43.960+0000 7f238cde9700 1 -- 172.21.15.46:0/469877316 learned_addr learned my addr 172.21.15.46:0/469877316 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:35:44.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:43.961+0000 7f238d5ea700 1 --2- 172.21.15.46:0/469877316 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f23881023e0 0x7f2388073120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:35:44.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:43.961+0000 7f238cde9700 1 -- 172.21.15.46:0/469877316 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2388101a40 msgr2=0x7f2388072be0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-19T12:35:44.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:43.961+0000 7f238cde9700 1 --2- 172.21.15.46:0/469877316 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2388101a40 0x7f2388072be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:44.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:43.961+0000 7f238cde9700 1 -- 172.21.15.46:0/469877316 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f23881023e0 msgr2=0x7f2388073120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:35:44.028 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:43.961+0000 7f238cde9700 1 --2- 172.21.15.46:0/469877316 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f23881023e0 0x7f2388073120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:44.028 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:43.961+0000 7f238cde9700 1 -- 172.21.15.46:0/469877316 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f237c0095f0 con 0x7f2388100840 2023-10-19T12:35:44.028 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:43.961+0000 7f238cde9700 1 --2- 172.21.15.46:0/469877316 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2388100840 0x7f2388074540 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f237c003730 tx=0x7f237c00fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:35:44.028 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:43.961+0000 7f2385ffb700 1 -- 172.21.15.46:0/469877316 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f237c01d070 con 0x7f2388100840 2023-10-19T12:35:44.028 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:43.961+0000 7f2385ffb700 1 -- 172.21.15.46:0/469877316 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f237c00fe70 con 0x7f2388100840 2023-10-19T12:35:44.028 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:43.961+0000 7f238f04d700 1 -- 172.21.15.46:0/469877316 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23881a0a40 con 0x7f2388100840 2023-10-19T12:35:44.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:43.961+0000 7f2385ffb700 1 -- 172.21.15.46:0/469877316 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f237c004b30 con 0x7f2388100840 2023-10-19T12:35:44.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:43.962+0000 7f238f04d700 1 -- 172.21.15.46:0/469877316 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23881a0eb0 con 0x7f2388100840 2023-10-19T12:35:44.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:43.963+0000 7f238f04d700 1 -- 172.21.15.46:0/469877316 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2388107d20 con 0x7f2388100840 2023-10-19T12:35:44.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:43.965+0000 7f2385ffb700 1 -- 172.21.15.46:0/469877316 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 15) v1 ==== 135947+0+0 (secure 0 0 0) 0x7f237c004cf0 con 0x7f2388100840 2023-10-19T12:35:44.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:43.966+0000 7f2385ffb700 1 --2- 172.21.15.46:0/469877316 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f23780a1470 0x7f23780a3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:35:44.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:43.966+0000 7f2385ffb700 1 -- 172.21.15.46:0/469877316 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f237c0cbe90 con 0x7f2388100840 2023-10-19T12:35:44.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:43.966+0000 7f2387fff700 1 --2- 172.21.15.46:0/469877316 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f23780a1470 0x7f23780a3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:35:44.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:43.967+0000 7f2387fff700 1 --2- 172.21.15.46:0/469877316 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f23780a1470 0x7f23780a3930 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2374009af0 tx=0x7f2374009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:35:44.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:43.972+0000 7f2385ffb700 1 -- 172.21.15.46:0/469877316 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f237c0971b0 con 0x7f2388100840 2023-10-19T12:35:44.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:44.195+0000 7f238f04d700 1 -- 172.21.15.46:0/469877316 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) v1 -- 0x7f238810c340 con 0x7f2388100840 2023-10-19T12:35:44.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:44.199+0000 7f2385ffb700 1 -- 172.21.15.46:0/469877316 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v22)=0 v22) v1 ==== 122+0+0 (secure 0 0 0) 0x7f237c09a7d0 con 0x7f2388100840 2023-10-19T12:35:44.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:44.201+0000 7f238f04d700 1 -- 172.21.15.46:0/469877316 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f23780a1470 msgr2=0x7f23780a3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:35:44.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:44.201+0000 7f238f04d700 1 --2- 172.21.15.46:0/469877316 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f23780a1470 0x7f23780a3930 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2374009af0 tx=0x7f2374009260 comp rx=0 tx=0).stop 2023-10-19T12:35:44.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:44.201+0000 7f238f04d700 1 -- 172.21.15.46:0/469877316 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2388100840 msgr2=0x7f2388074540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:35:44.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:44.201+0000 7f238f04d700 1 --2- 172.21.15.46:0/469877316 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2388100840 0x7f2388074540 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f237c003730 tx=0x7f237c00fa00 comp rx=0 tx=0).stop 2023-10-19T12:35:44.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:44.201+0000 7f238f04d700 1 -- 172.21.15.46:0/469877316 shutdown_connections 2023-10-19T12:35:44.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:44.201+0000 7f238f04d700 1 --2- 172.21.15.46:0/469877316 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f23881023e0 0x7f2388073120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:44.206 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:44.201+0000 7f238f04d700 1 --2- 172.21.15.46:0/469877316 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2388100840 0x7f2388074540 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:44.206 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:44.201+0000 7f238f04d700 1 --2- 172.21.15.46:0/469877316 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f23780a1470 0x7f23780a3930 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:44.206 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:44.201+0000 7f238f04d700 1 --2- 172.21.15.46:0/469877316 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2388101a40 0x7f2388072be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:44.206 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:44.201+0000 7f238f04d700 1 -- 172.21.15.46:0/469877316 >> 172.21.15.46:0/469877316 conn(0x7f23880fbe00 msgr2=0x7f2388104e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:35:44.206 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:44.201+0000 7f238f04d700 1 -- 172.21.15.46:0/469877316 shutdown_connections 2023-10-19T12:35:44.207 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:44.202+0000 7f238f04d700 1 -- 172.21.15.46:0/469877316 wait complete. 2023-10-19T12:35:44.437 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '96a8be3c-6e7b-11ee-8db6-212e2dc638e7', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi046') 2023-10-19T12:35:44.438 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '96a8be3c-6e7b-11ee-8db6-212e2dc638e7', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi046') 2023-10-19T12:35:44.438 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '96a8be3c-6e7b-11ee-8db6-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi046') 2023-10-19T12:35:44.439 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '96a8be3c-6e7b-11ee-8db6-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi046') 2023-10-19T12:35:44.439 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '96a8be3c-6e7b-11ee-8db6-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '1'], check_status=True, hostname='smithi046') 2023-10-19T12:35:44.439 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '96a8be3c-6e7b-11ee-8db6-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_fragment_size_max', '10000'], check_status=True, hostname='smithi046') 2023-10-19T12:35:44.587 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-19T12:35:44.588 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-19T12:35:44.954 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:44.827+0000 7f49fe85b700 1 -- 172.21.15.46:0/1551051333 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49f8073250 msgr2=0x7f49f80736d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:35:44.954 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:44.827+0000 7f49fe85b700 1 --2- 172.21.15.46:0/1551051333 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49f8073250 0x7f49f80736d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f49ec009990 tx=0x7f49ec009ca0 comp rx=0 tx=0).stop 2023-10-19T12:35:44.955 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:44.827+0000 7f49fe85b700 1 -- 172.21.15.46:0/1551051333 shutdown_connections 2023-10-19T12:35:44.955 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:44.827+0000 7f49fe85b700 1 --2- 172.21.15.46:0/1551051333 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f49f810ce20 0x7f49f810f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:44.955 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:44.827+0000 7f49fe85b700 1 --2- 172.21.15.46:0/1551051333 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f49f8074820 0x7f49f8072c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:44.955 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:44.827+0000 7f49fe85b700 1 --2- 172.21.15.46:0/1551051333 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49f8073250 0x7f49f80736d0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:44.955 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:44.827+0000 7f49fe85b700 1 -- 172.21.15.46:0/1551051333 >> 172.21.15.46:0/1551051333 conn(0x7f49f80fbe00 msgr2=0x7f49f80fe220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:35:44.956 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:44.827+0000 7f49fe85b700 1 -- 172.21.15.46:0/1551051333 shutdown_connections 2023-10-19T12:35:44.956 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:44.827+0000 7f49fe85b700 1 -- 172.21.15.46:0/1551051333 wait complete. 2023-10-19T12:35:44.956 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:44.828+0000 7f49fe85b700 1 Processor -- start 2023-10-19T12:35:44.956 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:44.829+0000 7f49fe85b700 1 -- start start 2023-10-19T12:35:44.956 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:44.829+0000 7f49fe85b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f49f8073250 0x7f49f819cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:35:44.957 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:44.829+0000 7f49fe85b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49f8074820 0x7f49f819d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:35:44.957 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:44.829+0000 7f49fe85b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f49f810ce20 0x7f49f81a4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:35:44.957 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:44.829+0000 7f49fe85b700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49f81a48d0 con 0x7f49f8074820 2023-10-19T12:35:44.957 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:44.829+0000 7f49fe85b700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49f81a4a10 con 0x7f49f810ce20 2023-10-19T12:35:44.957 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:44.829+0000 7f49fe85b700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49f81a4ba0 con 0x7f49f8073250 2023-10-19T12:35:44.957 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:44.829+0000 7f49f77fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49f8074820 0x7f49f819d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:35:44.958 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:44.829+0000 7f49f7fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f49f8073250 0x7f49f819cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:35:44.958 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:44.830+0000 7f49f7fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f49f8073250 0x7f49f819cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:36982/0 (socket says 172.21.15.46:36982) 2023-10-19T12:35:44.958 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:44.830+0000 7f49f7fff700 1 -- 172.21.15.46:0/2087284119 learned_addr learned my addr 172.21.15.46:0/2087284119 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:35:44.958 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:44.830+0000 7f49f77fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49f8074820 0x7f49f819d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49030/0 (socket says 172.21.15.46:49030) 2023-10-19T12:35:44.959 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:44.830+0000 7f49fcdf8700 1 --2- 172.21.15.46:0/2087284119 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f49f810ce20 0x7f49f81a4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:35:44.959 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:44.830+0000 7f49f7fff700 1 -- 172.21.15.46:0/2087284119 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f49f810ce20 msgr2=0x7f49f81a4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:35:44.959 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:44.830+0000 7f49f7fff700 1 --2- 172.21.15.46:0/2087284119 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f49f810ce20 0x7f49f81a4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:44.959 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:44.830+0000 7f49f7fff700 1 -- 172.21.15.46:0/2087284119 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49f8074820 msgr2=0x7f49f819d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:35:44.959 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:44.830+0000 7f49f7fff700 1 --2- 172.21.15.46:0/2087284119 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49f8074820 0x7f49f819d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:44.959 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:44.830+0000 7f49f7fff700 1 -- 172.21.15.46:0/2087284119 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49ec0095f0 con 0x7f49f8073250 2023-10-19T12:35:44.960 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:44.830+0000 7f49f77fe700 1 --2- 172.21.15.46:0/2087284119 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49f8074820 0x7f49f819d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:35:44.960 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:44.830+0000 7f49f7fff700 1 --2- 172.21.15.46:0/2087284119 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f49f8073250 0x7f49f819cd90 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f49e800d9b0 tx=0x7f49e800dcc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:35:44.960 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:44.831+0000 7f49f57fa700 1 -- 172.21.15.46:0/2087284119 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e8009930 con 0x7f49f8073250 2023-10-19T12:35:44.960 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:44.831+0000 7f49f57fa700 1 -- 172.21.15.46:0/2087284119 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f49e8010460 con 0x7f49f8073250 2023-10-19T12:35:44.960 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:44.831+0000 7f49fe85b700 1 -- 172.21.15.46:0/2087284119 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49f81a4e80 con 0x7f49f8073250 2023-10-19T12:35:44.961 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:44.831+0000 7f49f57fa700 1 -- 172.21.15.46:0/2087284119 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e800f620 con 0x7f49f8073250 2023-10-19T12:35:44.961 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:44.831+0000 7f49fe85b700 1 -- 172.21.15.46:0/2087284119 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49f81a52a0 con 0x7f49f8073250 2023-10-19T12:35:44.961 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:44.832+0000 7f49fe85b700 1 -- 172.21.15.46:0/2087284119 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49f8103080 con 0x7f49f8073250 2023-10-19T12:35:44.961 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:44.834+0000 7f49f57fa700 1 -- 172.21.15.46:0/2087284119 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 15) v1 ==== 135947+0+0 (secure 0 0 0) 0x7f49e80108d0 con 0x7f49f8073250 2023-10-19T12:35:44.961 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:44.836+0000 7f49f57fa700 1 --2- 172.21.15.46:0/2087284119 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f49e00a1470 0x7f49e00a3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:35:44.962 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:44.837+0000 7f49f57fa700 1 -- 172.21.15.46:0/2087284119 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f49e80ca9f0 con 0x7f49f8073250 2023-10-19T12:35:44.962 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:44.837+0000 7f49f77fe700 1 --2- 172.21.15.46:0/2087284119 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f49e00a1470 0x7f49e00a3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:35:44.962 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:44.837+0000 7f49f77fe700 1 --2- 172.21.15.46:0/2087284119 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f49e00a1470 0x7f49e00a3930 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f49ec00b5c0 tx=0x7f49ec005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:35:44.962 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:44.840+0000 7f49f57fa700 1 -- 172.21.15.46:0/2087284119 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f49e8095c80 con 0x7f49f8073250 2023-10-19T12:35:45.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:45.082+0000 7f49fe85b700 1 -- 172.21.15.46:0/2087284119 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) v1 -- 0x7f49f8112960 con 0x7f49f8073250 2023-10-19T12:35:45.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:45.088+0000 7f49f57fa700 1 -- 172.21.15.46:0/2087284119 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v23)=0 v23) v1 ==== 118+0+0 (secure 0 0 0) 0x7f49e80992a0 con 0x7f49f8073250 2023-10-19T12:35:45.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:45.090+0000 7f49fe85b700 1 -- 172.21.15.46:0/2087284119 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f49e00a1470 msgr2=0x7f49e00a3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:35:45.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:45.090+0000 7f49fe85b700 1 --2- 172.21.15.46:0/2087284119 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f49e00a1470 0x7f49e00a3930 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f49ec00b5c0 tx=0x7f49ec005fd0 comp rx=0 tx=0).stop 2023-10-19T12:35:45.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:45.090+0000 7f49fe85b700 1 -- 172.21.15.46:0/2087284119 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f49f8073250 msgr2=0x7f49f819cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:35:45.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:45.090+0000 7f49fe85b700 1 --2- 172.21.15.46:0/2087284119 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f49f8073250 0x7f49f819cd90 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f49e800d9b0 tx=0x7f49e800dcc0 comp rx=0 tx=0).stop 2023-10-19T12:35:45.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:45.091+0000 7f49fe85b700 1 -- 172.21.15.46:0/2087284119 shutdown_connections 2023-10-19T12:35:45.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:45.091+0000 7f49fe85b700 1 --2- 172.21.15.46:0/2087284119 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f49f810ce20 0x7f49f81a4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:45.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:45.091+0000 7f49fe85b700 1 --2- 172.21.15.46:0/2087284119 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f49e00a1470 0x7f49e00a3930 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:45.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:45.091+0000 7f49fe85b700 1 --2- 172.21.15.46:0/2087284119 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f49f8073250 0x7f49f819cd90 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:45.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:45.091+0000 7f49fe85b700 1 --2- 172.21.15.46:0/2087284119 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49f8074820 0x7f49f819d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:45.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:45.091+0000 7f49fe85b700 1 -- 172.21.15.46:0/2087284119 >> 172.21.15.46:0/2087284119 conn(0x7f49f80fbe00 msgr2=0x7f49f81001c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:35:45.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:45.091+0000 7f49fe85b700 1 -- 172.21.15.46:0/2087284119 shutdown_connections 2023-10-19T12:35:45.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:45.091+0000 7f49fe85b700 1 -- 172.21.15.46:0/2087284119 wait complete. 2023-10-19T12:35:45.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:45 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:45.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:45 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:45.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:45 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:35:45.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:45 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:35:45.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:45 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:35:45.382 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:45 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:45.382 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:45 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/469877316' entity='client.admin' 2023-10-19T12:35:45.382 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:45 smithi195 ceph-mon[134493]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:45.382 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:45 smithi195 ceph-mon[134493]: from='client.? ' entity='client.admin' 2023-10-19T12:35:45.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:45 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:45.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:45 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:45.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:45 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:35:45.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:45 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:35:45.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:45 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:35:45.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:45 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:45.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:45 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/469877316' entity='client.admin' 2023-10-19T12:35:45.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:45 smithi046 ceph-mon[98509]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:45.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:45 smithi046 ceph-mon[98509]: from='client.? ' entity='client.admin' 2023-10-19T12:35:45.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:45 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:45.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:45 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:45.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:45 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:35:45.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:45 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:35:45.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:45 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:35:45.589 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:45 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:35:45.589 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:45 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/469877316' entity='client.admin' 2023-10-19T12:35:45.589 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:45 smithi157 ceph-mon[134109]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:45.589 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:45 smithi157 ceph-mon[134109]: from='client.? ' entity='client.admin' 2023-10-19T12:35:46.028 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '96a8be3c-6e7b-11ee-8db6-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_merge_size', '5'], check_status=True, hostname='smithi046') 2023-10-19T12:35:46.158 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-19T12:35:46.348 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:46.345+0000 7fbdaf63a700 1 -- 172.21.15.46:0/3610297024 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbda8100820 msgr2=0x7fbda8100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:35:46.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:46.345+0000 7fbdaf63a700 1 --2- 172.21.15.46:0/3610297024 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbda8100820 0x7fbda8100c40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fbda40099c0 tx=0x7fbda4009cd0 comp rx=0 tx=0).stop 2023-10-19T12:35:46.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:46.345+0000 7fbdaf63a700 1 -- 172.21.15.46:0/3610297024 shutdown_connections 2023-10-19T12:35:46.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:46.345+0000 7fbdaf63a700 1 --2- 172.21.15.46:0/3610297024 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbda81023c0 0x7fbda8108c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:46.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:46.345+0000 7fbdaf63a700 1 --2- 172.21.15.46:0/3610297024 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbda8100820 0x7fbda8100c40 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:46.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:46.345+0000 7fbdaf63a700 1 --2- 172.21.15.46:0/3610297024 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbda8101a20 0x7fbda8101e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:46.350 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:46.345+0000 7fbdaf63a700 1 -- 172.21.15.46:0/3610297024 >> 172.21.15.46:0/3610297024 conn(0x7fbda80fbdc0 msgr2=0x7fbda80fe200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:35:46.350 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:46.345+0000 7fbdaf63a700 1 -- 172.21.15.46:0/3610297024 shutdown_connections 2023-10-19T12:35:46.350 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:46.345+0000 7fbdaf63a700 1 -- 172.21.15.46:0/3610297024 wait complete. 2023-10-19T12:35:46.351 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:46.347+0000 7fbdaf63a700 1 Processor -- start 2023-10-19T12:35:46.351 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:46.347+0000 7fbdaf63a700 1 -- start start 2023-10-19T12:35:46.352 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:46.347+0000 7fbdaf63a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbda8100820 0x7fbda8198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:35:46.352 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:46.347+0000 7fbdaf63a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbda8101a20 0x7fbda8198ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:35:46.352 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:46.347+0000 7fbdaf63a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbda81023c0 0x7fbda819fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:35:46.352 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:46.347+0000 7fbdaf63a700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbda81a04c0 con 0x7fbda81023c0 2023-10-19T12:35:46.352 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:46.347+0000 7fbdaf63a700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbda81a0600 con 0x7fbda8100820 2023-10-19T12:35:46.352 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:46.347+0000 7fbdaf63a700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbda81a0790 con 0x7fbda8101a20 2023-10-19T12:35:46.353 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:46.347+0000 7fbdacbd5700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbda8101a20 0x7fbda8198ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:35:46.353 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:46.347+0000 7fbdacbd5700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbda8101a20 0x7fbda8198ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:37000/0 (socket says 172.21.15.46:37000) 2023-10-19T12:35:46.353 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:46.347+0000 7fbdacbd5700 1 -- 172.21.15.46:0/2836072459 learned_addr learned my addr 172.21.15.46:0/2836072459 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:35:46.353 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:46.347+0000 7fbdadbd7700 1 --2- 172.21.15.46:0/2836072459 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbda81023c0 0x7fbda819fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:35:46.353 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:46.348+0000 7fbdad3d6700 1 --2- 172.21.15.46:0/2836072459 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbda8100820 0x7fbda8198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:35:46.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:46.348+0000 7fbdacbd5700 1 -- 172.21.15.46:0/2836072459 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbda8100820 msgr2=0x7fbda8198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:35:46.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:46.348+0000 7fbdacbd5700 1 --2- 172.21.15.46:0/2836072459 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbda8100820 0x7fbda8198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:46.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:46.348+0000 7fbdacbd5700 1 -- 172.21.15.46:0/2836072459 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbda81023c0 msgr2=0x7fbda819fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:35:46.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:46.348+0000 7fbdacbd5700 1 --2- 172.21.15.46:0/2836072459 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbda81023c0 0x7fbda819fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:46.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:46.348+0000 7fbdacbd5700 1 -- 172.21.15.46:0/2836072459 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbda40095f0 con 0x7fbda8101a20 2023-10-19T12:35:46.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:46.348+0000 7fbdad3d6700 1 --2- 172.21.15.46:0/2836072459 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbda8100820 0x7fbda8198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:35:46.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:46.348+0000 7fbdadbd7700 1 --2- 172.21.15.46:0/2836072459 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbda81023c0 0x7fbda819fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:35:46.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:46.348+0000 7fbdacbd5700 1 --2- 172.21.15.46:0/2836072459 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbda8101a20 0x7fbda8198ec0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fbd9800e9d0 tx=0x7fbd9800ece0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:35:46.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:46.349+0000 7fbd9e7fc700 1 -- 172.21.15.46:0/2836072459 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd98009790 con 0x7fbda8101a20 2023-10-19T12:35:46.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:46.349+0000 7fbdaf63a700 1 -- 172.21.15.46:0/2836072459 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbda81a0a70 con 0x7fbda8101a20 2023-10-19T12:35:46.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:46.349+0000 7fbd9e7fc700 1 -- 172.21.15.46:0/2836072459 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbd9800ee70 con 0x7fbda8101a20 2023-10-19T12:35:46.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:46.349+0000 7fbd9e7fc700 1 -- 172.21.15.46:0/2836072459 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd98010ea0 con 0x7fbda8101a20 2023-10-19T12:35:46.357 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:46.349+0000 7fbdaf63a700 1 -- 172.21.15.46:0/2836072459 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbda81a0fc0 con 0x7fbda8101a20 2023-10-19T12:35:46.357 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:46.350+0000 7fbd93fff700 1 -- 172.21.15.46:0/2836072459 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbda804e4c0 con 0x7fbda8101a20 2023-10-19T12:35:46.357 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:46.352+0000 7fbd9e7fc700 1 -- 172.21.15.46:0/2836072459 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 15) v1 ==== 135947+0+0 (secure 0 0 0) 0x7fbd9800cbd0 con 0x7fbda8101a20 2023-10-19T12:35:46.358 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:46.354+0000 7fbd9e7fc700 1 --2- 172.21.15.46:0/2836072459 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fbd940a13f0 0x7fbd940a38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:35:46.358 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:46.354+0000 7fbd9e7fc700 1 -- 172.21.15.46:0/2836072459 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fbd98014070 con 0x7fbda8101a20 2023-10-19T12:35:46.358 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:46.354+0000 7fbdad3d6700 1 --2- 172.21.15.46:0/2836072459 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fbd940a13f0 0x7fbd940a38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:35:46.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:46.355+0000 7fbdad3d6700 1 --2- 172.21.15.46:0/2836072459 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fbd940a13f0 0x7fbd940a38b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbda4003730 tx=0x7fbda400b540 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:35:46.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:46.355+0000 7fbd9e7fc700 1 -- 172.21.15.46:0/2836072459 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fbd98096620 con 0x7fbda8101a20 2023-10-19T12:35:46.575 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '96a8be3c-6e7b-11ee-8db6-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_bits', '3'], check_status=True, hostname='smithi046') 2023-10-19T12:35:46.575 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '96a8be3c-6e7b-11ee-8db6-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_size', '100'], check_status=True, hostname='smithi046') 2023-10-19T12:35:46.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:46.574+0000 7fbd93fff700 1 -- 172.21.15.46:0/2836072459 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) v1 -- 0x7fbda810c070 con 0x7fbda8101a20 2023-10-19T12:35:46.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:46.580+0000 7fbd9e7fc700 1 -- 172.21.15.46:0/2836072459 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v24)=0 v24) v1 ==== 121+0+0 (secure 0 0 0) 0x7fbd98099c40 con 0x7fbda8101a20 2023-10-19T12:35:46.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:46.584+0000 7fbd93fff700 1 -- 172.21.15.46:0/2836072459 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fbd940a13f0 msgr2=0x7fbd940a38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:35:46.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:46.584+0000 7fbd93fff700 1 --2- 172.21.15.46:0/2836072459 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fbd940a13f0 0x7fbd940a38b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbda4003730 tx=0x7fbda400b540 comp rx=0 tx=0).stop 2023-10-19T12:35:46.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:46.584+0000 7fbd93fff700 1 -- 172.21.15.46:0/2836072459 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbda8101a20 msgr2=0x7fbda8198ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:35:46.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:46.584+0000 7fbd93fff700 1 --2- 172.21.15.46:0/2836072459 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbda8101a20 0x7fbda8198ec0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fbd9800e9d0 tx=0x7fbd9800ece0 comp rx=0 tx=0).stop 2023-10-19T12:35:46.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:46.585+0000 7fbd93fff700 1 -- 172.21.15.46:0/2836072459 shutdown_connections 2023-10-19T12:35:46.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:46.585+0000 7fbd93fff700 1 --2- 172.21.15.46:0/2836072459 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbda81023c0 0x7fbda819fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:46.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:46.585+0000 7fbd93fff700 1 --2- 172.21.15.46:0/2836072459 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbda8100820 0x7fbda8198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:46.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:46.585+0000 7fbd93fff700 1 --2- 172.21.15.46:0/2836072459 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fbd940a13f0 0x7fbd940a38b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:46.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:46.585+0000 7fbd93fff700 1 --2- 172.21.15.46:0/2836072459 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbda8101a20 0x7fbda8198ec0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:46.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:46.585+0000 7fbd93fff700 1 -- 172.21.15.46:0/2836072459 >> 172.21.15.46:0/2836072459 conn(0x7fbda80fbdc0 msgr2=0x7fbda8072a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:35:46.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:46.585+0000 7fbd93fff700 1 -- 172.21.15.46:0/2836072459 shutdown_connections 2023-10-19T12:35:46.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:46.585+0000 7fbd93fff700 1 -- 172.21.15.46:0/2836072459 wait complete. 2023-10-19T12:35:47.290 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '96a8be3c-6e7b-11ee-8db6-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi046') 2023-10-19T12:35:47.702 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:47 smithi046 ceph-mon[98509]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:47.703 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:47 smithi046 ceph-mon[98509]: from='client.? ' entity='client.admin' 2023-10-19T12:35:47.837 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:47 smithi157 ceph-mon[134109]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:47.838 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:47 smithi157 ceph-mon[134109]: from='client.? ' entity='client.admin' 2023-10-19T12:35:47.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:47 smithi195 ceph-mon[134493]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:47.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:47 smithi195 ceph-mon[134493]: from='client.? ' entity='client.admin' 2023-10-19T12:35:48.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.037+0000 7f0385f55700 1 -- 172.21.15.46:0/2961635315 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0380073250 msgr2=0x7f03800736d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:35:48.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.037+0000 7f0385f55700 1 --2- 172.21.15.46:0/2961635315 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0380073250 0x7f03800736d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0374009990 tx=0x7f0374009ca0 comp rx=0 tx=0).stop 2023-10-19T12:35:48.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.037+0000 7f0385f55700 1 -- 172.21.15.46:0/2961635315 shutdown_connections 2023-10-19T12:35:48.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.037+0000 7f0385f55700 1 --2- 172.21.15.46:0/2961635315 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0380108710 0x7f038010aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:48.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.037+0000 7f0385f55700 1 --2- 172.21.15.46:0/2961635315 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0380074820 0x7f0380072c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:48.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.037+0000 7f0385f55700 1 --2- 172.21.15.46:0/2961635315 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0380073250 0x7f03800736d0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:48.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.037+0000 7f0385f55700 1 -- 172.21.15.46:0/2961635315 >> 172.21.15.46:0/2961635315 conn(0x7f03800fbe00 msgr2=0x7f03800fe220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:35:48.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.037+0000 7f0385f55700 1 -- 172.21.15.46:0/2961635315 shutdown_connections 2023-10-19T12:35:48.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.037+0000 7f0385f55700 1 -- 172.21.15.46:0/2961635315 wait complete. 2023-10-19T12:35:48.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.038+0000 7f0385f55700 1 Processor -- start 2023-10-19T12:35:48.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.038+0000 7f0385f55700 1 -- start start 2023-10-19T12:35:48.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.039+0000 7f0385f55700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0380073250 0x7f0380198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:35:48.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.039+0000 7f0385f55700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0380074820 0x7f0380198fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:35:48.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.039+0000 7f0385f55700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0380108710 0x7f038019ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:35:48.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.039+0000 7f0385f55700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03801a0550 con 0x7f0380074820 2023-10-19T12:35:48.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.039+0000 7f0385f55700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03801a0690 con 0x7f0380108710 2023-10-19T12:35:48.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.039+0000 7f0385f55700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03801a0820 con 0x7f0380073250 2023-10-19T12:35:48.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.039+0000 7f037effd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0380074820 0x7f0380198fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:35:48.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.039+0000 7f037effd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0380074820 0x7f0380198fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49052/0 (socket says 172.21.15.46:49052) 2023-10-19T12:35:48.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.039+0000 7f037effd700 1 -- 172.21.15.46:0/2417049686 learned_addr learned my addr 172.21.15.46:0/2417049686 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:35:48.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.039+0000 7f037f7fe700 1 --2- 172.21.15.46:0/2417049686 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0380073250 0x7f0380198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:35:48.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.039+0000 7f037ffff700 1 --2- 172.21.15.46:0/2417049686 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0380108710 0x7f038019ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:35:48.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.039+0000 7f037f7fe700 1 -- 172.21.15.46:0/2417049686 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0380108710 msgr2=0x7f038019ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:35:48.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.039+0000 7f037f7fe700 1 --2- 172.21.15.46:0/2417049686 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0380108710 0x7f038019ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:48.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.039+0000 7f037f7fe700 1 -- 172.21.15.46:0/2417049686 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0380074820 msgr2=0x7f0380198fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:35:48.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.039+0000 7f037f7fe700 1 --2- 172.21.15.46:0/2417049686 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0380074820 0x7f0380198fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:48.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.039+0000 7f037f7fe700 1 -- 172.21.15.46:0/2417049686 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03740095f0 con 0x7f0380073250 2023-10-19T12:35:48.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.039+0000 7f037effd700 1 --2- 172.21.15.46:0/2417049686 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0380074820 0x7f0380198fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:35:48.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.040+0000 7f037f7fe700 1 --2- 172.21.15.46:0/2417049686 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0380073250 0x7f0380198a60 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f037000e9f0 tx=0x7f037000ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:35:48.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.040+0000 7f037cff9700 1 -- 172.21.15.46:0/2417049686 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f037000c9c0 con 0x7f0380073250 2023-10-19T12:35:48.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.040+0000 7f0385f55700 1 -- 172.21.15.46:0/2417049686 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03801a0b00 con 0x7f0380073250 2023-10-19T12:35:48.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.040+0000 7f037cff9700 1 -- 172.21.15.46:0/2417049686 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0370010430 con 0x7f0380073250 2023-10-19T12:35:48.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.040+0000 7f037cff9700 1 -- 172.21.15.46:0/2417049686 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0370018680 con 0x7f0380073250 2023-10-19T12:35:48.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.040+0000 7f0385f55700 1 -- 172.21.15.46:0/2417049686 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03801a1050 con 0x7f0380073250 2023-10-19T12:35:48.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.041+0000 7f0385f55700 1 -- 172.21.15.46:0/2417049686 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03801074d0 con 0x7f0380073250 2023-10-19T12:35:48.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.043+0000 7f037cff9700 1 -- 172.21.15.46:0/2417049686 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 15) v1 ==== 135947+0+0 (secure 0 0 0) 0x7f03700105a0 con 0x7f0380073250 2023-10-19T12:35:48.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.044+0000 7f037cff9700 1 --2- 172.21.15.46:0/2417049686 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f03680a1470 0x7f03680a3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:35:48.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.045+0000 7f037cff9700 1 -- 172.21.15.46:0/2417049686 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f0370014070 con 0x7f0380073250 2023-10-19T12:35:48.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.045+0000 7f037effd700 1 --2- 172.21.15.46:0/2417049686 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f03680a1470 0x7f03680a3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:35:48.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.045+0000 7f037effd700 1 --2- 172.21.15.46:0/2417049686 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f03680a1470 0x7f03680a3930 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f037400b2e0 tx=0x7f0374005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:35:48.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.049+0000 7f037cff9700 1 -- 172.21.15.46:0/2417049686 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0370052100 con 0x7f0380073250 2023-10-19T12:35:48.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.113+0000 7f50a1e93700 1 -- 172.21.15.46:0/843479623 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f509c074820 msgr2=0x7f509c072c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:35:48.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.113+0000 7f50a1e93700 1 --2- 172.21.15.46:0/843479623 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f509c074820 0x7f509c072c80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f508c009990 tx=0x7f508c009ca0 comp rx=0 tx=0).stop 2023-10-19T12:35:48.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.113+0000 7f50a1e93700 1 -- 172.21.15.46:0/843479623 shutdown_connections 2023-10-19T12:35:48.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.113+0000 7f50a1e93700 1 --2- 172.21.15.46:0/843479623 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f509c10ce20 0x7f509c10f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:48.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.113+0000 7f50a1e93700 1 --2- 172.21.15.46:0/843479623 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f509c074820 0x7f509c072c80 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:48.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.113+0000 7f50a1e93700 1 --2- 172.21.15.46:0/843479623 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f509c073250 0x7f509c0736d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:48.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.113+0000 7f50a1e93700 1 -- 172.21.15.46:0/843479623 >> 172.21.15.46:0/843479623 conn(0x7f509c0fbe00 msgr2=0x7f509c0fe220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:35:48.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.113+0000 7f50a1e93700 1 -- 172.21.15.46:0/843479623 shutdown_connections 2023-10-19T12:35:48.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.113+0000 7f50a1e93700 1 -- 172.21.15.46:0/843479623 wait complete. 2023-10-19T12:35:48.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.114+0000 7f50a1e93700 1 Processor -- start 2023-10-19T12:35:48.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.115+0000 7f50a1e93700 1 -- start start 2023-10-19T12:35:48.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.115+0000 7f50a1e93700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f509c073250 0x7f509c19cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:35:48.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.115+0000 7f50a1e93700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f509c074820 0x7f509c19d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:35:48.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.115+0000 7f50a1e93700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f509c10ce20 0x7f509c1a42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:35:48.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.115+0000 7f50a1e93700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f509c1a4870 con 0x7f509c10ce20 2023-10-19T12:35:48.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.115+0000 7f50a1e93700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f509c1a49b0 con 0x7f509c074820 2023-10-19T12:35:48.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.115+0000 7f50a1e93700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f509c1a4b70 con 0x7f509c073250 2023-10-19T12:35:48.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.115+0000 7f509b7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f509c073250 0x7f509c19cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:35:48.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.115+0000 7f509b7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f509c073250 0x7f509c19cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:37038/0 (socket says 172.21.15.46:37038) 2023-10-19T12:35:48.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.115+0000 7f509bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f509c10ce20 0x7f509c1a42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:35:48.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.115+0000 7f509b7fe700 1 -- 172.21.15.46:0/3788725641 learned_addr learned my addr 172.21.15.46:0/3788725641 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:35:48.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.116+0000 7f509affd700 1 --2- 172.21.15.46:0/3788725641 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f509c074820 0x7f509c19d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:35:48.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.116+0000 7f509b7fe700 1 -- 172.21.15.46:0/3788725641 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f509c074820 msgr2=0x7f509c19d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:35:48.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.116+0000 7f509b7fe700 1 --2- 172.21.15.46:0/3788725641 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f509c074820 0x7f509c19d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:48.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.116+0000 7f509b7fe700 1 -- 172.21.15.46:0/3788725641 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f509c10ce20 msgr2=0x7f509c1a42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:35:48.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.116+0000 7f509b7fe700 1 --2- 172.21.15.46:0/3788725641 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f509c10ce20 0x7f509c1a42a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:48.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.116+0000 7f509b7fe700 1 -- 172.21.15.46:0/3788725641 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5090009520 con 0x7f509c073250 2023-10-19T12:35:48.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.116+0000 7f509bfff700 1 --2- 172.21.15.46:0/3788725641 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f509c10ce20 0x7f509c1a42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:35:48.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.116+0000 7f509b7fe700 1 --2- 172.21.15.46:0/3788725641 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f509c073250 0x7f509c19cd70 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f508c000c00 tx=0x7f508c004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:35:48.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.117+0000 7f5098ff9700 1 -- 172.21.15.46:0/3788725641 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f508c01d070 con 0x7f509c073250 2023-10-19T12:35:48.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.117+0000 7f50a1e93700 1 -- 172.21.15.46:0/3788725641 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f508c0095f0 con 0x7f509c073250 2023-10-19T12:35:48.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.117+0000 7f5098ff9700 1 -- 172.21.15.46:0/3788725641 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f508c021410 con 0x7f509c073250 2023-10-19T12:35:48.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.117+0000 7f5098ff9700 1 -- 172.21.15.46:0/3788725641 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f508c017650 con 0x7f509c073250 2023-10-19T12:35:48.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.117+0000 7f50a1e93700 1 -- 172.21.15.46:0/3788725641 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f509c1a50d0 con 0x7f509c073250 2023-10-19T12:35:48.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.118+0000 7f50a1e93700 1 -- 172.21.15.46:0/3788725641 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f509c103080 con 0x7f509c073250 2023-10-19T12:35:48.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.122+0000 7f5098ff9700 1 -- 172.21.15.46:0/3788725641 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 15) v1 ==== 135947+0+0 (secure 0 0 0) 0x7f508c021580 con 0x7f509c073250 2023-10-19T12:35:48.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.123+0000 7f5098ff9700 1 --2- 172.21.15.46:0/3788725641 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f50840a1470 0x7f50840a3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:35:48.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.124+0000 7f5098ff9700 1 -- 172.21.15.46:0/3788725641 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f508c0ccb00 con 0x7f509c073250 2023-10-19T12:35:48.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.124+0000 7f509affd700 1 --2- 172.21.15.46:0/3788725641 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f50840a1470 0x7f50840a3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:35:48.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.124+0000 7f5098ff9700 1 -- 172.21.15.46:0/3788725641 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f508c097e20 con 0x7f509c073250 2023-10-19T12:35:48.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.124+0000 7f509affd700 1 --2- 172.21.15.46:0/3788725641 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f50840a1470 0x7f50840a3930 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f509c074550 tx=0x7f5090009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:35:48.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.289+0000 7f0385f55700 1 -- 172.21.15.46:0/2417049686 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) v1 -- 0x7f038004e4c0 con 0x7f0380073250 2023-10-19T12:35:48.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.294+0000 7f037cff9700 1 -- 172.21.15.46:0/2417049686 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v25)=0 v25) v1 ==== 120+0+0 (secure 0 0 0) 0x7f038004e4c0 con 0x7f0380073250 2023-10-19T12:35:48.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.297+0000 7f0385f55700 1 -- 172.21.15.46:0/2417049686 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f03680a1470 msgr2=0x7f03680a3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:35:48.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.297+0000 7f0385f55700 1 --2- 172.21.15.46:0/2417049686 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f03680a1470 0x7f03680a3930 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f037400b2e0 tx=0x7f0374005fb0 comp rx=0 tx=0).stop 2023-10-19T12:35:48.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.297+0000 7f0385f55700 1 -- 172.21.15.46:0/2417049686 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0380073250 msgr2=0x7f0380198a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:35:48.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.297+0000 7f0385f55700 1 --2- 172.21.15.46:0/2417049686 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0380073250 0x7f0380198a60 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f037000e9f0 tx=0x7f037000ed00 comp rx=0 tx=0).stop 2023-10-19T12:35:48.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.297+0000 7f0385f55700 1 -- 172.21.15.46:0/2417049686 shutdown_connections 2023-10-19T12:35:48.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.297+0000 7f0385f55700 1 --2- 172.21.15.46:0/2417049686 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0380108710 0x7f038019ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:48.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.297+0000 7f0385f55700 1 --2- 172.21.15.46:0/2417049686 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f03680a1470 0x7f03680a3930 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:48.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.297+0000 7f0385f55700 1 --2- 172.21.15.46:0/2417049686 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0380073250 0x7f0380198a60 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:48.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.297+0000 7f0385f55700 1 --2- 172.21.15.46:0/2417049686 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0380074820 0x7f0380198fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:48.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.297+0000 7f0385f55700 1 -- 172.21.15.46:0/2417049686 >> 172.21.15.46:0/2417049686 conn(0x7f03800fbe00 msgr2=0x7f0380104610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:35:48.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.297+0000 7f0385f55700 1 -- 172.21.15.46:0/2417049686 shutdown_connections 2023-10-19T12:35:48.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.297+0000 7f0385f55700 1 -- 172.21.15.46:0/2417049686 wait complete. 2023-10-19T12:35:48.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.353+0000 7f50a1e93700 1 -- 172.21.15.46:0/3788725641 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) v1 -- 0x7f509c112640 con 0x7f509c073250 2023-10-19T12:35:48.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.358+0000 7f5098ff9700 1 -- 172.21.15.46:0/3788725641 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v26)=0 v26) v1 ==== 121+0+0 (secure 0 0 0) 0x7f508c09b440 con 0x7f509c073250 2023-10-19T12:35:48.364 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.360+0000 7f50a1e93700 1 -- 172.21.15.46:0/3788725641 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f50840a1470 msgr2=0x7f50840a3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:35:48.364 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.360+0000 7f50a1e93700 1 --2- 172.21.15.46:0/3788725641 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f50840a1470 0x7f50840a3930 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f509c074550 tx=0x7f5090009260 comp rx=0 tx=0).stop 2023-10-19T12:35:48.364 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.360+0000 7f50a1e93700 1 -- 172.21.15.46:0/3788725641 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f509c073250 msgr2=0x7f509c19cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:35:48.364 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.360+0000 7f50a1e93700 1 --2- 172.21.15.46:0/3788725641 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f509c073250 0x7f509c19cd70 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f508c000c00 tx=0x7f508c004730 comp rx=0 tx=0).stop 2023-10-19T12:35:48.365 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.360+0000 7f50a1e93700 1 -- 172.21.15.46:0/3788725641 shutdown_connections 2023-10-19T12:35:48.365 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.361+0000 7f50a1e93700 1 --2- 172.21.15.46:0/3788725641 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f509c10ce20 0x7f509c1a42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:48.365 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.361+0000 7f50a1e93700 1 --2- 172.21.15.46:0/3788725641 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f50840a1470 0x7f50840a3930 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:48.365 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.361+0000 7f50a1e93700 1 --2- 172.21.15.46:0/3788725641 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f509c073250 0x7f509c19cd70 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:48.365 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.361+0000 7f50a1e93700 1 --2- 172.21.15.46:0/3788725641 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f509c074820 0x7f509c19d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:48.366 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.361+0000 7f50a1e93700 1 -- 172.21.15.46:0/3788725641 >> 172.21.15.46:0/3788725641 conn(0x7f509c0fbe00 msgr2=0x7f509c1001c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:35:48.366 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.361+0000 7f50a1e93700 1 -- 172.21.15.46:0/3788725641 shutdown_connections 2023-10-19T12:35:48.366 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.361+0000 7f50a1e93700 1 -- 172.21.15.46:0/3788725641 wait complete. 2023-10-19T12:35:48.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.729+0000 7f0c6ed98700 1 -- 172.21.15.46:0/3296860055 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c68100430 msgr2=0x7f0c681008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:35:48.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.729+0000 7f0c6ed98700 1 --2- 172.21.15.46:0/3296860055 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c68100430 0x7f0c681008b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0c60009f90 tx=0x7f0c6000b330 comp rx=0 tx=0).stop 2023-10-19T12:35:48.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.729+0000 7f0c6ed98700 1 -- 172.21.15.46:0/3296860055 shutdown_connections 2023-10-19T12:35:48.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.729+0000 7f0c6ed98700 1 --2- 172.21.15.46:0/3296860055 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c68100430 0x7f0c681008b0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:48.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.729+0000 7f0c6ed98700 1 --2- 172.21.15.46:0/3296860055 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0c680ff110 0x7f0c680ff530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:48.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.729+0000 7f0c6ed98700 1 --2- 172.21.15.46:0/3296860055 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0c680ffa70 0x7f0c680ffef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:48.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.729+0000 7f0c6ed98700 1 -- 172.21.15.46:0/3296860055 >> 172.21.15.46:0/3296860055 conn(0x7f0c680facf0 msgr2=0x7f0c680fd110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:35:48.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.729+0000 7f0c6ed98700 1 -- 172.21.15.46:0/3296860055 shutdown_connections 2023-10-19T12:35:48.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.729+0000 7f0c6ed98700 1 -- 172.21.15.46:0/3296860055 wait complete. 2023-10-19T12:35:48.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.730+0000 7f0c6ed98700 1 Processor -- start 2023-10-19T12:35:48.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.731+0000 7f0c6ed98700 1 -- start start 2023-10-19T12:35:48.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.731+0000 7f0c6ed98700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0c680ff110 0x7f0c68104bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:35:48.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.731+0000 7f0c6ed98700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0c680ffa70 0x7f0c68105130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:35:48.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.731+0000 7f0c6ed98700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c68100430 0x7f0c68101770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:35:48.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.731+0000 7f0c6ed98700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c68101f10 con 0x7f0c680ffa70 2023-10-19T12:35:48.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.731+0000 7f0c6ed98700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c68102080 con 0x7f0c68100430 2023-10-19T12:35:48.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.731+0000 7f0c6ed98700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c68102240 con 0x7f0c680ff110 2023-10-19T12:35:48.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.732+0000 7f0c6cb34700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0c680ff110 0x7f0c68104bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:35:48.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.732+0000 7f0c6cb34700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0c680ff110 0x7f0c68104bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:37050/0 (socket says 172.21.15.46:37050) 2023-10-19T12:35:48.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.732+0000 7f0c6cb34700 1 -- 172.21.15.46:0/1127032 learned_addr learned my addr 172.21.15.46:0/1127032 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:35:48.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.732+0000 7f0c6cb34700 1 -- 172.21.15.46:0/1127032 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c68100430 msgr2=0x7f0c68101770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:35:48.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.732+0000 7f0c6cb34700 1 --2- 172.21.15.46:0/1127032 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c68100430 0x7f0c68101770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:48.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.732+0000 7f0c6cb34700 1 -- 172.21.15.46:0/1127032 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0c680ffa70 msgr2=0x7f0c68105130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:35:48.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.732+0000 7f0c67fff700 1 --2- 172.21.15.46:0/1127032 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0c680ffa70 0x7f0c68105130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:35:48.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.732+0000 7f0c6cb34700 1 --2- 172.21.15.46:0/1127032 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0c680ffa70 0x7f0c68105130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:48.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.732+0000 7f0c6cb34700 1 -- 172.21.15.46:0/1127032 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c540095f0 con 0x7f0c680ff110 2023-10-19T12:35:48.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.733+0000 7f0c6cb34700 1 --2- 172.21.15.46:0/1127032 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0c680ff110 0x7f0c68104bf0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c00e9c0 tx=0x7f0c5c00ed80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:35:48.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.733+0000 7f0c67fff700 1 --2- 172.21.15.46:0/1127032 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0c680ffa70 0x7f0c68105130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T12:35:48.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.733+0000 7f0c65ffb700 1 -- 172.21.15.46:0/1127032 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c5c00cbd0 con 0x7f0c680ff110 2023-10-19T12:35:48.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.733+0000 7f0c65ffb700 1 -- 172.21.15.46:0/1127032 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0c5c00cd30 con 0x7f0c680ff110 2023-10-19T12:35:48.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.733+0000 7f0c65ffb700 1 -- 172.21.15.46:0/1127032 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c5c0056b0 con 0x7f0c680ff110 2023-10-19T12:35:48.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.733+0000 7f0c6ed98700 1 -- 172.21.15.46:0/1127032 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c60009c40 con 0x7f0c680ff110 2023-10-19T12:35:48.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.733+0000 7f0c6ed98700 1 -- 172.21.15.46:0/1127032 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c68198a10 con 0x7f0c680ff110 2023-10-19T12:35:48.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.734+0000 7f0c6ed98700 1 -- 172.21.15.46:0/1127032 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c68109ef0 con 0x7f0c680ff110 2023-10-19T12:35:48.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.738+0000 7f0c65ffb700 1 -- 172.21.15.46:0/1127032 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 15) v1 ==== 135947+0+0 (secure 0 0 0) 0x7f0c5c004750 con 0x7f0c680ff110 2023-10-19T12:35:48.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.740+0000 7f0c65ffb700 1 --2- 172.21.15.46:0/1127032 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f0c580a1470 0x7f0c580a3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:35:48.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.741+0000 7f0c65ffb700 1 -- 172.21.15.46:0/1127032 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f0c5c014070 con 0x7f0c680ff110 2023-10-19T12:35:48.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.741+0000 7f0c67fff700 1 --2- 172.21.15.46:0/1127032 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f0c580a1470 0x7f0c580a3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:35:48.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.741+0000 7f0c67fff700 1 --2- 172.21.15.46:0/1127032 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f0c580a1470 0x7f0c580a3930 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0c54005fd0 tx=0x7f0c54009310 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:35:48.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.743+0000 7f0c65ffb700 1 -- 172.21.15.46:0/1127032 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0c5c0966a0 con 0x7f0c680ff110 2023-10-19T12:35:48.985 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.981+0000 7f0c6ed98700 1 -- 172.21.15.46:0/1127032 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) v1 -- 0x7f0c6804e4c0 con 0x7f0c680ff110 2023-10-19T12:35:48.990 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.987+0000 7f0c65ffb700 1 -- 172.21.15.46:0/1127032 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v27)=0 v27) v1 ==== 121+0+0 (secure 0 0 0) 0x7f0c5c099cc0 con 0x7f0c680ff110 2023-10-19T12:35:48.993 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.990+0000 7f0c6ed98700 1 -- 172.21.15.46:0/1127032 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f0c580a1470 msgr2=0x7f0c580a3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:35:48.993 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.990+0000 7f0c6ed98700 1 --2- 172.21.15.46:0/1127032 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f0c580a1470 0x7f0c580a3930 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0c54005fd0 tx=0x7f0c54009310 comp rx=0 tx=0).stop 2023-10-19T12:35:48.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.990+0000 7f0c6ed98700 1 -- 172.21.15.46:0/1127032 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0c680ff110 msgr2=0x7f0c68104bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:35:48.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.990+0000 7f0c6ed98700 1 --2- 172.21.15.46:0/1127032 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0c680ff110 0x7f0c68104bf0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c00e9c0 tx=0x7f0c5c00ed80 comp rx=0 tx=0).stop 2023-10-19T12:35:48.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.990+0000 7f0c6ed98700 1 -- 172.21.15.46:0/1127032 shutdown_connections 2023-10-19T12:35:48.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.990+0000 7f0c6ed98700 1 --2- 172.21.15.46:0/1127032 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c68100430 0x7f0c68101770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:48.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.990+0000 7f0c6ed98700 1 --2- 172.21.15.46:0/1127032 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f0c580a1470 0x7f0c580a3930 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:48.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.990+0000 7f0c6ed98700 1 --2- 172.21.15.46:0/1127032 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0c680ff110 0x7f0c68104bf0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:48.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.990+0000 7f0c6ed98700 1 --2- 172.21.15.46:0/1127032 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0c680ffa70 0x7f0c68105130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:48.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.990+0000 7f0c6ed98700 1 -- 172.21.15.46:0/1127032 >> 172.21.15.46:0/1127032 conn(0x7f0c680facf0 msgr2=0x7f0c680fc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:35:48.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.990+0000 7f0c6ed98700 1 -- 172.21.15.46:0/1127032 shutdown_connections 2023-10-19T12:35:48.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:48.990+0000 7f0c6ed98700 1 -- 172.21.15.46:0/1127032 wait complete. 2023-10-19T12:35:49.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:49 smithi046 ceph-mon[98509]: from='client.? ' entity='client.admin' 2023-10-19T12:35:49.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:49 smithi046 ceph-mon[98509]: from='client.? ' entity='client.admin' 2023-10-19T12:35:49.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:49 smithi046 ceph-mon[98509]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:49.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:49 smithi046 ceph-mon[98509]: from='client.? ' entity='client.admin' 2023-10-19T12:35:49.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:49 smithi157 ceph-mon[134109]: from='client.? ' entity='client.admin' 2023-10-19T12:35:49.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:49 smithi157 ceph-mon[134109]: from='client.? ' entity='client.admin' 2023-10-19T12:35:49.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:49 smithi157 ceph-mon[134109]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:49.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:49 smithi157 ceph-mon[134109]: from='client.? ' entity='client.admin' 2023-10-19T12:35:49.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:49 smithi195 ceph-mon[134493]: from='client.? ' entity='client.admin' 2023-10-19T12:35:49.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:49 smithi195 ceph-mon[134493]: from='client.? ' entity='client.admin' 2023-10-19T12:35:49.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:49 smithi195 ceph-mon[134493]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:49.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:49 smithi195 ceph-mon[134493]: from='client.? ' entity='client.admin' 2023-10-19T12:35:50.179 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:50.175+0000 7fbd59be3700 1 -- 172.21.15.46:0/2391135514 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd54101320 msgr2=0x7fbd54103710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:35:50.179 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:50.175+0000 7fbd59be3700 1 --2- 172.21.15.46:0/2391135514 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd54101320 0x7fbd54103710 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fbd44009990 tx=0x7fbd44009ca0 comp rx=0 tx=0).stop 2023-10-19T12:35:50.179 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:50.175+0000 7fbd59be3700 1 -- 172.21.15.46:0/2391135514 shutdown_connections 2023-10-19T12:35:50.180 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:50.175+0000 7fbd59be3700 1 --2- 172.21.15.46:0/2391135514 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbd54106580 0x7fbd54108990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:50.180 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:50.175+0000 7fbd59be3700 1 --2- 172.21.15.46:0/2391135514 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd54101320 0x7fbd54103710 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:50.180 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:50.175+0000 7fbd59be3700 1 --2- 172.21.15.46:0/2391135514 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbd54103c50 0x7fbd54106040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:50.180 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:50.175+0000 7fbd59be3700 1 -- 172.21.15.46:0/2391135514 >> 172.21.15.46:0/2391135514 conn(0x7fbd540facf0 msgr2=0x7fbd540fd110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:35:50.180 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:50.175+0000 7fbd59be3700 1 -- 172.21.15.46:0/2391135514 shutdown_connections 2023-10-19T12:35:50.181 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:50.175+0000 7fbd59be3700 1 -- 172.21.15.46:0/2391135514 wait complete. 2023-10-19T12:35:50.182 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:50.177+0000 7fbd59be3700 1 Processor -- start 2023-10-19T12:35:50.182 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:50.177+0000 7fbd59be3700 1 -- start start 2023-10-19T12:35:50.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:50.178+0000 7fbd59be3700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd54101320 0x7fbd541989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:35:50.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:50.178+0000 7fbd59be3700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbd54103c50 0x7fbd54198ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:35:50.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:50.178+0000 7fbd59be3700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbd54106580 0x7fbd5419ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:35:50.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:50.178+0000 7fbd59be3700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd541a04f0 con 0x7fbd54101320 2023-10-19T12:35:50.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:50.178+0000 7fbd59be3700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd541a0630 con 0x7fbd54106580 2023-10-19T12:35:50.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:50.178+0000 7fbd59be3700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd541a07c0 con 0x7fbd54103c50 2023-10-19T12:35:50.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:50.178+0000 7fbd53fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbd54106580 0x7fbd5419ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:35:50.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:50.178+0000 7fbd52ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbd54103c50 0x7fbd54198ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:35:50.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:50.178+0000 7fbd53fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbd54106580 0x7fbd5419ff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:42746/0 (socket says 172.21.15.46:42746) 2023-10-19T12:35:50.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:50.178+0000 7fbd53fff700 1 -- 172.21.15.46:0/454123368 learned_addr learned my addr 172.21.15.46:0/454123368 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:35:50.185 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:50.178+0000 7fbd537fe700 1 --2- 172.21.15.46:0/454123368 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd54101320 0x7fbd541989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:35:50.185 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:50.179+0000 7fbd53fff700 1 -- 172.21.15.46:0/454123368 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbd54103c50 msgr2=0x7fbd54198ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:35:50.185 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:50.179+0000 7fbd53fff700 1 --2- 172.21.15.46:0/454123368 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbd54103c50 0x7fbd54198ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:50.185 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:50.179+0000 7fbd53fff700 1 -- 172.21.15.46:0/454123368 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd54101320 msgr2=0x7fbd541989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:35:50.185 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:50.179+0000 7fbd53fff700 1 --2- 172.21.15.46:0/454123368 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd54101320 0x7fbd541989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:50.186 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:50.179+0000 7fbd53fff700 1 -- 172.21.15.46:0/454123368 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd440095f0 con 0x7fbd54106580 2023-10-19T12:35:50.186 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:50.179+0000 7fbd537fe700 1 --2- 172.21.15.46:0/454123368 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd54101320 0x7fbd541989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T12:35:50.186 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:50.179+0000 7fbd53fff700 1 --2- 172.21.15.46:0/454123368 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbd54106580 0x7fbd5419ff20 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c00ef90 tx=0x7fbd4c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:35:50.187 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:50.179+0000 7fbd50ff9700 1 -- 172.21.15.46:0/454123368 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd4c018070 con 0x7fbd54106580 2023-10-19T12:35:50.187 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:50.179+0000 7fbd50ff9700 1 -- 172.21.15.46:0/454123368 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbd4c00f040 con 0x7fbd54106580 2023-10-19T12:35:50.188 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:50.179+0000 7fbd59be3700 1 -- 172.21.15.46:0/454123368 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd54191900 con 0x7fbd54106580 2023-10-19T12:35:50.188 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:50.179+0000 7fbd50ff9700 1 -- 172.21.15.46:0/454123368 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd4c003ea0 con 0x7fbd54106580 2023-10-19T12:35:50.188 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:50.180+0000 7fbd59be3700 1 -- 172.21.15.46:0/454123368 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd54191db0 con 0x7fbd54106580 2023-10-19T12:35:50.188 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:50.181+0000 7fbd59be3700 1 -- 172.21.15.46:0/454123368 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd54108120 con 0x7fbd54106580 2023-10-19T12:35:50.188 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:50.183+0000 7fbd50ff9700 1 -- 172.21.15.46:0/454123368 <== mon.2 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 15) v1 ==== 135947+0+0 (secure 0 0 0) 0x7fbd4c00ca50 con 0x7fbd54106580 2023-10-19T12:35:50.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:50.184+0000 7fbd50ff9700 1 --2- 172.21.15.46:0/454123368 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fbd3c0a13f0 0x7fbd3c0a38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:35:50.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:50.184+0000 7fbd50ff9700 1 -- 172.21.15.46:0/454123368 <== mon.2 v2:172.21.15.157:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fbd4c0ca7f0 con 0x7fbd54106580 2023-10-19T12:35:50.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:50.184+0000 7fbd537fe700 1 --2- 172.21.15.46:0/454123368 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fbd3c0a13f0 0x7fbd3c0a38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:35:50.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:50.187+0000 7fbd537fe700 1 --2- 172.21.15.46:0/454123368 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fbd3c0a13f0 0x7fbd3c0a38b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbd4400b2e0 tx=0x7fbd4400b750 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:35:50.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:50.188+0000 7fbd50ff9700 1 -- 172.21.15.46:0/454123368 <== mon.2 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fbd4c095bb0 con 0x7fbd54106580 2023-10-19T12:35:50.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:50.408+0000 7fbd59be3700 1 -- 172.21.15.46:0/454123368 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) v1 -- 0x7fbd54107b00 con 0x7fbd54106580 2023-10-19T12:35:50.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:50.413+0000 7fbd50ff9700 1 -- 172.21.15.46:0/454123368 <== mon.2 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v28)=0 v28) v1 ==== 115+0+0 (secure 0 0 0) 0x7fbd4c0991d0 con 0x7fbd54106580 2023-10-19T12:35:50.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:50.416+0000 7fbd59be3700 1 -- 172.21.15.46:0/454123368 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fbd3c0a13f0 msgr2=0x7fbd3c0a38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:35:50.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:50.416+0000 7fbd59be3700 1 --2- 172.21.15.46:0/454123368 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fbd3c0a13f0 0x7fbd3c0a38b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbd4400b2e0 tx=0x7fbd4400b750 comp rx=0 tx=0).stop 2023-10-19T12:35:50.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:50.416+0000 7fbd59be3700 1 -- 172.21.15.46:0/454123368 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbd54106580 msgr2=0x7fbd5419ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:35:50.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:50.416+0000 7fbd59be3700 1 --2- 172.21.15.46:0/454123368 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbd54106580 0x7fbd5419ff20 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c00ef90 tx=0x7fbd4c00c3a0 comp rx=0 tx=0).stop 2023-10-19T12:35:50.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:50.416+0000 7fbd59be3700 1 -- 172.21.15.46:0/454123368 shutdown_connections 2023-10-19T12:35:50.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:50.416+0000 7fbd59be3700 1 --2- 172.21.15.46:0/454123368 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbd54106580 0x7fbd5419ff20 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:50.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:50.416+0000 7fbd59be3700 1 --2- 172.21.15.46:0/454123368 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd54101320 0x7fbd541989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:50.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:50.416+0000 7fbd59be3700 1 --2- 172.21.15.46:0/454123368 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fbd3c0a13f0 0x7fbd3c0a38b0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:50.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:50.416+0000 7fbd59be3700 1 --2- 172.21.15.46:0/454123368 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbd54103c50 0x7fbd54198ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:50.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:50.416+0000 7fbd59be3700 1 -- 172.21.15.46:0/454123368 >> 172.21.15.46:0/454123368 conn(0x7fbd540facf0 msgr2=0x7fbd54100bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:35:50.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:50.416+0000 7fbd59be3700 1 -- 172.21.15.46:0/454123368 shutdown_connections 2023-10-19T12:35:50.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:50.416+0000 7fbd59be3700 1 -- 172.21.15.46:0/454123368 wait complete. 2023-10-19T12:35:51.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.028+0000 7fc92f9e3700 1 -- 172.21.15.46:0/3383559396 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9281023e0 msgr2=0x7fc928108c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:35:51.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.028+0000 7fc92f9e3700 1 --2- 172.21.15.46:0/3383559396 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9281023e0 0x7fc928108c90 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc92000b0d0 tx=0x7fc92000b3e0 comp rx=0 tx=0).stop 2023-10-19T12:35:51.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.028+0000 7fc92f9e3700 1 -- 172.21.15.46:0/3383559396 shutdown_connections 2023-10-19T12:35:51.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.028+0000 7fc92f9e3700 1 --2- 172.21.15.46:0/3383559396 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9281023e0 0x7fc928108c90 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:51.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.028+0000 7fc92f9e3700 1 --2- 172.21.15.46:0/3383559396 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc928100840 0x7fc928100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:51.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.028+0000 7fc92f9e3700 1 --2- 172.21.15.46:0/3383559396 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc928101a40 0x7fc928101ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:51.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.028+0000 7fc92f9e3700 1 -- 172.21.15.46:0/3383559396 >> 172.21.15.46:0/3383559396 conn(0x7fc9280fbe00 msgr2=0x7fc9280fe220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:35:51.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.028+0000 7fc92f9e3700 1 -- 172.21.15.46:0/3383559396 shutdown_connections 2023-10-19T12:35:51.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.028+0000 7fc92f9e3700 1 -- 172.21.15.46:0/3383559396 wait complete. 2023-10-19T12:35:51.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.029+0000 7fc92f9e3700 1 Processor -- start 2023-10-19T12:35:51.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.030+0000 7fc92f9e3700 1 -- start start 2023-10-19T12:35:51.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.030+0000 7fc92f9e3700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc928100840 0x7fc9281968b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:35:51.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.030+0000 7fc92f9e3700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc928101a40 0x7fc928196df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:35:51.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.030+0000 7fc92f9e3700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9281023e0 0x7fc92819ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:35:51.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.030+0000 7fc92f9e3700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc92819e3a0 con 0x7fc928101a40 2023-10-19T12:35:51.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.030+0000 7fc92f9e3700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc92819e4e0 con 0x7fc928100840 2023-10-19T12:35:51.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.030+0000 7fc92f9e3700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc92819e670 con 0x7fc9281023e0 2023-10-19T12:35:51.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.030+0000 7fc92cf7e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc928101a40 0x7fc928196df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:35:51.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.030+0000 7fc92d77f700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc928100840 0x7fc9281968b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:35:51.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.030+0000 7fc92cf7e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc928101a40 0x7fc928196df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49114/0 (socket says 172.21.15.46:49114) 2023-10-19T12:35:51.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.030+0000 7fc92d77f700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc928100840 0x7fc9281968b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:42758/0 (socket says 172.21.15.46:42758) 2023-10-19T12:35:51.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.030+0000 7fc92cf7e700 1 -- 172.21.15.46:0/3346189119 learned_addr learned my addr 172.21.15.46:0/3346189119 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:35:51.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.030+0000 7fc92df80700 1 --2- 172.21.15.46:0/3346189119 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9281023e0 0x7fc92819ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:35:51.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.031+0000 7fc92d77f700 1 -- 172.21.15.46:0/3346189119 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9281023e0 msgr2=0x7fc92819ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:35:51.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.031+0000 7fc92d77f700 1 --2- 172.21.15.46:0/3346189119 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9281023e0 0x7fc92819ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:51.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.031+0000 7fc92d77f700 1 -- 172.21.15.46:0/3346189119 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc928101a40 msgr2=0x7fc928196df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:35:51.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.031+0000 7fc92d77f700 1 --2- 172.21.15.46:0/3346189119 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc928101a40 0x7fc928196df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:51.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.031+0000 7fc92d77f700 1 -- 172.21.15.46:0/3346189119 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc920009d00 con 0x7fc928100840 2023-10-19T12:35:51.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.031+0000 7fc92cf7e700 1 --2- 172.21.15.46:0/3346189119 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc928101a40 0x7fc928196df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:35:51.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.031+0000 7fc92df80700 1 --2- 172.21.15.46:0/3346189119 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9281023e0 0x7fc92819ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:35:51.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.031+0000 7fc92d77f700 1 --2- 172.21.15.46:0/3346189119 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc928100840 0x7fc9281968b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc92400e9c0 tx=0x7fc92400ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:35:51.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.031+0000 7fc91e7fc700 1 -- 172.21.15.46:0/3346189119 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc924004220 con 0x7fc928100840 2023-10-19T12:35:51.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.031+0000 7fc91e7fc700 1 -- 172.21.15.46:0/3346189119 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc924004380 con 0x7fc928100840 2023-10-19T12:35:51.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.031+0000 7fc92f9e3700 1 -- 172.21.15.46:0/3346189119 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc92819e950 con 0x7fc928100840 2023-10-19T12:35:51.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.031+0000 7fc91e7fc700 1 -- 172.21.15.46:0/3346189119 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc924003c50 con 0x7fc928100840 2023-10-19T12:35:51.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.031+0000 7fc92f9e3700 1 -- 172.21.15.46:0/3346189119 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc92819ee50 con 0x7fc928100840 2023-10-19T12:35:51.049 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.033+0000 7fc92f9e3700 1 -- 172.21.15.46:0/3346189119 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc928107c00 con 0x7fc928100840 2023-10-19T12:35:51.049 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.035+0000 7fc91e7fc700 1 -- 172.21.15.46:0/3346189119 <== mon.2 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 15) v1 ==== 135947+0+0 (secure 0 0 0) 0x7fc92400c7c0 con 0x7fc928100840 2023-10-19T12:35:51.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.036+0000 7fc91e7fc700 1 --2- 172.21.15.46:0/3346189119 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fc9140a13f0 0x7fc9140a38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:35:51.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.036+0000 7fc91e7fc700 1 -- 172.21.15.46:0/3346189119 <== mon.2 v2:172.21.15.157:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fc924014070 con 0x7fc928100840 2023-10-19T12:35:51.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.036+0000 7fc92cf7e700 1 --2- 172.21.15.46:0/3346189119 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fc9140a13f0 0x7fc9140a38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:35:51.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.037+0000 7fc92cf7e700 1 --2- 172.21.15.46:0/3346189119 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fc9140a13f0 0x7fc9140a38b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc918011550 tx=0x7fc918009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:35:51.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.040+0000 7fc91e7fc700 1 -- 172.21.15.46:0/3346189119 <== mon.2 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc9240964e0 con 0x7fc928100840 2023-10-19T12:35:51.108 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '96a8be3c-6e7b-11ee-8db6-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi046') 2023-10-19T12:35:51.109 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '96a8be3c-6e7b-11ee-8db6-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi046') 2023-10-19T12:35:51.110 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '96a8be3c-6e7b-11ee-8db6-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi046') 2023-10-19T12:35:51.111 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '96a8be3c-6e7b-11ee-8db6-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi046') 2023-10-19T12:35:51.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.282+0000 7fc92f9e3700 1 -- 172.21.15.46:0/3346189119 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) v1 -- 0x7fc92804e4c0 con 0x7fc928100840 2023-10-19T12:35:51.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.288+0000 7fc91e7fc700 1 -- 172.21.15.46:0/3346189119 <== mon.2 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v29)=0 v29) v1 ==== 121+0+0 (secure 0 0 0) 0x7fc924099b00 con 0x7fc928100840 2023-10-19T12:35:51.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.290+0000 7fc92f9e3700 1 -- 172.21.15.46:0/3346189119 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fc9140a13f0 msgr2=0x7fc9140a38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:35:51.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.290+0000 7fc92f9e3700 1 --2- 172.21.15.46:0/3346189119 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fc9140a13f0 0x7fc9140a38b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc918011550 tx=0x7fc918009260 comp rx=0 tx=0).stop 2023-10-19T12:35:51.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.290+0000 7fc92f9e3700 1 -- 172.21.15.46:0/3346189119 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc928100840 msgr2=0x7fc9281968b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:35:51.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.290+0000 7fc92f9e3700 1 --2- 172.21.15.46:0/3346189119 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc928100840 0x7fc9281968b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc92400e9c0 tx=0x7fc92400ecd0 comp rx=0 tx=0).stop 2023-10-19T12:35:51.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.290+0000 7fc92f9e3700 1 -- 172.21.15.46:0/3346189119 shutdown_connections 2023-10-19T12:35:51.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.290+0000 7fc92f9e3700 1 --2- 172.21.15.46:0/3346189119 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fc9140a13f0 0x7fc9140a38b0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:51.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.290+0000 7fc92f9e3700 1 --2- 172.21.15.46:0/3346189119 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9281023e0 0x7fc92819ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:51.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.290+0000 7fc92f9e3700 1 --2- 172.21.15.46:0/3346189119 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc928100840 0x7fc9281968b0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:51.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.290+0000 7fc92f9e3700 1 --2- 172.21.15.46:0/3346189119 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc928101a40 0x7fc928196df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:51.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.290+0000 7fc92f9e3700 1 -- 172.21.15.46:0/3346189119 >> 172.21.15.46:0/3346189119 conn(0x7fc9280fbe00 msgr2=0x7fc928104d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:35:51.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.290+0000 7fc92f9e3700 1 -- 172.21.15.46:0/3346189119 shutdown_connections 2023-10-19T12:35:51.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.290+0000 7fc92f9e3700 1 -- 172.21.15.46:0/3346189119 wait complete. 2023-10-19T12:35:51.415 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.411+0000 7f3a4c05d700 1 -- 172.21.15.46:0/2967199333 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a44101a40 msgr2=0x7f3a44101ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:35:51.415 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.411+0000 7f3a4c05d700 1 --2- 172.21.15.46:0/2967199333 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a44101a40 0x7f3a44101ea0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3a340099c0 tx=0x7f3a34009cd0 comp rx=0 tx=0).stop 2023-10-19T12:35:51.415 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.411+0000 7f3a4c05d700 1 -- 172.21.15.46:0/2967199333 shutdown_connections 2023-10-19T12:35:51.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.411+0000 7f3a4c05d700 1 --2- 172.21.15.46:0/2967199333 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3a441023e0 0x7f3a44108c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:51.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.411+0000 7f3a4c05d700 1 --2- 172.21.15.46:0/2967199333 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3a44100840 0x7f3a44100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:51.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.411+0000 7f3a4c05d700 1 --2- 172.21.15.46:0/2967199333 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a44101a40 0x7f3a44101ea0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:51.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.411+0000 7f3a4c05d700 1 -- 172.21.15.46:0/2967199333 >> 172.21.15.46:0/2967199333 conn(0x7f3a440fbe00 msgr2=0x7f3a440fe220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:35:51.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.412+0000 7f3a4c05d700 1 -- 172.21.15.46:0/2967199333 shutdown_connections 2023-10-19T12:35:51.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.412+0000 7f3a4c05d700 1 -- 172.21.15.46:0/2967199333 wait complete. 2023-10-19T12:35:51.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.413+0000 7f3a4c05d700 1 Processor -- start 2023-10-19T12:35:51.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.413+0000 7f3a4c05d700 1 -- start start 2023-10-19T12:35:51.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.413+0000 7f3a4c05d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3a44100840 0x7f3a44198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:35:51.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.413+0000 7f3a4c05d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3a44101a40 0x7f3a44198ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:35:51.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.413+0000 7f3a4c05d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a441023e0 0x7f3a4419fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:35:51.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.413+0000 7f3a4c05d700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a441a04c0 con 0x7f3a441023e0 2023-10-19T12:35:51.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.413+0000 7f3a4c05d700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a441a0600 con 0x7f3a44100840 2023-10-19T12:35:51.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.413+0000 7f3a4c05d700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a441a0790 con 0x7f3a44101a40 2023-10-19T12:35:51.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.414+0000 7f3a49df9700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3a44100840 0x7f3a44198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:35:51.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.414+0000 7f3a49df9700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3a44100840 0x7f3a44198980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:42768/0 (socket says 172.21.15.46:42768) 2023-10-19T12:35:51.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.414+0000 7f3a49df9700 1 -- 172.21.15.46:0/1528429343 learned_addr learned my addr 172.21.15.46:0/1528429343 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:35:51.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.414+0000 7f3a495f8700 1 --2- 172.21.15.46:0/1528429343 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3a44101a40 0x7f3a44198ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:35:51.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.414+0000 7f3a4a5fa700 1 --2- 172.21.15.46:0/1528429343 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a441023e0 0x7f3a4419fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:35:51.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.414+0000 7f3a49df9700 1 -- 172.21.15.46:0/1528429343 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3a44101a40 msgr2=0x7f3a44198ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:35:51.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.414+0000 7f3a49df9700 1 --2- 172.21.15.46:0/1528429343 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3a44101a40 0x7f3a44198ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:51.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.414+0000 7f3a49df9700 1 -- 172.21.15.46:0/1528429343 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a441023e0 msgr2=0x7f3a4419fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:35:51.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.414+0000 7f3a49df9700 1 --2- 172.21.15.46:0/1528429343 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a441023e0 0x7f3a4419fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:51.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.414+0000 7f3a49df9700 1 -- 172.21.15.46:0/1528429343 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a40009520 con 0x7f3a44100840 2023-10-19T12:35:51.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.414+0000 7f3a4a5fa700 1 --2- 172.21.15.46:0/1528429343 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a441023e0 0x7f3a4419fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T12:35:51.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.414+0000 7f3a49df9700 1 --2- 172.21.15.46:0/1528429343 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3a44100840 0x7f3a44198980 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3a4000ea50 tx=0x7f3a4000ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:35:51.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.417+0000 7f3a3affd700 1 -- 172.21.15.46:0/1528429343 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a4000cbd0 con 0x7f3a44100840 2023-10-19T12:35:51.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.417+0000 7f3a3affd700 1 -- 172.21.15.46:0/1528429343 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3a4000cd30 con 0x7f3a44100840 2023-10-19T12:35:51.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.417+0000 7f3a4c05d700 1 -- 172.21.15.46:0/1528429343 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a340095f0 con 0x7f3a44100840 2023-10-19T12:35:51.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.417+0000 7f3a3affd700 1 -- 172.21.15.46:0/1528429343 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a400186a0 con 0x7f3a44100840 2023-10-19T12:35:51.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.417+0000 7f3a4c05d700 1 -- 172.21.15.46:0/1528429343 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a441a0e30 con 0x7f3a44100840 2023-10-19T12:35:51.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.418+0000 7f3a4c05d700 1 -- 172.21.15.46:0/1528429343 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a4404e4c0 con 0x7f3a44100840 2023-10-19T12:35:51.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.420+0000 7f3a3affd700 1 -- 172.21.15.46:0/1528429343 <== mon.2 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 15) v1 ==== 135947+0+0 (secure 0 0 0) 0x7f3a40010430 con 0x7f3a44100840 2023-10-19T12:35:51.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.421+0000 7f3a3affd700 1 --2- 172.21.15.46:0/1528429343 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f3a300a1470 0x7f3a300a3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:35:51.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.422+0000 7f3a3affd700 1 -- 172.21.15.46:0/1528429343 <== mon.2 v2:172.21.15.157:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f3a40014070 con 0x7f3a44100840 2023-10-19T12:35:51.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.422+0000 7f3a495f8700 1 --2- 172.21.15.46:0/1528429343 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f3a300a1470 0x7f3a300a3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:35:51.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.422+0000 7f3a495f8700 1 --2- 172.21.15.46:0/1528429343 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f3a300a1470 0x7f3a300a3930 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3a34006010 tx=0x7f3a3400b540 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:35:51.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.425+0000 7f3a3affd700 1 -- 172.21.15.46:0/1528429343 <== mon.2 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3a400967d0 con 0x7f3a44100840 2023-10-19T12:35:51.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.641+0000 7f3a4c05d700 1 -- 172.21.15.46:0/1528429343 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) v1 -- 0x7f3a4410c090 con 0x7f3a44100840 2023-10-19T12:35:51.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.646+0000 7f3a3affd700 1 -- 172.21.15.46:0/1528429343 <== mon.2 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v30)=0 v30) v1 ==== 120+0+0 (secure 0 0 0) 0x7f3a40099df0 con 0x7f3a44100840 2023-10-19T12:35:51.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.649+0000 7f3a4c05d700 1 -- 172.21.15.46:0/1528429343 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f3a300a1470 msgr2=0x7f3a300a3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:35:51.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.649+0000 7f3a4c05d700 1 --2- 172.21.15.46:0/1528429343 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f3a300a1470 0x7f3a300a3930 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3a34006010 tx=0x7f3a3400b540 comp rx=0 tx=0).stop 2023-10-19T12:35:51.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.649+0000 7f3a4c05d700 1 -- 172.21.15.46:0/1528429343 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3a44100840 msgr2=0x7f3a44198980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:35:51.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.649+0000 7f3a4c05d700 1 --2- 172.21.15.46:0/1528429343 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3a44100840 0x7f3a44198980 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3a4000ea50 tx=0x7f3a4000ed60 comp rx=0 tx=0).stop 2023-10-19T12:35:51.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.649+0000 7f3a4c05d700 1 -- 172.21.15.46:0/1528429343 shutdown_connections 2023-10-19T12:35:51.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.649+0000 7f3a4c05d700 1 --2- 172.21.15.46:0/1528429343 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a441023e0 0x7f3a4419fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:51.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.649+0000 7f3a4c05d700 1 --2- 172.21.15.46:0/1528429343 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3a44100840 0x7f3a44198980 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:51.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.649+0000 7f3a4c05d700 1 --2- 172.21.15.46:0/1528429343 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f3a300a1470 0x7f3a300a3930 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:51.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.649+0000 7f3a4c05d700 1 --2- 172.21.15.46:0/1528429343 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3a44101a40 0x7f3a44198ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:35:51.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.649+0000 7f3a4c05d700 1 -- 172.21.15.46:0/1528429343 >> 172.21.15.46:0/1528429343 conn(0x7f3a440fbe00 msgr2=0x7f3a44107200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:35:51.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.649+0000 7f3a4c05d700 1 -- 172.21.15.46:0/1528429343 shutdown_connections 2023-10-19T12:35:51.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:35:51.649+0000 7f3a4c05d700 1 -- 172.21.15.46:0/1528429343 wait complete. 2023-10-19T12:35:51.674 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:51 smithi046 ceph-mon[98509]: from='client.? ' entity='client.admin' 2023-10-19T12:35:51.674 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:51 smithi046 ceph-mon[98509]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:51.674 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:51 smithi046 ceph-mon[98509]: from='client.? ' entity='client.admin' 2023-10-19T12:35:51.837 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:51 smithi157 ceph-mon[134109]: from='client.? ' entity='client.admin' 2023-10-19T12:35:51.838 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:51 smithi157 ceph-mon[134109]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:51.838 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:51 smithi157 ceph-mon[134109]: from='client.? ' entity='client.admin' 2023-10-19T12:35:51.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:51 smithi195 ceph-mon[134493]: from='client.? ' entity='client.admin' 2023-10-19T12:35:51.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:51 smithi195 ceph-mon[134493]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:51.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:51 smithi195 ceph-mon[134493]: from='client.? ' entity='client.admin' 2023-10-19T12:35:52.317 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '96a8be3c-6e7b-11ee-8db6-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi046') 2023-10-19T12:35:52.318 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '96a8be3c-6e7b-11ee-8db6-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi046') 2023-10-19T12:35:52.318 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '96a8be3c-6e7b-11ee-8db6-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi046') 2023-10-19T12:35:52.318 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '96a8be3c-6e7b-11ee-8db6-212e2dc638e7', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi046') 2023-10-19T12:35:52.319 INFO:tasks.cephadm:Deploying OSDs... 2023-10-19T12:35:52.319 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-10-19T12:35:52.319 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/scratch_devs of=/dev/stdout 2023-10-19T12:35:52.365 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-19T12:35:52.366 DEBUG:teuthology.orchestra.run.smithi046:> stat /dev/vg_nvme/lv_1 2023-10-19T12:35:52.451 INFO:teuthology.orchestra.run.smithi046.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-19T12:35:52.451 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-19T12:35:52.451 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 5h/5d Inode: 448 Links: 1 2023-10-19T12:35:52.452 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-19T12:35:52.452 INFO:teuthology.orchestra.run.smithi046.stdout:Context: system_u:object_r:device_t:s0 2023-10-19T12:35:52.452 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 2023-10-19 12:34:36.078282250 +0000 2023-10-19T12:35:52.452 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2023-10-19 12:28:59.285773662 +0000 2023-10-19T12:35:52.452 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2023-10-19 12:28:59.285773662 +0000 2023-10-19T12:35:52.453 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: 2023-10-19 12:28:59.262773896 +0000 2023-10-19T12:35:52.453 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-19T12:35:52.560 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records in 2023-10-19T12:35:52.560 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records out 2023-10-19T12:35:52.560 INFO:teuthology.orchestra.run.smithi046.stderr:512 bytes copied, 0.000199075 s, 2.6 MB/s 2023-10-19T12:35:52.562 DEBUG:teuthology.orchestra.run.smithi046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-19T12:35:52.610 DEBUG:teuthology.orchestra.run.smithi046:> stat /dev/vg_nvme/lv_2 2023-10-19T12:35:52.655 INFO:teuthology.orchestra.run.smithi046.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-19T12:35:52.656 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-19T12:35:52.656 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 5h/5d Inode: 454 Links: 1 2023-10-19T12:35:52.656 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-19T12:35:52.656 INFO:teuthology.orchestra.run.smithi046.stdout:Context: system_u:object_r:device_t:s0 2023-10-19T12:35:52.656 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 2023-10-19 12:34:36.152281482 +0000 2023-10-19T12:35:52.657 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2023-10-19 12:29:00.117765174 +0000 2023-10-19T12:35:52.657 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2023-10-19 12:29:00.117765174 +0000 2023-10-19T12:35:52.657 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: 2023-10-19 12:29:00.093765419 +0000 2023-10-19T12:35:52.657 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-19T12:35:52.763 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records in 2023-10-19T12:35:52.763 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records out 2023-10-19T12:35:52.763 INFO:teuthology.orchestra.run.smithi046.stderr:512 bytes copied, 0.00018755 s, 2.7 MB/s 2023-10-19T12:35:52.765 DEBUG:teuthology.orchestra.run.smithi046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-19T12:35:52.811 DEBUG:teuthology.orchestra.run.smithi046:> stat /dev/vg_nvme/lv_3 2023-10-19T12:35:52.896 INFO:teuthology.orchestra.run.smithi046.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-19T12:35:52.897 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-19T12:35:52.897 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 5h/5d Inode: 460 Links: 1 2023-10-19T12:35:52.897 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-19T12:35:52.897 INFO:teuthology.orchestra.run.smithi046.stdout:Context: system_u:object_r:device_t:s0 2023-10-19T12:35:52.897 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 2023-10-19 12:34:36.214280839 +0000 2023-10-19T12:35:52.897 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2023-10-19 12:29:00.947756707 +0000 2023-10-19T12:35:52.898 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2023-10-19 12:29:00.947756707 +0000 2023-10-19T12:35:52.898 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: 2023-10-19 12:29:00.923756952 +0000 2023-10-19T12:35:52.898 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-19T12:35:52.978 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:52 smithi046 ceph-mon[98509]: from='client.? ' entity='client.admin' 2023-10-19T12:35:53.003 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records in 2023-10-19T12:35:53.004 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records out 2023-10-19T12:35:53.004 INFO:teuthology.orchestra.run.smithi046.stderr:512 bytes copied, 0.000190426 s, 2.7 MB/s 2023-10-19T12:35:53.006 DEBUG:teuthology.orchestra.run.smithi046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-19T12:35:53.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:52 smithi157 ceph-mon[134109]: from='client.? ' entity='client.admin' 2023-10-19T12:35:53.094 DEBUG:teuthology.orchestra.run.smithi046:> stat /dev/vg_nvme/lv_4 2023-10-19T12:35:53.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:52 smithi195 ceph-mon[134493]: from='client.? ' entity='client.admin' 2023-10-19T12:35:53.139 INFO:teuthology.orchestra.run.smithi046.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-19T12:35:53.140 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-19T12:35:53.140 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 5h/5d Inode: 466 Links: 1 2023-10-19T12:35:53.140 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-19T12:35:53.140 INFO:teuthology.orchestra.run.smithi046.stdout:Context: system_u:object_r:device_t:s0 2023-10-19T12:35:53.140 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 2023-10-19 12:34:36.279280165 +0000 2023-10-19T12:35:53.141 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2023-10-19 12:29:01.783748179 +0000 2023-10-19T12:35:53.141 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2023-10-19 12:29:01.783748179 +0000 2023-10-19T12:35:53.141 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: 2023-10-19 12:29:01.758748433 +0000 2023-10-19T12:35:53.141 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-19T12:35:53.246 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records in 2023-10-19T12:35:53.246 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records out 2023-10-19T12:35:53.247 INFO:teuthology.orchestra.run.smithi046.stderr:512 bytes copied, 0.000191652 s, 2.7 MB/s 2023-10-19T12:35:53.249 DEBUG:teuthology.orchestra.run.smithi046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-19T12:35:53.295 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-10-19T12:35:53.295 DEBUG:teuthology.orchestra.run.smithi157:> dd if=/scratch_devs of=/dev/stdout 2023-10-19T12:35:53.316 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-19T12:35:53.317 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_1 2023-10-19T12:35:53.377 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-19T12:35:53.377 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-19T12:35:53.377 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 6h/6d Inode: 385793 Links: 1 2023-10-19T12:35:53.377 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-19T12:35:53.377 INFO:teuthology.orchestra.run.smithi157.stdout:Context: system_u:object_r:device_t:s0 2023-10-19T12:35:53.378 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2023-10-19 12:35:31.390645779 +0000 2023-10-19T12:35:53.378 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2023-10-19 12:25:14.889934913 +0000 2023-10-19T12:35:53.378 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2023-10-19 12:25:14.889934913 +0000 2023-10-19T12:35:53.378 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: - 2023-10-19T12:35:53.379 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-19T12:35:53.450 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2023-10-19T12:35:53.450 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2023-10-19T12:35:53.450 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 0.000135217 s, 3.8 MB/s 2023-10-19T12:35:53.451 DEBUG:teuthology.orchestra.run.smithi157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-19T12:35:53.512 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_2 2023-10-19T12:35:53.571 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-19T12:35:53.572 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-19T12:35:53.572 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 6h/6d Inode: 385837 Links: 1 2023-10-19T12:35:53.572 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-19T12:35:53.572 INFO:teuthology.orchestra.run.smithi157.stdout:Context: system_u:object_r:device_t:s0 2023-10-19T12:35:53.572 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2023-10-19 12:35:31.390645779 +0000 2023-10-19T12:35:53.573 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2023-10-19 12:25:15.398925934 +0000 2023-10-19T12:35:53.573 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2023-10-19 12:25:15.398925934 +0000 2023-10-19T12:35:53.573 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: - 2023-10-19T12:35:53.573 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-19T12:35:53.641 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2023-10-19T12:35:53.641 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2023-10-19T12:35:53.642 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 0.00010866 s, 4.7 MB/s 2023-10-19T12:35:53.643 DEBUG:teuthology.orchestra.run.smithi157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-19T12:35:53.703 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_3 2023-10-19T12:35:53.761 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-19T12:35:53.761 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-19T12:35:53.762 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 6h/6d Inode: 394394 Links: 1 2023-10-19T12:35:53.762 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-19T12:35:53.762 INFO:teuthology.orchestra.run.smithi157.stdout:Context: system_u:object_r:device_t:s0 2023-10-19T12:35:53.762 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2023-10-19 12:35:31.391645761 +0000 2023-10-19T12:35:53.763 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2023-10-19 12:25:15.891917237 +0000 2023-10-19T12:35:53.763 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2023-10-19 12:25:15.891917237 +0000 2023-10-19T12:35:53.763 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: - 2023-10-19T12:35:53.763 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-19T12:35:53.826 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:53 smithi157 ceph-mon[134109]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:53.828 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2023-10-19T12:35:53.828 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2023-10-19T12:35:53.829 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 9.6111e-05 s, 5.3 MB/s 2023-10-19T12:35:53.830 DEBUG:teuthology.orchestra.run.smithi157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-19T12:35:53.889 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_4 2023-10-19T12:35:53.946 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-19T12:35:53.946 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-19T12:35:53.947 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 6h/6d Inode: 396427 Links: 1 2023-10-19T12:35:53.947 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-19T12:35:53.947 INFO:teuthology.orchestra.run.smithi157.stdout:Context: system_u:object_r:device_t:s0 2023-10-19T12:35:53.947 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2023-10-19 12:35:31.391645761 +0000 2023-10-19T12:35:53.947 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2023-10-19 12:25:16.386908504 +0000 2023-10-19T12:35:53.948 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2023-10-19 12:25:16.386908504 +0000 2023-10-19T12:35:53.948 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: - 2023-10-19T12:35:53.948 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-19T12:35:53.978 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:53 smithi046 ceph-mon[98509]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:54.012 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2023-10-19T12:35:54.013 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2023-10-19T12:35:54.013 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 0.000120969 s, 4.2 MB/s 2023-10-19T12:35:54.014 DEBUG:teuthology.orchestra.run.smithi157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-19T12:35:54.072 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2023-10-19T12:35:54.073 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/scratch_devs of=/dev/stdout 2023-10-19T12:35:54.094 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-19T12:35:54.095 DEBUG:teuthology.orchestra.run.smithi195:> stat /dev/vg_nvme/lv_1 2023-10-19T12:35:54.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:53 smithi195 ceph-mon[134493]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:54.150 INFO:teuthology.orchestra.run.smithi195.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-19T12:35:54.151 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-19T12:35:54.151 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 6h/6d Inode: 391756 Links: 1 2023-10-19T12:35:54.151 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-19T12:35:54.151 INFO:teuthology.orchestra.run.smithi195.stdout:Context: system_u:object_r:device_t:s0 2023-10-19T12:35:54.152 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 2023-10-19 12:35:29.166992127 +0000 2023-10-19T12:35:54.152 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2023-10-19 12:25:16.311542056 +0000 2023-10-19T12:35:54.152 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2023-10-19 12:25:16.311542056 +0000 2023-10-19T12:35:54.152 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: - 2023-10-19T12:35:54.152 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-19T12:35:54.224 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records in 2023-10-19T12:35:54.225 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records out 2023-10-19T12:35:54.225 INFO:teuthology.orchestra.run.smithi195.stderr:512 bytes copied, 0.000157066 s, 3.3 MB/s 2023-10-19T12:35:54.226 DEBUG:teuthology.orchestra.run.smithi195:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-19T12:35:54.286 DEBUG:teuthology.orchestra.run.smithi195:> stat /dev/vg_nvme/lv_2 2023-10-19T12:35:54.345 INFO:teuthology.orchestra.run.smithi195.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-19T12:35:54.345 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-19T12:35:54.346 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 6h/6d Inode: 393324 Links: 1 2023-10-19T12:35:54.346 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-19T12:35:54.346 INFO:teuthology.orchestra.run.smithi195.stdout:Context: system_u:object_r:device_t:s0 2023-10-19T12:35:54.346 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 2023-10-19 12:35:29.166992127 +0000 2023-10-19T12:35:54.346 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2023-10-19 12:25:16.827532427 +0000 2023-10-19T12:35:54.347 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2023-10-19 12:25:16.827532427 +0000 2023-10-19T12:35:54.347 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: - 2023-10-19T12:35:54.347 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-19T12:35:54.413 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records in 2023-10-19T12:35:54.414 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records out 2023-10-19T12:35:54.414 INFO:teuthology.orchestra.run.smithi195.stderr:512 bytes copied, 0.000104294 s, 4.9 MB/s 2023-10-19T12:35:54.415 DEBUG:teuthology.orchestra.run.smithi195:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-19T12:35:54.475 DEBUG:teuthology.orchestra.run.smithi195:> stat /dev/vg_nvme/lv_3 2023-10-19T12:35:54.533 INFO:teuthology.orchestra.run.smithi195.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-19T12:35:54.534 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-19T12:35:54.534 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 6h/6d Inode: 394636 Links: 1 2023-10-19T12:35:54.534 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-19T12:35:54.534 INFO:teuthology.orchestra.run.smithi195.stdout:Context: system_u:object_r:device_t:s0 2023-10-19T12:35:54.535 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 2023-10-19 12:35:29.166992127 +0000 2023-10-19T12:35:54.535 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2023-10-19 12:25:17.319523247 +0000 2023-10-19T12:35:54.535 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2023-10-19 12:25:17.319523247 +0000 2023-10-19T12:35:54.535 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: - 2023-10-19T12:35:54.536 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-19T12:35:54.600 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records in 2023-10-19T12:35:54.600 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records out 2023-10-19T12:35:54.600 INFO:teuthology.orchestra.run.smithi195.stderr:512 bytes copied, 0.000117422 s, 4.4 MB/s 2023-10-19T12:35:54.601 DEBUG:teuthology.orchestra.run.smithi195:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-19T12:35:54.660 DEBUG:teuthology.orchestra.run.smithi195:> stat /dev/vg_nvme/lv_4 2023-10-19T12:35:54.716 INFO:teuthology.orchestra.run.smithi195.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-19T12:35:54.717 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-19T12:35:54.717 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 6h/6d Inode: 392086 Links: 1 2023-10-19T12:35:54.717 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-19T12:35:54.718 INFO:teuthology.orchestra.run.smithi195.stdout:Context: system_u:object_r:device_t:s0 2023-10-19T12:35:54.718 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 2023-10-19 12:35:29.166992127 +0000 2023-10-19T12:35:54.718 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2023-10-19 12:25:17.825513804 +0000 2023-10-19T12:35:54.718 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2023-10-19 12:25:17.825513804 +0000 2023-10-19T12:35:54.718 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: - 2023-10-19T12:35:54.719 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-19T12:35:54.783 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records in 2023-10-19T12:35:54.783 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records out 2023-10-19T12:35:54.783 INFO:teuthology.orchestra.run.smithi195.stderr:512 bytes copied, 0.000133065 s, 3.8 MB/s 2023-10-19T12:35:54.784 DEBUG:teuthology.orchestra.run.smithi195:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-19T12:35:54.842 INFO:tasks.cephadm:Deploying osd.0 on smithi046 with /dev/vg_nvme/lv_4... 2023-10-19T12:35:54.845 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-10-19T12:35:55.596 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-19T12:35:55.910 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:55 smithi046 ceph-mon[98509]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:56.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:55 smithi157 ceph-mon[134109]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:56.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:55 smithi195 ceph-mon[134493]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:57.547 INFO:teuthology.orchestra.run.smithi046.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-10-19T12:35:57.547 INFO:teuthology.orchestra.run.smithi046.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-10-19T12:35:57.547 INFO:teuthology.orchestra.run.smithi046.stderr: stderr: 10+0 records in 2023-10-19T12:35:57.547 INFO:teuthology.orchestra.run.smithi046.stderr:10+0 records out 2023-10-19T12:35:57.548 INFO:teuthology.orchestra.run.smithi046.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.03125 s, 336 MB/s 2023-10-19T12:35:57.548 INFO:teuthology.orchestra.run.smithi046.stderr:--> Zapping successful for: 2023-10-19T12:35:57.978 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:57 smithi046 ceph-mon[98509]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:57.980 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph orch daemon add osd smithi046:vg_nvme/lv_4 2023-10-19T12:35:58.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:57 smithi157 ceph-mon[134109]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:58.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:57 smithi195 ceph-mon[134493]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:35:58.724 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-19T12:35:59.963 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:35:59 smithi046 ceph-mon[98509]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:36:00.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:35:59 smithi157 ceph-mon[134109]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:36:00.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:35:59 smithi195 ceph-mon[134493]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:36:00.225 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:36:00.221+0000 7f1711cea700 1 -- 172.21.15.46:0/2478077446 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f170c074820 msgr2=0x7f170c072c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:36:00.225 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:36:00.221+0000 7f1711cea700 1 --2- 172.21.15.46:0/2478077446 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f170c074820 0x7f170c072c80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f16fc009990 tx=0x7f16fc009ca0 comp rx=0 tx=0).stop 2023-10-19T12:36:00.225 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:36:00.221+0000 7f1711cea700 1 -- 172.21.15.46:0/2478077446 shutdown_connections 2023-10-19T12:36:00.226 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:36:00.221+0000 7f1711cea700 1 --2- 172.21.15.46:0/2478077446 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f170c108710 0x7f170c10aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:36:00.226 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:36:00.221+0000 7f1711cea700 1 --2- 172.21.15.46:0/2478077446 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f170c074820 0x7f170c072c80 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:36:00.226 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:36:00.221+0000 7f1711cea700 1 --2- 172.21.15.46:0/2478077446 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f170c073250 0x7f170c0736d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:36:00.226 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:36:00.221+0000 7f1711cea700 1 -- 172.21.15.46:0/2478077446 >> 172.21.15.46:0/2478077446 conn(0x7f170c0fbe00 msgr2=0x7f170c0fe220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:36:00.226 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:36:00.221+0000 7f1711cea700 1 -- 172.21.15.46:0/2478077446 shutdown_connections 2023-10-19T12:36:00.227 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:36:00.221+0000 7f1711cea700 1 -- 172.21.15.46:0/2478077446 wait complete. 2023-10-19T12:36:00.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:36:00.222+0000 7f1711cea700 1 Processor -- start 2023-10-19T12:36:00.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:36:00.223+0000 7f1711cea700 1 -- start start 2023-10-19T12:36:00.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:36:00.223+0000 7f1711cea700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f170c073250 0x7f170c198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:36:00.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:36:00.223+0000 7f1711cea700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f170c074820 0x7f170c198f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:36:00.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:36:00.223+0000 7f1711cea700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f170c108710 0x7f170c19ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:36:00.230 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:36:00.223+0000 7f1711cea700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f170c1a0520 con 0x7f170c074820 2023-10-19T12:36:00.230 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:36:00.223+0000 7f1711cea700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f170c1a0660 con 0x7f170c073250 2023-10-19T12:36:00.230 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:36:00.223+0000 7f1711cea700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f170c1a07f0 con 0x7f170c108710 2023-10-19T12:36:00.230 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:36:00.223+0000 7f170affd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f170c074820 0x7f170c198f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:36:00.230 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:36:00.223+0000 7f170b7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f170c073250 0x7f170c198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:36:00.231 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:36:00.223+0000 7f170affd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f170c074820 0x7f170c198f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34152/0 (socket says 172.21.15.46:34152) 2023-10-19T12:36:00.231 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:36:00.223+0000 7f170affd700 1 -- 172.21.15.46:0/2070673484 learned_addr learned my addr 172.21.15.46:0/2070673484 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:36:00.231 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:36:00.223+0000 7f170bfff700 1 --2- 172.21.15.46:0/2070673484 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f170c108710 0x7f170c19ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:36:00.231 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:36:00.224+0000 7f170affd700 1 -- 172.21.15.46:0/2070673484 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f170c108710 msgr2=0x7f170c19ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:36:00.231 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:36:00.224+0000 7f170affd700 1 --2- 172.21.15.46:0/2070673484 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f170c108710 0x7f170c19ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:36:00.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:36:00.224+0000 7f170affd700 1 -- 172.21.15.46:0/2070673484 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f170c073250 msgr2=0x7f170c198a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:36:00.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:36:00.224+0000 7f170affd700 1 --2- 172.21.15.46:0/2070673484 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f170c073250 0x7f170c198a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:36:00.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:36:00.224+0000 7f170affd700 1 -- 172.21.15.46:0/2070673484 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16fc0095f0 con 0x7f170c074820 2023-10-19T12:36:00.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:36:00.224+0000 7f170b7fe700 1 --2- 172.21.15.46:0/2070673484 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f170c073250 0x7f170c198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:36:00.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:36:00.224+0000 7f170bfff700 1 --2- 172.21.15.46:0/2070673484 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f170c108710 0x7f170c19ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:36:00.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:36:00.224+0000 7f170affd700 1 --2- 172.21.15.46:0/2070673484 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f170c074820 0x7f170c198f70 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f170000e9a0 tx=0x7f170000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:36:00.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:36:00.224+0000 7f1708ff9700 1 -- 172.21.15.46:0/2070673484 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1700009790 con 0x7f170c074820 2023-10-19T12:36:00.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:36:00.224+0000 7f1708ff9700 1 -- 172.21.15.46:0/2070673484 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f170000c810 con 0x7f170c074820 2023-10-19T12:36:00.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:36:00.224+0000 7f1711cea700 1 -- 172.21.15.46:0/2070673484 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f170c1a0ad0 con 0x7f170c074820 2023-10-19T12:36:00.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:36:00.224+0000 7f1708ff9700 1 -- 172.21.15.46:0/2070673484 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1700003c70 con 0x7f170c074820 2023-10-19T12:36:00.234 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:36:00.225+0000 7f1711cea700 1 -- 172.21.15.46:0/2070673484 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f170c1a0fd0 con 0x7f170c074820 2023-10-19T12:36:00.235 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:36:00.226+0000 7f1711cea700 1 -- 172.21.15.46:0/2070673484 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f170c1074d0 con 0x7f170c074820 2023-10-19T12:36:00.235 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:36:00.228+0000 7f1708ff9700 1 -- 172.21.15.46:0/2070673484 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 15) v1 ==== 135947+0+0 (secure 0 0 0) 0x7f170000cc80 con 0x7f170c074820 2023-10-19T12:36:00.235 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:36:00.229+0000 7f1708ff9700 1 --2- 172.21.15.46:0/2070673484 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f16f40a13f0 0x7f16f40a38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:36:00.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:36:00.229+0000 7f1708ff9700 1 -- 172.21.15.46:0/2070673484 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f1700014070 con 0x7f170c074820 2023-10-19T12:36:00.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:36:00.229+0000 7f170b7fe700 1 --2- 172.21.15.46:0/2070673484 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f16f40a13f0 0x7f16f40a38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:36:00.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:36:00.230+0000 7f170b7fe700 1 --2- 172.21.15.46:0/2070673484 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f16f40a13f0 0x7f16f40a38b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f16fc00b680 tx=0x7f16fc005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:36:00.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:36:00.233+0000 7f1708ff9700 1 -- 172.21.15.46:0/2070673484 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f1700096480 con 0x7f170c074820 2023-10-19T12:36:00.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:36:00.454+0000 7f1711cea700 1 -- 172.21.15.46:0/2070673484 --> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f170c060c30 con 0x7f16f40a13f0 2023-10-19T12:36:00.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:00 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-19T12:36:00.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:00 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-19T12:36:00.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:00 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:36:01.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:00 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-19T12:36:01.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:00 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-19T12:36:01.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:00 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:36:01.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:00 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-19T12:36:01.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:00 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-19T12:36:01.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:00 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:36:01.781 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:01 smithi046 ceph-mon[98509]: from='client.14340 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-19T12:36:01.781 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:01 smithi046 ceph-mon[98509]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:36:02.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:01 smithi157 ceph-mon[134109]: from='client.14340 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-19T12:36:02.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:01 smithi157 ceph-mon[134109]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:36:02.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:01 smithi195 ceph-mon[134493]: from='client.14340 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-19T12:36:02.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:01 smithi195 ceph-mon[134493]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:36:03.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:03 smithi046 ceph-mon[98509]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:36:03.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:03 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/3468366792' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "346ce86b-a10a-4869-9fdb-c3c1d4161455"}]: dispatch 2023-10-19T12:36:03.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:03 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/3468366792' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "346ce86b-a10a-4869-9fdb-c3c1d4161455"}]': finished 2023-10-19T12:36:03.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:03 smithi046 ceph-mon[98509]: osdmap e5: 1 total, 0 up, 1 in 2023-10-19T12:36:03.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:03 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-19T12:36:04.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:03 smithi157 ceph-mon[134109]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:36:04.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:03 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/3468366792' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "346ce86b-a10a-4869-9fdb-c3c1d4161455"}]: dispatch 2023-10-19T12:36:04.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:03 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/3468366792' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "346ce86b-a10a-4869-9fdb-c3c1d4161455"}]': finished 2023-10-19T12:36:04.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:03 smithi157 ceph-mon[134109]: osdmap e5: 1 total, 0 up, 1 in 2023-10-19T12:36:04.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:03 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-19T12:36:04.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:03 smithi195 ceph-mon[134493]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:36:04.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:03 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/3468366792' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "346ce86b-a10a-4869-9fdb-c3c1d4161455"}]: dispatch 2023-10-19T12:36:04.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:03 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/3468366792' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "346ce86b-a10a-4869-9fdb-c3c1d4161455"}]': finished 2023-10-19T12:36:04.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:03 smithi195 ceph-mon[134493]: osdmap e5: 1 total, 0 up, 1 in 2023-10-19T12:36:04.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:03 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-19T12:36:04.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:04 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/3825892924' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-19T12:36:05.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:04 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/3825892924' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-19T12:36:05.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:04 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/3825892924' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-19T12:36:05.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:05 smithi046 ceph-mon[98509]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:36:06.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:05 smithi157 ceph-mon[134109]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:36:06.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:05 smithi195 ceph-mon[134493]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:36:07.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:07 smithi046 ceph-mon[98509]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:36:08.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:07 smithi157 ceph-mon[134109]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:36:08.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:07 smithi195 ceph-mon[134493]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:36:09.940 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:09 smithi046 ceph-mon[98509]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:36:10.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:09 smithi157 ceph-mon[134109]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:36:10.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:09 smithi195 ceph-mon[134493]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:36:11.968 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:11 smithi046 ceph-mon[98509]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:36:11.968 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:11 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-10-19T12:36:11.969 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:11 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:36:12.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:11 smithi157 ceph-mon[134109]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:36:12.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:11 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-10-19T12:36:12.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:11 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:36:12.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:11 smithi195 ceph-mon[134493]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:36:12.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:11 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-10-19T12:36:12.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:11 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:36:12.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:12 smithi046 ceph-mon[98509]: Deploying daemon osd.0 on smithi046 2023-10-19T12:36:13.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:12 smithi157 ceph-mon[134109]: Deploying daemon osd.0 on smithi046 2023-10-19T12:36:13.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:12 smithi195 ceph-mon[134493]: Deploying daemon osd.0 on smithi046 2023-10-19T12:36:13.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:13 smithi046 ceph-mon[98509]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:36:14.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:13 smithi157 ceph-mon[134109]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:36:14.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:13 smithi195 ceph-mon[134493]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:36:15.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:15 smithi046 ceph-mon[98509]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:36:16.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:15 smithi157 ceph-mon[134109]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:36:16.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:15 smithi195 ceph-mon[134493]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:36:17.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:17 smithi046 ceph-mon[98509]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:36:17.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:17 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:36:17.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:17 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:36:17.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:17 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:36:18.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:17 smithi157 ceph-mon[134109]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:36:18.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:17 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:36:18.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:17 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:36:18.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:17 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:36:18.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:17 smithi195 ceph-mon[134493]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:36:18.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:17 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:36:18.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:17 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:36:18.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:17 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:36:19.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:19 smithi046 ceph-mon[98509]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:36:19.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:19 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:36:19.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:19 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:36:19.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:19 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:36:19.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:19 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:36:19.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:19 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:36:20.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:19 smithi157 ceph-mon[134109]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:36:20.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:19 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:36:20.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:19 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:36:20.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:19 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:36:20.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:19 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:36:20.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:19 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:36:20.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:19 smithi195 ceph-mon[134493]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:36:20.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:19 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:36:20.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:19 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:36:20.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:19 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:36:20.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:19 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:36:20.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:19 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:36:20.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:36:20.562+0000 7f1708ff9700 1 -- 172.21.15.46:0/2070673484 <== mgr.14150 v2:172.21.15.46:6800/3168073651 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f170c060c30 con 0x7f16f40a13f0 2023-10-19T12:36:20.566 INFO:teuthology.orchestra.run.smithi046.stdout:Created osd(s) 0 on host 'smithi046' 2023-10-19T12:36:20.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:36:20.565+0000 7f1711cea700 1 -- 172.21.15.46:0/2070673484 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f16f40a13f0 msgr2=0x7f16f40a38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:36:20.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:36:20.565+0000 7f1711cea700 1 --2- 172.21.15.46:0/2070673484 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f16f40a13f0 0x7f16f40a38b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f16fc00b680 tx=0x7f16fc005fd0 comp rx=0 tx=0).stop 2023-10-19T12:36:20.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:36:20.565+0000 7f1711cea700 1 -- 172.21.15.46:0/2070673484 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f170c074820 msgr2=0x7f170c198f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:36:20.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:36:20.565+0000 7f1711cea700 1 --2- 172.21.15.46:0/2070673484 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f170c074820 0x7f170c198f70 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f170000e9a0 tx=0x7f170000ecb0 comp rx=0 tx=0).stop 2023-10-19T12:36:20.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:36:20.565+0000 7f1711cea700 1 -- 172.21.15.46:0/2070673484 shutdown_connections 2023-10-19T12:36:20.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:36:20.565+0000 7f1711cea700 1 --2- 172.21.15.46:0/2070673484 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f16f40a13f0 0x7f16f40a38b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:36:20.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:36:20.565+0000 7f1711cea700 1 --2- 172.21.15.46:0/2070673484 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f170c108710 0x7f170c19ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:36:20.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:36:20.565+0000 7f1711cea700 1 --2- 172.21.15.46:0/2070673484 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f170c073250 0x7f170c198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:36:20.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:36:20.565+0000 7f1711cea700 1 --2- 172.21.15.46:0/2070673484 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f170c074820 0x7f170c198f70 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:36:20.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:36:20.565+0000 7f1711cea700 1 -- 172.21.15.46:0/2070673484 >> 172.21.15.46:0/2070673484 conn(0x7f170c0fbe00 msgr2=0x7f170c104610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:36:20.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:36:20.565+0000 7f1711cea700 1 -- 172.21.15.46:0/2070673484 shutdown_connections 2023-10-19T12:36:20.571 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:36:20.565+0000 7f1711cea700 1 -- 172.21.15.46:0/2070673484 wait complete. 2023-10-19T12:36:21.049 DEBUG:teuthology.orchestra.run.smithi046:osd.0> sudo journalctl -f -n 0 -u ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@osd.0.service 2023-10-19T12:36:21.059 INFO:tasks.cephadm:Deploying osd.1 on smithi157 with /dev/vg_nvme/lv_4... 2023-10-19T12:36:21.060 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-10-19T12:36:21.130 INFO:journalctl@ceph.osd.0.smithi046.stdout:-- Logs begin at Thu 2023-10-19 12:15:13 UTC. -- 2023-10-19T12:36:21.626 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.b/config 2023-10-19T12:36:21.838 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:21 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:36:21.838 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:21 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:36:21.838 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:21 smithi157 ceph-mon[134109]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:36:21.839 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:21 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:36:21.839 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:21 smithi157 ceph-mon[134109]: from='osd.0 [v2:172.21.15.46:6802/500237995,v1:172.21.15.46:6803/500237995]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-10-19T12:36:21.839 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:21 smithi157 ceph-mon[134109]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-10-19T12:36:21.843 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:21 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:36:21.843 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:21 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:36:21.843 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:21 smithi046 ceph-mon[98509]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:36:21.844 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:21 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:36:21.844 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:21 smithi046 ceph-mon[98509]: from='osd.0 [v2:172.21.15.46:6802/500237995,v1:172.21.15.46:6803/500237995]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-10-19T12:36:21.844 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:21 smithi046 ceph-mon[98509]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-10-19T12:36:21.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:21 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:36:21.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:21 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:36:21.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:21 smithi195 ceph-mon[134493]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:36:21.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:21 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:36:21.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:21 smithi195 ceph-mon[134493]: from='osd.0 [v2:172.21.15.46:6802/500237995,v1:172.21.15.46:6803/500237995]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-10-19T12:36:21.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:21 smithi195 ceph-mon[134493]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-10-19T12:36:22.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:22 smithi046 ceph-mon[98509]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-10-19T12:36:22.730 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:22 smithi046 ceph-mon[98509]: osdmap e6: 1 total, 0 up, 1 in 2023-10-19T12:36:22.730 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:22 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-19T12:36:22.730 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:22 smithi046 ceph-mon[98509]: from='osd.0 [v2:172.21.15.46:6802/500237995,v1:172.21.15.46:6803/500237995]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2023-10-19T12:36:22.730 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:22 smithi046 ceph-mon[98509]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2023-10-19T12:36:22.731 INFO:journalctl@ceph.osd.0.smithi046.stdout:Oct 19 12:36:22 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-0[117765]: 2023-10-19T12:36:22.566+0000 7fcd69d33700 -1 osd.0 0 waiting for initial osdmap 2023-10-19T12:36:22.731 INFO:journalctl@ceph.osd.0.smithi046.stdout:Oct 19 12:36:22 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-0[117765]: 2023-10-19T12:36:22.571+0000 7fcd65b28700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-19T12:36:22.749 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:22 smithi157 ceph-mon[134109]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-10-19T12:36:22.749 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:22 smithi157 ceph-mon[134109]: osdmap e6: 1 total, 0 up, 1 in 2023-10-19T12:36:22.750 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:22 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-19T12:36:22.750 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:22 smithi157 ceph-mon[134109]: from='osd.0 [v2:172.21.15.46:6802/500237995,v1:172.21.15.46:6803/500237995]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2023-10-19T12:36:22.750 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:22 smithi157 ceph-mon[134109]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2023-10-19T12:36:22.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:22 smithi195 ceph-mon[134493]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-10-19T12:36:22.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:22 smithi195 ceph-mon[134493]: osdmap e6: 1 total, 0 up, 1 in 2023-10-19T12:36:22.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:22 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-19T12:36:22.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:22 smithi195 ceph-mon[134493]: from='osd.0 [v2:172.21.15.46:6802/500237995,v1:172.21.15.46:6803/500237995]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2023-10-19T12:36:22.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:22 smithi195 ceph-mon[134493]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2023-10-19T12:36:23.253 INFO:teuthology.orchestra.run.smithi157.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-10-19T12:36:23.253 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-10-19T12:36:23.254 INFO:teuthology.orchestra.run.smithi157.stderr: stderr: 10+0 records in 2023-10-19T12:36:23.254 INFO:teuthology.orchestra.run.smithi157.stderr:10+0 records out 2023-10-19T12:36:23.254 INFO:teuthology.orchestra.run.smithi157.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0081136 s, 1.3 GB/s 2023-10-19T12:36:23.254 INFO:teuthology.orchestra.run.smithi157.stderr:--> Zapping successful for: 2023-10-19T12:36:23.682 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph orch daemon add osd smithi157:vg_nvme/lv_4 2023-10-19T12:36:23.837 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:23 smithi157 ceph-mon[134109]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]': finished 2023-10-19T12:36:23.838 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:23 smithi157 ceph-mon[134109]: osdmap e7: 1 total, 0 up, 1 in 2023-10-19T12:36:23.838 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:23 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-19T12:36:23.838 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:23 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-19T12:36:23.839 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:23 smithi157 ceph-mon[134109]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:36:23.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:23 smithi195 ceph-mon[134493]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]': finished 2023-10-19T12:36:23.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:23 smithi195 ceph-mon[134493]: osdmap e7: 1 total, 0 up, 1 in 2023-10-19T12:36:23.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:23 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-19T12:36:23.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:23 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-19T12:36:23.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:23 smithi195 ceph-mon[134493]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:36:23.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:23 smithi046 ceph-mon[98509]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]': finished 2023-10-19T12:36:23.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:23 smithi046 ceph-mon[98509]: osdmap e7: 1 total, 0 up, 1 in 2023-10-19T12:36:23.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:23 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-19T12:36:23.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:23 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-19T12:36:23.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:23 smithi046 ceph-mon[98509]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-19T12:36:24.237 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.b/config 2023-10-19T12:36:24.783 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:24 smithi157 ceph-mon[134109]: purged_snaps scrub starts 2023-10-19T12:36:24.783 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:24 smithi157 ceph-mon[134109]: purged_snaps scrub ok 2023-10-19T12:36:24.783 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:24 smithi157 ceph-mon[134109]: osd.0 [v2:172.21.15.46:6802/500237995,v1:172.21.15.46:6803/500237995] boot 2023-10-19T12:36:24.783 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:24 smithi157 ceph-mon[134109]: osdmap e8: 1 total, 1 up, 1 in 2023-10-19T12:36:24.784 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:24 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-19T12:36:24.784 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:24 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:36:24.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:24 smithi195 ceph-mon[134493]: purged_snaps scrub starts 2023-10-19T12:36:24.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:24 smithi195 ceph-mon[134493]: purged_snaps scrub ok 2023-10-19T12:36:24.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:24 smithi195 ceph-mon[134493]: osd.0 [v2:172.21.15.46:6802/500237995,v1:172.21.15.46:6803/500237995] boot 2023-10-19T12:36:24.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:24 smithi195 ceph-mon[134493]: osdmap e8: 1 total, 1 up, 1 in 2023-10-19T12:36:24.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:24 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-19T12:36:24.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:24 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:36:24.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:24 smithi046 ceph-mon[98509]: purged_snaps scrub starts 2023-10-19T12:36:24.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:24 smithi046 ceph-mon[98509]: purged_snaps scrub ok 2023-10-19T12:36:24.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:24 smithi046 ceph-mon[98509]: osd.0 [v2:172.21.15.46:6802/500237995,v1:172.21.15.46:6803/500237995] boot 2023-10-19T12:36:24.983 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:24 smithi046 ceph-mon[98509]: osdmap e8: 1 total, 1 up, 1 in 2023-10-19T12:36:24.983 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:24 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-19T12:36:24.983 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:24 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:36:25.448 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:36:25.442+0000 7fee6d146700 1 -- 172.21.15.157:0/1892972525 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fee681012d0 msgr2=0x7fee68107b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:36:25.448 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:36:25.442+0000 7fee6d146700 1 --2- 172.21.15.157:0/1892972525 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fee681012d0 0x7fee68107b80 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fee6000b0d0 tx=0x7fee6000b3e0 comp rx=0 tx=0).stop 2023-10-19T12:36:25.448 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:36:25.442+0000 7fee6d146700 1 -- 172.21.15.157:0/1892972525 shutdown_connections 2023-10-19T12:36:25.449 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:36:25.442+0000 7fee6d146700 1 --2- 172.21.15.157:0/1892972525 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fee681012d0 0x7fee68107b80 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:36:25.449 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:36:25.442+0000 7fee6d146700 1 --2- 172.21.15.157:0/1892972525 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fee680ff730 0x7fee680ffb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:36:25.449 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:36:25.442+0000 7fee6d146700 1 --2- 172.21.15.157:0/1892972525 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee68100930 0x7fee68100d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:36:25.449 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:36:25.442+0000 7fee6d146700 1 -- 172.21.15.157:0/1892972525 >> 172.21.15.157:0/1892972525 conn(0x7fee680facf0 msgr2=0x7fee680fd110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:36:25.450 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:36:25.442+0000 7fee6d146700 1 -- 172.21.15.157:0/1892972525 shutdown_connections 2023-10-19T12:36:25.450 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:36:25.442+0000 7fee6d146700 1 -- 172.21.15.157:0/1892972525 wait complete. 2023-10-19T12:36:25.450 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:36:25.443+0000 7fee6d146700 1 Processor -- start 2023-10-19T12:36:25.450 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:36:25.443+0000 7fee6d146700 1 -- start start 2023-10-19T12:36:25.451 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:36:25.443+0000 7fee6d146700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee680ff730 0x7fee68198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:36:25.451 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:36:25.443+0000 7fee6d146700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fee68100930 0x7fee68198fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:36:25.451 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:36:25.443+0000 7fee6d146700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fee681012d0 0x7fee6819ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:36:25.451 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:36:25.443+0000 7fee6d146700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee681a05b0 con 0x7fee680ff730 2023-10-19T12:36:25.452 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:36:25.443+0000 7fee6d146700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee681a06f0 con 0x7fee68100930 2023-10-19T12:36:25.452 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:36:25.443+0000 7fee6d146700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee681a0880 con 0x7fee681012d0 2023-10-19T12:36:25.452 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:36:25.443+0000 7fee6659c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fee68100930 0x7fee68198fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:36:25.452 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:36:25.443+0000 7fee6659c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fee68100930 0x7fee68198fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:58534/0 (socket says 172.21.15.157:58534) 2023-10-19T12:36:25.453 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:36:25.443+0000 7fee6659c700 1 -- 172.21.15.157:0/2989629293 learned_addr learned my addr 172.21.15.157:0/2989629293 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-19T12:36:25.453 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:36:25.444+0000 7fee6759e700 1 --2- 172.21.15.157:0/2989629293 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fee681012d0 0x7fee6819ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:36:25.453 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:36:25.444+0000 7fee66d9d700 1 --2- 172.21.15.157:0/2989629293 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee680ff730 0x7fee68198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:36:25.453 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:36:25.444+0000 7fee6659c700 1 -- 172.21.15.157:0/2989629293 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fee681012d0 msgr2=0x7fee6819ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:36:25.454 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:36:25.444+0000 7fee6659c700 1 --2- 172.21.15.157:0/2989629293 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fee681012d0 0x7fee6819ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:36:25.454 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:36:25.444+0000 7fee6659c700 1 -- 172.21.15.157:0/2989629293 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee680ff730 msgr2=0x7fee68198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:36:25.454 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:36:25.444+0000 7fee6659c700 1 --2- 172.21.15.157:0/2989629293 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee680ff730 0x7fee68198a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:36:25.454 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:36:25.444+0000 7fee6659c700 1 -- 172.21.15.157:0/2989629293 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee60009d00 con 0x7fee68100930 2023-10-19T12:36:25.454 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:36:25.444+0000 7fee6659c700 1 --2- 172.21.15.157:0/2989629293 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fee68100930 0x7fee68198fb0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fee5800b530 tx=0x7fee5800b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:36:25.455 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:36:25.444+0000 7fee4ffff700 1 -- 172.21.15.157:0/2989629293 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee58011830 con 0x7fee68100930 2023-10-19T12:36:25.455 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:36:25.444+0000 7fee6d146700 1 -- 172.21.15.157:0/2989629293 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee681a0b60 con 0x7fee68100930 2023-10-19T12:36:25.455 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:36:25.444+0000 7fee4ffff700 1 -- 172.21.15.157:0/2989629293 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fee58011e50 con 0x7fee68100930 2023-10-19T12:36:25.455 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:36:25.444+0000 7fee4ffff700 1 -- 172.21.15.157:0/2989629293 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee5800f2e0 con 0x7fee68100930 2023-10-19T12:36:25.456 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:36:25.444+0000 7fee6d146700 1 -- 172.21.15.157:0/2989629293 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee681a1060 con 0x7fee68100930 2023-10-19T12:36:25.457 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:36:25.445+0000 7fee6d146700 1 -- 172.21.15.157:0/2989629293 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee6804e4c0 con 0x7fee68100930 2023-10-19T12:36:25.457 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:36:25.446+0000 7fee4ffff700 1 -- 172.21.15.157:0/2989629293 <== mon.2 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 15) v1 ==== 135947+0+0 (secure 0 0 0) 0x7fee58010380 con 0x7fee68100930 2023-10-19T12:36:25.457 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:36:25.447+0000 7fee4ffff700 1 --2- 172.21.15.157:0/2989629293 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fee500a13f0 0x7fee500a38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:36:25.457 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:36:25.447+0000 7fee4ffff700 1 -- 172.21.15.157:0/2989629293 <== mon.2 v2:172.21.15.157:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1767+0+0 (secure 0 0 0) 0x7fee580cae40 con 0x7fee68100930 2023-10-19T12:36:25.458 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:36:25.447+0000 7fee66d9d700 1 --2- 172.21.15.157:0/2989629293 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fee500a13f0 0x7fee500a38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:36:25.458 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:36:25.447+0000 7fee66d9d700 1 --2- 172.21.15.157:0/2989629293 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fee500a13f0 0x7fee500a38b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fee5c005950 tx=0x7fee5c0058e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:36:25.458 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:36:25.451+0000 7fee4ffff700 1 -- 172.21.15.157:0/2989629293 <== mon.2 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fee58095e70 con 0x7fee68100930 2023-10-19T12:36:25.655 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:36:25.651+0000 7fee6d146700 1 -- 172.21.15.157:0/2989629293 --> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fee680fcef0 con 0x7fee500a13f0 2023-10-19T12:36:25.837 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:25 smithi157 ceph-mon[134109]: Detected new or changed devices on smithi046 2023-10-19T12:36:25.838 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:25 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:36:25.838 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:25 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:36:25.838 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:25 smithi157 ceph-mon[134109]: osdmap e9: 1 total, 1 up, 1 in 2023-10-19T12:36:25.839 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:25 smithi157 ceph-mon[134109]: Adjusting osd_memory_target on smithi046 to 17276M 2023-10-19T12:36:25.839 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:25 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:36:25.839 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:25 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:36:25.839 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:25 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:36:25.840 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:25 smithi157 ceph-mon[134109]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-19T12:36:25.840 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:25 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:36:25.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:25 smithi195 ceph-mon[134493]: Detected new or changed devices on smithi046 2023-10-19T12:36:25.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:25 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:36:25.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:25 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:36:25.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:25 smithi195 ceph-mon[134493]: osdmap e9: 1 total, 1 up, 1 in 2023-10-19T12:36:25.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:25 smithi195 ceph-mon[134493]: Adjusting osd_memory_target on smithi046 to 17276M 2023-10-19T12:36:25.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:25 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:36:25.882 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:25 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:36:25.882 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:25 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:36:25.882 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:25 smithi195 ceph-mon[134493]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-19T12:36:25.882 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:25 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:36:25.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:25 smithi046 ceph-mon[98509]: Detected new or changed devices on smithi046 2023-10-19T12:36:25.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:25 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:36:25.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:25 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:36:25.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:25 smithi046 ceph-mon[98509]: osdmap e9: 1 total, 1 up, 1 in 2023-10-19T12:36:25.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:25 smithi046 ceph-mon[98509]: Adjusting osd_memory_target on smithi046 to 17276M 2023-10-19T12:36:25.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:25 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:36:25.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:25 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:36:25.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:25 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:36:25.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:25 smithi046 ceph-mon[98509]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-19T12:36:25.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:25 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:36:26.782 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:26 smithi157 ceph-mon[134109]: from='client.24272 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-19T12:36:26.783 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:26 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-19T12:36:26.783 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:26 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-19T12:36:26.783 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:26 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:36:26.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:26 smithi195 ceph-mon[134493]: from='client.24272 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-19T12:36:26.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:26 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-19T12:36:26.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:26 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-19T12:36:26.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:26 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:36:26.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:26 smithi046 ceph-mon[98509]: from='client.24272 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-19T12:36:26.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:26 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-19T12:36:26.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:26 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-19T12:36:26.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:26 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:36:27.837 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:27 smithi157 ceph-mon[134109]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-19T12:36:27.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:27 smithi195 ceph-mon[134493]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-19T12:36:27.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:27 smithi046 ceph-mon[98509]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-19T12:36:28.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:28 smithi195 ceph-mon[134493]: from='client.? 172.21.15.157:0/3836826164' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "02aae687-76c5-4124-bae4-9787ed571c28"}]: dispatch 2023-10-19T12:36:28.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:28 smithi195 ceph-mon[134493]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "02aae687-76c5-4124-bae4-9787ed571c28"}]: dispatch 2023-10-19T12:36:28.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:28 smithi195 ceph-mon[134493]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "02aae687-76c5-4124-bae4-9787ed571c28"}]': finished 2023-10-19T12:36:28.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:28 smithi195 ceph-mon[134493]: osdmap e10: 2 total, 1 up, 2 in 2023-10-19T12:36:28.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:28 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-19T12:36:28.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:28 smithi046 ceph-mon[98509]: from='client.? 172.21.15.157:0/3836826164' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "02aae687-76c5-4124-bae4-9787ed571c28"}]: dispatch 2023-10-19T12:36:28.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:28 smithi046 ceph-mon[98509]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "02aae687-76c5-4124-bae4-9787ed571c28"}]: dispatch 2023-10-19T12:36:28.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:28 smithi046 ceph-mon[98509]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "02aae687-76c5-4124-bae4-9787ed571c28"}]': finished 2023-10-19T12:36:28.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:28 smithi046 ceph-mon[98509]: osdmap e10: 2 total, 1 up, 2 in 2023-10-19T12:36:28.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:28 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-19T12:36:29.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:28 smithi157 ceph-mon[134109]: from='client.? 172.21.15.157:0/3836826164' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "02aae687-76c5-4124-bae4-9787ed571c28"}]: dispatch 2023-10-19T12:36:29.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:28 smithi157 ceph-mon[134109]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "02aae687-76c5-4124-bae4-9787ed571c28"}]: dispatch 2023-10-19T12:36:29.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:28 smithi157 ceph-mon[134109]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "02aae687-76c5-4124-bae4-9787ed571c28"}]': finished 2023-10-19T12:36:29.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:28 smithi157 ceph-mon[134109]: osdmap e10: 2 total, 1 up, 2 in 2023-10-19T12:36:29.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:28 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-19T12:36:29.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:29 smithi195 ceph-mon[134493]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-19T12:36:29.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:29 smithi195 ceph-mon[134493]: from='client.? 172.21.15.157:0/2519496521' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-19T12:36:29.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:29 smithi046 ceph-mon[98509]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-19T12:36:29.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:29 smithi046 ceph-mon[98509]: from='client.? 172.21.15.157:0/2519496521' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-19T12:36:30.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:29 smithi157 ceph-mon[134109]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-19T12:36:30.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:29 smithi157 ceph-mon[134109]: from='client.? 172.21.15.157:0/2519496521' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-19T12:36:31.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:31 smithi195 ceph-mon[134493]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-19T12:36:31.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:31 smithi046 ceph-mon[98509]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-19T12:36:32.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:31 smithi157 ceph-mon[134109]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-19T12:36:33.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:33 smithi195 ceph-mon[134493]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-19T12:36:33.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:33 smithi046 ceph-mon[98509]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-19T12:36:34.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:33 smithi157 ceph-mon[134109]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-19T12:36:35.802 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:35 smithi157 ceph-mon[134109]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-19T12:36:35.803 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:35 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-10-19T12:36:35.803 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:35 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:36:35.803 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:35 smithi157 ceph-mon[134109]: Deploying daemon osd.1 on smithi157 2023-10-19T12:36:35.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:35 smithi195 ceph-mon[134493]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-19T12:36:35.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:35 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-10-19T12:36:35.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:35 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:36:35.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:35 smithi195 ceph-mon[134493]: Deploying daemon osd.1 on smithi157 2023-10-19T12:36:35.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:35 smithi046 ceph-mon[98509]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-19T12:36:35.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:35 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-10-19T12:36:35.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:35 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:36:35.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:35 smithi046 ceph-mon[98509]: Deploying daemon osd.1 on smithi157 2023-10-19T12:36:37.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:37 smithi195 ceph-mon[134493]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-19T12:36:37.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:37 smithi046 ceph-mon[98509]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-19T12:36:38.062 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:37 smithi157 ceph-mon[134109]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-19T12:36:39.837 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:39 smithi157 ceph-mon[134109]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-19T12:36:39.838 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:39 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:36:39.838 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:39 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:36:39.838 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:39 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:36:39.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:39 smithi046 ceph-mon[98509]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-19T12:36:39.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:39 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:36:39.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:39 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:36:39.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:39 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:36:40.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:39 smithi195 ceph-mon[134493]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-19T12:36:40.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:39 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:36:40.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:39 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:36:40.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:39 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:36:41.799 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:41 smithi157 ceph-mon[134109]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-19T12:36:41.799 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:41 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:36:41.799 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:41 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:36:41.799 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:41 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:36:41.800 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:41 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:36:41.800 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:41 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:36:41.822 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:36:41.819+0000 7fee4ffff700 1 -- 172.21.15.157:0/2989629293 <== mgr.14150 v2:172.21.15.46:6800/3168073651 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fee680fcef0 con 0x7fee500a13f0 2023-10-19T12:36:41.823 INFO:teuthology.orchestra.run.smithi157.stdout:Created osd(s) 1 on host 'smithi157' 2023-10-19T12:36:41.824 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:36:41.821+0000 7fee6d146700 1 -- 172.21.15.157:0/2989629293 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fee500a13f0 msgr2=0x7fee500a38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:36:41.824 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:36:41.821+0000 7fee6d146700 1 --2- 172.21.15.157:0/2989629293 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fee500a13f0 0x7fee500a38b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fee5c005950 tx=0x7fee5c0058e0 comp rx=0 tx=0).stop 2023-10-19T12:36:41.824 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:36:41.821+0000 7fee6d146700 1 -- 172.21.15.157:0/2989629293 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fee68100930 msgr2=0x7fee68198fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:36:41.825 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:36:41.821+0000 7fee6d146700 1 --2- 172.21.15.157:0/2989629293 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fee68100930 0x7fee68198fb0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fee5800b530 tx=0x7fee5800b840 comp rx=0 tx=0).stop 2023-10-19T12:36:41.825 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:36:41.821+0000 7fee6d146700 1 -- 172.21.15.157:0/2989629293 shutdown_connections 2023-10-19T12:36:41.825 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:36:41.822+0000 7fee6d146700 1 --2- 172.21.15.157:0/2989629293 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fee500a13f0 0x7fee500a38b0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:36:41.825 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:36:41.822+0000 7fee6d146700 1 --2- 172.21.15.157:0/2989629293 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fee681012d0 0x7fee6819ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:36:41.826 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:36:41.822+0000 7fee6d146700 1 --2- 172.21.15.157:0/2989629293 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee680ff730 0x7fee68198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:36:41.826 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:36:41.822+0000 7fee6d146700 1 --2- 172.21.15.157:0/2989629293 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fee68100930 0x7fee68198fb0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:36:41.826 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:36:41.822+0000 7fee6d146700 1 -- 172.21.15.157:0/2989629293 >> 172.21.15.157:0/2989629293 conn(0x7fee680facf0 msgr2=0x7fee680fc7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:36:41.826 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:36:41.822+0000 7fee6d146700 1 -- 172.21.15.157:0/2989629293 shutdown_connections 2023-10-19T12:36:41.826 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:36:41.822+0000 7fee6d146700 1 -- 172.21.15.157:0/2989629293 wait complete. 2023-10-19T12:36:41.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:41 smithi046 ceph-mon[98509]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-19T12:36:41.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:41 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:36:41.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:41 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:36:41.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:41 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:36:41.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:41 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:36:41.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:41 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:36:42.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:41 smithi195 ceph-mon[134493]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-19T12:36:42.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:41 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:36:42.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:41 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:36:42.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:41 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:36:42.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:41 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:36:42.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:41 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:36:42.231 DEBUG:teuthology.orchestra.run.smithi157:osd.1> sudo journalctl -f -n 0 -u ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@osd.1.service 2023-10-19T12:36:42.234 INFO:tasks.cephadm:Deploying osd.2 on smithi195 with /dev/vg_nvme/lv_4... 2023-10-19T12:36:42.234 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-10-19T12:36:42.262 INFO:journalctl@ceph.osd.1.smithi157.stdout:-- Logs begin at Thu 2023-10-19 12:11:40 UTC. -- 2023-10-19T12:36:42.802 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.c/config 2023-10-19T12:36:43.066 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:42 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:36:43.067 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:42 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:36:43.067 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:42 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:36:43.067 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:42 smithi195 ceph-mon[134493]: pgmap v68: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-19T12:36:43.080 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:42 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:36:43.080 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:42 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:36:43.080 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:42 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:36:43.080 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:42 smithi157 ceph-mon[134109]: pgmap v68: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-19T12:36:43.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:42 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:36:43.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:42 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:36:43.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:42 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:36:43.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:42 smithi046 ceph-mon[98509]: pgmap v68: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-19T12:36:43.337 INFO:journalctl@ceph.osd.1.smithi157.stdout:Oct 19 12:36:43 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-1[139168]: 2023-10-19T12:36:43.097+0000 7feecceca640 -1 osd.1 0 log_to_monitors true 2023-10-19T12:36:44.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:43 smithi157 ceph-mon[134109]: from='osd.1 [v2:172.21.15.157:6800/2496862790,v1:172.21.15.157:6801/2496862790]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-10-19T12:36:44.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:43 smithi157 ceph-mon[134109]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-10-19T12:36:44.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:43 smithi195 ceph-mon[134493]: from='osd.1 [v2:172.21.15.157:6800/2496862790,v1:172.21.15.157:6801/2496862790]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-10-19T12:36:44.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:43 smithi195 ceph-mon[134493]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-10-19T12:36:44.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:43 smithi046 ceph-mon[98509]: from='osd.1 [v2:172.21.15.157:6800/2496862790,v1:172.21.15.157:6801/2496862790]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-10-19T12:36:44.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:43 smithi046 ceph-mon[98509]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-10-19T12:36:44.298 INFO:teuthology.orchestra.run.smithi195.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-10-19T12:36:44.298 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-10-19T12:36:44.299 INFO:teuthology.orchestra.run.smithi195.stderr: stderr: 10+0 records in 2023-10-19T12:36:44.299 INFO:teuthology.orchestra.run.smithi195.stderr:10+0 records out 2023-10-19T12:36:44.299 INFO:teuthology.orchestra.run.smithi195.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00810656 s, 1.3 GB/s 2023-10-19T12:36:44.299 INFO:teuthology.orchestra.run.smithi195.stderr: stderr: 2023-10-19T12:36:44.299 INFO:teuthology.orchestra.run.smithi195.stderr:--> Zapping successful for: 2023-10-19T12:36:44.643 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph orch daemon add osd smithi195:vg_nvme/lv_4 2023-10-19T12:36:45.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:44 smithi157 ceph-mon[134109]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-10-19T12:36:45.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:44 smithi157 ceph-mon[134109]: from='osd.1 [v2:172.21.15.157:6800/2496862790,v1:172.21.15.157:6801/2496862790]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2023-10-19T12:36:45.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:44 smithi157 ceph-mon[134109]: osdmap e11: 2 total, 1 up, 2 in 2023-10-19T12:36:45.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:44 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-19T12:36:45.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:44 smithi157 ceph-mon[134109]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2023-10-19T12:36:45.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:44 smithi157 ceph-mon[134109]: pgmap v70: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-19T12:36:45.089 INFO:journalctl@ceph.osd.1.smithi157.stdout:Oct 19 12:36:44 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-1[139168]: 2023-10-19T12:36:44.831+0000 7feec2541700 -1 osd.1 0 waiting for initial osdmap 2023-10-19T12:36:45.089 INFO:journalctl@ceph.osd.1.smithi157.stdout:Oct 19 12:36:44 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-1[139168]: 2023-10-19T12:36:44.835+0000 7feebab2f700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-19T12:36:45.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:44 smithi195 ceph-mon[134493]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-10-19T12:36:45.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:44 smithi195 ceph-mon[134493]: from='osd.1 [v2:172.21.15.157:6800/2496862790,v1:172.21.15.157:6801/2496862790]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2023-10-19T12:36:45.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:44 smithi195 ceph-mon[134493]: osdmap e11: 2 total, 1 up, 2 in 2023-10-19T12:36:45.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:44 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-19T12:36:45.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:44 smithi195 ceph-mon[134493]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2023-10-19T12:36:45.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:44 smithi195 ceph-mon[134493]: pgmap v70: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-19T12:36:45.203 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.c/config 2023-10-19T12:36:45.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:44 smithi046 ceph-mon[98509]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-10-19T12:36:45.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:44 smithi046 ceph-mon[98509]: from='osd.1 [v2:172.21.15.157:6800/2496862790,v1:172.21.15.157:6801/2496862790]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2023-10-19T12:36:45.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:44 smithi046 ceph-mon[98509]: osdmap e11: 2 total, 1 up, 2 in 2023-10-19T12:36:45.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:44 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-19T12:36:45.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:44 smithi046 ceph-mon[98509]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2023-10-19T12:36:45.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:44 smithi046 ceph-mon[98509]: pgmap v70: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-19T12:36:46.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:45 smithi195 ceph-mon[134493]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]': finished 2023-10-19T12:36:46.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:45 smithi195 ceph-mon[134493]: osdmap e12: 2 total, 1 up, 2 in 2023-10-19T12:36:46.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:45 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-19T12:36:46.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:45 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-19T12:36:46.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:45 smithi195 ceph-mon[134493]: Detected new or changed devices on smithi157 2023-10-19T12:36:46.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:45 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:36:46.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:45 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:36:46.133 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:45 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:36:46.133 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:45 smithi195 ceph-mon[134493]: Adjusting osd_memory_target on smithi157 to 17168M 2023-10-19T12:36:46.133 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:45 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:36:46.133 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:45 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:36:46.133 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:45 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:36:46.134 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:45 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:36:46.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:45 smithi046 ceph-mon[98509]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]': finished 2023-10-19T12:36:46.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:45 smithi046 ceph-mon[98509]: osdmap e12: 2 total, 1 up, 2 in 2023-10-19T12:36:46.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:45 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-19T12:36:46.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:45 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-19T12:36:46.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:45 smithi046 ceph-mon[98509]: Detected new or changed devices on smithi157 2023-10-19T12:36:46.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:45 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:36:46.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:45 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:36:46.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:45 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:36:46.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:45 smithi046 ceph-mon[98509]: Adjusting osd_memory_target on smithi157 to 17168M 2023-10-19T12:36:46.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:45 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:36:46.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:45 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:36:46.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:45 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:36:46.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:45 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:36:46.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:45 smithi157 ceph-mon[134109]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]': finished 2023-10-19T12:36:46.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:45 smithi157 ceph-mon[134109]: osdmap e12: 2 total, 1 up, 2 in 2023-10-19T12:36:46.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:45 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-19T12:36:46.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:45 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-19T12:36:46.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:45 smithi157 ceph-mon[134109]: Detected new or changed devices on smithi157 2023-10-19T12:36:46.339 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:45 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:36:46.339 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:45 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:36:46.339 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:45 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:36:46.339 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:45 smithi157 ceph-mon[134109]: Adjusting osd_memory_target on smithi157 to 17168M 2023-10-19T12:36:46.339 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:45 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:36:46.340 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:45 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:36:46.340 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:45 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:36:46.340 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:45 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:36:46.373 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:36:46.367+0000 7f58d4724700 1 -- 172.21.15.195:0/2161934103 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58cc100840 msgr2=0x7f58cc100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:36:46.373 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:36:46.367+0000 7f58d4724700 1 --2- 172.21.15.195:0/2161934103 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58cc100840 0x7f58cc100c60 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f58bc009990 tx=0x7f58bc009ca0 comp rx=0 tx=0).stop 2023-10-19T12:36:46.373 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:36:46.368+0000 7f58d4724700 1 -- 172.21.15.195:0/2161934103 shutdown_connections 2023-10-19T12:36:46.374 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:36:46.368+0000 7f58d4724700 1 --2- 172.21.15.195:0/2161934103 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f58cc1023e0 0x7f58cc108c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:36:46.374 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:36:46.368+0000 7f58d4724700 1 --2- 172.21.15.195:0/2161934103 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58cc100840 0x7f58cc100c60 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:36:46.374 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:36:46.368+0000 7f58d4724700 1 --2- 172.21.15.195:0/2161934103 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f58cc101a40 0x7f58cc101ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:36:46.374 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:36:46.368+0000 7f58d4724700 1 -- 172.21.15.195:0/2161934103 >> 172.21.15.195:0/2161934103 conn(0x7f58cc0fbe00 msgr2=0x7f58cc0fe220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:36:46.375 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:36:46.368+0000 7f58d4724700 1 -- 172.21.15.195:0/2161934103 shutdown_connections 2023-10-19T12:36:46.375 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:36:46.368+0000 7f58d4724700 1 -- 172.21.15.195:0/2161934103 wait complete. 2023-10-19T12:36:46.375 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:36:46.368+0000 7f58d4724700 1 Processor -- start 2023-10-19T12:36:46.375 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:36:46.368+0000 7f58d4724700 1 -- start start 2023-10-19T12:36:46.375 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:36:46.368+0000 7f58d4724700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f58cc100840 0x7f58cc074540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:36:46.376 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:36:46.368+0000 7f58d4724700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58cc101a40 0x7f58cc072be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:36:46.376 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:36:46.368+0000 7f58d4724700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f58cc1023e0 0x7f58cc073120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:36:46.376 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:36:46.368+0000 7f58d4724700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58cc0738c0 con 0x7f58cc1023e0 2023-10-19T12:36:46.376 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:36:46.368+0000 7f58d4724700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58cc073a30 con 0x7f58cc100840 2023-10-19T12:36:46.376 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:36:46.368+0000 7f58d4724700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58cc1a08a0 con 0x7f58cc101a40 2023-10-19T12:36:46.377 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:36:46.369+0000 7f58d1cbf700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58cc101a40 0x7f58cc072be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:36:46.377 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:36:46.369+0000 7f58d1cbf700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58cc101a40 0x7f58cc072be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:48568/0 (socket says 172.21.15.195:48568) 2023-10-19T12:36:46.377 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:36:46.369+0000 7f58d1cbf700 1 -- 172.21.15.195:0/370457899 learned_addr learned my addr 172.21.15.195:0/370457899 (peer_addr_for_me v2:172.21.15.195:0/0) 2023-10-19T12:36:46.377 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:36:46.369+0000 7f58d24c0700 1 --2- 172.21.15.195:0/370457899 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f58cc100840 0x7f58cc074540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:36:46.377 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:36:46.369+0000 7f58d1cbf700 1 -- 172.21.15.195:0/370457899 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f58cc100840 msgr2=0x7f58cc074540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:36:46.378 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:36:46.369+0000 7f58d1cbf700 1 --2- 172.21.15.195:0/370457899 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f58cc100840 0x7f58cc074540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:36:46.378 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:36:46.369+0000 7f58d1cbf700 1 -- 172.21.15.195:0/370457899 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f58cc1023e0 msgr2=0x7f58cc073120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:36:46.378 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:36:46.369+0000 7f58d1cbf700 1 --2- 172.21.15.195:0/370457899 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f58cc1023e0 0x7f58cc073120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:36:46.378 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:36:46.369+0000 7f58d1cbf700 1 -- 172.21.15.195:0/370457899 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58bc0095f0 con 0x7f58cc101a40 2023-10-19T12:36:46.378 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:36:46.369+0000 7f58d1cbf700 1 --2- 172.21.15.195:0/370457899 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58cc101a40 0x7f58cc072be0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f58c800b530 tx=0x7f58c800b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:36:46.379 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:36:46.369+0000 7f58c37fe700 1 -- 172.21.15.195:0/370457899 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c8011830 con 0x7f58cc101a40 2023-10-19T12:36:46.379 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:36:46.369+0000 7f58c37fe700 1 -- 172.21.15.195:0/370457899 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f58c8011e50 con 0x7f58cc101a40 2023-10-19T12:36:46.379 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:36:46.369+0000 7f58d4724700 1 -- 172.21.15.195:0/370457899 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58cc1a0b30 con 0x7f58cc101a40 2023-10-19T12:36:46.379 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:36:46.369+0000 7f58c37fe700 1 -- 172.21.15.195:0/370457899 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c800f2e0 con 0x7f58cc101a40 2023-10-19T12:36:46.379 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:36:46.369+0000 7f58d4724700 1 -- 172.21.15.195:0/370457899 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58cc1a1100 con 0x7f58cc101a40 2023-10-19T12:36:46.380 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:36:46.370+0000 7f58d4724700 1 -- 172.21.15.195:0/370457899 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58cc107d70 con 0x7f58cc101a40 2023-10-19T12:36:46.381 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:36:46.371+0000 7f58c37fe700 1 -- 172.21.15.195:0/370457899 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 15) v1 ==== 135947+0+0 (secure 0 0 0) 0x7f58c8010580 con 0x7f58cc101a40 2023-10-19T12:36:46.381 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:36:46.372+0000 7f58c37fe700 1 --2- 172.21.15.195:0/370457899 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f58b80a1470 0x7f58b80a3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:36:46.381 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:36:46.372+0000 7f58c37fe700 1 -- 172.21.15.195:0/370457899 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2309+0+0 (secure 0 0 0) 0x7f58c80caf20 con 0x7f58cc101a40 2023-10-19T12:36:46.381 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:36:46.372+0000 7f58d24c0700 1 --2- 172.21.15.195:0/370457899 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f58b80a1470 0x7f58b80a3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:36:46.381 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:36:46.373+0000 7f58d24c0700 1 --2- 172.21.15.195:0/370457899 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f58b80a1470 0x7f58b80a3930 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f58bc0038c0 tx=0x7f58bc005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:36:46.382 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:36:46.376+0000 7f58c37fe700 1 -- 172.21.15.195:0/370457899 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f58c8095dd0 con 0x7f58cc101a40 2023-10-19T12:36:46.574 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:36:46.570+0000 7f58d4724700 1 -- 172.21.15.195:0/370457899 --> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f58cc02d020 con 0x7f58b80a1470 2023-10-19T12:36:47.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:46 smithi195 ceph-mon[134493]: purged_snaps scrub starts 2023-10-19T12:36:47.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:46 smithi195 ceph-mon[134493]: purged_snaps scrub ok 2023-10-19T12:36:47.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:46 smithi195 ceph-mon[134493]: osd.1 [v2:172.21.15.157:6800/2496862790,v1:172.21.15.157:6801/2496862790] boot 2023-10-19T12:36:47.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:46 smithi195 ceph-mon[134493]: osdmap e13: 2 total, 2 up, 2 in 2023-10-19T12:36:47.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:46 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-19T12:36:47.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:46 smithi195 ceph-mon[134493]: from='client.24283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-19T12:36:47.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:46 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-19T12:36:47.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:46 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-19T12:36:47.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:46 smithi195 ceph-mon[134493]: pgmap v73: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-19T12:36:47.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:46 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:36:47.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:46 smithi046 ceph-mon[98509]: purged_snaps scrub starts 2023-10-19T12:36:47.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:46 smithi046 ceph-mon[98509]: purged_snaps scrub ok 2023-10-19T12:36:47.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:46 smithi046 ceph-mon[98509]: osd.1 [v2:172.21.15.157:6800/2496862790,v1:172.21.15.157:6801/2496862790] boot 2023-10-19T12:36:47.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:46 smithi046 ceph-mon[98509]: osdmap e13: 2 total, 2 up, 2 in 2023-10-19T12:36:47.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:46 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-19T12:36:47.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:46 smithi046 ceph-mon[98509]: from='client.24283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-19T12:36:47.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:46 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-19T12:36:47.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:46 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-19T12:36:47.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:46 smithi046 ceph-mon[98509]: pgmap v73: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-19T12:36:47.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:46 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:36:47.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:46 smithi157 ceph-mon[134109]: purged_snaps scrub starts 2023-10-19T12:36:47.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:46 smithi157 ceph-mon[134109]: purged_snaps scrub ok 2023-10-19T12:36:47.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:46 smithi157 ceph-mon[134109]: osd.1 [v2:172.21.15.157:6800/2496862790,v1:172.21.15.157:6801/2496862790] boot 2023-10-19T12:36:47.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:46 smithi157 ceph-mon[134109]: osdmap e13: 2 total, 2 up, 2 in 2023-10-19T12:36:47.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:46 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-19T12:36:47.339 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:46 smithi157 ceph-mon[134109]: from='client.24283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-19T12:36:47.339 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:46 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-19T12:36:47.339 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:46 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-19T12:36:47.339 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:46 smithi157 ceph-mon[134109]: pgmap v73: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-19T12:36:47.339 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:46 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:36:48.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:47 smithi195 ceph-mon[134493]: osdmap e14: 2 total, 2 up, 2 in 2023-10-19T12:36:48.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:47 smithi046 ceph-mon[98509]: osdmap e14: 2 total, 2 up, 2 in 2023-10-19T12:36:48.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:47 smithi157 ceph-mon[134109]: osdmap e14: 2 total, 2 up, 2 in 2023-10-19T12:36:49.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:48 smithi195 ceph-mon[134493]: pgmap v75: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-19T12:36:49.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:48 smithi046 ceph-mon[98509]: pgmap v75: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-19T12:36:49.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:48 smithi157 ceph-mon[134109]: pgmap v75: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-19T12:36:50.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:49 smithi195 ceph-mon[134493]: from='client.? 172.21.15.195:0/2897279877' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d5360828-1f58-4380-b2ad-0c21ff850981"}]: dispatch 2023-10-19T12:36:50.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:49 smithi195 ceph-mon[134493]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d5360828-1f58-4380-b2ad-0c21ff850981"}]: dispatch 2023-10-19T12:36:50.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:49 smithi195 ceph-mon[134493]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d5360828-1f58-4380-b2ad-0c21ff850981"}]': finished 2023-10-19T12:36:50.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:49 smithi195 ceph-mon[134493]: osdmap e15: 3 total, 2 up, 3 in 2023-10-19T12:36:50.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:49 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-19T12:36:50.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:49 smithi195 ceph-mon[134493]: from='client.? 172.21.15.195:0/874416421' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-19T12:36:50.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:49 smithi046 ceph-mon[98509]: from='client.? 172.21.15.195:0/2897279877' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d5360828-1f58-4380-b2ad-0c21ff850981"}]: dispatch 2023-10-19T12:36:50.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:49 smithi046 ceph-mon[98509]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d5360828-1f58-4380-b2ad-0c21ff850981"}]: dispatch 2023-10-19T12:36:50.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:49 smithi046 ceph-mon[98509]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d5360828-1f58-4380-b2ad-0c21ff850981"}]': finished 2023-10-19T12:36:50.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:49 smithi046 ceph-mon[98509]: osdmap e15: 3 total, 2 up, 3 in 2023-10-19T12:36:50.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:49 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-19T12:36:50.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:49 smithi046 ceph-mon[98509]: from='client.? 172.21.15.195:0/874416421' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-19T12:36:50.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:49 smithi157 ceph-mon[134109]: from='client.? 172.21.15.195:0/2897279877' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d5360828-1f58-4380-b2ad-0c21ff850981"}]: dispatch 2023-10-19T12:36:50.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:49 smithi157 ceph-mon[134109]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d5360828-1f58-4380-b2ad-0c21ff850981"}]: dispatch 2023-10-19T12:36:50.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:49 smithi157 ceph-mon[134109]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d5360828-1f58-4380-b2ad-0c21ff850981"}]': finished 2023-10-19T12:36:50.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:49 smithi157 ceph-mon[134109]: osdmap e15: 3 total, 2 up, 3 in 2023-10-19T12:36:50.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:49 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-19T12:36:50.339 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:49 smithi157 ceph-mon[134109]: from='client.? 172.21.15.195:0/874416421' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-19T12:36:51.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:50 smithi195 ceph-mon[134493]: pgmap v77: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-19T12:36:51.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:50 smithi046 ceph-mon[98509]: pgmap v77: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-19T12:36:51.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:50 smithi157 ceph-mon[134109]: pgmap v77: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-19T12:36:53.923 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:53 smithi195 ceph-mon[134493]: pgmap v78: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-19T12:36:53.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:53 smithi046 ceph-mon[98509]: pgmap v78: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-19T12:36:54.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:53 smithi157 ceph-mon[134109]: pgmap v78: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-19T12:36:55.899 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:55 smithi195 ceph-mon[134493]: pgmap v79: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-19T12:36:55.899 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:55 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-10-19T12:36:55.899 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:55 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:36:55.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:55 smithi046 ceph-mon[98509]: pgmap v79: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-19T12:36:55.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:55 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-10-19T12:36:55.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:55 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:36:56.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:55 smithi157 ceph-mon[134109]: pgmap v79: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-19T12:36:56.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:55 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-10-19T12:36:56.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:55 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:36:56.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:56 smithi046 ceph-mon[98509]: Deploying daemon osd.2 on smithi195 2023-10-19T12:36:57.075 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:56 smithi195 ceph-mon[134493]: Deploying daemon osd.2 on smithi195 2023-10-19T12:36:57.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:56 smithi157 ceph-mon[134109]: Deploying daemon osd.2 on smithi195 2023-10-19T12:36:57.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:57 smithi046 ceph-mon[98509]: pgmap v80: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-19T12:36:58.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:57 smithi157 ceph-mon[134109]: pgmap v80: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-19T12:36:58.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:57 smithi195 ceph-mon[134493]: pgmap v80: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-19T12:36:59.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:59 smithi195 ceph-mon[134493]: pgmap v81: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-19T12:36:59.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:59 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:36:59.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:59 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:36:59.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:36:59 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:36:59.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:59 smithi046 ceph-mon[98509]: pgmap v81: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-19T12:36:59.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:59 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:36:59.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:59 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:36:59.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:36:59 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:37:00.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:59 smithi157 ceph-mon[134109]: pgmap v81: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-19T12:37:00.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:59 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:00.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:59 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:00.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:36:59 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:37:01.840 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:01 smithi195 ceph-mon[134493]: pgmap v82: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-19T12:37:01.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:01 smithi046 ceph-mon[98509]: pgmap v82: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-19T12:37:02.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:01 smithi157 ceph-mon[134109]: pgmap v82: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-19T12:37:02.239 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:37:02.236+0000 7f58c37fe700 1 -- 172.21.15.195:0/370457899 <== mgr.14150 v2:172.21.15.46:6800/3168073651 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f58cc02d020 con 0x7f58b80a1470 2023-10-19T12:37:02.239 INFO:teuthology.orchestra.run.smithi195.stdout:Created osd(s) 2 on host 'smithi195' 2023-10-19T12:37:02.242 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:37:02.239+0000 7f58d4724700 1 -- 172.21.15.195:0/370457899 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f58b80a1470 msgr2=0x7f58b80a3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:37:02.242 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:37:02.239+0000 7f58d4724700 1 --2- 172.21.15.195:0/370457899 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f58b80a1470 0x7f58b80a3930 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f58bc0038c0 tx=0x7f58bc005fb0 comp rx=0 tx=0).stop 2023-10-19T12:37:02.242 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:37:02.239+0000 7f58d4724700 1 -- 172.21.15.195:0/370457899 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58cc101a40 msgr2=0x7f58cc072be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:37:02.242 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:37:02.239+0000 7f58d4724700 1 --2- 172.21.15.195:0/370457899 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58cc101a40 0x7f58cc072be0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f58c800b530 tx=0x7f58c800b8f0 comp rx=0 tx=0).stop 2023-10-19T12:37:02.242 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:37:02.239+0000 7f58d4724700 1 -- 172.21.15.195:0/370457899 shutdown_connections 2023-10-19T12:37:02.243 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:37:02.239+0000 7f58d4724700 1 --2- 172.21.15.195:0/370457899 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f58cc1023e0 0x7f58cc073120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:37:02.243 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:37:02.239+0000 7f58d4724700 1 --2- 172.21.15.195:0/370457899 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f58cc100840 0x7f58cc074540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:37:02.243 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:37:02.239+0000 7f58d4724700 1 --2- 172.21.15.195:0/370457899 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f58b80a1470 0x7f58b80a3930 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:37:02.243 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:37:02.239+0000 7f58d4724700 1 --2- 172.21.15.195:0/370457899 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58cc101a40 0x7f58cc072be0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:37:02.243 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:37:02.239+0000 7f58d4724700 1 -- 172.21.15.195:0/370457899 >> 172.21.15.195:0/370457899 conn(0x7f58cc0fbe00 msgr2=0x7f58cc104eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:37:02.244 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:37:02.239+0000 7f58d4724700 1 -- 172.21.15.195:0/370457899 shutdown_connections 2023-10-19T12:37:02.244 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:37:02.239+0000 7f58d4724700 1 -- 172.21.15.195:0/370457899 wait complete. 2023-10-19T12:37:02.590 DEBUG:teuthology.orchestra.run.smithi195:osd.2> sudo journalctl -f -n 0 -u ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@osd.2.service 2023-10-19T12:37:02.593 INFO:tasks.cephadm:Deploying osd.3 on smithi046 with /dev/vg_nvme/lv_3... 2023-10-19T12:37:02.593 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-10-19T12:37:02.622 INFO:journalctl@ceph.osd.2.smithi195.stdout:-- Logs begin at Thu 2023-10-19 12:10:53 UTC. -- 2023-10-19T12:37:02.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:02 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:02.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:02 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:02.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:02 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:37:02.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:02 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:37:02.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:02 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:02.882 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:02 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:02.882 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:02 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:02.882 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:02 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:37:02.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:02 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:02.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:02 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:02.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:02 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:37:02.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:02 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:37:02.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:02 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:02.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:02 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:02.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:02 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:02.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:02 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:37:03.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:02 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:03.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:02 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:03.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:02 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:37:03.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:02 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:37:03.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:02 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:03.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:02 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:03.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:02 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:03.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:02 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:37:03.352 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-19T12:37:03.710 INFO:journalctl@ceph.osd.2.smithi195.stdout:Oct 19 12:37:03 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-2[140262]: 2023-10-19T12:37:03.533+0000 7f268e262640 -1 osd.2 0 log_to_monitors true 2023-10-19T12:37:03.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:03 smithi046 ceph-mon[98509]: pgmap v83: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-19T12:37:03.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:03 smithi046 ceph-mon[98509]: from='osd.2 [v2:172.21.15.195:6800/4211767276,v1:172.21.15.195:6801/4211767276]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-10-19T12:37:03.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:03 smithi046 ceph-mon[98509]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-10-19T12:37:04.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:03 smithi157 ceph-mon[134109]: pgmap v83: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-19T12:37:04.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:03 smithi157 ceph-mon[134109]: from='osd.2 [v2:172.21.15.195:6800/4211767276,v1:172.21.15.195:6801/4211767276]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-10-19T12:37:04.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:03 smithi157 ceph-mon[134109]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-10-19T12:37:04.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:03 smithi195 ceph-mon[134493]: pgmap v83: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-19T12:37:04.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:03 smithi195 ceph-mon[134493]: from='osd.2 [v2:172.21.15.195:6800/4211767276,v1:172.21.15.195:6801/4211767276]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-10-19T12:37:04.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:03 smithi195 ceph-mon[134493]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-10-19T12:37:05.351 INFO:teuthology.orchestra.run.smithi046.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-10-19T12:37:05.351 INFO:teuthology.orchestra.run.smithi046.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-10-19T12:37:05.351 INFO:teuthology.orchestra.run.smithi046.stderr: stderr: 10+0 records in 2023-10-19T12:37:05.352 INFO:teuthology.orchestra.run.smithi046.stderr:10+0 records out 2023-10-19T12:37:05.352 INFO:teuthology.orchestra.run.smithi046.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0315911 s, 332 MB/s 2023-10-19T12:37:05.352 INFO:teuthology.orchestra.run.smithi046.stderr:--> Zapping successful for: 2023-10-19T12:37:05.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:05 smithi046 ceph-mon[98509]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-10-19T12:37:05.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:05 smithi046 ceph-mon[98509]: from='osd.2 [v2:172.21.15.195:6800/4211767276,v1:172.21.15.195:6801/4211767276]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2023-10-19T12:37:05.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:05 smithi046 ceph-mon[98509]: osdmap e16: 3 total, 2 up, 3 in 2023-10-19T12:37:05.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:05 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-19T12:37:05.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:05 smithi046 ceph-mon[98509]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2023-10-19T12:37:05.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:05 smithi046 ceph-mon[98509]: pgmap v85: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-19T12:37:05.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:05 smithi157 ceph-mon[134109]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-10-19T12:37:05.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:05 smithi157 ceph-mon[134109]: from='osd.2 [v2:172.21.15.195:6800/4211767276,v1:172.21.15.195:6801/4211767276]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2023-10-19T12:37:05.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:05 smithi157 ceph-mon[134109]: osdmap e16: 3 total, 2 up, 3 in 2023-10-19T12:37:05.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:05 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-19T12:37:05.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:05 smithi157 ceph-mon[134109]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2023-10-19T12:37:05.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:05 smithi157 ceph-mon[134109]: pgmap v85: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-19T12:37:05.630 INFO:journalctl@ceph.osd.2.smithi195.stdout:Oct 19 12:37:05 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-2[140262]: 2023-10-19T12:37:05.207+0000 7f26838d9700 -1 osd.2 0 waiting for initial osdmap 2023-10-19T12:37:05.631 INFO:journalctl@ceph.osd.2.smithi195.stdout:Oct 19 12:37:05 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-2[140262]: 2023-10-19T12:37:05.210+0000 7f267e6cc700 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-19T12:37:05.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:05 smithi195 ceph-mon[134493]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-10-19T12:37:05.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:05 smithi195 ceph-mon[134493]: from='osd.2 [v2:172.21.15.195:6800/4211767276,v1:172.21.15.195:6801/4211767276]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2023-10-19T12:37:05.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:05 smithi195 ceph-mon[134493]: osdmap e16: 3 total, 2 up, 3 in 2023-10-19T12:37:05.632 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:05 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-19T12:37:05.632 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:05 smithi195 ceph-mon[134493]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2023-10-19T12:37:05.632 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:05 smithi195 ceph-mon[134493]: pgmap v85: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-19T12:37:05.736 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph orch daemon add osd smithi046:vg_nvme/lv_3 2023-10-19T12:37:06.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:06 smithi046 ceph-mon[98509]: Detected new or changed devices on smithi195 2023-10-19T12:37:06.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:06 smithi046 ceph-mon[98509]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2023-10-19T12:37:06.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:06 smithi046 ceph-mon[98509]: osdmap e17: 3 total, 2 up, 3 in 2023-10-19T12:37:06.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:06 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-19T12:37:06.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:06 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:06.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:06 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-19T12:37:06.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:06 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:06.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:06 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:37:06.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:06 smithi046 ceph-mon[98509]: Adjusting osd_memory_target on smithi195 to 17168M 2023-10-19T12:37:06.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:06 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:06.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:06 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:37:06.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:06 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:37:06.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:06 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:06.484 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-19T12:37:06.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:06 smithi157 ceph-mon[134109]: Detected new or changed devices on smithi195 2023-10-19T12:37:06.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:06 smithi157 ceph-mon[134109]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2023-10-19T12:37:06.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:06 smithi157 ceph-mon[134109]: osdmap e17: 3 total, 2 up, 3 in 2023-10-19T12:37:06.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:06 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-19T12:37:06.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:06 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:06.589 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:06 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-19T12:37:06.589 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:06 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:06.589 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:06 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:37:06.589 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:06 smithi157 ceph-mon[134109]: Adjusting osd_memory_target on smithi195 to 17168M 2023-10-19T12:37:06.589 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:06 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:06.589 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:06 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:37:06.590 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:06 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:37:06.590 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:06 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:06.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:06 smithi195 ceph-mon[134493]: Detected new or changed devices on smithi195 2023-10-19T12:37:06.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:06 smithi195 ceph-mon[134493]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2023-10-19T12:37:06.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:06 smithi195 ceph-mon[134493]: osdmap e17: 3 total, 2 up, 3 in 2023-10-19T12:37:06.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:06 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-19T12:37:06.632 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:06 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:06.632 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:06 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-19T12:37:06.632 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:06 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:06.632 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:06 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:37:06.632 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:06 smithi195 ceph-mon[134493]: Adjusting osd_memory_target on smithi195 to 17168M 2023-10-19T12:37:06.633 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:06 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:06.633 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:06 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:37:06.633 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:06 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:37:06.633 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:06 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:07.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:07 smithi046 ceph-mon[98509]: purged_snaps scrub starts 2023-10-19T12:37:07.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:07 smithi046 ceph-mon[98509]: purged_snaps scrub ok 2023-10-19T12:37:07.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:07 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-19T12:37:07.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:07 smithi046 ceph-mon[98509]: osd.2 [v2:172.21.15.195:6800/4211767276,v1:172.21.15.195:6801/4211767276] boot 2023-10-19T12:37:07.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:07 smithi046 ceph-mon[98509]: osdmap e18: 3 total, 3 up, 3 in 2023-10-19T12:37:07.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:07 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-19T12:37:07.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:07 smithi046 ceph-mon[98509]: pgmap v88: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-19T12:37:07.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:07 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-10-19T12:37:07.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:07 smithi157 ceph-mon[134109]: purged_snaps scrub starts 2023-10-19T12:37:07.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:07 smithi157 ceph-mon[134109]: purged_snaps scrub ok 2023-10-19T12:37:07.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:07 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-19T12:37:07.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:07 smithi157 ceph-mon[134109]: osd.2 [v2:172.21.15.195:6800/4211767276,v1:172.21.15.195:6801/4211767276] boot 2023-10-19T12:37:07.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:07 smithi157 ceph-mon[134109]: osdmap e18: 3 total, 3 up, 3 in 2023-10-19T12:37:07.589 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:07 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-19T12:37:07.589 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:07 smithi157 ceph-mon[134109]: pgmap v88: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-19T12:37:07.589 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:07 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-10-19T12:37:07.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:07 smithi195 ceph-mon[134493]: purged_snaps scrub starts 2023-10-19T12:37:07.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:07 smithi195 ceph-mon[134493]: purged_snaps scrub ok 2023-10-19T12:37:07.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:07 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-19T12:37:07.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:07 smithi195 ceph-mon[134493]: osd.2 [v2:172.21.15.195:6800/4211767276,v1:172.21.15.195:6801/4211767276] boot 2023-10-19T12:37:07.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:07 smithi195 ceph-mon[134493]: osdmap e18: 3 total, 3 up, 3 in 2023-10-19T12:37:07.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:07 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-19T12:37:07.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:07 smithi195 ceph-mon[134493]: pgmap v88: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-19T12:37:07.632 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:07 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-10-19T12:37:07.972 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:37:07.968+0000 7f34c1f93700 1 -- 172.21.15.46:0/4251486124 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34bc1023e0 msgr2=0x7f34bc108c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:37:07.972 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:37:07.968+0000 7f34c1f93700 1 --2- 172.21.15.46:0/4251486124 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34bc1023e0 0x7f34bc108c90 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f34b400b0a0 tx=0x7f34b400b3b0 comp rx=0 tx=0).stop 2023-10-19T12:37:07.972 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:37:07.968+0000 7f34c1f93700 1 -- 172.21.15.46:0/4251486124 shutdown_connections 2023-10-19T12:37:07.972 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:37:07.968+0000 7f34c1f93700 1 --2- 172.21.15.46:0/4251486124 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34bc1023e0 0x7f34bc108c90 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:37:07.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:37:07.968+0000 7f34c1f93700 1 --2- 172.21.15.46:0/4251486124 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f34bc100840 0x7f34bc100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:37:07.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:37:07.968+0000 7f34c1f93700 1 --2- 172.21.15.46:0/4251486124 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f34bc101a40 0x7f34bc101ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:37:07.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:37:07.968+0000 7f34c1f93700 1 -- 172.21.15.46:0/4251486124 >> 172.21.15.46:0/4251486124 conn(0x7f34bc0fbe00 msgr2=0x7f34bc0fe220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:37:07.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:37:07.968+0000 7f34c1f93700 1 -- 172.21.15.46:0/4251486124 shutdown_connections 2023-10-19T12:37:07.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:37:07.968+0000 7f34c1f93700 1 -- 172.21.15.46:0/4251486124 wait complete. 2023-10-19T12:37:07.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:37:07.969+0000 7f34c1f93700 1 Processor -- start 2023-10-19T12:37:07.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:37:07.969+0000 7f34c1f93700 1 -- start start 2023-10-19T12:37:07.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:37:07.970+0000 7f34c1f93700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34bc100840 0x7f34bc198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:37:07.976 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:37:07.970+0000 7f34c1f93700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f34bc101a40 0x7f34bc198f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:37:07.976 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:37:07.970+0000 7f34c1f93700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f34bc1023e0 0x7f34bc19ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:37:07.976 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:37:07.970+0000 7f34c1f93700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34bc1a0570 con 0x7f34bc1023e0 2023-10-19T12:37:07.976 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:37:07.970+0000 7f34c1f93700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34bc1a06b0 con 0x7f34bc101a40 2023-10-19T12:37:07.976 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:37:07.970+0000 7f34c1f93700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34bc1a0840 con 0x7f34bc100840 2023-10-19T12:37:07.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:37:07.970+0000 7f34bb7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34bc100840 0x7f34bc198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:37:07.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:37:07.970+0000 7f34bbfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f34bc1023e0 0x7f34bc19ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:37:07.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:37:07.970+0000 7f34bb7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34bc100840 0x7f34bc198a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:48318/0 (socket says 172.21.15.46:48318) 2023-10-19T12:37:07.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:37:07.970+0000 7f34bb7fe700 1 -- 172.21.15.46:0/1095886042 learned_addr learned my addr 172.21.15.46:0/1095886042 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:37:07.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:37:07.970+0000 7f34baffd700 1 --2- 172.21.15.46:0/1095886042 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f34bc101a40 0x7f34bc198f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:37:07.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:37:07.970+0000 7f34bb7fe700 1 -- 172.21.15.46:0/1095886042 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f34bc101a40 msgr2=0x7f34bc198f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:37:07.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:37:07.970+0000 7f34bb7fe700 1 --2- 172.21.15.46:0/1095886042 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f34bc101a40 0x7f34bc198f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:37:07.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:37:07.970+0000 7f34bb7fe700 1 -- 172.21.15.46:0/1095886042 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f34bc1023e0 msgr2=0x7f34bc19ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:37:07.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:37:07.970+0000 7f34bb7fe700 1 --2- 172.21.15.46:0/1095886042 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f34bc1023e0 0x7f34bc19ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:37:07.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:37:07.970+0000 7f34bb7fe700 1 -- 172.21.15.46:0/1095886042 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34b4009d00 con 0x7f34bc100840 2023-10-19T12:37:07.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:37:07.971+0000 7f34bb7fe700 1 --2- 172.21.15.46:0/1095886042 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34bc100840 0x7f34bc198a30 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f34ac00e9a0 tx=0x7f34ac00ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:37:07.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:37:07.971+0000 7f34b8ff9700 1 -- 172.21.15.46:0/1095886042 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34ac009790 con 0x7f34bc100840 2023-10-19T12:37:07.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:37:07.971+0000 7f34b8ff9700 1 -- 172.21.15.46:0/1095886042 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f34ac00c810 con 0x7f34bc100840 2023-10-19T12:37:07.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:37:07.971+0000 7f34b8ff9700 1 -- 172.21.15.46:0/1095886042 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34ac003c70 con 0x7f34bc100840 2023-10-19T12:37:07.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:37:07.971+0000 7f34c1f93700 1 -- 172.21.15.46:0/1095886042 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34bc1a0b20 con 0x7f34bc100840 2023-10-19T12:37:07.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:37:07.971+0000 7f34c1f93700 1 -- 172.21.15.46:0/1095886042 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34bc1a0fd0 con 0x7f34bc100840 2023-10-19T12:37:07.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:37:07.972+0000 7f34c1f93700 1 -- 172.21.15.46:0/1095886042 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34bc04e4c0 con 0x7f34bc100840 2023-10-19T12:37:07.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:37:07.974+0000 7f34b8ff9700 1 -- 172.21.15.46:0/1095886042 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 15) v1 ==== 135947+0+0 (secure 0 0 0) 0x7f34ac00cc80 con 0x7f34bc100840 2023-10-19T12:37:07.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:37:07.976+0000 7f34b8ff9700 1 --2- 172.21.15.46:0/1095886042 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f34a40a14f0 0x7f34a40a39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:37:07.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:37:07.976+0000 7f34b8ff9700 1 -- 172.21.15.46:0/1095886042 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3226+0+0 (secure 0 0 0) 0x7f34ac014070 con 0x7f34bc100840 2023-10-19T12:37:07.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:37:07.976+0000 7f34baffd700 1 --2- 172.21.15.46:0/1095886042 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f34a40a14f0 0x7f34a40a39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:37:07.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:37:07.976+0000 7f34baffd700 1 --2- 172.21.15.46:0/1095886042 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f34a40a14f0 0x7f34a40a39b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f34b0009c60 tx=0x7f34b0009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:37:07.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:37:07.980+0000 7f34b8ff9700 1 -- 172.21.15.46:0/1095886042 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f34ac096440 con 0x7f34bc100840 2023-10-19T12:37:08.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:37:08.200+0000 7f34c1f93700 1 -- 172.21.15.46:0/1095886042 --> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f34bc074140 con 0x7f34a40a14f0 2023-10-19T12:37:08.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:08 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-10-19T12:37:08.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:08 smithi157 ceph-mon[134109]: osdmap e19: 3 total, 3 up, 3 in 2023-10-19T12:37:08.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:08 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-10-19T12:37:08.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:08 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-19T12:37:08.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:08 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-19T12:37:08.589 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:08 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:37:08.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:08 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-10-19T12:37:08.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:08 smithi195 ceph-mon[134493]: osdmap e19: 3 total, 3 up, 3 in 2023-10-19T12:37:08.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:08 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-10-19T12:37:08.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:08 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-19T12:37:08.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:08 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-19T12:37:08.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:08 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:37:08.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:08 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-10-19T12:37:08.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:08 smithi046 ceph-mon[98509]: osdmap e19: 3 total, 3 up, 3 in 2023-10-19T12:37:08.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:08 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-10-19T12:37:08.730 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:08 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-19T12:37:08.730 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:08 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-19T12:37:08.730 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:08 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:37:09.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:37:09.245+0000 7f34b8ff9700 1 -- 172.21.15.46:0/1095886042 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f34ac00c980 con 0x7f34bc100840 2023-10-19T12:37:09.361 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:09 smithi046 ceph-mon[98509]: from='client.24310 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-19T12:37:09.361 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:09 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-10-19T12:37:09.361 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:09 smithi046 ceph-mon[98509]: osdmap e20: 3 total, 3 up, 3 in 2023-10-19T12:37:09.361 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:09 smithi046 ceph-mon[98509]: pgmap v91: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-19T12:37:09.362 INFO:journalctl@ceph.osd.0.smithi046.stdout:Oct 19 12:37:09 smithi046 sudo[123163]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-10-19T12:37:09.362 INFO:journalctl@ceph.osd.0.smithi046.stdout:Oct 19 12:37:09 smithi046 sudo[123163]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-19T12:37:09.362 INFO:journalctl@ceph.osd.0.smithi046.stdout:Oct 19 12:37:09 smithi046 sudo[123163]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-19T12:37:09.363 INFO:journalctl@ceph.osd.0.smithi046.stdout:Oct 19 12:37:09 smithi046 sudo[123163]: pam_unix(sudo:session): session closed for user root 2023-10-19T12:37:09.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:09 smithi157 ceph-mon[134109]: from='client.24310 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-19T12:37:09.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:09 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-10-19T12:37:09.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:09 smithi157 ceph-mon[134109]: osdmap e20: 3 total, 3 up, 3 in 2023-10-19T12:37:09.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:09 smithi157 ceph-mon[134109]: pgmap v91: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-19T12:37:09.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:09 smithi195 ceph-mon[134493]: from='client.24310 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-19T12:37:09.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:09 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-10-19T12:37:09.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:09 smithi195 ceph-mon[134493]: osdmap e20: 3 total, 3 up, 3 in 2023-10-19T12:37:09.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:09 smithi195 ceph-mon[134493]: pgmap v91: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-19T12:37:09.670 INFO:journalctl@ceph.osd.0.smithi046.stdout:Oct 19 12:37:09 smithi046 sudo[123230]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-10-19T12:37:09.979 INFO:journalctl@ceph.osd.0.smithi046.stdout:Oct 19 12:37:09 smithi046 sudo[123230]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-19T12:37:09.980 INFO:journalctl@ceph.osd.0.smithi046.stdout:Oct 19 12:37:09 smithi046 sudo[123230]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-19T12:37:09.980 INFO:journalctl@ceph.osd.0.smithi046.stdout:Oct 19 12:37:09 smithi046 sudo[123230]: pam_unix(sudo:session): session closed for user root 2023-10-19T12:37:10.207 INFO:journalctl@ceph.osd.1.smithi157.stdout:Oct 19 12:37:09 smithi157 sudo[143873]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-10-19T12:37:10.207 INFO:journalctl@ceph.osd.1.smithi157.stdout:Oct 19 12:37:09 smithi157 sudo[143873]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-19T12:37:10.207 INFO:journalctl@ceph.osd.1.smithi157.stdout:Oct 19 12:37:09 smithi157 sudo[143873]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-19T12:37:10.208 INFO:journalctl@ceph.osd.1.smithi157.stdout:Oct 19 12:37:09 smithi157 sudo[143873]: pam_unix(sudo:session): session closed for user root 2023-10-19T12:37:10.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:10 smithi157 ceph-mon[134109]: osdmap e21: 3 total, 3 up, 3 in 2023-10-19T12:37:10.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:10 smithi157 ceph-mon[134109]: mgrmap e16: x(active, since 2m), standbys: z, y 2023-10-19T12:37:10.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:10 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:10.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:10 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:10.588 INFO:journalctl@ceph.osd.1.smithi157.stdout:Oct 19 12:37:10 smithi157 sudo[143876]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-10-19T12:37:10.589 INFO:journalctl@ceph.osd.1.smithi157.stdout:Oct 19 12:37:10 smithi157 sudo[143876]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-19T12:37:10.589 INFO:journalctl@ceph.osd.1.smithi157.stdout:Oct 19 12:37:10 smithi157 sudo[143876]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-19T12:37:10.589 INFO:journalctl@ceph.osd.1.smithi157.stdout:Oct 19 12:37:10 smithi157 sudo[143876]: pam_unix(sudo:session): session closed for user root 2023-10-19T12:37:10.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:10 smithi195 ceph-mon[134493]: osdmap e21: 3 total, 3 up, 3 in 2023-10-19T12:37:10.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:10 smithi195 ceph-mon[134493]: mgrmap e16: x(active, since 2m), standbys: z, y 2023-10-19T12:37:10.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:10 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:10.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:10 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:10.631 INFO:journalctl@ceph.osd.2.smithi195.stdout:Oct 19 12:37:10 smithi195 sudo[145698]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-10-19T12:37:10.631 INFO:journalctl@ceph.osd.2.smithi195.stdout:Oct 19 12:37:10 smithi195 sudo[145698]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-19T12:37:10.632 INFO:journalctl@ceph.osd.2.smithi195.stdout:Oct 19 12:37:10 smithi195 sudo[145698]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-19T12:37:10.632 INFO:journalctl@ceph.osd.2.smithi195.stdout:Oct 19 12:37:10 smithi195 sudo[145698]: pam_unix(sudo:session): session closed for user root 2023-10-19T12:37:10.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:10 smithi046 ceph-mon[98509]: osdmap e21: 3 total, 3 up, 3 in 2023-10-19T12:37:10.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:10 smithi046 ceph-mon[98509]: mgrmap e16: x(active, since 2m), standbys: z, y 2023-10-19T12:37:10.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:10 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:10.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:10 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:11.130 INFO:journalctl@ceph.osd.2.smithi195.stdout:Oct 19 12:37:10 smithi195 sudo[145701]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-10-19T12:37:11.131 INFO:journalctl@ceph.osd.2.smithi195.stdout:Oct 19 12:37:10 smithi195 sudo[145701]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-19T12:37:11.131 INFO:journalctl@ceph.osd.2.smithi195.stdout:Oct 19 12:37:10 smithi195 sudo[145701]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-19T12:37:11.131 INFO:journalctl@ceph.osd.2.smithi195.stdout:Oct 19 12:37:10 smithi195 sudo[145701]: pam_unix(sudo:session): session closed for user root 2023-10-19T12:37:11.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:11 smithi046 sudo[123320]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-10-19T12:37:11.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:11 smithi046 sudo[123320]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-19T12:37:11.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:11 smithi046 sudo[123320]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-19T12:37:11.730 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:11 smithi046 sudo[123320]: pam_unix(sudo:session): session closed for user root 2023-10-19T12:37:12.116 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:11 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:12.116 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:11 smithi195 ceph-mon[134493]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-19T12:37:12.116 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:12 smithi195 sudo[145704]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-10-19T12:37:12.117 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:12 smithi195 sudo[145704]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-19T12:37:12.117 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:12 smithi195 sudo[145704]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-19T12:37:12.117 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:12 smithi195 sudo[145704]: pam_unix(sudo:session): session closed for user root 2023-10-19T12:37:12.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:11 smithi046 sudo[123324]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-10-19T12:37:12.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:11 smithi046 sudo[123324]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-19T12:37:12.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:11 smithi046 sudo[123324]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-19T12:37:12.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:11 smithi046 sudo[123324]: pam_unix(sudo:session): session closed for user root 2023-10-19T12:37:12.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:11 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:12.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:11 smithi046 ceph-mon[98509]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-19T12:37:12.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:11 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:12.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:11 smithi157 ceph-mon[134109]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-19T12:37:12.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:12 smithi195 sudo[145707]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-10-19T12:37:12.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:12 smithi195 sudo[145707]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-19T12:37:12.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:12 smithi195 sudo[145707]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-19T12:37:12.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:12 smithi195 sudo[145707]: pam_unix(sudo:session): session closed for user root 2023-10-19T12:37:12.848 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:12 smithi157 sudo[143879]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-10-19T12:37:12.849 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:12 smithi157 sudo[143879]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-19T12:37:12.849 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:12 smithi157 sudo[143879]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-19T12:37:12.849 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:12 smithi157 sudo[143879]: pam_unix(sudo:session): session closed for user root 2023-10-19T12:37:12.850 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:12 smithi157 sudo[143882]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-10-19T12:37:13.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:12 smithi195 ceph-mon[134493]: pgmap v93: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-19T12:37:13.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:12 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/4001899159' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "accb780f-49d0-43f8-b166-ee12c558ef00"}]: dispatch 2023-10-19T12:37:13.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:12 smithi195 ceph-mon[134493]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-19T12:37:13.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:12 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-19T12:37:13.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:12 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-19T12:37:13.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:12 smithi195 ceph-mon[134493]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "accb780f-49d0-43f8-b166-ee12c558ef00"}]: dispatch 2023-10-19T12:37:13.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:12 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-19T12:37:13.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:12 smithi195 ceph-mon[134493]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "accb780f-49d0-43f8-b166-ee12c558ef00"}]': finished 2023-10-19T12:37:13.133 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:12 smithi195 ceph-mon[134493]: osdmap e22: 4 total, 3 up, 4 in 2023-10-19T12:37:13.133 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:12 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-19T12:37:13.133 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:12 smithi195 ceph-mon[134493]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-19T12:37:13.133 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:12 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-19T12:37:13.133 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:12 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-19T12:37:13.134 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:12 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-19T12:37:13.134 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:12 smithi195 ceph-mon[134493]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-19T12:37:13.134 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:12 smithi195 ceph-mon[134493]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-19T12:37:13.134 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:12 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-19T12:37:13.134 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:12 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-19T12:37:13.135 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:12 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-19T12:37:13.135 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:12 smithi195 ceph-mon[134493]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2023-10-19T12:37:13.135 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:12 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/1337212059' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-19T12:37:13.135 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:12 smithi195 ceph-mon[134493]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-19T12:37:13.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:12 smithi046 ceph-mon[98509]: pgmap v93: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-19T12:37:13.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:12 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/4001899159' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "accb780f-49d0-43f8-b166-ee12c558ef00"}]: dispatch 2023-10-19T12:37:13.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:12 smithi046 ceph-mon[98509]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-19T12:37:13.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:12 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-19T12:37:13.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:12 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-19T12:37:13.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:12 smithi046 ceph-mon[98509]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "accb780f-49d0-43f8-b166-ee12c558ef00"}]: dispatch 2023-10-19T12:37:13.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:12 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-19T12:37:13.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:12 smithi046 ceph-mon[98509]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "accb780f-49d0-43f8-b166-ee12c558ef00"}]': finished 2023-10-19T12:37:13.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:12 smithi046 ceph-mon[98509]: osdmap e22: 4 total, 3 up, 4 in 2023-10-19T12:37:13.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:12 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-19T12:37:13.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:12 smithi046 ceph-mon[98509]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-19T12:37:13.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:12 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-19T12:37:13.232 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:12 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-19T12:37:13.232 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:12 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-19T12:37:13.232 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:12 smithi046 ceph-mon[98509]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-19T12:37:13.232 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:12 smithi046 ceph-mon[98509]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-19T12:37:13.232 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:12 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-19T12:37:13.233 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:12 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-19T12:37:13.233 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:12 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-19T12:37:13.233 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:12 smithi046 ceph-mon[98509]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2023-10-19T12:37:13.233 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:12 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/1337212059' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-19T12:37:13.233 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:12 smithi046 ceph-mon[98509]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-19T12:37:13.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:12 smithi157 sudo[143882]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-19T12:37:13.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:12 smithi157 sudo[143882]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-19T12:37:13.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:12 smithi157 sudo[143882]: pam_unix(sudo:session): session closed for user root 2023-10-19T12:37:13.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:12 smithi157 ceph-mon[134109]: pgmap v93: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-19T12:37:13.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:12 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/4001899159' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "accb780f-49d0-43f8-b166-ee12c558ef00"}]: dispatch 2023-10-19T12:37:13.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:12 smithi157 ceph-mon[134109]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-19T12:37:13.339 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:12 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-19T12:37:13.339 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:12 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-19T12:37:13.339 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:12 smithi157 ceph-mon[134109]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "accb780f-49d0-43f8-b166-ee12c558ef00"}]: dispatch 2023-10-19T12:37:13.339 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:12 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-19T12:37:13.339 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:12 smithi157 ceph-mon[134109]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "accb780f-49d0-43f8-b166-ee12c558ef00"}]': finished 2023-10-19T12:37:13.340 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:12 smithi157 ceph-mon[134109]: osdmap e22: 4 total, 3 up, 4 in 2023-10-19T12:37:13.340 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:12 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-19T12:37:13.340 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:12 smithi157 ceph-mon[134109]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-19T12:37:13.340 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:12 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-19T12:37:13.340 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:12 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-19T12:37:13.340 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:12 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-19T12:37:13.341 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:12 smithi157 ceph-mon[134109]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-19T12:37:13.341 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:12 smithi157 ceph-mon[134109]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-19T12:37:13.341 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:12 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-19T12:37:13.341 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:12 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-19T12:37:13.341 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:12 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-19T12:37:13.341 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:12 smithi157 ceph-mon[134109]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2023-10-19T12:37:13.342 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:12 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/1337212059' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-19T12:37:13.342 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:12 smithi157 ceph-mon[134109]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-19T12:37:15.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:15 smithi046 ceph-mon[98509]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2023-10-19T12:37:16.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:15 smithi157 ceph-mon[134109]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2023-10-19T12:37:16.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:15 smithi195 ceph-mon[134493]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2023-10-19T12:37:17.819 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:17 smithi046 ceph-mon[98509]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2023-10-19T12:37:18.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:17 smithi157 ceph-mon[134109]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2023-10-19T12:37:18.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:17 smithi195 ceph-mon[134493]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2023-10-19T12:37:19.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:19 smithi046 ceph-mon[98509]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 39 KiB/s wr, 3 op/s 2023-10-19T12:37:19.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:19 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-10-19T12:37:19.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:19 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:37:20.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:19 smithi157 ceph-mon[134109]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 39 KiB/s wr, 3 op/s 2023-10-19T12:37:20.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:19 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-10-19T12:37:20.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:19 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:37:20.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:19 smithi195 ceph-mon[134493]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 39 KiB/s wr, 3 op/s 2023-10-19T12:37:20.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:19 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-10-19T12:37:20.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:19 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:37:20.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:20 smithi046 ceph-mon[98509]: Deploying daemon osd.3 on smithi046 2023-10-19T12:37:21.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:20 smithi157 ceph-mon[134109]: Deploying daemon osd.3 on smithi046 2023-10-19T12:37:21.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:20 smithi195 ceph-mon[134493]: Deploying daemon osd.3 on smithi046 2023-10-19T12:37:21.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:21 smithi046 ceph-mon[98509]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.0 KiB/s rd, 30 KiB/s wr, 2 op/s 2023-10-19T12:37:22.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:21 smithi157 ceph-mon[134109]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.0 KiB/s rd, 30 KiB/s wr, 2 op/s 2023-10-19T12:37:22.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:21 smithi195 ceph-mon[134493]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.0 KiB/s rd, 30 KiB/s wr, 2 op/s 2023-10-19T12:37:23.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:23 smithi046 ceph-mon[98509]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 859 B/s rd, 24 KiB/s wr, 2 op/s 2023-10-19T12:37:24.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:23 smithi157 ceph-mon[134109]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 859 B/s rd, 24 KiB/s wr, 2 op/s 2023-10-19T12:37:24.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:23 smithi195 ceph-mon[134493]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 859 B/s rd, 24 KiB/s wr, 2 op/s 2023-10-19T12:37:25.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:25 smithi046 ceph-mon[98509]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2023-10-19T12:37:26.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:25 smithi157 ceph-mon[134109]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2023-10-19T12:37:26.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:25 smithi195 ceph-mon[134493]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2023-10-19T12:37:27.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:26 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:27.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:26 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:27.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:26 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:37:27.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:26 smithi157 ceph-mon[134109]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2023-10-19T12:37:27.093 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:26 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:27.094 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:26 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:27.094 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:26 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:37:27.094 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:26 smithi046 ceph-mon[98509]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2023-10-19T12:37:27.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:26 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:27.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:26 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:27.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:26 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:37:27.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:26 smithi195 ceph-mon[134493]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2023-10-19T12:37:29.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:37:29.119+0000 7f34b8ff9700 1 -- 172.21.15.46:0/1095886042 <== mgr.14150 v2:172.21.15.46:6800/3168073651 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f34bc074140 con 0x7f34a40a14f0 2023-10-19T12:37:29.123 INFO:teuthology.orchestra.run.smithi046.stdout:Created osd(s) 3 on host 'smithi046' 2023-10-19T12:37:29.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:37:29.122+0000 7f34c1f93700 1 -- 172.21.15.46:0/1095886042 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f34a40a14f0 msgr2=0x7f34a40a39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:37:29.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:37:29.122+0000 7f34c1f93700 1 --2- 172.21.15.46:0/1095886042 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f34a40a14f0 0x7f34a40a39b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f34b0009c60 tx=0x7f34b0009260 comp rx=0 tx=0).stop 2023-10-19T12:37:29.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:37:29.123+0000 7f34c1f93700 1 -- 172.21.15.46:0/1095886042 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34bc100840 msgr2=0x7f34bc198a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:37:29.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:37:29.123+0000 7f34c1f93700 1 --2- 172.21.15.46:0/1095886042 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34bc100840 0x7f34bc198a30 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f34ac00e9a0 tx=0x7f34ac00ecb0 comp rx=0 tx=0).stop 2023-10-19T12:37:29.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:37:29.123+0000 7f34c1f93700 1 -- 172.21.15.46:0/1095886042 shutdown_connections 2023-10-19T12:37:29.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:37:29.123+0000 7f34c1f93700 1 --2- 172.21.15.46:0/1095886042 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f34bc1023e0 0x7f34bc19ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:37:29.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:37:29.123+0000 7f34c1f93700 1 --2- 172.21.15.46:0/1095886042 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f34a40a14f0 0x7f34a40a39b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:37:29.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:37:29.123+0000 7f34c1f93700 1 --2- 172.21.15.46:0/1095886042 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34bc100840 0x7f34bc198a30 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:37:29.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:37:29.123+0000 7f34c1f93700 1 --2- 172.21.15.46:0/1095886042 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f34bc101a40 0x7f34bc198f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:37:29.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:37:29.123+0000 7f34c1f93700 1 -- 172.21.15.46:0/1095886042 >> 172.21.15.46:0/1095886042 conn(0x7f34bc0fbe00 msgr2=0x7f34bc072a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:37:29.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:37:29.123+0000 7f34c1f93700 1 -- 172.21.15.46:0/1095886042 shutdown_connections 2023-10-19T12:37:29.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:37:29.123+0000 7f34c1f93700 1 -- 172.21.15.46:0/1095886042 wait complete. 2023-10-19T12:37:29.550 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:29 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:29.551 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:29 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:29.551 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:29 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:37:29.551 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:29 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:37:29.551 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:29 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:29.552 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:29 smithi046 ceph-mon[98509]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2023-10-19T12:37:29.552 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:29 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:29.552 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:29 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:37:29.552 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:29 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:29.616 DEBUG:teuthology.orchestra.run.smithi046:osd.3> sudo journalctl -f -n 0 -u ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@osd.3.service 2023-10-19T12:37:29.622 INFO:tasks.cephadm:Deploying osd.4 on smithi157 with /dev/vg_nvme/lv_3... 2023-10-19T12:37:29.622 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-10-19T12:37:29.699 INFO:journalctl@ceph.osd.3.smithi046.stdout:-- Logs begin at Thu 2023-10-19 12:15:13 UTC. -- 2023-10-19T12:37:29.837 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:29 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:29.838 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:29 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:29.838 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:29 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:37:29.838 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:29 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:37:29.838 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:29 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:29.839 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:29 smithi157 ceph-mon[134109]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2023-10-19T12:37:29.839 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:29 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:29.839 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:29 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:37:29.839 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:29 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:29.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:29 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:29.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:29 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:29.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:29 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:37:29.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:29 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:37:29.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:29 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:29.882 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:29 smithi195 ceph-mon[134493]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2023-10-19T12:37:29.882 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:29 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:29.882 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:29 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:37:29.883 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:29 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:29.979 INFO:journalctl@ceph.osd.3.smithi046.stdout:Oct 19 12:37:29 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-3[125604]: 2023-10-19T12:37:29.778+0000 7ffa184c8640 -1 osd.3 0 log_to_monitors true 2023-10-19T12:37:30.192 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.b/config 2023-10-19T12:37:30.747 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:30 smithi157 ceph-mon[134109]: from='osd.3 [v2:172.21.15.46:6810/1964113352,v1:172.21.15.46:6811/1964113352]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-10-19T12:37:30.747 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:30 smithi157 ceph-mon[134109]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-10-19T12:37:30.783 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:30 smithi046 ceph-mon[98509]: from='osd.3 [v2:172.21.15.46:6810/1964113352,v1:172.21.15.46:6811/1964113352]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-10-19T12:37:30.783 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:30 smithi046 ceph-mon[98509]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-10-19T12:37:30.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:30 smithi195 ceph-mon[134493]: from='osd.3 [v2:172.21.15.46:6810/1964113352,v1:172.21.15.46:6811/1964113352]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-10-19T12:37:30.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:30 smithi195 ceph-mon[134493]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-10-19T12:37:31.740 INFO:teuthology.orchestra.run.smithi157.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-10-19T12:37:31.741 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-10-19T12:37:31.741 INFO:teuthology.orchestra.run.smithi157.stderr: stderr: 10+0 records in 2023-10-19T12:37:31.741 INFO:teuthology.orchestra.run.smithi157.stderr:10+0 records out 2023-10-19T12:37:31.741 INFO:teuthology.orchestra.run.smithi157.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0083047 s, 1.3 GB/s 2023-10-19T12:37:31.742 INFO:teuthology.orchestra.run.smithi157.stderr:--> Zapping successful for: 2023-10-19T12:37:31.837 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:31 smithi157 ceph-mon[134109]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-10-19T12:37:31.838 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:31 smithi157 ceph-mon[134109]: osdmap e23: 4 total, 3 up, 4 in 2023-10-19T12:37:31.838 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:31 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-19T12:37:31.838 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:31 smithi157 ceph-mon[134109]: from='osd.3 [v2:172.21.15.46:6810/1964113352,v1:172.21.15.46:6811/1964113352]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2023-10-19T12:37:31.838 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:31 smithi157 ceph-mon[134109]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2023-10-19T12:37:31.839 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:31 smithi157 ceph-mon[134109]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2023-10-19T12:37:31.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:31 smithi195 ceph-mon[134493]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-10-19T12:37:31.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:31 smithi195 ceph-mon[134493]: osdmap e23: 4 total, 3 up, 4 in 2023-10-19T12:37:31.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:31 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-19T12:37:31.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:31 smithi195 ceph-mon[134493]: from='osd.3 [v2:172.21.15.46:6810/1964113352,v1:172.21.15.46:6811/1964113352]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2023-10-19T12:37:31.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:31 smithi195 ceph-mon[134493]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2023-10-19T12:37:31.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:31 smithi195 ceph-mon[134493]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2023-10-19T12:37:31.979 INFO:journalctl@ceph.osd.3.smithi046.stdout:Oct 19 12:37:31 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-3[125604]: 2023-10-19T12:37:31.538+0000 7ffa0db3f700 -1 osd.3 0 waiting for initial osdmap 2023-10-19T12:37:31.979 INFO:journalctl@ceph.osd.3.smithi046.stdout:Oct 19 12:37:31 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-3[125604]: 2023-10-19T12:37:31.545+0000 7ffa07930700 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-19T12:37:31.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:31 smithi046 ceph-mon[98509]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-10-19T12:37:31.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:31 smithi046 ceph-mon[98509]: osdmap e23: 4 total, 3 up, 4 in 2023-10-19T12:37:31.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:31 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-19T12:37:31.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:31 smithi046 ceph-mon[98509]: from='osd.3 [v2:172.21.15.46:6810/1964113352,v1:172.21.15.46:6811/1964113352]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2023-10-19T12:37:31.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:31 smithi046 ceph-mon[98509]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2023-10-19T12:37:31.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:31 smithi046 ceph-mon[98509]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2023-10-19T12:37:32.245 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph orch daemon add osd smithi157:vg_nvme/lv_3 2023-10-19T12:37:32.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:32 smithi046 ceph-mon[98509]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]': finished 2023-10-19T12:37:32.730 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:32 smithi046 ceph-mon[98509]: osdmap e24: 4 total, 3 up, 4 in 2023-10-19T12:37:32.730 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:32 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-19T12:37:32.730 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:32 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-19T12:37:32.802 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.b/config 2023-10-19T12:37:32.837 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:32 smithi157 ceph-mon[134109]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]': finished 2023-10-19T12:37:32.838 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:32 smithi157 ceph-mon[134109]: osdmap e24: 4 total, 3 up, 4 in 2023-10-19T12:37:32.838 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:32 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-19T12:37:32.838 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:32 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-19T12:37:32.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:32 smithi195 ceph-mon[134493]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]': finished 2023-10-19T12:37:32.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:32 smithi195 ceph-mon[134493]: osdmap e24: 4 total, 3 up, 4 in 2023-10-19T12:37:32.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:32 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-19T12:37:32.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:32 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-19T12:37:33.567 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:33 smithi157 ceph-mon[134109]: purged_snaps scrub starts 2023-10-19T12:37:33.567 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:33 smithi157 ceph-mon[134109]: purged_snaps scrub ok 2023-10-19T12:37:33.568 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:33 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-19T12:37:33.568 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:33 smithi157 ceph-mon[134109]: osd.3 [v2:172.21.15.46:6810/1964113352,v1:172.21.15.46:6811/1964113352] boot 2023-10-19T12:37:33.568 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:33 smithi157 ceph-mon[134109]: osdmap e25: 4 total, 4 up, 4 in 2023-10-19T12:37:33.568 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:33 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-19T12:37:33.568 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:33 smithi157 ceph-mon[134109]: pgmap v108: 1 pgs: 1 peering; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2023-10-19T12:37:33.569 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:33 smithi157 ceph-mon[134109]: osdmap e26: 4 total, 4 up, 4 in 2023-10-19T12:37:33.569 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:33 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:33.569 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:33 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:33.569 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:33 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:37:33.569 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:33 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:37:33.570 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:33 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:33.570 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:33 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:37:33.570 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:33 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:37:33.570 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:33 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:33.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:33 smithi195 ceph-mon[134493]: purged_snaps scrub starts 2023-10-19T12:37:33.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:33 smithi195 ceph-mon[134493]: purged_snaps scrub ok 2023-10-19T12:37:33.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:33 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-19T12:37:33.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:33 smithi195 ceph-mon[134493]: osd.3 [v2:172.21.15.46:6810/1964113352,v1:172.21.15.46:6811/1964113352] boot 2023-10-19T12:37:33.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:33 smithi195 ceph-mon[134493]: osdmap e25: 4 total, 4 up, 4 in 2023-10-19T12:37:33.882 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:33 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-19T12:37:33.882 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:33 smithi195 ceph-mon[134493]: pgmap v108: 1 pgs: 1 peering; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2023-10-19T12:37:33.882 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:33 smithi195 ceph-mon[134493]: osdmap e26: 4 total, 4 up, 4 in 2023-10-19T12:37:33.882 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:33 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:33.882 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:33 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:33.883 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:33 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:37:33.883 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:33 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:37:33.883 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:33 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:33.883 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:33 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:37:33.883 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:33 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:37:33.884 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:33 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:33.967 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:37:33.964+0000 7f9ee1893700 1 -- 172.21.15.157:0/3166475708 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9edc0ff9a0 msgr2=0x7f9edc0ffe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:37:33.968 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:37:33.964+0000 7f9ee1893700 1 --2- 172.21.15.157:0/3166475708 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9edc0ff9a0 0x7f9edc0ffe20 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc009990 tx=0x7f9ecc009ca0 comp rx=0 tx=0).stop 2023-10-19T12:37:33.968 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:37:33.964+0000 7f9ee1893700 1 -- 172.21.15.157:0/3166475708 shutdown_connections 2023-10-19T12:37:33.968 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:37:33.964+0000 7f9ee1893700 1 --2- 172.21.15.157:0/3166475708 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9edc100360 0x7f9edc107c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:37:33.968 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:37:33.964+0000 7f9ee1893700 1 --2- 172.21.15.157:0/3166475708 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9edc100d40 0x7f9edc101160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:37:33.969 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:37:33.964+0000 7f9ee1893700 1 --2- 172.21.15.157:0/3166475708 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9edc0ff9a0 0x7f9edc0ffe20 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:37:33.969 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:37:33.964+0000 7f9ee1893700 1 -- 172.21.15.157:0/3166475708 >> 172.21.15.157:0/3166475708 conn(0x7f9edc0fa450 msgr2=0x7f9edc0fc890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:37:33.969 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:37:33.964+0000 7f9ee1893700 1 -- 172.21.15.157:0/3166475708 shutdown_connections 2023-10-19T12:37:33.969 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:37:33.965+0000 7f9ee1893700 1 -- 172.21.15.157:0/3166475708 wait complete. 2023-10-19T12:37:33.969 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:37:33.965+0000 7f9ee1893700 1 Processor -- start 2023-10-19T12:37:33.970 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:37:33.965+0000 7f9ee1893700 1 -- start start 2023-10-19T12:37:33.972 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:37:33.965+0000 7f9ee1893700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9edc0ff9a0 0x7f9edc0ff3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:37:33.972 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:37:33.965+0000 7f9ee1893700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9edc100360 0x7f9edc19b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:37:33.972 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:37:33.965+0000 7f9ee1893700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9edc100d40 0x7f9edc19d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:37:33.973 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:37:33.965+0000 7f9ee1893700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9edc19e180 con 0x7f9edc100360 2023-10-19T12:37:33.973 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:37:33.965+0000 7f9ee1893700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9edc19e2f0 con 0x7f9edc0ff9a0 2023-10-19T12:37:33.973 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:37:33.965+0000 7f9ee1893700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9edc19e4b0 con 0x7f9edc100d40 2023-10-19T12:37:33.973 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:37:33.965+0000 7f9edaffd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9edc0ff9a0 0x7f9edc0ff3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:37:33.974 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:37:33.966+0000 7f9edaffd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9edc0ff9a0 0x7f9edc0ff3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:58614/0 (socket says 172.21.15.157:58614) 2023-10-19T12:37:33.974 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:37:33.966+0000 7f9edaffd700 1 -- 172.21.15.157:0/2265327488 learned_addr learned my addr 172.21.15.157:0/2265327488 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-19T12:37:33.974 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:37:33.966+0000 7f9edb7fe700 1 --2- 172.21.15.157:0/2265327488 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9edc100d40 0x7f9edc19d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:37:33.974 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:37:33.966+0000 7f9edaffd700 1 -- 172.21.15.157:0/2265327488 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9edc100d40 msgr2=0x7f9edc19d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:37:33.974 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:37:33.966+0000 7f9edaffd700 1 --2- 172.21.15.157:0/2265327488 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9edc100d40 0x7f9edc19d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:37:33.975 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:37:33.966+0000 7f9edaffd700 1 -- 172.21.15.157:0/2265327488 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9edc100360 msgr2=0x7f9edc19b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:37:33.975 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:37:33.966+0000 7f9edaffd700 1 --2- 172.21.15.157:0/2265327488 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9edc100360 0x7f9edc19b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:37:33.975 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:37:33.966+0000 7f9edaffd700 1 -- 172.21.15.157:0/2265327488 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ecc0095f0 con 0x7f9edc0ff9a0 2023-10-19T12:37:33.975 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:37:33.966+0000 7f9edaffd700 1 --2- 172.21.15.157:0/2265327488 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9edc0ff9a0 0x7f9edc0ff3a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9ed000c8f0 tx=0x7f9ed000ccb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:37:33.975 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:37:33.966+0000 7f9ee0891700 1 -- 172.21.15.157:0/2265327488 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed0004220 con 0x7f9edc0ff9a0 2023-10-19T12:37:33.976 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:37:33.966+0000 7f9ee0891700 1 -- 172.21.15.157:0/2265327488 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9ed0007dc0 con 0x7f9edc0ff9a0 2023-10-19T12:37:33.976 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:37:33.966+0000 7f9ee0891700 1 -- 172.21.15.157:0/2265327488 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed0003d10 con 0x7f9edc0ff9a0 2023-10-19T12:37:33.976 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:37:33.966+0000 7f9ee1893700 1 -- 172.21.15.157:0/2265327488 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9edc19e790 con 0x7f9edc0ff9a0 2023-10-19T12:37:33.976 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:37:33.966+0000 7f9ee1893700 1 -- 172.21.15.157:0/2265327488 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9edc19ec40 con 0x7f9edc0ff9a0 2023-10-19T12:37:33.976 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:37:33.967+0000 7f9ee1893700 1 -- 172.21.15.157:0/2265327488 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9edc106b90 con 0x7f9edc0ff9a0 2023-10-19T12:37:33.977 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:37:33.968+0000 7f9ee0891700 1 -- 172.21.15.157:0/2265327488 <== mon.2 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f9ed0004380 con 0x7f9edc0ff9a0 2023-10-19T12:37:33.977 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:37:33.969+0000 7f9ee0891700 1 --2- 172.21.15.157:0/2265327488 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f9ec40a1500 0x7f9ec40a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:37:33.977 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:37:33.969+0000 7f9ee0891700 1 -- 172.21.15.157:0/2265327488 <== mon.2 v2:172.21.15.157:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 3698+0+0 (secure 0 0 0) 0x7f9ed00cb710 con 0x7f9edc0ff9a0 2023-10-19T12:37:33.977 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:37:33.969+0000 7f9eda7fc700 1 --2- 172.21.15.157:0/2265327488 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f9ec40a1500 0x7f9ec40a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:37:33.977 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:37:33.970+0000 7f9eda7fc700 1 --2- 172.21.15.157:0/2265327488 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f9ec40a1500 0x7f9ec40a39c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc0098e0 tx=0x7f9ecc005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:37:33.978 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:37:33.973+0000 7f9ee0891700 1 -- 172.21.15.157:0/2265327488 <== mon.2 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f9ed0095f70 con 0x7f9edc0ff9a0 2023-10-19T12:37:33.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:33 smithi046 ceph-mon[98509]: purged_snaps scrub starts 2023-10-19T12:37:33.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:33 smithi046 ceph-mon[98509]: purged_snaps scrub ok 2023-10-19T12:37:33.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:33 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-19T12:37:33.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:33 smithi046 ceph-mon[98509]: osd.3 [v2:172.21.15.46:6810/1964113352,v1:172.21.15.46:6811/1964113352] boot 2023-10-19T12:37:33.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:33 smithi046 ceph-mon[98509]: osdmap e25: 4 total, 4 up, 4 in 2023-10-19T12:37:33.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:33 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-19T12:37:33.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:33 smithi046 ceph-mon[98509]: pgmap v108: 1 pgs: 1 peering; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2023-10-19T12:37:33.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:33 smithi046 ceph-mon[98509]: osdmap e26: 4 total, 4 up, 4 in 2023-10-19T12:37:33.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:33 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:33.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:33 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:33.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:33 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:37:33.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:33 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:37:33.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:33 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:33.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:33 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:37:33.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:33 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:37:33.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:33 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:34.174 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:37:34.171+0000 7f9ee1893700 1 -- 172.21.15.157:0/2265327488 --> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f9edc02d020 con 0x7f9ec40a1500 2023-10-19T12:37:34.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:34 smithi046 ceph-mon[98509]: Detected new or changed devices on smithi046 2023-10-19T12:37:34.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:34 smithi046 ceph-mon[98509]: Adjusting osd_memory_target on smithi046 to 8638M 2023-10-19T12:37:34.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:34 smithi046 ceph-mon[98509]: osdmap e27: 4 total, 4 up, 4 in 2023-10-19T12:37:34.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:34 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-19T12:37:34.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:34 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-19T12:37:34.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:34 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:37:34.985 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:34 smithi157 ceph-mon[134109]: Detected new or changed devices on smithi046 2023-10-19T12:37:34.985 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:34 smithi157 ceph-mon[134109]: Adjusting osd_memory_target on smithi046 to 8638M 2023-10-19T12:37:34.985 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:34 smithi157 ceph-mon[134109]: osdmap e27: 4 total, 4 up, 4 in 2023-10-19T12:37:34.985 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:34 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-19T12:37:34.985 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:34 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-19T12:37:34.986 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:34 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:37:35.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:34 smithi195 ceph-mon[134493]: Detected new or changed devices on smithi046 2023-10-19T12:37:35.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:34 smithi195 ceph-mon[134493]: Adjusting osd_memory_target on smithi046 to 8638M 2023-10-19T12:37:35.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:34 smithi195 ceph-mon[134493]: osdmap e27: 4 total, 4 up, 4 in 2023-10-19T12:37:35.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:34 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-19T12:37:35.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:34 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-19T12:37:35.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:34 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:37:35.838 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:35 smithi157 ceph-mon[134109]: from='client.24347 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-19T12:37:35.838 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:35 smithi157 ceph-mon[134109]: pgmap v111: 1 pgs: 1 peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-19T12:37:35.838 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:35 smithi157 ceph-mon[134109]: osdmap e28: 4 total, 4 up, 4 in 2023-10-19T12:37:35.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:35 smithi046 ceph-mon[98509]: from='client.24347 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-19T12:37:35.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:35 smithi046 ceph-mon[98509]: pgmap v111: 1 pgs: 1 peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-19T12:37:35.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:35 smithi046 ceph-mon[98509]: osdmap e28: 4 total, 4 up, 4 in 2023-10-19T12:37:36.133 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:35 smithi195 ceph-mon[134493]: from='client.24347 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-19T12:37:36.134 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:35 smithi195 ceph-mon[134493]: pgmap v111: 1 pgs: 1 peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-19T12:37:36.134 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:35 smithi195 ceph-mon[134493]: osdmap e28: 4 total, 4 up, 4 in 2023-10-19T12:37:36.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:36 smithi046 ceph-mon[98509]: osdmap e29: 4 total, 4 up, 4 in 2023-10-19T12:37:36.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:36 smithi046 ceph-mon[98509]: from='client.? 172.21.15.157:0/3094184300' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e662886d-e989-4d02-8c1f-3c4671352b0b"}]: dispatch 2023-10-19T12:37:36.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:36 smithi046 ceph-mon[98509]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e662886d-e989-4d02-8c1f-3c4671352b0b"}]: dispatch 2023-10-19T12:37:36.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:36 smithi046 ceph-mon[98509]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e662886d-e989-4d02-8c1f-3c4671352b0b"}]': finished 2023-10-19T12:37:36.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:36 smithi046 ceph-mon[98509]: osdmap e30: 5 total, 4 up, 5 in 2023-10-19T12:37:36.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:36 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-19T12:37:37.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:36 smithi157 ceph-mon[134109]: osdmap e29: 4 total, 4 up, 4 in 2023-10-19T12:37:37.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:36 smithi157 ceph-mon[134109]: from='client.? 172.21.15.157:0/3094184300' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e662886d-e989-4d02-8c1f-3c4671352b0b"}]: dispatch 2023-10-19T12:37:37.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:36 smithi157 ceph-mon[134109]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e662886d-e989-4d02-8c1f-3c4671352b0b"}]: dispatch 2023-10-19T12:37:37.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:36 smithi157 ceph-mon[134109]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e662886d-e989-4d02-8c1f-3c4671352b0b"}]': finished 2023-10-19T12:37:37.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:36 smithi157 ceph-mon[134109]: osdmap e30: 5 total, 4 up, 5 in 2023-10-19T12:37:37.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:36 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-19T12:37:37.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:36 smithi195 ceph-mon[134493]: osdmap e29: 4 total, 4 up, 4 in 2023-10-19T12:37:37.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:36 smithi195 ceph-mon[134493]: from='client.? 172.21.15.157:0/3094184300' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e662886d-e989-4d02-8c1f-3c4671352b0b"}]: dispatch 2023-10-19T12:37:37.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:36 smithi195 ceph-mon[134493]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e662886d-e989-4d02-8c1f-3c4671352b0b"}]: dispatch 2023-10-19T12:37:37.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:36 smithi195 ceph-mon[134493]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e662886d-e989-4d02-8c1f-3c4671352b0b"}]': finished 2023-10-19T12:37:37.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:36 smithi195 ceph-mon[134493]: osdmap e30: 5 total, 4 up, 5 in 2023-10-19T12:37:37.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:36 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-19T12:37:37.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:37 smithi046 ceph-mon[98509]: pgmap v114: 1 pgs: 1 peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-19T12:37:37.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:37 smithi046 ceph-mon[98509]: from='client.? 172.21.15.157:0/3508883208' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-19T12:37:38.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:37 smithi157 ceph-mon[134109]: pgmap v114: 1 pgs: 1 peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-19T12:37:38.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:37 smithi157 ceph-mon[134109]: from='client.? 172.21.15.157:0/3508883208' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-19T12:37:38.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:37 smithi195 ceph-mon[134493]: pgmap v114: 1 pgs: 1 peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-19T12:37:38.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:37 smithi195 ceph-mon[134493]: from='client.? 172.21.15.157:0/3508883208' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-19T12:37:39.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:39 smithi046 ceph-mon[98509]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 109 MiB used, 358 GiB / 358 GiB avail; 116 KiB/s, 0 objects/s recovering 2023-10-19T12:37:40.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:39 smithi157 ceph-mon[134109]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 109 MiB used, 358 GiB / 358 GiB avail; 116 KiB/s, 0 objects/s recovering 2023-10-19T12:37:40.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:39 smithi195 ceph-mon[134493]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 109 MiB used, 358 GiB / 358 GiB avail; 116 KiB/s, 0 objects/s recovering 2023-10-19T12:37:41.837 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:41 smithi157 ceph-mon[134109]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-19T12:37:41.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:41 smithi046 ceph-mon[98509]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-19T12:37:42.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:41 smithi195 ceph-mon[134493]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-19T12:37:43.978 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:43 smithi157 ceph-mon[134109]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 73 KiB/s, 0 objects/s recovering 2023-10-19T12:37:43.979 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:43 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-10-19T12:37:43.979 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:43 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:37:43.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:43 smithi046 ceph-mon[98509]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 73 KiB/s, 0 objects/s recovering 2023-10-19T12:37:43.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:43 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-10-19T12:37:43.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:43 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:37:44.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:43 smithi195 ceph-mon[134493]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 73 KiB/s, 0 objects/s recovering 2023-10-19T12:37:44.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:43 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-10-19T12:37:44.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:43 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:37:44.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:44 smithi046 ceph-mon[98509]: Deploying daemon osd.4 on smithi157 2023-10-19T12:37:45.068 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:44 smithi157 ceph-mon[134109]: Deploying daemon osd.4 on smithi157 2023-10-19T12:37:45.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:44 smithi195 ceph-mon[134493]: Deploying daemon osd.4 on smithi157 2023-10-19T12:37:45.729 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:45 smithi157 ceph-mon[134109]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 64 KiB/s, 0 objects/s recovering 2023-10-19T12:37:45.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:45 smithi046 ceph-mon[98509]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 64 KiB/s, 0 objects/s recovering 2023-10-19T12:37:46.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:45 smithi195 ceph-mon[134493]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 64 KiB/s, 0 objects/s recovering 2023-10-19T12:37:47.685 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:47 smithi157 ceph-mon[134109]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-10-19T12:37:47.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:47 smithi046 ceph-mon[98509]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-10-19T12:37:48.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:47 smithi195 ceph-mon[134493]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-10-19T12:37:48.994 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:48 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:48.994 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:48 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:48.995 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:48 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:37:49.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:48 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:49.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:48 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:49.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:48 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:37:49.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:48 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:49.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:48 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:49.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:48 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:37:50.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:49 smithi157 ceph-mon[134109]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-10-19T12:37:50.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:49 smithi195 ceph-mon[134493]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-10-19T12:37:50.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:49 smithi046 ceph-mon[98509]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-10-19T12:37:50.693 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:37:50.691+0000 7f9ee0891700 1 -- 172.21.15.157:0/2265327488 <== mgr.14150 v2:172.21.15.46:6800/3168073651 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f9edc02d020 con 0x7f9ec40a1500 2023-10-19T12:37:50.694 INFO:teuthology.orchestra.run.smithi157.stdout:Created osd(s) 4 on host 'smithi157' 2023-10-19T12:37:50.696 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:37:50.693+0000 7f9ee1893700 1 -- 172.21.15.157:0/2265327488 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f9ec40a1500 msgr2=0x7f9ec40a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:37:50.696 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:37:50.693+0000 7f9ee1893700 1 --2- 172.21.15.157:0/2265327488 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f9ec40a1500 0x7f9ec40a39c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc0098e0 tx=0x7f9ecc005fb0 comp rx=0 tx=0).stop 2023-10-19T12:37:50.696 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:37:50.693+0000 7f9ee1893700 1 -- 172.21.15.157:0/2265327488 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9edc0ff9a0 msgr2=0x7f9edc0ff3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:37:50.696 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:37:50.693+0000 7f9ee1893700 1 --2- 172.21.15.157:0/2265327488 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9edc0ff9a0 0x7f9edc0ff3a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9ed000c8f0 tx=0x7f9ed000ccb0 comp rx=0 tx=0).stop 2023-10-19T12:37:50.696 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:37:50.693+0000 7f9ee1893700 1 -- 172.21.15.157:0/2265327488 shutdown_connections 2023-10-19T12:37:50.697 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:37:50.693+0000 7f9ee1893700 1 --2- 172.21.15.157:0/2265327488 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f9ec40a1500 0x7f9ec40a39c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:37:50.697 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:37:50.693+0000 7f9ee1893700 1 --2- 172.21.15.157:0/2265327488 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9edc100d40 0x7f9edc19d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:37:50.697 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:37:50.693+0000 7f9ee1893700 1 --2- 172.21.15.157:0/2265327488 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9edc0ff9a0 0x7f9edc0ff3a0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:37:50.697 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:37:50.693+0000 7f9ee1893700 1 --2- 172.21.15.157:0/2265327488 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9edc100360 0x7f9edc19b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:37:50.697 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:37:50.693+0000 7f9ee1893700 1 -- 172.21.15.157:0/2265327488 >> 172.21.15.157:0/2265327488 conn(0x7f9edc0fa450 msgr2=0x7f9edc103cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:37:50.698 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:37:50.693+0000 7f9ee1893700 1 -- 172.21.15.157:0/2265327488 shutdown_connections 2023-10-19T12:37:50.698 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:37:50.693+0000 7f9ee1893700 1 -- 172.21.15.157:0/2265327488 wait complete. 2023-10-19T12:37:51.186 DEBUG:teuthology.orchestra.run.smithi157:osd.4> sudo journalctl -f -n 0 -u ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@osd.4.service 2023-10-19T12:37:51.189 INFO:tasks.cephadm:Deploying osd.5 on smithi195 with /dev/vg_nvme/lv_3... 2023-10-19T12:37:51.189 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-10-19T12:37:51.232 INFO:journalctl@ceph.osd.4.smithi157.stdout:-- Logs begin at Thu 2023-10-19 12:11:40 UTC. -- 2023-10-19T12:37:51.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:51 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:51.653 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:51 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:51.654 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:51 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:37:51.654 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:51 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:37:51.654 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:51 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:51.654 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:51 smithi195 ceph-mon[134493]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-19T12:37:51.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:51 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:51.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:51 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:51.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:51 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:37:51.727 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:51 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:51.727 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:51 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:51.727 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:51 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:37:51.727 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:51 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:37:51.727 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:51 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:51.728 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:51 smithi157 ceph-mon[134109]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-19T12:37:51.728 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:51 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:51.728 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:51 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:51.728 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:51 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:37:51.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:51 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:51.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:51 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:51.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:51 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:37:51.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:51 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:37:51.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:51 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:51.730 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:51 smithi046 ceph-mon[98509]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-19T12:37:51.730 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:51 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:51.730 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:51 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:51.730 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:51 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:37:51.767 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.c/config 2023-10-19T12:37:52.043 INFO:journalctl@ceph.osd.4.smithi157.stdout:Oct 19 12:37:51 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-4[147065]: 2023-10-19T12:37:51.741+0000 7fd1c4186640 -1 osd.4 0 log_to_monitors true 2023-10-19T12:37:52.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:52 smithi195 ceph-mon[134493]: from='osd.4 [v2:172.21.15.157:6808/3636910144,v1:172.21.15.157:6809/3636910144]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-10-19T12:37:52.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:52 smithi195 ceph-mon[134493]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-10-19T12:37:52.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:52 smithi046 ceph-mon[98509]: from='osd.4 [v2:172.21.15.157:6808/3636910144,v1:172.21.15.157:6809/3636910144]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-10-19T12:37:52.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:52 smithi046 ceph-mon[98509]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-10-19T12:37:52.838 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:52 smithi157 ceph-mon[134109]: from='osd.4 [v2:172.21.15.157:6808/3636910144,v1:172.21.15.157:6809/3636910144]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-10-19T12:37:52.838 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:52 smithi157 ceph-mon[134109]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-10-19T12:37:53.218 INFO:teuthology.orchestra.run.smithi195.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-10-19T12:37:53.219 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-10-19T12:37:53.219 INFO:teuthology.orchestra.run.smithi195.stderr: stderr: 10+0 records in 2023-10-19T12:37:53.219 INFO:teuthology.orchestra.run.smithi195.stderr:10+0 records out 2023-10-19T12:37:53.219 INFO:teuthology.orchestra.run.smithi195.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0124957 s, 839 MB/s 2023-10-19T12:37:53.219 INFO:teuthology.orchestra.run.smithi195.stderr:--> Zapping successful for: 2023-10-19T12:37:53.607 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:53 smithi195 ceph-mon[134493]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-10-19T12:37:53.608 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:53 smithi195 ceph-mon[134493]: from='osd.4 [v2:172.21.15.157:6808/3636910144,v1:172.21.15.157:6809/3636910144]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2023-10-19T12:37:53.608 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:53 smithi195 ceph-mon[134493]: osdmap e31: 5 total, 4 up, 5 in 2023-10-19T12:37:53.608 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:53 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-19T12:37:53.608 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:53 smithi195 ceph-mon[134493]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2023-10-19T12:37:53.608 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:53 smithi195 ceph-mon[134493]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-19T12:37:53.609 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph orch daemon add osd smithi195:vg_nvme/lv_3 2023-10-19T12:37:53.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:53 smithi046 ceph-mon[98509]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-10-19T12:37:53.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:53 smithi046 ceph-mon[98509]: from='osd.4 [v2:172.21.15.157:6808/3636910144,v1:172.21.15.157:6809/3636910144]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2023-10-19T12:37:53.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:53 smithi046 ceph-mon[98509]: osdmap e31: 5 total, 4 up, 5 in 2023-10-19T12:37:53.730 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:53 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-19T12:37:53.730 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:53 smithi046 ceph-mon[98509]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2023-10-19T12:37:53.730 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:53 smithi046 ceph-mon[98509]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-19T12:37:53.837 INFO:journalctl@ceph.osd.4.smithi157.stdout:Oct 19 12:37:53 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-4[147065]: 2023-10-19T12:37:53.472+0000 7fd1b97fd700 -1 osd.4 0 waiting for initial osdmap 2023-10-19T12:37:53.838 INFO:journalctl@ceph.osd.4.smithi157.stdout:Oct 19 12:37:53 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-4[147065]: 2023-10-19T12:37:53.481+0000 7fd1b35ee700 -1 osd.4 32 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-19T12:37:53.838 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:53 smithi157 ceph-mon[134109]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-10-19T12:37:53.838 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:53 smithi157 ceph-mon[134109]: from='osd.4 [v2:172.21.15.157:6808/3636910144,v1:172.21.15.157:6809/3636910144]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2023-10-19T12:37:53.839 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:53 smithi157 ceph-mon[134109]: osdmap e31: 5 total, 4 up, 5 in 2023-10-19T12:37:53.839 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:53 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-19T12:37:53.839 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:53 smithi157 ceph-mon[134109]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2023-10-19T12:37:53.839 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:53 smithi157 ceph-mon[134109]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-19T12:37:54.166 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.c/config 2023-10-19T12:37:54.728 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:54 smithi195 ceph-mon[134493]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]': finished 2023-10-19T12:37:54.728 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:54 smithi195 ceph-mon[134493]: osdmap e32: 5 total, 4 up, 5 in 2023-10-19T12:37:54.729 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:54 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-19T12:37:54.729 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:54 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-19T12:37:54.729 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:54 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:54.729 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:54 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:54.730 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:54 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:37:54.730 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:54 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:37:54.730 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:54 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:54.730 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:54 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:37:54.730 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:54 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:37:54.731 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:54 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:54.837 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:54 smithi157 ceph-mon[134109]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]': finished 2023-10-19T12:37:54.838 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:54 smithi157 ceph-mon[134109]: osdmap e32: 5 total, 4 up, 5 in 2023-10-19T12:37:54.838 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:54 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-19T12:37:54.838 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:54 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-19T12:37:54.838 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:54 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:54.838 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:54 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:54.839 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:54 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:37:54.839 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:54 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:37:54.839 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:54 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:54.839 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:54 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:37:54.839 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:54 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:37:54.840 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:54 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:54.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:54 smithi046 ceph-mon[98509]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]': finished 2023-10-19T12:37:54.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:54 smithi046 ceph-mon[98509]: osdmap e32: 5 total, 4 up, 5 in 2023-10-19T12:37:54.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:54 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-19T12:37:54.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:54 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-19T12:37:54.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:54 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:54.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:54 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:54.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:54 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:37:54.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:54 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:37:54.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:54 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:54.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:54 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:37:54.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:54 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:37:54.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:54 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:37:55.380 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:37:55.376+0000 7fc5d94de700 1 -- 172.21.15.195:0/11317660 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc5d4100ef0 msgr2=0x7fc5d4101310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:37:55.380 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:37:55.376+0000 7fc5d94de700 1 --2- 172.21.15.195:0/11317660 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc5d4100ef0 0x7fc5d4101310 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc5c8009990 tx=0x7fc5c8009ca0 comp rx=0 tx=0).stop 2023-10-19T12:37:55.381 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:37:55.376+0000 7fc5d94de700 1 -- 172.21.15.195:0/11317660 shutdown_connections 2023-10-19T12:37:55.381 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:37:55.376+0000 7fc5d94de700 1 --2- 172.21.15.195:0/11317660 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc5d41003d0 0x7fc5d4107c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:37:55.381 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:37:55.376+0000 7fc5d94de700 1 --2- 172.21.15.195:0/11317660 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc5d4100ef0 0x7fc5d4101310 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:37:55.381 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:37:55.376+0000 7fc5d94de700 1 --2- 172.21.15.195:0/11317660 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc5d40ff9c0 0x7fc5d40ffe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:37:55.381 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:37:55.376+0000 7fc5d94de700 1 -- 172.21.15.195:0/11317660 >> 172.21.15.195:0/11317660 conn(0x7fc5d40fa490 msgr2=0x7fc5d40fc8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:37:55.382 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:37:55.376+0000 7fc5d94de700 1 -- 172.21.15.195:0/11317660 shutdown_connections 2023-10-19T12:37:55.382 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:37:55.376+0000 7fc5d94de700 1 -- 172.21.15.195:0/11317660 wait complete. 2023-10-19T12:37:55.382 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:37:55.376+0000 7fc5d94de700 1 Processor -- start 2023-10-19T12:37:55.382 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:37:55.376+0000 7fc5d94de700 1 -- start start 2023-10-19T12:37:55.382 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:37:55.377+0000 7fc5d94de700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc5d40ff9c0 0x7fc5d41946b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:37:55.383 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:37:55.377+0000 7fc5d94de700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc5d41003d0 0x7fc5d4194bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:37:55.383 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:37:55.377+0000 7fc5d94de700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc5d4100ef0 0x7fc5d419bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:37:55.383 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:37:55.377+0000 7fc5d94de700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d419c1f0 con 0x7fc5d40ff9c0 2023-10-19T12:37:55.383 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:37:55.377+0000 7fc5d94de700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d419c330 con 0x7fc5d41003d0 2023-10-19T12:37:55.383 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:37:55.377+0000 7fc5d94de700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d419c4c0 con 0x7fc5d4100ef0 2023-10-19T12:37:55.384 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:37:55.377+0000 7fc5d37fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc5d4100ef0 0x7fc5d419bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:37:55.384 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:37:55.377+0000 7fc5d37fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc5d4100ef0 0x7fc5d419bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:48650/0 (socket says 172.21.15.195:48650) 2023-10-19T12:37:55.384 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:37:55.377+0000 7fc5d37fe700 1 -- 172.21.15.195:0/2905045517 learned_addr learned my addr 172.21.15.195:0/2905045517 (peer_addr_for_me v2:172.21.15.195:0/0) 2023-10-19T12:37:55.384 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:37:55.377+0000 7fc5d27fc700 1 --2- 172.21.15.195:0/2905045517 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc5d41003d0 0x7fc5d4194bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:37:55.385 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:37:55.377+0000 7fc5d37fe700 1 -- 172.21.15.195:0/2905045517 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc5d41003d0 msgr2=0x7fc5d4194bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:37:55.385 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:37:55.377+0000 7fc5d37fe700 1 --2- 172.21.15.195:0/2905045517 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc5d41003d0 0x7fc5d4194bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:37:55.385 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:37:55.377+0000 7fc5d37fe700 1 -- 172.21.15.195:0/2905045517 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc5d40ff9c0 msgr2=0x7fc5d41946b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:37:55.385 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:37:55.377+0000 7fc5d37fe700 1 --2- 172.21.15.195:0/2905045517 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc5d40ff9c0 0x7fc5d41946b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:37:55.385 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:37:55.377+0000 7fc5d37fe700 1 -- 172.21.15.195:0/2905045517 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5c80095f0 con 0x7fc5d4100ef0 2023-10-19T12:37:55.386 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:37:55.377+0000 7fc5d37fe700 1 --2- 172.21.15.195:0/2905045517 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc5d4100ef0 0x7fc5d419bc20 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc00add0 tx=0x7fc5cc00c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:37:55.386 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:37:55.377+0000 7fc5bbfff700 1 -- 172.21.15.195:0/2905045517 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5cc00f070 con 0x7fc5d4100ef0 2023-10-19T12:37:55.386 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:37:55.377+0000 7fc5d94de700 1 -- 172.21.15.195:0/2905045517 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5d419c7a0 con 0x7fc5d4100ef0 2023-10-19T12:37:55.386 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:37:55.377+0000 7fc5bbfff700 1 -- 172.21.15.195:0/2905045517 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc5cc007b30 con 0x7fc5d4100ef0 2023-10-19T12:37:55.386 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:37:55.377+0000 7fc5bbfff700 1 -- 172.21.15.195:0/2905045517 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5cc005310 con 0x7fc5d4100ef0 2023-10-19T12:37:55.387 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:37:55.377+0000 7fc5d94de700 1 -- 172.21.15.195:0/2905045517 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5d419cca0 con 0x7fc5d4100ef0 2023-10-19T12:37:55.388 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:37:55.378+0000 7fc5d94de700 1 -- 172.21.15.195:0/2905045517 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5d4106c50 con 0x7fc5d4100ef0 2023-10-19T12:37:55.388 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:37:55.379+0000 7fc5bbfff700 1 -- 172.21.15.195:0/2905045517 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fc5cc00c940 con 0x7fc5d4100ef0 2023-10-19T12:37:55.388 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:37:55.380+0000 7fc5bbfff700 1 --2- 172.21.15.195:0/2905045517 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fc5bc0a3690 0x7fc5bc0a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:37:55.388 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:37:55.380+0000 7fc5bbfff700 1 -- 172.21.15.195:0/2905045517 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 4101+0+0 (secure 0 0 0) 0x7fc5cc0cb830 con 0x7fc5d4100ef0 2023-10-19T12:37:55.389 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:37:55.380+0000 7fc5d2ffd700 1 --2- 172.21.15.195:0/2905045517 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fc5bc0a3690 0x7fc5bc0a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:37:55.389 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:37:55.381+0000 7fc5d2ffd700 1 --2- 172.21.15.195:0/2905045517 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fc5bc0a3690 0x7fc5bc0a5b50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc5c80098e0 tx=0x7fc5c8005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:37:55.389 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:37:55.383+0000 7fc5bbfff700 1 -- 172.21.15.195:0/2905045517 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc5cc095f90 con 0x7fc5d4100ef0 2023-10-19T12:37:55.583 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:37:55.580+0000 7fc5d94de700 1 -- 172.21.15.195:0/2905045517 --> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fc5d4060c30 con 0x7fc5bc0a3690 2023-10-19T12:37:55.838 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:55 smithi157 ceph-mon[134109]: purged_snaps scrub starts 2023-10-19T12:37:55.838 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:55 smithi157 ceph-mon[134109]: purged_snaps scrub ok 2023-10-19T12:37:55.838 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:55 smithi157 ceph-mon[134109]: Detected new or changed devices on smithi157 2023-10-19T12:37:55.838 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:55 smithi157 ceph-mon[134109]: Adjusting osd_memory_target on smithi157 to 8584M 2023-10-19T12:37:55.839 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:55 smithi157 ceph-mon[134109]: osd.4 [v2:172.21.15.157:6808/3636910144,v1:172.21.15.157:6809/3636910144] boot 2023-10-19T12:37:55.839 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:55 smithi157 ceph-mon[134109]: osdmap e33: 5 total, 5 up, 5 in 2023-10-19T12:37:55.839 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:55 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-19T12:37:55.839 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:55 smithi157 ceph-mon[134109]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-19T12:37:55.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:55 smithi195 ceph-mon[134493]: purged_snaps scrub starts 2023-10-19T12:37:55.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:55 smithi195 ceph-mon[134493]: purged_snaps scrub ok 2023-10-19T12:37:55.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:55 smithi195 ceph-mon[134493]: Detected new or changed devices on smithi157 2023-10-19T12:37:55.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:55 smithi195 ceph-mon[134493]: Adjusting osd_memory_target on smithi157 to 8584M 2023-10-19T12:37:55.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:55 smithi195 ceph-mon[134493]: osd.4 [v2:172.21.15.157:6808/3636910144,v1:172.21.15.157:6809/3636910144] boot 2023-10-19T12:37:55.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:55 smithi195 ceph-mon[134493]: osdmap e33: 5 total, 5 up, 5 in 2023-10-19T12:37:55.882 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:55 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-19T12:37:55.882 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:55 smithi195 ceph-mon[134493]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-19T12:37:55.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:55 smithi046 ceph-mon[98509]: purged_snaps scrub starts 2023-10-19T12:37:55.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:55 smithi046 ceph-mon[98509]: purged_snaps scrub ok 2023-10-19T12:37:55.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:55 smithi046 ceph-mon[98509]: Detected new or changed devices on smithi157 2023-10-19T12:37:55.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:55 smithi046 ceph-mon[98509]: Adjusting osd_memory_target on smithi157 to 8584M 2023-10-19T12:37:55.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:55 smithi046 ceph-mon[98509]: osd.4 [v2:172.21.15.157:6808/3636910144,v1:172.21.15.157:6809/3636910144] boot 2023-10-19T12:37:55.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:55 smithi046 ceph-mon[98509]: osdmap e33: 5 total, 5 up, 5 in 2023-10-19T12:37:55.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:55 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-19T12:37:55.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:55 smithi046 ceph-mon[98509]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-19T12:37:56.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:56 smithi195 ceph-mon[134493]: osdmap e34: 5 total, 5 up, 5 in 2023-10-19T12:37:56.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:56 smithi195 ceph-mon[134493]: from='client.24364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-19T12:37:56.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:56 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-19T12:37:56.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:56 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-19T12:37:56.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:56 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:37:56.837 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:56 smithi157 ceph-mon[134109]: osdmap e34: 5 total, 5 up, 5 in 2023-10-19T12:37:56.838 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:56 smithi157 ceph-mon[134109]: from='client.24364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-19T12:37:56.838 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:56 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-19T12:37:56.838 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:56 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-19T12:37:56.838 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:56 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:37:56.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:56 smithi046 ceph-mon[98509]: osdmap e34: 5 total, 5 up, 5 in 2023-10-19T12:37:56.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:56 smithi046 ceph-mon[98509]: from='client.24364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-19T12:37:56.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:56 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-19T12:37:56.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:56 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-19T12:37:56.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:56 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:37:57.837 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:57 smithi157 ceph-mon[134109]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-19T12:37:57.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:57 smithi195 ceph-mon[134493]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-19T12:37:57.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:57 smithi046 ceph-mon[98509]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-19T12:37:58.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:58 smithi046 ceph-mon[98509]: from='client.? 172.21.15.195:0/297852666' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9597e0ce-14ea-407d-90fe-f74bccee38b2"}]: dispatch 2023-10-19T12:37:58.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:58 smithi046 ceph-mon[98509]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9597e0ce-14ea-407d-90fe-f74bccee38b2"}]: dispatch 2023-10-19T12:37:58.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:58 smithi046 ceph-mon[98509]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9597e0ce-14ea-407d-90fe-f74bccee38b2"}]': finished 2023-10-19T12:37:58.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:58 smithi046 ceph-mon[98509]: osdmap e35: 6 total, 5 up, 6 in 2023-10-19T12:37:58.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:58 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-19T12:37:58.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:58 smithi046 ceph-mon[98509]: from='client.? 172.21.15.195:0/242874242' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-19T12:37:59.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:58 smithi157 ceph-mon[134109]: from='client.? 172.21.15.195:0/297852666' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9597e0ce-14ea-407d-90fe-f74bccee38b2"}]: dispatch 2023-10-19T12:37:59.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:58 smithi157 ceph-mon[134109]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9597e0ce-14ea-407d-90fe-f74bccee38b2"}]: dispatch 2023-10-19T12:37:59.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:58 smithi157 ceph-mon[134109]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9597e0ce-14ea-407d-90fe-f74bccee38b2"}]': finished 2023-10-19T12:37:59.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:58 smithi157 ceph-mon[134109]: osdmap e35: 6 total, 5 up, 6 in 2023-10-19T12:37:59.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:58 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-19T12:37:59.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:58 smithi157 ceph-mon[134109]: from='client.? 172.21.15.195:0/242874242' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-19T12:37:59.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:58 smithi195 ceph-mon[134493]: from='client.? 172.21.15.195:0/297852666' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9597e0ce-14ea-407d-90fe-f74bccee38b2"}]: dispatch 2023-10-19T12:37:59.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:58 smithi195 ceph-mon[134493]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9597e0ce-14ea-407d-90fe-f74bccee38b2"}]: dispatch 2023-10-19T12:37:59.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:58 smithi195 ceph-mon[134493]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9597e0ce-14ea-407d-90fe-f74bccee38b2"}]': finished 2023-10-19T12:37:59.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:58 smithi195 ceph-mon[134493]: osdmap e35: 6 total, 5 up, 6 in 2023-10-19T12:37:59.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:58 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-19T12:37:59.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:58 smithi195 ceph-mon[134493]: from='client.? 172.21.15.195:0/242874242' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-19T12:37:59.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:37:59 smithi046 ceph-mon[98509]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-19T12:38:00.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:37:59 smithi157 ceph-mon[134109]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-19T12:38:00.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:37:59 smithi195 ceph-mon[134493]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-19T12:38:01.968 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:01 smithi195 ceph-mon[134493]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-19T12:38:01.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:01 smithi046 ceph-mon[98509]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-19T12:38:02.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:01 smithi157 ceph-mon[134109]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-19T12:38:03.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:03 smithi046 ceph-mon[98509]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-19T12:38:04.043 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:03 smithi195 ceph-mon[134493]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-19T12:38:04.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:03 smithi157 ceph-mon[134109]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-19T12:38:04.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:04 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-10-19T12:38:04.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:04 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:38:04.990 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:04 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-10-19T12:38:04.991 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:04 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:38:05.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:04 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-10-19T12:38:05.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:04 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:38:05.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:05 smithi046 ceph-mon[98509]: Deploying daemon osd.5 on smithi195 2023-10-19T12:38:05.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:05 smithi046 ceph-mon[98509]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-19T12:38:06.067 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:05 smithi195 ceph-mon[134493]: Deploying daemon osd.5 on smithi195 2023-10-19T12:38:06.068 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:05 smithi195 ceph-mon[134493]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-19T12:38:06.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:05 smithi157 ceph-mon[134109]: Deploying daemon osd.5 on smithi195 2023-10-19T12:38:06.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:05 smithi157 ceph-mon[134109]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-19T12:38:07.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:07 smithi195 ceph-mon[134493]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-19T12:38:07.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:07 smithi046 ceph-mon[98509]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-19T12:38:08.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:07 smithi157 ceph-mon[134109]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-19T12:38:09.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:09 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:38:09.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:09 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:38:09.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:09 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:38:09.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:09 smithi195 ceph-mon[134493]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-19T12:38:09.837 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:09 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:38:09.838 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:09 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:38:09.838 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:09 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:38:09.838 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:09 smithi157 ceph-mon[134109]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-19T12:38:09.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:09 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:38:09.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:09 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:38:09.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:09 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:38:09.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:09 smithi046 ceph-mon[98509]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-19T12:38:11.298 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:38:11.294+0000 7fc5bbfff700 1 -- 172.21.15.195:0/2905045517 <== mgr.14150 v2:172.21.15.46:6800/3168073651 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fc5d4060c30 con 0x7fc5bc0a3690 2023-10-19T12:38:11.298 INFO:teuthology.orchestra.run.smithi195.stdout:Created osd(s) 5 on host 'smithi195' 2023-10-19T12:38:11.300 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:38:11.296+0000 7fc5d94de700 1 -- 172.21.15.195:0/2905045517 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fc5bc0a3690 msgr2=0x7fc5bc0a5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:38:11.300 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:38:11.296+0000 7fc5d94de700 1 --2- 172.21.15.195:0/2905045517 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fc5bc0a3690 0x7fc5bc0a5b50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc5c80098e0 tx=0x7fc5c8005fb0 comp rx=0 tx=0).stop 2023-10-19T12:38:11.300 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:38:11.296+0000 7fc5d94de700 1 -- 172.21.15.195:0/2905045517 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc5d4100ef0 msgr2=0x7fc5d419bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:38:11.300 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:38:11.296+0000 7fc5d94de700 1 --2- 172.21.15.195:0/2905045517 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc5d4100ef0 0x7fc5d419bc20 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc00add0 tx=0x7fc5cc00c330 comp rx=0 tx=0).stop 2023-10-19T12:38:11.300 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:38:11.296+0000 7fc5d94de700 1 -- 172.21.15.195:0/2905045517 shutdown_connections 2023-10-19T12:38:11.301 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:38:11.296+0000 7fc5d94de700 1 --2- 172.21.15.195:0/2905045517 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fc5bc0a3690 0x7fc5bc0a5b50 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:38:11.301 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:38:11.296+0000 7fc5d94de700 1 --2- 172.21.15.195:0/2905045517 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc5d4100ef0 0x7fc5d419bc20 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:38:11.301 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:38:11.296+0000 7fc5d94de700 1 --2- 172.21.15.195:0/2905045517 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc5d40ff9c0 0x7fc5d41946b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:38:11.301 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:38:11.296+0000 7fc5d94de700 1 --2- 172.21.15.195:0/2905045517 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc5d41003d0 0x7fc5d4194bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:38:11.301 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:38:11.296+0000 7fc5d94de700 1 -- 172.21.15.195:0/2905045517 >> 172.21.15.195:0/2905045517 conn(0x7fc5d40fa490 msgr2=0x7fc5d4103d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:38:11.302 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:38:11.296+0000 7fc5d94de700 1 -- 172.21.15.195:0/2905045517 shutdown_connections 2023-10-19T12:38:11.302 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:38:11.296+0000 7fc5d94de700 1 -- 172.21.15.195:0/2905045517 wait complete. 2023-10-19T12:38:11.763 DEBUG:teuthology.orchestra.run.smithi195:osd.5> sudo journalctl -f -n 0 -u ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@osd.5.service 2023-10-19T12:38:11.766 INFO:tasks.cephadm:Deploying osd.6 on smithi046 with /dev/vg_nvme/lv_2... 2023-10-19T12:38:11.766 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-10-19T12:38:11.794 INFO:journalctl@ceph.osd.5.smithi195.stdout:-- Logs begin at Thu 2023-10-19 12:10:53 UTC. -- 2023-10-19T12:38:11.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:11 smithi046 ceph-mon[98509]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-19T12:38:11.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:11 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:38:11.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:11 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:38:11.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:11 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:38:11.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:11 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:38:11.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:11 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:38:11.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:11 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:38:11.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:11 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:38:11.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:11 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:38:12.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:11 smithi157 ceph-mon[134109]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-19T12:38:12.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:11 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:38:12.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:11 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:38:12.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:11 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:38:12.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:11 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:38:12.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:11 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:38:12.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:11 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:38:12.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:11 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:38:12.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:11 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:38:12.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:11 smithi195 ceph-mon[134493]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-19T12:38:12.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:11 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:38:12.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:11 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:38:12.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:11 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:38:12.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:11 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:38:12.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:11 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:38:12.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:11 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:38:12.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:11 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:38:12.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:11 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:38:12.492 INFO:journalctl@ceph.osd.5.smithi195.stdout:Oct 19 12:38:12 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-5[148917]: 2023-10-19T12:38:12.441+0000 7fa35bb9d640 -1 osd.5 0 log_to_monitors true 2023-10-19T12:38:12.540 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-19T12:38:12.765 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:12 smithi195 ceph-mon[134493]: from='osd.5 [v2:172.21.15.195:6808/4071287969,v1:172.21.15.195:6809/4071287969]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-10-19T12:38:12.765 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:12 smithi195 ceph-mon[134493]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-10-19T12:38:12.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:12 smithi046 ceph-mon[98509]: from='osd.5 [v2:172.21.15.195:6808/4071287969,v1:172.21.15.195:6809/4071287969]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-10-19T12:38:12.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:12 smithi046 ceph-mon[98509]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-10-19T12:38:13.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:12 smithi157 ceph-mon[134109]: from='osd.5 [v2:172.21.15.195:6808/4071287969,v1:172.21.15.195:6809/4071287969]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-10-19T12:38:13.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:12 smithi157 ceph-mon[134109]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-10-19T12:38:13.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:13 smithi046 ceph-mon[98509]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-19T12:38:13.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:13 smithi046 ceph-mon[98509]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-10-19T12:38:13.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:13 smithi046 ceph-mon[98509]: osdmap e36: 6 total, 5 up, 6 in 2023-10-19T12:38:13.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:13 smithi046 ceph-mon[98509]: from='osd.5 [v2:172.21.15.195:6808/4071287969,v1:172.21.15.195:6809/4071287969]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2023-10-19T12:38:13.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:13 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-19T12:38:13.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:13 smithi046 ceph-mon[98509]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2023-10-19T12:38:14.009 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:13 smithi195 ceph-mon[134493]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-19T12:38:14.009 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:13 smithi195 ceph-mon[134493]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-10-19T12:38:14.009 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:13 smithi195 ceph-mon[134493]: osdmap e36: 6 total, 5 up, 6 in 2023-10-19T12:38:14.010 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:13 smithi195 ceph-mon[134493]: from='osd.5 [v2:172.21.15.195:6808/4071287969,v1:172.21.15.195:6809/4071287969]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2023-10-19T12:38:14.010 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:13 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-19T12:38:14.010 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:13 smithi195 ceph-mon[134493]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2023-10-19T12:38:14.010 INFO:journalctl@ceph.osd.5.smithi195.stdout:Oct 19 12:38:13 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-5[148917]: 2023-10-19T12:38:13.710+0000 7fa351214700 -1 osd.5 0 waiting for initial osdmap 2023-10-19T12:38:14.011 INFO:journalctl@ceph.osd.5.smithi195.stdout:Oct 19 12:38:13 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-5[148917]: 2023-10-19T12:38:13.717+0000 7fa34c007700 -1 osd.5 37 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-19T12:38:14.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:13 smithi157 ceph-mon[134109]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-19T12:38:14.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:13 smithi157 ceph-mon[134109]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-10-19T12:38:14.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:13 smithi157 ceph-mon[134109]: osdmap e36: 6 total, 5 up, 6 in 2023-10-19T12:38:14.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:13 smithi157 ceph-mon[134109]: from='osd.5 [v2:172.21.15.195:6808/4071287969,v1:172.21.15.195:6809/4071287969]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2023-10-19T12:38:14.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:13 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-19T12:38:14.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:13 smithi157 ceph-mon[134109]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2023-10-19T12:38:14.574 INFO:teuthology.orchestra.run.smithi046.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-10-19T12:38:14.575 INFO:teuthology.orchestra.run.smithi046.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-10-19T12:38:14.575 INFO:teuthology.orchestra.run.smithi046.stderr: stderr: 10+0 records in 2023-10-19T12:38:14.575 INFO:teuthology.orchestra.run.smithi046.stderr:10+0 records out 2023-10-19T12:38:14.576 INFO:teuthology.orchestra.run.smithi046.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0495023 s, 212 MB/s 2023-10-19T12:38:14.576 INFO:teuthology.orchestra.run.smithi046.stderr: stderr: 2023-10-19T12:38:14.576 INFO:teuthology.orchestra.run.smithi046.stderr:--> Zapping successful for: 2023-10-19T12:38:14.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:14 smithi046 ceph-mon[98509]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2023-10-19T12:38:14.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:14 smithi046 ceph-mon[98509]: osdmap e37: 6 total, 5 up, 6 in 2023-10-19T12:38:14.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:14 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-19T12:38:14.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:14 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-19T12:38:14.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:14 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:38:14.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:14 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:38:14.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:14 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:38:14.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:14 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:38:14.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:14 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:38:14.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:14 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:38:14.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:14 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:38:14.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:14 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:38:15.026 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph orch daemon add osd smithi046:vg_nvme/lv_2 2023-10-19T12:38:15.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:14 smithi157 ceph-mon[134109]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2023-10-19T12:38:15.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:14 smithi157 ceph-mon[134109]: osdmap e37: 6 total, 5 up, 6 in 2023-10-19T12:38:15.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:14 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-19T12:38:15.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:14 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-19T12:38:15.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:14 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:38:15.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:14 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:38:15.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:14 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:38:15.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:14 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:38:15.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:14 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:38:15.090 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:14 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:38:15.090 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:14 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:38:15.090 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:14 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:38:15.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:14 smithi195 ceph-mon[134493]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2023-10-19T12:38:15.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:14 smithi195 ceph-mon[134493]: osdmap e37: 6 total, 5 up, 6 in 2023-10-19T12:38:15.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:14 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-19T12:38:15.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:14 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-19T12:38:15.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:14 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:38:15.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:14 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:38:15.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:14 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:38:15.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:14 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:38:15.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:14 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:38:15.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:14 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:38:15.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:14 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:38:15.133 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:14 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:38:15.769 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-19T12:38:15.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:15 smithi046 ceph-mon[98509]: purged_snaps scrub starts 2023-10-19T12:38:15.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:15 smithi046 ceph-mon[98509]: purged_snaps scrub ok 2023-10-19T12:38:15.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:15 smithi046 ceph-mon[98509]: Detected new or changed devices on smithi195 2023-10-19T12:38:15.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:15 smithi046 ceph-mon[98509]: Adjusting osd_memory_target on smithi195 to 8584M 2023-10-19T12:38:15.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:15 smithi046 ceph-mon[98509]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-19T12:38:15.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:15 smithi046 ceph-mon[98509]: osd.5 [v2:172.21.15.195:6808/4071287969,v1:172.21.15.195:6809/4071287969] boot 2023-10-19T12:38:15.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:15 smithi046 ceph-mon[98509]: osdmap e38: 6 total, 6 up, 6 in 2023-10-19T12:38:15.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:15 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-19T12:38:16.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:15 smithi157 ceph-mon[134109]: purged_snaps scrub starts 2023-10-19T12:38:16.090 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:15 smithi157 ceph-mon[134109]: purged_snaps scrub ok 2023-10-19T12:38:16.090 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:15 smithi157 ceph-mon[134109]: Detected new or changed devices on smithi195 2023-10-19T12:38:16.090 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:15 smithi157 ceph-mon[134109]: Adjusting osd_memory_target on smithi195 to 8584M 2023-10-19T12:38:16.090 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:15 smithi157 ceph-mon[134109]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-19T12:38:16.091 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:15 smithi157 ceph-mon[134109]: osd.5 [v2:172.21.15.195:6808/4071287969,v1:172.21.15.195:6809/4071287969] boot 2023-10-19T12:38:16.091 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:15 smithi157 ceph-mon[134109]: osdmap e38: 6 total, 6 up, 6 in 2023-10-19T12:38:16.091 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:15 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-19T12:38:16.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:15 smithi195 ceph-mon[134493]: purged_snaps scrub starts 2023-10-19T12:38:16.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:15 smithi195 ceph-mon[134493]: purged_snaps scrub ok 2023-10-19T12:38:16.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:15 smithi195 ceph-mon[134493]: Detected new or changed devices on smithi195 2023-10-19T12:38:16.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:15 smithi195 ceph-mon[134493]: Adjusting osd_memory_target on smithi195 to 8584M 2023-10-19T12:38:16.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:15 smithi195 ceph-mon[134493]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-19T12:38:16.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:15 smithi195 ceph-mon[134493]: osd.5 [v2:172.21.15.195:6808/4071287969,v1:172.21.15.195:6809/4071287969] boot 2023-10-19T12:38:16.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:15 smithi195 ceph-mon[134493]: osdmap e38: 6 total, 6 up, 6 in 2023-10-19T12:38:16.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:15 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-19T12:38:16.926 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:16 smithi046 ceph-mon[98509]: osdmap e39: 6 total, 6 up, 6 in 2023-10-19T12:38:17.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:16 smithi157 ceph-mon[134109]: osdmap e39: 6 total, 6 up, 6 in 2023-10-19T12:38:17.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:16 smithi195 ceph-mon[134493]: osdmap e39: 6 total, 6 up, 6 in 2023-10-19T12:38:17.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:38:17.186+0000 7f97b47f6700 1 -- 172.21.15.46:0/139630725 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97ac1023e0 msgr2=0x7f97ac108c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:38:17.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:38:17.186+0000 7f97b47f6700 1 --2- 172.21.15.46:0/139630725 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97ac1023e0 0x7f97ac108c90 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f97a4009fc0 tx=0x7f97a400b330 comp rx=0 tx=0).stop 2023-10-19T12:38:17.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:38:17.186+0000 7f97b47f6700 1 -- 172.21.15.46:0/139630725 shutdown_connections 2023-10-19T12:38:17.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:38:17.186+0000 7f97b47f6700 1 --2- 172.21.15.46:0/139630725 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97ac1023e0 0x7f97ac108c90 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:38:17.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:38:17.186+0000 7f97b47f6700 1 --2- 172.21.15.46:0/139630725 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f97ac100840 0x7f97ac100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:38:17.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:38:17.186+0000 7f97b47f6700 1 --2- 172.21.15.46:0/139630725 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f97ac101a40 0x7f97ac101ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:38:17.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:38:17.186+0000 7f97b47f6700 1 -- 172.21.15.46:0/139630725 >> 172.21.15.46:0/139630725 conn(0x7f97ac0fbe00 msgr2=0x7f97ac0fe220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:38:17.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:38:17.186+0000 7f97b47f6700 1 -- 172.21.15.46:0/139630725 shutdown_connections 2023-10-19T12:38:17.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:38:17.186+0000 7f97b47f6700 1 -- 172.21.15.46:0/139630725 wait complete. 2023-10-19T12:38:17.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:38:17.187+0000 7f97b47f6700 1 Processor -- start 2023-10-19T12:38:17.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:38:17.188+0000 7f97b47f6700 1 -- start start 2023-10-19T12:38:17.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:38:17.188+0000 7f97b47f6700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f97ac100840 0x7f97ac198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:38:17.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:38:17.188+0000 7f97b47f6700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97ac101a40 0x7f97ac199000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:38:17.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:38:17.188+0000 7f97b47f6700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f97ac1023e0 0x7f97ac1a0030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:38:17.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:38:17.188+0000 7f97b47f6700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97ac1a0600 con 0x7f97ac101a40 2023-10-19T12:38:17.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:38:17.188+0000 7f97b47f6700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97ac1a0740 con 0x7f97ac1023e0 2023-10-19T12:38:17.195 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:38:17.188+0000 7f97b47f6700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97ac1a08d0 con 0x7f97ac100840 2023-10-19T12:38:17.195 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:38:17.188+0000 7f97b1d91700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97ac101a40 0x7f97ac199000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:38:17.195 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:38:17.188+0000 7f97b2592700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f97ac100840 0x7f97ac198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:38:17.195 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:38:17.188+0000 7f97b1d91700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97ac101a40 0x7f97ac199000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36716/0 (socket says 172.21.15.46:36716) 2023-10-19T12:38:17.195 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:38:17.188+0000 7f97b1d91700 1 -- 172.21.15.46:0/1182348325 learned_addr learned my addr 172.21.15.46:0/1182348325 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:38:17.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:38:17.189+0000 7f97b2d93700 1 --2- 172.21.15.46:0/1182348325 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f97ac1023e0 0x7f97ac1a0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:38:17.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:38:17.189+0000 7f97b1d91700 1 -- 172.21.15.46:0/1182348325 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f97ac100840 msgr2=0x7f97ac198ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:38:17.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:38:17.189+0000 7f97b1d91700 1 --2- 172.21.15.46:0/1182348325 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f97ac100840 0x7f97ac198ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:38:17.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:38:17.189+0000 7f97b1d91700 1 -- 172.21.15.46:0/1182348325 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f97ac1023e0 msgr2=0x7f97ac1a0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:38:17.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:38:17.189+0000 7f97b1d91700 1 --2- 172.21.15.46:0/1182348325 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f97ac1023e0 0x7f97ac1a0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:38:17.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:38:17.189+0000 7f97b1d91700 1 -- 172.21.15.46:0/1182348325 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f979c0095f0 con 0x7f97ac101a40 2023-10-19T12:38:17.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:38:17.189+0000 7f97b1d91700 1 --2- 172.21.15.46:0/1182348325 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97ac101a40 0x7f97ac199000 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f979c00ec40 tx=0x7f979c00ef50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:38:17.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:38:17.189+0000 7f97a37fe700 1 -- 172.21.15.46:0/1182348325 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f979c009a10 con 0x7f97ac101a40 2023-10-19T12:38:17.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:38:17.189+0000 7f97b47f6700 1 -- 172.21.15.46:0/1182348325 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97a4009c40 con 0x7f97ac101a40 2023-10-19T12:38:17.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:38:17.189+0000 7f97a37fe700 1 -- 172.21.15.46:0/1182348325 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f979c0044e0 con 0x7f97ac101a40 2023-10-19T12:38:17.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:38:17.189+0000 7f97a37fe700 1 -- 172.21.15.46:0/1182348325 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f979c010430 con 0x7f97ac101a40 2023-10-19T12:38:17.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:38:17.189+0000 7f97b47f6700 1 -- 172.21.15.46:0/1182348325 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97ac1a0f70 con 0x7f97ac101a40 2023-10-19T12:38:17.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:38:17.190+0000 7f97b47f6700 1 -- 172.21.15.46:0/1182348325 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97ac04e4c0 con 0x7f97ac101a40 2023-10-19T12:38:17.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:38:17.194+0000 7f97a37fe700 1 -- 172.21.15.46:0/1182348325 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f979c004000 con 0x7f97ac101a40 2023-10-19T12:38:17.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:38:17.195+0000 7f97a37fe700 1 --2- 172.21.15.46:0/1182348325 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f97980a1500 0x7f97980a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:38:17.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:38:17.196+0000 7f97a37fe700 1 -- 172.21.15.46:0/1182348325 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4562+0+0 (secure 0 0 0) 0x7f979c014070 con 0x7f97ac101a40 2023-10-19T12:38:17.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:38:17.196+0000 7f97b2592700 1 --2- 172.21.15.46:0/1182348325 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f97980a1500 0x7f97980a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:38:17.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:38:17.196+0000 7f97b2592700 1 --2- 172.21.15.46:0/1182348325 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f97980a1500 0x7f97980a39c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f97ac1018a0 tx=0x7f97a8009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:38:17.201 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:38:17.199+0000 7f97a37fe700 1 -- 172.21.15.46:0/1182348325 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f979c096a90 con 0x7f97ac101a40 2023-10-19T12:38:17.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:38:17.417+0000 7f97b47f6700 1 -- 172.21.15.46:0/1182348325 --> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f97ac074140 con 0x7f97980a1500 2023-10-19T12:38:18.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:17 smithi157 ceph-mon[134109]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-19T12:38:18.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:17 smithi157 ceph-mon[134109]: osdmap e40: 6 total, 6 up, 6 in 2023-10-19T12:38:18.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:17 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-19T12:38:18.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:17 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-19T12:38:18.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:17 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:38:18.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:17 smithi157 ceph-mon[134109]: osdmap e41: 6 total, 6 up, 6 in 2023-10-19T12:38:18.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:17 smithi195 ceph-mon[134493]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-19T12:38:18.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:17 smithi195 ceph-mon[134493]: osdmap e40: 6 total, 6 up, 6 in 2023-10-19T12:38:18.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:17 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-19T12:38:18.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:17 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-19T12:38:18.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:17 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:38:18.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:17 smithi195 ceph-mon[134493]: osdmap e41: 6 total, 6 up, 6 in 2023-10-19T12:38:18.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:17 smithi046 ceph-mon[98509]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-19T12:38:18.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:17 smithi046 ceph-mon[98509]: osdmap e40: 6 total, 6 up, 6 in 2023-10-19T12:38:18.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:17 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-19T12:38:18.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:17 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-19T12:38:18.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:17 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:38:18.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:17 smithi046 ceph-mon[98509]: osdmap e41: 6 total, 6 up, 6 in 2023-10-19T12:38:18.812 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:18 smithi046 ceph-mon[98509]: from='client.14442 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-19T12:38:18.813 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:18 smithi046 ceph-mon[98509]: osdmap e42: 6 total, 6 up, 6 in 2023-10-19T12:38:19.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:18 smithi157 ceph-mon[134109]: from='client.14442 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-19T12:38:19.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:18 smithi157 ceph-mon[134109]: osdmap e42: 6 total, 6 up, 6 in 2023-10-19T12:38:19.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:18 smithi195 ceph-mon[134493]: from='client.14442 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-19T12:38:19.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:18 smithi195 ceph-mon[134493]: osdmap e42: 6 total, 6 up, 6 in 2023-10-19T12:38:19.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:19 smithi046 ceph-mon[98509]: pgmap v147: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2/6 objects degraded (33.333%) 2023-10-19T12:38:19.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:19 smithi046 ceph-mon[98509]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2023-10-19T12:38:20.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:19 smithi157 ceph-mon[134109]: pgmap v147: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2/6 objects degraded (33.333%) 2023-10-19T12:38:20.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:19 smithi157 ceph-mon[134109]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2023-10-19T12:38:20.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:19 smithi195 ceph-mon[134493]: pgmap v147: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2/6 objects degraded (33.333%) 2023-10-19T12:38:20.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:19 smithi195 ceph-mon[134493]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2023-10-19T12:38:21.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:20 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/3531176881' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6b78ba38-f60e-4cb6-b01c-cecc1820e8e9"}]: dispatch 2023-10-19T12:38:21.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:20 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/3531176881' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6b78ba38-f60e-4cb6-b01c-cecc1820e8e9"}]': finished 2023-10-19T12:38:21.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:20 smithi157 ceph-mon[134109]: osdmap e43: 7 total, 6 up, 7 in 2023-10-19T12:38:21.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:20 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-19T12:38:21.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:20 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/3531176881' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6b78ba38-f60e-4cb6-b01c-cecc1820e8e9"}]: dispatch 2023-10-19T12:38:21.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:20 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/3531176881' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6b78ba38-f60e-4cb6-b01c-cecc1820e8e9"}]': finished 2023-10-19T12:38:21.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:20 smithi195 ceph-mon[134493]: osdmap e43: 7 total, 6 up, 7 in 2023-10-19T12:38:21.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:20 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-19T12:38:21.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:20 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/3531176881' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6b78ba38-f60e-4cb6-b01c-cecc1820e8e9"}]: dispatch 2023-10-19T12:38:21.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:20 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/3531176881' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6b78ba38-f60e-4cb6-b01c-cecc1820e8e9"}]': finished 2023-10-19T12:38:21.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:20 smithi046 ceph-mon[98509]: osdmap e43: 7 total, 6 up, 7 in 2023-10-19T12:38:21.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:20 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-19T12:38:22.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:21 smithi157 ceph-mon[134109]: pgmap v150: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2/6 objects degraded (33.333%) 2023-10-19T12:38:22.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:21 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/3053073173' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-19T12:38:22.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:21 smithi195 ceph-mon[134493]: pgmap v150: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2/6 objects degraded (33.333%) 2023-10-19T12:38:22.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:21 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/3053073173' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-19T12:38:22.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:21 smithi046 ceph-mon[98509]: pgmap v150: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2/6 objects degraded (33.333%) 2023-10-19T12:38:22.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:21 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/3053073173' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-19T12:38:23.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:23 smithi046 ceph-mon[98509]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 98 KiB/s, 0 objects/s recovering 2023-10-19T12:38:23.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:23 smithi046 ceph-mon[98509]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2023-10-19T12:38:23.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:23 smithi046 ceph-mon[98509]: Cluster is now healthy 2023-10-19T12:38:24.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:23 smithi157 ceph-mon[134109]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 98 KiB/s, 0 objects/s recovering 2023-10-19T12:38:24.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:23 smithi157 ceph-mon[134109]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2023-10-19T12:38:24.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:23 smithi157 ceph-mon[134109]: Cluster is now healthy 2023-10-19T12:38:24.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:23 smithi195 ceph-mon[134493]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 98 KiB/s, 0 objects/s recovering 2023-10-19T12:38:24.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:23 smithi195 ceph-mon[134493]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2023-10-19T12:38:24.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:23 smithi195 ceph-mon[134493]: Cluster is now healthy 2023-10-19T12:38:25.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:25 smithi046 ceph-mon[98509]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 83 KiB/s, 0 objects/s recovering 2023-10-19T12:38:26.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:25 smithi157 ceph-mon[134109]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 83 KiB/s, 0 objects/s recovering 2023-10-19T12:38:26.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:25 smithi195 ceph-mon[134493]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 83 KiB/s, 0 objects/s recovering 2023-10-19T12:38:27.954 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:27 smithi046 ceph-mon[98509]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-10-19T12:38:28.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:27 smithi157 ceph-mon[134109]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-10-19T12:38:28.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:27 smithi195 ceph-mon[134493]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-10-19T12:38:28.908 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:28 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-10-19T12:38:28.908 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:28 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:38:29.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:28 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-10-19T12:38:29.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:28 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:38:29.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:28 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-10-19T12:38:29.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:28 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:38:29.945 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:29 smithi046 ceph-mon[98509]: Deploying daemon osd.6 on smithi046 2023-10-19T12:38:29.946 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:29 smithi046 ceph-mon[98509]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-10-19T12:38:30.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:29 smithi157 ceph-mon[134109]: Deploying daemon osd.6 on smithi046 2023-10-19T12:38:30.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:29 smithi157 ceph-mon[134109]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-10-19T12:38:30.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:29 smithi195 ceph-mon[134493]: Deploying daemon osd.6 on smithi046 2023-10-19T12:38:30.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:29 smithi195 ceph-mon[134493]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-10-19T12:38:31.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:31 smithi046 ceph-mon[98509]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 57 KiB/s, 0 objects/s recovering 2023-10-19T12:38:32.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:31 smithi157 ceph-mon[134109]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 57 KiB/s, 0 objects/s recovering 2023-10-19T12:38:32.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:31 smithi195 ceph-mon[134493]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 57 KiB/s, 0 objects/s recovering 2023-10-19T12:38:33.933 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:33 smithi046 ceph-mon[98509]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-10-19T12:38:34.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:33 smithi157 ceph-mon[134109]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-10-19T12:38:34.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:33 smithi195 ceph-mon[134493]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-10-19T12:38:35.367 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:35 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:38:35.367 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:35 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:38:35.368 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:35 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:38:35.368 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:35 smithi046 ceph-mon[98509]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-19T12:38:35.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:35 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:38:35.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:35 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:38:35.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:35 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:38:35.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:35 smithi195 ceph-mon[134493]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-19T12:38:35.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:35 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:38:35.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:35 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:38:35.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:35 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:38:35.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:35 smithi157 ceph-mon[134109]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-19T12:38:37.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:38:37.586+0000 7f97a37fe700 1 -- 172.21.15.46:0/1182348325 <== mgr.14150 v2:172.21.15.46:6800/3168073651 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f97ac074140 con 0x7f97980a1500 2023-10-19T12:38:37.591 INFO:teuthology.orchestra.run.smithi046.stdout:Created osd(s) 6 on host 'smithi046' 2023-10-19T12:38:37.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:38:37.589+0000 7f97b47f6700 1 -- 172.21.15.46:0/1182348325 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f97980a1500 msgr2=0x7f97980a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:38:37.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:38:37.589+0000 7f97b47f6700 1 --2- 172.21.15.46:0/1182348325 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f97980a1500 0x7f97980a39c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f97ac1018a0 tx=0x7f97a8009260 comp rx=0 tx=0).stop 2023-10-19T12:38:37.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:38:37.589+0000 7f97b47f6700 1 -- 172.21.15.46:0/1182348325 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97ac101a40 msgr2=0x7f97ac199000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:38:37.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:38:37.589+0000 7f97b47f6700 1 --2- 172.21.15.46:0/1182348325 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97ac101a40 0x7f97ac199000 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f979c00ec40 tx=0x7f979c00ef50 comp rx=0 tx=0).stop 2023-10-19T12:38:37.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:38:37.589+0000 7f97b47f6700 1 -- 172.21.15.46:0/1182348325 shutdown_connections 2023-10-19T12:38:37.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:38:37.589+0000 7f97b47f6700 1 --2- 172.21.15.46:0/1182348325 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f97ac1023e0 0x7f97ac1a0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:38:37.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:38:37.589+0000 7f97b47f6700 1 --2- 172.21.15.46:0/1182348325 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f97980a1500 0x7f97980a39c0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:38:37.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:38:37.589+0000 7f97b47f6700 1 --2- 172.21.15.46:0/1182348325 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f97ac100840 0x7f97ac198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:38:37.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:38:37.589+0000 7f97b47f6700 1 --2- 172.21.15.46:0/1182348325 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97ac101a40 0x7f97ac199000 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:38:37.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:38:37.589+0000 7f97b47f6700 1 -- 172.21.15.46:0/1182348325 >> 172.21.15.46:0/1182348325 conn(0x7f97ac0fbe00 msgr2=0x7f97ac072a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:38:37.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:38:37.589+0000 7f97b47f6700 1 -- 172.21.15.46:0/1182348325 shutdown_connections 2023-10-19T12:38:37.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:38:37.589+0000 7f97b47f6700 1 -- 172.21.15.46:0/1182348325 wait complete. 2023-10-19T12:38:37.973 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:37 smithi046 ceph-mon[98509]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-19T12:38:37.974 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:37 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:38:37.974 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:37 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:38:37.974 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:37 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:38:37.975 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:37 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:38:37.975 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:37 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:38:37.975 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:37 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:38:37.975 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:37 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:38:37.976 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:37 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:38:38.004 DEBUG:teuthology.orchestra.run.smithi046:osd.6> sudo journalctl -f -n 0 -u ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@osd.6.service 2023-10-19T12:38:38.010 INFO:tasks.cephadm:Deploying osd.7 on smithi157 with /dev/vg_nvme/lv_2... 2023-10-19T12:38:38.010 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-10-19T12:38:38.043 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:37 smithi157 ceph-mon[134109]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-19T12:38:38.043 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:37 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:38:38.043 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:37 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:38:38.043 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:37 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:38:38.044 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:37 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:38:38.044 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:37 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:38:38.044 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:37 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:38:38.044 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:37 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:38:38.044 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:37 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:38:38.086 INFO:journalctl@ceph.osd.6.smithi046.stdout:-- Logs begin at Thu 2023-10-19 12:15:13 UTC. -- 2023-10-19T12:38:38.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:37 smithi195 ceph-mon[134493]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-19T12:38:38.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:37 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:38:38.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:37 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:38:38.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:37 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:38:38.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:37 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:38:38.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:37 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:38:38.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:37 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:38:38.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:37 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:38:38.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:37 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:38:38.583 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.b/config 2023-10-19T12:38:38.910 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:38 smithi046 ceph-mon[98509]: from='osd.6 [v2:172.21.15.46:6818/1842285555,v1:172.21.15.46:6819/1842285555]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-10-19T12:38:38.910 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:38 smithi046 ceph-mon[98509]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-10-19T12:38:39.026 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:38 smithi157 ceph-mon[134109]: from='osd.6 [v2:172.21.15.46:6818/1842285555,v1:172.21.15.46:6819/1842285555]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-10-19T12:38:39.027 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:38 smithi157 ceph-mon[134109]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-10-19T12:38:39.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:38 smithi195 ceph-mon[134493]: from='osd.6 [v2:172.21.15.46:6818/1842285555,v1:172.21.15.46:6819/1842285555]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-10-19T12:38:39.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:38 smithi195 ceph-mon[134493]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-10-19T12:38:39.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:39 smithi046 ceph-mon[98509]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-19T12:38:39.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:39 smithi046 ceph-mon[98509]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-10-19T12:38:39.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:39 smithi046 ceph-mon[98509]: osdmap e44: 7 total, 6 up, 7 in 2023-10-19T12:38:39.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:39 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-19T12:38:39.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:39 smithi046 ceph-mon[98509]: from='osd.6 [v2:172.21.15.46:6818/1842285555,v1:172.21.15.46:6819/1842285555]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2023-10-19T12:38:39.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:39 smithi046 ceph-mon[98509]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2023-10-19T12:38:39.981 INFO:journalctl@ceph.osd.6.smithi046.stdout:Oct 19 12:38:39 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-6[133654]: 2023-10-19T12:38:39.678+0000 7f7c3ef5f700 -1 osd.6 0 waiting for initial osdmap 2023-10-19T12:38:39.981 INFO:journalctl@ceph.osd.6.smithi046.stdout:Oct 19 12:38:39 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-6[133654]: 2023-10-19T12:38:39.695+0000 7f7c38d50700 -1 osd.6 45 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-19T12:38:40.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:39 smithi157 ceph-mon[134109]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-19T12:38:40.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:39 smithi157 ceph-mon[134109]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-10-19T12:38:40.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:39 smithi157 ceph-mon[134109]: osdmap e44: 7 total, 6 up, 7 in 2023-10-19T12:38:40.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:39 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-19T12:38:40.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:39 smithi157 ceph-mon[134109]: from='osd.6 [v2:172.21.15.46:6818/1842285555,v1:172.21.15.46:6819/1842285555]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2023-10-19T12:38:40.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:39 smithi157 ceph-mon[134109]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2023-10-19T12:38:40.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:39 smithi195 ceph-mon[134493]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-19T12:38:40.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:39 smithi195 ceph-mon[134493]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-10-19T12:38:40.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:39 smithi195 ceph-mon[134493]: osdmap e44: 7 total, 6 up, 7 in 2023-10-19T12:38:40.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:39 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-19T12:38:40.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:39 smithi195 ceph-mon[134493]: from='osd.6 [v2:172.21.15.46:6818/1842285555,v1:172.21.15.46:6819/1842285555]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2023-10-19T12:38:40.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:39 smithi195 ceph-mon[134493]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2023-10-19T12:38:40.220 INFO:teuthology.orchestra.run.smithi157.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-10-19T12:38:40.220 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-10-19T12:38:40.220 INFO:teuthology.orchestra.run.smithi157.stderr: stderr: 10+0 records in 2023-10-19T12:38:40.220 INFO:teuthology.orchestra.run.smithi157.stderr:10+0 records out 2023-10-19T12:38:40.221 INFO:teuthology.orchestra.run.smithi157.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00851403 s, 1.2 GB/s 2023-10-19T12:38:40.221 INFO:teuthology.orchestra.run.smithi157.stderr:--> Zapping successful for: 2023-10-19T12:38:40.628 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph orch daemon add osd smithi157:vg_nvme/lv_2 2023-10-19T12:38:40.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:40 smithi046 ceph-mon[98509]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]': finished 2023-10-19T12:38:40.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:40 smithi046 ceph-mon[98509]: osdmap e45: 7 total, 6 up, 7 in 2023-10-19T12:38:40.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:40 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-19T12:38:40.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:40 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-19T12:38:41.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:40 smithi157 ceph-mon[134109]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]': finished 2023-10-19T12:38:41.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:40 smithi157 ceph-mon[134109]: osdmap e45: 7 total, 6 up, 7 in 2023-10-19T12:38:41.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:40 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-19T12:38:41.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:40 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-19T12:38:41.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:40 smithi195 ceph-mon[134493]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]': finished 2023-10-19T12:38:41.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:40 smithi195 ceph-mon[134493]: osdmap e45: 7 total, 6 up, 7 in 2023-10-19T12:38:41.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:40 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-19T12:38:41.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:40 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-19T12:38:41.228 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.b/config 2023-10-19T12:38:41.752 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:41 smithi157 ceph-mon[134109]: purged_snaps scrub starts 2023-10-19T12:38:41.752 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:41 smithi157 ceph-mon[134109]: purged_snaps scrub ok 2023-10-19T12:38:41.752 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:41 smithi157 ceph-mon[134109]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-19T12:38:41.753 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:41 smithi157 ceph-mon[134109]: osd.6 [v2:172.21.15.46:6818/1842285555,v1:172.21.15.46:6819/1842285555] boot 2023-10-19T12:38:41.753 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:41 smithi157 ceph-mon[134109]: osdmap e46: 7 total, 7 up, 7 in 2023-10-19T12:38:41.753 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:41 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-19T12:38:41.753 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:41 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:38:41.753 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:41 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:38:41.753 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:41 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:38:41.754 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:41 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:38:41.754 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:41 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:38:41.754 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:41 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:38:41.754 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:41 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:38:41.755 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:41 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:38:41.755 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:41 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:38:41.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:41 smithi046 ceph-mon[98509]: purged_snaps scrub starts 2023-10-19T12:38:41.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:41 smithi046 ceph-mon[98509]: purged_snaps scrub ok 2023-10-19T12:38:41.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:41 smithi046 ceph-mon[98509]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-19T12:38:41.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:41 smithi046 ceph-mon[98509]: osd.6 [v2:172.21.15.46:6818/1842285555,v1:172.21.15.46:6819/1842285555] boot 2023-10-19T12:38:41.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:41 smithi046 ceph-mon[98509]: osdmap e46: 7 total, 7 up, 7 in 2023-10-19T12:38:41.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:41 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-19T12:38:41.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:41 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:38:41.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:41 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:38:41.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:41 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:38:41.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:41 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:38:41.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:41 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:38:41.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:41 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:38:41.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:41 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:38:41.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:41 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:38:41.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:41 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:38:42.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:41 smithi195 ceph-mon[134493]: purged_snaps scrub starts 2023-10-19T12:38:42.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:41 smithi195 ceph-mon[134493]: purged_snaps scrub ok 2023-10-19T12:38:42.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:41 smithi195 ceph-mon[134493]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-19T12:38:42.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:41 smithi195 ceph-mon[134493]: osd.6 [v2:172.21.15.46:6818/1842285555,v1:172.21.15.46:6819/1842285555] boot 2023-10-19T12:38:42.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:41 smithi195 ceph-mon[134493]: osdmap e46: 7 total, 7 up, 7 in 2023-10-19T12:38:42.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:41 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-19T12:38:42.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:41 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:38:42.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:41 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:38:42.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:41 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:38:42.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:41 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:38:42.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:41 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:38:42.133 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:41 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:38:42.133 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:41 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:38:42.133 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:41 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:38:42.133 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:41 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:38:42.537 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:38:42.532+0000 7f2c702a0700 1 -- 172.21.15.157:0/1302162790 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2c68100050 msgr2=0x7f2c681004d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:38:42.537 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:38:42.532+0000 7f2c702a0700 1 --2- 172.21.15.157:0/1302162790 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2c68100050 0x7f2c681004d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2c64009990 tx=0x7f2c64009ca0 comp rx=0 tx=0).stop 2023-10-19T12:38:42.537 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:38:42.532+0000 7f2c702a0700 1 -- 172.21.15.157:0/1302162790 shutdown_connections 2023-10-19T12:38:42.538 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:38:42.532+0000 7f2c702a0700 1 --2- 172.21.15.157:0/1302162790 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2c68100a10 0x7f2c68107330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:38:42.538 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:38:42.532+0000 7f2c702a0700 1 --2- 172.21.15.157:0/1302162790 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2c680fee60 0x7f2c680ff280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:38:42.538 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:38:42.532+0000 7f2c702a0700 1 --2- 172.21.15.157:0/1302162790 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2c68100050 0x7f2c681004d0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:38:42.538 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:38:42.532+0000 7f2c702a0700 1 -- 172.21.15.157:0/1302162790 >> 172.21.15.157:0/1302162790 conn(0x7f2c680fa450 msgr2=0x7f2c680fc890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:38:42.539 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:38:42.532+0000 7f2c702a0700 1 -- 172.21.15.157:0/1302162790 shutdown_connections 2023-10-19T12:38:42.539 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:38:42.532+0000 7f2c702a0700 1 -- 172.21.15.157:0/1302162790 wait complete. 2023-10-19T12:38:42.539 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:38:42.533+0000 7f2c702a0700 1 Processor -- start 2023-10-19T12:38:42.539 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:38:42.533+0000 7f2c702a0700 1 -- start start 2023-10-19T12:38:42.539 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:38:42.533+0000 7f2c702a0700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2c680fee60 0x7f2c68195680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:38:42.540 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:38:42.533+0000 7f2c702a0700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2c68100050 0x7f2c68195bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:38:42.540 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:38:42.533+0000 7f2c702a0700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2c68100a10 0x7f2c6819cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:38:42.540 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:38:42.533+0000 7f2c702a0700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c6819d1c0 con 0x7f2c68100050 2023-10-19T12:38:42.540 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:38:42.533+0000 7f2c702a0700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c6819d300 con 0x7f2c680fee60 2023-10-19T12:38:42.540 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:38:42.533+0000 7f2c702a0700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c6819d490 con 0x7f2c68100a10 2023-10-19T12:38:42.541 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:38:42.533+0000 7f2c6e03c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2c680fee60 0x7f2c68195680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:38:42.541 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:38:42.533+0000 7f2c6e03c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2c680fee60 0x7f2c68195680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:58722/0 (socket says 172.21.15.157:58722) 2023-10-19T12:38:42.541 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:38:42.533+0000 7f2c6e03c700 1 -- 172.21.15.157:0/4197689420 learned_addr learned my addr 172.21.15.157:0/4197689420 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-19T12:38:42.541 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:38:42.533+0000 7f2c6d83b700 1 --2- 172.21.15.157:0/4197689420 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2c68100050 0x7f2c68195bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:38:42.541 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:38:42.533+0000 7f2c6e83d700 1 --2- 172.21.15.157:0/4197689420 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2c68100a10 0x7f2c6819cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:38:42.542 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:38:42.534+0000 7f2c6e03c700 1 -- 172.21.15.157:0/4197689420 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2c68100a10 msgr2=0x7f2c6819cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:38:42.542 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:38:42.534+0000 7f2c6e03c700 1 --2- 172.21.15.157:0/4197689420 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2c68100a10 0x7f2c6819cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:38:42.542 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:38:42.534+0000 7f2c6e03c700 1 -- 172.21.15.157:0/4197689420 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2c68100050 msgr2=0x7f2c68195bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:38:42.542 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:38:42.534+0000 7f2c6e03c700 1 --2- 172.21.15.157:0/4197689420 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2c68100050 0x7f2c68195bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:38:42.542 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:38:42.534+0000 7f2c6e03c700 1 -- 172.21.15.157:0/4197689420 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c640095f0 con 0x7f2c680fee60 2023-10-19T12:38:42.543 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:38:42.534+0000 7f2c6d83b700 1 --2- 172.21.15.157:0/4197689420 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2c68100050 0x7f2c68195bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T12:38:42.543 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:38:42.534+0000 7f2c6e03c700 1 --2- 172.21.15.157:0/4197689420 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2c680fee60 0x7f2c68195680 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2c5800c970 tx=0x7f2c5800cd30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:38:42.543 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:38:42.534+0000 7f2c5f7fe700 1 -- 172.21.15.157:0/4197689420 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c58004220 con 0x7f2c680fee60 2023-10-19T12:38:42.543 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:38:42.534+0000 7f2c702a0700 1 -- 172.21.15.157:0/4197689420 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c6819d770 con 0x7f2c680fee60 2023-10-19T12:38:42.543 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:38:42.534+0000 7f2c5f7fe700 1 -- 172.21.15.157:0/4197689420 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2c58007d60 con 0x7f2c680fee60 2023-10-19T12:38:42.544 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:38:42.534+0000 7f2c5f7fe700 1 -- 172.21.15.157:0/4197689420 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c58003d00 con 0x7f2c680fee60 2023-10-19T12:38:42.544 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:38:42.534+0000 7f2c702a0700 1 -- 172.21.15.157:0/4197689420 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c6819dc70 con 0x7f2c680fee60 2023-10-19T12:38:42.545 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:38:42.535+0000 7f2c702a0700 1 -- 172.21.15.157:0/4197689420 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c68106390 con 0x7f2c680fee60 2023-10-19T12:38:42.545 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:38:42.536+0000 7f2c5f7fe700 1 -- 172.21.15.157:0/4197689420 <== mon.2 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f2c580078a0 con 0x7f2c680fee60 2023-10-19T12:38:42.545 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:38:42.537+0000 7f2c5f7fe700 1 --2- 172.21.15.157:0/4197689420 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f2c540a1480 0x7f2c540a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:38:42.545 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:38:42.537+0000 7f2c5f7fe700 1 -- 172.21.15.157:0/4197689420 <== mon.2 v2:172.21.15.157:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 4965+0+0 (secure 0 0 0) 0x7f2c580cbf90 con 0x7f2c680fee60 2023-10-19T12:38:42.546 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:38:42.537+0000 7f2c6d83b700 1 --2- 172.21.15.157:0/4197689420 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f2c540a1480 0x7f2c540a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:38:42.546 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:38:42.538+0000 7f2c6d83b700 1 --2- 172.21.15.157:0/4197689420 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f2c540a1480 0x7f2c540a3940 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2c6400b5c0 tx=0x7f2c64005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:38:42.546 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:38:42.540+0000 7f2c5f7fe700 1 -- 172.21.15.157:0/4197689420 <== mon.2 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f2c58096300 con 0x7f2c680fee60 2023-10-19T12:38:42.745 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:38:42.742+0000 7f2c702a0700 1 -- 172.21.15.157:0/4197689420 --> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f2c68060c30 con 0x7f2c540a1480 2023-10-19T12:38:42.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:42 smithi046 ceph-mon[98509]: Detected new or changed devices on smithi046 2023-10-19T12:38:42.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:42 smithi046 ceph-mon[98509]: Adjusting osd_memory_target on smithi046 to 5758M 2023-10-19T12:38:42.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:42 smithi046 ceph-mon[98509]: osdmap e47: 7 total, 7 up, 7 in 2023-10-19T12:38:43.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:42 smithi157 ceph-mon[134109]: Detected new or changed devices on smithi046 2023-10-19T12:38:43.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:42 smithi157 ceph-mon[134109]: Adjusting osd_memory_target on smithi046 to 5758M 2023-10-19T12:38:43.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:42 smithi157 ceph-mon[134109]: osdmap e47: 7 total, 7 up, 7 in 2023-10-19T12:38:43.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:42 smithi195 ceph-mon[134493]: Detected new or changed devices on smithi046 2023-10-19T12:38:43.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:42 smithi195 ceph-mon[134493]: Adjusting osd_memory_target on smithi046 to 5758M 2023-10-19T12:38:43.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:42 smithi195 ceph-mon[134493]: osdmap e47: 7 total, 7 up, 7 in 2023-10-19T12:38:43.837 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:43 smithi157 ceph-mon[134109]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-19T12:38:43.838 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:43 smithi157 ceph-mon[134109]: from='client.24416 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-19T12:38:43.838 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:43 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-19T12:38:43.838 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:43 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-19T12:38:43.838 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:43 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:38:43.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:43 smithi046 ceph-mon[98509]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-19T12:38:43.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:43 smithi046 ceph-mon[98509]: from='client.24416 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-19T12:38:43.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:43 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-19T12:38:43.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:43 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-19T12:38:43.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:43 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:38:44.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:43 smithi195 ceph-mon[134493]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-19T12:38:44.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:43 smithi195 ceph-mon[134493]: from='client.24416 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-19T12:38:44.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:43 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-19T12:38:44.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:43 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-19T12:38:44.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:43 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:38:45.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:45 smithi046 ceph-mon[98509]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-19T12:38:45.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:45 smithi046 ceph-mon[98509]: from='client.? 172.21.15.157:0/200765383' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "59a0899f-3bcd-4db2-b544-24df3a536749"}]: dispatch 2023-10-19T12:38:45.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:45 smithi046 ceph-mon[98509]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "59a0899f-3bcd-4db2-b544-24df3a536749"}]: dispatch 2023-10-19T12:38:45.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:45 smithi046 ceph-mon[98509]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "59a0899f-3bcd-4db2-b544-24df3a536749"}]': finished 2023-10-19T12:38:45.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:45 smithi046 ceph-mon[98509]: osdmap e48: 8 total, 7 up, 8 in 2023-10-19T12:38:45.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:45 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-19T12:38:46.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:45 smithi157 ceph-mon[134109]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-19T12:38:46.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:45 smithi157 ceph-mon[134109]: from='client.? 172.21.15.157:0/200765383' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "59a0899f-3bcd-4db2-b544-24df3a536749"}]: dispatch 2023-10-19T12:38:46.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:45 smithi157 ceph-mon[134109]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "59a0899f-3bcd-4db2-b544-24df3a536749"}]: dispatch 2023-10-19T12:38:46.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:45 smithi157 ceph-mon[134109]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "59a0899f-3bcd-4db2-b544-24df3a536749"}]': finished 2023-10-19T12:38:46.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:45 smithi157 ceph-mon[134109]: osdmap e48: 8 total, 7 up, 8 in 2023-10-19T12:38:46.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:45 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-19T12:38:46.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:45 smithi195 ceph-mon[134493]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-19T12:38:46.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:45 smithi195 ceph-mon[134493]: from='client.? 172.21.15.157:0/200765383' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "59a0899f-3bcd-4db2-b544-24df3a536749"}]: dispatch 2023-10-19T12:38:46.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:45 smithi195 ceph-mon[134493]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "59a0899f-3bcd-4db2-b544-24df3a536749"}]: dispatch 2023-10-19T12:38:46.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:45 smithi195 ceph-mon[134493]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "59a0899f-3bcd-4db2-b544-24df3a536749"}]': finished 2023-10-19T12:38:46.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:45 smithi195 ceph-mon[134493]: osdmap e48: 8 total, 7 up, 8 in 2023-10-19T12:38:46.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:45 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-19T12:38:46.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:46 smithi046 ceph-mon[98509]: from='client.? 172.21.15.157:0/3282439560' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-19T12:38:47.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:46 smithi157 ceph-mon[134109]: from='client.? 172.21.15.157:0/3282439560' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-19T12:38:47.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:46 smithi195 ceph-mon[134493]: from='client.? 172.21.15.157:0/3282439560' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-19T12:38:47.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:47 smithi046 ceph-mon[98509]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-19T12:38:48.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:47 smithi157 ceph-mon[134109]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-19T12:38:48.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:47 smithi195 ceph-mon[134493]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-19T12:38:49.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:49 smithi046 ceph-mon[98509]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-19T12:38:50.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:49 smithi157 ceph-mon[134109]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-19T12:38:50.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:49 smithi195 ceph-mon[134493]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-19T12:38:51.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:51 smithi046 ceph-mon[98509]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-19T12:38:52.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:51 smithi157 ceph-mon[134109]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-19T12:38:52.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:51 smithi195 ceph-mon[134493]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-19T12:38:52.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:52 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-10-19T12:38:52.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:52 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:38:52.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:52 smithi046 ceph-mon[98509]: Deploying daemon osd.7 on smithi157 2023-10-19T12:38:53.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:52 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-10-19T12:38:53.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:52 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:38:53.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:52 smithi157 ceph-mon[134109]: Deploying daemon osd.7 on smithi157 2023-10-19T12:38:53.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:52 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-10-19T12:38:53.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:52 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:38:53.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:52 smithi195 ceph-mon[134493]: Deploying daemon osd.7 on smithi157 2023-10-19T12:38:53.837 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:53 smithi157 ceph-mon[134109]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-19T12:38:53.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:53 smithi046 ceph-mon[98509]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-19T12:38:54.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:53 smithi195 ceph-mon[134493]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-19T12:38:55.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:55 smithi046 ceph-mon[98509]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-19T12:38:56.016 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:55 smithi157 ceph-mon[134109]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-19T12:38:56.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:55 smithi195 ceph-mon[134493]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-19T12:38:57.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:57 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:38:57.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:57 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:38:57.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:57 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:38:57.589 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:57 smithi157 ceph-mon[134109]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-19T12:38:57.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:57 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:38:57.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:57 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:38:57.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:57 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:38:57.632 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:57 smithi195 ceph-mon[134493]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-19T12:38:57.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:57 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:38:57.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:57 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:38:57.730 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:57 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:38:57.730 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:57 smithi046 ceph-mon[98509]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-19T12:38:59.161 INFO:teuthology.orchestra.run.smithi157.stdout:Created osd(s) 7 on host 'smithi157' 2023-10-19T12:38:59.162 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:38:59.157+0000 7f2c5f7fe700 1 -- 172.21.15.157:0/4197689420 <== mgr.14150 v2:172.21.15.46:6800/3168073651 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f2c68060c30 con 0x7f2c540a1480 2023-10-19T12:38:59.163 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:38:59.159+0000 7f2c702a0700 1 -- 172.21.15.157:0/4197689420 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f2c540a1480 msgr2=0x7f2c540a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:38:59.163 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:38:59.159+0000 7f2c702a0700 1 --2- 172.21.15.157:0/4197689420 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f2c540a1480 0x7f2c540a3940 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2c6400b5c0 tx=0x7f2c64005fb0 comp rx=0 tx=0).stop 2023-10-19T12:38:59.163 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:38:59.159+0000 7f2c702a0700 1 -- 172.21.15.157:0/4197689420 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2c680fee60 msgr2=0x7f2c68195680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:38:59.164 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:38:59.159+0000 7f2c702a0700 1 --2- 172.21.15.157:0/4197689420 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2c680fee60 0x7f2c68195680 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2c5800c970 tx=0x7f2c5800cd30 comp rx=0 tx=0).stop 2023-10-19T12:38:59.164 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:38:59.159+0000 7f2c702a0700 1 -- 172.21.15.157:0/4197689420 shutdown_connections 2023-10-19T12:38:59.164 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:38:59.159+0000 7f2c702a0700 1 --2- 172.21.15.157:0/4197689420 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f2c540a1480 0x7f2c540a3940 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:38:59.164 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:38:59.159+0000 7f2c702a0700 1 --2- 172.21.15.157:0/4197689420 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2c68100a10 0x7f2c6819cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:38:59.164 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:38:59.159+0000 7f2c702a0700 1 --2- 172.21.15.157:0/4197689420 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2c680fee60 0x7f2c68195680 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:38:59.165 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:38:59.159+0000 7f2c702a0700 1 --2- 172.21.15.157:0/4197689420 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2c68100050 0x7f2c68195bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:38:59.165 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:38:59.159+0000 7f2c702a0700 1 -- 172.21.15.157:0/4197689420 >> 172.21.15.157:0/4197689420 conn(0x7f2c680fa450 msgr2=0x7f2c681034d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:38:59.165 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:38:59.159+0000 7f2c702a0700 1 -- 172.21.15.157:0/4197689420 shutdown_connections 2023-10-19T12:38:59.165 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:38:59.159+0000 7f2c702a0700 1 -- 172.21.15.157:0/4197689420 wait complete. 2023-10-19T12:38:59.619 DEBUG:teuthology.orchestra.run.smithi157:osd.7> sudo journalctl -f -n 0 -u ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@osd.7.service 2023-10-19T12:38:59.622 INFO:tasks.cephadm:Deploying osd.8 on smithi195 with /dev/vg_nvme/lv_2... 2023-10-19T12:38:59.622 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-10-19T12:38:59.656 INFO:journalctl@ceph.osd.7.smithi157.stdout:-- Logs begin at Thu 2023-10-19 12:11:40 UTC. -- 2023-10-19T12:38:59.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:59 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:38:59.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:59 smithi195 ceph-mon[134493]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-19T12:38:59.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:59 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:38:59.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:59 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:38:59.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:59 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:38:59.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:59 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:38:59.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:59 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:38:59.882 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:59 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:38:59.882 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:38:59 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:38:59.946 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:59 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:38:59.947 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:59 smithi157 ceph-mon[134109]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-19T12:38:59.947 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:59 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:38:59.947 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:59 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:38:59.947 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:59 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:38:59.948 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:59 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:38:59.948 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:59 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:38:59.948 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:59 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:38:59.948 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:38:59 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:38:59.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:59 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:38:59.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:59 smithi046 ceph-mon[98509]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-19T12:38:59.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:59 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:38:59.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:59 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:38:59.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:59 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:38:59.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:59 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:38:59.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:59 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:38:59.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:59 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:38:59.983 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:38:59 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:39:00.191 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.c/config 2023-10-19T12:39:00.224 INFO:journalctl@ceph.osd.7.smithi157.stdout:Oct 19 12:39:00 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-7[155800]: 2023-10-19T12:39:00.134+0000 7fa107c05640 -1 osd.7 0 log_to_monitors true 2023-10-19T12:39:00.710 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:00 smithi195 ceph-mon[134493]: from='osd.7 [v2:172.21.15.157:6816/3498672588,v1:172.21.15.157:6817/3498672588]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-10-19T12:39:00.710 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:00 smithi195 ceph-mon[134493]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-10-19T12:39:00.837 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:00 smithi157 ceph-mon[134109]: from='osd.7 [v2:172.21.15.157:6816/3498672588,v1:172.21.15.157:6817/3498672588]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-10-19T12:39:00.838 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:00 smithi157 ceph-mon[134109]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-10-19T12:39:00.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:00 smithi046 ceph-mon[98509]: from='osd.7 [v2:172.21.15.157:6816/3498672588,v1:172.21.15.157:6817/3498672588]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-10-19T12:39:00.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:00 smithi046 ceph-mon[98509]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-10-19T12:39:01.655 INFO:teuthology.orchestra.run.smithi195.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-10-19T12:39:01.655 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-10-19T12:39:01.656 INFO:teuthology.orchestra.run.smithi195.stderr: stderr: 10+0 records in 2023-10-19T12:39:01.656 INFO:teuthology.orchestra.run.smithi195.stderr:10+0 records out 2023-10-19T12:39:01.656 INFO:teuthology.orchestra.run.smithi195.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0082657 s, 1.3 GB/s 2023-10-19T12:39:01.656 INFO:teuthology.orchestra.run.smithi195.stderr:--> Zapping successful for: 2023-10-19T12:39:01.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:01 smithi195 ceph-mon[134493]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-19T12:39:01.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:01 smithi195 ceph-mon[134493]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-10-19T12:39:01.882 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:01 smithi195 ceph-mon[134493]: osdmap e49: 8 total, 7 up, 8 in 2023-10-19T12:39:01.882 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:01 smithi195 ceph-mon[134493]: from='osd.7 [v2:172.21.15.157:6816/3498672588,v1:172.21.15.157:6817/3498672588]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2023-10-19T12:39:01.882 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:01 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-19T12:39:01.882 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:01 smithi195 ceph-mon[134493]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2023-10-19T12:39:01.957 INFO:journalctl@ceph.osd.7.smithi157.stdout:Oct 19 12:39:01 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-7[155800]: 2023-10-19T12:39:01.619+0000 7fa0fd27c700 -1 osd.7 0 waiting for initial osdmap 2023-10-19T12:39:01.958 INFO:journalctl@ceph.osd.7.smithi157.stdout:Oct 19 12:39:01 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-7[155800]: 2023-10-19T12:39:01.628+0000 7fa0f786e700 -1 osd.7 50 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-19T12:39:01.958 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:01 smithi157 ceph-mon[134109]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-19T12:39:01.959 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:01 smithi157 ceph-mon[134109]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-10-19T12:39:01.959 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:01 smithi157 ceph-mon[134109]: osdmap e49: 8 total, 7 up, 8 in 2023-10-19T12:39:01.959 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:01 smithi157 ceph-mon[134109]: from='osd.7 [v2:172.21.15.157:6816/3498672588,v1:172.21.15.157:6817/3498672588]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2023-10-19T12:39:01.960 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:01 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-19T12:39:01.960 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:01 smithi157 ceph-mon[134109]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2023-10-19T12:39:01.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:01 smithi046 ceph-mon[98509]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-19T12:39:01.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:01 smithi046 ceph-mon[98509]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-10-19T12:39:01.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:01 smithi046 ceph-mon[98509]: osdmap e49: 8 total, 7 up, 8 in 2023-10-19T12:39:01.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:01 smithi046 ceph-mon[98509]: from='osd.7 [v2:172.21.15.157:6816/3498672588,v1:172.21.15.157:6817/3498672588]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2023-10-19T12:39:01.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:01 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-19T12:39:01.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:01 smithi046 ceph-mon[98509]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2023-10-19T12:39:02.035 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph orch daemon add osd smithi195:vg_nvme/lv_2 2023-10-19T12:39:02.592 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.c/config 2023-10-19T12:39:02.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:02 smithi195 ceph-mon[134493]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]': finished 2023-10-19T12:39:02.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:02 smithi195 ceph-mon[134493]: osdmap e50: 8 total, 7 up, 8 in 2023-10-19T12:39:02.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:02 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-19T12:39:02.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:02 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-19T12:39:02.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:02 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:39:02.882 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:02 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:39:02.882 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:02 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:39:02.882 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:02 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:39:02.882 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:02 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:39:02.883 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:02 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:39:02.883 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:02 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:39:02.883 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:02 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:39:02.883 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:02 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:39:02.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:02 smithi046 ceph-mon[98509]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]': finished 2023-10-19T12:39:02.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:02 smithi046 ceph-mon[98509]: osdmap e50: 8 total, 7 up, 8 in 2023-10-19T12:39:02.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:02 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-19T12:39:02.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:02 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-19T12:39:02.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:02 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:39:02.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:02 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:39:02.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:02 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:39:02.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:02 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:39:02.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:02 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:39:02.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:02 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:39:02.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:02 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:39:02.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:02 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:39:02.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:02 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:39:03.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:02 smithi157 ceph-mon[134109]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]': finished 2023-10-19T12:39:03.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:02 smithi157 ceph-mon[134109]: osdmap e50: 8 total, 7 up, 8 in 2023-10-19T12:39:03.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:02 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-19T12:39:03.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:02 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-19T12:39:03.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:02 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:39:03.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:02 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:39:03.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:02 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:39:03.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:02 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:39:03.090 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:02 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:39:03.090 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:02 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:39:03.090 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:02 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:39:03.090 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:02 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:39:03.091 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:02 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:39:03.826 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:39:03.820+0000 7eff75a54700 1 -- 172.21.15.195:0/3082046961 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7eff70101340 msgr2=0x7eff70103730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:39:03.826 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:39:03.820+0000 7eff75a54700 1 --2- 172.21.15.195:0/3082046961 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7eff70101340 0x7eff70103730 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7eff60009990 tx=0x7eff60009ca0 comp rx=0 tx=0).stop 2023-10-19T12:39:03.826 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:39:03.820+0000 7eff75a54700 1 -- 172.21.15.195:0/3082046961 shutdown_connections 2023-10-19T12:39:03.827 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:39:03.820+0000 7eff75a54700 1 --2- 172.21.15.195:0/3082046961 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff701065a0 0x7eff701089b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:39:03.827 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:39:03.820+0000 7eff75a54700 1 --2- 172.21.15.195:0/3082046961 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7eff70101340 0x7eff70103730 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:39:03.827 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:39:03.820+0000 7eff75a54700 1 --2- 172.21.15.195:0/3082046961 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff70103c70 0x7eff70106060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:39:03.827 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:39:03.820+0000 7eff75a54700 1 -- 172.21.15.195:0/3082046961 >> 172.21.15.195:0/3082046961 conn(0x7eff700facf0 msgr2=0x7eff700fd130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:39:03.827 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:39:03.820+0000 7eff75a54700 1 -- 172.21.15.195:0/3082046961 shutdown_connections 2023-10-19T12:39:03.828 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:39:03.820+0000 7eff75a54700 1 -- 172.21.15.195:0/3082046961 wait complete. 2023-10-19T12:39:03.828 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:39:03.821+0000 7eff75a54700 1 Processor -- start 2023-10-19T12:39:03.828 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:39:03.821+0000 7eff75a54700 1 -- start start 2023-10-19T12:39:03.828 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:39:03.821+0000 7eff75a54700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff70101340 0x7eff701967d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:39:03.828 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:39:03.821+0000 7eff75a54700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff70103c70 0x7eff70196d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:39:03.829 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:39:03.821+0000 7eff75a54700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7eff701065a0 0x7eff7019dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:39:03.829 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:39:03.821+0000 7eff75a54700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff7019e2c0 con 0x7eff70101340 2023-10-19T12:39:03.829 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:39:03.821+0000 7eff75a54700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff7019e400 con 0x7eff70103c70 2023-10-19T12:39:03.829 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:39:03.821+0000 7eff75a54700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff7019e590 con 0x7eff701065a0 2023-10-19T12:39:03.829 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:39:03.821+0000 7eff6f7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7eff701065a0 0x7eff7019dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:39:03.830 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:39:03.821+0000 7eff6f7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7eff701065a0 0x7eff7019dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:48766/0 (socket says 172.21.15.195:48766) 2023-10-19T12:39:03.830 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:39:03.821+0000 7eff6f7fe700 1 -- 172.21.15.195:0/3548820191 learned_addr learned my addr 172.21.15.195:0/3548820191 (peer_addr_for_me v2:172.21.15.195:0/0) 2023-10-19T12:39:03.830 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:39:03.822+0000 7eff6e7fc700 1 --2- 172.21.15.195:0/3548820191 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff70103c70 0x7eff70196d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:39:03.830 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:39:03.822+0000 7eff6effd700 1 --2- 172.21.15.195:0/3548820191 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff70101340 0x7eff701967d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:39:03.830 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:39:03.822+0000 7eff6f7fe700 1 -- 172.21.15.195:0/3548820191 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff70103c70 msgr2=0x7eff70196d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:39:03.831 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:39:03.822+0000 7eff6f7fe700 1 --2- 172.21.15.195:0/3548820191 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff70103c70 0x7eff70196d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:39:03.831 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:39:03.822+0000 7eff6f7fe700 1 -- 172.21.15.195:0/3548820191 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff70101340 msgr2=0x7eff701967d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:39:03.831 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:39:03.822+0000 7eff6f7fe700 1 --2- 172.21.15.195:0/3548820191 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff70101340 0x7eff701967d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:39:03.831 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:39:03.822+0000 7eff6f7fe700 1 -- 172.21.15.195:0/3548820191 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff600095f0 con 0x7eff701065a0 2023-10-19T12:39:03.831 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:39:03.822+0000 7eff6effd700 1 --2- 172.21.15.195:0/3548820191 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff70101340 0x7eff701967d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T12:39:03.832 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:39:03.822+0000 7eff6f7fe700 1 --2- 172.21.15.195:0/3548820191 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7eff701065a0 0x7eff7019dcf0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7eff6800ba10 tx=0x7eff6800bd20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:39:03.832 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:39:03.822+0000 7eff74a52700 1 -- 172.21.15.195:0/3548820191 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff6800c930 con 0x7eff701065a0 2023-10-19T12:39:03.832 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:39:03.822+0000 7eff75a54700 1 -- 172.21.15.195:0/3548820191 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff7019e870 con 0x7eff701065a0 2023-10-19T12:39:03.832 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:39:03.822+0000 7eff74a52700 1 -- 172.21.15.195:0/3548820191 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7eff68014440 con 0x7eff701065a0 2023-10-19T12:39:03.832 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:39:03.822+0000 7eff74a52700 1 -- 172.21.15.195:0/3548820191 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff680125a0 con 0x7eff701065a0 2023-10-19T12:39:03.833 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:39:03.822+0000 7eff75a54700 1 -- 172.21.15.195:0/3548820191 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff7019ed20 con 0x7eff701065a0 2023-10-19T12:39:03.834 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:39:03.823+0000 7eff75a54700 1 -- 172.21.15.195:0/3548820191 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff700fc870 con 0x7eff701065a0 2023-10-19T12:39:03.834 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:39:03.824+0000 7eff74a52700 1 -- 172.21.15.195:0/3548820191 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7eff680145b0 con 0x7eff701065a0 2023-10-19T12:39:03.834 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:39:03.825+0000 7eff74a52700 1 --2- 172.21.15.195:0/3548820191 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7eff580a1500 0x7eff580a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:39:03.834 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:39:03.825+0000 7eff74a52700 1 -- 172.21.15.195:0/3548820191 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5426+0+0 (secure 0 0 0) 0x7eff68006e40 con 0x7eff701065a0 2023-10-19T12:39:03.835 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:39:03.825+0000 7eff6effd700 1 --2- 172.21.15.195:0/3548820191 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7eff580a1500 0x7eff580a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:39:03.835 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:39:03.826+0000 7eff6effd700 1 --2- 172.21.15.195:0/3548820191 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7eff580a1500 0x7eff580a39c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7eff600037f0 tx=0x7eff60005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:39:03.835 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:39:03.828+0000 7eff74a52700 1 -- 172.21.15.195:0/3548820191 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7eff68095bb0 con 0x7eff701065a0 2023-10-19T12:39:03.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:03 smithi195 ceph-mon[134493]: purged_snaps scrub starts 2023-10-19T12:39:03.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:03 smithi195 ceph-mon[134493]: purged_snaps scrub ok 2023-10-19T12:39:03.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:03 smithi195 ceph-mon[134493]: Detected new or changed devices on smithi157 2023-10-19T12:39:03.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:03 smithi195 ceph-mon[134493]: Adjusting osd_memory_target on smithi157 to 5722M 2023-10-19T12:39:03.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:03 smithi195 ceph-mon[134493]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-19T12:39:03.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:03 smithi195 ceph-mon[134493]: osd.7 [v2:172.21.15.157:6816/3498672588,v1:172.21.15.157:6817/3498672588] boot 2023-10-19T12:39:03.882 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:03 smithi195 ceph-mon[134493]: osdmap e51: 8 total, 8 up, 8 in 2023-10-19T12:39:03.882 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:03 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-19T12:39:03.882 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:03 smithi195 ceph-mon[134493]: osdmap e52: 8 total, 8 up, 8 in 2023-10-19T12:39:03.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:03 smithi046 ceph-mon[98509]: purged_snaps scrub starts 2023-10-19T12:39:03.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:03 smithi046 ceph-mon[98509]: purged_snaps scrub ok 2023-10-19T12:39:03.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:03 smithi046 ceph-mon[98509]: Detected new or changed devices on smithi157 2023-10-19T12:39:03.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:03 smithi046 ceph-mon[98509]: Adjusting osd_memory_target on smithi157 to 5722M 2023-10-19T12:39:03.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:03 smithi046 ceph-mon[98509]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-19T12:39:03.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:03 smithi046 ceph-mon[98509]: osd.7 [v2:172.21.15.157:6816/3498672588,v1:172.21.15.157:6817/3498672588] boot 2023-10-19T12:39:03.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:03 smithi046 ceph-mon[98509]: osdmap e51: 8 total, 8 up, 8 in 2023-10-19T12:39:03.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:03 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-19T12:39:03.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:03 smithi046 ceph-mon[98509]: osdmap e52: 8 total, 8 up, 8 in 2023-10-19T12:39:04.029 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:39:04.026+0000 7eff75a54700 1 -- 172.21.15.195:0/3548820191 --> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7eff70060c30 con 0x7eff580a1500 2023-10-19T12:39:04.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:03 smithi157 ceph-mon[134109]: purged_snaps scrub starts 2023-10-19T12:39:04.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:03 smithi157 ceph-mon[134109]: purged_snaps scrub ok 2023-10-19T12:39:04.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:03 smithi157 ceph-mon[134109]: Detected new or changed devices on smithi157 2023-10-19T12:39:04.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:03 smithi157 ceph-mon[134109]: Adjusting osd_memory_target on smithi157 to 5722M 2023-10-19T12:39:04.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:03 smithi157 ceph-mon[134109]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-19T12:39:04.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:03 smithi157 ceph-mon[134109]: osd.7 [v2:172.21.15.157:6816/3498672588,v1:172.21.15.157:6817/3498672588] boot 2023-10-19T12:39:04.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:03 smithi157 ceph-mon[134109]: osdmap e51: 8 total, 8 up, 8 in 2023-10-19T12:39:04.090 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:03 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-19T12:39:04.090 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:03 smithi157 ceph-mon[134109]: osdmap e52: 8 total, 8 up, 8 in 2023-10-19T12:39:04.923 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:04 smithi195 ceph-mon[134493]: osdmap e53: 8 total, 8 up, 8 in 2023-10-19T12:39:04.924 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:04 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-19T12:39:04.924 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:04 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-19T12:39:04.924 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:04 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:39:04.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:04 smithi046 ceph-mon[98509]: osdmap e53: 8 total, 8 up, 8 in 2023-10-19T12:39:04.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:04 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-19T12:39:04.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:04 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-19T12:39:04.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:04 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:39:05.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:04 smithi157 ceph-mon[134109]: osdmap e53: 8 total, 8 up, 8 in 2023-10-19T12:39:05.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:04 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-19T12:39:05.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:04 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-19T12:39:05.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:04 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:39:05.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:05 smithi195 ceph-mon[134493]: from='client.24433 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-19T12:39:05.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:05 smithi195 ceph-mon[134493]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-19T12:39:05.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:05 smithi195 ceph-mon[134493]: osdmap e54: 8 total, 8 up, 8 in 2023-10-19T12:39:05.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:05 smithi046 ceph-mon[98509]: from='client.24433 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-19T12:39:05.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:05 smithi046 ceph-mon[98509]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-19T12:39:05.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:05 smithi046 ceph-mon[98509]: osdmap e54: 8 total, 8 up, 8 in 2023-10-19T12:39:06.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:05 smithi157 ceph-mon[134109]: from='client.24433 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-19T12:39:06.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:05 smithi157 ceph-mon[134109]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-19T12:39:06.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:05 smithi157 ceph-mon[134109]: osdmap e54: 8 total, 8 up, 8 in 2023-10-19T12:39:06.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:06 smithi046 ceph-mon[98509]: osdmap e55: 8 total, 8 up, 8 in 2023-10-19T12:39:06.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:06 smithi046 ceph-mon[98509]: from='client.? 172.21.15.195:0/2709496943' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9c3c9835-043a-4fb5-a9ee-edf8caf6b605"}]: dispatch 2023-10-19T12:39:06.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:06 smithi046 ceph-mon[98509]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9c3c9835-043a-4fb5-a9ee-edf8caf6b605"}]: dispatch 2023-10-19T12:39:06.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:06 smithi046 ceph-mon[98509]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9c3c9835-043a-4fb5-a9ee-edf8caf6b605"}]': finished 2023-10-19T12:39:06.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:06 smithi046 ceph-mon[98509]: osdmap e56: 9 total, 8 up, 9 in 2023-10-19T12:39:06.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:06 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-19T12:39:07.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:06 smithi157 ceph-mon[134109]: osdmap e55: 8 total, 8 up, 8 in 2023-10-19T12:39:07.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:06 smithi157 ceph-mon[134109]: from='client.? 172.21.15.195:0/2709496943' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9c3c9835-043a-4fb5-a9ee-edf8caf6b605"}]: dispatch 2023-10-19T12:39:07.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:06 smithi157 ceph-mon[134109]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9c3c9835-043a-4fb5-a9ee-edf8caf6b605"}]: dispatch 2023-10-19T12:39:07.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:06 smithi157 ceph-mon[134109]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9c3c9835-043a-4fb5-a9ee-edf8caf6b605"}]': finished 2023-10-19T12:39:07.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:06 smithi157 ceph-mon[134109]: osdmap e56: 9 total, 8 up, 9 in 2023-10-19T12:39:07.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:06 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-19T12:39:07.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:06 smithi195 ceph-mon[134493]: osdmap e55: 8 total, 8 up, 8 in 2023-10-19T12:39:07.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:06 smithi195 ceph-mon[134493]: from='client.? 172.21.15.195:0/2709496943' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9c3c9835-043a-4fb5-a9ee-edf8caf6b605"}]: dispatch 2023-10-19T12:39:07.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:06 smithi195 ceph-mon[134493]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9c3c9835-043a-4fb5-a9ee-edf8caf6b605"}]: dispatch 2023-10-19T12:39:07.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:06 smithi195 ceph-mon[134493]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9c3c9835-043a-4fb5-a9ee-edf8caf6b605"}]': finished 2023-10-19T12:39:07.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:06 smithi195 ceph-mon[134493]: osdmap e56: 9 total, 8 up, 9 in 2023-10-19T12:39:07.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:06 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-19T12:39:07.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:07 smithi046 ceph-mon[98509]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-19T12:39:07.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:07 smithi046 ceph-mon[98509]: from='client.? 172.21.15.195:0/3658710228' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-19T12:39:08.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:07 smithi157 ceph-mon[134109]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-19T12:39:08.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:07 smithi157 ceph-mon[134109]: from='client.? 172.21.15.195:0/3658710228' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-19T12:39:08.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:07 smithi195 ceph-mon[134493]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-19T12:39:08.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:07 smithi195 ceph-mon[134493]: from='client.? 172.21.15.195:0/3658710228' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-19T12:39:09.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:09 smithi046 ceph-mon[98509]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-19T12:39:10.049 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:09 smithi195 ceph-mon[134493]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-19T12:39:10.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:09 smithi157 ceph-mon[134109]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-19T12:39:11.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:11 smithi195 ceph-mon[134493]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2023-10-19T12:39:11.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:11 smithi046 ceph-mon[98509]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2023-10-19T12:39:12.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:11 smithi157 ceph-mon[134109]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 715 GiB / 715 GiB avail 2023-10-19T12:39:13.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:13 smithi046 ceph-mon[98509]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-19T12:39:13.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:13 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-10-19T12:39:13.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:13 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:39:13.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:13 smithi046 ceph-mon[98509]: Deploying daemon osd.8 on smithi195 2023-10-19T12:39:14.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:13 smithi157 ceph-mon[134109]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-19T12:39:14.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:13 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-10-19T12:39:14.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:13 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:39:14.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:13 smithi157 ceph-mon[134109]: Deploying daemon osd.8 on smithi195 2023-10-19T12:39:14.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:13 smithi195 ceph-mon[134493]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-19T12:39:14.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:13 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-10-19T12:39:14.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:13 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:39:14.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:13 smithi195 ceph-mon[134493]: Deploying daemon osd.8 on smithi195 2023-10-19T12:39:15.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:15 smithi195 ceph-mon[134493]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-19T12:39:15.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:15 smithi046 ceph-mon[98509]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-19T12:39:16.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:15 smithi157 ceph-mon[134109]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-19T12:39:17.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:17 smithi046 ceph-mon[98509]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-19T12:39:17.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:17 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:39:17.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:17 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:39:17.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:17 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:39:18.040 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:17 smithi195 ceph-mon[134493]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-19T12:39:18.040 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:17 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:39:18.041 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:17 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:39:18.041 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:17 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:39:18.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:17 smithi157 ceph-mon[134109]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-19T12:39:18.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:17 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:39:18.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:17 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:39:18.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:17 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:39:19.442 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:39:19.438+0000 7eff74a52700 1 -- 172.21.15.195:0/3548820191 <== mgr.14150 v2:172.21.15.46:6800/3168073651 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7eff70060c30 con 0x7eff580a1500 2023-10-19T12:39:19.443 INFO:teuthology.orchestra.run.smithi195.stdout:Created osd(s) 8 on host 'smithi195' 2023-10-19T12:39:19.444 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:39:19.440+0000 7eff75a54700 1 -- 172.21.15.195:0/3548820191 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7eff580a1500 msgr2=0x7eff580a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:39:19.444 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:39:19.440+0000 7eff75a54700 1 --2- 172.21.15.195:0/3548820191 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7eff580a1500 0x7eff580a39c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7eff600037f0 tx=0x7eff60005fb0 comp rx=0 tx=0).stop 2023-10-19T12:39:19.444 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:39:19.440+0000 7eff75a54700 1 -- 172.21.15.195:0/3548820191 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7eff701065a0 msgr2=0x7eff7019dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:39:19.445 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:39:19.440+0000 7eff75a54700 1 --2- 172.21.15.195:0/3548820191 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7eff701065a0 0x7eff7019dcf0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7eff6800ba10 tx=0x7eff6800bd20 comp rx=0 tx=0).stop 2023-10-19T12:39:19.445 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:39:19.440+0000 7eff75a54700 1 -- 172.21.15.195:0/3548820191 shutdown_connections 2023-10-19T12:39:19.445 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:39:19.440+0000 7eff75a54700 1 --2- 172.21.15.195:0/3548820191 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7eff580a1500 0x7eff580a39c0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:39:19.445 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:39:19.440+0000 7eff75a54700 1 --2- 172.21.15.195:0/3548820191 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7eff701065a0 0x7eff7019dcf0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:39:19.445 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:39:19.440+0000 7eff75a54700 1 --2- 172.21.15.195:0/3548820191 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff70101340 0x7eff701967d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:39:19.445 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:39:19.440+0000 7eff75a54700 1 --2- 172.21.15.195:0/3548820191 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff70103c70 0x7eff70196d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:39:19.446 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:39:19.440+0000 7eff75a54700 1 -- 172.21.15.195:0/3548820191 >> 172.21.15.195:0/3548820191 conn(0x7eff700facf0 msgr2=0x7eff70101c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:39:19.446 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:39:19.440+0000 7eff75a54700 1 -- 172.21.15.195:0/3548820191 shutdown_connections 2023-10-19T12:39:19.446 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:39:19.441+0000 7eff75a54700 1 -- 172.21.15.195:0/3548820191 wait complete. 2023-10-19T12:39:19.786 DEBUG:teuthology.orchestra.run.smithi195:osd.8> sudo journalctl -f -n 0 -u ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@osd.8.service 2023-10-19T12:39:19.788 INFO:tasks.cephadm:Deploying osd.9 on smithi046 with /dev/vg_nvme/lv_1... 2023-10-19T12:39:19.789 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-10-19T12:39:19.818 INFO:journalctl@ceph.osd.8.smithi195.stdout:-- Logs begin at Thu 2023-10-19 12:10:53 UTC. -- 2023-10-19T12:39:19.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:19 smithi046 ceph-mon[98509]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-19T12:39:19.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:19 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:39:19.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:19 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:39:19.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:19 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:39:19.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:19 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:39:19.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:19 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:39:19.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:19 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:39:19.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:19 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:39:19.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:19 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:39:20.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:19 smithi157 ceph-mon[134109]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-19T12:39:20.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:19 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:39:20.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:19 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:39:20.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:19 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:39:20.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:19 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:39:20.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:19 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:39:20.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:19 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:39:20.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:19 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:39:20.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:19 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:39:20.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:19 smithi195 ceph-mon[134493]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-19T12:39:20.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:19 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:39:20.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:19 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:39:20.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:19 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:39:20.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:19 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:39:20.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:19 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:39:20.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:19 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:39:20.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:19 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:39:20.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:19 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:39:20.547 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-19T12:39:21.381 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 12:39:20 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T12:39:20.928+0000 7ff1dde9c640 -1 osd.8 0 log_to_monitors true 2023-10-19T12:39:21.973 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:21 smithi195 ceph-mon[134493]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-19T12:39:21.973 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:21 smithi195 ceph-mon[134493]: from='osd.8 [v2:172.21.15.195:6816/74230104,v1:172.21.15.195:6817/74230104]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-10-19T12:39:21.973 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:21 smithi195 ceph-mon[134493]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-10-19T12:39:21.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:21 smithi046 ceph-mon[98509]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-19T12:39:21.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:21 smithi046 ceph-mon[98509]: from='osd.8 [v2:172.21.15.195:6816/74230104,v1:172.21.15.195:6817/74230104]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-10-19T12:39:21.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:21 smithi046 ceph-mon[98509]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-10-19T12:39:22.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:21 smithi157 ceph-mon[134109]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-19T12:39:22.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:21 smithi157 ceph-mon[134109]: from='osd.8 [v2:172.21.15.195:6816/74230104,v1:172.21.15.195:6817/74230104]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-10-19T12:39:22.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:21 smithi157 ceph-mon[134109]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-10-19T12:39:22.447 INFO:teuthology.orchestra.run.smithi046.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-10-19T12:39:22.447 INFO:teuthology.orchestra.run.smithi046.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-10-19T12:39:22.447 INFO:teuthology.orchestra.run.smithi046.stderr: stderr: 10+0 records in 2023-10-19T12:39:22.448 INFO:teuthology.orchestra.run.smithi046.stderr:10+0 records out 2023-10-19T12:39:22.448 INFO:teuthology.orchestra.run.smithi046.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0445881 s, 235 MB/s 2023-10-19T12:39:22.448 INFO:teuthology.orchestra.run.smithi046.stderr:--> Zapping successful for: 2023-10-19T12:39:22.860 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:22 smithi046 ceph-mon[98509]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-10-19T12:39:22.860 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:22 smithi046 ceph-mon[98509]: osdmap e57: 9 total, 8 up, 9 in 2023-10-19T12:39:22.860 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:22 smithi046 ceph-mon[98509]: from='osd.8 [v2:172.21.15.195:6816/74230104,v1:172.21.15.195:6817/74230104]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2023-10-19T12:39:22.860 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:22 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-19T12:39:22.861 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:22 smithi046 ceph-mon[98509]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2023-10-19T12:39:22.861 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:22 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:39:22.861 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:22 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:39:22.861 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:22 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:39:22.861 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:22 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:39:22.862 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:22 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:39:22.862 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:22 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:39:22.862 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:22 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:39:22.862 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:22 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:39:22.862 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:22 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:39:22.863 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:22 smithi046 ceph-mon[98509]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2023-10-19T12:39:22.863 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:22 smithi046 ceph-mon[98509]: osdmap e58: 9 total, 8 up, 9 in 2023-10-19T12:39:22.930 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph orch daemon add osd smithi046:vg_nvme/lv_1 2023-10-19T12:39:23.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:22 smithi157 ceph-mon[134109]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-10-19T12:39:23.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:22 smithi157 ceph-mon[134109]: osdmap e57: 9 total, 8 up, 9 in 2023-10-19T12:39:23.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:22 smithi157 ceph-mon[134109]: from='osd.8 [v2:172.21.15.195:6816/74230104,v1:172.21.15.195:6817/74230104]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2023-10-19T12:39:23.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:22 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-19T12:39:23.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:22 smithi157 ceph-mon[134109]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2023-10-19T12:39:23.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:22 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:39:23.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:22 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:39:23.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:22 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:39:23.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:22 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:39:23.090 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:22 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:39:23.090 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:22 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:39:23.090 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:22 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:39:23.090 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:22 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:39:23.090 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:22 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:39:23.091 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:22 smithi157 ceph-mon[134109]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2023-10-19T12:39:23.091 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:22 smithi157 ceph-mon[134109]: osdmap e58: 9 total, 8 up, 9 in 2023-10-19T12:39:23.130 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 12:39:22 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T12:39:22.701+0000 7ff1d3513700 -1 osd.8 0 waiting for initial osdmap 2023-10-19T12:39:23.131 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 12:39:22 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T12:39:22.711+0000 7ff1ccb03700 -1 osd.8 58 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-19T12:39:23.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:22 smithi195 ceph-mon[134493]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-10-19T12:39:23.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:22 smithi195 ceph-mon[134493]: osdmap e57: 9 total, 8 up, 9 in 2023-10-19T12:39:23.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:22 smithi195 ceph-mon[134493]: from='osd.8 [v2:172.21.15.195:6816/74230104,v1:172.21.15.195:6817/74230104]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2023-10-19T12:39:23.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:22 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-19T12:39:23.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:22 smithi195 ceph-mon[134493]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2023-10-19T12:39:23.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:22 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:39:23.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:22 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:39:23.133 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:22 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:39:23.133 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:22 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:39:23.133 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:22 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:39:23.133 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:22 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:39:23.133 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:22 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:39:23.134 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:22 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:39:23.134 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:22 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:39:23.134 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:22 smithi195 ceph-mon[134493]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2023-10-19T12:39:23.134 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:22 smithi195 ceph-mon[134493]: osdmap e58: 9 total, 8 up, 9 in 2023-10-19T12:39:23.678 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-19T12:39:23.958 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:23 smithi046 ceph-mon[98509]: Detected new or changed devices on smithi195 2023-10-19T12:39:23.958 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:23 smithi046 ceph-mon[98509]: Adjusting osd_memory_target on smithi195 to 5722M 2023-10-19T12:39:23.958 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:23 smithi046 ceph-mon[98509]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-19T12:39:23.959 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:23 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-19T12:39:23.959 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:23 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-19T12:39:24.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:23 smithi157 ceph-mon[134109]: Detected new or changed devices on smithi195 2023-10-19T12:39:24.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:23 smithi157 ceph-mon[134109]: Adjusting osd_memory_target on smithi195 to 5722M 2023-10-19T12:39:24.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:23 smithi157 ceph-mon[134109]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-19T12:39:24.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:23 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-19T12:39:24.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:23 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-19T12:39:24.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:23 smithi195 ceph-mon[134493]: Detected new or changed devices on smithi195 2023-10-19T12:39:24.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:23 smithi195 ceph-mon[134493]: Adjusting osd_memory_target on smithi195 to 5722M 2023-10-19T12:39:24.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:23 smithi195 ceph-mon[134493]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-19T12:39:24.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:23 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-19T12:39:24.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:23 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-19T12:39:24.960 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:24 smithi046 ceph-mon[98509]: purged_snaps scrub starts 2023-10-19T12:39:24.960 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:24 smithi046 ceph-mon[98509]: purged_snaps scrub ok 2023-10-19T12:39:24.960 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:24 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-19T12:39:24.961 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:24 smithi046 ceph-mon[98509]: osd.8 [v2:172.21.15.195:6816/74230104,v1:172.21.15.195:6817/74230104] boot 2023-10-19T12:39:24.961 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:24 smithi046 ceph-mon[98509]: osdmap e59: 9 total, 9 up, 9 in 2023-10-19T12:39:24.962 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:24 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-19T12:39:25.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:24 smithi157 ceph-mon[134109]: purged_snaps scrub starts 2023-10-19T12:39:25.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:24 smithi157 ceph-mon[134109]: purged_snaps scrub ok 2023-10-19T12:39:25.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:24 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-19T12:39:25.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:24 smithi157 ceph-mon[134109]: osd.8 [v2:172.21.15.195:6816/74230104,v1:172.21.15.195:6817/74230104] boot 2023-10-19T12:39:25.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:24 smithi157 ceph-mon[134109]: osdmap e59: 9 total, 9 up, 9 in 2023-10-19T12:39:25.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:24 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-19T12:39:25.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:24 smithi195 ceph-mon[134493]: purged_snaps scrub starts 2023-10-19T12:39:25.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:24 smithi195 ceph-mon[134493]: purged_snaps scrub ok 2023-10-19T12:39:25.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:24 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-19T12:39:25.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:24 smithi195 ceph-mon[134493]: osd.8 [v2:172.21.15.195:6816/74230104,v1:172.21.15.195:6817/74230104] boot 2023-10-19T12:39:25.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:24 smithi195 ceph-mon[134493]: osdmap e59: 9 total, 9 up, 9 in 2023-10-19T12:39:25.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:24 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-19T12:39:25.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:39:25.169+0000 7f6baebe9700 1 -- 172.21.15.46:0/1580721614 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ba8100660 msgr2=0x7f6ba8100a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:39:25.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:39:25.169+0000 7f6baebe9700 1 --2- 172.21.15.46:0/1580721614 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ba8100660 0x7f6ba8100a80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6ba40099c0 tx=0x7f6ba4009cd0 comp rx=0 tx=0).stop 2023-10-19T12:39:25.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:39:25.169+0000 7f6baebe9700 1 -- 172.21.15.46:0/1580721614 shutdown_connections 2023-10-19T12:39:25.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:39:25.169+0000 7f6baebe9700 1 --2- 172.21.15.46:0/1580721614 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6ba8102200 0x7f6ba8108ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:39:25.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:39:25.169+0000 7f6baebe9700 1 --2- 172.21.15.46:0/1580721614 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ba8100660 0x7f6ba8100a80 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:39:25.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:39:25.169+0000 7f6baebe9700 1 --2- 172.21.15.46:0/1580721614 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6ba8101860 0x7f6ba8101cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:39:25.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:39:25.169+0000 7f6baebe9700 1 -- 172.21.15.46:0/1580721614 >> 172.21.15.46:0/1580721614 conn(0x7f6ba80fbc00 msgr2=0x7f6ba80fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:39:25.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:39:25.169+0000 7f6baebe9700 1 -- 172.21.15.46:0/1580721614 shutdown_connections 2023-10-19T12:39:25.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:39:25.169+0000 7f6baebe9700 1 -- 172.21.15.46:0/1580721614 wait complete. 2023-10-19T12:39:25.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:39:25.170+0000 7f6baebe9700 1 Processor -- start 2023-10-19T12:39:25.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:39:25.170+0000 7f6baebe9700 1 -- start start 2023-10-19T12:39:25.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:39:25.171+0000 7f6baebe9700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6ba8100660 0x7f6ba81987a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:39:25.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:39:25.171+0000 7f6baebe9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ba8101860 0x7f6ba8198ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:39:25.178 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:39:25.171+0000 7f6baebe9700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6ba8102200 0x7f6ba819fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:39:25.178 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:39:25.171+0000 7f6baebe9700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba81a02e0 con 0x7f6ba8101860 2023-10-19T12:39:25.178 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:39:25.171+0000 7f6baebe9700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba81a0420 con 0x7f6ba8100660 2023-10-19T12:39:25.178 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:39:25.171+0000 7f6baebe9700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba81a05b0 con 0x7f6ba8102200 2023-10-19T12:39:25.178 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:39:25.171+0000 7f6bad3e6700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ba8101860 0x7f6ba8198ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:39:25.179 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:39:25.171+0000 7f6bad3e6700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ba8101860 0x7f6ba8198ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59000/0 (socket says 172.21.15.46:59000) 2023-10-19T12:39:25.179 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:39:25.171+0000 7f6bad3e6700 1 -- 172.21.15.46:0/2009856377 learned_addr learned my addr 172.21.15.46:0/2009856377 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:39:25.179 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:39:25.171+0000 7f6badbe7700 1 --2- 172.21.15.46:0/2009856377 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6ba8100660 0x7f6ba81987a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:39:25.179 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:39:25.171+0000 7f6bae3e8700 1 --2- 172.21.15.46:0/2009856377 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6ba8102200 0x7f6ba819fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:39:25.179 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:39:25.171+0000 7f6bad3e6700 1 -- 172.21.15.46:0/2009856377 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6ba8102200 msgr2=0x7f6ba819fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:39:25.180 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:39:25.171+0000 7f6bad3e6700 1 --2- 172.21.15.46:0/2009856377 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6ba8102200 0x7f6ba819fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:39:25.180 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:39:25.171+0000 7f6bad3e6700 1 -- 172.21.15.46:0/2009856377 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6ba8100660 msgr2=0x7f6ba81987a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:39:25.180 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:39:25.171+0000 7f6bad3e6700 1 --2- 172.21.15.46:0/2009856377 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6ba8100660 0x7f6ba81987a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:39:25.180 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:39:25.171+0000 7f6bad3e6700 1 -- 172.21.15.46:0/2009856377 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ba40095f0 con 0x7f6ba8101860 2023-10-19T12:39:25.180 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:39:25.172+0000 7f6bad3e6700 1 --2- 172.21.15.46:0/2009856377 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ba8101860 0x7f6ba8198ce0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6b9800d9b0 tx=0x7f6b9800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:39:25.181 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:39:25.172+0000 7f6b9effd700 1 -- 172.21.15.46:0/2009856377 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b98004220 con 0x7f6ba8101860 2023-10-19T12:39:25.181 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:39:25.172+0000 7f6b9effd700 1 -- 172.21.15.46:0/2009856377 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6b98007640 con 0x7f6ba8101860 2023-10-19T12:39:25.181 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:39:25.172+0000 7f6baebe9700 1 -- 172.21.15.46:0/2009856377 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ba81a0890 con 0x7f6ba8101860 2023-10-19T12:39:25.181 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:39:25.172+0000 7f6b9effd700 1 -- 172.21.15.46:0/2009856377 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b98005590 con 0x7f6ba8101860 2023-10-19T12:39:25.181 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:39:25.172+0000 7f6baebe9700 1 -- 172.21.15.46:0/2009856377 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ba81a0d90 con 0x7f6ba8101860 2023-10-19T12:39:25.182 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:39:25.173+0000 7f6baebe9700 1 -- 172.21.15.46:0/2009856377 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ba804e4c0 con 0x7f6ba8101860 2023-10-19T12:39:25.182 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:39:25.175+0000 7f6b9effd700 1 -- 172.21.15.46:0/2009856377 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f6b98004750 con 0x7f6ba8101860 2023-10-19T12:39:25.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:39:25.177+0000 7f6b9effd700 1 --2- 172.21.15.46:0/2009856377 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f6b940a1480 0x7f6b940a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:39:25.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:39:25.178+0000 7f6b9effd700 1 -- 172.21.15.46:0/2009856377 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5858+0+0 (secure 0 0 0) 0x7f6b980cc700 con 0x7f6ba8101860 2023-10-19T12:39:25.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:39:25.178+0000 7f6badbe7700 1 --2- 172.21.15.46:0/2009856377 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f6b940a1480 0x7f6b940a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:39:25.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:39:25.178+0000 7f6badbe7700 1 --2- 172.21.15.46:0/2009856377 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f6b940a1480 0x7f6b940a3940 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6ba4003730 tx=0x7f6ba4000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:39:25.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:39:25.180+0000 7f6b9effd700 1 -- 172.21.15.46:0/2009856377 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6b98096650 con 0x7f6ba8101860 2023-10-19T12:39:25.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:39:25.401+0000 7f6baebe9700 1 -- 172.21.15.46:0/2009856377 --> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f6ba8108750 con 0x7f6b940a1480 2023-10-19T12:39:25.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:25 smithi046 ceph-mon[98509]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-19T12:39:25.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:25 smithi046 ceph-mon[98509]: osdmap e60: 9 total, 9 up, 9 in 2023-10-19T12:39:25.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:25 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-19T12:39:25.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:25 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-19T12:39:25.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:25 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:39:26.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:25 smithi157 ceph-mon[134109]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-19T12:39:26.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:25 smithi157 ceph-mon[134109]: osdmap e60: 9 total, 9 up, 9 in 2023-10-19T12:39:26.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:25 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-19T12:39:26.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:25 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-19T12:39:26.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:25 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:39:26.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:25 smithi195 ceph-mon[134493]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-19T12:39:26.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:25 smithi195 ceph-mon[134493]: osdmap e60: 9 total, 9 up, 9 in 2023-10-19T12:39:26.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:25 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-19T12:39:26.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:25 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-19T12:39:26.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:25 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:39:26.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:26 smithi046 ceph-mon[98509]: from='client.14478 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-19T12:39:26.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:26 smithi046 ceph-mon[98509]: osdmap e61: 9 total, 9 up, 9 in 2023-10-19T12:39:27.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:26 smithi157 ceph-mon[134109]: from='client.14478 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-19T12:39:27.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:26 smithi157 ceph-mon[134109]: osdmap e61: 9 total, 9 up, 9 in 2023-10-19T12:39:27.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:26 smithi195 ceph-mon[134493]: from='client.14478 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-19T12:39:27.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:26 smithi195 ceph-mon[134493]: osdmap e61: 9 total, 9 up, 9 in 2023-10-19T12:39:27.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:27 smithi046 ceph-mon[98509]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail 2023-10-19T12:39:27.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:27 smithi046 ceph-mon[98509]: osdmap e62: 9 total, 9 up, 9 in 2023-10-19T12:39:28.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:27 smithi157 ceph-mon[134109]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail 2023-10-19T12:39:28.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:27 smithi157 ceph-mon[134109]: osdmap e62: 9 total, 9 up, 9 in 2023-10-19T12:39:28.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:27 smithi195 ceph-mon[134493]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail 2023-10-19T12:39:28.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:27 smithi195 ceph-mon[134493]: osdmap e62: 9 total, 9 up, 9 in 2023-10-19T12:39:29.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:28 smithi157 ceph-mon[134109]: osdmap e63: 9 total, 9 up, 9 in 2023-10-19T12:39:29.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:28 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/1163302834' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3f18f506-a577-4b7c-ae0d-9351c07e81f8"}]: dispatch 2023-10-19T12:39:29.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:28 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/1163302834' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3f18f506-a577-4b7c-ae0d-9351c07e81f8"}]': finished 2023-10-19T12:39:29.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:28 smithi157 ceph-mon[134109]: osdmap e64: 10 total, 9 up, 10 in 2023-10-19T12:39:29.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:28 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-19T12:39:29.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:28 smithi195 ceph-mon[134493]: osdmap e63: 9 total, 9 up, 9 in 2023-10-19T12:39:29.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:28 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/1163302834' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3f18f506-a577-4b7c-ae0d-9351c07e81f8"}]: dispatch 2023-10-19T12:39:29.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:28 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/1163302834' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3f18f506-a577-4b7c-ae0d-9351c07e81f8"}]': finished 2023-10-19T12:39:29.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:28 smithi195 ceph-mon[134493]: osdmap e64: 10 total, 9 up, 10 in 2023-10-19T12:39:29.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:28 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-19T12:39:29.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:28 smithi046 ceph-mon[98509]: osdmap e63: 9 total, 9 up, 9 in 2023-10-19T12:39:29.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:28 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/1163302834' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3f18f506-a577-4b7c-ae0d-9351c07e81f8"}]: dispatch 2023-10-19T12:39:29.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:28 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/1163302834' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3f18f506-a577-4b7c-ae0d-9351c07e81f8"}]': finished 2023-10-19T12:39:29.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:28 smithi046 ceph-mon[98509]: osdmap e64: 10 total, 9 up, 10 in 2023-10-19T12:39:29.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:28 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-19T12:39:30.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:29 smithi157 ceph-mon[134109]: pgmap v205: 1 pgs: 1 peering; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail; 148 KiB/s, 0 objects/s recovering 2023-10-19T12:39:30.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:29 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/1633255570' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-19T12:39:30.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:29 smithi195 ceph-mon[134493]: pgmap v205: 1 pgs: 1 peering; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail; 148 KiB/s, 0 objects/s recovering 2023-10-19T12:39:30.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:29 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/1633255570' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-19T12:39:30.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:29 smithi046 ceph-mon[98509]: pgmap v205: 1 pgs: 1 peering; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail; 148 KiB/s, 0 objects/s recovering 2023-10-19T12:39:30.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:29 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/1633255570' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-19T12:39:32.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:31 smithi157 ceph-mon[134109]: pgmap v206: 1 pgs: 1 peering; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 118 KiB/s, 0 objects/s recovering 2023-10-19T12:39:32.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:31 smithi195 ceph-mon[134493]: pgmap v206: 1 pgs: 1 peering; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 118 KiB/s, 0 objects/s recovering 2023-10-19T12:39:32.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:31 smithi046 ceph-mon[98509]: pgmap v206: 1 pgs: 1 peering; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 118 KiB/s, 0 objects/s recovering 2023-10-19T12:39:34.000 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:33 smithi046 ceph-mon[98509]: pgmap v207: 1 pgs: 1 peering; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-19T12:39:34.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:33 smithi157 ceph-mon[134109]: pgmap v207: 1 pgs: 1 peering; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-19T12:39:34.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:33 smithi195 ceph-mon[134493]: pgmap v207: 1 pgs: 1 peering; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-19T12:39:36.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:35 smithi157 ceph-mon[134109]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 73 KiB/s, 0 objects/s recovering 2023-10-19T12:39:36.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:35 smithi195 ceph-mon[134493]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 73 KiB/s, 0 objects/s recovering 2023-10-19T12:39:36.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:35 smithi046 ceph-mon[98509]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 73 KiB/s, 0 objects/s recovering 2023-10-19T12:39:36.998 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:36 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-10-19T12:39:36.998 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:36 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:39:37.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:36 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-10-19T12:39:37.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:36 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:39:37.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:36 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-10-19T12:39:37.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:36 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:39:38.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:37 smithi157 ceph-mon[134109]: Deploying daemon osd.9 on smithi046 2023-10-19T12:39:38.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:37 smithi157 ceph-mon[134109]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-19T12:39:38.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:37 smithi195 ceph-mon[134493]: Deploying daemon osd.9 on smithi046 2023-10-19T12:39:38.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:37 smithi195 ceph-mon[134493]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-19T12:39:38.189 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:37 smithi046 ceph-mon[98509]: Deploying daemon osd.9 on smithi046 2023-10-19T12:39:38.189 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:37 smithi046 ceph-mon[98509]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-19T12:39:40.022 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:39 smithi046 ceph-mon[98509]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-19T12:39:40.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:39 smithi157 ceph-mon[134109]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-19T12:39:40.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:39 smithi195 ceph-mon[134493]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-19T12:39:41.834 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:41 smithi046 ceph-mon[98509]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-19T12:39:42.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:41 smithi157 ceph-mon[134109]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-19T12:39:42.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:41 smithi195 ceph-mon[134493]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-19T12:39:43.065 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:42 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:39:43.065 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:42 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:39:43.065 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:42 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:39:43.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:42 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:39:43.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:42 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:39:43.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:42 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:39:43.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:42 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:39:43.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:42 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:39:43.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:42 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:39:43.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:43 smithi046 ceph-mon[98509]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-19T12:39:44.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:43 smithi157 ceph-mon[134109]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-19T12:39:44.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:43 smithi195 ceph-mon[134493]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-19T12:39:45.263 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:39:45.258+0000 7f6b9effd700 1 -- 172.21.15.46:0/2009856377 <== mgr.14150 v2:172.21.15.46:6800/3168073651 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f6ba8108750 con 0x7f6b940a1480 2023-10-19T12:39:45.263 INFO:teuthology.orchestra.run.smithi046.stdout:Created osd(s) 9 on host 'smithi046' 2023-10-19T12:39:45.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:39:45.261+0000 7f6baebe9700 1 -- 172.21.15.46:0/2009856377 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f6b940a1480 msgr2=0x7f6b940a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:39:45.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:39:45.261+0000 7f6baebe9700 1 --2- 172.21.15.46:0/2009856377 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f6b940a1480 0x7f6b940a3940 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6ba4003730 tx=0x7f6ba4000bc0 comp rx=0 tx=0).stop 2023-10-19T12:39:45.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:39:45.261+0000 7f6baebe9700 1 -- 172.21.15.46:0/2009856377 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ba8101860 msgr2=0x7f6ba8198ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:39:45.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:39:45.261+0000 7f6baebe9700 1 --2- 172.21.15.46:0/2009856377 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ba8101860 0x7f6ba8198ce0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6b9800d9b0 tx=0x7f6b9800dcc0 comp rx=0 tx=0).stop 2023-10-19T12:39:45.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:39:45.261+0000 7f6baebe9700 1 -- 172.21.15.46:0/2009856377 shutdown_connections 2023-10-19T12:39:45.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:39:45.261+0000 7f6baebe9700 1 --2- 172.21.15.46:0/2009856377 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f6b940a1480 0x7f6b940a3940 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:39:45.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:39:45.261+0000 7f6baebe9700 1 --2- 172.21.15.46:0/2009856377 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6ba8102200 0x7f6ba819fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:39:45.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:39:45.261+0000 7f6baebe9700 1 --2- 172.21.15.46:0/2009856377 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6ba8100660 0x7f6ba81987a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:39:45.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:39:45.261+0000 7f6baebe9700 1 --2- 172.21.15.46:0/2009856377 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ba8101860 0x7f6ba8198ce0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:39:45.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:39:45.261+0000 7f6baebe9700 1 -- 172.21.15.46:0/2009856377 >> 172.21.15.46:0/2009856377 conn(0x7f6ba80fbc00 msgr2=0x7f6ba8107030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:39:45.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:39:45.262+0000 7f6baebe9700 1 -- 172.21.15.46:0/2009856377 shutdown_connections 2023-10-19T12:39:45.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:39:45.262+0000 7f6baebe9700 1 -- 172.21.15.46:0/2009856377 wait complete. 2023-10-19T12:39:45.818 DEBUG:teuthology.orchestra.run.smithi046:osd.9> sudo journalctl -f -n 0 -u ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@osd.9.service 2023-10-19T12:39:45.823 INFO:tasks.cephadm:Deploying osd.10 on smithi157 with /dev/vg_nvme/lv_1... 2023-10-19T12:39:45.823 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-10-19T12:39:45.911 INFO:journalctl@ceph.osd.9.smithi046.stdout:-- Logs begin at Thu 2023-10-19 12:15:13 UTC. -- 2023-10-19T12:39:46.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:45 smithi157 ceph-mon[134109]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-19T12:39:46.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:45 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:39:46.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:45 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:39:46.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:45 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:39:46.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:45 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:39:46.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:45 smithi195 ceph-mon[134493]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-19T12:39:46.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:45 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:39:46.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:45 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:39:46.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:45 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:39:46.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:45 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:39:46.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:45 smithi046 ceph-mon[98509]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-19T12:39:46.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:45 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:39:46.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:45 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:39:46.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:45 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:39:46.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:45 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:39:46.394 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.b/config 2023-10-19T12:39:46.941 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:46 smithi157 ceph-mon[134109]: from='osd.9 [v2:172.21.15.46:6826/3472581046,v1:172.21.15.46:6827/3472581046]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-10-19T12:39:46.941 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:46 smithi157 ceph-mon[134109]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-10-19T12:39:46.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:46 smithi046 ceph-mon[98509]: from='osd.9 [v2:172.21.15.46:6826/3472581046,v1:172.21.15.46:6827/3472581046]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-10-19T12:39:46.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:46 smithi046 ceph-mon[98509]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-10-19T12:39:47.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:46 smithi195 ceph-mon[134493]: from='osd.9 [v2:172.21.15.46:6826/3472581046,v1:172.21.15.46:6827/3472581046]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-10-19T12:39:47.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:46 smithi195 ceph-mon[134493]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-10-19T12:39:47.884 INFO:teuthology.orchestra.run.smithi157.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-10-19T12:39:47.884 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-10-19T12:39:47.884 INFO:teuthology.orchestra.run.smithi157.stderr: stderr: 10+0 records in 2023-10-19T12:39:47.885 INFO:teuthology.orchestra.run.smithi157.stderr:10+0 records out 2023-10-19T12:39:47.885 INFO:teuthology.orchestra.run.smithi157.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00819845 s, 1.3 GB/s 2023-10-19T12:39:47.885 INFO:teuthology.orchestra.run.smithi157.stderr: stderr: 2023-10-19T12:39:47.885 INFO:teuthology.orchestra.run.smithi157.stderr:--> Zapping successful for: 2023-10-19T12:39:47.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:47 smithi046 ceph-mon[98509]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-19T12:39:47.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:47 smithi046 ceph-mon[98509]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-10-19T12:39:47.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:47 smithi046 ceph-mon[98509]: osdmap e65: 10 total, 9 up, 10 in 2023-10-19T12:39:47.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:47 smithi046 ceph-mon[98509]: from='osd.9 [v2:172.21.15.46:6826/3472581046,v1:172.21.15.46:6827/3472581046]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2023-10-19T12:39:47.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:47 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-19T12:39:47.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:47 smithi046 ceph-mon[98509]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2023-10-19T12:39:47.981 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 12:39:47 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T12:39:47.780+0000 7fc9a58a9700 -1 osd.9 0 waiting for initial osdmap 2023-10-19T12:39:47.981 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 12:39:47 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T12:39:47.802+0000 7fc99f69a700 -1 osd.9 66 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-19T12:39:48.074 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:47 smithi157 ceph-mon[134109]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-19T12:39:48.074 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:47 smithi157 ceph-mon[134109]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-10-19T12:39:48.075 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:47 smithi157 ceph-mon[134109]: osdmap e65: 10 total, 9 up, 10 in 2023-10-19T12:39:48.075 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:47 smithi157 ceph-mon[134109]: from='osd.9 [v2:172.21.15.46:6826/3472581046,v1:172.21.15.46:6827/3472581046]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2023-10-19T12:39:48.075 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:47 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-19T12:39:48.075 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:47 smithi157 ceph-mon[134109]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2023-10-19T12:39:48.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:47 smithi195 ceph-mon[134493]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-19T12:39:48.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:47 smithi195 ceph-mon[134493]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-10-19T12:39:48.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:47 smithi195 ceph-mon[134493]: osdmap e65: 10 total, 9 up, 10 in 2023-10-19T12:39:48.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:47 smithi195 ceph-mon[134493]: from='osd.9 [v2:172.21.15.46:6826/3472581046,v1:172.21.15.46:6827/3472581046]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2023-10-19T12:39:48.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:47 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-19T12:39:48.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:47 smithi195 ceph-mon[134493]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2023-10-19T12:39:48.350 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph orch daemon add osd smithi157:vg_nvme/lv_1 2023-10-19T12:39:48.910 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.b/config 2023-10-19T12:39:49.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:48 smithi157 ceph-mon[134109]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]': finished 2023-10-19T12:39:49.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:48 smithi157 ceph-mon[134109]: osdmap e66: 10 total, 9 up, 10 in 2023-10-19T12:39:49.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:48 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-19T12:39:49.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:48 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-19T12:39:49.113 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:48 smithi046 ceph-mon[98509]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]': finished 2023-10-19T12:39:49.113 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:48 smithi046 ceph-mon[98509]: osdmap e66: 10 total, 9 up, 10 in 2023-10-19T12:39:49.114 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:48 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-19T12:39:49.114 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:48 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-19T12:39:49.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:48 smithi195 ceph-mon[134493]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]': finished 2023-10-19T12:39:49.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:48 smithi195 ceph-mon[134493]: osdmap e66: 10 total, 9 up, 10 in 2023-10-19T12:39:49.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:48 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-19T12:39:49.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:48 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-19T12:39:49.953 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:49 smithi157 ceph-mon[134109]: purged_snaps scrub starts 2023-10-19T12:39:49.953 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:49 smithi157 ceph-mon[134109]: purged_snaps scrub ok 2023-10-19T12:39:49.953 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:49 smithi157 ceph-mon[134109]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-19T12:39:49.953 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:49 smithi157 ceph-mon[134109]: osd.9 [v2:172.21.15.46:6826/3472581046,v1:172.21.15.46:6827/3472581046] boot 2023-10-19T12:39:49.954 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:49 smithi157 ceph-mon[134109]: osdmap e67: 10 total, 10 up, 10 in 2023-10-19T12:39:49.954 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:49 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-19T12:39:49.954 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:49 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:39:49.955 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:49 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:39:49.955 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:49 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:39:49.955 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:49 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:39:49.955 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:49 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:39:49.955 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:49 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:39:49.956 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:49 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:39:49.956 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:49 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:39:49.956 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:49 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:39:49.956 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:49 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:39:49.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:49 smithi046 ceph-mon[98509]: purged_snaps scrub starts 2023-10-19T12:39:49.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:49 smithi046 ceph-mon[98509]: purged_snaps scrub ok 2023-10-19T12:39:49.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:49 smithi046 ceph-mon[98509]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-19T12:39:49.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:49 smithi046 ceph-mon[98509]: osd.9 [v2:172.21.15.46:6826/3472581046,v1:172.21.15.46:6827/3472581046] boot 2023-10-19T12:39:49.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:49 smithi046 ceph-mon[98509]: osdmap e67: 10 total, 10 up, 10 in 2023-10-19T12:39:49.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:49 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-19T12:39:49.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:49 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:39:49.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:49 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:39:49.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:49 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:39:49.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:49 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:39:49.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:49 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:39:49.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:49 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:39:49.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:49 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:39:49.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:49 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:39:49.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:49 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:39:49.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:49 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:39:50.095 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:39:50.092+0000 7fe1e2de7700 1 -- 172.21.15.157:0/3702284321 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe1dc0ff730 msgr2=0x7fe1dc0ffb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:39:50.095 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:39:50.092+0000 7fe1e2de7700 1 --2- 172.21.15.157:0/3702284321 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe1dc0ff730 0x7fe1dc0ffb50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe1d00099c0 tx=0x7fe1d0009cd0 comp rx=0 tx=0).stop 2023-10-19T12:39:50.096 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:39:50.092+0000 7fe1e2de7700 1 -- 172.21.15.157:0/3702284321 shutdown_connections 2023-10-19T12:39:50.096 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:39:50.092+0000 7fe1e2de7700 1 --2- 172.21.15.157:0/3702284321 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe1dc1012d0 0x7fe1dc107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:39:50.096 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:39:50.092+0000 7fe1e2de7700 1 --2- 172.21.15.157:0/3702284321 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe1dc0ff730 0x7fe1dc0ffb50 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:39:50.096 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:39:50.092+0000 7fe1e2de7700 1 --2- 172.21.15.157:0/3702284321 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe1dc100930 0x7fe1dc100d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:39:50.097 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:39:50.092+0000 7fe1e2de7700 1 -- 172.21.15.157:0/3702284321 >> 172.21.15.157:0/3702284321 conn(0x7fe1dc0facf0 msgr2=0x7fe1dc0fd110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:39:50.097 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:39:50.092+0000 7fe1e2de7700 1 -- 172.21.15.157:0/3702284321 shutdown_connections 2023-10-19T12:39:50.097 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:39:50.092+0000 7fe1e2de7700 1 -- 172.21.15.157:0/3702284321 wait complete. 2023-10-19T12:39:50.099 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:39:50.093+0000 7fe1e2de7700 1 Processor -- start 2023-10-19T12:39:50.099 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:39:50.093+0000 7fe1e2de7700 1 -- start start 2023-10-19T12:39:50.100 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:39:50.093+0000 7fe1e2de7700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe1dc0ff730 0x7fe1dc195680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:39:50.100 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:39:50.093+0000 7fe1e2de7700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe1dc100930 0x7fe1dc195bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:39:50.100 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:39:50.093+0000 7fe1e2de7700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe1dc1012d0 0x7fe1dc19cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:39:50.100 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:39:50.093+0000 7fe1e2de7700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1dc19d1c0 con 0x7fe1dc100930 2023-10-19T12:39:50.100 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:39:50.093+0000 7fe1e2de7700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1dc19d300 con 0x7fe1dc0ff730 2023-10-19T12:39:50.101 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:39:50.093+0000 7fe1e2de7700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1dc19d490 con 0x7fe1dc1012d0 2023-10-19T12:39:50.101 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:39:50.093+0000 7fe1e0b83700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe1dc0ff730 0x7fe1dc195680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:39:50.101 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:39:50.093+0000 7fe1e0b83700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe1dc0ff730 0x7fe1dc195680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:58860/0 (socket says 172.21.15.157:58860) 2023-10-19T12:39:50.101 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:39:50.093+0000 7fe1e0b83700 1 -- 172.21.15.157:0/2046807706 learned_addr learned my addr 172.21.15.157:0/2046807706 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-19T12:39:50.101 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:39:50.094+0000 7fe1e0b83700 1 -- 172.21.15.157:0/2046807706 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe1dc1012d0 msgr2=0x7fe1dc19cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:39:50.101 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:39:50.094+0000 7fe1e0b83700 1 --2- 172.21.15.157:0/2046807706 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe1dc1012d0 0x7fe1dc19cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:39:50.102 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:39:50.094+0000 7fe1e0b83700 1 -- 172.21.15.157:0/2046807706 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe1dc100930 msgr2=0x7fe1dc195bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:39:50.102 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:39:50.094+0000 7fe1e0b83700 1 --2- 172.21.15.157:0/2046807706 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe1dc100930 0x7fe1dc195bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:39:50.102 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:39:50.094+0000 7fe1e0b83700 1 -- 172.21.15.157:0/2046807706 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1d00095f0 con 0x7fe1dc0ff730 2023-10-19T12:39:50.102 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:39:50.094+0000 7fe1e0b83700 1 --2- 172.21.15.157:0/2046807706 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe1dc0ff730 0x7fe1dc195680 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe1d0003820 tx=0x7fe1d0005ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:39:50.103 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:39:50.094+0000 7fe1d9ffb700 1 -- 172.21.15.157:0/2046807706 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d001d070 con 0x7fe1dc0ff730 2023-10-19T12:39:50.103 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:39:50.094+0000 7fe1e2de7700 1 -- 172.21.15.157:0/2046807706 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1dc19d710 con 0x7fe1dc0ff730 2023-10-19T12:39:50.103 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:39:50.094+0000 7fe1d9ffb700 1 -- 172.21.15.157:0/2046807706 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe1d0004110 con 0x7fe1dc0ff730 2023-10-19T12:39:50.103 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:39:50.094+0000 7fe1d9ffb700 1 -- 172.21.15.157:0/2046807706 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d0022e20 con 0x7fe1dc0ff730 2023-10-19T12:39:50.103 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:39:50.094+0000 7fe1e2de7700 1 -- 172.21.15.157:0/2046807706 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1dc19dc00 con 0x7fe1dc0ff730 2023-10-19T12:39:50.104 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:39:50.096+0000 7fe1e2de7700 1 -- 172.21.15.157:0/2046807706 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1dc106c00 con 0x7fe1dc0ff730 2023-10-19T12:39:50.104 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:39:50.096+0000 7fe1d9ffb700 1 -- 172.21.15.157:0/2046807706 <== mon.2 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fe1d0022470 con 0x7fe1dc0ff730 2023-10-19T12:39:50.104 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:39:50.097+0000 7fe1d9ffb700 1 --2- 172.21.15.157:0/2046807706 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fe1cc0a1480 0x7fe1cc0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:39:50.104 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:39:50.097+0000 7fe1d9ffb700 1 -- 172.21.15.157:0/2046807706 <== mon.2 v2:172.21.15.157:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6261+0+0 (secure 0 0 0) 0x7fe1d00cd7f0 con 0x7fe1dc0ff730 2023-10-19T12:39:50.105 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:39:50.097+0000 7fe1dbfff700 1 --2- 172.21.15.157:0/2046807706 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fe1cc0a1480 0x7fe1cc0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:39:50.105 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:39:50.098+0000 7fe1dbfff700 1 --2- 172.21.15.157:0/2046807706 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fe1cc0a1480 0x7fe1cc0a3940 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe1c8005d90 tx=0x7fe1c8005d00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:39:50.106 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:39:50.101+0000 7fe1d9ffb700 1 -- 172.21.15.157:0/2046807706 <== mon.2 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fe1d00976e0 con 0x7fe1dc0ff730 2023-10-19T12:39:50.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:49 smithi195 ceph-mon[134493]: purged_snaps scrub starts 2023-10-19T12:39:50.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:49 smithi195 ceph-mon[134493]: purged_snaps scrub ok 2023-10-19T12:39:50.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:49 smithi195 ceph-mon[134493]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-19T12:39:50.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:49 smithi195 ceph-mon[134493]: osd.9 [v2:172.21.15.46:6826/3472581046,v1:172.21.15.46:6827/3472581046] boot 2023-10-19T12:39:50.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:49 smithi195 ceph-mon[134493]: osdmap e67: 10 total, 10 up, 10 in 2023-10-19T12:39:50.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:49 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-19T12:39:50.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:49 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:39:50.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:49 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:39:50.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:49 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:39:50.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:49 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:39:50.133 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:49 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:39:50.133 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:49 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:39:50.133 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:49 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:39:50.133 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:49 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:39:50.133 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:49 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:39:50.134 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:49 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:39:50.306 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:39:50.304+0000 7fe1e2de7700 1 -- 172.21.15.157:0/2046807706 --> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7fe1dc060c30 con 0x7fe1cc0a1480 2023-10-19T12:39:51.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:50 smithi157 ceph-mon[134109]: Detected new or changed devices on smithi046 2023-10-19T12:39:51.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:50 smithi157 ceph-mon[134109]: Adjusting osd_memory_target on smithi046 to 4319M 2023-10-19T12:39:51.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:50 smithi157 ceph-mon[134109]: osdmap e68: 10 total, 10 up, 10 in 2023-10-19T12:39:51.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:50 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:39:51.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:50 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:39:51.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:50 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:39:51.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:50 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:39:51.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:50 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-19T12:39:51.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:50 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-19T12:39:51.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:50 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:39:51.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:50 smithi195 ceph-mon[134493]: Detected new or changed devices on smithi046 2023-10-19T12:39:51.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:50 smithi195 ceph-mon[134493]: Adjusting osd_memory_target on smithi046 to 4319M 2023-10-19T12:39:51.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:50 smithi195 ceph-mon[134493]: osdmap e68: 10 total, 10 up, 10 in 2023-10-19T12:39:51.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:50 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:39:51.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:50 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:39:51.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:50 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:39:51.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:50 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:39:51.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:50 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-19T12:39:51.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:50 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-19T12:39:51.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:50 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:39:51.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:50 smithi046 ceph-mon[98509]: Detected new or changed devices on smithi046 2023-10-19T12:39:51.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:50 smithi046 ceph-mon[98509]: Adjusting osd_memory_target on smithi046 to 4319M 2023-10-19T12:39:51.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:50 smithi046 ceph-mon[98509]: osdmap e68: 10 total, 10 up, 10 in 2023-10-19T12:39:51.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:50 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:39:51.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:50 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:39:51.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:50 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:39:51.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:50 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:39:51.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:50 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-19T12:39:51.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:50 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-19T12:39:51.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:50 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:39:52.037 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:51 smithi157 ceph-mon[134109]: from='client.24482 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-19T12:39:52.037 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:51 smithi157 ceph-mon[134109]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-19T12:39:52.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:51 smithi195 ceph-mon[134493]: from='client.24482 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-19T12:39:52.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:51 smithi195 ceph-mon[134493]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-19T12:39:52.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:51 smithi046 ceph-mon[98509]: from='client.24482 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-19T12:39:52.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:51 smithi046 ceph-mon[98509]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-19T12:39:53.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:53 smithi046 ceph-mon[98509]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-19T12:39:53.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:53 smithi046 ceph-mon[98509]: from='client.? 172.21.15.157:0/1182993242' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1ed01854-443a-4acf-9293-7ca0d451a93d"}]: dispatch 2023-10-19T12:39:53.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:53 smithi046 ceph-mon[98509]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1ed01854-443a-4acf-9293-7ca0d451a93d"}]: dispatch 2023-10-19T12:39:53.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:53 smithi046 ceph-mon[98509]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1ed01854-443a-4acf-9293-7ca0d451a93d"}]': finished 2023-10-19T12:39:53.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:53 smithi046 ceph-mon[98509]: osdmap e69: 11 total, 10 up, 11 in 2023-10-19T12:39:53.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:53 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-19T12:39:53.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:53 smithi046 ceph-mon[98509]: from='client.? 172.21.15.157:0/2434428869' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-19T12:39:54.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:53 smithi157 ceph-mon[134109]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-19T12:39:54.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:53 smithi157 ceph-mon[134109]: from='client.? 172.21.15.157:0/1182993242' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1ed01854-443a-4acf-9293-7ca0d451a93d"}]: dispatch 2023-10-19T12:39:54.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:53 smithi157 ceph-mon[134109]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1ed01854-443a-4acf-9293-7ca0d451a93d"}]: dispatch 2023-10-19T12:39:54.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:53 smithi157 ceph-mon[134109]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1ed01854-443a-4acf-9293-7ca0d451a93d"}]': finished 2023-10-19T12:39:54.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:53 smithi157 ceph-mon[134109]: osdmap e69: 11 total, 10 up, 11 in 2023-10-19T12:39:54.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:53 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-19T12:39:54.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:53 smithi157 ceph-mon[134109]: from='client.? 172.21.15.157:0/2434428869' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-19T12:39:54.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:53 smithi195 ceph-mon[134493]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-19T12:39:54.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:53 smithi195 ceph-mon[134493]: from='client.? 172.21.15.157:0/1182993242' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1ed01854-443a-4acf-9293-7ca0d451a93d"}]: dispatch 2023-10-19T12:39:54.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:53 smithi195 ceph-mon[134493]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1ed01854-443a-4acf-9293-7ca0d451a93d"}]: dispatch 2023-10-19T12:39:54.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:53 smithi195 ceph-mon[134493]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1ed01854-443a-4acf-9293-7ca0d451a93d"}]': finished 2023-10-19T12:39:54.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:53 smithi195 ceph-mon[134493]: osdmap e69: 11 total, 10 up, 11 in 2023-10-19T12:39:54.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:53 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-19T12:39:54.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:53 smithi195 ceph-mon[134493]: from='client.? 172.21.15.157:0/2434428869' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-19T12:39:55.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:55 smithi046 ceph-mon[98509]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-19T12:39:56.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:55 smithi157 ceph-mon[134109]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-19T12:39:56.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:55 smithi195 ceph-mon[134493]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-19T12:39:57.972 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:57 smithi157 ceph-mon[134109]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-19T12:39:57.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:57 smithi046 ceph-mon[98509]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-19T12:39:58.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:57 smithi195 ceph-mon[134493]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-19T12:39:59.936 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:59 smithi157 ceph-mon[134109]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-19T12:39:59.936 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:59 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-10-19T12:39:59.936 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:39:59 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:39:59.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:59 smithi046 ceph-mon[98509]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-19T12:39:59.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:59 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-10-19T12:39:59.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:39:59 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:40:00.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:59 smithi195 ceph-mon[134493]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-19T12:40:00.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:59 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-10-19T12:40:00.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:39:59 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:40:00.794 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:00 smithi157 ceph-mon[134109]: Deploying daemon osd.10 on smithi157 2023-10-19T12:40:00.797 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:00 smithi157 ceph-mon[134109]: overall HEALTH_OK 2023-10-19T12:40:00.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:00 smithi046 ceph-mon[98509]: Deploying daemon osd.10 on smithi157 2023-10-19T12:40:00.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:00 smithi046 ceph-mon[98509]: overall HEALTH_OK 2023-10-19T12:40:01.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:00 smithi195 ceph-mon[134493]: Deploying daemon osd.10 on smithi157 2023-10-19T12:40:01.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:00 smithi195 ceph-mon[134493]: overall HEALTH_OK 2023-10-19T12:40:01.830 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:01 smithi157 ceph-mon[134109]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-19T12:40:01.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:01 smithi046 ceph-mon[98509]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-19T12:40:02.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:01 smithi195 ceph-mon[134493]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-19T12:40:03.793 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:03 smithi157 ceph-mon[134109]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-19T12:40:03.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:03 smithi046 ceph-mon[98509]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-19T12:40:04.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:03 smithi195 ceph-mon[134493]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-19T12:40:05.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:04 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:05.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:04 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:05.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:04 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:40:05.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:04 smithi157 ceph-mon[134109]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-19T12:40:05.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:04 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:05.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:04 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:05.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:04 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:40:05.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:04 smithi195 ceph-mon[134493]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-19T12:40:05.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:04 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:05.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:04 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:05.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:04 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:40:05.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:04 smithi046 ceph-mon[98509]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-19T12:40:06.577 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:40:06.573+0000 7fe1d9ffb700 1 -- 172.21.15.157:0/2046807706 <== mgr.14150 v2:172.21.15.46:6800/3168073651 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7fe1dc060c30 con 0x7fe1cc0a1480 2023-10-19T12:40:06.577 INFO:teuthology.orchestra.run.smithi157.stdout:Created osd(s) 10 on host 'smithi157' 2023-10-19T12:40:06.579 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:40:06.575+0000 7fe1e2de7700 1 -- 172.21.15.157:0/2046807706 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fe1cc0a1480 msgr2=0x7fe1cc0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:40:06.579 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:40:06.575+0000 7fe1e2de7700 1 --2- 172.21.15.157:0/2046807706 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fe1cc0a1480 0x7fe1cc0a3940 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe1c8005d90 tx=0x7fe1c8005d00 comp rx=0 tx=0).stop 2023-10-19T12:40:06.579 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:40:06.575+0000 7fe1e2de7700 1 -- 172.21.15.157:0/2046807706 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe1dc0ff730 msgr2=0x7fe1dc195680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:40:06.579 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:40:06.575+0000 7fe1e2de7700 1 --2- 172.21.15.157:0/2046807706 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe1dc0ff730 0x7fe1dc195680 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe1d0003820 tx=0x7fe1d0005ad0 comp rx=0 tx=0).stop 2023-10-19T12:40:06.579 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:40:06.575+0000 7fe1e2de7700 1 -- 172.21.15.157:0/2046807706 shutdown_connections 2023-10-19T12:40:06.580 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:40:06.575+0000 7fe1e2de7700 1 --2- 172.21.15.157:0/2046807706 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fe1cc0a1480 0x7fe1cc0a3940 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:06.580 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:40:06.575+0000 7fe1e2de7700 1 --2- 172.21.15.157:0/2046807706 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe1dc1012d0 0x7fe1dc19cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:06.580 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:40:06.575+0000 7fe1e2de7700 1 --2- 172.21.15.157:0/2046807706 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe1dc0ff730 0x7fe1dc195680 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:06.580 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:40:06.575+0000 7fe1e2de7700 1 --2- 172.21.15.157:0/2046807706 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe1dc100930 0x7fe1dc195bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:06.580 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:40:06.575+0000 7fe1e2de7700 1 -- 172.21.15.157:0/2046807706 >> 172.21.15.157:0/2046807706 conn(0x7fe1dc0facf0 msgr2=0x7fe1dc103d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:40:06.581 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:40:06.575+0000 7fe1e2de7700 1 -- 172.21.15.157:0/2046807706 shutdown_connections 2023-10-19T12:40:06.581 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-19T12:40:06.575+0000 7fe1e2de7700 1 -- 172.21.15.157:0/2046807706 wait complete. 2023-10-19T12:40:07.011 DEBUG:teuthology.orchestra.run.smithi157:osd.10> sudo journalctl -f -n 0 -u ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@osd.10.service 2023-10-19T12:40:07.014 INFO:tasks.cephadm:Deploying osd.11 on smithi195 with /dev/vg_nvme/lv_1... 2023-10-19T12:40:07.014 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-10-19T12:40:07.052 INFO:journalctl@ceph.osd.10.smithi157.stdout:-- Logs begin at Thu 2023-10-19 12:11:40 UTC. -- 2023-10-19T12:40:07.586 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.c/config 2023-10-19T12:40:07.780 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:07 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:07.780 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:07 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:07.780 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:07 smithi195 ceph-mon[134493]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-19T12:40:07.781 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:07 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:07.781 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:07 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:07.783 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:07 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:07.783 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:07 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:07.783 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:07 smithi157 ceph-mon[134109]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-19T12:40:07.783 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:07 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:07.784 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:07 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:07.784 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 12:40:07 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T12:40:07.778+0000 7fae3a426640 -1 osd.10 0 log_to_monitors true 2023-10-19T12:40:07.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:07 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:07.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:07 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:07.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:07 smithi046 ceph-mon[98509]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-19T12:40:07.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:07 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:07.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:07 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:08.838 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:08 smithi157 ceph-mon[134109]: from='osd.10 [v2:172.21.15.157:6824/2378416559,v1:172.21.15.157:6825/2378416559]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-10-19T12:40:08.838 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:08 smithi157 ceph-mon[134109]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-10-19T12:40:08.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:08 smithi195 ceph-mon[134493]: from='osd.10 [v2:172.21.15.157:6824/2378416559,v1:172.21.15.157:6825/2378416559]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-10-19T12:40:08.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:08 smithi195 ceph-mon[134493]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-10-19T12:40:08.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:08 smithi046 ceph-mon[98509]: from='osd.10 [v2:172.21.15.157:6824/2378416559,v1:172.21.15.157:6825/2378416559]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-10-19T12:40:08.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:08 smithi046 ceph-mon[98509]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-10-19T12:40:09.032 INFO:teuthology.orchestra.run.smithi195.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-10-19T12:40:09.032 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-10-19T12:40:09.032 INFO:teuthology.orchestra.run.smithi195.stderr: stderr: 10+0 records in 2023-10-19T12:40:09.033 INFO:teuthology.orchestra.run.smithi195.stderr:10+0 records out 2023-10-19T12:40:09.033 INFO:teuthology.orchestra.run.smithi195.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00817622 s, 1.3 GB/s 2023-10-19T12:40:09.033 INFO:teuthology.orchestra.run.smithi195.stderr:--> Zapping successful for: 2023-10-19T12:40:09.427 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph orch daemon add osd smithi195:vg_nvme/lv_1 2023-10-19T12:40:09.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:09 smithi046 ceph-mon[98509]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-19T12:40:09.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:09 smithi046 ceph-mon[98509]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-10-19T12:40:09.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:09 smithi046 ceph-mon[98509]: osdmap e70: 11 total, 10 up, 11 in 2023-10-19T12:40:09.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:09 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-19T12:40:09.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:09 smithi046 ceph-mon[98509]: from='osd.10 [v2:172.21.15.157:6824/2378416559,v1:172.21.15.157:6825/2378416559]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2023-10-19T12:40:09.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:09 smithi046 ceph-mon[98509]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2023-10-19T12:40:09.987 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.c/config 2023-10-19T12:40:10.087 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 12:40:09 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T12:40:09.685+0000 7fae2fa9d700 -1 osd.10 0 waiting for initial osdmap 2023-10-19T12:40:10.088 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 12:40:09 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T12:40:09.698+0000 7fae2788a700 -1 osd.10 71 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-19T12:40:10.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:09 smithi157 ceph-mon[134109]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-19T12:40:10.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:09 smithi157 ceph-mon[134109]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-10-19T12:40:10.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:09 smithi157 ceph-mon[134109]: osdmap e70: 11 total, 10 up, 11 in 2023-10-19T12:40:10.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:09 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-19T12:40:10.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:09 smithi157 ceph-mon[134109]: from='osd.10 [v2:172.21.15.157:6824/2378416559,v1:172.21.15.157:6825/2378416559]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2023-10-19T12:40:10.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:09 smithi157 ceph-mon[134109]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2023-10-19T12:40:10.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:09 smithi195 ceph-mon[134493]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-19T12:40:10.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:09 smithi195 ceph-mon[134493]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-10-19T12:40:10.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:09 smithi195 ceph-mon[134493]: osdmap e70: 11 total, 10 up, 11 in 2023-10-19T12:40:10.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:09 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-19T12:40:10.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:09 smithi195 ceph-mon[134493]: from='osd.10 [v2:172.21.15.157:6824/2378416559,v1:172.21.15.157:6825/2378416559]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2023-10-19T12:40:10.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:09 smithi195 ceph-mon[134493]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2023-10-19T12:40:10.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:10 smithi195 ceph-mon[134493]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]': finished 2023-10-19T12:40:10.882 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:10 smithi195 ceph-mon[134493]: osdmap e71: 11 total, 10 up, 11 in 2023-10-19T12:40:10.882 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:10 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-19T12:40:10.882 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:10 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-19T12:40:10.882 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:10 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:10.883 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:10 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:10.883 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:10 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:40:10.883 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:10 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:40:10.883 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:10 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:40:10.883 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:10 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:40:10.884 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:10 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:10.884 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:10 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:40:10.884 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:10 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:40:10.884 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:10 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:10.884 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:10 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:40:10.885 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:10 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:40:10.885 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:10 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:40:10.885 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:10 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:10.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:10 smithi046 ceph-mon[98509]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]': finished 2023-10-19T12:40:10.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:10 smithi046 ceph-mon[98509]: osdmap e71: 11 total, 10 up, 11 in 2023-10-19T12:40:10.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:10 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-19T12:40:10.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:10 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-19T12:40:10.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:10 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:10.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:10 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:10.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:10 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:40:10.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:10 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:40:10.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:10 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:40:10.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:10 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:40:10.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:10 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:10.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:10 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:40:10.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:10 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:40:10.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:10 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:10.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:10 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:40:10.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:10 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:40:10.983 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:10 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:40:10.983 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:10 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:11.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:10 smithi157 ceph-mon[134109]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]': finished 2023-10-19T12:40:11.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:10 smithi157 ceph-mon[134109]: osdmap e71: 11 total, 10 up, 11 in 2023-10-19T12:40:11.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:10 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-19T12:40:11.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:10 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-19T12:40:11.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:10 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:11.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:10 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:11.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:10 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:40:11.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:10 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:40:11.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:10 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:40:11.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:10 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:40:11.090 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:10 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:11.090 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:10 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:40:11.090 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:10 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:40:11.090 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:10 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:11.090 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:10 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:40:11.091 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:10 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:40:11.091 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:10 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:40:11.091 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:10 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:11.121 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:11.117+0000 7f99749f4700 1 -- 172.21.15.195:0/2823975169 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99701012d0 msgr2=0x7f9970107b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:40:11.121 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:11.117+0000 7f99749f4700 1 --2- 172.21.15.195:0/2823975169 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99701012d0 0x7f9970107b80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f996800b0a0 tx=0x7f996800b3b0 comp rx=0 tx=0).stop 2023-10-19T12:40:11.121 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:11.117+0000 7f99749f4700 1 -- 172.21.15.195:0/2823975169 shutdown_connections 2023-10-19T12:40:11.122 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:11.117+0000 7f99749f4700 1 --2- 172.21.15.195:0/2823975169 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99701012d0 0x7f9970107b80 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:11.122 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:11.117+0000 7f99749f4700 1 --2- 172.21.15.195:0/2823975169 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f99700ff730 0x7f99700ffb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:11.122 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:11.117+0000 7f99749f4700 1 --2- 172.21.15.195:0/2823975169 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9970100930 0x7f9970100d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:11.122 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:11.117+0000 7f99749f4700 1 -- 172.21.15.195:0/2823975169 >> 172.21.15.195:0/2823975169 conn(0x7f99700facf0 msgr2=0x7f99700fd110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:40:11.122 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:11.117+0000 7f99749f4700 1 -- 172.21.15.195:0/2823975169 shutdown_connections 2023-10-19T12:40:11.123 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:11.117+0000 7f99749f4700 1 -- 172.21.15.195:0/2823975169 wait complete. 2023-10-19T12:40:11.125 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:11.118+0000 7f99749f4700 1 Processor -- start 2023-10-19T12:40:11.125 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:11.118+0000 7f99749f4700 1 -- start start 2023-10-19T12:40:11.125 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:11.118+0000 7f99749f4700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f99700ff730 0x7f9970068cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:40:11.126 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:11.118+0000 7f99749f4700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9970100930 0x7f997019b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:40:11.126 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:11.118+0000 7f99749f4700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99701012d0 0x7f997019dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:40:11.126 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:11.118+0000 7f99749f4700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f997019e440 con 0x7f9970100930 2023-10-19T12:40:11.126 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:11.118+0000 7f99749f4700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f997019e5b0 con 0x7f99700ff730 2023-10-19T12:40:11.127 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:11.118+0000 7f99749f4700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f997019e770 con 0x7f99701012d0 2023-10-19T12:40:11.127 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:11.118+0000 7f996ed9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99701012d0 0x7f997019dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:40:11.127 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:11.118+0000 7f996ed9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99701012d0 0x7f997019dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:48906/0 (socket says 172.21.15.195:48906) 2023-10-19T12:40:11.127 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:11.118+0000 7f996ed9d700 1 -- 172.21.15.195:0/378391877 learned_addr learned my addr 172.21.15.195:0/378391877 (peer_addr_for_me v2:172.21.15.195:0/0) 2023-10-19T12:40:11.127 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:11.118+0000 7f996e59c700 1 --2- 172.21.15.195:0/378391877 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f99700ff730 0x7f9970068cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:40:11.128 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:11.118+0000 7f996dd9b700 1 --2- 172.21.15.195:0/378391877 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9970100930 0x7f997019b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:40:11.128 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:11.118+0000 7f996ed9d700 1 -- 172.21.15.195:0/378391877 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f99700ff730 msgr2=0x7f9970068cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:40:11.128 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:11.118+0000 7f996ed9d700 1 --2- 172.21.15.195:0/378391877 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f99700ff730 0x7f9970068cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:11.128 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:11.118+0000 7f996ed9d700 1 -- 172.21.15.195:0/378391877 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9970100930 msgr2=0x7f997019b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:40:11.128 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:11.118+0000 7f996ed9d700 1 --2- 172.21.15.195:0/378391877 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9970100930 0x7f997019b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:11.129 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:11.118+0000 7f996ed9d700 1 -- 172.21.15.195:0/378391877 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9968009d00 con 0x7f99701012d0 2023-10-19T12:40:11.129 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:11.118+0000 7f996e59c700 1 --2- 172.21.15.195:0/378391877 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f99700ff730 0x7f9970068cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T12:40:11.129 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:11.118+0000 7f996dd9b700 1 --2- 172.21.15.195:0/378391877 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9970100930 0x7f997019b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T12:40:11.129 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:11.119+0000 7f996ed9d700 1 --2- 172.21.15.195:0/378391877 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99701012d0 0x7f997019dca0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f996800b830 tx=0x7f9968004d30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:40:11.129 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:11.119+0000 7f995f7fe700 1 -- 172.21.15.195:0/378391877 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f996800e040 con 0x7f99701012d0 2023-10-19T12:40:11.129 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:11.119+0000 7f995f7fe700 1 -- 172.21.15.195:0/378391877 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f996801db50 con 0x7f99701012d0 2023-10-19T12:40:11.130 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:11.119+0000 7f995f7fe700 1 -- 172.21.15.195:0/378391877 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f996801bc20 con 0x7f99701012d0 2023-10-19T12:40:11.130 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:11.119+0000 7f99749f4700 1 -- 172.21.15.195:0/378391877 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9970195540 con 0x7f99701012d0 2023-10-19T12:40:11.130 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:11.119+0000 7f99749f4700 1 -- 172.21.15.195:0/378391877 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9970195ac0 con 0x7f99701012d0 2023-10-19T12:40:11.130 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:11.120+0000 7f99749f4700 1 -- 172.21.15.195:0/378391877 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9970106b70 con 0x7f99701012d0 2023-10-19T12:40:11.130 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:11.121+0000 7f995f7fe700 1 -- 172.21.15.195:0/378391877 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f996801d690 con 0x7f99701012d0 2023-10-19T12:40:11.131 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:11.122+0000 7f995f7fe700 1 --2- 172.21.15.195:0/378391877 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f99580a1500 0x7f99580a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:40:11.131 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:11.122+0000 7f995f7fe700 1 -- 172.21.15.195:0/378391877 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6727+0+0 (secure 0 0 0) 0x7f99680ce880 con 0x7f99701012d0 2023-10-19T12:40:11.132 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:11.122+0000 7f996e59c700 1 --2- 172.21.15.195:0/378391877 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f99580a1500 0x7f99580a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:40:11.132 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:11.123+0000 7f996e59c700 1 --2- 172.21.15.195:0/378391877 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f99580a1500 0x7f99580a39c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9970100790 tx=0x7f9960008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:40:11.133 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:11.125+0000 7f995f7fe700 1 -- 172.21.15.195:0/378391877 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f99680985a0 con 0x7f99701012d0 2023-10-19T12:40:11.324 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:11.321+0000 7f99749f4700 1 -- 172.21.15.195:0/378391877 --> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f997002cf80 con 0x7f99580a1500 2023-10-19T12:40:11.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:11 smithi046 ceph-mon[98509]: purged_snaps scrub starts 2023-10-19T12:40:11.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:11 smithi046 ceph-mon[98509]: purged_snaps scrub ok 2023-10-19T12:40:11.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:11 smithi046 ceph-mon[98509]: Detected new or changed devices on smithi157 2023-10-19T12:40:11.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:11 smithi046 ceph-mon[98509]: Adjusting osd_memory_target on smithi157 to 4292M 2023-10-19T12:40:11.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:11 smithi046 ceph-mon[98509]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-19T12:40:11.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:11 smithi046 ceph-mon[98509]: osd.10 [v2:172.21.15.157:6824/2378416559,v1:172.21.15.157:6825/2378416559] boot 2023-10-19T12:40:11.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:11 smithi046 ceph-mon[98509]: osdmap e72: 11 total, 11 up, 11 in 2023-10-19T12:40:11.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:11 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-19T12:40:11.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:11 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-19T12:40:11.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:11 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-19T12:40:11.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:11 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:40:12.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:11 smithi157 ceph-mon[134109]: purged_snaps scrub starts 2023-10-19T12:40:12.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:11 smithi157 ceph-mon[134109]: purged_snaps scrub ok 2023-10-19T12:40:12.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:11 smithi157 ceph-mon[134109]: Detected new or changed devices on smithi157 2023-10-19T12:40:12.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:11 smithi157 ceph-mon[134109]: Adjusting osd_memory_target on smithi157 to 4292M 2023-10-19T12:40:12.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:11 smithi157 ceph-mon[134109]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-19T12:40:12.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:11 smithi157 ceph-mon[134109]: osd.10 [v2:172.21.15.157:6824/2378416559,v1:172.21.15.157:6825/2378416559] boot 2023-10-19T12:40:12.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:11 smithi157 ceph-mon[134109]: osdmap e72: 11 total, 11 up, 11 in 2023-10-19T12:40:12.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:11 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-19T12:40:12.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:11 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-19T12:40:12.090 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:11 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-19T12:40:12.090 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:11 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:40:12.104 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:11 smithi195 ceph-mon[134493]: purged_snaps scrub starts 2023-10-19T12:40:12.104 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:11 smithi195 ceph-mon[134493]: purged_snaps scrub ok 2023-10-19T12:40:12.104 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:11 smithi195 ceph-mon[134493]: Detected new or changed devices on smithi157 2023-10-19T12:40:12.105 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:11 smithi195 ceph-mon[134493]: Adjusting osd_memory_target on smithi157 to 4292M 2023-10-19T12:40:12.105 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:11 smithi195 ceph-mon[134493]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-19T12:40:12.105 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:11 smithi195 ceph-mon[134493]: osd.10 [v2:172.21.15.157:6824/2378416559,v1:172.21.15.157:6825/2378416559] boot 2023-10-19T12:40:12.105 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:11 smithi195 ceph-mon[134493]: osdmap e72: 11 total, 11 up, 11 in 2023-10-19T12:40:12.106 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:11 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-19T12:40:12.106 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:11 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-19T12:40:12.106 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:11 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-19T12:40:12.106 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:11 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:40:12.961 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:12 smithi195 ceph-mon[134493]: from='client.24499 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-19T12:40:12.961 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:12 smithi195 ceph-mon[134493]: osdmap e73: 11 total, 11 up, 11 in 2023-10-19T12:40:12.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:12 smithi046 ceph-mon[98509]: from='client.24499 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-19T12:40:12.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:12 smithi046 ceph-mon[98509]: osdmap e73: 11 total, 11 up, 11 in 2023-10-19T12:40:13.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:12 smithi157 ceph-mon[134109]: from='client.24499 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-19T12:40:13.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:12 smithi157 ceph-mon[134109]: osdmap e73: 11 total, 11 up, 11 in 2023-10-19T12:40:13.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:13 smithi046 ceph-mon[98509]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-10-19T12:40:13.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:13 smithi046 ceph-mon[98509]: osdmap e74: 11 total, 11 up, 11 in 2023-10-19T12:40:13.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:13 smithi046 ceph-mon[98509]: from='client.? 172.21.15.195:0/887776120' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "021398c0-9184-4647-8220-e40f6705ca90"}]: dispatch 2023-10-19T12:40:13.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:13 smithi046 ceph-mon[98509]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "021398c0-9184-4647-8220-e40f6705ca90"}]: dispatch 2023-10-19T12:40:13.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:13 smithi046 ceph-mon[98509]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "021398c0-9184-4647-8220-e40f6705ca90"}]': finished 2023-10-19T12:40:13.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:13 smithi046 ceph-mon[98509]: osdmap e75: 12 total, 11 up, 12 in 2023-10-19T12:40:13.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:13 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-19T12:40:14.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:13 smithi157 ceph-mon[134109]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-10-19T12:40:14.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:13 smithi157 ceph-mon[134109]: osdmap e74: 11 total, 11 up, 11 in 2023-10-19T12:40:14.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:13 smithi157 ceph-mon[134109]: from='client.? 172.21.15.195:0/887776120' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "021398c0-9184-4647-8220-e40f6705ca90"}]: dispatch 2023-10-19T12:40:14.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:13 smithi157 ceph-mon[134109]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "021398c0-9184-4647-8220-e40f6705ca90"}]: dispatch 2023-10-19T12:40:14.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:13 smithi157 ceph-mon[134109]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "021398c0-9184-4647-8220-e40f6705ca90"}]': finished 2023-10-19T12:40:14.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:13 smithi157 ceph-mon[134109]: osdmap e75: 12 total, 11 up, 12 in 2023-10-19T12:40:14.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:13 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-19T12:40:14.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:13 smithi195 ceph-mon[134493]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-10-19T12:40:14.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:13 smithi195 ceph-mon[134493]: osdmap e74: 11 total, 11 up, 11 in 2023-10-19T12:40:14.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:13 smithi195 ceph-mon[134493]: from='client.? 172.21.15.195:0/887776120' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "021398c0-9184-4647-8220-e40f6705ca90"}]: dispatch 2023-10-19T12:40:14.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:13 smithi195 ceph-mon[134493]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "021398c0-9184-4647-8220-e40f6705ca90"}]: dispatch 2023-10-19T12:40:14.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:13 smithi195 ceph-mon[134493]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "021398c0-9184-4647-8220-e40f6705ca90"}]': finished 2023-10-19T12:40:14.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:13 smithi195 ceph-mon[134493]: osdmap e75: 12 total, 11 up, 12 in 2023-10-19T12:40:14.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:13 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-19T12:40:14.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:14 smithi046 ceph-mon[98509]: from='client.? 172.21.15.195:0/2909150629' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-19T12:40:14.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:14 smithi046 ceph-mon[98509]: osdmap e76: 12 total, 11 up, 12 in 2023-10-19T12:40:14.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:14 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-19T12:40:15.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:14 smithi157 ceph-mon[134109]: from='client.? 172.21.15.195:0/2909150629' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-19T12:40:15.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:14 smithi157 ceph-mon[134109]: osdmap e76: 12 total, 11 up, 12 in 2023-10-19T12:40:15.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:14 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-19T12:40:15.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:14 smithi195 ceph-mon[134493]: from='client.? 172.21.15.195:0/2909150629' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-19T12:40:15.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:14 smithi195 ceph-mon[134493]: osdmap e76: 12 total, 11 up, 12 in 2023-10-19T12:40:15.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:14 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-19T12:40:15.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:15 smithi046 ceph-mon[98509]: pgmap v239: 1 pgs: 1 remapped+peering; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-10-19T12:40:16.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:15 smithi157 ceph-mon[134109]: pgmap v239: 1 pgs: 1 remapped+peering; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-10-19T12:40:16.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:15 smithi195 ceph-mon[134493]: pgmap v239: 1 pgs: 1 remapped+peering; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-10-19T12:40:17.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:17 smithi046 ceph-mon[98509]: pgmap v241: 1 pgs: 1 remapped+peering; 577 KiB data, 301 MiB used, 983 GiB / 983 GiB avail 2023-10-19T12:40:18.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:17 smithi157 ceph-mon[134109]: pgmap v241: 1 pgs: 1 remapped+peering; 577 KiB data, 301 MiB used, 983 GiB / 983 GiB avail 2023-10-19T12:40:18.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:17 smithi195 ceph-mon[134493]: pgmap v241: 1 pgs: 1 remapped+peering; 577 KiB data, 301 MiB used, 983 GiB / 983 GiB avail 2023-10-19T12:40:19.978 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:19 smithi195 ceph-mon[134493]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-19T12:40:19.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:19 smithi046 ceph-mon[98509]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-19T12:40:20.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:19 smithi157 ceph-mon[134109]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-19T12:40:20.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:20 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-10-19T12:40:20.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:20 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:40:20.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:20 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-10-19T12:40:20.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:20 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:40:21.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:20 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-10-19T12:40:21.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:20 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:40:21.834 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:21 smithi195 ceph-mon[134493]: Deploying daemon osd.11 on smithi195 2023-10-19T12:40:21.834 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:21 smithi195 ceph-mon[134493]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 73 KiB/s, 0 objects/s recovering 2023-10-19T12:40:21.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:21 smithi046 ceph-mon[98509]: Deploying daemon osd.11 on smithi195 2023-10-19T12:40:21.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:21 smithi046 ceph-mon[98509]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 73 KiB/s, 0 objects/s recovering 2023-10-19T12:40:22.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:21 smithi157 ceph-mon[134109]: Deploying daemon osd.11 on smithi195 2023-10-19T12:40:22.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:21 smithi157 ceph-mon[134109]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 73 KiB/s, 0 objects/s recovering 2023-10-19T12:40:23.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:23 smithi046 ceph-mon[98509]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 64 KiB/s, 0 objects/s recovering 2023-10-19T12:40:23.995 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:23 smithi195 ceph-mon[134493]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 64 KiB/s, 0 objects/s recovering 2023-10-19T12:40:24.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:23 smithi157 ceph-mon[134109]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 64 KiB/s, 0 objects/s recovering 2023-10-19T12:40:25.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:25 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:25.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:25 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:25.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:25 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:40:25.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:25 smithi195 ceph-mon[134493]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-10-19T12:40:25.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:25 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:25.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:25 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:25.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:25 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:40:25.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:25 smithi157 ceph-mon[134109]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-10-19T12:40:25.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:25 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:25.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:25 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:25.730 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:25 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:40:25.730 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:25 smithi046 ceph-mon[98509]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-10-19T12:40:26.787 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:26.784+0000 7f995f7fe700 1 -- 172.21.15.195:0/378391877 <== mgr.14150 v2:172.21.15.46:6800/3168073651 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7f997002cf80 con 0x7f99580a1500 2023-10-19T12:40:26.787 INFO:teuthology.orchestra.run.smithi195.stdout:Created osd(s) 11 on host 'smithi195' 2023-10-19T12:40:26.789 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:26.786+0000 7f99749f4700 1 -- 172.21.15.195:0/378391877 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f99580a1500 msgr2=0x7f99580a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:40:26.789 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:26.786+0000 7f99749f4700 1 --2- 172.21.15.195:0/378391877 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f99580a1500 0x7f99580a39c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9970100790 tx=0x7f9960008040 comp rx=0 tx=0).stop 2023-10-19T12:40:26.789 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:26.786+0000 7f99749f4700 1 -- 172.21.15.195:0/378391877 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99701012d0 msgr2=0x7f997019dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:40:26.789 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:26.786+0000 7f99749f4700 1 --2- 172.21.15.195:0/378391877 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99701012d0 0x7f997019dca0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f996800b830 tx=0x7f9968004d30 comp rx=0 tx=0).stop 2023-10-19T12:40:26.790 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:26.786+0000 7f99749f4700 1 -- 172.21.15.195:0/378391877 shutdown_connections 2023-10-19T12:40:26.790 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:26.786+0000 7f99749f4700 1 --2- 172.21.15.195:0/378391877 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f99580a1500 0x7f99580a39c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:26.790 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:26.786+0000 7f99749f4700 1 --2- 172.21.15.195:0/378391877 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99701012d0 0x7f997019dca0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:26.790 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:26.786+0000 7f99749f4700 1 --2- 172.21.15.195:0/378391877 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f99700ff730 0x7f9970068cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:26.791 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:26.786+0000 7f99749f4700 1 --2- 172.21.15.195:0/378391877 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9970100930 0x7f997019b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:26.791 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:26.786+0000 7f99749f4700 1 -- 172.21.15.195:0/378391877 >> 172.21.15.195:0/378391877 conn(0x7f99700facf0 msgr2=0x7f9970103cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:40:26.791 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:26.786+0000 7f99749f4700 1 -- 172.21.15.195:0/378391877 shutdown_connections 2023-10-19T12:40:26.791 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:26.786+0000 7f99749f4700 1 -- 172.21.15.195:0/378391877 wait complete. 2023-10-19T12:40:27.174 DEBUG:teuthology.orchestra.run.smithi195:osd.11> sudo journalctl -f -n 0 -u ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@osd.11.service 2023-10-19T12:40:27.176 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2023-10-19T12:40:27.177 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph osd stat -f json 2023-10-19T12:40:27.211 INFO:journalctl@ceph.osd.11.smithi195.stdout:-- Logs begin at Thu 2023-10-19 12:10:53 UTC. -- 2023-10-19T12:40:27.838 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-19T12:40:28.054 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:27 smithi195 ceph-mon[134493]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-10-19T12:40:28.054 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:27 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:28.055 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:27 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:28.055 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:27 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:28.055 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:27 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:28.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:27 smithi157 ceph-mon[134109]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-10-19T12:40:28.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:27 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:28.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:27 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:28.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:27 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:28.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:27 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:28.100 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:27 smithi046 ceph-mon[98509]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-10-19T12:40:28.100 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:27 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:28.100 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:27 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:28.100 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:27 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:28.101 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:27 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:28.375 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 12:40:28 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T12:40:28.259+0000 7f94b95f5640 -1 osd.11 0 log_to_monitors true 2023-10-19T12:40:29.010 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:28 smithi046 ceph-mon[98509]: from='osd.11 [v2:172.21.15.195:6824/3075632222,v1:172.21.15.195:6825/3075632222]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-10-19T12:40:29.010 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:28 smithi046 ceph-mon[98509]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-10-19T12:40:29.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:28 smithi157 ceph-mon[134109]: from='osd.11 [v2:172.21.15.195:6824/3075632222,v1:172.21.15.195:6825/3075632222]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-10-19T12:40:29.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:28 smithi157 ceph-mon[134109]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-10-19T12:40:29.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:28 smithi195 ceph-mon[134493]: from='osd.11 [v2:172.21.15.195:6824/3075632222,v1:172.21.15.195:6825/3075632222]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-10-19T12:40:29.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:28 smithi195 ceph-mon[134493]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-10-19T12:40:29.271 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:29.268+0000 7f0841315700 1 -- 172.21.15.46:0/176681357 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f083c101a40 msgr2=0x7f083c101ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:40:29.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:29.268+0000 7f0841315700 1 --2- 172.21.15.46:0/176681357 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f083c101a40 0x7f083c101ea0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0830009920 tx=0x7f0830009c30 comp rx=0 tx=0).stop 2023-10-19T12:40:29.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:29.268+0000 7f0841315700 1 -- 172.21.15.46:0/176681357 shutdown_connections 2023-10-19T12:40:29.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:29.268+0000 7f0841315700 1 --2- 172.21.15.46:0/176681357 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f083c1023e0 0x7f083c108c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:29.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:29.268+0000 7f0841315700 1 --2- 172.21.15.46:0/176681357 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f083c100840 0x7f083c100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:29.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:29.268+0000 7f0841315700 1 --2- 172.21.15.46:0/176681357 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f083c101a40 0x7f083c101ea0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:29.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:29.268+0000 7f0841315700 1 -- 172.21.15.46:0/176681357 >> 172.21.15.46:0/176681357 conn(0x7f083c0fbe00 msgr2=0x7f083c0fe220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:40:29.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:29.268+0000 7f0841315700 1 -- 172.21.15.46:0/176681357 shutdown_connections 2023-10-19T12:40:29.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:29.268+0000 7f0841315700 1 -- 172.21.15.46:0/176681357 wait complete. 2023-10-19T12:40:29.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:29.269+0000 7f0841315700 1 Processor -- start 2023-10-19T12:40:29.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:29.269+0000 7f0841315700 1 -- start start 2023-10-19T12:40:29.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:29.270+0000 7f0841315700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f083c100840 0x7f083c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:40:29.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:29.270+0000 7f0841315700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f083c101a40 0x7f083c072be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:40:29.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:29.270+0000 7f0841315700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f083c1023e0 0x7f083c073120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:40:29.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:29.270+0000 7f0841315700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f083c073800 con 0x7f083c101a40 2023-10-19T12:40:29.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:29.270+0000 7f0841315700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f083c073970 con 0x7f083c1023e0 2023-10-19T12:40:29.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:29.270+0000 7f0841315700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f083c1a0900 con 0x7f083c100840 2023-10-19T12:40:29.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:29.270+0000 7f083affd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f083c100840 0x7f083c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:40:29.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:29.270+0000 7f083affd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f083c100840 0x7f083c0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:37786/0 (socket says 172.21.15.46:37786) 2023-10-19T12:40:29.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:29.270+0000 7f083affd700 1 -- 172.21.15.46:0/221977191 learned_addr learned my addr 172.21.15.46:0/221977191 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:40:29.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:29.270+0000 7f083a7fc700 1 --2- 172.21.15.46:0/221977191 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f083c101a40 0x7f083c072be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:40:29.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:29.270+0000 7f083b7fe700 1 --2- 172.21.15.46:0/221977191 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f083c1023e0 0x7f083c073120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:40:29.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:29.270+0000 7f083affd700 1 -- 172.21.15.46:0/221977191 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f083c1023e0 msgr2=0x7f083c073120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:40:29.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:29.270+0000 7f083affd700 1 --2- 172.21.15.46:0/221977191 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f083c1023e0 0x7f083c073120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:29.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:29.270+0000 7f083affd700 1 -- 172.21.15.46:0/221977191 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f083c101a40 msgr2=0x7f083c072be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:40:29.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:29.270+0000 7f083affd700 1 --2- 172.21.15.46:0/221977191 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f083c101a40 0x7f083c072be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:29.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:29.270+0000 7f083affd700 1 -- 172.21.15.46:0/221977191 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f082c0095f0 con 0x7f083c100840 2023-10-19T12:40:29.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:29.270+0000 7f083b7fe700 1 --2- 172.21.15.46:0/221977191 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f083c1023e0 0x7f083c073120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T12:40:29.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:29.270+0000 7f083a7fc700 1 --2- 172.21.15.46:0/221977191 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f083c101a40 0x7f083c072be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:40:29.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:29.271+0000 7f083affd700 1 --2- 172.21.15.46:0/221977191 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f083c100840 0x7f083c0744f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f082c00ebf0 tx=0x7f082c00ef00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:40:29.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:29.271+0000 7f0823fff700 1 -- 172.21.15.46:0/221977191 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f082c009a10 con 0x7f083c100840 2023-10-19T12:40:29.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:29.271+0000 7f0841315700 1 -- 172.21.15.46:0/221977191 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0830009520 con 0x7f083c100840 2023-10-19T12:40:29.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:29.271+0000 7f0823fff700 1 -- 172.21.15.46:0/221977191 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f082c00cd40 con 0x7f083c100840 2023-10-19T12:40:29.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:29.271+0000 7f0823fff700 1 -- 172.21.15.46:0/221977191 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f082c018820 con 0x7f083c100840 2023-10-19T12:40:29.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:29.271+0000 7f0841315700 1 -- 172.21.15.46:0/221977191 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f083c1a0ef0 con 0x7f083c100840 2023-10-19T12:40:29.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:29.272+0000 7f0841315700 1 -- 172.21.15.46:0/221977191 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f083c107dc0 con 0x7f083c100840 2023-10-19T12:40:29.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:29.274+0000 7f0823fff700 1 -- 172.21.15.46:0/221977191 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f082c018980 con 0x7f083c100840 2023-10-19T12:40:29.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:29.275+0000 7f0823fff700 1 --2- 172.21.15.46:0/221977191 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f08240a1480 0x7f08240a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:40:29.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:29.275+0000 7f0823fff700 1 -- 172.21.15.46:0/221977191 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6831+0+0 (secure 0 0 0) 0x7f082c014070 con 0x7f083c100840 2023-10-19T12:40:29.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:29.276+0000 7f083a7fc700 1 --2- 172.21.15.46:0/221977191 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f08240a1480 0x7f08240a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:40:29.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:29.276+0000 7f083a7fc700 1 --2- 172.21.15.46:0/221977191 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f08240a1480 0x7f08240a3940 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f083000fa40 tx=0x7f0830019040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:40:29.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:29.279+0000 7f0823fff700 1 -- 172.21.15.46:0/221977191 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f082c096a00 con 0x7f083c100840 2023-10-19T12:40:29.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:29.489+0000 7f0841315700 1 -- 172.21.15.46:0/221977191 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f083c04e4c0 con 0x7f083c100840 2023-10-19T12:40:29.493 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:29.489+0000 7f0823fff700 1 -- 172.21.15.46:0/221977191 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v77) v1 ==== 74+0+133 (secure 0 0 0) 0x7f082c09a020 con 0x7f083c100840 2023-10-19T12:40:29.493 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:40:29.495 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:29.492+0000 7f0841315700 1 -- 172.21.15.46:0/221977191 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f08240a1480 msgr2=0x7f08240a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:40:29.495 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:29.492+0000 7f0841315700 1 --2- 172.21.15.46:0/221977191 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f08240a1480 0x7f08240a3940 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f083000fa40 tx=0x7f0830019040 comp rx=0 tx=0).stop 2023-10-19T12:40:29.496 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:29.492+0000 7f0841315700 1 -- 172.21.15.46:0/221977191 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f083c100840 msgr2=0x7f083c0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:40:29.496 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:29.492+0000 7f0841315700 1 --2- 172.21.15.46:0/221977191 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f083c100840 0x7f083c0744f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f082c00ebf0 tx=0x7f082c00ef00 comp rx=0 tx=0).stop 2023-10-19T12:40:29.496 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:29.492+0000 7f0841315700 1 -- 172.21.15.46:0/221977191 shutdown_connections 2023-10-19T12:40:29.496 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:29.492+0000 7f0841315700 1 --2- 172.21.15.46:0/221977191 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f083c1023e0 0x7f083c073120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:29.496 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:29.492+0000 7f0841315700 1 --2- 172.21.15.46:0/221977191 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f08240a1480 0x7f08240a3940 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:29.496 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:29.492+0000 7f0841315700 1 --2- 172.21.15.46:0/221977191 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f083c100840 0x7f083c0744f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:29.497 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:29.492+0000 7f0841315700 1 --2- 172.21.15.46:0/221977191 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f083c101a40 0x7f083c072be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:29.497 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:29.492+0000 7f0841315700 1 -- 172.21.15.46:0/221977191 >> 172.21.15.46:0/221977191 conn(0x7f083c0fbe00 msgr2=0x7f083c104f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:40:29.497 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:29.492+0000 7f0841315700 1 -- 172.21.15.46:0/221977191 shutdown_connections 2023-10-19T12:40:29.497 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:29.492+0000 7f0841315700 1 -- 172.21.15.46:0/221977191 wait complete. 2023-10-19T12:40:29.880 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 12:40:29 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T12:40:29.764+0000 7f94aec6c700 -1 osd.11 0 waiting for initial osdmap 2023-10-19T12:40:29.881 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 12:40:29 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T12:40:29.777+0000 7f94a8a5d700 -1 osd.11 78 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-19T12:40:29.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:29 smithi195 ceph-mon[134493]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-10-19T12:40:29.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:29 smithi195 ceph-mon[134493]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-10-19T12:40:29.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:29 smithi195 ceph-mon[134493]: from='osd.11 [v2:172.21.15.195:6824/3075632222,v1:172.21.15.195:6825/3075632222]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2023-10-19T12:40:29.882 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:29 smithi195 ceph-mon[134493]: osdmap e77: 12 total, 11 up, 12 in 2023-10-19T12:40:29.882 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:29 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-19T12:40:29.882 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:29 smithi195 ceph-mon[134493]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2023-10-19T12:40:29.882 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:29 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/221977191' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-10-19T12:40:29.922 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:29 smithi046 ceph-mon[98509]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-10-19T12:40:29.923 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:29 smithi046 ceph-mon[98509]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-10-19T12:40:29.923 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:29 smithi046 ceph-mon[98509]: from='osd.11 [v2:172.21.15.195:6824/3075632222,v1:172.21.15.195:6825/3075632222]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2023-10-19T12:40:29.923 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:29 smithi046 ceph-mon[98509]: osdmap e77: 12 total, 11 up, 12 in 2023-10-19T12:40:29.923 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:29 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-19T12:40:29.923 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:29 smithi046 ceph-mon[98509]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2023-10-19T12:40:29.924 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:29 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/221977191' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-10-19T12:40:29.925 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":77,"num_osds":12,"num_up_osds":11,"osd_up_since":1697719210,"num_in_osds":12,"osd_in_since":1697719213,"num_remapped_pgs":0} 2023-10-19T12:40:30.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:29 smithi157 ceph-mon[134109]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-10-19T12:40:30.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:29 smithi157 ceph-mon[134109]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-10-19T12:40:30.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:29 smithi157 ceph-mon[134109]: from='osd.11 [v2:172.21.15.195:6824/3075632222,v1:172.21.15.195:6825/3075632222]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2023-10-19T12:40:30.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:29 smithi157 ceph-mon[134109]: osdmap e77: 12 total, 11 up, 12 in 2023-10-19T12:40:30.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:29 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-19T12:40:30.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:29 smithi157 ceph-mon[134109]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2023-10-19T12:40:30.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:29 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/221977191' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-10-19T12:40:30.926 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph osd stat -f json 2023-10-19T12:40:31.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:30 smithi157 ceph-mon[134109]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2023-10-19T12:40:31.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:30 smithi157 ceph-mon[134109]: osdmap e78: 12 total, 11 up, 12 in 2023-10-19T12:40:31.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:30 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-19T12:40:31.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:30 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-19T12:40:31.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:30 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:31.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:30 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:31.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:30 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:40:31.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:30 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:40:31.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:30 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:40:31.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:30 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:40:31.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:30 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:31.090 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:30 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:40:31.090 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:30 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:40:31.090 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:30 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:31.090 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:30 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:40:31.090 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:30 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:40:31.091 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:30 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:40:31.091 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:30 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:31.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:30 smithi195 ceph-mon[134493]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2023-10-19T12:40:31.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:30 smithi195 ceph-mon[134493]: osdmap e78: 12 total, 11 up, 12 in 2023-10-19T12:40:31.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:30 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-19T12:40:31.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:30 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-19T12:40:31.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:30 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:31.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:30 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:31.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:30 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:40:31.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:30 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:40:31.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:30 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:40:31.133 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:30 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:40:31.133 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:30 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:31.133 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:30 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:40:31.133 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:30 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:40:31.133 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:30 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:31.134 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:30 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:40:31.134 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:30 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:40:31.134 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:30 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:40:31.134 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:30 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:31.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:30 smithi046 ceph-mon[98509]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2023-10-19T12:40:31.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:30 smithi046 ceph-mon[98509]: osdmap e78: 12 total, 11 up, 12 in 2023-10-19T12:40:31.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:30 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-19T12:40:31.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:30 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-19T12:40:31.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:30 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:31.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:30 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:31.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:30 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:40:31.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:30 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:40:31.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:30 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:40:31.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:30 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:40:31.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:30 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:31.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:30 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:40:31.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:30 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:40:31.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:30 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:31.232 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:30 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:40:31.232 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:30 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:40:31.232 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:30 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:40:31.232 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:30 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:31.679 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-19T12:40:32.085 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:31 smithi046 ceph-mon[98509]: purged_snaps scrub starts 2023-10-19T12:40:32.085 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:31 smithi046 ceph-mon[98509]: purged_snaps scrub ok 2023-10-19T12:40:32.086 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:31 smithi046 ceph-mon[98509]: Detected new or changed devices on smithi195 2023-10-19T12:40:32.086 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:31 smithi046 ceph-mon[98509]: Adjusting osd_memory_target on smithi195 to 4292M 2023-10-19T12:40:32.086 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:31 smithi046 ceph-mon[98509]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-10-19T12:40:32.086 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:31 smithi046 ceph-mon[98509]: osd.11 [v2:172.21.15.195:6824/3075632222,v1:172.21.15.195:6825/3075632222] boot 2023-10-19T12:40:32.087 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:31 smithi046 ceph-mon[98509]: osdmap e79: 12 total, 12 up, 12 in 2023-10-19T12:40:32.087 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:31 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-19T12:40:32.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:31 smithi157 ceph-mon[134109]: purged_snaps scrub starts 2023-10-19T12:40:32.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:31 smithi157 ceph-mon[134109]: purged_snaps scrub ok 2023-10-19T12:40:32.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:31 smithi157 ceph-mon[134109]: Detected new or changed devices on smithi195 2023-10-19T12:40:32.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:31 smithi157 ceph-mon[134109]: Adjusting osd_memory_target on smithi195 to 4292M 2023-10-19T12:40:32.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:31 smithi157 ceph-mon[134109]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-10-19T12:40:32.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:31 smithi157 ceph-mon[134109]: osd.11 [v2:172.21.15.195:6824/3075632222,v1:172.21.15.195:6825/3075632222] boot 2023-10-19T12:40:32.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:31 smithi157 ceph-mon[134109]: osdmap e79: 12 total, 12 up, 12 in 2023-10-19T12:40:32.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:31 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-19T12:40:32.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:31 smithi195 ceph-mon[134493]: purged_snaps scrub starts 2023-10-19T12:40:32.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:31 smithi195 ceph-mon[134493]: purged_snaps scrub ok 2023-10-19T12:40:32.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:31 smithi195 ceph-mon[134493]: Detected new or changed devices on smithi195 2023-10-19T12:40:32.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:31 smithi195 ceph-mon[134493]: Adjusting osd_memory_target on smithi195 to 4292M 2023-10-19T12:40:32.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:31 smithi195 ceph-mon[134493]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-10-19T12:40:32.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:31 smithi195 ceph-mon[134493]: osd.11 [v2:172.21.15.195:6824/3075632222,v1:172.21.15.195:6825/3075632222] boot 2023-10-19T12:40:32.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:31 smithi195 ceph-mon[134493]: osdmap e79: 12 total, 12 up, 12 in 2023-10-19T12:40:32.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:31 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-19T12:40:33.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:33.067+0000 7f921f8f1700 1 -- 172.21.15.46:0/495056493 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9218101a40 msgr2=0x7f9218101ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:40:33.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:33.067+0000 7f921f8f1700 1 --2- 172.21.15.46:0/495056493 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9218101a40 0x7f9218101ea0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f92080099c0 tx=0x7f9208009cd0 comp rx=0 tx=0).stop 2023-10-19T12:40:33.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:33.067+0000 7f921f8f1700 1 -- 172.21.15.46:0/495056493 shutdown_connections 2023-10-19T12:40:33.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:33.067+0000 7f921f8f1700 1 --2- 172.21.15.46:0/495056493 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f92181023e0 0x7f9218108c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:33.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:33.067+0000 7f921f8f1700 1 --2- 172.21.15.46:0/495056493 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9218100840 0x7f9218100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:33.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:33.067+0000 7f921f8f1700 1 --2- 172.21.15.46:0/495056493 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9218101a40 0x7f9218101ea0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:33.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:33.067+0000 7f921f8f1700 1 -- 172.21.15.46:0/495056493 >> 172.21.15.46:0/495056493 conn(0x7f92180fbe00 msgr2=0x7f92180fe220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:40:33.073 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:33.068+0000 7f921f8f1700 1 -- 172.21.15.46:0/495056493 shutdown_connections 2023-10-19T12:40:33.073 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:33.068+0000 7f921f8f1700 1 -- 172.21.15.46:0/495056493 wait complete. 2023-10-19T12:40:33.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:33.068+0000 7f921f8f1700 1 Processor -- start 2023-10-19T12:40:33.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:33.069+0000 7f921f8f1700 1 -- start start 2023-10-19T12:40:33.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:33.069+0000 7f921f8f1700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9218100840 0x7f9218196770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:40:33.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:33.069+0000 7f921f8f1700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9218101a40 0x7f9218196cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:40:33.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:33.069+0000 7f921f8f1700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f92181023e0 0x7f921819dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:40:33.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:33.069+0000 7f921f8f1700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f921819e2b0 con 0x7f92181023e0 2023-10-19T12:40:33.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:33.069+0000 7f921f8f1700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f921819e3f0 con 0x7f9218101a40 2023-10-19T12:40:33.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:33.069+0000 7f921f8f1700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f921819e580 con 0x7f9218100840 2023-10-19T12:40:33.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:33.069+0000 7f921de8e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f92181023e0 0x7f921819dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:40:33.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:33.069+0000 7f921ce8c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9218101a40 0x7f9218196cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:40:33.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:33.069+0000 7f921d68d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9218100840 0x7f9218196770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:40:33.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:33.069+0000 7f921ce8c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9218101a40 0x7f9218196cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:49680/0 (socket says 172.21.15.46:49680) 2023-10-19T12:40:33.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:33.069+0000 7f921ce8c700 1 -- 172.21.15.46:0/2929975754 learned_addr learned my addr 172.21.15.46:0/2929975754 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:40:33.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:33.069+0000 7f921de8e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f92181023e0 0x7f921819dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47968/0 (socket says 172.21.15.46:47968) 2023-10-19T12:40:33.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:33.070+0000 7f921ce8c700 1 -- 172.21.15.46:0/2929975754 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9218100840 msgr2=0x7f9218196770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:40:33.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:33.070+0000 7f921ce8c700 1 --2- 172.21.15.46:0/2929975754 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9218100840 0x7f9218196770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:33.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:33.070+0000 7f921ce8c700 1 -- 172.21.15.46:0/2929975754 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f92181023e0 msgr2=0x7f921819dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:40:33.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:33.070+0000 7f921ce8c700 1 --2- 172.21.15.46:0/2929975754 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f92181023e0 0x7f921819dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:33.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:33.070+0000 7f921ce8c700 1 -- 172.21.15.46:0/2929975754 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92080095f0 con 0x7f9218101a40 2023-10-19T12:40:33.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:33.070+0000 7f921de8e700 1 --2- 172.21.15.46:0/2929975754 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f92181023e0 0x7f921819dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:40:33.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:33.070+0000 7f921ce8c700 1 --2- 172.21.15.46:0/2929975754 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9218101a40 0x7f9218196cb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9208006010 tx=0x7f920800f690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:40:33.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:33.070+0000 7f920e7fc700 1 -- 172.21.15.46:0/2929975754 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f920801d070 con 0x7f9218101a40 2023-10-19T12:40:33.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:33.070+0000 7f921f8f1700 1 -- 172.21.15.46:0/2929975754 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f921819e800 con 0x7f9218101a40 2023-10-19T12:40:33.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:33.070+0000 7f920e7fc700 1 -- 172.21.15.46:0/2929975754 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9208005030 con 0x7f9218101a40 2023-10-19T12:40:33.080 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:33.070+0000 7f920e7fc700 1 -- 172.21.15.46:0/2929975754 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9208004b10 con 0x7f9218101a40 2023-10-19T12:40:33.080 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:33.071+0000 7f921f8f1700 1 -- 172.21.15.46:0/2929975754 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f921819ec20 con 0x7f9218101a40 2023-10-19T12:40:33.080 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:33.071+0000 7f921f8f1700 1 -- 172.21.15.46:0/2929975754 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9218107cc0 con 0x7f9218101a40 2023-10-19T12:40:33.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:33.074+0000 7f920e7fc700 1 -- 172.21.15.46:0/2929975754 <== mon.2 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f92080051a0 con 0x7f9218101a40 2023-10-19T12:40:33.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:33.075+0000 7f920e7fc700 1 --2- 172.21.15.46:0/2929975754 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f92040a1480 0x7f92040a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:40:33.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:33.075+0000 7f920e7fc700 1 -- 172.21.15.46:0/2929975754 <== mon.2 v2:172.21.15.157:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f92080cd9b0 con 0x7f9218101a40 2023-10-19T12:40:33.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:33.075+0000 7f921d68d700 1 --2- 172.21.15.46:0/2929975754 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f92040a1480 0x7f92040a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:40:33.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:33.076+0000 7f921d68d700 1 --2- 172.21.15.46:0/2929975754 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f92040a1480 0x7f92040a3940 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f92181018a0 tx=0x7f9214009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:40:33.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:33.077+0000 7f920e7fc700 1 -- 172.21.15.46:0/2929975754 <== mon.2 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f92080974a0 con 0x7f9218101a40 2023-10-19T12:40:33.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:33.287+0000 7f921f8f1700 1 -- 172.21.15.46:0/2929975754 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f921810c090 con 0x7f9218101a40 2023-10-19T12:40:33.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:33.287+0000 7f920e7fc700 1 -- 172.21.15.46:0/2929975754 <== mon.2 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v80) v1 ==== 74+0+133 (secure 0 0 0) 0x7f920809aac0 con 0x7f9218101a40 2023-10-19T12:40:33.291 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:40:33.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:33.290+0000 7f921f8f1700 1 -- 172.21.15.46:0/2929975754 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f92040a1480 msgr2=0x7f92040a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:40:33.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:33.290+0000 7f921f8f1700 1 --2- 172.21.15.46:0/2929975754 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f92040a1480 0x7f92040a3940 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f92181018a0 tx=0x7f9214009260 comp rx=0 tx=0).stop 2023-10-19T12:40:33.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:33.290+0000 7f921f8f1700 1 -- 172.21.15.46:0/2929975754 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9218101a40 msgr2=0x7f9218196cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:40:33.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:33.290+0000 7f921f8f1700 1 --2- 172.21.15.46:0/2929975754 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9218101a40 0x7f9218196cb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9208006010 tx=0x7f920800f690 comp rx=0 tx=0).stop 2023-10-19T12:40:33.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:33.290+0000 7f921f8f1700 1 -- 172.21.15.46:0/2929975754 shutdown_connections 2023-10-19T12:40:33.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:33.290+0000 7f921f8f1700 1 --2- 172.21.15.46:0/2929975754 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f92181023e0 0x7f921819dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:33.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:33.290+0000 7f921f8f1700 1 --2- 172.21.15.46:0/2929975754 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f92040a1480 0x7f92040a3940 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:33.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:33.290+0000 7f921f8f1700 1 --2- 172.21.15.46:0/2929975754 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9218100840 0x7f9218196770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:33.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:33.290+0000 7f921f8f1700 1 --2- 172.21.15.46:0/2929975754 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9218101a40 0x7f9218196cb0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:33.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:33.290+0000 7f921f8f1700 1 -- 172.21.15.46:0/2929975754 >> 172.21.15.46:0/2929975754 conn(0x7f92180fbe00 msgr2=0x7f9218104e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:40:33.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:33.290+0000 7f921f8f1700 1 -- 172.21.15.46:0/2929975754 shutdown_connections 2023-10-19T12:40:33.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:33.290+0000 7f921f8f1700 1 -- 172.21.15.46:0/2929975754 wait complete. 2023-10-19T12:40:33.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:33 smithi157 ceph-mon[134109]: osdmap e80: 12 total, 12 up, 12 in 2023-10-19T12:40:33.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:33 smithi157 ceph-mon[134109]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-19T12:40:33.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:33 smithi195 ceph-mon[134493]: osdmap e80: 12 total, 12 up, 12 in 2023-10-19T12:40:33.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:33 smithi195 ceph-mon[134493]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-19T12:40:33.709 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:33 smithi046 ceph-mon[98509]: osdmap e80: 12 total, 12 up, 12 in 2023-10-19T12:40:33.709 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:33 smithi046 ceph-mon[98509]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-19T12:40:33.763 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":80,"num_osds":12,"num_up_osds":12,"osd_up_since":1697719230,"num_in_osds":12,"osd_in_since":1697719213,"num_remapped_pgs":0} 2023-10-19T12:40:33.764 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph osd dump --format=json 2023-10-19T12:40:34.514 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-19T12:40:34.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:34 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/2929975754' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-10-19T12:40:34.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:34 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/2929975754' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-10-19T12:40:34.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:34 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/2929975754' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-10-19T12:40:35.431 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:35 smithi046 ceph-mon[98509]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-19T12:40:35.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:35 smithi157 ceph-mon[134109]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-19T12:40:35.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:35 smithi195 ceph-mon[134493]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-19T12:40:36.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:36.132+0000 7ff64f74a700 1 -- 172.21.15.46:0/3923635004 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6481008a0 msgr2=0x7ff648100d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:40:36.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:36.132+0000 7ff64f74a700 1 --2- 172.21.15.46:0/3923635004 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6481008a0 0x7ff648100d20 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff638009990 tx=0x7ff638009ca0 comp rx=0 tx=0).stop 2023-10-19T12:40:36.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:36.132+0000 7ff64f74a700 1 -- 172.21.15.46:0/3923635004 shutdown_connections 2023-10-19T12:40:36.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:36.132+0000 7ff64f74a700 1 --2- 172.21.15.46:0/3923635004 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff648101260 0x7ff64810d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:36.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:36.132+0000 7ff64f74a700 1 --2- 172.21.15.46:0/3923635004 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff6481057c0 0x7ff648105ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:36.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:36.132+0000 7ff64f74a700 1 --2- 172.21.15.46:0/3923635004 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6481008a0 0x7ff648100d20 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:36.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:36.132+0000 7ff64f74a700 1 -- 172.21.15.46:0/3923635004 >> 172.21.15.46:0/3923635004 conn(0x7ff6480779e0 msgr2=0x7ff648077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:40:36.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:36.132+0000 7ff64f74a700 1 -- 172.21.15.46:0/3923635004 shutdown_connections 2023-10-19T12:40:36.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:36.132+0000 7ff64f74a700 1 -- 172.21.15.46:0/3923635004 wait complete. 2023-10-19T12:40:36.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:36.133+0000 7ff64f74a700 1 Processor -- start 2023-10-19T12:40:36.140 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:36.133+0000 7ff64f74a700 1 -- start start 2023-10-19T12:40:36.140 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:36.134+0000 7ff64f74a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff6481008a0 0x7ff64819c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:40:36.140 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:36.134+0000 7ff64f74a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff648101260 0x7ff64819ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:40:36.140 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:36.134+0000 7ff64f74a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6481057c0 0x7ff648196a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:40:36.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:36.134+0000 7ff64f74a700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6481970d0 con 0x7ff6481057c0 2023-10-19T12:40:36.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:36.134+0000 7ff64f74a700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff648197240 con 0x7ff648101260 2023-10-19T12:40:36.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:36.134+0000 7ff64f74a700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff648197400 con 0x7ff6481008a0 2023-10-19T12:40:36.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:36.134+0000 7ff64dce7700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6481057c0 0x7ff648196a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:40:36.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:36.134+0000 7ff64dce7700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6481057c0 0x7ff648196a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47986/0 (socket says 172.21.15.46:47986) 2023-10-19T12:40:36.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:36.134+0000 7ff64dce7700 1 -- 172.21.15.46:0/656843571 learned_addr learned my addr 172.21.15.46:0/656843571 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:40:36.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:36.134+0000 7ff64d4e6700 1 --2- 172.21.15.46:0/656843571 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff6481008a0 0x7ff64819c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:40:36.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:36.134+0000 7ff64cce5700 1 --2- 172.21.15.46:0/656843571 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff648101260 0x7ff64819ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:40:36.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:36.135+0000 7ff64dce7700 1 -- 172.21.15.46:0/656843571 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff6481008a0 msgr2=0x7ff64819c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:40:36.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:36.135+0000 7ff64dce7700 1 --2- 172.21.15.46:0/656843571 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff6481008a0 0x7ff64819c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:36.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:36.135+0000 7ff64dce7700 1 -- 172.21.15.46:0/656843571 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff648101260 msgr2=0x7ff64819ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:40:36.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:36.135+0000 7ff64dce7700 1 --2- 172.21.15.46:0/656843571 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff648101260 0x7ff64819ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:36.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:36.135+0000 7ff64dce7700 1 -- 172.21.15.46:0/656843571 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6380095f0 con 0x7ff6481057c0 2023-10-19T12:40:36.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:36.135+0000 7ff64dce7700 1 --2- 172.21.15.46:0/656843571 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6481057c0 0x7ff648196a60 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff64000efc0 tx=0x7ff64000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:40:36.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:36.135+0000 7ff63e7fc700 1 -- 172.21.15.46:0/656843571 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff640018070 con 0x7ff6481057c0 2023-10-19T12:40:36.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:36.135+0000 7ff63e7fc700 1 -- 172.21.15.46:0/656843571 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff64000f040 con 0x7ff6481057c0 2023-10-19T12:40:36.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:36.135+0000 7ff64f74a700 1 -- 172.21.15.46:0/656843571 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff648197680 con 0x7ff6481057c0 2023-10-19T12:40:36.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:36.135+0000 7ff63e7fc700 1 -- 172.21.15.46:0/656843571 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff64000cc10 con 0x7ff6481057c0 2023-10-19T12:40:36.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:36.135+0000 7ff64f74a700 1 -- 172.21.15.46:0/656843571 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6481a38c0 con 0x7ff6481057c0 2023-10-19T12:40:36.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:36.136+0000 7ff64f74a700 1 -- 172.21.15.46:0/656843571 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff648108da0 con 0x7ff6481057c0 2023-10-19T12:40:36.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:36.138+0000 7ff63e7fc700 1 -- 172.21.15.46:0/656843571 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7ff640003a00 con 0x7ff6481057c0 2023-10-19T12:40:36.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:36.140+0000 7ff63e7fc700 1 --2- 172.21.15.46:0/656843571 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7ff6340a1480 0x7ff6340a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:40:36.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:36.140+0000 7ff63e7fc700 1 -- 172.21.15.46:0/656843571 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7ff6400cc320 con 0x7ff6481057c0 2023-10-19T12:40:36.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:36.140+0000 7ff64d4e6700 1 --2- 172.21.15.46:0/656843571 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7ff6340a1480 0x7ff6340a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:40:36.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:36.141+0000 7ff64d4e6700 1 --2- 172.21.15.46:0/656843571 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7ff6340a1480 0x7ff6340a3940 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff648101930 tx=0x7ff644009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:40:36.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:36.144+0000 7ff63e7fc700 1 -- 172.21.15.46:0/656843571 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff640095e10 con 0x7ff6481057c0 2023-10-19T12:40:36.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:36.356+0000 7ff64f74a700 1 -- 172.21.15.46:0/656843571 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff648101f30 con 0x7ff6481057c0 2023-10-19T12:40:36.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:36.357+0000 7ff63e7fc700 1 -- 172.21.15.46:0/656843571 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+18415 (secure 0 0 0) 0x7ff640099430 con 0x7ff6481057c0 2023-10-19T12:40:36.361 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:40:36.361 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":80,"fsid":"96a8be3c-6e7b-11ee-8db6-212e2dc638e7","created":"2023-10-19T12:33:26.148713+0000","modified":"2023-10-19T12:40:32.226583+0000","last_up_change":"2023-10-19T12:40:30.761679+0000","last_in_change":"2023-10-19T12:40:13.663559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-19T12:37:07.175795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"346ce86b-a10a-4869-9fdb-c3c1d4161455","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6803","nonce":500237995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6805","nonce":500237995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6809","nonce":500237995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6807","nonce":500237995}]},"public_addr":"172.21.15.46:6803/500237995","cluster_addr":"172.21.15.46:6805/500237995","heartbeat_back_addr":"172.21.15.46:6809/500237995","heartbeat_front_addr":"172.21.15.46:6807/500237995","state":["exists","up"]},{"osd":1,"uuid":"02aae687-76c5-4124-bae4-9787ed571c28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6801","nonce":2496862790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6803","nonce":2496862790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6807","nonce":2496862790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6805","nonce":2496862790}]},"public_addr":"172.21.15.157:6801/2496862790","cluster_addr":"172.21.15.157:6803/2496862790","heartbeat_back_addr":"172.21.15.157:6807/2496862790","heartbeat_front_addr":"172.21.15.157:6805/2496862790","state":["exists","up"]},{"osd":2,"uuid":"d5360828-1f58-4380-b2ad-0c21ff850981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6801","nonce":4211767276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6803","nonce":4211767276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6807","nonce":4211767276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6805","nonce":4211767276}]},"public_addr":"172.21.15.195:6801/4211767276","cluster_addr":"172.21.15.195:6803/4211767276","heartbeat_back_addr":"172.21.15.195:6807/4211767276","heartbeat_front_addr":"172.21.15.195:6805/4211767276","state":["exists","up"]},{"osd":3,"uuid":"accb780f-49d0-43f8-b166-ee12c558ef00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6811","nonce":1964113352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6813","nonce":1964113352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6817","nonce":1964113352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6815","nonce":1964113352}]},"public_addr":"172.21.15.46:6811/1964113352","cluster_addr":"172.21.15.46:6813/1964113352","heartbeat_back_addr":"172.21.15.46:6817/1964113352","heartbeat_front_addr":"172.21.15.46:6815/1964113352","state":["exists","up"]},{"osd":4,"uuid":"e662886d-e989-4d02-8c1f-3c4671352b0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6809","nonce":3636910144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6811","nonce":3636910144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6815","nonce":3636910144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6813","nonce":3636910144}]},"public_addr":"172.21.15.157:6809/3636910144","cluster_addr":"172.21.15.157:6811/3636910144","heartbeat_back_addr":"172.21.15.157:6815/3636910144","heartbeat_front_addr":"172.21.15.157:6813/3636910144","state":["exists","up"]},{"osd":5,"uuid":"9597e0ce-14ea-407d-90fe-f74bccee38b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6809","nonce":4071287969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6811","nonce":4071287969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6815","nonce":4071287969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6813","nonce":4071287969}]},"public_addr":"172.21.15.195:6809/4071287969","cluster_addr":"172.21.15.195:6811/4071287969","heartbeat_back_addr":"172.21.15.195:6815/4071287969","heartbeat_front_addr":"172.21.15.195:6813/4071287969","state":["exists","up"]},{"osd":6,"uuid":"6b78ba38-f60e-4cb6-b01c-cecc1820e8e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6819","nonce":1842285555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6821","nonce":1842285555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6825","nonce":1842285555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6823","nonce":1842285555}]},"public_addr":"172.21.15.46:6819/1842285555","cluster_addr":"172.21.15.46:6821/1842285555","heartbeat_back_addr":"172.21.15.46:6825/1842285555","heartbeat_front_addr":"172.21.15.46:6823/1842285555","state":["exists","up"]},{"osd":7,"uuid":"59a0899f-3bcd-4db2-b544-24df3a536749","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6817","nonce":3498672588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6819","nonce":3498672588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6823","nonce":3498672588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6821","nonce":3498672588}]},"public_addr":"172.21.15.157:6817/3498672588","cluster_addr":"172.21.15.157:6819/3498672588","heartbeat_back_addr":"172.21.15.157:6823/3498672588","heartbeat_front_addr":"172.21.15.157:6821/3498672588","state":["exists","up"]},{"osd":8,"uuid":"9c3c9835-043a-4fb5-a9ee-edf8caf6b605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6817","nonce":74230104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6819","nonce":74230104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6823","nonce":74230104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6821","nonce":74230104}]},"public_addr":"172.21.15.195:6817/74230104","cluster_addr":"172.21.15.195:6819/74230104","heartbeat_back_addr":"172.21.15.195:6823/74230104","heartbeat_front_addr":"172.21.15.195:6821/74230104","state":["exists","up"]},{"osd":9,"uuid":"3f18f506-a577-4b7c-ae0d-9351c07e81f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6827","nonce":3472581046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6829","nonce":3472581046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6833","nonce":3472581046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6831","nonce":3472581046}]},"public_addr":"172.21.15.46:6827/3472581046","cluster_addr":"172.21.15.46:6829/3472581046","heartbeat_back_addr":"172.21.15.46:6833/3472581046","heartbeat_front_addr":"172.21.15.46:6831/3472581046","state":["exists","up"]},{"osd":10,"uuid":"1ed01854-443a-4acf-9293-7ca0d451a93d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6825","nonce":2378416559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6827","nonce":2378416559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6831","nonce":2378416559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6829","nonce":2378416559}]},"public_addr":"172.21.15.157:6825/2378416559","cluster_addr":"172.21.15.157:6827/2378416559","heartbeat_back_addr":"172.21.15.157:6831/2378416559","heartbeat_front_addr":"172.21.15.157:6829/2378416559","state":["exists","up"]},{"osd":11,"uuid":"021398c0-9184-4647-8220-e40f6705ca90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6825","nonce":3075632222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6827","nonce":3075632222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6831","nonce":3075632222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6829","nonce":3075632222}]},"public_addr":"172.21.15.195:6825/3075632222","cluster_addr":"172.21.15.195:6827/3075632222","heartbeat_back_addr":"172.21.15.195:6831/3075632222","heartbeat_front_addr":"172.21.15.195:6829/3075632222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:36:22.002614+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:36:44.098031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:37:04.518341+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:37:30.796462+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:37:52.756555+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:38:13.403168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:38:39.058472+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:39:01.106893+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:39:21.908334+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:39:46.843884+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:40:08.792020+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:40:29.282974+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.46:0/3248595150":"2023-10-20T12:34:26.552115+0000","172.21.15.46:0/3624849341":"2023-10-20T12:34:26.552115+0000","172.21.15.46:0/1844094590":"2023-10-20T12:34:26.552115+0000","172.21.15.46:6801/20022894":"2023-10-20T12:34:26.552115+0000","172.21.15.46:0/3969790632":"2023-10-20T12:34:00.135248+0000","172.21.15.46:0/2331135821":"2023-10-20T12:34:00.135248+0000","172.21.15.46:6800/51664346":"2023-10-20T12:34:00.135248+0000","172.21.15.46:6801/51664346":"2023-10-20T12:34:00.135248+0000","172.21.15.46:0/585851467":"2023-10-20T12:34:00.135248+0000","172.21.15.46:6800/20022894":"2023-10-20T12:34:26.552115+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-19T12:40:36.363 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:36.360+0000 7ff64f74a700 1 -- 172.21.15.46:0/656843571 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7ff6340a1480 msgr2=0x7ff6340a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:40:36.364 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:36.360+0000 7ff64f74a700 1 --2- 172.21.15.46:0/656843571 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7ff6340a1480 0x7ff6340a3940 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff648101930 tx=0x7ff644009260 comp rx=0 tx=0).stop 2023-10-19T12:40:36.364 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:36.360+0000 7ff64f74a700 1 -- 172.21.15.46:0/656843571 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6481057c0 msgr2=0x7ff648196a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:40:36.364 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:36.360+0000 7ff64f74a700 1 --2- 172.21.15.46:0/656843571 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6481057c0 0x7ff648196a60 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff64000efc0 tx=0x7ff64000c3a0 comp rx=0 tx=0).stop 2023-10-19T12:40:36.364 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:36.360+0000 7ff64f74a700 1 -- 172.21.15.46:0/656843571 shutdown_connections 2023-10-19T12:40:36.365 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:36.360+0000 7ff64f74a700 1 --2- 172.21.15.46:0/656843571 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6481057c0 0x7ff648196a60 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:36.365 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:36.360+0000 7ff64f74a700 1 --2- 172.21.15.46:0/656843571 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7ff6340a1480 0x7ff6340a3940 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:36.365 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:36.360+0000 7ff64f74a700 1 --2- 172.21.15.46:0/656843571 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff6481008a0 0x7ff64819c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:36.365 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:36.360+0000 7ff64f74a700 1 --2- 172.21.15.46:0/656843571 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff648101260 0x7ff64819ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:36.365 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:36.360+0000 7ff64f74a700 1 -- 172.21.15.46:0/656843571 >> 172.21.15.46:0/656843571 conn(0x7ff6480779e0 msgr2=0x7ff6480fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:40:36.366 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:36.360+0000 7ff64f74a700 1 -- 172.21.15.46:0/656843571 shutdown_connections 2023-10-19T12:40:36.366 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:36.361+0000 7ff64f74a700 1 -- 172.21.15.46:0/656843571 wait complete. 2023-10-19T12:40:36.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:36 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/656843571' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-19T12:40:36.837 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:36 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/656843571' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-19T12:40:36.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:36 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/656843571' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-19T12:40:37.003 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-19T12:37:07.175795+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-19T12:40:37.004 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph osd pool get .mgr pg_num 2023-10-19T12:40:37.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:37 smithi046 ceph-mon[98509]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-19T12:40:37.751 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-19T12:40:37.837 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:37 smithi157 ceph-mon[134109]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-19T12:40:37.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:37 smithi195 ceph-mon[134493]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-19T12:40:39.207 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:39.203+0000 7ffaf4327700 1 -- 172.21.15.46:0/2217411992 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffaec068b30 msgr2=0x7ffaec10d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:40:39.207 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:39.203+0000 7ffaf4327700 1 --2- 172.21.15.46:0/2217411992 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffaec068b30 0x7ffaec10d670 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ffae400b0a0 tx=0x7ffae400b3b0 comp rx=0 tx=0).stop 2023-10-19T12:40:39.207 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:39.203+0000 7ffaf4327700 1 -- 172.21.15.46:0/2217411992 shutdown_connections 2023-10-19T12:40:39.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:39.203+0000 7ffaf4327700 1 --2- 172.21.15.46:0/2217411992 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffaec068b30 0x7ffaec10d670 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:39.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:39.203+0000 7ffaf4327700 1 --2- 172.21.15.46:0/2217411992 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffaec1067a0 0x7ffaec106b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:39.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:39.203+0000 7ffaf4327700 1 --2- 172.21.15.46:0/2217411992 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffaec068190 0x7ffaec0685f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:39.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:39.203+0000 7ffaf4327700 1 -- 172.21.15.46:0/2217411992 >> 172.21.15.46:0/2217411992 conn(0x7ffaec075790 msgr2=0x7ffaec075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:40:39.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:39.203+0000 7ffaf4327700 1 -- 172.21.15.46:0/2217411992 shutdown_connections 2023-10-19T12:40:39.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:39.203+0000 7ffaf4327700 1 -- 172.21.15.46:0/2217411992 wait complete. 2023-10-19T12:40:39.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:39.204+0000 7ffaf4327700 1 Processor -- start 2023-10-19T12:40:39.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:39.204+0000 7ffaf4327700 1 -- start start 2023-10-19T12:40:39.212 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:39.205+0000 7ffaf4327700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffaec068190 0x7ffaec0ff820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:40:39.212 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:39.205+0000 7ffaf4327700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffaec068b30 0x7ffaec0ffd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:40:39.212 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:39.205+0000 7ffaf4327700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffaec1067a0 0x7ffaec1002a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:40:39.212 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:39.205+0000 7ffaf4327700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaec1a5110 con 0x7ffaec068190 2023-10-19T12:40:39.213 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:39.205+0000 7ffaf4327700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaec1a5280 con 0x7ffaec1067a0 2023-10-19T12:40:39.213 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:39.205+0000 7ffaf4327700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaec1a5440 con 0x7ffaec068b30 2023-10-19T12:40:39.213 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:39.205+0000 7ffaf20c3700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffaec068190 0x7ffaec0ff820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:40:39.213 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:39.205+0000 7ffaf20c3700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffaec068190 0x7ffaec0ff820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47998/0 (socket says 172.21.15.46:47998) 2023-10-19T12:40:39.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:39.205+0000 7ffaf20c3700 1 -- 172.21.15.46:0/691522955 learned_addr learned my addr 172.21.15.46:0/691522955 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:40:39.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:39.205+0000 7ffaf18c2700 1 --2- 172.21.15.46:0/691522955 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffaec068b30 0x7ffaec0ffd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:40:39.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:39.205+0000 7ffaf28c4700 1 --2- 172.21.15.46:0/691522955 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffaec1067a0 0x7ffaec1002a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:40:39.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:39.206+0000 7ffaf20c3700 1 -- 172.21.15.46:0/691522955 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffaec068b30 msgr2=0x7ffaec0ffd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:40:39.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:39.206+0000 7ffaf20c3700 1 --2- 172.21.15.46:0/691522955 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffaec068b30 0x7ffaec0ffd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:39.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:39.206+0000 7ffaf20c3700 1 -- 172.21.15.46:0/691522955 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffaec1067a0 msgr2=0x7ffaec1002a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:40:39.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:39.206+0000 7ffaf20c3700 1 --2- 172.21.15.46:0/691522955 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffaec1067a0 0x7ffaec1002a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:39.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:39.206+0000 7ffaf20c3700 1 -- 172.21.15.46:0/691522955 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffae4009d00 con 0x7ffaec068190 2023-10-19T12:40:39.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:39.206+0000 7ffaf20c3700 1 --2- 172.21.15.46:0/691522955 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffaec068190 0x7ffaec0ff820 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ffae800e9a0 tx=0x7ffae800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:40:39.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:39.206+0000 7ffae37fe700 1 -- 172.21.15.46:0/691522955 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae8009790 con 0x7ffaec068190 2023-10-19T12:40:39.216 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:39.206+0000 7ffae37fe700 1 -- 172.21.15.46:0/691522955 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffae8010430 con 0x7ffaec068190 2023-10-19T12:40:39.216 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:39.206+0000 7ffaf4327700 1 -- 172.21.15.46:0/691522955 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaec1a5720 con 0x7ffaec068190 2023-10-19T12:40:39.216 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:39.206+0000 7ffae37fe700 1 -- 172.21.15.46:0/691522955 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae8018680 con 0x7ffaec068190 2023-10-19T12:40:39.217 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:39.206+0000 7ffaf4327700 1 -- 172.21.15.46:0/691522955 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaec1a5c20 con 0x7ffaec068190 2023-10-19T12:40:39.217 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:39.207+0000 7ffaf4327700 1 -- 172.21.15.46:0/691522955 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaec108d50 con 0x7ffaec068190 2023-10-19T12:40:39.218 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:39.209+0000 7ffae37fe700 1 -- 172.21.15.46:0/691522955 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7ffae80105a0 con 0x7ffaec068190 2023-10-19T12:40:39.218 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:39.210+0000 7ffae37fe700 1 --2- 172.21.15.46:0/691522955 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7ffad80a1480 0x7ffad80a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:40:39.218 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:39.211+0000 7ffae37fe700 1 -- 172.21.15.46:0/691522955 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7ffae8014070 con 0x7ffaec068190 2023-10-19T12:40:39.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:39.211+0000 7ffaf18c2700 1 --2- 172.21.15.46:0/691522955 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7ffad80a1480 0x7ffad80a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:40:39.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:39.211+0000 7ffaf18c2700 1 --2- 172.21.15.46:0/691522955 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7ffad80a1480 0x7ffad80a3940 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ffaec100f50 tx=0x7ffadc009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:40:39.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:39.215+0000 7ffae37fe700 1 -- 172.21.15.46:0/691522955 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ffae8052100 con 0x7ffaec068190 2023-10-19T12:40:39.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:39.424+0000 7ffaf4327700 1 -- 172.21.15.46:0/691522955 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ffaec100d00 con 0x7ffaec068190 2023-10-19T12:40:39.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:39.424+0000 7ffae37fe700 1 -- 172.21.15.46:0/691522955 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v80) v1 ==== 93+0+10 (secure 0 0 0) 0x7ffae80964b0 con 0x7ffaec068190 2023-10-19T12:40:39.428 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2023-10-19T12:40:39.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:39.427+0000 7ffaf4327700 1 -- 172.21.15.46:0/691522955 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7ffad80a1480 msgr2=0x7ffad80a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:40:39.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:39.427+0000 7ffaf4327700 1 --2- 172.21.15.46:0/691522955 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7ffad80a1480 0x7ffad80a3940 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ffaec100f50 tx=0x7ffadc009260 comp rx=0 tx=0).stop 2023-10-19T12:40:39.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:39.427+0000 7ffaf4327700 1 -- 172.21.15.46:0/691522955 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffaec068190 msgr2=0x7ffaec0ff820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:40:39.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:39.427+0000 7ffaf4327700 1 --2- 172.21.15.46:0/691522955 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffaec068190 0x7ffaec0ff820 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ffae800e9a0 tx=0x7ffae800ecb0 comp rx=0 tx=0).stop 2023-10-19T12:40:39.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:39.427+0000 7ffaf4327700 1 -- 172.21.15.46:0/691522955 shutdown_connections 2023-10-19T12:40:39.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:39.427+0000 7ffaf4327700 1 --2- 172.21.15.46:0/691522955 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffaec1067a0 0x7ffaec1002a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:39.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:39.427+0000 7ffaf4327700 1 --2- 172.21.15.46:0/691522955 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffaec068190 0x7ffaec0ff820 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:39.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:39.427+0000 7ffaf4327700 1 --2- 172.21.15.46:0/691522955 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7ffad80a1480 0x7ffad80a3940 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:39.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:39.427+0000 7ffaf4327700 1 --2- 172.21.15.46:0/691522955 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffaec068b30 0x7ffaec0ffd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:39.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:39.427+0000 7ffaf4327700 1 -- 172.21.15.46:0/691522955 >> 172.21.15.46:0/691522955 conn(0x7ffaec075790 msgr2=0x7ffaec0fd840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:40:39.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:39.427+0000 7ffaf4327700 1 -- 172.21.15.46:0/691522955 shutdown_connections 2023-10-19T12:40:39.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:39.427+0000 7ffaf4327700 1 -- 172.21.15.46:0/691522955 wait complete. 2023-10-19T12:40:39.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:39 smithi046 ceph-mon[98509]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-19T12:40:39.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:39 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/691522955' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-19T12:40:39.937 INFO:tasks.cephadm:Adding mds.a on smithi046 2023-10-19T12:40:39.937 INFO:tasks.cephadm:Adding mds.d on smithi046 2023-10-19T12:40:39.938 INFO:tasks.cephadm:Adding mds.g on smithi046 2023-10-19T12:40:39.938 INFO:tasks.cephadm:Adding mds.j on smithi046 2023-10-19T12:40:39.938 INFO:tasks.cephadm:Adding mds.b on smithi157 2023-10-19T12:40:39.939 INFO:tasks.cephadm:Adding mds.e on smithi157 2023-10-19T12:40:39.939 INFO:tasks.cephadm:Adding mds.h on smithi157 2023-10-19T12:40:39.939 INFO:tasks.cephadm:Adding mds.k on smithi157 2023-10-19T12:40:39.939 INFO:tasks.cephadm:Adding mds.c on smithi195 2023-10-19T12:40:39.940 INFO:tasks.cephadm:Adding mds.f on smithi195 2023-10-19T12:40:39.940 INFO:tasks.cephadm:Adding mds.i on smithi195 2023-10-19T12:40:39.940 INFO:tasks.cephadm:Adding mds.l on smithi195 2023-10-19T12:40:39.940 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph orch apply mds all '12;smithi046=a;smithi046=d;smithi046=g;smithi046=j;smithi157=b;smithi157=e;smithi157=h;smithi157=k;smithi195=c;smithi195=f;smithi195=i;smithi195=l' 2023-10-19T12:40:39.973 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:39 smithi195 ceph-mon[134493]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-19T12:40:39.974 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:39 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/691522955' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-19T12:40:40.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:39 smithi157 ceph-mon[134109]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-19T12:40:40.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:39 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/691522955' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-19T12:40:40.513 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.c/config 2023-10-19T12:40:41.711 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:41.708+0000 7f3a1f8c5700 1 -- 172.21.15.195:0/956327370 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3a18100940 msgr2=0x7f3a18100da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:40:41.711 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:41.708+0000 7f3a1f8c5700 1 --2- 172.21.15.195:0/956327370 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3a18100940 0x7f3a18100da0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3a14009990 tx=0x7f3a14009ca0 comp rx=0 tx=0).stop 2023-10-19T12:40:41.712 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:41.708+0000 7f3a1f8c5700 1 -- 172.21.15.195:0/956327370 shutdown_connections 2023-10-19T12:40:41.712 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:41.708+0000 7f3a1f8c5700 1 --2- 172.21.15.195:0/956327370 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3a181012e0 0x7f3a18107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:41.712 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:41.708+0000 7f3a1f8c5700 1 --2- 172.21.15.195:0/956327370 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a180ff740 0x7f3a180ffb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:41.712 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:41.708+0000 7f3a1f8c5700 1 --2- 172.21.15.195:0/956327370 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3a18100940 0x7f3a18100da0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:41.712 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:41.708+0000 7f3a1f8c5700 1 -- 172.21.15.195:0/956327370 >> 172.21.15.195:0/956327370 conn(0x7f3a180fad00 msgr2=0x7f3a180fd120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:40:41.713 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:41.708+0000 7f3a1f8c5700 1 -- 172.21.15.195:0/956327370 shutdown_connections 2023-10-19T12:40:41.713 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:41.708+0000 7f3a1f8c5700 1 -- 172.21.15.195:0/956327370 wait complete. 2023-10-19T12:40:41.715 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:41.709+0000 7f3a1f8c5700 1 Processor -- start 2023-10-19T12:40:41.715 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:41.709+0000 7f3a1f8c5700 1 -- start start 2023-10-19T12:40:41.715 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:41.709+0000 7f3a1f8c5700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3a180ff740 0x7f3a181956b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:40:41.717 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:41.709+0000 7f3a1f8c5700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a18100940 0x7f3a18195bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:40:41.717 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:41.709+0000 7f3a1f8c5700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3a181012e0 0x7f3a1819cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:40:41.717 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:41.709+0000 7f3a1f8c5700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1819d1f0 con 0x7f3a18100940 2023-10-19T12:40:41.718 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:41.709+0000 7f3a1f8c5700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1819d330 con 0x7f3a181012e0 2023-10-19T12:40:41.718 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:41.709+0000 7f3a1f8c5700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1819d4c0 con 0x7f3a180ff740 2023-10-19T12:40:41.718 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:41.709+0000 7f3a1d661700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3a180ff740 0x7f3a181956b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:40:41.718 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:41.709+0000 7f3a1d661700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3a180ff740 0x7f3a181956b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:49038/0 (socket says 172.21.15.195:49038) 2023-10-19T12:40:41.718 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:41.709+0000 7f3a1d661700 1 -- 172.21.15.195:0/3100490002 learned_addr learned my addr 172.21.15.195:0/3100490002 (peer_addr_for_me v2:172.21.15.195:0/0) 2023-10-19T12:40:41.719 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:41.709+0000 7f3a1ce60700 1 --2- 172.21.15.195:0/3100490002 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a18100940 0x7f3a18195bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:40:41.719 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:41.710+0000 7f3a1d661700 1 -- 172.21.15.195:0/3100490002 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3a181012e0 msgr2=0x7f3a1819cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:40:41.719 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:41.710+0000 7f3a1d661700 1 --2- 172.21.15.195:0/3100490002 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3a181012e0 0x7f3a1819cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:41.719 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:41.710+0000 7f3a1d661700 1 -- 172.21.15.195:0/3100490002 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a18100940 msgr2=0x7f3a18195bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:40:41.719 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:41.710+0000 7f3a1d661700 1 --2- 172.21.15.195:0/3100490002 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a18100940 0x7f3a18195bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:41.720 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:41.710+0000 7f3a1d661700 1 -- 172.21.15.195:0/3100490002 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a140095f0 con 0x7f3a180ff740 2023-10-19T12:40:41.720 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:41.710+0000 7f3a1d661700 1 --2- 172.21.15.195:0/3100490002 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3a180ff740 0x7f3a181956b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3a0800c9a0 tx=0x7f3a0800cd60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:40:41.720 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:41.710+0000 7f3a0e7fc700 1 -- 172.21.15.195:0/3100490002 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a08004220 con 0x7f3a180ff740 2023-10-19T12:40:41.720 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:41.710+0000 7f3a1f8c5700 1 -- 172.21.15.195:0/3100490002 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a1819d7a0 con 0x7f3a180ff740 2023-10-19T12:40:41.720 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:41.710+0000 7f3a0e7fc700 1 -- 172.21.15.195:0/3100490002 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3a08007d20 con 0x7f3a180ff740 2023-10-19T12:40:41.720 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:41.710+0000 7f3a0e7fc700 1 -- 172.21.15.195:0/3100490002 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a08003d00 con 0x7f3a180ff740 2023-10-19T12:40:41.721 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:41.710+0000 7f3a1f8c5700 1 -- 172.21.15.195:0/3100490002 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a1819dca0 con 0x7f3a180ff740 2023-10-19T12:40:41.721 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:41.711+0000 7f3a1f8c5700 1 -- 172.21.15.195:0/3100490002 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a1804e4c0 con 0x7f3a180ff740 2023-10-19T12:40:41.721 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:41.712+0000 7f3a0e7fc700 1 -- 172.21.15.195:0/3100490002 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f3a08004380 con 0x7f3a180ff740 2023-10-19T12:40:41.721 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:41.712+0000 7f3a0e7fc700 1 --2- 172.21.15.195:0/3100490002 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f3a040a1480 0x7f3a040a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:40:41.722 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:41.713+0000 7f3a0e7fc700 1 -- 172.21.15.195:0/3100490002 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f3a080cc490 con 0x7f3a180ff740 2023-10-19T12:40:41.722 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:41.713+0000 7f3a1ce60700 1 --2- 172.21.15.195:0/3100490002 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f3a040a1480 0x7f3a040a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:40:41.722 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:41.713+0000 7f3a1ce60700 1 --2- 172.21.15.195:0/3100490002 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f3a040a1480 0x7f3a040a3940 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3a1400b5c0 tx=0x7f3a14005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:40:41.723 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:41.717+0000 7f3a0e7fc700 1 -- 172.21.15.195:0/3100490002 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3a08095f90 con 0x7f3a180ff740 2023-10-19T12:40:41.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:41 smithi195 ceph-mon[134493]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-19T12:40:41.916 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:41.913+0000 7f3a1f8c5700 1 -- 172.21.15.195:0/3100490002 --> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi046=a;smithi046=d;smithi046=g;smithi046=j;smithi157=b;smithi157=e;smithi157=h;smithi157=k;smithi195=c;smithi195=f;smithi195=i;smithi195=l", "target": ["mon-mgr", ""]}) v1 -- 0x7f3a18106990 con 0x7f3a040a1480 2023-10-19T12:40:41.924 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:41.922+0000 7f3a0e7fc700 1 -- 172.21.15.195:0/3100490002 <== mgr.14150 v2:172.21.15.46:6800/3168073651 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7f3a18106990 con 0x7f3a040a1480 2023-10-19T12:40:41.925 INFO:teuthology.orchestra.run.smithi195.stdout:Scheduled mds.all update... 2023-10-19T12:40:41.926 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:41.924+0000 7f3a1f8c5700 1 -- 172.21.15.195:0/3100490002 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f3a040a1480 msgr2=0x7f3a040a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:40:41.927 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:41.924+0000 7f3a1f8c5700 1 --2- 172.21.15.195:0/3100490002 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f3a040a1480 0x7f3a040a3940 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3a1400b5c0 tx=0x7f3a14005fb0 comp rx=0 tx=0).stop 2023-10-19T12:40:41.927 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:41.924+0000 7f3a1f8c5700 1 -- 172.21.15.195:0/3100490002 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3a180ff740 msgr2=0x7f3a181956b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:40:41.927 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:41.924+0000 7f3a1f8c5700 1 --2- 172.21.15.195:0/3100490002 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3a180ff740 0x7f3a181956b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3a0800c9a0 tx=0x7f3a0800cd60 comp rx=0 tx=0).stop 2023-10-19T12:40:41.927 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:41.924+0000 7f3a1f8c5700 1 -- 172.21.15.195:0/3100490002 shutdown_connections 2023-10-19T12:40:41.927 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:41.924+0000 7f3a1f8c5700 1 --2- 172.21.15.195:0/3100490002 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3a181012e0 0x7f3a1819cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:41.928 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:41.924+0000 7f3a1f8c5700 1 --2- 172.21.15.195:0/3100490002 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f3a040a1480 0x7f3a040a3940 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:41.928 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:41.924+0000 7f3a1f8c5700 1 --2- 172.21.15.195:0/3100490002 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3a180ff740 0x7f3a181956b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:41.928 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:41.924+0000 7f3a1f8c5700 1 --2- 172.21.15.195:0/3100490002 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a18100940 0x7f3a18195bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:41.928 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:41.924+0000 7f3a1f8c5700 1 -- 172.21.15.195:0/3100490002 >> 172.21.15.195:0/3100490002 conn(0x7f3a180fad00 msgr2=0x7f3a18103d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:40:41.929 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:41.924+0000 7f3a1f8c5700 1 -- 172.21.15.195:0/3100490002 shutdown_connections 2023-10-19T12:40:41.929 INFO:teuthology.orchestra.run.smithi195.stderr:2023-10-19T12:40:41.924+0000 7f3a1f8c5700 1 -- 172.21.15.195:0/3100490002 wait complete. 2023-10-19T12:40:41.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:41 smithi046 ceph-mon[98509]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-19T12:40:42.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:41 smithi157 ceph-mon[134109]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-19T12:40:42.366 DEBUG:teuthology.orchestra.run.smithi046:mds.a> sudo journalctl -f -n 0 -u ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@mds.a.service 2023-10-19T12:40:42.371 DEBUG:teuthology.orchestra.run.smithi046:mds.d> sudo journalctl -f -n 0 -u ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@mds.d.service 2023-10-19T12:40:42.417 DEBUG:teuthology.orchestra.run.smithi046:mds.g> sudo journalctl -f -n 0 -u ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@mds.g.service 2023-10-19T12:40:42.454 INFO:journalctl@ceph.mds.a.smithi046.stdout:-- Logs begin at Thu 2023-10-19 12:15:13 UTC. -- 2023-10-19T12:40:42.457 DEBUG:teuthology.orchestra.run.smithi046:mds.j> sudo journalctl -f -n 0 -u ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@mds.j.service 2023-10-19T12:40:42.492 INFO:journalctl@ceph.mds.d.smithi046.stdout:-- Logs begin at Thu 2023-10-19 12:15:13 UTC. -- 2023-10-19T12:40:42.496 DEBUG:teuthology.orchestra.run.smithi157:mds.b> sudo journalctl -f -n 0 -u ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@mds.b.service 2023-10-19T12:40:42.499 DEBUG:teuthology.orchestra.run.smithi157:mds.e> sudo journalctl -f -n 0 -u ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@mds.e.service 2023-10-19T12:40:42.532 INFO:journalctl@ceph.mds.g.smithi046.stdout:-- Logs begin at Thu 2023-10-19 12:15:13 UTC. -- 2023-10-19T12:40:42.537 INFO:journalctl@ceph.mds.b.smithi157.stdout:-- Logs begin at Thu 2023-10-19 12:11:40 UTC. -- 2023-10-19T12:40:42.538 DEBUG:teuthology.orchestra.run.smithi157:mds.h> sudo journalctl -f -n 0 -u ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@mds.h.service 2023-10-19T12:40:42.566 INFO:journalctl@ceph.mds.e.smithi157.stdout:-- Logs begin at Thu 2023-10-19 12:11:40 UTC. -- 2023-10-19T12:40:42.567 INFO:journalctl@ceph.mds.j.smithi046.stdout:-- Logs begin at Thu 2023-10-19 12:15:13 UTC. -- 2023-10-19T12:40:42.568 DEBUG:teuthology.orchestra.run.smithi157:mds.k> sudo journalctl -f -n 0 -u ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@mds.k.service 2023-10-19T12:40:42.595 INFO:journalctl@ceph.mds.h.smithi157.stdout:-- Logs begin at Thu 2023-10-19 12:11:40 UTC. -- 2023-10-19T12:40:42.596 DEBUG:teuthology.orchestra.run.smithi195:mds.c> sudo journalctl -f -n 0 -u ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@mds.c.service 2023-10-19T12:40:42.598 DEBUG:teuthology.orchestra.run.smithi195:mds.f> sudo journalctl -f -n 0 -u ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@mds.f.service 2023-10-19T12:40:42.622 INFO:journalctl@ceph.mds.k.smithi157.stdout:-- Logs begin at Thu 2023-10-19 12:11:40 UTC. -- 2023-10-19T12:40:42.628 INFO:journalctl@ceph.mds.c.smithi195.stdout:-- Logs begin at Thu 2023-10-19 12:10:53 UTC. -- 2023-10-19T12:40:42.629 DEBUG:teuthology.orchestra.run.smithi195:mds.i> sudo journalctl -f -n 0 -u ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@mds.i.service 2023-10-19T12:40:42.657 INFO:journalctl@ceph.mds.f.smithi195.stdout:-- Logs begin at Thu 2023-10-19 12:10:53 UTC. -- 2023-10-19T12:40:42.658 DEBUG:teuthology.orchestra.run.smithi195:mds.l> sudo journalctl -f -n 0 -u ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@mds.l.service 2023-10-19T12:40:42.687 INFO:journalctl@ceph.mds.i.smithi195.stdout:-- Logs begin at Thu 2023-10-19 12:10:53 UTC. -- 2023-10-19T12:40:42.689 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2023-10-19T12:40:42.689 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-19T12:40:42.713 INFO:journalctl@ceph.mds.l.smithi195.stdout:-- Logs begin at Thu 2023-10-19 12:10:53 UTC. -- 2023-10-19T12:40:42.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:42.896+0000 7f12cbfff700 1 -- 172.21.15.46:0/923543763 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f12c41022d0 msgr2=0x7f12c4108b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:40:42.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:42.896+0000 7f12cbfff700 1 --2- 172.21.15.46:0/923543763 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f12c41022d0 0x7f12c4108b80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f12bc009fc0 tx=0x7f12bc00b330 comp rx=0 tx=0).stop 2023-10-19T12:40:42.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:42.896+0000 7f12cbfff700 1 -- 172.21.15.46:0/923543763 shutdown_connections 2023-10-19T12:40:42.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:42.896+0000 7f12cbfff700 1 --2- 172.21.15.46:0/923543763 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f12c41022d0 0x7f12c4108b80 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:42.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:42.896+0000 7f12cbfff700 1 --2- 172.21.15.46:0/923543763 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f12c4100740 0x7f12c4100b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:42.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:42.896+0000 7f12cbfff700 1 --2- 172.21.15.46:0/923543763 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f12c4101930 0x7f12c4101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:42.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:42.896+0000 7f12cbfff700 1 -- 172.21.15.46:0/923543763 >> 172.21.15.46:0/923543763 conn(0x7f12c40fbc90 msgr2=0x7f12c40fe0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:40:42.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:42.896+0000 7f12cbfff700 1 -- 172.21.15.46:0/923543763 shutdown_connections 2023-10-19T12:40:42.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:42.896+0000 7f12cbfff700 1 -- 172.21.15.46:0/923543763 wait complete. 2023-10-19T12:40:42.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:42.898+0000 7f12cbfff700 1 Processor -- start 2023-10-19T12:40:42.905 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:42.898+0000 7f12cbfff700 1 -- start start 2023-10-19T12:40:42.909 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:42.898+0000 7f12cbfff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f12c4100740 0x7f12c41967c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:40:42.909 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:42.898+0000 7f12cbfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f12c4101930 0x7f12c4196d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:40:42.910 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:42.898+0000 7f12cbfff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f12c41022d0 0x7f12c419dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:40:42.910 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:42.898+0000 7f12cbfff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12c419e2f0 con 0x7f12c4101930 2023-10-19T12:40:42.911 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:42.898+0000 7f12cbfff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12c419e430 con 0x7f12c4100740 2023-10-19T12:40:42.911 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:42.898+0000 7f12cbfff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12c419e5c0 con 0x7f12c41022d0 2023-10-19T12:40:42.911 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:42.898+0000 7f12c9d9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f12c4100740 0x7f12c41967c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:40:42.912 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:42.898+0000 7f12c959a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f12c4101930 0x7f12c4196d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:40:42.912 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:42.898+0000 7f12c9d9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f12c4100740 0x7f12c41967c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:49750/0 (socket says 172.21.15.46:49750) 2023-10-19T12:40:42.912 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:42.898+0000 7f12c9d9b700 1 -- 172.21.15.46:0/577133180 learned_addr learned my addr 172.21.15.46:0/577133180 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:40:42.913 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:42.898+0000 7f12ca59c700 1 --2- 172.21.15.46:0/577133180 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f12c41022d0 0x7f12c419dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:40:42.913 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:42.899+0000 7f12c9d9b700 1 -- 172.21.15.46:0/577133180 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f12c41022d0 msgr2=0x7f12c419dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:40:42.913 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:42.899+0000 7f12c9d9b700 1 --2- 172.21.15.46:0/577133180 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f12c41022d0 0x7f12c419dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:42.914 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:42.899+0000 7f12c9d9b700 1 -- 172.21.15.46:0/577133180 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f12c4101930 msgr2=0x7f12c4196d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:40:42.914 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:42.899+0000 7f12c9d9b700 1 --2- 172.21.15.46:0/577133180 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f12c4101930 0x7f12c4196d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:42.914 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:42.899+0000 7f12c9d9b700 1 -- 172.21.15.46:0/577133180 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12c00095f0 con 0x7f12c4100740 2023-10-19T12:40:42.915 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:42.899+0000 7f12c959a700 1 --2- 172.21.15.46:0/577133180 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f12c4101930 0x7f12c4196d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:40:42.915 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:42.899+0000 7f12c9d9b700 1 --2- 172.21.15.46:0/577133180 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f12c4100740 0x7f12c41967c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f12c000ebf0 tx=0x7f12c000ef00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:40:42.915 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:42.899+0000 7f12baffd700 1 -- 172.21.15.46:0/577133180 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c0009a10 con 0x7f12c4100740 2023-10-19T12:40:42.916 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:42.899+0000 7f12baffd700 1 -- 172.21.15.46:0/577133180 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f12c000cc90 con 0x7f12c4100740 2023-10-19T12:40:42.916 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:42.899+0000 7f12cbfff700 1 -- 172.21.15.46:0/577133180 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12bc009c40 con 0x7f12c4100740 2023-10-19T12:40:42.916 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:42.899+0000 7f12baffd700 1 -- 172.21.15.46:0/577133180 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c0018750 con 0x7f12c4100740 2023-10-19T12:40:42.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:42.899+0000 7f12cbfff700 1 -- 172.21.15.46:0/577133180 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12c419ec70 con 0x7f12c4100740 2023-10-19T12:40:42.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:42.900+0000 7f12cbfff700 1 -- 172.21.15.46:0/577133180 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12c4107af0 con 0x7f12c4100740 2023-10-19T12:40:42.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:42.902+0000 7f12baffd700 1 -- 172.21.15.46:0/577133180 <== mon.2 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f12c00188b0 con 0x7f12c4100740 2023-10-19T12:40:42.919 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:42.904+0000 7f12baffd700 1 --2- 172.21.15.46:0/577133180 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f12b00a1500 0x7f12b00a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:40:42.919 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:42.904+0000 7f12baffd700 1 -- 172.21.15.46:0/577133180 <== mon.2 v2:172.21.15.157:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f12c0014070 con 0x7f12c4100740 2023-10-19T12:40:42.920 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:42.904+0000 7f12c959a700 1 --2- 172.21.15.46:0/577133180 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f12b00a1500 0x7f12b00a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:40:42.920 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:42.904+0000 7f12c959a700 1 --2- 172.21.15.46:0/577133180 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f12b00a1500 0x7f12b00a39c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f12b4011490 tx=0x7f12b4009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:40:42.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:42.908+0000 7f12baffd700 1 -- 172.21.15.46:0/577133180 <== mon.2 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f12c00968d0 con 0x7f12c4100740 2023-10-19T12:40:43.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.125+0000 7f12cbfff700 1 -- 172.21.15.46:0/577133180 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f12c4067530 con 0x7f12c4100740 2023-10-19T12:40:43.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.126+0000 7f12baffd700 1 -- 172.21.15.46:0/577133180 <== mon.2 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+18415 (secure 0 0 0) 0x7f12c0099ef0 con 0x7f12c4100740 2023-10-19T12:40:43.130 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:40:43.131 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":80,"fsid":"96a8be3c-6e7b-11ee-8db6-212e2dc638e7","created":"2023-10-19T12:33:26.148713+0000","modified":"2023-10-19T12:40:32.226583+0000","last_up_change":"2023-10-19T12:40:30.761679+0000","last_in_change":"2023-10-19T12:40:13.663559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-19T12:37:07.175795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"346ce86b-a10a-4869-9fdb-c3c1d4161455","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6803","nonce":500237995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6805","nonce":500237995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6809","nonce":500237995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6807","nonce":500237995}]},"public_addr":"172.21.15.46:6803/500237995","cluster_addr":"172.21.15.46:6805/500237995","heartbeat_back_addr":"172.21.15.46:6809/500237995","heartbeat_front_addr":"172.21.15.46:6807/500237995","state":["exists","up"]},{"osd":1,"uuid":"02aae687-76c5-4124-bae4-9787ed571c28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6801","nonce":2496862790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6803","nonce":2496862790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6807","nonce":2496862790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6805","nonce":2496862790}]},"public_addr":"172.21.15.157:6801/2496862790","cluster_addr":"172.21.15.157:6803/2496862790","heartbeat_back_addr":"172.21.15.157:6807/2496862790","heartbeat_front_addr":"172.21.15.157:6805/2496862790","state":["exists","up"]},{"osd":2,"uuid":"d5360828-1f58-4380-b2ad-0c21ff850981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6801","nonce":4211767276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6803","nonce":4211767276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6807","nonce":4211767276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6805","nonce":4211767276}]},"public_addr":"172.21.15.195:6801/4211767276","cluster_addr":"172.21.15.195:6803/4211767276","heartbeat_back_addr":"172.21.15.195:6807/4211767276","heartbeat_front_addr":"172.21.15.195:6805/4211767276","state":["exists","up"]},{"osd":3,"uuid":"accb780f-49d0-43f8-b166-ee12c558ef00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6811","nonce":1964113352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6813","nonce":1964113352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6817","nonce":1964113352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6815","nonce":1964113352}]},"public_addr":"172.21.15.46:6811/1964113352","cluster_addr":"172.21.15.46:6813/1964113352","heartbeat_back_addr":"172.21.15.46:6817/1964113352","heartbeat_front_addr":"172.21.15.46:6815/1964113352","state":["exists","up"]},{"osd":4,"uuid":"e662886d-e989-4d02-8c1f-3c4671352b0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6809","nonce":3636910144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6811","nonce":3636910144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6815","nonce":3636910144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6813","nonce":3636910144}]},"public_addr":"172.21.15.157:6809/3636910144","cluster_addr":"172.21.15.157:6811/3636910144","heartbeat_back_addr":"172.21.15.157:6815/3636910144","heartbeat_front_addr":"172.21.15.157:6813/3636910144","state":["exists","up"]},{"osd":5,"uuid":"9597e0ce-14ea-407d-90fe-f74bccee38b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6809","nonce":4071287969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6811","nonce":4071287969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6815","nonce":4071287969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6813","nonce":4071287969}]},"public_addr":"172.21.15.195:6809/4071287969","cluster_addr":"172.21.15.195:6811/4071287969","heartbeat_back_addr":"172.21.15.195:6815/4071287969","heartbeat_front_addr":"172.21.15.195:6813/4071287969","state":["exists","up"]},{"osd":6,"uuid":"6b78ba38-f60e-4cb6-b01c-cecc1820e8e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6819","nonce":1842285555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6821","nonce":1842285555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6825","nonce":1842285555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6823","nonce":1842285555}]},"public_addr":"172.21.15.46:6819/1842285555","cluster_addr":"172.21.15.46:6821/1842285555","heartbeat_back_addr":"172.21.15.46:6825/1842285555","heartbeat_front_addr":"172.21.15.46:6823/1842285555","state":["exists","up"]},{"osd":7,"uuid":"59a0899f-3bcd-4db2-b544-24df3a536749","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6817","nonce":3498672588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6819","nonce":3498672588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6823","nonce":3498672588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6821","nonce":3498672588}]},"public_addr":"172.21.15.157:6817/3498672588","cluster_addr":"172.21.15.157:6819/3498672588","heartbeat_back_addr":"172.21.15.157:6823/3498672588","heartbeat_front_addr":"172.21.15.157:6821/3498672588","state":["exists","up"]},{"osd":8,"uuid":"9c3c9835-043a-4fb5-a9ee-edf8caf6b605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6817","nonce":74230104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6819","nonce":74230104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6823","nonce":74230104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6821","nonce":74230104}]},"public_addr":"172.21.15.195:6817/74230104","cluster_addr":"172.21.15.195:6819/74230104","heartbeat_back_addr":"172.21.15.195:6823/74230104","heartbeat_front_addr":"172.21.15.195:6821/74230104","state":["exists","up"]},{"osd":9,"uuid":"3f18f506-a577-4b7c-ae0d-9351c07e81f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6827","nonce":3472581046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6829","nonce":3472581046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6833","nonce":3472581046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6831","nonce":3472581046}]},"public_addr":"172.21.15.46:6827/3472581046","cluster_addr":"172.21.15.46:6829/3472581046","heartbeat_back_addr":"172.21.15.46:6833/3472581046","heartbeat_front_addr":"172.21.15.46:6831/3472581046","state":["exists","up"]},{"osd":10,"uuid":"1ed01854-443a-4acf-9293-7ca0d451a93d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6825","nonce":2378416559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6827","nonce":2378416559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6831","nonce":2378416559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6829","nonce":2378416559}]},"public_addr":"172.21.15.157:6825/2378416559","cluster_addr":"172.21.15.157:6827/2378416559","heartbeat_back_addr":"172.21.15.157:6831/2378416559","heartbeat_front_addr":"172.21.15.157:6829/2378416559","state":["exists","up"]},{"osd":11,"uuid":"021398c0-9184-4647-8220-e40f6705ca90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6825","nonce":3075632222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6827","nonce":3075632222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6831","nonce":3075632222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6829","nonce":3075632222}]},"public_addr":"172.21.15.195:6825/3075632222","cluster_addr":"172.21.15.195:6827/3075632222","heartbeat_back_addr":"172.21.15.195:6831/3075632222","heartbeat_front_addr":"172.21.15.195:6829/3075632222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:36:22.002614+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:36:44.098031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:37:04.518341+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:37:30.796462+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:37:52.756555+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:38:13.403168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:38:39.058472+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:39:01.106893+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:39:21.908334+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:39:46.843884+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:40:08.792020+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:40:29.282974+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.46:0/3248595150":"2023-10-20T12:34:26.552115+0000","172.21.15.46:0/3624849341":"2023-10-20T12:34:26.552115+0000","172.21.15.46:0/1844094590":"2023-10-20T12:34:26.552115+0000","172.21.15.46:6801/20022894":"2023-10-20T12:34:26.552115+0000","172.21.15.46:0/3969790632":"2023-10-20T12:34:00.135248+0000","172.21.15.46:0/2331135821":"2023-10-20T12:34:00.135248+0000","172.21.15.46:6800/51664346":"2023-10-20T12:34:00.135248+0000","172.21.15.46:6801/51664346":"2023-10-20T12:34:00.135248+0000","172.21.15.46:0/585851467":"2023-10-20T12:34:00.135248+0000","172.21.15.46:6800/20022894":"2023-10-20T12:34:26.552115+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-19T12:40:43.135 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.129+0000 7f12cbfff700 1 -- 172.21.15.46:0/577133180 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f12b00a1500 msgr2=0x7f12b00a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:40:43.135 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.129+0000 7f12cbfff700 1 --2- 172.21.15.46:0/577133180 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f12b00a1500 0x7f12b00a39c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f12b4011490 tx=0x7f12b4009260 comp rx=0 tx=0).stop 2023-10-19T12:40:43.135 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.129+0000 7f12cbfff700 1 -- 172.21.15.46:0/577133180 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f12c4100740 msgr2=0x7f12c41967c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:40:43.135 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.129+0000 7f12cbfff700 1 --2- 172.21.15.46:0/577133180 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f12c4100740 0x7f12c41967c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f12c000ebf0 tx=0x7f12c000ef00 comp rx=0 tx=0).stop 2023-10-19T12:40:43.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.129+0000 7f12cbfff700 1 -- 172.21.15.46:0/577133180 shutdown_connections 2023-10-19T12:40:43.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.129+0000 7f12cbfff700 1 --2- 172.21.15.46:0/577133180 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f12b00a1500 0x7f12b00a39c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:43.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.129+0000 7f12cbfff700 1 --2- 172.21.15.46:0/577133180 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f12c41022d0 0x7f12c419dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:43.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.129+0000 7f12cbfff700 1 --2- 172.21.15.46:0/577133180 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f12c4100740 0x7f12c41967c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:43.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.129+0000 7f12cbfff700 1 --2- 172.21.15.46:0/577133180 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f12c4101930 0x7f12c4196d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:43.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.129+0000 7f12cbfff700 1 -- 172.21.15.46:0/577133180 >> 172.21.15.46:0/577133180 conn(0x7f12c40fbc90 msgr2=0x7f12c4104c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:40:43.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.129+0000 7f12cbfff700 1 -- 172.21.15.46:0/577133180 shutdown_connections 2023-10-19T12:40:43.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.129+0000 7f12cbfff700 1 -- 172.21.15.46:0/577133180 wait complete. 2023-10-19T12:40:43.150 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:42 smithi046 ceph-mon[98509]: from='client.24550 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi046=a;smithi046=d;smithi046=g;smithi046=j;smithi157=b;smithi157=e;smithi157=h;smithi157=k;smithi195=c;smithi195=f;smithi195=i;smithi195=l", "target": ["mon-mgr", ""]}]: dispatch 2023-10-19T12:40:43.151 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:42 smithi046 ceph-mon[98509]: Saving service mds.all spec with placement smithi046=a;smithi046=d;smithi046=g;smithi046=j;smithi157=b;smithi157=e;smithi157=h;smithi157=k;smithi195=c;smithi195=f;smithi195=i;smithi195=l;count:12 2023-10-19T12:40:43.151 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:42 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:43.151 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:42 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:40:43.151 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:42 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:40:43.152 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:42 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:40:43.152 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:42 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:43.152 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:42 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-19T12:40:43.152 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:42 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-19T12:40:43.153 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:42 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:40:43.153 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:42 smithi046 ceph-mon[98509]: Deploying daemon mds.l on smithi195 2023-10-19T12:40:43.153 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:42 smithi046 ceph-mon[98509]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-19T12:40:43.155 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-19T12:37:07.175795+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-19T12:40:43.155 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-19T12:40:43.192 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:42 smithi195 ceph-mon[134493]: from='client.24550 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi046=a;smithi046=d;smithi046=g;smithi046=j;smithi157=b;smithi157=e;smithi157=h;smithi157=k;smithi195=c;smithi195=f;smithi195=i;smithi195=l", "target": ["mon-mgr", ""]}]: dispatch 2023-10-19T12:40:43.193 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:42 smithi195 ceph-mon[134493]: Saving service mds.all spec with placement smithi046=a;smithi046=d;smithi046=g;smithi046=j;smithi157=b;smithi157=e;smithi157=h;smithi157=k;smithi195=c;smithi195=f;smithi195=i;smithi195=l;count:12 2023-10-19T12:40:43.193 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:42 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:43.193 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:42 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:40:43.193 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:42 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:40:43.193 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:42 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:40:43.194 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:42 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:43.194 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:42 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-19T12:40:43.194 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:42 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-19T12:40:43.194 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:42 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:40:43.194 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:42 smithi195 ceph-mon[134493]: Deploying daemon mds.l on smithi195 2023-10-19T12:40:43.195 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:42 smithi195 ceph-mon[134493]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-19T12:40:43.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:42 smithi157 ceph-mon[134109]: from='client.24550 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi046=a;smithi046=d;smithi046=g;smithi046=j;smithi157=b;smithi157=e;smithi157=h;smithi157=k;smithi195=c;smithi195=f;smithi195=i;smithi195=l", "target": ["mon-mgr", ""]}]: dispatch 2023-10-19T12:40:43.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:42 smithi157 ceph-mon[134109]: Saving service mds.all spec with placement smithi046=a;smithi046=d;smithi046=g;smithi046=j;smithi157=b;smithi157=e;smithi157=h;smithi157=k;smithi195=c;smithi195=f;smithi195=i;smithi195=l;count:12 2023-10-19T12:40:43.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:42 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:43.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:42 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:40:43.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:42 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:40:43.339 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:42 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:40:43.339 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:42 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:43.339 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:42 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-19T12:40:43.339 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:42 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-19T12:40:43.339 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:42 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:40:43.340 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:42 smithi157 ceph-mon[134109]: Deploying daemon mds.l on smithi195 2023-10-19T12:40:43.340 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:42 smithi157 ceph-mon[134109]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-19T12:40:43.363 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.360+0000 7f8810bff700 1 -- 172.21.15.46:0/3756550257 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f880c101990 msgr2=0x7f880c101df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:40:43.364 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.360+0000 7f8810bff700 1 --2- 172.21.15.46:0/3756550257 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f880c101990 0x7f880c101df0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f87f40099c0 tx=0x7f87f4009cd0 comp rx=0 tx=0).stop 2023-10-19T12:40:43.364 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.360+0000 7f8810bff700 1 -- 172.21.15.46:0/3756550257 shutdown_connections 2023-10-19T12:40:43.364 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.360+0000 7f8810bff700 1 --2- 172.21.15.46:0/3756550257 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f880c102330 0x7f880c108be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:43.364 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.360+0000 7f8810bff700 1 --2- 172.21.15.46:0/3756550257 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f880c1007a0 0x7f880c100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:43.365 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.360+0000 7f8810bff700 1 --2- 172.21.15.46:0/3756550257 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f880c101990 0x7f880c101df0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:43.365 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.360+0000 7f8810bff700 1 -- 172.21.15.46:0/3756550257 >> 172.21.15.46:0/3756550257 conn(0x7f880c0fbcf0 msgr2=0x7f880c0fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:40:43.365 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.360+0000 7f8810bff700 1 -- 172.21.15.46:0/3756550257 shutdown_connections 2023-10-19T12:40:43.365 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.360+0000 7f8810bff700 1 -- 172.21.15.46:0/3756550257 wait complete. 2023-10-19T12:40:43.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.361+0000 7f8810bff700 1 Processor -- start 2023-10-19T12:40:43.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.361+0000 7f8810bff700 1 -- start start 2023-10-19T12:40:43.368 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.361+0000 7f8810bff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f880c1007a0 0x7f880c074550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:40:43.368 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.361+0000 7f8810bff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f880c101990 0x7f880c072be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:40:43.368 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.361+0000 7f8810bff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f880c102330 0x7f880c073120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:40:43.368 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.362+0000 7f8810bff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f880c0738c0 con 0x7f880c1007a0 2023-10-19T12:40:43.368 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.362+0000 7f8810bff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f880c073a30 con 0x7f880c102330 2023-10-19T12:40:43.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.362+0000 7f8810bff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f880c1a0760 con 0x7f880c101990 2023-10-19T12:40:43.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.362+0000 7f880a59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f880c1007a0 0x7f880c074550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:40:43.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.362+0000 7f8803fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f880c101990 0x7f880c072be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:40:43.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.362+0000 7f880a59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f880c1007a0 0x7f880c074550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48606/0 (socket says 172.21.15.46:48606) 2023-10-19T12:40:43.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.362+0000 7f880a59c700 1 -- 172.21.15.46:0/350303927 learned_addr learned my addr 172.21.15.46:0/350303927 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:40:43.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.362+0000 7f880ad9d700 1 --2- 172.21.15.46:0/350303927 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f880c102330 0x7f880c073120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:40:43.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.362+0000 7f8803fff700 1 -- 172.21.15.46:0/350303927 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f880c102330 msgr2=0x7f880c073120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:40:43.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.362+0000 7f8803fff700 1 --2- 172.21.15.46:0/350303927 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f880c102330 0x7f880c073120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:43.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.362+0000 7f8803fff700 1 -- 172.21.15.46:0/350303927 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f880c1007a0 msgr2=0x7f880c074550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:40:43.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.362+0000 7f8803fff700 1 --2- 172.21.15.46:0/350303927 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f880c1007a0 0x7f880c074550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:43.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.362+0000 7f8803fff700 1 -- 172.21.15.46:0/350303927 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87f40095f0 con 0x7f880c101990 2023-10-19T12:40:43.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.362+0000 7f880a59c700 1 --2- 172.21.15.46:0/350303927 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f880c1007a0 0x7f880c074550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:40:43.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.362+0000 7f8803fff700 1 --2- 172.21.15.46:0/350303927 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f880c101990 0x7f880c072be0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f87f4009fd0 tx=0x7f87f400fa00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:40:43.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.363+0000 7f88037fe700 1 -- 172.21.15.46:0/350303927 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f401d070 con 0x7f880c101990 2023-10-19T12:40:43.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.363+0000 7f88037fe700 1 -- 172.21.15.46:0/350303927 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f87f400bda0 con 0x7f880c101990 2023-10-19T12:40:43.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.363+0000 7f88037fe700 1 -- 172.21.15.46:0/350303927 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f4004b00 con 0x7f880c101990 2023-10-19T12:40:43.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.363+0000 7f8810bff700 1 -- 172.21.15.46:0/350303927 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f880c1a0990 con 0x7f880c101990 2023-10-19T12:40:43.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.363+0000 7f8810bff700 1 -- 172.21.15.46:0/350303927 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f880c1a0d00 con 0x7f880c101990 2023-10-19T12:40:43.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.364+0000 7f8810bff700 1 -- 172.21.15.46:0/350303927 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f880c107c40 con 0x7f880c101990 2023-10-19T12:40:43.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.366+0000 7f88037fe700 1 -- 172.21.15.46:0/350303927 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f87f4004c60 con 0x7f880c101990 2023-10-19T12:40:43.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.367+0000 7f88037fe700 1 --2- 172.21.15.46:0/350303927 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f87f80a1480 0x7f87f80a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:40:43.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.367+0000 7f88037fe700 1 -- 172.21.15.46:0/350303927 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f87f40cd660 con 0x7f880c101990 2023-10-19T12:40:43.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.368+0000 7f880a59c700 1 --2- 172.21.15.46:0/350303927 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f87f80a1480 0x7f87f80a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:40:43.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.368+0000 7f880a59c700 1 --2- 172.21.15.46:0/350303927 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f87f80a1480 0x7f87f80a3940 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f87fc0105c0 tx=0x7f87fc00b4a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:40:43.375 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.369+0000 7f88037fe700 1 -- 172.21.15.46:0/350303927 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f87f4097270 con 0x7f880c101990 2023-10-19T12:40:43.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.580+0000 7f8810bff700 1 -- 172.21.15.46:0/350303927 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f880c10c000 con 0x7f880c101990 2023-10-19T12:40:43.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.581+0000 7f88037fe700 1 -- 172.21.15.46:0/350303927 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v80) v1 ==== 93+0+10 (secure 0 0 0) 0x7f87f409a890 con 0x7f880c101990 2023-10-19T12:40:43.584 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2023-10-19T12:40:43.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.583+0000 7f8810bff700 1 -- 172.21.15.46:0/350303927 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f87f80a1480 msgr2=0x7f87f80a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:40:43.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.583+0000 7f8810bff700 1 --2- 172.21.15.46:0/350303927 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f87f80a1480 0x7f87f80a3940 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f87fc0105c0 tx=0x7f87fc00b4a0 comp rx=0 tx=0).stop 2023-10-19T12:40:43.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.583+0000 7f8810bff700 1 -- 172.21.15.46:0/350303927 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f880c101990 msgr2=0x7f880c072be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:40:43.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.583+0000 7f8810bff700 1 --2- 172.21.15.46:0/350303927 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f880c101990 0x7f880c072be0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f87f4009fd0 tx=0x7f87f400fa00 comp rx=0 tx=0).stop 2023-10-19T12:40:43.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.583+0000 7f8810bff700 1 -- 172.21.15.46:0/350303927 shutdown_connections 2023-10-19T12:40:43.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.583+0000 7f8810bff700 1 --2- 172.21.15.46:0/350303927 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f880c102330 0x7f880c073120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:43.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.583+0000 7f8810bff700 1 --2- 172.21.15.46:0/350303927 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f880c1007a0 0x7f880c074550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:43.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.583+0000 7f8810bff700 1 --2- 172.21.15.46:0/350303927 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f87f80a1480 0x7f87f80a3940 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:43.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.583+0000 7f8810bff700 1 --2- 172.21.15.46:0/350303927 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f880c101990 0x7f880c072be0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:43.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.583+0000 7f8810bff700 1 -- 172.21.15.46:0/350303927 >> 172.21.15.46:0/350303927 conn(0x7f880c0fbcf0 msgr2=0x7f880c104d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:40:43.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.583+0000 7f8810bff700 1 -- 172.21.15.46:0/350303927 shutdown_connections 2023-10-19T12:40:43.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.583+0000 7f8810bff700 1 -- 172.21.15.46:0/350303927 wait complete. 2023-10-19T12:40:43.606 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-19T12:40:43.630 INFO:journalctl@ceph.mds.l.smithi195.stdout:Oct 19 12:40:43 smithi195 systemd[1]: Starting Ceph mds.l for 96a8be3c-6e7b-11ee-8db6-212e2dc638e7... 2023-10-19T12:40:43.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.807+0000 7fcf0fbff700 1 -- 172.21.15.46:0/652506080 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf081022d0 msgr2=0x7fcf08108b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:40:43.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.807+0000 7fcf0fbff700 1 --2- 172.21.15.46:0/652506080 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf081022d0 0x7fcf08108b80 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fcf0000b0d0 tx=0x7fcf0000b3e0 comp rx=0 tx=0).stop 2023-10-19T12:40:43.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.808+0000 7fcf0fbff700 1 -- 172.21.15.46:0/652506080 shutdown_connections 2023-10-19T12:40:43.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.808+0000 7fcf0fbff700 1 --2- 172.21.15.46:0/652506080 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf081022d0 0x7fcf08108b80 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:43.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.808+0000 7fcf0fbff700 1 --2- 172.21.15.46:0/652506080 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf08100740 0x7fcf08100b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:43.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.808+0000 7fcf0fbff700 1 --2- 172.21.15.46:0/652506080 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf08101930 0x7fcf08101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:43.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.808+0000 7fcf0fbff700 1 -- 172.21.15.46:0/652506080 >> 172.21.15.46:0/652506080 conn(0x7fcf080fbc90 msgr2=0x7fcf080fe0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:40:43.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.808+0000 7fcf0fbff700 1 -- 172.21.15.46:0/652506080 shutdown_connections 2023-10-19T12:40:43.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.808+0000 7fcf0fbff700 1 -- 172.21.15.46:0/652506080 wait complete. 2023-10-19T12:40:43.815 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.809+0000 7fcf0fbff700 1 Processor -- start 2023-10-19T12:40:43.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.809+0000 7fcf0fbff700 1 -- start start 2023-10-19T12:40:43.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.810+0000 7fcf0fbff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf08100740 0x7fcf08074550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:40:43.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.810+0000 7fcf0fbff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf08101930 0x7fcf08072be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:40:43.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.810+0000 7fcf0fbff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf081022d0 0x7fcf08073120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:40:43.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.810+0000 7fcf0fbff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf080738c0 con 0x7fcf081022d0 2023-10-19T12:40:43.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.810+0000 7fcf0fbff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf08073a30 con 0x7fcf08101930 2023-10-19T12:40:43.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.810+0000 7fcf0fbff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf081a0820 con 0x7fcf08100740 2023-10-19T12:40:43.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.810+0000 7fcf0d99b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf08100740 0x7fcf08074550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:40:43.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.810+0000 7fcf0d99b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf08100740 0x7fcf08074550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:46576/0 (socket says 172.21.15.46:46576) 2023-10-19T12:40:43.818 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.810+0000 7fcf0e19c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf081022d0 0x7fcf08073120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:40:43.818 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.810+0000 7fcf0d99b700 1 -- 172.21.15.46:0/2221768375 learned_addr learned my addr 172.21.15.46:0/2221768375 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:40:43.818 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.810+0000 7fcf0d19a700 1 --2- 172.21.15.46:0/2221768375 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf08101930 0x7fcf08072be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:40:43.818 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.811+0000 7fcf0e19c700 1 -- 172.21.15.46:0/2221768375 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf08100740 msgr2=0x7fcf08074550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:40:43.818 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.811+0000 7fcf0e19c700 1 --2- 172.21.15.46:0/2221768375 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf08100740 0x7fcf08074550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:43.819 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.811+0000 7fcf0e19c700 1 -- 172.21.15.46:0/2221768375 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf08101930 msgr2=0x7fcf08072be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:40:43.819 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.811+0000 7fcf0e19c700 1 --2- 172.21.15.46:0/2221768375 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf08101930 0x7fcf08072be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:43.819 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.811+0000 7fcf0e19c700 1 -- 172.21.15.46:0/2221768375 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf00009d00 con 0x7fcf081022d0 2023-10-19T12:40:43.819 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.811+0000 7fcf0d99b700 1 --2- 172.21.15.46:0/2221768375 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf08100740 0x7fcf08074550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:40:43.819 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.811+0000 7fcf0e19c700 1 --2- 172.21.15.46:0/2221768375 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf081022d0 0x7fcf08073120 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fcf00007b60 tx=0x7fcf00008e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:40:43.820 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.811+0000 7fcefeffd700 1 -- 172.21.15.46:0/2221768375 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf0000e040 con 0x7fcf081022d0 2023-10-19T12:40:43.820 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.811+0000 7fcefeffd700 1 -- 172.21.15.46:0/2221768375 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcf00005070 con 0x7fcf081022d0 2023-10-19T12:40:43.820 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.811+0000 7fcf0fbff700 1 -- 172.21.15.46:0/2221768375 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf081a0a50 con 0x7fcf081022d0 2023-10-19T12:40:43.820 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.811+0000 7fcefeffd700 1 -- 172.21.15.46:0/2221768375 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf0001d6d0 con 0x7fcf081022d0 2023-10-19T12:40:43.820 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.811+0000 7fcf0fbff700 1 -- 172.21.15.46:0/2221768375 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf081a0e70 con 0x7fcf081022d0 2023-10-19T12:40:43.820 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.812+0000 7fcf0fbff700 1 -- 172.21.15.46:0/2221768375 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf08107af0 con 0x7fcf081022d0 2023-10-19T12:40:43.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.814+0000 7fcefeffd700 1 -- 172.21.15.46:0/2221768375 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fcf000051e0 con 0x7fcf081022d0 2023-10-19T12:40:43.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.816+0000 7fcefeffd700 1 --2- 172.21.15.46:0/2221768375 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fcef40a1480 0x7fcef40a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:40:43.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.816+0000 7fcefeffd700 1 -- 172.21.15.46:0/2221768375 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fcf000cdcc0 con 0x7fcf081022d0 2023-10-19T12:40:43.823 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.816+0000 7fcf0d99b700 1 --2- 172.21.15.46:0/2221768375 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fcef40a1480 0x7fcef40a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:40:43.823 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.817+0000 7fcf0d99b700 1 --2- 172.21.15.46:0/2221768375 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fcef40a1480 0x7fcef40a3940 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fcf04005950 tx=0x7fcf04009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:40:43.823 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:43.818+0000 7fcefeffd700 1 -- 172.21.15.46:0/2221768375 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fcf00097840 con 0x7fcf081022d0 2023-10-19T12:40:44.022 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:43 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/577133180' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-19T12:40:44.022 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:43 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/350303927' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-19T12:40:44.023 INFO:journalctl@ceph.mds.l.smithi195.stdout:Oct 19 12:40:43 smithi195 podman[171040]: 2023-10-19T12:40:44.023 INFO:journalctl@ceph.mds.l.smithi195.stdout:Oct 19 12:40:43 smithi195 bash[171040]: ff2a9bcd5d4fd967c3ef99a0ff02878bd4b271aa88959b043638dffb0b55336c 2023-10-19T12:40:44.024 INFO:journalctl@ceph.mds.l.smithi195.stdout:Oct 19 12:40:43 smithi195 ceph-mds[171081]: -- 172.21.15.195:0/51903617 <== mon.1 v2:172.21.15.195:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5612ab3651e0 con 0x5612ab33a800 2023-10-19T12:40:44.024 INFO:journalctl@ceph.mds.l.smithi195.stdout:Oct 19 12:40:43 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mds-l[171056]: starting mds.l at 2023-10-19T12:40:44.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:44.080+0000 7fcf0fbff700 1 -- 172.21.15.46:0/2221768375 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcf08067530 con 0x7fcf081022d0 2023-10-19T12:40:44.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:44.081+0000 7fcefeffd700 1 -- 172.21.15.46:0/2221768375 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1328 (secure 0 0 0) 0x7fcf0009ae60 con 0x7fcf081022d0 2023-10-19T12:40:44.084 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:40:44.085 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24574,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6833/3629933235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3629933235},{"type":"v1","addr":"172.21.15.195:6833","nonce":3629933235}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-10-19T12:40:44.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:44.083+0000 7fcf0fbff700 1 -- 172.21.15.46:0/2221768375 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fcef40a1480 msgr2=0x7fcef40a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:40:44.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:44.083+0000 7fcf0fbff700 1 --2- 172.21.15.46:0/2221768375 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fcef40a1480 0x7fcef40a3940 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fcf04005950 tx=0x7fcf04009260 comp rx=0 tx=0).stop 2023-10-19T12:40:44.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:44.083+0000 7fcf0fbff700 1 -- 172.21.15.46:0/2221768375 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf081022d0 msgr2=0x7fcf08073120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:40:44.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:44.083+0000 7fcf0fbff700 1 --2- 172.21.15.46:0/2221768375 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf081022d0 0x7fcf08073120 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fcf00007b60 tx=0x7fcf00008e40 comp rx=0 tx=0).stop 2023-10-19T12:40:44.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:44.083+0000 7fcf0fbff700 1 -- 172.21.15.46:0/2221768375 shutdown_connections 2023-10-19T12:40:44.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:44.083+0000 7fcf0fbff700 1 --2- 172.21.15.46:0/2221768375 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf081022d0 0x7fcf08073120 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:44.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:44.083+0000 7fcf0fbff700 1 --2- 172.21.15.46:0/2221768375 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fcef40a1480 0x7fcef40a3940 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:44.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:44.083+0000 7fcf0fbff700 1 --2- 172.21.15.46:0/2221768375 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf08100740 0x7fcf08074550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:44.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:44.083+0000 7fcf0fbff700 1 --2- 172.21.15.46:0/2221768375 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf08101930 0x7fcf08072be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:44.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:44.083+0000 7fcf0fbff700 1 -- 172.21.15.46:0/2221768375 >> 172.21.15.46:0/2221768375 conn(0x7fcf080fbc90 msgr2=0x7fcf08104c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:40:44.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:44.083+0000 7fcf0fbff700 1 -- 172.21.15.46:0/2221768375 shutdown_connections 2023-10-19T12:40:44.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:44.083+0000 7fcf0fbff700 1 -- 172.21.15.46:0/2221768375 wait complete. 2023-10-19T12:40:44.089 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 2 2023-10-19T12:40:44.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:43 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/577133180' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-19T12:40:44.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:43 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/350303927' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-19T12:40:44.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:43 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/577133180' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-19T12:40:44.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:43 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/350303927' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-19T12:40:44.380 INFO:journalctl@ceph.mds.l.smithi195.stdout:Oct 19 12:40:44 smithi195 systemd[1]: Started Ceph mds.l for 96a8be3c-6e7b-11ee-8db6-212e2dc638e7. 2023-10-19T12:40:45.048 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:44 smithi157 ceph-mon[134109]: mds.? [v2:172.21.15.195:6832/3629933235,v1:172.21.15.195:6833/3629933235] up:boot 2023-10-19T12:40:45.048 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:44 smithi157 ceph-mon[134109]: fsmap 1 up:standby 2023-10-19T12:40:45.048 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:44 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-10-19T12:40:45.048 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:44 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:45.049 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:44 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:45.049 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:44 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:45.049 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:44 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-19T12:40:45.049 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:44 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-19T12:40:45.049 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:44 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:40:45.050 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:44 smithi157 ceph-mon[134109]: Deploying daemon mds.k on smithi157 2023-10-19T12:40:45.050 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:44 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/2221768375' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-19T12:40:45.050 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:44 smithi157 ceph-mon[134109]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-19T12:40:45.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:44 smithi195 ceph-mon[134493]: mds.? [v2:172.21.15.195:6832/3629933235,v1:172.21.15.195:6833/3629933235] up:boot 2023-10-19T12:40:45.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:44 smithi195 ceph-mon[134493]: fsmap 1 up:standby 2023-10-19T12:40:45.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:44 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-10-19T12:40:45.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:44 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:45.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:44 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:45.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:44 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:45.382 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:44 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-19T12:40:45.382 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:44 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-19T12:40:45.382 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:44 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:40:45.382 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:44 smithi195 ceph-mon[134493]: Deploying daemon mds.k on smithi157 2023-10-19T12:40:45.383 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:44 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/2221768375' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-19T12:40:45.383 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:44 smithi195 ceph-mon[134493]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-19T12:40:45.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:44 smithi046 ceph-mon[98509]: mds.? [v2:172.21.15.195:6832/3629933235,v1:172.21.15.195:6833/3629933235] up:boot 2023-10-19T12:40:45.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:44 smithi046 ceph-mon[98509]: fsmap 1 up:standby 2023-10-19T12:40:45.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:44 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-10-19T12:40:45.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:44 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:45.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:44 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:45.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:44 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:45.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:44 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-19T12:40:45.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:44 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-19T12:40:45.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:44 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:40:45.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:44 smithi046 ceph-mon[98509]: Deploying daemon mds.k on smithi157 2023-10-19T12:40:45.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:44 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/2221768375' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-19T12:40:45.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:44 smithi046 ceph-mon[98509]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-19T12:40:45.587 INFO:journalctl@ceph.mds.k.smithi157.stdout:Oct 19 12:40:45 smithi157 systemd[1]: Starting Ceph mds.k for 96a8be3c-6e7b-11ee-8db6-212e2dc638e7... 2023-10-19T12:40:46.106 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-19T12:40:46.147 INFO:journalctl@ceph.mds.k.smithi157.stdout:Oct 19 12:40:45 smithi157 podman[169799]: 2023-10-19T12:40:46.147 INFO:journalctl@ceph.mds.k.smithi157.stdout:Oct 19 12:40:46 smithi157 ceph-mds[169839]: -- 172.21.15.157:0/1886143196 <== mon.2 v2:172.21.15.157:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5598e511d1e0 con 0x5598e50f3000 2023-10-19T12:40:46.148 INFO:journalctl@ceph.mds.k.smithi157.stdout:Oct 19 12:40:46 smithi157 bash[169799]: 537efbcd3c78394beb34b2c1d6d9a061c49e9bfec71b260d73da7ecf65b338a3 2023-10-19T12:40:46.148 INFO:journalctl@ceph.mds.k.smithi157.stdout:Oct 19 12:40:46 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mds-k[169815]: starting mds.k at 2023-10-19T12:40:46.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:46.324+0000 7f575cd9d700 1 -- 172.21.15.46:0/544354962 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5758100520 msgr2=0x7f5758100940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:40:46.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:46.324+0000 7f575cd9d700 1 --2- 172.21.15.46:0/544354962 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5758100520 0x7f5758100940 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5748009920 tx=0x7f5748009c30 comp rx=0 tx=0).stop 2023-10-19T12:40:46.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:46.324+0000 7f575cd9d700 1 -- 172.21.15.46:0/544354962 shutdown_connections 2023-10-19T12:40:46.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:46.324+0000 7f575cd9d700 1 --2- 172.21.15.46:0/544354962 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f57581020b0 0x7f5758108960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:46.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:46.324+0000 7f575cd9d700 1 --2- 172.21.15.46:0/544354962 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5758100520 0x7f5758100940 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:46.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:46.324+0000 7f575cd9d700 1 --2- 172.21.15.46:0/544354962 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5758101710 0x7f5758101b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:46.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:46.324+0000 7f575cd9d700 1 -- 172.21.15.46:0/544354962 >> 172.21.15.46:0/544354962 conn(0x7f57580fba70 msgr2=0x7f57580fded0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:40:46.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:46.324+0000 7f575cd9d700 1 -- 172.21.15.46:0/544354962 shutdown_connections 2023-10-19T12:40:46.330 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:46.324+0000 7f575cd9d700 1 -- 172.21.15.46:0/544354962 wait complete. 2023-10-19T12:40:46.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:46.325+0000 7f575cd9d700 1 Processor -- start 2023-10-19T12:40:46.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:46.326+0000 7f575cd9d700 1 -- start start 2023-10-19T12:40:46.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:46.326+0000 7f575cd9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5758100520 0x7f5758198760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:40:46.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:46.326+0000 7f575cd9d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5758101710 0x7f5758198ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:40:46.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:46.326+0000 7f575cd9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f57581020b0 0x7f575819fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:40:46.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:46.326+0000 7f575cd9d700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57581a0290 con 0x7f57581020b0 2023-10-19T12:40:46.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:46.326+0000 7f575cd9d700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57581a03d0 con 0x7f5758101710 2023-10-19T12:40:46.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:46.326+0000 7f575cd9d700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57581a0560 con 0x7f5758100520 2023-10-19T12:40:46.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:46.326+0000 7f5757fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f57581020b0 0x7f575819fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:40:46.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:46.326+0000 7f57577fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5758100520 0x7f5758198760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:40:46.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:46.326+0000 7f5756ffd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5758101710 0x7f5758198ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:40:46.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:46.326+0000 7f57577fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5758100520 0x7f5758198760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:46580/0 (socket says 172.21.15.46:46580) 2023-10-19T12:40:46.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:46.326+0000 7f5757fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f57581020b0 0x7f575819fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48648/0 (socket says 172.21.15.46:48648) 2023-10-19T12:40:46.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:46.326+0000 7f57577fe700 1 -- 172.21.15.46:0/3543406379 learned_addr learned my addr 172.21.15.46:0/3543406379 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:40:46.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:46.326+0000 7f5756ffd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5758101710 0x7f5758198ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:48352/0 (socket says 172.21.15.46:48352) 2023-10-19T12:40:46.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:46.327+0000 7f57577fe700 1 -- 172.21.15.46:0/3543406379 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5758101710 msgr2=0x7f5758198ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:40:46.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:46.327+0000 7f57577fe700 1 --2- 172.21.15.46:0/3543406379 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5758101710 0x7f5758198ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:46.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:46.327+0000 7f57577fe700 1 -- 172.21.15.46:0/3543406379 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f57581020b0 msgr2=0x7f575819fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:40:46.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:46.327+0000 7f57577fe700 1 --2- 172.21.15.46:0/3543406379 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f57581020b0 0x7f575819fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:46.336 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:46.327+0000 7f57577fe700 1 -- 172.21.15.46:0/3543406379 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5748009520 con 0x7f5758100520 2023-10-19T12:40:46.336 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:46.327+0000 7f5757fff700 1 --2- 172.21.15.46:0/3543406379 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f57581020b0 0x7f575819fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:40:46.336 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:46.327+0000 7f57577fe700 1 --2- 172.21.15.46:0/3543406379 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5758100520 0x7f5758198760 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5748009230 tx=0x7f574800bef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:40:46.336 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:46.327+0000 7f5754ff9700 1 -- 172.21.15.46:0/3543406379 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f574801c070 con 0x7f5758100520 2023-10-19T12:40:46.336 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:46.327+0000 7f575cd9d700 1 -- 172.21.15.46:0/3543406379 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57581a07e0 con 0x7f5758100520 2023-10-19T12:40:46.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:46.327+0000 7f5754ff9700 1 -- 172.21.15.46:0/3543406379 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f574800bba0 con 0x7f5758100520 2023-10-19T12:40:46.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:46.327+0000 7f5754ff9700 1 -- 172.21.15.46:0/3543406379 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5748004930 con 0x7f5758100520 2023-10-19T12:40:46.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:46.327+0000 7f575cd9d700 1 -- 172.21.15.46:0/3543406379 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57581a0bb0 con 0x7f5758100520 2023-10-19T12:40:46.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:46.328+0000 7f575cd9d700 1 -- 172.21.15.46:0/3543406379 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57580673e0 con 0x7f5758100520 2023-10-19T12:40:46.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:46.331+0000 7f5754ff9700 1 -- 172.21.15.46:0/3543406379 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f5748020070 con 0x7f5758100520 2023-10-19T12:40:46.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:46.332+0000 7f5754ff9700 1 --2- 172.21.15.46:0/3543406379 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f57400a1480 0x7f57400a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:40:46.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:46.332+0000 7f5754ff9700 1 -- 172.21.15.46:0/3543406379 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f57480cd4b0 con 0x7f5758100520 2023-10-19T12:40:46.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:46.332+0000 7f5756ffd700 1 --2- 172.21.15.46:0/3543406379 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f57400a1480 0x7f57400a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:40:46.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:46.333+0000 7f5756ffd700 1 --2- 172.21.15.46:0/3543406379 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f57400a1480 0x7f57400a3940 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f574c005fd0 tx=0x7f574c009310 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:40:46.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:46.334+0000 7f5754ff9700 1 -- 172.21.15.46:0/3543406379 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5748097040 con 0x7f5758100520 2023-10-19T12:40:46.587 INFO:journalctl@ceph.mds.k.smithi157.stdout:Oct 19 12:40:46 smithi157 systemd[1]: Started Ceph mds.k for 96a8be3c-6e7b-11ee-8db6-212e2dc638e7. 2023-10-19T12:40:46.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:46.600+0000 7f575cd9d700 1 -- 172.21.15.46:0/3543406379 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f575810be80 con 0x7f5758100520 2023-10-19T12:40:46.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:46.600+0000 7f5754ff9700 1 -- 172.21.15.46:0/3543406379 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2122 (secure 0 0 0) 0x7f57480ba020 con 0x7f5758100520 2023-10-19T12:40:46.604 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:40:46.604 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24560,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/1687745569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":1687745569},{"type":"v1","addr":"172.21.15.157:6833","nonce":1687745569}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24574,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6833/3629933235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3629933235},{"type":"v1","addr":"172.21.15.195:6833","nonce":3629933235}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-10-19T12:40:46.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:46.603+0000 7f575cd9d700 1 -- 172.21.15.46:0/3543406379 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f57400a1480 msgr2=0x7f57400a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:40:46.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:46.603+0000 7f575cd9d700 1 --2- 172.21.15.46:0/3543406379 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f57400a1480 0x7f57400a3940 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f574c005fd0 tx=0x7f574c009310 comp rx=0 tx=0).stop 2023-10-19T12:40:46.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:46.603+0000 7f575cd9d700 1 -- 172.21.15.46:0/3543406379 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5758100520 msgr2=0x7f5758198760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:40:46.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:46.603+0000 7f575cd9d700 1 --2- 172.21.15.46:0/3543406379 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5758100520 0x7f5758198760 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5748009230 tx=0x7f574800bef0 comp rx=0 tx=0).stop 2023-10-19T12:40:46.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:46.603+0000 7f575cd9d700 1 -- 172.21.15.46:0/3543406379 shutdown_connections 2023-10-19T12:40:46.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:46.603+0000 7f575cd9d700 1 --2- 172.21.15.46:0/3543406379 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f57581020b0 0x7f575819fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:46.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:46.603+0000 7f575cd9d700 1 --2- 172.21.15.46:0/3543406379 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f57400a1480 0x7f57400a3940 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:46.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:46.603+0000 7f575cd9d700 1 --2- 172.21.15.46:0/3543406379 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5758100520 0x7f5758198760 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:46.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:46.603+0000 7f575cd9d700 1 --2- 172.21.15.46:0/3543406379 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5758101710 0x7f5758198ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:46.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:46.603+0000 7f575cd9d700 1 -- 172.21.15.46:0/3543406379 >> 172.21.15.46:0/3543406379 conn(0x7f57580fba70 msgr2=0x7f5758106f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:40:46.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:46.603+0000 7f575cd9d700 1 -- 172.21.15.46:0/3543406379 shutdown_connections 2023-10-19T12:40:46.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:46.604+0000 7f575cd9d700 1 -- 172.21.15.46:0/3543406379 wait complete. 2023-10-19T12:40:46.609 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 3 2023-10-19T12:40:47.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:47 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:47.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:47 smithi046 ceph-mon[98509]: mds.? [v2:172.21.15.157:6832/1687745569,v1:172.21.15.157:6833/1687745569] up:boot 2023-10-19T12:40:47.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:47 smithi046 ceph-mon[98509]: fsmap 2 up:standby 2023-10-19T12:40:47.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:47 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-10-19T12:40:47.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:47 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:47.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:47 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:47.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:47 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-19T12:40:47.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:47 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-19T12:40:47.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:47 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:40:47.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:47 smithi046 ceph-mon[98509]: Deploying daemon mds.j on smithi046 2023-10-19T12:40:47.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:47 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/3543406379' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-19T12:40:47.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:47 smithi046 ceph-mon[98509]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-19T12:40:47.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:47 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:47.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:47 smithi157 ceph-mon[134109]: mds.? [v2:172.21.15.157:6832/1687745569,v1:172.21.15.157:6833/1687745569] up:boot 2023-10-19T12:40:47.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:47 smithi157 ceph-mon[134109]: fsmap 2 up:standby 2023-10-19T12:40:47.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:47 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-10-19T12:40:47.589 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:47 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:47.589 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:47 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:47.589 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:47 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-19T12:40:47.589 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:47 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-19T12:40:47.590 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:47 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:40:47.590 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:47 smithi157 ceph-mon[134109]: Deploying daemon mds.j on smithi046 2023-10-19T12:40:47.590 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:47 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/3543406379' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-19T12:40:47.590 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:47 smithi157 ceph-mon[134109]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-19T12:40:47.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:47 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:47.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:47 smithi195 ceph-mon[134493]: mds.? [v2:172.21.15.157:6832/1687745569,v1:172.21.15.157:6833/1687745569] up:boot 2023-10-19T12:40:47.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:47 smithi195 ceph-mon[134493]: fsmap 2 up:standby 2023-10-19T12:40:47.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:47 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-10-19T12:40:47.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:47 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:47.632 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:47 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:47.632 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:47 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-19T12:40:47.632 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:47 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-19T12:40:47.632 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:47 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:40:47.632 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:47 smithi195 ceph-mon[134493]: Deploying daemon mds.j on smithi046 2023-10-19T12:40:47.633 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:47 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/3543406379' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-19T12:40:47.633 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:47 smithi195 ceph-mon[134493]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-19T12:40:48.630 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-19T12:40:48.865 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:48.857+0000 7ff055fff700 1 -- 172.21.15.46:0/2949835513 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff050108630 msgr2=0x7ff05010aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:40:48.865 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:48.857+0000 7ff055fff700 1 --2- 172.21.15.46:0/2949835513 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff050108630 0x7ff05010aac0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff04800b0a0 tx=0x7ff04800b3b0 comp rx=0 tx=0).stop 2023-10-19T12:40:48.865 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:48.857+0000 7ff055fff700 1 -- 172.21.15.46:0/2949835513 shutdown_connections 2023-10-19T12:40:48.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:48.857+0000 7ff055fff700 1 --2- 172.21.15.46:0/2949835513 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff050108630 0x7ff05010aac0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:48.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:48.857+0000 7ff055fff700 1 --2- 172.21.15.46:0/2949835513 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff0500747b0 0x7ff050072c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:48.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:48.857+0000 7ff055fff700 1 --2- 172.21.15.46:0/2949835513 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff0500731d0 0x7ff050073650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:48.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:48.857+0000 7ff055fff700 1 -- 172.21.15.46:0/2949835513 >> 172.21.15.46:0/2949835513 conn(0x7ff0500fbc90 msgr2=0x7ff0500fe0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:40:48.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:48.857+0000 7ff055fff700 1 -- 172.21.15.46:0/2949835513 shutdown_connections 2023-10-19T12:40:48.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:48.857+0000 7ff055fff700 1 -- 172.21.15.46:0/2949835513 wait complete. 2023-10-19T12:40:48.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:48.858+0000 7ff055fff700 1 Processor -- start 2023-10-19T12:40:48.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:48.858+0000 7ff055fff700 1 -- start start 2023-10-19T12:40:48.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:48.859+0000 7ff055fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0500731d0 0x7ff050198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:40:48.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:48.859+0000 7ff055fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff0500747b0 0x7ff050198eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:40:48.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:48.859+0000 7ff055fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff050108630 0x7ff05019fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:40:48.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:48.859+0000 7ff055fff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0501a04a0 con 0x7ff0500731d0 2023-10-19T12:40:48.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:48.859+0000 7ff055fff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0501a05e0 con 0x7ff0500747b0 2023-10-19T12:40:48.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:48.859+0000 7ff055fff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0501a0770 con 0x7ff050108630 2023-10-19T12:40:48.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:48.859+0000 7ff04f7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0500731d0 0x7ff050198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:40:48.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:48.859+0000 7ff04f7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0500731d0 0x7ff050198970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48654/0 (socket says 172.21.15.46:48654) 2023-10-19T12:40:48.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:48.859+0000 7ff04f7fe700 1 -- 172.21.15.46:0/4200263614 learned_addr learned my addr 172.21.15.46:0/4200263614 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:40:48.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:48.859+0000 7ff04ffff700 1 --2- 172.21.15.46:0/4200263614 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff050108630 0x7ff05019fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:40:48.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:48.859+0000 7ff04effd700 1 --2- 172.21.15.46:0/4200263614 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff0500747b0 0x7ff050198eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:40:48.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:48.860+0000 7ff04f7fe700 1 -- 172.21.15.46:0/4200263614 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff050108630 msgr2=0x7ff05019fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:40:48.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:48.860+0000 7ff04f7fe700 1 --2- 172.21.15.46:0/4200263614 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff050108630 0x7ff05019fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:48.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:48.860+0000 7ff04f7fe700 1 -- 172.21.15.46:0/4200263614 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff0500747b0 msgr2=0x7ff050198eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:40:48.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:48.860+0000 7ff04f7fe700 1 --2- 172.21.15.46:0/4200263614 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff0500747b0 0x7ff050198eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:48.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:48.860+0000 7ff04f7fe700 1 -- 172.21.15.46:0/4200263614 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff048009d00 con 0x7ff0500731d0 2023-10-19T12:40:48.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:48.860+0000 7ff04f7fe700 1 --2- 172.21.15.46:0/4200263614 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0500731d0 0x7ff050198970 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff04000d980 tx=0x7ff04000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:40:48.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:48.860+0000 7ff04cff9700 1 -- 172.21.15.46:0/4200263614 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff040004220 con 0x7ff0500731d0 2023-10-19T12:40:48.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:48.860+0000 7ff055fff700 1 -- 172.21.15.46:0/4200263614 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0501a0a50 con 0x7ff0500731d0 2023-10-19T12:40:48.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:48.860+0000 7ff04cff9700 1 -- 172.21.15.46:0/4200263614 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff040007640 con 0x7ff0500731d0 2023-10-19T12:40:48.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:48.860+0000 7ff04cff9700 1 -- 172.21.15.46:0/4200263614 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff040005690 con 0x7ff0500731d0 2023-10-19T12:40:48.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:48.860+0000 7ff055fff700 1 -- 172.21.15.46:0/4200263614 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0501a0fb0 con 0x7ff0500731d0 2023-10-19T12:40:48.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:48.861+0000 7ff055fff700 1 -- 172.21.15.46:0/4200263614 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff050107440 con 0x7ff0500731d0 2023-10-19T12:40:48.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:48.863+0000 7ff04cff9700 1 -- 172.21.15.46:0/4200263614 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7ff040004750 con 0x7ff0500731d0 2023-10-19T12:40:48.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:48.865+0000 7ff04cff9700 1 --2- 172.21.15.46:0/4200263614 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7ff0380a1480 0x7ff0380a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:40:48.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:48.865+0000 7ff04cff9700 1 -- 172.21.15.46:0/4200263614 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7ff0400cc660 con 0x7ff0500731d0 2023-10-19T12:40:48.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:48.865+0000 7ff04effd700 1 --2- 172.21.15.46:0/4200263614 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7ff0380a1480 0x7ff0380a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:40:48.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:48.866+0000 7ff04effd700 1 --2- 172.21.15.46:0/4200263614 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7ff0380a1480 0x7ff0380a3940 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff044009c60 tx=0x7ff044009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:40:48.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:48.869+0000 7ff04cff9700 1 -- 172.21.15.46:0/4200263614 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff0400960c0 con 0x7ff0500731d0 2023-10-19T12:40:48.979 INFO:journalctl@ceph.mds.j.smithi046.stdout:Oct 19 12:40:48 smithi046 systemd[1]: Starting Ceph mds.j for 96a8be3c-6e7b-11ee-8db6-212e2dc638e7... 2023-10-19T12:40:49.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:49.153+0000 7ff055fff700 1 -- 172.21.15.46:0/4200263614 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff050067500 con 0x7ff0500731d0 2023-10-19T12:40:49.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:49.153+0000 7ff04cff9700 1 -- 172.21.15.46:0/4200263614 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2122 (secure 0 0 0) 0x7ff040016860 con 0x7ff0500731d0 2023-10-19T12:40:49.157 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:40:49.157 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24560,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/1687745569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":1687745569},{"type":"v1","addr":"172.21.15.157:6833","nonce":1687745569}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24574,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6833/3629933235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3629933235},{"type":"v1","addr":"172.21.15.195:6833","nonce":3629933235}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-10-19T12:40:49.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:49.156+0000 7ff055fff700 1 -- 172.21.15.46:0/4200263614 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7ff0380a1480 msgr2=0x7ff0380a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:40:49.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:49.156+0000 7ff055fff700 1 --2- 172.21.15.46:0/4200263614 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7ff0380a1480 0x7ff0380a3940 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff044009c60 tx=0x7ff044009260 comp rx=0 tx=0).stop 2023-10-19T12:40:49.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:49.156+0000 7ff055fff700 1 -- 172.21.15.46:0/4200263614 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0500731d0 msgr2=0x7ff050198970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:40:49.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:49.156+0000 7ff055fff700 1 --2- 172.21.15.46:0/4200263614 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0500731d0 0x7ff050198970 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff04000d980 tx=0x7ff04000dc90 comp rx=0 tx=0).stop 2023-10-19T12:40:49.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:49.156+0000 7ff055fff700 1 -- 172.21.15.46:0/4200263614 shutdown_connections 2023-10-19T12:40:49.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:49.156+0000 7ff055fff700 1 --2- 172.21.15.46:0/4200263614 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7ff0380a1480 0x7ff0380a3940 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:49.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:49.156+0000 7ff055fff700 1 --2- 172.21.15.46:0/4200263614 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff050108630 0x7ff05019fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:49.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:49.156+0000 7ff055fff700 1 --2- 172.21.15.46:0/4200263614 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0500731d0 0x7ff050198970 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:49.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:49.156+0000 7ff055fff700 1 --2- 172.21.15.46:0/4200263614 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff0500747b0 0x7ff050198eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:49.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:49.156+0000 7ff055fff700 1 -- 172.21.15.46:0/4200263614 >> 172.21.15.46:0/4200263614 conn(0x7ff0500fbc90 msgr2=0x7ff050104580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:40:49.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:49.156+0000 7ff055fff700 1 -- 172.21.15.46:0/4200263614 shutdown_connections 2023-10-19T12:40:49.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:49.156+0000 7ff055fff700 1 -- 172.21.15.46:0/4200263614 wait complete. 2023-10-19T12:40:49.163 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 3 2023-10-19T12:40:49.367 INFO:journalctl@ceph.mds.j.smithi046.stdout:Oct 19 12:40:49 smithi046 podman[148597]: 2023-10-19T12:40:49.367 INFO:journalctl@ceph.mds.j.smithi046.stdout:Oct 19 12:40:49 smithi046 bash[148597]: e0ecfe5111dc88f6be08c35638824201fa0ebf44bcaa102efe09d34de268ec53 2023-10-19T12:40:49.368 INFO:journalctl@ceph.mds.j.smithi046.stdout:Oct 19 12:40:49 smithi046 ceph-mds[148640]: -- 172.21.15.46:0/1857599971 <== mon.0 v2:172.21.15.46:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5561f41e51e0 con 0x5561f41bd000 2023-10-19T12:40:49.368 INFO:journalctl@ceph.mds.j.smithi046.stdout:Oct 19 12:40:49 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mds-j[148613]: starting mds.j at 2023-10-19T12:40:49.691 INFO:journalctl@ceph.mds.j.smithi046.stdout:Oct 19 12:40:49 smithi046 systemd[1]: Started Ceph mds.j for 96a8be3c-6e7b-11ee-8db6-212e2dc638e7. 2023-10-19T12:40:49.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:49 smithi046 ceph-mon[98509]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-19T12:40:49.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:49 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/4200263614' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-19T12:40:49.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:49 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:49.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:49 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:49.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:49 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:49.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:49 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-19T12:40:49.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:49 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-19T12:40:49.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:49 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:40:50.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:49 smithi157 ceph-mon[134109]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-19T12:40:50.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:49 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/4200263614' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-19T12:40:50.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:49 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:50.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:49 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:50.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:49 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:50.090 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:49 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-19T12:40:50.090 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:49 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-19T12:40:50.090 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:49 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:40:50.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:49 smithi195 ceph-mon[134493]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-19T12:40:50.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:49 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/4200263614' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-19T12:40:50.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:49 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:50.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:49 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:50.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:49 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:50.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:49 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-19T12:40:50.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:49 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-19T12:40:50.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:49 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:40:50.957 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:50 smithi046 ceph-mon[98509]: Deploying daemon mds.d on smithi046 2023-10-19T12:40:50.957 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:50 smithi046 ceph-mon[98509]: mds.? [v2:172.21.15.46:6834/2235286008,v1:172.21.15.46:6835/2235286008] up:boot 2023-10-19T12:40:50.958 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:50 smithi046 ceph-mon[98509]: fsmap 3 up:standby 2023-10-19T12:40:50.958 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:50 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-10-19T12:40:51.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:50 smithi157 ceph-mon[134109]: Deploying daemon mds.d on smithi046 2023-10-19T12:40:51.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:50 smithi157 ceph-mon[134109]: mds.? [v2:172.21.15.46:6834/2235286008,v1:172.21.15.46:6835/2235286008] up:boot 2023-10-19T12:40:51.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:50 smithi157 ceph-mon[134109]: fsmap 3 up:standby 2023-10-19T12:40:51.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:50 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-10-19T12:40:51.134 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:50 smithi195 ceph-mon[134493]: Deploying daemon mds.d on smithi046 2023-10-19T12:40:51.135 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:50 smithi195 ceph-mon[134493]: mds.? [v2:172.21.15.46:6834/2235286008,v1:172.21.15.46:6835/2235286008] up:boot 2023-10-19T12:40:51.135 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:50 smithi195 ceph-mon[134493]: fsmap 3 up:standby 2023-10-19T12:40:51.135 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:50 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-10-19T12:40:51.182 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-19T12:40:51.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:51.444+0000 7fcd2d7ff700 1 -- 172.21.15.46:0/3063439920 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd281022d0 msgr2=0x7fcd28108b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:40:51.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:51.444+0000 7fcd2d7ff700 1 --2- 172.21.15.46:0/3063439920 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd281022d0 0x7fcd28108b80 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fcd2000b0d0 tx=0x7fcd2000b3e0 comp rx=0 tx=0).stop 2023-10-19T12:40:51.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:51.444+0000 7fcd2d7ff700 1 -- 172.21.15.46:0/3063439920 shutdown_connections 2023-10-19T12:40:51.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:51.444+0000 7fcd2d7ff700 1 --2- 172.21.15.46:0/3063439920 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd281022d0 0x7fcd28108b80 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:51.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:51.445+0000 7fcd2d7ff700 1 --2- 172.21.15.46:0/3063439920 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcd28100740 0x7fcd28100b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:51.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:51.445+0000 7fcd2d7ff700 1 --2- 172.21.15.46:0/3063439920 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcd28101930 0x7fcd28101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:51.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:51.445+0000 7fcd2d7ff700 1 -- 172.21.15.46:0/3063439920 >> 172.21.15.46:0/3063439920 conn(0x7fcd280fbc90 msgr2=0x7fcd280fe0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:40:51.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:51.445+0000 7fcd2d7ff700 1 -- 172.21.15.46:0/3063439920 shutdown_connections 2023-10-19T12:40:51.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:51.445+0000 7fcd2d7ff700 1 -- 172.21.15.46:0/3063439920 wait complete. 2023-10-19T12:40:51.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:51.446+0000 7fcd2d7ff700 1 Processor -- start 2023-10-19T12:40:51.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:51.446+0000 7fcd2d7ff700 1 -- start start 2023-10-19T12:40:51.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:51.446+0000 7fcd2d7ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd28100740 0x7fcd28074550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:40:51.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:51.446+0000 7fcd2d7ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcd28101930 0x7fcd28072be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:40:51.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:51.446+0000 7fcd2d7ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcd281022d0 0x7fcd28073120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:40:51.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:51.446+0000 7fcd2d7ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd280738c0 con 0x7fcd28100740 2023-10-19T12:40:51.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:51.446+0000 7fcd2d7ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd28073a30 con 0x7fcd28101930 2023-10-19T12:40:51.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:51.446+0000 7fcd2d7ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd281a0820 con 0x7fcd281022d0 2023-10-19T12:40:51.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:51.446+0000 7fcd26ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd28100740 0x7fcd28074550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:40:51.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:51.447+0000 7fcd267fc700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcd28101930 0x7fcd28072be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:40:51.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:51.447+0000 7fcd26ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd28100740 0x7fcd28074550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48714/0 (socket says 172.21.15.46:48714) 2023-10-19T12:40:51.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:51.447+0000 7fcd26ffd700 1 -- 172.21.15.46:0/1523560081 learned_addr learned my addr 172.21.15.46:0/1523560081 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:40:51.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:51.447+0000 7fcd267fc700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcd28101930 0x7fcd28072be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:48412/0 (socket says 172.21.15.46:48412) 2023-10-19T12:40:51.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:51.447+0000 7fcd277fe700 1 --2- 172.21.15.46:0/1523560081 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcd281022d0 0x7fcd28073120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:40:51.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:51.447+0000 7fcd267fc700 1 -- 172.21.15.46:0/1523560081 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcd281022d0 msgr2=0x7fcd28073120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:40:51.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:51.447+0000 7fcd267fc700 1 --2- 172.21.15.46:0/1523560081 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcd281022d0 0x7fcd28073120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:51.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:51.447+0000 7fcd267fc700 1 -- 172.21.15.46:0/1523560081 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd28100740 msgr2=0x7fcd28074550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:40:51.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:51.447+0000 7fcd267fc700 1 --2- 172.21.15.46:0/1523560081 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd28100740 0x7fcd28074550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:51.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:51.447+0000 7fcd267fc700 1 -- 172.21.15.46:0/1523560081 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd20009d00 con 0x7fcd28101930 2023-10-19T12:40:51.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:51.447+0000 7fcd267fc700 1 --2- 172.21.15.46:0/1523560081 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcd28101930 0x7fcd28072be0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c00d750 tx=0x7fcd1c00da60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:40:51.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:51.448+0000 7fcd0ffff700 1 -- 172.21.15.46:0/1523560081 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1c004020 con 0x7fcd28101930 2023-10-19T12:40:51.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:51.448+0000 7fcd2d7ff700 1 -- 172.21.15.46:0/1523560081 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd281a0ab0 con 0x7fcd28101930 2023-10-19T12:40:51.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:51.448+0000 7fcd0ffff700 1 -- 172.21.15.46:0/1523560081 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcd1c004830 con 0x7fcd28101930 2023-10-19T12:40:51.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:51.448+0000 7fcd0ffff700 1 -- 172.21.15.46:0/1523560081 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1c005550 con 0x7fcd28101930 2023-10-19T12:40:51.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:51.448+0000 7fcd2d7ff700 1 -- 172.21.15.46:0/1523560081 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd281a1010 con 0x7fcd28101930 2023-10-19T12:40:51.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:51.449+0000 7fcd2d7ff700 1 -- 172.21.15.46:0/1523560081 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd28107af0 con 0x7fcd28101930 2023-10-19T12:40:51.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:51.451+0000 7fcd0ffff700 1 -- 172.21.15.46:0/1523560081 <== mon.2 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fcd1c004ca0 con 0x7fcd28101930 2023-10-19T12:40:51.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:51.452+0000 7fcd0ffff700 1 --2- 172.21.15.46:0/1523560081 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fcd100a1480 0x7fcd100a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:40:51.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:51.453+0000 7fcd0ffff700 1 -- 172.21.15.46:0/1523560081 <== mon.2 v2:172.21.15.157:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fcd1c0cc0f0 con 0x7fcd28101930 2023-10-19T12:40:51.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:51.453+0000 7fcd26ffd700 1 --2- 172.21.15.46:0/1523560081 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fcd100a1480 0x7fcd100a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:40:51.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:51.453+0000 7fcd26ffd700 1 --2- 172.21.15.46:0/1523560081 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fcd100a1480 0x7fcd100a3940 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fcd18005950 tx=0x7fcd18009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:40:51.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:51.455+0000 7fcd0ffff700 1 -- 172.21.15.46:0/1523560081 <== mon.2 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fcd1c095b50 con 0x7fcd28101930 2023-10-19T12:40:51.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:51.726+0000 7fcd2d7ff700 1 -- 172.21.15.46:0/1523560081 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcd28067530 con 0x7fcd28101930 2023-10-19T12:40:51.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:51.727+0000 7fcd0ffff700 1 -- 172.21.15.46:0/1523560081 <== mon.2 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) v1 ==== 93+0+2913 (secure 0 0 0) 0x7fcd1c099170 con 0x7fcd28101930 2023-10-19T12:40:51.731 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:40:51.731 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14580,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/2235286008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":2235286008},{"type":"v1","addr":"172.21.15.46:6835","nonce":2235286008}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24560,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/1687745569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":1687745569},{"type":"v1","addr":"172.21.15.157:6833","nonce":1687745569}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24574,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6833/3629933235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3629933235},{"type":"v1","addr":"172.21.15.195:6833","nonce":3629933235}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-10-19T12:40:51.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:51.730+0000 7fcd2d7ff700 1 -- 172.21.15.46:0/1523560081 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fcd100a1480 msgr2=0x7fcd100a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:40:51.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:51.730+0000 7fcd2d7ff700 1 --2- 172.21.15.46:0/1523560081 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fcd100a1480 0x7fcd100a3940 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fcd18005950 tx=0x7fcd18009260 comp rx=0 tx=0).stop 2023-10-19T12:40:51.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:51.730+0000 7fcd2d7ff700 1 -- 172.21.15.46:0/1523560081 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcd28101930 msgr2=0x7fcd28072be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:40:51.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:51.730+0000 7fcd2d7ff700 1 --2- 172.21.15.46:0/1523560081 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcd28101930 0x7fcd28072be0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c00d750 tx=0x7fcd1c00da60 comp rx=0 tx=0).stop 2023-10-19T12:40:51.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:51.730+0000 7fcd2d7ff700 1 -- 172.21.15.46:0/1523560081 shutdown_connections 2023-10-19T12:40:51.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:51.730+0000 7fcd2d7ff700 1 --2- 172.21.15.46:0/1523560081 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fcd100a1480 0x7fcd100a3940 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:51.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:51.730+0000 7fcd2d7ff700 1 --2- 172.21.15.46:0/1523560081 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcd281022d0 0x7fcd28073120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:51.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:51.730+0000 7fcd2d7ff700 1 --2- 172.21.15.46:0/1523560081 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd28100740 0x7fcd28074550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:51.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:51.730+0000 7fcd2d7ff700 1 --2- 172.21.15.46:0/1523560081 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcd28101930 0x7fcd28072be0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:51.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:51.730+0000 7fcd2d7ff700 1 -- 172.21.15.46:0/1523560081 >> 172.21.15.46:0/1523560081 conn(0x7fcd280fbc90 msgr2=0x7fcd28104c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:40:51.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:51.730+0000 7fcd2d7ff700 1 -- 172.21.15.46:0/1523560081 shutdown_connections 2023-10-19T12:40:51.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:51.730+0000 7fcd2d7ff700 1 -- 172.21.15.46:0/1523560081 wait complete. 2023-10-19T12:40:51.736 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 4 2023-10-19T12:40:51.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:51 smithi046 ceph-mon[98509]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-19T12:40:51.979 INFO:journalctl@ceph.mds.d.smithi046.stdout:Oct 19 12:40:51 smithi046 systemd[1]: Starting Ceph mds.d for 96a8be3c-6e7b-11ee-8db6-212e2dc638e7... 2023-10-19T12:40:52.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:51 smithi157 ceph-mon[134109]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-19T12:40:52.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:51 smithi195 ceph-mon[134493]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-19T12:40:52.390 INFO:journalctl@ceph.mds.d.smithi046.stdout:Oct 19 12:40:52 smithi046 podman[148982]: 2023-10-19T12:40:52.703 INFO:journalctl@ceph.mds.d.smithi046.stdout:Oct 19 12:40:52 smithi046 bash[148982]: 723b463aa29b52ec474003da4bec37bac9915bd7e909f8616ad278cafad38ddc 2023-10-19T12:40:52.703 INFO:journalctl@ceph.mds.d.smithi046.stdout:Oct 19 12:40:52 smithi046 ceph-mds[149022]: -- 172.21.15.46:0/3650258800 <== mon.0 v2:172.21.15.46:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x557e3c91b1e0 con 0x557e3c8f2c00 2023-10-19T12:40:52.703 INFO:journalctl@ceph.mds.d.smithi046.stdout:Oct 19 12:40:52 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mds-d[148998]: starting mds.d at 2023-10-19T12:40:52.703 INFO:journalctl@ceph.mds.d.smithi046.stdout:Oct 19 12:40:52 smithi046 systemd[1]: Started Ceph mds.d for 96a8be3c-6e7b-11ee-8db6-212e2dc638e7. 2023-10-19T12:40:52.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:52 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/1523560081' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-19T12:40:52.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:52 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:52.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:52 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:52.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:52 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:52.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:52 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-19T12:40:52.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:52 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-19T12:40:52.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:52 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:40:53.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:52 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/1523560081' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-19T12:40:53.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:52 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:53.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:52 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:53.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:52 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:53.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:52 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-19T12:40:53.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:52 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-19T12:40:53.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:52 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:40:53.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:52 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/1523560081' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-19T12:40:53.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:52 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:53.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:52 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:53.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:52 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:53.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:52 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-19T12:40:53.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:52 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-19T12:40:53.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:52 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:40:53.755 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-19T12:40:53.970 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:53 smithi157 ceph-mon[134109]: Deploying daemon mds.e on smithi157 2023-10-19T12:40:53.971 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:53 smithi157 ceph-mon[134109]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-19T12:40:53.971 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:53 smithi157 ceph-mon[134109]: mds.? [v2:172.21.15.46:6836/339398444,v1:172.21.15.46:6837/339398444] up:boot 2023-10-19T12:40:53.971 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:53 smithi157 ceph-mon[134109]: fsmap 4 up:standby 2023-10-19T12:40:53.971 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:53 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-10-19T12:40:53.976 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:53.973+0000 7f481efff700 1 -- 172.21.15.46:0/4055334415 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4818100740 msgr2=0x7f4818100b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:40:53.976 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:53.973+0000 7f481efff700 1 --2- 172.21.15.46:0/4055334415 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4818100740 0x7f4818100b60 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f480c0099c0 tx=0x7f480c009cd0 comp rx=0 tx=0).stop 2023-10-19T12:40:53.976 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:53.973+0000 7f481efff700 1 -- 172.21.15.46:0/4055334415 shutdown_connections 2023-10-19T12:40:53.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:53.973+0000 7f481efff700 1 --2- 172.21.15.46:0/4055334415 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f48181022d0 0x7f4818108b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:53.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:53.973+0000 7f481efff700 1 --2- 172.21.15.46:0/4055334415 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4818100740 0x7f4818100b60 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:53.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:53.973+0000 7f481efff700 1 --2- 172.21.15.46:0/4055334415 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4818101930 0x7f4818101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:53.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:53.973+0000 7f481efff700 1 -- 172.21.15.46:0/4055334415 >> 172.21.15.46:0/4055334415 conn(0x7f48180fbc90 msgr2=0x7f48180fe0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:40:53.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:53.973+0000 7f481efff700 1 -- 172.21.15.46:0/4055334415 shutdown_connections 2023-10-19T12:40:53.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:53.973+0000 7f481efff700 1 -- 172.21.15.46:0/4055334415 wait complete. 2023-10-19T12:40:53.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:53.974+0000 7f481efff700 1 Processor -- start 2023-10-19T12:40:53.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:53.974+0000 7f481efff700 1 -- start start 2023-10-19T12:40:53.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:53.974+0000 7f481efff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4818100740 0x7f4818198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:40:53.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:53.974+0000 7f481efff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4818101930 0x7f4818198e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:40:53.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:53.974+0000 7f481efff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f48181022d0 0x7f481819fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:40:53.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:53.974+0000 7f481efff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48181a0430 con 0x7f4818100740 2023-10-19T12:40:53.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:53.974+0000 7f481efff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48181a0570 con 0x7f48181022d0 2023-10-19T12:40:53.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:53.974+0000 7f481efff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48181a0700 con 0x7f4818101930 2023-10-19T12:40:53.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:53.975+0000 7f481cd9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4818100740 0x7f4818198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:40:53.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:53.975+0000 7f481d59c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f48181022d0 0x7f481819fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:40:53.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:53.975+0000 7f481d59c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f48181022d0 0x7f481819fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:49414/0 (socket says 172.21.15.46:49414) 2023-10-19T12:40:53.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:53.975+0000 7f481d59c700 1 -- 172.21.15.46:0/1976977225 learned_addr learned my addr 172.21.15.46:0/1976977225 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:40:53.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:53.975+0000 7f4817fff700 1 --2- 172.21.15.46:0/1976977225 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4818101930 0x7f4818198e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:40:53.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:53.975+0000 7f481cd9b700 1 -- 172.21.15.46:0/1976977225 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4818101930 msgr2=0x7f4818198e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:40:53.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:53.975+0000 7f481cd9b700 1 --2- 172.21.15.46:0/1976977225 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4818101930 0x7f4818198e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:53.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:53.975+0000 7f481cd9b700 1 -- 172.21.15.46:0/1976977225 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f48181022d0 msgr2=0x7f481819fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:40:53.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:53.975+0000 7f481cd9b700 1 --2- 172.21.15.46:0/1976977225 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f48181022d0 0x7f481819fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:53.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:53.975+0000 7f481cd9b700 1 -- 172.21.15.46:0/1976977225 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4810009c40 con 0x7f4818100740 2023-10-19T12:40:53.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:53.975+0000 7f481d59c700 1 --2- 172.21.15.46:0/1976977225 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f48181022d0 0x7f481819fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:40:53.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:53.976+0000 7f481cd9b700 1 --2- 172.21.15.46:0/1976977225 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4818100740 0x7f4818198900 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f480c0098e0 tx=0x7f480c00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:40:53.984 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:53 smithi046 ceph-mon[98509]: Deploying daemon mds.e on smithi157 2023-10-19T12:40:53.984 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:53 smithi046 ceph-mon[98509]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-19T12:40:53.984 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:53 smithi046 ceph-mon[98509]: mds.? [v2:172.21.15.46:6836/339398444,v1:172.21.15.46:6837/339398444] up:boot 2023-10-19T12:40:53.985 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:53 smithi046 ceph-mon[98509]: fsmap 4 up:standby 2023-10-19T12:40:53.985 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:53 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-10-19T12:40:53.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:53.976+0000 7f4815ffb700 1 -- 172.21.15.46:0/1976977225 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f480c01d070 con 0x7f4818100740 2023-10-19T12:40:53.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:53.976+0000 7f4815ffb700 1 -- 172.21.15.46:0/1976977225 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f480c005050 con 0x7f4818100740 2023-10-19T12:40:53.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:53.976+0000 7f481efff700 1 -- 172.21.15.46:0/1976977225 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f480c0095f0 con 0x7f4818100740 2023-10-19T12:40:53.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:53.976+0000 7f4815ffb700 1 -- 172.21.15.46:0/1976977225 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f480c004a50 con 0x7f4818100740 2023-10-19T12:40:53.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:53.976+0000 7f481efff700 1 -- 172.21.15.46:0/1976977225 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48181a0c10 con 0x7f4818100740 2023-10-19T12:40:53.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:53.977+0000 7f481efff700 1 -- 172.21.15.46:0/1976977225 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4818067530 con 0x7f4818100740 2023-10-19T12:40:53.988 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:53.979+0000 7f4815ffb700 1 -- 172.21.15.46:0/1976977225 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f480c0051c0 con 0x7f4818100740 2023-10-19T12:40:53.988 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:53.981+0000 7f4815ffb700 1 --2- 172.21.15.46:0/1976977225 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f48080a1480 0x7f48080a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:40:53.988 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:53.982+0000 7f4815ffb700 1 -- 172.21.15.46:0/1976977225 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f480c0cd720 con 0x7f4818100740 2023-10-19T12:40:53.988 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:53.982+0000 7f4817fff700 1 --2- 172.21.15.46:0/1976977225 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f48080a1480 0x7f48080a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:40:53.988 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:53.982+0000 7f4817fff700 1 --2- 172.21.15.46:0/1976977225 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f48080a1480 0x7f48080a3940 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4804009c60 tx=0x7f4804009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:40:53.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:53.984+0000 7f4815ffb700 1 -- 172.21.15.46:0/1976977225 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f480c097210 con 0x7f4818100740 2023-10-19T12:40:54.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:53 smithi195 ceph-mon[134493]: Deploying daemon mds.e on smithi157 2023-10-19T12:40:54.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:53 smithi195 ceph-mon[134493]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-19T12:40:54.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:53 smithi195 ceph-mon[134493]: mds.? [v2:172.21.15.46:6836/339398444,v1:172.21.15.46:6837/339398444] up:boot 2023-10-19T12:40:54.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:53 smithi195 ceph-mon[134493]: fsmap 4 up:standby 2023-10-19T12:40:54.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:53 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-10-19T12:40:54.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:54.243+0000 7f481efff700 1 -- 172.21.15.46:0/1976977225 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f481810c0a0 con 0x7f4818100740 2023-10-19T12:40:54.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:54.244+0000 7f4815ffb700 1 -- 172.21.15.46:0/1976977225 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+3701 (secure 0 0 0) 0x7f480c09a830 con 0x7f4818100740 2023-10-19T12:40:54.248 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:40:54.248 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":5,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14580,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/2235286008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":2235286008},{"type":"v1","addr":"172.21.15.46:6835","nonce":2235286008}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14592,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/339398444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":339398444},{"type":"v1","addr":"172.21.15.46:6837","nonce":339398444}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24560,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/1687745569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":1687745569},{"type":"v1","addr":"172.21.15.157:6833","nonce":1687745569}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24574,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6833/3629933235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3629933235},{"type":"v1","addr":"172.21.15.195:6833","nonce":3629933235}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-10-19T12:40:54.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:54.246+0000 7f481efff700 1 -- 172.21.15.46:0/1976977225 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f48080a1480 msgr2=0x7f48080a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:40:54.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:54.246+0000 7f481efff700 1 --2- 172.21.15.46:0/1976977225 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f48080a1480 0x7f48080a3940 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4804009c60 tx=0x7f4804009260 comp rx=0 tx=0).stop 2023-10-19T12:40:54.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:54.246+0000 7f481efff700 1 -- 172.21.15.46:0/1976977225 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4818100740 msgr2=0x7f4818198900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:40:54.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:54.246+0000 7f481efff700 1 --2- 172.21.15.46:0/1976977225 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4818100740 0x7f4818198900 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f480c0098e0 tx=0x7f480c00f690 comp rx=0 tx=0).stop 2023-10-19T12:40:54.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:54.247+0000 7f481efff700 1 -- 172.21.15.46:0/1976977225 shutdown_connections 2023-10-19T12:40:54.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:54.247+0000 7f481efff700 1 --2- 172.21.15.46:0/1976977225 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f48181022d0 0x7f481819fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:54.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:54.247+0000 7f481efff700 1 --2- 172.21.15.46:0/1976977225 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4818100740 0x7f4818198900 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:54.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:54.247+0000 7f481efff700 1 --2- 172.21.15.46:0/1976977225 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f48080a1480 0x7f48080a3940 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:54.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:54.247+0000 7f481efff700 1 --2- 172.21.15.46:0/1976977225 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4818101930 0x7f4818198e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:54.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:54.247+0000 7f481efff700 1 -- 172.21.15.46:0/1976977225 >> 172.21.15.46:0/1976977225 conn(0x7f48180fbc90 msgr2=0x7f4818107170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:40:54.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:54.247+0000 7f481efff700 1 -- 172.21.15.46:0/1976977225 shutdown_connections 2023-10-19T12:40:54.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:54.247+0000 7f481efff700 1 -- 172.21.15.46:0/1976977225 wait complete. 2023-10-19T12:40:54.253 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 5 2023-10-19T12:40:54.337 INFO:journalctl@ceph.mds.e.smithi157.stdout:Oct 19 12:40:54 smithi157 systemd[1]: Starting Ceph mds.e for 96a8be3c-6e7b-11ee-8db6-212e2dc638e7... 2023-10-19T12:40:54.661 INFO:journalctl@ceph.mds.e.smithi157.stdout:Oct 19 12:40:54 smithi157 podman[170144]: 2023-10-19T12:40:54.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:54 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/1976977225' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-19T12:40:55.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:54 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/1976977225' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-19T12:40:55.088 INFO:journalctl@ceph.mds.e.smithi157.stdout:Oct 19 12:40:54 smithi157 ceph-mds[170184]: -- 172.21.15.157:0/1275520368 <== mon.2 v2:172.21.15.157:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55c6322e91e0 con 0x55c6322be800 2023-10-19T12:40:55.088 INFO:journalctl@ceph.mds.e.smithi157.stdout:Oct 19 12:40:54 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mds-e[170160]: starting mds.e at 2023-10-19T12:40:55.088 INFO:journalctl@ceph.mds.e.smithi157.stdout:Oct 19 12:40:54 smithi157 bash[170144]: 1d795adccf5b53b5cfadd9368172a9396f60d2b568abfc803005d0c3ddbd360d 2023-10-19T12:40:55.088 INFO:journalctl@ceph.mds.e.smithi157.stdout:Oct 19 12:40:54 smithi157 systemd[1]: Started Ceph mds.e for 96a8be3c-6e7b-11ee-8db6-212e2dc638e7. 2023-10-19T12:40:55.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:54 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/1976977225' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-19T12:40:55.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:55 smithi046 ceph-mon[98509]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-19T12:40:55.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:55 smithi046 ceph-mon[98509]: mds.? [v2:172.21.15.157:6834/108432552,v1:172.21.15.157:6835/108432552] up:boot 2023-10-19T12:40:55.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:55 smithi046 ceph-mon[98509]: fsmap 5 up:standby 2023-10-19T12:40:55.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:55 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-10-19T12:40:55.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:55 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:55.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:55 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:55.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:55 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:55.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:55 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-19T12:40:55.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:55 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-19T12:40:55.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:55 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:40:55.981 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:55 smithi195 ceph-mon[134493]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-19T12:40:55.982 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:55 smithi195 ceph-mon[134493]: mds.? [v2:172.21.15.157:6834/108432552,v1:172.21.15.157:6835/108432552] up:boot 2023-10-19T12:40:55.982 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:55 smithi195 ceph-mon[134493]: fsmap 5 up:standby 2023-10-19T12:40:55.982 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:55 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-10-19T12:40:55.982 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:55 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:55.982 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:55 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:55.983 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:55 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:55.983 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:55 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-19T12:40:55.983 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:55 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-19T12:40:55.983 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:55 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:40:56.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:55 smithi157 ceph-mon[134109]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-19T12:40:56.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:55 smithi157 ceph-mon[134109]: mds.? [v2:172.21.15.157:6834/108432552,v1:172.21.15.157:6835/108432552] up:boot 2023-10-19T12:40:56.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:55 smithi157 ceph-mon[134109]: fsmap 5 up:standby 2023-10-19T12:40:56.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:55 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-10-19T12:40:56.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:55 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:56.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:55 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:56.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:55 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:56.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:55 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-19T12:40:56.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:55 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-19T12:40:56.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:55 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:40:56.270 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-19T12:40:56.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:56.483+0000 7f0394fff700 1 -- 172.21.15.46:0/1320740803 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0390100740 msgr2=0x7f0390100b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:40:56.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:56.483+0000 7f0394fff700 1 --2- 172.21.15.46:0/1320740803 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0390100740 0x7f0390100b60 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f03800099c0 tx=0x7f0380009cd0 comp rx=0 tx=0).stop 2023-10-19T12:40:56.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:56.483+0000 7f0394fff700 1 -- 172.21.15.46:0/1320740803 shutdown_connections 2023-10-19T12:40:56.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:56.483+0000 7f0394fff700 1 --2- 172.21.15.46:0/1320740803 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f03901022d0 0x7f0390108b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:56.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:56.483+0000 7f0394fff700 1 --2- 172.21.15.46:0/1320740803 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0390100740 0x7f0390100b60 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:56.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:56.483+0000 7f0394fff700 1 --2- 172.21.15.46:0/1320740803 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0390101930 0x7f0390101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:56.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:56.483+0000 7f0394fff700 1 -- 172.21.15.46:0/1320740803 >> 172.21.15.46:0/1320740803 conn(0x7f03900fbc90 msgr2=0x7f03900fe0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:40:56.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:56.483+0000 7f0394fff700 1 -- 172.21.15.46:0/1320740803 shutdown_connections 2023-10-19T12:40:56.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:56.483+0000 7f0394fff700 1 -- 172.21.15.46:0/1320740803 wait complete. 2023-10-19T12:40:56.490 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:56.484+0000 7f0394fff700 1 Processor -- start 2023-10-19T12:40:56.491 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:56.485+0000 7f0394fff700 1 -- start start 2023-10-19T12:40:56.491 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:56.485+0000 7f0394fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0390100740 0x7f03901966e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:40:56.491 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:56.485+0000 7f0394fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0390101930 0x7f0390196c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:40:56.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:56.485+0000 7f0394fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f03901022d0 0x7f039019dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:40:56.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:56.485+0000 7f0394fff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f039019e210 con 0x7f0390101930 2023-10-19T12:40:56.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:56.485+0000 7f0394fff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f039019e350 con 0x7f03901022d0 2023-10-19T12:40:56.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:56.485+0000 7f0394fff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f039019e4e0 con 0x7f0390100740 2023-10-19T12:40:56.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:56.485+0000 7f038e59c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0390100740 0x7f03901966e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:40:56.493 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:56.485+0000 7f038dd9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0390101930 0x7f0390196c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:40:56.493 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:56.485+0000 7f038e59c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0390100740 0x7f03901966e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:54426/0 (socket says 172.21.15.46:54426) 2023-10-19T12:40:56.493 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:56.485+0000 7f038e59c700 1 -- 172.21.15.46:0/877177061 learned_addr learned my addr 172.21.15.46:0/877177061 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:40:56.493 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:56.485+0000 7f038dd9b700 1 --2- 172.21.15.46:0/877177061 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0390101930 0x7f0390196c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47320/0 (socket says 172.21.15.46:47320) 2023-10-19T12:40:56.493 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:56.485+0000 7f038ed9d700 1 --2- 172.21.15.46:0/877177061 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f03901022d0 0x7f039019dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:40:56.494 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:56.486+0000 7f038e59c700 1 -- 172.21.15.46:0/877177061 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f03901022d0 msgr2=0x7f039019dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:40:56.494 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:56.486+0000 7f038e59c700 1 --2- 172.21.15.46:0/877177061 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f03901022d0 0x7f039019dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:56.494 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:56.486+0000 7f038e59c700 1 -- 172.21.15.46:0/877177061 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0390101930 msgr2=0x7f0390196c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:40:56.494 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:56.486+0000 7f038e59c700 1 --2- 172.21.15.46:0/877177061 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0390101930 0x7f0390196c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:56.494 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:56.486+0000 7f038e59c700 1 -- 172.21.15.46:0/877177061 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03800095f0 con 0x7f0390100740 2023-10-19T12:40:56.495 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:56.486+0000 7f038dd9b700 1 --2- 172.21.15.46:0/877177061 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0390101930 0x7f0390196c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:40:56.495 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:56.486+0000 7f038e59c700 1 --2- 172.21.15.46:0/877177061 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0390100740 0x7f03901966e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0380006010 tx=0x7f038000f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:40:56.495 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:56.486+0000 7f037f7fe700 1 -- 172.21.15.46:0/877177061 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f038001d070 con 0x7f0390100740 2023-10-19T12:40:56.495 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:56.486+0000 7f0394fff700 1 -- 172.21.15.46:0/877177061 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f039019e760 con 0x7f0390100740 2023-10-19T12:40:56.495 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:56.486+0000 7f037f7fe700 1 -- 172.21.15.46:0/877177061 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0380005020 con 0x7f0390100740 2023-10-19T12:40:56.496 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:56.486+0000 7f037f7fe700 1 -- 172.21.15.46:0/877177061 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0380004b10 con 0x7f0390100740 2023-10-19T12:40:56.496 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:56.486+0000 7f0394fff700 1 -- 172.21.15.46:0/877177061 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f039019eb80 con 0x7f0390100740 2023-10-19T12:40:56.496 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:56.487+0000 7f0394fff700 1 -- 172.21.15.46:0/877177061 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0390107c10 con 0x7f0390100740 2023-10-19T12:40:56.497 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:56.489+0000 7f037f7fe700 1 -- 172.21.15.46:0/877177061 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f0380005190 con 0x7f0390100740 2023-10-19T12:40:56.497 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:56.491+0000 7f037f7fe700 1 --2- 172.21.15.46:0/877177061 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f03780a1480 0x7f03780a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:40:56.497 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:56.491+0000 7f037f7fe700 1 -- 172.21.15.46:0/877177061 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f03800cd4c0 con 0x7f0390100740 2023-10-19T12:40:56.497 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:56.491+0000 7f038dd9b700 1 --2- 172.21.15.46:0/877177061 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f03780a1480 0x7f03780a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:40:56.498 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:56.492+0000 7f038dd9b700 1 --2- 172.21.15.46:0/877177061 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f03780a1480 0x7f03780a3940 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0384011490 tx=0x7f0384009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:40:56.499 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:56.496+0000 7f037f7fe700 1 -- 172.21.15.46:0/877177061 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0380096fb0 con 0x7f0390100740 2023-10-19T12:40:56.603 INFO:journalctl@ceph.mds.f.smithi195.stdout:Oct 19 12:40:56 smithi195 systemd[1]: Starting Ceph mds.f for 96a8be3c-6e7b-11ee-8db6-212e2dc638e7... 2023-10-19T12:40:56.758 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:56.755+0000 7f0394fff700 1 -- 172.21.15.46:0/877177061 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f039010c0c0 con 0x7f0390100740 2023-10-19T12:40:56.759 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:56.756+0000 7f037f7fe700 1 -- 172.21.15.46:0/877177061 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4492 (secure 0 0 0) 0x7f038009a5d0 con 0x7f0390100740 2023-10-19T12:40:56.759 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:40:56.759 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":6,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14580,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/2235286008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":2235286008},{"type":"v1","addr":"172.21.15.46:6835","nonce":2235286008}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14592,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/339398444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":339398444},{"type":"v1","addr":"172.21.15.46:6837","nonce":339398444}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24560,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/1687745569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":1687745569},{"type":"v1","addr":"172.21.15.157:6833","nonce":1687745569}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24574,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6833/3629933235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3629933235},{"type":"v1","addr":"172.21.15.195:6833","nonce":3629933235}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24602,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/108432552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":108432552},{"type":"v1","addr":"172.21.15.157:6835","nonce":108432552}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6}],"filesystems":[]} 2023-10-19T12:40:56.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:56.758+0000 7f0394fff700 1 -- 172.21.15.46:0/877177061 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f03780a1480 msgr2=0x7f03780a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:40:56.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:56.758+0000 7f0394fff700 1 --2- 172.21.15.46:0/877177061 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f03780a1480 0x7f03780a3940 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0384011490 tx=0x7f0384009260 comp rx=0 tx=0).stop 2023-10-19T12:40:56.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:56.758+0000 7f0394fff700 1 -- 172.21.15.46:0/877177061 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0390100740 msgr2=0x7f03901966e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:40:56.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:56.758+0000 7f0394fff700 1 --2- 172.21.15.46:0/877177061 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0390100740 0x7f03901966e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0380006010 tx=0x7f038000f690 comp rx=0 tx=0).stop 2023-10-19T12:40:56.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:56.758+0000 7f0394fff700 1 -- 172.21.15.46:0/877177061 shutdown_connections 2023-10-19T12:40:56.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:56.758+0000 7f0394fff700 1 --2- 172.21.15.46:0/877177061 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f03901022d0 0x7f039019dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:56.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:56.758+0000 7f0394fff700 1 --2- 172.21.15.46:0/877177061 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f03780a1480 0x7f03780a3940 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:56.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:56.758+0000 7f0394fff700 1 --2- 172.21.15.46:0/877177061 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0390100740 0x7f03901966e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:56.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:56.758+0000 7f0394fff700 1 --2- 172.21.15.46:0/877177061 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0390101930 0x7f0390196c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:56.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:56.758+0000 7f0394fff700 1 -- 172.21.15.46:0/877177061 >> 172.21.15.46:0/877177061 conn(0x7f03900fbc90 msgr2=0x7f0390104d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:40:56.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:56.758+0000 7f0394fff700 1 -- 172.21.15.46:0/877177061 shutdown_connections 2023-10-19T12:40:56.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:56.758+0000 7f0394fff700 1 -- 172.21.15.46:0/877177061 wait complete. 2023-10-19T12:40:56.764 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 6 2023-10-19T12:40:56.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:56 smithi195 ceph-mon[134493]: Deploying daemon mds.f on smithi195 2023-10-19T12:40:56.881 INFO:journalctl@ceph.mds.f.smithi195.stdout:Oct 19 12:40:56 smithi195 podman[171382]: 2023-10-19T12:40:56.881 INFO:journalctl@ceph.mds.f.smithi195.stdout:Oct 19 12:40:56 smithi195 ceph-mds[171422]: -- 172.21.15.195:0/812774954 <== mon.1 v2:172.21.15.195:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55a46425d1e0 con 0x55a464233000 2023-10-19T12:40:56.881 INFO:journalctl@ceph.mds.f.smithi195.stdout:Oct 19 12:40:56 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mds-f[171398]: starting mds.f at 2023-10-19T12:40:56.881 INFO:journalctl@ceph.mds.f.smithi195.stdout:Oct 19 12:40:56 smithi195 bash[171382]: 68490d82705b9a4f0cb8cd45df58196b72e267bc32dedb5a401a65042b0d092c 2023-10-19T12:40:56.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:56 smithi046 ceph-mon[98509]: Deploying daemon mds.f on smithi195 2023-10-19T12:40:57.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:56 smithi157 ceph-mon[134109]: Deploying daemon mds.f on smithi195 2023-10-19T12:40:57.380 INFO:journalctl@ceph.mds.f.smithi195.stdout:Oct 19 12:40:56 smithi195 systemd[1]: Started Ceph mds.f for 96a8be3c-6e7b-11ee-8db6-212e2dc638e7. 2023-10-19T12:40:57.959 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:57 smithi195 ceph-mon[134493]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-19T12:40:57.959 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:57 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/877177061' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-19T12:40:57.959 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:57 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:57.959 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:57 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:57.960 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:57 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:57.960 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:57 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-19T12:40:57.960 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:57 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-19T12:40:57.960 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:57 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:40:57.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:57 smithi046 ceph-mon[98509]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-19T12:40:57.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:57 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/877177061' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-19T12:40:57.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:57 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:57.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:57 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:57.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:57 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:57.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:57 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-19T12:40:57.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:57 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-19T12:40:57.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:57 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:40:58.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:57 smithi157 ceph-mon[134109]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-19T12:40:58.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:57 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/877177061' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-19T12:40:58.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:57 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:58.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:57 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:58.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:57 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:40:58.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:57 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-19T12:40:58.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:57 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-19T12:40:58.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:57 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:40:58.515 INFO:journalctl@ceph.mds.c.smithi195.stdout:Oct 19 12:40:58 smithi195 systemd[1]: Starting Ceph mds.c for 96a8be3c-6e7b-11ee-8db6-212e2dc638e7... 2023-10-19T12:40:58.781 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-19T12:40:58.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:58 smithi046 ceph-mon[98509]: Deploying daemon mds.c on smithi195 2023-10-19T12:40:58.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:58 smithi046 ceph-mon[98509]: mds.? [v2:172.21.15.195:6834/1406909915,v1:172.21.15.195:6835/1406909915] up:boot 2023-10-19T12:40:58.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:58 smithi046 ceph-mon[98509]: fsmap 6 up:standby 2023-10-19T12:40:58.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:58 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-10-19T12:40:59.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:58.996+0000 7fd70a9ff700 1 -- 172.21.15.46:0/900632805 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd704100740 msgr2=0x7fd704100b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:40:59.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:58.996+0000 7fd70a9ff700 1 --2- 172.21.15.46:0/900632805 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd704100740 0x7fd704100b60 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd6f40099c0 tx=0x7fd6f4009cd0 comp rx=0 tx=0).stop 2023-10-19T12:40:59.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:58.996+0000 7fd70a9ff700 1 -- 172.21.15.46:0/900632805 shutdown_connections 2023-10-19T12:40:59.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:58.996+0000 7fd70a9ff700 1 --2- 172.21.15.46:0/900632805 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd7041022d0 0x7fd704108b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:59.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:58.996+0000 7fd70a9ff700 1 --2- 172.21.15.46:0/900632805 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd704100740 0x7fd704100b60 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:59.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:58.996+0000 7fd70a9ff700 1 --2- 172.21.15.46:0/900632805 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd704101930 0x7fd704101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:59.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:58.996+0000 7fd70a9ff700 1 -- 172.21.15.46:0/900632805 >> 172.21.15.46:0/900632805 conn(0x7fd7040fbc90 msgr2=0x7fd7040fe0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:40:59.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:58.996+0000 7fd70a9ff700 1 -- 172.21.15.46:0/900632805 shutdown_connections 2023-10-19T12:40:59.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:58.996+0000 7fd70a9ff700 1 -- 172.21.15.46:0/900632805 wait complete. 2023-10-19T12:40:59.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:58.997+0000 7fd70a9ff700 1 Processor -- start 2023-10-19T12:40:59.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:58.997+0000 7fd70a9ff700 1 -- start start 2023-10-19T12:40:59.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:58.997+0000 7fd70a9ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd704100740 0x7fd704198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:40:59.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:58.997+0000 7fd70a9ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd704101930 0x7fd704198e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:40:59.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:58.997+0000 7fd70a9ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd7041022d0 0x7fd70419fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:40:59.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:58.997+0000 7fd70a9ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7041a0430 con 0x7fd704101930 2023-10-19T12:40:59.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:58.997+0000 7fd70a9ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7041a0570 con 0x7fd7041022d0 2023-10-19T12:40:59.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:58.997+0000 7fd70a9ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7041a0700 con 0x7fd704100740 2023-10-19T12:40:59.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:58.998+0000 7fd7037fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd704101930 0x7fd704198e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:40:59.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:58.998+0000 7fd7037fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd704101930 0x7fd704198e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47332/0 (socket says 172.21.15.46:47332) 2023-10-19T12:40:59.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:58.998+0000 7fd7037fe700 1 -- 172.21.15.46:0/623266089 learned_addr learned my addr 172.21.15.46:0/623266089 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:40:59.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:58.998+0000 7fd703fff700 1 --2- 172.21.15.46:0/623266089 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd704100740 0x7fd704198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:40:59.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:58.998+0000 7fd708f9c700 1 --2- 172.21.15.46:0/623266089 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd7041022d0 0x7fd70419fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:40:59.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:58.998+0000 7fd7037fe700 1 -- 172.21.15.46:0/623266089 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd704100740 msgr2=0x7fd704198900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:40:59.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:58.998+0000 7fd7037fe700 1 --2- 172.21.15.46:0/623266089 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd704100740 0x7fd704198900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:59.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:58.998+0000 7fd7037fe700 1 -- 172.21.15.46:0/623266089 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd7041022d0 msgr2=0x7fd70419fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:40:59.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:58.998+0000 7fd7037fe700 1 --2- 172.21.15.46:0/623266089 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd7041022d0 0x7fd70419fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:59.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:58.998+0000 7fd7037fe700 1 -- 172.21.15.46:0/623266089 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6f40095f0 con 0x7fd704101930 2023-10-19T12:40:59.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:58.998+0000 7fd708f9c700 1 --2- 172.21.15.46:0/623266089 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd7041022d0 0x7fd70419fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T12:40:59.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:58.998+0000 7fd703fff700 1 --2- 172.21.15.46:0/623266089 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd704100740 0x7fd704198900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:40:59.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:58.998+0000 7fd7037fe700 1 --2- 172.21.15.46:0/623266089 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd704101930 0x7fd704198e40 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd6f800e9a0 tx=0x7fd6f800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:40:59.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:58.998+0000 7fd7017fa700 1 -- 172.21.15.46:0/623266089 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f8009790 con 0x7fd704101930 2023-10-19T12:40:59.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:58.999+0000 7fd70a9ff700 1 -- 172.21.15.46:0/623266089 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7041a09e0 con 0x7fd704101930 2023-10-19T12:40:59.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:58.999+0000 7fd7017fa700 1 -- 172.21.15.46:0/623266089 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd6f800cbd0 con 0x7fd704101930 2023-10-19T12:40:59.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:58.999+0000 7fd70a9ff700 1 -- 172.21.15.46:0/623266089 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7041a0ef0 con 0x7fd704101930 2023-10-19T12:40:59.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:58.999+0000 7fd7017fa700 1 -- 172.21.15.46:0/623266089 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f8018620 con 0x7fd704101930 2023-10-19T12:40:59.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:59.000+0000 7fd70a9ff700 1 -- 172.21.15.46:0/623266089 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd704067530 con 0x7fd704101930 2023-10-19T12:40:59.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:59.002+0000 7fd7017fa700 1 -- 172.21.15.46:0/623266089 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fd6f800cd40 con 0x7fd704101930 2023-10-19T12:40:59.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:59.003+0000 7fd7017fa700 1 --2- 172.21.15.46:0/623266089 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fd6ec0a1480 0x7fd6ec0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:40:59.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:59.004+0000 7fd7017fa700 1 -- 172.21.15.46:0/623266089 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fd6f8014070 con 0x7fd704101930 2023-10-19T12:40:59.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:59.004+0000 7fd703fff700 1 --2- 172.21.15.46:0/623266089 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fd6ec0a1480 0x7fd6ec0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:40:59.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:59.004+0000 7fd703fff700 1 --2- 172.21.15.46:0/623266089 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fd6ec0a1480 0x7fd6ec0a3940 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd6f4003730 tx=0x7fd6f400b540 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:40:59.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:59.006+0000 7fd7017fa700 1 -- 172.21.15.46:0/623266089 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd6f8096860 con 0x7fd704101930 2023-10-19T12:40:59.036 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:58 smithi195 ceph-mon[134493]: Deploying daemon mds.c on smithi195 2023-10-19T12:40:59.036 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:58 smithi195 ceph-mon[134493]: mds.? [v2:172.21.15.195:6834/1406909915,v1:172.21.15.195:6835/1406909915] up:boot 2023-10-19T12:40:59.037 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:58 smithi195 ceph-mon[134493]: fsmap 6 up:standby 2023-10-19T12:40:59.037 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:58 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-10-19T12:40:59.037 INFO:journalctl@ceph.mds.c.smithi195.stdout:Oct 19 12:40:58 smithi195 podman[171721]: 2023-10-19T12:40:59.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:58 smithi157 ceph-mon[134109]: Deploying daemon mds.c on smithi195 2023-10-19T12:40:59.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:58 smithi157 ceph-mon[134109]: mds.? [v2:172.21.15.195:6834/1406909915,v1:172.21.15.195:6835/1406909915] up:boot 2023-10-19T12:40:59.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:58 smithi157 ceph-mon[134109]: fsmap 6 up:standby 2023-10-19T12:40:59.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:58 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-10-19T12:40:59.271 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:59.268+0000 7fd70a9ff700 1 -- 172.21.15.46:0/623266089 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd70410bfb0 con 0x7fd704101930 2023-10-19T12:40:59.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:59.268+0000 7fd7017fa700 1 -- 172.21.15.46:0/623266089 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+5286 (secure 0 0 0) 0x7fd6f8099e80 con 0x7fd704101930 2023-10-19T12:40:59.272 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:40:59.272 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":7,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14580,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/2235286008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":2235286008},{"type":"v1","addr":"172.21.15.46:6835","nonce":2235286008}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14592,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/339398444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":339398444},{"type":"v1","addr":"172.21.15.46:6837","nonce":339398444}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24560,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/1687745569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":1687745569},{"type":"v1","addr":"172.21.15.157:6833","nonce":1687745569}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24574,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6833/3629933235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3629933235},{"type":"v1","addr":"172.21.15.195:6833","nonce":3629933235}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24602,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/108432552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":108432552},{"type":"v1","addr":"172.21.15.157:6835","nonce":108432552}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24631,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/1406909915","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":1406909915},{"type":"v1","addr":"172.21.15.195:6835","nonce":1406909915}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7}],"filesystems":[]} 2023-10-19T12:40:59.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:59.271+0000 7fd70a9ff700 1 -- 172.21.15.46:0/623266089 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fd6ec0a1480 msgr2=0x7fd6ec0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:40:59.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:59.271+0000 7fd70a9ff700 1 --2- 172.21.15.46:0/623266089 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fd6ec0a1480 0x7fd6ec0a3940 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd6f4003730 tx=0x7fd6f400b540 comp rx=0 tx=0).stop 2023-10-19T12:40:59.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:59.271+0000 7fd70a9ff700 1 -- 172.21.15.46:0/623266089 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd704101930 msgr2=0x7fd704198e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:40:59.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:59.271+0000 7fd70a9ff700 1 --2- 172.21.15.46:0/623266089 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd704101930 0x7fd704198e40 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd6f800e9a0 tx=0x7fd6f800ecb0 comp rx=0 tx=0).stop 2023-10-19T12:40:59.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:59.271+0000 7fd70a9ff700 1 -- 172.21.15.46:0/623266089 shutdown_connections 2023-10-19T12:40:59.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:59.271+0000 7fd70a9ff700 1 --2- 172.21.15.46:0/623266089 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd7041022d0 0x7fd70419fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:59.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:59.271+0000 7fd70a9ff700 1 --2- 172.21.15.46:0/623266089 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fd6ec0a1480 0x7fd6ec0a3940 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:59.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:59.271+0000 7fd70a9ff700 1 --2- 172.21.15.46:0/623266089 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd704100740 0x7fd704198900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:59.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:59.271+0000 7fd70a9ff700 1 --2- 172.21.15.46:0/623266089 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd704101930 0x7fd704198e40 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:40:59.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:59.271+0000 7fd70a9ff700 1 -- 172.21.15.46:0/623266089 >> 172.21.15.46:0/623266089 conn(0x7fd7040fbc90 msgr2=0x7fd704107170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:40:59.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:59.271+0000 7fd70a9ff700 1 -- 172.21.15.46:0/623266089 shutdown_connections 2023-10-19T12:40:59.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:40:59.271+0000 7fd70a9ff700 1 -- 172.21.15.46:0/623266089 wait complete. 2023-10-19T12:40:59.277 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 7 2023-10-19T12:40:59.380 INFO:journalctl@ceph.mds.c.smithi195.stdout:Oct 19 12:40:59 smithi195 ceph-mds[171761]: -- 172.21.15.195:0/1668945397 <== mon.1 v2:172.21.15.195:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5607693031e0 con 0x5607692d8800 2023-10-19T12:40:59.381 INFO:journalctl@ceph.mds.c.smithi195.stdout:Oct 19 12:40:59 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mds-c[171737]: starting mds.c at 2023-10-19T12:40:59.381 INFO:journalctl@ceph.mds.c.smithi195.stdout:Oct 19 12:40:59 smithi195 bash[171721]: 0d72d06d4b1b719001ab882fd64f17fc7677a72fb57ae01a29e80d2fb0579aef 2023-10-19T12:40:59.381 INFO:journalctl@ceph.mds.c.smithi195.stdout:Oct 19 12:40:59 smithi195 systemd[1]: Started Ceph mds.c for 96a8be3c-6e7b-11ee-8db6-212e2dc638e7. 2023-10-19T12:41:00.047 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:59 smithi157 ceph-mon[134109]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-19T12:41:00.047 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:59 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:00.047 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:59 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:00.047 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:59 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:00.047 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:59 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-19T12:41:00.048 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:59 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-19T12:41:00.048 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:59 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:41:00.048 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:40:59 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/623266089' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-19T12:41:00.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:59 smithi195 ceph-mon[134493]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-19T12:41:00.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:59 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:00.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:59 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:00.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:59 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:00.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:59 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-19T12:41:00.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:59 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-19T12:41:00.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:59 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:41:00.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:40:59 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/623266089' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-19T12:41:00.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:59 smithi046 ceph-mon[98509]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-19T12:41:00.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:59 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:00.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:59 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:00.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:59 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:00.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:59 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-19T12:41:00.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:59 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-19T12:41:00.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:59 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:41:00.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:40:59 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/623266089' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-19T12:41:01.066 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:00 smithi157 ceph-mon[134109]: Deploying daemon mds.h on smithi157 2023-10-19T12:41:01.066 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:00 smithi157 ceph-mon[134109]: mds.? [v2:172.21.15.195:6836/293916188,v1:172.21.15.195:6837/293916188] up:boot 2023-10-19T12:41:01.066 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:00 smithi157 ceph-mon[134109]: fsmap 7 up:standby 2023-10-19T12:41:01.067 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:00 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-10-19T12:41:01.067 INFO:journalctl@ceph.mds.h.smithi157.stdout:Oct 19 12:41:00 smithi157 systemd[1]: Starting Ceph mds.h for 96a8be3c-6e7b-11ee-8db6-212e2dc638e7... 2023-10-19T12:41:01.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:00 smithi195 ceph-mon[134493]: Deploying daemon mds.h on smithi157 2023-10-19T12:41:01.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:00 smithi195 ceph-mon[134493]: mds.? [v2:172.21.15.195:6836/293916188,v1:172.21.15.195:6837/293916188] up:boot 2023-10-19T12:41:01.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:00 smithi195 ceph-mon[134493]: fsmap 7 up:standby 2023-10-19T12:41:01.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:00 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-10-19T12:41:01.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:00 smithi046 ceph-mon[98509]: Deploying daemon mds.h on smithi157 2023-10-19T12:41:01.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:00 smithi046 ceph-mon[98509]: mds.? [v2:172.21.15.195:6836/293916188,v1:172.21.15.195:6837/293916188] up:boot 2023-10-19T12:41:01.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:00 smithi046 ceph-mon[98509]: fsmap 7 up:standby 2023-10-19T12:41:01.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:00 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-10-19T12:41:01.294 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-19T12:41:01.337 INFO:journalctl@ceph.mds.h.smithi157.stdout:Oct 19 12:41:01 smithi157 podman[170485]: 2023-10-19T12:41:01.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:01.509+0000 7f4a143ff700 1 -- 172.21.15.46:0/3191425281 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4a0c103ac0 msgr2=0x7f4a0c105eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:01.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:01.509+0000 7f4a143ff700 1 --2- 172.21.15.46:0/3191425281 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4a0c103ac0 0x7f4a0c105eb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f49fc009990 tx=0x7f49fc009ca0 comp rx=0 tx=0).stop 2023-10-19T12:41:01.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:01.509+0000 7f4a143ff700 1 -- 172.21.15.46:0/3191425281 shutdown_connections 2023-10-19T12:41:01.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:01.509+0000 7f4a143ff700 1 --2- 172.21.15.46:0/3191425281 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a0c1063f0 0x7f4a0c108860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:01.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:01.509+0000 7f4a143ff700 1 --2- 172.21.15.46:0/3191425281 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4a0c101190 0x7f4a0c103580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:01.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:01.509+0000 7f4a143ff700 1 --2- 172.21.15.46:0/3191425281 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4a0c103ac0 0x7f4a0c105eb0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:01.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:01.509+0000 7f4a143ff700 1 -- 172.21.15.46:0/3191425281 >> 172.21.15.46:0/3191425281 conn(0x7f4a0c0faba0 msgr2=0x7f4a0c0fcfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:01.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:01.509+0000 7f4a143ff700 1 -- 172.21.15.46:0/3191425281 shutdown_connections 2023-10-19T12:41:01.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:01.509+0000 7f4a143ff700 1 -- 172.21.15.46:0/3191425281 wait complete. 2023-10-19T12:41:01.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:01.510+0000 7f4a143ff700 1 Processor -- start 2023-10-19T12:41:01.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:01.510+0000 7f4a143ff700 1 -- start start 2023-10-19T12:41:01.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:01.510+0000 7f4a143ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4a0c101190 0x7f4a0c198890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:01.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:01.510+0000 7f4a143ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4a0c103ac0 0x7f4a0c198dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:01.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:01.510+0000 7f4a143ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a0c1063f0 0x7f4a0c19fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:01.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:01.510+0000 7f4a143ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a0c1a03c0 con 0x7f4a0c1063f0 2023-10-19T12:41:01.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:01.510+0000 7f4a143ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a0c1a0500 con 0x7f4a0c103ac0 2023-10-19T12:41:01.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:01.510+0000 7f4a143ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a0c1a0690 con 0x7f4a0c101190 2023-10-19T12:41:01.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:01.511+0000 7f4a1299c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a0c1063f0 0x7f4a0c19fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:01.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:01.511+0000 7f4a1299c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a0c1063f0 0x7f4a0c19fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47336/0 (socket says 172.21.15.46:47336) 2023-10-19T12:41:01.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:01.511+0000 7f4a1299c700 1 -- 172.21.15.46:0/2510671335 learned_addr learned my addr 172.21.15.46:0/2510671335 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:41:01.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:01.511+0000 7f4a1219b700 1 --2- 172.21.15.46:0/2510671335 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4a0c101190 0x7f4a0c198890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:01.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:01.511+0000 7f4a1199a700 1 --2- 172.21.15.46:0/2510671335 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4a0c103ac0 0x7f4a0c198dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:01.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:01.511+0000 7f4a1299c700 1 -- 172.21.15.46:0/2510671335 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4a0c101190 msgr2=0x7f4a0c198890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:01.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:01.511+0000 7f4a1299c700 1 --2- 172.21.15.46:0/2510671335 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4a0c101190 0x7f4a0c198890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:01.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:01.511+0000 7f4a1299c700 1 -- 172.21.15.46:0/2510671335 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4a0c103ac0 msgr2=0x7f4a0c198dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:01.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:01.511+0000 7f4a1299c700 1 --2- 172.21.15.46:0/2510671335 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4a0c103ac0 0x7f4a0c198dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:01.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:01.511+0000 7f4a1299c700 1 -- 172.21.15.46:0/2510671335 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a08009520 con 0x7f4a0c1063f0 2023-10-19T12:41:01.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:01.511+0000 7f4a1299c700 1 --2- 172.21.15.46:0/2510671335 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a0c1063f0 0x7f4a0c19fdf0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4a0400ef30 tx=0x7f4a0400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:01.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:01.511+0000 7f4a037fe700 1 -- 172.21.15.46:0/2510671335 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a04018070 con 0x7f4a0c1063f0 2023-10-19T12:41:01.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:01.512+0000 7f4a037fe700 1 -- 172.21.15.46:0/2510671335 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4a0400f040 con 0x7f4a0c1063f0 2023-10-19T12:41:01.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:01.512+0000 7f4a143ff700 1 -- 172.21.15.46:0/2510671335 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49fc0095f0 con 0x7f4a0c1063f0 2023-10-19T12:41:01.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:01.512+0000 7f4a037fe700 1 -- 172.21.15.46:0/2510671335 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a0400cd00 con 0x7f4a0c1063f0 2023-10-19T12:41:01.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:01.512+0000 7f4a143ff700 1 -- 172.21.15.46:0/2510671335 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a0c1a0c90 con 0x7f4a0c1063f0 2023-10-19T12:41:01.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:01.513+0000 7f4a143ff700 1 -- 172.21.15.46:0/2510671335 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a0c107ff0 con 0x7f4a0c1063f0 2023-10-19T12:41:01.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:01.515+0000 7f4a037fe700 1 -- 172.21.15.46:0/2510671335 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f4a04003a00 con 0x7f4a0c1063f0 2023-10-19T12:41:01.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:01.516+0000 7f4a037fe700 1 --2- 172.21.15.46:0/2510671335 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f49f80a1500 0x7f49f80a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:01.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:01.516+0000 7f4a037fe700 1 -- 172.21.15.46:0/2510671335 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f4a040cc420 con 0x7f4a0c1063f0 2023-10-19T12:41:01.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:01.516+0000 7f4a1219b700 1 --2- 172.21.15.46:0/2510671335 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f49f80a1500 0x7f49f80a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:01.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:01.517+0000 7f4a1219b700 1 --2- 172.21.15.46:0/2510671335 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f49f80a1500 0x7f49f80a39c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4a08009df0 tx=0x7f4a08009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:01.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:01.522+0000 7f4a037fe700 1 -- 172.21.15.46:0/2510671335 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f4a04095f10 con 0x7f4a0c1063f0 2023-10-19T12:41:01.740 INFO:journalctl@ceph.mds.h.smithi157.stdout:Oct 19 12:41:01 smithi157 bash[170485]: a4f66750f6594c162f841b1e72d2f726854b99ff4c688934546ac0ddcab567aa 2023-10-19T12:41:01.741 INFO:journalctl@ceph.mds.h.smithi157.stdout:Oct 19 12:41:01 smithi157 ceph-mds[170525]: -- 172.21.15.157:0/3048927374 <== mon.2 v2:172.21.15.157:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55d23da6b1e0 con 0x55d23da40800 2023-10-19T12:41:01.741 INFO:journalctl@ceph.mds.h.smithi157.stdout:Oct 19 12:41:01 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mds-h[170501]: starting mds.h at 2023-10-19T12:41:01.741 INFO:journalctl@ceph.mds.h.smithi157.stdout:Oct 19 12:41:01 smithi157 systemd[1]: Started Ceph mds.h for 96a8be3c-6e7b-11ee-8db6-212e2dc638e7. 2023-10-19T12:41:01.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:01.783+0000 7f4a143ff700 1 -- 172.21.15.46:0/2510671335 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4a0c067500 con 0x7f4a0c1063f0 2023-10-19T12:41:01.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:01.784+0000 7f4a037fe700 1 -- 172.21.15.46:0/2510671335 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+6871 (secure 0 0 0) 0x7f4a04099530 con 0x7f4a0c1063f0 2023-10-19T12:41:01.787 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:41:01.787 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":9,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14580,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/2235286008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":2235286008},{"type":"v1","addr":"172.21.15.46:6835","nonce":2235286008}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14592,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/339398444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":339398444},{"type":"v1","addr":"172.21.15.46:6837","nonce":339398444}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24560,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/1687745569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":1687745569},{"type":"v1","addr":"172.21.15.157:6833","nonce":1687745569}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24574,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6833/3629933235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3629933235},{"type":"v1","addr":"172.21.15.195:6833","nonce":3629933235}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24602,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/108432552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":108432552},{"type":"v1","addr":"172.21.15.157:6835","nonce":108432552}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24629,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6837/2629536514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6836","nonce":2629536514},{"type":"v1","addr":"172.21.15.157:6837","nonce":2629536514}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24631,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/1406909915","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":1406909915},{"type":"v1","addr":"172.21.15.195:6835","nonce":1406909915}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24643,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6837/293916188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":293916188},{"type":"v1","addr":"172.21.15.195:6837","nonce":293916188}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8}],"filesystems":[]} 2023-10-19T12:41:01.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:01.786+0000 7f4a143ff700 1 -- 172.21.15.46:0/2510671335 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f49f80a1500 msgr2=0x7f49f80a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:01.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:01.786+0000 7f4a143ff700 1 --2- 172.21.15.46:0/2510671335 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f49f80a1500 0x7f49f80a39c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4a08009df0 tx=0x7f4a08009260 comp rx=0 tx=0).stop 2023-10-19T12:41:01.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:01.786+0000 7f4a143ff700 1 -- 172.21.15.46:0/2510671335 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a0c1063f0 msgr2=0x7f4a0c19fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:01.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:01.786+0000 7f4a143ff700 1 --2- 172.21.15.46:0/2510671335 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a0c1063f0 0x7f4a0c19fdf0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4a0400ef30 tx=0x7f4a0400c3a0 comp rx=0 tx=0).stop 2023-10-19T12:41:01.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:01.786+0000 7f4a143ff700 1 -- 172.21.15.46:0/2510671335 shutdown_connections 2023-10-19T12:41:01.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:01.786+0000 7f4a143ff700 1 --2- 172.21.15.46:0/2510671335 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a0c1063f0 0x7f4a0c19fdf0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:01.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:01.786+0000 7f4a143ff700 1 --2- 172.21.15.46:0/2510671335 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f49f80a1500 0x7f49f80a39c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:01.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:01.786+0000 7f4a143ff700 1 --2- 172.21.15.46:0/2510671335 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4a0c101190 0x7f4a0c198890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:01.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:01.786+0000 7f4a143ff700 1 --2- 172.21.15.46:0/2510671335 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4a0c103ac0 0x7f4a0c198dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:01.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:01.786+0000 7f4a143ff700 1 -- 172.21.15.46:0/2510671335 >> 172.21.15.46:0/2510671335 conn(0x7f4a0c0faba0 msgr2=0x7f4a0c100a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:01.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:01.786+0000 7f4a143ff700 1 -- 172.21.15.46:0/2510671335 shutdown_connections 2023-10-19T12:41:01.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:01.787+0000 7f4a143ff700 1 -- 172.21.15.46:0/2510671335 wait complete. 2023-10-19T12:41:01.793 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 9 2023-10-19T12:41:02.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:01 smithi157 ceph-mon[134109]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-19T12:41:02.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:01 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:02.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:01 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:02.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:01 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:02.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:01 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-19T12:41:02.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:01 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-19T12:41:02.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:01 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:41:02.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:01 smithi195 ceph-mon[134493]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-19T12:41:02.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:01 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:02.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:01 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:02.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:01 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:02.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:01 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-19T12:41:02.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:01 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-19T12:41:02.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:01 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:41:02.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:01 smithi046 ceph-mon[98509]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-19T12:41:02.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:01 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:02.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:01 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:02.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:01 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:02.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:01 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-19T12:41:02.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:01 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-19T12:41:02.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:01 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:41:03.017 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:02 smithi195 ceph-mon[134493]: Deploying daemon mds.i on smithi195 2023-10-19T12:41:03.017 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:02 smithi195 ceph-mon[134493]: mds.? [v2:172.21.15.157:6836/2629536514,v1:172.21.15.157:6837/2629536514] up:boot 2023-10-19T12:41:03.018 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:02 smithi195 ceph-mon[134493]: fsmap 8 up:standby 2023-10-19T12:41:03.018 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:02 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-10-19T12:41:03.019 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:02 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/2510671335' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-19T12:41:03.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:02 smithi157 ceph-mon[134109]: Deploying daemon mds.i on smithi195 2023-10-19T12:41:03.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:02 smithi157 ceph-mon[134109]: mds.? [v2:172.21.15.157:6836/2629536514,v1:172.21.15.157:6837/2629536514] up:boot 2023-10-19T12:41:03.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:02 smithi157 ceph-mon[134109]: fsmap 8 up:standby 2023-10-19T12:41:03.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:02 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-10-19T12:41:03.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:02 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/2510671335' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-19T12:41:03.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:02 smithi046 ceph-mon[98509]: Deploying daemon mds.i on smithi195 2023-10-19T12:41:03.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:02 smithi046 ceph-mon[98509]: mds.? [v2:172.21.15.157:6836/2629536514,v1:172.21.15.157:6837/2629536514] up:boot 2023-10-19T12:41:03.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:02 smithi046 ceph-mon[98509]: fsmap 8 up:standby 2023-10-19T12:41:03.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:02 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-10-19T12:41:03.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:02 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/2510671335' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-19T12:41:03.380 INFO:journalctl@ceph.mds.i.smithi195.stdout:Oct 19 12:41:03 smithi195 systemd[1]: Starting Ceph mds.i for 96a8be3c-6e7b-11ee-8db6-212e2dc638e7... 2023-10-19T12:41:03.680 INFO:journalctl@ceph.mds.i.smithi195.stdout:Oct 19 12:41:03 smithi195 podman[172070]: 2023-10-19T12:41:03.810 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-19T12:41:04.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:04.026+0000 7f67bc9ff700 1 -- 172.21.15.46:0/1422826170 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f67b80731f0 msgr2=0x7f67b8073670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:04.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:04.026+0000 7f67bc9ff700 1 --2- 172.21.15.46:0/1422826170 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f67b80731f0 0x7f67b8073670 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f67ac009990 tx=0x7f67ac009ca0 comp rx=0 tx=0).stop 2023-10-19T12:41:04.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:04.026+0000 7f67bc9ff700 1 -- 172.21.15.46:0/1422826170 shutdown_connections 2023-10-19T12:41:04.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:04.026+0000 7f67bc9ff700 1 --2- 172.21.15.46:0/1422826170 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f67b8108610 0x7f67b810aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:04.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:04.026+0000 7f67bc9ff700 1 --2- 172.21.15.46:0/1422826170 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f67b80747d0 0x7f67b8072c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:04.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:04.026+0000 7f67bc9ff700 1 --2- 172.21.15.46:0/1422826170 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f67b80731f0 0x7f67b8073670 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:04.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:04.026+0000 7f67bc9ff700 1 -- 172.21.15.46:0/1422826170 >> 172.21.15.46:0/1422826170 conn(0x7f67b80fbc90 msgr2=0x7f67b80fe0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:04.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:04.026+0000 7f67bc9ff700 1 -- 172.21.15.46:0/1422826170 shutdown_connections 2023-10-19T12:41:04.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:04.026+0000 7f67bc9ff700 1 -- 172.21.15.46:0/1422826170 wait complete. 2023-10-19T12:41:04.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:04.027+0000 7f67bc9ff700 1 Processor -- start 2023-10-19T12:41:04.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:04.027+0000 7f67bc9ff700 1 -- start start 2023-10-19T12:41:04.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:04.027+0000 7f67bc9ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f67b80731f0 0x7f67b8198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:04.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:04.027+0000 7f67bc9ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f67b80747d0 0x7f67b8198ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:04.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:04.027+0000 7f67bc9ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f67b8108610 0x7f67b819fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:04.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:04.027+0000 7f67bc9ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67b81a0440 con 0x7f67b80747d0 2023-10-19T12:41:04.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:04.027+0000 7f67bc9ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67b81a0580 con 0x7f67b80731f0 2023-10-19T12:41:04.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:04.027+0000 7f67bc9ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67b81a0710 con 0x7f67b8108610 2023-10-19T12:41:04.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:04.028+0000 7f67b5d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f67b80747d0 0x7f67b8198ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:04.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:04.028+0000 7f67b5d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f67b80747d0 0x7f67b8198ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54318/0 (socket says 172.21.15.46:54318) 2023-10-19T12:41:04.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:04.028+0000 7f67b5d9b700 1 -- 172.21.15.46:0/164804740 learned_addr learned my addr 172.21.15.46:0/164804740 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:41:04.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:04.028+0000 7f67b659c700 1 --2- 172.21.15.46:0/164804740 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f67b80731f0 0x7f67b8198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:04.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:04.028+0000 7f67b6d9d700 1 --2- 172.21.15.46:0/164804740 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f67b8108610 0x7f67b819fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:04.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:04.028+0000 7f67b5d9b700 1 -- 172.21.15.46:0/164804740 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f67b8108610 msgr2=0x7f67b819fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:04.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:04.028+0000 7f67b5d9b700 1 --2- 172.21.15.46:0/164804740 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f67b8108610 0x7f67b819fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:04.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:04.028+0000 7f67b5d9b700 1 -- 172.21.15.46:0/164804740 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f67b80731f0 msgr2=0x7f67b8198960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:04.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:04.028+0000 7f67b5d9b700 1 --2- 172.21.15.46:0/164804740 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f67b80731f0 0x7f67b8198960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:04.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:04.028+0000 7f67b5d9b700 1 -- 172.21.15.46:0/164804740 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67ac0095f0 con 0x7f67b80747d0 2023-10-19T12:41:04.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:04.028+0000 7f67b659c700 1 --2- 172.21.15.46:0/164804740 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f67b80731f0 0x7f67b8198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:41:04.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:04.028+0000 7f67b5d9b700 1 --2- 172.21.15.46:0/164804740 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f67b80747d0 0x7f67b8198ea0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f67ac00b680 tx=0x7f67ac009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:04.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:04.029+0000 7f67a77fe700 1 -- 172.21.15.46:0/164804740 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67ac01d070 con 0x7f67b80747d0 2023-10-19T12:41:04.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:04.029+0000 7f67a77fe700 1 -- 172.21.15.46:0/164804740 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f67ac022470 con 0x7f67b80747d0 2023-10-19T12:41:04.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:04.029+0000 7f67bc9ff700 1 -- 172.21.15.46:0/164804740 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67b81a0990 con 0x7f67b80747d0 2023-10-19T12:41:04.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:04.029+0000 7f67a77fe700 1 -- 172.21.15.46:0/164804740 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67ac017650 con 0x7f67b80747d0 2023-10-19T12:41:04.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:04.029+0000 7f67bc9ff700 1 -- 172.21.15.46:0/164804740 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67b81a0e10 con 0x7f67b80747d0 2023-10-19T12:41:04.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:04.030+0000 7f67bc9ff700 1 -- 172.21.15.46:0/164804740 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67b8107420 con 0x7f67b80747d0 2023-10-19T12:41:04.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:04.032+0000 7f67a77fe700 1 -- 172.21.15.46:0/164804740 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f67ac0225e0 con 0x7f67b80747d0 2023-10-19T12:41:04.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:04.033+0000 7f67a77fe700 1 --2- 172.21.15.46:0/164804740 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f67a00a1500 0x7f67a00a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:04.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:04.034+0000 7f67a77fe700 1 -- 172.21.15.46:0/164804740 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f67ac0ce080 con 0x7f67b80747d0 2023-10-19T12:41:04.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:04.034+0000 7f67b659c700 1 --2- 172.21.15.46:0/164804740 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f67a00a1500 0x7f67a00a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:04.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:04.034+0000 7f67b659c700 1 --2- 172.21.15.46:0/164804740 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f67a00a1500 0x7f67a00a39c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f67a8011490 tx=0x7f67a8009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:04.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:04.040+0000 7f67a77fe700 1 -- 172.21.15.46:0/164804740 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f67ac097b70 con 0x7f67b80747d0 2023-10-19T12:41:04.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:03 smithi157 ceph-mon[134109]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-19T12:41:04.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:03 smithi195 ceph-mon[134493]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-19T12:41:04.131 INFO:journalctl@ceph.mds.i.smithi195.stdout:Oct 19 12:41:03 smithi195 bash[172070]: 6d8cc1b0ad321348c6fa0649a69baba445b44519ce131d51efcee857ef53d4b7 2023-10-19T12:41:04.131 INFO:journalctl@ceph.mds.i.smithi195.stdout:Oct 19 12:41:03 smithi195 ceph-mds[172111]: -- 172.21.15.195:0/1976750730 <== mon.1 v2:172.21.15.195:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x556bd5f8f1e0 con 0x556bd5f65000 2023-10-19T12:41:04.131 INFO:journalctl@ceph.mds.i.smithi195.stdout:Oct 19 12:41:03 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mds-i[172086]: starting mds.i at 2023-10-19T12:41:04.131 INFO:journalctl@ceph.mds.i.smithi195.stdout:Oct 19 12:41:03 smithi195 systemd[1]: Started Ceph mds.i for 96a8be3c-6e7b-11ee-8db6-212e2dc638e7. 2023-10-19T12:41:04.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:03 smithi046 ceph-mon[98509]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-19T12:41:04.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:04.305+0000 7f67bc9ff700 1 -- 172.21.15.46:0/164804740 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f67b8067530 con 0x7f67b80747d0 2023-10-19T12:41:04.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:04.306+0000 7f67a77fe700 1 -- 172.21.15.46:0/164804740 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+7667 (secure 0 0 0) 0x7f67ac09b190 con 0x7f67b80747d0 2023-10-19T12:41:04.310 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:41:04.310 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14580,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/2235286008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":2235286008},{"type":"v1","addr":"172.21.15.46:6835","nonce":2235286008}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14592,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/339398444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":339398444},{"type":"v1","addr":"172.21.15.46:6837","nonce":339398444}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24560,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/1687745569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":1687745569},{"type":"v1","addr":"172.21.15.157:6833","nonce":1687745569}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24574,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6833/3629933235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3629933235},{"type":"v1","addr":"172.21.15.195:6833","nonce":3629933235}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24602,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/108432552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":108432552},{"type":"v1","addr":"172.21.15.157:6835","nonce":108432552}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24629,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6837/2629536514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6836","nonce":2629536514},{"type":"v1","addr":"172.21.15.157:6837","nonce":2629536514}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24631,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/1406909915","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":1406909915},{"type":"v1","addr":"172.21.15.195:6835","nonce":1406909915}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24643,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6837/293916188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":293916188},{"type":"v1","addr":"172.21.15.195:6837","nonce":293916188}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24655,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6839/4094901934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6838","nonce":4094901934},{"type":"v1","addr":"172.21.15.195:6839","nonce":4094901934}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[]} 2023-10-19T12:41:04.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:04.309+0000 7f67bc9ff700 1 -- 172.21.15.46:0/164804740 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f67a00a1500 msgr2=0x7f67a00a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:04.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:04.309+0000 7f67bc9ff700 1 --2- 172.21.15.46:0/164804740 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f67a00a1500 0x7f67a00a39c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f67a8011490 tx=0x7f67a8009260 comp rx=0 tx=0).stop 2023-10-19T12:41:04.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:04.309+0000 7f67bc9ff700 1 -- 172.21.15.46:0/164804740 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f67b80747d0 msgr2=0x7f67b8198ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:04.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:04.309+0000 7f67bc9ff700 1 --2- 172.21.15.46:0/164804740 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f67b80747d0 0x7f67b8198ea0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f67ac00b680 tx=0x7f67ac009580 comp rx=0 tx=0).stop 2023-10-19T12:41:04.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:04.309+0000 7f67bc9ff700 1 -- 172.21.15.46:0/164804740 shutdown_connections 2023-10-19T12:41:04.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:04.309+0000 7f67bc9ff700 1 --2- 172.21.15.46:0/164804740 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f67a00a1500 0x7f67a00a39c0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:04.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:04.309+0000 7f67bc9ff700 1 --2- 172.21.15.46:0/164804740 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f67b8108610 0x7f67b819fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:04.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:04.309+0000 7f67bc9ff700 1 --2- 172.21.15.46:0/164804740 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f67b80731f0 0x7f67b8198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:04.314 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:04.309+0000 7f67bc9ff700 1 --2- 172.21.15.46:0/164804740 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f67b80747d0 0x7f67b8198ea0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:04.314 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:04.309+0000 7f67bc9ff700 1 -- 172.21.15.46:0/164804740 >> 172.21.15.46:0/164804740 conn(0x7f67b80fbc90 msgr2=0x7f67b8104560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:04.314 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:04.309+0000 7f67bc9ff700 1 -- 172.21.15.46:0/164804740 shutdown_connections 2023-10-19T12:41:04.314 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:04.309+0000 7f67bc9ff700 1 -- 172.21.15.46:0/164804740 wait complete. 2023-10-19T12:41:04.315 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 10 2023-10-19T12:41:05.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:04 smithi157 ceph-mon[134109]: mds.? [v2:172.21.15.195:6838/4094901934,v1:172.21.15.195:6839/4094901934] up:boot 2023-10-19T12:41:05.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:04 smithi157 ceph-mon[134109]: fsmap 9 up:standby 2023-10-19T12:41:05.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:04 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-10-19T12:41:05.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:04 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:05.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:04 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:05.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:04 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:05.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:04 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-19T12:41:05.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:04 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-19T12:41:05.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:04 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:41:05.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:04 smithi157 ceph-mon[134109]: Deploying daemon mds.g on smithi046 2023-10-19T12:41:05.090 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:04 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/164804740' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-19T12:41:05.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:04 smithi195 ceph-mon[134493]: mds.? [v2:172.21.15.195:6838/4094901934,v1:172.21.15.195:6839/4094901934] up:boot 2023-10-19T12:41:05.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:04 smithi195 ceph-mon[134493]: fsmap 9 up:standby 2023-10-19T12:41:05.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:04 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-10-19T12:41:05.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:04 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:05.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:04 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:05.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:04 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:05.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:04 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-19T12:41:05.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:04 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-19T12:41:05.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:04 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:41:05.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:04 smithi195 ceph-mon[134493]: Deploying daemon mds.g on smithi046 2023-10-19T12:41:05.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:04 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/164804740' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-19T12:41:05.133 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:04 smithi046 ceph-mon[98509]: mds.? [v2:172.21.15.195:6838/4094901934,v1:172.21.15.195:6839/4094901934] up:boot 2023-10-19T12:41:05.134 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:04 smithi046 ceph-mon[98509]: fsmap 9 up:standby 2023-10-19T12:41:05.134 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:04 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-10-19T12:41:05.134 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:04 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:05.134 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:04 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:05.135 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:04 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:05.135 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:04 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-19T12:41:05.135 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:04 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-19T12:41:05.135 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:04 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:41:05.135 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:04 smithi046 ceph-mon[98509]: Deploying daemon mds.g on smithi046 2023-10-19T12:41:05.136 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:04 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/164804740' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-19T12:41:06.061 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:05 smithi046 ceph-mon[98509]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-19T12:41:06.062 INFO:journalctl@ceph.mds.g.smithi046.stdout:Oct 19 12:41:06 smithi046 systemd[1]: Starting Ceph mds.g for 96a8be3c-6e7b-11ee-8db6-212e2dc638e7... 2023-10-19T12:41:06.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:05 smithi157 ceph-mon[134109]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-19T12:41:06.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:05 smithi195 ceph-mon[134493]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-19T12:41:06.335 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-19T12:41:06.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:06.551+0000 7f385bbff700 1 -- 172.21.15.46:0/1047496084 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f38541042c0 msgr2=0x7f3854104740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:06.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:06.551+0000 7f385bbff700 1 --2- 172.21.15.46:0/1047496084 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f38541042c0 0x7f3854104740 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f384c00b0a0 tx=0x7f384c00b3b0 comp rx=0 tx=0).stop 2023-10-19T12:41:06.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:06.551+0000 7f385bbff700 1 -- 172.21.15.46:0/1047496084 shutdown_connections 2023-10-19T12:41:06.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:06.551+0000 7f385bbff700 1 --2- 172.21.15.46:0/1047496084 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f38541042c0 0x7f3854104740 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:06.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:06.551+0000 7f385bbff700 1 --2- 172.21.15.46:0/1047496084 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f38540fef80 0x7f38541013b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:06.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:06.551+0000 7f385bbff700 1 --2- 172.21.15.46:0/1047496084 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f38541018f0 0x7f3854103d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:06.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:06.551+0000 7f385bbff700 1 -- 172.21.15.46:0/1047496084 >> 172.21.15.46:0/1047496084 conn(0x7f38540faba0 msgr2=0x7f38540fcfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:06.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:06.551+0000 7f385bbff700 1 -- 172.21.15.46:0/1047496084 shutdown_connections 2023-10-19T12:41:06.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:06.551+0000 7f385bbff700 1 -- 172.21.15.46:0/1047496084 wait complete. 2023-10-19T12:41:06.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:06.553+0000 7f385bbff700 1 Processor -- start 2023-10-19T12:41:06.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:06.553+0000 7f385bbff700 1 -- start start 2023-10-19T12:41:06.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:06.553+0000 7f385bbff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f38540fef80 0x7f385419cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:06.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:06.553+0000 7f385bbff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f38541018f0 0x7f385419d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:06.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:06.553+0000 7f385bbff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f38541042c0 0x7f38541a42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:06.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:06.553+0000 7f385bbff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38541a4890 con 0x7f38541042c0 2023-10-19T12:41:06.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:06.553+0000 7f385bbff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38541a4a00 con 0x7f38540fef80 2023-10-19T12:41:06.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:06.553+0000 7f385bbff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38541a4bc0 con 0x7f38541018f0 2023-10-19T12:41:06.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:06.554+0000 7f385a19c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f38541042c0 0x7f38541a42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:06.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:06.554+0000 7f385999b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f38540fef80 0x7f385419cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:06.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:06.554+0000 7f385919a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f38541018f0 0x7f385419d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:06.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:06.554+0000 7f385999b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f38540fef80 0x7f385419cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:43026/0 (socket says 172.21.15.46:43026) 2023-10-19T12:41:06.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:06.554+0000 7f385a19c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f38541042c0 0x7f38541a42c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54340/0 (socket says 172.21.15.46:54340) 2023-10-19T12:41:06.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:06.554+0000 7f385999b700 1 -- 172.21.15.46:0/2596113103 learned_addr learned my addr 172.21.15.46:0/2596113103 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:41:06.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:06.554+0000 7f385a19c700 1 -- 172.21.15.46:0/2596113103 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f38541018f0 msgr2=0x7f385419d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:06.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:06.554+0000 7f385a19c700 1 --2- 172.21.15.46:0/2596113103 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f38541018f0 0x7f385419d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:06.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:06.554+0000 7f385a19c700 1 -- 172.21.15.46:0/2596113103 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f38540fef80 msgr2=0x7f385419cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:06.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:06.554+0000 7f385a19c700 1 --2- 172.21.15.46:0/2596113103 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f38540fef80 0x7f385419cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:06.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:06.554+0000 7f385a19c700 1 -- 172.21.15.46:0/2596113103 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f384c009d00 con 0x7f38541042c0 2023-10-19T12:41:06.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:06.554+0000 7f385a19c700 1 --2- 172.21.15.46:0/2596113103 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f38541042c0 0x7f38541a42c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f384c007b90 tx=0x7f384c007930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:06.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:06.555+0000 7f384affd700 1 -- 172.21.15.46:0/2596113103 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f384c00e040 con 0x7f38541042c0 2023-10-19T12:41:06.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:06.555+0000 7f384affd700 1 -- 172.21.15.46:0/2596113103 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f384c00be40 con 0x7f38541042c0 2023-10-19T12:41:06.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:06.555+0000 7f384affd700 1 -- 172.21.15.46:0/2596113103 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f384c01b460 con 0x7f38541042c0 2023-10-19T12:41:06.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:06.555+0000 7f385bbff700 1 -- 172.21.15.46:0/2596113103 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38541a4e40 con 0x7f38541042c0 2023-10-19T12:41:06.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:06.555+0000 7f385bbff700 1 -- 172.21.15.46:0/2596113103 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38541a51b0 con 0x7f38541042c0 2023-10-19T12:41:06.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:06.556+0000 7f385bbff700 1 -- 172.21.15.46:0/2596113103 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38540fc720 con 0x7f38541042c0 2023-10-19T12:41:06.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:06.558+0000 7f384affd700 1 -- 172.21.15.46:0/2596113103 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f384c01d470 con 0x7f38541042c0 2023-10-19T12:41:06.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:06.559+0000 7f384affd700 1 --2- 172.21.15.46:0/2596113103 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f38400a1580 0x7f38400a3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:06.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:06.559+0000 7f384affd700 1 -- 172.21.15.46:0/2596113103 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f384c0cd750 con 0x7f38541042c0 2023-10-19T12:41:06.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:06.560+0000 7f385999b700 1 --2- 172.21.15.46:0/2596113103 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f38400a1580 0x7f38400a3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:06.566 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:06.560+0000 7f385999b700 1 --2- 172.21.15.46:0/2596113103 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f38400a1580 0x7f38400a3a40 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f385419e220 tx=0x7f3850009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:06.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:06.563+0000 7f384affd700 1 -- 172.21.15.46:0/2596113103 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f384c097240 con 0x7f38541042c0 2023-10-19T12:41:06.702 INFO:journalctl@ceph.mds.g.smithi046.stdout:Oct 19 12:41:06 smithi046 podman[149564]: 2023-10-19T12:41:06.838 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:06.835+0000 7f385bbff700 1 -- 172.21.15.46:0/2596113103 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3854112780 con 0x7f38541042c0 2023-10-19T12:41:06.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:06.836+0000 7f384affd700 1 -- 172.21.15.46:0/2596113103 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+7667 (secure 0 0 0) 0x7f384c09a860 con 0x7f38541042c0 2023-10-19T12:41:06.840 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:41:06.841 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14580,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/2235286008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":2235286008},{"type":"v1","addr":"172.21.15.46:6835","nonce":2235286008}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14592,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/339398444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":339398444},{"type":"v1","addr":"172.21.15.46:6837","nonce":339398444}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24560,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/1687745569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":1687745569},{"type":"v1","addr":"172.21.15.157:6833","nonce":1687745569}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24574,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6833/3629933235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3629933235},{"type":"v1","addr":"172.21.15.195:6833","nonce":3629933235}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24602,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/108432552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":108432552},{"type":"v1","addr":"172.21.15.157:6835","nonce":108432552}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24629,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6837/2629536514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6836","nonce":2629536514},{"type":"v1","addr":"172.21.15.157:6837","nonce":2629536514}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24631,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/1406909915","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":1406909915},{"type":"v1","addr":"172.21.15.195:6835","nonce":1406909915}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24643,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6837/293916188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":293916188},{"type":"v1","addr":"172.21.15.195:6837","nonce":293916188}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24655,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6839/4094901934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6838","nonce":4094901934},{"type":"v1","addr":"172.21.15.195:6839","nonce":4094901934}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[]} 2023-10-19T12:41:06.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:06.838+0000 7f385bbff700 1 -- 172.21.15.46:0/2596113103 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f38400a1580 msgr2=0x7f38400a3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:06.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:06.838+0000 7f385bbff700 1 --2- 172.21.15.46:0/2596113103 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f38400a1580 0x7f38400a3a40 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f385419e220 tx=0x7f3850009260 comp rx=0 tx=0).stop 2023-10-19T12:41:06.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:06.838+0000 7f385bbff700 1 -- 172.21.15.46:0/2596113103 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f38541042c0 msgr2=0x7f38541a42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:06.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:06.838+0000 7f385bbff700 1 --2- 172.21.15.46:0/2596113103 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f38541042c0 0x7f38541a42c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f384c007b90 tx=0x7f384c007930 comp rx=0 tx=0).stop 2023-10-19T12:41:06.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:06.839+0000 7f385bbff700 1 -- 172.21.15.46:0/2596113103 shutdown_connections 2023-10-19T12:41:06.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:06.839+0000 7f385bbff700 1 --2- 172.21.15.46:0/2596113103 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f38541042c0 0x7f38541a42c0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:06.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:06.839+0000 7f385bbff700 1 --2- 172.21.15.46:0/2596113103 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f38540fef80 0x7f385419cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:06.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:06.839+0000 7f385bbff700 1 --2- 172.21.15.46:0/2596113103 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f38400a1580 0x7f38400a3a40 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:06.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:06.839+0000 7f385bbff700 1 --2- 172.21.15.46:0/2596113103 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f38541018f0 0x7f385419d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:06.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:06.839+0000 7f385bbff700 1 -- 172.21.15.46:0/2596113103 >> 172.21.15.46:0/2596113103 conn(0x7f38540faba0 msgr2=0x7f38540ff900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:06.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:06.839+0000 7f385bbff700 1 -- 172.21.15.46:0/2596113103 shutdown_connections 2023-10-19T12:41:06.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:06.839+0000 7f385bbff700 1 -- 172.21.15.46:0/2596113103 wait complete. 2023-10-19T12:41:06.845 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 10 2023-10-19T12:41:07.229 INFO:journalctl@ceph.mds.g.smithi046.stdout:Oct 19 12:41:06 smithi046 bash[149564]: 5423dd7a569be611f4cbb945fd7158688a7d916092bfe29f127da4b8d6a3b5c4 2023-10-19T12:41:07.229 INFO:journalctl@ceph.mds.g.smithi046.stdout:Oct 19 12:41:06 smithi046 ceph-mds[149634]: -- 172.21.15.46:0/308927479 <== mon.0 v2:172.21.15.46:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55b9c1ef31e0 con 0x55b9c1ecb000 2023-10-19T12:41:07.229 INFO:journalctl@ceph.mds.g.smithi046.stdout:Oct 19 12:41:06 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mds-g[149610]: starting mds.g at 2023-10-19T12:41:07.229 INFO:journalctl@ceph.mds.g.smithi046.stdout:Oct 19 12:41:06 smithi046 systemd[1]: Started Ceph mds.g for 96a8be3c-6e7b-11ee-8db6-212e2dc638e7. 2023-10-19T12:41:08.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:07 smithi157 ceph-mon[134109]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-19T12:41:08.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:07 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/2596113103' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-19T12:41:08.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:07 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:08.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:07 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:08.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:07 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:08.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:07 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-19T12:41:08.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:07 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-19T12:41:08.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:07 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:41:08.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:07 smithi195 ceph-mon[134493]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-19T12:41:08.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:07 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/2596113103' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-19T12:41:08.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:07 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:08.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:07 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:08.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:07 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:08.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:07 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-19T12:41:08.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:07 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-19T12:41:08.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:07 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:41:08.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:07 smithi046 ceph-mon[98509]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-19T12:41:08.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:07 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/2596113103' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-19T12:41:08.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:07 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:08.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:07 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:08.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:07 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:08.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:07 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-19T12:41:08.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:07 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-19T12:41:08.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:07 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:41:08.864 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-19T12:41:09.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:08 smithi157 ceph-mon[134109]: Deploying daemon mds.a on smithi046 2023-10-19T12:41:09.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:08 smithi157 ceph-mon[134109]: mds.? [v2:172.21.15.46:6838/1655843965,v1:172.21.15.46:6839/1655843965] up:boot 2023-10-19T12:41:09.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:08 smithi157 ceph-mon[134109]: fsmap 10 up:standby 2023-10-19T12:41:09.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:08 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-10-19T12:41:09.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:08 smithi157 ceph-mon[134109]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-19T12:41:09.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:09.107+0000 7f0e5c5ff700 1 -- 172.21.15.46:0/3794534156 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0e540747d0 msgr2=0x7f0e54072c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:09.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:09.107+0000 7f0e5c5ff700 1 --2- 172.21.15.46:0/3794534156 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0e540747d0 0x7f0e54072c20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0e50009990 tx=0x7f0e50009ca0 comp rx=0 tx=0).stop 2023-10-19T12:41:09.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:09.107+0000 7f0e5c5ff700 1 -- 172.21.15.46:0/3794534156 shutdown_connections 2023-10-19T12:41:09.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:09.107+0000 7f0e5c5ff700 1 --2- 172.21.15.46:0/3794534156 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0e54108610 0x7f0e5410aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:09.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:09.107+0000 7f0e5c5ff700 1 --2- 172.21.15.46:0/3794534156 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0e540747d0 0x7f0e54072c20 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:09.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:09.107+0000 7f0e5c5ff700 1 --2- 172.21.15.46:0/3794534156 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0e540731f0 0x7f0e54073670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:09.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:09.107+0000 7f0e5c5ff700 1 -- 172.21.15.46:0/3794534156 >> 172.21.15.46:0/3794534156 conn(0x7f0e540fbc90 msgr2=0x7f0e540fe0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:09.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:09.107+0000 7f0e5c5ff700 1 -- 172.21.15.46:0/3794534156 shutdown_connections 2023-10-19T12:41:09.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:09.107+0000 7f0e5c5ff700 1 -- 172.21.15.46:0/3794534156 wait complete. 2023-10-19T12:41:09.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:09.108+0000 7f0e5c5ff700 1 Processor -- start 2023-10-19T12:41:09.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:09.108+0000 7f0e5c5ff700 1 -- start start 2023-10-19T12:41:09.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:09.108+0000 7f0e5c5ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0e540731f0 0x7f0e541988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:09.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:09.108+0000 7f0e5c5ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0e540747d0 0x7f0e54198df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:09.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:09.109+0000 7f0e5c5ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0e54108610 0x7f0e5419fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:09.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:09.109+0000 7f0e5c5ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e541a03e0 con 0x7f0e54108610 2023-10-19T12:41:09.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:09.109+0000 7f0e5c5ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e541a0520 con 0x7f0e540731f0 2023-10-19T12:41:09.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:09.109+0000 7f0e5c5ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e541a06b0 con 0x7f0e540747d0 2023-10-19T12:41:09.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:09.109+0000 7f0e59b9a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0e540747d0 0x7f0e54198df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:09.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:09.109+0000 7f0e5ab9c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0e54108610 0x7f0e5419fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:09.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:09.109+0000 7f0e59b9a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0e540747d0 0x7f0e54198df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:50214/0 (socket says 172.21.15.46:50214) 2023-10-19T12:41:09.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:09.109+0000 7f0e59b9a700 1 -- 172.21.15.46:0/2604425073 learned_addr learned my addr 172.21.15.46:0/2604425073 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:41:09.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:09.109+0000 7f0e5a39b700 1 --2- 172.21.15.46:0/2604425073 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0e540731f0 0x7f0e541988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:09.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:09.109+0000 7f0e59b9a700 1 -- 172.21.15.46:0/2604425073 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0e540731f0 msgr2=0x7f0e541988b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:09.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:09.109+0000 7f0e59b9a700 1 --2- 172.21.15.46:0/2604425073 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0e540731f0 0x7f0e541988b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:09.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:09.109+0000 7f0e59b9a700 1 -- 172.21.15.46:0/2604425073 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0e54108610 msgr2=0x7f0e5419fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:09.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:09.109+0000 7f0e59b9a700 1 --2- 172.21.15.46:0/2604425073 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0e54108610 0x7f0e5419fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:09.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:09.109+0000 7f0e59b9a700 1 -- 172.21.15.46:0/2604425073 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e44009520 con 0x7f0e540747d0 2023-10-19T12:41:09.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:09.109+0000 7f0e5a39b700 1 --2- 172.21.15.46:0/2604425073 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0e540731f0 0x7f0e541988b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:41:09.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:09.109+0000 7f0e5ab9c700 1 --2- 172.21.15.46:0/2604425073 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0e54108610 0x7f0e5419fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:41:09.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:09.110+0000 7f0e59b9a700 1 --2- 172.21.15.46:0/2604425073 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0e540747d0 0x7f0e54198df0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0e4400eb30 tx=0x7f0e4400ee40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:09.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:09.110+0000 7f0e4b7fe700 1 -- 172.21.15.46:0/2604425073 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e44009880 con 0x7f0e540747d0 2023-10-19T12:41:09.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:09.110+0000 7f0e5c5ff700 1 -- 172.21.15.46:0/2604425073 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e500095f0 con 0x7f0e540747d0 2023-10-19T12:41:09.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:09.110+0000 7f0e4b7fe700 1 -- 172.21.15.46:0/2604425073 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0e440044e0 con 0x7f0e540747d0 2023-10-19T12:41:09.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:09.110+0000 7f0e4b7fe700 1 -- 172.21.15.46:0/2604425073 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e44003d80 con 0x7f0e540747d0 2023-10-19T12:41:09.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:09.110+0000 7f0e5c5ff700 1 -- 172.21.15.46:0/2604425073 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e541a0d60 con 0x7f0e540747d0 2023-10-19T12:41:09.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:09.111+0000 7f0e5c5ff700 1 -- 172.21.15.46:0/2604425073 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e54107420 con 0x7f0e540747d0 2023-10-19T12:41:09.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:09.113+0000 7f0e4b7fe700 1 -- 172.21.15.46:0/2604425073 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f0e44003f20 con 0x7f0e540747d0 2023-10-19T12:41:09.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:09.114+0000 7f0e4b7fe700 1 --2- 172.21.15.46:0/2604425073 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f0e400a1480 0x7f0e400a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:09.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:09.115+0000 7f0e4b7fe700 1 -- 172.21.15.46:0/2604425073 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f0e44014070 con 0x7f0e540747d0 2023-10-19T12:41:09.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:09.115+0000 7f0e5a39b700 1 --2- 172.21.15.46:0/2604425073 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f0e400a1480 0x7f0e400a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:09.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:09.115+0000 7f0e5a39b700 1 --2- 172.21.15.46:0/2604425073 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f0e400a1480 0x7f0e400a3940 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0e5000b2e0 tx=0x7f0e50005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:09.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:09.117+0000 7f0e4b7fe700 1 -- 172.21.15.46:0/2604425073 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0e44096c80 con 0x7f0e540747d0 2023-10-19T12:41:09.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:08 smithi195 ceph-mon[134493]: Deploying daemon mds.a on smithi046 2023-10-19T12:41:09.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:08 smithi195 ceph-mon[134493]: mds.? [v2:172.21.15.46:6838/1655843965,v1:172.21.15.46:6839/1655843965] up:boot 2023-10-19T12:41:09.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:08 smithi195 ceph-mon[134493]: fsmap 10 up:standby 2023-10-19T12:41:09.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:08 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-10-19T12:41:09.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:08 smithi195 ceph-mon[134493]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-19T12:41:09.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:08 smithi046 ceph-mon[98509]: Deploying daemon mds.a on smithi046 2023-10-19T12:41:09.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:08 smithi046 ceph-mon[98509]: mds.? [v2:172.21.15.46:6838/1655843965,v1:172.21.15.46:6839/1655843965] up:boot 2023-10-19T12:41:09.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:08 smithi046 ceph-mon[98509]: fsmap 10 up:standby 2023-10-19T12:41:09.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:08 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-10-19T12:41:09.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:08 smithi046 ceph-mon[98509]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-19T12:41:09.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:09.385+0000 7f0e5c5ff700 1 -- 172.21.15.46:0/2604425073 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0e54067530 con 0x7f0e540747d0 2023-10-19T12:41:09.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:09.386+0000 7f0e4b7fe700 1 -- 172.21.15.46:0/2604425073 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+8459 (secure 0 0 0) 0x7f0e4409a2a0 con 0x7f0e540747d0 2023-10-19T12:41:09.389 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:41:09.389 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14580,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/2235286008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":2235286008},{"type":"v1","addr":"172.21.15.46:6835","nonce":2235286008}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14592,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/339398444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":339398444},{"type":"v1","addr":"172.21.15.46:6837","nonce":339398444}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14640,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6839/1655843965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":1655843965},{"type":"v1","addr":"172.21.15.46:6839","nonce":1655843965}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":24560,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/1687745569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":1687745569},{"type":"v1","addr":"172.21.15.157:6833","nonce":1687745569}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24574,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6833/3629933235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3629933235},{"type":"v1","addr":"172.21.15.195:6833","nonce":3629933235}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24602,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/108432552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":108432552},{"type":"v1","addr":"172.21.15.157:6835","nonce":108432552}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24629,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6837/2629536514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6836","nonce":2629536514},{"type":"v1","addr":"172.21.15.157:6837","nonce":2629536514}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24631,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/1406909915","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":1406909915},{"type":"v1","addr":"172.21.15.195:6835","nonce":1406909915}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24643,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6837/293916188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":293916188},{"type":"v1","addr":"172.21.15.195:6837","nonce":293916188}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24655,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6839/4094901934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6838","nonce":4094901934},{"type":"v1","addr":"172.21.15.195:6839","nonce":4094901934}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[]} 2023-10-19T12:41:09.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:09.388+0000 7f0e5c5ff700 1 -- 172.21.15.46:0/2604425073 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f0e400a1480 msgr2=0x7f0e400a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:09.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:09.388+0000 7f0e5c5ff700 1 --2- 172.21.15.46:0/2604425073 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f0e400a1480 0x7f0e400a3940 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0e5000b2e0 tx=0x7f0e50005fd0 comp rx=0 tx=0).stop 2023-10-19T12:41:09.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:09.388+0000 7f0e5c5ff700 1 -- 172.21.15.46:0/2604425073 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0e540747d0 msgr2=0x7f0e54198df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:09.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:09.388+0000 7f0e5c5ff700 1 --2- 172.21.15.46:0/2604425073 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0e540747d0 0x7f0e54198df0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0e4400eb30 tx=0x7f0e4400ee40 comp rx=0 tx=0).stop 2023-10-19T12:41:09.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:09.388+0000 7f0e5c5ff700 1 -- 172.21.15.46:0/2604425073 shutdown_connections 2023-10-19T12:41:09.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:09.388+0000 7f0e5c5ff700 1 --2- 172.21.15.46:0/2604425073 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0e54108610 0x7f0e5419fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:09.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:09.388+0000 7f0e5c5ff700 1 --2- 172.21.15.46:0/2604425073 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0e540731f0 0x7f0e541988b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:09.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:09.388+0000 7f0e5c5ff700 1 --2- 172.21.15.46:0/2604425073 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f0e400a1480 0x7f0e400a3940 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:09.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:09.388+0000 7f0e5c5ff700 1 --2- 172.21.15.46:0/2604425073 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0e540747d0 0x7f0e54198df0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:09.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:09.388+0000 7f0e5c5ff700 1 -- 172.21.15.46:0/2604425073 >> 172.21.15.46:0/2604425073 conn(0x7f0e540fbc90 msgr2=0x7f0e54104560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:09.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:09.389+0000 7f0e5c5ff700 1 -- 172.21.15.46:0/2604425073 shutdown_connections 2023-10-19T12:41:09.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:09.389+0000 7f0e5c5ff700 1 -- 172.21.15.46:0/2604425073 wait complete. 2023-10-19T12:41:09.395 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 11 2023-10-19T12:41:09.729 INFO:journalctl@ceph.mds.a.smithi046.stdout:Oct 19 12:41:09 smithi046 systemd[1]: Starting Ceph mds.a for 96a8be3c-6e7b-11ee-8db6-212e2dc638e7... 2023-10-19T12:41:10.049 INFO:journalctl@ceph.mds.a.smithi046.stdout:Oct 19 12:41:09 smithi046 podman[149986]: 2023-10-19T12:41:10.049 INFO:journalctl@ceph.mds.a.smithi046.stdout:Oct 19 12:41:10 smithi046 bash[149986]: 2b3b1b004d20b78c6e2222d4aeb4397e9ce1882e2eea0ecbf9ec084e2767f15a 2023-10-19T12:41:10.050 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:09 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/2604425073' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-19T12:41:10.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:09 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/2604425073' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-19T12:41:10.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:09 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/2604425073' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-19T12:41:10.479 INFO:journalctl@ceph.mds.a.smithi046.stdout:Oct 19 12:41:10 smithi046 ceph-mds[150026]: -- 172.21.15.46:0/657506319 <== mon.0 v2:172.21.15.46:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x558e669211e0 con 0x558e668f8c00 2023-10-19T12:41:10.479 INFO:journalctl@ceph.mds.a.smithi046.stdout:Oct 19 12:41:10 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mds-a[150002]: starting mds.a at 2023-10-19T12:41:10.479 INFO:journalctl@ceph.mds.a.smithi046.stdout:Oct 19 12:41:10 smithi046 systemd[1]: Started Ceph mds.a for 96a8be3c-6e7b-11ee-8db6-212e2dc638e7. 2023-10-19T12:41:11.379 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:11 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:11.379 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:11 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:11.379 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:11 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:11.379 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:11 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-19T12:41:11.380 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:11 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-19T12:41:11.380 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:11 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:41:11.380 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:11 smithi157 ceph-mon[134109]: Deploying daemon mds.b on smithi157 2023-10-19T12:41:11.380 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:11 smithi157 ceph-mon[134109]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-19T12:41:11.380 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:11 smithi157 ceph-mon[134109]: mds.? [v2:172.21.15.46:6840/4204925553,v1:172.21.15.46:6841/4204925553] up:boot 2023-10-19T12:41:11.380 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:11 smithi157 ceph-mon[134109]: fsmap 11 up:standby 2023-10-19T12:41:11.381 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:11 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-10-19T12:41:11.413 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-19T12:41:11.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:11 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:11.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:11 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:11.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:11 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:11.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:11 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-19T12:41:11.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:11 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-19T12:41:11.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:11 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:41:11.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:11 smithi046 ceph-mon[98509]: Deploying daemon mds.b on smithi157 2023-10-19T12:41:11.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:11 smithi046 ceph-mon[98509]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-19T12:41:11.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:11 smithi046 ceph-mon[98509]: mds.? [v2:172.21.15.46:6840/4204925553,v1:172.21.15.46:6841/4204925553] up:boot 2023-10-19T12:41:11.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:11 smithi046 ceph-mon[98509]: fsmap 11 up:standby 2023-10-19T12:41:11.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:11 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-10-19T12:41:11.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:11 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:11.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:11 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:11.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:11 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:11.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:11 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-19T12:41:11.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:11 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-19T12:41:11.632 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:11 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:41:11.632 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:11 smithi195 ceph-mon[134493]: Deploying daemon mds.b on smithi157 2023-10-19T12:41:11.632 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:11 smithi195 ceph-mon[134493]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-19T12:41:11.632 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:11 smithi195 ceph-mon[134493]: mds.? [v2:172.21.15.46:6840/4204925553,v1:172.21.15.46:6841/4204925553] up:boot 2023-10-19T12:41:11.632 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:11 smithi195 ceph-mon[134493]: fsmap 11 up:standby 2023-10-19T12:41:11.633 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:11 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-10-19T12:41:11.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:11.631+0000 7f7e1f3ff700 1 -- 172.21.15.46:0/2425658728 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e18101190 msgr2=0x7f7e18103580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:11.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:11.631+0000 7f7e1f3ff700 1 --2- 172.21.15.46:0/2425658728 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e18101190 0x7f7e18103580 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7e140098f0 tx=0x7f7e14009c00 comp rx=0 tx=0).stop 2023-10-19T12:41:11.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:11.631+0000 7f7e1f3ff700 1 -- 172.21.15.46:0/2425658728 shutdown_connections 2023-10-19T12:41:11.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:11.631+0000 7f7e1f3ff700 1 --2- 172.21.15.46:0/2425658728 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7e181063f0 0x7f7e18108860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:11.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:11.631+0000 7f7e1f3ff700 1 --2- 172.21.15.46:0/2425658728 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e18101190 0x7f7e18103580 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:11.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:11.631+0000 7f7e1f3ff700 1 --2- 172.21.15.46:0/2425658728 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7e18103ac0 0x7f7e18105eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:11.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:11.631+0000 7f7e1f3ff700 1 -- 172.21.15.46:0/2425658728 >> 172.21.15.46:0/2425658728 conn(0x7f7e180faba0 msgr2=0x7f7e180fcfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:11.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:11.631+0000 7f7e1f3ff700 1 -- 172.21.15.46:0/2425658728 shutdown_connections 2023-10-19T12:41:11.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:11.632+0000 7f7e1f3ff700 1 -- 172.21.15.46:0/2425658728 wait complete. 2023-10-19T12:41:11.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:11.632+0000 7f7e1f3ff700 1 Processor -- start 2023-10-19T12:41:11.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:11.633+0000 7f7e1f3ff700 1 -- start start 2023-10-19T12:41:11.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:11.633+0000 7f7e1f3ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e18101190 0x7f7e181966c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:11.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:11.633+0000 7f7e1f3ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7e18103ac0 0x7f7e18196c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:11.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:11.633+0000 7f7e1f3ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7e181063f0 0x7f7e1819dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:11.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:11.633+0000 7f7e1f3ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1819e1f0 con 0x7f7e18101190 2023-10-19T12:41:11.640 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:11.633+0000 7f7e1f3ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1819e330 con 0x7f7e18103ac0 2023-10-19T12:41:11.640 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:11.633+0000 7f7e1f3ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1819e4c0 con 0x7f7e181063f0 2023-10-19T12:41:11.640 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:11.633+0000 7f7e1c99a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7e18103ac0 0x7f7e18196c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:11.640 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:11.633+0000 7f7e1c99a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7e18103ac0 0x7f7e18196c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:43104/0 (socket says 172.21.15.46:43104) 2023-10-19T12:41:11.640 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:11.633+0000 7f7e1c99a700 1 -- 172.21.15.46:0/877435648 learned_addr learned my addr 172.21.15.46:0/877435648 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:41:11.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:11.633+0000 7f7e1d19b700 1 --2- 172.21.15.46:0/877435648 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e18101190 0x7f7e181966c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:11.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:11.633+0000 7f7e1d99c700 1 --2- 172.21.15.46:0/877435648 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7e181063f0 0x7f7e1819dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:11.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:11.634+0000 7f7e1c99a700 1 -- 172.21.15.46:0/877435648 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7e181063f0 msgr2=0x7f7e1819dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:11.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:11.634+0000 7f7e1c99a700 1 --2- 172.21.15.46:0/877435648 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7e181063f0 0x7f7e1819dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:11.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:11.634+0000 7f7e1c99a700 1 -- 172.21.15.46:0/877435648 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e18101190 msgr2=0x7f7e181966c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:11.642 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:11.634+0000 7f7e1c99a700 1 --2- 172.21.15.46:0/877435648 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e18101190 0x7f7e181966c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:11.642 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:11.634+0000 7f7e1c99a700 1 -- 172.21.15.46:0/877435648 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e080095f0 con 0x7f7e18103ac0 2023-10-19T12:41:11.642 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:11.634+0000 7f7e1d19b700 1 --2- 172.21.15.46:0/877435648 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e18101190 0x7f7e181966c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:41:11.642 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:11.634+0000 7f7e1c99a700 1 --2- 172.21.15.46:0/877435648 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7e18103ac0 0x7f7e18196c00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7e0800ec10 tx=0x7f7e0800ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:11.643 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:11.634+0000 7f7e0e7fc700 1 -- 172.21.15.46:0/877435648 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e0800cc90 con 0x7f7e18103ac0 2023-10-19T12:41:11.643 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:11.634+0000 7f7e1f3ff700 1 -- 172.21.15.46:0/877435648 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e14009520 con 0x7f7e18103ac0 2023-10-19T12:41:11.643 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:11.634+0000 7f7e0e7fc700 1 -- 172.21.15.46:0/877435648 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7e080044e0 con 0x7f7e18103ac0 2023-10-19T12:41:11.643 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:11.634+0000 7f7e0e7fc700 1 -- 172.21.15.46:0/877435648 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e08010430 con 0x7f7e18103ac0 2023-10-19T12:41:11.643 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:11.634+0000 7f7e1f3ff700 1 -- 172.21.15.46:0/877435648 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e1819eb20 con 0x7f7e18103ac0 2023-10-19T12:41:11.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:11.635+0000 7f7e1f3ff700 1 -- 172.21.15.46:0/877435648 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e180fc720 con 0x7f7e18103ac0 2023-10-19T12:41:11.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:11.637+0000 7f7e0e7fc700 1 -- 172.21.15.46:0/877435648 <== mon.2 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f7e08003f90 con 0x7f7e18103ac0 2023-10-19T12:41:11.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:11.639+0000 7f7e0e7fc700 1 --2- 172.21.15.46:0/877435648 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f7e040a1480 0x7f7e040a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:11.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:11.639+0000 7f7e0e7fc700 1 -- 172.21.15.46:0/877435648 <== mon.2 v2:172.21.15.157:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f7e08014070 con 0x7f7e18103ac0 2023-10-19T12:41:11.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:11.639+0000 7f7e1d19b700 1 --2- 172.21.15.46:0/877435648 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f7e040a1480 0x7f7e040a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:11.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:11.639+0000 7f7e1d19b700 1 --2- 172.21.15.46:0/877435648 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f7e040a1480 0x7f7e040a3940 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7e1400fa40 tx=0x7f7e14019040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:11.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:11.645+0000 7f7e0e7fc700 1 -- 172.21.15.46:0/877435648 <== mon.2 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7e08096a50 con 0x7f7e18103ac0 2023-10-19T12:41:11.905 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:11.902+0000 7f7e1f3ff700 1 -- 172.21.15.46:0/877435648 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7e18067530 con 0x7f7e18103ac0 2023-10-19T12:41:11.906 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:11.903+0000 7f7e0e7fc700 1 -- 172.21.15.46:0/877435648 <== mon.2 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+9251 (secure 0 0 0) 0x7f7e0801f340 con 0x7f7e18103ac0 2023-10-19T12:41:11.906 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:41:11.906 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14580,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/2235286008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":2235286008},{"type":"v1","addr":"172.21.15.46:6835","nonce":2235286008}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14592,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/339398444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":339398444},{"type":"v1","addr":"172.21.15.46:6837","nonce":339398444}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14640,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6839/1655843965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":1655843965},{"type":"v1","addr":"172.21.15.46:6839","nonce":1655843965}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14652,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6841/4204925553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6840","nonce":4204925553},{"type":"v1","addr":"172.21.15.46:6841","nonce":4204925553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24560,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/1687745569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":1687745569},{"type":"v1","addr":"172.21.15.157:6833","nonce":1687745569}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24574,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6833/3629933235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3629933235},{"type":"v1","addr":"172.21.15.195:6833","nonce":3629933235}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24602,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/108432552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":108432552},{"type":"v1","addr":"172.21.15.157:6835","nonce":108432552}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24629,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6837/2629536514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6836","nonce":2629536514},{"type":"v1","addr":"172.21.15.157:6837","nonce":2629536514}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24631,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/1406909915","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":1406909915},{"type":"v1","addr":"172.21.15.195:6835","nonce":1406909915}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24643,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6837/293916188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":293916188},{"type":"v1","addr":"172.21.15.195:6837","nonce":293916188}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24655,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6839/4094901934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6838","nonce":4094901934},{"type":"v1","addr":"172.21.15.195:6839","nonce":4094901934}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[]} 2023-10-19T12:41:11.908 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:11.905+0000 7f7e1f3ff700 1 -- 172.21.15.46:0/877435648 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f7e040a1480 msgr2=0x7f7e040a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:11.909 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:11.905+0000 7f7e1f3ff700 1 --2- 172.21.15.46:0/877435648 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f7e040a1480 0x7f7e040a3940 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7e1400fa40 tx=0x7f7e14019040 comp rx=0 tx=0).stop 2023-10-19T12:41:11.909 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:11.905+0000 7f7e1f3ff700 1 -- 172.21.15.46:0/877435648 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7e18103ac0 msgr2=0x7f7e18196c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:11.909 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:11.905+0000 7f7e1f3ff700 1 --2- 172.21.15.46:0/877435648 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7e18103ac0 0x7f7e18196c00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7e0800ec10 tx=0x7f7e0800ef20 comp rx=0 tx=0).stop 2023-10-19T12:41:11.909 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:11.905+0000 7f7e1f3ff700 1 -- 172.21.15.46:0/877435648 shutdown_connections 2023-10-19T12:41:11.909 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:11.905+0000 7f7e1f3ff700 1 --2- 172.21.15.46:0/877435648 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f7e040a1480 0x7f7e040a3940 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:11.910 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:11.905+0000 7f7e1f3ff700 1 --2- 172.21.15.46:0/877435648 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7e181063f0 0x7f7e1819dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:11.910 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:11.905+0000 7f7e1f3ff700 1 --2- 172.21.15.46:0/877435648 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e18101190 0x7f7e181966c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:11.910 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:11.905+0000 7f7e1f3ff700 1 --2- 172.21.15.46:0/877435648 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7e18103ac0 0x7f7e18196c00 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:11.910 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:11.905+0000 7f7e1f3ff700 1 -- 172.21.15.46:0/877435648 >> 172.21.15.46:0/877435648 conn(0x7f7e180faba0 msgr2=0x7f7e18103030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:11.910 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:11.905+0000 7f7e1f3ff700 1 -- 172.21.15.46:0/877435648 shutdown_connections 2023-10-19T12:41:11.911 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:11.905+0000 7f7e1f3ff700 1 -- 172.21.15.46:0/877435648 wait complete. 2023-10-19T12:41:11.911 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 12 2023-10-19T12:41:11.964 INFO:journalctl@ceph.mds.b.smithi157.stdout:Oct 19 12:41:11 smithi157 systemd[1]: Starting Ceph mds.b for 96a8be3c-6e7b-11ee-8db6-212e2dc638e7... 2023-10-19T12:41:12.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:12 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/877435648' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-19T12:41:12.240 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:12 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/877435648' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-19T12:41:12.240 INFO:journalctl@ceph.mds.b.smithi157.stdout:Oct 19 12:41:11 smithi157 podman[170825]: 2023-10-19T12:41:12.587 INFO:journalctl@ceph.mds.b.smithi157.stdout:Oct 19 12:41:12 smithi157 ceph-mds[170865]: -- 172.21.15.157:0/3992819596 <== mon.2 v2:172.21.15.157:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5562e80e11e0 con 0x5562e80b6800 2023-10-19T12:41:12.588 INFO:journalctl@ceph.mds.b.smithi157.stdout:Oct 19 12:41:12 smithi157 bash[170825]: 8960b246aab3d6915e435c743d9dd9fd00fcbdfd484747bf255c4c6b3b5e5baa 2023-10-19T12:41:12.588 INFO:journalctl@ceph.mds.b.smithi157.stdout:Oct 19 12:41:12 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mds-b[170841]: starting mds.b at 2023-10-19T12:41:12.588 INFO:journalctl@ceph.mds.b.smithi157.stdout:Oct 19 12:41:12 smithi157 systemd[1]: Started Ceph mds.b for 96a8be3c-6e7b-11ee-8db6-212e2dc638e7. 2023-10-19T12:41:12.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:12 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/877435648' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-19T12:41:13.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:13 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:13.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:13 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:13.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:13 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:13.589 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:13 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:13.589 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:13 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:13.589 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:13 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:41:13.590 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:13 smithi157 ceph-mon[134109]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-19T12:41:13.590 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:13 smithi157 ceph-mon[134109]: mds.? [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] up:boot 2023-10-19T12:41:13.590 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:13 smithi157 ceph-mon[134109]: fsmap 12 up:standby 2023-10-19T12:41:13.591 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:13 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-10-19T12:41:13.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:13 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:13.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:13 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:13.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:13 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:13.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:13 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:13.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:13 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:13.632 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:13 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:41:13.632 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:13 smithi195 ceph-mon[134493]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-19T12:41:13.632 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:13 smithi195 ceph-mon[134493]: mds.? [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] up:boot 2023-10-19T12:41:13.632 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:13 smithi195 ceph-mon[134493]: fsmap 12 up:standby 2023-10-19T12:41:13.632 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:13 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-10-19T12:41:13.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:13 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:13.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:13 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:13.730 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:13 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:13.730 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:13 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:13.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:13 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:13.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:13 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:41:13.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:13 smithi046 ceph-mon[98509]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-19T12:41:13.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:13 smithi046 ceph-mon[98509]: mds.? [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] up:boot 2023-10-19T12:41:13.732 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:13 smithi046 ceph-mon[98509]: fsmap 12 up:standby 2023-10-19T12:41:13.732 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:13 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-10-19T12:41:13.928 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-19T12:41:14.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.142+0000 7fd9a07ff700 1 -- 172.21.15.46:0/1996893369 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9980747d0 msgr2=0x7fd998072c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:14.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.142+0000 7fd9a07ff700 1 --2- 172.21.15.46:0/1996893369 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9980747d0 0x7fd998072c20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd994009990 tx=0x7fd994009ca0 comp rx=0 tx=0).stop 2023-10-19T12:41:14.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.142+0000 7fd9a07ff700 1 -- 172.21.15.46:0/1996893369 shutdown_connections 2023-10-19T12:41:14.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.142+0000 7fd9a07ff700 1 --2- 172.21.15.46:0/1996893369 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd998108610 0x7fd99810aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:14.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.142+0000 7fd9a07ff700 1 --2- 172.21.15.46:0/1996893369 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9980747d0 0x7fd998072c20 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:14.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.142+0000 7fd9a07ff700 1 --2- 172.21.15.46:0/1996893369 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd9980731f0 0x7fd998073670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:14.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.142+0000 7fd9a07ff700 1 -- 172.21.15.46:0/1996893369 >> 172.21.15.46:0/1996893369 conn(0x7fd9980fbc90 msgr2=0x7fd9980fe0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:14.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.142+0000 7fd9a07ff700 1 -- 172.21.15.46:0/1996893369 shutdown_connections 2023-10-19T12:41:14.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.142+0000 7fd9a07ff700 1 -- 172.21.15.46:0/1996893369 wait complete. 2023-10-19T12:41:14.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.143+0000 7fd9a07ff700 1 Processor -- start 2023-10-19T12:41:14.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.144+0000 7fd9a07ff700 1 -- start start 2023-10-19T12:41:14.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.144+0000 7fd9a07ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd9980731f0 0x7fd9981988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:14.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.144+0000 7fd9a07ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd9980747d0 0x7fd998198e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:14.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.144+0000 7fd9a07ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd998108610 0x7fd99819fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:14.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.144+0000 7fd9a07ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9981a0410 con 0x7fd998108610 2023-10-19T12:41:14.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.144+0000 7fd9a07ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9981a0550 con 0x7fd9980747d0 2023-10-19T12:41:14.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.144+0000 7fd9a07ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9981a06e0 con 0x7fd9980731f0 2023-10-19T12:41:14.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.144+0000 7fd99dd9a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd9980747d0 0x7fd998198e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:14.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.144+0000 7fd99dd9a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd9980747d0 0x7fd998198e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:51210/0 (socket says 172.21.15.46:51210) 2023-10-19T12:41:14.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.144+0000 7fd99dd9a700 1 -- 172.21.15.46:0/2588908391 learned_addr learned my addr 172.21.15.46:0/2588908391 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:41:14.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.144+0000 7fd99ed9c700 1 --2- 172.21.15.46:0/2588908391 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd998108610 0x7fd99819fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:14.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.144+0000 7fd99e59b700 1 --2- 172.21.15.46:0/2588908391 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd9980731f0 0x7fd9981988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:14.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.145+0000 7fd99dd9a700 1 -- 172.21.15.46:0/2588908391 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd9980731f0 msgr2=0x7fd9981988e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:14.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.145+0000 7fd99dd9a700 1 --2- 172.21.15.46:0/2588908391 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd9980731f0 0x7fd9981988e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:14.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.145+0000 7fd99dd9a700 1 -- 172.21.15.46:0/2588908391 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd998108610 msgr2=0x7fd99819fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:14.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.145+0000 7fd99dd9a700 1 --2- 172.21.15.46:0/2588908391 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd998108610 0x7fd99819fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:14.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.145+0000 7fd99dd9a700 1 -- 172.21.15.46:0/2588908391 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9940095f0 con 0x7fd9980747d0 2023-10-19T12:41:14.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.145+0000 7fd99dd9a700 1 --2- 172.21.15.46:0/2588908391 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd9980747d0 0x7fd998198e20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd98800d950 tx=0x7fd98800dc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:14.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.146+0000 7fd98f7fe700 1 -- 172.21.15.46:0/2588908391 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd98800f890 con 0x7fd9980747d0 2023-10-19T12:41:14.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.146+0000 7fd98f7fe700 1 -- 172.21.15.46:0/2588908391 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd988010460 con 0x7fd9980747d0 2023-10-19T12:41:14.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.146+0000 7fd98f7fe700 1 -- 172.21.15.46:0/2588908391 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd98800e610 con 0x7fd9980747d0 2023-10-19T12:41:14.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.146+0000 7fd9a07ff700 1 -- 172.21.15.46:0/2588908391 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9981a09c0 con 0x7fd9980747d0 2023-10-19T12:41:14.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.147+0000 7fd9a07ff700 1 -- 172.21.15.46:0/2588908391 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9981a0e80 con 0x7fd9980747d0 2023-10-19T12:41:14.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.148+0000 7fd9a07ff700 1 -- 172.21.15.46:0/2588908391 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd998107420 con 0x7fd9980747d0 2023-10-19T12:41:14.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.149+0000 7fd98f7fe700 1 -- 172.21.15.46:0/2588908391 <== mon.2 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fd9880108d0 con 0x7fd9980747d0 2023-10-19T12:41:14.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.151+0000 7fd98f7fe700 1 --2- 172.21.15.46:0/2588908391 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fd9840a15d0 0x7fd9840a3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:14.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.151+0000 7fd98f7fe700 1 -- 172.21.15.46:0/2588908391 <== mon.2 v2:172.21.15.157:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fd9880cc540 con 0x7fd9980747d0 2023-10-19T12:41:14.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.151+0000 7fd99e59b700 1 --2- 172.21.15.46:0/2588908391 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fd9840a15d0 0x7fd9840a3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:14.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.152+0000 7fd99e59b700 1 --2- 172.21.15.46:0/2588908391 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fd9840a15d0 0x7fd9840a3a90 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd99400b2e0 tx=0x7fd994005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:14.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.155+0000 7fd98f7fe700 1 -- 172.21.15.46:0/2588908391 <== mon.2 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd988095fa0 con 0x7fd9980747d0 2023-10-19T12:41:14.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.442+0000 7fd9a07ff700 1 -- 172.21.15.46:0/2588908391 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd998067530 con 0x7fd9980747d0 2023-10-19T12:41:14.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.443+0000 7fd98f7fe700 1 -- 172.21.15.46:0/2588908391 <== mon.2 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+10043 (secure 0 0 0) 0x7fd9880995c0 con 0x7fd9980747d0 2023-10-19T12:41:14.446 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:41:14.447 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14580,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/2235286008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":2235286008},{"type":"v1","addr":"172.21.15.46:6835","nonce":2235286008}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14592,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/339398444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":339398444},{"type":"v1","addr":"172.21.15.46:6837","nonce":339398444}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14640,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6839/1655843965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":1655843965},{"type":"v1","addr":"172.21.15.46:6839","nonce":1655843965}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14652,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6841/4204925553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6840","nonce":4204925553},{"type":"v1","addr":"172.21.15.46:6841","nonce":4204925553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24560,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/1687745569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":1687745569},{"type":"v1","addr":"172.21.15.157:6833","nonce":1687745569}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24574,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6833/3629933235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3629933235},{"type":"v1","addr":"172.21.15.195:6833","nonce":3629933235}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24602,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/108432552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":108432552},{"type":"v1","addr":"172.21.15.157:6835","nonce":108432552}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24629,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6837/2629536514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6836","nonce":2629536514},{"type":"v1","addr":"172.21.15.157:6837","nonce":2629536514}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24631,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/1406909915","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":1406909915},{"type":"v1","addr":"172.21.15.195:6835","nonce":1406909915}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24643,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6837/293916188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":293916188},{"type":"v1","addr":"172.21.15.195:6837","nonce":293916188}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24655,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6839/4094901934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6838","nonce":4094901934},{"type":"v1","addr":"172.21.15.195:6839","nonce":4094901934}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":24680,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6839/552718978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6838","nonce":552718978},{"type":"v1","addr":"172.21.15.157:6839","nonce":552718978}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[]} 2023-10-19T12:41:14.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.445+0000 7fd9a07ff700 1 -- 172.21.15.46:0/2588908391 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fd9840a15d0 msgr2=0x7fd9840a3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:14.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.445+0000 7fd9a07ff700 1 --2- 172.21.15.46:0/2588908391 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fd9840a15d0 0x7fd9840a3a90 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd99400b2e0 tx=0x7fd994005fd0 comp rx=0 tx=0).stop 2023-10-19T12:41:14.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.445+0000 7fd9a07ff700 1 -- 172.21.15.46:0/2588908391 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd9980747d0 msgr2=0x7fd998198e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:14.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.445+0000 7fd9a07ff700 1 --2- 172.21.15.46:0/2588908391 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd9980747d0 0x7fd998198e20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd98800d950 tx=0x7fd98800dc60 comp rx=0 tx=0).stop 2023-10-19T12:41:14.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.445+0000 7fd9a07ff700 1 -- 172.21.15.46:0/2588908391 shutdown_connections 2023-10-19T12:41:14.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.445+0000 7fd9a07ff700 1 --2- 172.21.15.46:0/2588908391 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd998108610 0x7fd99819fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:14.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.445+0000 7fd9a07ff700 1 --2- 172.21.15.46:0/2588908391 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fd9840a15d0 0x7fd9840a3a90 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:14.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.445+0000 7fd9a07ff700 1 --2- 172.21.15.46:0/2588908391 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd9980731f0 0x7fd9981988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:14.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.445+0000 7fd9a07ff700 1 --2- 172.21.15.46:0/2588908391 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd9980747d0 0x7fd998198e20 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:14.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.445+0000 7fd9a07ff700 1 -- 172.21.15.46:0/2588908391 >> 172.21.15.46:0/2588908391 conn(0x7fd9980fbc90 msgr2=0x7fd998104560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:14.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.446+0000 7fd9a07ff700 1 -- 172.21.15.46:0/2588908391 shutdown_connections 2023-10-19T12:41:14.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.446+0000 7fd9a07ff700 1 -- 172.21.15.46:0/2588908391 wait complete. 2023-10-19T12:41:14.452 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 13 2023-10-19T12:41:14.469 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-19T12:41:14.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.685+0000 7f0aa01ff700 1 -- 172.21.15.46:0/3255317538 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a98103b60 msgr2=0x7f0a98103fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:14.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.685+0000 7f0aa01ff700 1 --2- 172.21.15.46:0/3255317538 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a98103b60 0x7f0a98103fc0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0a880099c0 tx=0x7f0a88009cd0 comp rx=0 tx=0).stop 2023-10-19T12:41:14.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.685+0000 7f0aa01ff700 1 -- 172.21.15.46:0/3255317538 shutdown_connections 2023-10-19T12:41:14.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.685+0000 7f0aa01ff700 1 --2- 172.21.15.46:0/3255317538 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0a98104500 0x7f0a9810adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:14.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.685+0000 7f0aa01ff700 1 --2- 172.21.15.46:0/3255317538 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a98102970 0x7f0a98102d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:14.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.685+0000 7f0aa01ff700 1 --2- 172.21.15.46:0/3255317538 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a98103b60 0x7f0a98103fc0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:14.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.685+0000 7f0aa01ff700 1 -- 172.21.15.46:0/3255317538 >> 172.21.15.46:0/3255317538 conn(0x7f0a980fdf00 msgr2=0x7f0a98100320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:14.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.685+0000 7f0aa01ff700 1 -- 172.21.15.46:0/3255317538 shutdown_connections 2023-10-19T12:41:14.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.685+0000 7f0aa01ff700 1 -- 172.21.15.46:0/3255317538 wait complete. 2023-10-19T12:41:14.692 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.686+0000 7f0aa01ff700 1 Processor -- start 2023-10-19T12:41:14.692 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.687+0000 7f0aa01ff700 1 -- start start 2023-10-19T12:41:14.693 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.687+0000 7f0aa01ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a98102970 0x7f0a981988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:14.693 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.687+0000 7f0aa01ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0a98103b60 0x7f0a98198e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:14.693 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.687+0000 7f0aa01ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a98104500 0x7f0a9819fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:14.693 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.687+0000 7f0aa01ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a981a03f0 con 0x7f0a98104500 2023-10-19T12:41:14.693 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.687+0000 7f0aa01ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a981a0530 con 0x7f0a98102970 2023-10-19T12:41:14.694 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.687+0000 7f0aa01ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a981a06c0 con 0x7f0a98103b60 2023-10-19T12:41:14.694 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.687+0000 7f0a9df9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a98102970 0x7f0a981988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:14.694 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.687+0000 7f0a9d79a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0a98103b60 0x7f0a98198e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:14.694 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.687+0000 7f0a9df9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a98102970 0x7f0a981988c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:51222/0 (socket says 172.21.15.46:51222) 2023-10-19T12:41:14.694 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.687+0000 7f0a9d79a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0a98103b60 0x7f0a98198e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:56480/0 (socket says 172.21.15.46:56480) 2023-10-19T12:41:14.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.687+0000 7f0a9df9b700 1 -- 172.21.15.46:0/1843389380 learned_addr learned my addr 172.21.15.46:0/1843389380 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:41:14.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.687+0000 7f0a9e79c700 1 --2- 172.21.15.46:0/1843389380 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a98104500 0x7f0a9819fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:14.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.688+0000 7f0a9df9b700 1 -- 172.21.15.46:0/1843389380 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0a98103b60 msgr2=0x7f0a98198e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:14.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.688+0000 7f0a9df9b700 1 --2- 172.21.15.46:0/1843389380 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0a98103b60 0x7f0a98198e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:14.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.688+0000 7f0a9df9b700 1 -- 172.21.15.46:0/1843389380 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a98104500 msgr2=0x7f0a9819fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:14.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.688+0000 7f0a9df9b700 1 --2- 172.21.15.46:0/1843389380 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a98104500 0x7f0a9819fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:14.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.688+0000 7f0a9df9b700 1 -- 172.21.15.46:0/1843389380 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a94009520 con 0x7f0a98102970 2023-10-19T12:41:14.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.688+0000 7f0a9df9b700 1 --2- 172.21.15.46:0/1843389380 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a98102970 0x7f0a981988c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0a9400ea50 tx=0x7f0a9400ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:14.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.688+0000 7f0a8effd700 1 -- 172.21.15.46:0/1843389380 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9400cbd0 con 0x7f0a98102970 2023-10-19T12:41:14.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.688+0000 7f0a8effd700 1 -- 172.21.15.46:0/1843389380 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0a9400cd30 con 0x7f0a98102970 2023-10-19T12:41:14.697 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.688+0000 7f0aa01ff700 1 -- 172.21.15.46:0/1843389380 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a880095f0 con 0x7f0a98102970 2023-10-19T12:41:14.697 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.688+0000 7f0a8effd700 1 -- 172.21.15.46:0/1843389380 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a940186c0 con 0x7f0a98102970 2023-10-19T12:41:14.697 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.688+0000 7f0aa01ff700 1 -- 172.21.15.46:0/1843389380 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a981a0d70 con 0x7f0a98102970 2023-10-19T12:41:14.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.690+0000 7f0aa01ff700 1 -- 172.21.15.46:0/1843389380 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a98109df0 con 0x7f0a98102970 2023-10-19T12:41:14.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.691+0000 7f0a8effd700 1 -- 172.21.15.46:0/1843389380 <== mon.2 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f0a94018820 con 0x7f0a98102970 2023-10-19T12:41:14.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.693+0000 7f0a8effd700 1 --2- 172.21.15.46:0/1843389380 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f0a840a1500 0x7f0a840a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:14.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.693+0000 7f0a8effd700 1 -- 172.21.15.46:0/1843389380 <== mon.2 v2:172.21.15.157:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f0a94014070 con 0x7f0a98102970 2023-10-19T12:41:14.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.693+0000 7f0a9d79a700 1 --2- 172.21.15.46:0/1843389380 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f0a840a1500 0x7f0a840a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:14.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.693+0000 7f0a9d79a700 1 --2- 172.21.15.46:0/1843389380 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f0a840a1500 0x7f0a840a39c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0a8800b580 tx=0x7f0a8801a040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:14.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.696+0000 7f0a8effd700 1 -- 172.21.15.46:0/1843389380 <== mon.2 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0a94096830 con 0x7f0a98102970 2023-10-19T12:41:14.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:14 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/2588908391' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-19T12:41:14.837 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:14 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/2588908391' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-19T12:41:14.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:14 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/2588908391' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-19T12:41:14.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.919+0000 7f0aa01ff700 1 -- 172.21.15.46:0/1843389380 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0a981097d0 con 0x7f0a98102970 2023-10-19T12:41:14.923 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.921+0000 7f0a8effd700 1 -- 172.21.15.46:0/1843389380 <== mon.2 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+18415 (secure 0 0 0) 0x7f0a94099e50 con 0x7f0a98102970 2023-10-19T12:41:14.924 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:41:14.924 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":80,"fsid":"96a8be3c-6e7b-11ee-8db6-212e2dc638e7","created":"2023-10-19T12:33:26.148713+0000","modified":"2023-10-19T12:40:32.226583+0000","last_up_change":"2023-10-19T12:40:30.761679+0000","last_in_change":"2023-10-19T12:40:13.663559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-19T12:37:07.175795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"346ce86b-a10a-4869-9fdb-c3c1d4161455","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6803","nonce":500237995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6805","nonce":500237995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6809","nonce":500237995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6807","nonce":500237995}]},"public_addr":"172.21.15.46:6803/500237995","cluster_addr":"172.21.15.46:6805/500237995","heartbeat_back_addr":"172.21.15.46:6809/500237995","heartbeat_front_addr":"172.21.15.46:6807/500237995","state":["exists","up"]},{"osd":1,"uuid":"02aae687-76c5-4124-bae4-9787ed571c28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6801","nonce":2496862790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6803","nonce":2496862790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6807","nonce":2496862790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6805","nonce":2496862790}]},"public_addr":"172.21.15.157:6801/2496862790","cluster_addr":"172.21.15.157:6803/2496862790","heartbeat_back_addr":"172.21.15.157:6807/2496862790","heartbeat_front_addr":"172.21.15.157:6805/2496862790","state":["exists","up"]},{"osd":2,"uuid":"d5360828-1f58-4380-b2ad-0c21ff850981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6801","nonce":4211767276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6803","nonce":4211767276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6807","nonce":4211767276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6805","nonce":4211767276}]},"public_addr":"172.21.15.195:6801/4211767276","cluster_addr":"172.21.15.195:6803/4211767276","heartbeat_back_addr":"172.21.15.195:6807/4211767276","heartbeat_front_addr":"172.21.15.195:6805/4211767276","state":["exists","up"]},{"osd":3,"uuid":"accb780f-49d0-43f8-b166-ee12c558ef00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6811","nonce":1964113352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6813","nonce":1964113352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6817","nonce":1964113352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6815","nonce":1964113352}]},"public_addr":"172.21.15.46:6811/1964113352","cluster_addr":"172.21.15.46:6813/1964113352","heartbeat_back_addr":"172.21.15.46:6817/1964113352","heartbeat_front_addr":"172.21.15.46:6815/1964113352","state":["exists","up"]},{"osd":4,"uuid":"e662886d-e989-4d02-8c1f-3c4671352b0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6809","nonce":3636910144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6811","nonce":3636910144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6815","nonce":3636910144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6813","nonce":3636910144}]},"public_addr":"172.21.15.157:6809/3636910144","cluster_addr":"172.21.15.157:6811/3636910144","heartbeat_back_addr":"172.21.15.157:6815/3636910144","heartbeat_front_addr":"172.21.15.157:6813/3636910144","state":["exists","up"]},{"osd":5,"uuid":"9597e0ce-14ea-407d-90fe-f74bccee38b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6809","nonce":4071287969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6811","nonce":4071287969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6815","nonce":4071287969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6813","nonce":4071287969}]},"public_addr":"172.21.15.195:6809/4071287969","cluster_addr":"172.21.15.195:6811/4071287969","heartbeat_back_addr":"172.21.15.195:6815/4071287969","heartbeat_front_addr":"172.21.15.195:6813/4071287969","state":["exists","up"]},{"osd":6,"uuid":"6b78ba38-f60e-4cb6-b01c-cecc1820e8e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6819","nonce":1842285555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6821","nonce":1842285555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6825","nonce":1842285555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6823","nonce":1842285555}]},"public_addr":"172.21.15.46:6819/1842285555","cluster_addr":"172.21.15.46:6821/1842285555","heartbeat_back_addr":"172.21.15.46:6825/1842285555","heartbeat_front_addr":"172.21.15.46:6823/1842285555","state":["exists","up"]},{"osd":7,"uuid":"59a0899f-3bcd-4db2-b544-24df3a536749","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6817","nonce":3498672588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6819","nonce":3498672588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6823","nonce":3498672588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6821","nonce":3498672588}]},"public_addr":"172.21.15.157:6817/3498672588","cluster_addr":"172.21.15.157:6819/3498672588","heartbeat_back_addr":"172.21.15.157:6823/3498672588","heartbeat_front_addr":"172.21.15.157:6821/3498672588","state":["exists","up"]},{"osd":8,"uuid":"9c3c9835-043a-4fb5-a9ee-edf8caf6b605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6817","nonce":74230104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6819","nonce":74230104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6823","nonce":74230104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6821","nonce":74230104}]},"public_addr":"172.21.15.195:6817/74230104","cluster_addr":"172.21.15.195:6819/74230104","heartbeat_back_addr":"172.21.15.195:6823/74230104","heartbeat_front_addr":"172.21.15.195:6821/74230104","state":["exists","up"]},{"osd":9,"uuid":"3f18f506-a577-4b7c-ae0d-9351c07e81f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6827","nonce":3472581046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6829","nonce":3472581046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6833","nonce":3472581046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6831","nonce":3472581046}]},"public_addr":"172.21.15.46:6827/3472581046","cluster_addr":"172.21.15.46:6829/3472581046","heartbeat_back_addr":"172.21.15.46:6833/3472581046","heartbeat_front_addr":"172.21.15.46:6831/3472581046","state":["exists","up"]},{"osd":10,"uuid":"1ed01854-443a-4acf-9293-7ca0d451a93d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6825","nonce":2378416559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6827","nonce":2378416559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6831","nonce":2378416559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6829","nonce":2378416559}]},"public_addr":"172.21.15.157:6825/2378416559","cluster_addr":"172.21.15.157:6827/2378416559","heartbeat_back_addr":"172.21.15.157:6831/2378416559","heartbeat_front_addr":"172.21.15.157:6829/2378416559","state":["exists","up"]},{"osd":11,"uuid":"021398c0-9184-4647-8220-e40f6705ca90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6825","nonce":3075632222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6827","nonce":3075632222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6831","nonce":3075632222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6829","nonce":3075632222}]},"public_addr":"172.21.15.195:6825/3075632222","cluster_addr":"172.21.15.195:6827/3075632222","heartbeat_back_addr":"172.21.15.195:6831/3075632222","heartbeat_front_addr":"172.21.15.195:6829/3075632222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:36:22.002614+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:36:44.098031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:37:04.518341+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:37:30.796462+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:37:52.756555+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:38:13.403168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:38:39.058472+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:39:01.106893+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:39:21.908334+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:39:46.843884+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:40:08.792020+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:40:29.282974+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.46:0/3248595150":"2023-10-20T12:34:26.552115+0000","172.21.15.46:0/3624849341":"2023-10-20T12:34:26.552115+0000","172.21.15.46:0/1844094590":"2023-10-20T12:34:26.552115+0000","172.21.15.46:6801/20022894":"2023-10-20T12:34:26.552115+0000","172.21.15.46:0/3969790632":"2023-10-20T12:34:00.135248+0000","172.21.15.46:0/2331135821":"2023-10-20T12:34:00.135248+0000","172.21.15.46:6800/51664346":"2023-10-20T12:34:00.135248+0000","172.21.15.46:6801/51664346":"2023-10-20T12:34:00.135248+0000","172.21.15.46:0/585851467":"2023-10-20T12:34:00.135248+0000","172.21.15.46:6800/20022894":"2023-10-20T12:34:26.552115+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-19T12:41:14.926 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.923+0000 7f0aa01ff700 1 -- 172.21.15.46:0/1843389380 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f0a840a1500 msgr2=0x7f0a840a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:14.927 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.923+0000 7f0aa01ff700 1 --2- 172.21.15.46:0/1843389380 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f0a840a1500 0x7f0a840a39c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0a8800b580 tx=0x7f0a8801a040 comp rx=0 tx=0).stop 2023-10-19T12:41:14.927 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.923+0000 7f0aa01ff700 1 -- 172.21.15.46:0/1843389380 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a98102970 msgr2=0x7f0a981988c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:14.927 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.923+0000 7f0aa01ff700 1 --2- 172.21.15.46:0/1843389380 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a98102970 0x7f0a981988c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0a9400ea50 tx=0x7f0a9400ed60 comp rx=0 tx=0).stop 2023-10-19T12:41:14.927 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.923+0000 7f0aa01ff700 1 -- 172.21.15.46:0/1843389380 shutdown_connections 2023-10-19T12:41:14.928 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.923+0000 7f0aa01ff700 1 --2- 172.21.15.46:0/1843389380 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a98104500 0x7f0a9819fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:14.928 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.923+0000 7f0aa01ff700 1 --2- 172.21.15.46:0/1843389380 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a98102970 0x7f0a981988c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:14.928 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.923+0000 7f0aa01ff700 1 --2- 172.21.15.46:0/1843389380 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f0a840a1500 0x7f0a840a39c0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:14.928 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.923+0000 7f0aa01ff700 1 --2- 172.21.15.46:0/1843389380 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0a98103b60 0x7f0a98198e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:14.928 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.923+0000 7f0aa01ff700 1 -- 172.21.15.46:0/1843389380 >> 172.21.15.46:0/1843389380 conn(0x7f0a980fdf00 msgr2=0x7f0a98106f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:14.929 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.923+0000 7f0aa01ff700 1 -- 172.21.15.46:0/1843389380 shutdown_connections 2023-10-19T12:41:14.929 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:14.924+0000 7f0aa01ff700 1 -- 172.21.15.46:0/1843389380 wait complete. 2023-10-19T12:41:14.947 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-19T12:37:07.175795+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-19T12:41:14.948 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-19T12:41:15.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.160+0000 7f358c5ff700 1 -- 172.21.15.46:0/907575419 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3584101990 msgr2=0x7f3584101df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:15.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.160+0000 7f358c5ff700 1 --2- 172.21.15.46:0/907575419 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3584101990 0x7f3584101df0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f35740099c0 tx=0x7f3574009cd0 comp rx=0 tx=0).stop 2023-10-19T12:41:15.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.160+0000 7f358c5ff700 1 -- 172.21.15.46:0/907575419 shutdown_connections 2023-10-19T12:41:15.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.160+0000 7f358c5ff700 1 --2- 172.21.15.46:0/907575419 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3584102330 0x7f3584108be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:15.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.160+0000 7f358c5ff700 1 --2- 172.21.15.46:0/907575419 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f35841007a0 0x7f3584100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:15.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.160+0000 7f358c5ff700 1 --2- 172.21.15.46:0/907575419 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3584101990 0x7f3584101df0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:15.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.160+0000 7f358c5ff700 1 -- 172.21.15.46:0/907575419 >> 172.21.15.46:0/907575419 conn(0x7f35840fbcf0 msgr2=0x7f35840fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:15.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.160+0000 7f358c5ff700 1 -- 172.21.15.46:0/907575419 shutdown_connections 2023-10-19T12:41:15.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.160+0000 7f358c5ff700 1 -- 172.21.15.46:0/907575419 wait complete. 2023-10-19T12:41:15.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.161+0000 7f358c5ff700 1 Processor -- start 2023-10-19T12:41:15.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.161+0000 7f358c5ff700 1 -- start start 2023-10-19T12:41:15.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.161+0000 7f358c5ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35841007a0 0x7f3584196700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:15.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.161+0000 7f358c5ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3584101990 0x7f3584196c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:15.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.162+0000 7f358c5ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3584102330 0x7f358419dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:15.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.162+0000 7f358c5ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f358419e230 con 0x7f35841007a0 2023-10-19T12:41:15.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.162+0000 7f358c5ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f358419e370 con 0x7f3584101990 2023-10-19T12:41:15.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.162+0000 7f358c5ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f358419e500 con 0x7f3584102330 2023-10-19T12:41:15.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.162+0000 7f358a39b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35841007a0 0x7f3584196700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:15.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.162+0000 7f358a39b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35841007a0 0x7f3584196700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34162/0 (socket says 172.21.15.46:34162) 2023-10-19T12:41:15.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.162+0000 7f358a39b700 1 -- 172.21.15.46:0/2816022741 learned_addr learned my addr 172.21.15.46:0/2816022741 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:41:15.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.162+0000 7f3589b9a700 1 --2- 172.21.15.46:0/2816022741 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3584101990 0x7f3584196c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:15.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.162+0000 7f358ab9c700 1 --2- 172.21.15.46:0/2816022741 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3584102330 0x7f358419dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:15.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.162+0000 7f358a39b700 1 -- 172.21.15.46:0/2816022741 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3584102330 msgr2=0x7f358419dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:15.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.162+0000 7f358a39b700 1 --2- 172.21.15.46:0/2816022741 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3584102330 0x7f358419dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:15.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.162+0000 7f358a39b700 1 -- 172.21.15.46:0/2816022741 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3584101990 msgr2=0x7f3584196c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:15.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.162+0000 7f358a39b700 1 --2- 172.21.15.46:0/2816022741 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3584101990 0x7f3584196c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:15.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.162+0000 7f358a39b700 1 -- 172.21.15.46:0/2816022741 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35740095f0 con 0x7f35841007a0 2023-10-19T12:41:15.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.163+0000 7f358a39b700 1 --2- 172.21.15.46:0/2816022741 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35841007a0 0x7f3584196700 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f358000e970 tx=0x7f358000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:15.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.163+0000 7f357b7fe700 1 -- 172.21.15.46:0/2816022741 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3580009790 con 0x7f35841007a0 2023-10-19T12:41:15.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.163+0000 7f357b7fe700 1 -- 172.21.15.46:0/2816022741 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f358000c7e0 con 0x7f35841007a0 2023-10-19T12:41:15.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.163+0000 7f358c5ff700 1 -- 172.21.15.46:0/2816022741 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f358419e7e0 con 0x7f35841007a0 2023-10-19T12:41:15.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.163+0000 7f357b7fe700 1 -- 172.21.15.46:0/2816022741 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3580003c70 con 0x7f35841007a0 2023-10-19T12:41:15.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.163+0000 7f358c5ff700 1 -- 172.21.15.46:0/2816022741 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f358419ed40 con 0x7f35841007a0 2023-10-19T12:41:15.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.164+0000 7f358c5ff700 1 -- 172.21.15.46:0/2816022741 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3584107c40 con 0x7f35841007a0 2023-10-19T12:41:15.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.166+0000 7f357b7fe700 1 -- 172.21.15.46:0/2816022741 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f358000cc50 con 0x7f35841007a0 2023-10-19T12:41:15.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.168+0000 7f357b7fe700 1 --2- 172.21.15.46:0/2816022741 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f35700a1500 0x7f35700a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:15.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.168+0000 7f357b7fe700 1 -- 172.21.15.46:0/2816022741 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f3580014070 con 0x7f35841007a0 2023-10-19T12:41:15.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.168+0000 7f3589b9a700 1 --2- 172.21.15.46:0/2816022741 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f35700a1500 0x7f35700a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:15.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.169+0000 7f3589b9a700 1 --2- 172.21.15.46:0/2816022741 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f35700a1500 0x7f35700a39c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3574006010 tx=0x7f357400b540 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:15.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.172+0000 7f357b7fe700 1 -- 172.21.15.46:0/2816022741 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3580096490 con 0x7f35841007a0 2023-10-19T12:41:15.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.401+0000 7f358c5ff700 1 -- 172.21.15.46:0/2816022741 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3584107620 con 0x7f35841007a0 2023-10-19T12:41:15.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.402+0000 7f357b7fe700 1 -- 172.21.15.46:0/2816022741 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v80) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3580003dd0 con 0x7f35841007a0 2023-10-19T12:41:15.405 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2023-10-19T12:41:15.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.404+0000 7f358c5ff700 1 -- 172.21.15.46:0/2816022741 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f35700a1500 msgr2=0x7f35700a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:15.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.404+0000 7f358c5ff700 1 --2- 172.21.15.46:0/2816022741 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f35700a1500 0x7f35700a39c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3574006010 tx=0x7f357400b540 comp rx=0 tx=0).stop 2023-10-19T12:41:15.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.404+0000 7f358c5ff700 1 -- 172.21.15.46:0/2816022741 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35841007a0 msgr2=0x7f3584196700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:15.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.404+0000 7f358c5ff700 1 --2- 172.21.15.46:0/2816022741 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35841007a0 0x7f3584196700 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f358000e970 tx=0x7f358000ec80 comp rx=0 tx=0).stop 2023-10-19T12:41:15.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.404+0000 7f358c5ff700 1 -- 172.21.15.46:0/2816022741 shutdown_connections 2023-10-19T12:41:15.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.404+0000 7f358c5ff700 1 --2- 172.21.15.46:0/2816022741 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f35700a1500 0x7f35700a39c0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:15.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.404+0000 7f358c5ff700 1 --2- 172.21.15.46:0/2816022741 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3584102330 0x7f358419dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:15.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.404+0000 7f358c5ff700 1 --2- 172.21.15.46:0/2816022741 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35841007a0 0x7f3584196700 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:15.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.404+0000 7f358c5ff700 1 --2- 172.21.15.46:0/2816022741 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3584101990 0x7f3584196c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:15.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.404+0000 7f358c5ff700 1 -- 172.21.15.46:0/2816022741 >> 172.21.15.46:0/2816022741 conn(0x7f35840fbcf0 msgr2=0x7f3584104d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:15.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.404+0000 7f358c5ff700 1 -- 172.21.15.46:0/2816022741 shutdown_connections 2023-10-19T12:41:15.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.404+0000 7f358c5ff700 1 -- 172.21.15.46:0/2816022741 wait complete. 2023-10-19T12:41:15.426 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-19T12:41:15.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.634+0000 7fa495bff700 1 -- 172.21.15.46:0/615798128 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa490101930 msgr2=0x7fa490101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:15.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.634+0000 7fa495bff700 1 --2- 172.21.15.46:0/615798128 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa490101930 0x7fa490101d90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa484009920 tx=0x7fa484009c30 comp rx=0 tx=0).stop 2023-10-19T12:41:15.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.634+0000 7fa495bff700 1 -- 172.21.15.46:0/615798128 shutdown_connections 2023-10-19T12:41:15.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.634+0000 7fa495bff700 1 --2- 172.21.15.46:0/615798128 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4901022d0 0x7fa490108b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:15.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.634+0000 7fa495bff700 1 --2- 172.21.15.46:0/615798128 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa490100740 0x7fa490100b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:15.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.634+0000 7fa495bff700 1 --2- 172.21.15.46:0/615798128 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa490101930 0x7fa490101d90 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:15.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.634+0000 7fa495bff700 1 -- 172.21.15.46:0/615798128 >> 172.21.15.46:0/615798128 conn(0x7fa4900fbc90 msgr2=0x7fa4900fe0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:15.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.634+0000 7fa495bff700 1 -- 172.21.15.46:0/615798128 shutdown_connections 2023-10-19T12:41:15.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.634+0000 7fa495bff700 1 -- 172.21.15.46:0/615798128 wait complete. 2023-10-19T12:41:15.642 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.635+0000 7fa495bff700 1 Processor -- start 2023-10-19T12:41:15.642 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.636+0000 7fa495bff700 1 -- start start 2023-10-19T12:41:15.642 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.636+0000 7fa495bff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa490100740 0x7fa4901989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:15.642 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.636+0000 7fa495bff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa490101930 0x7fa490198f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:15.642 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.636+0000 7fa495bff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa4901022d0 0x7fa49019ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:15.643 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.636+0000 7fa495bff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4901a04d0 con 0x7fa490101930 2023-10-19T12:41:15.643 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.636+0000 7fa495bff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4901a0610 con 0x7fa490100740 2023-10-19T12:41:15.643 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.636+0000 7fa495bff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4901a07a0 con 0x7fa4901022d0 2023-10-19T12:41:15.643 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.636+0000 7fa48f7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa490100740 0x7fa4901989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:15.643 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.636+0000 7fa48effd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa490101930 0x7fa490198f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:15.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.636+0000 7fa48f7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa490100740 0x7fa4901989f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:51248/0 (socket says 172.21.15.46:51248) 2023-10-19T12:41:15.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.636+0000 7fa48f7fe700 1 -- 172.21.15.46:0/2427672275 learned_addr learned my addr 172.21.15.46:0/2427672275 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:41:15.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.637+0000 7fa48ffff700 1 --2- 172.21.15.46:0/2427672275 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa4901022d0 0x7fa49019ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:15.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.637+0000 7fa48f7fe700 1 -- 172.21.15.46:0/2427672275 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa4901022d0 msgr2=0x7fa49019ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:15.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.637+0000 7fa48f7fe700 1 --2- 172.21.15.46:0/2427672275 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa4901022d0 0x7fa49019ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:15.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.637+0000 7fa48f7fe700 1 -- 172.21.15.46:0/2427672275 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa490101930 msgr2=0x7fa490198f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:15.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.637+0000 7fa48f7fe700 1 --2- 172.21.15.46:0/2427672275 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa490101930 0x7fa490198f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:15.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.637+0000 7fa48f7fe700 1 -- 172.21.15.46:0/2427672275 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4800095f0 con 0x7fa490100740 2023-10-19T12:41:15.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.637+0000 7fa48effd700 1 --2- 172.21.15.46:0/2427672275 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa490101930 0x7fa490198f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:41:15.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.637+0000 7fa48f7fe700 1 --2- 172.21.15.46:0/2427672275 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa490100740 0x7fa4901989f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa48000ebf0 tx=0x7fa48000ef00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:15.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.637+0000 7fa48cff9700 1 -- 172.21.15.46:0/2427672275 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa480009a10 con 0x7fa490100740 2023-10-19T12:41:15.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.637+0000 7fa48cff9700 1 -- 172.21.15.46:0/2427672275 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa48000cc90 con 0x7fa490100740 2023-10-19T12:41:15.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.637+0000 7fa495bff700 1 -- 172.21.15.46:0/2427672275 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa484009520 con 0x7fa490100740 2023-10-19T12:41:15.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.637+0000 7fa48cff9700 1 -- 172.21.15.46:0/2427672275 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa480018750 con 0x7fa490100740 2023-10-19T12:41:15.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.638+0000 7fa495bff700 1 -- 172.21.15.46:0/2427672275 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4901a0e50 con 0x7fa490100740 2023-10-19T12:41:15.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.638+0000 7fa495bff700 1 -- 172.21.15.46:0/2427672275 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa490067530 con 0x7fa490100740 2023-10-19T12:41:15.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.641+0000 7fa48cff9700 1 -- 172.21.15.46:0/2427672275 <== mon.2 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fa4800188b0 con 0x7fa490100740 2023-10-19T12:41:15.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.642+0000 7fa48cff9700 1 --2- 172.21.15.46:0/2427672275 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fa4780a1500 0x7fa4780a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:15.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.642+0000 7fa48cff9700 1 -- 172.21.15.46:0/2427672275 <== mon.2 v2:172.21.15.157:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fa480014070 con 0x7fa490100740 2023-10-19T12:41:15.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.642+0000 7fa48effd700 1 --2- 172.21.15.46:0/2427672275 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fa4780a1500 0x7fa4780a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:15.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.643+0000 7fa48effd700 1 --2- 172.21.15.46:0/2427672275 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fa4780a1500 0x7fa4780a39c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa48400fa40 tx=0x7fa484019040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:15.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.644+0000 7fa48cff9700 1 -- 172.21.15.46:0/2427672275 <== mon.2 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa480097010 con 0x7fa490100740 2023-10-19T12:41:15.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:15 smithi046 ceph-mon[98509]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-19T12:41:15.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:15 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/1843389380' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-19T12:41:15.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:15 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:15.730 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:15 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:15.730 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:15 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:15.730 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:15 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:15.730 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:15 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/2816022741' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-19T12:41:15.837 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:15 smithi157 ceph-mon[134109]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-19T12:41:15.838 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:15 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/1843389380' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-19T12:41:15.838 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:15 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:15.838 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:15 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:15.838 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:15 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:15.839 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:15 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:15.839 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:15 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/2816022741' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-19T12:41:15.876 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.873+0000 7fa495bff700 1 -- 172.21.15.46:0/2427672275 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fa49010c1c0 con 0x7fa490100740 2023-10-19T12:41:15.877 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.874+0000 7fa48cff9700 1 -- 172.21.15.46:0/2427672275 <== mon.2 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v80) v1 ==== 84+0+65 (secure 0 0 0) 0x7fa48009a630 con 0x7fa490100740 2023-10-19T12:41:15.877 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:41:15.877 INFO:teuthology.orchestra.run.smithi046.stdout:[ 2023-10-19T12:41:15.878 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:41:15.878 INFO:teuthology.orchestra.run.smithi046.stdout: "poolnum": 1, 2023-10-19T12:41:15.878 INFO:teuthology.orchestra.run.smithi046.stdout: "poolname": ".mgr" 2023-10-19T12:41:15.878 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:41:15.878 INFO:teuthology.orchestra.run.smithi046.stdout:] 2023-10-19T12:41:15.879 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.876+0000 7fa495bff700 1 -- 172.21.15.46:0/2427672275 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fa4780a1500 msgr2=0x7fa4780a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:15.879 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.876+0000 7fa495bff700 1 --2- 172.21.15.46:0/2427672275 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fa4780a1500 0x7fa4780a39c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa48400fa40 tx=0x7fa484019040 comp rx=0 tx=0).stop 2023-10-19T12:41:15.880 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.876+0000 7fa495bff700 1 -- 172.21.15.46:0/2427672275 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa490100740 msgr2=0x7fa4901989f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:15.880 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.876+0000 7fa495bff700 1 --2- 172.21.15.46:0/2427672275 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa490100740 0x7fa4901989f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa48000ebf0 tx=0x7fa48000ef00 comp rx=0 tx=0).stop 2023-10-19T12:41:15.880 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.876+0000 7fa495bff700 1 -- 172.21.15.46:0/2427672275 shutdown_connections 2023-10-19T12:41:15.880 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.876+0000 7fa495bff700 1 --2- 172.21.15.46:0/2427672275 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fa4780a1500 0x7fa4780a39c0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:15.881 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.876+0000 7fa495bff700 1 --2- 172.21.15.46:0/2427672275 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa4901022d0 0x7fa49019ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:15.881 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.876+0000 7fa495bff700 1 --2- 172.21.15.46:0/2427672275 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa490100740 0x7fa4901989f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:15.881 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.876+0000 7fa495bff700 1 --2- 172.21.15.46:0/2427672275 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa490101930 0x7fa490198f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:15.881 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.876+0000 7fa495bff700 1 -- 172.21.15.46:0/2427672275 >> 172.21.15.46:0/2427672275 conn(0x7fa4900fbc90 msgr2=0x7fa490107100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:15.881 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.876+0000 7fa495bff700 1 -- 172.21.15.46:0/2427672275 shutdown_connections 2023-10-19T12:41:15.882 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:15.876+0000 7fa495bff700 1 -- 172.21.15.46:0/2427672275 wait complete. 2023-10-19T12:41:15.882 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:15 smithi195 ceph-mon[134493]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-19T12:41:15.882 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:15 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/1843389380' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-19T12:41:15.882 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:15 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:15.883 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:15 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:15.883 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:15 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:15.883 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:15 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:15.883 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:15 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/2816022741' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-19T12:41:15.899 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-19T12:41:15.900 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-19T12:41:16.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:16.111+0000 7ff236fff700 1 -- 172.21.15.46:0/3210280039 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff2301007a0 msgr2=0x7ff230100bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:16.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:16.111+0000 7ff236fff700 1 --2- 172.21.15.46:0/3210280039 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff2301007a0 0x7ff230100bc0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff22400b0d0 tx=0x7ff22400b3e0 comp rx=0 tx=0).stop 2023-10-19T12:41:16.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:16.111+0000 7ff236fff700 1 -- 172.21.15.46:0/3210280039 shutdown_connections 2023-10-19T12:41:16.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:16.111+0000 7ff236fff700 1 --2- 172.21.15.46:0/3210280039 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff230102330 0x7ff230108be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:16.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:16.111+0000 7ff236fff700 1 --2- 172.21.15.46:0/3210280039 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff2301007a0 0x7ff230100bc0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:16.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:16.111+0000 7ff236fff700 1 --2- 172.21.15.46:0/3210280039 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff230101990 0x7ff230101df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:16.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:16.111+0000 7ff236fff700 1 -- 172.21.15.46:0/3210280039 >> 172.21.15.46:0/3210280039 conn(0x7ff2300fbcf0 msgr2=0x7ff2300fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:16.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:16.111+0000 7ff236fff700 1 -- 172.21.15.46:0/3210280039 shutdown_connections 2023-10-19T12:41:16.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:16.112+0000 7ff236fff700 1 -- 172.21.15.46:0/3210280039 wait complete. 2023-10-19T12:41:16.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:16.112+0000 7ff236fff700 1 Processor -- start 2023-10-19T12:41:16.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:16.113+0000 7ff236fff700 1 -- start start 2023-10-19T12:41:16.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:16.113+0000 7ff236fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff2301007a0 0x7ff230198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:16.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:16.113+0000 7ff236fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff230101990 0x7ff230199010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:16.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:16.113+0000 7ff236fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff230102330 0x7ff2301a0030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:16.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:16.113+0000 7ff236fff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2301a0600 con 0x7ff230101990 2023-10-19T12:41:16.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:16.113+0000 7ff236fff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2301a0740 con 0x7ff2301007a0 2023-10-19T12:41:16.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:16.113+0000 7ff236fff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2301a08d0 con 0x7ff230102330 2023-10-19T12:41:16.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:16.113+0000 7ff22ffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff230101990 0x7ff230199010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:16.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:16.113+0000 7ff22ffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff230101990 0x7ff230199010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34198/0 (socket says 172.21.15.46:34198) 2023-10-19T12:41:16.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:16.113+0000 7ff22ffff700 1 -- 172.21.15.46:0/1870026618 learned_addr learned my addr 172.21.15.46:0/1870026618 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:41:16.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:16.113+0000 7ff234d9b700 1 --2- 172.21.15.46:0/1870026618 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff2301007a0 0x7ff230198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:16.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:16.113+0000 7ff23559c700 1 --2- 172.21.15.46:0/1870026618 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff230102330 0x7ff2301a0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:16.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:16.114+0000 7ff22ffff700 1 -- 172.21.15.46:0/1870026618 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff230102330 msgr2=0x7ff2301a0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:16.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:16.114+0000 7ff22ffff700 1 --2- 172.21.15.46:0/1870026618 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff230102330 0x7ff2301a0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:16.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:16.114+0000 7ff22ffff700 1 -- 172.21.15.46:0/1870026618 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff2301007a0 msgr2=0x7ff230198ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:16.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:16.114+0000 7ff22ffff700 1 --2- 172.21.15.46:0/1870026618 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff2301007a0 0x7ff230198ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:16.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:16.114+0000 7ff22ffff700 1 -- 172.21.15.46:0/1870026618 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff21c009520 con 0x7ff230101990 2023-10-19T12:41:16.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:16.114+0000 7ff22ffff700 1 --2- 172.21.15.46:0/1870026618 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff230101990 0x7ff230199010 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff21c00eb30 tx=0x7ff21c00ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:16.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:16.114+0000 7ff22dffb700 1 -- 172.21.15.46:0/1870026618 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff21c009880 con 0x7ff230101990 2023-10-19T12:41:16.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:16.114+0000 7ff22dffb700 1 -- 172.21.15.46:0/1870026618 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff21c0044e0 con 0x7ff230101990 2023-10-19T12:41:16.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:16.114+0000 7ff22dffb700 1 -- 172.21.15.46:0/1870026618 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff21c003d80 con 0x7ff230101990 2023-10-19T12:41:16.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:16.114+0000 7ff236fff700 1 -- 172.21.15.46:0/1870026618 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff224009d00 con 0x7ff230101990 2023-10-19T12:41:16.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:16.114+0000 7ff236fff700 1 -- 172.21.15.46:0/1870026618 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2301a0f30 con 0x7ff230101990 2023-10-19T12:41:16.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:16.115+0000 7ff236fff700 1 -- 172.21.15.46:0/1870026618 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2300675a0 con 0x7ff230101990 2023-10-19T12:41:16.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:16.117+0000 7ff22dffb700 1 -- 172.21.15.46:0/1870026618 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7ff21c003f20 con 0x7ff230101990 2023-10-19T12:41:16.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:16.119+0000 7ff22dffb700 1 --2- 172.21.15.46:0/1870026618 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7ff2200a1500 0x7ff2200a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:16.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:16.119+0000 7ff22dffb700 1 -- 172.21.15.46:0/1870026618 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7ff21c014070 con 0x7ff230101990 2023-10-19T12:41:16.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:16.119+0000 7ff234d9b700 1 --2- 172.21.15.46:0/1870026618 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7ff2200a1500 0x7ff2200a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:16.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:16.120+0000 7ff234d9b700 1 --2- 172.21.15.46:0/1870026618 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7ff2200a1500 0x7ff2200a39c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff224009fd0 tx=0x7ff22400b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:16.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:16.123+0000 7ff22dffb700 1 -- 172.21.15.46:0/1870026618 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff21c096820 con 0x7ff230101990 2023-10-19T12:41:16.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:16.367+0000 7ff236fff700 1 -- 172.21.15.46:0/1870026618 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7ff23010c000 con 0x7ff230101990 2023-10-19T12:41:17.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:17.212+0000 7ff22dffb700 1 -- 172.21.15.46:0/1870026618 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v81) v1 ==== 138+0+0 (secure 0 0 0) 0x7ff21c099e40 con 0x7ff230101990 2023-10-19T12:41:17.218 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:17.215+0000 7ff236fff700 1 -- 172.21.15.46:0/1870026618 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7ff2200a1500 msgr2=0x7ff2200a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:17.218 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:17.215+0000 7ff236fff700 1 --2- 172.21.15.46:0/1870026618 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7ff2200a1500 0x7ff2200a39c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff224009fd0 tx=0x7ff22400b040 comp rx=0 tx=0).stop 2023-10-19T12:41:17.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:17.215+0000 7ff236fff700 1 -- 172.21.15.46:0/1870026618 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff230101990 msgr2=0x7ff230199010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:17.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:17.215+0000 7ff236fff700 1 --2- 172.21.15.46:0/1870026618 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff230101990 0x7ff230199010 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff21c00eb30 tx=0x7ff21c00ee40 comp rx=0 tx=0).stop 2023-10-19T12:41:17.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:17.215+0000 7ff236fff700 1 -- 172.21.15.46:0/1870026618 shutdown_connections 2023-10-19T12:41:17.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:17.215+0000 7ff236fff700 1 --2- 172.21.15.46:0/1870026618 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7ff2200a1500 0x7ff2200a39c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:17.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:17.215+0000 7ff236fff700 1 --2- 172.21.15.46:0/1870026618 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff230102330 0x7ff2301a0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:17.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:17.215+0000 7ff236fff700 1 --2- 172.21.15.46:0/1870026618 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff2301007a0 0x7ff230198ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:17.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:17.215+0000 7ff236fff700 1 --2- 172.21.15.46:0/1870026618 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff230101990 0x7ff230199010 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:17.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:17.215+0000 7ff236fff700 1 -- 172.21.15.46:0/1870026618 >> 172.21.15.46:0/1870026618 conn(0x7ff2300fbcf0 msgr2=0x7ff230072a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:17.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:17.216+0000 7ff236fff700 1 -- 172.21.15.46:0/1870026618 shutdown_connections 2023-10-19T12:41:17.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:17.216+0000 7ff236fff700 1 -- 172.21.15.46:0/1870026618 wait complete. 2023-10-19T12:41:17.222 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_metadata' created 2023-10-19T12:41:17.228 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:16 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/2427672275' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-10-19T12:41:17.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:16 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:17.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:16 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:17.242 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-10-19T12:41:17.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:16 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/2427672275' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-10-19T12:41:17.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:16 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:17.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:16 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:17.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:16 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/2427672275' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-10-19T12:41:17.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:16 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:17.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:16 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:17.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:17.460+0000 7f37c8bff700 1 -- 172.21.15.46:0/2814789593 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f37c4100880 msgr2=0x7f37c4100ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:17.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:17.460+0000 7f37c8bff700 1 --2- 172.21.15.46:0/2814789593 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f37c4100880 0x7f37c4100ce0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f37b8009920 tx=0x7f37b8009c30 comp rx=0 tx=0).stop 2023-10-19T12:41:17.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:17.460+0000 7f37c8bff700 1 -- 172.21.15.46:0/2814789593 shutdown_connections 2023-10-19T12:41:17.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:17.460+0000 7f37c8bff700 1 --2- 172.21.15.46:0/2814789593 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37c4101220 0x7f37c4107ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:17.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:17.460+0000 7f37c8bff700 1 --2- 172.21.15.46:0/2814789593 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37c40ff690 0x7f37c40ffab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:17.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:17.460+0000 7f37c8bff700 1 --2- 172.21.15.46:0/2814789593 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f37c4100880 0x7f37c4100ce0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:17.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:17.460+0000 7f37c8bff700 1 -- 172.21.15.46:0/2814789593 >> 172.21.15.46:0/2814789593 conn(0x7f37c40fac00 msgr2=0x7f37c40fd040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:17.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:17.460+0000 7f37c8bff700 1 -- 172.21.15.46:0/2814789593 shutdown_connections 2023-10-19T12:41:17.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:17.460+0000 7f37c8bff700 1 -- 172.21.15.46:0/2814789593 wait complete. 2023-10-19T12:41:17.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:17.461+0000 7f37c8bff700 1 Processor -- start 2023-10-19T12:41:17.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:17.461+0000 7f37c8bff700 1 -- start start 2023-10-19T12:41:17.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:17.461+0000 7f37c8bff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37c40ff690 0x7f37c41967d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:17.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:17.461+0000 7f37c8bff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f37c4100880 0x7f37c4196d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:17.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:17.461+0000 7f37c8bff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37c4101220 0x7f37c419dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:17.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:17.461+0000 7f37c8bff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37c419e300 con 0x7f37c40ff690 2023-10-19T12:41:17.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:17.461+0000 7f37c8bff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37c419e440 con 0x7f37c4100880 2023-10-19T12:41:17.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:17.461+0000 7f37c8bff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37c419e5d0 con 0x7f37c4101220 2023-10-19T12:41:17.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:17.462+0000 7f37c259c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37c40ff690 0x7f37c41967d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:17.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:17.462+0000 7f37c1d9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f37c4100880 0x7f37c4196d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:17.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:17.462+0000 7f37c1d9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f37c4100880 0x7f37c4196d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:51276/0 (socket says 172.21.15.46:51276) 2023-10-19T12:41:17.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:17.462+0000 7f37c1d9b700 1 -- 172.21.15.46:0/2951717873 learned_addr learned my addr 172.21.15.46:0/2951717873 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:41:17.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:17.462+0000 7f37c2d9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37c4101220 0x7f37c419dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:17.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:17.462+0000 7f37c1d9b700 1 -- 172.21.15.46:0/2951717873 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37c4101220 msgr2=0x7f37c419dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:17.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:17.462+0000 7f37c1d9b700 1 --2- 172.21.15.46:0/2951717873 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37c4101220 0x7f37c419dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:17.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:17.462+0000 7f37c1d9b700 1 -- 172.21.15.46:0/2951717873 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37c40ff690 msgr2=0x7f37c41967d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:17.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:17.462+0000 7f37c1d9b700 1 --2- 172.21.15.46:0/2951717873 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37c40ff690 0x7f37c41967d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:17.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:17.462+0000 7f37c1d9b700 1 -- 172.21.15.46:0/2951717873 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37b8009520 con 0x7f37c4100880 2023-10-19T12:41:17.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:17.462+0000 7f37c259c700 1 --2- 172.21.15.46:0/2951717873 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37c40ff690 0x7f37c41967d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:41:17.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:17.462+0000 7f37c2d9d700 1 --2- 172.21.15.46:0/2951717873 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37c4101220 0x7f37c419dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:41:17.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:17.462+0000 7f37c1d9b700 1 --2- 172.21.15.46:0/2951717873 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f37c4100880 0x7f37c4196d10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f37b8009840 tx=0x7f37b800b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:17.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:17.463+0000 7f37b37fe700 1 -- 172.21.15.46:0/2951717873 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b801c070 con 0x7f37c4100880 2023-10-19T12:41:17.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:17.463+0000 7f37b37fe700 1 -- 172.21.15.46:0/2951717873 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f37b800f7d0 con 0x7f37c4100880 2023-10-19T12:41:17.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:17.463+0000 7f37c8bff700 1 -- 172.21.15.46:0/2951717873 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37c419e850 con 0x7f37c4100880 2023-10-19T12:41:17.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:17.463+0000 7f37b37fe700 1 -- 172.21.15.46:0/2951717873 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b80038a0 con 0x7f37c4100880 2023-10-19T12:41:17.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:17.463+0000 7f37c8bff700 1 -- 172.21.15.46:0/2951717873 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37c419ec20 con 0x7f37c4100880 2023-10-19T12:41:17.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:17.464+0000 7f37c8bff700 1 -- 172.21.15.46:0/2951717873 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37c4106b10 con 0x7f37c4100880 2023-10-19T12:41:17.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:17.466+0000 7f37b37fe700 1 -- 172.21.15.46:0/2951717873 <== mon.2 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f37b8020030 con 0x7f37c4100880 2023-10-19T12:41:17.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:17.467+0000 7f37b37fe700 1 --2- 172.21.15.46:0/2951717873 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f37ac0a1480 0x7f37ac0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:17.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:17.468+0000 7f37b37fe700 1 -- 172.21.15.46:0/2951717873 <== mon.2 v2:172.21.15.157:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7497+0+0 (secure 0 0 0) 0x7f37b80cd9d0 con 0x7f37c4100880 2023-10-19T12:41:17.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:17.468+0000 7f37c259c700 1 --2- 172.21.15.46:0/2951717873 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f37ac0a1480 0x7f37ac0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:17.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:17.468+0000 7f37c259c700 1 --2- 172.21.15.46:0/2951717873 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f37ac0a1480 0x7f37ac0a3940 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f37c41006e0 tx=0x7f37b4009310 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:17.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:17.470+0000 7f37b37fe700 1 -- 172.21.15.46:0/2951717873 <== mon.2 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f37b8097350 con 0x7f37c4100880 2023-10-19T12:41:17.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:17.683+0000 7f37c8bff700 1 -- 172.21.15.46:0/2951717873 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f37c40675a0 con 0x7f37c4100880 2023-10-19T12:41:18.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:18.268+0000 7f37b37fe700 1 -- 172.21.15.46:0/2951717873 <== mon.2 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v82) v1 ==== 171+0+0 (secure 0 0 0) 0x7f37b809a970 con 0x7f37c4100880 2023-10-19T12:41:18.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:18.276+0000 7f37c8bff700 1 -- 172.21.15.46:0/2951717873 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f37ac0a1480 msgr2=0x7f37ac0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:18.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:18.276+0000 7f37c8bff700 1 --2- 172.21.15.46:0/2951717873 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f37ac0a1480 0x7f37ac0a3940 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f37c41006e0 tx=0x7f37b4009310 comp rx=0 tx=0).stop 2023-10-19T12:41:18.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:18.276+0000 7f37c8bff700 1 -- 172.21.15.46:0/2951717873 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f37c4100880 msgr2=0x7f37c4196d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:18.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:18.276+0000 7f37c8bff700 1 --2- 172.21.15.46:0/2951717873 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f37c4100880 0x7f37c4196d10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f37b8009840 tx=0x7f37b800b790 comp rx=0 tx=0).stop 2023-10-19T12:41:18.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:18.277+0000 7f37c8bff700 1 -- 172.21.15.46:0/2951717873 shutdown_connections 2023-10-19T12:41:18.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:18.277+0000 7f37c8bff700 1 --2- 172.21.15.46:0/2951717873 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f37ac0a1480 0x7f37ac0a3940 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:18.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:18.277+0000 7f37c8bff700 1 --2- 172.21.15.46:0/2951717873 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37c4101220 0x7f37c419dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:18.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:18.277+0000 7f37c8bff700 1 --2- 172.21.15.46:0/2951717873 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37c40ff690 0x7f37c41967d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:18.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:18.277+0000 7f37c8bff700 1 --2- 172.21.15.46:0/2951717873 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f37c4100880 0x7f37c4196d10 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:18.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:18.277+0000 7f37c8bff700 1 -- 172.21.15.46:0/2951717873 >> 172.21.15.46:0/2951717873 conn(0x7f37c40fac00 msgr2=0x7f37c4103c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:18.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:18.280+0000 7f37c8bff700 1 -- 172.21.15.46:0/2951717873 shutdown_connections 2023-10-19T12:41:18.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:18.280+0000 7f37c8bff700 1 -- 172.21.15.46:0/2951717873 wait complete. 2023-10-19T12:41:18.291 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_data' created 2023-10-19T12:41:18.319 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-19T12:41:18.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:18.533+0000 7f8b9b1ff700 1 -- 172.21.15.46:0/1599484744 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8b941007a0 msgr2=0x7f8b94100bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:18.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:18.533+0000 7f8b9b1ff700 1 --2- 172.21.15.46:0/1599484744 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8b941007a0 0x7f8b94100bc0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8b880099c0 tx=0x7f8b88009cd0 comp rx=0 tx=0).stop 2023-10-19T12:41:18.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:18.533+0000 7f8b9b1ff700 1 -- 172.21.15.46:0/1599484744 shutdown_connections 2023-10-19T12:41:18.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:18.533+0000 7f8b9b1ff700 1 --2- 172.21.15.46:0/1599484744 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8b94102330 0x7f8b94108be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:18.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:18.533+0000 7f8b9b1ff700 1 --2- 172.21.15.46:0/1599484744 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8b941007a0 0x7f8b94100bc0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:18.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:18.533+0000 7f8b9b1ff700 1 --2- 172.21.15.46:0/1599484744 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b94101990 0x7f8b94101df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:18.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:18.533+0000 7f8b9b1ff700 1 -- 172.21.15.46:0/1599484744 >> 172.21.15.46:0/1599484744 conn(0x7f8b940fbcf0 msgr2=0x7f8b940fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:18.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:18.533+0000 7f8b9b1ff700 1 -- 172.21.15.46:0/1599484744 shutdown_connections 2023-10-19T12:41:18.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:18.533+0000 7f8b9b1ff700 1 -- 172.21.15.46:0/1599484744 wait complete. 2023-10-19T12:41:18.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:18.534+0000 7f8b9b1ff700 1 Processor -- start 2023-10-19T12:41:18.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:18.534+0000 7f8b9b1ff700 1 -- start start 2023-10-19T12:41:18.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:18.535+0000 7f8b9b1ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8b941007a0 0x7f8b94198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:18.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:18.535+0000 7f8b9b1ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8b94101990 0x7f8b94198eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:18.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:18.535+0000 7f8b9b1ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b94102330 0x7f8b9419fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:18.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:18.535+0000 7f8b9b1ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b941a04a0 con 0x7f8b94102330 2023-10-19T12:41:18.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:18.535+0000 7f8b9b1ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b941a05e0 con 0x7f8b941007a0 2023-10-19T12:41:18.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:18.535+0000 7f8b9b1ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b941a0770 con 0x7f8b94101990 2023-10-19T12:41:18.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:18.535+0000 7f8b93fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8b94101990 0x7f8b94198eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:18.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:18.535+0000 7f8b98f9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8b941007a0 0x7f8b94198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:18.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:18.535+0000 7f8b9979c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b94102330 0x7f8b9419fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:18.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:18.535+0000 7f8b93fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8b94101990 0x7f8b94198eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:56564/0 (socket says 172.21.15.46:56564) 2023-10-19T12:41:18.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:18.535+0000 7f8b93fff700 1 -- 172.21.15.46:0/3822750718 learned_addr learned my addr 172.21.15.46:0/3822750718 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:41:18.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:18.535+0000 7f8b98f9b700 1 -- 172.21.15.46:0/3822750718 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8b94101990 msgr2=0x7f8b94198eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:18.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:18.535+0000 7f8b98f9b700 1 --2- 172.21.15.46:0/3822750718 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8b94101990 0x7f8b94198eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:18.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:18.535+0000 7f8b98f9b700 1 -- 172.21.15.46:0/3822750718 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b94102330 msgr2=0x7f8b9419fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:18.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:18.535+0000 7f8b98f9b700 1 --2- 172.21.15.46:0/3822750718 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b94102330 0x7f8b9419fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:18.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:18.535+0000 7f8b98f9b700 1 -- 172.21.15.46:0/3822750718 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b880095f0 con 0x7f8b941007a0 2023-10-19T12:41:18.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:18.535+0000 7f8b93fff700 1 --2- 172.21.15.46:0/3822750718 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8b94101990 0x7f8b94198eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:41:18.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:18.536+0000 7f8b98f9b700 1 --2- 172.21.15.46:0/3822750718 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8b941007a0 0x7f8b94198970 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8b880098e0 tx=0x7f8b8800f690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:18.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:18.536+0000 7f8b91ffb700 1 -- 172.21.15.46:0/3822750718 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b8801d070 con 0x7f8b941007a0 2023-10-19T12:41:18.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:18.536+0000 7f8b91ffb700 1 -- 172.21.15.46:0/3822750718 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8b88005050 con 0x7f8b941007a0 2023-10-19T12:41:18.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:18.536+0000 7f8b91ffb700 1 -- 172.21.15.46:0/3822750718 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b88004a50 con 0x7f8b941007a0 2023-10-19T12:41:18.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:18.536+0000 7f8b9b1ff700 1 -- 172.21.15.46:0/3822750718 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b941a09f0 con 0x7f8b941007a0 2023-10-19T12:41:18.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:18.536+0000 7f8b9b1ff700 1 -- 172.21.15.46:0/3822750718 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b941a0dc0 con 0x7f8b941007a0 2023-10-19T12:41:18.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:18.537+0000 7f8b9b1ff700 1 -- 172.21.15.46:0/3822750718 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b940675a0 con 0x7f8b941007a0 2023-10-19T12:41:18.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:18.539+0000 7f8b91ffb700 1 -- 172.21.15.46:0/3822750718 <== mon.2 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f8b880051c0 con 0x7f8b941007a0 2023-10-19T12:41:18.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:18.540+0000 7f8b91ffb700 1 --2- 172.21.15.46:0/3822750718 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f8b840a1480 0x7f8b840a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:18.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:18.541+0000 7f8b91ffb700 1 -- 172.21.15.46:0/3822750718 <== mon.2 v2:172.21.15.157:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7879+0+0 (secure 0 0 0) 0x7f8b880cd860 con 0x7f8b941007a0 2023-10-19T12:41:18.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:18.541+0000 7f8b93fff700 1 --2- 172.21.15.46:0/3822750718 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f8b840a1480 0x7f8b840a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:18.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:18.541+0000 7f8b93fff700 1 --2- 172.21.15.46:0/3822750718 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f8b840a1480 0x7f8b840a3940 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8b80011550 tx=0x7f8b80009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:18.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:18.544+0000 7f8b91ffb700 1 -- 172.21.15.46:0/3822750718 <== mon.2 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f8b88097060 con 0x7f8b941007a0 2023-10-19T12:41:18.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:18 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/1870026618' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-10-19T12:41:18.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:18 smithi157 ceph-mon[134109]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-19T12:41:18.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:18 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:18.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:18 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:41:18.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:18 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:41:18.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:18 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:18.589 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:18 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/1870026618' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-10-19T12:41:18.589 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:18 smithi157 ceph-mon[134109]: osdmap e81: 12 total, 12 up, 12 in 2023-10-19T12:41:18.589 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:18 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:41:18.589 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:18 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/2951717873' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2023-10-19T12:41:18.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:18 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/1870026618' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-10-19T12:41:18.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:18 smithi195 ceph-mon[134493]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-19T12:41:18.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:18 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:18.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:18 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:41:18.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:18 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:41:18.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:18 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:18.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:18 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/1870026618' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-10-19T12:41:18.632 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:18 smithi195 ceph-mon[134493]: osdmap e81: 12 total, 12 up, 12 in 2023-10-19T12:41:18.632 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:18 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:41:18.632 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:18 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/2951717873' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2023-10-19T12:41:18.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:18 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/1870026618' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-10-19T12:41:18.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:18 smithi046 ceph-mon[98509]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-19T12:41:18.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:18 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:18.730 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:18 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:41:18.730 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:18 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:41:18.730 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:18 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:18.730 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:18 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/1870026618' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-10-19T12:41:18.730 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:18 smithi046 ceph-mon[98509]: osdmap e81: 12 total, 12 up, 12 in 2023-10-19T12:41:18.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:18 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:41:18.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:18 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/2951717873' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2023-10-19T12:41:18.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:18.813+0000 7f8b9b1ff700 1 -- 172.21.15.46:0/3822750718 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f8b9410c030 con 0x7f8b941007a0 2023-10-19T12:41:19.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:19.269+0000 7f8b91ffb700 1 -- 172.21.15.46:0/3822750718 <== mon.2 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7f8b8809a680 con 0x7f8b941007a0 2023-10-19T12:41:19.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:19.276+0000 7f8b9b1ff700 1 -- 172.21.15.46:0/3822750718 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f8b840a1480 msgr2=0x7f8b840a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:19.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:19.276+0000 7f8b9b1ff700 1 --2- 172.21.15.46:0/3822750718 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f8b840a1480 0x7f8b840a3940 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8b80011550 tx=0x7f8b80009260 comp rx=0 tx=0).stop 2023-10-19T12:41:19.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:19.276+0000 7f8b9b1ff700 1 -- 172.21.15.46:0/3822750718 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8b941007a0 msgr2=0x7f8b94198970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:19.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:19.276+0000 7f8b9b1ff700 1 --2- 172.21.15.46:0/3822750718 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8b941007a0 0x7f8b94198970 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8b880098e0 tx=0x7f8b8800f690 comp rx=0 tx=0).stop 2023-10-19T12:41:19.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:19.277+0000 7f8b9b1ff700 1 -- 172.21.15.46:0/3822750718 shutdown_connections 2023-10-19T12:41:19.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:19.277+0000 7f8b9b1ff700 1 --2- 172.21.15.46:0/3822750718 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b94102330 0x7f8b9419fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:19.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:19.277+0000 7f8b9b1ff700 1 --2- 172.21.15.46:0/3822750718 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8b941007a0 0x7f8b94198970 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:19.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:19.277+0000 7f8b9b1ff700 1 --2- 172.21.15.46:0/3822750718 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f8b840a1480 0x7f8b840a3940 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:19.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:19.277+0000 7f8b9b1ff700 1 --2- 172.21.15.46:0/3822750718 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8b94101990 0x7f8b94198eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:19.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:19.277+0000 7f8b9b1ff700 1 -- 172.21.15.46:0/3822750718 >> 172.21.15.46:0/3822750718 conn(0x7f8b940fbcf0 msgr2=0x7f8b94107130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:19.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:19.278+0000 7f8b9b1ff700 1 -- 172.21.15.46:0/3822750718 shutdown_connections 2023-10-19T12:41:19.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:19.279+0000 7f8b9b1ff700 1 -- 172.21.15.46:0/3822750718 wait complete. 2023-10-19T12:41:19.287 INFO:teuthology.orchestra.run.smithi046.stderr:new fs with metadata pool 2 and data pool 3 2023-10-19T12:41:19.332 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-10-19T12:41:19.332 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-10-19T12:41:19.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:19.550+0000 7f7c381ff700 1 -- 172.21.15.46:0/4264465061 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7c30101990 msgr2=0x7f7c30101df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:19.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:19.550+0000 7f7c381ff700 1 --2- 172.21.15.46:0/4264465061 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7c30101990 0x7f7c30101df0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7c200099c0 tx=0x7f7c20009cd0 comp rx=0 tx=0).stop 2023-10-19T12:41:19.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:19.550+0000 7f7c381ff700 1 -- 172.21.15.46:0/4264465061 shutdown_connections 2023-10-19T12:41:19.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:19.550+0000 7f7c381ff700 1 --2- 172.21.15.46:0/4264465061 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7c30102330 0x7f7c30108be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:19.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:19.550+0000 7f7c381ff700 1 --2- 172.21.15.46:0/4264465061 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7c301007a0 0x7f7c30100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:19.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:19.550+0000 7f7c381ff700 1 --2- 172.21.15.46:0/4264465061 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7c30101990 0x7f7c30101df0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:19.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:19.550+0000 7f7c381ff700 1 -- 172.21.15.46:0/4264465061 >> 172.21.15.46:0/4264465061 conn(0x7f7c300fbcf0 msgr2=0x7f7c300fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:19.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:19.550+0000 7f7c381ff700 1 -- 172.21.15.46:0/4264465061 shutdown_connections 2023-10-19T12:41:19.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:19.550+0000 7f7c381ff700 1 -- 172.21.15.46:0/4264465061 wait complete. 2023-10-19T12:41:19.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:19.551+0000 7f7c381ff700 1 Processor -- start 2023-10-19T12:41:19.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:19.552+0000 7f7c381ff700 1 -- start start 2023-10-19T12:41:19.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:19.552+0000 7f7c381ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7c301007a0 0x7f7c301988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:19.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:19.552+0000 7f7c381ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7c30101990 0x7f7c30198e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:19.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:19.552+0000 7f7c381ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7c30102330 0x7f7c3019fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:19.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:19.552+0000 7f7c381ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c301a0420 con 0x7f7c301007a0 2023-10-19T12:41:19.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:19.552+0000 7f7c381ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c301a0560 con 0x7f7c30101990 2023-10-19T12:41:19.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:19.552+0000 7f7c381ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c301a06f0 con 0x7f7c30102330 2023-10-19T12:41:19.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:19.552+0000 7f7c35f9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7c301007a0 0x7f7c301988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:19.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:19.552+0000 7f7c35f9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7c301007a0 0x7f7c301988f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34268/0 (socket says 172.21.15.46:34268) 2023-10-19T12:41:19.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:19.552+0000 7f7c35f9b700 1 -- 172.21.15.46:0/703407842 learned_addr learned my addr 172.21.15.46:0/703407842 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:41:19.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:19.552+0000 7f7c3679c700 1 --2- 172.21.15.46:0/703407842 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7c30102330 0x7f7c3019fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:19.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:19.552+0000 7f7c3579a700 1 --2- 172.21.15.46:0/703407842 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7c30101990 0x7f7c30198e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:19.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:19.552+0000 7f7c35f9b700 1 -- 172.21.15.46:0/703407842 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7c30102330 msgr2=0x7f7c3019fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:19.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:19.552+0000 7f7c35f9b700 1 --2- 172.21.15.46:0/703407842 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7c30102330 0x7f7c3019fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:19.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:19.552+0000 7f7c35f9b700 1 -- 172.21.15.46:0/703407842 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7c30101990 msgr2=0x7f7c30198e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:19.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:19.553+0000 7f7c35f9b700 1 --2- 172.21.15.46:0/703407842 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7c30101990 0x7f7c30198e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:19.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:19.553+0000 7f7c35f9b700 1 -- 172.21.15.46:0/703407842 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c200095f0 con 0x7f7c301007a0 2023-10-19T12:41:19.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:19.553+0000 7f7c3579a700 1 --2- 172.21.15.46:0/703407842 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7c30101990 0x7f7c30198e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:41:19.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:19.553+0000 7f7c35f9b700 1 --2- 172.21.15.46:0/703407842 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7c301007a0 0x7f7c301988f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c00e970 tx=0x7f7c2c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:19.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:19.553+0000 7f7c26ffd700 1 -- 172.21.15.46:0/703407842 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2c009790 con 0x7f7c301007a0 2023-10-19T12:41:19.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:19.553+0000 7f7c26ffd700 1 -- 172.21.15.46:0/703407842 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7c2c00c7e0 con 0x7f7c301007a0 2023-10-19T12:41:19.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:19.553+0000 7f7c381ff700 1 -- 172.21.15.46:0/703407842 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c301a09d0 con 0x7f7c301007a0 2023-10-19T12:41:19.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:19.553+0000 7f7c26ffd700 1 -- 172.21.15.46:0/703407842 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2c003c70 con 0x7f7c301007a0 2023-10-19T12:41:19.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:19.553+0000 7f7c381ff700 1 -- 172.21.15.46:0/703407842 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c301a0ee0 con 0x7f7c301007a0 2023-10-19T12:41:19.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:19.554+0000 7f7c381ff700 1 -- 172.21.15.46:0/703407842 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c300675a0 con 0x7f7c301007a0 2023-10-19T12:41:19.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:19.556+0000 7f7c26ffd700 1 -- 172.21.15.46:0/703407842 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f7c2c00cc50 con 0x7f7c301007a0 2023-10-19T12:41:19.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:19.558+0000 7f7c26ffd700 1 --2- 172.21.15.46:0/703407842 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f7c1c0a1480 0x7f7c1c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:19.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:19.558+0000 7f7c26ffd700 1 -- 172.21.15.46:0/703407842 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f7c2c014070 con 0x7f7c301007a0 2023-10-19T12:41:19.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:19.558+0000 7f7c3579a700 1 --2- 172.21.15.46:0/703407842 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f7c1c0a1480 0x7f7c1c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:19.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:19.558+0000 7f7c3579a700 1 --2- 172.21.15.46:0/703407842 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f7c1c0a1480 0x7f7c1c0a3940 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7c20000c00 tx=0x7f7c20019040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:19.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:19.560+0000 7f7c26ffd700 1 -- 172.21.15.46:0/703407842 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7c2c096660 con 0x7f7c301007a0 2023-10-19T12:41:19.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:19 smithi157 ceph-mon[134109]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2023-10-19T12:41:19.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:19 smithi157 ceph-mon[134109]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2023-10-19T12:41:19.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:19 smithi157 ceph-mon[134109]: osdmap e82: 12 total, 12 up, 12 in 2023-10-19T12:41:19.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:19 smithi157 ceph-mon[134109]: pgmap v278: 97 pgs: 14 creating+peering, 80 unknown, 3 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-19T12:41:19.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:19 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/3822750718' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-10-19T12:41:19.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:19 smithi157 ceph-mon[134109]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-10-19T12:41:19.589 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:19 smithi157 ceph-mon[134109]: daemon mds.b assigned to filesystem cephfs as rank 0 2023-10-19T12:41:19.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:19 smithi195 ceph-mon[134493]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2023-10-19T12:41:19.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:19 smithi195 ceph-mon[134493]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2023-10-19T12:41:19.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:19 smithi195 ceph-mon[134493]: osdmap e82: 12 total, 12 up, 12 in 2023-10-19T12:41:19.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:19 smithi195 ceph-mon[134493]: pgmap v278: 97 pgs: 14 creating+peering, 80 unknown, 3 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-19T12:41:19.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:19 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/3822750718' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-10-19T12:41:19.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:19 smithi195 ceph-mon[134493]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-10-19T12:41:19.632 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:19 smithi195 ceph-mon[134493]: daemon mds.b assigned to filesystem cephfs as rank 0 2023-10-19T12:41:19.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:19 smithi046 ceph-mon[98509]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2023-10-19T12:41:19.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:19 smithi046 ceph-mon[98509]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2023-10-19T12:41:19.730 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:19 smithi046 ceph-mon[98509]: osdmap e82: 12 total, 12 up, 12 in 2023-10-19T12:41:19.730 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:19 smithi046 ceph-mon[98509]: pgmap v278: 97 pgs: 14 creating+peering, 80 unknown, 3 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-19T12:41:19.730 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:19 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/3822750718' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-10-19T12:41:19.730 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:19 smithi046 ceph-mon[98509]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-10-19T12:41:19.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:19 smithi046 ceph-mon[98509]: daemon mds.b assigned to filesystem cephfs as rank 0 2023-10-19T12:41:19.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:19.788+0000 7f7c381ff700 1 -- 172.21.15.46:0/703407842 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f7c3010c160 con 0x7f7c301007a0 2023-10-19T12:41:20.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:20.296+0000 7f7c26ffd700 1 -- 172.21.15.46:0/703407842 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v84) v1 ==== 157+0+0 (secure 0 0 0) 0x7f7c2c003dd0 con 0x7f7c301007a0 2023-10-19T12:41:20.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:20.299+0000 7f7c381ff700 1 -- 172.21.15.46:0/703407842 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f7c1c0a1480 msgr2=0x7f7c1c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:20.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:20.299+0000 7f7c381ff700 1 --2- 172.21.15.46:0/703407842 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f7c1c0a1480 0x7f7c1c0a3940 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7c20000c00 tx=0x7f7c20019040 comp rx=0 tx=0).stop 2023-10-19T12:41:20.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:20.299+0000 7f7c381ff700 1 -- 172.21.15.46:0/703407842 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7c301007a0 msgr2=0x7f7c301988f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:20.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:20.299+0000 7f7c381ff700 1 --2- 172.21.15.46:0/703407842 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7c301007a0 0x7f7c301988f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c00e970 tx=0x7f7c2c00ec80 comp rx=0 tx=0).stop 2023-10-19T12:41:20.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:20.299+0000 7f7c381ff700 1 -- 172.21.15.46:0/703407842 shutdown_connections 2023-10-19T12:41:20.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:20.299+0000 7f7c381ff700 1 --2- 172.21.15.46:0/703407842 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f7c1c0a1480 0x7f7c1c0a3940 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:20.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:20.299+0000 7f7c381ff700 1 --2- 172.21.15.46:0/703407842 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7c30102330 0x7f7c3019fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:20.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:20.299+0000 7f7c381ff700 1 --2- 172.21.15.46:0/703407842 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7c301007a0 0x7f7c301988f0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:20.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:20.299+0000 7f7c381ff700 1 --2- 172.21.15.46:0/703407842 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7c30101990 0x7f7c30198e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:20.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:20.299+0000 7f7c381ff700 1 -- 172.21.15.46:0/703407842 >> 172.21.15.46:0/703407842 conn(0x7f7c300fbcf0 msgr2=0x7f7c30072a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:20.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:20.300+0000 7f7c381ff700 1 -- 172.21.15.46:0/703407842 shutdown_connections 2023-10-19T12:41:20.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:20.300+0000 7f7c381ff700 1 -- 172.21.15.46:0/703407842 wait complete. 2023-10-19T12:41:20.331 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-10-19T12:41:20.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:20.549+0000 7efc549ff700 1 -- 172.21.15.46:0/2099456428 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efc501085a0 msgr2=0x7efc5010aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:20.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:20.549+0000 7efc549ff700 1 --2- 172.21.15.46:0/2099456428 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efc501085a0 0x7efc5010aa10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7efc48009f90 tx=0x7efc4800b330 comp rx=0 tx=0).stop 2023-10-19T12:41:20.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:20.549+0000 7efc549ff700 1 -- 172.21.15.46:0/2099456428 shutdown_connections 2023-10-19T12:41:20.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:20.549+0000 7efc549ff700 1 --2- 172.21.15.46:0/2099456428 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efc501085a0 0x7efc5010aa10 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:20.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:20.549+0000 7efc549ff700 1 --2- 172.21.15.46:0/2099456428 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efc500747d0 0x7efc50072c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:20.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:20.549+0000 7efc549ff700 1 --2- 172.21.15.46:0/2099456428 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc500731f0 0x7efc50073670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:20.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:20.549+0000 7efc549ff700 1 -- 172.21.15.46:0/2099456428 >> 172.21.15.46:0/2099456428 conn(0x7efc500fbc60 msgr2=0x7efc500fe080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:20.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:20.549+0000 7efc549ff700 1 -- 172.21.15.46:0/2099456428 shutdown_connections 2023-10-19T12:41:20.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:20.549+0000 7efc549ff700 1 -- 172.21.15.46:0/2099456428 wait complete. 2023-10-19T12:41:20.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:20.550+0000 7efc549ff700 1 Processor -- start 2023-10-19T12:41:20.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:20.551+0000 7efc549ff700 1 -- start start 2023-10-19T12:41:20.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:20.551+0000 7efc549ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efc500731f0 0x7efc501988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:20.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:20.551+0000 7efc549ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efc500747d0 0x7efc50198df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:20.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:20.551+0000 7efc549ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc501085a0 0x7efc5019fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:20.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:20.551+0000 7efc549ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc501a03e0 con 0x7efc501085a0 2023-10-19T12:41:20.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:20.551+0000 7efc549ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc501a0520 con 0x7efc500731f0 2023-10-19T12:41:20.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:20.551+0000 7efc549ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc501a06b0 con 0x7efc500747d0 2023-10-19T12:41:20.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:20.551+0000 7efc4e59c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efc500731f0 0x7efc501988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:20.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:20.551+0000 7efc4dd9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efc500747d0 0x7efc50198df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:20.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:20.551+0000 7efc4ed9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc501085a0 0x7efc5019fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:20.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:20.551+0000 7efc4e59c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efc500731f0 0x7efc501988b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:51348/0 (socket says 172.21.15.46:51348) 2023-10-19T12:41:20.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:20.551+0000 7efc4dd9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efc500747d0 0x7efc50198df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:56584/0 (socket says 172.21.15.46:56584) 2023-10-19T12:41:20.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:20.551+0000 7efc4e59c700 1 -- 172.21.15.46:0/434141600 learned_addr learned my addr 172.21.15.46:0/434141600 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:41:20.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:20.552+0000 7efc4ed9d700 1 -- 172.21.15.46:0/434141600 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efc500747d0 msgr2=0x7efc50198df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:20.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:20.552+0000 7efc4ed9d700 1 --2- 172.21.15.46:0/434141600 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efc500747d0 0x7efc50198df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:20.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:20.552+0000 7efc4ed9d700 1 -- 172.21.15.46:0/434141600 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efc500731f0 msgr2=0x7efc501988b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:20.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:20.552+0000 7efc4ed9d700 1 --2- 172.21.15.46:0/434141600 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efc500731f0 0x7efc501988b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:20.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:20.552+0000 7efc4ed9d700 1 -- 172.21.15.46:0/434141600 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc48009c40 con 0x7efc501085a0 2023-10-19T12:41:20.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:20.552+0000 7efc4ed9d700 1 --2- 172.21.15.46:0/434141600 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc501085a0 0x7efc5019fe10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7efc4800b6c0 tx=0x7efc48004a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:20.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:20.552+0000 7efc3f7fe700 1 -- 172.21.15.46:0/434141600 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc4800e040 con 0x7efc501085a0 2023-10-19T12:41:20.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:20.552+0000 7efc549ff700 1 -- 172.21.15.46:0/434141600 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc501a0930 con 0x7efc501085a0 2023-10-19T12:41:20.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:20.552+0000 7efc3f7fe700 1 -- 172.21.15.46:0/434141600 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efc48004e30 con 0x7efc501085a0 2023-10-19T12:41:20.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:20.552+0000 7efc3f7fe700 1 -- 172.21.15.46:0/434141600 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc480052a0 con 0x7efc501085a0 2023-10-19T12:41:20.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:20.552+0000 7efc549ff700 1 -- 172.21.15.46:0/434141600 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc501a0db0 con 0x7efc501085a0 2023-10-19T12:41:20.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:20.554+0000 7efc549ff700 1 -- 172.21.15.46:0/434141600 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc501073b0 con 0x7efc501085a0 2023-10-19T12:41:20.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:20.557+0000 7efc3f7fe700 1 -- 172.21.15.46:0/434141600 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7efc4801d470 con 0x7efc501085a0 2023-10-19T12:41:20.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:20.558+0000 7efc3f7fe700 1 --2- 172.21.15.46:0/434141600 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7efc380a14f0 0x7efc380a39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:20.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:20.559+0000 7efc3f7fe700 1 -- 172.21.15.46:0/434141600 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8205+0+0 (secure 0 0 0) 0x7efc480cea00 con 0x7efc501085a0 2023-10-19T12:41:20.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:20.559+0000 7efc4e59c700 1 --2- 172.21.15.46:0/434141600 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7efc380a14f0 0x7efc380a39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:20.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:20.559+0000 7efc4e59c700 1 --2- 172.21.15.46:0/434141600 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7efc380a14f0 0x7efc380a39b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7efc40005950 tx=0x7efc40009310 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:20.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:20.561+0000 7efc3f7fe700 1 -- 172.21.15.46:0/434141600 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7efc480980b0 con 0x7efc501085a0 2023-10-19T12:41:20.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:20 smithi157 ceph-mon[134109]: Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-19T12:41:20.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:20 smithi157 ceph-mon[134109]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-10-19T12:41:20.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:20 smithi157 ceph-mon[134109]: osdmap e83: 12 total, 12 up, 12 in 2023-10-19T12:41:20.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:20 smithi157 ceph-mon[134109]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2023-10-19T12:41:20.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:20 smithi157 ceph-mon[134109]: daemon mds.b is now active in filesystem cephfs as rank 0 2023-10-19T12:41:20.589 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:20 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/703407842' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2023-10-19T12:41:20.589 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:20 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:20.589 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:20 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:20.589 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:20 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:20.589 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:20 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:20.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:20 smithi195 ceph-mon[134493]: Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-19T12:41:20.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:20 smithi195 ceph-mon[134493]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-10-19T12:41:20.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:20 smithi195 ceph-mon[134493]: osdmap e83: 12 total, 12 up, 12 in 2023-10-19T12:41:20.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:20 smithi195 ceph-mon[134493]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2023-10-19T12:41:20.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:20 smithi195 ceph-mon[134493]: daemon mds.b is now active in filesystem cephfs as rank 0 2023-10-19T12:41:20.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:20 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/703407842' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2023-10-19T12:41:20.632 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:20 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:20.632 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:20 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:20.632 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:20 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:20.633 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:20 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:20.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:20 smithi046 ceph-mon[98509]: Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-19T12:41:20.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:20 smithi046 ceph-mon[98509]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-10-19T12:41:20.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:20 smithi046 ceph-mon[98509]: osdmap e83: 12 total, 12 up, 12 in 2023-10-19T12:41:20.730 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:20 smithi046 ceph-mon[98509]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2023-10-19T12:41:20.730 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:20 smithi046 ceph-mon[98509]: daemon mds.b is now active in filesystem cephfs as rank 0 2023-10-19T12:41:20.730 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:20 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/703407842' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2023-10-19T12:41:20.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:20 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:20.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:20 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:20.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:20 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:20.732 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:20 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:20.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:20.782+0000 7efc549ff700 1 -- 172.21.15.46:0/434141600 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7efc5010e0b0 con 0x7efc501085a0 2023-10-19T12:41:21.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:21 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/703407842' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2023-10-19T12:41:21.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:21 smithi157 ceph-mon[134109]: osdmap e84: 12 total, 12 up, 12 in 2023-10-19T12:41:21.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:21 smithi157 ceph-mon[134109]: mds.? [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] up:active 2023-10-19T12:41:21.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:21 smithi157 ceph-mon[134109]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-19T12:41:21.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:21 smithi157 ceph-mon[134109]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-19T12:41:21.589 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:21 smithi157 ceph-mon[134109]: pgmap v281: 97 pgs: 16 creating+peering, 52 unknown, 29 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 5 op/s 2023-10-19T12:41:21.589 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:21 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/434141600' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-10-19T12:41:21.589 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:21 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:21.589 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:21 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:21.589 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:21 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:41:21.590 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:21 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:41:21.590 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:21 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:21.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:21 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/703407842' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2023-10-19T12:41:21.632 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:21 smithi195 ceph-mon[134493]: osdmap e84: 12 total, 12 up, 12 in 2023-10-19T12:41:21.632 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:21 smithi195 ceph-mon[134493]: mds.? [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] up:active 2023-10-19T12:41:21.632 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:21 smithi195 ceph-mon[134493]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-19T12:41:21.632 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:21 smithi195 ceph-mon[134493]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-19T12:41:21.633 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:21 smithi195 ceph-mon[134493]: pgmap v281: 97 pgs: 16 creating+peering, 52 unknown, 29 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 5 op/s 2023-10-19T12:41:21.633 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:21 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/434141600' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-10-19T12:41:21.633 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:21 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:21.634 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:21 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:21.634 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:21 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:41:21.634 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:21 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:41:21.635 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:21 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:21.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:21 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/703407842' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2023-10-19T12:41:21.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:21 smithi046 ceph-mon[98509]: osdmap e84: 12 total, 12 up, 12 in 2023-10-19T12:41:21.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:21 smithi046 ceph-mon[98509]: mds.? [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] up:active 2023-10-19T12:41:21.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:21 smithi046 ceph-mon[98509]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-19T12:41:21.730 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:21 smithi046 ceph-mon[98509]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-19T12:41:21.730 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:21 smithi046 ceph-mon[98509]: pgmap v281: 97 pgs: 16 creating+peering, 52 unknown, 29 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 5 op/s 2023-10-19T12:41:21.730 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:21 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/434141600' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-10-19T12:41:21.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:21 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:21.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:21 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:21.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:21 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:41:21.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:21 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:41:21.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:21 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:41:22.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:22.304+0000 7efc3f7fe700 1 -- 172.21.15.46:0/434141600 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v86) v1 ==== 228+0+0 (secure 0 0 0) 0x7efc4809b6d0 con 0x7efc501085a0 2023-10-19T12:41:22.311 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:22.308+0000 7efc549ff700 1 -- 172.21.15.46:0/434141600 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7efc380a14f0 msgr2=0x7efc380a39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:22.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:22.308+0000 7efc549ff700 1 --2- 172.21.15.46:0/434141600 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7efc380a14f0 0x7efc380a39b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7efc40005950 tx=0x7efc40009310 comp rx=0 tx=0).stop 2023-10-19T12:41:22.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:22.308+0000 7efc549ff700 1 -- 172.21.15.46:0/434141600 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc501085a0 msgr2=0x7efc5019fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:22.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:22.308+0000 7efc549ff700 1 --2- 172.21.15.46:0/434141600 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc501085a0 0x7efc5019fe10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7efc4800b6c0 tx=0x7efc48004a30 comp rx=0 tx=0).stop 2023-10-19T12:41:22.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:22.309+0000 7efc549ff700 1 -- 172.21.15.46:0/434141600 shutdown_connections 2023-10-19T12:41:22.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:22.309+0000 7efc549ff700 1 --2- 172.21.15.46:0/434141600 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc501085a0 0x7efc5019fe10 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:22.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:22.309+0000 7efc549ff700 1 --2- 172.21.15.46:0/434141600 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efc500731f0 0x7efc501988b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:22.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:22.309+0000 7efc549ff700 1 --2- 172.21.15.46:0/434141600 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7efc380a14f0 0x7efc380a39b0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:22.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:22.309+0000 7efc549ff700 1 --2- 172.21.15.46:0/434141600 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efc500747d0 0x7efc50198df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:22.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:22.309+0000 7efc549ff700 1 -- 172.21.15.46:0/434141600 >> 172.21.15.46:0/434141600 conn(0x7efc500fbc60 msgr2=0x7efc501044f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:22.314 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:22.310+0000 7efc549ff700 1 -- 172.21.15.46:0/434141600 shutdown_connections 2023-10-19T12:41:22.314 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:22.311+0000 7efc549ff700 1 -- 172.21.15.46:0/434141600 wait complete. 2023-10-19T12:41:22.317 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_data_ec' created 2023-10-19T12:41:22.339 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-10-19T12:41:22.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:22.544+0000 7fb00ffff700 1 -- 172.21.15.46:0/1874977014 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb008102330 msgr2=0x7fb008108be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:22.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:22.544+0000 7fb00ffff700 1 --2- 172.21.15.46:0/1874977014 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb008102330 0x7fb008108be0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb00000b0d0 tx=0x7fb00000b3e0 comp rx=0 tx=0).stop 2023-10-19T12:41:22.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:22.545+0000 7fb00ffff700 1 -- 172.21.15.46:0/1874977014 shutdown_connections 2023-10-19T12:41:22.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:22.545+0000 7fb00ffff700 1 --2- 172.21.15.46:0/1874977014 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb008102330 0x7fb008108be0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:22.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:22.545+0000 7fb00ffff700 1 --2- 172.21.15.46:0/1874977014 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb0081007a0 0x7fb008100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:22.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:22.545+0000 7fb00ffff700 1 --2- 172.21.15.46:0/1874977014 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb008101990 0x7fb008101df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:22.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:22.545+0000 7fb00ffff700 1 -- 172.21.15.46:0/1874977014 >> 172.21.15.46:0/1874977014 conn(0x7fb0080fbcf0 msgr2=0x7fb0080fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:22.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:22.545+0000 7fb00ffff700 1 -- 172.21.15.46:0/1874977014 shutdown_connections 2023-10-19T12:41:22.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:22.545+0000 7fb00ffff700 1 -- 172.21.15.46:0/1874977014 wait complete. 2023-10-19T12:41:22.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:22.546+0000 7fb00ffff700 1 Processor -- start 2023-10-19T12:41:22.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:22.546+0000 7fb00ffff700 1 -- start start 2023-10-19T12:41:22.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:22.546+0000 7fb00ffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb0081007a0 0x7fb008198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:22.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:22.546+0000 7fb00ffff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb008101990 0x7fb008198f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:22.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:22.546+0000 7fb00ffff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb008102330 0x7fb00819ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:22.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:22.546+0000 7fb00ffff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0081a0570 con 0x7fb0081007a0 2023-10-19T12:41:22.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:22.546+0000 7fb00ffff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0081a06b0 con 0x7fb008101990 2023-10-19T12:41:22.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:22.546+0000 7fb00ffff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0081a0840 con 0x7fb008102330 2023-10-19T12:41:22.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:22.546+0000 7fb00dd9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb0081007a0 0x7fb008198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:22.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:22.546+0000 7fb00dd9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb0081007a0 0x7fb008198a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34292/0 (socket says 172.21.15.46:34292) 2023-10-19T12:41:22.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:22.546+0000 7fb00dd9b700 1 -- 172.21.15.46:0/2706990507 learned_addr learned my addr 172.21.15.46:0/2706990507 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:41:22.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:22.546+0000 7fb00d59a700 1 --2- 172.21.15.46:0/2706990507 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb008101990 0x7fb008198f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:22.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:22.547+0000 7fb00e59c700 1 --2- 172.21.15.46:0/2706990507 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb008102330 0x7fb00819ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:22.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:22.547+0000 7fb00dd9b700 1 -- 172.21.15.46:0/2706990507 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb008102330 msgr2=0x7fb00819ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:22.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:22.547+0000 7fb00dd9b700 1 --2- 172.21.15.46:0/2706990507 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb008102330 0x7fb00819ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:22.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:22.547+0000 7fb00dd9b700 1 -- 172.21.15.46:0/2706990507 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb008101990 msgr2=0x7fb008198f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:22.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:22.547+0000 7fb00dd9b700 1 --2- 172.21.15.46:0/2706990507 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb008101990 0x7fb008198f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:22.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:22.547+0000 7fb00dd9b700 1 -- 172.21.15.46:0/2706990507 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb000009d00 con 0x7fb0081007a0 2023-10-19T12:41:22.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:22.547+0000 7fb00e59c700 1 --2- 172.21.15.46:0/2706990507 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb008102330 0x7fb00819ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T12:41:22.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:22.547+0000 7fb00d59a700 1 --2- 172.21.15.46:0/2706990507 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb008101990 0x7fb008198f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:41:22.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:22.547+0000 7fb00dd9b700 1 --2- 172.21.15.46:0/2706990507 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb0081007a0 0x7fb008198a40 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb00400e970 tx=0x7fb00400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:22.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:22.547+0000 7faffeffd700 1 -- 172.21.15.46:0/2706990507 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb004009790 con 0x7fb0081007a0 2023-10-19T12:41:22.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:22.547+0000 7faffeffd700 1 -- 172.21.15.46:0/2706990507 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb00400eec0 con 0x7fb0081007a0 2023-10-19T12:41:22.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:22.547+0000 7fb00ffff700 1 -- 172.21.15.46:0/2706990507 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0081a0b20 con 0x7fb0081007a0 2023-10-19T12:41:22.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:22.547+0000 7faffeffd700 1 -- 172.21.15.46:0/2706990507 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb004003cf0 con 0x7fb0081007a0 2023-10-19T12:41:22.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:22.547+0000 7fb00ffff700 1 -- 172.21.15.46:0/2706990507 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0081a1030 con 0x7fb0081007a0 2023-10-19T12:41:22.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:22.548+0000 7fb00ffff700 1 -- 172.21.15.46:0/2706990507 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0080675a0 con 0x7fb0081007a0 2023-10-19T12:41:22.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:22.551+0000 7faffeffd700 1 -- 172.21.15.46:0/2706990507 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fb00400ccd0 con 0x7fb0081007a0 2023-10-19T12:41:22.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:22.552+0000 7faffeffd700 1 --2- 172.21.15.46:0/2706990507 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7faff40a1480 0x7faff40a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:22.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:22.552+0000 7faffeffd700 1 -- 172.21.15.46:0/2706990507 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8698+0+0 (secure 0 0 0) 0x7fb004014070 con 0x7fb0081007a0 2023-10-19T12:41:22.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:22.552+0000 7fb00d59a700 1 --2- 172.21.15.46:0/2706990507 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7faff40a1480 0x7faff40a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:22.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:22.553+0000 7fb00d59a700 1 --2- 172.21.15.46:0/2706990507 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7faff40a1480 0x7faff40a3940 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7faff8011490 tx=0x7faff8009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:22.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:22.555+0000 7faffeffd700 1 -- 172.21.15.46:0/2706990507 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb004096760 con 0x7fb0081007a0 2023-10-19T12:41:22.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:22 smithi157 ceph-mon[134109]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2023-10-19T12:41:22.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:22 smithi157 ceph-mon[134109]: Cluster is now healthy 2023-10-19T12:41:22.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:22 smithi157 ceph-mon[134109]: osdmap e85: 12 total, 12 up, 12 in 2023-10-19T12:41:22.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:22 smithi195 ceph-mon[134493]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2023-10-19T12:41:22.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:22 smithi195 ceph-mon[134493]: Cluster is now healthy 2023-10-19T12:41:22.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:22 smithi195 ceph-mon[134493]: osdmap e85: 12 total, 12 up, 12 in 2023-10-19T12:41:22.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:22 smithi046 ceph-mon[98509]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2023-10-19T12:41:22.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:22 smithi046 ceph-mon[98509]: Cluster is now healthy 2023-10-19T12:41:22.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:22 smithi046 ceph-mon[98509]: osdmap e85: 12 total, 12 up, 12 in 2023-10-19T12:41:22.768 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:22.765+0000 7fb00ffff700 1 -- 172.21.15.46:0/2706990507 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7fb00810c100 con 0x7fb0081007a0 2023-10-19T12:41:23.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:23.309+0000 7faffeffd700 1 -- 172.21.15.46:0/2706990507 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v87) v1 ==== 169+0+0 (secure 0 0 0) 0x7fb004099d80 con 0x7fb0081007a0 2023-10-19T12:41:23.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:23.313+0000 7fb00ffff700 1 -- 172.21.15.46:0/2706990507 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7faff40a1480 msgr2=0x7faff40a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:23.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:23.313+0000 7fb00ffff700 1 --2- 172.21.15.46:0/2706990507 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7faff40a1480 0x7faff40a3940 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7faff8011490 tx=0x7faff8009260 comp rx=0 tx=0).stop 2023-10-19T12:41:23.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:23.313+0000 7fb00ffff700 1 -- 172.21.15.46:0/2706990507 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb0081007a0 msgr2=0x7fb008198a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:23.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:23.313+0000 7fb00ffff700 1 --2- 172.21.15.46:0/2706990507 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb0081007a0 0x7fb008198a40 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb00400e970 tx=0x7fb00400ec80 comp rx=0 tx=0).stop 2023-10-19T12:41:23.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:23.313+0000 7fb00ffff700 1 -- 172.21.15.46:0/2706990507 shutdown_connections 2023-10-19T12:41:23.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:23.313+0000 7fb00ffff700 1 --2- 172.21.15.46:0/2706990507 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7faff40a1480 0x7faff40a3940 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:23.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:23.313+0000 7fb00ffff700 1 --2- 172.21.15.46:0/2706990507 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb008102330 0x7fb00819ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:23.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:23.313+0000 7fb00ffff700 1 --2- 172.21.15.46:0/2706990507 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb0081007a0 0x7fb008198a40 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:23.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:23.313+0000 7fb00ffff700 1 --2- 172.21.15.46:0/2706990507 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb008101990 0x7fb008198f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:23.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:23.313+0000 7fb00ffff700 1 -- 172.21.15.46:0/2706990507 >> 172.21.15.46:0/2706990507 conn(0x7fb0080fbcf0 msgr2=0x7fb008072a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:23.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:23.313+0000 7fb00ffff700 1 -- 172.21.15.46:0/2706990507 shutdown_connections 2023-10-19T12:41:23.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:23.314+0000 7fb00ffff700 1 -- 172.21.15.46:0/2706990507 wait complete. 2023-10-19T12:41:23.321 INFO:teuthology.orchestra.run.smithi046.stderr:set pool 4 allow_ec_overwrites to true 2023-10-19T12:41:23.351 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-10-19T12:41:23.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:23.558+0000 7fea5dbff700 1 -- 172.21.15.46:0/2478307917 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea581007a0 msgr2=0x7fea58100bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:23.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:23.558+0000 7fea5dbff700 1 --2- 172.21.15.46:0/2478307917 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea581007a0 0x7fea58100bc0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fea480099c0 tx=0x7fea48009cd0 comp rx=0 tx=0).stop 2023-10-19T12:41:23.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:23.559+0000 7fea5dbff700 1 -- 172.21.15.46:0/2478307917 shutdown_connections 2023-10-19T12:41:23.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:23.559+0000 7fea5dbff700 1 --2- 172.21.15.46:0/2478307917 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fea58102330 0x7fea58108be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:23.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:23.559+0000 7fea5dbff700 1 --2- 172.21.15.46:0/2478307917 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea581007a0 0x7fea58100bc0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:23.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:23.559+0000 7fea5dbff700 1 --2- 172.21.15.46:0/2478307917 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fea58101990 0x7fea58101df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:23.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:23.559+0000 7fea5dbff700 1 -- 172.21.15.46:0/2478307917 >> 172.21.15.46:0/2478307917 conn(0x7fea580fbcf0 msgr2=0x7fea580fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:23.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:23.559+0000 7fea5dbff700 1 -- 172.21.15.46:0/2478307917 shutdown_connections 2023-10-19T12:41:23.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:23.559+0000 7fea5dbff700 1 -- 172.21.15.46:0/2478307917 wait complete. 2023-10-19T12:41:23.566 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:23.560+0000 7fea5dbff700 1 Processor -- start 2023-10-19T12:41:23.566 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:23.560+0000 7fea5dbff700 1 -- start start 2023-10-19T12:41:23.566 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:23.560+0000 7fea5dbff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fea581007a0 0x7fea58196750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:23.566 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:23.560+0000 7fea5dbff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fea58101990 0x7fea58196c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:23.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:23.560+0000 7fea5dbff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea58102330 0x7fea5819dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:23.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:23.560+0000 7fea5dbff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea5819e280 con 0x7fea58102330 2023-10-19T12:41:23.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:23.560+0000 7fea5dbff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea5819e3c0 con 0x7fea581007a0 2023-10-19T12:41:23.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:23.560+0000 7fea5dbff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea5819e550 con 0x7fea58101990 2023-10-19T12:41:23.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:23.560+0000 7fea57fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea58102330 0x7fea5819dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:23.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:23.560+0000 7fea577fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fea581007a0 0x7fea58196750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:23.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:23.561+0000 7fea57fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea58102330 0x7fea5819dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40948/0 (socket says 172.21.15.46:40948) 2023-10-19T12:41:23.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:23.561+0000 7fea57fff700 1 -- 172.21.15.46:0/3938591122 learned_addr learned my addr 172.21.15.46:0/3938591122 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:41:23.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:23.561+0000 7fea56ffd700 1 --2- 172.21.15.46:0/3938591122 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fea58101990 0x7fea58196c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:23.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:23.561+0000 7fea57fff700 1 -- 172.21.15.46:0/3938591122 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fea58101990 msgr2=0x7fea58196c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:23.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:23.561+0000 7fea57fff700 1 --2- 172.21.15.46:0/3938591122 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fea58101990 0x7fea58196c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:23.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:23.561+0000 7fea57fff700 1 -- 172.21.15.46:0/3938591122 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fea581007a0 msgr2=0x7fea58196750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:23.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:23.561+0000 7fea57fff700 1 --2- 172.21.15.46:0/3938591122 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fea581007a0 0x7fea58196750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:23.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:23.561+0000 7fea57fff700 1 -- 172.21.15.46:0/3938591122 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea480095f0 con 0x7fea58102330 2023-10-19T12:41:23.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:23.561+0000 7fea577fe700 1 --2- 172.21.15.46:0/3938591122 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fea581007a0 0x7fea58196750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:41:23.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:23.561+0000 7fea57fff700 1 --2- 172.21.15.46:0/3938591122 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea58102330 0x7fea5819dcb0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fea50007ee0 tx=0x7fea5000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:23.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:23.561+0000 7fea54ff9700 1 -- 172.21.15.46:0/3938591122 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea50017070 con 0x7fea58102330 2023-10-19T12:41:23.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:23.561+0000 7fea54ff9700 1 -- 172.21.15.46:0/3938591122 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fea5000f040 con 0x7fea58102330 2023-10-19T12:41:23.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:23.561+0000 7fea5dbff700 1 -- 172.21.15.46:0/3938591122 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea5819e830 con 0x7fea58102330 2023-10-19T12:41:23.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:23.561+0000 7fea54ff9700 1 -- 172.21.15.46:0/3938591122 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea50005580 con 0x7fea58102330 2023-10-19T12:41:23.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:23.562+0000 7fea5dbff700 1 -- 172.21.15.46:0/3938591122 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea5819ed40 con 0x7fea58102330 2023-10-19T12:41:23.571 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:23.562+0000 7fea5dbff700 1 -- 172.21.15.46:0/3938591122 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea58107bc0 con 0x7fea58102330 2023-10-19T12:41:23.571 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:23.564+0000 7fea54ff9700 1 -- 172.21.15.46:0/3938591122 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fea5000db20 con 0x7fea58102330 2023-10-19T12:41:23.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:23.566+0000 7fea54ff9700 1 --2- 172.21.15.46:0/3938591122 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fea400a1500 0x7fea400a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:23.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:23.566+0000 7fea54ff9700 1 -- 172.21.15.46:0/3938591122 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8698+0+0 (secure 0 0 0) 0x7fea500cc5a0 con 0x7fea58102330 2023-10-19T12:41:23.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:23.566+0000 7fea577fe700 1 --2- 172.21.15.46:0/3938591122 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fea400a1500 0x7fea400a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:23.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:23.567+0000 7fea577fe700 1 --2- 172.21.15.46:0/3938591122 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fea400a1500 0x7fea400a39c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fea48006010 tx=0x7fea4800b540 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:23.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:23.570+0000 7fea54ff9700 1 -- 172.21.15.46:0/3938591122 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fea500959d0 con 0x7fea58102330 2023-10-19T12:41:23.587 INFO:journalctl@ceph.mds.b.smithi157.stdout:Oct 19 12:41:23 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mds-b[170841]: 2023-10-19T12:41:23.175+0000 7f63d3baa700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-19T12:41:23.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:23 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/434141600' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-10-19T12:41:23.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:23 smithi157 ceph-mon[134109]: osdmap e86: 12 total, 12 up, 12 in 2023-10-19T12:41:23.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:23 smithi157 ceph-mon[134109]: pgmap v284: 129 pgs: 13 creating+peering, 40 unknown, 76 active+clean; 578 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s wr, 9 op/s 2023-10-19T12:41:23.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:23 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/2706990507' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2023-10-19T12:41:23.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:23 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/434141600' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-10-19T12:41:23.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:23 smithi195 ceph-mon[134493]: osdmap e86: 12 total, 12 up, 12 in 2023-10-19T12:41:23.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:23 smithi195 ceph-mon[134493]: pgmap v284: 129 pgs: 13 creating+peering, 40 unknown, 76 active+clean; 578 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s wr, 9 op/s 2023-10-19T12:41:23.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:23 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/2706990507' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2023-10-19T12:41:23.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:23 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/434141600' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-10-19T12:41:23.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:23 smithi046 ceph-mon[98509]: osdmap e86: 12 total, 12 up, 12 in 2023-10-19T12:41:23.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:23 smithi046 ceph-mon[98509]: pgmap v284: 129 pgs: 13 creating+peering, 40 unknown, 76 active+clean; 578 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s wr, 9 op/s 2023-10-19T12:41:23.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:23 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/2706990507' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2023-10-19T12:41:23.833 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:23.830+0000 7fea5dbff700 1 -- 172.21.15.46:0/3938591122 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7fea580675a0 con 0x7fea58102330 2023-10-19T12:41:24.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:24.316+0000 7fea54ff9700 1 -- 172.21.15.46:0/3938591122 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v17) v1 ==== 137+0+0 (secure 0 0 0) 0x7fea50098ff0 con 0x7fea58102330 2023-10-19T12:41:24.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:24.319+0000 7fea5dbff700 1 -- 172.21.15.46:0/3938591122 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fea400a1500 msgr2=0x7fea400a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:24.323 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:24.319+0000 7fea5dbff700 1 --2- 172.21.15.46:0/3938591122 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fea400a1500 0x7fea400a39c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fea48006010 tx=0x7fea4800b540 comp rx=0 tx=0).stop 2023-10-19T12:41:24.323 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:24.319+0000 7fea5dbff700 1 -- 172.21.15.46:0/3938591122 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea58102330 msgr2=0x7fea5819dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:24.323 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:24.319+0000 7fea5dbff700 1 --2- 172.21.15.46:0/3938591122 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea58102330 0x7fea5819dcb0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fea50007ee0 tx=0x7fea5000d3b0 comp rx=0 tx=0).stop 2023-10-19T12:41:24.323 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:24.319+0000 7fea5dbff700 1 -- 172.21.15.46:0/3938591122 shutdown_connections 2023-10-19T12:41:24.324 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:24.319+0000 7fea5dbff700 1 --2- 172.21.15.46:0/3938591122 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea58102330 0x7fea5819dcb0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:24.324 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:24.319+0000 7fea5dbff700 1 --2- 172.21.15.46:0/3938591122 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fea581007a0 0x7fea58196750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:24.324 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:24.319+0000 7fea5dbff700 1 --2- 172.21.15.46:0/3938591122 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fea400a1500 0x7fea400a39c0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:24.324 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:24.319+0000 7fea5dbff700 1 --2- 172.21.15.46:0/3938591122 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fea58101990 0x7fea58196c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:24.324 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:24.319+0000 7fea5dbff700 1 -- 172.21.15.46:0/3938591122 >> 172.21.15.46:0/3938591122 conn(0x7fea580fbcf0 msgr2=0x7fea58104d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:24.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:24.319+0000 7fea5dbff700 1 -- 172.21.15.46:0/3938591122 shutdown_connections 2023-10-19T12:41:24.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:24.319+0000 7fea5dbff700 1 -- 172.21.15.46:0/3938591122 wait complete. 2023-10-19T12:41:24.325 INFO:teuthology.orchestra.run.smithi046.stderr:added data pool 4 to fsmap 2023-10-19T12:41:24.344 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-19T12:41:24.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:24.548+0000 7f8d5c1ff700 1 -- 172.21.15.46:0/2134440204 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d54100740 msgr2=0x7f8d54100b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:24.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:24.548+0000 7f8d5c1ff700 1 --2- 172.21.15.46:0/2134440204 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d54100740 0x7f8d54100b60 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8d500099c0 tx=0x7f8d50009cd0 comp rx=0 tx=0).stop 2023-10-19T12:41:24.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:24.548+0000 7f8d5c1ff700 1 -- 172.21.15.46:0/2134440204 shutdown_connections 2023-10-19T12:41:24.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:24.548+0000 7f8d5c1ff700 1 --2- 172.21.15.46:0/2134440204 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8d541022d0 0x7f8d54108b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:24.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:24.548+0000 7f8d5c1ff700 1 --2- 172.21.15.46:0/2134440204 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d54100740 0x7f8d54100b60 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:24.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:24.548+0000 7f8d5c1ff700 1 --2- 172.21.15.46:0/2134440204 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8d54101930 0x7f8d54101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:24.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:24.548+0000 7f8d5c1ff700 1 -- 172.21.15.46:0/2134440204 >> 172.21.15.46:0/2134440204 conn(0x7f8d540fbc90 msgr2=0x7f8d540fe0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:24.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:24.548+0000 7f8d5c1ff700 1 -- 172.21.15.46:0/2134440204 shutdown_connections 2023-10-19T12:41:24.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:24.548+0000 7f8d5c1ff700 1 -- 172.21.15.46:0/2134440204 wait complete. 2023-10-19T12:41:24.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:24.549+0000 7f8d5c1ff700 1 Processor -- start 2023-10-19T12:41:24.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:24.549+0000 7f8d5c1ff700 1 -- start start 2023-10-19T12:41:24.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:24.549+0000 7f8d5c1ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8d54100740 0x7f8d541988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:24.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:24.550+0000 7f8d5c1ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d54101930 0x7f8d54198e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:24.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:24.550+0000 7f8d5c1ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8d541022d0 0x7f8d5419fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:24.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:24.550+0000 7f8d5c1ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d541a0400 con 0x7f8d54101930 2023-10-19T12:41:24.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:24.550+0000 7f8d5c1ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d541a0540 con 0x7f8d541022d0 2023-10-19T12:41:24.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:24.550+0000 7f8d5c1ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d541a06d0 con 0x7f8d54100740 2023-10-19T12:41:24.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:24.550+0000 7f8d5979a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d54101930 0x7f8d54198e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:24.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:24.550+0000 7f8d5979a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d54101930 0x7f8d54198e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40972/0 (socket says 172.21.15.46:40972) 2023-10-19T12:41:24.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:24.550+0000 7f8d5979a700 1 -- 172.21.15.46:0/3683734653 learned_addr learned my addr 172.21.15.46:0/3683734653 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:41:24.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:24.550+0000 7f8d59f9b700 1 --2- 172.21.15.46:0/3683734653 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8d54100740 0x7f8d541988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:24.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:24.550+0000 7f8d5a79c700 1 --2- 172.21.15.46:0/3683734653 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8d541022d0 0x7f8d5419fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:24.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:24.550+0000 7f8d5979a700 1 -- 172.21.15.46:0/3683734653 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8d54100740 msgr2=0x7f8d541988d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:24.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:24.550+0000 7f8d5979a700 1 --2- 172.21.15.46:0/3683734653 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8d54100740 0x7f8d541988d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:24.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:24.550+0000 7f8d5979a700 1 -- 172.21.15.46:0/3683734653 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8d541022d0 msgr2=0x7f8d5419fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:24.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:24.550+0000 7f8d5979a700 1 --2- 172.21.15.46:0/3683734653 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8d541022d0 0x7f8d5419fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:24.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:24.550+0000 7f8d5979a700 1 -- 172.21.15.46:0/3683734653 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d500095f0 con 0x7f8d54101930 2023-10-19T12:41:24.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:24.550+0000 7f8d5a79c700 1 --2- 172.21.15.46:0/3683734653 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8d541022d0 0x7f8d5419fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T12:41:24.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:24.551+0000 7f8d5979a700 1 --2- 172.21.15.46:0/3683734653 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d54101930 0x7f8d54198e10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8d4400e9a0 tx=0x7f8d4400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:24.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:24.551+0000 7f8d4affd700 1 -- 172.21.15.46:0/3683734653 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d44009790 con 0x7f8d54101930 2023-10-19T12:41:24.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:24.551+0000 7f8d4affd700 1 -- 172.21.15.46:0/3683734653 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8d4400cbd0 con 0x7f8d54101930 2023-10-19T12:41:24.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:24.551+0000 7f8d5c1ff700 1 -- 172.21.15.46:0/3683734653 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d541a09b0 con 0x7f8d54101930 2023-10-19T12:41:24.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:24.551+0000 7f8d4affd700 1 -- 172.21.15.46:0/3683734653 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d44018680 con 0x7f8d54101930 2023-10-19T12:41:24.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:24.551+0000 7f8d5c1ff700 1 -- 172.21.15.46:0/3683734653 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d541a0f10 con 0x7f8d54101930 2023-10-19T12:41:24.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:24.552+0000 7f8d5c1ff700 1 -- 172.21.15.46:0/3683734653 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d54067530 con 0x7f8d54101930 2023-10-19T12:41:24.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:24.554+0000 7f8d4affd700 1 -- 172.21.15.46:0/3683734653 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f8d4400cd40 con 0x7f8d54101930 2023-10-19T12:41:24.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:24.555+0000 7f8d4affd700 1 --2- 172.21.15.46:0/3683734653 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f8d400a1500 0x7f8d400a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:24.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:24.555+0000 7f8d4affd700 1 -- 172.21.15.46:0/3683734653 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f8d44014070 con 0x7f8d54101930 2023-10-19T12:41:24.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:24.555+0000 7f8d59f9b700 1 --2- 172.21.15.46:0/3683734653 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f8d400a1500 0x7f8d400a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:24.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:24.556+0000 7f8d59f9b700 1 --2- 172.21.15.46:0/3683734653 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f8d400a1500 0x7f8d400a39c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8d50009990 tx=0x7f8d50000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:24.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:24.559+0000 7f8d4affd700 1 -- 172.21.15.46:0/3683734653 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f8d44052100 con 0x7f8d54101930 2023-10-19T12:41:24.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:24 smithi157 ceph-mon[134109]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-19T12:41:24.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:24 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/2706990507' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2023-10-19T12:41:24.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:24 smithi157 ceph-mon[134109]: osdmap e87: 12 total, 12 up, 12 in 2023-10-19T12:41:24.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:24 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/3938591122' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2023-10-19T12:41:24.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:24 smithi195 ceph-mon[134493]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-19T12:41:24.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:24 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/2706990507' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2023-10-19T12:41:24.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:24 smithi195 ceph-mon[134493]: osdmap e87: 12 total, 12 up, 12 in 2023-10-19T12:41:24.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:24 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/3938591122' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2023-10-19T12:41:24.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:24 smithi046 ceph-mon[98509]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-19T12:41:24.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:24 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/2706990507' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2023-10-19T12:41:24.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:24 smithi046 ceph-mon[98509]: osdmap e87: 12 total, 12 up, 12 in 2023-10-19T12:41:24.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:24 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/3938591122' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2023-10-19T12:41:24.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:24.819+0000 7f8d5c1ff700 1 -- 172.21.15.46:0/3683734653 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8d5410bfb0 con 0x7f8d54101930 2023-10-19T12:41:24.823 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:24.820+0000 7f8d4affd700 1 -- 172.21.15.46:0/3683734653 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+11261 (secure 0 0 0) 0x7f8d44096530 con 0x7f8d54101930 2023-10-19T12:41:24.823 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:41:24.824 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14580,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/2235286008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":2235286008},{"type":"v1","addr":"172.21.15.46:6835","nonce":2235286008}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14592,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/339398444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":339398444},{"type":"v1","addr":"172.21.15.46:6837","nonce":339398444}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14640,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6839/1655843965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":1655843965},{"type":"v1","addr":"172.21.15.46:6839","nonce":1655843965}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14652,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6841/4204925553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6840","nonce":4204925553},{"type":"v1","addr":"172.21.15.46:6841","nonce":4204925553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24560,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/1687745569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":1687745569},{"type":"v1","addr":"172.21.15.157:6833","nonce":1687745569}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24574,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6833/3629933235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3629933235},{"type":"v1","addr":"172.21.15.195:6833","nonce":3629933235}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24602,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/108432552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":108432552},{"type":"v1","addr":"172.21.15.157:6835","nonce":108432552}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24629,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6837/2629536514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6836","nonce":2629536514},{"type":"v1","addr":"172.21.15.157:6837","nonce":2629536514}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24631,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/1406909915","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":1406909915},{"type":"v1","addr":"172.21.15.195:6835","nonce":1406909915}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24643,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6837/293916188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":293916188},{"type":"v1","addr":"172.21.15.195:6837","nonce":293916188}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24655,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6839/4094901934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6838","nonce":4094901934},{"type":"v1","addr":"172.21.15.195:6839","nonce":4094901934}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-19T12:41:18.815780+0000","modified":"2023-10-19T12:41:23.832102+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":24680},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24680":{"gid":24680,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.157:6839/552718978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6838","nonce":552718978},{"type":"v1","addr":"172.21.15.157:6839","nonce":552718978}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-10-19T12:41:24.826 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:24.822+0000 7f8d5c1ff700 1 -- 172.21.15.46:0/3683734653 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f8d400a1500 msgr2=0x7f8d400a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:24.826 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:24.822+0000 7f8d5c1ff700 1 --2- 172.21.15.46:0/3683734653 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f8d400a1500 0x7f8d400a39c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8d50009990 tx=0x7f8d50000bc0 comp rx=0 tx=0).stop 2023-10-19T12:41:24.826 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:24.822+0000 7f8d5c1ff700 1 -- 172.21.15.46:0/3683734653 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d54101930 msgr2=0x7f8d54198e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:24.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:24.822+0000 7f8d5c1ff700 1 --2- 172.21.15.46:0/3683734653 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d54101930 0x7f8d54198e10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8d4400e9a0 tx=0x7f8d4400ecb0 comp rx=0 tx=0).stop 2023-10-19T12:41:24.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:24.823+0000 7f8d5c1ff700 1 -- 172.21.15.46:0/3683734653 shutdown_connections 2023-10-19T12:41:24.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:24.823+0000 7f8d5c1ff700 1 --2- 172.21.15.46:0/3683734653 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8d541022d0 0x7f8d5419fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:24.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:24.823+0000 7f8d5c1ff700 1 --2- 172.21.15.46:0/3683734653 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f8d400a1500 0x7f8d400a39c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:24.828 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:24.823+0000 7f8d5c1ff700 1 --2- 172.21.15.46:0/3683734653 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8d54100740 0x7f8d541988d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:24.828 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:24.823+0000 7f8d5c1ff700 1 --2- 172.21.15.46:0/3683734653 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d54101930 0x7f8d54198e10 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:24.828 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:24.823+0000 7f8d5c1ff700 1 -- 172.21.15.46:0/3683734653 >> 172.21.15.46:0/3683734653 conn(0x7f8d540fbc90 msgr2=0x7f8d541070d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:24.828 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:24.823+0000 7f8d5c1ff700 1 -- 172.21.15.46:0/3683734653 shutdown_connections 2023-10-19T12:41:24.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:24.823+0000 7f8d5c1ff700 1 -- 172.21.15.46:0/3683734653 wait complete. 2023-10-19T12:41:24.829 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 17 2023-10-19T12:41:24.846 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-19T12:41:25.056 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.049+0000 7f20d8fff700 1 -- 172.21.15.46:0/2548650285 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f20d40747d0 msgr2=0x7f20d4072c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:25.056 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.049+0000 7f20d8fff700 1 --2- 172.21.15.46:0/2548650285 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f20d40747d0 0x7f20d4072c20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f20c4009990 tx=0x7f20c4009ca0 comp rx=0 tx=0).stop 2023-10-19T12:41:25.057 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.049+0000 7f20d8fff700 1 -- 172.21.15.46:0/2548650285 shutdown_connections 2023-10-19T12:41:25.057 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.049+0000 7f20d8fff700 1 --2- 172.21.15.46:0/2548650285 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20d4108610 0x7f20d410aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:25.057 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.049+0000 7f20d8fff700 1 --2- 172.21.15.46:0/2548650285 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f20d40747d0 0x7f20d4072c20 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:25.057 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.049+0000 7f20d8fff700 1 --2- 172.21.15.46:0/2548650285 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f20d40731f0 0x7f20d4073670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:25.058 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.049+0000 7f20d8fff700 1 -- 172.21.15.46:0/2548650285 >> 172.21.15.46:0/2548650285 conn(0x7f20d40fbc90 msgr2=0x7f20d40fe0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:25.058 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.049+0000 7f20d8fff700 1 -- 172.21.15.46:0/2548650285 shutdown_connections 2023-10-19T12:41:25.058 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.049+0000 7f20d8fff700 1 -- 172.21.15.46:0/2548650285 wait complete. 2023-10-19T12:41:25.059 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.050+0000 7f20d8fff700 1 Processor -- start 2023-10-19T12:41:25.059 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.050+0000 7f20d8fff700 1 -- start start 2023-10-19T12:41:25.059 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.051+0000 7f20d8fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20d40731f0 0x7f20d4198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:25.059 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.051+0000 7f20d8fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f20d40747d0 0x7f20d4198db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:25.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.051+0000 7f20d8fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f20d4108610 0x7f20d419fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:25.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.051+0000 7f20d8fff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20d41a03a0 con 0x7f20d40731f0 2023-10-19T12:41:25.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.051+0000 7f20d8fff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20d41a04e0 con 0x7f20d4108610 2023-10-19T12:41:25.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.051+0000 7f20d8fff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20d41a0670 con 0x7f20d40747d0 2023-10-19T12:41:25.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.051+0000 7f20d259c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20d40731f0 0x7f20d4198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:25.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.051+0000 7f20d259c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20d40731f0 0x7f20d4198870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40986/0 (socket says 172.21.15.46:40986) 2023-10-19T12:41:25.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.051+0000 7f20d259c700 1 -- 172.21.15.46:0/1010715338 learned_addr learned my addr 172.21.15.46:0/1010715338 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:41:25.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.051+0000 7f20cbfff700 1 --2- 172.21.15.46:0/1010715338 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f20d40747d0 0x7f20d4198db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:25.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.051+0000 7f20d2d9d700 1 --2- 172.21.15.46:0/1010715338 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f20d4108610 0x7f20d419fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:25.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.051+0000 7f20d259c700 1 -- 172.21.15.46:0/1010715338 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f20d40747d0 msgr2=0x7f20d4198db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:25.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.051+0000 7f20d259c700 1 --2- 172.21.15.46:0/1010715338 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f20d40747d0 0x7f20d4198db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:25.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.051+0000 7f20d259c700 1 -- 172.21.15.46:0/1010715338 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f20d4108610 msgr2=0x7f20d419fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:25.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.051+0000 7f20d259c700 1 --2- 172.21.15.46:0/1010715338 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f20d4108610 0x7f20d419fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:25.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.051+0000 7f20d259c700 1 -- 172.21.15.46:0/1010715338 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20cc009c40 con 0x7f20d40731f0 2023-10-19T12:41:25.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.051+0000 7f20cbfff700 1 --2- 172.21.15.46:0/1010715338 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f20d40747d0 0x7f20d4198db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:41:25.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.052+0000 7f20d259c700 1 --2- 172.21.15.46:0/1010715338 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20d40731f0 0x7f20d4198870 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f20c40098e0 tx=0x7f20c4005720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:25.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.052+0000 7f20cb7fe700 1 -- 172.21.15.46:0/1010715338 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c401d070 con 0x7f20d40731f0 2023-10-19T12:41:25.064 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.052+0000 7f20cb7fe700 1 -- 172.21.15.46:0/1010715338 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f20c4022470 con 0x7f20d40731f0 2023-10-19T12:41:25.064 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.052+0000 7f20d8fff700 1 -- 172.21.15.46:0/1010715338 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20c40095f0 con 0x7f20d40731f0 2023-10-19T12:41:25.064 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.052+0000 7f20cb7fe700 1 -- 172.21.15.46:0/1010715338 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c4017650 con 0x7f20d40731f0 2023-10-19T12:41:25.064 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.052+0000 7f20d8fff700 1 -- 172.21.15.46:0/1010715338 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20d41a0be0 con 0x7f20d40731f0 2023-10-19T12:41:25.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.053+0000 7f20d8fff700 1 -- 172.21.15.46:0/1010715338 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20d4107420 con 0x7f20d40731f0 2023-10-19T12:41:25.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.055+0000 7f20cb7fe700 1 -- 172.21.15.46:0/1010715338 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f20c4022850 con 0x7f20d40731f0 2023-10-19T12:41:25.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.057+0000 7f20cb7fe700 1 --2- 172.21.15.46:0/1010715338 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f20c00a1500 0x7f20c00a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:25.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.058+0000 7f20cb7fe700 1 -- 172.21.15.46:0/1010715338 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f20c40ce300 con 0x7f20d40731f0 2023-10-19T12:41:25.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.058+0000 7f20cbfff700 1 --2- 172.21.15.46:0/1010715338 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f20c00a1500 0x7f20c00a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:25.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.058+0000 7f20cbfff700 1 --2- 172.21.15.46:0/1010715338 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f20c00a1500 0x7f20c00a39c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f20bc011490 tx=0x7f20bc009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:25.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.062+0000 7f20cb7fe700 1 -- 172.21.15.46:0/1010715338 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f20c40978c0 con 0x7f20d40731f0 2023-10-19T12:41:25.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.279+0000 7f20d8fff700 1 -- 172.21.15.46:0/1010715338 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f20d4067530 con 0x7f20d40731f0 2023-10-19T12:41:25.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.281+0000 7f20cb7fe700 1 -- 172.21.15.46:0/1010715338 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+23953 (secure 0 0 0) 0x7f20c4027020 con 0x7f20d40731f0 2023-10-19T12:41:25.284 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:41:25.285 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":88,"fsid":"96a8be3c-6e7b-11ee-8db6-212e2dc638e7","created":"2023-10-19T12:33:26.148713+0000","modified":"2023-10-19T12:41:23.831907+0000","last_up_change":"2023-10-19T12:40:30.761679+0000","last_in_change":"2023-10-19T12:40:13.663559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-19T12:37:07.175795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-19T12:41:16.895203+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-19T12:41:18.255601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-19T12:41:21.830455+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"346ce86b-a10a-4869-9fdb-c3c1d4161455","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6803","nonce":500237995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6805","nonce":500237995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6809","nonce":500237995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6807","nonce":500237995}]},"public_addr":"172.21.15.46:6803/500237995","cluster_addr":"172.21.15.46:6805/500237995","heartbeat_back_addr":"172.21.15.46:6809/500237995","heartbeat_front_addr":"172.21.15.46:6807/500237995","state":["exists","up"]},{"osd":1,"uuid":"02aae687-76c5-4124-bae4-9787ed571c28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6801","nonce":2496862790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6803","nonce":2496862790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6807","nonce":2496862790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6805","nonce":2496862790}]},"public_addr":"172.21.15.157:6801/2496862790","cluster_addr":"172.21.15.157:6803/2496862790","heartbeat_back_addr":"172.21.15.157:6807/2496862790","heartbeat_front_addr":"172.21.15.157:6805/2496862790","state":["exists","up"]},{"osd":2,"uuid":"d5360828-1f58-4380-b2ad-0c21ff850981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6801","nonce":4211767276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6803","nonce":4211767276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6807","nonce":4211767276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6805","nonce":4211767276}]},"public_addr":"172.21.15.195:6801/4211767276","cluster_addr":"172.21.15.195:6803/4211767276","heartbeat_back_addr":"172.21.15.195:6807/4211767276","heartbeat_front_addr":"172.21.15.195:6805/4211767276","state":["exists","up"]},{"osd":3,"uuid":"accb780f-49d0-43f8-b166-ee12c558ef00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6811","nonce":1964113352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6813","nonce":1964113352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6817","nonce":1964113352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6815","nonce":1964113352}]},"public_addr":"172.21.15.46:6811/1964113352","cluster_addr":"172.21.15.46:6813/1964113352","heartbeat_back_addr":"172.21.15.46:6817/1964113352","heartbeat_front_addr":"172.21.15.46:6815/1964113352","state":["exists","up"]},{"osd":4,"uuid":"e662886d-e989-4d02-8c1f-3c4671352b0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6809","nonce":3636910144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6811","nonce":3636910144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6815","nonce":3636910144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6813","nonce":3636910144}]},"public_addr":"172.21.15.157:6809/3636910144","cluster_addr":"172.21.15.157:6811/3636910144","heartbeat_back_addr":"172.21.15.157:6815/3636910144","heartbeat_front_addr":"172.21.15.157:6813/3636910144","state":["exists","up"]},{"osd":5,"uuid":"9597e0ce-14ea-407d-90fe-f74bccee38b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6809","nonce":4071287969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6811","nonce":4071287969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6815","nonce":4071287969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6813","nonce":4071287969}]},"public_addr":"172.21.15.195:6809/4071287969","cluster_addr":"172.21.15.195:6811/4071287969","heartbeat_back_addr":"172.21.15.195:6815/4071287969","heartbeat_front_addr":"172.21.15.195:6813/4071287969","state":["exists","up"]},{"osd":6,"uuid":"6b78ba38-f60e-4cb6-b01c-cecc1820e8e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6819","nonce":1842285555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6821","nonce":1842285555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6825","nonce":1842285555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6823","nonce":1842285555}]},"public_addr":"172.21.15.46:6819/1842285555","cluster_addr":"172.21.15.46:6821/1842285555","heartbeat_back_addr":"172.21.15.46:6825/1842285555","heartbeat_front_addr":"172.21.15.46:6823/1842285555","state":["exists","up"]},{"osd":7,"uuid":"59a0899f-3bcd-4db2-b544-24df3a536749","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6817","nonce":3498672588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6819","nonce":3498672588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6823","nonce":3498672588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6821","nonce":3498672588}]},"public_addr":"172.21.15.157:6817/3498672588","cluster_addr":"172.21.15.157:6819/3498672588","heartbeat_back_addr":"172.21.15.157:6823/3498672588","heartbeat_front_addr":"172.21.15.157:6821/3498672588","state":["exists","up"]},{"osd":8,"uuid":"9c3c9835-043a-4fb5-a9ee-edf8caf6b605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6817","nonce":74230104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6819","nonce":74230104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6823","nonce":74230104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6821","nonce":74230104}]},"public_addr":"172.21.15.195:6817/74230104","cluster_addr":"172.21.15.195:6819/74230104","heartbeat_back_addr":"172.21.15.195:6823/74230104","heartbeat_front_addr":"172.21.15.195:6821/74230104","state":["exists","up"]},{"osd":9,"uuid":"3f18f506-a577-4b7c-ae0d-9351c07e81f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6827","nonce":3472581046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6829","nonce":3472581046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6833","nonce":3472581046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6831","nonce":3472581046}]},"public_addr":"172.21.15.46:6827/3472581046","cluster_addr":"172.21.15.46:6829/3472581046","heartbeat_back_addr":"172.21.15.46:6833/3472581046","heartbeat_front_addr":"172.21.15.46:6831/3472581046","state":["exists","up"]},{"osd":10,"uuid":"1ed01854-443a-4acf-9293-7ca0d451a93d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6825","nonce":2378416559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6827","nonce":2378416559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6831","nonce":2378416559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6829","nonce":2378416559}]},"public_addr":"172.21.15.157:6825/2378416559","cluster_addr":"172.21.15.157:6827/2378416559","heartbeat_back_addr":"172.21.15.157:6831/2378416559","heartbeat_front_addr":"172.21.15.157:6829/2378416559","state":["exists","up"]},{"osd":11,"uuid":"021398c0-9184-4647-8220-e40f6705ca90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6825","nonce":3075632222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6827","nonce":3075632222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6831","nonce":3075632222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6829","nonce":3075632222}]},"public_addr":"172.21.15.195:6825/3075632222","cluster_addr":"172.21.15.195:6827/3075632222","heartbeat_back_addr":"172.21.15.195:6831/3075632222","heartbeat_front_addr":"172.21.15.195:6829/3075632222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:36:22.002614+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:36:44.098031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:37:04.518341+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:37:30.796462+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:37:52.756555+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:38:13.403168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:38:39.058472+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:39:01.106893+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:39:21.908334+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:39:46.843884+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:40:08.792020+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:40:29.282974+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.46:0/3248595150":"2023-10-20T12:34:26.552115+0000","172.21.15.46:0/3624849341":"2023-10-20T12:34:26.552115+0000","172.21.15.46:0/1844094590":"2023-10-20T12:34:26.552115+0000","172.21.15.46:6801/20022894":"2023-10-20T12:34:26.552115+0000","172.21.15.46:0/3969790632":"2023-10-20T12:34:00.135248+0000","172.21.15.46:0/2331135821":"2023-10-20T12:34:00.135248+0000","172.21.15.46:6800/51664346":"2023-10-20T12:34:00.135248+0000","172.21.15.46:6801/51664346":"2023-10-20T12:34:00.135248+0000","172.21.15.46:0/585851467":"2023-10-20T12:34:00.135248+0000","172.21.15.46:6800/20022894":"2023-10-20T12:34:26.552115+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-19T12:41:25.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.283+0000 7f20d8fff700 1 -- 172.21.15.46:0/1010715338 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f20c00a1500 msgr2=0x7f20c00a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:25.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.283+0000 7f20d8fff700 1 --2- 172.21.15.46:0/1010715338 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f20c00a1500 0x7f20c00a39c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f20bc011490 tx=0x7f20bc009260 comp rx=0 tx=0).stop 2023-10-19T12:41:25.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.283+0000 7f20d8fff700 1 -- 172.21.15.46:0/1010715338 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20d40731f0 msgr2=0x7f20d4198870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:25.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.283+0000 7f20d8fff700 1 --2- 172.21.15.46:0/1010715338 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20d40731f0 0x7f20d4198870 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f20c40098e0 tx=0x7f20c4005720 comp rx=0 tx=0).stop 2023-10-19T12:41:25.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.283+0000 7f20d8fff700 1 -- 172.21.15.46:0/1010715338 shutdown_connections 2023-10-19T12:41:25.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.283+0000 7f20d8fff700 1 --2- 172.21.15.46:0/1010715338 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f20d4108610 0x7f20d419fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:25.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.283+0000 7f20d8fff700 1 --2- 172.21.15.46:0/1010715338 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20d40731f0 0x7f20d4198870 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:25.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.283+0000 7f20d8fff700 1 --2- 172.21.15.46:0/1010715338 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f20c00a1500 0x7f20c00a39c0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:25.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.283+0000 7f20d8fff700 1 --2- 172.21.15.46:0/1010715338 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f20d40747d0 0x7f20d4198db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:25.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.283+0000 7f20d8fff700 1 -- 172.21.15.46:0/1010715338 >> 172.21.15.46:0/1010715338 conn(0x7f20d40fbc90 msgr2=0x7f20d4104560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:25.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.283+0000 7f20d8fff700 1 -- 172.21.15.46:0/1010715338 shutdown_connections 2023-10-19T12:41:25.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.283+0000 7f20d8fff700 1 -- 172.21.15.46:0/1010715338 wait complete. 2023-10-19T12:41:25.306 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-19T12:41:25.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.508+0000 7fcb0fbff700 1 -- 172.21.15.46:0/3703389226 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb081022d0 msgr2=0x7fcb08108b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:25.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.508+0000 7fcb0fbff700 1 --2- 172.21.15.46:0/3703389226 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb081022d0 0x7fcb08108b80 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fcb0000b0d0 tx=0x7fcb0000b3e0 comp rx=0 tx=0).stop 2023-10-19T12:41:25.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.508+0000 7fcb0fbff700 1 -- 172.21.15.46:0/3703389226 shutdown_connections 2023-10-19T12:41:25.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.508+0000 7fcb0fbff700 1 --2- 172.21.15.46:0/3703389226 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb081022d0 0x7fcb08108b80 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:25.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.508+0000 7fcb0fbff700 1 --2- 172.21.15.46:0/3703389226 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcb08100740 0x7fcb08100b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:25.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.508+0000 7fcb0fbff700 1 --2- 172.21.15.46:0/3703389226 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcb08101930 0x7fcb08101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:25.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.508+0000 7fcb0fbff700 1 -- 172.21.15.46:0/3703389226 >> 172.21.15.46:0/3703389226 conn(0x7fcb080fbc90 msgr2=0x7fcb080fe0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:25.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.508+0000 7fcb0fbff700 1 -- 172.21.15.46:0/3703389226 shutdown_connections 2023-10-19T12:41:25.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.508+0000 7fcb0fbff700 1 -- 172.21.15.46:0/3703389226 wait complete. 2023-10-19T12:41:25.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.509+0000 7fcb0fbff700 1 Processor -- start 2023-10-19T12:41:25.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.510+0000 7fcb0fbff700 1 -- start start 2023-10-19T12:41:25.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.510+0000 7fcb0fbff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb08100740 0x7fcb081967c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:25.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.510+0000 7fcb0fbff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcb08101930 0x7fcb08196d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:25.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.510+0000 7fcb0fbff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcb081022d0 0x7fcb0819dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:25.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.510+0000 7fcb0fbff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0819e2f0 con 0x7fcb08100740 2023-10-19T12:41:25.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.510+0000 7fcb0fbff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0819e430 con 0x7fcb081022d0 2023-10-19T12:41:25.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.510+0000 7fcb0fbff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0819e5c0 con 0x7fcb08101930 2023-10-19T12:41:25.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.510+0000 7fcb0d99b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb08100740 0x7fcb081967c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:25.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.510+0000 7fcb0d99b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb08100740 0x7fcb081967c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40992/0 (socket says 172.21.15.46:40992) 2023-10-19T12:41:25.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.510+0000 7fcb0d99b700 1 -- 172.21.15.46:0/602373775 learned_addr learned my addr 172.21.15.46:0/602373775 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:41:25.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.510+0000 7fcb0d19a700 1 --2- 172.21.15.46:0/602373775 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcb08101930 0x7fcb08196d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:25.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.510+0000 7fcb0e19c700 1 --2- 172.21.15.46:0/602373775 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcb081022d0 0x7fcb0819dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:25.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.510+0000 7fcb0d99b700 1 -- 172.21.15.46:0/602373775 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcb08101930 msgr2=0x7fcb08196d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:25.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.510+0000 7fcb0d99b700 1 --2- 172.21.15.46:0/602373775 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcb08101930 0x7fcb08196d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:25.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.510+0000 7fcb0d99b700 1 -- 172.21.15.46:0/602373775 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcb081022d0 msgr2=0x7fcb0819dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:25.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.510+0000 7fcb0d99b700 1 --2- 172.21.15.46:0/602373775 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcb081022d0 0x7fcb0819dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:25.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.510+0000 7fcb0d99b700 1 -- 172.21.15.46:0/602373775 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb00009d00 con 0x7fcb08100740 2023-10-19T12:41:25.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.511+0000 7fcb0d99b700 1 --2- 172.21.15.46:0/602373775 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb08100740 0x7fcb081967c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fcb0400e970 tx=0x7fcb0400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:25.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.511+0000 7fcafeffd700 1 -- 172.21.15.46:0/602373775 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb04009790 con 0x7fcb08100740 2023-10-19T12:41:25.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.511+0000 7fcafeffd700 1 -- 172.21.15.46:0/602373775 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcb0400c7e0 con 0x7fcb08100740 2023-10-19T12:41:25.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.511+0000 7fcb0fbff700 1 -- 172.21.15.46:0/602373775 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb0819e8a0 con 0x7fcb08100740 2023-10-19T12:41:25.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.511+0000 7fcafeffd700 1 -- 172.21.15.46:0/602373775 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb04003c70 con 0x7fcb08100740 2023-10-19T12:41:25.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.511+0000 7fcb0fbff700 1 -- 172.21.15.46:0/602373775 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb0819ee00 con 0x7fcb08100740 2023-10-19T12:41:25.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.512+0000 7fcb0fbff700 1 -- 172.21.15.46:0/602373775 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb08107af0 con 0x7fcb08100740 2023-10-19T12:41:25.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.514+0000 7fcafeffd700 1 -- 172.21.15.46:0/602373775 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fcb0400cc50 con 0x7fcb08100740 2023-10-19T12:41:25.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.515+0000 7fcafeffd700 1 --2- 172.21.15.46:0/602373775 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fcaf40a1500 0x7fcaf40a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:25.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.516+0000 7fcafeffd700 1 -- 172.21.15.46:0/602373775 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fcb04014070 con 0x7fcb08100740 2023-10-19T12:41:25.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.516+0000 7fcb0d19a700 1 --2- 172.21.15.46:0/602373775 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fcaf40a1500 0x7fcaf40a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:25.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.516+0000 7fcb0d19a700 1 --2- 172.21.15.46:0/602373775 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fcaf40a1500 0x7fcaf40a39c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fcaf8009c60 tx=0x7fcaf8009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:25.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.519+0000 7fcafeffd700 1 -- 172.21.15.46:0/602373775 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fcb04096490 con 0x7fcb08100740 2023-10-19T12:41:25.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:25 smithi157 ceph-mon[134109]: osdmap e88: 12 total, 12 up, 12 in 2023-10-19T12:41:25.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:25 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/3938591122' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2023-10-19T12:41:25.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:25 smithi157 ceph-mon[134109]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-19T12:41:25.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:25 smithi157 ceph-mon[134109]: pgmap v287: 129 pgs: 1 creating+peering, 23 unknown, 105 active+clean; 579 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s wr, 5 op/s 2023-10-19T12:41:25.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:25 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/3683734653' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-19T12:41:25.589 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:25 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/1010715338' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-19T12:41:25.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:25 smithi195 ceph-mon[134493]: osdmap e88: 12 total, 12 up, 12 in 2023-10-19T12:41:25.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:25 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/3938591122' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2023-10-19T12:41:25.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:25 smithi195 ceph-mon[134493]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-19T12:41:25.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:25 smithi195 ceph-mon[134493]: pgmap v287: 129 pgs: 1 creating+peering, 23 unknown, 105 active+clean; 579 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s wr, 5 op/s 2023-10-19T12:41:25.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:25 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/3683734653' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-19T12:41:25.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:25 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/1010715338' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-19T12:41:25.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:25 smithi046 ceph-mon[98509]: osdmap e88: 12 total, 12 up, 12 in 2023-10-19T12:41:25.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:25 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/3938591122' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2023-10-19T12:41:25.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:25 smithi046 ceph-mon[98509]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-19T12:41:25.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:25 smithi046 ceph-mon[98509]: pgmap v287: 129 pgs: 1 creating+peering, 23 unknown, 105 active+clean; 579 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s wr, 5 op/s 2023-10-19T12:41:25.730 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:25 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/3683734653' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-19T12:41:25.730 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:25 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/1010715338' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-19T12:41:25.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.735+0000 7fcb0fbff700 1 -- 172.21.15.46:0/602373775 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcb08067530 con 0x7fcb08100740 2023-10-19T12:41:25.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.736+0000 7fcafeffd700 1 -- 172.21.15.46:0/602373775 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+23953 (secure 0 0 0) 0x7fcb04003dd0 con 0x7fcb08100740 2023-10-19T12:41:25.740 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:41:25.740 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":88,"fsid":"96a8be3c-6e7b-11ee-8db6-212e2dc638e7","created":"2023-10-19T12:33:26.148713+0000","modified":"2023-10-19T12:41:23.831907+0000","last_up_change":"2023-10-19T12:40:30.761679+0000","last_in_change":"2023-10-19T12:40:13.663559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-19T12:37:07.175795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-19T12:41:16.895203+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-19T12:41:18.255601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-19T12:41:21.830455+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"346ce86b-a10a-4869-9fdb-c3c1d4161455","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6803","nonce":500237995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6805","nonce":500237995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6809","nonce":500237995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6807","nonce":500237995}]},"public_addr":"172.21.15.46:6803/500237995","cluster_addr":"172.21.15.46:6805/500237995","heartbeat_back_addr":"172.21.15.46:6809/500237995","heartbeat_front_addr":"172.21.15.46:6807/500237995","state":["exists","up"]},{"osd":1,"uuid":"02aae687-76c5-4124-bae4-9787ed571c28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6801","nonce":2496862790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6803","nonce":2496862790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6807","nonce":2496862790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6805","nonce":2496862790}]},"public_addr":"172.21.15.157:6801/2496862790","cluster_addr":"172.21.15.157:6803/2496862790","heartbeat_back_addr":"172.21.15.157:6807/2496862790","heartbeat_front_addr":"172.21.15.157:6805/2496862790","state":["exists","up"]},{"osd":2,"uuid":"d5360828-1f58-4380-b2ad-0c21ff850981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6801","nonce":4211767276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6803","nonce":4211767276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6807","nonce":4211767276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6805","nonce":4211767276}]},"public_addr":"172.21.15.195:6801/4211767276","cluster_addr":"172.21.15.195:6803/4211767276","heartbeat_back_addr":"172.21.15.195:6807/4211767276","heartbeat_front_addr":"172.21.15.195:6805/4211767276","state":["exists","up"]},{"osd":3,"uuid":"accb780f-49d0-43f8-b166-ee12c558ef00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6811","nonce":1964113352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6813","nonce":1964113352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6817","nonce":1964113352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6815","nonce":1964113352}]},"public_addr":"172.21.15.46:6811/1964113352","cluster_addr":"172.21.15.46:6813/1964113352","heartbeat_back_addr":"172.21.15.46:6817/1964113352","heartbeat_front_addr":"172.21.15.46:6815/1964113352","state":["exists","up"]},{"osd":4,"uuid":"e662886d-e989-4d02-8c1f-3c4671352b0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6809","nonce":3636910144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6811","nonce":3636910144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6815","nonce":3636910144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6813","nonce":3636910144}]},"public_addr":"172.21.15.157:6809/3636910144","cluster_addr":"172.21.15.157:6811/3636910144","heartbeat_back_addr":"172.21.15.157:6815/3636910144","heartbeat_front_addr":"172.21.15.157:6813/3636910144","state":["exists","up"]},{"osd":5,"uuid":"9597e0ce-14ea-407d-90fe-f74bccee38b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6809","nonce":4071287969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6811","nonce":4071287969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6815","nonce":4071287969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6813","nonce":4071287969}]},"public_addr":"172.21.15.195:6809/4071287969","cluster_addr":"172.21.15.195:6811/4071287969","heartbeat_back_addr":"172.21.15.195:6815/4071287969","heartbeat_front_addr":"172.21.15.195:6813/4071287969","state":["exists","up"]},{"osd":6,"uuid":"6b78ba38-f60e-4cb6-b01c-cecc1820e8e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6819","nonce":1842285555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6821","nonce":1842285555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6825","nonce":1842285555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6823","nonce":1842285555}]},"public_addr":"172.21.15.46:6819/1842285555","cluster_addr":"172.21.15.46:6821/1842285555","heartbeat_back_addr":"172.21.15.46:6825/1842285555","heartbeat_front_addr":"172.21.15.46:6823/1842285555","state":["exists","up"]},{"osd":7,"uuid":"59a0899f-3bcd-4db2-b544-24df3a536749","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6817","nonce":3498672588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6819","nonce":3498672588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6823","nonce":3498672588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6821","nonce":3498672588}]},"public_addr":"172.21.15.157:6817/3498672588","cluster_addr":"172.21.15.157:6819/3498672588","heartbeat_back_addr":"172.21.15.157:6823/3498672588","heartbeat_front_addr":"172.21.15.157:6821/3498672588","state":["exists","up"]},{"osd":8,"uuid":"9c3c9835-043a-4fb5-a9ee-edf8caf6b605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6817","nonce":74230104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6819","nonce":74230104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6823","nonce":74230104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6821","nonce":74230104}]},"public_addr":"172.21.15.195:6817/74230104","cluster_addr":"172.21.15.195:6819/74230104","heartbeat_back_addr":"172.21.15.195:6823/74230104","heartbeat_front_addr":"172.21.15.195:6821/74230104","state":["exists","up"]},{"osd":9,"uuid":"3f18f506-a577-4b7c-ae0d-9351c07e81f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6827","nonce":3472581046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6829","nonce":3472581046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6833","nonce":3472581046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6831","nonce":3472581046}]},"public_addr":"172.21.15.46:6827/3472581046","cluster_addr":"172.21.15.46:6829/3472581046","heartbeat_back_addr":"172.21.15.46:6833/3472581046","heartbeat_front_addr":"172.21.15.46:6831/3472581046","state":["exists","up"]},{"osd":10,"uuid":"1ed01854-443a-4acf-9293-7ca0d451a93d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6825","nonce":2378416559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6827","nonce":2378416559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6831","nonce":2378416559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6829","nonce":2378416559}]},"public_addr":"172.21.15.157:6825/2378416559","cluster_addr":"172.21.15.157:6827/2378416559","heartbeat_back_addr":"172.21.15.157:6831/2378416559","heartbeat_front_addr":"172.21.15.157:6829/2378416559","state":["exists","up"]},{"osd":11,"uuid":"021398c0-9184-4647-8220-e40f6705ca90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6825","nonce":3075632222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6827","nonce":3075632222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6831","nonce":3075632222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6829","nonce":3075632222}]},"public_addr":"172.21.15.195:6825/3075632222","cluster_addr":"172.21.15.195:6827/3075632222","heartbeat_back_addr":"172.21.15.195:6831/3075632222","heartbeat_front_addr":"172.21.15.195:6829/3075632222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:36:22.002614+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:36:44.098031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:37:04.518341+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:37:30.796462+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:37:52.756555+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:38:13.403168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:38:39.058472+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:39:01.106893+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:39:21.908334+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:39:46.843884+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:40:08.792020+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:40:29.282974+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.46:0/3248595150":"2023-10-20T12:34:26.552115+0000","172.21.15.46:0/3624849341":"2023-10-20T12:34:26.552115+0000","172.21.15.46:0/1844094590":"2023-10-20T12:34:26.552115+0000","172.21.15.46:6801/20022894":"2023-10-20T12:34:26.552115+0000","172.21.15.46:0/3969790632":"2023-10-20T12:34:00.135248+0000","172.21.15.46:0/2331135821":"2023-10-20T12:34:00.135248+0000","172.21.15.46:6800/51664346":"2023-10-20T12:34:00.135248+0000","172.21.15.46:6801/51664346":"2023-10-20T12:34:00.135248+0000","172.21.15.46:0/585851467":"2023-10-20T12:34:00.135248+0000","172.21.15.46:6800/20022894":"2023-10-20T12:34:26.552115+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-19T12:41:25.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.739+0000 7fcb0fbff700 1 -- 172.21.15.46:0/602373775 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fcaf40a1500 msgr2=0x7fcaf40a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:25.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.739+0000 7fcb0fbff700 1 --2- 172.21.15.46:0/602373775 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fcaf40a1500 0x7fcaf40a39c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fcaf8009c60 tx=0x7fcaf8009260 comp rx=0 tx=0).stop 2023-10-19T12:41:25.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.739+0000 7fcb0fbff700 1 -- 172.21.15.46:0/602373775 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb08100740 msgr2=0x7fcb081967c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:25.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.739+0000 7fcb0fbff700 1 --2- 172.21.15.46:0/602373775 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb08100740 0x7fcb081967c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fcb0400e970 tx=0x7fcb0400ec80 comp rx=0 tx=0).stop 2023-10-19T12:41:25.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.739+0000 7fcb0fbff700 1 -- 172.21.15.46:0/602373775 shutdown_connections 2023-10-19T12:41:25.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.739+0000 7fcb0fbff700 1 --2- 172.21.15.46:0/602373775 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcb081022d0 0x7fcb0819dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:25.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.739+0000 7fcb0fbff700 1 --2- 172.21.15.46:0/602373775 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb08100740 0x7fcb081967c0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:25.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.739+0000 7fcb0fbff700 1 --2- 172.21.15.46:0/602373775 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fcaf40a1500 0x7fcaf40a39c0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:25.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.739+0000 7fcb0fbff700 1 --2- 172.21.15.46:0/602373775 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcb08101930 0x7fcb08196d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:25.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.739+0000 7fcb0fbff700 1 -- 172.21.15.46:0/602373775 >> 172.21.15.46:0/602373775 conn(0x7fcb080fbc90 msgr2=0x7fcb08104c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:25.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.739+0000 7fcb0fbff700 1 -- 172.21.15.46:0/602373775 shutdown_connections 2023-10-19T12:41:25.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.739+0000 7fcb0fbff700 1 -- 172.21.15.46:0/602373775 wait complete. 2023-10-19T12:41:25.777 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-19T12:41:25.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.980+0000 7fce89fff700 1 -- 172.21.15.46:0/3651737255 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fce840747d0 msgr2=0x7fce84072c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:25.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.980+0000 7fce89fff700 1 --2- 172.21.15.46:0/3651737255 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fce840747d0 0x7fce84072c20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fce74009990 tx=0x7fce74009ca0 comp rx=0 tx=0).stop 2023-10-19T12:41:25.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.980+0000 7fce89fff700 1 -- 172.21.15.46:0/3651737255 shutdown_connections 2023-10-19T12:41:25.985 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.980+0000 7fce89fff700 1 --2- 172.21.15.46:0/3651737255 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fce84108610 0x7fce8410aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:25.985 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.980+0000 7fce89fff700 1 --2- 172.21.15.46:0/3651737255 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fce840747d0 0x7fce84072c20 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:25.985 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.980+0000 7fce89fff700 1 --2- 172.21.15.46:0/3651737255 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fce840731f0 0x7fce84073670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:25.985 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.980+0000 7fce89fff700 1 -- 172.21.15.46:0/3651737255 >> 172.21.15.46:0/3651737255 conn(0x7fce840fbc90 msgr2=0x7fce840fe0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:25.985 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.980+0000 7fce89fff700 1 -- 172.21.15.46:0/3651737255 shutdown_connections 2023-10-19T12:41:25.985 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.980+0000 7fce89fff700 1 -- 172.21.15.46:0/3651737255 wait complete. 2023-10-19T12:41:25.988 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.981+0000 7fce89fff700 1 Processor -- start 2023-10-19T12:41:25.988 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.982+0000 7fce89fff700 1 -- start start 2023-10-19T12:41:25.988 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.982+0000 7fce89fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fce840731f0 0x7fce84198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:25.988 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.982+0000 7fce89fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fce840747d0 0x7fce84198e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:25.988 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.982+0000 7fce89fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fce84108610 0x7fce8419fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:25.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.982+0000 7fce89fff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce841a0430 con 0x7fce840731f0 2023-10-19T12:41:25.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.982+0000 7fce89fff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce841a0570 con 0x7fce840747d0 2023-10-19T12:41:25.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.982+0000 7fce89fff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce841a0700 con 0x7fce84108610 2023-10-19T12:41:25.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.982+0000 7fce837fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fce840731f0 0x7fce84198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:25.990 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.982+0000 7fce837fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fce840731f0 0x7fce84198950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41014/0 (socket says 172.21.15.46:41014) 2023-10-19T12:41:25.990 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.982+0000 7fce837fe700 1 -- 172.21.15.46:0/3965637706 learned_addr learned my addr 172.21.15.46:0/3965637706 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:41:25.990 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.982+0000 7fce82ffd700 1 --2- 172.21.15.46:0/3965637706 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fce840747d0 0x7fce84198e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:25.990 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.982+0000 7fce83fff700 1 --2- 172.21.15.46:0/3965637706 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fce84108610 0x7fce8419fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:25.990 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.983+0000 7fce837fe700 1 -- 172.21.15.46:0/3965637706 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fce84108610 msgr2=0x7fce8419fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:25.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.983+0000 7fce837fe700 1 --2- 172.21.15.46:0/3965637706 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fce84108610 0x7fce8419fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:25.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.983+0000 7fce837fe700 1 -- 172.21.15.46:0/3965637706 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fce840747d0 msgr2=0x7fce84198e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:25.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.983+0000 7fce837fe700 1 --2- 172.21.15.46:0/3965637706 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fce840747d0 0x7fce84198e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:25.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.983+0000 7fce837fe700 1 -- 172.21.15.46:0/3965637706 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce740095f0 con 0x7fce840731f0 2023-10-19T12:41:25.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.983+0000 7fce837fe700 1 --2- 172.21.15.46:0/3965637706 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fce840731f0 0x7fce84198950 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fce74005910 tx=0x7fce74009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:25.992 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.983+0000 7fce80ff9700 1 -- 172.21.15.46:0/3965637706 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce7401d070 con 0x7fce840731f0 2023-10-19T12:41:25.992 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.983+0000 7fce80ff9700 1 -- 172.21.15.46:0/3965637706 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fce74021410 con 0x7fce840731f0 2023-10-19T12:41:25.992 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.983+0000 7fce89fff700 1 -- 172.21.15.46:0/3965637706 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce841a0980 con 0x7fce840731f0 2023-10-19T12:41:25.992 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.983+0000 7fce80ff9700 1 -- 172.21.15.46:0/3965637706 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce74005720 con 0x7fce840731f0 2023-10-19T12:41:25.993 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.983+0000 7fce89fff700 1 -- 172.21.15.46:0/3965637706 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce841a0e00 con 0x7fce840731f0 2023-10-19T12:41:25.993 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.984+0000 7fce89fff700 1 -- 172.21.15.46:0/3965637706 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce84107420 con 0x7fce840731f0 2023-10-19T12:41:25.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.986+0000 7fce80ff9700 1 -- 172.21.15.46:0/3965637706 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fce74021580 con 0x7fce840731f0 2023-10-19T12:41:25.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.988+0000 7fce80ff9700 1 --2- 172.21.15.46:0/3965637706 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fce6c0a1500 0x7fce6c0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:25.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.988+0000 7fce80ff9700 1 -- 172.21.15.46:0/3965637706 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fce740ce200 con 0x7fce840731f0 2023-10-19T12:41:25.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.988+0000 7fce82ffd700 1 --2- 172.21.15.46:0/3965637706 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fce6c0a1500 0x7fce6c0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:25.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.988+0000 7fce82ffd700 1 --2- 172.21.15.46:0/3965637706 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fce6c0a1500 0x7fce6c0a39c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fce78009c60 tx=0x7fce78009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:25.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:25.992+0000 7fce80ff9700 1 -- 172.21.15.46:0/3965637706 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fce740976a0 con 0x7fce840731f0 2023-10-19T12:41:26.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.248+0000 7fce89fff700 1 -- 172.21.15.46:0/3965637706 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fce84067530 con 0x7fce840731f0 2023-10-19T12:41:26.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.249+0000 7fce80ff9700 1 -- 172.21.15.46:0/3965637706 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+11261 (secure 0 0 0) 0x7fce7409acc0 con 0x7fce840731f0 2023-10-19T12:41:26.252 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:41:26.252 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14580,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/2235286008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":2235286008},{"type":"v1","addr":"172.21.15.46:6835","nonce":2235286008}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14592,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/339398444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":339398444},{"type":"v1","addr":"172.21.15.46:6837","nonce":339398444}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14640,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6839/1655843965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":1655843965},{"type":"v1","addr":"172.21.15.46:6839","nonce":1655843965}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14652,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6841/4204925553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6840","nonce":4204925553},{"type":"v1","addr":"172.21.15.46:6841","nonce":4204925553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24560,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/1687745569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":1687745569},{"type":"v1","addr":"172.21.15.157:6833","nonce":1687745569}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24574,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6833/3629933235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3629933235},{"type":"v1","addr":"172.21.15.195:6833","nonce":3629933235}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24602,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/108432552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":108432552},{"type":"v1","addr":"172.21.15.157:6835","nonce":108432552}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24629,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6837/2629536514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6836","nonce":2629536514},{"type":"v1","addr":"172.21.15.157:6837","nonce":2629536514}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24631,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/1406909915","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":1406909915},{"type":"v1","addr":"172.21.15.195:6835","nonce":1406909915}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24643,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6837/293916188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":293916188},{"type":"v1","addr":"172.21.15.195:6837","nonce":293916188}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24655,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6839/4094901934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6838","nonce":4094901934},{"type":"v1","addr":"172.21.15.195:6839","nonce":4094901934}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-19T12:41:18.815780+0000","modified":"2023-10-19T12:41:23.832102+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":24680},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24680":{"gid":24680,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.157:6839/552718978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6838","nonce":552718978},{"type":"v1","addr":"172.21.15.157:6839","nonce":552718978}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-10-19T12:41:26.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.251+0000 7fce89fff700 1 -- 172.21.15.46:0/3965637706 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fce6c0a1500 msgr2=0x7fce6c0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:26.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.251+0000 7fce89fff700 1 --2- 172.21.15.46:0/3965637706 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fce6c0a1500 0x7fce6c0a39c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fce78009c60 tx=0x7fce78009260 comp rx=0 tx=0).stop 2023-10-19T12:41:26.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.251+0000 7fce89fff700 1 -- 172.21.15.46:0/3965637706 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fce840731f0 msgr2=0x7fce84198950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:26.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.251+0000 7fce89fff700 1 --2- 172.21.15.46:0/3965637706 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fce840731f0 0x7fce84198950 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fce74005910 tx=0x7fce74009580 comp rx=0 tx=0).stop 2023-10-19T12:41:26.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.251+0000 7fce89fff700 1 -- 172.21.15.46:0/3965637706 shutdown_connections 2023-10-19T12:41:26.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.251+0000 7fce89fff700 1 --2- 172.21.15.46:0/3965637706 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fce6c0a1500 0x7fce6c0a39c0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:26.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.251+0000 7fce89fff700 1 --2- 172.21.15.46:0/3965637706 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fce84108610 0x7fce8419fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:26.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.251+0000 7fce89fff700 1 --2- 172.21.15.46:0/3965637706 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fce840731f0 0x7fce84198950 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:26.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.251+0000 7fce89fff700 1 --2- 172.21.15.46:0/3965637706 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fce840747d0 0x7fce84198e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:26.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.251+0000 7fce89fff700 1 -- 172.21.15.46:0/3965637706 >> 172.21.15.46:0/3965637706 conn(0x7fce840fbc90 msgr2=0x7fce84104560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:26.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.251+0000 7fce89fff700 1 -- 172.21.15.46:0/3965637706 shutdown_connections 2023-10-19T12:41:26.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.251+0000 7fce89fff700 1 -- 172.21.15.46:0/3965637706 wait complete. 2023-10-19T12:41:26.257 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 17 2023-10-19T12:41:26.274 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-19T12:41:26.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.477+0000 7fbba99ff700 1 -- 172.21.15.46:0/1104777593 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbba4108610 msgr2=0x7fbba410aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:26.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.477+0000 7fbba99ff700 1 --2- 172.21.15.46:0/1104777593 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbba4108610 0x7fbba410aa80 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c00b0a0 tx=0x7fbb9c00b3b0 comp rx=0 tx=0).stop 2023-10-19T12:41:26.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.477+0000 7fbba99ff700 1 -- 172.21.15.46:0/1104777593 shutdown_connections 2023-10-19T12:41:26.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.477+0000 7fbba99ff700 1 --2- 172.21.15.46:0/1104777593 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbba4108610 0x7fbba410aa80 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:26.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.477+0000 7fbba99ff700 1 --2- 172.21.15.46:0/1104777593 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbba40747d0 0x7fbba4072c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:26.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.477+0000 7fbba99ff700 1 --2- 172.21.15.46:0/1104777593 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbba40731f0 0x7fbba4073670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:26.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.477+0000 7fbba99ff700 1 -- 172.21.15.46:0/1104777593 >> 172.21.15.46:0/1104777593 conn(0x7fbba40fbc90 msgr2=0x7fbba40fe0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:26.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.477+0000 7fbba99ff700 1 -- 172.21.15.46:0/1104777593 shutdown_connections 2023-10-19T12:41:26.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.477+0000 7fbba99ff700 1 -- 172.21.15.46:0/1104777593 wait complete. 2023-10-19T12:41:26.484 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.478+0000 7fbba99ff700 1 Processor -- start 2023-10-19T12:41:26.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.479+0000 7fbba99ff700 1 -- start start 2023-10-19T12:41:26.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.479+0000 7fbba99ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbba40731f0 0x7fbba4198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:26.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.479+0000 7fbba99ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbba40747d0 0x7fbba4198eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:26.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.479+0000 7fbba99ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbba4108610 0x7fbba419fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:26.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.479+0000 7fbba99ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbba41a04a0 con 0x7fbba40731f0 2023-10-19T12:41:26.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.479+0000 7fbba99ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbba41a05e0 con 0x7fbba40747d0 2023-10-19T12:41:26.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.479+0000 7fbba99ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbba41a0770 con 0x7fbba4108610 2023-10-19T12:41:26.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.479+0000 7fbba2ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbba40731f0 0x7fbba4198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:26.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.479+0000 7fbba2ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbba40731f0 0x7fbba4198970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41026/0 (socket says 172.21.15.46:41026) 2023-10-19T12:41:26.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.479+0000 7fbba2ffd700 1 -- 172.21.15.46:0/1147065030 learned_addr learned my addr 172.21.15.46:0/1147065030 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:41:26.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.479+0000 7fbba37fe700 1 --2- 172.21.15.46:0/1147065030 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbba4108610 0x7fbba419fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:26.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.479+0000 7fbba27fc700 1 --2- 172.21.15.46:0/1147065030 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbba40747d0 0x7fbba4198eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:26.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.479+0000 7fbba2ffd700 1 -- 172.21.15.46:0/1147065030 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbba4108610 msgr2=0x7fbba419fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:26.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.479+0000 7fbba2ffd700 1 --2- 172.21.15.46:0/1147065030 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbba4108610 0x7fbba419fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:26.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.479+0000 7fbba2ffd700 1 -- 172.21.15.46:0/1147065030 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbba40747d0 msgr2=0x7fbba4198eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:26.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.479+0000 7fbba2ffd700 1 --2- 172.21.15.46:0/1147065030 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbba40747d0 0x7fbba4198eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:26.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.480+0000 7fbba2ffd700 1 -- 172.21.15.46:0/1147065030 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb9c009d00 con 0x7fbba40731f0 2023-10-19T12:41:26.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.480+0000 7fbba2ffd700 1 --2- 172.21.15.46:0/1147065030 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbba40731f0 0x7fbba4198970 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fbb9400e9a0 tx=0x7fbb9400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:26.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.480+0000 7fbba89fd700 1 -- 172.21.15.46:0/1147065030 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb94009790 con 0x7fbba40731f0 2023-10-19T12:41:26.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.480+0000 7fbba89fd700 1 -- 172.21.15.46:0/1147065030 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbb94010430 con 0x7fbba40731f0 2023-10-19T12:41:26.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.480+0000 7fbba99ff700 1 -- 172.21.15.46:0/1147065030 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbba41a0a50 con 0x7fbba40731f0 2023-10-19T12:41:26.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.480+0000 7fbba89fd700 1 -- 172.21.15.46:0/1147065030 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb94018680 con 0x7fbba40731f0 2023-10-19T12:41:26.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.480+0000 7fbba99ff700 1 -- 172.21.15.46:0/1147065030 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbba41a0fb0 con 0x7fbba40731f0 2023-10-19T12:41:26.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.481+0000 7fbba99ff700 1 -- 172.21.15.46:0/1147065030 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbba4107420 con 0x7fbba40731f0 2023-10-19T12:41:26.490 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.483+0000 7fbba89fd700 1 -- 172.21.15.46:0/1147065030 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fbb940105a0 con 0x7fbba40731f0 2023-10-19T12:41:26.490 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.484+0000 7fbba89fd700 1 --2- 172.21.15.46:0/1147065030 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fbb8c0a1500 0x7fbb8c0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:26.490 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.485+0000 7fbba89fd700 1 -- 172.21.15.46:0/1147065030 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fbb94014070 con 0x7fbba40731f0 2023-10-19T12:41:26.491 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.485+0000 7fbba27fc700 1 --2- 172.21.15.46:0/1147065030 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fbb8c0a1500 0x7fbb8c0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:26.491 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.485+0000 7fbba27fc700 1 --2- 172.21.15.46:0/1147065030 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fbb8c0a1500 0x7fbb8c0a39c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fbb98009c60 tx=0x7fbb98009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:26.491 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.488+0000 7fbba89fd700 1 -- 172.21.15.46:0/1147065030 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fbb940964b0 con 0x7fbba40731f0 2023-10-19T12:41:26.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:26 smithi157 ceph-mon[134109]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2023-10-19T12:41:26.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:26 smithi157 ceph-mon[134109]: Cluster is now healthy 2023-10-19T12:41:26.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:26 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/602373775' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-19T12:41:26.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:26 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/3965637706' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-19T12:41:26.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:26 smithi195 ceph-mon[134493]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2023-10-19T12:41:26.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:26 smithi195 ceph-mon[134493]: Cluster is now healthy 2023-10-19T12:41:26.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:26 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/602373775' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-19T12:41:26.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:26 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/3965637706' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-19T12:41:26.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.703+0000 7fbba99ff700 1 -- 172.21.15.46:0/1147065030 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbba4067530 con 0x7fbba40731f0 2023-10-19T12:41:26.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.705+0000 7fbba89fd700 1 -- 172.21.15.46:0/1147065030 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+23953 (secure 0 0 0) 0x7fbb94099ad0 con 0x7fbba40731f0 2023-10-19T12:41:26.709 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:41:26.709 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":88,"fsid":"96a8be3c-6e7b-11ee-8db6-212e2dc638e7","created":"2023-10-19T12:33:26.148713+0000","modified":"2023-10-19T12:41:23.831907+0000","last_up_change":"2023-10-19T12:40:30.761679+0000","last_in_change":"2023-10-19T12:40:13.663559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-19T12:37:07.175795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-19T12:41:16.895203+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-19T12:41:18.255601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-19T12:41:21.830455+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"346ce86b-a10a-4869-9fdb-c3c1d4161455","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6803","nonce":500237995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6805","nonce":500237995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6809","nonce":500237995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6807","nonce":500237995}]},"public_addr":"172.21.15.46:6803/500237995","cluster_addr":"172.21.15.46:6805/500237995","heartbeat_back_addr":"172.21.15.46:6809/500237995","heartbeat_front_addr":"172.21.15.46:6807/500237995","state":["exists","up"]},{"osd":1,"uuid":"02aae687-76c5-4124-bae4-9787ed571c28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6801","nonce":2496862790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6803","nonce":2496862790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6807","nonce":2496862790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6805","nonce":2496862790}]},"public_addr":"172.21.15.157:6801/2496862790","cluster_addr":"172.21.15.157:6803/2496862790","heartbeat_back_addr":"172.21.15.157:6807/2496862790","heartbeat_front_addr":"172.21.15.157:6805/2496862790","state":["exists","up"]},{"osd":2,"uuid":"d5360828-1f58-4380-b2ad-0c21ff850981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6801","nonce":4211767276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6803","nonce":4211767276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6807","nonce":4211767276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6805","nonce":4211767276}]},"public_addr":"172.21.15.195:6801/4211767276","cluster_addr":"172.21.15.195:6803/4211767276","heartbeat_back_addr":"172.21.15.195:6807/4211767276","heartbeat_front_addr":"172.21.15.195:6805/4211767276","state":["exists","up"]},{"osd":3,"uuid":"accb780f-49d0-43f8-b166-ee12c558ef00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6811","nonce":1964113352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6813","nonce":1964113352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6817","nonce":1964113352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6815","nonce":1964113352}]},"public_addr":"172.21.15.46:6811/1964113352","cluster_addr":"172.21.15.46:6813/1964113352","heartbeat_back_addr":"172.21.15.46:6817/1964113352","heartbeat_front_addr":"172.21.15.46:6815/1964113352","state":["exists","up"]},{"osd":4,"uuid":"e662886d-e989-4d02-8c1f-3c4671352b0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6809","nonce":3636910144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6811","nonce":3636910144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6815","nonce":3636910144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6813","nonce":3636910144}]},"public_addr":"172.21.15.157:6809/3636910144","cluster_addr":"172.21.15.157:6811/3636910144","heartbeat_back_addr":"172.21.15.157:6815/3636910144","heartbeat_front_addr":"172.21.15.157:6813/3636910144","state":["exists","up"]},{"osd":5,"uuid":"9597e0ce-14ea-407d-90fe-f74bccee38b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6809","nonce":4071287969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6811","nonce":4071287969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6815","nonce":4071287969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6813","nonce":4071287969}]},"public_addr":"172.21.15.195:6809/4071287969","cluster_addr":"172.21.15.195:6811/4071287969","heartbeat_back_addr":"172.21.15.195:6815/4071287969","heartbeat_front_addr":"172.21.15.195:6813/4071287969","state":["exists","up"]},{"osd":6,"uuid":"6b78ba38-f60e-4cb6-b01c-cecc1820e8e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6819","nonce":1842285555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6821","nonce":1842285555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6825","nonce":1842285555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6823","nonce":1842285555}]},"public_addr":"172.21.15.46:6819/1842285555","cluster_addr":"172.21.15.46:6821/1842285555","heartbeat_back_addr":"172.21.15.46:6825/1842285555","heartbeat_front_addr":"172.21.15.46:6823/1842285555","state":["exists","up"]},{"osd":7,"uuid":"59a0899f-3bcd-4db2-b544-24df3a536749","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6817","nonce":3498672588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6819","nonce":3498672588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6823","nonce":3498672588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6821","nonce":3498672588}]},"public_addr":"172.21.15.157:6817/3498672588","cluster_addr":"172.21.15.157:6819/3498672588","heartbeat_back_addr":"172.21.15.157:6823/3498672588","heartbeat_front_addr":"172.21.15.157:6821/3498672588","state":["exists","up"]},{"osd":8,"uuid":"9c3c9835-043a-4fb5-a9ee-edf8caf6b605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6817","nonce":74230104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6819","nonce":74230104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6823","nonce":74230104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6821","nonce":74230104}]},"public_addr":"172.21.15.195:6817/74230104","cluster_addr":"172.21.15.195:6819/74230104","heartbeat_back_addr":"172.21.15.195:6823/74230104","heartbeat_front_addr":"172.21.15.195:6821/74230104","state":["exists","up"]},{"osd":9,"uuid":"3f18f506-a577-4b7c-ae0d-9351c07e81f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6827","nonce":3472581046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6829","nonce":3472581046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6833","nonce":3472581046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6831","nonce":3472581046}]},"public_addr":"172.21.15.46:6827/3472581046","cluster_addr":"172.21.15.46:6829/3472581046","heartbeat_back_addr":"172.21.15.46:6833/3472581046","heartbeat_front_addr":"172.21.15.46:6831/3472581046","state":["exists","up"]},{"osd":10,"uuid":"1ed01854-443a-4acf-9293-7ca0d451a93d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6825","nonce":2378416559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6827","nonce":2378416559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6831","nonce":2378416559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6829","nonce":2378416559}]},"public_addr":"172.21.15.157:6825/2378416559","cluster_addr":"172.21.15.157:6827/2378416559","heartbeat_back_addr":"172.21.15.157:6831/2378416559","heartbeat_front_addr":"172.21.15.157:6829/2378416559","state":["exists","up"]},{"osd":11,"uuid":"021398c0-9184-4647-8220-e40f6705ca90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6825","nonce":3075632222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6827","nonce":3075632222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6831","nonce":3075632222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6829","nonce":3075632222}]},"public_addr":"172.21.15.195:6825/3075632222","cluster_addr":"172.21.15.195:6827/3075632222","heartbeat_back_addr":"172.21.15.195:6831/3075632222","heartbeat_front_addr":"172.21.15.195:6829/3075632222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:36:22.002614+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:36:44.098031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:37:04.518341+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:37:30.796462+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:37:52.756555+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:38:13.403168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:38:39.058472+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:39:01.106893+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:39:21.908334+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:39:46.843884+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:40:08.792020+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:40:29.282974+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.46:0/3248595150":"2023-10-20T12:34:26.552115+0000","172.21.15.46:0/3624849341":"2023-10-20T12:34:26.552115+0000","172.21.15.46:0/1844094590":"2023-10-20T12:34:26.552115+0000","172.21.15.46:6801/20022894":"2023-10-20T12:34:26.552115+0000","172.21.15.46:0/3969790632":"2023-10-20T12:34:00.135248+0000","172.21.15.46:0/2331135821":"2023-10-20T12:34:00.135248+0000","172.21.15.46:6800/51664346":"2023-10-20T12:34:00.135248+0000","172.21.15.46:6801/51664346":"2023-10-20T12:34:00.135248+0000","172.21.15.46:0/585851467":"2023-10-20T12:34:00.135248+0000","172.21.15.46:6800/20022894":"2023-10-20T12:34:26.552115+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-19T12:41:26.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.707+0000 7fbba99ff700 1 -- 172.21.15.46:0/1147065030 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fbb8c0a1500 msgr2=0x7fbb8c0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:26.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.707+0000 7fbba99ff700 1 --2- 172.21.15.46:0/1147065030 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fbb8c0a1500 0x7fbb8c0a39c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fbb98009c60 tx=0x7fbb98009260 comp rx=0 tx=0).stop 2023-10-19T12:41:26.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.707+0000 7fbba99ff700 1 -- 172.21.15.46:0/1147065030 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbba40731f0 msgr2=0x7fbba4198970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:26.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.707+0000 7fbba99ff700 1 --2- 172.21.15.46:0/1147065030 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbba40731f0 0x7fbba4198970 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fbb9400e9a0 tx=0x7fbb9400ecb0 comp rx=0 tx=0).stop 2023-10-19T12:41:26.712 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.707+0000 7fbba99ff700 1 -- 172.21.15.46:0/1147065030 shutdown_connections 2023-10-19T12:41:26.712 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.707+0000 7fbba99ff700 1 --2- 172.21.15.46:0/1147065030 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fbb8c0a1500 0x7fbb8c0a39c0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:26.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.707+0000 7fbba99ff700 1 --2- 172.21.15.46:0/1147065030 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbba4108610 0x7fbba419fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:26.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.707+0000 7fbba99ff700 1 --2- 172.21.15.46:0/1147065030 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbba40731f0 0x7fbba4198970 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:26.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.707+0000 7fbba99ff700 1 --2- 172.21.15.46:0/1147065030 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbba40747d0 0x7fbba4198eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:26.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.707+0000 7fbba99ff700 1 -- 172.21.15.46:0/1147065030 >> 172.21.15.46:0/1147065030 conn(0x7fbba40fbc90 msgr2=0x7fbba4104560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:26.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.708+0000 7fbba99ff700 1 -- 172.21.15.46:0/1147065030 shutdown_connections 2023-10-19T12:41:26.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.708+0000 7fbba99ff700 1 -- 172.21.15.46:0/1147065030 wait complete. 2023-10-19T12:41:26.728 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:26 smithi046 ceph-mon[98509]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2023-10-19T12:41:26.728 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:26 smithi046 ceph-mon[98509]: Cluster is now healthy 2023-10-19T12:41:26.728 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:26 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/602373775' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-19T12:41:26.728 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:26 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/3965637706' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-19T12:41:26.731 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-19T12:41:18.815780+0000', 'modified': '2023-10-19T12:41:23.832102+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24680}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24680': {'gid': 24680, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.157:6839/552718978', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6838', 'nonce': 552718978}, {'type': 'v1', 'addr': '172.21.15.157:6839', 'nonce': 552718978}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-10-19T12:41:26.731 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-19T12:41:26.731 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-19T12:41:26.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.933+0000 7f0b9fdff700 1 -- 172.21.15.46:0/3242832819 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b981022b0 msgr2=0x7f0b98108b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:26.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.933+0000 7f0b9fdff700 1 --2- 172.21.15.46:0/3242832819 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b981022b0 0x7f0b98108b60 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0b9000b0d0 tx=0x7f0b9000b3e0 comp rx=0 tx=0).stop 2023-10-19T12:41:26.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.934+0000 7f0b9fdff700 1 -- 172.21.15.46:0/3242832819 shutdown_connections 2023-10-19T12:41:26.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.934+0000 7f0b9fdff700 1 --2- 172.21.15.46:0/3242832819 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b981022b0 0x7f0b98108b60 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:26.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.934+0000 7f0b9fdff700 1 --2- 172.21.15.46:0/3242832819 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b98100720 0x7f0b98100b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:26.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.934+0000 7f0b9fdff700 1 --2- 172.21.15.46:0/3242832819 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0b98101910 0x7f0b98101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:26.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.934+0000 7f0b9fdff700 1 -- 172.21.15.46:0/3242832819 >> 172.21.15.46:0/3242832819 conn(0x7f0b980fbc90 msgr2=0x7f0b980fe0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:26.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.934+0000 7f0b9fdff700 1 -- 172.21.15.46:0/3242832819 shutdown_connections 2023-10-19T12:41:26.939 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.934+0000 7f0b9fdff700 1 -- 172.21.15.46:0/3242832819 wait complete. 2023-10-19T12:41:26.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.935+0000 7f0b9fdff700 1 Processor -- start 2023-10-19T12:41:26.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.935+0000 7f0b9fdff700 1 -- start start 2023-10-19T12:41:26.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.935+0000 7f0b9fdff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b98100720 0x7f0b981967c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:26.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.935+0000 7f0b9fdff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b98101910 0x7f0b98196d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:26.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.935+0000 7f0b9fdff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0b981022b0 0x7f0b9819dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:26.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.935+0000 7f0b9fdff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9819e2f0 con 0x7f0b98100720 2023-10-19T12:41:26.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.935+0000 7f0b9fdff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9819e430 con 0x7f0b981022b0 2023-10-19T12:41:26.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.935+0000 7f0b9fdff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9819e5c0 con 0x7f0b98101910 2023-10-19T12:41:26.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.935+0000 7f0b9db9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b98100720 0x7f0b981967c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:26.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.935+0000 7f0b9db9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b98100720 0x7f0b981967c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41044/0 (socket says 172.21.15.46:41044) 2023-10-19T12:41:26.943 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.936+0000 7f0b9db9b700 1 -- 172.21.15.46:0/1532152979 learned_addr learned my addr 172.21.15.46:0/1532152979 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:41:26.943 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.936+0000 7f0b9d39a700 1 --2- 172.21.15.46:0/1532152979 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b98101910 0x7f0b98196d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:26.943 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.936+0000 7f0b9e39c700 1 --2- 172.21.15.46:0/1532152979 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0b981022b0 0x7f0b9819dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:26.943 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.936+0000 7f0b9db9b700 1 -- 172.21.15.46:0/1532152979 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b98101910 msgr2=0x7f0b98196d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:26.943 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.936+0000 7f0b9db9b700 1 --2- 172.21.15.46:0/1532152979 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b98101910 0x7f0b98196d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:26.944 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.936+0000 7f0b9db9b700 1 -- 172.21.15.46:0/1532152979 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0b981022b0 msgr2=0x7f0b9819dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:26.944 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.936+0000 7f0b9db9b700 1 --2- 172.21.15.46:0/1532152979 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0b981022b0 0x7f0b9819dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:26.944 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.936+0000 7f0b9db9b700 1 -- 172.21.15.46:0/1532152979 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b90009d00 con 0x7f0b98100720 2023-10-19T12:41:26.946 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.936+0000 7f0b9db9b700 1 --2- 172.21.15.46:0/1532152979 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b98100720 0x7f0b981967c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0b9400e970 tx=0x7f0b9400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:26.946 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.936+0000 7f0b8effd700 1 -- 172.21.15.46:0/1532152979 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b94009790 con 0x7f0b98100720 2023-10-19T12:41:26.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.936+0000 7f0b8effd700 1 -- 172.21.15.46:0/1532152979 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0b9400c7e0 con 0x7f0b98100720 2023-10-19T12:41:26.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.936+0000 7f0b9fdff700 1 -- 172.21.15.46:0/1532152979 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b9819e8a0 con 0x7f0b98100720 2023-10-19T12:41:26.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.936+0000 7f0b8effd700 1 -- 172.21.15.46:0/1532152979 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b94003c70 con 0x7f0b98100720 2023-10-19T12:41:26.948 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.937+0000 7f0b9fdff700 1 -- 172.21.15.46:0/1532152979 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b9819ee00 con 0x7f0b98100720 2023-10-19T12:41:26.954 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.940+0000 7f0b8effd700 1 -- 172.21.15.46:0/1532152979 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f0b9400cc50 con 0x7f0b98100720 2023-10-19T12:41:26.955 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.941+0000 7f0bb36b2b80 1 Processor -- start 2023-10-19T12:41:26.955 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.941+0000 7f0bb36b2b80 1 -- start start 2023-10-19T12:41:26.955 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.941+0000 7f0b8effd700 1 --2- 172.21.15.46:0/1532152979 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f0b840a1500 0x7f0b840a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:26.956 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.942+0000 7f0bb36b2b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5557e860e6b0 0x5557e860ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:26.956 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.942+0000 7f0bb36b2b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5557e860f010 0x5557e860d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:26.956 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.942+0000 7f0bb36b2b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5557e860d990 0x5557e860de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:26.957 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.942+0000 7f0b8effd700 1 -- 172.21.15.46:0/1532152979 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f0b94014070 con 0x7f0b98100720 2023-10-19T12:41:26.958 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.942+0000 7f0b9e39c700 1 --2- 172.21.15.46:0/1532152979 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f0b840a1500 0x7f0b840a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:26.958 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.942+0000 7f0bb36b2b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557e857c690 con 0x5557e860e6b0 2023-10-19T12:41:26.958 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.942+0000 7f0bb36b2b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557e8562c10 con 0x5557e860f010 2023-10-19T12:41:26.959 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.942+0000 7f0bb36b2b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557e8560530 con 0x5557e860d990 2023-10-19T12:41:26.959 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.942+0000 7f0b9db9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5557e860e6b0 0x5557e860ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:26.959 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.942+0000 7f0b9db9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5557e860e6b0 0x5557e860ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41060/0 (socket says 172.21.15.46:41060) 2023-10-19T12:41:26.960 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.942+0000 7f0b9db9b700 1 -- 172.21.15.46:0/1622668674 learned_addr learned my addr 172.21.15.46:0/1622668674 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:41:26.960 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.942+0000 7f0b9d39a700 1 --2- 172.21.15.46:0/1622668674 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5557e860f010 0x5557e860d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:26.961 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.942+0000 7f0b9e39c700 1 --2- 172.21.15.46:0/1622668674 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5557e860d990 0x5557e860de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:26.961 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.942+0000 7f0b9db9b700 1 -- 172.21.15.46:0/1622668674 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5557e860d990 msgr2=0x5557e860de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:41:26.962 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.942+0000 7f0b9db9b700 1 --2- 172.21.15.46:0/1622668674 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5557e860d990 0x5557e860de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:26.962 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.942+0000 7f0b9db9b700 1 -- 172.21.15.46:0/1622668674 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5557e860f010 msgr2=0x5557e860d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:41:26.962 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.942+0000 7f0b9db9b700 1 --2- 172.21.15.46:0/1622668674 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5557e860f010 0x5557e860d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:26.962 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.942+0000 7f0b9db9b700 1 -- 172.21.15.46:0/1622668674 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5557e85193a0 con 0x5557e860e6b0 2023-10-19T12:41:26.963 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.943+0000 7f0b9e39c700 1 --2- 172.21.15.46:0/1532152979 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f0b840a1500 0x7f0b840a39c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0b90009fd0 tx=0x7f0b90009340 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:26.963 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.943+0000 7f0b9db9b700 1 --2- 172.21.15.46:0/1622668674 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5557e860e6b0 0x5557e860ead0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0b94096bc0 tx=0x7f0b9400cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=984e026bf1cca0b server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:26.964 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.943+0000 7f0b83fff700 1 -- 172.21.15.46:0/1622668674 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b940b1070 con 0x5557e860e6b0 2023-10-19T12:41:26.964 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.943+0000 7f0b83fff700 1 -- 172.21.15.46:0/1622668674 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0b9409a150 con 0x5557e860e6b0 2023-10-19T12:41:26.964 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.943+0000 7f0b83fff700 1 -- 172.21.15.46:0/1622668674 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b940cab10 con 0x5557e860e6b0 2023-10-19T12:41:26.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.944+0000 7f0bb36b2b80 1 -- 172.21.15.46:0/1622668674 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5557e860e6b0 msgr2=0x5557e860ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:26.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.944+0000 7f0bb36b2b80 1 --2- 172.21.15.46:0/1622668674 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5557e860e6b0 0x5557e860ead0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0b94096bc0 tx=0x7f0b9400cf50 comp rx=0 tx=0).stop 2023-10-19T12:41:26.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.944+0000 7f0bb36b2b80 1 -- 172.21.15.46:0/1622668674 shutdown_connections 2023-10-19T12:41:26.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.944+0000 7f0bb36b2b80 1 --2- 172.21.15.46:0/1622668674 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5557e860d990 0x5557e860de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:26.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.944+0000 7f0bb36b2b80 1 --2- 172.21.15.46:0/1622668674 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5557e860e6b0 0x5557e860ead0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:26.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.944+0000 7f0bb36b2b80 1 --2- 172.21.15.46:0/1622668674 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5557e860f010 0x5557e860d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:26.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.944+0000 7f0bb36b2b80 1 -- 172.21.15.46:0/1622668674 >> 172.21.15.46:0/1622668674 conn(0x5557e857d6d0 msgr2=0x5557e8603b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:26.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.944+0000 7f0bb36b2b80 1 -- 172.21.15.46:0/1622668674 shutdown_connections 2023-10-19T12:41:26.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.944+0000 7f0bb36b2b80 1 -- 172.21.15.46:0/1622668674 wait complete. 2023-10-19T12:41:26.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.944+0000 7f0bb36b2b80 1 -- start start 2023-10-19T12:41:26.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.945+0000 7f0bb36b2b80 1 Processor -- start 2023-10-19T12:41:26.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.945+0000 7f0bb36b2b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5557e860d990 0x5557e8616ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:26.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.945+0000 7f0bb36b2b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5557e860e6b0 0x5557e8617420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:26.970 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.945+0000 7f0bb36b2b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5557e860f010 0x5557e861e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:26.970 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.945+0000 7f0bb36b2b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557e855be20 con 0x5557e860d990 2023-10-19T12:41:26.970 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.945+0000 7f0bb36b2b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557e84f86c0 con 0x5557e860f010 2023-10-19T12:41:26.971 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.945+0000 7f0bb36b2b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557e84f8360 con 0x5557e860e6b0 2023-10-19T12:41:26.972 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.945+0000 7f0bb36b2b80 10 client.0 _ll_register_callbacks cb 0x5557e8442a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:41:26.972 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.945+0000 7f0b9db9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5557e860d990 0x5557e8616ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:26.972 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.945+0000 7f0b9db9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5557e860d990 0x5557e8616ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41070/0 (socket says 172.21.15.46:41070) 2023-10-19T12:41:26.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.945+0000 7f0b9db9b700 1 -- 172.21.15.46:0/1764819692 learned_addr learned my addr 172.21.15.46:0/1764819692 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:41:26.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.945+0000 7f0b9e39c700 1 --2- 172.21.15.46:0/1764819692 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5557e860f010 0x5557e861e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:26.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.945+0000 7f0b9d39a700 1 --2- 172.21.15.46:0/1764819692 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5557e860e6b0 0x5557e8617420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:26.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.946+0000 7f0b9db9b700 1 -- 172.21.15.46:0/1764819692 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5557e860e6b0 msgr2=0x5557e8617420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:41:26.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.946+0000 7f0b9db9b700 1 --2- 172.21.15.46:0/1764819692 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5557e860e6b0 0x5557e8617420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:26.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.946+0000 7f0b9db9b700 1 -- 172.21.15.46:0/1764819692 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5557e860f010 msgr2=0x5557e861e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:41:26.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.946+0000 7f0b9db9b700 1 --2- 172.21.15.46:0/1764819692 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5557e860f010 0x5557e861e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:26.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.946+0000 7f0b9db9b700 1 -- 172.21.15.46:0/1764819692 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b9819ee00 con 0x5557e860d990 2023-10-19T12:41:26.976 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.946+0000 7f0b9db9b700 1 --2- 172.21.15.46:0/1764819692 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5557e860d990 0x5557e8616ee0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f0b940a1fb0 tx=0x7f0b9409e2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dafe7fb18912e7e server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:26.976 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.946+0000 7f0b817fa700 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2023-10-19T12:41:26.976 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.946+0000 7f0b817fa700 1 -- 172.21.15.46:0/1764819692 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b940b1030 con 0x5557e860d990 2023-10-19T12:41:26.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.946+0000 7f0b817fa700 1 -- 172.21.15.46:0/1764819692 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f0b940b2070 con 0x5557e860d990 2023-10-19T12:41:26.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.946+0000 7f0bb36b2b80 1 -- 172.21.15.46:0/1764819692 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5557e8560ea0 con 0x5557e860d990 2023-10-19T12:41:26.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.946+0000 7f0b817fa700 1 -- 172.21.15.46:0/1764819692 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0b940caab0 con 0x5557e860d990 2023-10-19T12:41:26.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.946+0000 7f0bb36b2b80 10 client.14769 fetch_fsmap learned FSMap version 17 2023-10-19T12:41:26.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.946+0000 7f0bb36b2b80 1 -- 172.21.15.46:0/1764819692 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) v3 -- 0x5557e8386d90 con 0x5557e860d990 2023-10-19T12:41:26.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.947+0000 7f0b817fa700 1 -- 172.21.15.46:0/1764819692 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5557e8560ea0 con 0x5557e860d990 2023-10-19T12:41:26.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.947+0000 7f0b817fa700 1 -- 172.21.15.46:0/1764819692 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 17) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f0b940a2170 con 0x5557e860d990 2023-10-19T12:41:26.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.947+0000 7f0bb36b2b80 10 client.14769 fetch_fsmap finished waiting for FSMap version 17 2023-10-19T12:41:26.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.947+0000 7f0bb36b2b80 10 client.14769 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-19T12:41:26.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.947+0000 7f0bb36b2b80 20 client.14769 populate_metadata read hostname 'smithi046' 2023-10-19T12:41:26.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.947+0000 7f0bb36b2b80 1 --2- 172.21.15.46:0/1764819692 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x5557e86227f0 0x5557e8621430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:26.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.947+0000 7f0bb36b2b80 4 client.14769 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-19T12:41:26.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.947+0000 7f0bb36b2b80 1 -- 172.21.15.46:0/1764819692 --> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5557e85d8860 con 0x5557e86227f0 2023-10-19T12:41:26.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.947+0000 7f0b9d39a700 1 --2- 172.21.15.46:0/1764819692 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x5557e86227f0 0x5557e8621430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:26.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.948+0000 7f0b9d39a700 1 --2- 172.21.15.46:0/1764819692 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x5557e86227f0 0x5557e8621430 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7cda598f52f41a4b server_cookie=3020b99e28723656 in_seq=0 out_seq=0 2023-10-19T12:41:26.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.948+0000 7f0b817fa700 10 client.14769 ms_handle_connect on v2:172.21.15.157:6838/552718978 2023-10-19T12:41:26.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.949+0000 7f0b817fa700 1 -- 172.21.15.46:0/1764819692 <== mds.0 v2:172.21.15.157:6838/552718978 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5557e85d8860 con 0x5557e86227f0 2023-10-19T12:41:26.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.949+0000 7f0b817fa700 10 client.14769 handle_command_reply: tid=0 2023-10-19T12:41:26.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.949+0000 7f0bb36b2b80 1 client.14769 shutdown 2023-10-19T12:41:26.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.949+0000 7f0bb36b2b80 1 -- 172.21.15.46:0/1764819692 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5557e860d990 msgr2=0x5557e8616ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:26.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.949+0000 7f0bb36b2b80 1 --2- 172.21.15.46:0/1764819692 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5557e860d990 0x5557e8616ee0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f0b940a1fb0 tx=0x7f0b9409e2a0 comp rx=0 tx=0).stop 2023-10-19T12:41:26.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.949+0000 7f0bb36b2b80 1 -- 172.21.15.46:0/1764819692 shutdown_connections 2023-10-19T12:41:26.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.949+0000 7f0bb36b2b80 1 --2- 172.21.15.46:0/1764819692 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5557e860f010 0x5557e861e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:26.990 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.949+0000 7f0bb36b2b80 1 --2- 172.21.15.46:0/1764819692 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x5557e86227f0 0x5557e8621430 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:26.990 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.949+0000 7f0bb36b2b80 1 --2- 172.21.15.46:0/1764819692 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5557e860d990 0x5557e8616ee0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:26.990 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.949+0000 7f0bb36b2b80 1 --2- 172.21.15.46:0/1764819692 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5557e860e6b0 0x5557e8617420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:26.990 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.949+0000 7f0b817fa700 0 client.14769 ms_handle_reset on v2:172.21.15.157:6838/552718978 2023-10-19T12:41:26.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.949+0000 7f0bb36b2b80 1 -- 172.21.15.46:0/1764819692 >> 172.21.15.46:0/1764819692 conn(0x5557e857d6d0 msgr2=0x5557e8608030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:26.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.949+0000 7f0bb36b2b80 1 -- 172.21.15.46:0/1764819692 shutdown_connections 2023-10-19T12:41:26.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.949+0000 7f0bb36b2b80 1 -- 172.21.15.46:0/1764819692 wait complete. 2023-10-19T12:41:26.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.949+0000 7f0bb36b2b80 20 client.14769 trim_cache size 0 max 16384 2023-10-19T12:41:26.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.968+0000 7f0bb36b2b80 1 Processor -- start 2023-10-19T12:41:26.992 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.968+0000 7f0bb36b2b80 1 -- start start 2023-10-19T12:41:26.992 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.968+0000 7f0bb36b2b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5557e860d990 0x5557e8614f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:26.992 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.968+0000 7f0bb36b2b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5557e860e6b0 0x5557e861e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:26.993 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.968+0000 7f0bb36b2b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5557e860f010 0x5557e860dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:26.993 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.968+0000 7f0bb36b2b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557e83dc8d0 con 0x5557e860e6b0 2023-10-19T12:41:26.993 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.968+0000 7f0bb36b2b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557e85d8860 con 0x5557e860f010 2023-10-19T12:41:26.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.968+0000 7f0bb36b2b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557e8560ea0 con 0x5557e860d990 2023-10-19T12:41:26.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.968+0000 7f0b9d39a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5557e860e6b0 0x5557e861e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:26.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.968+0000 7f0b9d39a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5557e860e6b0 0x5557e861e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41078/0 (socket says 172.21.15.46:41078) 2023-10-19T12:41:26.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.968+0000 7f0b9d39a700 1 -- 172.21.15.46:0/1027761335 learned_addr learned my addr 172.21.15.46:0/1027761335 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:41:26.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.968+0000 7f0b9e39c700 1 --2- 172.21.15.46:0/1027761335 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5557e860f010 0x5557e860dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:26.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.969+0000 7f0b9db9b700 1 --2- 172.21.15.46:0/1027761335 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5557e860d990 0x5557e8614f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:26.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.969+0000 7f0b9d39a700 1 -- 172.21.15.46:0/1027761335 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5557e860d990 msgr2=0x5557e8614f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:41:26.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.969+0000 7f0b9d39a700 1 --2- 172.21.15.46:0/1027761335 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5557e860d990 0x5557e8614f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:26.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.969+0000 7f0b9d39a700 1 -- 172.21.15.46:0/1027761335 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5557e860f010 msgr2=0x5557e860dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:41:26.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.969+0000 7f0b9d39a700 1 --2- 172.21.15.46:0/1027761335 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5557e860f010 0x5557e860dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:26.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.969+0000 7f0b9d39a700 1 -- 172.21.15.46:0/1027761335 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5557e836fc10 con 0x5557e860e6b0 2023-10-19T12:41:26.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.969+0000 7f0b9d39a700 1 --2- 172.21.15.46:0/1027761335 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5557e860e6b0 0x5557e861e420 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0b88005d90 tx=0x7f0b88009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e79ec14430cd6960 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:26.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.969+0000 7f0b8cbff700 1 -- 172.21.15.46:0/1027761335 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b88017070 con 0x5557e860e6b0 2023-10-19T12:41:26.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.969+0000 7f0b8cbff700 1 -- 172.21.15.46:0/1027761335 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0b88018040 con 0x5557e860e6b0 2023-10-19T12:41:26.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.969+0000 7f0b8cbff700 1 -- 172.21.15.46:0/1027761335 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b8801d840 con 0x5557e860e6b0 2023-10-19T12:41:26.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.970+0000 7f0bb36b2b80 1 -- 172.21.15.46:0/1027761335 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5557e860e6b0 msgr2=0x5557e861e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:26.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.970+0000 7f0bb36b2b80 1 --2- 172.21.15.46:0/1027761335 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5557e860e6b0 0x5557e861e420 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0b88005d90 tx=0x7f0b88009260 comp rx=0 tx=0).stop 2023-10-19T12:41:26.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.970+0000 7f0bb36b2b80 1 -- 172.21.15.46:0/1027761335 shutdown_connections 2023-10-19T12:41:26.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.970+0000 7f0bb36b2b80 1 --2- 172.21.15.46:0/1027761335 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5557e860f010 0x5557e860dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:26.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.970+0000 7f0bb36b2b80 1 --2- 172.21.15.46:0/1027761335 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5557e860d990 0x5557e8614f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:27.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.970+0000 7f0bb36b2b80 1 --2- 172.21.15.46:0/1027761335 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5557e860e6b0 0x5557e861e420 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:27.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.970+0000 7f0bb36b2b80 1 -- 172.21.15.46:0/1027761335 >> 172.21.15.46:0/1027761335 conn(0x5557e857d6d0 msgr2=0x5557e862b150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:27.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.970+0000 7f0bb36b2b80 1 -- 172.21.15.46:0/1027761335 shutdown_connections 2023-10-19T12:41:27.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.970+0000 7f0bb36b2b80 1 -- 172.21.15.46:0/1027761335 wait complete. 2023-10-19T12:41:27.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.970+0000 7f0bb36b2b80 1 -- start start 2023-10-19T12:41:27.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.970+0000 7f0bb36b2b80 1 Processor -- start 2023-10-19T12:41:27.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.971+0000 7f0bb36b2b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5557e860d990 0x5557e861e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:27.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.971+0000 7f0bb36b2b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5557e860e6b0 0x5557e861acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:27.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.971+0000 7f0bb36b2b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5557e860f010 0x5557e861b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:27.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.971+0000 7f0bb36b2b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557e861b750 con 0x5557e860f010 2023-10-19T12:41:27.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.971+0000 7f0bb36b2b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557e861b8c0 con 0x5557e860e6b0 2023-10-19T12:41:27.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.971+0000 7f0bb36b2b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557e861ba30 con 0x5557e860d990 2023-10-19T12:41:27.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.971+0000 7f0bb36b2b80 10 client.0 _ll_register_callbacks cb 0x5557e8442a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:41:27.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.971+0000 7f0b9e39c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5557e860f010 0x5557e861b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:27.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.971+0000 7f0b9d39a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5557e860e6b0 0x5557e861acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:27.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.971+0000 7f0b9db9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5557e860d990 0x5557e861e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:27.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.971+0000 7f0b9e39c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5557e860f010 0x5557e861b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41088/0 (socket says 172.21.15.46:41088) 2023-10-19T12:41:27.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.971+0000 7f0b9e39c700 1 -- 172.21.15.46:0/726263180 learned_addr learned my addr 172.21.15.46:0/726263180 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:41:27.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.972+0000 7f0b9e39c700 1 -- 172.21.15.46:0/726263180 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5557e860d990 msgr2=0x5557e861e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:41:27.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.972+0000 7f0b9e39c700 1 --2- 172.21.15.46:0/726263180 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5557e860d990 0x5557e861e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:27.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.972+0000 7f0b9e39c700 1 -- 172.21.15.46:0/726263180 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5557e860e6b0 msgr2=0x5557e861acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:41:27.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.972+0000 7f0b9e39c700 1 --2- 172.21.15.46:0/726263180 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5557e860e6b0 0x5557e861acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:27.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.972+0000 7f0b9e39c700 1 -- 172.21.15.46:0/726263180 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b88009b30 con 0x5557e860f010 2023-10-19T12:41:27.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.972+0000 7f0b9db9b700 1 --2- 172.21.15.46:0/726263180 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5557e860d990 0x5557e861e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:41:27.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.972+0000 7f0b9e39c700 1 --2- 172.21.15.46:0/726263180 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5557e860f010 0x5557e861b210 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0b9000b0d0 tx=0x7f0b9000b3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20ecf832c7823b2b server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:27.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.972+0000 7f0b817fa700 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2023-10-19T12:41:27.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.972+0000 7f0b817fa700 1 -- 172.21.15.46:0/726263180 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b9000e040 con 0x5557e860f010 2023-10-19T12:41:27.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.972+0000 7f0bb36b2b80 1 -- 172.21.15.46:0/726263180 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0b9409a150 con 0x5557e860f010 2023-10-19T12:41:27.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.972+0000 7f0b817fa700 1 -- 172.21.15.46:0/726263180 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f0b9001ea90 con 0x5557e860f010 2023-10-19T12:41:27.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.972+0000 7f0b817fa700 1 -- 172.21.15.46:0/726263180 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0b9001ec90 con 0x5557e860f010 2023-10-19T12:41:27.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.973+0000 7f0bb36b2b80 10 client.14775 fetch_fsmap learned FSMap version 17 2023-10-19T12:41:27.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.973+0000 7f0bb36b2b80 1 -- 172.21.15.46:0/726263180 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) v3 -- 0x5557e83ad200 con 0x5557e860f010 2023-10-19T12:41:27.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.973+0000 7f0b817fa700 1 -- 172.21.15.46:0/726263180 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0b9409a150 con 0x5557e860f010 2023-10-19T12:41:27.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.973+0000 7f0b817fa700 1 -- 172.21.15.46:0/726263180 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 17) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f0b90034430 con 0x5557e860f010 2023-10-19T12:41:27.013 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.973+0000 7f0bb36b2b80 10 client.14775 fetch_fsmap finished waiting for FSMap version 17 2023-10-19T12:41:27.013 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.973+0000 7f0bb36b2b80 10 client.14775 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-19T12:41:27.013 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.973+0000 7f0bb36b2b80 20 client.14775 populate_metadata read hostname 'smithi046' 2023-10-19T12:41:27.014 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.973+0000 7f0bb36b2b80 1 --2- 172.21.15.46:0/726263180 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x5557e867b510 0x5557e8677970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:27.014 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.973+0000 7f0bb36b2b80 4 client.14775 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-19T12:41:27.015 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.973+0000 7f0bb36b2b80 1 -- 172.21.15.46:0/726263180 --> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5557e8554e00 con 0x5557e867b510 2023-10-19T12:41:27.015 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.973+0000 7f0b9db9b700 1 --2- 172.21.15.46:0/726263180 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x5557e867b510 0x5557e8677970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:27.015 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.974+0000 7f0b9db9b700 1 --2- 172.21.15.46:0/726263180 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x5557e867b510 0x5557e8677970 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd9454695415c65c server_cookie=bd7ac6bf9934830d in_seq=0 out_seq=0 2023-10-19T12:41:27.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.974+0000 7f0b817fa700 10 client.14775 ms_handle_connect on v2:172.21.15.157:6838/552718978 2023-10-19T12:41:27.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.974+0000 7f0b817fa700 1 -- 172.21.15.46:0/726263180 <== mds.0 v2:172.21.15.157:6838/552718978 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x5557e8554e00 con 0x5557e867b510 2023-10-19T12:41:27.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.974+0000 7f0b817fa700 10 client.14775 handle_command_reply: tid=0 2023-10-19T12:41:27.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.974+0000 7f0bb36b2b80 1 client.14775 shutdown 2023-10-19T12:41:27.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.974+0000 7f0bb36b2b80 1 -- 172.21.15.46:0/726263180 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5557e860f010 msgr2=0x5557e861b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:27.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.974+0000 7f0bb36b2b80 1 --2- 172.21.15.46:0/726263180 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5557e860f010 0x5557e861b210 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0b9000b0d0 tx=0x7f0b9000b3e0 comp rx=0 tx=0).stop 2023-10-19T12:41:27.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.974+0000 7f0bb36b2b80 1 -- 172.21.15.46:0/726263180 shutdown_connections 2023-10-19T12:41:27.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.974+0000 7f0bb36b2b80 1 --2- 172.21.15.46:0/726263180 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x5557e867b510 0x5557e8677970 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:27.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.974+0000 7f0bb36b2b80 1 --2- 172.21.15.46:0/726263180 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5557e860f010 0x5557e861b210 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:27.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.974+0000 7f0bb36b2b80 1 --2- 172.21.15.46:0/726263180 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5557e860d990 0x5557e861e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:27.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.974+0000 7f0b817fa700 0 client.14775 ms_handle_reset on v2:172.21.15.157:6838/552718978 2023-10-19T12:41:27.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.974+0000 7f0bb36b2b80 1 --2- 172.21.15.46:0/726263180 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5557e860e6b0 0x5557e861acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:27.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.974+0000 7f0bb36b2b80 1 -- 172.21.15.46:0/726263180 >> 172.21.15.46:0/726263180 conn(0x5557e857d6d0 msgr2=0x5557e860dd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:27.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.975+0000 7f0bb36b2b80 1 -- 172.21.15.46:0/726263180 shutdown_connections 2023-10-19T12:41:27.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.975+0000 7f0bb36b2b80 1 -- 172.21.15.46:0/726263180 wait complete. 2023-10-19T12:41:27.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.975+0000 7f0bb36b2b80 20 client.14775 trim_cache size 0 max 16384 2023-10-19T12:41:27.022 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-10-19T12:41:27.022 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_fsid": "96a8be3c-6e7b-11ee-8db6-212e2dc638e7", 2023-10-19T12:41:27.023 INFO:teuthology.orchestra.run.smithi046.stdout: "whoami": 0, 2023-10-19T12:41:27.023 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 24680, 2023-10-19T12:41:27.024 INFO:teuthology.orchestra.run.smithi046.stdout: "want_state": "up:active", 2023-10-19T12:41:27.024 INFO:teuthology.orchestra.run.smithi046.stdout: "state": "up:active", 2023-10-19T12:41:27.024 INFO:teuthology.orchestra.run.smithi046.stdout: "fs_name": "cephfs", 2023-10-19T12:41:27.025 INFO:teuthology.orchestra.run.smithi046.stdout: "rank_uptime": 7.7078991520000004, 2023-10-19T12:41:27.025 INFO:teuthology.orchestra.run.smithi046.stdout: "mdsmap_epoch": 17, 2023-10-19T12:41:27.026 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch": 88, 2023-10-19T12:41:27.026 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch_barrier": 88, 2023-10-19T12:41:27.026 INFO:teuthology.orchestra.run.smithi046.stdout: "uptime": 14.734351440999999 2023-10-19T12:41:27.027 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-10-19T12:41:27.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.975+0000 7f0b9fdff700 1 -- 172.21.15.46:0/1532152979 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f0b840a1500 msgr2=0x7f0b840a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:27.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.975+0000 7f0b9fdff700 1 --2- 172.21.15.46:0/1532152979 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f0b840a1500 0x7f0b840a39c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0b90009fd0 tx=0x7f0b90009340 comp rx=0 tx=0).stop 2023-10-19T12:41:27.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.975+0000 7f0b9fdff700 1 -- 172.21.15.46:0/1532152979 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b98100720 msgr2=0x7f0b981967c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:27.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.975+0000 7f0b9fdff700 1 --2- 172.21.15.46:0/1532152979 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b98100720 0x7f0b981967c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0b9400e970 tx=0x7f0b9400ec80 comp rx=0 tx=0).stop 2023-10-19T12:41:27.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.976+0000 7f0b9fdff700 1 -- 172.21.15.46:0/1532152979 shutdown_connections 2023-10-19T12:41:27.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.976+0000 7f0b9fdff700 1 --2- 172.21.15.46:0/1532152979 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0b981022b0 0x7f0b9819dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:27.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.976+0000 7f0b9fdff700 1 --2- 172.21.15.46:0/1532152979 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b98100720 0x7f0b981967c0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:27.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.976+0000 7f0b9fdff700 1 --2- 172.21.15.46:0/1532152979 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f0b840a1500 0x7f0b840a39c0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:27.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.976+0000 7f0b9fdff700 1 --2- 172.21.15.46:0/1532152979 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b98101910 0x7f0b98196d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:27.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.976+0000 7f0b9fdff700 1 -- 172.21.15.46:0/1532152979 >> 172.21.15.46:0/1532152979 conn(0x7f0b980fbc90 msgr2=0x7f0b98104c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:27.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.976+0000 7f0b9fdff700 1 -- 172.21.15.46:0/1532152979 shutdown_connections 2023-10-19T12:41:27.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:26.976+0000 7f0b9fdff700 1 -- 172.21.15.46:0/1532152979 wait complete. 2023-10-19T12:41:27.033 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-19T12:41:27.034 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-10-19T12:41:27.035 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph fs ls 2023-10-19T12:41:27.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:27 smithi157 ceph-mon[134109]: pgmap v288: 129 pgs: 1 creating+peering, 8 unknown, 120 active+clean; 579 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 1 op/s 2023-10-19T12:41:27.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:27 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/1147065030' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-19T12:41:27.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:27 smithi195 ceph-mon[134493]: pgmap v288: 129 pgs: 1 creating+peering, 8 unknown, 120 active+clean; 579 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 1 op/s 2023-10-19T12:41:27.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:27 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/1147065030' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-19T12:41:27.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:27 smithi046 ceph-mon[98509]: pgmap v288: 129 pgs: 1 creating+peering, 8 unknown, 120 active+clean; 579 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 1 op/s 2023-10-19T12:41:27.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:27 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/1147065030' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-19T12:41:27.783 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-19T12:41:29.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:29.302+0000 7f2c45d06700 1 -- 172.21.15.46:0/4000005313 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2c401057c0 msgr2=0x7f2c40105ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:29.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:29.302+0000 7f2c45d06700 1 --2- 172.21.15.46:0/4000005313 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2c401057c0 0x7f2c40105ba0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2c30009990 tx=0x7f2c30009ca0 comp rx=0 tx=0).stop 2023-10-19T12:41:29.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:29.302+0000 7f2c45d06700 1 -- 172.21.15.46:0/4000005313 shutdown_connections 2023-10-19T12:41:29.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:29.302+0000 7f2c45d06700 1 --2- 172.21.15.46:0/4000005313 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2c40101260 0x7f2c4010d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:29.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:29.302+0000 7f2c45d06700 1 --2- 172.21.15.46:0/4000005313 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2c401057c0 0x7f2c40105ba0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:29.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:29.302+0000 7f2c45d06700 1 --2- 172.21.15.46:0/4000005313 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2c401008a0 0x7f2c40100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:29.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:29.302+0000 7f2c45d06700 1 -- 172.21.15.46:0/4000005313 >> 172.21.15.46:0/4000005313 conn(0x7f2c400779e0 msgr2=0x7f2c40077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:29.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:29.302+0000 7f2c45d06700 1 -- 172.21.15.46:0/4000005313 shutdown_connections 2023-10-19T12:41:29.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:29.303+0000 7f2c45d06700 1 -- 172.21.15.46:0/4000005313 wait complete. 2023-10-19T12:41:29.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:29.304+0000 7f2c45d06700 1 Processor -- start 2023-10-19T12:41:29.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:29.304+0000 7f2c45d06700 1 -- start start 2023-10-19T12:41:29.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:29.304+0000 7f2c45d06700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2c401008a0 0x7f2c4019c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:29.311 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:29.304+0000 7f2c45d06700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2c40101260 0x7f2c4019ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:29.311 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:29.304+0000 7f2c45d06700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2c401057c0 0x7f2c40196a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:29.311 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:29.304+0000 7f2c45d06700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c401970b0 con 0x7f2c40101260 2023-10-19T12:41:29.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:29.304+0000 7f2c45d06700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c40197220 con 0x7f2c401008a0 2023-10-19T12:41:29.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:29.304+0000 7f2c45d06700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c401973e0 con 0x7f2c401057c0 2023-10-19T12:41:29.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:29.304+0000 7f2c3effd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2c40101260 0x7f2c4019ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:29.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:29.304+0000 7f2c3effd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2c40101260 0x7f2c4019ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41120/0 (socket says 172.21.15.46:41120) 2023-10-19T12:41:29.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:29.305+0000 7f2c3effd700 1 -- 172.21.15.46:0/1621686261 learned_addr learned my addr 172.21.15.46:0/1621686261 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:41:29.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:29.305+0000 7f2c3f7fe700 1 --2- 172.21.15.46:0/1621686261 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2c401008a0 0x7f2c4019c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:29.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:29.305+0000 7f2c3ffff700 1 --2- 172.21.15.46:0/1621686261 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2c401057c0 0x7f2c40196a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:29.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:29.305+0000 7f2c3effd700 1 -- 172.21.15.46:0/1621686261 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2c401057c0 msgr2=0x7f2c40196a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:29.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:29.305+0000 7f2c3effd700 1 --2- 172.21.15.46:0/1621686261 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2c401057c0 0x7f2c40196a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:29.314 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:29.305+0000 7f2c3effd700 1 -- 172.21.15.46:0/1621686261 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2c401008a0 msgr2=0x7f2c4019c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:29.314 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:29.305+0000 7f2c3effd700 1 --2- 172.21.15.46:0/1621686261 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2c401008a0 0x7f2c4019c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:29.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:29.305+0000 7f2c3effd700 1 -- 172.21.15.46:0/1621686261 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c300095f0 con 0x7f2c40101260 2023-10-19T12:41:29.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:29.305+0000 7f2c3f7fe700 1 --2- 172.21.15.46:0/1621686261 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2c401008a0 0x7f2c4019c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:41:29.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:29.305+0000 7f2c3effd700 1 --2- 172.21.15.46:0/1621686261 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2c40101260 0x7f2c4019ce50 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2c3400e9a0 tx=0x7f2c3400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:29.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:29.305+0000 7f2c3cff9700 1 -- 172.21.15.46:0/1621686261 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c34009790 con 0x7f2c40101260 2023-10-19T12:41:29.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:29.305+0000 7f2c3cff9700 1 -- 172.21.15.46:0/1621686261 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2c34010430 con 0x7f2c40101260 2023-10-19T12:41:29.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:29.305+0000 7f2c3cff9700 1 -- 172.21.15.46:0/1621686261 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c34018680 con 0x7f2c40101260 2023-10-19T12:41:29.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:29.305+0000 7f2c45d06700 1 -- 172.21.15.46:0/1621686261 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c401976c0 con 0x7f2c40101260 2023-10-19T12:41:29.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:29.306+0000 7f2c45d06700 1 -- 172.21.15.46:0/1621686261 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c401a3900 con 0x7f2c40101260 2023-10-19T12:41:29.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:29.307+0000 7f2c45d06700 1 -- 172.21.15.46:0/1621686261 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c40108d80 con 0x7f2c40101260 2023-10-19T12:41:29.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:29.309+0000 7f2c3cff9700 1 -- 172.21.15.46:0/1621686261 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f2c340105a0 con 0x7f2c40101260 2023-10-19T12:41:29.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:29.311+0000 7f2c3cff9700 1 --2- 172.21.15.46:0/1621686261 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f2c280a1500 0x7f2c280a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:29.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:29.311+0000 7f2c3cff9700 1 -- 172.21.15.46:0/1621686261 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f2c34014070 con 0x7f2c40101260 2023-10-19T12:41:29.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:29.311+0000 7f2c3f7fe700 1 --2- 172.21.15.46:0/1621686261 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f2c280a1500 0x7f2c280a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:29.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:29.312+0000 7f2c3f7fe700 1 --2- 172.21.15.46:0/1621686261 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f2c280a1500 0x7f2c280a39c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2c3000b2e0 tx=0x7f2c30005960 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:29.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:29.315+0000 7f2c3cff9700 1 -- 172.21.15.46:0/1621686261 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f2c340964b0 con 0x7f2c40101260 2023-10-19T12:41:29.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:29 smithi046 ceph-mon[98509]: pgmap v289: 129 pgs: 129 active+clean; 579 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 161 B/s wr, 0 op/s 2023-10-19T12:41:29.571 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:29.568+0000 7f2c45d06700 1 -- 172.21.15.46:0/1621686261 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2c40101f30 con 0x7f2c40101260 2023-10-19T12:41:29.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:29.568+0000 7f2c3cff9700 1 -- 172.21.15.46:0/1621686261 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+88 (secure 0 0 0) 0x7f2c34099ad0 con 0x7f2c40101260 2023-10-19T12:41:29.572 INFO:teuthology.orchestra.run.smithi046.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-19T12:41:29.575 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:29.571+0000 7f2c45d06700 1 -- 172.21.15.46:0/1621686261 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f2c280a1500 msgr2=0x7f2c280a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:29.575 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:29.571+0000 7f2c45d06700 1 --2- 172.21.15.46:0/1621686261 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f2c280a1500 0x7f2c280a39c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2c3000b2e0 tx=0x7f2c30005960 comp rx=0 tx=0).stop 2023-10-19T12:41:29.575 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:29.571+0000 7f2c45d06700 1 -- 172.21.15.46:0/1621686261 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2c40101260 msgr2=0x7f2c4019ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:29.575 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:29.571+0000 7f2c45d06700 1 --2- 172.21.15.46:0/1621686261 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2c40101260 0x7f2c4019ce50 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2c3400e9a0 tx=0x7f2c3400ecb0 comp rx=0 tx=0).stop 2023-10-19T12:41:29.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:29.571+0000 7f2c45d06700 1 -- 172.21.15.46:0/1621686261 shutdown_connections 2023-10-19T12:41:29.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:29.571+0000 7f2c45d06700 1 --2- 172.21.15.46:0/1621686261 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f2c280a1500 0x7f2c280a39c0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:29.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:29.571+0000 7f2c45d06700 1 --2- 172.21.15.46:0/1621686261 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2c401057c0 0x7f2c40196a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:29.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:29.571+0000 7f2c45d06700 1 --2- 172.21.15.46:0/1621686261 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2c401008a0 0x7f2c4019c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:29.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:29.571+0000 7f2c45d06700 1 --2- 172.21.15.46:0/1621686261 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2c40101260 0x7f2c4019ce50 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:29.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:29.571+0000 7f2c45d06700 1 -- 172.21.15.46:0/1621686261 >> 172.21.15.46:0/1621686261 conn(0x7f2c400779e0 msgr2=0x7f2c400fe9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:29.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:29.571+0000 7f2c45d06700 1 -- 172.21.15.46:0/1621686261 shutdown_connections 2023-10-19T12:41:29.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:29.571+0000 7f2c45d06700 1 -- 172.21.15.46:0/1621686261 wait complete. 2023-10-19T12:41:29.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:29 smithi157 ceph-mon[134109]: pgmap v289: 129 pgs: 129 active+clean; 579 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 161 B/s wr, 0 op/s 2023-10-19T12:41:29.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:29 smithi195 ceph-mon[134493]: pgmap v289: 129 pgs: 129 active+clean; 579 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 161 B/s wr, 0 op/s 2023-10-19T12:41:30.168 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-19T12:41:30.169 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-19T12:41:30.169 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi046.front.sepia.ceph.com 2023-10-19T12:41:30.169 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-10-19T12:41:30.170 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-10-19T12:41:30.170 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-19T12:41:30.170 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-19T12:41:30.171 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-19T12:41:30.171 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-10-19T12:41:30.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T12:41:30.172 DEBUG:teuthology.orchestra.run.smithi046:> ip addr 2023-10-19T12:41:30.218 INFO:teuthology.orchestra.run.smithi046.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-19T12:41:30.219 INFO:teuthology.orchestra.run.smithi046.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-19T12:41:30.219 INFO:teuthology.orchestra.run.smithi046.stdout: inet 127.0.0.1/8 scope host lo 2023-10-19T12:41:30.219 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-19T12:41:30.219 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 ::1/128 scope host 2023-10-19T12:41:30.219 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-19T12:41:30.220 INFO:teuthology.orchestra.run.smithi046.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-19T12:41:30.220 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:6b:f6:10 brd ff:ff:ff:ff:ff:ff 2023-10-19T12:41:30.220 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp7s0f0 2023-10-19T12:41:30.220 INFO:teuthology.orchestra.run.smithi046.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-19T12:41:30.220 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:6b:f6:11 brd ff:ff:ff:ff:ff:ff 2023-10-19T12:41:30.221 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp7s0f1 2023-10-19T12:41:30.221 INFO:teuthology.orchestra.run.smithi046.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-19T12:41:30.221 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:bd:15:f8 brd ff:ff:ff:ff:ff:ff 2023-10-19T12:41:30.221 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp1s0f0 2023-10-19T12:41:30.221 INFO:teuthology.orchestra.run.smithi046.stdout: inet 172.21.15.46/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-19T12:41:30.222 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft 41642sec preferred_lft 41642sec 2023-10-19T12:41:30.222 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::ec4:7aff:febd:15f8/64 scope link 2023-10-19T12:41:30.222 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-19T12:41:30.222 INFO:teuthology.orchestra.run.smithi046.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-19T12:41:30.222 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:bd:15:f9 brd ff:ff:ff:ff:ff:ff 2023-10-19T12:41:30.223 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp1s0f1 2023-10-19T12:41:30.223 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-19T12:41:30.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T12:41:30.224 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2023-10-19T12:41:30.224 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2023-10-19T12:41:30.225 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link add name ceph-brx type bridge 2023-10-19T12:41:30.225 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip addr flush dev ceph-brx 2023-10-19T12:41:30.225 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set ceph-brx up 2023-10-19T12:41:30.226 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-19T12:41:30.226 DEBUG:teuthology.orchestra.run.smithi046:> ') 2023-10-19T12:41:30.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:30 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/1621686261' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-10-19T12:41:30.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:30 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/1621686261' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-10-19T12:41:30.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:30 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/1621686261' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-10-19T12:41:30.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T12:41:30.710 DEBUG:teuthology.orchestra.run.smithi046:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-19T12:41:30.786 INFO:teuthology.orchestra.run.smithi046.stdout:1 2023-10-19T12:41:30.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T12:41:30.790 DEBUG:teuthology.orchestra.run.smithi046:> route 2023-10-19T12:41:30.849 INFO:teuthology.orchestra.run.smithi046.stdout:Kernel IP routing table 2023-10-19T12:41:30.849 INFO:teuthology.orchestra.run.smithi046.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-19T12:41:30.849 INFO:teuthology.orchestra.run.smithi046.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-19T12:41:30.850 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-19T12:41:30.850 INFO:teuthology.orchestra.run.smithi046.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-19T12:41:30.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T12:41:30.851 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2023-10-19T12:41:30.852 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2023-10-19T12:41:30.852 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-19T12:41:30.852 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-19T12:41:30.853 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-19T12:41:30.853 DEBUG:teuthology.orchestra.run.smithi046:> ') 2023-10-19T12:41:31.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:31 smithi046 ceph-mon[98509]: pgmap v290: 129 pgs: 129 active+clean; 579 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s wr, 0 op/s 2023-10-19T12:41:31.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T12:41:31.556 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list 2023-10-19T12:41:31.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:31 smithi157 ceph-mon[134109]: pgmap v290: 129 pgs: 129 active+clean; 579 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s wr, 0 op/s 2023-10-19T12:41:31.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T12:41:31.601 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list-id 2023-10-19T12:41:31.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:31 smithi195 ceph-mon[134493]: pgmap v290: 129 pgs: 129 active+clean; 579 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s wr, 0 op/s 2023-10-19T12:41:31.685 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T12:41:31.686 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2023-10-19T12:41:31.686 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2023-10-19T12:41:31.687 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-19T12:41:31.687 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-10-19T12:41:31.687 DEBUG:teuthology.orchestra.run.smithi046:> ') 2023-10-19T12:41:31.876 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-10-19T12:41:31.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T12:41:31.877 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2023-10-19T12:41:31.877 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2023-10-19T12:41:31.878 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-10-19T12:41:31.878 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-19T12:41:31.878 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-10-19T12:41:31.879 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-10-19T12:41:31.879 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-10-19T12:41:31.879 DEBUG:teuthology.orchestra.run.smithi046:> ') 2023-10-19T12:41:32.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T12:41:32.176 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2023-10-19T12:41:32.177 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2023-10-19T12:41:32.177 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set brx.0 up 2023-10-19T12:41:32.177 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set dev brx.0 master ceph-brx 2023-10-19T12:41:32.178 DEBUG:teuthology.orchestra.run.smithi046:> ') 2023-10-19T12:41:32.355 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-10-19T12:41:32.355 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-19T12:41:32.356 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-10-19T12:41:32.401 INFO:teuthology.orchestra.run.smithi046.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-10-19T12:41:32.401 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-19T12:41:32.402 DEBUG:teuthology.orchestra.run.smithi046:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-10-19T12:41:32.484 DEBUG:teuthology.orchestra.run.smithi046:> sudo modprobe fuse 2023-10-19T12:41:32.596 DEBUG:teuthology.orchestra.run.smithi046:> cat /proc/self/mounts | awk '{print $2}' 2023-10-19T12:41:32.642 INFO:teuthology.orchestra.run.smithi046.stdout:/sys 2023-10-19T12:41:32.642 INFO:teuthology.orchestra.run.smithi046.stdout:/proc 2023-10-19T12:41:32.642 INFO:teuthology.orchestra.run.smithi046.stdout:/dev 2023-10-19T12:41:32.643 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/security 2023-10-19T12:41:32.643 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/shm 2023-10-19T12:41:32.643 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/pts 2023-10-19T12:41:32.643 INFO:teuthology.orchestra.run.smithi046.stdout:/run 2023-10-19T12:41:32.643 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/cgroup 2023-10-19T12:41:32.644 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/cgroup/systemd 2023-10-19T12:41:32.644 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/pstore 2023-10-19T12:41:32.644 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-10-19T12:41:32.644 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/cgroup/blkio 2023-10-19T12:41:32.644 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/cgroup/devices 2023-10-19T12:41:32.645 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/cgroup/cpuset 2023-10-19T12:41:32.645 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/cgroup/perf_event 2023-10-19T12:41:32.645 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/cgroup/memory 2023-10-19T12:41:32.645 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-10-19T12:41:32.645 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/cgroup/pids 2023-10-19T12:41:32.646 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/cgroup/hugetlb 2023-10-19T12:41:32.646 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/cgroup/freezer 2023-10-19T12:41:32.646 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/tracing 2023-10-19T12:41:32.646 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/config 2023-10-19T12:41:32.646 INFO:teuthology.orchestra.run.smithi046.stdout:/ 2023-10-19T12:41:32.647 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/selinux 2023-10-19T12:41:32.647 INFO:teuthology.orchestra.run.smithi046.stdout:/proc/sys/fs/binfmt_misc 2023-10-19T12:41:32.647 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/mqueue 2023-10-19T12:41:32.647 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/hugepages 2023-10-19T12:41:32.647 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/debug 2023-10-19T12:41:32.648 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/fuse/connections 2023-10-19T12:41:32.648 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/nfs/rpc_pipefs 2023-10-19T12:41:32.648 INFO:teuthology.orchestra.run.smithi046.stdout:/run/user/1000 2023-10-19T12:41:32.648 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph 2023-10-19T12:41:32.649 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay 2023-10-19T12:41:32.649 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/982624e5d552b7460ffa5415a7675477254bf70e2aac4653ed3b916eae4e4023/merged 2023-10-19T12:41:32.649 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/d5b8b3c8416fced17346997e0b0bc46630368cb854b03020a08ee543f171a5b3/merged 2023-10-19T12:41:32.649 INFO:teuthology.orchestra.run.smithi046.stdout:/run/user/0 2023-10-19T12:41:32.649 INFO:teuthology.orchestra.run.smithi046.stdout:/proc/sys/fs/binfmt_misc 2023-10-19T12:41:32.650 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/5bce7eab21c97f113f5f46cc903d708d935999a2132e3ff2d720cf54986ba199/merged 2023-10-19T12:41:32.650 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/e51592e5e941ddc34dd09f9d31df23e60b42be403131ab7e8b529d4ed4482dd2/merged 2023-10-19T12:41:32.650 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/0065cb72b3d8f75737f0d0e5d0757558b40d7657fd7af4ef1490f8f1f934fef1/merged 2023-10-19T12:41:32.650 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/a0a5599af662a92f3e252f6e66d5ea5a3012d30d1fff02979fbcb475078659c1/merged 2023-10-19T12:41:32.650 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/fab8dcca3950e180451851e88e50a966149d55fd964e3ecb5c6c6f63b5a8b5ce/merged 2023-10-19T12:41:32.651 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/72db17cc2a8f8f2fe73dd3f1f370eeab26fe52222f51c484101017f52bce60ef/merged 2023-10-19T12:41:32.651 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/b1b3ab1114d1c8b37bce4b5585d9821e46436d2b37b88f646ede532c798bd046/merged 2023-10-19T12:41:32.651 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/66b1345a44b563987ac8a606e524f7ab200a5d6345f887cf32c3bc86febf3982/merged 2023-10-19T12:41:32.651 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns 2023-10-19T12:41:32.652 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-19T12:41:32.652 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-19T12:41:32.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T12:41:32.653 DEBUG:teuthology.orchestra.run.smithi046:> ls /sys/fs/fuse/connections 2023-10-19T12:41:32.738 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-19T12:41:32.739 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-10-19T12:41:32.783 DEBUG:teuthology.orchestra.run.smithi046:> sudo modprobe fuse 2023-10-19T12:41:32.856 DEBUG:teuthology.orchestra.run.smithi046:> cat /proc/self/mounts | awk '{print $2}' 2023-10-19T12:41:32.907 INFO:teuthology.orchestra.run.smithi046.stdout:/sys 2023-10-19T12:41:32.907 INFO:teuthology.orchestra.run.smithi046.stdout:/proc 2023-10-19T12:41:32.907 INFO:teuthology.orchestra.run.smithi046.stdout:/dev 2023-10-19T12:41:32.908 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/security 2023-10-19T12:41:32.908 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/shm 2023-10-19T12:41:32.908 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/pts 2023-10-19T12:41:32.908 INFO:teuthology.orchestra.run.smithi046.stdout:/run 2023-10-19T12:41:32.908 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/cgroup 2023-10-19T12:41:32.909 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/cgroup/systemd 2023-10-19T12:41:32.909 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/pstore 2023-10-19T12:41:32.909 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-10-19T12:41:32.909 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/cgroup/blkio 2023-10-19T12:41:32.909 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/cgroup/devices 2023-10-19T12:41:32.910 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/cgroup/cpuset 2023-10-19T12:41:32.910 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/cgroup/perf_event 2023-10-19T12:41:32.910 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/cgroup/memory 2023-10-19T12:41:32.910 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-10-19T12:41:32.910 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/cgroup/pids 2023-10-19T12:41:32.911 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/cgroup/hugetlb 2023-10-19T12:41:32.911 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/cgroup/freezer 2023-10-19T12:41:32.911 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/tracing 2023-10-19T12:41:32.911 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/config 2023-10-19T12:41:32.911 INFO:teuthology.orchestra.run.smithi046.stdout:/ 2023-10-19T12:41:32.912 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/selinux 2023-10-19T12:41:32.912 INFO:teuthology.orchestra.run.smithi046.stdout:/proc/sys/fs/binfmt_misc 2023-10-19T12:41:32.912 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/mqueue 2023-10-19T12:41:32.912 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/hugepages 2023-10-19T12:41:32.912 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/debug 2023-10-19T12:41:32.913 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/fuse/connections 2023-10-19T12:41:32.913 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/nfs/rpc_pipefs 2023-10-19T12:41:32.913 INFO:teuthology.orchestra.run.smithi046.stdout:/run/user/1000 2023-10-19T12:41:32.913 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph 2023-10-19T12:41:32.913 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay 2023-10-19T12:41:32.914 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/982624e5d552b7460ffa5415a7675477254bf70e2aac4653ed3b916eae4e4023/merged 2023-10-19T12:41:32.914 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/d5b8b3c8416fced17346997e0b0bc46630368cb854b03020a08ee543f171a5b3/merged 2023-10-19T12:41:32.914 INFO:teuthology.orchestra.run.smithi046.stdout:/run/user/0 2023-10-19T12:41:32.914 INFO:teuthology.orchestra.run.smithi046.stdout:/proc/sys/fs/binfmt_misc 2023-10-19T12:41:32.914 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/5bce7eab21c97f113f5f46cc903d708d935999a2132e3ff2d720cf54986ba199/merged 2023-10-19T12:41:32.915 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/e51592e5e941ddc34dd09f9d31df23e60b42be403131ab7e8b529d4ed4482dd2/merged 2023-10-19T12:41:32.915 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/0065cb72b3d8f75737f0d0e5d0757558b40d7657fd7af4ef1490f8f1f934fef1/merged 2023-10-19T12:41:32.915 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/a0a5599af662a92f3e252f6e66d5ea5a3012d30d1fff02979fbcb475078659c1/merged 2023-10-19T12:41:32.915 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/fab8dcca3950e180451851e88e50a966149d55fd964e3ecb5c6c6f63b5a8b5ce/merged 2023-10-19T12:41:32.915 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/72db17cc2a8f8f2fe73dd3f1f370eeab26fe52222f51c484101017f52bce60ef/merged 2023-10-19T12:41:32.916 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/b1b3ab1114d1c8b37bce4b5585d9821e46436d2b37b88f646ede532c798bd046/merged 2023-10-19T12:41:32.916 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/66b1345a44b563987ac8a606e524f7ab200a5d6345f887cf32c3bc86febf3982/merged 2023-10-19T12:41:32.916 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns 2023-10-19T12:41:32.916 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-19T12:41:32.917 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-19T12:41:32.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T12:41:32.918 DEBUG:teuthology.orchestra.run.smithi046:> ls /sys/fs/fuse/connections 2023-10-19T12:41:32.979 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi046.stderr:2023-10-19T12:41:32.977+0000 7f27c19da5c0 -1 init, newargv = 0x55b2acd24aa0 newargc=15 2023-10-19T12:41:32.979 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi046.stderr:ceph-fuse[152582]: starting ceph client 2023-10-19T12:41:32.989 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi046.stderr:ceph-fuse[152582]: starting fuse 2023-10-19T12:41:33.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:33 smithi046 ceph-mon[98509]: pgmap v291: 129 pgs: 129 active+clean; 579 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 109 B/s wr, 0 op/s 2023-10-19T12:41:34.063 DEBUG:teuthology.orchestra.run.smithi046:> sudo modprobe fuse 2023-10-19T12:41:34.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:33 smithi157 ceph-mon[134109]: pgmap v291: 129 pgs: 129 active+clean; 579 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 109 B/s wr, 0 op/s 2023-10-19T12:41:34.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:33 smithi195 ceph-mon[134493]: pgmap v291: 129 pgs: 129 active+clean; 579 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 109 B/s wr, 0 op/s 2023-10-19T12:41:34.143 DEBUG:teuthology.orchestra.run.smithi046:> cat /proc/self/mounts | awk '{print $2}' 2023-10-19T12:41:34.190 INFO:teuthology.orchestra.run.smithi046.stdout:/sys 2023-10-19T12:41:34.191 INFO:teuthology.orchestra.run.smithi046.stdout:/proc 2023-10-19T12:41:34.191 INFO:teuthology.orchestra.run.smithi046.stdout:/dev 2023-10-19T12:41:34.192 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/security 2023-10-19T12:41:34.192 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/shm 2023-10-19T12:41:34.192 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/pts 2023-10-19T12:41:34.192 INFO:teuthology.orchestra.run.smithi046.stdout:/run 2023-10-19T12:41:34.193 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/cgroup 2023-10-19T12:41:34.193 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/cgroup/systemd 2023-10-19T12:41:34.193 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/pstore 2023-10-19T12:41:34.193 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-10-19T12:41:34.194 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/cgroup/blkio 2023-10-19T12:41:34.194 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/cgroup/devices 2023-10-19T12:41:34.194 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/cgroup/cpuset 2023-10-19T12:41:34.195 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/cgroup/perf_event 2023-10-19T12:41:34.195 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/cgroup/memory 2023-10-19T12:41:34.195 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-10-19T12:41:34.195 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/cgroup/pids 2023-10-19T12:41:34.196 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/cgroup/hugetlb 2023-10-19T12:41:34.196 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/cgroup/freezer 2023-10-19T12:41:34.196 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/tracing 2023-10-19T12:41:34.196 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/config 2023-10-19T12:41:34.196 INFO:teuthology.orchestra.run.smithi046.stdout:/ 2023-10-19T12:41:34.197 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/selinux 2023-10-19T12:41:34.197 INFO:teuthology.orchestra.run.smithi046.stdout:/proc/sys/fs/binfmt_misc 2023-10-19T12:41:34.197 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/mqueue 2023-10-19T12:41:34.197 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/hugepages 2023-10-19T12:41:34.197 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/debug 2023-10-19T12:41:34.197 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/fuse/connections 2023-10-19T12:41:34.198 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/nfs/rpc_pipefs 2023-10-19T12:41:34.198 INFO:teuthology.orchestra.run.smithi046.stdout:/run/user/1000 2023-10-19T12:41:34.198 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph 2023-10-19T12:41:34.198 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay 2023-10-19T12:41:34.198 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/982624e5d552b7460ffa5415a7675477254bf70e2aac4653ed3b916eae4e4023/merged 2023-10-19T12:41:34.199 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/d5b8b3c8416fced17346997e0b0bc46630368cb854b03020a08ee543f171a5b3/merged 2023-10-19T12:41:34.199 INFO:teuthology.orchestra.run.smithi046.stdout:/run/user/0 2023-10-19T12:41:34.199 INFO:teuthology.orchestra.run.smithi046.stdout:/proc/sys/fs/binfmt_misc 2023-10-19T12:41:34.199 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/5bce7eab21c97f113f5f46cc903d708d935999a2132e3ff2d720cf54986ba199/merged 2023-10-19T12:41:34.199 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/e51592e5e941ddc34dd09f9d31df23e60b42be403131ab7e8b529d4ed4482dd2/merged 2023-10-19T12:41:34.200 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/0065cb72b3d8f75737f0d0e5d0757558b40d7657fd7af4ef1490f8f1f934fef1/merged 2023-10-19T12:41:34.200 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/a0a5599af662a92f3e252f6e66d5ea5a3012d30d1fff02979fbcb475078659c1/merged 2023-10-19T12:41:34.200 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/fab8dcca3950e180451851e88e50a966149d55fd964e3ecb5c6c6f63b5a8b5ce/merged 2023-10-19T12:41:34.200 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/72db17cc2a8f8f2fe73dd3f1f370eeab26fe52222f51c484101017f52bce60ef/merged 2023-10-19T12:41:34.200 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/b1b3ab1114d1c8b37bce4b5585d9821e46436d2b37b88f646ede532c798bd046/merged 2023-10-19T12:41:34.201 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/66b1345a44b563987ac8a606e524f7ab200a5d6345f887cf32c3bc86febf3982/merged 2023-10-19T12:41:34.201 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns 2023-10-19T12:41:34.201 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-19T12:41:34.201 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-19T12:41:34.201 INFO:teuthology.orchestra.run.smithi046.stdout:/home/ubuntu/cephtest/mnt.admin 2023-10-19T12:41:34.202 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T12:41:34.203 DEBUG:teuthology.orchestra.run.smithi046:> ls /sys/fs/fuse/connections 2023-10-19T12:41:34.247 INFO:teuthology.orchestra.run.smithi046.stdout:121 2023-10-19T12:41:34.248 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [121] 2023-10-19T12:41:34.248 DEBUG:teuthology.orchestra.run.smithi046:> sudo stdin-killer -- python3 -c ' 2023-10-19T12:41:34.249 DEBUG:teuthology.orchestra.run.smithi046:> import glob 2023-10-19T12:41:34.249 DEBUG:teuthology.orchestra.run.smithi046:> import re 2023-10-19T12:41:34.249 DEBUG:teuthology.orchestra.run.smithi046:> import os 2023-10-19T12:41:34.250 DEBUG:teuthology.orchestra.run.smithi046:> import subprocess 2023-10-19T12:41:34.250 DEBUG:teuthology.orchestra.run.smithi046:> 2023-10-19T12:41:34.251 DEBUG:teuthology.orchestra.run.smithi046:> def _find_admin_socket(client_name): 2023-10-19T12:41:34.251 DEBUG:teuthology.orchestra.run.smithi046:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-10-19T12:41:34.251 DEBUG:teuthology.orchestra.run.smithi046:> files = glob.glob(asok_path) 2023-10-19T12:41:34.251 DEBUG:teuthology.orchestra.run.smithi046:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-10-19T12:41:34.252 DEBUG:teuthology.orchestra.run.smithi046:> 2023-10-19T12:41:34.252 DEBUG:teuthology.orchestra.run.smithi046:> # Given a non-glob path, it better be there 2023-10-19T12:41:34.253 DEBUG:teuthology.orchestra.run.smithi046:> if "*" not in asok_path: 2023-10-19T12:41:34.253 DEBUG:teuthology.orchestra.run.smithi046:> assert(len(files) == 1) 2023-10-19T12:41:34.253 DEBUG:teuthology.orchestra.run.smithi046:> return files[0] 2023-10-19T12:41:34.254 DEBUG:teuthology.orchestra.run.smithi046:> 2023-10-19T12:41:34.254 DEBUG:teuthology.orchestra.run.smithi046:> for f in files: 2023-10-19T12:41:34.254 DEBUG:teuthology.orchestra.run.smithi046:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-19T12:41:34.255 DEBUG:teuthology.orchestra.run.smithi046:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-19T12:41:34.255 DEBUG:teuthology.orchestra.run.smithi046:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-19T12:41:34.256 DEBUG:teuthology.orchestra.run.smithi046:> contents = proc_f.read() 2023-10-19T12:41:34.256 DEBUG:teuthology.orchestra.run.smithi046:> if mountpoint in contents: 2023-10-19T12:41:34.256 DEBUG:teuthology.orchestra.run.smithi046:> return f 2023-10-19T12:41:34.257 DEBUG:teuthology.orchestra.run.smithi046:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-19T12:41:34.257 DEBUG:teuthology.orchestra.run.smithi046:> 2023-10-19T12:41:34.257 DEBUG:teuthology.orchestra.run.smithi046:> print(_find_admin_socket("client.admin")) 2023-10-19T12:41:34.258 DEBUG:teuthology.orchestra.run.smithi046:> ' 2023-10-19T12:41:34.433 INFO:teuthology.orchestra.run.smithi046.stdout:/var/run/ceph/ceph-client.admin.152582.asok 2023-10-19T12:41:34.437 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-19T12:41:34.447 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.152582.asok 2023-10-19T12:41:34.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T12:41:34.448 DEBUG:teuthology.orchestra.run.smithi046:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.152582.asok status 2023-10-19T12:41:34.679 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-10-19T12:41:34.679 INFO:teuthology.orchestra.run.smithi046.stdout: "metadata": { 2023-10-19T12:41:34.680 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph_sha1": "f7420d7f8e55ceea786dcbf536c338ce920c21eb", 2023-10-19T12:41:34.680 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph_version": "ceph version 18.0.0-6786-gf7420d7f (f7420d7f8e55ceea786dcbf536c338ce920c21eb) reef (dev)", 2023-10-19T12:41:34.680 INFO:teuthology.orchestra.run.smithi046.stdout: "entity_id": "admin", 2023-10-19T12:41:34.680 INFO:teuthology.orchestra.run.smithi046.stdout: "hostname": "smithi046", 2023-10-19T12:41:34.680 INFO:teuthology.orchestra.run.smithi046.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-10-19T12:41:34.681 INFO:teuthology.orchestra.run.smithi046.stdout: "pid": "152582", 2023-10-19T12:41:34.681 INFO:teuthology.orchestra.run.smithi046.stdout: "root": "/" 2023-10-19T12:41:34.681 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:41:34.681 INFO:teuthology.orchestra.run.smithi046.stdout: "dentry_count": 0, 2023-10-19T12:41:34.681 INFO:teuthology.orchestra.run.smithi046.stdout: "dentry_pinned_count": 0, 2023-10-19T12:41:34.682 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 14787, 2023-10-19T12:41:34.682 INFO:teuthology.orchestra.run.smithi046.stdout: "inst": { 2023-10-19T12:41:34.682 INFO:teuthology.orchestra.run.smithi046.stdout: "name": { 2023-10-19T12:41:34.682 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "client", 2023-10-19T12:41:34.682 INFO:teuthology.orchestra.run.smithi046.stdout: "num": 14787 2023-10-19T12:41:34.683 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:41:34.683 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": { 2023-10-19T12:41:34.683 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v1", 2023-10-19T12:41:34.683 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "192.168.0.1:0", 2023-10-19T12:41:34.684 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 1705240047 2023-10-19T12:41:34.684 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:41:34.684 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:41:34.684 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": { 2023-10-19T12:41:34.684 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v1", 2023-10-19T12:41:34.685 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "192.168.0.1:0", 2023-10-19T12:41:34.685 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 1705240047 2023-10-19T12:41:34.685 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:41:34.685 INFO:teuthology.orchestra.run.smithi046.stdout: "inst_str": "client.14787 192.168.0.1:0/1705240047", 2023-10-19T12:41:34.685 INFO:teuthology.orchestra.run.smithi046.stdout: "addr_str": "192.168.0.1:0/1705240047", 2023-10-19T12:41:34.685 INFO:teuthology.orchestra.run.smithi046.stdout: "inode_count": 1, 2023-10-19T12:41:34.686 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_epoch": 17, 2023-10-19T12:41:34.686 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_epoch": 88, 2023-10-19T12:41:34.686 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_epoch_barrier": 0, 2023-10-19T12:41:34.686 INFO:teuthology.orchestra.run.smithi046.stdout: "blocklisted": false, 2023-10-19T12:41:34.686 INFO:teuthology.orchestra.run.smithi046.stdout: "fs_name": "cephfs" 2023-10-19T12:41:34.687 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-10-19T12:41:34.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T12:41:34.694 DEBUG:teuthology.orchestra.run.smithi046:> stat --file-system '--printf=%T 2023-10-19T12:41:34.695 DEBUG:teuthology.orchestra.run.smithi046:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-10-19T12:41:34.740 INFO:teuthology.orchestra.run.smithi046.stdout:fuseblk 2023-10-19T12:41:34.740 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-10-19T12:41:34.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T12:41:34.741 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-10-19T12:41:34.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T12:41:34.852 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-10-19T12:41:34.985 INFO:teuthology.orchestra.run.smithi046.stdout:# file: . 2023-10-19T12:41:34.985 INFO:teuthology.orchestra.run.smithi046.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-10-19T12:41:34.986 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:41:34.987 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-10-19T12:41:34.987 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-19T12:41:35.032 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-19T12:41:35.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.273+0000 7f7821dff700 1 -- 172.21.15.46:0/124501890 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f781c100740 msgr2=0x7f781c100b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:35.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.273+0000 7f7821dff700 1 --2- 172.21.15.46:0/124501890 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f781c100740 0x7f781c100b60 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f780c0099c0 tx=0x7f780c009cd0 comp rx=0 tx=0).stop 2023-10-19T12:41:35.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.273+0000 7f7821dff700 1 -- 172.21.15.46:0/124501890 shutdown_connections 2023-10-19T12:41:35.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.273+0000 7f7821dff700 1 --2- 172.21.15.46:0/124501890 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f781c1022d0 0x7f781c108b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:35.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.273+0000 7f7821dff700 1 --2- 172.21.15.46:0/124501890 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f781c100740 0x7f781c100b60 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:35.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.273+0000 7f7821dff700 1 --2- 172.21.15.46:0/124501890 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f781c101930 0x7f781c101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:35.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.273+0000 7f7821dff700 1 -- 172.21.15.46:0/124501890 >> 172.21.15.46:0/124501890 conn(0x7f781c0fbc90 msgr2=0x7f781c0fe0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:35.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.273+0000 7f7821dff700 1 -- 172.21.15.46:0/124501890 shutdown_connections 2023-10-19T12:41:35.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.273+0000 7f7821dff700 1 -- 172.21.15.46:0/124501890 wait complete. 2023-10-19T12:41:35.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.274+0000 7f7821dff700 1 Processor -- start 2023-10-19T12:41:35.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.274+0000 7f7821dff700 1 -- start start 2023-10-19T12:41:35.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.275+0000 7f7821dff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f781c100740 0x7f781c198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:35.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.275+0000 7f7821dff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f781c101930 0x7f781c198e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:35.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.275+0000 7f7821dff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f781c1022d0 0x7f781c19fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:35.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.275+0000 7f7821dff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f781c1a0430 con 0x7f781c1022d0 2023-10-19T12:41:35.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.275+0000 7f7821dff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f781c1a0570 con 0x7f781c101930 2023-10-19T12:41:35.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.275+0000 7f7821dff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f781c1a0700 con 0x7f781c100740 2023-10-19T12:41:35.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.275+0000 7f781bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f781c1022d0 0x7f781c19fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:35.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.275+0000 7f781bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f781c1022d0 0x7f781c19fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43852/0 (socket says 172.21.15.46:43852) 2023-10-19T12:41:35.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.275+0000 7f781bfff700 1 -- 172.21.15.46:0/4143170222 learned_addr learned my addr 172.21.15.46:0/4143170222 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:41:35.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.275+0000 7f781b7fe700 1 --2- 172.21.15.46:0/4143170222 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f781c100740 0x7f781c198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:35.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.275+0000 7f7813fff700 1 --2- 172.21.15.46:0/4143170222 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f781c101930 0x7f781c198e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:35.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.275+0000 7f781bfff700 1 -- 172.21.15.46:0/4143170222 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f781c100740 msgr2=0x7f781c198900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:35.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.275+0000 7f781bfff700 1 --2- 172.21.15.46:0/4143170222 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f781c100740 0x7f781c198900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:35.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.275+0000 7f781bfff700 1 -- 172.21.15.46:0/4143170222 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f781c101930 msgr2=0x7f781c198e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:35.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.275+0000 7f781bfff700 1 --2- 172.21.15.46:0/4143170222 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f781c101930 0x7f781c198e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:35.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.275+0000 7f781bfff700 1 -- 172.21.15.46:0/4143170222 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f780c0095f0 con 0x7f781c1022d0 2023-10-19T12:41:35.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.276+0000 7f781bfff700 1 --2- 172.21.15.46:0/4143170222 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f781c1022d0 0x7f781c19fe60 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7814007ee0 tx=0x7f781400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:35.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.276+0000 7f78197fa700 1 -- 172.21.15.46:0/4143170222 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7814017070 con 0x7f781c1022d0 2023-10-19T12:41:35.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.276+0000 7f78197fa700 1 -- 172.21.15.46:0/4143170222 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f781400f040 con 0x7f781c1022d0 2023-10-19T12:41:35.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.276+0000 7f7821dff700 1 -- 172.21.15.46:0/4143170222 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f781c1a09e0 con 0x7f781c1022d0 2023-10-19T12:41:35.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.276+0000 7f78197fa700 1 -- 172.21.15.46:0/4143170222 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7814005580 con 0x7f781c1022d0 2023-10-19T12:41:35.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.276+0000 7f7821dff700 1 -- 172.21.15.46:0/4143170222 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f781c1a0ea0 con 0x7f781c1022d0 2023-10-19T12:41:35.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.277+0000 7f7821dff700 1 -- 172.21.15.46:0/4143170222 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f781c067530 con 0x7f781c1022d0 2023-10-19T12:41:35.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.279+0000 7f78197fa700 1 -- 172.21.15.46:0/4143170222 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f781400db20 con 0x7f781c1022d0 2023-10-19T12:41:35.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.281+0000 7f78197fa700 1 --2- 172.21.15.46:0/4143170222 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f78080a1480 0x7f78080a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:35.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.281+0000 7f78197fa700 1 -- 172.21.15.46:0/4143170222 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f78140cc660 con 0x7f781c1022d0 2023-10-19T12:41:35.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.281+0000 7f781b7fe700 1 --2- 172.21.15.46:0/4143170222 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f78080a1480 0x7f78080a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:35.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.281+0000 7f781b7fe700 1 --2- 172.21.15.46:0/4143170222 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f78080a1480 0x7f78080a3940 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f780c003730 tx=0x7f780c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:35.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.285+0000 7f78197fa700 1 -- 172.21.15.46:0/4143170222 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7814095ad0 con 0x7f781c1022d0 2023-10-19T12:41:35.504 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.501+0000 7f7821dff700 1 -- 172.21.15.46:0/4143170222 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f781c10c1d0 con 0x7f781c1022d0 2023-10-19T12:41:35.506 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.503+0000 7f78197fa700 1 -- 172.21.15.46:0/4143170222 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+23953 (secure 0 0 0) 0x7f78140990f0 con 0x7f781c1022d0 2023-10-19T12:41:35.506 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:41:35.507 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":88,"fsid":"96a8be3c-6e7b-11ee-8db6-212e2dc638e7","created":"2023-10-19T12:33:26.148713+0000","modified":"2023-10-19T12:41:23.831907+0000","last_up_change":"2023-10-19T12:40:30.761679+0000","last_in_change":"2023-10-19T12:40:13.663559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-19T12:37:07.175795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-19T12:41:16.895203+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-19T12:41:18.255601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-19T12:41:21.830455+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"346ce86b-a10a-4869-9fdb-c3c1d4161455","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6803","nonce":500237995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6805","nonce":500237995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6809","nonce":500237995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6807","nonce":500237995}]},"public_addr":"172.21.15.46:6803/500237995","cluster_addr":"172.21.15.46:6805/500237995","heartbeat_back_addr":"172.21.15.46:6809/500237995","heartbeat_front_addr":"172.21.15.46:6807/500237995","state":["exists","up"]},{"osd":1,"uuid":"02aae687-76c5-4124-bae4-9787ed571c28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6801","nonce":2496862790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6803","nonce":2496862790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6807","nonce":2496862790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6805","nonce":2496862790}]},"public_addr":"172.21.15.157:6801/2496862790","cluster_addr":"172.21.15.157:6803/2496862790","heartbeat_back_addr":"172.21.15.157:6807/2496862790","heartbeat_front_addr":"172.21.15.157:6805/2496862790","state":["exists","up"]},{"osd":2,"uuid":"d5360828-1f58-4380-b2ad-0c21ff850981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6801","nonce":4211767276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6803","nonce":4211767276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6807","nonce":4211767276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6805","nonce":4211767276}]},"public_addr":"172.21.15.195:6801/4211767276","cluster_addr":"172.21.15.195:6803/4211767276","heartbeat_back_addr":"172.21.15.195:6807/4211767276","heartbeat_front_addr":"172.21.15.195:6805/4211767276","state":["exists","up"]},{"osd":3,"uuid":"accb780f-49d0-43f8-b166-ee12c558ef00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6811","nonce":1964113352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6813","nonce":1964113352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6817","nonce":1964113352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6815","nonce":1964113352}]},"public_addr":"172.21.15.46:6811/1964113352","cluster_addr":"172.21.15.46:6813/1964113352","heartbeat_back_addr":"172.21.15.46:6817/1964113352","heartbeat_front_addr":"172.21.15.46:6815/1964113352","state":["exists","up"]},{"osd":4,"uuid":"e662886d-e989-4d02-8c1f-3c4671352b0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6809","nonce":3636910144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6811","nonce":3636910144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6815","nonce":3636910144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6813","nonce":3636910144}]},"public_addr":"172.21.15.157:6809/3636910144","cluster_addr":"172.21.15.157:6811/3636910144","heartbeat_back_addr":"172.21.15.157:6815/3636910144","heartbeat_front_addr":"172.21.15.157:6813/3636910144","state":["exists","up"]},{"osd":5,"uuid":"9597e0ce-14ea-407d-90fe-f74bccee38b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6809","nonce":4071287969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6811","nonce":4071287969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6815","nonce":4071287969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6813","nonce":4071287969}]},"public_addr":"172.21.15.195:6809/4071287969","cluster_addr":"172.21.15.195:6811/4071287969","heartbeat_back_addr":"172.21.15.195:6815/4071287969","heartbeat_front_addr":"172.21.15.195:6813/4071287969","state":["exists","up"]},{"osd":6,"uuid":"6b78ba38-f60e-4cb6-b01c-cecc1820e8e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6819","nonce":1842285555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6821","nonce":1842285555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6825","nonce":1842285555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6823","nonce":1842285555}]},"public_addr":"172.21.15.46:6819/1842285555","cluster_addr":"172.21.15.46:6821/1842285555","heartbeat_back_addr":"172.21.15.46:6825/1842285555","heartbeat_front_addr":"172.21.15.46:6823/1842285555","state":["exists","up"]},{"osd":7,"uuid":"59a0899f-3bcd-4db2-b544-24df3a536749","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6817","nonce":3498672588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6819","nonce":3498672588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6823","nonce":3498672588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6821","nonce":3498672588}]},"public_addr":"172.21.15.157:6817/3498672588","cluster_addr":"172.21.15.157:6819/3498672588","heartbeat_back_addr":"172.21.15.157:6823/3498672588","heartbeat_front_addr":"172.21.15.157:6821/3498672588","state":["exists","up"]},{"osd":8,"uuid":"9c3c9835-043a-4fb5-a9ee-edf8caf6b605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6817","nonce":74230104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6819","nonce":74230104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6823","nonce":74230104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6821","nonce":74230104}]},"public_addr":"172.21.15.195:6817/74230104","cluster_addr":"172.21.15.195:6819/74230104","heartbeat_back_addr":"172.21.15.195:6823/74230104","heartbeat_front_addr":"172.21.15.195:6821/74230104","state":["exists","up"]},{"osd":9,"uuid":"3f18f506-a577-4b7c-ae0d-9351c07e81f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6827","nonce":3472581046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6829","nonce":3472581046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6833","nonce":3472581046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6831","nonce":3472581046}]},"public_addr":"172.21.15.46:6827/3472581046","cluster_addr":"172.21.15.46:6829/3472581046","heartbeat_back_addr":"172.21.15.46:6833/3472581046","heartbeat_front_addr":"172.21.15.46:6831/3472581046","state":["exists","up"]},{"osd":10,"uuid":"1ed01854-443a-4acf-9293-7ca0d451a93d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6825","nonce":2378416559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6827","nonce":2378416559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6831","nonce":2378416559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6829","nonce":2378416559}]},"public_addr":"172.21.15.157:6825/2378416559","cluster_addr":"172.21.15.157:6827/2378416559","heartbeat_back_addr":"172.21.15.157:6831/2378416559","heartbeat_front_addr":"172.21.15.157:6829/2378416559","state":["exists","up"]},{"osd":11,"uuid":"021398c0-9184-4647-8220-e40f6705ca90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6825","nonce":3075632222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6827","nonce":3075632222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6831","nonce":3075632222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6829","nonce":3075632222}]},"public_addr":"172.21.15.195:6825/3075632222","cluster_addr":"172.21.15.195:6827/3075632222","heartbeat_back_addr":"172.21.15.195:6831/3075632222","heartbeat_front_addr":"172.21.15.195:6829/3075632222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:36:22.002614+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:36:44.098031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:37:04.518341+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:37:30.796462+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:37:52.756555+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:38:13.403168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:38:39.058472+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:39:01.106893+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:39:21.908334+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:39:46.843884+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:40:08.792020+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:40:29.282974+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.46:0/3248595150":"2023-10-20T12:34:26.552115+0000","172.21.15.46:0/3624849341":"2023-10-20T12:34:26.552115+0000","172.21.15.46:0/1844094590":"2023-10-20T12:34:26.552115+0000","172.21.15.46:6801/20022894":"2023-10-20T12:34:26.552115+0000","172.21.15.46:0/3969790632":"2023-10-20T12:34:00.135248+0000","172.21.15.46:0/2331135821":"2023-10-20T12:34:00.135248+0000","172.21.15.46:6800/51664346":"2023-10-20T12:34:00.135248+0000","172.21.15.46:6801/51664346":"2023-10-20T12:34:00.135248+0000","172.21.15.46:0/585851467":"2023-10-20T12:34:00.135248+0000","172.21.15.46:6800/20022894":"2023-10-20T12:34:26.552115+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-19T12:41:35.509 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.505+0000 7f7821dff700 1 -- 172.21.15.46:0/4143170222 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f78080a1480 msgr2=0x7f78080a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:35.509 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.505+0000 7f7821dff700 1 --2- 172.21.15.46:0/4143170222 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f78080a1480 0x7f78080a3940 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f780c003730 tx=0x7f780c000bc0 comp rx=0 tx=0).stop 2023-10-19T12:41:35.509 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.505+0000 7f7821dff700 1 -- 172.21.15.46:0/4143170222 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f781c1022d0 msgr2=0x7f781c19fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:35.509 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.505+0000 7f7821dff700 1 --2- 172.21.15.46:0/4143170222 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f781c1022d0 0x7f781c19fe60 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7814007ee0 tx=0x7f781400d3b0 comp rx=0 tx=0).stop 2023-10-19T12:41:35.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.505+0000 7f7821dff700 1 -- 172.21.15.46:0/4143170222 shutdown_connections 2023-10-19T12:41:35.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.505+0000 7f7821dff700 1 --2- 172.21.15.46:0/4143170222 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f781c1022d0 0x7f781c19fe60 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:35.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.505+0000 7f7821dff700 1 --2- 172.21.15.46:0/4143170222 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f78080a1480 0x7f78080a3940 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:35.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.505+0000 7f7821dff700 1 --2- 172.21.15.46:0/4143170222 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f781c100740 0x7f781c198900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:35.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.505+0000 7f7821dff700 1 --2- 172.21.15.46:0/4143170222 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f781c101930 0x7f781c198e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:35.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.505+0000 7f7821dff700 1 -- 172.21.15.46:0/4143170222 >> 172.21.15.46:0/4143170222 conn(0x7f781c0fbc90 msgr2=0x7f781c107100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:35.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.506+0000 7f7821dff700 1 -- 172.21.15.46:0/4143170222 shutdown_connections 2023-10-19T12:41:35.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.506+0000 7f7821dff700 1 -- 172.21.15.46:0/4143170222 wait complete. 2023-10-19T12:41:35.527 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-19T12:37:07.175795+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-19T12:41:16.895203+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-19T12:41:18.255601+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-19T12:41:21.830455+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-19T12:41:35.528 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-19T12:41:35.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.734+0000 7fd989bff700 1 -- 172.21.15.46:0/1627341655 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd984102330 msgr2=0x7fd984108be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:35.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.734+0000 7fd989bff700 1 --2- 172.21.15.46:0/1627341655 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd984102330 0x7fd984108be0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd97c00b0d0 tx=0x7fd97c00b3e0 comp rx=0 tx=0).stop 2023-10-19T12:41:35.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.734+0000 7fd989bff700 1 -- 172.21.15.46:0/1627341655 shutdown_connections 2023-10-19T12:41:35.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.734+0000 7fd989bff700 1 --2- 172.21.15.46:0/1627341655 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd984102330 0x7fd984108be0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:35.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.734+0000 7fd989bff700 1 --2- 172.21.15.46:0/1627341655 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd9841007a0 0x7fd984100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:35.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.734+0000 7fd989bff700 1 --2- 172.21.15.46:0/1627341655 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd984101990 0x7fd984101df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:35.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.734+0000 7fd989bff700 1 -- 172.21.15.46:0/1627341655 >> 172.21.15.46:0/1627341655 conn(0x7fd9840fbcf0 msgr2=0x7fd9840fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:35.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.734+0000 7fd989bff700 1 -- 172.21.15.46:0/1627341655 shutdown_connections 2023-10-19T12:41:35.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.734+0000 7fd989bff700 1 -- 172.21.15.46:0/1627341655 wait complete. 2023-10-19T12:41:35.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.735+0000 7fd989bff700 1 Processor -- start 2023-10-19T12:41:35.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.735+0000 7fd989bff700 1 -- start start 2023-10-19T12:41:35.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.736+0000 7fd989bff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd9841007a0 0x7fd984196830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:35.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.736+0000 7fd989bff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd984101990 0x7fd984196d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:35.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.736+0000 7fd989bff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd984102330 0x7fd98419dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:35.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.736+0000 7fd989bff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd98419e360 con 0x7fd984102330 2023-10-19T12:41:35.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.736+0000 7fd989bff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd98419e4a0 con 0x7fd984101990 2023-10-19T12:41:35.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.736+0000 7fd989bff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd98419e630 con 0x7fd9841007a0 2023-10-19T12:41:35.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.736+0000 7fd983fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd984102330 0x7fd98419dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:35.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.736+0000 7fd983fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd984102330 0x7fd98419dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43876/0 (socket says 172.21.15.46:43876) 2023-10-19T12:41:35.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.736+0000 7fd983fff700 1 -- 172.21.15.46:0/4012763939 learned_addr learned my addr 172.21.15.46:0/4012763939 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:41:35.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.736+0000 7fd982ffd700 1 --2- 172.21.15.46:0/4012763939 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd984101990 0x7fd984196d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:35.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.736+0000 7fd9837fe700 1 --2- 172.21.15.46:0/4012763939 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd9841007a0 0x7fd984196830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:35.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.736+0000 7fd983fff700 1 -- 172.21.15.46:0/4012763939 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd9841007a0 msgr2=0x7fd984196830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:35.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.736+0000 7fd983fff700 1 --2- 172.21.15.46:0/4012763939 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd9841007a0 0x7fd984196830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:35.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.736+0000 7fd983fff700 1 -- 172.21.15.46:0/4012763939 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd984101990 msgr2=0x7fd984196d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:35.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.736+0000 7fd983fff700 1 --2- 172.21.15.46:0/4012763939 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd984101990 0x7fd984196d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:35.746 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.736+0000 7fd983fff700 1 -- 172.21.15.46:0/4012763939 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd97c009d00 con 0x7fd984102330 2023-10-19T12:41:35.746 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.737+0000 7fd983fff700 1 --2- 172.21.15.46:0/4012763939 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd984102330 0x7fd98419dd90 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd97c007b60 tx=0x7fd97c008e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:35.746 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.737+0000 7fd980ff9700 1 -- 172.21.15.46:0/4012763939 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd97c00e040 con 0x7fd984102330 2023-10-19T12:41:35.746 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.737+0000 7fd980ff9700 1 -- 172.21.15.46:0/4012763939 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd97c01d930 con 0x7fd984102330 2023-10-19T12:41:35.746 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.737+0000 7fd989bff700 1 -- 172.21.15.46:0/4012763939 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd98419e8b0 con 0x7fd984102330 2023-10-19T12:41:35.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.737+0000 7fd980ff9700 1 -- 172.21.15.46:0/4012763939 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd97c01b9f0 con 0x7fd984102330 2023-10-19T12:41:35.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.737+0000 7fd989bff700 1 -- 172.21.15.46:0/4012763939 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd98419ed80 con 0x7fd984102330 2023-10-19T12:41:35.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.738+0000 7fd989bff700 1 -- 172.21.15.46:0/4012763939 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd984107b70 con 0x7fd984102330 2023-10-19T12:41:35.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.740+0000 7fd980ff9700 1 -- 172.21.15.46:0/4012763939 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fd97c01daa0 con 0x7fd984102330 2023-10-19T12:41:35.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.742+0000 7fd980ff9700 1 --2- 172.21.15.46:0/4012763939 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fd96c0a1500 0x7fd96c0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:35.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.742+0000 7fd980ff9700 1 -- 172.21.15.46:0/4012763939 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fd97c0cecc0 con 0x7fd984102330 2023-10-19T12:41:35.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.742+0000 7fd9837fe700 1 --2- 172.21.15.46:0/4012763939 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fd96c0a1500 0x7fd96c0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:35.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.743+0000 7fd9837fe700 1 --2- 172.21.15.46:0/4012763939 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fd96c0a1500 0x7fd96c0a39c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd9841017f0 tx=0x7fd974009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:35.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.744+0000 7fd980ff9700 1 -- 172.21.15.46:0/4012763939 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd97c098160 con 0x7fd984102330 2023-10-19T12:41:35.960 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.957+0000 7fd989bff700 1 -- 172.21.15.46:0/4012763939 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd98410c010 con 0x7fd984102330 2023-10-19T12:41:35.961 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.957+0000 7fd980ff9700 1 -- 172.21.15.46:0/4012763939 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd97c09b780 con 0x7fd984102330 2023-10-19T12:41:35.962 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2023-10-19T12:41:35.963 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.960+0000 7fd989bff700 1 -- 172.21.15.46:0/4012763939 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fd96c0a1500 msgr2=0x7fd96c0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:35.964 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.960+0000 7fd989bff700 1 --2- 172.21.15.46:0/4012763939 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fd96c0a1500 0x7fd96c0a39c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd9841017f0 tx=0x7fd974009260 comp rx=0 tx=0).stop 2023-10-19T12:41:35.964 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.960+0000 7fd989bff700 1 -- 172.21.15.46:0/4012763939 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd984102330 msgr2=0x7fd98419dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:35.964 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.960+0000 7fd989bff700 1 --2- 172.21.15.46:0/4012763939 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd984102330 0x7fd98419dd90 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd97c007b60 tx=0x7fd97c008e40 comp rx=0 tx=0).stop 2023-10-19T12:41:35.964 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.960+0000 7fd989bff700 1 -- 172.21.15.46:0/4012763939 shutdown_connections 2023-10-19T12:41:35.964 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.960+0000 7fd989bff700 1 --2- 172.21.15.46:0/4012763939 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd984102330 0x7fd98419dd90 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:35.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.960+0000 7fd989bff700 1 --2- 172.21.15.46:0/4012763939 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fd96c0a1500 0x7fd96c0a39c0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:35.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.960+0000 7fd989bff700 1 --2- 172.21.15.46:0/4012763939 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd9841007a0 0x7fd984196830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:35.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.960+0000 7fd989bff700 1 --2- 172.21.15.46:0/4012763939 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd984101990 0x7fd984196d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:35.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.960+0000 7fd989bff700 1 -- 172.21.15.46:0/4012763939 >> 172.21.15.46:0/4012763939 conn(0x7fd9840fbcf0 msgr2=0x7fd984104cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:35.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.960+0000 7fd989bff700 1 -- 172.21.15.46:0/4012763939 shutdown_connections 2023-10-19T12:41:35.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:35.960+0000 7fd989bff700 1 -- 172.21.15.46:0/4012763939 wait complete. 2023-10-19T12:41:35.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:35 smithi046 ceph-mon[98509]: pgmap v292: 129 pgs: 129 active+clean; 579 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-19T12:41:35.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:35 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/4143170222' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-19T12:41:35.982 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-19T12:41:36.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:35 smithi157 ceph-mon[134109]: pgmap v292: 129 pgs: 129 active+clean; 579 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-19T12:41:36.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:35 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/4143170222' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-19T12:41:36.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:35 smithi195 ceph-mon[134493]: pgmap v292: 129 pgs: 129 active+clean; 579 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-19T12:41:36.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:35 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/4143170222' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-19T12:41:36.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.185+0000 7f7acddff700 1 -- 172.21.15.46:0/2522436817 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ac81007a0 msgr2=0x7f7ac8100bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:36.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.185+0000 7f7acddff700 1 --2- 172.21.15.46:0/2522436817 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ac81007a0 0x7f7ac8100bc0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7ab80099c0 tx=0x7f7ab8009cd0 comp rx=0 tx=0).stop 2023-10-19T12:41:36.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.186+0000 7f7acddff700 1 -- 172.21.15.46:0/2522436817 shutdown_connections 2023-10-19T12:41:36.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.186+0000 7f7acddff700 1 --2- 172.21.15.46:0/2522436817 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7ac8102330 0x7f7ac8108be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:36.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.186+0000 7f7acddff700 1 --2- 172.21.15.46:0/2522436817 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ac81007a0 0x7f7ac8100bc0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:36.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.186+0000 7f7acddff700 1 --2- 172.21.15.46:0/2522436817 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ac8101990 0x7f7ac8101df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:36.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.186+0000 7f7acddff700 1 -- 172.21.15.46:0/2522436817 >> 172.21.15.46:0/2522436817 conn(0x7f7ac80fbcf0 msgr2=0x7f7ac80fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:36.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.186+0000 7f7acddff700 1 -- 172.21.15.46:0/2522436817 shutdown_connections 2023-10-19T12:41:36.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.186+0000 7f7acddff700 1 -- 172.21.15.46:0/2522436817 wait complete. 2023-10-19T12:41:36.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.187+0000 7f7acddff700 1 Processor -- start 2023-10-19T12:41:36.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.187+0000 7f7acddff700 1 -- start start 2023-10-19T12:41:36.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.187+0000 7f7acddff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ac81007a0 0x7f7ac8196760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:36.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.187+0000 7f7acddff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ac8101990 0x7f7ac8196ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:36.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.187+0000 7f7acddff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7ac8102330 0x7f7ac819dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:36.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.187+0000 7f7acddff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac819e290 con 0x7f7ac81007a0 2023-10-19T12:41:36.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.187+0000 7f7acddff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac819e3d0 con 0x7f7ac8101990 2023-10-19T12:41:36.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.187+0000 7f7acddff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac819e560 con 0x7f7ac8102330 2023-10-19T12:41:36.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.187+0000 7f7ac77fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ac81007a0 0x7f7ac8196760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:36.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.187+0000 7f7ac77fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ac81007a0 0x7f7ac8196760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43892/0 (socket says 172.21.15.46:43892) 2023-10-19T12:41:36.195 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.187+0000 7f7ac77fe700 1 -- 172.21.15.46:0/1152472479 learned_addr learned my addr 172.21.15.46:0/1152472479 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:41:36.195 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.187+0000 7f7ac7fff700 1 --2- 172.21.15.46:0/1152472479 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7ac8102330 0x7f7ac819dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:36.195 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.187+0000 7f7ac6ffd700 1 --2- 172.21.15.46:0/1152472479 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ac8101990 0x7f7ac8196ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:36.195 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.188+0000 7f7ac77fe700 1 -- 172.21.15.46:0/1152472479 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7ac8102330 msgr2=0x7f7ac819dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:36.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.188+0000 7f7ac77fe700 1 --2- 172.21.15.46:0/1152472479 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7ac8102330 0x7f7ac819dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:36.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.188+0000 7f7ac77fe700 1 -- 172.21.15.46:0/1152472479 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ac8101990 msgr2=0x7f7ac8196ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:36.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.188+0000 7f7ac77fe700 1 --2- 172.21.15.46:0/1152472479 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ac8101990 0x7f7ac8196ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:36.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.188+0000 7f7ac77fe700 1 -- 172.21.15.46:0/1152472479 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ab80095f0 con 0x7f7ac81007a0 2023-10-19T12:41:36.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.188+0000 7f7ac77fe700 1 --2- 172.21.15.46:0/1152472479 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ac81007a0 0x7f7ac8196760 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f7ab8003730 tx=0x7f7ab800fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:36.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.188+0000 7f7ac4ff9700 1 -- 172.21.15.46:0/1152472479 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab801d070 con 0x7f7ac81007a0 2023-10-19T12:41:36.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.188+0000 7f7ac4ff9700 1 -- 172.21.15.46:0/1152472479 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7ab800bda0 con 0x7f7ac81007a0 2023-10-19T12:41:36.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.188+0000 7f7acddff700 1 -- 172.21.15.46:0/1152472479 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ac819e7e0 con 0x7f7ac81007a0 2023-10-19T12:41:36.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.188+0000 7f7ac4ff9700 1 -- 172.21.15.46:0/1152472479 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab8004b30 con 0x7f7ac81007a0 2023-10-19T12:41:36.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.188+0000 7f7acddff700 1 -- 172.21.15.46:0/1152472479 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ac819ec60 con 0x7f7ac81007a0 2023-10-19T12:41:36.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.189+0000 7f7acddff700 1 -- 172.21.15.46:0/1152472479 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ac8107c70 con 0x7f7ac81007a0 2023-10-19T12:41:36.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.191+0000 7f7ac4ff9700 1 -- 172.21.15.46:0/1152472479 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f7ab8004c90 con 0x7f7ac81007a0 2023-10-19T12:41:36.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.193+0000 7f7ac4ff9700 1 --2- 172.21.15.46:0/1152472479 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f7ab00a1500 0x7f7ab00a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:36.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.193+0000 7f7ac4ff9700 1 -- 172.21.15.46:0/1152472479 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f7ab80ce0f0 con 0x7f7ac81007a0 2023-10-19T12:41:36.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.193+0000 7f7ac6ffd700 1 --2- 172.21.15.46:0/1152472479 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f7ab00a1500 0x7f7ab00a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:36.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.193+0000 7f7ac6ffd700 1 --2- 172.21.15.46:0/1152472479 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f7ab00a1500 0x7f7ab00a39c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7abc009c60 tx=0x7f7abc009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:36.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.195+0000 7f7ac4ff9700 1 -- 172.21.15.46:0/1152472479 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7ab8097590 con 0x7f7ac81007a0 2023-10-19T12:41:36.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.410+0000 7f7acddff700 1 -- 172.21.15.46:0/1152472479 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7ac810c000 con 0x7f7ac81007a0 2023-10-19T12:41:36.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.411+0000 7f7ac4ff9700 1 -- 172.21.15.46:0/1152472479 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7ab8095e60 con 0x7f7ac81007a0 2023-10-19T12:41:36.414 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2023-10-19T12:41:36.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.413+0000 7f7acddff700 1 -- 172.21.15.46:0/1152472479 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f7ab00a1500 msgr2=0x7f7ab00a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:36.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.413+0000 7f7acddff700 1 --2- 172.21.15.46:0/1152472479 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f7ab00a1500 0x7f7ab00a39c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7abc009c60 tx=0x7f7abc009260 comp rx=0 tx=0).stop 2023-10-19T12:41:36.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.413+0000 7f7acddff700 1 -- 172.21.15.46:0/1152472479 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ac81007a0 msgr2=0x7f7ac8196760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:36.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.413+0000 7f7acddff700 1 --2- 172.21.15.46:0/1152472479 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ac81007a0 0x7f7ac8196760 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f7ab8003730 tx=0x7f7ab800fa00 comp rx=0 tx=0).stop 2023-10-19T12:41:36.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.413+0000 7f7acddff700 1 -- 172.21.15.46:0/1152472479 shutdown_connections 2023-10-19T12:41:36.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.413+0000 7f7acddff700 1 --2- 172.21.15.46:0/1152472479 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f7ab00a1500 0x7f7ab00a39c0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:36.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.413+0000 7f7acddff700 1 --2- 172.21.15.46:0/1152472479 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7ac8102330 0x7f7ac819dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:36.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.413+0000 7f7acddff700 1 --2- 172.21.15.46:0/1152472479 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ac81007a0 0x7f7ac8196760 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:36.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.413+0000 7f7acddff700 1 --2- 172.21.15.46:0/1152472479 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ac8101990 0x7f7ac8196ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:36.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.413+0000 7f7acddff700 1 -- 172.21.15.46:0/1152472479 >> 172.21.15.46:0/1152472479 conn(0x7f7ac80fbcf0 msgr2=0x7f7ac8104db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:36.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.413+0000 7f7acddff700 1 -- 172.21.15.46:0/1152472479 shutdown_connections 2023-10-19T12:41:36.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.413+0000 7f7acddff700 1 -- 172.21.15.46:0/1152472479 wait complete. 2023-10-19T12:41:36.435 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-19T12:41:36.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.640+0000 7ff9ecdff700 1 -- 172.21.15.46:0/1324101849 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9e81029d0 msgr2=0x7ff9e8102df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:36.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.640+0000 7ff9ecdff700 1 --2- 172.21.15.46:0/1324101849 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9e81029d0 0x7ff9e8102df0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff9d80099c0 tx=0x7ff9d8009cd0 comp rx=0 tx=0).stop 2023-10-19T12:41:36.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.640+0000 7ff9ecdff700 1 -- 172.21.15.46:0/1324101849 shutdown_connections 2023-10-19T12:41:36.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.640+0000 7ff9ecdff700 1 --2- 172.21.15.46:0/1324101849 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff9e8104560 0x7ff9e810ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:36.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.640+0000 7ff9ecdff700 1 --2- 172.21.15.46:0/1324101849 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9e81029d0 0x7ff9e8102df0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:36.650 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.640+0000 7ff9ecdff700 1 --2- 172.21.15.46:0/1324101849 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff9e8103bc0 0x7ff9e8104020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:36.650 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.640+0000 7ff9ecdff700 1 -- 172.21.15.46:0/1324101849 >> 172.21.15.46:0/1324101849 conn(0x7ff9e80fdf40 msgr2=0x7ff9e8100380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:36.650 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.640+0000 7ff9ecdff700 1 -- 172.21.15.46:0/1324101849 shutdown_connections 2023-10-19T12:41:36.651 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.640+0000 7ff9ecdff700 1 -- 172.21.15.46:0/1324101849 wait complete. 2023-10-19T12:41:36.651 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.641+0000 7ff9ecdff700 1 Processor -- start 2023-10-19T12:41:36.651 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.641+0000 7ff9ecdff700 1 -- start start 2023-10-19T12:41:36.651 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.641+0000 7ff9ecdff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff9e81029d0 0x7ff9e8198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:36.651 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.641+0000 7ff9ecdff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9e8103bc0 0x7ff9e8198eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:36.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.641+0000 7ff9ecdff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff9e8104560 0x7ff9e819fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:36.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.641+0000 7ff9ecdff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e81a0450 con 0x7ff9e8103bc0 2023-10-19T12:41:36.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.641+0000 7ff9ecdff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e81a0590 con 0x7ff9e8104560 2023-10-19T12:41:36.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.641+0000 7ff9ecdff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e81a0720 con 0x7ff9e81029d0 2023-10-19T12:41:36.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.641+0000 7ff9dffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9e8103bc0 0x7ff9e8198eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:36.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.642+0000 7ff9dffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9e8103bc0 0x7ff9e8198eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43920/0 (socket says 172.21.15.46:43920) 2023-10-19T12:41:36.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.642+0000 7ff9dffff700 1 -- 172.21.15.46:0/2034680240 learned_addr learned my addr 172.21.15.46:0/2034680240 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:41:36.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.642+0000 7ff9e659c700 1 --2- 172.21.15.46:0/2034680240 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff9e81029d0 0x7ff9e8198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:36.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.642+0000 7ff9e6d9d700 1 --2- 172.21.15.46:0/2034680240 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff9e8104560 0x7ff9e819fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:36.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.642+0000 7ff9dffff700 1 -- 172.21.15.46:0/2034680240 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff9e81029d0 msgr2=0x7ff9e8198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:36.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.642+0000 7ff9dffff700 1 --2- 172.21.15.46:0/2034680240 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff9e81029d0 0x7ff9e8198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:36.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.642+0000 7ff9dffff700 1 -- 172.21.15.46:0/2034680240 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff9e8104560 msgr2=0x7ff9e819fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:36.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.642+0000 7ff9dffff700 1 --2- 172.21.15.46:0/2034680240 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff9e8104560 0x7ff9e819fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:36.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.642+0000 7ff9dffff700 1 -- 172.21.15.46:0/2034680240 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9d0009520 con 0x7ff9e8103bc0 2023-10-19T12:41:36.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.642+0000 7ff9dffff700 1 --2- 172.21.15.46:0/2034680240 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9e8103bc0 0x7ff9e8198eb0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff9d000eb30 tx=0x7ff9d000ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:36.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.642+0000 7ff9df7fe700 1 -- 172.21.15.46:0/2034680240 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d0009880 con 0x7ff9e8103bc0 2023-10-19T12:41:36.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.642+0000 7ff9df7fe700 1 -- 172.21.15.46:0/2034680240 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff9d00044e0 con 0x7ff9e8103bc0 2023-10-19T12:41:36.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.642+0000 7ff9df7fe700 1 -- 172.21.15.46:0/2034680240 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d0003d80 con 0x7ff9e8103bc0 2023-10-19T12:41:36.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.642+0000 7ff9ecdff700 1 -- 172.21.15.46:0/2034680240 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9d80095f0 con 0x7ff9e8103bc0 2023-10-19T12:41:36.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.643+0000 7ff9ecdff700 1 -- 172.21.15.46:0/2034680240 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9e81a0d80 con 0x7ff9e8103bc0 2023-10-19T12:41:36.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.644+0000 7ff9ecdff700 1 -- 172.21.15.46:0/2034680240 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9e8109e50 con 0x7ff9e8103bc0 2023-10-19T12:41:36.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.646+0000 7ff9df7fe700 1 -- 172.21.15.46:0/2034680240 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7ff9d0003f20 con 0x7ff9e8103bc0 2023-10-19T12:41:36.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.647+0000 7ff9df7fe700 1 --2- 172.21.15.46:0/2034680240 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7ff9d40a1500 0x7ff9d40a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:36.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.647+0000 7ff9df7fe700 1 -- 172.21.15.46:0/2034680240 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7ff9d0014070 con 0x7ff9e8103bc0 2023-10-19T12:41:36.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.647+0000 7ff9e659c700 1 --2- 172.21.15.46:0/2034680240 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7ff9d40a1500 0x7ff9d40a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:36.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.648+0000 7ff9e659c700 1 --2- 172.21.15.46:0/2034680240 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7ff9d40a1500 0x7ff9d40a39c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff9d8003730 tx=0x7ff9d8000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:36.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.651+0000 7ff9df7fe700 1 -- 172.21.15.46:0/2034680240 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff9d0096820 con 0x7ff9e8103bc0 2023-10-19T12:41:36.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.865+0000 7ff9ecdff700 1 -- 172.21.15.46:0/2034680240 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff9e802cf10 con 0x7ff9e8103bc0 2023-10-19T12:41:36.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.865+0000 7ff9df7fe700 1 -- 172.21.15.46:0/2034680240 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff9d0099e40 con 0x7ff9e8103bc0 2023-10-19T12:41:36.869 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2023-10-19T12:41:36.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.868+0000 7ff9ecdff700 1 -- 172.21.15.46:0/2034680240 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7ff9d40a1500 msgr2=0x7ff9d40a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:36.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.868+0000 7ff9ecdff700 1 --2- 172.21.15.46:0/2034680240 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7ff9d40a1500 0x7ff9d40a39c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff9d8003730 tx=0x7ff9d8000bc0 comp rx=0 tx=0).stop 2023-10-19T12:41:36.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.868+0000 7ff9ecdff700 1 -- 172.21.15.46:0/2034680240 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9e8103bc0 msgr2=0x7ff9e8198eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:36.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.868+0000 7ff9ecdff700 1 --2- 172.21.15.46:0/2034680240 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9e8103bc0 0x7ff9e8198eb0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff9d000eb30 tx=0x7ff9d000ee40 comp rx=0 tx=0).stop 2023-10-19T12:41:36.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.868+0000 7ff9ecdff700 1 -- 172.21.15.46:0/2034680240 shutdown_connections 2023-10-19T12:41:36.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.868+0000 7ff9ecdff700 1 --2- 172.21.15.46:0/2034680240 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff9e8104560 0x7ff9e819fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:36.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.868+0000 7ff9ecdff700 1 --2- 172.21.15.46:0/2034680240 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7ff9d40a1500 0x7ff9d40a39c0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:36.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.868+0000 7ff9ecdff700 1 --2- 172.21.15.46:0/2034680240 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff9e81029d0 0x7ff9e8198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:36.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.868+0000 7ff9ecdff700 1 --2- 172.21.15.46:0/2034680240 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9e8103bc0 0x7ff9e8198eb0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:36.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.868+0000 7ff9ecdff700 1 -- 172.21.15.46:0/2034680240 >> 172.21.15.46:0/2034680240 conn(0x7ff9e80fdf40 msgr2=0x7ff9e8106f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:36.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.868+0000 7ff9ecdff700 1 -- 172.21.15.46:0/2034680240 shutdown_connections 2023-10-19T12:41:36.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:36.868+0000 7ff9ecdff700 1 -- 172.21.15.46:0/2034680240 wait complete. 2023-10-19T12:41:36.890 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-19T12:41:36.951 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:36 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/4012763939' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-19T12:41:36.951 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:36 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/1152472479' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-19T12:41:37.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:36 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/4012763939' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-19T12:41:37.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:36 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/1152472479' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-19T12:41:37.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.095+0000 7fc9c79ff700 1 -- 172.21.15.46:0/1015767239 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc9c0102330 msgr2=0x7fc9c0108be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:37.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.095+0000 7fc9c79ff700 1 --2- 172.21.15.46:0/1015767239 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc9c0102330 0x7fc9c0108be0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc9b8009fc0 tx=0x7fc9b800b330 comp rx=0 tx=0).stop 2023-10-19T12:41:37.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.095+0000 7fc9c79ff700 1 -- 172.21.15.46:0/1015767239 shutdown_connections 2023-10-19T12:41:37.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.095+0000 7fc9c79ff700 1 --2- 172.21.15.46:0/1015767239 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc9c0102330 0x7fc9c0108be0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:37.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.095+0000 7fc9c79ff700 1 --2- 172.21.15.46:0/1015767239 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9c01007a0 0x7fc9c0100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:37.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.095+0000 7fc9c79ff700 1 --2- 172.21.15.46:0/1015767239 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9c0101990 0x7fc9c0101df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:37.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.095+0000 7fc9c79ff700 1 -- 172.21.15.46:0/1015767239 >> 172.21.15.46:0/1015767239 conn(0x7fc9c00fbcf0 msgr2=0x7fc9c00fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:37.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.095+0000 7fc9c79ff700 1 -- 172.21.15.46:0/1015767239 shutdown_connections 2023-10-19T12:41:37.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.095+0000 7fc9c79ff700 1 -- 172.21.15.46:0/1015767239 wait complete. 2023-10-19T12:41:37.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.096+0000 7fc9c79ff700 1 Processor -- start 2023-10-19T12:41:37.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.096+0000 7fc9c79ff700 1 -- start start 2023-10-19T12:41:37.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.096+0000 7fc9c79ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9c01007a0 0x7fc9c0198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:37.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.096+0000 7fc9c79ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9c0101990 0x7fc9c0198f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:37.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.096+0000 7fc9c79ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc9c0102330 0x7fc9c019ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:37.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.096+0000 7fc9c79ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c01a0530 con 0x7fc9c01007a0 2023-10-19T12:41:37.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.096+0000 7fc9c79ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c01a0670 con 0x7fc9c0102330 2023-10-19T12:41:37.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.096+0000 7fc9c79ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c01a0800 con 0x7fc9c0101990 2023-10-19T12:41:37.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.097+0000 7fc9c579b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9c01007a0 0x7fc9c0198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:37.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.097+0000 7fc9c579b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9c01007a0 0x7fc9c0198a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43948/0 (socket says 172.21.15.46:43948) 2023-10-19T12:41:37.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.097+0000 7fc9c579b700 1 -- 172.21.15.46:0/2360742573 learned_addr learned my addr 172.21.15.46:0/2360742573 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:41:37.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.097+0000 7fc9c4f9a700 1 --2- 172.21.15.46:0/2360742573 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9c0101990 0x7fc9c0198f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:37.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.097+0000 7fc9c5f9c700 1 --2- 172.21.15.46:0/2360742573 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc9c0102330 0x7fc9c019ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:37.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.097+0000 7fc9c579b700 1 -- 172.21.15.46:0/2360742573 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9c0101990 msgr2=0x7fc9c0198f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:37.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.097+0000 7fc9c579b700 1 --2- 172.21.15.46:0/2360742573 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9c0101990 0x7fc9c0198f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:37.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.097+0000 7fc9c579b700 1 -- 172.21.15.46:0/2360742573 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc9c0102330 msgr2=0x7fc9c019ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:37.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.097+0000 7fc9c579b700 1 --2- 172.21.15.46:0/2360742573 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc9c0102330 0x7fc9c019ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:37.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.097+0000 7fc9c579b700 1 -- 172.21.15.46:0/2360742573 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9b8009c40 con 0x7fc9c01007a0 2023-10-19T12:41:37.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.097+0000 7fc9c4f9a700 1 --2- 172.21.15.46:0/2360742573 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9c0101990 0x7fc9c0198f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T12:41:37.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.097+0000 7fc9c579b700 1 --2- 172.21.15.46:0/2360742573 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9c01007a0 0x7fc9c0198a00 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc00e970 tx=0x7fc9bc00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:37.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.098+0000 7fc9b67fc700 1 -- 172.21.15.46:0/2360742573 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9bc009790 con 0x7fc9c01007a0 2023-10-19T12:41:37.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.098+0000 7fc9b67fc700 1 -- 172.21.15.46:0/2360742573 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc9bc00eec0 con 0x7fc9c01007a0 2023-10-19T12:41:37.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.098+0000 7fc9b67fc700 1 -- 172.21.15.46:0/2360742573 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9bc003cf0 con 0x7fc9c01007a0 2023-10-19T12:41:37.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.098+0000 7fc9c79ff700 1 -- 172.21.15.46:0/2360742573 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9c01a0ae0 con 0x7fc9c01007a0 2023-10-19T12:41:37.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.098+0000 7fc9c79ff700 1 -- 172.21.15.46:0/2360742573 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9c01a0fa0 con 0x7fc9c01007a0 2023-10-19T12:41:37.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.099+0000 7fc9c79ff700 1 -- 172.21.15.46:0/2360742573 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9c00675a0 con 0x7fc9c01007a0 2023-10-19T12:41:37.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.101+0000 7fc9b67fc700 1 -- 172.21.15.46:0/2360742573 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fc9bc00ccd0 con 0x7fc9c01007a0 2023-10-19T12:41:37.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.102+0000 7fc9b67fc700 1 --2- 172.21.15.46:0/2360742573 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fc9ac0a1500 0x7fc9ac0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:37.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.102+0000 7fc9b67fc700 1 -- 172.21.15.46:0/2360742573 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fc9bc014070 con 0x7fc9c01007a0 2023-10-19T12:41:37.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.102+0000 7fc9c4f9a700 1 --2- 172.21.15.46:0/2360742573 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fc9ac0a1500 0x7fc9ac0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:37.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.103+0000 7fc9c4f9a700 1 --2- 172.21.15.46:0/2360742573 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fc9ac0a1500 0x7fc9ac0a39c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc9b0005fd0 tx=0x7fc9b0009310 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:37.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.106+0000 7fc9b67fc700 1 -- 172.21.15.46:0/2360742573 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc9bc096550 con 0x7fc9c01007a0 2023-10-19T12:41:37.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:36 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/4012763939' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-19T12:41:37.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:36 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/1152472479' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-19T12:41:37.323 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.320+0000 7fc9c79ff700 1 -- 172.21.15.46:0/2360742573 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fc9c01a1350 con 0x7fc9c01007a0 2023-10-19T12:41:37.324 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.321+0000 7fc9b67fc700 1 -- 172.21.15.46:0/2360742573 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v88) v1 ==== 103+0+11 (secure 0 0 0) 0x7fc9bc099b70 con 0x7fc9c01007a0 2023-10-19T12:41:37.324 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2023-10-19T12:41:37.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.323+0000 7fc9c79ff700 1 -- 172.21.15.46:0/2360742573 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fc9ac0a1500 msgr2=0x7fc9ac0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:37.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.323+0000 7fc9c79ff700 1 --2- 172.21.15.46:0/2360742573 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fc9ac0a1500 0x7fc9ac0a39c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc9b0005fd0 tx=0x7fc9b0009310 comp rx=0 tx=0).stop 2023-10-19T12:41:37.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.323+0000 7fc9c79ff700 1 -- 172.21.15.46:0/2360742573 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9c01007a0 msgr2=0x7fc9c0198a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:37.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.323+0000 7fc9c79ff700 1 --2- 172.21.15.46:0/2360742573 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9c01007a0 0x7fc9c0198a00 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc00e970 tx=0x7fc9bc00ec80 comp rx=0 tx=0).stop 2023-10-19T12:41:37.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.323+0000 7fc9c79ff700 1 -- 172.21.15.46:0/2360742573 shutdown_connections 2023-10-19T12:41:37.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.323+0000 7fc9c79ff700 1 --2- 172.21.15.46:0/2360742573 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc9c0102330 0x7fc9c019ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:37.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.323+0000 7fc9c79ff700 1 --2- 172.21.15.46:0/2360742573 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9c01007a0 0x7fc9c0198a00 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:37.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.323+0000 7fc9c79ff700 1 --2- 172.21.15.46:0/2360742573 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fc9ac0a1500 0x7fc9ac0a39c0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:37.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.323+0000 7fc9c79ff700 1 --2- 172.21.15.46:0/2360742573 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9c0101990 0x7fc9c0198f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:37.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.323+0000 7fc9c79ff700 1 -- 172.21.15.46:0/2360742573 >> 172.21.15.46:0/2360742573 conn(0x7fc9c00fbcf0 msgr2=0x7fc9c0072a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:37.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.323+0000 7fc9c79ff700 1 -- 172.21.15.46:0/2360742573 shutdown_connections 2023-10-19T12:41:37.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.324+0000 7fc9c79ff700 1 -- 172.21.15.46:0/2360742573 wait complete. 2023-10-19T12:41:37.346 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-19T12:41:37.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.550+0000 7f54559ff700 1 -- 172.21.15.46:0/1247503650 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54501022b0 msgr2=0x7f5450108b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:37.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.550+0000 7f54559ff700 1 --2- 172.21.15.46:0/1247503650 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54501022b0 0x7f5450108b60 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f544800b0d0 tx=0x7f544800b3e0 comp rx=0 tx=0).stop 2023-10-19T12:41:37.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.550+0000 7f54559ff700 1 -- 172.21.15.46:0/1247503650 shutdown_connections 2023-10-19T12:41:37.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.550+0000 7f54559ff700 1 --2- 172.21.15.46:0/1247503650 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54501022b0 0x7f5450108b60 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:37.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.550+0000 7f54559ff700 1 --2- 172.21.15.46:0/1247503650 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5450100720 0x7f5450100b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:37.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.550+0000 7f54559ff700 1 --2- 172.21.15.46:0/1247503650 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5450101910 0x7f5450101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:37.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.550+0000 7f54559ff700 1 -- 172.21.15.46:0/1247503650 >> 172.21.15.46:0/1247503650 conn(0x7f54500fbc90 msgr2=0x7f54500fe0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:37.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.550+0000 7f54559ff700 1 -- 172.21.15.46:0/1247503650 shutdown_connections 2023-10-19T12:41:37.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.550+0000 7f54559ff700 1 -- 172.21.15.46:0/1247503650 wait complete. 2023-10-19T12:41:37.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.551+0000 7f54559ff700 1 Processor -- start 2023-10-19T12:41:37.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.551+0000 7f54559ff700 1 -- start start 2023-10-19T12:41:37.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.551+0000 7f54559ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5450100720 0x7f5450074550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:37.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.551+0000 7f54559ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5450101910 0x7f5450072be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:37.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.551+0000 7f54559ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54501022b0 0x7f5450073120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:37.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.551+0000 7f54559ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54500738c0 con 0x7f54501022b0 2023-10-19T12:41:37.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.551+0000 7f54559ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5450073a30 con 0x7f5450100720 2023-10-19T12:41:37.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.551+0000 7f54559ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54501a0830 con 0x7f5450101910 2023-10-19T12:41:37.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.552+0000 7f544effd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5450100720 0x7f5450074550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:37.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.552+0000 7f544f7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54501022b0 0x7f5450073120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:37.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.552+0000 7f544effd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5450100720 0x7f5450074550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:33416/0 (socket says 172.21.15.46:33416) 2023-10-19T12:41:37.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.552+0000 7f544effd700 1 -- 172.21.15.46:0/3954970690 learned_addr learned my addr 172.21.15.46:0/3954970690 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:41:37.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.552+0000 7f5447fff700 1 --2- 172.21.15.46:0/3954970690 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5450101910 0x7f5450072be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:37.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.552+0000 7f544effd700 1 -- 172.21.15.46:0/3954970690 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5450101910 msgr2=0x7f5450072be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:37.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.552+0000 7f544effd700 1 --2- 172.21.15.46:0/3954970690 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5450101910 0x7f5450072be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:37.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.552+0000 7f544effd700 1 -- 172.21.15.46:0/3954970690 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54501022b0 msgr2=0x7f5450073120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:37.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.552+0000 7f544effd700 1 --2- 172.21.15.46:0/3954970690 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54501022b0 0x7f5450073120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:37.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.552+0000 7f544effd700 1 -- 172.21.15.46:0/3954970690 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5448009d00 con 0x7f5450100720 2023-10-19T12:41:37.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.552+0000 7f544f7fe700 1 --2- 172.21.15.46:0/3954970690 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54501022b0 0x7f5450073120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:41:37.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.552+0000 7f544effd700 1 --2- 172.21.15.46:0/3954970690 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5450100720 0x7f5450074550 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f544000e970 tx=0x7f544000ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:37.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.553+0000 7f54549fd700 1 -- 172.21.15.46:0/3954970690 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5440009790 con 0x7f5450100720 2023-10-19T12:41:37.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.553+0000 7f54559ff700 1 -- 172.21.15.46:0/3954970690 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54501a0ac0 con 0x7f5450100720 2023-10-19T12:41:37.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.553+0000 7f54549fd700 1 -- 172.21.15.46:0/3954970690 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f544000c780 con 0x7f5450100720 2023-10-19T12:41:37.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.553+0000 7f54549fd700 1 -- 172.21.15.46:0/3954970690 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5440003be0 con 0x7f5450100720 2023-10-19T12:41:37.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.553+0000 7f54559ff700 1 -- 172.21.15.46:0/3954970690 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54501a0fd0 con 0x7f5450100720 2023-10-19T12:41:37.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.554+0000 7f54559ff700 1 -- 172.21.15.46:0/3954970690 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5450107af0 con 0x7f5450100720 2023-10-19T12:41:37.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.556+0000 7f54549fd700 1 -- 172.21.15.46:0/3954970690 <== mon.2 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f5440003d60 con 0x7f5450100720 2023-10-19T12:41:37.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.558+0000 7f54549fd700 1 --2- 172.21.15.46:0/3954970690 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f543c0a1480 0x7f543c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:37.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.558+0000 7f54549fd700 1 -- 172.21.15.46:0/3954970690 <== mon.2 v2:172.21.15.157:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f5440014070 con 0x7f5450100720 2023-10-19T12:41:37.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.558+0000 7f5447fff700 1 --2- 172.21.15.46:0/3954970690 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f543c0a1480 0x7f543c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:37.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.559+0000 7f5447fff700 1 --2- 172.21.15.46:0/3954970690 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f543c0a1480 0x7f543c0a3940 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5438009c60 tx=0x7f5438009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:37.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.560+0000 7f54549fd700 1 -- 172.21.15.46:0/3954970690 <== mon.2 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5440096640 con 0x7f5450100720 2023-10-19T12:41:37.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.791+0000 7f54559ff700 1 -- 172.21.15.46:0/3954970690 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f5450067530 con 0x7f5450100720 2023-10-19T12:41:37.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.791+0000 7f54549fd700 1 -- 172.21.15.46:0/3954970690 <== mon.2 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v88) v1 ==== 81+0+583 (secure 0 0 0) 0x7f5440099c60 con 0x7f5450100720 2023-10-19T12:41:37.795 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/3248595150 2023-10-20T12:34:26.552115+0000 2023-10-19T12:41:37.795 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/3624849341 2023-10-20T12:34:26.552115+0000 2023-10-19T12:41:37.795 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/1844094590 2023-10-20T12:34:26.552115+0000 2023-10-19T12:41:37.795 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6801/20022894 2023-10-20T12:34:26.552115+0000 2023-10-19T12:41:37.795 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/3969790632 2023-10-20T12:34:00.135248+0000 2023-10-19T12:41:37.796 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/2331135821 2023-10-20T12:34:00.135248+0000 2023-10-19T12:41:37.796 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6800/51664346 2023-10-20T12:34:00.135248+0000 2023-10-19T12:41:37.796 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6801/51664346 2023-10-20T12:34:00.135248+0000 2023-10-19T12:41:37.796 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/585851467 2023-10-20T12:34:00.135248+0000 2023-10-19T12:41:37.797 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6800/20022894 2023-10-20T12:34:26.552115+0000 2023-10-19T12:41:37.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.794+0000 7f54559ff700 1 -- 172.21.15.46:0/3954970690 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f543c0a1480 msgr2=0x7f543c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:37.798 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.794+0000 7f54559ff700 1 --2- 172.21.15.46:0/3954970690 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f543c0a1480 0x7f543c0a3940 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5438009c60 tx=0x7f5438009260 comp rx=0 tx=0).stop 2023-10-19T12:41:37.798 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.794+0000 7f54559ff700 1 -- 172.21.15.46:0/3954970690 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5450100720 msgr2=0x7f5450074550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:37.798 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.794+0000 7f54559ff700 1 --2- 172.21.15.46:0/3954970690 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5450100720 0x7f5450074550 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f544000e970 tx=0x7f544000ec80 comp rx=0 tx=0).stop 2023-10-19T12:41:37.798 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.794+0000 7f54559ff700 1 -- 172.21.15.46:0/3954970690 shutdown_connections 2023-10-19T12:41:37.799 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.794+0000 7f54559ff700 1 --2- 172.21.15.46:0/3954970690 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54501022b0 0x7f5450073120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:37.799 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.794+0000 7f54559ff700 1 --2- 172.21.15.46:0/3954970690 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5450100720 0x7f5450074550 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:37.799 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.794+0000 7f54559ff700 1 --2- 172.21.15.46:0/3954970690 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f543c0a1480 0x7f543c0a3940 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:37.799 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.794+0000 7f54559ff700 1 --2- 172.21.15.46:0/3954970690 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5450101910 0x7f5450072be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:37.799 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.794+0000 7f54559ff700 1 -- 172.21.15.46:0/3954970690 >> 172.21.15.46:0/3954970690 conn(0x7f54500fbc90 msgr2=0x7f5450104c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:37.800 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.794+0000 7f54559ff700 1 -- 172.21.15.46:0/3954970690 shutdown_connections 2023-10-19T12:41:37.800 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:37.794+0000 7f54559ff700 1 -- 172.21.15.46:0/3954970690 wait complete. 2023-10-19T12:41:37.800 INFO:teuthology.orchestra.run.smithi046.stderr:listed 10 entries 2023-10-19T12:41:37.815 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-10-19T12:41:37.816 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-19T12:41:37.861 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-19T12:41:37.962 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:37 smithi046 ceph-mon[98509]: pgmap v293: 129 pgs: 129 active+clean; 581 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2023-10-19T12:41:37.963 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:37 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/2034680240' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-19T12:41:37.963 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:37 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/2360742573' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-19T12:41:38.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:37 smithi157 ceph-mon[134109]: pgmap v293: 129 pgs: 129 active+clean; 581 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2023-10-19T12:41:38.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:37 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/2034680240' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-19T12:41:38.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:37 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/2360742573' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-19T12:41:38.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.103+0000 7fa351dff700 1 -- 172.21.15.46:0/3775107012 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa34c0747d0 msgr2=0x7fa34c072c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:38.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.103+0000 7fa351dff700 1 --2- 172.21.15.46:0/3775107012 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa34c0747d0 0x7fa34c072c20 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa33c0098f0 tx=0x7fa33c009c00 comp rx=0 tx=0).stop 2023-10-19T12:41:38.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.103+0000 7fa351dff700 1 -- 172.21.15.46:0/3775107012 shutdown_connections 2023-10-19T12:41:38.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.103+0000 7fa351dff700 1 --2- 172.21.15.46:0/3775107012 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa34c108610 0x7fa34c10aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:38.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.103+0000 7fa351dff700 1 --2- 172.21.15.46:0/3775107012 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa34c0747d0 0x7fa34c072c20 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:38.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.103+0000 7fa351dff700 1 --2- 172.21.15.46:0/3775107012 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa34c0731f0 0x7fa34c073670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:38.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.103+0000 7fa351dff700 1 -- 172.21.15.46:0/3775107012 >> 172.21.15.46:0/3775107012 conn(0x7fa34c0fbc90 msgr2=0x7fa34c0fe0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:38.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.103+0000 7fa351dff700 1 -- 172.21.15.46:0/3775107012 shutdown_connections 2023-10-19T12:41:38.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.103+0000 7fa351dff700 1 -- 172.21.15.46:0/3775107012 wait complete. 2023-10-19T12:41:38.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.104+0000 7fa351dff700 1 Processor -- start 2023-10-19T12:41:38.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.104+0000 7fa351dff700 1 -- start start 2023-10-19T12:41:38.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.104+0000 7fa351dff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa34c0731f0 0x7fa34c198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:38.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.104+0000 7fa351dff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa34c0747d0 0x7fa34c198e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:38.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.104+0000 7fa351dff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa34c108610 0x7fa34c19fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:38.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.104+0000 7fa351dff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa34c1a0440 con 0x7fa34c0731f0 2023-10-19T12:41:38.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.104+0000 7fa351dff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa34c1a0580 con 0x7fa34c108610 2023-10-19T12:41:38.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.104+0000 7fa351dff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa34c1a0710 con 0x7fa34c0747d0 2023-10-19T12:41:38.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.105+0000 7fa34b7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa34c0731f0 0x7fa34c198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:38.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.105+0000 7fa34b7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa34c0731f0 0x7fa34c198910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43996/0 (socket says 172.21.15.46:43996) 2023-10-19T12:41:38.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.105+0000 7fa34b7fe700 1 -- 172.21.15.46:0/2267152831 learned_addr learned my addr 172.21.15.46:0/2267152831 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:41:38.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.105+0000 7fa343fff700 1 --2- 172.21.15.46:0/2267152831 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa34c0747d0 0x7fa34c198e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:38.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.105+0000 7fa34bfff700 1 --2- 172.21.15.46:0/2267152831 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa34c108610 0x7fa34c19fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:38.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.105+0000 7fa34b7fe700 1 -- 172.21.15.46:0/2267152831 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa34c0747d0 msgr2=0x7fa34c198e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:38.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.105+0000 7fa34b7fe700 1 --2- 172.21.15.46:0/2267152831 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa34c0747d0 0x7fa34c198e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:38.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.105+0000 7fa34b7fe700 1 -- 172.21.15.46:0/2267152831 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa34c108610 msgr2=0x7fa34c19fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:38.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.105+0000 7fa34b7fe700 1 --2- 172.21.15.46:0/2267152831 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa34c108610 0x7fa34c19fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:38.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.105+0000 7fa34b7fe700 1 -- 172.21.15.46:0/2267152831 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa33c009520 con 0x7fa34c0731f0 2023-10-19T12:41:38.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.105+0000 7fa343fff700 1 --2- 172.21.15.46:0/2267152831 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa34c0747d0 0x7fa34c198e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T12:41:38.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.105+0000 7fa34bfff700 1 --2- 172.21.15.46:0/2267152831 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa34c108610 0x7fa34c19fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T12:41:38.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.105+0000 7fa34b7fe700 1 --2- 172.21.15.46:0/2267152831 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa34c0731f0 0x7fa34c198910 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa33c009810 tx=0x7fa33c00b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:38.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.105+0000 7fa3497fa700 1 -- 172.21.15.46:0/2267152831 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa33c01c070 con 0x7fa34c0731f0 2023-10-19T12:41:38.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.106+0000 7fa3497fa700 1 -- 172.21.15.46:0/2267152831 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa33c00f7d0 con 0x7fa34c0731f0 2023-10-19T12:41:38.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.106+0000 7fa351dff700 1 -- 172.21.15.46:0/2267152831 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa34c1a0990 con 0x7fa34c0731f0 2023-10-19T12:41:38.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.106+0000 7fa3497fa700 1 -- 172.21.15.46:0/2267152831 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa33c003b90 con 0x7fa34c0731f0 2023-10-19T12:41:38.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.106+0000 7fa351dff700 1 -- 172.21.15.46:0/2267152831 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa34c1a0db0 con 0x7fa34c0731f0 2023-10-19T12:41:38.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.107+0000 7fa351dff700 1 -- 172.21.15.46:0/2267152831 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa34c107420 con 0x7fa34c0731f0 2023-10-19T12:41:38.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.109+0000 7fa3497fa700 1 -- 172.21.15.46:0/2267152831 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fa33c020030 con 0x7fa34c0731f0 2023-10-19T12:41:38.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.110+0000 7fa3497fa700 1 --2- 172.21.15.46:0/2267152831 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fa3380a1480 0x7fa3380a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:38.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.110+0000 7fa3497fa700 1 -- 172.21.15.46:0/2267152831 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fa33c0ce200 con 0x7fa34c0731f0 2023-10-19T12:41:38.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.110+0000 7fa343fff700 1 --2- 172.21.15.46:0/2267152831 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fa3380a1480 0x7fa3380a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:38.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.111+0000 7fa343fff700 1 --2- 172.21.15.46:0/2267152831 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fa3380a1480 0x7fa3380a3940 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa334009cb0 tx=0x7fa334009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:38.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.112+0000 7fa3497fa700 1 -- 172.21.15.46:0/2267152831 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa33c0976a0 con 0x7fa34c0731f0 2023-10-19T12:41:38.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:37 smithi195 ceph-mon[134493]: pgmap v293: 129 pgs: 129 active+clean; 581 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2023-10-19T12:41:38.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:37 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/2034680240' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-19T12:41:38.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:37 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/2360742573' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-19T12:41:38.330 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.327+0000 7fa351dff700 1 -- 172.21.15.46:0/2267152831 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa34c10e170 con 0x7fa34c0731f0 2023-10-19T12:41:38.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.329+0000 7fa3497fa700 1 -- 172.21.15.46:0/2267152831 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+23953 (secure 0 0 0) 0x7fa33c09acc0 con 0x7fa34c0731f0 2023-10-19T12:41:38.332 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:41:38.333 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":88,"fsid":"96a8be3c-6e7b-11ee-8db6-212e2dc638e7","created":"2023-10-19T12:33:26.148713+0000","modified":"2023-10-19T12:41:23.831907+0000","last_up_change":"2023-10-19T12:40:30.761679+0000","last_in_change":"2023-10-19T12:40:13.663559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-19T12:37:07.175795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-19T12:41:16.895203+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-19T12:41:18.255601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-19T12:41:21.830455+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"346ce86b-a10a-4869-9fdb-c3c1d4161455","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6803","nonce":500237995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6805","nonce":500237995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6809","nonce":500237995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6807","nonce":500237995}]},"public_addr":"172.21.15.46:6803/500237995","cluster_addr":"172.21.15.46:6805/500237995","heartbeat_back_addr":"172.21.15.46:6809/500237995","heartbeat_front_addr":"172.21.15.46:6807/500237995","state":["exists","up"]},{"osd":1,"uuid":"02aae687-76c5-4124-bae4-9787ed571c28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6801","nonce":2496862790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6803","nonce":2496862790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6807","nonce":2496862790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6805","nonce":2496862790}]},"public_addr":"172.21.15.157:6801/2496862790","cluster_addr":"172.21.15.157:6803/2496862790","heartbeat_back_addr":"172.21.15.157:6807/2496862790","heartbeat_front_addr":"172.21.15.157:6805/2496862790","state":["exists","up"]},{"osd":2,"uuid":"d5360828-1f58-4380-b2ad-0c21ff850981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6801","nonce":4211767276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6803","nonce":4211767276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6807","nonce":4211767276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6805","nonce":4211767276}]},"public_addr":"172.21.15.195:6801/4211767276","cluster_addr":"172.21.15.195:6803/4211767276","heartbeat_back_addr":"172.21.15.195:6807/4211767276","heartbeat_front_addr":"172.21.15.195:6805/4211767276","state":["exists","up"]},{"osd":3,"uuid":"accb780f-49d0-43f8-b166-ee12c558ef00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6811","nonce":1964113352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6813","nonce":1964113352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6817","nonce":1964113352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6815","nonce":1964113352}]},"public_addr":"172.21.15.46:6811/1964113352","cluster_addr":"172.21.15.46:6813/1964113352","heartbeat_back_addr":"172.21.15.46:6817/1964113352","heartbeat_front_addr":"172.21.15.46:6815/1964113352","state":["exists","up"]},{"osd":4,"uuid":"e662886d-e989-4d02-8c1f-3c4671352b0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6809","nonce":3636910144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6811","nonce":3636910144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6815","nonce":3636910144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6813","nonce":3636910144}]},"public_addr":"172.21.15.157:6809/3636910144","cluster_addr":"172.21.15.157:6811/3636910144","heartbeat_back_addr":"172.21.15.157:6815/3636910144","heartbeat_front_addr":"172.21.15.157:6813/3636910144","state":["exists","up"]},{"osd":5,"uuid":"9597e0ce-14ea-407d-90fe-f74bccee38b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6809","nonce":4071287969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6811","nonce":4071287969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6815","nonce":4071287969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6813","nonce":4071287969}]},"public_addr":"172.21.15.195:6809/4071287969","cluster_addr":"172.21.15.195:6811/4071287969","heartbeat_back_addr":"172.21.15.195:6815/4071287969","heartbeat_front_addr":"172.21.15.195:6813/4071287969","state":["exists","up"]},{"osd":6,"uuid":"6b78ba38-f60e-4cb6-b01c-cecc1820e8e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6819","nonce":1842285555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6821","nonce":1842285555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6825","nonce":1842285555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6823","nonce":1842285555}]},"public_addr":"172.21.15.46:6819/1842285555","cluster_addr":"172.21.15.46:6821/1842285555","heartbeat_back_addr":"172.21.15.46:6825/1842285555","heartbeat_front_addr":"172.21.15.46:6823/1842285555","state":["exists","up"]},{"osd":7,"uuid":"59a0899f-3bcd-4db2-b544-24df3a536749","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6817","nonce":3498672588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6819","nonce":3498672588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6823","nonce":3498672588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6821","nonce":3498672588}]},"public_addr":"172.21.15.157:6817/3498672588","cluster_addr":"172.21.15.157:6819/3498672588","heartbeat_back_addr":"172.21.15.157:6823/3498672588","heartbeat_front_addr":"172.21.15.157:6821/3498672588","state":["exists","up"]},{"osd":8,"uuid":"9c3c9835-043a-4fb5-a9ee-edf8caf6b605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6817","nonce":74230104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6819","nonce":74230104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6823","nonce":74230104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6821","nonce":74230104}]},"public_addr":"172.21.15.195:6817/74230104","cluster_addr":"172.21.15.195:6819/74230104","heartbeat_back_addr":"172.21.15.195:6823/74230104","heartbeat_front_addr":"172.21.15.195:6821/74230104","state":["exists","up"]},{"osd":9,"uuid":"3f18f506-a577-4b7c-ae0d-9351c07e81f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6827","nonce":3472581046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6829","nonce":3472581046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6833","nonce":3472581046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6831","nonce":3472581046}]},"public_addr":"172.21.15.46:6827/3472581046","cluster_addr":"172.21.15.46:6829/3472581046","heartbeat_back_addr":"172.21.15.46:6833/3472581046","heartbeat_front_addr":"172.21.15.46:6831/3472581046","state":["exists","up"]},{"osd":10,"uuid":"1ed01854-443a-4acf-9293-7ca0d451a93d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6825","nonce":2378416559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6827","nonce":2378416559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6831","nonce":2378416559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6829","nonce":2378416559}]},"public_addr":"172.21.15.157:6825/2378416559","cluster_addr":"172.21.15.157:6827/2378416559","heartbeat_back_addr":"172.21.15.157:6831/2378416559","heartbeat_front_addr":"172.21.15.157:6829/2378416559","state":["exists","up"]},{"osd":11,"uuid":"021398c0-9184-4647-8220-e40f6705ca90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6825","nonce":3075632222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6827","nonce":3075632222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6831","nonce":3075632222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6829","nonce":3075632222}]},"public_addr":"172.21.15.195:6825/3075632222","cluster_addr":"172.21.15.195:6827/3075632222","heartbeat_back_addr":"172.21.15.195:6831/3075632222","heartbeat_front_addr":"172.21.15.195:6829/3075632222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:36:22.002614+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:36:44.098031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:37:04.518341+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:37:30.796462+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:37:52.756555+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:38:13.403168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:38:39.058472+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:39:01.106893+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:39:21.908334+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:39:46.843884+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:40:08.792020+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:40:29.282974+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.46:0/3248595150":"2023-10-20T12:34:26.552115+0000","172.21.15.46:0/3624849341":"2023-10-20T12:34:26.552115+0000","172.21.15.46:0/1844094590":"2023-10-20T12:34:26.552115+0000","172.21.15.46:6801/20022894":"2023-10-20T12:34:26.552115+0000","172.21.15.46:0/3969790632":"2023-10-20T12:34:00.135248+0000","172.21.15.46:0/2331135821":"2023-10-20T12:34:00.135248+0000","172.21.15.46:6800/51664346":"2023-10-20T12:34:00.135248+0000","172.21.15.46:6801/51664346":"2023-10-20T12:34:00.135248+0000","172.21.15.46:0/585851467":"2023-10-20T12:34:00.135248+0000","172.21.15.46:6800/20022894":"2023-10-20T12:34:26.552115+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-19T12:41:38.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.331+0000 7fa351dff700 1 -- 172.21.15.46:0/2267152831 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fa3380a1480 msgr2=0x7fa3380a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:38.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.331+0000 7fa351dff700 1 --2- 172.21.15.46:0/2267152831 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fa3380a1480 0x7fa3380a3940 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa334009cb0 tx=0x7fa334009260 comp rx=0 tx=0).stop 2023-10-19T12:41:38.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.331+0000 7fa351dff700 1 -- 172.21.15.46:0/2267152831 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa34c0731f0 msgr2=0x7fa34c198910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:38.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.331+0000 7fa351dff700 1 --2- 172.21.15.46:0/2267152831 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa34c0731f0 0x7fa34c198910 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa33c009810 tx=0x7fa33c00b840 comp rx=0 tx=0).stop 2023-10-19T12:41:38.336 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.331+0000 7fa351dff700 1 -- 172.21.15.46:0/2267152831 shutdown_connections 2023-10-19T12:41:38.336 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.331+0000 7fa351dff700 1 --2- 172.21.15.46:0/2267152831 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa34c108610 0x7fa34c19fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:38.336 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.331+0000 7fa351dff700 1 --2- 172.21.15.46:0/2267152831 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa34c0731f0 0x7fa34c198910 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:38.336 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.331+0000 7fa351dff700 1 --2- 172.21.15.46:0/2267152831 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fa3380a1480 0x7fa3380a3940 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:38.336 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.331+0000 7fa351dff700 1 --2- 172.21.15.46:0/2267152831 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa34c0747d0 0x7fa34c198e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:38.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.332+0000 7fa351dff700 1 -- 172.21.15.46:0/2267152831 >> 172.21.15.46:0/2267152831 conn(0x7fa34c0fbc90 msgr2=0x7fa34c104560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:38.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.332+0000 7fa351dff700 1 -- 172.21.15.46:0/2267152831 shutdown_connections 2023-10-19T12:41:38.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.332+0000 7fa351dff700 1 -- 172.21.15.46:0/2267152831 wait complete. 2023-10-19T12:41:38.353 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-19T12:37:07.175795+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-19T12:41:16.895203+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-19T12:41:18.255601+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-19T12:41:21.830455+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-19T12:41:38.354 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-19T12:41:38.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.560+0000 7f6c17fff700 1 -- 172.21.15.46:0/3112911997 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c101007a0 msgr2=0x7f6c10100bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:38.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.560+0000 7f6c17fff700 1 --2- 172.21.15.46:0/3112911997 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c101007a0 0x7f6c10100bc0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c0099c0 tx=0x7f6c0c009cd0 comp rx=0 tx=0).stop 2023-10-19T12:41:38.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.560+0000 7f6c17fff700 1 -- 172.21.15.46:0/3112911997 shutdown_connections 2023-10-19T12:41:38.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.560+0000 7f6c17fff700 1 --2- 172.21.15.46:0/3112911997 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c10102330 0x7f6c10108be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:38.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.560+0000 7f6c17fff700 1 --2- 172.21.15.46:0/3112911997 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c101007a0 0x7f6c10100bc0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:38.566 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.560+0000 7f6c17fff700 1 --2- 172.21.15.46:0/3112911997 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6c10101990 0x7f6c10101df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:38.566 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.560+0000 7f6c17fff700 1 -- 172.21.15.46:0/3112911997 >> 172.21.15.46:0/3112911997 conn(0x7f6c100fbcf0 msgr2=0x7f6c100fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:38.566 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.560+0000 7f6c17fff700 1 -- 172.21.15.46:0/3112911997 shutdown_connections 2023-10-19T12:41:38.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.560+0000 7f6c17fff700 1 -- 172.21.15.46:0/3112911997 wait complete. 2023-10-19T12:41:38.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.561+0000 7f6c17fff700 1 Processor -- start 2023-10-19T12:41:38.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.561+0000 7f6c17fff700 1 -- start start 2023-10-19T12:41:38.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.562+0000 7f6c17fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c101007a0 0x7f6c10198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:38.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.562+0000 7f6c17fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6c10101990 0x7f6c10198e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:38.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.562+0000 7f6c17fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c10102330 0x7f6c1019fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:38.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.562+0000 7f6c17fff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c101a0470 con 0x7f6c101007a0 2023-10-19T12:41:38.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.562+0000 7f6c17fff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c101a05b0 con 0x7f6c10101990 2023-10-19T12:41:38.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.562+0000 7f6c17fff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c101a0740 con 0x7f6c10102330 2023-10-19T12:41:38.571 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.562+0000 7f6c15d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c101007a0 0x7f6c10198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:38.571 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.562+0000 7f6c15d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c101007a0 0x7f6c10198940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44014/0 (socket says 172.21.15.46:44014) 2023-10-19T12:41:38.571 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.562+0000 7f6c15d9b700 1 -- 172.21.15.46:0/2461683620 learned_addr learned my addr 172.21.15.46:0/2461683620 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:41:38.571 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.562+0000 7f6c1559a700 1 --2- 172.21.15.46:0/2461683620 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6c10101990 0x7f6c10198e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:38.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.562+0000 7f6c1659c700 1 --2- 172.21.15.46:0/2461683620 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c10102330 0x7f6c1019fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:38.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.562+0000 7f6c15d9b700 1 -- 172.21.15.46:0/2461683620 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c10102330 msgr2=0x7f6c1019fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:38.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.562+0000 7f6c15d9b700 1 --2- 172.21.15.46:0/2461683620 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c10102330 0x7f6c1019fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:38.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.562+0000 7f6c15d9b700 1 -- 172.21.15.46:0/2461683620 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6c10101990 msgr2=0x7f6c10198e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:38.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.562+0000 7f6c15d9b700 1 --2- 172.21.15.46:0/2461683620 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6c10101990 0x7f6c10198e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:38.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.562+0000 7f6c15d9b700 1 -- 172.21.15.46:0/2461683620 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c0c0095f0 con 0x7f6c101007a0 2023-10-19T12:41:38.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.562+0000 7f6c1659c700 1 --2- 172.21.15.46:0/2461683620 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c10102330 0x7f6c1019fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T12:41:38.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.563+0000 7f6c15d9b700 1 --2- 172.21.15.46:0/2461683620 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c101007a0 0x7f6c10198940 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c006010 tx=0x7f6c0c00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:38.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.563+0000 7f6c06ffd700 1 -- 172.21.15.46:0/2461683620 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c0c01d070 con 0x7f6c101007a0 2023-10-19T12:41:38.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.563+0000 7f6c06ffd700 1 -- 172.21.15.46:0/2461683620 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6c0c005020 con 0x7f6c101007a0 2023-10-19T12:41:38.574 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.563+0000 7f6c17fff700 1 -- 172.21.15.46:0/2461683620 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c101a09c0 con 0x7f6c101007a0 2023-10-19T12:41:38.574 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.563+0000 7f6c06ffd700 1 -- 172.21.15.46:0/2461683620 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c0c004bb0 con 0x7f6c101007a0 2023-10-19T12:41:38.574 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.563+0000 7f6c17fff700 1 -- 172.21.15.46:0/2461683620 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c101a0d80 con 0x7f6c101007a0 2023-10-19T12:41:38.574 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.564+0000 7f6c17fff700 1 -- 172.21.15.46:0/2461683620 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c100675a0 con 0x7f6c101007a0 2023-10-19T12:41:38.574 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.566+0000 7f6c06ffd700 1 -- 172.21.15.46:0/2461683620 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f6c0c005190 con 0x7f6c101007a0 2023-10-19T12:41:38.575 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.567+0000 7f6c06ffd700 1 --2- 172.21.15.46:0/2461683620 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f6bfc0a1480 0x7f6bfc0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:38.575 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.567+0000 7f6c06ffd700 1 -- 172.21.15.46:0/2461683620 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f6c0c0cd9b0 con 0x7f6c101007a0 2023-10-19T12:41:38.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.568+0000 7f6c1559a700 1 --2- 172.21.15.46:0/2461683620 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f6bfc0a1480 0x7f6bfc0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:38.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.568+0000 7f6c1559a700 1 --2- 172.21.15.46:0/2461683620 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f6bfc0a1480 0x7f6bfc0a3940 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6c00009c60 tx=0x7f6c00009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:38.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.572+0000 7f6c06ffd700 1 -- 172.21.15.46:0/2461683620 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6c0c096e50 con 0x7f6c101007a0 2023-10-19T12:41:38.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.782+0000 7f6c17fff700 1 -- 172.21.15.46:0/2461683620 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6c101a10d0 con 0x7f6c101007a0 2023-10-19T12:41:38.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.783+0000 7f6c06ffd700 1 -- 172.21.15.46:0/2461683620 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6c0c09a470 con 0x7f6c101007a0 2023-10-19T12:41:38.787 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2023-10-19T12:41:38.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.786+0000 7f6c17fff700 1 -- 172.21.15.46:0/2461683620 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f6bfc0a1480 msgr2=0x7f6bfc0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:38.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.786+0000 7f6c17fff700 1 --2- 172.21.15.46:0/2461683620 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f6bfc0a1480 0x7f6bfc0a3940 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6c00009c60 tx=0x7f6c00009260 comp rx=0 tx=0).stop 2023-10-19T12:41:38.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.786+0000 7f6c17fff700 1 -- 172.21.15.46:0/2461683620 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c101007a0 msgr2=0x7f6c10198940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:38.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.786+0000 7f6c17fff700 1 --2- 172.21.15.46:0/2461683620 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c101007a0 0x7f6c10198940 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c006010 tx=0x7f6c0c00f690 comp rx=0 tx=0).stop 2023-10-19T12:41:38.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.786+0000 7f6c17fff700 1 -- 172.21.15.46:0/2461683620 shutdown_connections 2023-10-19T12:41:38.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.786+0000 7f6c17fff700 1 --2- 172.21.15.46:0/2461683620 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f6bfc0a1480 0x7f6bfc0a3940 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:38.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.786+0000 7f6c17fff700 1 --2- 172.21.15.46:0/2461683620 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c10102330 0x7f6c1019fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:38.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.786+0000 7f6c17fff700 1 --2- 172.21.15.46:0/2461683620 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c101007a0 0x7f6c10198940 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:38.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.786+0000 7f6c17fff700 1 --2- 172.21.15.46:0/2461683620 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6c10101990 0x7f6c10198e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:38.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.786+0000 7f6c17fff700 1 -- 172.21.15.46:0/2461683620 >> 172.21.15.46:0/2461683620 conn(0x7f6c100fbcf0 msgr2=0x7f6c10072a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:38.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.786+0000 7f6c17fff700 1 -- 172.21.15.46:0/2461683620 shutdown_connections 2023-10-19T12:41:38.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:38.786+0000 7f6c17fff700 1 -- 172.21.15.46:0/2461683620 wait complete. 2023-10-19T12:41:38.807 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-19T12:41:38.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:38 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/3954970690' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-10-19T12:41:38.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:38 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/2267152831' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-19T12:41:39.015 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.011+0000 7fa32239d700 1 -- 172.21.15.46:0/443551156 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa31c100650 msgr2=0x7fa31c100a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:39.015 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.011+0000 7fa32239d700 1 --2- 172.21.15.46:0/443551156 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa31c100650 0x7fa31c100a70 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa3180099c0 tx=0x7fa318009cd0 comp rx=0 tx=0).stop 2023-10-19T12:41:39.015 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.011+0000 7fa32239d700 1 -- 172.21.15.46:0/443551156 shutdown_connections 2023-10-19T12:41:39.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.011+0000 7fa32239d700 1 --2- 172.21.15.46:0/443551156 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa31c1021e0 0x7fa31c108a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:39.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.011+0000 7fa32239d700 1 --2- 172.21.15.46:0/443551156 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa31c100650 0x7fa31c100a70 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:39.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.011+0000 7fa32239d700 1 --2- 172.21.15.46:0/443551156 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa31c101840 0x7fa31c101ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:39.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.011+0000 7fa32239d700 1 -- 172.21.15.46:0/443551156 >> 172.21.15.46:0/443551156 conn(0x7fa31c0fbbc0 msgr2=0x7fa31c0fe000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:39.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.011+0000 7fa32239d700 1 -- 172.21.15.46:0/443551156 shutdown_connections 2023-10-19T12:41:39.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.011+0000 7fa32239d700 1 -- 172.21.15.46:0/443551156 wait complete. 2023-10-19T12:41:39.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.012+0000 7fa32239d700 1 Processor -- start 2023-10-19T12:41:39.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.013+0000 7fa32239d700 1 -- start start 2023-10-19T12:41:39.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.013+0000 7fa32239d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa31c100650 0x7fa31c198830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:39.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.013+0000 7fa32239d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa31c101840 0x7fa31c198d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:39.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.013+0000 7fa32239d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa31c1021e0 0x7fa31c19fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:39.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.013+0000 7fa32239d700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa31c1a0360 con 0x7fa31c1021e0 2023-10-19T12:41:39.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.013+0000 7fa32239d700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa31c1a04a0 con 0x7fa31c100650 2023-10-19T12:41:39.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.013+0000 7fa32239d700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa31c1a0630 con 0x7fa31c101840 2023-10-19T12:41:39.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.013+0000 7fa321b9c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa31c1021e0 0x7fa31c19fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:39.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.013+0000 7fa321b9c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa31c1021e0 0x7fa31c19fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44044/0 (socket says 172.21.15.46:44044) 2023-10-19T12:41:39.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.013+0000 7fa321b9c700 1 -- 172.21.15.46:0/1514881647 learned_addr learned my addr 172.21.15.46:0/1514881647 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:41:39.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.013+0000 7fa32139b700 1 --2- 172.21.15.46:0/1514881647 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa31c100650 0x7fa31c198830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:39.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.013+0000 7fa320b9a700 1 --2- 172.21.15.46:0/1514881647 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa31c101840 0x7fa31c198d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:39.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.014+0000 7fa321b9c700 1 -- 172.21.15.46:0/1514881647 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa31c101840 msgr2=0x7fa31c198d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:39.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.014+0000 7fa321b9c700 1 --2- 172.21.15.46:0/1514881647 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa31c101840 0x7fa31c198d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:39.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.014+0000 7fa321b9c700 1 -- 172.21.15.46:0/1514881647 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa31c100650 msgr2=0x7fa31c198830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:39.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.014+0000 7fa321b9c700 1 --2- 172.21.15.46:0/1514881647 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa31c100650 0x7fa31c198830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:39.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.014+0000 7fa321b9c700 1 -- 172.21.15.46:0/1514881647 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3180095f0 con 0x7fa31c1021e0 2023-10-19T12:41:39.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.014+0000 7fa321b9c700 1 --2- 172.21.15.46:0/1514881647 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa31c1021e0 0x7fa31c19fd90 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa31400ef30 tx=0x7fa31400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:39.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.014+0000 7fa3127fc700 1 -- 172.21.15.46:0/1514881647 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa314018070 con 0x7fa31c1021e0 2023-10-19T12:41:39.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.014+0000 7fa3127fc700 1 -- 172.21.15.46:0/1514881647 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa31400f040 con 0x7fa31c1021e0 2023-10-19T12:41:39.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.014+0000 7fa32239d700 1 -- 172.21.15.46:0/1514881647 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa31c1a08b0 con 0x7fa31c1021e0 2023-10-19T12:41:39.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.014+0000 7fa3127fc700 1 -- 172.21.15.46:0/1514881647 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa31400cd00 con 0x7fa31c1021e0 2023-10-19T12:41:39.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.014+0000 7fa32239d700 1 -- 172.21.15.46:0/1514881647 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa31c1a0dc0 con 0x7fa31c1021e0 2023-10-19T12:41:39.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.015+0000 7fa32239d700 1 -- 172.21.15.46:0/1514881647 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa31c0673e0 con 0x7fa31c1021e0 2023-10-19T12:41:39.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.017+0000 7fa3127fc700 1 -- 172.21.15.46:0/1514881647 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fa314003a00 con 0x7fa31c1021e0 2023-10-19T12:41:39.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.018+0000 7fa3127fc700 1 --2- 172.21.15.46:0/1514881647 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fa3080a1500 0x7fa3080a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:39.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.019+0000 7fa3127fc700 1 -- 172.21.15.46:0/1514881647 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fa3140cca70 con 0x7fa31c1021e0 2023-10-19T12:41:39.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.019+0000 7fa32139b700 1 --2- 172.21.15.46:0/1514881647 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fa3080a1500 0x7fa3080a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:39.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.019+0000 7fa32139b700 1 --2- 172.21.15.46:0/1514881647 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fa3080a1500 0x7fa3080a39c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa318003730 tx=0x7fa318000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:39.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.022+0000 7fa3127fc700 1 -- 172.21.15.46:0/1514881647 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa314095f10 con 0x7fa31c1021e0 2023-10-19T12:41:39.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:38 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/3954970690' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-10-19T12:41:39.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:38 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/2267152831' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-19T12:41:39.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:38 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/3954970690' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-10-19T12:41:39.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:38 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/2267152831' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-19T12:41:39.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.234+0000 7fa32239d700 1 -- 172.21.15.46:0/1514881647 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa31c1a0fe0 con 0x7fa31c1021e0 2023-10-19T12:41:39.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.235+0000 7fa3127fc700 1 -- 172.21.15.46:0/1514881647 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa314099530 con 0x7fa31c1021e0 2023-10-19T12:41:39.238 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2023-10-19T12:41:39.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.237+0000 7fa32239d700 1 -- 172.21.15.46:0/1514881647 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fa3080a1500 msgr2=0x7fa3080a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:39.241 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.237+0000 7fa32239d700 1 --2- 172.21.15.46:0/1514881647 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fa3080a1500 0x7fa3080a39c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa318003730 tx=0x7fa318000bc0 comp rx=0 tx=0).stop 2023-10-19T12:41:39.241 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.237+0000 7fa32239d700 1 -- 172.21.15.46:0/1514881647 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa31c1021e0 msgr2=0x7fa31c19fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:39.241 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.237+0000 7fa32239d700 1 --2- 172.21.15.46:0/1514881647 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa31c1021e0 0x7fa31c19fd90 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa31400ef30 tx=0x7fa31400c3a0 comp rx=0 tx=0).stop 2023-10-19T12:41:39.241 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.237+0000 7fa32239d700 1 -- 172.21.15.46:0/1514881647 shutdown_connections 2023-10-19T12:41:39.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.237+0000 7fa32239d700 1 --2- 172.21.15.46:0/1514881647 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa31c1021e0 0x7fa31c19fd90 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:39.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.237+0000 7fa32239d700 1 --2- 172.21.15.46:0/1514881647 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa31c100650 0x7fa31c198830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:39.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.237+0000 7fa32239d700 1 --2- 172.21.15.46:0/1514881647 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fa3080a1500 0x7fa3080a39c0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:39.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.237+0000 7fa32239d700 1 --2- 172.21.15.46:0/1514881647 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa31c101840 0x7fa31c198d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:39.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.237+0000 7fa32239d700 1 -- 172.21.15.46:0/1514881647 >> 172.21.15.46:0/1514881647 conn(0x7fa31c0fbbc0 msgr2=0x7fa31c072a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:39.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.237+0000 7fa32239d700 1 -- 172.21.15.46:0/1514881647 shutdown_connections 2023-10-19T12:41:39.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.237+0000 7fa32239d700 1 -- 172.21.15.46:0/1514881647 wait complete. 2023-10-19T12:41:39.259 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-19T12:41:39.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.469+0000 7f92a0dff700 1 -- 172.21.15.46:0/1040503076 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f929c102330 msgr2=0x7f929c108be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:39.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.469+0000 7f92a0dff700 1 --2- 172.21.15.46:0/1040503076 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f929c102330 0x7f929c108be0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f929400b0d0 tx=0x7f929400b3e0 comp rx=0 tx=0).stop 2023-10-19T12:41:39.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.469+0000 7f92a0dff700 1 -- 172.21.15.46:0/1040503076 shutdown_connections 2023-10-19T12:41:39.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.469+0000 7f92a0dff700 1 --2- 172.21.15.46:0/1040503076 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f929c102330 0x7f929c108be0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:39.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.469+0000 7f92a0dff700 1 --2- 172.21.15.46:0/1040503076 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f929c1007a0 0x7f929c100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:39.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.469+0000 7f92a0dff700 1 --2- 172.21.15.46:0/1040503076 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f929c101990 0x7f929c101df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:39.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.469+0000 7f92a0dff700 1 -- 172.21.15.46:0/1040503076 >> 172.21.15.46:0/1040503076 conn(0x7f929c0fbcf0 msgr2=0x7f929c0fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:39.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.469+0000 7f92a0dff700 1 -- 172.21.15.46:0/1040503076 shutdown_connections 2023-10-19T12:41:39.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.469+0000 7f92a0dff700 1 -- 172.21.15.46:0/1040503076 wait complete. 2023-10-19T12:41:39.476 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.470+0000 7f92a0dff700 1 Processor -- start 2023-10-19T12:41:39.477 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.470+0000 7f92a0dff700 1 -- start start 2023-10-19T12:41:39.477 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.470+0000 7f92a0dff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f929c1007a0 0x7f929c198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:39.477 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.470+0000 7f92a0dff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f929c101990 0x7f929c199040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:39.478 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.470+0000 7f92a0dff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f929c102330 0x7f929c1a0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:39.478 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.470+0000 7f92a0dff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f929c1a05e0 con 0x7f929c1007a0 2023-10-19T12:41:39.478 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.471+0000 7f92a0dff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f929c1a0720 con 0x7f929c102330 2023-10-19T12:41:39.478 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.471+0000 7f92a0dff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f929c1a08b0 con 0x7f929c101990 2023-10-19T12:41:39.478 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.471+0000 7f929a59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f929c1007a0 0x7f929c198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:39.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.471+0000 7f929a59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f929c1007a0 0x7f929c198b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44056/0 (socket says 172.21.15.46:44056) 2023-10-19T12:41:39.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.471+0000 7f929a59c700 1 -- 172.21.15.46:0/3022429979 learned_addr learned my addr 172.21.15.46:0/3022429979 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:41:39.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.471+0000 7f9293fff700 1 --2- 172.21.15.46:0/3022429979 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f929c101990 0x7f929c199040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:39.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.471+0000 7f929ad9d700 1 --2- 172.21.15.46:0/3022429979 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f929c102330 0x7f929c1a0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:39.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.471+0000 7f929a59c700 1 -- 172.21.15.46:0/3022429979 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f929c101990 msgr2=0x7f929c199040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:39.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.471+0000 7f929a59c700 1 --2- 172.21.15.46:0/3022429979 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f929c101990 0x7f929c199040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:39.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.471+0000 7f929a59c700 1 -- 172.21.15.46:0/3022429979 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f929c102330 msgr2=0x7f929c1a0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:39.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.471+0000 7f929a59c700 1 --2- 172.21.15.46:0/3022429979 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f929c102330 0x7f929c1a0010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:39.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.471+0000 7f929a59c700 1 -- 172.21.15.46:0/3022429979 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9294009d00 con 0x7f929c1007a0 2023-10-19T12:41:39.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.471+0000 7f9293fff700 1 --2- 172.21.15.46:0/3022429979 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f929c101990 0x7f929c199040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T12:41:39.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.471+0000 7f929ad9d700 1 --2- 172.21.15.46:0/3022429979 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f929c102330 0x7f929c1a0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T12:41:39.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.472+0000 7f929a59c700 1 --2- 172.21.15.46:0/3022429979 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f929c1007a0 0x7f929c198b00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f928c00e970 tx=0x7f928c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:39.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.472+0000 7f92937fe700 1 -- 172.21.15.46:0/3022429979 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f928c009790 con 0x7f929c1007a0 2023-10-19T12:41:39.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.472+0000 7f92937fe700 1 -- 172.21.15.46:0/3022429979 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f928c0044e0 con 0x7f929c1007a0 2023-10-19T12:41:39.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.472+0000 7f92a0dff700 1 -- 172.21.15.46:0/3022429979 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f929c1a0b90 con 0x7f929c1007a0 2023-10-19T12:41:39.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.472+0000 7f92937fe700 1 -- 172.21.15.46:0/3022429979 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f928c003e30 con 0x7f929c1007a0 2023-10-19T12:41:39.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.472+0000 7f92a0dff700 1 -- 172.21.15.46:0/3022429979 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f929c1a10a0 con 0x7f929c1007a0 2023-10-19T12:41:39.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.473+0000 7f92a0dff700 1 -- 172.21.15.46:0/3022429979 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f929c0675a0 con 0x7f929c1007a0 2023-10-19T12:41:39.483 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.475+0000 7f92937fe700 1 -- 172.21.15.46:0/3022429979 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f928c003f90 con 0x7f929c1007a0 2023-10-19T12:41:39.484 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.476+0000 7f92937fe700 1 --2- 172.21.15.46:0/3022429979 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f92880a1480 0x7f92880a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:39.484 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.477+0000 7f92937fe700 1 -- 172.21.15.46:0/3022429979 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f928c014070 con 0x7f929c1007a0 2023-10-19T12:41:39.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.477+0000 7f9293fff700 1 --2- 172.21.15.46:0/3022429979 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f92880a1480 0x7f92880a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:39.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.478+0000 7f9293fff700 1 --2- 172.21.15.46:0/3022429979 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f92880a1480 0x7f92880a3940 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9284009cb0 tx=0x7f9284009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:39.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.481+0000 7f92937fe700 1 -- 172.21.15.46:0/3022429979 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f928c096640 con 0x7f929c1007a0 2023-10-19T12:41:39.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.696+0000 7f92a0dff700 1 -- 172.21.15.46:0/3022429979 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f929c1a13c0 con 0x7f929c1007a0 2023-10-19T12:41:39.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.697+0000 7f92937fe700 1 -- 172.21.15.46:0/3022429979 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7f928c099c60 con 0x7f929c1007a0 2023-10-19T12:41:39.700 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2023-10-19T12:41:39.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.699+0000 7f92a0dff700 1 -- 172.21.15.46:0/3022429979 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f92880a1480 msgr2=0x7f92880a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:39.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.699+0000 7f92a0dff700 1 --2- 172.21.15.46:0/3022429979 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f92880a1480 0x7f92880a3940 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9284009cb0 tx=0x7f9284009260 comp rx=0 tx=0).stop 2023-10-19T12:41:39.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.699+0000 7f92a0dff700 1 -- 172.21.15.46:0/3022429979 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f929c1007a0 msgr2=0x7f929c198b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:39.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.699+0000 7f92a0dff700 1 --2- 172.21.15.46:0/3022429979 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f929c1007a0 0x7f929c198b00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f928c00e970 tx=0x7f928c00ed30 comp rx=0 tx=0).stop 2023-10-19T12:41:39.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.699+0000 7f92a0dff700 1 -- 172.21.15.46:0/3022429979 shutdown_connections 2023-10-19T12:41:39.704 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.699+0000 7f92a0dff700 1 --2- 172.21.15.46:0/3022429979 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f929c102330 0x7f929c1a0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:39.704 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.699+0000 7f92a0dff700 1 --2- 172.21.15.46:0/3022429979 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f929c1007a0 0x7f929c198b00 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:39.704 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.699+0000 7f92a0dff700 1 --2- 172.21.15.46:0/3022429979 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f92880a1480 0x7f92880a3940 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:39.704 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.699+0000 7f92a0dff700 1 --2- 172.21.15.46:0/3022429979 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f929c101990 0x7f929c199040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:39.704 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.699+0000 7f92a0dff700 1 -- 172.21.15.46:0/3022429979 >> 172.21.15.46:0/3022429979 conn(0x7f929c0fbcf0 msgr2=0x7f929c072a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:39.705 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.699+0000 7f92a0dff700 1 -- 172.21.15.46:0/3022429979 shutdown_connections 2023-10-19T12:41:39.705 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.699+0000 7f92a0dff700 1 -- 172.21.15.46:0/3022429979 wait complete. 2023-10-19T12:41:39.722 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-19T12:41:39.930 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.926+0000 7fa3895ff700 1 -- 172.21.15.46:0/2078911642 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3841007a0 msgr2=0x7fa384100bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:39.930 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.926+0000 7fa3895ff700 1 --2- 172.21.15.46:0/2078911642 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3841007a0 0x7fa384100bc0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa3740099c0 tx=0x7fa374009cd0 comp rx=0 tx=0).stop 2023-10-19T12:41:39.930 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.926+0000 7fa3895ff700 1 -- 172.21.15.46:0/2078911642 shutdown_connections 2023-10-19T12:41:39.931 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.926+0000 7fa3895ff700 1 --2- 172.21.15.46:0/2078911642 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa384102330 0x7fa384108be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:39.931 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.926+0000 7fa3895ff700 1 --2- 172.21.15.46:0/2078911642 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3841007a0 0x7fa384100bc0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:39.931 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.926+0000 7fa3895ff700 1 --2- 172.21.15.46:0/2078911642 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa384101990 0x7fa384101df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:39.931 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.926+0000 7fa3895ff700 1 -- 172.21.15.46:0/2078911642 >> 172.21.15.46:0/2078911642 conn(0x7fa3840fbcf0 msgr2=0x7fa3840fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:39.931 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.927+0000 7fa3895ff700 1 -- 172.21.15.46:0/2078911642 shutdown_connections 2023-10-19T12:41:39.932 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.927+0000 7fa3895ff700 1 -- 172.21.15.46:0/2078911642 wait complete. 2023-10-19T12:41:39.934 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.928+0000 7fa3895ff700 1 Processor -- start 2023-10-19T12:41:39.934 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.928+0000 7fa3895ff700 1 -- start start 2023-10-19T12:41:39.934 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.928+0000 7fa3895ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa3841007a0 0x7fa384198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:39.934 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.928+0000 7fa3895ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa384101990 0x7fa384198ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:39.935 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.928+0000 7fa3895ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa384102330 0x7fa38419fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:39.935 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.928+0000 7fa3895ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3841a04b0 con 0x7fa384101990 2023-10-19T12:41:39.935 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.928+0000 7fa3895ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3841a05f0 con 0x7fa384102330 2023-10-19T12:41:39.935 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.928+0000 7fa3895ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3841a0780 con 0x7fa3841007a0 2023-10-19T12:41:39.935 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.928+0000 7fa382ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa3841007a0 0x7fa384198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:39.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.928+0000 7fa3827fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa384101990 0x7fa384198ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:39.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.928+0000 7fa382ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa3841007a0 0x7fa384198980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:36718/0 (socket says 172.21.15.46:36718) 2023-10-19T12:41:39.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.928+0000 7fa382ffd700 1 -- 172.21.15.46:0/3295922771 learned_addr learned my addr 172.21.15.46:0/3295922771 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:41:39.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.928+0000 7fa3837fe700 1 --2- 172.21.15.46:0/3295922771 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa384102330 0x7fa38419fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:39.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.929+0000 7fa382ffd700 1 -- 172.21.15.46:0/3295922771 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa384102330 msgr2=0x7fa38419fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:39.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.929+0000 7fa382ffd700 1 --2- 172.21.15.46:0/3295922771 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa384102330 0x7fa38419fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:39.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.929+0000 7fa382ffd700 1 -- 172.21.15.46:0/3295922771 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa384101990 msgr2=0x7fa384198ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:39.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.929+0000 7fa382ffd700 1 --2- 172.21.15.46:0/3295922771 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa384101990 0x7fa384198ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:39.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.929+0000 7fa382ffd700 1 -- 172.21.15.46:0/3295922771 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3740095f0 con 0x7fa3841007a0 2023-10-19T12:41:39.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.929+0000 7fa3827fc700 1 --2- 172.21.15.46:0/3295922771 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa384101990 0x7fa384198ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:41:39.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.929+0000 7fa382ffd700 1 --2- 172.21.15.46:0/3295922771 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa3841007a0 0x7fa384198980 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa374003730 tx=0x7fa37400fa00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:39.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.929+0000 7fa36bfff700 1 -- 172.21.15.46:0/3295922771 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37401d070 con 0x7fa3841007a0 2023-10-19T12:41:39.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.929+0000 7fa36bfff700 1 -- 172.21.15.46:0/3295922771 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa37400bda0 con 0x7fa3841007a0 2023-10-19T12:41:39.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.929+0000 7fa3895ff700 1 -- 172.21.15.46:0/3295922771 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3841a0a00 con 0x7fa3841007a0 2023-10-19T12:41:39.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.929+0000 7fa36bfff700 1 -- 172.21.15.46:0/3295922771 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa374004b30 con 0x7fa3841007a0 2023-10-19T12:41:39.939 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.930+0000 7fa3895ff700 1 -- 172.21.15.46:0/3295922771 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3841a0e20 con 0x7fa3841007a0 2023-10-19T12:41:39.939 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.930+0000 7fa3895ff700 1 -- 172.21.15.46:0/3295922771 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3840675a0 con 0x7fa3841007a0 2023-10-19T12:41:39.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.932+0000 7fa36bfff700 1 -- 172.21.15.46:0/3295922771 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fa374004c90 con 0x7fa3841007a0 2023-10-19T12:41:39.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.934+0000 7fa36bfff700 1 --2- 172.21.15.46:0/3295922771 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fa36c0a1480 0x7fa36c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:39.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.934+0000 7fa36bfff700 1 -- 172.21.15.46:0/3295922771 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fa3740cdd90 con 0x7fa3841007a0 2023-10-19T12:41:39.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.934+0000 7fa3827fc700 1 --2- 172.21.15.46:0/3295922771 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fa36c0a1480 0x7fa36c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:39.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.935+0000 7fa3827fc700 1 --2- 172.21.15.46:0/3295922771 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fa36c0a1480 0x7fa36c0a3940 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa378011490 tx=0x7fa378009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:39.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:39.936+0000 7fa36bfff700 1 -- 172.21.15.46:0/3295922771 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa374097230 con 0x7fa3841007a0 2023-10-19T12:41:39.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:39 smithi046 ceph-mon[98509]: pgmap v294: 129 pgs: 129 active+clean; 581 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2023-10-19T12:41:39.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:39 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/2461683620' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-19T12:41:39.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:39 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/1514881647' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-19T12:41:39.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:39 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/3022429979' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-19T12:41:40.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:39 smithi157 ceph-mon[134109]: pgmap v294: 129 pgs: 129 active+clean; 581 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2023-10-19T12:41:40.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:39 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/2461683620' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-19T12:41:40.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:39 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/1514881647' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-19T12:41:40.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:39 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/3022429979' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-19T12:41:40.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:39 smithi195 ceph-mon[134493]: pgmap v294: 129 pgs: 129 active+clean; 581 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2023-10-19T12:41:40.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:39 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/2461683620' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-19T12:41:40.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:39 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/1514881647' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-19T12:41:40.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:39 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/3022429979' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-19T12:41:40.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:40.148+0000 7fa3895ff700 1 -- 172.21.15.46:0/3295922771 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fa3841a1110 con 0x7fa3841007a0 2023-10-19T12:41:40.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:40.149+0000 7fa36bfff700 1 -- 172.21.15.46:0/3295922771 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v88) v1 ==== 103+0+11 (secure 0 0 0) 0x7fa37409a850 con 0x7fa3841007a0 2023-10-19T12:41:40.153 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2023-10-19T12:41:40.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:40.152+0000 7fa3895ff700 1 -- 172.21.15.46:0/3295922771 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fa36c0a1480 msgr2=0x7fa36c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:40.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:40.152+0000 7fa3895ff700 1 --2- 172.21.15.46:0/3295922771 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fa36c0a1480 0x7fa36c0a3940 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa378011490 tx=0x7fa378009260 comp rx=0 tx=0).stop 2023-10-19T12:41:40.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:40.152+0000 7fa3895ff700 1 -- 172.21.15.46:0/3295922771 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa3841007a0 msgr2=0x7fa384198980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:40.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:40.152+0000 7fa3895ff700 1 --2- 172.21.15.46:0/3295922771 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa3841007a0 0x7fa384198980 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa374003730 tx=0x7fa37400fa00 comp rx=0 tx=0).stop 2023-10-19T12:41:40.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:40.152+0000 7fa3895ff700 1 -- 172.21.15.46:0/3295922771 shutdown_connections 2023-10-19T12:41:40.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:40.152+0000 7fa3895ff700 1 --2- 172.21.15.46:0/3295922771 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa384102330 0x7fa38419fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:40.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:40.152+0000 7fa3895ff700 1 --2- 172.21.15.46:0/3295922771 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fa36c0a1480 0x7fa36c0a3940 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:40.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:40.152+0000 7fa3895ff700 1 --2- 172.21.15.46:0/3295922771 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa3841007a0 0x7fa384198980 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:40.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:40.152+0000 7fa3895ff700 1 --2- 172.21.15.46:0/3295922771 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa384101990 0x7fa384198ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:40.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:40.152+0000 7fa3895ff700 1 -- 172.21.15.46:0/3295922771 >> 172.21.15.46:0/3295922771 conn(0x7fa3840fbcf0 msgr2=0x7fa384072a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:40.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:40.152+0000 7fa3895ff700 1 -- 172.21.15.46:0/3295922771 shutdown_connections 2023-10-19T12:41:40.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:40.152+0000 7fa3895ff700 1 -- 172.21.15.46:0/3295922771 wait complete. 2023-10-19T12:41:40.174 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-19T12:41:40.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:40.376+0000 7f11119ff700 1 -- 172.21.15.46:0/1558798232 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f110c0747d0 msgr2=0x7f110c072c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:40.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:40.376+0000 7f11119ff700 1 --2- 172.21.15.46:0/1558798232 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f110c0747d0 0x7f110c072c20 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f10fc009990 tx=0x7f10fc009ca0 comp rx=0 tx=0).stop 2023-10-19T12:41:40.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:40.376+0000 7f11119ff700 1 -- 172.21.15.46:0/1558798232 shutdown_connections 2023-10-19T12:41:40.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:40.376+0000 7f11119ff700 1 --2- 172.21.15.46:0/1558798232 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f110c1085f0 0x7f110c10aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:40.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:40.376+0000 7f11119ff700 1 --2- 172.21.15.46:0/1558798232 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f110c0747d0 0x7f110c072c20 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:40.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:40.376+0000 7f11119ff700 1 --2- 172.21.15.46:0/1558798232 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f110c0731f0 0x7f110c073670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:40.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:40.376+0000 7f11119ff700 1 -- 172.21.15.46:0/1558798232 >> 172.21.15.46:0/1558798232 conn(0x7f110c0fbc90 msgr2=0x7f110c0fe0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:40.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:40.376+0000 7f11119ff700 1 -- 172.21.15.46:0/1558798232 shutdown_connections 2023-10-19T12:41:40.382 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:40.376+0000 7f11119ff700 1 -- 172.21.15.46:0/1558798232 wait complete. 2023-10-19T12:41:40.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:40.377+0000 7f11119ff700 1 Processor -- start 2023-10-19T12:41:40.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:40.377+0000 7f11119ff700 1 -- start start 2023-10-19T12:41:40.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:40.378+0000 7f11119ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f110c0731f0 0x7f110c198850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:40.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:40.378+0000 7f11119ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f110c0747d0 0x7f110c198d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:40.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:40.378+0000 7f11119ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f110c1085f0 0x7f110c19fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:40.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:40.378+0000 7f11119ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f110c1a0380 con 0x7f110c0731f0 2023-10-19T12:41:40.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:40.378+0000 7f11119ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f110c1a04c0 con 0x7f110c1085f0 2023-10-19T12:41:40.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:40.378+0000 7f11119ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f110c1a0650 con 0x7f110c0747d0 2023-10-19T12:41:40.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:40.378+0000 7f110affd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f110c0731f0 0x7f110c198850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:40.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:40.378+0000 7f110affd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f110c0731f0 0x7f110c198850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44100/0 (socket says 172.21.15.46:44100) 2023-10-19T12:41:40.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:40.378+0000 7f110affd700 1 -- 172.21.15.46:0/1460458884 learned_addr learned my addr 172.21.15.46:0/1460458884 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:41:40.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:40.378+0000 7f1103fff700 1 --2- 172.21.15.46:0/1460458884 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f110c0747d0 0x7f110c198d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:40.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:40.378+0000 7f110b7fe700 1 --2- 172.21.15.46:0/1460458884 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f110c1085f0 0x7f110c19fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:40.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:40.378+0000 7f110affd700 1 -- 172.21.15.46:0/1460458884 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f110c0747d0 msgr2=0x7f110c198d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:40.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:40.378+0000 7f110affd700 1 --2- 172.21.15.46:0/1460458884 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f110c0747d0 0x7f110c198d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:40.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:40.378+0000 7f110affd700 1 -- 172.21.15.46:0/1460458884 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f110c1085f0 msgr2=0x7f110c19fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:40.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:40.378+0000 7f110affd700 1 --2- 172.21.15.46:0/1460458884 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f110c1085f0 0x7f110c19fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:40.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:40.378+0000 7f110affd700 1 -- 172.21.15.46:0/1460458884 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10fc0095f0 con 0x7f110c0731f0 2023-10-19T12:41:40.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:40.378+0000 7f110b7fe700 1 --2- 172.21.15.46:0/1460458884 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f110c1085f0 0x7f110c19fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T12:41:40.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:40.379+0000 7f110affd700 1 --2- 172.21.15.46:0/1460458884 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f110c0731f0 0x7f110c198850 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f10fc0095c0 tx=0x7f10fc00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:40.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:40.379+0000 7f11109fd700 1 -- 172.21.15.46:0/1460458884 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10fc01d070 con 0x7f110c0731f0 2023-10-19T12:41:40.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:40.379+0000 7f11109fd700 1 -- 172.21.15.46:0/1460458884 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f10fc005510 con 0x7f110c0731f0 2023-10-19T12:41:40.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:40.379+0000 7f11119ff700 1 -- 172.21.15.46:0/1460458884 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f110c1a08d0 con 0x7f110c0731f0 2023-10-19T12:41:40.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:40.379+0000 7f11109fd700 1 -- 172.21.15.46:0/1460458884 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10fc004cd0 con 0x7f110c0731f0 2023-10-19T12:41:40.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:40.379+0000 7f11119ff700 1 -- 172.21.15.46:0/1460458884 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f110c1a0cf0 con 0x7f110c0731f0 2023-10-19T12:41:40.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:40.380+0000 7f11119ff700 1 -- 172.21.15.46:0/1460458884 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f110c107400 con 0x7f110c0731f0 2023-10-19T12:41:40.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:40.382+0000 7f11109fd700 1 -- 172.21.15.46:0/1460458884 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f10fc00fc40 con 0x7f110c0731f0 2023-10-19T12:41:40.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:40.384+0000 7f11109fd700 1 --2- 172.21.15.46:0/1460458884 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f10f80a1480 0x7f10f80a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:40.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:40.384+0000 7f11109fd700 1 -- 172.21.15.46:0/1460458884 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f10fc0cdf90 con 0x7f110c0731f0 2023-10-19T12:41:40.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:40.384+0000 7f1103fff700 1 --2- 172.21.15.46:0/1460458884 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f10f80a1480 0x7f10f80a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:40.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:40.385+0000 7f1103fff700 1 --2- 172.21.15.46:0/1460458884 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f10f80a1480 0x7f10f80a3940 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f10f400bbd0 tx=0x7f10f400b5b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:40.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:40.387+0000 7f11109fd700 1 -- 172.21.15.46:0/1460458884 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f10fc097430 con 0x7f110c0731f0 2023-10-19T12:41:40.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:40.615+0000 7f11119ff700 1 -- 172.21.15.46:0/1460458884 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f110c067530 con 0x7f110c0731f0 2023-10-19T12:41:40.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:40.616+0000 7f11109fd700 1 -- 172.21.15.46:0/1460458884 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v88) v1 ==== 81+0+583 (secure 0 0 0) 0x7f10fc09aa50 con 0x7f110c0731f0 2023-10-19T12:41:40.619 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/3248595150 2023-10-20T12:34:26.552115+0000 2023-10-19T12:41:40.620 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/3624849341 2023-10-20T12:34:26.552115+0000 2023-10-19T12:41:40.620 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/1844094590 2023-10-20T12:34:26.552115+0000 2023-10-19T12:41:40.620 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6801/20022894 2023-10-20T12:34:26.552115+0000 2023-10-19T12:41:40.620 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/3969790632 2023-10-20T12:34:00.135248+0000 2023-10-19T12:41:40.620 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/2331135821 2023-10-20T12:34:00.135248+0000 2023-10-19T12:41:40.621 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6800/51664346 2023-10-20T12:34:00.135248+0000 2023-10-19T12:41:40.621 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6801/51664346 2023-10-20T12:34:00.135248+0000 2023-10-19T12:41:40.621 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/585851467 2023-10-20T12:34:00.135248+0000 2023-10-19T12:41:40.621 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6800/20022894 2023-10-20T12:34:26.552115+0000 2023-10-19T12:41:40.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:40.618+0000 7f11119ff700 1 -- 172.21.15.46:0/1460458884 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f10f80a1480 msgr2=0x7f10f80a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:40.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:40.618+0000 7f11119ff700 1 --2- 172.21.15.46:0/1460458884 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f10f80a1480 0x7f10f80a3940 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f10f400bbd0 tx=0x7f10f400b5b0 comp rx=0 tx=0).stop 2023-10-19T12:41:40.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:40.618+0000 7f11119ff700 1 -- 172.21.15.46:0/1460458884 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f110c0731f0 msgr2=0x7f110c198850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:40.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:40.618+0000 7f11119ff700 1 --2- 172.21.15.46:0/1460458884 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f110c0731f0 0x7f110c198850 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f10fc0095c0 tx=0x7f10fc00f690 comp rx=0 tx=0).stop 2023-10-19T12:41:40.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:40.618+0000 7f11119ff700 1 -- 172.21.15.46:0/1460458884 shutdown_connections 2023-10-19T12:41:40.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:40.618+0000 7f11119ff700 1 --2- 172.21.15.46:0/1460458884 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f110c1085f0 0x7f110c19fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:40.624 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:40.618+0000 7f11119ff700 1 --2- 172.21.15.46:0/1460458884 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f110c0731f0 0x7f110c198850 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:40.624 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:40.618+0000 7f11119ff700 1 --2- 172.21.15.46:0/1460458884 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f10f80a1480 0x7f10f80a3940 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:40.624 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:40.618+0000 7f11119ff700 1 --2- 172.21.15.46:0/1460458884 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f110c0747d0 0x7f110c198d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:40.624 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:40.618+0000 7f11119ff700 1 -- 172.21.15.46:0/1460458884 >> 172.21.15.46:0/1460458884 conn(0x7f110c0fbc90 msgr2=0x7f110c104540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:40.624 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:40.618+0000 7f11119ff700 1 -- 172.21.15.46:0/1460458884 shutdown_connections 2023-10-19T12:41:40.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:40.618+0000 7f11119ff700 1 -- 172.21.15.46:0/1460458884 wait complete. 2023-10-19T12:41:40.625 INFO:teuthology.orchestra.run.smithi046.stderr:listed 10 entries 2023-10-19T12:41:40.640 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi046.front.sepia.ceph.com... 2023-10-19T12:41:40.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T12:41:40.641 DEBUG:teuthology.orchestra.run.smithi046:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-10-19T12:41:40.710 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi046.stderr:ceph-fuse[152582]: fuse finished with error 0 and tester_r 0 2023-10-19T12:41:40.714 INFO:teuthology.orchestra.run:waiting for 300 2023-10-19T12:41:40.761 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi046.front.sepia.ceph.com 2023-10-19T12:41:40.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T12:41:40.762 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-10-19T12:41:40.815 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-19T12:41:40.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:40 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/3295922771' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-19T12:41:40.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:40 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/1460458884' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-10-19T12:41:41.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.017+0000 7fe512fff700 1 -- 172.21.15.46:0/4126373041 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe50c0731f0 msgr2=0x7fe50c073670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:41.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.017+0000 7fe512fff700 1 --2- 172.21.15.46:0/4126373041 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe50c0731f0 0x7fe50c073670 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe4f8009990 tx=0x7fe4f8009ca0 comp rx=0 tx=0).stop 2023-10-19T12:41:41.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.017+0000 7fe512fff700 1 -- 172.21.15.46:0/4126373041 shutdown_connections 2023-10-19T12:41:41.021 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.017+0000 7fe512fff700 1 --2- 172.21.15.46:0/4126373041 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe50c108610 0x7fe50c10aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:41.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.017+0000 7fe512fff700 1 --2- 172.21.15.46:0/4126373041 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe50c0747d0 0x7fe50c072c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:41.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.017+0000 7fe512fff700 1 --2- 172.21.15.46:0/4126373041 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe50c0731f0 0x7fe50c073670 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:41.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.017+0000 7fe512fff700 1 -- 172.21.15.46:0/4126373041 >> 172.21.15.46:0/4126373041 conn(0x7fe50c0fbc90 msgr2=0x7fe50c0fe0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:41.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.017+0000 7fe512fff700 1 -- 172.21.15.46:0/4126373041 shutdown_connections 2023-10-19T12:41:41.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.017+0000 7fe512fff700 1 -- 172.21.15.46:0/4126373041 wait complete. 2023-10-19T12:41:41.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.018+0000 7fe512fff700 1 Processor -- start 2023-10-19T12:41:41.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.019+0000 7fe512fff700 1 -- start start 2023-10-19T12:41:41.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.019+0000 7fe512fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe50c0731f0 0x7fe50c198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:41.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.019+0000 7fe512fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe50c0747d0 0x7fe50c198ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:41.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.019+0000 7fe512fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe50c108610 0x7fe50c19fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:41.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.019+0000 7fe512fff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe50c1a0440 con 0x7fe50c108610 2023-10-19T12:41:41.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.019+0000 7fe512fff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe50c1a0580 con 0x7fe50c0731f0 2023-10-19T12:41:41.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.019+0000 7fe512fff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe50c1a0710 con 0x7fe50c0747d0 2023-10-19T12:41:41.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.019+0000 7fe51159c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe50c108610 0x7fe50c19fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:41.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.019+0000 7fe51159c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe50c108610 0x7fe50c19fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44124/0 (socket says 172.21.15.46:44124) 2023-10-19T12:41:41.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.019+0000 7fe51159c700 1 -- 172.21.15.46:0/3881843459 learned_addr learned my addr 172.21.15.46:0/3881843459 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:41:41.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.019+0000 7fe510d9b700 1 --2- 172.21.15.46:0/3881843459 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe50c0731f0 0x7fe50c198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:41.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.019+0000 7fe50bfff700 1 --2- 172.21.15.46:0/3881843459 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe50c0747d0 0x7fe50c198ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:41.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.020+0000 7fe51159c700 1 -- 172.21.15.46:0/3881843459 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe50c0747d0 msgr2=0x7fe50c198ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:41.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.020+0000 7fe51159c700 1 --2- 172.21.15.46:0/3881843459 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe50c0747d0 0x7fe50c198ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:41.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.020+0000 7fe51159c700 1 -- 172.21.15.46:0/3881843459 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe50c0731f0 msgr2=0x7fe50c198960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:41.028 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.020+0000 7fe51159c700 1 --2- 172.21.15.46:0/3881843459 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe50c0731f0 0x7fe50c198960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:41.028 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.020+0000 7fe51159c700 1 -- 172.21.15.46:0/3881843459 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4f80095f0 con 0x7fe50c108610 2023-10-19T12:41:41.028 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.020+0000 7fe51159c700 1 --2- 172.21.15.46:0/3881843459 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe50c108610 0x7fe50c19fe70 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe50400ef30 tx=0x7fe50400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:41.028 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.020+0000 7fe509ffb700 1 -- 172.21.15.46:0/3881843459 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe504018070 con 0x7fe50c108610 2023-10-19T12:41:41.028 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.020+0000 7fe509ffb700 1 -- 172.21.15.46:0/3881843459 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe50400f040 con 0x7fe50c108610 2023-10-19T12:41:41.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.020+0000 7fe512fff700 1 -- 172.21.15.46:0/3881843459 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe50c1a0990 con 0x7fe50c108610 2023-10-19T12:41:41.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.020+0000 7fe509ffb700 1 -- 172.21.15.46:0/3881843459 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe50400cd00 con 0x7fe50c108610 2023-10-19T12:41:41.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.020+0000 7fe512fff700 1 -- 172.21.15.46:0/3881843459 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe50c1a0e50 con 0x7fe50c108610 2023-10-19T12:41:41.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.021+0000 7fe512fff700 1 -- 172.21.15.46:0/3881843459 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe50c107420 con 0x7fe50c108610 2023-10-19T12:41:41.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.023+0000 7fe509ffb700 1 -- 172.21.15.46:0/3881843459 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fe504003a00 con 0x7fe50c108610 2023-10-19T12:41:41.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.025+0000 7fe509ffb700 1 --2- 172.21.15.46:0/3881843459 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fe4fc0a1480 0x7fe4fc0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:41.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.025+0000 7fe509ffb700 1 -- 172.21.15.46:0/3881843459 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fe5040ccac0 con 0x7fe50c108610 2023-10-19T12:41:41.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.025+0000 7fe510d9b700 1 --2- 172.21.15.46:0/3881843459 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fe4fc0a1480 0x7fe4fc0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:41.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.026+0000 7fe510d9b700 1 --2- 172.21.15.46:0/3881843459 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fe4fc0a1480 0x7fe4fc0a3940 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe500009c60 tx=0x7fe500009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:41.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.029+0000 7fe509ffb700 1 -- 172.21.15.46:0/3881843459 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fe504095f60 con 0x7fe50c108610 2023-10-19T12:41:41.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:40 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/3295922771' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-19T12:41:41.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:40 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/1460458884' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-10-19T12:41:41.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:40 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/3295922771' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-19T12:41:41.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:40 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/1460458884' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-10-19T12:41:41.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.242+0000 7fe512fff700 1 -- 172.21.15.46:0/3881843459 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe50c067530 con 0x7fe50c108610 2023-10-19T12:41:41.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.244+0000 7fe509ffb700 1 -- 172.21.15.46:0/3881843459 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+23953 (secure 0 0 0) 0x7fe504099580 con 0x7fe50c108610 2023-10-19T12:41:41.247 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:41:41.248 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":88,"fsid":"96a8be3c-6e7b-11ee-8db6-212e2dc638e7","created":"2023-10-19T12:33:26.148713+0000","modified":"2023-10-19T12:41:23.831907+0000","last_up_change":"2023-10-19T12:40:30.761679+0000","last_in_change":"2023-10-19T12:40:13.663559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-19T12:37:07.175795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-19T12:41:16.895203+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-19T12:41:18.255601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-19T12:41:21.830455+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"346ce86b-a10a-4869-9fdb-c3c1d4161455","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6803","nonce":500237995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6805","nonce":500237995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6809","nonce":500237995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6807","nonce":500237995}]},"public_addr":"172.21.15.46:6803/500237995","cluster_addr":"172.21.15.46:6805/500237995","heartbeat_back_addr":"172.21.15.46:6809/500237995","heartbeat_front_addr":"172.21.15.46:6807/500237995","state":["exists","up"]},{"osd":1,"uuid":"02aae687-76c5-4124-bae4-9787ed571c28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6801","nonce":2496862790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6803","nonce":2496862790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6807","nonce":2496862790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6805","nonce":2496862790}]},"public_addr":"172.21.15.157:6801/2496862790","cluster_addr":"172.21.15.157:6803/2496862790","heartbeat_back_addr":"172.21.15.157:6807/2496862790","heartbeat_front_addr":"172.21.15.157:6805/2496862790","state":["exists","up"]},{"osd":2,"uuid":"d5360828-1f58-4380-b2ad-0c21ff850981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6801","nonce":4211767276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6803","nonce":4211767276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6807","nonce":4211767276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6805","nonce":4211767276}]},"public_addr":"172.21.15.195:6801/4211767276","cluster_addr":"172.21.15.195:6803/4211767276","heartbeat_back_addr":"172.21.15.195:6807/4211767276","heartbeat_front_addr":"172.21.15.195:6805/4211767276","state":["exists","up"]},{"osd":3,"uuid":"accb780f-49d0-43f8-b166-ee12c558ef00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6811","nonce":1964113352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6813","nonce":1964113352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6817","nonce":1964113352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6815","nonce":1964113352}]},"public_addr":"172.21.15.46:6811/1964113352","cluster_addr":"172.21.15.46:6813/1964113352","heartbeat_back_addr":"172.21.15.46:6817/1964113352","heartbeat_front_addr":"172.21.15.46:6815/1964113352","state":["exists","up"]},{"osd":4,"uuid":"e662886d-e989-4d02-8c1f-3c4671352b0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6809","nonce":3636910144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6811","nonce":3636910144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6815","nonce":3636910144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6813","nonce":3636910144}]},"public_addr":"172.21.15.157:6809/3636910144","cluster_addr":"172.21.15.157:6811/3636910144","heartbeat_back_addr":"172.21.15.157:6815/3636910144","heartbeat_front_addr":"172.21.15.157:6813/3636910144","state":["exists","up"]},{"osd":5,"uuid":"9597e0ce-14ea-407d-90fe-f74bccee38b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6809","nonce":4071287969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6811","nonce":4071287969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6815","nonce":4071287969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6813","nonce":4071287969}]},"public_addr":"172.21.15.195:6809/4071287969","cluster_addr":"172.21.15.195:6811/4071287969","heartbeat_back_addr":"172.21.15.195:6815/4071287969","heartbeat_front_addr":"172.21.15.195:6813/4071287969","state":["exists","up"]},{"osd":6,"uuid":"6b78ba38-f60e-4cb6-b01c-cecc1820e8e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6819","nonce":1842285555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6821","nonce":1842285555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6825","nonce":1842285555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6823","nonce":1842285555}]},"public_addr":"172.21.15.46:6819/1842285555","cluster_addr":"172.21.15.46:6821/1842285555","heartbeat_back_addr":"172.21.15.46:6825/1842285555","heartbeat_front_addr":"172.21.15.46:6823/1842285555","state":["exists","up"]},{"osd":7,"uuid":"59a0899f-3bcd-4db2-b544-24df3a536749","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6817","nonce":3498672588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6819","nonce":3498672588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6823","nonce":3498672588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6821","nonce":3498672588}]},"public_addr":"172.21.15.157:6817/3498672588","cluster_addr":"172.21.15.157:6819/3498672588","heartbeat_back_addr":"172.21.15.157:6823/3498672588","heartbeat_front_addr":"172.21.15.157:6821/3498672588","state":["exists","up"]},{"osd":8,"uuid":"9c3c9835-043a-4fb5-a9ee-edf8caf6b605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6817","nonce":74230104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6819","nonce":74230104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6823","nonce":74230104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6821","nonce":74230104}]},"public_addr":"172.21.15.195:6817/74230104","cluster_addr":"172.21.15.195:6819/74230104","heartbeat_back_addr":"172.21.15.195:6823/74230104","heartbeat_front_addr":"172.21.15.195:6821/74230104","state":["exists","up"]},{"osd":9,"uuid":"3f18f506-a577-4b7c-ae0d-9351c07e81f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6827","nonce":3472581046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6829","nonce":3472581046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6833","nonce":3472581046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6831","nonce":3472581046}]},"public_addr":"172.21.15.46:6827/3472581046","cluster_addr":"172.21.15.46:6829/3472581046","heartbeat_back_addr":"172.21.15.46:6833/3472581046","heartbeat_front_addr":"172.21.15.46:6831/3472581046","state":["exists","up"]},{"osd":10,"uuid":"1ed01854-443a-4acf-9293-7ca0d451a93d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6825","nonce":2378416559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6827","nonce":2378416559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6831","nonce":2378416559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6829","nonce":2378416559}]},"public_addr":"172.21.15.157:6825/2378416559","cluster_addr":"172.21.15.157:6827/2378416559","heartbeat_back_addr":"172.21.15.157:6831/2378416559","heartbeat_front_addr":"172.21.15.157:6829/2378416559","state":["exists","up"]},{"osd":11,"uuid":"021398c0-9184-4647-8220-e40f6705ca90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6825","nonce":3075632222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6827","nonce":3075632222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6831","nonce":3075632222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6829","nonce":3075632222}]},"public_addr":"172.21.15.195:6825/3075632222","cluster_addr":"172.21.15.195:6827/3075632222","heartbeat_back_addr":"172.21.15.195:6831/3075632222","heartbeat_front_addr":"172.21.15.195:6829/3075632222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:36:22.002614+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:36:44.098031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:37:04.518341+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:37:30.796462+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:37:52.756555+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:38:13.403168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:38:39.058472+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:39:01.106893+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:39:21.908334+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:39:46.843884+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:40:08.792020+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:40:29.282974+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.46:0/3248595150":"2023-10-20T12:34:26.552115+0000","172.21.15.46:0/3624849341":"2023-10-20T12:34:26.552115+0000","172.21.15.46:0/1844094590":"2023-10-20T12:34:26.552115+0000","172.21.15.46:6801/20022894":"2023-10-20T12:34:26.552115+0000","172.21.15.46:0/3969790632":"2023-10-20T12:34:00.135248+0000","172.21.15.46:0/2331135821":"2023-10-20T12:34:00.135248+0000","172.21.15.46:6800/51664346":"2023-10-20T12:34:00.135248+0000","172.21.15.46:6801/51664346":"2023-10-20T12:34:00.135248+0000","172.21.15.46:0/585851467":"2023-10-20T12:34:00.135248+0000","172.21.15.46:6800/20022894":"2023-10-20T12:34:26.552115+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-19T12:41:41.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.246+0000 7fe512fff700 1 -- 172.21.15.46:0/3881843459 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fe4fc0a1480 msgr2=0x7fe4fc0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:41.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.246+0000 7fe512fff700 1 --2- 172.21.15.46:0/3881843459 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fe4fc0a1480 0x7fe4fc0a3940 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe500009c60 tx=0x7fe500009260 comp rx=0 tx=0).stop 2023-10-19T12:41:41.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.246+0000 7fe512fff700 1 -- 172.21.15.46:0/3881843459 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe50c108610 msgr2=0x7fe50c19fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:41.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.246+0000 7fe512fff700 1 --2- 172.21.15.46:0/3881843459 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe50c108610 0x7fe50c19fe70 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe50400ef30 tx=0x7fe50400c3a0 comp rx=0 tx=0).stop 2023-10-19T12:41:41.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.246+0000 7fe512fff700 1 -- 172.21.15.46:0/3881843459 shutdown_connections 2023-10-19T12:41:41.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.246+0000 7fe512fff700 1 --2- 172.21.15.46:0/3881843459 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe50c108610 0x7fe50c19fe70 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:41.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.246+0000 7fe512fff700 1 --2- 172.21.15.46:0/3881843459 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe50c0731f0 0x7fe50c198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:41.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.246+0000 7fe512fff700 1 --2- 172.21.15.46:0/3881843459 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fe4fc0a1480 0x7fe4fc0a3940 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:41.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.246+0000 7fe512fff700 1 --2- 172.21.15.46:0/3881843459 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe50c0747d0 0x7fe50c198ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:41.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.246+0000 7fe512fff700 1 -- 172.21.15.46:0/3881843459 >> 172.21.15.46:0/3881843459 conn(0x7fe50c0fbc90 msgr2=0x7fe50c104560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:41.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.246+0000 7fe512fff700 1 -- 172.21.15.46:0/3881843459 shutdown_connections 2023-10-19T12:41:41.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.247+0000 7fe512fff700 1 -- 172.21.15.46:0/3881843459 wait complete. 2023-10-19T12:41:41.269 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-19T12:41:41.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.471+0000 7f842f7ff700 1 -- 172.21.15.46:0/576732297 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8428101930 msgr2=0x7f8428101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:41.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.471+0000 7f842f7ff700 1 --2- 172.21.15.46:0/576732297 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8428101930 0x7f8428101d90 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f84180099c0 tx=0x7f8418009cd0 comp rx=0 tx=0).stop 2023-10-19T12:41:41.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.471+0000 7f842f7ff700 1 -- 172.21.15.46:0/576732297 shutdown_connections 2023-10-19T12:41:41.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.471+0000 7f842f7ff700 1 --2- 172.21.15.46:0/576732297 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f84281022d0 0x7f8428108b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:41.476 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.471+0000 7f842f7ff700 1 --2- 172.21.15.46:0/576732297 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8428100740 0x7f8428100b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:41.476 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.471+0000 7f842f7ff700 1 --2- 172.21.15.46:0/576732297 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8428101930 0x7f8428101d90 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:41.476 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.471+0000 7f842f7ff700 1 -- 172.21.15.46:0/576732297 >> 172.21.15.46:0/576732297 conn(0x7f84280fbc90 msgr2=0x7f84280fe0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:41.476 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.471+0000 7f842f7ff700 1 -- 172.21.15.46:0/576732297 shutdown_connections 2023-10-19T12:41:41.476 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.471+0000 7f842f7ff700 1 -- 172.21.15.46:0/576732297 wait complete. 2023-10-19T12:41:41.478 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.473+0000 7f842f7ff700 1 Processor -- start 2023-10-19T12:41:41.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.473+0000 7f842f7ff700 1 -- start start 2023-10-19T12:41:41.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.473+0000 7f842f7ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8428100740 0x7f84281988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:41.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.473+0000 7f842f7ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8428101930 0x7f8428198e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:41.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.474+0000 7f842f7ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84281022d0 0x7f842819fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:41.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.474+0000 7f842f7ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84281a0420 con 0x7f84281022d0 2023-10-19T12:41:41.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.474+0000 7f842f7ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84281a0560 con 0x7f8428101930 2023-10-19T12:41:41.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.474+0000 7f842f7ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84281a06f0 con 0x7f8428100740 2023-10-19T12:41:41.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.474+0000 7f842dd9c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84281022d0 0x7f842819fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:41.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.474+0000 7f842dd9c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84281022d0 0x7f842819fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44134/0 (socket says 172.21.15.46:44134) 2023-10-19T12:41:41.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.474+0000 7f842cd9a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8428101930 0x7f8428198e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:41.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.474+0000 7f842dd9c700 1 -- 172.21.15.46:0/728772789 learned_addr learned my addr 172.21.15.46:0/728772789 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:41:41.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.474+0000 7f842d59b700 1 --2- 172.21.15.46:0/728772789 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8428100740 0x7f84281988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:41.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.474+0000 7f842cd9a700 1 -- 172.21.15.46:0/728772789 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8428100740 msgr2=0x7f84281988f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:41.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.474+0000 7f842cd9a700 1 --2- 172.21.15.46:0/728772789 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8428100740 0x7f84281988f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:41.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.474+0000 7f842cd9a700 1 -- 172.21.15.46:0/728772789 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84281022d0 msgr2=0x7f842819fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:41.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.474+0000 7f842cd9a700 1 --2- 172.21.15.46:0/728772789 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84281022d0 0x7f842819fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:41.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.474+0000 7f842cd9a700 1 -- 172.21.15.46:0/728772789 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8424009520 con 0x7f8428101930 2023-10-19T12:41:41.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.474+0000 7f842dd9c700 1 --2- 172.21.15.46:0/728772789 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84281022d0 0x7f842819fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:41:41.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.475+0000 7f842cd9a700 1 --2- 172.21.15.46:0/728772789 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8428101930 0x7f8428198e30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f84180098e0 tx=0x7f841800f690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:41.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.475+0000 7f841e7fc700 1 -- 172.21.15.46:0/728772789 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f841801d070 con 0x7f8428101930 2023-10-19T12:41:41.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.475+0000 7f841e7fc700 1 -- 172.21.15.46:0/728772789 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8418005020 con 0x7f8428101930 2023-10-19T12:41:41.483 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.475+0000 7f841e7fc700 1 -- 172.21.15.46:0/728772789 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84180049e0 con 0x7f8428101930 2023-10-19T12:41:41.483 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.475+0000 7f842f7ff700 1 -- 172.21.15.46:0/728772789 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84180095f0 con 0x7f8428101930 2023-10-19T12:41:41.484 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.476+0000 7f842f7ff700 1 -- 172.21.15.46:0/728772789 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84281a0b50 con 0x7f8428101930 2023-10-19T12:41:41.484 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.477+0000 7f842f7ff700 1 -- 172.21.15.46:0/728772789 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8428067530 con 0x7f8428101930 2023-10-19T12:41:41.484 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.479+0000 7f841e7fc700 1 -- 172.21.15.46:0/728772789 <== mon.2 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f8418005190 con 0x7f8428101930 2023-10-19T12:41:41.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.480+0000 7f841e7fc700 1 --2- 172.21.15.46:0/728772789 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f84140a1480 0x7f84140a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:41.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.480+0000 7f841e7fc700 1 -- 172.21.15.46:0/728772789 <== mon.2 v2:172.21.15.157:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f84180cdb20 con 0x7f8428101930 2023-10-19T12:41:41.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.480+0000 7f842d59b700 1 --2- 172.21.15.46:0/728772789 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f84140a1480 0x7f84140a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:41.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.481+0000 7f842d59b700 1 --2- 172.21.15.46:0/728772789 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f84140a1480 0x7f84140a3940 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8428101790 tx=0x7f8424009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:41.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.482+0000 7f841e7fc700 1 -- 172.21.15.46:0/728772789 <== mon.2 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f8418096fc0 con 0x7f8428101930 2023-10-19T12:41:41.697 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.694+0000 7f842f7ff700 1 -- 172.21.15.46:0/728772789 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f842810bfb0 con 0x7f8428101930 2023-10-19T12:41:41.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.696+0000 7f841e7fc700 1 -- 172.21.15.46:0/728772789 <== mon.2 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+23953 (secure 0 0 0) 0x7f841809a5e0 con 0x7f8428101930 2023-10-19T12:41:41.699 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:41:41.700 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":88,"fsid":"96a8be3c-6e7b-11ee-8db6-212e2dc638e7","created":"2023-10-19T12:33:26.148713+0000","modified":"2023-10-19T12:41:23.831907+0000","last_up_change":"2023-10-19T12:40:30.761679+0000","last_in_change":"2023-10-19T12:40:13.663559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-19T12:37:07.175795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-19T12:41:16.895203+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-19T12:41:18.255601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-19T12:41:21.830455+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"346ce86b-a10a-4869-9fdb-c3c1d4161455","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6803","nonce":500237995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6805","nonce":500237995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6809","nonce":500237995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6807","nonce":500237995}]},"public_addr":"172.21.15.46:6803/500237995","cluster_addr":"172.21.15.46:6805/500237995","heartbeat_back_addr":"172.21.15.46:6809/500237995","heartbeat_front_addr":"172.21.15.46:6807/500237995","state":["exists","up"]},{"osd":1,"uuid":"02aae687-76c5-4124-bae4-9787ed571c28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6801","nonce":2496862790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6803","nonce":2496862790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6807","nonce":2496862790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6805","nonce":2496862790}]},"public_addr":"172.21.15.157:6801/2496862790","cluster_addr":"172.21.15.157:6803/2496862790","heartbeat_back_addr":"172.21.15.157:6807/2496862790","heartbeat_front_addr":"172.21.15.157:6805/2496862790","state":["exists","up"]},{"osd":2,"uuid":"d5360828-1f58-4380-b2ad-0c21ff850981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6801","nonce":4211767276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6803","nonce":4211767276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6807","nonce":4211767276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6805","nonce":4211767276}]},"public_addr":"172.21.15.195:6801/4211767276","cluster_addr":"172.21.15.195:6803/4211767276","heartbeat_back_addr":"172.21.15.195:6807/4211767276","heartbeat_front_addr":"172.21.15.195:6805/4211767276","state":["exists","up"]},{"osd":3,"uuid":"accb780f-49d0-43f8-b166-ee12c558ef00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6811","nonce":1964113352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6813","nonce":1964113352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6817","nonce":1964113352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6815","nonce":1964113352}]},"public_addr":"172.21.15.46:6811/1964113352","cluster_addr":"172.21.15.46:6813/1964113352","heartbeat_back_addr":"172.21.15.46:6817/1964113352","heartbeat_front_addr":"172.21.15.46:6815/1964113352","state":["exists","up"]},{"osd":4,"uuid":"e662886d-e989-4d02-8c1f-3c4671352b0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6809","nonce":3636910144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6811","nonce":3636910144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6815","nonce":3636910144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6813","nonce":3636910144}]},"public_addr":"172.21.15.157:6809/3636910144","cluster_addr":"172.21.15.157:6811/3636910144","heartbeat_back_addr":"172.21.15.157:6815/3636910144","heartbeat_front_addr":"172.21.15.157:6813/3636910144","state":["exists","up"]},{"osd":5,"uuid":"9597e0ce-14ea-407d-90fe-f74bccee38b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6809","nonce":4071287969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6811","nonce":4071287969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6815","nonce":4071287969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6813","nonce":4071287969}]},"public_addr":"172.21.15.195:6809/4071287969","cluster_addr":"172.21.15.195:6811/4071287969","heartbeat_back_addr":"172.21.15.195:6815/4071287969","heartbeat_front_addr":"172.21.15.195:6813/4071287969","state":["exists","up"]},{"osd":6,"uuid":"6b78ba38-f60e-4cb6-b01c-cecc1820e8e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6819","nonce":1842285555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6821","nonce":1842285555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6825","nonce":1842285555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6823","nonce":1842285555}]},"public_addr":"172.21.15.46:6819/1842285555","cluster_addr":"172.21.15.46:6821/1842285555","heartbeat_back_addr":"172.21.15.46:6825/1842285555","heartbeat_front_addr":"172.21.15.46:6823/1842285555","state":["exists","up"]},{"osd":7,"uuid":"59a0899f-3bcd-4db2-b544-24df3a536749","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6817","nonce":3498672588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6819","nonce":3498672588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6823","nonce":3498672588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6821","nonce":3498672588}]},"public_addr":"172.21.15.157:6817/3498672588","cluster_addr":"172.21.15.157:6819/3498672588","heartbeat_back_addr":"172.21.15.157:6823/3498672588","heartbeat_front_addr":"172.21.15.157:6821/3498672588","state":["exists","up"]},{"osd":8,"uuid":"9c3c9835-043a-4fb5-a9ee-edf8caf6b605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6817","nonce":74230104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6819","nonce":74230104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6823","nonce":74230104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6821","nonce":74230104}]},"public_addr":"172.21.15.195:6817/74230104","cluster_addr":"172.21.15.195:6819/74230104","heartbeat_back_addr":"172.21.15.195:6823/74230104","heartbeat_front_addr":"172.21.15.195:6821/74230104","state":["exists","up"]},{"osd":9,"uuid":"3f18f506-a577-4b7c-ae0d-9351c07e81f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6827","nonce":3472581046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6829","nonce":3472581046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6833","nonce":3472581046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6831","nonce":3472581046}]},"public_addr":"172.21.15.46:6827/3472581046","cluster_addr":"172.21.15.46:6829/3472581046","heartbeat_back_addr":"172.21.15.46:6833/3472581046","heartbeat_front_addr":"172.21.15.46:6831/3472581046","state":["exists","up"]},{"osd":10,"uuid":"1ed01854-443a-4acf-9293-7ca0d451a93d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6825","nonce":2378416559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6827","nonce":2378416559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6831","nonce":2378416559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6829","nonce":2378416559}]},"public_addr":"172.21.15.157:6825/2378416559","cluster_addr":"172.21.15.157:6827/2378416559","heartbeat_back_addr":"172.21.15.157:6831/2378416559","heartbeat_front_addr":"172.21.15.157:6829/2378416559","state":["exists","up"]},{"osd":11,"uuid":"021398c0-9184-4647-8220-e40f6705ca90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6825","nonce":3075632222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6827","nonce":3075632222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6831","nonce":3075632222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6829","nonce":3075632222}]},"public_addr":"172.21.15.195:6825/3075632222","cluster_addr":"172.21.15.195:6827/3075632222","heartbeat_back_addr":"172.21.15.195:6831/3075632222","heartbeat_front_addr":"172.21.15.195:6829/3075632222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:36:22.002614+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:36:44.098031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:37:04.518341+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:37:30.796462+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:37:52.756555+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:38:13.403168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:38:39.058472+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:39:01.106893+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:39:21.908334+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:39:46.843884+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:40:08.792020+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:40:29.282974+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.46:0/3248595150":"2023-10-20T12:34:26.552115+0000","172.21.15.46:0/3624849341":"2023-10-20T12:34:26.552115+0000","172.21.15.46:0/1844094590":"2023-10-20T12:34:26.552115+0000","172.21.15.46:6801/20022894":"2023-10-20T12:34:26.552115+0000","172.21.15.46:0/3969790632":"2023-10-20T12:34:00.135248+0000","172.21.15.46:0/2331135821":"2023-10-20T12:34:00.135248+0000","172.21.15.46:6800/51664346":"2023-10-20T12:34:00.135248+0000","172.21.15.46:6801/51664346":"2023-10-20T12:34:00.135248+0000","172.21.15.46:0/585851467":"2023-10-20T12:34:00.135248+0000","172.21.15.46:6800/20022894":"2023-10-20T12:34:26.552115+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-19T12:41:41.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.698+0000 7f842f7ff700 1 -- 172.21.15.46:0/728772789 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f84140a1480 msgr2=0x7f84140a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:41.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.698+0000 7f842f7ff700 1 --2- 172.21.15.46:0/728772789 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f84140a1480 0x7f84140a3940 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8428101790 tx=0x7f8424009260 comp rx=0 tx=0).stop 2023-10-19T12:41:41.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.698+0000 7f842f7ff700 1 -- 172.21.15.46:0/728772789 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8428101930 msgr2=0x7f8428198e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:41.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.698+0000 7f842f7ff700 1 --2- 172.21.15.46:0/728772789 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8428101930 0x7f8428198e30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f84180098e0 tx=0x7f841800f690 comp rx=0 tx=0).stop 2023-10-19T12:41:41.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.698+0000 7f842f7ff700 1 -- 172.21.15.46:0/728772789 shutdown_connections 2023-10-19T12:41:41.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.698+0000 7f842f7ff700 1 --2- 172.21.15.46:0/728772789 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84281022d0 0x7f842819fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:41.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.698+0000 7f842f7ff700 1 --2- 172.21.15.46:0/728772789 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f84140a1480 0x7f84140a3940 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:41.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.698+0000 7f842f7ff700 1 --2- 172.21.15.46:0/728772789 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8428100740 0x7f84281988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:41.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.698+0000 7f842f7ff700 1 --2- 172.21.15.46:0/728772789 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8428101930 0x7f8428198e30 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:41.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.698+0000 7f842f7ff700 1 -- 172.21.15.46:0/728772789 >> 172.21.15.46:0/728772789 conn(0x7f84280fbc90 msgr2=0x7f8428107150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:41.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.698+0000 7f842f7ff700 1 -- 172.21.15.46:0/728772789 shutdown_connections 2023-10-19T12:41:41.704 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.698+0000 7f842f7ff700 1 -- 172.21.15.46:0/728772789 wait complete. 2023-10-19T12:41:41.721 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-19T12:41:41.931 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.928+0000 7f715cfff700 1 -- 172.21.15.46:0/4024182636 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7158102330 msgr2=0x7f7158108be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:41.932 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.928+0000 7f715cfff700 1 --2- 172.21.15.46:0/4024182636 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7158102330 0x7f7158108be0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f715000b0d0 tx=0x7f715000b3e0 comp rx=0 tx=0).stop 2023-10-19T12:41:41.932 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.928+0000 7f715cfff700 1 -- 172.21.15.46:0/4024182636 shutdown_connections 2023-10-19T12:41:41.932 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.928+0000 7f715cfff700 1 --2- 172.21.15.46:0/4024182636 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7158102330 0x7f7158108be0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:41.932 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.928+0000 7f715cfff700 1 --2- 172.21.15.46:0/4024182636 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f71581007a0 0x7f7158100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:41.932 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.928+0000 7f715cfff700 1 --2- 172.21.15.46:0/4024182636 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7158101990 0x7f7158101df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:41.933 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.928+0000 7f715cfff700 1 -- 172.21.15.46:0/4024182636 >> 172.21.15.46:0/4024182636 conn(0x7f71580fbcf0 msgr2=0x7f71580fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:41.933 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.928+0000 7f715cfff700 1 -- 172.21.15.46:0/4024182636 shutdown_connections 2023-10-19T12:41:41.933 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.928+0000 7f715cfff700 1 -- 172.21.15.46:0/4024182636 wait complete. 2023-10-19T12:41:41.935 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.929+0000 7f715cfff700 1 Processor -- start 2023-10-19T12:41:41.935 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.929+0000 7f715cfff700 1 -- start start 2023-10-19T12:41:41.935 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.929+0000 7f715cfff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f71581007a0 0x7f7158198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:41.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.929+0000 7f715cfff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7158101990 0x7f7158199020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:41.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.929+0000 7f715cfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7158102330 0x7f715819fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:41.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.929+0000 7f715cfff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71581a05c0 con 0x7f7158102330 2023-10-19T12:41:41.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.929+0000 7f715cfff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71581a0700 con 0x7f71581007a0 2023-10-19T12:41:41.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.929+0000 7f715cfff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71581a0890 con 0x7f7158101990 2023-10-19T12:41:41.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.930+0000 7f7156d9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7158102330 0x7f715819fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:41.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.930+0000 7f715659c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f71581007a0 0x7f7158198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:41.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.930+0000 7f714ffff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7158101990 0x7f7158199020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:41.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.930+0000 7f7156d9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7158102330 0x7f715819fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44154/0 (socket says 172.21.15.46:44154) 2023-10-19T12:41:41.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.930+0000 7f715659c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f71581007a0 0x7f7158198ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:33578/0 (socket says 172.21.15.46:33578) 2023-10-19T12:41:41.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.930+0000 7f7156d9d700 1 -- 172.21.15.46:0/2055573210 learned_addr learned my addr 172.21.15.46:0/2055573210 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:41:41.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.930+0000 7f715659c700 1 -- 172.21.15.46:0/2055573210 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7158101990 msgr2=0x7f7158199020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:41.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.930+0000 7f715659c700 1 --2- 172.21.15.46:0/2055573210 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7158101990 0x7f7158199020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:41.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.930+0000 7f715659c700 1 -- 172.21.15.46:0/2055573210 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7158102330 msgr2=0x7f715819fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:41.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.930+0000 7f715659c700 1 --2- 172.21.15.46:0/2055573210 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7158102330 0x7f715819fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:41.939 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.930+0000 7f715659c700 1 -- 172.21.15.46:0/2055573210 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7150009d00 con 0x7f71581007a0 2023-10-19T12:41:41.939 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.930+0000 7f7156d9d700 1 --2- 172.21.15.46:0/2055573210 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7158102330 0x7f715819fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:41:41.939 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.931+0000 7f715659c700 1 --2- 172.21.15.46:0/2055573210 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f71581007a0 0x7f7158198ae0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f714800e9c0 tx=0x7f714800ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:41.939 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.931+0000 7f714f7fe700 1 -- 172.21.15.46:0/2055573210 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7148004220 con 0x7f71581007a0 2023-10-19T12:41:41.939 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.931+0000 7f714f7fe700 1 -- 172.21.15.46:0/2055573210 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7148004380 con 0x7f71581007a0 2023-10-19T12:41:41.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.931+0000 7f715cfff700 1 -- 172.21.15.46:0/2055573210 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71581a0b70 con 0x7f71581007a0 2023-10-19T12:41:41.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.931+0000 7f714f7fe700 1 -- 172.21.15.46:0/2055573210 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7148003be0 con 0x7f71581007a0 2023-10-19T12:41:41.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.931+0000 7f715cfff700 1 -- 172.21.15.46:0/2055573210 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71581a1080 con 0x7f71581007a0 2023-10-19T12:41:41.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.932+0000 7f715cfff700 1 -- 172.21.15.46:0/2055573210 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71580675a0 con 0x7f71581007a0 2023-10-19T12:41:41.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.934+0000 7f714f7fe700 1 -- 172.21.15.46:0/2055573210 <== mon.2 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f7148003d40 con 0x7f71581007a0 2023-10-19T12:41:41.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.935+0000 7f714f7fe700 1 --2- 172.21.15.46:0/2055573210 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f71440a1480 0x7f71440a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:41.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.935+0000 7f714f7fe700 1 -- 172.21.15.46:0/2055573210 <== mon.2 v2:172.21.15.157:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f7148014070 con 0x7f71581007a0 2023-10-19T12:41:41.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.936+0000 7f714ffff700 1 --2- 172.21.15.46:0/2055573210 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f71440a1480 0x7f71440a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:41.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.936+0000 7f714ffff700 1 --2- 172.21.15.46:0/2055573210 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f71440a1480 0x7f71440a3940 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7140007be0 tx=0x7f71400073d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:41.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:41.938+0000 7f714f7fe700 1 -- 172.21.15.46:0/2055573210 <== mon.2 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f71480969e0 con 0x7f71581007a0 2023-10-19T12:41:41.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:41 smithi046 ceph-mon[98509]: pgmap v295: 129 pgs: 129 active+clean; 581 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2023-10-19T12:41:41.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:41 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/3881843459' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-19T12:41:41.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:41 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/728772789' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-19T12:41:42.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:41 smithi157 ceph-mon[134109]: pgmap v295: 129 pgs: 129 active+clean; 581 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2023-10-19T12:41:42.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:41 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/3881843459' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-19T12:41:42.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:41 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/728772789' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-19T12:41:42.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:41 smithi195 ceph-mon[134493]: pgmap v295: 129 pgs: 129 active+clean; 581 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2023-10-19T12:41:42.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:41 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/3881843459' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-19T12:41:42.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:41 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/728772789' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-19T12:41:42.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:42.196+0000 7f715cfff700 1 -- 172.21.15.46:0/2055573210 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f715810c010 con 0x7f71581007a0 2023-10-19T12:41:42.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:42.716+0000 7f714f7fe700 1 -- 172.21.15.46:0/2055573210 <== mon.2 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v18) v1 ==== 118+0+0 (secure 0 0 0) 0x7f7148017e90 con 0x7f71581007a0 2023-10-19T12:41:42.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:42.719+0000 7f715cfff700 1 -- 172.21.15.46:0/2055573210 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f71440a1480 msgr2=0x7f71440a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:42.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:42.719+0000 7f715cfff700 1 --2- 172.21.15.46:0/2055573210 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f71440a1480 0x7f71440a3940 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7140007be0 tx=0x7f71400073d0 comp rx=0 tx=0).stop 2023-10-19T12:41:42.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:42.719+0000 7f715cfff700 1 -- 172.21.15.46:0/2055573210 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f71581007a0 msgr2=0x7f7158198ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:42.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:42.719+0000 7f715cfff700 1 --2- 172.21.15.46:0/2055573210 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f71581007a0 0x7f7158198ae0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f714800e9c0 tx=0x7f714800ecd0 comp rx=0 tx=0).stop 2023-10-19T12:41:42.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:42.719+0000 7f715cfff700 1 -- 172.21.15.46:0/2055573210 shutdown_connections 2023-10-19T12:41:42.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:42.719+0000 7f715cfff700 1 --2- 172.21.15.46:0/2055573210 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7158102330 0x7f715819fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:42.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:42.719+0000 7f715cfff700 1 --2- 172.21.15.46:0/2055573210 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f71581007a0 0x7f7158198ae0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:42.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:42.719+0000 7f715cfff700 1 --2- 172.21.15.46:0/2055573210 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f71440a1480 0x7f71440a3940 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:42.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:42.719+0000 7f715cfff700 1 --2- 172.21.15.46:0/2055573210 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7158101990 0x7f7158199020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:42.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:42.719+0000 7f715cfff700 1 -- 172.21.15.46:0/2055573210 >> 172.21.15.46:0/2055573210 conn(0x7f71580fbcf0 msgr2=0x7f7158072a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:42.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:42.719+0000 7f715cfff700 1 -- 172.21.15.46:0/2055573210 shutdown_connections 2023-10-19T12:41:42.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:42.720+0000 7f715cfff700 1 -- 172.21.15.46:0/2055573210 wait complete. 2023-10-19T12:41:42.743 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2023-10-19T12:41:42.744 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 5 2023-10-19T12:41:42.955 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:42.951+0000 7f702edff700 1 -- 172.21.15.46:0/1189484693 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7028101990 msgr2=0x7f7028101df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:42.955 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:42.951+0000 7f702edff700 1 --2- 172.21.15.46:0/1189484693 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7028101990 0x7f7028101df0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f70140099c0 tx=0x7f7014009cd0 comp rx=0 tx=0).stop 2023-10-19T12:41:42.955 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:42.951+0000 7f702edff700 1 -- 172.21.15.46:0/1189484693 shutdown_connections 2023-10-19T12:41:42.956 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:42.951+0000 7f702edff700 1 --2- 172.21.15.46:0/1189484693 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7028102330 0x7f7028108be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:42.956 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:42.951+0000 7f702edff700 1 --2- 172.21.15.46:0/1189484693 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f70281007a0 0x7f7028100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:42.956 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:42.951+0000 7f702edff700 1 --2- 172.21.15.46:0/1189484693 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7028101990 0x7f7028101df0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:42.956 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:42.951+0000 7f702edff700 1 -- 172.21.15.46:0/1189484693 >> 172.21.15.46:0/1189484693 conn(0x7f70280fbcf0 msgr2=0x7f70280fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:42.957 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:42.951+0000 7f702edff700 1 -- 172.21.15.46:0/1189484693 shutdown_connections 2023-10-19T12:41:42.957 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:42.951+0000 7f702edff700 1 -- 172.21.15.46:0/1189484693 wait complete. 2023-10-19T12:41:42.960 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:42.952+0000 7f702edff700 1 Processor -- start 2023-10-19T12:41:42.960 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:42.952+0000 7f702edff700 1 -- start start 2023-10-19T12:41:42.960 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:42.953+0000 7f702edff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f70281007a0 0x7f7028198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:42.961 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:42.953+0000 7f702edff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7028101990 0x7f7028198e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:42.961 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:42.953+0000 7f702edff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7028102330 0x7f702819fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:42.961 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:42.953+0000 7f702edff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70281a0440 con 0x7f7028101990 2023-10-19T12:41:42.961 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:42.953+0000 7f702edff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70281a0580 con 0x7f7028102330 2023-10-19T12:41:42.962 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:42.953+0000 7f702edff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70281a0710 con 0x7f70281007a0 2023-10-19T12:41:42.962 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:42.953+0000 7f7027fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7028101990 0x7f7028198e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:42.962 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:42.953+0000 7f7027fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7028101990 0x7f7028198e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44174/0 (socket says 172.21.15.46:44174) 2023-10-19T12:41:42.962 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:42.953+0000 7f7027fff700 1 -- 172.21.15.46:0/3030288259 learned_addr learned my addr 172.21.15.46:0/3030288259 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:41:42.963 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:42.953+0000 7f702cb9b700 1 --2- 172.21.15.46:0/3030288259 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f70281007a0 0x7f7028198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:42.963 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:42.953+0000 7f702d39c700 1 --2- 172.21.15.46:0/3030288259 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7028102330 0x7f702819fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:42.963 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:42.953+0000 7f7027fff700 1 -- 172.21.15.46:0/3030288259 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f70281007a0 msgr2=0x7f7028198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:42.963 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:42.953+0000 7f7027fff700 1 --2- 172.21.15.46:0/3030288259 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f70281007a0 0x7f7028198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:42.963 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:42.953+0000 7f7027fff700 1 -- 172.21.15.46:0/3030288259 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7028102330 msgr2=0x7f702819fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:42.964 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:42.953+0000 7f7027fff700 1 --2- 172.21.15.46:0/3030288259 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7028102330 0x7f702819fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:42.964 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:42.953+0000 7f7027fff700 1 -- 172.21.15.46:0/3030288259 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70140095f0 con 0x7f7028101990 2023-10-19T12:41:42.964 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:42.953+0000 7f702d39c700 1 --2- 172.21.15.46:0/3030288259 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7028102330 0x7f702819fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T12:41:42.964 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:42.954+0000 7f7027fff700 1 --2- 172.21.15.46:0/3030288259 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7028101990 0x7f7028198e50 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f7014006010 tx=0x7f701400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:42.964 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:42.954+0000 7f7025ffb700 1 -- 172.21.15.46:0/3030288259 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f701401d070 con 0x7f7028101990 2023-10-19T12:41:42.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:42.954+0000 7f7025ffb700 1 -- 172.21.15.46:0/3030288259 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7014005030 con 0x7f7028101990 2023-10-19T12:41:42.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:42.954+0000 7f7025ffb700 1 -- 172.21.15.46:0/3030288259 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7014004bb0 con 0x7f7028101990 2023-10-19T12:41:42.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:42.954+0000 7f702edff700 1 -- 172.21.15.46:0/3030288259 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70281a0990 con 0x7f7028101990 2023-10-19T12:41:42.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:42.954+0000 7f702edff700 1 -- 172.21.15.46:0/3030288259 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70281a0d60 con 0x7f7028101990 2023-10-19T12:41:42.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:42.955+0000 7f702edff700 1 -- 172.21.15.46:0/3030288259 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70280675a0 con 0x7f7028101990 2023-10-19T12:41:42.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:42.957+0000 7f7025ffb700 1 -- 172.21.15.46:0/3030288259 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f70140051a0 con 0x7f7028101990 2023-10-19T12:41:42.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:42.959+0000 7f7025ffb700 1 --2- 172.21.15.46:0/3030288259 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f70180a1500 0x7f70180a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:42.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:42.959+0000 7f7025ffb700 1 -- 172.21.15.46:0/3030288259 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f70140cdfe0 con 0x7f7028101990 2023-10-19T12:41:42.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:42.959+0000 7f702cb9b700 1 --2- 172.21.15.46:0/3030288259 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f70180a1500 0x7f70180a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:42.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:42.959+0000 7f702cb9b700 1 --2- 172.21.15.46:0/3030288259 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f70180a1500 0x7f70180a39c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f70281017f0 tx=0x7f701c009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:42.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:42.960+0000 7f7025ffb700 1 -- 172.21.15.46:0/3030288259 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f70140974e0 con 0x7f7028101990 2023-10-19T12:41:42.978 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:42 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/2055573210' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-10-19T12:41:42.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:42 smithi046 ceph-mon[98509]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-10-19T12:41:43.090 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:42 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/2055573210' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-10-19T12:41:43.090 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:42 smithi157 ceph-mon[134109]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-10-19T12:41:43.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:42 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/2055573210' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-10-19T12:41:43.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:42 smithi195 ceph-mon[134493]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-10-19T12:41:43.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:43.218+0000 7f702edff700 1 -- 172.21.15.46:0/3030288259 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) v1 -- 0x7f702810c1b0 con 0x7f7028101990 2023-10-19T12:41:43.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:43.265+0000 7f7025ffb700 1 -- 172.21.15.46:0/3030288259 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v19) v1 ==== 105+0+0 (secure 0 0 0) 0x7f70140260b0 con 0x7f7028101990 2023-10-19T12:41:43.270 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:43.267+0000 7f702edff700 1 -- 172.21.15.46:0/3030288259 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f70180a1500 msgr2=0x7f70180a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:43.270 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:43.267+0000 7f702edff700 1 --2- 172.21.15.46:0/3030288259 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f70180a1500 0x7f70180a39c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f70281017f0 tx=0x7f701c009260 comp rx=0 tx=0).stop 2023-10-19T12:41:43.271 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:43.267+0000 7f702edff700 1 -- 172.21.15.46:0/3030288259 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7028101990 msgr2=0x7f7028198e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:43.271 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:43.267+0000 7f702edff700 1 --2- 172.21.15.46:0/3030288259 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7028101990 0x7f7028198e50 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f7014006010 tx=0x7f701400f690 comp rx=0 tx=0).stop 2023-10-19T12:41:43.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:43.268+0000 7f702edff700 1 -- 172.21.15.46:0/3030288259 shutdown_connections 2023-10-19T12:41:43.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:43.268+0000 7f702edff700 1 --2- 172.21.15.46:0/3030288259 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7028102330 0x7f702819fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:43.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:43.268+0000 7f702edff700 1 --2- 172.21.15.46:0/3030288259 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f70180a1500 0x7f70180a39c0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:43.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:43.268+0000 7f702edff700 1 --2- 172.21.15.46:0/3030288259 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f70281007a0 0x7f7028198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:43.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:43.268+0000 7f702edff700 1 --2- 172.21.15.46:0/3030288259 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7028101990 0x7f7028198e50 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:43.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:43.268+0000 7f702edff700 1 -- 172.21.15.46:0/3030288259 >> 172.21.15.46:0/3030288259 conn(0x7f70280fbcf0 msgr2=0x7f7028072a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:43.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:43.268+0000 7f702edff700 1 -- 172.21.15.46:0/3030288259 shutdown_connections 2023-10-19T12:41:43.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:43.268+0000 7f702edff700 1 -- 172.21.15.46:0/3030288259 wait complete. 2023-10-19T12:41:43.294 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay true 2023-10-19T12:41:43.504 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:43.501+0000 7f98a73ff700 1 -- 172.21.15.46:0/2814991185 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98a0101990 msgr2=0x7f98a0101df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:43.504 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:43.501+0000 7f98a73ff700 1 --2- 172.21.15.46:0/2814991185 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98a0101990 0x7f98a0101df0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f98900099c0 tx=0x7f9890009cd0 comp rx=0 tx=0).stop 2023-10-19T12:41:43.505 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:43.501+0000 7f98a73ff700 1 -- 172.21.15.46:0/2814991185 shutdown_connections 2023-10-19T12:41:43.505 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:43.501+0000 7f98a73ff700 1 --2- 172.21.15.46:0/2814991185 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f98a0102330 0x7f98a0108be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:43.505 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:43.501+0000 7f98a73ff700 1 --2- 172.21.15.46:0/2814991185 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98a01007a0 0x7f98a0100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:43.505 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:43.501+0000 7f98a73ff700 1 --2- 172.21.15.46:0/2814991185 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98a0101990 0x7f98a0101df0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:43.506 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:43.501+0000 7f98a73ff700 1 -- 172.21.15.46:0/2814991185 >> 172.21.15.46:0/2814991185 conn(0x7f98a00fbcf0 msgr2=0x7f98a00fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:43.506 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:43.501+0000 7f98a73ff700 1 -- 172.21.15.46:0/2814991185 shutdown_connections 2023-10-19T12:41:43.506 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:43.501+0000 7f98a73ff700 1 -- 172.21.15.46:0/2814991185 wait complete. 2023-10-19T12:41:43.508 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:43.502+0000 7f98a73ff700 1 Processor -- start 2023-10-19T12:41:43.508 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:43.502+0000 7f98a73ff700 1 -- start start 2023-10-19T12:41:43.508 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:43.502+0000 7f98a73ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98a01007a0 0x7f98a0196700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:43.509 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:43.502+0000 7f98a73ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98a0101990 0x7f98a0196c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:43.509 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:43.502+0000 7f98a73ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f98a0102330 0x7f98a019dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:43.509 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:43.502+0000 7f98a73ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98a019e230 con 0x7f98a0101990 2023-10-19T12:41:43.509 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:43.502+0000 7f98a73ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98a019e370 con 0x7f98a0102330 2023-10-19T12:41:43.509 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:43.502+0000 7f98a73ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98a019e500 con 0x7f98a01007a0 2023-10-19T12:41:43.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:43.502+0000 7f98a499a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98a0101990 0x7f98a0196c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:43.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:43.503+0000 7f98a499a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98a0101990 0x7f98a0196c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56326/0 (socket says 172.21.15.46:56326) 2023-10-19T12:41:43.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:43.503+0000 7f98a519b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98a01007a0 0x7f98a0196700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:43.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:43.503+0000 7f98a499a700 1 -- 172.21.15.46:0/13840193 learned_addr learned my addr 172.21.15.46:0/13840193 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:41:43.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:43.503+0000 7f98a599c700 1 --2- 172.21.15.46:0/13840193 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f98a0102330 0x7f98a019dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:43.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:43.503+0000 7f98a499a700 1 -- 172.21.15.46:0/13840193 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98a01007a0 msgr2=0x7f98a0196700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:43.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:43.503+0000 7f98a499a700 1 --2- 172.21.15.46:0/13840193 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98a01007a0 0x7f98a0196700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:43.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:43.503+0000 7f98a499a700 1 -- 172.21.15.46:0/13840193 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f98a0102330 msgr2=0x7f98a019dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:43.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:43.503+0000 7f98a499a700 1 --2- 172.21.15.46:0/13840193 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f98a0102330 0x7f98a019dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:43.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:43.503+0000 7f98a499a700 1 -- 172.21.15.46:0/13840193 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98900095f0 con 0x7f98a0101990 2023-10-19T12:41:43.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:43.503+0000 7f98a599c700 1 --2- 172.21.15.46:0/13840193 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f98a0102330 0x7f98a019dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T12:41:43.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:43.503+0000 7f98a499a700 1 --2- 172.21.15.46:0/13840193 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98a0101990 0x7f98a0196c40 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f98900036f0 tx=0x7f9890009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:43.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:43.503+0000 7f98967fc700 1 -- 172.21.15.46:0/13840193 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f989001d070 con 0x7f98a0101990 2023-10-19T12:41:43.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:43.503+0000 7f98967fc700 1 -- 172.21.15.46:0/13840193 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9890004050 con 0x7f98a0101990 2023-10-19T12:41:43.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:43.503+0000 7f98967fc700 1 -- 172.21.15.46:0/13840193 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9890022d60 con 0x7f98a0101990 2023-10-19T12:41:43.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:43.503+0000 7f98a73ff700 1 -- 172.21.15.46:0/13840193 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98a019e780 con 0x7f98a0101990 2023-10-19T12:41:43.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:43.504+0000 7f98a73ff700 1 -- 172.21.15.46:0/13840193 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98a019eb50 con 0x7f98a0101990 2023-10-19T12:41:43.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:43.505+0000 7f98a73ff700 1 -- 172.21.15.46:0/13840193 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98a0107c40 con 0x7f98a0101990 2023-10-19T12:41:43.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:43.507+0000 7f98967fc700 1 -- 172.21.15.46:0/13840193 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f9890022470 con 0x7f98a0101990 2023-10-19T12:41:43.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:43.508+0000 7f98967fc700 1 --2- 172.21.15.46:0/13840193 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f988c0a1480 0x7f988c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:43.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:43.508+0000 7f98967fc700 1 -- 172.21.15.46:0/13840193 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f98900ce1b0 con 0x7f98a0101990 2023-10-19T12:41:43.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:43.508+0000 7f98a519b700 1 --2- 172.21.15.46:0/13840193 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f988c0a1480 0x7f988c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:43.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:43.509+0000 7f98a519b700 1 --2- 172.21.15.46:0/13840193 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f988c0a1480 0x7f988c0a3940 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f98a01017f0 tx=0x7f989c007400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:43.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:43.512+0000 7f98967fc700 1 -- 172.21.15.46:0/13840193 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f989005d100 con 0x7f98a0101990 2023-10-19T12:41:43.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:43.772+0000 7f98a73ff700 1 -- 172.21.15.46:0/13840193 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7f98a00675a0 con 0x7f98a0101990 2023-10-19T12:41:43.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:43 smithi046 ceph-mon[98509]: pgmap v296: 129 pgs: 129 active+clean; 581 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2023-10-19T12:41:43.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:43 smithi046 ceph-mon[98509]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-10-19T12:41:43.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:43 smithi046 ceph-mon[98509]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-19T12:41:43.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:43 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/3030288259' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2023-10-19T12:41:43.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:43 smithi046 ceph-mon[98509]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-10-19T12:41:43.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:43 smithi046 ceph-mon[98509]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-10-19T12:41:43.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:43 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/3030288259' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2023-10-19T12:41:43.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:43 smithi046 ceph-mon[98509]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2023-10-19T12:41:43.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:43 smithi046 ceph-mon[98509]: daemon mds.i is now active in filesystem cephfs as rank 1 2023-10-19T12:41:44.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:43 smithi157 ceph-mon[134109]: pgmap v296: 129 pgs: 129 active+clean; 581 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2023-10-19T12:41:44.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:43 smithi157 ceph-mon[134109]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-10-19T12:41:44.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:43 smithi157 ceph-mon[134109]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-19T12:41:44.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:43 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/3030288259' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2023-10-19T12:41:44.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:43 smithi157 ceph-mon[134109]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-10-19T12:41:44.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:43 smithi157 ceph-mon[134109]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-10-19T12:41:44.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:43 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/3030288259' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2023-10-19T12:41:44.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:43 smithi157 ceph-mon[134109]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2023-10-19T12:41:44.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:43 smithi157 ceph-mon[134109]: daemon mds.i is now active in filesystem cephfs as rank 1 2023-10-19T12:41:44.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:43 smithi195 ceph-mon[134493]: pgmap v296: 129 pgs: 129 active+clean; 581 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2023-10-19T12:41:44.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:43 smithi195 ceph-mon[134493]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-10-19T12:41:44.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:43 smithi195 ceph-mon[134493]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-19T12:41:44.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:43 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/3030288259' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2023-10-19T12:41:44.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:43 smithi195 ceph-mon[134493]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-10-19T12:41:44.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:43 smithi195 ceph-mon[134493]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-10-19T12:41:44.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:43 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/3030288259' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2023-10-19T12:41:44.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:43 smithi195 ceph-mon[134493]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2023-10-19T12:41:44.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:43 smithi195 ceph-mon[134493]: daemon mds.i is now active in filesystem cephfs as rank 1 2023-10-19T12:41:44.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:44.271+0000 7f98967fc700 1 -- 172.21.15.46:0/13840193 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v20) v1 ==== 121+0+0 (secure 0 0 0) 0x7f9890097650 con 0x7f98a0101990 2023-10-19T12:41:44.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:44.274+0000 7f98a73ff700 1 -- 172.21.15.46:0/13840193 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f988c0a1480 msgr2=0x7f988c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:44.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:44.274+0000 7f98a73ff700 1 --2- 172.21.15.46:0/13840193 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f988c0a1480 0x7f988c0a3940 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f98a01017f0 tx=0x7f989c007400 comp rx=0 tx=0).stop 2023-10-19T12:41:44.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:44.274+0000 7f98a73ff700 1 -- 172.21.15.46:0/13840193 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98a0101990 msgr2=0x7f98a0196c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:44.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:44.274+0000 7f98a73ff700 1 --2- 172.21.15.46:0/13840193 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98a0101990 0x7f98a0196c40 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f98900036f0 tx=0x7f9890009580 comp rx=0 tx=0).stop 2023-10-19T12:41:44.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:44.274+0000 7f98a73ff700 1 -- 172.21.15.46:0/13840193 shutdown_connections 2023-10-19T12:41:44.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:44.274+0000 7f98a73ff700 1 --2- 172.21.15.46:0/13840193 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f98a0102330 0x7f98a019dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:44.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:44.274+0000 7f98a73ff700 1 --2- 172.21.15.46:0/13840193 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f988c0a1480 0x7f988c0a3940 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:44.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:44.274+0000 7f98a73ff700 1 --2- 172.21.15.46:0/13840193 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98a01007a0 0x7f98a0196700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:44.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:44.274+0000 7f98a73ff700 1 --2- 172.21.15.46:0/13840193 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98a0101990 0x7f98a0196c40 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:44.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:44.274+0000 7f98a73ff700 1 -- 172.21.15.46:0/13840193 >> 172.21.15.46:0/13840193 conn(0x7f98a00fbcf0 msgr2=0x7f98a0104d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:44.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:44.274+0000 7f98a73ff700 1 -- 172.21.15.46:0/13840193 shutdown_connections 2023-10-19T12:41:44.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:44.274+0000 7f98a73ff700 1 -- 172.21.15.46:0/13840193 wait complete. 2023-10-19T12:41:44.305 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2023-10-19T12:41:44.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:44.511+0000 7f7ce4fff700 1 -- 172.21.15.46:0/845491184 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ce0101990 msgr2=0x7f7ce0101df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:44.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:44.511+0000 7f7ce4fff700 1 --2- 172.21.15.46:0/845491184 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ce0101990 0x7f7ce0101df0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f7cd40099c0 tx=0x7f7cd4009cd0 comp rx=0 tx=0).stop 2023-10-19T12:41:44.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:44.511+0000 7f7ce4fff700 1 -- 172.21.15.46:0/845491184 shutdown_connections 2023-10-19T12:41:44.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:44.511+0000 7f7ce4fff700 1 --2- 172.21.15.46:0/845491184 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ce0102330 0x7f7ce0108be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:44.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:44.511+0000 7f7ce4fff700 1 --2- 172.21.15.46:0/845491184 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7ce01007a0 0x7f7ce0100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:44.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:44.511+0000 7f7ce4fff700 1 --2- 172.21.15.46:0/845491184 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ce0101990 0x7f7ce0101df0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:44.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:44.511+0000 7f7ce4fff700 1 -- 172.21.15.46:0/845491184 >> 172.21.15.46:0/845491184 conn(0x7f7ce00fbcf0 msgr2=0x7f7ce00fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:44.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:44.511+0000 7f7ce4fff700 1 -- 172.21.15.46:0/845491184 shutdown_connections 2023-10-19T12:41:44.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:44.511+0000 7f7ce4fff700 1 -- 172.21.15.46:0/845491184 wait complete. 2023-10-19T12:41:44.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:44.512+0000 7f7ce4fff700 1 Processor -- start 2023-10-19T12:41:44.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:44.513+0000 7f7ce4fff700 1 -- start start 2023-10-19T12:41:44.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:44.513+0000 7f7ce4fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ce01007a0 0x7f7ce0196700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:44.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:44.513+0000 7f7ce4fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ce0101990 0x7f7ce0196c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:44.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:44.513+0000 7f7ce4fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7ce0102330 0x7f7ce019dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:44.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:44.513+0000 7f7ce4fff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce019e230 con 0x7f7ce0101990 2023-10-19T12:41:44.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:44.513+0000 7f7ce4fff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce019e370 con 0x7f7ce01007a0 2023-10-19T12:41:44.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:44.513+0000 7f7ce4fff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce019e500 con 0x7f7ce0102330 2023-10-19T12:41:44.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:44.513+0000 7f7cddd9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ce0101990 0x7f7ce0196c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:44.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:44.513+0000 7f7cddd9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ce0101990 0x7f7ce0196c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56336/0 (socket says 172.21.15.46:56336) 2023-10-19T12:41:44.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:44.513+0000 7f7cddd9b700 1 -- 172.21.15.46:0/2646911375 learned_addr learned my addr 172.21.15.46:0/2646911375 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:41:44.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:44.513+0000 7f7cde59c700 1 --2- 172.21.15.46:0/2646911375 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ce01007a0 0x7f7ce0196700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:44.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:44.513+0000 7f7cded9d700 1 --2- 172.21.15.46:0/2646911375 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7ce0102330 0x7f7ce019dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:44.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:44.514+0000 7f7cddd9b700 1 -- 172.21.15.46:0/2646911375 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7ce0102330 msgr2=0x7f7ce019dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:44.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:44.514+0000 7f7cddd9b700 1 --2- 172.21.15.46:0/2646911375 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7ce0102330 0x7f7ce019dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:44.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:44.514+0000 7f7cddd9b700 1 -- 172.21.15.46:0/2646911375 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ce01007a0 msgr2=0x7f7ce0196700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:44.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:44.514+0000 7f7cddd9b700 1 --2- 172.21.15.46:0/2646911375 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ce01007a0 0x7f7ce0196700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:44.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:44.514+0000 7f7cddd9b700 1 -- 172.21.15.46:0/2646911375 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cd40095f0 con 0x7f7ce0101990 2023-10-19T12:41:44.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:44.514+0000 7f7cde59c700 1 --2- 172.21.15.46:0/2646911375 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ce01007a0 0x7f7ce0196700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:41:44.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:44.514+0000 7f7cddd9b700 1 --2- 172.21.15.46:0/2646911375 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ce0101990 0x7f7ce0196c40 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f7cd4006010 tx=0x7f7cd400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:44.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:44.514+0000 7f7ccf7fe700 1 -- 172.21.15.46:0/2646911375 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cd401d070 con 0x7f7ce0101990 2023-10-19T12:41:44.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:44.514+0000 7f7ccf7fe700 1 -- 172.21.15.46:0/2646911375 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7cd4005030 con 0x7f7ce0101990 2023-10-19T12:41:44.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:44.514+0000 7f7ce4fff700 1 -- 172.21.15.46:0/2646911375 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ce0072a20 con 0x7f7ce0101990 2023-10-19T12:41:44.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:44.514+0000 7f7ccf7fe700 1 -- 172.21.15.46:0/2646911375 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cd4004b10 con 0x7f7ce0101990 2023-10-19T12:41:44.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:44.514+0000 7f7ce4fff700 1 -- 172.21.15.46:0/2646911375 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ce0072ed0 con 0x7f7ce0101990 2023-10-19T12:41:44.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:44.515+0000 7f7ce4fff700 1 -- 172.21.15.46:0/2646911375 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ce0107c40 con 0x7f7ce0101990 2023-10-19T12:41:44.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:44.517+0000 7f7ccf7fe700 1 -- 172.21.15.46:0/2646911375 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f7cd40051a0 con 0x7f7ce0101990 2023-10-19T12:41:44.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:44.519+0000 7f7ccf7fe700 1 --2- 172.21.15.46:0/2646911375 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f7cc80a1480 0x7f7cc80a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:44.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:44.520+0000 7f7ccf7fe700 1 -- 172.21.15.46:0/2646911375 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f7cd40cdbe0 con 0x7f7ce0101990 2023-10-19T12:41:44.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:44.520+0000 7f7cde59c700 1 --2- 172.21.15.46:0/2646911375 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f7cc80a1480 0x7f7cc80a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:44.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:44.520+0000 7f7cde59c700 1 --2- 172.21.15.46:0/2646911375 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f7cc80a1480 0x7f7cc80a3940 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7ce01017f0 tx=0x7f7cd0009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:44.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:44.524+0000 7f7ccf7fe700 1 -- 172.21.15.46:0/2646911375 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7cd4097080 con 0x7f7ce0101990 2023-10-19T12:41:44.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:44.784+0000 7f7ce4fff700 1 -- 172.21.15.46:0/2646911375 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7f7ce00675a0 con 0x7f7ce0101990 2023-10-19T12:41:44.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:44 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/13840193' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-10-19T12:41:44.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:44 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/13840193' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-10-19T12:41:44.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:44 smithi046 ceph-mon[98509]: mds.? [v2:172.21.15.195:6838/4094901934,v1:172.21.15.195:6839/4094901934] up:active 2023-10-19T12:41:44.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:44 smithi046 ceph-mon[98509]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2023-10-19T12:41:44.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:44 smithi046 ceph-mon[98509]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2023-10-19T12:41:44.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:44 smithi046 ceph-mon[98509]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2023-10-19T12:41:44.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:44 smithi046 ceph-mon[98509]: daemon mds.c is now active in filesystem cephfs as rank 2 2023-10-19T12:41:45.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:44 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/13840193' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-10-19T12:41:45.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:44 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/13840193' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-10-19T12:41:45.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:44 smithi157 ceph-mon[134109]: mds.? [v2:172.21.15.195:6838/4094901934,v1:172.21.15.195:6839/4094901934] up:active 2023-10-19T12:41:45.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:44 smithi157 ceph-mon[134109]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2023-10-19T12:41:45.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:44 smithi157 ceph-mon[134109]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2023-10-19T12:41:45.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:44 smithi157 ceph-mon[134109]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2023-10-19T12:41:45.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:44 smithi157 ceph-mon[134109]: daemon mds.c is now active in filesystem cephfs as rank 2 2023-10-19T12:41:45.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:44 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/13840193' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-10-19T12:41:45.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:44 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/13840193' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-10-19T12:41:45.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:44 smithi195 ceph-mon[134493]: mds.? [v2:172.21.15.195:6838/4094901934,v1:172.21.15.195:6839/4094901934] up:active 2023-10-19T12:41:45.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:44 smithi195 ceph-mon[134493]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2023-10-19T12:41:45.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:44 smithi195 ceph-mon[134493]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2023-10-19T12:41:45.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:44 smithi195 ceph-mon[134493]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2023-10-19T12:41:45.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:44 smithi195 ceph-mon[134493]: daemon mds.c is now active in filesystem cephfs as rank 2 2023-10-19T12:41:45.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:45.282+0000 7f7ccf7fe700 1 -- 172.21.15.46:0/2646911375 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v22) v1 ==== 115+0+0 (secure 0 0 0) 0x7f7cd409a6a0 con 0x7f7ce0101990 2023-10-19T12:41:45.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:45.285+0000 7f7ce4fff700 1 -- 172.21.15.46:0/2646911375 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f7cc80a1480 msgr2=0x7f7cc80a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:45.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:45.285+0000 7f7ce4fff700 1 --2- 172.21.15.46:0/2646911375 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f7cc80a1480 0x7f7cc80a3940 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7ce01017f0 tx=0x7f7cd0009260 comp rx=0 tx=0).stop 2023-10-19T12:41:45.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:45.285+0000 7f7ce4fff700 1 -- 172.21.15.46:0/2646911375 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ce0101990 msgr2=0x7f7ce0196c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:45.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:45.285+0000 7f7ce4fff700 1 --2- 172.21.15.46:0/2646911375 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ce0101990 0x7f7ce0196c40 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f7cd4006010 tx=0x7f7cd400f690 comp rx=0 tx=0).stop 2023-10-19T12:41:45.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:45.285+0000 7f7ce4fff700 1 -- 172.21.15.46:0/2646911375 shutdown_connections 2023-10-19T12:41:45.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:45.285+0000 7f7ce4fff700 1 --2- 172.21.15.46:0/2646911375 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f7cc80a1480 0x7f7cc80a3940 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:45.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:45.285+0000 7f7ce4fff700 1 --2- 172.21.15.46:0/2646911375 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7ce0102330 0x7f7ce019dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:45.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:45.285+0000 7f7ce4fff700 1 --2- 172.21.15.46:0/2646911375 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ce01007a0 0x7f7ce0196700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:45.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:45.285+0000 7f7ce4fff700 1 --2- 172.21.15.46:0/2646911375 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ce0101990 0x7f7ce0196c40 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:45.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:45.285+0000 7f7ce4fff700 1 -- 172.21.15.46:0/2646911375 >> 172.21.15.46:0/2646911375 conn(0x7f7ce00fbcf0 msgr2=0x7f7ce0104d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:45.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:45.285+0000 7f7ce4fff700 1 -- 172.21.15.46:0/2646911375 shutdown_connections 2023-10-19T12:41:45.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:45.285+0000 7f7ce4fff700 1 -- 172.21.15.46:0/2646911375 wait complete. 2023-10-19T12:41:45.313 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated'} subvols for filesystem 'cephfs' 2023-10-19T12:41:45.313 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_0 '' 2023-10-19T12:41:45.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:45.520+0000 7fee2adff700 1 -- 172.21.15.46:0/642453557 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee241007a0 msgr2=0x7fee24100bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:45.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:45.520+0000 7fee2adff700 1 --2- 172.21.15.46:0/642453557 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee241007a0 0x7fee24100bc0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fee180099c0 tx=0x7fee18009cd0 comp rx=0 tx=0).stop 2023-10-19T12:41:45.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:45.520+0000 7fee2adff700 1 -- 172.21.15.46:0/642453557 shutdown_connections 2023-10-19T12:41:45.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:45.520+0000 7fee2adff700 1 --2- 172.21.15.46:0/642453557 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fee24102330 0x7fee24108be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:45.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:45.520+0000 7fee2adff700 1 --2- 172.21.15.46:0/642453557 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee241007a0 0x7fee24100bc0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:45.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:45.520+0000 7fee2adff700 1 --2- 172.21.15.46:0/642453557 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fee24101990 0x7fee24101df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:45.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:45.520+0000 7fee2adff700 1 -- 172.21.15.46:0/642453557 >> 172.21.15.46:0/642453557 conn(0x7fee240fbcf0 msgr2=0x7fee240fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:45.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:45.520+0000 7fee2adff700 1 -- 172.21.15.46:0/642453557 shutdown_connections 2023-10-19T12:41:45.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:45.520+0000 7fee2adff700 1 -- 172.21.15.46:0/642453557 wait complete. 2023-10-19T12:41:45.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:45.522+0000 7fee2adff700 1 Processor -- start 2023-10-19T12:41:45.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:45.522+0000 7fee2adff700 1 -- start start 2023-10-19T12:41:45.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:45.523+0000 7fee2adff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fee241007a0 0x7fee24198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:45.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:45.523+0000 7fee2adff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee24101990 0x7fee24198ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:45.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:45.523+0000 7fee2adff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fee24102330 0x7fee2419fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:45.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:45.523+0000 7fee2adff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee241a0490 con 0x7fee24101990 2023-10-19T12:41:45.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:45.523+0000 7fee2adff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee241a05d0 con 0x7fee241007a0 2023-10-19T12:41:45.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:45.523+0000 7fee2adff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee241a0760 con 0x7fee24102330 2023-10-19T12:41:45.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:45.523+0000 7fee23fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee24101990 0x7fee24198ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:45.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:45.523+0000 7fee23fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee24101990 0x7fee24198ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56358/0 (socket says 172.21.15.46:56358) 2023-10-19T12:41:45.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:45.523+0000 7fee23fff700 1 -- 172.21.15.46:0/1284732770 learned_addr learned my addr 172.21.15.46:0/1284732770 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:41:45.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:45.523+0000 7fee2939c700 1 --2- 172.21.15.46:0/1284732770 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fee24102330 0x7fee2419fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:45.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:45.523+0000 7fee28b9b700 1 --2- 172.21.15.46:0/1284732770 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fee241007a0 0x7fee24198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:45.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:45.523+0000 7fee23fff700 1 -- 172.21.15.46:0/1284732770 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fee24102330 msgr2=0x7fee2419fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:45.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:45.523+0000 7fee23fff700 1 --2- 172.21.15.46:0/1284732770 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fee24102330 0x7fee2419fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:45.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:45.523+0000 7fee23fff700 1 -- 172.21.15.46:0/1284732770 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fee241007a0 msgr2=0x7fee24198960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:45.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:45.523+0000 7fee23fff700 1 --2- 172.21.15.46:0/1284732770 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fee241007a0 0x7fee24198960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:45.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:45.523+0000 7fee23fff700 1 -- 172.21.15.46:0/1284732770 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee180095f0 con 0x7fee24101990 2023-10-19T12:41:45.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:45.524+0000 7fee23fff700 1 --2- 172.21.15.46:0/1284732770 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee24101990 0x7fee24198ea0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fee1000e9a0 tx=0x7fee1000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:45.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:45.524+0000 7fee21ffb700 1 -- 172.21.15.46:0/1284732770 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee10009790 con 0x7fee24101990 2023-10-19T12:41:45.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:45.524+0000 7fee21ffb700 1 -- 172.21.15.46:0/1284732770 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fee10010430 con 0x7fee24101990 2023-10-19T12:41:45.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:45.524+0000 7fee21ffb700 1 -- 172.21.15.46:0/1284732770 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee10018680 con 0x7fee24101990 2023-10-19T12:41:45.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:45.524+0000 7fee2adff700 1 -- 172.21.15.46:0/1284732770 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee241a0a40 con 0x7fee24101990 2023-10-19T12:41:45.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:45.524+0000 7fee2adff700 1 -- 172.21.15.46:0/1284732770 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee241a0f00 con 0x7fee24101990 2023-10-19T12:41:45.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:45.525+0000 7fee2adff700 1 -- 172.21.15.46:0/1284732770 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee240675a0 con 0x7fee24101990 2023-10-19T12:41:45.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:45.527+0000 7fee21ffb700 1 -- 172.21.15.46:0/1284732770 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fee100105a0 con 0x7fee24101990 2023-10-19T12:41:45.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:45.529+0000 7fee21ffb700 1 --2- 172.21.15.46:0/1284732770 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fee140a1500 0x7fee140a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:45.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:45.529+0000 7fee21ffb700 1 -- 172.21.15.46:0/1284732770 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fee10014070 con 0x7fee24101990 2023-10-19T12:41:45.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:45.529+0000 7fee28b9b700 1 --2- 172.21.15.46:0/1284732770 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fee140a1500 0x7fee140a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:45.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:45.530+0000 7fee28b9b700 1 --2- 172.21.15.46:0/1284732770 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fee140a1500 0x7fee140a39c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fee18003730 tx=0x7fee18000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:45.539 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:45.531+0000 7fee21ffb700 1 -- 172.21.15.46:0/1284732770 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fee10096750 con 0x7fee24101990 2023-10-19T12:41:45.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:45.776+0000 7fee2adff700 1 -- 172.21.15.46:0/1284732770 --> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}) v1 -- 0x7fee24074140 con 0x7fee140a1500 2023-10-19T12:41:45.979 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:41:45 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: 2023-10-19T12:41:45.783+0000 7ff427688700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-19T12:41:45.979 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:41:45 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: 2023-10-19T12:41:45.783+0000 7ff427688700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-19T12:41:45.980 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:41:45 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: 2023-10-19T12:41:45.783+0000 7ff427688700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-19T12:41:45.980 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:41:45 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: 2023-10-19T12:41:45.783+0000 7ff427688700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-19T12:41:45.980 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 12:41:45 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: 2023-10-19T12:41:45.783+0000 7ff427688700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-19T12:41:45.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:45 smithi046 ceph-mon[98509]: pgmap v297: 129 pgs: 129 active+clean; 581 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2023-10-19T12:41:45.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:45 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/2646911375' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-10-19T12:41:45.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:45 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/2646911375' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-10-19T12:41:45.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:45 smithi046 ceph-mon[98509]: mds.? [v2:172.21.15.195:6836/293916188,v1:172.21.15.195:6837/293916188] up:active 2023-10-19T12:41:45.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:45 smithi046 ceph-mon[98509]: daemon mds.f assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2023-10-19T12:41:45.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:45 smithi046 ceph-mon[98509]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2023-10-19T12:41:45.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:45 smithi046 ceph-mon[98509]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=f=up:creating} 8 up:standby 2023-10-19T12:41:45.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:45 smithi046 ceph-mon[98509]: daemon mds.f is now active in filesystem cephfs as rank 3 2023-10-19T12:41:46.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:45 smithi157 ceph-mon[134109]: pgmap v297: 129 pgs: 129 active+clean; 581 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2023-10-19T12:41:46.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:45 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/2646911375' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-10-19T12:41:46.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:45 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/2646911375' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-10-19T12:41:46.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:45 smithi157 ceph-mon[134109]: mds.? [v2:172.21.15.195:6836/293916188,v1:172.21.15.195:6837/293916188] up:active 2023-10-19T12:41:46.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:45 smithi157 ceph-mon[134109]: daemon mds.f assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2023-10-19T12:41:46.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:45 smithi157 ceph-mon[134109]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2023-10-19T12:41:46.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:45 smithi157 ceph-mon[134109]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=f=up:creating} 8 up:standby 2023-10-19T12:41:46.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:45 smithi157 ceph-mon[134109]: daemon mds.f is now active in filesystem cephfs as rank 3 2023-10-19T12:41:46.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:45 smithi195 ceph-mon[134493]: pgmap v297: 129 pgs: 129 active+clean; 581 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2023-10-19T12:41:46.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:45 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/2646911375' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-10-19T12:41:46.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:45 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/2646911375' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-10-19T12:41:46.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:45 smithi195 ceph-mon[134493]: mds.? [v2:172.21.15.195:6836/293916188,v1:172.21.15.195:6837/293916188] up:active 2023-10-19T12:41:46.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:45 smithi195 ceph-mon[134493]: daemon mds.f assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2023-10-19T12:41:46.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:45 smithi195 ceph-mon[134493]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2023-10-19T12:41:46.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:45 smithi195 ceph-mon[134493]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=f=up:creating} 8 up:standby 2023-10-19T12:41:46.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:45 smithi195 ceph-mon[134493]: daemon mds.f is now active in filesystem cephfs as rank 3 2023-10-19T12:41:46.336 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:46.333+0000 7fee21ffb700 1 -- 172.21.15.46:0/1284732770 <== mgr.14150 v2:172.21.15.46:6800/3168073651 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fee24074140 con 0x7fee140a1500 2023-10-19T12:41:46.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:46.335+0000 7fee2adff700 1 -- 172.21.15.46:0/1284732770 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fee140a1500 msgr2=0x7fee140a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:46.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:46.335+0000 7fee2adff700 1 --2- 172.21.15.46:0/1284732770 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fee140a1500 0x7fee140a39c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fee18003730 tx=0x7fee18000bc0 comp rx=0 tx=0).stop 2023-10-19T12:41:46.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:46.335+0000 7fee2adff700 1 -- 172.21.15.46:0/1284732770 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee24101990 msgr2=0x7fee24198ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:46.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:46.335+0000 7fee2adff700 1 --2- 172.21.15.46:0/1284732770 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee24101990 0x7fee24198ea0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fee1000e9a0 tx=0x7fee1000ecb0 comp rx=0 tx=0).stop 2023-10-19T12:41:46.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:46.335+0000 7fee2adff700 1 -- 172.21.15.46:0/1284732770 shutdown_connections 2023-10-19T12:41:46.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:46.335+0000 7fee2adff700 1 --2- 172.21.15.46:0/1284732770 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fee140a1500 0x7fee140a39c0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:46.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:46.335+0000 7fee2adff700 1 --2- 172.21.15.46:0/1284732770 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fee24102330 0x7fee2419fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:46.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:46.335+0000 7fee2adff700 1 --2- 172.21.15.46:0/1284732770 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fee241007a0 0x7fee24198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:46.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:46.335+0000 7fee2adff700 1 --2- 172.21.15.46:0/1284732770 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee24101990 0x7fee24198ea0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:46.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:46.335+0000 7fee2adff700 1 -- 172.21.15.46:0/1284732770 >> 172.21.15.46:0/1284732770 conn(0x7fee240fbcf0 msgr2=0x7fee24072a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:46.341 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:46.336+0000 7fee2adff700 1 -- 172.21.15.46:0/1284732770 shutdown_connections 2023-10-19T12:41:46.341 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:46.336+0000 7fee2adff700 1 -- 172.21.15.46:0/1284732770 wait complete. 2023-10-19T12:41:46.359 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv_0 2023-10-19T12:41:46.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:46.565+0000 7fc8533ff700 1 -- 172.21.15.46:0/2282202268 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc84c102330 msgr2=0x7fc84c108be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:46.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:46.565+0000 7fc8533ff700 1 --2- 172.21.15.46:0/2282202268 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc84c102330 0x7fc84c108be0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc84400b0d0 tx=0x7fc84400b3e0 comp rx=0 tx=0).stop 2023-10-19T12:41:46.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:46.565+0000 7fc8533ff700 1 -- 172.21.15.46:0/2282202268 shutdown_connections 2023-10-19T12:41:46.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:46.565+0000 7fc8533ff700 1 --2- 172.21.15.46:0/2282202268 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc84c102330 0x7fc84c108be0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:46.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:46.565+0000 7fc8533ff700 1 --2- 172.21.15.46:0/2282202268 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc84c1007a0 0x7fc84c100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:46.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:46.565+0000 7fc8533ff700 1 --2- 172.21.15.46:0/2282202268 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc84c101990 0x7fc84c101df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:46.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:46.565+0000 7fc8533ff700 1 -- 172.21.15.46:0/2282202268 >> 172.21.15.46:0/2282202268 conn(0x7fc84c0fbcf0 msgr2=0x7fc84c0fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:46.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:46.565+0000 7fc8533ff700 1 -- 172.21.15.46:0/2282202268 shutdown_connections 2023-10-19T12:41:46.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:46.565+0000 7fc8533ff700 1 -- 172.21.15.46:0/2282202268 wait complete. 2023-10-19T12:41:46.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:46.566+0000 7fc8533ff700 1 Processor -- start 2023-10-19T12:41:46.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:46.566+0000 7fc8533ff700 1 -- start start 2023-10-19T12:41:46.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:46.567+0000 7fc8533ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc84c1007a0 0x7fc84c074550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:46.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:46.567+0000 7fc8533ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc84c101990 0x7fc84c072be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:46.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:46.567+0000 7fc8533ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc84c102330 0x7fc84c073120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:46.574 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:46.567+0000 7fc8533ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc84c0738c0 con 0x7fc84c1007a0 2023-10-19T12:41:46.574 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:46.567+0000 7fc8533ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc84c073a30 con 0x7fc84c102330 2023-10-19T12:41:46.574 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:46.567+0000 7fc8533ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc84c1a0890 con 0x7fc84c101990 2023-10-19T12:41:46.574 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:46.567+0000 7fc85119b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc84c1007a0 0x7fc84c074550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:46.574 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:46.567+0000 7fc85119b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc84c1007a0 0x7fc84c074550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56402/0 (socket says 172.21.15.46:56402) 2023-10-19T12:41:46.575 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:46.567+0000 7fc85119b700 1 -- 172.21.15.46:0/1486693780 learned_addr learned my addr 172.21.15.46:0/1486693780 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:41:46.575 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:46.567+0000 7fc85099a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc84c101990 0x7fc84c072be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:46.575 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:46.567+0000 7fc85199c700 1 --2- 172.21.15.46:0/1486693780 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc84c102330 0x7fc84c073120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:46.575 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:46.567+0000 7fc85119b700 1 -- 172.21.15.46:0/1486693780 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc84c101990 msgr2=0x7fc84c072be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:46.575 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:46.567+0000 7fc85119b700 1 --2- 172.21.15.46:0/1486693780 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc84c101990 0x7fc84c072be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:46.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:46.567+0000 7fc85119b700 1 -- 172.21.15.46:0/1486693780 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc84c102330 msgr2=0x7fc84c073120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:46.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:46.567+0000 7fc85119b700 1 --2- 172.21.15.46:0/1486693780 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc84c102330 0x7fc84c073120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:46.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:46.567+0000 7fc85119b700 1 -- 172.21.15.46:0/1486693780 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc844009d00 con 0x7fc84c1007a0 2023-10-19T12:41:46.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:46.568+0000 7fc85119b700 1 --2- 172.21.15.46:0/1486693780 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc84c1007a0 0x7fc84c074550 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc84800e970 tx=0x7fc84800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:46.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:46.568+0000 7fc8427fc700 1 -- 172.21.15.46:0/1486693780 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc848009790 con 0x7fc84c1007a0 2023-10-19T12:41:46.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:46.568+0000 7fc8427fc700 1 -- 172.21.15.46:0/1486693780 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc84800c780 con 0x7fc84c1007a0 2023-10-19T12:41:46.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:46.568+0000 7fc8533ff700 1 -- 172.21.15.46:0/1486693780 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc84c1a0b20 con 0x7fc84c1007a0 2023-10-19T12:41:46.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:46.568+0000 7fc8427fc700 1 -- 172.21.15.46:0/1486693780 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc848003be0 con 0x7fc84c1007a0 2023-10-19T12:41:46.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:46.568+0000 7fc8533ff700 1 -- 172.21.15.46:0/1486693780 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc84c1a1030 con 0x7fc84c1007a0 2023-10-19T12:41:46.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:46.569+0000 7fc8533ff700 1 -- 172.21.15.46:0/1486693780 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc84c107b70 con 0x7fc84c1007a0 2023-10-19T12:41:46.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:46.571+0000 7fc8427fc700 1 -- 172.21.15.46:0/1486693780 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fc84800cbf0 con 0x7fc84c1007a0 2023-10-19T12:41:46.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:46.573+0000 7fc8427fc700 1 --2- 172.21.15.46:0/1486693780 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fc8380a1480 0x7fc8380a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:46.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:46.574+0000 7fc8427fc700 1 -- 172.21.15.46:0/1486693780 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fc848014070 con 0x7fc84c1007a0 2023-10-19T12:41:46.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:46.574+0000 7fc85099a700 1 --2- 172.21.15.46:0/1486693780 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fc8380a1480 0x7fc8380a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:46.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:46.574+0000 7fc85099a700 1 --2- 172.21.15.46:0/1486693780 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fc8380a1480 0x7fc8380a3940 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc83c007be0 tx=0x7fc83c0073d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:46.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:46.578+0000 7fc8427fc700 1 -- 172.21.15.46:0/1486693780 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc848096500 con 0x7fc84c1007a0 2023-10-19T12:41:46.828 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:46.825+0000 7fc8533ff700 1 -- 172.21.15.46:0/1486693780 --> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) v1 -- 0x7fc84c02d020 con 0x7fc8380a1480 2023-10-19T12:41:46.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:46.829+0000 7fc8427fc700 1 -- 172.21.15.46:0/1486693780 <== mgr.14150 v2:172.21.15.46:6800/3168073651 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+60 (secure 0 0 0) 0x7fc84c02d020 con 0x7fc8380a1480 2023-10-19T12:41:46.833 INFO:teuthology.orchestra.run.smithi046.stdout:/volumes/_nogroup/sv_0/e744fa0a-2114-4484-9415-778644d6a098 2023-10-19T12:41:46.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:46.831+0000 7fc8533ff700 1 -- 172.21.15.46:0/1486693780 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fc8380a1480 msgr2=0x7fc8380a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:46.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:46.831+0000 7fc8533ff700 1 --2- 172.21.15.46:0/1486693780 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fc8380a1480 0x7fc8380a3940 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc83c007be0 tx=0x7fc83c0073d0 comp rx=0 tx=0).stop 2023-10-19T12:41:46.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:46.832+0000 7fc8533ff700 1 -- 172.21.15.46:0/1486693780 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc84c1007a0 msgr2=0x7fc84c074550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:46.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:46.832+0000 7fc8533ff700 1 --2- 172.21.15.46:0/1486693780 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc84c1007a0 0x7fc84c074550 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc84800e970 tx=0x7fc84800ec80 comp rx=0 tx=0).stop 2023-10-19T12:41:46.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:46.832+0000 7fc8533ff700 1 -- 172.21.15.46:0/1486693780 shutdown_connections 2023-10-19T12:41:46.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:46.832+0000 7fc8533ff700 1 --2- 172.21.15.46:0/1486693780 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc84c102330 0x7fc84c073120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:46.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:46.832+0000 7fc8533ff700 1 --2- 172.21.15.46:0/1486693780 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc84c1007a0 0x7fc84c074550 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:46.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:46.832+0000 7fc8533ff700 1 --2- 172.21.15.46:0/1486693780 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fc8380a1480 0x7fc8380a3940 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:46.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:46.832+0000 7fc8533ff700 1 --2- 172.21.15.46:0/1486693780 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc84c101990 0x7fc84c072be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:46.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:46.832+0000 7fc8533ff700 1 -- 172.21.15.46:0/1486693780 >> 172.21.15.46:0/1486693780 conn(0x7fc84c0fbcf0 msgr2=0x7fc84c104cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:46.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:46.832+0000 7fc8533ff700 1 -- 172.21.15.46:0/1486693780 shutdown_connections 2023-10-19T12:41:46.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:46.832+0000 7fc8533ff700 1 -- 172.21.15.46:0/1486693780 wait complete. 2023-10-19T12:41:46.854 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_1 '' 2023-10-19T12:41:46.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:46 smithi046 ceph-mon[98509]: from='client.14901 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-10-19T12:41:46.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:46 smithi046 ceph-mon[98509]: mds.? [v2:172.21.15.195:6834/1406909915,v1:172.21.15.195:6835/1406909915] up:active 2023-10-19T12:41:46.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:46 smithi046 ceph-mon[98509]: daemon mds.h assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2023-10-19T12:41:46.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:46 smithi046 ceph-mon[98509]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-10-19T12:41:46.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:46 smithi046 ceph-mon[98509]: Cluster is now healthy 2023-10-19T12:41:46.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:46 smithi046 ceph-mon[98509]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=f=up:active} 8 up:standby 2023-10-19T12:41:46.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:46 smithi046 ceph-mon[98509]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2023-10-19T12:41:46.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:46 smithi046 ceph-mon[98509]: daemon mds.h is now active in filesystem cephfs as rank 4 2023-10-19T12:41:47.064 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.061+0000 7feb203ff700 1 -- 172.21.15.46:0/3746323583 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feb18101990 msgr2=0x7feb18101df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:47.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.061+0000 7feb203ff700 1 --2- 172.21.15.46:0/3746323583 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feb18101990 0x7feb18101df0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7feb080099c0 tx=0x7feb08009cd0 comp rx=0 tx=0).stop 2023-10-19T12:41:47.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.061+0000 7feb203ff700 1 -- 172.21.15.46:0/3746323583 shutdown_connections 2023-10-19T12:41:47.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.061+0000 7feb203ff700 1 --2- 172.21.15.46:0/3746323583 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb18102330 0x7feb18108be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:47.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.061+0000 7feb203ff700 1 --2- 172.21.15.46:0/3746323583 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb181007a0 0x7feb18100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:47.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.061+0000 7feb203ff700 1 --2- 172.21.15.46:0/3746323583 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feb18101990 0x7feb18101df0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:47.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.061+0000 7feb203ff700 1 -- 172.21.15.46:0/3746323583 >> 172.21.15.46:0/3746323583 conn(0x7feb180fbcf0 msgr2=0x7feb180fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:47.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.061+0000 7feb203ff700 1 -- 172.21.15.46:0/3746323583 shutdown_connections 2023-10-19T12:41:47.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.061+0000 7feb203ff700 1 -- 172.21.15.46:0/3746323583 wait complete. 2023-10-19T12:41:47.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.062+0000 7feb203ff700 1 Processor -- start 2023-10-19T12:41:47.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.062+0000 7feb203ff700 1 -- start start 2023-10-19T12:41:47.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.062+0000 7feb203ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb181007a0 0x7feb181988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:47.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.062+0000 7feb203ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb18101990 0x7feb18198e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:47.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.063+0000 7feb203ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feb18102330 0x7feb1819fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:47.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.063+0000 7feb203ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb181a0420 con 0x7feb18102330 2023-10-19T12:41:47.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.063+0000 7feb203ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb181a0560 con 0x7feb18101990 2023-10-19T12:41:47.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.063+0000 7feb203ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb181a06f0 con 0x7feb181007a0 2023-10-19T12:41:47.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.063+0000 7feb1e99c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feb18102330 0x7feb1819fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:47.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.063+0000 7feb1e99c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feb18102330 0x7feb1819fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56430/0 (socket says 172.21.15.46:56430) 2023-10-19T12:41:47.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.063+0000 7feb1d99a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb18101990 0x7feb18198e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:47.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.063+0000 7feb1e99c700 1 -- 172.21.15.46:0/3008821719 learned_addr learned my addr 172.21.15.46:0/3008821719 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:41:47.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.063+0000 7feb1e19b700 1 --2- 172.21.15.46:0/3008821719 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb181007a0 0x7feb181988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:47.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.063+0000 7feb1e99c700 1 -- 172.21.15.46:0/3008821719 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb181007a0 msgr2=0x7feb181988f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:47.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.063+0000 7feb1e99c700 1 --2- 172.21.15.46:0/3008821719 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb181007a0 0x7feb181988f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:47.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.063+0000 7feb1e99c700 1 -- 172.21.15.46:0/3008821719 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb18101990 msgr2=0x7feb18198e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:47.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.063+0000 7feb1e99c700 1 --2- 172.21.15.46:0/3008821719 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb18101990 0x7feb18198e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:47.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.063+0000 7feb1e99c700 1 -- 172.21.15.46:0/3008821719 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb080095f0 con 0x7feb18102330 2023-10-19T12:41:47.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.064+0000 7feb1e99c700 1 --2- 172.21.15.46:0/3008821719 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feb18102330 0x7feb1819fe50 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7feb1000ef30 tx=0x7feb1000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:47.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.064+0000 7feb0f7fe700 1 -- 172.21.15.46:0/3008821719 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb10018070 con 0x7feb18102330 2023-10-19T12:41:47.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.064+0000 7feb0f7fe700 1 -- 172.21.15.46:0/3008821719 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7feb1000f040 con 0x7feb18102330 2023-10-19T12:41:47.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.064+0000 7feb203ff700 1 -- 172.21.15.46:0/3008821719 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb181a0970 con 0x7feb18102330 2023-10-19T12:41:47.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.064+0000 7feb0f7fe700 1 -- 172.21.15.46:0/3008821719 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb1000cd00 con 0x7feb18102330 2023-10-19T12:41:47.073 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.064+0000 7feb203ff700 1 -- 172.21.15.46:0/3008821719 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb181a0e30 con 0x7feb18102330 2023-10-19T12:41:47.073 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.065+0000 7feb203ff700 1 -- 172.21.15.46:0/3008821719 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb180675a0 con 0x7feb18102330 2023-10-19T12:41:47.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.067+0000 7feb0f7fe700 1 -- 172.21.15.46:0/3008821719 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7feb10003a00 con 0x7feb18102330 2023-10-19T12:41:47.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.068+0000 7feb0f7fe700 1 --2- 172.21.15.46:0/3008821719 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7feb040a1480 0x7feb040a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:47.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.068+0000 7feb0f7fe700 1 -- 172.21.15.46:0/3008821719 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7feb100ccac0 con 0x7feb18102330 2023-10-19T12:41:47.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.069+0000 7feb1e19b700 1 --2- 172.21.15.46:0/3008821719 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7feb040a1480 0x7feb040a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:47.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.069+0000 7feb1e19b700 1 --2- 172.21.15.46:0/3008821719 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7feb040a1480 0x7feb040a3940 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7feb181017f0 tx=0x7feb14009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:47.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.073+0000 7feb0f7fe700 1 -- 172.21.15.46:0/3008821719 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7feb10095f60 con 0x7feb18102330 2023-10-19T12:41:47.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:46 smithi157 ceph-mon[134109]: from='client.14901 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-10-19T12:41:47.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:46 smithi157 ceph-mon[134109]: mds.? [v2:172.21.15.195:6834/1406909915,v1:172.21.15.195:6835/1406909915] up:active 2023-10-19T12:41:47.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:46 smithi157 ceph-mon[134109]: daemon mds.h assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2023-10-19T12:41:47.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:46 smithi157 ceph-mon[134109]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-10-19T12:41:47.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:46 smithi157 ceph-mon[134109]: Cluster is now healthy 2023-10-19T12:41:47.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:46 smithi157 ceph-mon[134109]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=f=up:active} 8 up:standby 2023-10-19T12:41:47.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:46 smithi157 ceph-mon[134109]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2023-10-19T12:41:47.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:46 smithi157 ceph-mon[134109]: daemon mds.h is now active in filesystem cephfs as rank 4 2023-10-19T12:41:47.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:46 smithi195 ceph-mon[134493]: from='client.14901 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-10-19T12:41:47.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:46 smithi195 ceph-mon[134493]: mds.? [v2:172.21.15.195:6834/1406909915,v1:172.21.15.195:6835/1406909915] up:active 2023-10-19T12:41:47.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:46 smithi195 ceph-mon[134493]: daemon mds.h assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2023-10-19T12:41:47.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:46 smithi195 ceph-mon[134493]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-10-19T12:41:47.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:46 smithi195 ceph-mon[134493]: Cluster is now healthy 2023-10-19T12:41:47.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:46 smithi195 ceph-mon[134493]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=f=up:active} 8 up:standby 2023-10-19T12:41:47.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:46 smithi195 ceph-mon[134493]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2023-10-19T12:41:47.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:46 smithi195 ceph-mon[134493]: daemon mds.h is now active in filesystem cephfs as rank 4 2023-10-19T12:41:47.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.324+0000 7feb203ff700 1 -- 172.21.15.46:0/3008821719 --> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}) v1 -- 0x7feb18074140 con 0x7feb040a1480 2023-10-19T12:41:47.351 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.349+0000 7feb0f7fe700 1 -- 172.21.15.46:0/3008821719 <== mgr.14150 v2:172.21.15.46:6800/3168073651 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7feb18074140 con 0x7feb040a1480 2023-10-19T12:41:47.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.351+0000 7feb203ff700 1 -- 172.21.15.46:0/3008821719 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7feb040a1480 msgr2=0x7feb040a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:47.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.351+0000 7feb203ff700 1 --2- 172.21.15.46:0/3008821719 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7feb040a1480 0x7feb040a3940 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7feb181017f0 tx=0x7feb14009260 comp rx=0 tx=0).stop 2023-10-19T12:41:47.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.351+0000 7feb203ff700 1 -- 172.21.15.46:0/3008821719 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feb18102330 msgr2=0x7feb1819fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:47.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.351+0000 7feb203ff700 1 --2- 172.21.15.46:0/3008821719 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feb18102330 0x7feb1819fe50 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7feb1000ef30 tx=0x7feb1000c3a0 comp rx=0 tx=0).stop 2023-10-19T12:41:47.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.351+0000 7feb203ff700 1 -- 172.21.15.46:0/3008821719 shutdown_connections 2023-10-19T12:41:47.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.351+0000 7feb203ff700 1 --2- 172.21.15.46:0/3008821719 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feb18102330 0x7feb1819fe50 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:47.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.351+0000 7feb203ff700 1 --2- 172.21.15.46:0/3008821719 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7feb040a1480 0x7feb040a3940 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:47.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.351+0000 7feb203ff700 1 --2- 172.21.15.46:0/3008821719 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb181007a0 0x7feb181988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:47.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.351+0000 7feb203ff700 1 --2- 172.21.15.46:0/3008821719 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb18101990 0x7feb18198e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:47.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.351+0000 7feb203ff700 1 -- 172.21.15.46:0/3008821719 >> 172.21.15.46:0/3008821719 conn(0x7feb180fbcf0 msgr2=0x7feb18072a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:47.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.351+0000 7feb203ff700 1 -- 172.21.15.46:0/3008821719 shutdown_connections 2023-10-19T12:41:47.357 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.351+0000 7feb203ff700 1 -- 172.21.15.46:0/3008821719 wait complete. 2023-10-19T12:41:47.374 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv_1 2023-10-19T12:41:47.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.581+0000 7f4ef85ff700 1 -- 172.21.15.46:0/2062870505 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ef0102330 msgr2=0x7f4ef0108be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:47.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.581+0000 7f4ef85ff700 1 --2- 172.21.15.46:0/2062870505 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ef0102330 0x7f4ef0108be0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4ee8009fc0 tx=0x7f4ee800b330 comp rx=0 tx=0).stop 2023-10-19T12:41:47.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.581+0000 7f4ef85ff700 1 -- 172.21.15.46:0/2062870505 shutdown_connections 2023-10-19T12:41:47.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.581+0000 7f4ef85ff700 1 --2- 172.21.15.46:0/2062870505 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ef0102330 0x7f4ef0108be0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:47.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.581+0000 7f4ef85ff700 1 --2- 172.21.15.46:0/2062870505 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4ef01007a0 0x7f4ef0100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:47.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.581+0000 7f4ef85ff700 1 --2- 172.21.15.46:0/2062870505 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ef0101990 0x7f4ef0101df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:47.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.581+0000 7f4ef85ff700 1 -- 172.21.15.46:0/2062870505 >> 172.21.15.46:0/2062870505 conn(0x7f4ef00fbcf0 msgr2=0x7f4ef00fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:47.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.581+0000 7f4ef85ff700 1 -- 172.21.15.46:0/2062870505 shutdown_connections 2023-10-19T12:41:47.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.581+0000 7f4ef85ff700 1 -- 172.21.15.46:0/2062870505 wait complete. 2023-10-19T12:41:47.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.582+0000 7f4ef85ff700 1 Processor -- start 2023-10-19T12:41:47.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.582+0000 7f4ef85ff700 1 -- start start 2023-10-19T12:41:47.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.583+0000 7f4ef85ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ef01007a0 0x7f4ef0196830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:47.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.583+0000 7f4ef85ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4ef0101990 0x7f4ef0196d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:47.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.583+0000 7f4ef85ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ef0102330 0x7f4ef019dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:47.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.583+0000 7f4ef85ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef019e360 con 0x7f4ef0102330 2023-10-19T12:41:47.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.583+0000 7f4ef85ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef019e4a0 con 0x7f4ef0101990 2023-10-19T12:41:47.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.583+0000 7f4ef85ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef019e630 con 0x7f4ef01007a0 2023-10-19T12:41:47.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.583+0000 7f4ef6b9c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ef0102330 0x7f4ef019dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:47.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.583+0000 7f4ef6b9c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ef0102330 0x7f4ef019dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56450/0 (socket says 172.21.15.46:56450) 2023-10-19T12:41:47.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.583+0000 7f4ef6b9c700 1 -- 172.21.15.46:0/666449937 learned_addr learned my addr 172.21.15.46:0/666449937 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:41:47.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.583+0000 7f4ef639b700 1 --2- 172.21.15.46:0/666449937 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ef01007a0 0x7f4ef0196830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:47.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.583+0000 7f4ef5b9a700 1 --2- 172.21.15.46:0/666449937 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4ef0101990 0x7f4ef0196d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:47.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.583+0000 7f4ef6b9c700 1 -- 172.21.15.46:0/666449937 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ef01007a0 msgr2=0x7f4ef0196830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:47.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.583+0000 7f4ef6b9c700 1 --2- 172.21.15.46:0/666449937 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ef01007a0 0x7f4ef0196830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:47.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.583+0000 7f4ef6b9c700 1 -- 172.21.15.46:0/666449937 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4ef0101990 msgr2=0x7f4ef0196d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:47.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.584+0000 7f4ef6b9c700 1 --2- 172.21.15.46:0/666449937 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4ef0101990 0x7f4ef0196d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:47.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.584+0000 7f4ef6b9c700 1 -- 172.21.15.46:0/666449937 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ee8009c40 con 0x7f4ef0102330 2023-10-19T12:41:47.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.584+0000 7f4ef6b9c700 1 --2- 172.21.15.46:0/666449937 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ef0102330 0x7f4ef019dd90 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f4ee8008fd0 tx=0x7f4ee8009000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:47.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.584+0000 7f4ee77fe700 1 -- 172.21.15.46:0/666449937 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee800e040 con 0x7f4ef0102330 2023-10-19T12:41:47.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.584+0000 7f4ee77fe700 1 -- 172.21.15.46:0/666449937 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4ee800bbf0 con 0x7f4ef0102330 2023-10-19T12:41:47.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.584+0000 7f4ef85ff700 1 -- 172.21.15.46:0/666449937 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ef019e8b0 con 0x7f4ef0102330 2023-10-19T12:41:47.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.584+0000 7f4ee77fe700 1 -- 172.21.15.46:0/666449937 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee80052a0 con 0x7f4ef0102330 2023-10-19T12:41:47.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.584+0000 7f4ef85ff700 1 -- 172.21.15.46:0/666449937 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ef019ed80 con 0x7f4ef0102330 2023-10-19T12:41:47.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.585+0000 7f4ef85ff700 1 -- 172.21.15.46:0/666449937 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ef0107b70 con 0x7f4ef0102330 2023-10-19T12:41:47.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.587+0000 7f4ee77fe700 1 -- 172.21.15.46:0/666449937 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f4ee801d470 con 0x7f4ef0102330 2023-10-19T12:41:47.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.589+0000 7f4ee77fe700 1 --2- 172.21.15.46:0/666449937 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f4edc0a1500 0x7f4edc0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:47.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.590+0000 7f4ee77fe700 1 -- 172.21.15.46:0/666449937 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f4ee80ce320 con 0x7f4ef0102330 2023-10-19T12:41:47.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.590+0000 7f4ef639b700 1 --2- 172.21.15.46:0/666449937 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f4edc0a1500 0x7f4edc0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:47.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.590+0000 7f4ef639b700 1 --2- 172.21.15.46:0/666449937 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f4edc0a1500 0x7f4edc0a39c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4ef01017f0 tx=0x7f4eec009310 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:47.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.594+0000 7f4ee77fe700 1 -- 172.21.15.46:0/666449937 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f4ee80977c0 con 0x7f4ef0102330 2023-10-19T12:41:47.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.738+0000 7f4ee77fe700 1 -- 172.21.15.46:0/666449937 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f4ee8097b90 con 0x7f4ef0102330 2023-10-19T12:41:47.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.848+0000 7f4ef85ff700 1 -- 172.21.15.46:0/666449937 --> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f4ef0060c30 con 0x7f4edc0a1500 2023-10-19T12:41:47.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.853+0000 7f4ee77fe700 1 -- 172.21.15.46:0/666449937 <== mgr.14150 v2:172.21.15.46:6800/3168073651 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+60 (secure 0 0 0) 0x7f4ef0060c30 con 0x7f4edc0a1500 2023-10-19T12:41:47.856 INFO:teuthology.orchestra.run.smithi046.stdout:/volumes/_nogroup/sv_1/6e0973be-51e9-4268-9cb0-a3e0d00ea81e 2023-10-19T12:41:47.858 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.855+0000 7f4ef85ff700 1 -- 172.21.15.46:0/666449937 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f4edc0a1500 msgr2=0x7f4edc0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:47.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.855+0000 7f4ef85ff700 1 --2- 172.21.15.46:0/666449937 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f4edc0a1500 0x7f4edc0a39c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4ef01017f0 tx=0x7f4eec009310 comp rx=0 tx=0).stop 2023-10-19T12:41:47.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.855+0000 7f4ef85ff700 1 -- 172.21.15.46:0/666449937 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ef0102330 msgr2=0x7f4ef019dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:47.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.855+0000 7f4ef85ff700 1 --2- 172.21.15.46:0/666449937 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ef0102330 0x7f4ef019dd90 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f4ee8008fd0 tx=0x7f4ee8009000 comp rx=0 tx=0).stop 2023-10-19T12:41:47.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.855+0000 7f4ef85ff700 1 -- 172.21.15.46:0/666449937 shutdown_connections 2023-10-19T12:41:47.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.855+0000 7f4ef85ff700 1 --2- 172.21.15.46:0/666449937 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ef0102330 0x7f4ef019dd90 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:47.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.855+0000 7f4ef85ff700 1 --2- 172.21.15.46:0/666449937 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f4edc0a1500 0x7f4edc0a39c0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:47.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.855+0000 7f4ef85ff700 1 --2- 172.21.15.46:0/666449937 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ef01007a0 0x7f4ef0196830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:47.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.855+0000 7f4ef85ff700 1 --2- 172.21.15.46:0/666449937 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4ef0101990 0x7f4ef0196d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:47.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.855+0000 7f4ef85ff700 1 -- 172.21.15.46:0/666449937 >> 172.21.15.46:0/666449937 conn(0x7f4ef00fbcf0 msgr2=0x7f4ef0104cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:47.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.855+0000 7f4ef85ff700 1 -- 172.21.15.46:0/666449937 shutdown_connections 2023-10-19T12:41:47.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:47.855+0000 7f4ef85ff700 1 -- 172.21.15.46:0/666449937 wait complete. 2023-10-19T12:41:47.878 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-19T12:41:47.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:47 smithi046 ceph-mon[98509]: pgmap v298: 129 pgs: 129 active+clean; 584 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s wr, 5 op/s 2023-10-19T12:41:47.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:47 smithi046 ceph-mon[98509]: mds.? [v2:172.21.15.157:6836/2629536514,v1:172.21.15.157:6837/2629536514] up:active 2023-10-19T12:41:47.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:47 smithi046 ceph-mon[98509]: fsmap cephfs:5 7 up:standby 5 up:active 2023-10-19T12:41:47.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:47 smithi046 ceph-mon[98509]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-19T12:41:48.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.082+0000 7f831c7ff700 1 -- 172.21.15.46:0/3712007444 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8314100740 msgr2=0x7f8314100b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:48.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.082+0000 7f831c7ff700 1 --2- 172.21.15.46:0/3712007444 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8314100740 0x7f8314100b60 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f83100099c0 tx=0x7f8310009cd0 comp rx=0 tx=0).stop 2023-10-19T12:41:48.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.082+0000 7f831c7ff700 1 -- 172.21.15.46:0/3712007444 shutdown_connections 2023-10-19T12:41:48.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.082+0000 7f831c7ff700 1 --2- 172.21.15.46:0/3712007444 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f83141022d0 0x7f8314108b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:48.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.082+0000 7f831c7ff700 1 --2- 172.21.15.46:0/3712007444 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8314100740 0x7f8314100b60 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:48.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.082+0000 7f831c7ff700 1 --2- 172.21.15.46:0/3712007444 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8314101930 0x7f8314101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:48.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.082+0000 7f831c7ff700 1 -- 172.21.15.46:0/3712007444 >> 172.21.15.46:0/3712007444 conn(0x7f83140fbc90 msgr2=0x7f83140fe0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:48.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.082+0000 7f831c7ff700 1 -- 172.21.15.46:0/3712007444 shutdown_connections 2023-10-19T12:41:48.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.082+0000 7f831c7ff700 1 -- 172.21.15.46:0/3712007444 wait complete. 2023-10-19T12:41:48.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:47 smithi157 ceph-mon[134109]: pgmap v298: 129 pgs: 129 active+clean; 584 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s wr, 5 op/s 2023-10-19T12:41:48.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:47 smithi157 ceph-mon[134109]: mds.? [v2:172.21.15.157:6836/2629536514,v1:172.21.15.157:6837/2629536514] up:active 2023-10-19T12:41:48.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:47 smithi157 ceph-mon[134109]: fsmap cephfs:5 7 up:standby 5 up:active 2023-10-19T12:41:48.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:47 smithi157 ceph-mon[134109]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-19T12:41:48.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.083+0000 7f831c7ff700 1 Processor -- start 2023-10-19T12:41:48.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.083+0000 7f831c7ff700 1 -- start start 2023-10-19T12:41:48.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.083+0000 7f831c7ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8314100740 0x7f8314198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:48.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.083+0000 7f831c7ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8314101930 0x7f8314198e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:48.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.084+0000 7f831c7ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f83141022d0 0x7f831419fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:48.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.084+0000 7f831c7ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83141a0450 con 0x7f83141022d0 2023-10-19T12:41:48.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.084+0000 7f831c7ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83141a0590 con 0x7f8314101930 2023-10-19T12:41:48.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.084+0000 7f831c7ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83141a0720 con 0x7f8314100740 2023-10-19T12:41:48.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.084+0000 7f831ad9c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f83141022d0 0x7f831419fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:48.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.084+0000 7f831a59b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8314100740 0x7f8314198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:48.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.084+0000 7f831ad9c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f83141022d0 0x7f831419fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56480/0 (socket says 172.21.15.46:56480) 2023-10-19T12:41:48.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.084+0000 7f831a59b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8314100740 0x7f8314198920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:48144/0 (socket says 172.21.15.46:48144) 2023-10-19T12:41:48.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.084+0000 7f831ad9c700 1 -- 172.21.15.46:0/2862268936 learned_addr learned my addr 172.21.15.46:0/2862268936 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:41:48.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.084+0000 7f8319d9a700 1 --2- 172.21.15.46:0/2862268936 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8314101930 0x7f8314198e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:48.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.084+0000 7f831a59b700 1 -- 172.21.15.46:0/2862268936 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8314101930 msgr2=0x7f8314198e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:48.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.084+0000 7f831a59b700 1 --2- 172.21.15.46:0/2862268936 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8314101930 0x7f8314198e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:48.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.084+0000 7f831a59b700 1 -- 172.21.15.46:0/2862268936 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f83141022d0 msgr2=0x7f831419fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:48.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.084+0000 7f831a59b700 1 --2- 172.21.15.46:0/2862268936 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f83141022d0 0x7f831419fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:48.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.084+0000 7f831a59b700 1 -- 172.21.15.46:0/2862268936 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83100095f0 con 0x7f8314100740 2023-10-19T12:41:48.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.084+0000 7f831ad9c700 1 --2- 172.21.15.46:0/2862268936 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f83141022d0 0x7f831419fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:41:48.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.085+0000 7f831a59b700 1 --2- 172.21.15.46:0/2862268936 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8314100740 0x7f8314198920 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f83100098e0 tx=0x7f831000fa00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:48.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.085+0000 7f830b7fe700 1 -- 172.21.15.46:0/2862268936 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831001d070 con 0x7f8314100740 2023-10-19T12:41:48.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.085+0000 7f831c7ff700 1 -- 172.21.15.46:0/2862268936 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83141a09a0 con 0x7f8314100740 2023-10-19T12:41:48.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.085+0000 7f830b7fe700 1 -- 172.21.15.46:0/2862268936 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f831000bda0 con 0x7f8314100740 2023-10-19T12:41:48.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.085+0000 7f830b7fe700 1 -- 172.21.15.46:0/2862268936 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8310004a90 con 0x7f8314100740 2023-10-19T12:41:48.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.085+0000 7f831c7ff700 1 -- 172.21.15.46:0/2862268936 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83141a0e20 con 0x7f8314100740 2023-10-19T12:41:48.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.086+0000 7f831c7ff700 1 -- 172.21.15.46:0/2862268936 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8314067530 con 0x7f8314100740 2023-10-19T12:41:48.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.088+0000 7f830b7fe700 1 -- 172.21.15.46:0/2862268936 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f8310004bf0 con 0x7f8314100740 2023-10-19T12:41:48.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.089+0000 7f830b7fe700 1 --2- 172.21.15.46:0/2862268936 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f83000a1510 0x7f83000a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:48.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.089+0000 7f830b7fe700 1 -- 172.21.15.46:0/2862268936 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f83100ce0b0 con 0x7f8314100740 2023-10-19T12:41:48.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.090+0000 7f8319d9a700 1 --2- 172.21.15.46:0/2862268936 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f83000a1510 0x7f83000a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:48.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.090+0000 7f8319d9a700 1 --2- 172.21.15.46:0/2862268936 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f83000a1510 0x7f83000a39d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8304009c60 tx=0x7f8304009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:48.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.092+0000 7f830b7fe700 1 -- 172.21.15.46:0/2862268936 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f83100973f0 con 0x7f8314100740 2023-10-19T12:41:48.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:47 smithi195 ceph-mon[134493]: pgmap v298: 129 pgs: 129 active+clean; 584 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s wr, 5 op/s 2023-10-19T12:41:48.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:47 smithi195 ceph-mon[134493]: mds.? [v2:172.21.15.157:6836/2629536514,v1:172.21.15.157:6837/2629536514] up:active 2023-10-19T12:41:48.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:47 smithi195 ceph-mon[134493]: fsmap cephfs:5 7 up:standby 5 up:active 2023-10-19T12:41:48.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:47 smithi195 ceph-mon[134493]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-19T12:41:48.351 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.348+0000 7f831c7ff700 1 -- 172.21.15.46:0/2862268936 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f831410c0a0 con 0x7f8314100740 2023-10-19T12:41:48.352 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.349+0000 7f830b7fe700 1 -- 172.21.15.46:0/2862268936 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+11372 (secure 0 0 0) 0x7f831009aa10 con 0x7f8314100740 2023-10-19T12:41:48.353 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:41:48.353 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14580,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/2235286008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":2235286008},{"type":"v1","addr":"172.21.15.46:6835","nonce":2235286008}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14592,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/339398444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":339398444},{"type":"v1","addr":"172.21.15.46:6837","nonce":339398444}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-19T12:41:18.815780+0000","modified":"2023-10-19T12:41:47.301944+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24680,"mds_1":24655,"mds_2":24643,"mds_3":24631,"mds_4":24629},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14640":{"gid":14640,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.46:6839/1655843965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":1655843965},{"type":"v1","addr":"172.21.15.46:6839","nonce":1655843965}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14652":{"gid":14652,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.46:6841/4204925553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6840","nonce":4204925553},{"type":"v1","addr":"172.21.15.46:6841","nonce":4204925553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24560":{"gid":24560,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.157:6833/1687745569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":1687745569},{"type":"v1","addr":"172.21.15.157:6833","nonce":1687745569}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24574":{"gid":24574,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.195:6833/3629933235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3629933235},{"type":"v1","addr":"172.21.15.195:6833","nonce":3629933235}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24602":{"gid":24602,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.157:6835/108432552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":108432552},{"type":"v1","addr":"172.21.15.157:6835","nonce":108432552}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24629":{"gid":24629,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":13,"addr":"172.21.15.157:6837/2629536514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6836","nonce":2629536514},{"type":"v1","addr":"172.21.15.157:6837","nonce":2629536514}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24631":{"gid":24631,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.195:6835/1406909915","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":1406909915},{"type":"v1","addr":"172.21.15.195:6835","nonce":1406909915}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24643":{"gid":24643,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":13,"addr":"172.21.15.195:6837/293916188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":293916188},{"type":"v1","addr":"172.21.15.195:6837","nonce":293916188}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24655":{"gid":24655,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":11,"addr":"172.21.15.195:6839/4094901934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6838","nonce":4094901934},{"type":"v1","addr":"172.21.15.195:6839","nonce":4094901934}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24680":{"gid":24680,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.157:6839/552718978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6838","nonce":552718978},{"type":"v1","addr":"172.21.15.157:6839","nonce":552718978}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-19T12:41:48.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.352+0000 7f831c7ff700 1 -- 172.21.15.46:0/2862268936 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f83000a1510 msgr2=0x7f83000a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:48.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.352+0000 7f831c7ff700 1 --2- 172.21.15.46:0/2862268936 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f83000a1510 0x7f83000a39d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8304009c60 tx=0x7f8304009260 comp rx=0 tx=0).stop 2023-10-19T12:41:48.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.352+0000 7f831c7ff700 1 -- 172.21.15.46:0/2862268936 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8314100740 msgr2=0x7f8314198920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:48.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.352+0000 7f831c7ff700 1 --2- 172.21.15.46:0/2862268936 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8314100740 0x7f8314198920 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f83100098e0 tx=0x7f831000fa00 comp rx=0 tx=0).stop 2023-10-19T12:41:48.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.352+0000 7f831c7ff700 1 -- 172.21.15.46:0/2862268936 shutdown_connections 2023-10-19T12:41:48.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.352+0000 7f831c7ff700 1 --2- 172.21.15.46:0/2862268936 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f83141022d0 0x7f831419fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:48.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.352+0000 7f831c7ff700 1 --2- 172.21.15.46:0/2862268936 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f83000a1510 0x7f83000a39d0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:48.357 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.352+0000 7f831c7ff700 1 --2- 172.21.15.46:0/2862268936 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8314100740 0x7f8314198920 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:48.357 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.352+0000 7f831c7ff700 1 --2- 172.21.15.46:0/2862268936 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8314101930 0x7f8314198e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:48.357 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.352+0000 7f831c7ff700 1 -- 172.21.15.46:0/2862268936 >> 172.21.15.46:0/2862268936 conn(0x7f83140fbc90 msgr2=0x7f8314107150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:48.357 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.352+0000 7f831c7ff700 1 -- 172.21.15.46:0/2862268936 shutdown_connections 2023-10-19T12:41:48.357 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.352+0000 7f831c7ff700 1 -- 172.21.15.46:0/2862268936 wait complete. 2023-10-19T12:41:48.358 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 27 2023-10-19T12:41:48.375 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-19T12:41:48.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.576+0000 7f89509ff700 1 -- 172.21.15.46:0/2972859508 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f894c0747d0 msgr2=0x7f894c072c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:48.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.576+0000 7f89509ff700 1 --2- 172.21.15.46:0/2972859508 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f894c0747d0 0x7f894c072c20 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f893c009990 tx=0x7f893c009ca0 comp rx=0 tx=0).stop 2023-10-19T12:41:48.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.576+0000 7f89509ff700 1 -- 172.21.15.46:0/2972859508 shutdown_connections 2023-10-19T12:41:48.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.576+0000 7f89509ff700 1 --2- 172.21.15.46:0/2972859508 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f894c108610 0x7f894c10aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:48.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.576+0000 7f89509ff700 1 --2- 172.21.15.46:0/2972859508 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f894c0747d0 0x7f894c072c20 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:48.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.576+0000 7f89509ff700 1 --2- 172.21.15.46:0/2972859508 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f894c0731f0 0x7f894c073670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:48.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.576+0000 7f89509ff700 1 -- 172.21.15.46:0/2972859508 >> 172.21.15.46:0/2972859508 conn(0x7f894c0fbc90 msgr2=0x7f894c0fe0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:48.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.576+0000 7f89509ff700 1 -- 172.21.15.46:0/2972859508 shutdown_connections 2023-10-19T12:41:48.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.576+0000 7f89509ff700 1 -- 172.21.15.46:0/2972859508 wait complete. 2023-10-19T12:41:48.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.577+0000 7f89509ff700 1 Processor -- start 2023-10-19T12:41:48.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.577+0000 7f89509ff700 1 -- start start 2023-10-19T12:41:48.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.578+0000 7f89509ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f894c0731f0 0x7f894c1988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:48.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.578+0000 7f89509ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f894c0747d0 0x7f894c198e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:48.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.578+0000 7f89509ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f894c108610 0x7f894c19fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:48.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.578+0000 7f89509ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f894c1a0410 con 0x7f894c0731f0 2023-10-19T12:41:48.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.578+0000 7f89509ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f894c1a0550 con 0x7f894c0747d0 2023-10-19T12:41:48.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.578+0000 7f89509ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f894c1a06e0 con 0x7f894c108610 2023-10-19T12:41:48.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.578+0000 7f894a59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f894c0731f0 0x7f894c1988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:48.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.578+0000 7f894a59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f894c0731f0 0x7f894c1988e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56496/0 (socket says 172.21.15.46:56496) 2023-10-19T12:41:48.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.578+0000 7f894a59c700 1 -- 172.21.15.46:0/926039998 learned_addr learned my addr 172.21.15.46:0/926039998 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:41:48.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.578+0000 7f894ad9d700 1 --2- 172.21.15.46:0/926039998 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f894c108610 0x7f894c19fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:48.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.578+0000 7f8949d9b700 1 --2- 172.21.15.46:0/926039998 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f894c0747d0 0x7f894c198e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:48.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.578+0000 7f894a59c700 1 -- 172.21.15.46:0/926039998 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f894c108610 msgr2=0x7f894c19fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:48.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.578+0000 7f894a59c700 1 --2- 172.21.15.46:0/926039998 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f894c108610 0x7f894c19fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:48.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.578+0000 7f894a59c700 1 -- 172.21.15.46:0/926039998 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f894c0747d0 msgr2=0x7f894c198e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:48.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.578+0000 7f894a59c700 1 --2- 172.21.15.46:0/926039998 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f894c0747d0 0x7f894c198e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:48.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.578+0000 7f894a59c700 1 -- 172.21.15.46:0/926039998 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f893c0095f0 con 0x7f894c0731f0 2023-10-19T12:41:48.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.579+0000 7f894a59c700 1 --2- 172.21.15.46:0/926039998 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f894c0731f0 0x7f894c1988e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f893c005910 tx=0x7f893c009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:48.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.579+0000 7f893b7fe700 1 -- 172.21.15.46:0/926039998 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f893c01d070 con 0x7f894c0731f0 2023-10-19T12:41:48.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.579+0000 7f893b7fe700 1 -- 172.21.15.46:0/926039998 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f893c021410 con 0x7f894c0731f0 2023-10-19T12:41:48.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.579+0000 7f89509ff700 1 -- 172.21.15.46:0/926039998 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f894c1a0960 con 0x7f894c0731f0 2023-10-19T12:41:48.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.579+0000 7f893b7fe700 1 -- 172.21.15.46:0/926039998 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f893c005720 con 0x7f894c0731f0 2023-10-19T12:41:48.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.579+0000 7f89509ff700 1 -- 172.21.15.46:0/926039998 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f894c1a0d80 con 0x7f894c0731f0 2023-10-19T12:41:48.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.580+0000 7f89509ff700 1 -- 172.21.15.46:0/926039998 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f894c107420 con 0x7f894c0731f0 2023-10-19T12:41:48.589 INFO:journalctl@ceph.mds.b.smithi157.stdout:Oct 19 12:41:48 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mds-b[170841]: 2023-10-19T12:41:48.176+0000 7f63d3baa700 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2023-10-19T12:41:48.589 INFO:journalctl@ceph.mds.b.smithi157.stdout:Oct 19 12:41:48 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mds-b[170841]: 2023-10-19T12:41:48.176+0000 7f63d3baa700 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2023-10-19T12:41:48.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.582+0000 7f893b7fe700 1 -- 172.21.15.46:0/926039998 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f893c021580 con 0x7f894c0731f0 2023-10-19T12:41:48.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.583+0000 7f893b7fe700 1 --2- 172.21.15.46:0/926039998 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f89340a1510 0x7f89340a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:48.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.583+0000 7f893b7fe700 1 -- 172.21.15.46:0/926039998 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f893c0ce3e0 con 0x7f894c0731f0 2023-10-19T12:41:48.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.584+0000 7f8949d9b700 1 --2- 172.21.15.46:0/926039998 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f89340a1510 0x7f89340a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:48.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.584+0000 7f8949d9b700 1 --2- 172.21.15.46:0/926039998 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f89340a1510 0x7f89340a39d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8940009c60 tx=0x7f8940009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:48.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.588+0000 7f893b7fe700 1 -- 172.21.15.46:0/926039998 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f893c097720 con 0x7f894c0731f0 2023-10-19T12:41:48.806 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.801+0000 7f89509ff700 1 -- 172.21.15.46:0/926039998 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f894c10e170 con 0x7f894c0731f0 2023-10-19T12:41:48.806 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.803+0000 7f893b7fe700 1 -- 172.21.15.46:0/926039998 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+23953 (secure 0 0 0) 0x7f893c09ad40 con 0x7f894c0731f0 2023-10-19T12:41:48.807 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:41:48.807 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":88,"fsid":"96a8be3c-6e7b-11ee-8db6-212e2dc638e7","created":"2023-10-19T12:33:26.148713+0000","modified":"2023-10-19T12:41:23.831907+0000","last_up_change":"2023-10-19T12:40:30.761679+0000","last_in_change":"2023-10-19T12:40:13.663559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-19T12:37:07.175795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-19T12:41:16.895203+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-19T12:41:18.255601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-19T12:41:21.830455+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"346ce86b-a10a-4869-9fdb-c3c1d4161455","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6803","nonce":500237995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6805","nonce":500237995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6809","nonce":500237995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6807","nonce":500237995}]},"public_addr":"172.21.15.46:6803/500237995","cluster_addr":"172.21.15.46:6805/500237995","heartbeat_back_addr":"172.21.15.46:6809/500237995","heartbeat_front_addr":"172.21.15.46:6807/500237995","state":["exists","up"]},{"osd":1,"uuid":"02aae687-76c5-4124-bae4-9787ed571c28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6801","nonce":2496862790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6803","nonce":2496862790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6807","nonce":2496862790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6805","nonce":2496862790}]},"public_addr":"172.21.15.157:6801/2496862790","cluster_addr":"172.21.15.157:6803/2496862790","heartbeat_back_addr":"172.21.15.157:6807/2496862790","heartbeat_front_addr":"172.21.15.157:6805/2496862790","state":["exists","up"]},{"osd":2,"uuid":"d5360828-1f58-4380-b2ad-0c21ff850981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6801","nonce":4211767276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6803","nonce":4211767276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6807","nonce":4211767276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6805","nonce":4211767276}]},"public_addr":"172.21.15.195:6801/4211767276","cluster_addr":"172.21.15.195:6803/4211767276","heartbeat_back_addr":"172.21.15.195:6807/4211767276","heartbeat_front_addr":"172.21.15.195:6805/4211767276","state":["exists","up"]},{"osd":3,"uuid":"accb780f-49d0-43f8-b166-ee12c558ef00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6811","nonce":1964113352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6813","nonce":1964113352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6817","nonce":1964113352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6815","nonce":1964113352}]},"public_addr":"172.21.15.46:6811/1964113352","cluster_addr":"172.21.15.46:6813/1964113352","heartbeat_back_addr":"172.21.15.46:6817/1964113352","heartbeat_front_addr":"172.21.15.46:6815/1964113352","state":["exists","up"]},{"osd":4,"uuid":"e662886d-e989-4d02-8c1f-3c4671352b0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6809","nonce":3636910144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6811","nonce":3636910144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6815","nonce":3636910144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6813","nonce":3636910144}]},"public_addr":"172.21.15.157:6809/3636910144","cluster_addr":"172.21.15.157:6811/3636910144","heartbeat_back_addr":"172.21.15.157:6815/3636910144","heartbeat_front_addr":"172.21.15.157:6813/3636910144","state":["exists","up"]},{"osd":5,"uuid":"9597e0ce-14ea-407d-90fe-f74bccee38b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6809","nonce":4071287969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6811","nonce":4071287969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6815","nonce":4071287969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6813","nonce":4071287969}]},"public_addr":"172.21.15.195:6809/4071287969","cluster_addr":"172.21.15.195:6811/4071287969","heartbeat_back_addr":"172.21.15.195:6815/4071287969","heartbeat_front_addr":"172.21.15.195:6813/4071287969","state":["exists","up"]},{"osd":6,"uuid":"6b78ba38-f60e-4cb6-b01c-cecc1820e8e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6819","nonce":1842285555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6821","nonce":1842285555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6825","nonce":1842285555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6823","nonce":1842285555}]},"public_addr":"172.21.15.46:6819/1842285555","cluster_addr":"172.21.15.46:6821/1842285555","heartbeat_back_addr":"172.21.15.46:6825/1842285555","heartbeat_front_addr":"172.21.15.46:6823/1842285555","state":["exists","up"]},{"osd":7,"uuid":"59a0899f-3bcd-4db2-b544-24df3a536749","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6817","nonce":3498672588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6819","nonce":3498672588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6823","nonce":3498672588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6821","nonce":3498672588}]},"public_addr":"172.21.15.157:6817/3498672588","cluster_addr":"172.21.15.157:6819/3498672588","heartbeat_back_addr":"172.21.15.157:6823/3498672588","heartbeat_front_addr":"172.21.15.157:6821/3498672588","state":["exists","up"]},{"osd":8,"uuid":"9c3c9835-043a-4fb5-a9ee-edf8caf6b605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6817","nonce":74230104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6819","nonce":74230104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6823","nonce":74230104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6821","nonce":74230104}]},"public_addr":"172.21.15.195:6817/74230104","cluster_addr":"172.21.15.195:6819/74230104","heartbeat_back_addr":"172.21.15.195:6823/74230104","heartbeat_front_addr":"172.21.15.195:6821/74230104","state":["exists","up"]},{"osd":9,"uuid":"3f18f506-a577-4b7c-ae0d-9351c07e81f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6827","nonce":3472581046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6829","nonce":3472581046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6833","nonce":3472581046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6831","nonce":3472581046}]},"public_addr":"172.21.15.46:6827/3472581046","cluster_addr":"172.21.15.46:6829/3472581046","heartbeat_back_addr":"172.21.15.46:6833/3472581046","heartbeat_front_addr":"172.21.15.46:6831/3472581046","state":["exists","up"]},{"osd":10,"uuid":"1ed01854-443a-4acf-9293-7ca0d451a93d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6825","nonce":2378416559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6827","nonce":2378416559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6831","nonce":2378416559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6829","nonce":2378416559}]},"public_addr":"172.21.15.157:6825/2378416559","cluster_addr":"172.21.15.157:6827/2378416559","heartbeat_back_addr":"172.21.15.157:6831/2378416559","heartbeat_front_addr":"172.21.15.157:6829/2378416559","state":["exists","up"]},{"osd":11,"uuid":"021398c0-9184-4647-8220-e40f6705ca90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6825","nonce":3075632222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6827","nonce":3075632222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6831","nonce":3075632222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6829","nonce":3075632222}]},"public_addr":"172.21.15.195:6825/3075632222","cluster_addr":"172.21.15.195:6827/3075632222","heartbeat_back_addr":"172.21.15.195:6831/3075632222","heartbeat_front_addr":"172.21.15.195:6829/3075632222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:36:22.002614+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:36:44.098031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:37:04.518341+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:37:30.796462+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:37:52.756555+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:38:13.403168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:38:39.058472+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:39:01.106893+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:39:21.908334+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:39:46.843884+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:40:08.792020+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:40:29.282974+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.46:0/3248595150":"2023-10-20T12:34:26.552115+0000","172.21.15.46:0/3624849341":"2023-10-20T12:34:26.552115+0000","172.21.15.46:0/1844094590":"2023-10-20T12:34:26.552115+0000","172.21.15.46:6801/20022894":"2023-10-20T12:34:26.552115+0000","172.21.15.46:0/3969790632":"2023-10-20T12:34:00.135248+0000","172.21.15.46:0/2331135821":"2023-10-20T12:34:00.135248+0000","172.21.15.46:6800/51664346":"2023-10-20T12:34:00.135248+0000","172.21.15.46:6801/51664346":"2023-10-20T12:34:00.135248+0000","172.21.15.46:0/585851467":"2023-10-20T12:34:00.135248+0000","172.21.15.46:6800/20022894":"2023-10-20T12:34:26.552115+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-19T12:41:48.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.805+0000 7f89509ff700 1 -- 172.21.15.46:0/926039998 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f89340a1510 msgr2=0x7f89340a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:48.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.805+0000 7f89509ff700 1 --2- 172.21.15.46:0/926039998 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f89340a1510 0x7f89340a39d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8940009c60 tx=0x7f8940009260 comp rx=0 tx=0).stop 2023-10-19T12:41:48.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.805+0000 7f89509ff700 1 -- 172.21.15.46:0/926039998 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f894c0731f0 msgr2=0x7f894c1988e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:48.810 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.805+0000 7f89509ff700 1 --2- 172.21.15.46:0/926039998 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f894c0731f0 0x7f894c1988e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f893c005910 tx=0x7f893c009580 comp rx=0 tx=0).stop 2023-10-19T12:41:48.810 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.806+0000 7f89509ff700 1 -- 172.21.15.46:0/926039998 shutdown_connections 2023-10-19T12:41:48.810 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.806+0000 7f89509ff700 1 --2- 172.21.15.46:0/926039998 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f89340a1510 0x7f89340a39d0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:48.810 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.806+0000 7f89509ff700 1 --2- 172.21.15.46:0/926039998 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f894c108610 0x7f894c19fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:48.810 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.806+0000 7f89509ff700 1 --2- 172.21.15.46:0/926039998 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f894c0731f0 0x7f894c1988e0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:48.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.806+0000 7f89509ff700 1 --2- 172.21.15.46:0/926039998 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f894c0747d0 0x7f894c198e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:48.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.806+0000 7f89509ff700 1 -- 172.21.15.46:0/926039998 >> 172.21.15.46:0/926039998 conn(0x7f894c0fbc90 msgr2=0x7f894c104560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:48.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.806+0000 7f89509ff700 1 -- 172.21.15.46:0/926039998 shutdown_connections 2023-10-19T12:41:48.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:48.806+0000 7f89509ff700 1 -- 172.21.15.46:0/926039998 wait complete. 2023-10-19T12:41:48.828 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-19T12:41:48.829 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-19T12:41:49.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.029+0000 7f5ca5dff700 1 -- 172.21.15.46:0/711512740 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5ca01022d0 msgr2=0x7f5ca0108b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:49.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.029+0000 7f5ca5dff700 1 --2- 172.21.15.46:0/711512740 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5ca01022d0 0x7f5ca0108b80 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f5c98009fc0 tx=0x7f5c9800b330 comp rx=0 tx=0).stop 2023-10-19T12:41:49.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.030+0000 7f5ca5dff700 1 -- 172.21.15.46:0/711512740 shutdown_connections 2023-10-19T12:41:49.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.030+0000 7f5ca5dff700 1 --2- 172.21.15.46:0/711512740 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5ca01022d0 0x7f5ca0108b80 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:49.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.030+0000 7f5ca5dff700 1 --2- 172.21.15.46:0/711512740 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5ca0100740 0x7f5ca0100b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:49.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.030+0000 7f5ca5dff700 1 --2- 172.21.15.46:0/711512740 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5ca0101930 0x7f5ca0101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:49.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.030+0000 7f5ca5dff700 1 -- 172.21.15.46:0/711512740 >> 172.21.15.46:0/711512740 conn(0x7f5ca00fbc90 msgr2=0x7f5ca00fe0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:49.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.030+0000 7f5ca5dff700 1 -- 172.21.15.46:0/711512740 shutdown_connections 2023-10-19T12:41:49.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.030+0000 7f5ca5dff700 1 -- 172.21.15.46:0/711512740 wait complete. 2023-10-19T12:41:49.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.031+0000 7f5ca5dff700 1 Processor -- start 2023-10-19T12:41:49.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.031+0000 7f5ca5dff700 1 -- start start 2023-10-19T12:41:49.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.031+0000 7f5ca5dff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5ca0100740 0x7f5ca01989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:49.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.031+0000 7f5ca5dff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5ca0101930 0x7f5ca0198f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:49.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.031+0000 7f5ca5dff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5ca01022d0 0x7f5ca019ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:49.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.031+0000 7f5ca5dff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca01a04f0 con 0x7f5ca01022d0 2023-10-19T12:41:49.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.031+0000 7f5ca5dff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca01a0630 con 0x7f5ca0100740 2023-10-19T12:41:49.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.031+0000 7f5ca5dff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca01a07c0 con 0x7f5ca0101930 2023-10-19T12:41:49.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.032+0000 7f5c9ffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5ca01022d0 0x7f5ca019ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:49.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.032+0000 7f5c9f7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5ca0100740 0x7f5ca01989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:49.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.032+0000 7f5c9effd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5ca0101930 0x7f5ca0198f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:49.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.032+0000 7f5c9ffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5ca01022d0 0x7f5ca019ff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56520/0 (socket says 172.21.15.46:56520) 2023-10-19T12:41:49.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.032+0000 7f5c9f7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5ca0100740 0x7f5ca01989c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:58668/0 (socket says 172.21.15.46:58668) 2023-10-19T12:41:49.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.032+0000 7f5c9ffff700 1 -- 172.21.15.46:0/3478792456 learned_addr learned my addr 172.21.15.46:0/3478792456 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:41:49.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.032+0000 7f5c9ffff700 1 -- 172.21.15.46:0/3478792456 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5ca0101930 msgr2=0x7f5ca0198f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:49.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.032+0000 7f5c9ffff700 1 --2- 172.21.15.46:0/3478792456 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5ca0101930 0x7f5ca0198f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:49.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.032+0000 7f5c9ffff700 1 -- 172.21.15.46:0/3478792456 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5ca0100740 msgr2=0x7f5ca01989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:49.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.032+0000 7f5c9ffff700 1 --2- 172.21.15.46:0/3478792456 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5ca0100740 0x7f5ca01989c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:49.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.032+0000 7f5c9ffff700 1 -- 172.21.15.46:0/3478792456 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c900095f0 con 0x7f5ca01022d0 2023-10-19T12:41:49.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.032+0000 7f5c9ffff700 1 --2- 172.21.15.46:0/3478792456 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5ca01022d0 0x7f5ca019ff20 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5c98008fd0 tx=0x7f5c98009000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:49.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.033+0000 7f5c9cff9700 1 -- 172.21.15.46:0/3478792456 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c9800e040 con 0x7f5ca01022d0 2023-10-19T12:41:49.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.033+0000 7f5c9cff9700 1 -- 172.21.15.46:0/3478792456 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5c98004e90 con 0x7f5ca01022d0 2023-10-19T12:41:49.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.033+0000 7f5c9cff9700 1 -- 172.21.15.46:0/3478792456 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c980052a0 con 0x7f5ca01022d0 2023-10-19T12:41:49.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.033+0000 7f5ca5dff700 1 -- 172.21.15.46:0/3478792456 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c94009520 con 0x7f5ca01022d0 2023-10-19T12:41:49.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.033+0000 7f5ca5dff700 1 -- 172.21.15.46:0/3478792456 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c98009c40 con 0x7f5ca01022d0 2023-10-19T12:41:49.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.034+0000 7f5ca5dff700 1 -- 172.21.15.46:0/3478792456 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ca0067530 con 0x7f5ca01022d0 2023-10-19T12:41:49.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.035+0000 7f5c9cff9700 1 -- 172.21.15.46:0/3478792456 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f5c9801d470 con 0x7f5ca01022d0 2023-10-19T12:41:49.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.037+0000 7f5c9cff9700 1 --2- 172.21.15.46:0/3478792456 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f5c880a1590 0x7f5c880a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:49.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.037+0000 7f5c9cff9700 1 -- 172.21.15.46:0/3478792456 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f5c980ce430 con 0x7f5ca01022d0 2023-10-19T12:41:49.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.037+0000 7f5c9f7fe700 1 --2- 172.21.15.46:0/3478792456 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f5c880a1590 0x7f5c880a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:49.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.038+0000 7f5c9f7fe700 1 --2- 172.21.15.46:0/3478792456 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f5c880a1590 0x7f5c880a3a50 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5ca0101790 tx=0x7f5c90009310 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:49.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.041+0000 7f5c9cff9700 1 -- 172.21.15.46:0/3478792456 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5c98097770 con 0x7f5ca01022d0 2023-10-19T12:41:49.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:48 smithi157 ceph-mon[134109]: from='client.14913 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2023-10-19T12:41:49.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:48 smithi157 ceph-mon[134109]: from='client.14919 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-10-19T12:41:49.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:48 smithi157 ceph-mon[134109]: mgrmap e17: x(active, since 7m), standbys: z, y 2023-10-19T12:41:49.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:48 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/2862268936' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-19T12:41:49.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:48 smithi195 ceph-mon[134493]: from='client.14913 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2023-10-19T12:41:49.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:48 smithi195 ceph-mon[134493]: from='client.14919 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-10-19T12:41:49.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:48 smithi195 ceph-mon[134493]: mgrmap e17: x(active, since 7m), standbys: z, y 2023-10-19T12:41:49.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:48 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/2862268936' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-19T12:41:49.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:48 smithi046 ceph-mon[98509]: from='client.14913 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2023-10-19T12:41:49.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:48 smithi046 ceph-mon[98509]: from='client.14919 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-10-19T12:41:49.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:48 smithi046 ceph-mon[98509]: mgrmap e17: x(active, since 7m), standbys: z, y 2023-10-19T12:41:49.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:48 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/2862268936' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-19T12:41:49.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.250+0000 7f5ca5dff700 1 -- 172.21.15.46:0/3478792456 --> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5ca0074140 con 0x7f5c880a1590 2023-10-19T12:41:49.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.266+0000 7f5c9cff9700 1 -- 172.21.15.46:0/3478792456 <== mgr.14150 v2:172.21.15.46:6800/3168073651 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+422286 (secure 0 0 0) 0x7f5ca0074140 con 0x7f5c880a1590 2023-10-19T12:41:49.276 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:41:49.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.272+0000 7f5ca5dff700 1 -- 172.21.15.46:0/3478792456 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f5c880a1590 msgr2=0x7f5c880a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:49.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.272+0000 7f5ca5dff700 1 --2- 172.21.15.46:0/3478792456 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f5c880a1590 0x7f5c880a3a50 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5ca0101790 tx=0x7f5c90009310 comp rx=0 tx=0).stop 2023-10-19T12:41:49.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.272+0000 7f5ca5dff700 1 -- 172.21.15.46:0/3478792456 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5ca01022d0 msgr2=0x7f5ca019ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:49.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.272+0000 7f5ca5dff700 1 --2- 172.21.15.46:0/3478792456 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5ca01022d0 0x7f5ca019ff20 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5c98008fd0 tx=0x7f5c98009000 comp rx=0 tx=0).stop 2023-10-19T12:41:49.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.272+0000 7f5ca5dff700 1 -- 172.21.15.46:0/3478792456 shutdown_connections 2023-10-19T12:41:49.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.272+0000 7f5ca5dff700 1 --2- 172.21.15.46:0/3478792456 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5ca01022d0 0x7f5ca019ff20 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:49.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.272+0000 7f5ca5dff700 1 --2- 172.21.15.46:0/3478792456 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5ca0100740 0x7f5ca01989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:49.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.272+0000 7f5ca5dff700 1 --2- 172.21.15.46:0/3478792456 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f5c880a1590 0x7f5c880a3a50 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:49.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.272+0000 7f5ca5dff700 1 --2- 172.21.15.46:0/3478792456 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5ca0101930 0x7f5ca0198f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:49.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.272+0000 7f5ca5dff700 1 -- 172.21.15.46:0/3478792456 >> 172.21.15.46:0/3478792456 conn(0x7f5ca00fbc90 msgr2=0x7f5ca0072a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:49.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.272+0000 7f5ca5dff700 1 -- 172.21.15.46:0/3478792456 shutdown_connections 2023-10-19T12:41:49.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.272+0000 7f5ca5dff700 1 -- 172.21.15.46:0/3478792456 wait complete. 2023-10-19T12:41:49.284 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-10-19T12:41:49.295 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":299,"stamp":"2023-10-19T12:41:48.639923+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600327,"num_objects":76,"num_object_clones":0,"num_object_copies":229,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":128,"num_read_kb":110,"num_write":338,"num_write_kb":2996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":276,"ondisk_log_size":276,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":337572,"kb_used_data":13380,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124604252,"statfs":{"total":1151940427776,"available":1151594754048,"internally_reserved":0,"allocated":13701120,"data_stored":7477821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19130,"internal_metadata":331855174},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5460,"num_objects":52,"num_object_clones":0,"num_object_copies":157,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":109,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":32,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003191"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.318308+0000","last_change":"2023-10-19T12:41:19.300761+0000","last_active":"2023-10-19T12:41:23.318308+0000","last_peered":"2023-10-19T12:41:23.318308+0000","last_clean":"2023-10-19T12:41:23.318308+0000","last_became_active":"2023-10-19T12:41:19.300431+0000","last_became_peered":"2023-10-19T12:41:19.300431+0000","last_unstale":"2023-10-19T12:41:23.318308+0000","last_undegraded":"2023-10-19T12:41:23.318308+0000","last_fullsized":"2023-10-19T12:41:23.318308+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-21T00:36:29.735726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.322752+0000","last_change":"2023-10-19T12:41:19.300748+0000","last_active":"2023-10-19T12:41:23.322752+0000","last_peered":"2023-10-19T12:41:23.322752+0000","last_clean":"2023-10-19T12:41:23.322752+0000","last_became_active":"2023-10-19T12:41:19.294769+0000","last_became_peered":"2023-10-19T12:41:19.294769+0000","last_unstale":"2023-10-19T12:41:23.322752+0000","last_undegraded":"2023-10-19T12:41:23.322752+0000","last_fullsized":"2023-10-19T12:41:23.322752+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T23:04:58.055573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.322213+0000","last_change":"2023-10-19T12:41:19.294264+0000","last_active":"2023-10-19T12:41:23.322213+0000","last_peered":"2023-10-19T12:41:23.322213+0000","last_clean":"2023-10-19T12:41:23.322213+0000","last_became_active":"2023-10-19T12:41:19.293878+0000","last_became_peered":"2023-10-19T12:41:19.293878+0000","last_unstale":"2023-10-19T12:41:23.322213+0000","last_undegraded":"2023-10-19T12:41:23.322213+0000","last_fullsized":"2023-10-19T12:41:23.322213+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:11:01.049036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.318364+0000","last_change":"2023-10-19T12:41:19.292977+0000","last_active":"2023-10-19T12:41:23.318364+0000","last_peered":"2023-10-19T12:41:23.318364+0000","last_clean":"2023-10-19T12:41:23.318364+0000","last_became_active":"2023-10-19T12:41:19.292626+0000","last_became_peered":"2023-10-19T12:41:19.292626+0000","last_unstale":"2023-10-19T12:41:23.318364+0000","last_undegraded":"2023-10-19T12:41:23.318364+0000","last_fullsized":"2023-10-19T12:41:23.318364+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:56:11.175726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.317533+0000","last_change":"2023-10-19T12:41:19.301164+0000","last_active":"2023-10-19T12:41:23.317533+0000","last_peered":"2023-10-19T12:41:23.317533+0000","last_clean":"2023-10-19T12:41:23.317533+0000","last_became_active":"2023-10-19T12:41:19.300920+0000","last_became_peered":"2023-10-19T12:41:19.300920+0000","last_unstale":"2023-10-19T12:41:23.317533+0000","last_undegraded":"2023-10-19T12:41:23.317533+0000","last_fullsized":"2023-10-19T12:41:23.317533+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:15:40.211319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.477174+0000","last_change":"2023-10-19T12:41:19.292866+0000","last_active":"2023-10-19T12:41:23.477174+0000","last_peered":"2023-10-19T12:41:23.477174+0000","last_clean":"2023-10-19T12:41:23.477174+0000","last_became_active":"2023-10-19T12:41:19.292392+0000","last_became_peered":"2023-10-19T12:41:19.292392+0000","last_unstale":"2023-10-19T12:41:23.477174+0000","last_undegraded":"2023-10-19T12:41:23.477174+0000","last_fullsized":"2023-10-19T12:41:23.477174+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:37:34.373704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.317425+0000","last_change":"2023-10-19T12:41:19.289271+0000","last_active":"2023-10-19T12:41:23.317425+0000","last_peered":"2023-10-19T12:41:23.317425+0000","last_clean":"2023-10-19T12:41:23.317425+0000","last_became_active":"2023-10-19T12:41:19.288950+0000","last_became_peered":"2023-10-19T12:41:19.288950+0000","last_unstale":"2023-10-19T12:41:23.317425+0000","last_undegraded":"2023-10-19T12:41:23.317425+0000","last_fullsized":"2023-10-19T12:41:23.317425+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:34:07.053254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.319089+0000","last_change":"2023-10-19T12:41:19.290501+0000","last_active":"2023-10-19T12:41:23.319089+0000","last_peered":"2023-10-19T12:41:23.319089+0000","last_clean":"2023-10-19T12:41:23.319089+0000","last_became_active":"2023-10-19T12:41:19.290080+0000","last_became_peered":"2023-10-19T12:41:19.290080+0000","last_unstale":"2023-10-19T12:41:23.319089+0000","last_undegraded":"2023-10-19T12:41:23.319089+0000","last_fullsized":"2023-10-19T12:41:23.319089+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:40:19.827896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.312997+0000","last_change":"2023-10-19T12:41:19.304631+0000","last_active":"2023-10-19T12:41:23.312997+0000","last_peered":"2023-10-19T12:41:23.312997+0000","last_clean":"2023-10-19T12:41:23.312997+0000","last_became_active":"2023-10-19T12:41:19.301990+0000","last_became_peered":"2023-10-19T12:41:19.301990+0000","last_unstale":"2023-10-19T12:41:23.312997+0000","last_undegraded":"2023-10-19T12:41:23.312997+0000","last_fullsized":"2023-10-19T12:41:23.312997+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:50:46.128888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.478397+0000","last_change":"2023-10-19T12:41:19.294366+0000","last_active":"2023-10-19T12:41:23.478397+0000","last_peered":"2023-10-19T12:41:23.478397+0000","last_clean":"2023-10-19T12:41:23.478397+0000","last_became_active":"2023-10-19T12:41:19.292644+0000","last_became_peered":"2023-10-19T12:41:19.292644+0000","last_unstale":"2023-10-19T12:41:23.478397+0000","last_undegraded":"2023-10-19T12:41:23.478397+0000","last_fullsized":"2023-10-19T12:41:23.478397+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:59:30.111950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.318667+0000","last_change":"2023-10-19T12:41:19.290054+0000","last_active":"2023-10-19T12:41:23.318667+0000","last_peered":"2023-10-19T12:41:23.318667+0000","last_clean":"2023-10-19T12:41:23.318667+0000","last_became_active":"2023-10-19T12:41:19.289739+0000","last_became_peered":"2023-10-19T12:41:19.289739+0000","last_unstale":"2023-10-19T12:41:23.318667+0000","last_undegraded":"2023-10-19T12:41:23.318667+0000","last_fullsized":"2023-10-19T12:41:23.318667+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:30:36.398762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.318352+0000","last_change":"2023-10-19T12:41:19.295309+0000","last_active":"2023-10-19T12:41:23.318352+0000","last_peered":"2023-10-19T12:41:23.318352+0000","last_clean":"2023-10-19T12:41:23.318352+0000","last_became_active":"2023-10-19T12:41:19.295009+0000","last_became_peered":"2023-10-19T12:41:19.295009+0000","last_unstale":"2023-10-19T12:41:23.318352+0000","last_undegraded":"2023-10-19T12:41:23.318352+0000","last_fullsized":"2023-10-19T12:41:23.318352+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:27:33.798071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.312970+0000","last_change":"2023-10-19T12:41:19.302920+0000","last_active":"2023-10-19T12:41:23.312970+0000","last_peered":"2023-10-19T12:41:23.312970+0000","last_clean":"2023-10-19T12:41:23.312970+0000","last_became_active":"2023-10-19T12:41:19.300250+0000","last_became_peered":"2023-10-19T12:41:19.300250+0000","last_unstale":"2023-10-19T12:41:23.312970+0000","last_undegraded":"2023-10-19T12:41:23.312970+0000","last_fullsized":"2023-10-19T12:41:23.312970+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:51:47.487907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.321529+0000","last_change":"2023-10-19T12:41:19.300654+0000","last_active":"2023-10-19T12:41:23.321529+0000","last_peered":"2023-10-19T12:41:23.321529+0000","last_clean":"2023-10-19T12:41:23.321529+0000","last_became_active":"2023-10-19T12:41:19.295408+0000","last_became_peered":"2023-10-19T12:41:19.295408+0000","last_unstale":"2023-10-19T12:41:23.321529+0000","last_undegraded":"2023-10-19T12:41:23.321529+0000","last_fullsized":"2023-10-19T12:41:23.321529+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:53:47.039077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.322332+0000","last_change":"2023-10-19T12:41:19.293141+0000","last_active":"2023-10-19T12:41:23.322332+0000","last_peered":"2023-10-19T12:41:23.322332+0000","last_clean":"2023-10-19T12:41:23.322332+0000","last_became_active":"2023-10-19T12:41:19.290790+0000","last_became_peered":"2023-10-19T12:41:19.290790+0000","last_unstale":"2023-10-19T12:41:23.322332+0000","last_undegraded":"2023-10-19T12:41:23.322332+0000","last_fullsized":"2023-10-19T12:41:23.322332+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:23:44.757080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.312453+0000","last_change":"2023-10-19T12:41:19.299670+0000","last_active":"2023-10-19T12:41:23.312453+0000","last_peered":"2023-10-19T12:41:23.312453+0000","last_clean":"2023-10-19T12:41:23.312453+0000","last_became_active":"2023-10-19T12:41:19.299375+0000","last_became_peered":"2023-10-19T12:41:19.299375+0000","last_unstale":"2023-10-19T12:41:23.312453+0000","last_undegraded":"2023-10-19T12:41:23.312453+0000","last_fullsized":"2023-10-19T12:41:23.312453+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:30:23.234790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.318502+0000","last_change":"2023-10-19T12:41:19.300359+0000","last_active":"2023-10-19T12:41:23.318502+0000","last_peered":"2023-10-19T12:41:23.318502+0000","last_clean":"2023-10-19T12:41:23.318502+0000","last_became_active":"2023-10-19T12:41:19.300032+0000","last_became_peered":"2023-10-19T12:41:19.300032+0000","last_unstale":"2023-10-19T12:41:23.318502+0000","last_undegraded":"2023-10-19T12:41:23.318502+0000","last_fullsized":"2023-10-19T12:41:23.318502+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-21T00:33:24.621723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.329149+0000","last_change":"2023-10-19T12:41:19.288276+0000","last_active":"2023-10-19T12:41:23.329149+0000","last_peered":"2023-10-19T12:41:23.329149+0000","last_clean":"2023-10-19T12:41:23.329149+0000","last_became_active":"2023-10-19T12:41:19.287905+0000","last_became_peered":"2023-10-19T12:41:19.287905+0000","last_unstale":"2023-10-19T12:41:23.329149+0000","last_undegraded":"2023-10-19T12:41:23.329149+0000","last_fullsized":"2023-10-19T12:41:23.329149+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:46:15.640987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.324826+0000","last_change":"2023-10-19T12:41:19.300682+0000","last_active":"2023-10-19T12:41:23.324826+0000","last_peered":"2023-10-19T12:41:23.324826+0000","last_clean":"2023-10-19T12:41:23.324826+0000","last_became_active":"2023-10-19T12:41:19.300347+0000","last_became_peered":"2023-10-19T12:41:19.300347+0000","last_unstale":"2023-10-19T12:41:23.324826+0000","last_undegraded":"2023-10-19T12:41:23.324826+0000","last_fullsized":"2023-10-19T12:41:23.324826+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T21:21:31.772556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:24.974649+0000","last_change":"2023-10-19T12:41:23.337419+0000","last_active":"2023-10-19T12:41:24.974649+0000","last_peered":"2023-10-19T12:41:24.974649+0000","last_clean":"2023-10-19T12:41:24.974649+0000","last_became_active":"2023-10-19T12:41:23.337046+0000","last_became_peered":"2023-10-19T12:41:23.337046+0000","last_unstale":"2023-10-19T12:41:24.974649+0000","last_undegraded":"2023-10-19T12:41:24.974649+0000","last_fullsized":"2023-10-19T12:41:24.974649+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-21T00:20:22.732851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"83'4","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.325202+0000","last_change":"2023-10-19T12:41:18.282453+0000","last_active":"2023-10-19T12:41:23.325202+0000","last_peered":"2023-10-19T12:41:23.325202+0000","last_clean":"2023-10-19T12:41:23.325202+0000","last_became_active":"2023-10-19T12:41:18.281705+0000","last_became_peered":"2023-10-19T12:41:18.281705+0000","last_unstale":"2023-10-19T12:41:23.325202+0000","last_undegraded":"2023-10-19T12:41:23.325202+0000","last_fullsized":"2023-10-19T12:41:23.325202+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T21:12:33.877631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.328663+0000","last_change":"2023-10-19T12:41:19.292175+0000","last_active":"2023-10-19T12:41:23.328663+0000","last_peered":"2023-10-19T12:41:23.328663+0000","last_clean":"2023-10-19T12:41:23.328663+0000","last_became_active":"2023-10-19T12:41:19.291867+0000","last_became_peered":"2023-10-19T12:41:19.291867+0000","last_unstale":"2023-10-19T12:41:23.328663+0000","last_undegraded":"2023-10-19T12:41:23.328663+0000","last_fullsized":"2023-10-19T12:41:23.328663+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:22:12.255839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:24.314445+0000","last_change":"2023-10-19T12:41:23.340447+0000","last_active":"2023-10-19T12:41:24.314445+0000","last_peered":"2023-10-19T12:41:24.314445+0000","last_clean":"2023-10-19T12:41:24.314445+0000","last_became_active":"2023-10-19T12:41:23.340074+0000","last_became_peered":"2023-10-19T12:41:23.340074+0000","last_unstale":"2023-10-19T12:41:24.314445+0000","last_undegraded":"2023-10-19T12:41:24.314445+0000","last_fullsized":"2023-10-19T12:41:24.314445+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:12:11.828854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"88'2","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:25.678382+0000","last_change":"2023-10-19T12:41:18.297822+0000","last_active":"2023-10-19T12:41:25.678382+0000","last_peered":"2023-10-19T12:41:25.678382+0000","last_clean":"2023-10-19T12:41:25.678382+0000","last_became_active":"2023-10-19T12:41:18.297526+0000","last_became_peered":"2023-10-19T12:41:18.297526+0000","last_unstale":"2023-10-19T12:41:25.678382+0000","last_undegraded":"2023-10-19T12:41:25.678382+0000","last_fullsized":"2023-10-19T12:41:25.678382+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:59:28.110110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.324102+0000","last_change":"2023-10-19T12:41:19.309918+0000","last_active":"2023-10-19T12:41:23.324102+0000","last_peered":"2023-10-19T12:41:23.324102+0000","last_clean":"2023-10-19T12:41:23.324102+0000","last_became_active":"2023-10-19T12:41:19.309391+0000","last_became_peered":"2023-10-19T12:41:19.309391+0000","last_unstale":"2023-10-19T12:41:23.324102+0000","last_undegraded":"2023-10-19T12:41:23.324102+0000","last_fullsized":"2023-10-19T12:41:23.324102+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:52:49.320469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:24.314898+0000","last_change":"2023-10-19T12:41:23.337296+0000","last_active":"2023-10-19T12:41:24.314898+0000","last_peered":"2023-10-19T12:41:24.314898+0000","last_clean":"2023-10-19T12:41:24.314898+0000","last_became_active":"2023-10-19T12:41:23.336836+0000","last_became_peered":"2023-10-19T12:41:23.336836+0000","last_unstale":"2023-10-19T12:41:24.314898+0000","last_undegraded":"2023-10-19T12:41:24.314898+0000","last_fullsized":"2023-10-19T12:41:24.314898+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:15:25.400517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"88'4","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:44.286129+0000","last_change":"2023-10-19T12:41:18.282387+0000","last_active":"2023-10-19T12:41:44.286129+0000","last_peered":"2023-10-19T12:41:44.286129+0000","last_clean":"2023-10-19T12:41:44.286129+0000","last_became_active":"2023-10-19T12:41:18.282102+0000","last_became_peered":"2023-10-19T12:41:18.282102+0000","last_unstale":"2023-10-19T12:41:44.286129+0000","last_undegraded":"2023-10-19T12:41:44.286129+0000","last_fullsized":"2023-10-19T12:41:44.286129+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:07:17.409521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.312636+0000","last_change":"2023-10-19T12:41:19.301628+0000","last_active":"2023-10-19T12:41:23.312636+0000","last_peered":"2023-10-19T12:41:23.312636+0000","last_clean":"2023-10-19T12:41:23.312636+0000","last_became_active":"2023-10-19T12:41:19.301343+0000","last_became_peered":"2023-10-19T12:41:19.301343+0000","last_unstale":"2023-10-19T12:41:23.312636+0000","last_undegraded":"2023-10-19T12:41:23.312636+0000","last_fullsized":"2023-10-19T12:41:23.312636+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:02:31.273024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:24.314533+0000","last_change":"2023-10-19T12:41:23.330222+0000","last_active":"2023-10-19T12:41:24.314533+0000","last_peered":"2023-10-19T12:41:24.314533+0000","last_clean":"2023-10-19T12:41:24.314533+0000","last_became_active":"2023-10-19T12:41:23.329838+0000","last_became_peered":"2023-10-19T12:41:23.329838+0000","last_unstale":"2023-10-19T12:41:24.314533+0000","last_undegraded":"2023-10-19T12:41:24.314533+0000","last_fullsized":"2023-10-19T12:41:24.314533+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T21:40:52.899198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"83'2","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.318166+0000","last_change":"2023-10-19T12:41:18.279300+0000","last_active":"2023-10-19T12:41:23.318166+0000","last_peered":"2023-10-19T12:41:23.318166+0000","last_clean":"2023-10-19T12:41:23.318166+0000","last_became_active":"2023-10-19T12:41:18.278991+0000","last_became_peered":"2023-10-19T12:41:18.278991+0000","last_unstale":"2023-10-19T12:41:23.318166+0000","last_undegraded":"2023-10-19T12:41:23.318166+0000","last_fullsized":"2023-10-19T12:41:23.318166+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T21:06:16.319168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.326541+0000","last_change":"2023-10-19T12:41:19.286530+0000","last_active":"2023-10-19T12:41:23.326541+0000","last_peered":"2023-10-19T12:41:23.326541+0000","last_clean":"2023-10-19T12:41:23.326541+0000","last_became_active":"2023-10-19T12:41:19.286241+0000","last_became_peered":"2023-10-19T12:41:19.286241+0000","last_unstale":"2023-10-19T12:41:23.326541+0000","last_undegraded":"2023-10-19T12:41:23.326541+0000","last_fullsized":"2023-10-19T12:41:23.326541+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:30:16.438143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:24.975076+0000","last_change":"2023-10-19T12:41:23.330626+0000","last_active":"2023-10-19T12:41:24.975076+0000","last_peered":"2023-10-19T12:41:24.975076+0000","last_clean":"2023-10-19T12:41:24.975076+0000","last_became_active":"2023-10-19T12:41:23.330250+0000","last_became_peered":"2023-10-19T12:41:23.330250+0000","last_unstale":"2023-10-19T12:41:24.975076+0000","last_undegraded":"2023-10-19T12:41:24.975076+0000","last_fullsized":"2023-10-19T12:41:24.975076+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:09:48.428636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"88'5","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:43.277846+0000","last_change":"2023-10-19T12:41:18.277565+0000","last_active":"2023-10-19T12:41:43.277846+0000","last_peered":"2023-10-19T12:41:43.277846+0000","last_clean":"2023-10-19T12:41:43.277846+0000","last_became_active":"2023-10-19T12:41:18.277217+0000","last_became_peered":"2023-10-19T12:41:18.277217+0000","last_unstale":"2023-10-19T12:41:43.277846+0000","last_undegraded":"2023-10-19T12:41:43.277846+0000","last_fullsized":"2023-10-19T12:41:43.277846+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:47:37.626231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.317370+0000","last_change":"2023-10-19T12:41:19.285423+0000","last_active":"2023-10-19T12:41:23.317370+0000","last_peered":"2023-10-19T12:41:23.317370+0000","last_clean":"2023-10-19T12:41:23.317370+0000","last_became_active":"2023-10-19T12:41:19.285110+0000","last_became_peered":"2023-10-19T12:41:19.285110+0000","last_unstale":"2023-10-19T12:41:23.317370+0000","last_undegraded":"2023-10-19T12:41:23.317370+0000","last_fullsized":"2023-10-19T12:41:23.317370+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:27:51.707594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:24.974927+0000","last_change":"2023-10-19T12:41:23.343240+0000","last_active":"2023-10-19T12:41:24.974927+0000","last_peered":"2023-10-19T12:41:24.974927+0000","last_clean":"2023-10-19T12:41:24.974927+0000","last_became_active":"2023-10-19T12:41:23.342778+0000","last_became_peered":"2023-10-19T12:41:23.342778+0000","last_unstale":"2023-10-19T12:41:24.974927+0000","last_undegraded":"2023-10-19T12:41:24.974927+0000","last_fullsized":"2023-10-19T12:41:24.974927+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:47:15.690193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"88'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:45.297673+0000","last_change":"2023-10-19T12:41:18.286641+0000","last_active":"2023-10-19T12:41:45.297673+0000","last_peered":"2023-10-19T12:41:45.297673+0000","last_clean":"2023-10-19T12:41:45.297673+0000","last_became_active":"2023-10-19T12:41:18.286247+0000","last_became_peered":"2023-10-19T12:41:18.286247+0000","last_unstale":"2023-10-19T12:41:45.297673+0000","last_undegraded":"2023-10-19T12:41:45.297673+0000","last_fullsized":"2023-10-19T12:41:45.297673+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T21:28:47.086133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.317200+0000","last_change":"2023-10-19T12:41:19.291953+0000","last_active":"2023-10-19T12:41:23.317200+0000","last_peered":"2023-10-19T12:41:23.317200+0000","last_clean":"2023-10-19T12:41:23.317200+0000","last_became_active":"2023-10-19T12:41:19.291672+0000","last_became_peered":"2023-10-19T12:41:19.291672+0000","last_unstale":"2023-10-19T12:41:23.317200+0000","last_undegraded":"2023-10-19T12:41:23.317200+0000","last_fullsized":"2023-10-19T12:41:23.317200+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:40:09.239808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:24.314542+0000","last_change":"2023-10-19T12:41:23.338871+0000","last_active":"2023-10-19T12:41:24.314542+0000","last_peered":"2023-10-19T12:41:24.314542+0000","last_clean":"2023-10-19T12:41:24.314542+0000","last_became_active":"2023-10-19T12:41:23.338493+0000","last_became_peered":"2023-10-19T12:41:23.338493+0000","last_unstale":"2023-10-19T12:41:24.314542+0000","last_undegraded":"2023-10-19T12:41:24.314542+0000","last_fullsized":"2023-10-19T12:41:24.314542+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T22:49:12.948436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"88'2","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:44.288546+0000","last_change":"2023-10-19T12:41:18.291110+0000","last_active":"2023-10-19T12:41:44.288546+0000","last_peered":"2023-10-19T12:41:44.288546+0000","last_clean":"2023-10-19T12:41:44.288546+0000","last_became_active":"2023-10-19T12:41:18.290675+0000","last_became_peered":"2023-10-19T12:41:18.290675+0000","last_unstale":"2023-10-19T12:41:44.288546+0000","last_undegraded":"2023-10-19T12:41:44.288546+0000","last_fullsized":"2023-10-19T12:41:44.288546+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:57:44.713046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.318989+0000","last_change":"2023-10-19T12:41:19.299727+0000","last_active":"2023-10-19T12:41:23.318989+0000","last_peered":"2023-10-19T12:41:23.318989+0000","last_clean":"2023-10-19T12:41:23.318989+0000","last_became_active":"2023-10-19T12:41:19.299387+0000","last_became_peered":"2023-10-19T12:41:19.299387+0000","last_unstale":"2023-10-19T12:41:23.318989+0000","last_undegraded":"2023-10-19T12:41:23.318989+0000","last_fullsized":"2023-10-19T12:41:23.318989+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:34:03.783326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:25.721966+0000","last_change":"2023-10-19T12:41:23.331954+0000","last_active":"2023-10-19T12:41:25.721966+0000","last_peered":"2023-10-19T12:41:25.721966+0000","last_clean":"2023-10-19T12:41:25.721966+0000","last_became_active":"2023-10-19T12:41:23.328835+0000","last_became_peered":"2023-10-19T12:41:23.328835+0000","last_unstale":"2023-10-19T12:41:25.721966+0000","last_undegraded":"2023-10-19T12:41:25.721966+0000","last_fullsized":"2023-10-19T12:41:25.721966+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T21:49:10.473768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"88'2","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:43.275517+0000","last_change":"2023-10-19T12:41:18.280694+0000","last_active":"2023-10-19T12:41:43.275517+0000","last_peered":"2023-10-19T12:41:43.275517+0000","last_clean":"2023-10-19T12:41:43.275517+0000","last_became_active":"2023-10-19T12:41:18.280333+0000","last_became_peered":"2023-10-19T12:41:18.280333+0000","last_unstale":"2023-10-19T12:41:43.275517+0000","last_undegraded":"2023-10-19T12:41:43.275517+0000","last_fullsized":"2023-10-19T12:41:43.275517+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:06:02.944400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.318931+0000","last_change":"2023-10-19T12:41:19.288659+0000","last_active":"2023-10-19T12:41:23.318931+0000","last_peered":"2023-10-19T12:41:23.318931+0000","last_clean":"2023-10-19T12:41:23.318931+0000","last_became_active":"2023-10-19T12:41:19.288310+0000","last_became_peered":"2023-10-19T12:41:19.288310+0000","last_unstale":"2023-10-19T12:41:23.318931+0000","last_undegraded":"2023-10-19T12:41:23.318931+0000","last_fullsized":"2023-10-19T12:41:23.318931+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T23:15:05.772393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:25.678055+0000","last_change":"2023-10-19T12:41:23.333370+0000","last_active":"2023-10-19T12:41:25.678055+0000","last_peered":"2023-10-19T12:41:25.678055+0000","last_clean":"2023-10-19T12:41:25.678055+0000","last_became_active":"2023-10-19T12:41:23.332691+0000","last_became_peered":"2023-10-19T12:41:23.332691+0000","last_unstale":"2023-10-19T12:41:25.678055+0000","last_undegraded":"2023-10-19T12:41:25.678055+0000","last_fullsized":"2023-10-19T12:41:25.678055+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T21:28:45.414610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"88'4","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:43.277871+0000","last_change":"2023-10-19T12:41:18.287081+0000","last_active":"2023-10-19T12:41:43.277871+0000","last_peered":"2023-10-19T12:41:43.277871+0000","last_clean":"2023-10-19T12:41:43.277871+0000","last_became_active":"2023-10-19T12:41:18.286784+0000","last_became_peered":"2023-10-19T12:41:18.286784+0000","last_unstale":"2023-10-19T12:41:43.277871+0000","last_undegraded":"2023-10-19T12:41:43.277871+0000","last_fullsized":"2023-10-19T12:41:43.277871+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:49:10.167022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.313023+0000","last_change":"2023-10-19T12:41:19.300361+0000","last_active":"2023-10-19T12:41:23.313023+0000","last_peered":"2023-10-19T12:41:23.313023+0000","last_clean":"2023-10-19T12:41:23.313023+0000","last_became_active":"2023-10-19T12:41:19.299871+0000","last_became_peered":"2023-10-19T12:41:19.299871+0000","last_unstale":"2023-10-19T12:41:23.313023+0000","last_undegraded":"2023-10-19T12:41:23.313023+0000","last_fullsized":"2023-10-19T12:41:23.313023+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:46:31.437532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:25.010645+0000","last_change":"2023-10-19T12:41:23.338341+0000","last_active":"2023-10-19T12:41:25.010645+0000","last_peered":"2023-10-19T12:41:25.010645+0000","last_clean":"2023-10-19T12:41:25.010645+0000","last_became_active":"2023-10-19T12:41:23.336081+0000","last_became_peered":"2023-10-19T12:41:23.336081+0000","last_unstale":"2023-10-19T12:41:25.010645+0000","last_undegraded":"2023-10-19T12:41:25.010645+0000","last_fullsized":"2023-10-19T12:41:25.010645+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:02:35.474513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"88'4","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:46.306224+0000","last_change":"2023-10-19T12:41:18.280086+0000","last_active":"2023-10-19T12:41:46.306224+0000","last_peered":"2023-10-19T12:41:46.306224+0000","last_clean":"2023-10-19T12:41:46.306224+0000","last_became_active":"2023-10-19T12:41:18.279819+0000","last_became_peered":"2023-10-19T12:41:18.279819+0000","last_unstale":"2023-10-19T12:41:46.306224+0000","last_undegraded":"2023-10-19T12:41:46.306224+0000","last_fullsized":"2023-10-19T12:41:46.306224+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T23:02:28.723477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.324193+0000","last_change":"2023-10-19T12:41:19.306420+0000","last_active":"2023-10-19T12:41:23.324193+0000","last_peered":"2023-10-19T12:41:23.324193+0000","last_clean":"2023-10-19T12:41:23.324193+0000","last_became_active":"2023-10-19T12:41:19.301202+0000","last_became_peered":"2023-10-19T12:41:19.301202+0000","last_unstale":"2023-10-19T12:41:23.324193+0000","last_undegraded":"2023-10-19T12:41:23.324193+0000","last_fullsized":"2023-10-19T12:41:23.324193+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:56:16.765319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:24.314851+0000","last_change":"2023-10-19T12:41:23.337332+0000","last_active":"2023-10-19T12:41:24.314851+0000","last_peered":"2023-10-19T12:41:24.314851+0000","last_clean":"2023-10-19T12:41:24.314851+0000","last_became_active":"2023-10-19T12:41:23.336877+0000","last_became_peered":"2023-10-19T12:41:23.336877+0000","last_unstale":"2023-10-19T12:41:24.314851+0000","last_undegraded":"2023-10-19T12:41:24.314851+0000","last_fullsized":"2023-10-19T12:41:24.314851+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T22:47:23.795598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"88'5","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:43.275777+0000","last_change":"2023-10-19T12:41:18.285452+0000","last_active":"2023-10-19T12:41:43.275777+0000","last_peered":"2023-10-19T12:41:43.275777+0000","last_clean":"2023-10-19T12:41:43.275777+0000","last_became_active":"2023-10-19T12:41:18.285155+0000","last_became_peered":"2023-10-19T12:41:18.285155+0000","last_unstale":"2023-10-19T12:41:43.275777+0000","last_undegraded":"2023-10-19T12:41:43.275777+0000","last_fullsized":"2023-10-19T12:41:43.275777+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:30:41.041925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.312755+0000","last_change":"2023-10-19T12:41:19.284839+0000","last_active":"2023-10-19T12:41:23.312755+0000","last_peered":"2023-10-19T12:41:23.312755+0000","last_clean":"2023-10-19T12:41:23.312755+0000","last_became_active":"2023-10-19T12:41:19.284538+0000","last_became_peered":"2023-10-19T12:41:19.284538+0000","last_unstale":"2023-10-19T12:41:23.312755+0000","last_undegraded":"2023-10-19T12:41:23.312755+0000","last_fullsized":"2023-10-19T12:41:23.312755+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:29:12.288958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:25.010725+0000","last_change":"2023-10-19T12:41:23.339611+0000","last_active":"2023-10-19T12:41:25.010725+0000","last_peered":"2023-10-19T12:41:25.010725+0000","last_clean":"2023-10-19T12:41:25.010725+0000","last_became_active":"2023-10-19T12:41:23.337786+0000","last_became_peered":"2023-10-19T12:41:23.337786+0000","last_unstale":"2023-10-19T12:41:25.010725+0000","last_undegraded":"2023-10-19T12:41:25.010725+0000","last_fullsized":"2023-10-19T12:41:25.010725+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:56:01.219811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"88'12","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:43.277620+0000","last_change":"2023-10-19T12:41:18.279330+0000","last_active":"2023-10-19T12:41:43.277620+0000","last_peered":"2023-10-19T12:41:43.277620+0000","last_clean":"2023-10-19T12:41:43.277620+0000","last_became_active":"2023-10-19T12:41:18.278942+0000","last_became_peered":"2023-10-19T12:41:18.278942+0000","last_unstale":"2023-10-19T12:41:43.277620+0000","last_undegraded":"2023-10-19T12:41:43.277620+0000","last_fullsized":"2023-10-19T12:41:43.277620+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:40:23.340009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.323151+0000","last_change":"2023-10-19T12:41:19.296103+0000","last_active":"2023-10-19T12:41:23.323151+0000","last_peered":"2023-10-19T12:41:23.323151+0000","last_clean":"2023-10-19T12:41:23.323151+0000","last_became_active":"2023-10-19T12:41:19.293432+0000","last_became_peered":"2023-10-19T12:41:19.293432+0000","last_unstale":"2023-10-19T12:41:23.323151+0000","last_undegraded":"2023-10-19T12:41:23.323151+0000","last_fullsized":"2023-10-19T12:41:23.323151+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:21:46.039560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:25.679564+0000","last_change":"2023-10-19T12:41:23.330711+0000","last_active":"2023-10-19T12:41:25.679564+0000","last_peered":"2023-10-19T12:41:25.679564+0000","last_clean":"2023-10-19T12:41:25.679564+0000","last_became_active":"2023-10-19T12:41:23.330115+0000","last_became_peered":"2023-10-19T12:41:23.330115+0000","last_unstale":"2023-10-19T12:41:25.679564+0000","last_undegraded":"2023-10-19T12:41:25.679564+0000","last_fullsized":"2023-10-19T12:41:25.679564+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:48:50.296265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"88'9","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:46.307039+0000","last_change":"2023-10-19T12:41:18.289434+0000","last_active":"2023-10-19T12:41:46.307039+0000","last_peered":"2023-10-19T12:41:46.307039+0000","last_clean":"2023-10-19T12:41:46.307039+0000","last_became_active":"2023-10-19T12:41:18.289226+0000","last_became_peered":"2023-10-19T12:41:18.289226+0000","last_unstale":"2023-10-19T12:41:46.307039+0000","last_undegraded":"2023-10-19T12:41:46.307039+0000","last_fullsized":"2023-10-19T12:41:46.307039+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T21:18:19.007202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.313003+0000","last_change":"2023-10-19T12:41:19.300555+0000","last_active":"2023-10-19T12:41:23.313003+0000","last_peered":"2023-10-19T12:41:23.313003+0000","last_clean":"2023-10-19T12:41:23.313003+0000","last_became_active":"2023-10-19T12:41:19.300162+0000","last_became_peered":"2023-10-19T12:41:19.300162+0000","last_unstale":"2023-10-19T12:41:23.313003+0000","last_undegraded":"2023-10-19T12:41:23.313003+0000","last_fullsized":"2023-10-19T12:41:23.313003+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:26:33.779562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:24.314248+0000","last_change":"2023-10-19T12:41:23.338750+0000","last_active":"2023-10-19T12:41:24.314248+0000","last_peered":"2023-10-19T12:41:24.314248+0000","last_clean":"2023-10-19T12:41:24.314248+0000","last_became_active":"2023-10-19T12:41:23.338318+0000","last_became_peered":"2023-10-19T12:41:23.338318+0000","last_unstale":"2023-10-19T12:41:24.314248+0000","last_undegraded":"2023-10-19T12:41:24.314248+0000","last_fullsized":"2023-10-19T12:41:24.314248+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:11:20.182270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"88'4","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:43.277887+0000","last_change":"2023-10-19T12:41:18.293923+0000","last_active":"2023-10-19T12:41:43.277887+0000","last_peered":"2023-10-19T12:41:43.277887+0000","last_clean":"2023-10-19T12:41:43.277887+0000","last_became_active":"2023-10-19T12:41:18.293688+0000","last_became_peered":"2023-10-19T12:41:18.293688+0000","last_unstale":"2023-10-19T12:41:43.277887+0000","last_undegraded":"2023-10-19T12:41:43.277887+0000","last_fullsized":"2023-10-19T12:41:43.277887+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:34:15.162178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.317645+0000","last_change":"2023-10-19T12:41:19.302733+0000","last_active":"2023-10-19T12:41:23.317645+0000","last_peered":"2023-10-19T12:41:23.317645+0000","last_clean":"2023-10-19T12:41:23.317645+0000","last_became_active":"2023-10-19T12:41:19.302401+0000","last_became_peered":"2023-10-19T12:41:19.302401+0000","last_unstale":"2023-10-19T12:41:23.317645+0000","last_undegraded":"2023-10-19T12:41:23.317645+0000","last_fullsized":"2023-10-19T12:41:23.317645+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:55:05.864499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:25.011161+0000","last_change":"2023-10-19T12:41:23.338999+0000","last_active":"2023-10-19T12:41:25.011161+0000","last_peered":"2023-10-19T12:41:25.011161+0000","last_clean":"2023-10-19T12:41:25.011161+0000","last_became_active":"2023-10-19T12:41:23.338067+0000","last_became_peered":"2023-10-19T12:41:23.338067+0000","last_unstale":"2023-10-19T12:41:25.011161+0000","last_undegraded":"2023-10-19T12:41:25.011161+0000","last_fullsized":"2023-10-19T12:41:25.011161+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:36:12.984006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"88'5","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:45.296118+0000","last_change":"2023-10-19T12:41:18.277563+0000","last_active":"2023-10-19T12:41:45.296118+0000","last_peered":"2023-10-19T12:41:45.296118+0000","last_clean":"2023-10-19T12:41:45.296118+0000","last_became_active":"2023-10-19T12:41:18.277255+0000","last_became_peered":"2023-10-19T12:41:18.277255+0000","last_unstale":"2023-10-19T12:41:45.296118+0000","last_undegraded":"2023-10-19T12:41:45.296118+0000","last_fullsized":"2023-10-19T12:41:45.296118+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:28:31.468355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.317585+0000","last_change":"2023-10-19T12:41:19.288939+0000","last_active":"2023-10-19T12:41:23.317585+0000","last_peered":"2023-10-19T12:41:23.317585+0000","last_clean":"2023-10-19T12:41:23.317585+0000","last_became_active":"2023-10-19T12:41:19.288612+0000","last_became_peered":"2023-10-19T12:41:19.288612+0000","last_unstale":"2023-10-19T12:41:23.317585+0000","last_undegraded":"2023-10-19T12:41:23.317585+0000","last_fullsized":"2023-10-19T12:41:23.317585+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:45:36.050331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:25.181275+0000","last_change":"2023-10-19T12:41:23.333823+0000","last_active":"2023-10-19T12:41:25.181275+0000","last_peered":"2023-10-19T12:41:25.181275+0000","last_clean":"2023-10-19T12:41:25.181275+0000","last_became_active":"2023-10-19T12:41:23.332698+0000","last_became_peered":"2023-10-19T12:41:23.332698+0000","last_unstale":"2023-10-19T12:41:25.181275+0000","last_undegraded":"2023-10-19T12:41:25.181275+0000","last_fullsized":"2023-10-19T12:41:25.181275+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:54:43.952531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"88'15","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:44.289804+0000","last_change":"2023-10-19T12:41:18.290426+0000","last_active":"2023-10-19T12:41:44.289804+0000","last_peered":"2023-10-19T12:41:44.289804+0000","last_clean":"2023-10-19T12:41:44.289804+0000","last_became_active":"2023-10-19T12:41:18.290096+0000","last_became_peered":"2023-10-19T12:41:18.290096+0000","last_unstale":"2023-10-19T12:41:44.289804+0000","last_undegraded":"2023-10-19T12:41:44.289804+0000","last_fullsized":"2023-10-19T12:41:44.289804+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:14:34.731869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.325958+0000","last_change":"2023-10-19T12:41:19.300423+0000","last_active":"2023-10-19T12:41:23.325958+0000","last_peered":"2023-10-19T12:41:23.325958+0000","last_clean":"2023-10-19T12:41:23.325958+0000","last_became_active":"2023-10-19T12:41:19.299999+0000","last_became_peered":"2023-10-19T12:41:19.299999+0000","last_unstale":"2023-10-19T12:41:23.325958+0000","last_undegraded":"2023-10-19T12:41:23.325958+0000","last_fullsized":"2023-10-19T12:41:23.325958+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:35:32.703396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:25.679660+0000","last_change":"2023-10-19T12:41:23.330091+0000","last_active":"2023-10-19T12:41:25.679660+0000","last_peered":"2023-10-19T12:41:25.679660+0000","last_clean":"2023-10-19T12:41:25.679660+0000","last_became_active":"2023-10-19T12:41:23.329695+0000","last_became_peered":"2023-10-19T12:41:23.329695+0000","last_unstale":"2023-10-19T12:41:25.679660+0000","last_undegraded":"2023-10-19T12:41:25.679660+0000","last_fullsized":"2023-10-19T12:41:25.679660+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:37:09.840232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"83'1","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.320875+0000","last_change":"2023-10-19T12:41:18.279761+0000","last_active":"2023-10-19T12:41:23.320875+0000","last_peered":"2023-10-19T12:41:23.320875+0000","last_clean":"2023-10-19T12:41:23.320875+0000","last_became_active":"2023-10-19T12:41:18.279430+0000","last_became_peered":"2023-10-19T12:41:18.279430+0000","last_unstale":"2023-10-19T12:41:23.320875+0000","last_undegraded":"2023-10-19T12:41:23.320875+0000","last_fullsized":"2023-10-19T12:41:23.320875+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:43:32.447842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.319789+0000","last_change":"2023-10-19T12:41:19.290406+0000","last_active":"2023-10-19T12:41:23.319789+0000","last_peered":"2023-10-19T12:41:23.319789+0000","last_clean":"2023-10-19T12:41:23.319789+0000","last_became_active":"2023-10-19T12:41:19.290032+0000","last_became_peered":"2023-10-19T12:41:19.290032+0000","last_unstale":"2023-10-19T12:41:23.319789+0000","last_undegraded":"2023-10-19T12:41:23.319789+0000","last_fullsized":"2023-10-19T12:41:23.319789+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:30:30.875800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:25.679154+0000","last_change":"2023-10-19T12:41:23.478036+0000","last_active":"2023-10-19T12:41:25.679154+0000","last_peered":"2023-10-19T12:41:25.679154+0000","last_clean":"2023-10-19T12:41:25.679154+0000","last_became_active":"2023-10-19T12:41:23.477542+0000","last_became_peered":"2023-10-19T12:41:23.477542+0000","last_unstale":"2023-10-19T12:41:25.679154+0000","last_undegraded":"2023-10-19T12:41:25.679154+0000","last_fullsized":"2023-10-19T12:41:25.679154+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:32:24.599591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.318260+0000","last_change":"2023-10-19T12:41:18.289254+0000","last_active":"2023-10-19T12:41:23.318260+0000","last_peered":"2023-10-19T12:41:23.318260+0000","last_clean":"2023-10-19T12:41:23.318260+0000","last_became_active":"2023-10-19T12:41:18.287036+0000","last_became_peered":"2023-10-19T12:41:18.287036+0000","last_unstale":"2023-10-19T12:41:23.318260+0000","last_undegraded":"2023-10-19T12:41:23.318260+0000","last_fullsized":"2023-10-19T12:41:23.318260+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T21:33:41.720725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.478113+0000","last_change":"2023-10-19T12:41:19.299711+0000","last_active":"2023-10-19T12:41:23.478113+0000","last_peered":"2023-10-19T12:41:23.478113+0000","last_clean":"2023-10-19T12:41:23.478113+0000","last_became_active":"2023-10-19T12:41:19.299367+0000","last_became_peered":"2023-10-19T12:41:19.299367+0000","last_unstale":"2023-10-19T12:41:23.478113+0000","last_undegraded":"2023-10-19T12:41:23.478113+0000","last_fullsized":"2023-10-19T12:41:23.478113+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:32:36.783990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:25.181012+0000","last_change":"2023-10-19T12:41:23.328301+0000","last_active":"2023-10-19T12:41:25.181012+0000","last_peered":"2023-10-19T12:41:25.181012+0000","last_clean":"2023-10-19T12:41:25.181012+0000","last_became_active":"2023-10-19T12:41:23.327866+0000","last_became_peered":"2023-10-19T12:41:23.327866+0000","last_unstale":"2023-10-19T12:41:25.181012+0000","last_undegraded":"2023-10-19T12:41:25.181012+0000","last_fullsized":"2023-10-19T12:41:25.181012+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T21:53:23.600196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"88'5","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:47.312657+0000","last_change":"2023-10-19T12:41:18.286635+0000","last_active":"2023-10-19T12:41:47.312657+0000","last_peered":"2023-10-19T12:41:47.312657+0000","last_clean":"2023-10-19T12:41:47.312657+0000","last_became_active":"2023-10-19T12:41:18.286310+0000","last_became_peered":"2023-10-19T12:41:18.286310+0000","last_unstale":"2023-10-19T12:41:47.312657+0000","last_undegraded":"2023-10-19T12:41:47.312657+0000","last_fullsized":"2023-10-19T12:41:47.312657+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:30:38.266038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.477637+0000","last_change":"2023-10-19T12:41:19.297989+0000","last_active":"2023-10-19T12:41:23.477637+0000","last_peered":"2023-10-19T12:41:23.477637+0000","last_clean":"2023-10-19T12:41:23.477637+0000","last_became_active":"2023-10-19T12:41:19.297680+0000","last_became_peered":"2023-10-19T12:41:19.297680+0000","last_unstale":"2023-10-19T12:41:23.477637+0000","last_undegraded":"2023-10-19T12:41:23.477637+0000","last_fullsized":"2023-10-19T12:41:23.477637+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:40:22.883804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:25.181247+0000","last_change":"2023-10-19T12:41:23.478723+0000","last_active":"2023-10-19T12:41:25.181247+0000","last_peered":"2023-10-19T12:41:25.181247+0000","last_clean":"2023-10-19T12:41:25.181247+0000","last_became_active":"2023-10-19T12:41:23.478063+0000","last_became_peered":"2023-10-19T12:41:23.478063+0000","last_unstale":"2023-10-19T12:41:25.181247+0000","last_undegraded":"2023-10-19T12:41:25.181247+0000","last_fullsized":"2023-10-19T12:41:25.181247+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:41:00.885308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.326531+0000","last_change":"2023-10-19T12:41:19.285478+0000","last_active":"2023-10-19T12:41:23.326531+0000","last_peered":"2023-10-19T12:41:23.326531+0000","last_clean":"2023-10-19T12:41:23.326531+0000","last_became_active":"2023-10-19T12:41:19.285175+0000","last_became_peered":"2023-10-19T12:41:19.285175+0000","last_unstale":"2023-10-19T12:41:23.326531+0000","last_undegraded":"2023-10-19T12:41:23.326531+0000","last_fullsized":"2023-10-19T12:41:23.326531+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:18:03.423712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"88'4","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:44.290133+0000","last_change":"2023-10-19T12:41:18.297207+0000","last_active":"2023-10-19T12:41:44.290133+0000","last_peered":"2023-10-19T12:41:44.290133+0000","last_clean":"2023-10-19T12:41:44.290133+0000","last_became_active":"2023-10-19T12:41:18.296490+0000","last_became_peered":"2023-10-19T12:41:18.296490+0000","last_unstale":"2023-10-19T12:41:44.290133+0000","last_undegraded":"2023-10-19T12:41:44.290133+0000","last_fullsized":"2023-10-19T12:41:44.290133+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:42:33.769810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"88'1","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:24.363934+0000","last_change":"2023-10-19T12:41:23.338803+0000","last_active":"2023-10-19T12:41:24.363934+0000","last_peered":"2023-10-19T12:41:24.363934+0000","last_clean":"2023-10-19T12:41:24.363934+0000","last_became_active":"2023-10-19T12:41:23.338383+0000","last_became_peered":"2023-10-19T12:41:23.338383+0000","last_unstale":"2023-10-19T12:41:24.363934+0000","last_undegraded":"2023-10-19T12:41:24.363934+0000","last_fullsized":"2023-10-19T12:41:24.363934+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:39:24.412323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.323173+0000","last_change":"2023-10-19T12:41:19.290536+0000","last_active":"2023-10-19T12:41:23.323173+0000","last_peered":"2023-10-19T12:41:23.323173+0000","last_clean":"2023-10-19T12:41:23.323173+0000","last_became_active":"2023-10-19T12:41:19.290141+0000","last_became_peered":"2023-10-19T12:41:19.290141+0000","last_unstale":"2023-10-19T12:41:23.323173+0000","last_undegraded":"2023-10-19T12:41:23.323173+0000","last_fullsized":"2023-10-19T12:41:23.323173+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:49:59.601767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"88'5","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:45.299567+0000","last_change":"2023-10-19T12:41:18.276568+0000","last_active":"2023-10-19T12:41:45.299567+0000","last_peered":"2023-10-19T12:41:45.299567+0000","last_clean":"2023-10-19T12:41:45.299567+0000","last_became_active":"2023-10-19T12:41:18.276216+0000","last_became_peered":"2023-10-19T12:41:18.276216+0000","last_unstale":"2023-10-19T12:41:45.299567+0000","last_undegraded":"2023-10-19T12:41:45.299567+0000","last_fullsized":"2023-10-19T12:41:45.299567+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T23:24:32.159972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":311,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.317325+0000","last_change":"2023-10-19T12:40:14.674594+0000","last_active":"2023-10-19T12:41:23.317325+0000","last_peered":"2023-10-19T12:41:23.317325+0000","last_clean":"2023-10-19T12:41:23.317325+0000","last_became_active":"2023-10-19T12:40:14.674234+0000","last_became_peered":"2023-10-19T12:40:14.674234+0000","last_unstale":"2023-10-19T12:41:23.317325+0000","last_undegraded":"2023-10-19T12:41:23.317325+0000","last_fullsized":"2023-10-19T12:41:23.317325+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:37:07.222565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:37:07.222565+0000","last_clean_scrub_stamp":"2023-10-19T12:37:07.222565+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-21T00:22:40.530907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:25.679196+0000","last_change":"2023-10-19T12:41:23.479328+0000","last_active":"2023-10-19T12:41:25.679196+0000","last_peered":"2023-10-19T12:41:25.679196+0000","last_clean":"2023-10-19T12:41:25.679196+0000","last_became_active":"2023-10-19T12:41:23.478972+0000","last_became_peered":"2023-10-19T12:41:23.478972+0000","last_unstale":"2023-10-19T12:41:25.679196+0000","last_undegraded":"2023-10-19T12:41:25.679196+0000","last_fullsized":"2023-10-19T12:41:25.679196+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:58:38.949721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.312649+0000","last_change":"2023-10-19T12:41:19.294132+0000","last_active":"2023-10-19T12:41:23.312649+0000","last_peered":"2023-10-19T12:41:23.312649+0000","last_clean":"2023-10-19T12:41:23.312649+0000","last_became_active":"2023-10-19T12:41:19.293800+0000","last_became_peered":"2023-10-19T12:41:19.293800+0000","last_unstale":"2023-10-19T12:41:23.312649+0000","last_undegraded":"2023-10-19T12:41:23.312649+0000","last_fullsized":"2023-10-19T12:41:23.312649+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:30:56.734581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"88'4","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:44.287552+0000","last_change":"2023-10-19T12:41:18.282440+0000","last_active":"2023-10-19T12:41:44.287552+0000","last_peered":"2023-10-19T12:41:44.287552+0000","last_clean":"2023-10-19T12:41:44.287552+0000","last_became_active":"2023-10-19T12:41:18.282200+0000","last_became_peered":"2023-10-19T12:41:18.282200+0000","last_unstale":"2023-10-19T12:41:44.287552+0000","last_undegraded":"2023-10-19T12:41:44.287552+0000","last_fullsized":"2023-10-19T12:41:44.287552+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:06:22.767488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:24.314192+0000","last_change":"2023-10-19T12:41:23.328605+0000","last_active":"2023-10-19T12:41:24.314192+0000","last_peered":"2023-10-19T12:41:24.314192+0000","last_clean":"2023-10-19T12:41:24.314192+0000","last_became_active":"2023-10-19T12:41:23.327992+0000","last_became_peered":"2023-10-19T12:41:23.327992+0000","last_unstale":"2023-10-19T12:41:24.314192+0000","last_undegraded":"2023-10-19T12:41:24.314192+0000","last_fullsized":"2023-10-19T12:41:24.314192+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:00:04.415235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"88'1","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:25.678777+0000","last_change":"2023-10-19T12:41:18.290347+0000","last_active":"2023-10-19T12:41:25.678777+0000","last_peered":"2023-10-19T12:41:25.678777+0000","last_clean":"2023-10-19T12:41:25.678777+0000","last_became_active":"2023-10-19T12:41:18.290050+0000","last_became_peered":"2023-10-19T12:41:18.290050+0000","last_unstale":"2023-10-19T12:41:25.678777+0000","last_undegraded":"2023-10-19T12:41:25.678777+0000","last_fullsized":"2023-10-19T12:41:25.678777+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:19:05.618338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.313574+0000","last_change":"2023-10-19T12:41:19.303753+0000","last_active":"2023-10-19T12:41:23.313574+0000","last_peered":"2023-10-19T12:41:23.313574+0000","last_clean":"2023-10-19T12:41:23.313574+0000","last_became_active":"2023-10-19T12:41:19.299710+0000","last_became_peered":"2023-10-19T12:41:19.299710+0000","last_unstale":"2023-10-19T12:41:23.313574+0000","last_undegraded":"2023-10-19T12:41:23.313574+0000","last_fullsized":"2023-10-19T12:41:23.313574+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:40:27.929956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:25.677655+0000","last_change":"2023-10-19T12:41:23.478159+0000","last_active":"2023-10-19T12:41:25.677655+0000","last_peered":"2023-10-19T12:41:25.677655+0000","last_clean":"2023-10-19T12:41:25.677655+0000","last_became_active":"2023-10-19T12:41:23.477647+0000","last_became_peered":"2023-10-19T12:41:23.477647+0000","last_unstale":"2023-10-19T12:41:25.677655+0000","last_undegraded":"2023-10-19T12:41:25.677655+0000","last_fullsized":"2023-10-19T12:41:25.677655+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:48:31.904477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"85'1","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.324454+0000","last_change":"2023-10-19T12:41:18.295746+0000","last_active":"2023-10-19T12:41:23.324454+0000","last_peered":"2023-10-19T12:41:23.324454+0000","last_clean":"2023-10-19T12:41:23.324454+0000","last_became_active":"2023-10-19T12:41:18.294855+0000","last_became_peered":"2023-10-19T12:41:18.294855+0000","last_unstale":"2023-10-19T12:41:23.324454+0000","last_undegraded":"2023-10-19T12:41:23.324454+0000","last_fullsized":"2023-10-19T12:41:23.324454+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:52:24.628136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.328276+0000","last_change":"2023-10-19T12:41:19.283960+0000","last_active":"2023-10-19T12:41:23.328276+0000","last_peered":"2023-10-19T12:41:23.328276+0000","last_clean":"2023-10-19T12:41:23.328276+0000","last_became_active":"2023-10-19T12:41:19.282544+0000","last_became_peered":"2023-10-19T12:41:19.282544+0000","last_unstale":"2023-10-19T12:41:23.328276+0000","last_undegraded":"2023-10-19T12:41:23.328276+0000","last_fullsized":"2023-10-19T12:41:23.328276+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T23:58:08.794192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:24.974529+0000","last_change":"2023-10-19T12:41:23.323593+0000","last_active":"2023-10-19T12:41:24.974529+0000","last_peered":"2023-10-19T12:41:24.974529+0000","last_clean":"2023-10-19T12:41:24.974529+0000","last_became_active":"2023-10-19T12:41:23.323204+0000","last_became_peered":"2023-10-19T12:41:23.323204+0000","last_unstale":"2023-10-19T12:41:24.974529+0000","last_undegraded":"2023-10-19T12:41:24.974529+0000","last_fullsized":"2023-10-19T12:41:24.974529+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:15:15.379085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"88'5","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:43.278164+0000","last_change":"2023-10-19T12:41:18.286231+0000","last_active":"2023-10-19T12:41:43.278164+0000","last_peered":"2023-10-19T12:41:43.278164+0000","last_clean":"2023-10-19T12:41:43.278164+0000","last_became_active":"2023-10-19T12:41:18.285932+0000","last_became_peered":"2023-10-19T12:41:18.285932+0000","last_unstale":"2023-10-19T12:41:43.278164+0000","last_undegraded":"2023-10-19T12:41:43.278164+0000","last_fullsized":"2023-10-19T12:41:43.278164+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:13:02.066468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.322823+0000","last_change":"2023-10-19T12:41:19.305534+0000","last_active":"2023-10-19T12:41:23.322823+0000","last_peered":"2023-10-19T12:41:23.322823+0000","last_clean":"2023-10-19T12:41:23.322823+0000","last_became_active":"2023-10-19T12:41:19.304994+0000","last_became_peered":"2023-10-19T12:41:19.304994+0000","last_unstale":"2023-10-19T12:41:23.322823+0000","last_undegraded":"2023-10-19T12:41:23.322823+0000","last_fullsized":"2023-10-19T12:41:23.322823+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:05:38.896173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:24.314878+0000","last_change":"2023-10-19T12:41:23.479129+0000","last_active":"2023-10-19T12:41:24.314878+0000","last_peered":"2023-10-19T12:41:24.314878+0000","last_clean":"2023-10-19T12:41:24.314878+0000","last_became_active":"2023-10-19T12:41:23.478518+0000","last_became_peered":"2023-10-19T12:41:23.478518+0000","last_unstale":"2023-10-19T12:41:24.314878+0000","last_undegraded":"2023-10-19T12:41:24.314878+0000","last_fullsized":"2023-10-19T12:41:24.314878+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:55:38.767504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"88'2","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:43.276813+0000","last_change":"2023-10-19T12:41:18.283269+0000","last_active":"2023-10-19T12:41:43.276813+0000","last_peered":"2023-10-19T12:41:43.276813+0000","last_clean":"2023-10-19T12:41:43.276813+0000","last_became_active":"2023-10-19T12:41:18.282913+0000","last_became_peered":"2023-10-19T12:41:18.282913+0000","last_unstale":"2023-10-19T12:41:43.276813+0000","last_undegraded":"2023-10-19T12:41:43.276813+0000","last_fullsized":"2023-10-19T12:41:43.276813+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:44:01.042312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.318847+0000","last_change":"2023-10-19T12:41:19.284222+0000","last_active":"2023-10-19T12:41:23.318847+0000","last_peered":"2023-10-19T12:41:23.318847+0000","last_clean":"2023-10-19T12:41:23.318847+0000","last_became_active":"2023-10-19T12:41:19.283914+0000","last_became_peered":"2023-10-19T12:41:19.283914+0000","last_unstale":"2023-10-19T12:41:23.318847+0000","last_undegraded":"2023-10-19T12:41:23.318847+0000","last_fullsized":"2023-10-19T12:41:23.318847+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:15:34.801502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:25.011335+0000","last_change":"2023-10-19T12:41:23.338071+0000","last_active":"2023-10-19T12:41:25.011335+0000","last_peered":"2023-10-19T12:41:25.011335+0000","last_clean":"2023-10-19T12:41:25.011335+0000","last_became_active":"2023-10-19T12:41:23.336265+0000","last_became_peered":"2023-10-19T12:41:23.336265+0000","last_unstale":"2023-10-19T12:41:25.011335+0000","last_undegraded":"2023-10-19T12:41:25.011335+0000","last_fullsized":"2023-10-19T12:41:25.011335+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:02:53.139468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"88'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:46.306875+0000","last_change":"2023-10-19T12:41:18.293027+0000","last_active":"2023-10-19T12:41:46.306875+0000","last_peered":"2023-10-19T12:41:46.306875+0000","last_clean":"2023-10-19T12:41:46.306875+0000","last_became_active":"2023-10-19T12:41:18.289478+0000","last_became_peered":"2023-10-19T12:41:18.289478+0000","last_unstale":"2023-10-19T12:41:46.306875+0000","last_undegraded":"2023-10-19T12:41:46.306875+0000","last_fullsized":"2023-10-19T12:41:46.306875+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:26:32.986754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.319785+0000","last_change":"2023-10-19T12:41:19.293206+0000","last_active":"2023-10-19T12:41:23.319785+0000","last_peered":"2023-10-19T12:41:23.319785+0000","last_clean":"2023-10-19T12:41:23.319785+0000","last_became_active":"2023-10-19T12:41:19.292898+0000","last_became_peered":"2023-10-19T12:41:19.292898+0000","last_unstale":"2023-10-19T12:41:23.319785+0000","last_undegraded":"2023-10-19T12:41:23.319785+0000","last_fullsized":"2023-10-19T12:41:23.319785+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T23:36:17.548859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:24.314867+0000","last_change":"2023-10-19T12:41:23.343048+0000","last_active":"2023-10-19T12:41:24.314867+0000","last_peered":"2023-10-19T12:41:24.314867+0000","last_clean":"2023-10-19T12:41:24.314867+0000","last_became_active":"2023-10-19T12:41:23.342696+0000","last_became_peered":"2023-10-19T12:41:23.342696+0000","last_unstale":"2023-10-19T12:41:24.314867+0000","last_undegraded":"2023-10-19T12:41:24.314867+0000","last_fullsized":"2023-10-19T12:41:24.314867+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:30:38.858947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"88'2","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:45.299861+0000","last_change":"2023-10-19T12:41:18.293079+0000","last_active":"2023-10-19T12:41:45.299861+0000","last_peered":"2023-10-19T12:41:45.299861+0000","last_clean":"2023-10-19T12:41:45.299861+0000","last_became_active":"2023-10-19T12:41:18.292803+0000","last_became_peered":"2023-10-19T12:41:18.292803+0000","last_unstale":"2023-10-19T12:41:45.299861+0000","last_undegraded":"2023-10-19T12:41:45.299861+0000","last_fullsized":"2023-10-19T12:41:45.299861+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T22:37:14.550800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.327908+0000","last_change":"2023-10-19T12:41:19.292921+0000","last_active":"2023-10-19T12:41:23.327908+0000","last_peered":"2023-10-19T12:41:23.327908+0000","last_clean":"2023-10-19T12:41:23.327908+0000","last_became_active":"2023-10-19T12:41:19.292498+0000","last_became_peered":"2023-10-19T12:41:19.292498+0000","last_unstale":"2023-10-19T12:41:23.327908+0000","last_undegraded":"2023-10-19T12:41:23.327908+0000","last_fullsized":"2023-10-19T12:41:23.327908+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T22:02:55.878154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:24.314917+0000","last_change":"2023-10-19T12:41:23.477894+0000","last_active":"2023-10-19T12:41:24.314917+0000","last_peered":"2023-10-19T12:41:24.314917+0000","last_clean":"2023-10-19T12:41:24.314917+0000","last_became_active":"2023-10-19T12:41:23.477478+0000","last_became_peered":"2023-10-19T12:41:23.477478+0000","last_unstale":"2023-10-19T12:41:24.314917+0000","last_undegraded":"2023-10-19T12:41:24.314917+0000","last_fullsized":"2023-10-19T12:41:24.314917+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:44:21.730215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"88'4","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:43.277225+0000","last_change":"2023-10-19T12:41:18.282474+0000","last_active":"2023-10-19T12:41:43.277225+0000","last_peered":"2023-10-19T12:41:43.277225+0000","last_clean":"2023-10-19T12:41:43.277225+0000","last_became_active":"2023-10-19T12:41:18.282124+0000","last_became_peered":"2023-10-19T12:41:18.282124+0000","last_unstale":"2023-10-19T12:41:43.277225+0000","last_undegraded":"2023-10-19T12:41:43.277225+0000","last_fullsized":"2023-10-19T12:41:43.277225+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T21:27:37.530324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.318464+0000","last_change":"2023-10-19T12:41:19.302928+0000","last_active":"2023-10-19T12:41:23.318464+0000","last_peered":"2023-10-19T12:41:23.318464+0000","last_clean":"2023-10-19T12:41:23.318464+0000","last_became_active":"2023-10-19T12:41:19.302641+0000","last_became_peered":"2023-10-19T12:41:19.302641+0000","last_unstale":"2023-10-19T12:41:23.318464+0000","last_undegraded":"2023-10-19T12:41:23.318464+0000","last_fullsized":"2023-10-19T12:41:23.318464+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:07:46.333875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:25.678248+0000","last_change":"2023-10-19T12:41:23.329079+0000","last_active":"2023-10-19T12:41:25.678248+0000","last_peered":"2023-10-19T12:41:25.678248+0000","last_clean":"2023-10-19T12:41:25.678248+0000","last_became_active":"2023-10-19T12:41:23.328407+0000","last_became_peered":"2023-10-19T12:41:23.328407+0000","last_unstale":"2023-10-19T12:41:25.678248+0000","last_undegraded":"2023-10-19T12:41:25.678248+0000","last_fullsized":"2023-10-19T12:41:25.678248+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:46:19.404922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"88'6","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:45.300926+0000","last_change":"2023-10-19T12:41:18.286336+0000","last_active":"2023-10-19T12:41:45.300926+0000","last_peered":"2023-10-19T12:41:45.300926+0000","last_clean":"2023-10-19T12:41:45.300926+0000","last_became_active":"2023-10-19T12:41:18.285921+0000","last_became_peered":"2023-10-19T12:41:18.285921+0000","last_unstale":"2023-10-19T12:41:45.300926+0000","last_undegraded":"2023-10-19T12:41:45.300926+0000","last_fullsized":"2023-10-19T12:41:45.300926+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T23:16:34.842143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1560,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.318758+0000","last_change":"2023-10-19T12:41:19.289466+0000","last_active":"2023-10-19T12:41:23.318758+0000","last_peered":"2023-10-19T12:41:23.318758+0000","last_clean":"2023-10-19T12:41:23.318758+0000","last_became_active":"2023-10-19T12:41:19.288669+0000","last_became_peered":"2023-10-19T12:41:19.288669+0000","last_unstale":"2023-10-19T12:41:23.318758+0000","last_undegraded":"2023-10-19T12:41:23.318758+0000","last_fullsized":"2023-10-19T12:41:23.318758+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T23:31:52.163958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:25.721656+0000","last_change":"2023-10-19T12:41:23.343521+0000","last_active":"2023-10-19T12:41:25.721656+0000","last_peered":"2023-10-19T12:41:25.721656+0000","last_clean":"2023-10-19T12:41:25.721656+0000","last_became_active":"2023-10-19T12:41:23.342288+0000","last_became_peered":"2023-10-19T12:41:23.342288+0000","last_unstale":"2023-10-19T12:41:25.721656+0000","last_undegraded":"2023-10-19T12:41:25.721656+0000","last_fullsized":"2023-10-19T12:41:25.721656+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:58:06.810552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"88'2","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:25.679287+0000","last_change":"2023-10-19T12:41:18.294999+0000","last_active":"2023-10-19T12:41:25.679287+0000","last_peered":"2023-10-19T12:41:25.679287+0000","last_clean":"2023-10-19T12:41:25.679287+0000","last_became_active":"2023-10-19T12:41:18.294776+0000","last_became_peered":"2023-10-19T12:41:18.294776+0000","last_unstale":"2023-10-19T12:41:25.679287+0000","last_undegraded":"2023-10-19T12:41:25.679287+0000","last_fullsized":"2023-10-19T12:41:25.679287+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:17:53.704739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.321135+0000","last_change":"2023-10-19T12:41:19.291753+0000","last_active":"2023-10-19T12:41:23.321135+0000","last_peered":"2023-10-19T12:41:23.321135+0000","last_clean":"2023-10-19T12:41:23.321135+0000","last_became_active":"2023-10-19T12:41:19.291475+0000","last_became_peered":"2023-10-19T12:41:19.291475+0000","last_unstale":"2023-10-19T12:41:23.321135+0000","last_undegraded":"2023-10-19T12:41:23.321135+0000","last_fullsized":"2023-10-19T12:41:23.321135+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:26:38.494864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:25.678430+0000","last_change":"2023-10-19T12:41:23.327966+0000","last_active":"2023-10-19T12:41:25.678430+0000","last_peered":"2023-10-19T12:41:25.678430+0000","last_clean":"2023-10-19T12:41:25.678430+0000","last_became_active":"2023-10-19T12:41:23.327555+0000","last_became_peered":"2023-10-19T12:41:23.327555+0000","last_unstale":"2023-10-19T12:41:25.678430+0000","last_undegraded":"2023-10-19T12:41:25.678430+0000","last_fullsized":"2023-10-19T12:41:25.678430+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:01:34.044012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"88'3","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:25.181195+0000","last_change":"2023-10-19T12:41:18.297472+0000","last_active":"2023-10-19T12:41:25.181195+0000","last_peered":"2023-10-19T12:41:25.181195+0000","last_clean":"2023-10-19T12:41:25.181195+0000","last_became_active":"2023-10-19T12:41:18.296410+0000","last_became_peered":"2023-10-19T12:41:18.296410+0000","last_unstale":"2023-10-19T12:41:25.181195+0000","last_undegraded":"2023-10-19T12:41:25.181195+0000","last_fullsized":"2023-10-19T12:41:25.181195+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:20:15.039332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.318065+0000","last_change":"2023-10-19T12:41:19.295136+0000","last_active":"2023-10-19T12:41:23.318065+0000","last_peered":"2023-10-19T12:41:23.318065+0000","last_clean":"2023-10-19T12:41:23.318065+0000","last_became_active":"2023-10-19T12:41:19.294836+0000","last_became_peered":"2023-10-19T12:41:19.294836+0000","last_unstale":"2023-10-19T12:41:23.318065+0000","last_undegraded":"2023-10-19T12:41:23.318065+0000","last_fullsized":"2023-10-19T12:41:23.318065+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:08:25.830396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.319830+0000","last_change":"2023-10-19T12:41:19.290047+0000","last_active":"2023-10-19T12:41:23.319830+0000","last_peered":"2023-10-19T12:41:23.319830+0000","last_clean":"2023-10-19T12:41:23.319830+0000","last_became_active":"2023-10-19T12:41:19.289792+0000","last_became_peered":"2023-10-19T12:41:19.289792+0000","last_unstale":"2023-10-19T12:41:23.319830+0000","last_undegraded":"2023-10-19T12:41:23.319830+0000","last_fullsized":"2023-10-19T12:41:23.319830+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:10:58.981643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.319390+0000","last_change":"2023-10-19T12:41:19.287973+0000","last_active":"2023-10-19T12:41:23.319390+0000","last_peered":"2023-10-19T12:41:23.319390+0000","last_clean":"2023-10-19T12:41:23.319390+0000","last_became_active":"2023-10-19T12:41:19.287508+0000","last_became_peered":"2023-10-19T12:41:19.287508+0000","last_unstale":"2023-10-19T12:41:23.319390+0000","last_undegraded":"2023-10-19T12:41:23.319390+0000","last_fullsized":"2023-10-19T12:41:23.319390+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:25:57.815032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.317537+0000","last_change":"2023-10-19T12:41:19.294154+0000","last_active":"2023-10-19T12:41:23.317537+0000","last_peered":"2023-10-19T12:41:23.317537+0000","last_clean":"2023-10-19T12:41:23.317537+0000","last_became_active":"2023-10-19T12:41:19.293873+0000","last_became_peered":"2023-10-19T12:41:19.293873+0000","last_unstale":"2023-10-19T12:41:23.317537+0000","last_undegraded":"2023-10-19T12:41:23.317537+0000","last_fullsized":"2023-10-19T12:41:23.317537+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:29:58.428571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.321636+0000","last_change":"2023-10-19T12:41:19.309512+0000","last_active":"2023-10-19T12:41:23.321636+0000","last_peered":"2023-10-19T12:41:23.321636+0000","last_clean":"2023-10-19T12:41:23.321636+0000","last_became_active":"2023-10-19T12:41:19.309149+0000","last_became_peered":"2023-10-19T12:41:19.309149+0000","last_unstale":"2023-10-19T12:41:23.321636+0000","last_undegraded":"2023-10-19T12:41:23.321636+0000","last_fullsized":"2023-10-19T12:41:23.321636+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:19:34.971413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.313652+0000","last_change":"2023-10-19T12:41:19.301496+0000","last_active":"2023-10-19T12:41:23.313652+0000","last_peered":"2023-10-19T12:41:23.313652+0000","last_clean":"2023-10-19T12:41:23.313652+0000","last_became_active":"2023-10-19T12:41:19.299697+0000","last_became_peered":"2023-10-19T12:41:19.299697+0000","last_unstale":"2023-10-19T12:41:23.313652+0000","last_undegraded":"2023-10-19T12:41:23.313652+0000","last_fullsized":"2023-10-19T12:41:23.313652+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T23:51:52.448215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.317056+0000","last_change":"2023-10-19T12:41:19.289995+0000","last_active":"2023-10-19T12:41:23.317056+0000","last_peered":"2023-10-19T12:41:23.317056+0000","last_clean":"2023-10-19T12:41:23.317056+0000","last_became_active":"2023-10-19T12:41:19.289471+0000","last_became_peered":"2023-10-19T12:41:19.289471+0000","last_unstale":"2023-10-19T12:41:23.317056+0000","last_undegraded":"2023-10-19T12:41:23.317056+0000","last_fullsized":"2023-10-19T12:41:23.317056+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:28:25.801772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.317535+0000","last_change":"2023-10-19T12:41:19.287620+0000","last_active":"2023-10-19T12:41:23.317535+0000","last_peered":"2023-10-19T12:41:23.317535+0000","last_clean":"2023-10-19T12:41:23.317535+0000","last_became_active":"2023-10-19T12:41:19.287298+0000","last_became_peered":"2023-10-19T12:41:19.287298+0000","last_unstale":"2023-10-19T12:41:23.317535+0000","last_undegraded":"2023-10-19T12:41:23.317535+0000","last_fullsized":"2023-10-19T12:41:23.317535+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:01:46.919580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.328365+0000","last_change":"2023-10-19T12:41:19.278455+0000","last_active":"2023-10-19T12:41:23.328365+0000","last_peered":"2023-10-19T12:41:23.328365+0000","last_clean":"2023-10-19T12:41:23.328365+0000","last_became_active":"2023-10-19T12:41:19.278093+0000","last_became_peered":"2023-10-19T12:41:19.278093+0000","last_unstale":"2023-10-19T12:41:23.328365+0000","last_undegraded":"2023-10-19T12:41:23.328365+0000","last_fullsized":"2023-10-19T12:41:23.328365+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T22:52:00.939409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.325385+0000","last_change":"2023-10-19T12:41:19.294478+0000","last_active":"2023-10-19T12:41:23.325385+0000","last_peered":"2023-10-19T12:41:23.325385+0000","last_clean":"2023-10-19T12:41:23.325385+0000","last_became_active":"2023-10-19T12:41:19.294136+0000","last_became_peered":"2023-10-19T12:41:19.294136+0000","last_unstale":"2023-10-19T12:41:23.325385+0000","last_undegraded":"2023-10-19T12:41:23.325385+0000","last_fullsized":"2023-10-19T12:41:23.325385+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:18:20.066346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.323008+0000","last_change":"2023-10-19T12:41:19.283014+0000","last_active":"2023-10-19T12:41:23.323008+0000","last_peered":"2023-10-19T12:41:23.323008+0000","last_clean":"2023-10-19T12:41:23.323008+0000","last_became_active":"2023-10-19T12:41:19.279958+0000","last_became_peered":"2023-10-19T12:41:19.279958+0000","last_unstale":"2023-10-19T12:41:23.323008+0000","last_undegraded":"2023-10-19T12:41:23.323008+0000","last_fullsized":"2023-10-19T12:41:23.323008+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-21T00:26:13.329031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.313332+0000","last_change":"2023-10-19T12:41:19.296507+0000","last_active":"2023-10-19T12:41:23.313332+0000","last_peered":"2023-10-19T12:41:23.313332+0000","last_clean":"2023-10-19T12:41:23.313332+0000","last_became_active":"2023-10-19T12:41:19.295960+0000","last_became_peered":"2023-10-19T12:41:19.295960+0000","last_unstale":"2023-10-19T12:41:23.313332+0000","last_undegraded":"2023-10-19T12:41:23.313332+0000","last_fullsized":"2023-10-19T12:41:23.313332+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T22:49:06.224425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.312867+0000","last_change":"2023-10-19T12:41:19.300262+0000","last_active":"2023-10-19T12:41:23.312867+0000","last_peered":"2023-10-19T12:41:23.312867+0000","last_clean":"2023-10-19T12:41:23.312867+0000","last_became_active":"2023-10-19T12:41:19.299702+0000","last_became_peered":"2023-10-19T12:41:19.299702+0000","last_unstale":"2023-10-19T12:41:23.312867+0000","last_undegraded":"2023-10-19T12:41:23.312867+0000","last_fullsized":"2023-10-19T12:41:23.312867+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:30:22.690228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.320102+0000","last_change":"2023-10-19T12:41:19.289863+0000","last_active":"2023-10-19T12:41:23.320102+0000","last_peered":"2023-10-19T12:41:23.320102+0000","last_clean":"2023-10-19T12:41:23.320102+0000","last_became_active":"2023-10-19T12:41:19.289556+0000","last_became_peered":"2023-10-19T12:41:19.289556+0000","last_unstale":"2023-10-19T12:41:23.320102+0000","last_undegraded":"2023-10-19T12:41:23.320102+0000","last_fullsized":"2023-10-19T12:41:23.320102+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:17:18.560081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":12288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":9836,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":156,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":368640,"data_stored":63274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":138,"ondisk_log_size":138,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":79,"seq":339302416402,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":983040,"data_stored":475462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 19 12:41:32 2023","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":8.5449999999999999,"5min":8.5449999999999999,"15min":8.5449999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":7.641,"5min":7.641,"15min":7.641},"last":0.56499999999999995}]},{"osd":1,"last update":"Thu Oct 19 12:41:32 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.883,"5min":1.883,"15min":1.883},"last":0.65300000000000002}]},{"osd":2,"last update":"Thu Oct 19 12:41:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.496,"5min":1.496,"15min":1.496},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.52700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":4,"last update":"Thu Oct 19 12:41:32 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":3.5190000000000001,"5min":3.5190000000000001,"15min":3.5190000000000001},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.72299999999999998}]},{"osd":5,"last update":"Thu Oct 19 12:41:32 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.675,"5min":1.675,"15min":1.675},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":2.089,"5min":2.089,"15min":2.089},"last":0.75}]},{"osd":6,"last update":"Thu Oct 19 12:41:32 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":2.004,"5min":2.004,"15min":2.004},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.704,"5min":1.704,"15min":1.704},"last":0.59199999999999997}]},{"osd":7,"last update":"Thu Oct 19 12:41:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":6.5590000000000002,"5min":6.5590000000000002,"15min":6.5590000000000002},"last":0.82099999999999995},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":7.3070000000000004,"5min":7.3070000000000004,"15min":7.3070000000000004},"last":0.871}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82999999999999996}]},{"osd":9,"last update":"Thu Oct 19 12:41:32 2023","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":7.8440000000000003,"5min":7.8440000000000003,"15min":7.8440000000000003},"last":0.84799999999999998},{"interface":"front","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":5.0860000000000003,"5min":5.0860000000000003,"15min":5.0860000000000003},"last":0.90000000000000002}]},{"osd":10,"last update":"Thu Oct 19 12:41:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":7.2619999999999996,"5min":7.2619999999999996,"15min":7.2619999999999996},"last":0.91200000000000003},{"interface":"front","average":{"1min":1.153,"5min":1.153,"15min":1.153},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":7.7619999999999996,"5min":7.7619999999999996,"15min":7.7619999999999996},"last":0.88900000000000001}]}]},{"osd":10,"up_from":72,"seq":309237645333,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28580,"kb_used_data":1564,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716572,"statfs":{"total":95995035648,"available":95965769728,"internally_reserved":0,"allocated":1601536,"data_stored":1065241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":1,"last update":"Thu Oct 19 12:41:11 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.504},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.627,"5min":0.627,"15min":0.627},"last":0.47799999999999998}]},{"osd":2,"last update":"Thu Oct 19 12:41:11 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":2.0659999999999998,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":2.2050000000000001,"5min":2.2050000000000001,"15min":2.2050000000000001},"last":0.63100000000000001}]},{"osd":3,"last update":"Thu Oct 19 12:41:11 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.68000000000000005}]},{"osd":4,"last update":"Thu Oct 19 12:41:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.64400000000000002}]},{"osd":5,"last update":"Thu Oct 19 12:41:11 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":2.3940000000000001,"5min":2.3940000000000001,"15min":2.3940000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":2.2530000000000001,"5min":2.2530000000000001,"15min":2.2530000000000001},"last":0.71299999999999997}]},{"osd":6,"last update":"Thu Oct 19 12:41:11 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.83599999999999997}]},{"osd":7,"last update":"Thu Oct 19 12:41:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":1.046}]},{"osd":8,"last update":"Thu Oct 19 12:41:11 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":2.012,"5min":2.012,"15min":2.012},"last":0.748},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":2.2290000000000001,"5min":2.2290000000000001,"15min":2.2290000000000001},"last":0.76000000000000001}]},{"osd":9,"last update":"Thu Oct 19 12:41:11 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.78500000000000003}]},{"osd":11,"last update":"Thu Oct 19 12:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.86399999999999999}]}]},{"osd":9,"up_from":67,"seq":287762808857,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":983040,"data_stored":470568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 19 12:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.44900000000000001}]},{"osd":1,"last update":"Thu Oct 19 12:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.80600000000000005}]},{"osd":2,"last update":"Thu Oct 19 12:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.76100000000000001}]},{"osd":3,"last update":"Thu Oct 19 12:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.82199999999999995}]},{"osd":4,"last update":"Thu Oct 19 12:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.70199999999999996}]},{"osd":5,"last update":"Thu Oct 19 12:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.54300000000000004}]},{"osd":6,"last update":"Thu Oct 19 12:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.49399999999999999}]},{"osd":7,"last update":"Thu Oct 19 12:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.84299999999999997},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":1.6930000000000001,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":0.96599999999999997}]},{"osd":8,"last update":"Thu Oct 19 12:40:51 2023","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.048,"15min":1.048},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.61299999999999999}]},{"osd":10,"last update":"Thu Oct 19 12:41:10 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.878}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]}]},{"osd":8,"up_from":59,"seq":253403070493,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":978944,"data_stored":470410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 19 12:41:25 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.60099999999999998,"15min":0.60499999999999998},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.77500000000000002,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.58699999999999997,"15min":0.59099999999999997},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.86299999999999999,"5min":0.872,"15min":0.872},"last":0.63800000000000001}]},{"osd":1,"last update":"Thu Oct 19 12:41:25 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.59899999999999998,"15min":0.59699999999999998},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.79500000000000004,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.58899999999999997,"15min":0.58199999999999996},"min":{"1min":0.41899999999999998,"5min":0.38,"15min":0.38},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.89600000000000002}]},{"osd":2,"last update":"Thu Oct 19 12:41:25 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.46400000000000002,"15min":0.46500000000000002},"min":{"1min":0.30599999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46200000000000002,"15min":0.46200000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.67100000000000004}]},{"osd":3,"last update":"Thu Oct 19 12:41:25 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.622,"15min":0.628},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.74399999999999999,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.64000000000000001,"15min":0.65100000000000002},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.67400000000000004,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.754}]},{"osd":4,"last update":"Thu Oct 19 12:41:25 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.68799999999999994,"15min":0.69299999999999995},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.85799999999999998,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.82699999999999996,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.98999999999999999}]},{"osd":5,"last update":"Thu Oct 19 12:41:25 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.54600000000000004,"15min":0.55100000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.77800000000000002,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.59799999999999998,"15min":0.60999999999999999},"min":{"1min":0.34699999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.89400000000000002,"5min":1.01,"15min":1.01},"last":0.93899999999999995}]},{"osd":6,"last update":"Thu Oct 19 12:41:25 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.71299999999999997,"15min":0.72099999999999997},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.90500000000000003,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.70299999999999996,"15min":0.71099999999999997},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.82599999999999996,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.88100000000000001}]},{"osd":7,"last update":"Thu Oct 19 12:41:25 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.73199999999999998,"15min":0.73299999999999998},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.94099999999999995,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":1.042},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.76100000000000001,"15min":0.76900000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0720000000000001,"5min":1.113,"15min":1.113},"last":1.004}]},{"osd":9,"last update":"Thu Oct 19 12:40:49 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":1.03},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":1.0209999999999999}]},{"osd":10,"last update":"Thu Oct 19 12:41:14 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.97599999999999998},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":1.0529999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0640000000000001}]}]},{"osd":7,"up_from":51,"seq":219043332131,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28576,"kb_used_data":1560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716576,"statfs":{"total":95995035648,"available":95965773824,"internally_reserved":0,"allocated":1597440,"data_stored":1067390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 19 12:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.61899999999999999,"15min":0.60899999999999999},"min":{"1min":0.434,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.56699999999999995,"15min":0.56299999999999994},"min":{"1min":0.46400000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.76600000000000001,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.45400000000000001}]},{"osd":1,"last update":"Thu Oct 19 12:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.41199999999999998,"15min":0.40600000000000003},"min":{"1min":0.29599999999999999,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.42799999999999999,"15min":0.42399999999999999},"min":{"1min":0.26700000000000002,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.69499999999999995,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.29299999999999998}]},{"osd":2,"last update":"Thu Oct 19 12:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.59299999999999997,"15min":0.59499999999999997},"min":{"1min":0.40000000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.61399999999999999,"15min":0.61799999999999999},"min":{"1min":0.39200000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.59799999999999998}]},{"osd":3,"last update":"Thu Oct 19 12:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.64000000000000001,"15min":0.63100000000000001},"min":{"1min":0.47799999999999998,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.63,"5min":0.61699999999999999,"15min":0.61499999999999999},"min":{"1min":0.42199999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.52200000000000002}]},{"osd":4,"last update":"Thu Oct 19 12:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.51100000000000001,"15min":0.505},"min":{"1min":0.34300000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.48699999999999999,"15min":0.48099999999999998},"min":{"1min":0.316,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.45100000000000001}]},{"osd":5,"last update":"Thu Oct 19 12:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.67700000000000005,"15min":0.67500000000000004},"min":{"1min":0.46800000000000003,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.753},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.63800000000000001,"15min":0.63600000000000001},"min":{"1min":0.51900000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.73599999999999999}]},{"osd":6,"last update":"Thu Oct 19 12:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.73699999999999999,"15min":0.73099999999999998},"min":{"1min":0.53400000000000003,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.624},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.67400000000000004,"15min":0.66900000000000004},"min":{"1min":0.44800000000000001,"5min":0.435,"15min":0.435},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.50700000000000001}]},{"osd":8,"last update":"Thu Oct 19 12:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.71699999999999997,"15min":0.72099999999999997},"min":{"1min":0.45400000000000001,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.52100000000000002,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.69199999999999995}]},{"osd":9,"last update":"Thu Oct 19 12:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.54100000000000004}]},{"osd":10,"last update":"Thu Oct 19 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.71199999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]}]},{"osd":6,"up_from":46,"seq":197568495655,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":970752,"data_stored":469874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 19 12:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.48799999999999999,"15min":0.48299999999999998},"min":{"1min":0.33400000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.54700000000000004,"15min":0.55100000000000005},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.72099999999999997,"5min":1.107,"15min":1.107},"last":0.50700000000000001}]},{"osd":1,"last update":"Thu Oct 19 12:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.61899999999999999,"15min":0.61299999999999999},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.68000000000000005,"15min":0.67000000000000004},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.97099999999999997,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.76900000000000002}]},{"osd":2,"last update":"Thu Oct 19 12:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.67900000000000005,"15min":0.67700000000000005},"min":{"1min":0.48899999999999999,"5min":0.437,"15min":0.437},"max":{"1min":0.91200000000000003,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.46100000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.84699999999999998,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.88500000000000001}]},{"osd":3,"last update":"Thu Oct 19 12:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.70199999999999996,"15min":0.70399999999999996},"min":{"1min":0.439,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.98099999999999998,"5min":1.093,"15min":1.093},"last":0.71699999999999997}]},{"osd":4,"last update":"Thu Oct 19 12:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.77100000000000002,"15min":0.77200000000000002},"min":{"1min":0.55400000000000005,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0289999999999999,"5min":1.179,"15min":1.179},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.748,"5min":0.77900000000000003,"15min":0.78400000000000003},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.008,"5min":1.01,"15min":1.01},"last":0.75}]},{"osd":5,"last update":"Thu Oct 19 12:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.81599999999999995,"15min":0.81000000000000005},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.0509999999999999,"5min":1.177,"15min":1.177},"last":1.0149999999999999},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.82399999999999995,"15min":0.82599999999999996},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.0349999999999999,"5min":1.534,"15min":1.534},"last":0.92600000000000005}]},{"osd":7,"last update":"Thu Oct 19 12:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.82199999999999995,"15min":0.80800000000000005},"min":{"1min":0.63,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.1319999999999999,"5min":1.151,"15min":1.151},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.85099999999999998,"15min":0.84899999999999998},"min":{"1min":0.67600000000000005,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.86899999999999999}]},{"osd":8,"last update":"Thu Oct 19 12:41:30 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.88300000000000001,"15min":0.88700000000000001},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.1220000000000001,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.89800000000000002,"15min":0.90800000000000003},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.073,"5min":1.107,"15min":1.107},"last":0.97499999999999998}]},{"osd":9,"last update":"Thu Oct 19 12:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.70399999999999996},{"interface":"front","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.98999999999999999}]},{"osd":10,"last update":"Thu Oct 19 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":1.002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0229999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574910,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1011712,"data_stored":492759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 19 12:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.63900000000000001,"15min":0.59099999999999997},"min":{"1min":0.40699999999999997,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.77900000000000003,"5min":8.4559999999999995,"15min":8.4559999999999995},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.62,"5min":0.57299999999999995,"15min":0.56200000000000006},"min":{"1min":0.376,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.502}]},{"osd":2,"last update":"Thu Oct 19 12:41:14 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56100000000000005,"15min":0.59899999999999998},"min":{"1min":0.44500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.72999999999999998,"5min":4.1710000000000003,"15min":4.1710000000000003},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.52100000000000002,"15min":0.503},"min":{"1min":0.374,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.57999999999999996}]},{"osd":3,"last update":"Thu Oct 19 12:41:37 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60499999999999998,"15min":0.58899999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.83699999999999997,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.56599999999999995,"15min":0.55800000000000005},"min":{"1min":0.434,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.627}]},{"osd":4,"last update":"Thu Oct 19 12:41:02 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.40799999999999997,"15min":0.39600000000000002},"min":{"1min":0.27800000000000002,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.67800000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.41799999999999998,"15min":0.40000000000000002},"min":{"1min":0.29099999999999998,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.72399999999999998,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.379}]},{"osd":5,"last update":"Thu Oct 19 12:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53300000000000003},"min":{"1min":0.39000000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.69699999999999995,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.56799999999999995,"15min":0.56000000000000005},"min":{"1min":0.38900000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.874,"5min":1.03,"15min":1.03},"last":0.68400000000000005}]},{"osd":6,"last update":"Thu Oct 19 12:40:46 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.68999999999999995,"15min":0.68700000000000006},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.94799999999999995,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.751},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.93300000000000005,"15min":0.97699999999999998},"min":{"1min":0.48799999999999999,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.97299999999999998,"5min":8.4039999999999999,"15min":8.4039999999999999},"last":0.45000000000000001}]},{"osd":7,"last update":"Thu Oct 19 12:41:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.60599999999999998,"15min":0.60799999999999998},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.89600000000000002,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.58699999999999997,"15min":0.59099999999999997},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.78300000000000003,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.40300000000000002}]},{"osd":8,"last update":"Thu Oct 19 12:41:26 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.623,"15min":0.621},"min":{"1min":0.44900000000000001,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.93500000000000005,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72899999999999998,"15min":0.72999999999999998},"min":{"1min":0.54800000000000004,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0580000000000001,"5min":1.117,"15min":1.117},"last":0.77500000000000002}]},{"osd":9,"last update":"Thu Oct 19 12:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.51900000000000002}]},{"osd":10,"last update":"Thu Oct 19 12:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.70699999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]}]},{"osd":0,"up_from":8,"seq":34359738435,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":978944,"data_stored":470478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Oct 19 12:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.57799999999999996,"15min":0.55800000000000005},"min":{"1min":0.42799999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.58999999999999997,"15min":0.55900000000000005},"min":{"1min":0.39200000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.495}]},{"osd":2,"last update":"Thu Oct 19 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.621,"15min":0.60799999999999998},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.60099999999999998,"15min":0.56499999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.70899999999999996}]},{"osd":3,"last update":"Thu Oct 19 12:39:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.48099999999999998,"15min":0.46999999999999997},"min":{"1min":0.36899999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52900000000000003,"15min":0.53000000000000003},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.56899999999999995}]},{"osd":4,"last update":"Thu Oct 19 12:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.67000000000000004,"15min":0.63700000000000001},"min":{"1min":0.51800000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.0409999999999999,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.65200000000000002,"15min":0.63200000000000001},"min":{"1min":0.50800000000000001,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.1279999999999999,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.68100000000000005}]},{"osd":5,"last update":"Thu Oct 19 12:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.67600000000000005,"15min":0.66300000000000003},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.137,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.69699999999999995,"15min":0.68999999999999995},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.462,"5min":1.462,"15min":1.462},"last":0.63800000000000001}]},{"osd":6,"last update":"Thu Oct 19 12:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.66800000000000004,"15min":0.66000000000000003},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.65900000000000003,"15min":0.65000000000000002},"min":{"1min":0.379,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.6160000000000001,"5min":1.6160000000000001,"15min":1.6160000000000001},"last":0.46899999999999997}]},{"osd":7,"last update":"Thu Oct 19 12:41:05 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.78800000000000003,"15min":0.77400000000000002},"min":{"1min":0.61799999999999999,"5min":0.503,"15min":0.503},"max":{"1min":1.5960000000000001,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.877,"5min":0.76100000000000001,"15min":0.74099999999999999},"min":{"1min":0.54300000000000004,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.51,"5min":1.51,"15min":1.51},"last":0.65900000000000003}]},{"osd":8,"last update":"Thu Oct 19 12:41:28 2023","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":0.86499999999999999,"15min":0.81899999999999995},"min":{"1min":0.54000000000000004,"5min":0.503,"15min":0.503},"max":{"1min":6.8730000000000002,"5min":6.8730000000000002,"15min":6.8730000000000002},"last":0.628},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.83299999999999996,"15min":0.83099999999999996},"min":{"1min":0.57899999999999996,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.528,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.73099999999999998}]},{"osd":9,"last update":"Thu Oct 19 12:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.60199999999999998}]},{"osd":10,"last update":"Thu Oct 19 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.5720000000000001,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":0.54900000000000004}]},{"osd":11,"last update":"Thu Oct 19 12:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.72099999999999997}]}]},{"osd":2,"up_from":18,"seq":77309411387,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1032192,"data_stored":493369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 19 12:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.57599999999999996,"15min":0.56999999999999995},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.90200000000000002,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.56200000000000006,"15min":0.56000000000000005},"min":{"1min":0.35399999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.94899999999999995,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.69499999999999995}]},{"osd":1,"last update":"Thu Oct 19 12:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.55100000000000005,"15min":0.54600000000000004},"min":{"1min":0.40799999999999997,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.76700000000000002,"5min":1.081,"15min":1.081},"last":0.99299999999999999},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.56999999999999995,"15min":0.55600000000000005},"min":{"1min":0.37,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.97799999999999998,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.79000000000000004}]},{"osd":3,"last update":"Thu Oct 19 12:41:38 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59899999999999998,"15min":0.58699999999999997},"min":{"1min":0.40899999999999997,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.82699999999999996,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.58999999999999997,"15min":0.60199999999999998},"min":{"1min":0.437,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.81599999999999995,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.54600000000000004}]},{"osd":4,"last update":"Thu Oct 19 12:40:58 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.57999999999999996,"15min":0.58099999999999996},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.83399999999999996,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.57599999999999996,"15min":0.56399999999999995},"min":{"1min":0.41599999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.81499999999999995}]},{"osd":5,"last update":"Thu Oct 19 12:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.46500000000000002,"15min":0.44400000000000001},"min":{"1min":0.318,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.48199999999999998,"15min":0.46400000000000002},"min":{"1min":0.30099999999999999,"5min":0.25,"15min":0.25},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.66000000000000003}]},{"osd":6,"last update":"Thu Oct 19 12:41:46 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.66000000000000003,"15min":0.64100000000000001},"min":{"1min":0.56399999999999995,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.66800000000000004,"15min":0.66000000000000003},"min":{"1min":0.56299999999999994,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.88400000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.748}]},{"osd":7,"last update":"Thu Oct 19 12:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.64800000000000002,"15min":0.64700000000000002},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.86499999999999999,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":1.0189999999999999},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.68500000000000005,"15min":0.68300000000000005},"min":{"1min":0.46000000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.95399999999999996}]},{"osd":8,"last update":"Thu Oct 19 12:41:26 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.65200000000000002,"15min":0.65800000000000003},"min":{"1min":0.38500000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.85099999999999998,"5min":1.429,"15min":1.429},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.66800000000000004,"15min":0.66600000000000004},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.93500000000000005,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.82999999999999996}]},{"osd":9,"last update":"Thu Oct 19 12:40:49 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.96899999999999997},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.85099999999999998}]},{"osd":10,"last update":"Thu Oct 19 12:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":1.0720000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]}]},{"osd":3,"up_from":25,"seq":107374182454,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":995328,"data_stored":470214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 19 12:41:39 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.44900000000000001,"15min":0.433},"min":{"1min":0.318,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.70499999999999996,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.45700000000000002,"15min":0.41499999999999998},"min":{"1min":0.38400000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.65100000000000002,"5min":1.044,"15min":1.044},"last":0.48699999999999999}]},{"osd":1,"last update":"Thu Oct 19 12:41:39 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.66500000000000004,"15min":0.61299999999999999},"min":{"1min":0.48699999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.61199999999999999,"15min":0.56799999999999995},"min":{"1min":0.50900000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.0049999999999999,"5min":1.228,"15min":1.228},"last":0.622}]},{"osd":2,"last update":"Thu Oct 19 12:41:39 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.64100000000000001,"15min":0.60699999999999998},"min":{"1min":0.48499999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.91900000000000004,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.67100000000000004,"15min":0.60799999999999998},"min":{"1min":0.64500000000000002,"5min":0.374,"15min":0.374},"max":{"1min":1.004,"5min":1.056,"15min":1.056},"last":0.878}]},{"osd":4,"last update":"Thu Oct 19 12:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.67500000000000004,"15min":0.64300000000000002},"min":{"1min":0.56999999999999995,"5min":0.435,"15min":0.435},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.68100000000000005,"15min":0.64100000000000001},"min":{"1min":0.57899999999999996,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.83799999999999997}]},{"osd":5,"last update":"Thu Oct 19 12:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.76900000000000002,"15min":0.73599999999999999},"min":{"1min":0.50700000000000001,"5min":0.501,"15min":0.501},"max":{"1min":1.0840000000000001,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.71099999999999997,"15min":0.68999999999999995},"min":{"1min":0.57899999999999996,"5min":0.443,"15min":0.443},"max":{"1min":1.0309999999999999,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.77900000000000003}]},{"osd":6,"last update":"Thu Oct 19 12:41:43 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.64100000000000001,"15min":0.623},"min":{"1min":0.53500000000000003,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.97599999999999998,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.745,"15min":0.70599999999999996},"min":{"1min":0.51300000000000001,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.157,"5min":1.45,"15min":1.45},"last":0.51300000000000001}]},{"osd":7,"last update":"Thu Oct 19 12:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.70799999999999996,"15min":0.69599999999999995},"min":{"1min":0.52200000000000002,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.0369999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.75600000000000001,"15min":0.73299999999999998},"min":{"1min":0.61299999999999999,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.80200000000000005}]},{"osd":8,"last update":"Thu Oct 19 12:40:26 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.97599999999999998},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.998}]},{"osd":9,"last update":"Thu Oct 19 12:40:53 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.55300000000000005}]},{"osd":10,"last update":"Thu Oct 19 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.82499999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]}]},{"osd":4,"up_from":33,"seq":141733920816,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":978944,"data_stored":470428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 19 12:40:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.51900000000000002,"15min":0.50700000000000001},"min":{"1min":0.38500000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.44},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.54900000000000004,"15min":0.52900000000000003},"min":{"1min":0.47999999999999998,"5min":0.37,"15min":0.37},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":2.1539999999999999}]},{"osd":1,"last update":"Thu Oct 19 12:40:58 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.39000000000000001,"15min":0.38200000000000001},"min":{"1min":0.28599999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.59899999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.432,"5min":0.39500000000000002,"15min":0.39100000000000001},"min":{"1min":0.33200000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.39500000000000002}]},{"osd":2,"last update":"Thu Oct 19 12:40:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.54100000000000004,"15min":0.53500000000000003},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.749,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.58199999999999996,"15min":0.55900000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.83799999999999997,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.63200000000000001}]},{"osd":3,"last update":"Thu Oct 19 12:40:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.57199999999999995,"15min":0.56399999999999995},"min":{"1min":0.50700000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.59499999999999997,"15min":0.58999999999999997},"min":{"1min":0.496,"5min":0.443,"15min":0.443},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.52100000000000002}]},{"osd":5,"last update":"Thu Oct 19 12:41:20 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.63200000000000001,"15min":0.61599999999999999},"min":{"1min":0.46500000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":0.66600000000000004},{"interface":"front","average":{"1min":1.0089999999999999,"5min":0.67300000000000004,"15min":0.61599999999999999},"min":{"1min":0.47799999999999998,"5min":0.433,"15min":0.433},"max":{"1min":6.8390000000000004,"5min":6.8390000000000004,"15min":6.8390000000000004},"last":0.67800000000000005}]},{"osd":6,"last update":"Thu Oct 19 12:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.629,"15min":0.627},"min":{"1min":0.53000000000000003,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.66000000000000003,"15min":0.65300000000000002},"min":{"1min":0.49299999999999999,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.503}]},{"osd":7,"last update":"Thu Oct 19 12:41:05 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.58299999999999996,"15min":0.57199999999999995},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.621,"5min":0.55700000000000005,"15min":0.54600000000000004},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.60999999999999999}]},{"osd":8,"last update":"Thu Oct 19 12:41:26 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.71199999999999997,"15min":0.69099999999999995},"min":{"1min":0.45200000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":2.2719999999999998,"5min":2.2719999999999998,"15min":2.2719999999999998},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.70399999999999996,"15min":0.68100000000000005},"min":{"1min":0.46400000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":2.504,"5min":2.504,"15min":2.504},"last":0.72599999999999998}]},{"osd":9,"last update":"Thu Oct 19 12:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.71199999999999997}]},{"osd":10,"last update":"Thu Oct 19 12:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.77900000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]}]},{"osd":5,"up_from":38,"seq":163208757292,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28568,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716584,"statfs":{"total":95995035648,"available":95965782016,"internally_reserved":0,"allocated":1589248,"data_stored":1061628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 19 12:41:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53200000000000003,"15min":0.52500000000000002},"min":{"1min":0.39400000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.68500000000000005,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.55800000000000005,"15min":0.54100000000000004},"min":{"1min":0.41699999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.93000000000000005,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.50700000000000001}]},{"osd":1,"last update":"Thu Oct 19 12:41:19 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.53000000000000003,"15min":0.52200000000000002},"min":{"1min":0.33900000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.54300000000000004,"15min":0.53900000000000003},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.60599999999999998}]},{"osd":2,"last update":"Thu Oct 19 12:41:19 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.38900000000000001,"15min":0.38100000000000001},"min":{"1min":0.249,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.54900000000000004,"5min":0.75,"15min":0.75},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.436,"15min":0.42799999999999999},"min":{"1min":0.32200000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.39400000000000002}]},{"osd":3,"last update":"Thu Oct 19 12:41:19 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.59099999999999997,"15min":0.57899999999999996},"min":{"1min":0.43099999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.78600000000000003,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61399999999999999,"15min":0.61199999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.84299999999999997,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.49199999999999999}]},{"osd":4,"last update":"Thu Oct 19 12:41:19 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.58599999999999997,"15min":0.57099999999999995},"min":{"1min":0.41999999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56200000000000006,"15min":0.56100000000000005},"min":{"1min":0.30499999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.89900000000000002,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.63200000000000001}]},{"osd":6,"last update":"Thu Oct 19 12:40:46 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.67700000000000005,"15min":0.67100000000000004},"min":{"1min":0.47299999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68000000000000005,"15min":0.67800000000000005},"min":{"1min":0.5,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.56899999999999995}]},{"osd":7,"last update":"Thu Oct 19 12:41:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.65400000000000003,"15min":0.66200000000000003},"min":{"1min":0.42599999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.82999999999999996,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.66500000000000004,"15min":0.66100000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.73599999999999999}]},{"osd":8,"last update":"Thu Oct 19 12:41:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.626,"15min":0.624},"min":{"1min":0.45300000000000001,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68000000000000005,"15min":0.67900000000000005},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.038,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.47999999999999998}]},{"osd":9,"last update":"Thu Oct 19 12:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.59399999999999997}]},{"osd":10,"last update":"Thu Oct 19 12:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.77500000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":22975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":23585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":5544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-19T12:41:49.313 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-19T12:41:49.540 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.537+0000 7efbff9ff700 1 -- 172.21.15.46:0/2506781816 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efbf8108610 msgr2=0x7efbf810aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:49.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.537+0000 7efbff9ff700 1 --2- 172.21.15.46:0/2506781816 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efbf8108610 0x7efbf810aa80 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7efbf000b0a0 tx=0x7efbf000b3b0 comp rx=0 tx=0).stop 2023-10-19T12:41:49.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.537+0000 7efbff9ff700 1 -- 172.21.15.46:0/2506781816 shutdown_connections 2023-10-19T12:41:49.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.537+0000 7efbff9ff700 1 --2- 172.21.15.46:0/2506781816 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efbf8108610 0x7efbf810aa80 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:49.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.537+0000 7efbff9ff700 1 --2- 172.21.15.46:0/2506781816 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efbf80747d0 0x7efbf8072c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:49.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.537+0000 7efbff9ff700 1 --2- 172.21.15.46:0/2506781816 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efbf80731f0 0x7efbf8073670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:49.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.537+0000 7efbff9ff700 1 -- 172.21.15.46:0/2506781816 >> 172.21.15.46:0/2506781816 conn(0x7efbf80fbc90 msgr2=0x7efbf80fe0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:49.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.537+0000 7efbff9ff700 1 -- 172.21.15.46:0/2506781816 shutdown_connections 2023-10-19T12:41:49.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.537+0000 7efbff9ff700 1 -- 172.21.15.46:0/2506781816 wait complete. 2023-10-19T12:41:49.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.538+0000 7efbff9ff700 1 Processor -- start 2023-10-19T12:41:49.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.538+0000 7efbff9ff700 1 -- start start 2023-10-19T12:41:49.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.539+0000 7efbff9ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efbf80731f0 0x7efbf8198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:49.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.539+0000 7efbff9ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efbf80747d0 0x7efbf8198eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:49.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.539+0000 7efbff9ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efbf8108610 0x7efbf819fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:49.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.539+0000 7efbff9ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbf81a04a0 con 0x7efbf80731f0 2023-10-19T12:41:49.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.539+0000 7efbff9ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbf81a05e0 con 0x7efbf80747d0 2023-10-19T12:41:49.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.539+0000 7efbff9ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbf81a0770 con 0x7efbf8108610 2023-10-19T12:41:49.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.539+0000 7efbfd79b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efbf80731f0 0x7efbf8198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:49.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.539+0000 7efbfd79b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efbf80731f0 0x7efbf8198970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56540/0 (socket says 172.21.15.46:56540) 2023-10-19T12:41:49.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.539+0000 7efbfd79b700 1 -- 172.21.15.46:0/419354769 learned_addr learned my addr 172.21.15.46:0/419354769 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:41:49.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.539+0000 7efbfcf9a700 1 --2- 172.21.15.46:0/419354769 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efbf80747d0 0x7efbf8198eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:49.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.539+0000 7efbfdf9c700 1 --2- 172.21.15.46:0/419354769 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efbf8108610 0x7efbf819fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:49.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.539+0000 7efbfd79b700 1 -- 172.21.15.46:0/419354769 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efbf8108610 msgr2=0x7efbf819fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:49.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.539+0000 7efbfd79b700 1 --2- 172.21.15.46:0/419354769 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efbf8108610 0x7efbf819fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:49.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.539+0000 7efbfd79b700 1 -- 172.21.15.46:0/419354769 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efbf80747d0 msgr2=0x7efbf8198eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:49.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.539+0000 7efbfd79b700 1 --2- 172.21.15.46:0/419354769 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efbf80747d0 0x7efbf8198eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:49.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.539+0000 7efbfd79b700 1 -- 172.21.15.46:0/419354769 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbf0009d00 con 0x7efbf80731f0 2023-10-19T12:41:49.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.539+0000 7efbfcf9a700 1 --2- 172.21.15.46:0/419354769 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efbf80747d0 0x7efbf8198eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T12:41:49.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.539+0000 7efbfd79b700 1 --2- 172.21.15.46:0/419354769 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efbf80731f0 0x7efbf8198970 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7efbf400e9a0 tx=0x7efbf400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:49.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.540+0000 7efbee7fc700 1 -- 172.21.15.46:0/419354769 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf4009790 con 0x7efbf80731f0 2023-10-19T12:41:49.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.540+0000 7efbee7fc700 1 -- 172.21.15.46:0/419354769 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efbf400cbd0 con 0x7efbf80731f0 2023-10-19T12:41:49.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.540+0000 7efbee7fc700 1 -- 172.21.15.46:0/419354769 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf4018680 con 0x7efbf80731f0 2023-10-19T12:41:49.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.540+0000 7efbff9ff700 1 -- 172.21.15.46:0/419354769 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efbf81a0a50 con 0x7efbf80731f0 2023-10-19T12:41:49.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.540+0000 7efbff9ff700 1 -- 172.21.15.46:0/419354769 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efbf81a0f60 con 0x7efbf80731f0 2023-10-19T12:41:49.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.541+0000 7efbff9ff700 1 -- 172.21.15.46:0/419354769 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efbf8107420 con 0x7efbf80731f0 2023-10-19T12:41:49.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.544+0000 7efbee7fc700 1 -- 172.21.15.46:0/419354769 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7efbf400cd40 con 0x7efbf80731f0 2023-10-19T12:41:49.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.546+0000 7efbee7fc700 1 --2- 172.21.15.46:0/419354769 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7efbe40a1590 0x7efbe40a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:49.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.546+0000 7efbee7fc700 1 -- 172.21.15.46:0/419354769 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7efbf4014070 con 0x7efbf80731f0 2023-10-19T12:41:49.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.546+0000 7efbfcf9a700 1 --2- 172.21.15.46:0/419354769 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7efbe40a1590 0x7efbe40a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:49.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.547+0000 7efbfcf9a700 1 --2- 172.21.15.46:0/419354769 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7efbe40a1590 0x7efbe40a3a50 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7efbe8009cb0 tx=0x7efbe8009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:49.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.548+0000 7efbee7fc700 1 -- 172.21.15.46:0/419354769 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7efbf4096ee0 con 0x7efbf80731f0 2023-10-19T12:41:49.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.759+0000 7efbff9ff700 1 -- 172.21.15.46:0/419354769 --> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efbf802cf80 con 0x7efbe40a1590 2023-10-19T12:41:49.775 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.772+0000 7efbee7fc700 1 -- 172.21.15.46:0/419354769 <== mgr.14150 v2:172.21.15.46:6800/3168073651 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+422286 (secure 0 0 0) 0x7efbf802cf80 con 0x7efbe40a1590 2023-10-19T12:41:49.782 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:41:49.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.778+0000 7efbff9ff700 1 -- 172.21.15.46:0/419354769 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7efbe40a1590 msgr2=0x7efbe40a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:49.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.778+0000 7efbff9ff700 1 --2- 172.21.15.46:0/419354769 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7efbe40a1590 0x7efbe40a3a50 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7efbe8009cb0 tx=0x7efbe8009260 comp rx=0 tx=0).stop 2023-10-19T12:41:49.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.778+0000 7efbff9ff700 1 -- 172.21.15.46:0/419354769 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efbf80731f0 msgr2=0x7efbf8198970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:49.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.778+0000 7efbff9ff700 1 --2- 172.21.15.46:0/419354769 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efbf80731f0 0x7efbf8198970 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7efbf400e9a0 tx=0x7efbf400ed60 comp rx=0 tx=0).stop 2023-10-19T12:41:49.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.778+0000 7efbff9ff700 1 -- 172.21.15.46:0/419354769 shutdown_connections 2023-10-19T12:41:49.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.778+0000 7efbff9ff700 1 --2- 172.21.15.46:0/419354769 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7efbe40a1590 0x7efbe40a3a50 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:49.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.778+0000 7efbff9ff700 1 --2- 172.21.15.46:0/419354769 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efbf8108610 0x7efbf819fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:49.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.778+0000 7efbff9ff700 1 --2- 172.21.15.46:0/419354769 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efbf80731f0 0x7efbf8198970 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:49.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.778+0000 7efbff9ff700 1 --2- 172.21.15.46:0/419354769 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efbf80747d0 0x7efbf8198eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:49.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.778+0000 7efbff9ff700 1 -- 172.21.15.46:0/419354769 >> 172.21.15.46:0/419354769 conn(0x7efbf80fbc90 msgr2=0x7efbf8104560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:49.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.778+0000 7efbff9ff700 1 -- 172.21.15.46:0/419354769 shutdown_connections 2023-10-19T12:41:49.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:49.778+0000 7efbff9ff700 1 -- 172.21.15.46:0/419354769 wait complete. 2023-10-19T12:41:49.788 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-10-19T12:41:49.800 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":299,"stamp":"2023-10-19T12:41:48.639923+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600327,"num_objects":76,"num_object_clones":0,"num_object_copies":229,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":128,"num_read_kb":110,"num_write":338,"num_write_kb":2996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":276,"ondisk_log_size":276,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":337572,"kb_used_data":13380,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124604252,"statfs":{"total":1151940427776,"available":1151594754048,"internally_reserved":0,"allocated":13701120,"data_stored":7477821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19130,"internal_metadata":331855174},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5460,"num_objects":52,"num_object_clones":0,"num_object_copies":157,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":109,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":32,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003191"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.318308+0000","last_change":"2023-10-19T12:41:19.300761+0000","last_active":"2023-10-19T12:41:23.318308+0000","last_peered":"2023-10-19T12:41:23.318308+0000","last_clean":"2023-10-19T12:41:23.318308+0000","last_became_active":"2023-10-19T12:41:19.300431+0000","last_became_peered":"2023-10-19T12:41:19.300431+0000","last_unstale":"2023-10-19T12:41:23.318308+0000","last_undegraded":"2023-10-19T12:41:23.318308+0000","last_fullsized":"2023-10-19T12:41:23.318308+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-21T00:36:29.735726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.322752+0000","last_change":"2023-10-19T12:41:19.300748+0000","last_active":"2023-10-19T12:41:23.322752+0000","last_peered":"2023-10-19T12:41:23.322752+0000","last_clean":"2023-10-19T12:41:23.322752+0000","last_became_active":"2023-10-19T12:41:19.294769+0000","last_became_peered":"2023-10-19T12:41:19.294769+0000","last_unstale":"2023-10-19T12:41:23.322752+0000","last_undegraded":"2023-10-19T12:41:23.322752+0000","last_fullsized":"2023-10-19T12:41:23.322752+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T23:04:58.055573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.322213+0000","last_change":"2023-10-19T12:41:19.294264+0000","last_active":"2023-10-19T12:41:23.322213+0000","last_peered":"2023-10-19T12:41:23.322213+0000","last_clean":"2023-10-19T12:41:23.322213+0000","last_became_active":"2023-10-19T12:41:19.293878+0000","last_became_peered":"2023-10-19T12:41:19.293878+0000","last_unstale":"2023-10-19T12:41:23.322213+0000","last_undegraded":"2023-10-19T12:41:23.322213+0000","last_fullsized":"2023-10-19T12:41:23.322213+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:11:01.049036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.318364+0000","last_change":"2023-10-19T12:41:19.292977+0000","last_active":"2023-10-19T12:41:23.318364+0000","last_peered":"2023-10-19T12:41:23.318364+0000","last_clean":"2023-10-19T12:41:23.318364+0000","last_became_active":"2023-10-19T12:41:19.292626+0000","last_became_peered":"2023-10-19T12:41:19.292626+0000","last_unstale":"2023-10-19T12:41:23.318364+0000","last_undegraded":"2023-10-19T12:41:23.318364+0000","last_fullsized":"2023-10-19T12:41:23.318364+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:56:11.175726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.317533+0000","last_change":"2023-10-19T12:41:19.301164+0000","last_active":"2023-10-19T12:41:23.317533+0000","last_peered":"2023-10-19T12:41:23.317533+0000","last_clean":"2023-10-19T12:41:23.317533+0000","last_became_active":"2023-10-19T12:41:19.300920+0000","last_became_peered":"2023-10-19T12:41:19.300920+0000","last_unstale":"2023-10-19T12:41:23.317533+0000","last_undegraded":"2023-10-19T12:41:23.317533+0000","last_fullsized":"2023-10-19T12:41:23.317533+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:15:40.211319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.477174+0000","last_change":"2023-10-19T12:41:19.292866+0000","last_active":"2023-10-19T12:41:23.477174+0000","last_peered":"2023-10-19T12:41:23.477174+0000","last_clean":"2023-10-19T12:41:23.477174+0000","last_became_active":"2023-10-19T12:41:19.292392+0000","last_became_peered":"2023-10-19T12:41:19.292392+0000","last_unstale":"2023-10-19T12:41:23.477174+0000","last_undegraded":"2023-10-19T12:41:23.477174+0000","last_fullsized":"2023-10-19T12:41:23.477174+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:37:34.373704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.317425+0000","last_change":"2023-10-19T12:41:19.289271+0000","last_active":"2023-10-19T12:41:23.317425+0000","last_peered":"2023-10-19T12:41:23.317425+0000","last_clean":"2023-10-19T12:41:23.317425+0000","last_became_active":"2023-10-19T12:41:19.288950+0000","last_became_peered":"2023-10-19T12:41:19.288950+0000","last_unstale":"2023-10-19T12:41:23.317425+0000","last_undegraded":"2023-10-19T12:41:23.317425+0000","last_fullsized":"2023-10-19T12:41:23.317425+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:34:07.053254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.319089+0000","last_change":"2023-10-19T12:41:19.290501+0000","last_active":"2023-10-19T12:41:23.319089+0000","last_peered":"2023-10-19T12:41:23.319089+0000","last_clean":"2023-10-19T12:41:23.319089+0000","last_became_active":"2023-10-19T12:41:19.290080+0000","last_became_peered":"2023-10-19T12:41:19.290080+0000","last_unstale":"2023-10-19T12:41:23.319089+0000","last_undegraded":"2023-10-19T12:41:23.319089+0000","last_fullsized":"2023-10-19T12:41:23.319089+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:40:19.827896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.312997+0000","last_change":"2023-10-19T12:41:19.304631+0000","last_active":"2023-10-19T12:41:23.312997+0000","last_peered":"2023-10-19T12:41:23.312997+0000","last_clean":"2023-10-19T12:41:23.312997+0000","last_became_active":"2023-10-19T12:41:19.301990+0000","last_became_peered":"2023-10-19T12:41:19.301990+0000","last_unstale":"2023-10-19T12:41:23.312997+0000","last_undegraded":"2023-10-19T12:41:23.312997+0000","last_fullsized":"2023-10-19T12:41:23.312997+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:50:46.128888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.478397+0000","last_change":"2023-10-19T12:41:19.294366+0000","last_active":"2023-10-19T12:41:23.478397+0000","last_peered":"2023-10-19T12:41:23.478397+0000","last_clean":"2023-10-19T12:41:23.478397+0000","last_became_active":"2023-10-19T12:41:19.292644+0000","last_became_peered":"2023-10-19T12:41:19.292644+0000","last_unstale":"2023-10-19T12:41:23.478397+0000","last_undegraded":"2023-10-19T12:41:23.478397+0000","last_fullsized":"2023-10-19T12:41:23.478397+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:59:30.111950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.318667+0000","last_change":"2023-10-19T12:41:19.290054+0000","last_active":"2023-10-19T12:41:23.318667+0000","last_peered":"2023-10-19T12:41:23.318667+0000","last_clean":"2023-10-19T12:41:23.318667+0000","last_became_active":"2023-10-19T12:41:19.289739+0000","last_became_peered":"2023-10-19T12:41:19.289739+0000","last_unstale":"2023-10-19T12:41:23.318667+0000","last_undegraded":"2023-10-19T12:41:23.318667+0000","last_fullsized":"2023-10-19T12:41:23.318667+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:30:36.398762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.318352+0000","last_change":"2023-10-19T12:41:19.295309+0000","last_active":"2023-10-19T12:41:23.318352+0000","last_peered":"2023-10-19T12:41:23.318352+0000","last_clean":"2023-10-19T12:41:23.318352+0000","last_became_active":"2023-10-19T12:41:19.295009+0000","last_became_peered":"2023-10-19T12:41:19.295009+0000","last_unstale":"2023-10-19T12:41:23.318352+0000","last_undegraded":"2023-10-19T12:41:23.318352+0000","last_fullsized":"2023-10-19T12:41:23.318352+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:27:33.798071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.312970+0000","last_change":"2023-10-19T12:41:19.302920+0000","last_active":"2023-10-19T12:41:23.312970+0000","last_peered":"2023-10-19T12:41:23.312970+0000","last_clean":"2023-10-19T12:41:23.312970+0000","last_became_active":"2023-10-19T12:41:19.300250+0000","last_became_peered":"2023-10-19T12:41:19.300250+0000","last_unstale":"2023-10-19T12:41:23.312970+0000","last_undegraded":"2023-10-19T12:41:23.312970+0000","last_fullsized":"2023-10-19T12:41:23.312970+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:51:47.487907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.321529+0000","last_change":"2023-10-19T12:41:19.300654+0000","last_active":"2023-10-19T12:41:23.321529+0000","last_peered":"2023-10-19T12:41:23.321529+0000","last_clean":"2023-10-19T12:41:23.321529+0000","last_became_active":"2023-10-19T12:41:19.295408+0000","last_became_peered":"2023-10-19T12:41:19.295408+0000","last_unstale":"2023-10-19T12:41:23.321529+0000","last_undegraded":"2023-10-19T12:41:23.321529+0000","last_fullsized":"2023-10-19T12:41:23.321529+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:53:47.039077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.322332+0000","last_change":"2023-10-19T12:41:19.293141+0000","last_active":"2023-10-19T12:41:23.322332+0000","last_peered":"2023-10-19T12:41:23.322332+0000","last_clean":"2023-10-19T12:41:23.322332+0000","last_became_active":"2023-10-19T12:41:19.290790+0000","last_became_peered":"2023-10-19T12:41:19.290790+0000","last_unstale":"2023-10-19T12:41:23.322332+0000","last_undegraded":"2023-10-19T12:41:23.322332+0000","last_fullsized":"2023-10-19T12:41:23.322332+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:23:44.757080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.312453+0000","last_change":"2023-10-19T12:41:19.299670+0000","last_active":"2023-10-19T12:41:23.312453+0000","last_peered":"2023-10-19T12:41:23.312453+0000","last_clean":"2023-10-19T12:41:23.312453+0000","last_became_active":"2023-10-19T12:41:19.299375+0000","last_became_peered":"2023-10-19T12:41:19.299375+0000","last_unstale":"2023-10-19T12:41:23.312453+0000","last_undegraded":"2023-10-19T12:41:23.312453+0000","last_fullsized":"2023-10-19T12:41:23.312453+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:30:23.234790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.318502+0000","last_change":"2023-10-19T12:41:19.300359+0000","last_active":"2023-10-19T12:41:23.318502+0000","last_peered":"2023-10-19T12:41:23.318502+0000","last_clean":"2023-10-19T12:41:23.318502+0000","last_became_active":"2023-10-19T12:41:19.300032+0000","last_became_peered":"2023-10-19T12:41:19.300032+0000","last_unstale":"2023-10-19T12:41:23.318502+0000","last_undegraded":"2023-10-19T12:41:23.318502+0000","last_fullsized":"2023-10-19T12:41:23.318502+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-21T00:33:24.621723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.329149+0000","last_change":"2023-10-19T12:41:19.288276+0000","last_active":"2023-10-19T12:41:23.329149+0000","last_peered":"2023-10-19T12:41:23.329149+0000","last_clean":"2023-10-19T12:41:23.329149+0000","last_became_active":"2023-10-19T12:41:19.287905+0000","last_became_peered":"2023-10-19T12:41:19.287905+0000","last_unstale":"2023-10-19T12:41:23.329149+0000","last_undegraded":"2023-10-19T12:41:23.329149+0000","last_fullsized":"2023-10-19T12:41:23.329149+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:46:15.640987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.324826+0000","last_change":"2023-10-19T12:41:19.300682+0000","last_active":"2023-10-19T12:41:23.324826+0000","last_peered":"2023-10-19T12:41:23.324826+0000","last_clean":"2023-10-19T12:41:23.324826+0000","last_became_active":"2023-10-19T12:41:19.300347+0000","last_became_peered":"2023-10-19T12:41:19.300347+0000","last_unstale":"2023-10-19T12:41:23.324826+0000","last_undegraded":"2023-10-19T12:41:23.324826+0000","last_fullsized":"2023-10-19T12:41:23.324826+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T21:21:31.772556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:24.974649+0000","last_change":"2023-10-19T12:41:23.337419+0000","last_active":"2023-10-19T12:41:24.974649+0000","last_peered":"2023-10-19T12:41:24.974649+0000","last_clean":"2023-10-19T12:41:24.974649+0000","last_became_active":"2023-10-19T12:41:23.337046+0000","last_became_peered":"2023-10-19T12:41:23.337046+0000","last_unstale":"2023-10-19T12:41:24.974649+0000","last_undegraded":"2023-10-19T12:41:24.974649+0000","last_fullsized":"2023-10-19T12:41:24.974649+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-21T00:20:22.732851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"83'4","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.325202+0000","last_change":"2023-10-19T12:41:18.282453+0000","last_active":"2023-10-19T12:41:23.325202+0000","last_peered":"2023-10-19T12:41:23.325202+0000","last_clean":"2023-10-19T12:41:23.325202+0000","last_became_active":"2023-10-19T12:41:18.281705+0000","last_became_peered":"2023-10-19T12:41:18.281705+0000","last_unstale":"2023-10-19T12:41:23.325202+0000","last_undegraded":"2023-10-19T12:41:23.325202+0000","last_fullsized":"2023-10-19T12:41:23.325202+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T21:12:33.877631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.328663+0000","last_change":"2023-10-19T12:41:19.292175+0000","last_active":"2023-10-19T12:41:23.328663+0000","last_peered":"2023-10-19T12:41:23.328663+0000","last_clean":"2023-10-19T12:41:23.328663+0000","last_became_active":"2023-10-19T12:41:19.291867+0000","last_became_peered":"2023-10-19T12:41:19.291867+0000","last_unstale":"2023-10-19T12:41:23.328663+0000","last_undegraded":"2023-10-19T12:41:23.328663+0000","last_fullsized":"2023-10-19T12:41:23.328663+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:22:12.255839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:24.314445+0000","last_change":"2023-10-19T12:41:23.340447+0000","last_active":"2023-10-19T12:41:24.314445+0000","last_peered":"2023-10-19T12:41:24.314445+0000","last_clean":"2023-10-19T12:41:24.314445+0000","last_became_active":"2023-10-19T12:41:23.340074+0000","last_became_peered":"2023-10-19T12:41:23.340074+0000","last_unstale":"2023-10-19T12:41:24.314445+0000","last_undegraded":"2023-10-19T12:41:24.314445+0000","last_fullsized":"2023-10-19T12:41:24.314445+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:12:11.828854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"88'2","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:25.678382+0000","last_change":"2023-10-19T12:41:18.297822+0000","last_active":"2023-10-19T12:41:25.678382+0000","last_peered":"2023-10-19T12:41:25.678382+0000","last_clean":"2023-10-19T12:41:25.678382+0000","last_became_active":"2023-10-19T12:41:18.297526+0000","last_became_peered":"2023-10-19T12:41:18.297526+0000","last_unstale":"2023-10-19T12:41:25.678382+0000","last_undegraded":"2023-10-19T12:41:25.678382+0000","last_fullsized":"2023-10-19T12:41:25.678382+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:59:28.110110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.324102+0000","last_change":"2023-10-19T12:41:19.309918+0000","last_active":"2023-10-19T12:41:23.324102+0000","last_peered":"2023-10-19T12:41:23.324102+0000","last_clean":"2023-10-19T12:41:23.324102+0000","last_became_active":"2023-10-19T12:41:19.309391+0000","last_became_peered":"2023-10-19T12:41:19.309391+0000","last_unstale":"2023-10-19T12:41:23.324102+0000","last_undegraded":"2023-10-19T12:41:23.324102+0000","last_fullsized":"2023-10-19T12:41:23.324102+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:52:49.320469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:24.314898+0000","last_change":"2023-10-19T12:41:23.337296+0000","last_active":"2023-10-19T12:41:24.314898+0000","last_peered":"2023-10-19T12:41:24.314898+0000","last_clean":"2023-10-19T12:41:24.314898+0000","last_became_active":"2023-10-19T12:41:23.336836+0000","last_became_peered":"2023-10-19T12:41:23.336836+0000","last_unstale":"2023-10-19T12:41:24.314898+0000","last_undegraded":"2023-10-19T12:41:24.314898+0000","last_fullsized":"2023-10-19T12:41:24.314898+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:15:25.400517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"88'4","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:44.286129+0000","last_change":"2023-10-19T12:41:18.282387+0000","last_active":"2023-10-19T12:41:44.286129+0000","last_peered":"2023-10-19T12:41:44.286129+0000","last_clean":"2023-10-19T12:41:44.286129+0000","last_became_active":"2023-10-19T12:41:18.282102+0000","last_became_peered":"2023-10-19T12:41:18.282102+0000","last_unstale":"2023-10-19T12:41:44.286129+0000","last_undegraded":"2023-10-19T12:41:44.286129+0000","last_fullsized":"2023-10-19T12:41:44.286129+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:07:17.409521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.312636+0000","last_change":"2023-10-19T12:41:19.301628+0000","last_active":"2023-10-19T12:41:23.312636+0000","last_peered":"2023-10-19T12:41:23.312636+0000","last_clean":"2023-10-19T12:41:23.312636+0000","last_became_active":"2023-10-19T12:41:19.301343+0000","last_became_peered":"2023-10-19T12:41:19.301343+0000","last_unstale":"2023-10-19T12:41:23.312636+0000","last_undegraded":"2023-10-19T12:41:23.312636+0000","last_fullsized":"2023-10-19T12:41:23.312636+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:02:31.273024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:24.314533+0000","last_change":"2023-10-19T12:41:23.330222+0000","last_active":"2023-10-19T12:41:24.314533+0000","last_peered":"2023-10-19T12:41:24.314533+0000","last_clean":"2023-10-19T12:41:24.314533+0000","last_became_active":"2023-10-19T12:41:23.329838+0000","last_became_peered":"2023-10-19T12:41:23.329838+0000","last_unstale":"2023-10-19T12:41:24.314533+0000","last_undegraded":"2023-10-19T12:41:24.314533+0000","last_fullsized":"2023-10-19T12:41:24.314533+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T21:40:52.899198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"83'2","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.318166+0000","last_change":"2023-10-19T12:41:18.279300+0000","last_active":"2023-10-19T12:41:23.318166+0000","last_peered":"2023-10-19T12:41:23.318166+0000","last_clean":"2023-10-19T12:41:23.318166+0000","last_became_active":"2023-10-19T12:41:18.278991+0000","last_became_peered":"2023-10-19T12:41:18.278991+0000","last_unstale":"2023-10-19T12:41:23.318166+0000","last_undegraded":"2023-10-19T12:41:23.318166+0000","last_fullsized":"2023-10-19T12:41:23.318166+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T21:06:16.319168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.326541+0000","last_change":"2023-10-19T12:41:19.286530+0000","last_active":"2023-10-19T12:41:23.326541+0000","last_peered":"2023-10-19T12:41:23.326541+0000","last_clean":"2023-10-19T12:41:23.326541+0000","last_became_active":"2023-10-19T12:41:19.286241+0000","last_became_peered":"2023-10-19T12:41:19.286241+0000","last_unstale":"2023-10-19T12:41:23.326541+0000","last_undegraded":"2023-10-19T12:41:23.326541+0000","last_fullsized":"2023-10-19T12:41:23.326541+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:30:16.438143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:24.975076+0000","last_change":"2023-10-19T12:41:23.330626+0000","last_active":"2023-10-19T12:41:24.975076+0000","last_peered":"2023-10-19T12:41:24.975076+0000","last_clean":"2023-10-19T12:41:24.975076+0000","last_became_active":"2023-10-19T12:41:23.330250+0000","last_became_peered":"2023-10-19T12:41:23.330250+0000","last_unstale":"2023-10-19T12:41:24.975076+0000","last_undegraded":"2023-10-19T12:41:24.975076+0000","last_fullsized":"2023-10-19T12:41:24.975076+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:09:48.428636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"88'5","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:43.277846+0000","last_change":"2023-10-19T12:41:18.277565+0000","last_active":"2023-10-19T12:41:43.277846+0000","last_peered":"2023-10-19T12:41:43.277846+0000","last_clean":"2023-10-19T12:41:43.277846+0000","last_became_active":"2023-10-19T12:41:18.277217+0000","last_became_peered":"2023-10-19T12:41:18.277217+0000","last_unstale":"2023-10-19T12:41:43.277846+0000","last_undegraded":"2023-10-19T12:41:43.277846+0000","last_fullsized":"2023-10-19T12:41:43.277846+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:47:37.626231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.317370+0000","last_change":"2023-10-19T12:41:19.285423+0000","last_active":"2023-10-19T12:41:23.317370+0000","last_peered":"2023-10-19T12:41:23.317370+0000","last_clean":"2023-10-19T12:41:23.317370+0000","last_became_active":"2023-10-19T12:41:19.285110+0000","last_became_peered":"2023-10-19T12:41:19.285110+0000","last_unstale":"2023-10-19T12:41:23.317370+0000","last_undegraded":"2023-10-19T12:41:23.317370+0000","last_fullsized":"2023-10-19T12:41:23.317370+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:27:51.707594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:24.974927+0000","last_change":"2023-10-19T12:41:23.343240+0000","last_active":"2023-10-19T12:41:24.974927+0000","last_peered":"2023-10-19T12:41:24.974927+0000","last_clean":"2023-10-19T12:41:24.974927+0000","last_became_active":"2023-10-19T12:41:23.342778+0000","last_became_peered":"2023-10-19T12:41:23.342778+0000","last_unstale":"2023-10-19T12:41:24.974927+0000","last_undegraded":"2023-10-19T12:41:24.974927+0000","last_fullsized":"2023-10-19T12:41:24.974927+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:47:15.690193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"88'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:45.297673+0000","last_change":"2023-10-19T12:41:18.286641+0000","last_active":"2023-10-19T12:41:45.297673+0000","last_peered":"2023-10-19T12:41:45.297673+0000","last_clean":"2023-10-19T12:41:45.297673+0000","last_became_active":"2023-10-19T12:41:18.286247+0000","last_became_peered":"2023-10-19T12:41:18.286247+0000","last_unstale":"2023-10-19T12:41:45.297673+0000","last_undegraded":"2023-10-19T12:41:45.297673+0000","last_fullsized":"2023-10-19T12:41:45.297673+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T21:28:47.086133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.317200+0000","last_change":"2023-10-19T12:41:19.291953+0000","last_active":"2023-10-19T12:41:23.317200+0000","last_peered":"2023-10-19T12:41:23.317200+0000","last_clean":"2023-10-19T12:41:23.317200+0000","last_became_active":"2023-10-19T12:41:19.291672+0000","last_became_peered":"2023-10-19T12:41:19.291672+0000","last_unstale":"2023-10-19T12:41:23.317200+0000","last_undegraded":"2023-10-19T12:41:23.317200+0000","last_fullsized":"2023-10-19T12:41:23.317200+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:40:09.239808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:24.314542+0000","last_change":"2023-10-19T12:41:23.338871+0000","last_active":"2023-10-19T12:41:24.314542+0000","last_peered":"2023-10-19T12:41:24.314542+0000","last_clean":"2023-10-19T12:41:24.314542+0000","last_became_active":"2023-10-19T12:41:23.338493+0000","last_became_peered":"2023-10-19T12:41:23.338493+0000","last_unstale":"2023-10-19T12:41:24.314542+0000","last_undegraded":"2023-10-19T12:41:24.314542+0000","last_fullsized":"2023-10-19T12:41:24.314542+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T22:49:12.948436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"88'2","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:44.288546+0000","last_change":"2023-10-19T12:41:18.291110+0000","last_active":"2023-10-19T12:41:44.288546+0000","last_peered":"2023-10-19T12:41:44.288546+0000","last_clean":"2023-10-19T12:41:44.288546+0000","last_became_active":"2023-10-19T12:41:18.290675+0000","last_became_peered":"2023-10-19T12:41:18.290675+0000","last_unstale":"2023-10-19T12:41:44.288546+0000","last_undegraded":"2023-10-19T12:41:44.288546+0000","last_fullsized":"2023-10-19T12:41:44.288546+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:57:44.713046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.318989+0000","last_change":"2023-10-19T12:41:19.299727+0000","last_active":"2023-10-19T12:41:23.318989+0000","last_peered":"2023-10-19T12:41:23.318989+0000","last_clean":"2023-10-19T12:41:23.318989+0000","last_became_active":"2023-10-19T12:41:19.299387+0000","last_became_peered":"2023-10-19T12:41:19.299387+0000","last_unstale":"2023-10-19T12:41:23.318989+0000","last_undegraded":"2023-10-19T12:41:23.318989+0000","last_fullsized":"2023-10-19T12:41:23.318989+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:34:03.783326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:25.721966+0000","last_change":"2023-10-19T12:41:23.331954+0000","last_active":"2023-10-19T12:41:25.721966+0000","last_peered":"2023-10-19T12:41:25.721966+0000","last_clean":"2023-10-19T12:41:25.721966+0000","last_became_active":"2023-10-19T12:41:23.328835+0000","last_became_peered":"2023-10-19T12:41:23.328835+0000","last_unstale":"2023-10-19T12:41:25.721966+0000","last_undegraded":"2023-10-19T12:41:25.721966+0000","last_fullsized":"2023-10-19T12:41:25.721966+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T21:49:10.473768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"88'2","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:43.275517+0000","last_change":"2023-10-19T12:41:18.280694+0000","last_active":"2023-10-19T12:41:43.275517+0000","last_peered":"2023-10-19T12:41:43.275517+0000","last_clean":"2023-10-19T12:41:43.275517+0000","last_became_active":"2023-10-19T12:41:18.280333+0000","last_became_peered":"2023-10-19T12:41:18.280333+0000","last_unstale":"2023-10-19T12:41:43.275517+0000","last_undegraded":"2023-10-19T12:41:43.275517+0000","last_fullsized":"2023-10-19T12:41:43.275517+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:06:02.944400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.318931+0000","last_change":"2023-10-19T12:41:19.288659+0000","last_active":"2023-10-19T12:41:23.318931+0000","last_peered":"2023-10-19T12:41:23.318931+0000","last_clean":"2023-10-19T12:41:23.318931+0000","last_became_active":"2023-10-19T12:41:19.288310+0000","last_became_peered":"2023-10-19T12:41:19.288310+0000","last_unstale":"2023-10-19T12:41:23.318931+0000","last_undegraded":"2023-10-19T12:41:23.318931+0000","last_fullsized":"2023-10-19T12:41:23.318931+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T23:15:05.772393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:25.678055+0000","last_change":"2023-10-19T12:41:23.333370+0000","last_active":"2023-10-19T12:41:25.678055+0000","last_peered":"2023-10-19T12:41:25.678055+0000","last_clean":"2023-10-19T12:41:25.678055+0000","last_became_active":"2023-10-19T12:41:23.332691+0000","last_became_peered":"2023-10-19T12:41:23.332691+0000","last_unstale":"2023-10-19T12:41:25.678055+0000","last_undegraded":"2023-10-19T12:41:25.678055+0000","last_fullsized":"2023-10-19T12:41:25.678055+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T21:28:45.414610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"88'4","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:43.277871+0000","last_change":"2023-10-19T12:41:18.287081+0000","last_active":"2023-10-19T12:41:43.277871+0000","last_peered":"2023-10-19T12:41:43.277871+0000","last_clean":"2023-10-19T12:41:43.277871+0000","last_became_active":"2023-10-19T12:41:18.286784+0000","last_became_peered":"2023-10-19T12:41:18.286784+0000","last_unstale":"2023-10-19T12:41:43.277871+0000","last_undegraded":"2023-10-19T12:41:43.277871+0000","last_fullsized":"2023-10-19T12:41:43.277871+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:49:10.167022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.313023+0000","last_change":"2023-10-19T12:41:19.300361+0000","last_active":"2023-10-19T12:41:23.313023+0000","last_peered":"2023-10-19T12:41:23.313023+0000","last_clean":"2023-10-19T12:41:23.313023+0000","last_became_active":"2023-10-19T12:41:19.299871+0000","last_became_peered":"2023-10-19T12:41:19.299871+0000","last_unstale":"2023-10-19T12:41:23.313023+0000","last_undegraded":"2023-10-19T12:41:23.313023+0000","last_fullsized":"2023-10-19T12:41:23.313023+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:46:31.437532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:25.010645+0000","last_change":"2023-10-19T12:41:23.338341+0000","last_active":"2023-10-19T12:41:25.010645+0000","last_peered":"2023-10-19T12:41:25.010645+0000","last_clean":"2023-10-19T12:41:25.010645+0000","last_became_active":"2023-10-19T12:41:23.336081+0000","last_became_peered":"2023-10-19T12:41:23.336081+0000","last_unstale":"2023-10-19T12:41:25.010645+0000","last_undegraded":"2023-10-19T12:41:25.010645+0000","last_fullsized":"2023-10-19T12:41:25.010645+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:02:35.474513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"88'4","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:46.306224+0000","last_change":"2023-10-19T12:41:18.280086+0000","last_active":"2023-10-19T12:41:46.306224+0000","last_peered":"2023-10-19T12:41:46.306224+0000","last_clean":"2023-10-19T12:41:46.306224+0000","last_became_active":"2023-10-19T12:41:18.279819+0000","last_became_peered":"2023-10-19T12:41:18.279819+0000","last_unstale":"2023-10-19T12:41:46.306224+0000","last_undegraded":"2023-10-19T12:41:46.306224+0000","last_fullsized":"2023-10-19T12:41:46.306224+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T23:02:28.723477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.324193+0000","last_change":"2023-10-19T12:41:19.306420+0000","last_active":"2023-10-19T12:41:23.324193+0000","last_peered":"2023-10-19T12:41:23.324193+0000","last_clean":"2023-10-19T12:41:23.324193+0000","last_became_active":"2023-10-19T12:41:19.301202+0000","last_became_peered":"2023-10-19T12:41:19.301202+0000","last_unstale":"2023-10-19T12:41:23.324193+0000","last_undegraded":"2023-10-19T12:41:23.324193+0000","last_fullsized":"2023-10-19T12:41:23.324193+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:56:16.765319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:24.314851+0000","last_change":"2023-10-19T12:41:23.337332+0000","last_active":"2023-10-19T12:41:24.314851+0000","last_peered":"2023-10-19T12:41:24.314851+0000","last_clean":"2023-10-19T12:41:24.314851+0000","last_became_active":"2023-10-19T12:41:23.336877+0000","last_became_peered":"2023-10-19T12:41:23.336877+0000","last_unstale":"2023-10-19T12:41:24.314851+0000","last_undegraded":"2023-10-19T12:41:24.314851+0000","last_fullsized":"2023-10-19T12:41:24.314851+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T22:47:23.795598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"88'5","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:43.275777+0000","last_change":"2023-10-19T12:41:18.285452+0000","last_active":"2023-10-19T12:41:43.275777+0000","last_peered":"2023-10-19T12:41:43.275777+0000","last_clean":"2023-10-19T12:41:43.275777+0000","last_became_active":"2023-10-19T12:41:18.285155+0000","last_became_peered":"2023-10-19T12:41:18.285155+0000","last_unstale":"2023-10-19T12:41:43.275777+0000","last_undegraded":"2023-10-19T12:41:43.275777+0000","last_fullsized":"2023-10-19T12:41:43.275777+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:30:41.041925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.312755+0000","last_change":"2023-10-19T12:41:19.284839+0000","last_active":"2023-10-19T12:41:23.312755+0000","last_peered":"2023-10-19T12:41:23.312755+0000","last_clean":"2023-10-19T12:41:23.312755+0000","last_became_active":"2023-10-19T12:41:19.284538+0000","last_became_peered":"2023-10-19T12:41:19.284538+0000","last_unstale":"2023-10-19T12:41:23.312755+0000","last_undegraded":"2023-10-19T12:41:23.312755+0000","last_fullsized":"2023-10-19T12:41:23.312755+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:29:12.288958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:25.010725+0000","last_change":"2023-10-19T12:41:23.339611+0000","last_active":"2023-10-19T12:41:25.010725+0000","last_peered":"2023-10-19T12:41:25.010725+0000","last_clean":"2023-10-19T12:41:25.010725+0000","last_became_active":"2023-10-19T12:41:23.337786+0000","last_became_peered":"2023-10-19T12:41:23.337786+0000","last_unstale":"2023-10-19T12:41:25.010725+0000","last_undegraded":"2023-10-19T12:41:25.010725+0000","last_fullsized":"2023-10-19T12:41:25.010725+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:56:01.219811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"88'12","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:43.277620+0000","last_change":"2023-10-19T12:41:18.279330+0000","last_active":"2023-10-19T12:41:43.277620+0000","last_peered":"2023-10-19T12:41:43.277620+0000","last_clean":"2023-10-19T12:41:43.277620+0000","last_became_active":"2023-10-19T12:41:18.278942+0000","last_became_peered":"2023-10-19T12:41:18.278942+0000","last_unstale":"2023-10-19T12:41:43.277620+0000","last_undegraded":"2023-10-19T12:41:43.277620+0000","last_fullsized":"2023-10-19T12:41:43.277620+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:40:23.340009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.323151+0000","last_change":"2023-10-19T12:41:19.296103+0000","last_active":"2023-10-19T12:41:23.323151+0000","last_peered":"2023-10-19T12:41:23.323151+0000","last_clean":"2023-10-19T12:41:23.323151+0000","last_became_active":"2023-10-19T12:41:19.293432+0000","last_became_peered":"2023-10-19T12:41:19.293432+0000","last_unstale":"2023-10-19T12:41:23.323151+0000","last_undegraded":"2023-10-19T12:41:23.323151+0000","last_fullsized":"2023-10-19T12:41:23.323151+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:21:46.039560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:25.679564+0000","last_change":"2023-10-19T12:41:23.330711+0000","last_active":"2023-10-19T12:41:25.679564+0000","last_peered":"2023-10-19T12:41:25.679564+0000","last_clean":"2023-10-19T12:41:25.679564+0000","last_became_active":"2023-10-19T12:41:23.330115+0000","last_became_peered":"2023-10-19T12:41:23.330115+0000","last_unstale":"2023-10-19T12:41:25.679564+0000","last_undegraded":"2023-10-19T12:41:25.679564+0000","last_fullsized":"2023-10-19T12:41:25.679564+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:48:50.296265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"88'9","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:46.307039+0000","last_change":"2023-10-19T12:41:18.289434+0000","last_active":"2023-10-19T12:41:46.307039+0000","last_peered":"2023-10-19T12:41:46.307039+0000","last_clean":"2023-10-19T12:41:46.307039+0000","last_became_active":"2023-10-19T12:41:18.289226+0000","last_became_peered":"2023-10-19T12:41:18.289226+0000","last_unstale":"2023-10-19T12:41:46.307039+0000","last_undegraded":"2023-10-19T12:41:46.307039+0000","last_fullsized":"2023-10-19T12:41:46.307039+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T21:18:19.007202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.313003+0000","last_change":"2023-10-19T12:41:19.300555+0000","last_active":"2023-10-19T12:41:23.313003+0000","last_peered":"2023-10-19T12:41:23.313003+0000","last_clean":"2023-10-19T12:41:23.313003+0000","last_became_active":"2023-10-19T12:41:19.300162+0000","last_became_peered":"2023-10-19T12:41:19.300162+0000","last_unstale":"2023-10-19T12:41:23.313003+0000","last_undegraded":"2023-10-19T12:41:23.313003+0000","last_fullsized":"2023-10-19T12:41:23.313003+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:26:33.779562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:24.314248+0000","last_change":"2023-10-19T12:41:23.338750+0000","last_active":"2023-10-19T12:41:24.314248+0000","last_peered":"2023-10-19T12:41:24.314248+0000","last_clean":"2023-10-19T12:41:24.314248+0000","last_became_active":"2023-10-19T12:41:23.338318+0000","last_became_peered":"2023-10-19T12:41:23.338318+0000","last_unstale":"2023-10-19T12:41:24.314248+0000","last_undegraded":"2023-10-19T12:41:24.314248+0000","last_fullsized":"2023-10-19T12:41:24.314248+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:11:20.182270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"88'4","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:43.277887+0000","last_change":"2023-10-19T12:41:18.293923+0000","last_active":"2023-10-19T12:41:43.277887+0000","last_peered":"2023-10-19T12:41:43.277887+0000","last_clean":"2023-10-19T12:41:43.277887+0000","last_became_active":"2023-10-19T12:41:18.293688+0000","last_became_peered":"2023-10-19T12:41:18.293688+0000","last_unstale":"2023-10-19T12:41:43.277887+0000","last_undegraded":"2023-10-19T12:41:43.277887+0000","last_fullsized":"2023-10-19T12:41:43.277887+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:34:15.162178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.317645+0000","last_change":"2023-10-19T12:41:19.302733+0000","last_active":"2023-10-19T12:41:23.317645+0000","last_peered":"2023-10-19T12:41:23.317645+0000","last_clean":"2023-10-19T12:41:23.317645+0000","last_became_active":"2023-10-19T12:41:19.302401+0000","last_became_peered":"2023-10-19T12:41:19.302401+0000","last_unstale":"2023-10-19T12:41:23.317645+0000","last_undegraded":"2023-10-19T12:41:23.317645+0000","last_fullsized":"2023-10-19T12:41:23.317645+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:55:05.864499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:25.011161+0000","last_change":"2023-10-19T12:41:23.338999+0000","last_active":"2023-10-19T12:41:25.011161+0000","last_peered":"2023-10-19T12:41:25.011161+0000","last_clean":"2023-10-19T12:41:25.011161+0000","last_became_active":"2023-10-19T12:41:23.338067+0000","last_became_peered":"2023-10-19T12:41:23.338067+0000","last_unstale":"2023-10-19T12:41:25.011161+0000","last_undegraded":"2023-10-19T12:41:25.011161+0000","last_fullsized":"2023-10-19T12:41:25.011161+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:36:12.984006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"88'5","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:45.296118+0000","last_change":"2023-10-19T12:41:18.277563+0000","last_active":"2023-10-19T12:41:45.296118+0000","last_peered":"2023-10-19T12:41:45.296118+0000","last_clean":"2023-10-19T12:41:45.296118+0000","last_became_active":"2023-10-19T12:41:18.277255+0000","last_became_peered":"2023-10-19T12:41:18.277255+0000","last_unstale":"2023-10-19T12:41:45.296118+0000","last_undegraded":"2023-10-19T12:41:45.296118+0000","last_fullsized":"2023-10-19T12:41:45.296118+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:28:31.468355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.317585+0000","last_change":"2023-10-19T12:41:19.288939+0000","last_active":"2023-10-19T12:41:23.317585+0000","last_peered":"2023-10-19T12:41:23.317585+0000","last_clean":"2023-10-19T12:41:23.317585+0000","last_became_active":"2023-10-19T12:41:19.288612+0000","last_became_peered":"2023-10-19T12:41:19.288612+0000","last_unstale":"2023-10-19T12:41:23.317585+0000","last_undegraded":"2023-10-19T12:41:23.317585+0000","last_fullsized":"2023-10-19T12:41:23.317585+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:45:36.050331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:25.181275+0000","last_change":"2023-10-19T12:41:23.333823+0000","last_active":"2023-10-19T12:41:25.181275+0000","last_peered":"2023-10-19T12:41:25.181275+0000","last_clean":"2023-10-19T12:41:25.181275+0000","last_became_active":"2023-10-19T12:41:23.332698+0000","last_became_peered":"2023-10-19T12:41:23.332698+0000","last_unstale":"2023-10-19T12:41:25.181275+0000","last_undegraded":"2023-10-19T12:41:25.181275+0000","last_fullsized":"2023-10-19T12:41:25.181275+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:54:43.952531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"88'15","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:44.289804+0000","last_change":"2023-10-19T12:41:18.290426+0000","last_active":"2023-10-19T12:41:44.289804+0000","last_peered":"2023-10-19T12:41:44.289804+0000","last_clean":"2023-10-19T12:41:44.289804+0000","last_became_active":"2023-10-19T12:41:18.290096+0000","last_became_peered":"2023-10-19T12:41:18.290096+0000","last_unstale":"2023-10-19T12:41:44.289804+0000","last_undegraded":"2023-10-19T12:41:44.289804+0000","last_fullsized":"2023-10-19T12:41:44.289804+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:14:34.731869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.325958+0000","last_change":"2023-10-19T12:41:19.300423+0000","last_active":"2023-10-19T12:41:23.325958+0000","last_peered":"2023-10-19T12:41:23.325958+0000","last_clean":"2023-10-19T12:41:23.325958+0000","last_became_active":"2023-10-19T12:41:19.299999+0000","last_became_peered":"2023-10-19T12:41:19.299999+0000","last_unstale":"2023-10-19T12:41:23.325958+0000","last_undegraded":"2023-10-19T12:41:23.325958+0000","last_fullsized":"2023-10-19T12:41:23.325958+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:35:32.703396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:25.679660+0000","last_change":"2023-10-19T12:41:23.330091+0000","last_active":"2023-10-19T12:41:25.679660+0000","last_peered":"2023-10-19T12:41:25.679660+0000","last_clean":"2023-10-19T12:41:25.679660+0000","last_became_active":"2023-10-19T12:41:23.329695+0000","last_became_peered":"2023-10-19T12:41:23.329695+0000","last_unstale":"2023-10-19T12:41:25.679660+0000","last_undegraded":"2023-10-19T12:41:25.679660+0000","last_fullsized":"2023-10-19T12:41:25.679660+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:37:09.840232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"83'1","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.320875+0000","last_change":"2023-10-19T12:41:18.279761+0000","last_active":"2023-10-19T12:41:23.320875+0000","last_peered":"2023-10-19T12:41:23.320875+0000","last_clean":"2023-10-19T12:41:23.320875+0000","last_became_active":"2023-10-19T12:41:18.279430+0000","last_became_peered":"2023-10-19T12:41:18.279430+0000","last_unstale":"2023-10-19T12:41:23.320875+0000","last_undegraded":"2023-10-19T12:41:23.320875+0000","last_fullsized":"2023-10-19T12:41:23.320875+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:43:32.447842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.319789+0000","last_change":"2023-10-19T12:41:19.290406+0000","last_active":"2023-10-19T12:41:23.319789+0000","last_peered":"2023-10-19T12:41:23.319789+0000","last_clean":"2023-10-19T12:41:23.319789+0000","last_became_active":"2023-10-19T12:41:19.290032+0000","last_became_peered":"2023-10-19T12:41:19.290032+0000","last_unstale":"2023-10-19T12:41:23.319789+0000","last_undegraded":"2023-10-19T12:41:23.319789+0000","last_fullsized":"2023-10-19T12:41:23.319789+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:30:30.875800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:25.679154+0000","last_change":"2023-10-19T12:41:23.478036+0000","last_active":"2023-10-19T12:41:25.679154+0000","last_peered":"2023-10-19T12:41:25.679154+0000","last_clean":"2023-10-19T12:41:25.679154+0000","last_became_active":"2023-10-19T12:41:23.477542+0000","last_became_peered":"2023-10-19T12:41:23.477542+0000","last_unstale":"2023-10-19T12:41:25.679154+0000","last_undegraded":"2023-10-19T12:41:25.679154+0000","last_fullsized":"2023-10-19T12:41:25.679154+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:32:24.599591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.318260+0000","last_change":"2023-10-19T12:41:18.289254+0000","last_active":"2023-10-19T12:41:23.318260+0000","last_peered":"2023-10-19T12:41:23.318260+0000","last_clean":"2023-10-19T12:41:23.318260+0000","last_became_active":"2023-10-19T12:41:18.287036+0000","last_became_peered":"2023-10-19T12:41:18.287036+0000","last_unstale":"2023-10-19T12:41:23.318260+0000","last_undegraded":"2023-10-19T12:41:23.318260+0000","last_fullsized":"2023-10-19T12:41:23.318260+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T21:33:41.720725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.478113+0000","last_change":"2023-10-19T12:41:19.299711+0000","last_active":"2023-10-19T12:41:23.478113+0000","last_peered":"2023-10-19T12:41:23.478113+0000","last_clean":"2023-10-19T12:41:23.478113+0000","last_became_active":"2023-10-19T12:41:19.299367+0000","last_became_peered":"2023-10-19T12:41:19.299367+0000","last_unstale":"2023-10-19T12:41:23.478113+0000","last_undegraded":"2023-10-19T12:41:23.478113+0000","last_fullsized":"2023-10-19T12:41:23.478113+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:32:36.783990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:25.181012+0000","last_change":"2023-10-19T12:41:23.328301+0000","last_active":"2023-10-19T12:41:25.181012+0000","last_peered":"2023-10-19T12:41:25.181012+0000","last_clean":"2023-10-19T12:41:25.181012+0000","last_became_active":"2023-10-19T12:41:23.327866+0000","last_became_peered":"2023-10-19T12:41:23.327866+0000","last_unstale":"2023-10-19T12:41:25.181012+0000","last_undegraded":"2023-10-19T12:41:25.181012+0000","last_fullsized":"2023-10-19T12:41:25.181012+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T21:53:23.600196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"88'5","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:47.312657+0000","last_change":"2023-10-19T12:41:18.286635+0000","last_active":"2023-10-19T12:41:47.312657+0000","last_peered":"2023-10-19T12:41:47.312657+0000","last_clean":"2023-10-19T12:41:47.312657+0000","last_became_active":"2023-10-19T12:41:18.286310+0000","last_became_peered":"2023-10-19T12:41:18.286310+0000","last_unstale":"2023-10-19T12:41:47.312657+0000","last_undegraded":"2023-10-19T12:41:47.312657+0000","last_fullsized":"2023-10-19T12:41:47.312657+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:30:38.266038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.477637+0000","last_change":"2023-10-19T12:41:19.297989+0000","last_active":"2023-10-19T12:41:23.477637+0000","last_peered":"2023-10-19T12:41:23.477637+0000","last_clean":"2023-10-19T12:41:23.477637+0000","last_became_active":"2023-10-19T12:41:19.297680+0000","last_became_peered":"2023-10-19T12:41:19.297680+0000","last_unstale":"2023-10-19T12:41:23.477637+0000","last_undegraded":"2023-10-19T12:41:23.477637+0000","last_fullsized":"2023-10-19T12:41:23.477637+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:40:22.883804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:25.181247+0000","last_change":"2023-10-19T12:41:23.478723+0000","last_active":"2023-10-19T12:41:25.181247+0000","last_peered":"2023-10-19T12:41:25.181247+0000","last_clean":"2023-10-19T12:41:25.181247+0000","last_became_active":"2023-10-19T12:41:23.478063+0000","last_became_peered":"2023-10-19T12:41:23.478063+0000","last_unstale":"2023-10-19T12:41:25.181247+0000","last_undegraded":"2023-10-19T12:41:25.181247+0000","last_fullsized":"2023-10-19T12:41:25.181247+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:41:00.885308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.326531+0000","last_change":"2023-10-19T12:41:19.285478+0000","last_active":"2023-10-19T12:41:23.326531+0000","last_peered":"2023-10-19T12:41:23.326531+0000","last_clean":"2023-10-19T12:41:23.326531+0000","last_became_active":"2023-10-19T12:41:19.285175+0000","last_became_peered":"2023-10-19T12:41:19.285175+0000","last_unstale":"2023-10-19T12:41:23.326531+0000","last_undegraded":"2023-10-19T12:41:23.326531+0000","last_fullsized":"2023-10-19T12:41:23.326531+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:18:03.423712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"88'4","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:44.290133+0000","last_change":"2023-10-19T12:41:18.297207+0000","last_active":"2023-10-19T12:41:44.290133+0000","last_peered":"2023-10-19T12:41:44.290133+0000","last_clean":"2023-10-19T12:41:44.290133+0000","last_became_active":"2023-10-19T12:41:18.296490+0000","last_became_peered":"2023-10-19T12:41:18.296490+0000","last_unstale":"2023-10-19T12:41:44.290133+0000","last_undegraded":"2023-10-19T12:41:44.290133+0000","last_fullsized":"2023-10-19T12:41:44.290133+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:42:33.769810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"88'1","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:24.363934+0000","last_change":"2023-10-19T12:41:23.338803+0000","last_active":"2023-10-19T12:41:24.363934+0000","last_peered":"2023-10-19T12:41:24.363934+0000","last_clean":"2023-10-19T12:41:24.363934+0000","last_became_active":"2023-10-19T12:41:23.338383+0000","last_became_peered":"2023-10-19T12:41:23.338383+0000","last_unstale":"2023-10-19T12:41:24.363934+0000","last_undegraded":"2023-10-19T12:41:24.363934+0000","last_fullsized":"2023-10-19T12:41:24.363934+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:39:24.412323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.323173+0000","last_change":"2023-10-19T12:41:19.290536+0000","last_active":"2023-10-19T12:41:23.323173+0000","last_peered":"2023-10-19T12:41:23.323173+0000","last_clean":"2023-10-19T12:41:23.323173+0000","last_became_active":"2023-10-19T12:41:19.290141+0000","last_became_peered":"2023-10-19T12:41:19.290141+0000","last_unstale":"2023-10-19T12:41:23.323173+0000","last_undegraded":"2023-10-19T12:41:23.323173+0000","last_fullsized":"2023-10-19T12:41:23.323173+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:49:59.601767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"88'5","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:45.299567+0000","last_change":"2023-10-19T12:41:18.276568+0000","last_active":"2023-10-19T12:41:45.299567+0000","last_peered":"2023-10-19T12:41:45.299567+0000","last_clean":"2023-10-19T12:41:45.299567+0000","last_became_active":"2023-10-19T12:41:18.276216+0000","last_became_peered":"2023-10-19T12:41:18.276216+0000","last_unstale":"2023-10-19T12:41:45.299567+0000","last_undegraded":"2023-10-19T12:41:45.299567+0000","last_fullsized":"2023-10-19T12:41:45.299567+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T23:24:32.159972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":311,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.317325+0000","last_change":"2023-10-19T12:40:14.674594+0000","last_active":"2023-10-19T12:41:23.317325+0000","last_peered":"2023-10-19T12:41:23.317325+0000","last_clean":"2023-10-19T12:41:23.317325+0000","last_became_active":"2023-10-19T12:40:14.674234+0000","last_became_peered":"2023-10-19T12:40:14.674234+0000","last_unstale":"2023-10-19T12:41:23.317325+0000","last_undegraded":"2023-10-19T12:41:23.317325+0000","last_fullsized":"2023-10-19T12:41:23.317325+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:37:07.222565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:37:07.222565+0000","last_clean_scrub_stamp":"2023-10-19T12:37:07.222565+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-21T00:22:40.530907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:25.679196+0000","last_change":"2023-10-19T12:41:23.479328+0000","last_active":"2023-10-19T12:41:25.679196+0000","last_peered":"2023-10-19T12:41:25.679196+0000","last_clean":"2023-10-19T12:41:25.679196+0000","last_became_active":"2023-10-19T12:41:23.478972+0000","last_became_peered":"2023-10-19T12:41:23.478972+0000","last_unstale":"2023-10-19T12:41:25.679196+0000","last_undegraded":"2023-10-19T12:41:25.679196+0000","last_fullsized":"2023-10-19T12:41:25.679196+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:58:38.949721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.312649+0000","last_change":"2023-10-19T12:41:19.294132+0000","last_active":"2023-10-19T12:41:23.312649+0000","last_peered":"2023-10-19T12:41:23.312649+0000","last_clean":"2023-10-19T12:41:23.312649+0000","last_became_active":"2023-10-19T12:41:19.293800+0000","last_became_peered":"2023-10-19T12:41:19.293800+0000","last_unstale":"2023-10-19T12:41:23.312649+0000","last_undegraded":"2023-10-19T12:41:23.312649+0000","last_fullsized":"2023-10-19T12:41:23.312649+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:30:56.734581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"88'4","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:44.287552+0000","last_change":"2023-10-19T12:41:18.282440+0000","last_active":"2023-10-19T12:41:44.287552+0000","last_peered":"2023-10-19T12:41:44.287552+0000","last_clean":"2023-10-19T12:41:44.287552+0000","last_became_active":"2023-10-19T12:41:18.282200+0000","last_became_peered":"2023-10-19T12:41:18.282200+0000","last_unstale":"2023-10-19T12:41:44.287552+0000","last_undegraded":"2023-10-19T12:41:44.287552+0000","last_fullsized":"2023-10-19T12:41:44.287552+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:06:22.767488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:24.314192+0000","last_change":"2023-10-19T12:41:23.328605+0000","last_active":"2023-10-19T12:41:24.314192+0000","last_peered":"2023-10-19T12:41:24.314192+0000","last_clean":"2023-10-19T12:41:24.314192+0000","last_became_active":"2023-10-19T12:41:23.327992+0000","last_became_peered":"2023-10-19T12:41:23.327992+0000","last_unstale":"2023-10-19T12:41:24.314192+0000","last_undegraded":"2023-10-19T12:41:24.314192+0000","last_fullsized":"2023-10-19T12:41:24.314192+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:00:04.415235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"88'1","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:25.678777+0000","last_change":"2023-10-19T12:41:18.290347+0000","last_active":"2023-10-19T12:41:25.678777+0000","last_peered":"2023-10-19T12:41:25.678777+0000","last_clean":"2023-10-19T12:41:25.678777+0000","last_became_active":"2023-10-19T12:41:18.290050+0000","last_became_peered":"2023-10-19T12:41:18.290050+0000","last_unstale":"2023-10-19T12:41:25.678777+0000","last_undegraded":"2023-10-19T12:41:25.678777+0000","last_fullsized":"2023-10-19T12:41:25.678777+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:19:05.618338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.313574+0000","last_change":"2023-10-19T12:41:19.303753+0000","last_active":"2023-10-19T12:41:23.313574+0000","last_peered":"2023-10-19T12:41:23.313574+0000","last_clean":"2023-10-19T12:41:23.313574+0000","last_became_active":"2023-10-19T12:41:19.299710+0000","last_became_peered":"2023-10-19T12:41:19.299710+0000","last_unstale":"2023-10-19T12:41:23.313574+0000","last_undegraded":"2023-10-19T12:41:23.313574+0000","last_fullsized":"2023-10-19T12:41:23.313574+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:40:27.929956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:25.677655+0000","last_change":"2023-10-19T12:41:23.478159+0000","last_active":"2023-10-19T12:41:25.677655+0000","last_peered":"2023-10-19T12:41:25.677655+0000","last_clean":"2023-10-19T12:41:25.677655+0000","last_became_active":"2023-10-19T12:41:23.477647+0000","last_became_peered":"2023-10-19T12:41:23.477647+0000","last_unstale":"2023-10-19T12:41:25.677655+0000","last_undegraded":"2023-10-19T12:41:25.677655+0000","last_fullsized":"2023-10-19T12:41:25.677655+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:48:31.904477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"85'1","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.324454+0000","last_change":"2023-10-19T12:41:18.295746+0000","last_active":"2023-10-19T12:41:23.324454+0000","last_peered":"2023-10-19T12:41:23.324454+0000","last_clean":"2023-10-19T12:41:23.324454+0000","last_became_active":"2023-10-19T12:41:18.294855+0000","last_became_peered":"2023-10-19T12:41:18.294855+0000","last_unstale":"2023-10-19T12:41:23.324454+0000","last_undegraded":"2023-10-19T12:41:23.324454+0000","last_fullsized":"2023-10-19T12:41:23.324454+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:52:24.628136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.328276+0000","last_change":"2023-10-19T12:41:19.283960+0000","last_active":"2023-10-19T12:41:23.328276+0000","last_peered":"2023-10-19T12:41:23.328276+0000","last_clean":"2023-10-19T12:41:23.328276+0000","last_became_active":"2023-10-19T12:41:19.282544+0000","last_became_peered":"2023-10-19T12:41:19.282544+0000","last_unstale":"2023-10-19T12:41:23.328276+0000","last_undegraded":"2023-10-19T12:41:23.328276+0000","last_fullsized":"2023-10-19T12:41:23.328276+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T23:58:08.794192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:24.974529+0000","last_change":"2023-10-19T12:41:23.323593+0000","last_active":"2023-10-19T12:41:24.974529+0000","last_peered":"2023-10-19T12:41:24.974529+0000","last_clean":"2023-10-19T12:41:24.974529+0000","last_became_active":"2023-10-19T12:41:23.323204+0000","last_became_peered":"2023-10-19T12:41:23.323204+0000","last_unstale":"2023-10-19T12:41:24.974529+0000","last_undegraded":"2023-10-19T12:41:24.974529+0000","last_fullsized":"2023-10-19T12:41:24.974529+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:15:15.379085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"88'5","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:43.278164+0000","last_change":"2023-10-19T12:41:18.286231+0000","last_active":"2023-10-19T12:41:43.278164+0000","last_peered":"2023-10-19T12:41:43.278164+0000","last_clean":"2023-10-19T12:41:43.278164+0000","last_became_active":"2023-10-19T12:41:18.285932+0000","last_became_peered":"2023-10-19T12:41:18.285932+0000","last_unstale":"2023-10-19T12:41:43.278164+0000","last_undegraded":"2023-10-19T12:41:43.278164+0000","last_fullsized":"2023-10-19T12:41:43.278164+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:13:02.066468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.322823+0000","last_change":"2023-10-19T12:41:19.305534+0000","last_active":"2023-10-19T12:41:23.322823+0000","last_peered":"2023-10-19T12:41:23.322823+0000","last_clean":"2023-10-19T12:41:23.322823+0000","last_became_active":"2023-10-19T12:41:19.304994+0000","last_became_peered":"2023-10-19T12:41:19.304994+0000","last_unstale":"2023-10-19T12:41:23.322823+0000","last_undegraded":"2023-10-19T12:41:23.322823+0000","last_fullsized":"2023-10-19T12:41:23.322823+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:05:38.896173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:24.314878+0000","last_change":"2023-10-19T12:41:23.479129+0000","last_active":"2023-10-19T12:41:24.314878+0000","last_peered":"2023-10-19T12:41:24.314878+0000","last_clean":"2023-10-19T12:41:24.314878+0000","last_became_active":"2023-10-19T12:41:23.478518+0000","last_became_peered":"2023-10-19T12:41:23.478518+0000","last_unstale":"2023-10-19T12:41:24.314878+0000","last_undegraded":"2023-10-19T12:41:24.314878+0000","last_fullsized":"2023-10-19T12:41:24.314878+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:55:38.767504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"88'2","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:43.276813+0000","last_change":"2023-10-19T12:41:18.283269+0000","last_active":"2023-10-19T12:41:43.276813+0000","last_peered":"2023-10-19T12:41:43.276813+0000","last_clean":"2023-10-19T12:41:43.276813+0000","last_became_active":"2023-10-19T12:41:18.282913+0000","last_became_peered":"2023-10-19T12:41:18.282913+0000","last_unstale":"2023-10-19T12:41:43.276813+0000","last_undegraded":"2023-10-19T12:41:43.276813+0000","last_fullsized":"2023-10-19T12:41:43.276813+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:44:01.042312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.318847+0000","last_change":"2023-10-19T12:41:19.284222+0000","last_active":"2023-10-19T12:41:23.318847+0000","last_peered":"2023-10-19T12:41:23.318847+0000","last_clean":"2023-10-19T12:41:23.318847+0000","last_became_active":"2023-10-19T12:41:19.283914+0000","last_became_peered":"2023-10-19T12:41:19.283914+0000","last_unstale":"2023-10-19T12:41:23.318847+0000","last_undegraded":"2023-10-19T12:41:23.318847+0000","last_fullsized":"2023-10-19T12:41:23.318847+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:15:34.801502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:25.011335+0000","last_change":"2023-10-19T12:41:23.338071+0000","last_active":"2023-10-19T12:41:25.011335+0000","last_peered":"2023-10-19T12:41:25.011335+0000","last_clean":"2023-10-19T12:41:25.011335+0000","last_became_active":"2023-10-19T12:41:23.336265+0000","last_became_peered":"2023-10-19T12:41:23.336265+0000","last_unstale":"2023-10-19T12:41:25.011335+0000","last_undegraded":"2023-10-19T12:41:25.011335+0000","last_fullsized":"2023-10-19T12:41:25.011335+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:02:53.139468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"88'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:46.306875+0000","last_change":"2023-10-19T12:41:18.293027+0000","last_active":"2023-10-19T12:41:46.306875+0000","last_peered":"2023-10-19T12:41:46.306875+0000","last_clean":"2023-10-19T12:41:46.306875+0000","last_became_active":"2023-10-19T12:41:18.289478+0000","last_became_peered":"2023-10-19T12:41:18.289478+0000","last_unstale":"2023-10-19T12:41:46.306875+0000","last_undegraded":"2023-10-19T12:41:46.306875+0000","last_fullsized":"2023-10-19T12:41:46.306875+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:26:32.986754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.319785+0000","last_change":"2023-10-19T12:41:19.293206+0000","last_active":"2023-10-19T12:41:23.319785+0000","last_peered":"2023-10-19T12:41:23.319785+0000","last_clean":"2023-10-19T12:41:23.319785+0000","last_became_active":"2023-10-19T12:41:19.292898+0000","last_became_peered":"2023-10-19T12:41:19.292898+0000","last_unstale":"2023-10-19T12:41:23.319785+0000","last_undegraded":"2023-10-19T12:41:23.319785+0000","last_fullsized":"2023-10-19T12:41:23.319785+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T23:36:17.548859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:24.314867+0000","last_change":"2023-10-19T12:41:23.343048+0000","last_active":"2023-10-19T12:41:24.314867+0000","last_peered":"2023-10-19T12:41:24.314867+0000","last_clean":"2023-10-19T12:41:24.314867+0000","last_became_active":"2023-10-19T12:41:23.342696+0000","last_became_peered":"2023-10-19T12:41:23.342696+0000","last_unstale":"2023-10-19T12:41:24.314867+0000","last_undegraded":"2023-10-19T12:41:24.314867+0000","last_fullsized":"2023-10-19T12:41:24.314867+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:30:38.858947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"88'2","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:45.299861+0000","last_change":"2023-10-19T12:41:18.293079+0000","last_active":"2023-10-19T12:41:45.299861+0000","last_peered":"2023-10-19T12:41:45.299861+0000","last_clean":"2023-10-19T12:41:45.299861+0000","last_became_active":"2023-10-19T12:41:18.292803+0000","last_became_peered":"2023-10-19T12:41:18.292803+0000","last_unstale":"2023-10-19T12:41:45.299861+0000","last_undegraded":"2023-10-19T12:41:45.299861+0000","last_fullsized":"2023-10-19T12:41:45.299861+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T22:37:14.550800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.327908+0000","last_change":"2023-10-19T12:41:19.292921+0000","last_active":"2023-10-19T12:41:23.327908+0000","last_peered":"2023-10-19T12:41:23.327908+0000","last_clean":"2023-10-19T12:41:23.327908+0000","last_became_active":"2023-10-19T12:41:19.292498+0000","last_became_peered":"2023-10-19T12:41:19.292498+0000","last_unstale":"2023-10-19T12:41:23.327908+0000","last_undegraded":"2023-10-19T12:41:23.327908+0000","last_fullsized":"2023-10-19T12:41:23.327908+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T22:02:55.878154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:24.314917+0000","last_change":"2023-10-19T12:41:23.477894+0000","last_active":"2023-10-19T12:41:24.314917+0000","last_peered":"2023-10-19T12:41:24.314917+0000","last_clean":"2023-10-19T12:41:24.314917+0000","last_became_active":"2023-10-19T12:41:23.477478+0000","last_became_peered":"2023-10-19T12:41:23.477478+0000","last_unstale":"2023-10-19T12:41:24.314917+0000","last_undegraded":"2023-10-19T12:41:24.314917+0000","last_fullsized":"2023-10-19T12:41:24.314917+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:44:21.730215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"88'4","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:43.277225+0000","last_change":"2023-10-19T12:41:18.282474+0000","last_active":"2023-10-19T12:41:43.277225+0000","last_peered":"2023-10-19T12:41:43.277225+0000","last_clean":"2023-10-19T12:41:43.277225+0000","last_became_active":"2023-10-19T12:41:18.282124+0000","last_became_peered":"2023-10-19T12:41:18.282124+0000","last_unstale":"2023-10-19T12:41:43.277225+0000","last_undegraded":"2023-10-19T12:41:43.277225+0000","last_fullsized":"2023-10-19T12:41:43.277225+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T21:27:37.530324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.318464+0000","last_change":"2023-10-19T12:41:19.302928+0000","last_active":"2023-10-19T12:41:23.318464+0000","last_peered":"2023-10-19T12:41:23.318464+0000","last_clean":"2023-10-19T12:41:23.318464+0000","last_became_active":"2023-10-19T12:41:19.302641+0000","last_became_peered":"2023-10-19T12:41:19.302641+0000","last_unstale":"2023-10-19T12:41:23.318464+0000","last_undegraded":"2023-10-19T12:41:23.318464+0000","last_fullsized":"2023-10-19T12:41:23.318464+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:07:46.333875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:25.678248+0000","last_change":"2023-10-19T12:41:23.329079+0000","last_active":"2023-10-19T12:41:25.678248+0000","last_peered":"2023-10-19T12:41:25.678248+0000","last_clean":"2023-10-19T12:41:25.678248+0000","last_became_active":"2023-10-19T12:41:23.328407+0000","last_became_peered":"2023-10-19T12:41:23.328407+0000","last_unstale":"2023-10-19T12:41:25.678248+0000","last_undegraded":"2023-10-19T12:41:25.678248+0000","last_fullsized":"2023-10-19T12:41:25.678248+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:46:19.404922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"88'6","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:45.300926+0000","last_change":"2023-10-19T12:41:18.286336+0000","last_active":"2023-10-19T12:41:45.300926+0000","last_peered":"2023-10-19T12:41:45.300926+0000","last_clean":"2023-10-19T12:41:45.300926+0000","last_became_active":"2023-10-19T12:41:18.285921+0000","last_became_peered":"2023-10-19T12:41:18.285921+0000","last_unstale":"2023-10-19T12:41:45.300926+0000","last_undegraded":"2023-10-19T12:41:45.300926+0000","last_fullsized":"2023-10-19T12:41:45.300926+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T23:16:34.842143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1560,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.318758+0000","last_change":"2023-10-19T12:41:19.289466+0000","last_active":"2023-10-19T12:41:23.318758+0000","last_peered":"2023-10-19T12:41:23.318758+0000","last_clean":"2023-10-19T12:41:23.318758+0000","last_became_active":"2023-10-19T12:41:19.288669+0000","last_became_peered":"2023-10-19T12:41:19.288669+0000","last_unstale":"2023-10-19T12:41:23.318758+0000","last_undegraded":"2023-10-19T12:41:23.318758+0000","last_fullsized":"2023-10-19T12:41:23.318758+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T23:31:52.163958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:25.721656+0000","last_change":"2023-10-19T12:41:23.343521+0000","last_active":"2023-10-19T12:41:25.721656+0000","last_peered":"2023-10-19T12:41:25.721656+0000","last_clean":"2023-10-19T12:41:25.721656+0000","last_became_active":"2023-10-19T12:41:23.342288+0000","last_became_peered":"2023-10-19T12:41:23.342288+0000","last_unstale":"2023-10-19T12:41:25.721656+0000","last_undegraded":"2023-10-19T12:41:25.721656+0000","last_fullsized":"2023-10-19T12:41:25.721656+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:58:06.810552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"88'2","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:25.679287+0000","last_change":"2023-10-19T12:41:18.294999+0000","last_active":"2023-10-19T12:41:25.679287+0000","last_peered":"2023-10-19T12:41:25.679287+0000","last_clean":"2023-10-19T12:41:25.679287+0000","last_became_active":"2023-10-19T12:41:18.294776+0000","last_became_peered":"2023-10-19T12:41:18.294776+0000","last_unstale":"2023-10-19T12:41:25.679287+0000","last_undegraded":"2023-10-19T12:41:25.679287+0000","last_fullsized":"2023-10-19T12:41:25.679287+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:17:53.704739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.321135+0000","last_change":"2023-10-19T12:41:19.291753+0000","last_active":"2023-10-19T12:41:23.321135+0000","last_peered":"2023-10-19T12:41:23.321135+0000","last_clean":"2023-10-19T12:41:23.321135+0000","last_became_active":"2023-10-19T12:41:19.291475+0000","last_became_peered":"2023-10-19T12:41:19.291475+0000","last_unstale":"2023-10-19T12:41:23.321135+0000","last_undegraded":"2023-10-19T12:41:23.321135+0000","last_fullsized":"2023-10-19T12:41:23.321135+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:26:38.494864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:25.678430+0000","last_change":"2023-10-19T12:41:23.327966+0000","last_active":"2023-10-19T12:41:25.678430+0000","last_peered":"2023-10-19T12:41:25.678430+0000","last_clean":"2023-10-19T12:41:25.678430+0000","last_became_active":"2023-10-19T12:41:23.327555+0000","last_became_peered":"2023-10-19T12:41:23.327555+0000","last_unstale":"2023-10-19T12:41:25.678430+0000","last_undegraded":"2023-10-19T12:41:25.678430+0000","last_fullsized":"2023-10-19T12:41:25.678430+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:01:34.044012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"88'3","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-19T12:41:25.181195+0000","last_change":"2023-10-19T12:41:18.297472+0000","last_active":"2023-10-19T12:41:25.181195+0000","last_peered":"2023-10-19T12:41:25.181195+0000","last_clean":"2023-10-19T12:41:25.181195+0000","last_became_active":"2023-10-19T12:41:18.296410+0000","last_became_peered":"2023-10-19T12:41:18.296410+0000","last_unstale":"2023-10-19T12:41:25.181195+0000","last_undegraded":"2023-10-19T12:41:25.181195+0000","last_fullsized":"2023-10-19T12:41:25.181195+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:20:15.039332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.318065+0000","last_change":"2023-10-19T12:41:19.295136+0000","last_active":"2023-10-19T12:41:23.318065+0000","last_peered":"2023-10-19T12:41:23.318065+0000","last_clean":"2023-10-19T12:41:23.318065+0000","last_became_active":"2023-10-19T12:41:19.294836+0000","last_became_peered":"2023-10-19T12:41:19.294836+0000","last_unstale":"2023-10-19T12:41:23.318065+0000","last_undegraded":"2023-10-19T12:41:23.318065+0000","last_fullsized":"2023-10-19T12:41:23.318065+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:08:25.830396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.319830+0000","last_change":"2023-10-19T12:41:19.290047+0000","last_active":"2023-10-19T12:41:23.319830+0000","last_peered":"2023-10-19T12:41:23.319830+0000","last_clean":"2023-10-19T12:41:23.319830+0000","last_became_active":"2023-10-19T12:41:19.289792+0000","last_became_peered":"2023-10-19T12:41:19.289792+0000","last_unstale":"2023-10-19T12:41:23.319830+0000","last_undegraded":"2023-10-19T12:41:23.319830+0000","last_fullsized":"2023-10-19T12:41:23.319830+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:10:58.981643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.319390+0000","last_change":"2023-10-19T12:41:19.287973+0000","last_active":"2023-10-19T12:41:23.319390+0000","last_peered":"2023-10-19T12:41:23.319390+0000","last_clean":"2023-10-19T12:41:23.319390+0000","last_became_active":"2023-10-19T12:41:19.287508+0000","last_became_peered":"2023-10-19T12:41:19.287508+0000","last_unstale":"2023-10-19T12:41:23.319390+0000","last_undegraded":"2023-10-19T12:41:23.319390+0000","last_fullsized":"2023-10-19T12:41:23.319390+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:25:57.815032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.317537+0000","last_change":"2023-10-19T12:41:19.294154+0000","last_active":"2023-10-19T12:41:23.317537+0000","last_peered":"2023-10-19T12:41:23.317537+0000","last_clean":"2023-10-19T12:41:23.317537+0000","last_became_active":"2023-10-19T12:41:19.293873+0000","last_became_peered":"2023-10-19T12:41:19.293873+0000","last_unstale":"2023-10-19T12:41:23.317537+0000","last_undegraded":"2023-10-19T12:41:23.317537+0000","last_fullsized":"2023-10-19T12:41:23.317537+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:29:58.428571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.321636+0000","last_change":"2023-10-19T12:41:19.309512+0000","last_active":"2023-10-19T12:41:23.321636+0000","last_peered":"2023-10-19T12:41:23.321636+0000","last_clean":"2023-10-19T12:41:23.321636+0000","last_became_active":"2023-10-19T12:41:19.309149+0000","last_became_peered":"2023-10-19T12:41:19.309149+0000","last_unstale":"2023-10-19T12:41:23.321636+0000","last_undegraded":"2023-10-19T12:41:23.321636+0000","last_fullsized":"2023-10-19T12:41:23.321636+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:19:34.971413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.313652+0000","last_change":"2023-10-19T12:41:19.301496+0000","last_active":"2023-10-19T12:41:23.313652+0000","last_peered":"2023-10-19T12:41:23.313652+0000","last_clean":"2023-10-19T12:41:23.313652+0000","last_became_active":"2023-10-19T12:41:19.299697+0000","last_became_peered":"2023-10-19T12:41:19.299697+0000","last_unstale":"2023-10-19T12:41:23.313652+0000","last_undegraded":"2023-10-19T12:41:23.313652+0000","last_fullsized":"2023-10-19T12:41:23.313652+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T23:51:52.448215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.317056+0000","last_change":"2023-10-19T12:41:19.289995+0000","last_active":"2023-10-19T12:41:23.317056+0000","last_peered":"2023-10-19T12:41:23.317056+0000","last_clean":"2023-10-19T12:41:23.317056+0000","last_became_active":"2023-10-19T12:41:19.289471+0000","last_became_peered":"2023-10-19T12:41:19.289471+0000","last_unstale":"2023-10-19T12:41:23.317056+0000","last_undegraded":"2023-10-19T12:41:23.317056+0000","last_fullsized":"2023-10-19T12:41:23.317056+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:28:25.801772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.317535+0000","last_change":"2023-10-19T12:41:19.287620+0000","last_active":"2023-10-19T12:41:23.317535+0000","last_peered":"2023-10-19T12:41:23.317535+0000","last_clean":"2023-10-19T12:41:23.317535+0000","last_became_active":"2023-10-19T12:41:19.287298+0000","last_became_peered":"2023-10-19T12:41:19.287298+0000","last_unstale":"2023-10-19T12:41:23.317535+0000","last_undegraded":"2023-10-19T12:41:23.317535+0000","last_fullsized":"2023-10-19T12:41:23.317535+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:01:46.919580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.328365+0000","last_change":"2023-10-19T12:41:19.278455+0000","last_active":"2023-10-19T12:41:23.328365+0000","last_peered":"2023-10-19T12:41:23.328365+0000","last_clean":"2023-10-19T12:41:23.328365+0000","last_became_active":"2023-10-19T12:41:19.278093+0000","last_became_peered":"2023-10-19T12:41:19.278093+0000","last_unstale":"2023-10-19T12:41:23.328365+0000","last_undegraded":"2023-10-19T12:41:23.328365+0000","last_fullsized":"2023-10-19T12:41:23.328365+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T22:52:00.939409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.325385+0000","last_change":"2023-10-19T12:41:19.294478+0000","last_active":"2023-10-19T12:41:23.325385+0000","last_peered":"2023-10-19T12:41:23.325385+0000","last_clean":"2023-10-19T12:41:23.325385+0000","last_became_active":"2023-10-19T12:41:19.294136+0000","last_became_peered":"2023-10-19T12:41:19.294136+0000","last_unstale":"2023-10-19T12:41:23.325385+0000","last_undegraded":"2023-10-19T12:41:23.325385+0000","last_fullsized":"2023-10-19T12:41:23.325385+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:18:20.066346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.323008+0000","last_change":"2023-10-19T12:41:19.283014+0000","last_active":"2023-10-19T12:41:23.323008+0000","last_peered":"2023-10-19T12:41:23.323008+0000","last_clean":"2023-10-19T12:41:23.323008+0000","last_became_active":"2023-10-19T12:41:19.279958+0000","last_became_peered":"2023-10-19T12:41:19.279958+0000","last_unstale":"2023-10-19T12:41:23.323008+0000","last_undegraded":"2023-10-19T12:41:23.323008+0000","last_fullsized":"2023-10-19T12:41:23.323008+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-21T00:26:13.329031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.313332+0000","last_change":"2023-10-19T12:41:19.296507+0000","last_active":"2023-10-19T12:41:23.313332+0000","last_peered":"2023-10-19T12:41:23.313332+0000","last_clean":"2023-10-19T12:41:23.313332+0000","last_became_active":"2023-10-19T12:41:19.295960+0000","last_became_peered":"2023-10-19T12:41:19.295960+0000","last_unstale":"2023-10-19T12:41:23.313332+0000","last_undegraded":"2023-10-19T12:41:23.313332+0000","last_fullsized":"2023-10-19T12:41:23.313332+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T22:49:06.224425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.312867+0000","last_change":"2023-10-19T12:41:19.300262+0000","last_active":"2023-10-19T12:41:23.312867+0000","last_peered":"2023-10-19T12:41:23.312867+0000","last_clean":"2023-10-19T12:41:23.312867+0000","last_became_active":"2023-10-19T12:41:19.299702+0000","last_became_peered":"2023-10-19T12:41:19.299702+0000","last_unstale":"2023-10-19T12:41:23.312867+0000","last_undegraded":"2023-10-19T12:41:23.312867+0000","last_fullsized":"2023-10-19T12:41:23.312867+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:30:22.690228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-19T12:41:23.320102+0000","last_change":"2023-10-19T12:41:19.289863+0000","last_active":"2023-10-19T12:41:23.320102+0000","last_peered":"2023-10-19T12:41:23.320102+0000","last_clean":"2023-10-19T12:41:23.320102+0000","last_became_active":"2023-10-19T12:41:19.289556+0000","last_became_peered":"2023-10-19T12:41:19.289556+0000","last_unstale":"2023-10-19T12:41:23.320102+0000","last_undegraded":"2023-10-19T12:41:23.320102+0000","last_fullsized":"2023-10-19T12:41:23.320102+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:17:18.560081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":12288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":9836,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":156,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":368640,"data_stored":63274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":138,"ondisk_log_size":138,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":79,"seq":339302416402,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":983040,"data_stored":475462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 19 12:41:32 2023","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":8.5449999999999999,"5min":8.5449999999999999,"15min":8.5449999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":7.641,"5min":7.641,"15min":7.641},"last":0.56499999999999995}]},{"osd":1,"last update":"Thu Oct 19 12:41:32 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.883,"5min":1.883,"15min":1.883},"last":0.65300000000000002}]},{"osd":2,"last update":"Thu Oct 19 12:41:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.496,"5min":1.496,"15min":1.496},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.52700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":4,"last update":"Thu Oct 19 12:41:32 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":3.5190000000000001,"5min":3.5190000000000001,"15min":3.5190000000000001},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.72299999999999998}]},{"osd":5,"last update":"Thu Oct 19 12:41:32 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.675,"5min":1.675,"15min":1.675},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":2.089,"5min":2.089,"15min":2.089},"last":0.75}]},{"osd":6,"last update":"Thu Oct 19 12:41:32 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":2.004,"5min":2.004,"15min":2.004},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.704,"5min":1.704,"15min":1.704},"last":0.59199999999999997}]},{"osd":7,"last update":"Thu Oct 19 12:41:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":6.5590000000000002,"5min":6.5590000000000002,"15min":6.5590000000000002},"last":0.82099999999999995},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":7.3070000000000004,"5min":7.3070000000000004,"15min":7.3070000000000004},"last":0.871}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82999999999999996}]},{"osd":9,"last update":"Thu Oct 19 12:41:32 2023","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":7.8440000000000003,"5min":7.8440000000000003,"15min":7.8440000000000003},"last":0.84799999999999998},{"interface":"front","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":5.0860000000000003,"5min":5.0860000000000003,"15min":5.0860000000000003},"last":0.90000000000000002}]},{"osd":10,"last update":"Thu Oct 19 12:41:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":7.2619999999999996,"5min":7.2619999999999996,"15min":7.2619999999999996},"last":0.91200000000000003},{"interface":"front","average":{"1min":1.153,"5min":1.153,"15min":1.153},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":7.7619999999999996,"5min":7.7619999999999996,"15min":7.7619999999999996},"last":0.88900000000000001}]}]},{"osd":10,"up_from":72,"seq":309237645333,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28580,"kb_used_data":1564,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716572,"statfs":{"total":95995035648,"available":95965769728,"internally_reserved":0,"allocated":1601536,"data_stored":1065241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":1,"last update":"Thu Oct 19 12:41:11 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.504},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.627,"5min":0.627,"15min":0.627},"last":0.47799999999999998}]},{"osd":2,"last update":"Thu Oct 19 12:41:11 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":2.0659999999999998,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":2.2050000000000001,"5min":2.2050000000000001,"15min":2.2050000000000001},"last":0.63100000000000001}]},{"osd":3,"last update":"Thu Oct 19 12:41:11 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.68000000000000005}]},{"osd":4,"last update":"Thu Oct 19 12:41:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.64400000000000002}]},{"osd":5,"last update":"Thu Oct 19 12:41:11 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":2.3940000000000001,"5min":2.3940000000000001,"15min":2.3940000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":2.2530000000000001,"5min":2.2530000000000001,"15min":2.2530000000000001},"last":0.71299999999999997}]},{"osd":6,"last update":"Thu Oct 19 12:41:11 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.83599999999999997}]},{"osd":7,"last update":"Thu Oct 19 12:41:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":1.046}]},{"osd":8,"last update":"Thu Oct 19 12:41:11 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":2.012,"5min":2.012,"15min":2.012},"last":0.748},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":2.2290000000000001,"5min":2.2290000000000001,"15min":2.2290000000000001},"last":0.76000000000000001}]},{"osd":9,"last update":"Thu Oct 19 12:41:11 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.78500000000000003}]},{"osd":11,"last update":"Thu Oct 19 12:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.86399999999999999}]}]},{"osd":9,"up_from":67,"seq":287762808857,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":983040,"data_stored":470568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 19 12:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.44900000000000001}]},{"osd":1,"last update":"Thu Oct 19 12:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.80600000000000005}]},{"osd":2,"last update":"Thu Oct 19 12:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.76100000000000001}]},{"osd":3,"last update":"Thu Oct 19 12:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.82199999999999995}]},{"osd":4,"last update":"Thu Oct 19 12:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.70199999999999996}]},{"osd":5,"last update":"Thu Oct 19 12:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.54300000000000004}]},{"osd":6,"last update":"Thu Oct 19 12:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.49399999999999999}]},{"osd":7,"last update":"Thu Oct 19 12:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.84299999999999997},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":1.6930000000000001,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":0.96599999999999997}]},{"osd":8,"last update":"Thu Oct 19 12:40:51 2023","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.048,"15min":1.048},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.61299999999999999}]},{"osd":10,"last update":"Thu Oct 19 12:41:10 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.878}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]}]},{"osd":8,"up_from":59,"seq":253403070493,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":978944,"data_stored":470410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 19 12:41:25 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.60099999999999998,"15min":0.60499999999999998},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.77500000000000002,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.58699999999999997,"15min":0.59099999999999997},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.86299999999999999,"5min":0.872,"15min":0.872},"last":0.63800000000000001}]},{"osd":1,"last update":"Thu Oct 19 12:41:25 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.59899999999999998,"15min":0.59699999999999998},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.79500000000000004,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.58899999999999997,"15min":0.58199999999999996},"min":{"1min":0.41899999999999998,"5min":0.38,"15min":0.38},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.89600000000000002}]},{"osd":2,"last update":"Thu Oct 19 12:41:25 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.46400000000000002,"15min":0.46500000000000002},"min":{"1min":0.30599999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46200000000000002,"15min":0.46200000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.67100000000000004}]},{"osd":3,"last update":"Thu Oct 19 12:41:25 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.622,"15min":0.628},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.74399999999999999,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.64000000000000001,"15min":0.65100000000000002},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.67400000000000004,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.754}]},{"osd":4,"last update":"Thu Oct 19 12:41:25 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.68799999999999994,"15min":0.69299999999999995},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.85799999999999998,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.82699999999999996,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.98999999999999999}]},{"osd":5,"last update":"Thu Oct 19 12:41:25 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.54600000000000004,"15min":0.55100000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.77800000000000002,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.59799999999999998,"15min":0.60999999999999999},"min":{"1min":0.34699999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.89400000000000002,"5min":1.01,"15min":1.01},"last":0.93899999999999995}]},{"osd":6,"last update":"Thu Oct 19 12:41:25 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.71299999999999997,"15min":0.72099999999999997},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.90500000000000003,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.70299999999999996,"15min":0.71099999999999997},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.82599999999999996,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.88100000000000001}]},{"osd":7,"last update":"Thu Oct 19 12:41:25 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.73199999999999998,"15min":0.73299999999999998},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.94099999999999995,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":1.042},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.76100000000000001,"15min":0.76900000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0720000000000001,"5min":1.113,"15min":1.113},"last":1.004}]},{"osd":9,"last update":"Thu Oct 19 12:40:49 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":1.03},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":1.0209999999999999}]},{"osd":10,"last update":"Thu Oct 19 12:41:14 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.97599999999999998},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":1.0529999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0640000000000001}]}]},{"osd":7,"up_from":51,"seq":219043332131,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28576,"kb_used_data":1560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716576,"statfs":{"total":95995035648,"available":95965773824,"internally_reserved":0,"allocated":1597440,"data_stored":1067390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 19 12:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.61899999999999999,"15min":0.60899999999999999},"min":{"1min":0.434,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.56699999999999995,"15min":0.56299999999999994},"min":{"1min":0.46400000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.76600000000000001,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.45400000000000001}]},{"osd":1,"last update":"Thu Oct 19 12:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.41199999999999998,"15min":0.40600000000000003},"min":{"1min":0.29599999999999999,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.42799999999999999,"15min":0.42399999999999999},"min":{"1min":0.26700000000000002,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.69499999999999995,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.29299999999999998}]},{"osd":2,"last update":"Thu Oct 19 12:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.59299999999999997,"15min":0.59499999999999997},"min":{"1min":0.40000000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.61399999999999999,"15min":0.61799999999999999},"min":{"1min":0.39200000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.59799999999999998}]},{"osd":3,"last update":"Thu Oct 19 12:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.64000000000000001,"15min":0.63100000000000001},"min":{"1min":0.47799999999999998,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.63,"5min":0.61699999999999999,"15min":0.61499999999999999},"min":{"1min":0.42199999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.52200000000000002}]},{"osd":4,"last update":"Thu Oct 19 12:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.51100000000000001,"15min":0.505},"min":{"1min":0.34300000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.48699999999999999,"15min":0.48099999999999998},"min":{"1min":0.316,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.45100000000000001}]},{"osd":5,"last update":"Thu Oct 19 12:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.67700000000000005,"15min":0.67500000000000004},"min":{"1min":0.46800000000000003,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.753},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.63800000000000001,"15min":0.63600000000000001},"min":{"1min":0.51900000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.73599999999999999}]},{"osd":6,"last update":"Thu Oct 19 12:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.73699999999999999,"15min":0.73099999999999998},"min":{"1min":0.53400000000000003,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.624},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.67400000000000004,"15min":0.66900000000000004},"min":{"1min":0.44800000000000001,"5min":0.435,"15min":0.435},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.50700000000000001}]},{"osd":8,"last update":"Thu Oct 19 12:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.71699999999999997,"15min":0.72099999999999997},"min":{"1min":0.45400000000000001,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.52100000000000002,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.69199999999999995}]},{"osd":9,"last update":"Thu Oct 19 12:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.54100000000000004}]},{"osd":10,"last update":"Thu Oct 19 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.71199999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]}]},{"osd":6,"up_from":46,"seq":197568495655,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":970752,"data_stored":469874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 19 12:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.48799999999999999,"15min":0.48299999999999998},"min":{"1min":0.33400000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.54700000000000004,"15min":0.55100000000000005},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.72099999999999997,"5min":1.107,"15min":1.107},"last":0.50700000000000001}]},{"osd":1,"last update":"Thu Oct 19 12:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.61899999999999999,"15min":0.61299999999999999},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.68000000000000005,"15min":0.67000000000000004},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.97099999999999997,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.76900000000000002}]},{"osd":2,"last update":"Thu Oct 19 12:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.67900000000000005,"15min":0.67700000000000005},"min":{"1min":0.48899999999999999,"5min":0.437,"15min":0.437},"max":{"1min":0.91200000000000003,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.46100000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.84699999999999998,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.88500000000000001}]},{"osd":3,"last update":"Thu Oct 19 12:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.70199999999999996,"15min":0.70399999999999996},"min":{"1min":0.439,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.98099999999999998,"5min":1.093,"15min":1.093},"last":0.71699999999999997}]},{"osd":4,"last update":"Thu Oct 19 12:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.77100000000000002,"15min":0.77200000000000002},"min":{"1min":0.55400000000000005,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0289999999999999,"5min":1.179,"15min":1.179},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.748,"5min":0.77900000000000003,"15min":0.78400000000000003},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.008,"5min":1.01,"15min":1.01},"last":0.75}]},{"osd":5,"last update":"Thu Oct 19 12:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.81599999999999995,"15min":0.81000000000000005},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.0509999999999999,"5min":1.177,"15min":1.177},"last":1.0149999999999999},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.82399999999999995,"15min":0.82599999999999996},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.0349999999999999,"5min":1.534,"15min":1.534},"last":0.92600000000000005}]},{"osd":7,"last update":"Thu Oct 19 12:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.82199999999999995,"15min":0.80800000000000005},"min":{"1min":0.63,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.1319999999999999,"5min":1.151,"15min":1.151},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.85099999999999998,"15min":0.84899999999999998},"min":{"1min":0.67600000000000005,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.86899999999999999}]},{"osd":8,"last update":"Thu Oct 19 12:41:30 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.88300000000000001,"15min":0.88700000000000001},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.1220000000000001,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.89800000000000002,"15min":0.90800000000000003},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.073,"5min":1.107,"15min":1.107},"last":0.97499999999999998}]},{"osd":9,"last update":"Thu Oct 19 12:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.70399999999999996},{"interface":"front","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.98999999999999999}]},{"osd":10,"last update":"Thu Oct 19 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":1.002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0229999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574910,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1011712,"data_stored":492759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 19 12:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.63900000000000001,"15min":0.59099999999999997},"min":{"1min":0.40699999999999997,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.77900000000000003,"5min":8.4559999999999995,"15min":8.4559999999999995},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.62,"5min":0.57299999999999995,"15min":0.56200000000000006},"min":{"1min":0.376,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.502}]},{"osd":2,"last update":"Thu Oct 19 12:41:14 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56100000000000005,"15min":0.59899999999999998},"min":{"1min":0.44500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.72999999999999998,"5min":4.1710000000000003,"15min":4.1710000000000003},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.52100000000000002,"15min":0.503},"min":{"1min":0.374,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.57999999999999996}]},{"osd":3,"last update":"Thu Oct 19 12:41:37 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60499999999999998,"15min":0.58899999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.83699999999999997,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.56599999999999995,"15min":0.55800000000000005},"min":{"1min":0.434,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.627}]},{"osd":4,"last update":"Thu Oct 19 12:41:02 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.40799999999999997,"15min":0.39600000000000002},"min":{"1min":0.27800000000000002,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.67800000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.41799999999999998,"15min":0.40000000000000002},"min":{"1min":0.29099999999999998,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.72399999999999998,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.379}]},{"osd":5,"last update":"Thu Oct 19 12:41:18 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53300000000000003},"min":{"1min":0.39000000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.69699999999999995,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.56799999999999995,"15min":0.56000000000000005},"min":{"1min":0.38900000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.874,"5min":1.03,"15min":1.03},"last":0.68400000000000005}]},{"osd":6,"last update":"Thu Oct 19 12:40:46 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.68999999999999995,"15min":0.68700000000000006},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.94799999999999995,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.751},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.93300000000000005,"15min":0.97699999999999998},"min":{"1min":0.48799999999999999,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.97299999999999998,"5min":8.4039999999999999,"15min":8.4039999999999999},"last":0.45000000000000001}]},{"osd":7,"last update":"Thu Oct 19 12:41:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.60599999999999998,"15min":0.60799999999999998},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.89600000000000002,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.58699999999999997,"15min":0.59099999999999997},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.78300000000000003,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.40300000000000002}]},{"osd":8,"last update":"Thu Oct 19 12:41:26 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.623,"15min":0.621},"min":{"1min":0.44900000000000001,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.93500000000000005,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72899999999999998,"15min":0.72999999999999998},"min":{"1min":0.54800000000000004,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0580000000000001,"5min":1.117,"15min":1.117},"last":0.77500000000000002}]},{"osd":9,"last update":"Thu Oct 19 12:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.51900000000000002}]},{"osd":10,"last update":"Thu Oct 19 12:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.70699999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]}]},{"osd":0,"up_from":8,"seq":34359738435,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":978944,"data_stored":470478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Oct 19 12:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.57799999999999996,"15min":0.55800000000000005},"min":{"1min":0.42799999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.58999999999999997,"15min":0.55900000000000005},"min":{"1min":0.39200000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.495}]},{"osd":2,"last update":"Thu Oct 19 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.621,"15min":0.60799999999999998},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.60099999999999998,"15min":0.56499999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.70899999999999996}]},{"osd":3,"last update":"Thu Oct 19 12:39:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.48099999999999998,"15min":0.46999999999999997},"min":{"1min":0.36899999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52900000000000003,"15min":0.53000000000000003},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.56899999999999995}]},{"osd":4,"last update":"Thu Oct 19 12:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.67000000000000004,"15min":0.63700000000000001},"min":{"1min":0.51800000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.0409999999999999,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.65200000000000002,"15min":0.63200000000000001},"min":{"1min":0.50800000000000001,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.1279999999999999,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.68100000000000005}]},{"osd":5,"last update":"Thu Oct 19 12:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.67600000000000005,"15min":0.66300000000000003},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.137,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.69699999999999995,"15min":0.68999999999999995},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.462,"5min":1.462,"15min":1.462},"last":0.63800000000000001}]},{"osd":6,"last update":"Thu Oct 19 12:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.66800000000000004,"15min":0.66000000000000003},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.65900000000000003,"15min":0.65000000000000002},"min":{"1min":0.379,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.6160000000000001,"5min":1.6160000000000001,"15min":1.6160000000000001},"last":0.46899999999999997}]},{"osd":7,"last update":"Thu Oct 19 12:41:05 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.78800000000000003,"15min":0.77400000000000002},"min":{"1min":0.61799999999999999,"5min":0.503,"15min":0.503},"max":{"1min":1.5960000000000001,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.877,"5min":0.76100000000000001,"15min":0.74099999999999999},"min":{"1min":0.54300000000000004,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.51,"5min":1.51,"15min":1.51},"last":0.65900000000000003}]},{"osd":8,"last update":"Thu Oct 19 12:41:28 2023","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":0.86499999999999999,"15min":0.81899999999999995},"min":{"1min":0.54000000000000004,"5min":0.503,"15min":0.503},"max":{"1min":6.8730000000000002,"5min":6.8730000000000002,"15min":6.8730000000000002},"last":0.628},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.83299999999999996,"15min":0.83099999999999996},"min":{"1min":0.57899999999999996,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.528,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.73099999999999998}]},{"osd":9,"last update":"Thu Oct 19 12:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.60199999999999998}]},{"osd":10,"last update":"Thu Oct 19 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.5720000000000001,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":0.54900000000000004}]},{"osd":11,"last update":"Thu Oct 19 12:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.72099999999999997}]}]},{"osd":2,"up_from":18,"seq":77309411387,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1032192,"data_stored":493369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 19 12:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.57599999999999996,"15min":0.56999999999999995},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.90200000000000002,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.56200000000000006,"15min":0.56000000000000005},"min":{"1min":0.35399999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.94899999999999995,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.69499999999999995}]},{"osd":1,"last update":"Thu Oct 19 12:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.55100000000000005,"15min":0.54600000000000004},"min":{"1min":0.40799999999999997,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.76700000000000002,"5min":1.081,"15min":1.081},"last":0.99299999999999999},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.56999999999999995,"15min":0.55600000000000005},"min":{"1min":0.37,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.97799999999999998,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.79000000000000004}]},{"osd":3,"last update":"Thu Oct 19 12:41:38 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59899999999999998,"15min":0.58699999999999997},"min":{"1min":0.40899999999999997,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.82699999999999996,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.58999999999999997,"15min":0.60199999999999998},"min":{"1min":0.437,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.81599999999999995,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.54600000000000004}]},{"osd":4,"last update":"Thu Oct 19 12:40:58 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.57999999999999996,"15min":0.58099999999999996},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.83399999999999996,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.57599999999999996,"15min":0.56399999999999995},"min":{"1min":0.41599999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.81499999999999995}]},{"osd":5,"last update":"Thu Oct 19 12:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.46500000000000002,"15min":0.44400000000000001},"min":{"1min":0.318,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.48199999999999998,"15min":0.46400000000000002},"min":{"1min":0.30099999999999999,"5min":0.25,"15min":0.25},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.66000000000000003}]},{"osd":6,"last update":"Thu Oct 19 12:41:46 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.66000000000000003,"15min":0.64100000000000001},"min":{"1min":0.56399999999999995,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.66800000000000004,"15min":0.66000000000000003},"min":{"1min":0.56299999999999994,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.88400000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.748}]},{"osd":7,"last update":"Thu Oct 19 12:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.64800000000000002,"15min":0.64700000000000002},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.86499999999999999,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":1.0189999999999999},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.68500000000000005,"15min":0.68300000000000005},"min":{"1min":0.46000000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.95399999999999996}]},{"osd":8,"last update":"Thu Oct 19 12:41:26 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.65200000000000002,"15min":0.65800000000000003},"min":{"1min":0.38500000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.85099999999999998,"5min":1.429,"15min":1.429},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.66800000000000004,"15min":0.66600000000000004},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.93500000000000005,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.82999999999999996}]},{"osd":9,"last update":"Thu Oct 19 12:40:49 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.96899999999999997},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.85099999999999998}]},{"osd":10,"last update":"Thu Oct 19 12:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":1.0720000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]}]},{"osd":3,"up_from":25,"seq":107374182454,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":995328,"data_stored":470214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 19 12:41:39 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.44900000000000001,"15min":0.433},"min":{"1min":0.318,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.70499999999999996,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.45700000000000002,"15min":0.41499999999999998},"min":{"1min":0.38400000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.65100000000000002,"5min":1.044,"15min":1.044},"last":0.48699999999999999}]},{"osd":1,"last update":"Thu Oct 19 12:41:39 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.66500000000000004,"15min":0.61299999999999999},"min":{"1min":0.48699999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.61199999999999999,"15min":0.56799999999999995},"min":{"1min":0.50900000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.0049999999999999,"5min":1.228,"15min":1.228},"last":0.622}]},{"osd":2,"last update":"Thu Oct 19 12:41:39 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.64100000000000001,"15min":0.60699999999999998},"min":{"1min":0.48499999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.91900000000000004,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.67100000000000004,"15min":0.60799999999999998},"min":{"1min":0.64500000000000002,"5min":0.374,"15min":0.374},"max":{"1min":1.004,"5min":1.056,"15min":1.056},"last":0.878}]},{"osd":4,"last update":"Thu Oct 19 12:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.67500000000000004,"15min":0.64300000000000002},"min":{"1min":0.56999999999999995,"5min":0.435,"15min":0.435},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.68100000000000005,"15min":0.64100000000000001},"min":{"1min":0.57899999999999996,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.83799999999999997}]},{"osd":5,"last update":"Thu Oct 19 12:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.76900000000000002,"15min":0.73599999999999999},"min":{"1min":0.50700000000000001,"5min":0.501,"15min":0.501},"max":{"1min":1.0840000000000001,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.71099999999999997,"15min":0.68999999999999995},"min":{"1min":0.57899999999999996,"5min":0.443,"15min":0.443},"max":{"1min":1.0309999999999999,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.77900000000000003}]},{"osd":6,"last update":"Thu Oct 19 12:41:43 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.64100000000000001,"15min":0.623},"min":{"1min":0.53500000000000003,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.97599999999999998,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.745,"15min":0.70599999999999996},"min":{"1min":0.51300000000000001,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.157,"5min":1.45,"15min":1.45},"last":0.51300000000000001}]},{"osd":7,"last update":"Thu Oct 19 12:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.70799999999999996,"15min":0.69599999999999995},"min":{"1min":0.52200000000000002,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.0369999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.75600000000000001,"15min":0.73299999999999998},"min":{"1min":0.61299999999999999,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.80200000000000005}]},{"osd":8,"last update":"Thu Oct 19 12:40:26 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.97599999999999998},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.998}]},{"osd":9,"last update":"Thu Oct 19 12:40:53 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.55300000000000005}]},{"osd":10,"last update":"Thu Oct 19 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.82499999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]}]},{"osd":4,"up_from":33,"seq":141733920816,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":978944,"data_stored":470428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 19 12:40:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.51900000000000002,"15min":0.50700000000000001},"min":{"1min":0.38500000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.44},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.54900000000000004,"15min":0.52900000000000003},"min":{"1min":0.47999999999999998,"5min":0.37,"15min":0.37},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":2.1539999999999999}]},{"osd":1,"last update":"Thu Oct 19 12:40:58 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.39000000000000001,"15min":0.38200000000000001},"min":{"1min":0.28599999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.59899999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.432,"5min":0.39500000000000002,"15min":0.39100000000000001},"min":{"1min":0.33200000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.39500000000000002}]},{"osd":2,"last update":"Thu Oct 19 12:40:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.54100000000000004,"15min":0.53500000000000003},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.749,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.58199999999999996,"15min":0.55900000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.83799999999999997,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.63200000000000001}]},{"osd":3,"last update":"Thu Oct 19 12:40:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.57199999999999995,"15min":0.56399999999999995},"min":{"1min":0.50700000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.59499999999999997,"15min":0.58999999999999997},"min":{"1min":0.496,"5min":0.443,"15min":0.443},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.52100000000000002}]},{"osd":5,"last update":"Thu Oct 19 12:41:20 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.63200000000000001,"15min":0.61599999999999999},"min":{"1min":0.46500000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":0.66600000000000004},{"interface":"front","average":{"1min":1.0089999999999999,"5min":0.67300000000000004,"15min":0.61599999999999999},"min":{"1min":0.47799999999999998,"5min":0.433,"15min":0.433},"max":{"1min":6.8390000000000004,"5min":6.8390000000000004,"15min":6.8390000000000004},"last":0.67800000000000005}]},{"osd":6,"last update":"Thu Oct 19 12:40:44 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.629,"15min":0.627},"min":{"1min":0.53000000000000003,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.66000000000000003,"15min":0.65300000000000002},"min":{"1min":0.49299999999999999,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.503}]},{"osd":7,"last update":"Thu Oct 19 12:41:05 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.58299999999999996,"15min":0.57199999999999995},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.621,"5min":0.55700000000000005,"15min":0.54600000000000004},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.60999999999999999}]},{"osd":8,"last update":"Thu Oct 19 12:41:26 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.71199999999999997,"15min":0.69099999999999995},"min":{"1min":0.45200000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":2.2719999999999998,"5min":2.2719999999999998,"15min":2.2719999999999998},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.70399999999999996,"15min":0.68100000000000005},"min":{"1min":0.46400000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":2.504,"5min":2.504,"15min":2.504},"last":0.72599999999999998}]},{"osd":9,"last update":"Thu Oct 19 12:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.71199999999999997}]},{"osd":10,"last update":"Thu Oct 19 12:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.77900000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]}]},{"osd":5,"up_from":38,"seq":163208757292,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28568,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716584,"statfs":{"total":95995035648,"available":95965782016,"internally_reserved":0,"allocated":1589248,"data_stored":1061628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 19 12:41:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53200000000000003,"15min":0.52500000000000002},"min":{"1min":0.39400000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.68500000000000005,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.55800000000000005,"15min":0.54100000000000004},"min":{"1min":0.41699999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.93000000000000005,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.50700000000000001}]},{"osd":1,"last update":"Thu Oct 19 12:41:19 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.53000000000000003,"15min":0.52200000000000002},"min":{"1min":0.33900000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.54300000000000004,"15min":0.53900000000000003},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.60599999999999998}]},{"osd":2,"last update":"Thu Oct 19 12:41:19 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.38900000000000001,"15min":0.38100000000000001},"min":{"1min":0.249,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.54900000000000004,"5min":0.75,"15min":0.75},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.436,"15min":0.42799999999999999},"min":{"1min":0.32200000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.39400000000000002}]},{"osd":3,"last update":"Thu Oct 19 12:41:19 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.59099999999999997,"15min":0.57899999999999996},"min":{"1min":0.43099999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.78600000000000003,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61399999999999999,"15min":0.61199999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.84299999999999997,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.49199999999999999}]},{"osd":4,"last update":"Thu Oct 19 12:41:19 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.58599999999999997,"15min":0.57099999999999995},"min":{"1min":0.41999999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56200000000000006,"15min":0.56100000000000005},"min":{"1min":0.30499999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.89900000000000002,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.63200000000000001}]},{"osd":6,"last update":"Thu Oct 19 12:40:46 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.67700000000000005,"15min":0.67100000000000004},"min":{"1min":0.47299999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68000000000000005,"15min":0.67800000000000005},"min":{"1min":0.5,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.56899999999999995}]},{"osd":7,"last update":"Thu Oct 19 12:41:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.65400000000000003,"15min":0.66200000000000003},"min":{"1min":0.42599999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.82999999999999996,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.66500000000000004,"15min":0.66100000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.73599999999999999}]},{"osd":8,"last update":"Thu Oct 19 12:41:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.626,"15min":0.624},"min":{"1min":0.45300000000000001,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68000000000000005,"15min":0.67900000000000005},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.038,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.47999999999999998}]},{"osd":9,"last update":"Thu Oct 19 12:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.59399999999999997}]},{"osd":10,"last update":"Thu Oct 19 12:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.77500000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":22975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":23585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":5544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-19T12:41:49.815 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-19T12:41:49.816 INFO:tasks.cephadm:Setting up client nodes... 2023-10-19T12:41:49.816 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2023-10-19T12:41:50.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:49 smithi157 ceph-mon[134109]: from='client.14925 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-19T12:41:50.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:49 smithi157 ceph-mon[134109]: pgmap v299: 129 pgs: 129 active+clean; 586 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s rd, 3.3 KiB/s wr, 9 op/s 2023-10-19T12:41:50.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:49 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/926039998' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-19T12:41:50.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:49 smithi195 ceph-mon[134493]: from='client.14925 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-19T12:41:50.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:49 smithi195 ceph-mon[134493]: pgmap v299: 129 pgs: 129 active+clean; 586 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s rd, 3.3 KiB/s wr, 9 op/s 2023-10-19T12:41:50.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:49 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/926039998' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-19T12:41:50.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:49 smithi046 ceph-mon[98509]: from='client.14925 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-19T12:41:50.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:49 smithi046 ceph-mon[98509]: pgmap v299: 129 pgs: 129 active+clean; 586 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s rd, 3.3 KiB/s wr, 9 op/s 2023-10-19T12:41:50.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:49 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/926039998' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-19T12:41:50.590 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-19T12:41:51.019 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:50 smithi046 ceph-mon[98509]: from='client.14943 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-19T12:41:51.020 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:50 smithi046 ceph-mon[98509]: from='client.14949 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-19T12:41:51.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:50 smithi157 ceph-mon[134109]: from='client.14943 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-19T12:41:51.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:50 smithi157 ceph-mon[134109]: from='client.14949 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-19T12:41:51.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:50 smithi195 ceph-mon[134493]: from='client.14943 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-19T12:41:51.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:50 smithi195 ceph-mon[134493]: from='client.14949 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-19T12:41:51.999 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:51 smithi046 ceph-mon[98509]: pgmap v300: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3.8 KiB/s wr, 14 op/s 2023-10-19T12:41:52.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:51 smithi157 ceph-mon[134109]: pgmap v300: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3.8 KiB/s wr, 14 op/s 2023-10-19T12:41:52.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:51 smithi195 ceph-mon[134493]: pgmap v300: 129 pgs: 129 active+clean; 587 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3.8 KiB/s wr, 14 op/s 2023-10-19T12:41:52.227 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:52.224+0000 7f8e2d80b700 1 -- 172.21.15.46:0/2275376136 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8e281023a0 msgr2=0x7f8e28108c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:52.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:52.224+0000 7f8e2d80b700 1 --2- 172.21.15.46:0/2275376136 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8e281023a0 0x7f8e28108c50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8e2000b0a0 tx=0x7f8e2000b3b0 comp rx=0 tx=0).stop 2023-10-19T12:41:52.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:52.224+0000 7f8e2d80b700 1 -- 172.21.15.46:0/2275376136 shutdown_connections 2023-10-19T12:41:52.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:52.224+0000 7f8e2d80b700 1 --2- 172.21.15.46:0/2275376136 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8e281023a0 0x7f8e28108c50 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:52.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:52.224+0000 7f8e2d80b700 1 --2- 172.21.15.46:0/2275376136 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e28100800 0x7f8e28100c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:52.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:52.224+0000 7f8e2d80b700 1 --2- 172.21.15.46:0/2275376136 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8e28101a00 0x7f8e28101e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:52.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:52.224+0000 7f8e2d80b700 1 -- 172.21.15.46:0/2275376136 >> 172.21.15.46:0/2275376136 conn(0x7f8e280fbda0 msgr2=0x7f8e280fe1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:52.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:52.224+0000 7f8e2d80b700 1 -- 172.21.15.46:0/2275376136 shutdown_connections 2023-10-19T12:41:52.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:52.224+0000 7f8e2d80b700 1 -- 172.21.15.46:0/2275376136 wait complete. 2023-10-19T12:41:52.231 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:52.225+0000 7f8e2d80b700 1 Processor -- start 2023-10-19T12:41:52.231 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:52.225+0000 7f8e2d80b700 1 -- start start 2023-10-19T12:41:52.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:52.225+0000 7f8e2d80b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e28100800 0x7f8e28198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:52.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:52.225+0000 7f8e2d80b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8e28101a00 0x7f8e28198f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:52.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:52.225+0000 7f8e2d80b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8e281023a0 0x7f8e2819ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:52.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:52.225+0000 7f8e2d80b700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e281a0590 con 0x7f8e28100800 2023-10-19T12:41:52.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:52.225+0000 7f8e2d80b700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e281a06d0 con 0x7f8e281023a0 2023-10-19T12:41:52.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:52.225+0000 7f8e2d80b700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e281a0860 con 0x7f8e28101a00 2023-10-19T12:41:52.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:52.226+0000 7f8e26ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e28100800 0x7f8e28198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:52.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:52.226+0000 7f8e26ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e28100800 0x7f8e28198a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56564/0 (socket says 172.21.15.46:56564) 2023-10-19T12:41:52.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:52.226+0000 7f8e26ffd700 1 -- 172.21.15.46:0/3699306598 learned_addr learned my addr 172.21.15.46:0/3699306598 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:41:52.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:52.226+0000 7f8e267fc700 1 --2- 172.21.15.46:0/3699306598 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8e28101a00 0x7f8e28198f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:52.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:52.226+0000 7f8e277fe700 1 --2- 172.21.15.46:0/3699306598 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8e281023a0 0x7f8e2819ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:52.234 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:52.226+0000 7f8e26ffd700 1 -- 172.21.15.46:0/3699306598 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8e28101a00 msgr2=0x7f8e28198f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:52.234 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:52.226+0000 7f8e26ffd700 1 --2- 172.21.15.46:0/3699306598 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8e28101a00 0x7f8e28198f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:52.234 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:52.226+0000 7f8e26ffd700 1 -- 172.21.15.46:0/3699306598 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8e281023a0 msgr2=0x7f8e2819ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:52.234 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:52.226+0000 7f8e26ffd700 1 --2- 172.21.15.46:0/3699306598 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8e281023a0 0x7f8e2819ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:52.235 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:52.226+0000 7f8e26ffd700 1 -- 172.21.15.46:0/3699306598 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e18009520 con 0x7f8e28100800 2023-10-19T12:41:52.235 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:52.226+0000 7f8e277fe700 1 --2- 172.21.15.46:0/3699306598 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8e281023a0 0x7f8e2819ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T12:41:52.235 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:52.226+0000 7f8e26ffd700 1 --2- 172.21.15.46:0/3699306598 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e28100800 0x7f8e28198a50 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f8e1800ea80 tx=0x7f8e1800ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:52.235 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:52.227+0000 7f8e2c809700 1 -- 172.21.15.46:0/3699306598 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e1800cbd0 con 0x7f8e28100800 2023-10-19T12:41:52.235 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:52.227+0000 7f8e2d80b700 1 -- 172.21.15.46:0/3699306598 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e20009d00 con 0x7f8e28100800 2023-10-19T12:41:52.235 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:52.227+0000 7f8e2c809700 1 -- 172.21.15.46:0/3699306598 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8e1800cd30 con 0x7f8e28100800 2023-10-19T12:41:52.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:52.227+0000 7f8e2c809700 1 -- 172.21.15.46:0/3699306598 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e18018680 con 0x7f8e28100800 2023-10-19T12:41:52.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:52.227+0000 7f8e2d80b700 1 -- 172.21.15.46:0/3699306598 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e281a0f00 con 0x7f8e28100800 2023-10-19T12:41:52.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:52.228+0000 7f8e2d80b700 1 -- 172.21.15.46:0/3699306598 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e2804e4c0 con 0x7f8e28100800 2023-10-19T12:41:52.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:52.230+0000 7f8e2c809700 1 -- 172.21.15.46:0/3699306598 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f8e180188a0 con 0x7f8e28100800 2023-10-19T12:41:52.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:52.231+0000 7f8e2c809700 1 --2- 172.21.15.46:0/3699306598 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f8e100a1510 0x7f8e100a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:52.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:52.231+0000 7f8e2c809700 1 -- 172.21.15.46:0/3699306598 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f8e18014070 con 0x7f8e28100800 2023-10-19T12:41:52.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:52.232+0000 7f8e267fc700 1 --2- 172.21.15.46:0/3699306598 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f8e100a1510 0x7f8e100a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:52.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:52.232+0000 7f8e267fc700 1 --2- 172.21.15.46:0/3699306598 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f8e100a1510 0x7f8e100a39d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c009c60 tx=0x7f8e1c009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:52.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:52.235+0000 7f8e2c809700 1 -- 172.21.15.46:0/3699306598 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f8e18096960 con 0x7f8e28100800 2023-10-19T12:41:52.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:52.533+0000 7f8e2d80b700 1 -- 172.21.15.46:0/3699306598 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f8e2810c010 con 0x7f8e28100800 2023-10-19T12:41:52.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:52.535+0000 7f8e2c809700 1 -- 172.21.15.46:0/3699306598 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) v1 ==== 170+0+59 (secure 0 0 0) 0x7f8e1800cea0 con 0x7f8e28100800 2023-10-19T12:41:52.539 INFO:teuthology.orchestra.run.smithi046.stdout:[client.0] 2023-10-19T12:41:52.539 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQAQJDFlCWzcHxAAEn1D7Ap4uxCG/v77HmzyXA== 2023-10-19T12:41:52.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:52.539+0000 7f8e2d80b700 1 -- 172.21.15.46:0/3699306598 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f8e100a1510 msgr2=0x7f8e100a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:52.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:52.539+0000 7f8e2d80b700 1 --2- 172.21.15.46:0/3699306598 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f8e100a1510 0x7f8e100a39d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c009c60 tx=0x7f8e1c009260 comp rx=0 tx=0).stop 2023-10-19T12:41:52.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:52.539+0000 7f8e2d80b700 1 -- 172.21.15.46:0/3699306598 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e28100800 msgr2=0x7f8e28198a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:52.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:52.539+0000 7f8e2d80b700 1 --2- 172.21.15.46:0/3699306598 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e28100800 0x7f8e28198a50 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f8e1800ea80 tx=0x7f8e1800ed90 comp rx=0 tx=0).stop 2023-10-19T12:41:52.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:52.539+0000 7f8e2d80b700 1 -- 172.21.15.46:0/3699306598 shutdown_connections 2023-10-19T12:41:52.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:52.539+0000 7f8e2d80b700 1 --2- 172.21.15.46:0/3699306598 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8e281023a0 0x7f8e2819ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:52.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:52.539+0000 7f8e2d80b700 1 --2- 172.21.15.46:0/3699306598 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e28100800 0x7f8e28198a50 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:52.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:52.539+0000 7f8e2d80b700 1 --2- 172.21.15.46:0/3699306598 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f8e100a1510 0x7f8e100a39d0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:52.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:52.539+0000 7f8e2d80b700 1 --2- 172.21.15.46:0/3699306598 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8e28101a00 0x7f8e28198f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:52.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:52.539+0000 7f8e2d80b700 1 -- 172.21.15.46:0/3699306598 >> 172.21.15.46:0/3699306598 conn(0x7f8e280fbda0 msgr2=0x7f8e28072a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:52.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:52.539+0000 7f8e2d80b700 1 -- 172.21.15.46:0/3699306598 shutdown_connections 2023-10-19T12:41:52.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:52.539+0000 7f8e2d80b700 1 -- 172.21.15.46:0/3699306598 wait complete. 2023-10-19T12:41:52.957 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:52 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/3699306598' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-10-19T12:41:52.958 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:52 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/3699306598' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-10-19T12:41:52.994 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-10-19T12:41:52.994 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2023-10-19T12:41:52.994 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-19T12:41:53.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:52 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/3699306598' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-10-19T12:41:53.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:52 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/3699306598' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-10-19T12:41:53.100 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph config log 1 --format=json 2023-10-19T12:41:53.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:52 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/3699306598' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-10-19T12:41:53.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:52 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/3699306598' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-10-19T12:41:53.889 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-19T12:41:54.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:53 smithi157 ceph-mon[134109]: pgmap v301: 129 pgs: 129 active+clean; 621 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 7.6 KiB/s wr, 20 op/s 2023-10-19T12:41:54.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:53 smithi195 ceph-mon[134493]: pgmap v301: 129 pgs: 129 active+clean; 621 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 7.6 KiB/s wr, 20 op/s 2023-10-19T12:41:54.198 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:53 smithi046 ceph-mon[98509]: pgmap v301: 129 pgs: 129 active+clean; 621 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 7.6 KiB/s wr, 20 op/s 2023-10-19T12:41:55.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:55.508+0000 7f91a123c700 1 -- 172.21.15.46:0/187132497 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f919c101260 msgr2=0x7f919c10d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:55.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:55.508+0000 7f91a123c700 1 --2- 172.21.15.46:0/187132497 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f919c101260 0x7f919c10d650 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f919400b0a0 tx=0x7f919400b3b0 comp rx=0 tx=0).stop 2023-10-19T12:41:55.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:55.508+0000 7f91a123c700 1 -- 172.21.15.46:0/187132497 shutdown_connections 2023-10-19T12:41:55.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:55.508+0000 7f91a123c700 1 --2- 172.21.15.46:0/187132497 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f919c101260 0x7f919c10d650 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:55.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:55.508+0000 7f91a123c700 1 --2- 172.21.15.46:0/187132497 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f919c1057c0 0x7f919c105ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:55.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:55.508+0000 7f91a123c700 1 --2- 172.21.15.46:0/187132497 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f919c1008a0 0x7f919c100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:55.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:55.508+0000 7f91a123c700 1 -- 172.21.15.46:0/187132497 >> 172.21.15.46:0/187132497 conn(0x7f919c0779e0 msgr2=0x7f919c077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:55.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:55.508+0000 7f91a123c700 1 -- 172.21.15.46:0/187132497 shutdown_connections 2023-10-19T12:41:55.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:55.508+0000 7f91a123c700 1 -- 172.21.15.46:0/187132497 wait complete. 2023-10-19T12:41:55.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:55.510+0000 7f91a123c700 1 Processor -- start 2023-10-19T12:41:55.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:55.510+0000 7f91a123c700 1 -- start start 2023-10-19T12:41:55.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:55.510+0000 7f91a123c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f919c1008a0 0x7f919c198f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:55.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:55.511+0000 7f91a123c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f919c101260 0x7f919c199450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:55.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:55.511+0000 7f91a123c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f919c1057c0 0x7f919c19d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:55.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:55.511+0000 7f91a123c700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f919c19de10 con 0x7f919c1008a0 2023-10-19T12:41:55.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:55.511+0000 7f91a123c700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f919c19df80 con 0x7f919c1057c0 2023-10-19T12:41:55.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:55.511+0000 7f91a123c700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f919c19e140 con 0x7f919c101260 2023-10-19T12:41:55.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:55.511+0000 7f919ad9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f919c1008a0 0x7f919c198f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:55.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:55.511+0000 7f919ad9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f919c1008a0 0x7f919c198f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37156/0 (socket says 172.21.15.46:37156) 2023-10-19T12:41:55.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:55.511+0000 7f919ad9d700 1 -- 172.21.15.46:0/2004119299 learned_addr learned my addr 172.21.15.46:0/2004119299 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:41:55.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:55.511+0000 7f919b59e700 1 --2- 172.21.15.46:0/2004119299 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f919c1057c0 0x7f919c19d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:55.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:55.511+0000 7f919a59c700 1 --2- 172.21.15.46:0/2004119299 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f919c101260 0x7f919c199450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:55.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:55.511+0000 7f919ad9d700 1 -- 172.21.15.46:0/2004119299 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f919c101260 msgr2=0x7f919c199450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:55.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:55.511+0000 7f919ad9d700 1 --2- 172.21.15.46:0/2004119299 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f919c101260 0x7f919c199450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:55.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:55.511+0000 7f919ad9d700 1 -- 172.21.15.46:0/2004119299 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f919c1057c0 msgr2=0x7f919c19d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:55.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:55.511+0000 7f919ad9d700 1 --2- 172.21.15.46:0/2004119299 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f919c1057c0 0x7f919c19d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:55.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:55.511+0000 7f919ad9d700 1 -- 172.21.15.46:0/2004119299 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9194009d00 con 0x7f919c1008a0 2023-10-19T12:41:55.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:55.512+0000 7f919ad9d700 1 --2- 172.21.15.46:0/2004119299 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f919c1008a0 0x7f919c198f10 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f918c00e970 tx=0x7f918c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:55.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:55.512+0000 7f9183fff700 1 -- 172.21.15.46:0/2004119299 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f918c009790 con 0x7f919c1008a0 2023-10-19T12:41:55.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:55.512+0000 7f9183fff700 1 -- 172.21.15.46:0/2004119299 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f918c00c7e0 con 0x7f919c1008a0 2023-10-19T12:41:55.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:55.512+0000 7f91a123c700 1 -- 172.21.15.46:0/2004119299 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f919c19e420 con 0x7f919c1008a0 2023-10-19T12:41:55.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:55.512+0000 7f9183fff700 1 -- 172.21.15.46:0/2004119299 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f918c003c70 con 0x7f919c1008a0 2023-10-19T12:41:55.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:55.512+0000 7f91a123c700 1 -- 172.21.15.46:0/2004119299 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f919c1a5c80 con 0x7f919c1008a0 2023-10-19T12:41:55.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:55.513+0000 7f91a123c700 1 -- 172.21.15.46:0/2004119299 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f919c101f30 con 0x7f919c1008a0 2023-10-19T12:41:55.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:55.515+0000 7f9183fff700 1 -- 172.21.15.46:0/2004119299 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f918c00cc50 con 0x7f919c1008a0 2023-10-19T12:41:55.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:55.516+0000 7f9183fff700 1 --2- 172.21.15.46:0/2004119299 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f91840a1590 0x7f91840a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:55.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:55.516+0000 7f9183fff700 1 -- 172.21.15.46:0/2004119299 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f918c014070 con 0x7f919c1008a0 2023-10-19T12:41:55.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:55.517+0000 7f919a59c700 1 --2- 172.21.15.46:0/2004119299 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f91840a1590 0x7f91840a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:55.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:55.517+0000 7f919a59c700 1 --2- 172.21.15.46:0/2004119299 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f91840a1590 0x7f91840a3a50 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f919c19a470 tx=0x7f9190009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:55.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:55.519+0000 7f9183fff700 1 -- 172.21.15.46:0/2004119299 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f918c0965a0 con 0x7f919c1008a0 2023-10-19T12:41:55.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:55.729+0000 7f91a123c700 1 -- 172.21.15.46:0/2004119299 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) v1 -- 0x7f919c04e4c0 con 0x7f919c1008a0 2023-10-19T12:41:55.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:55.730+0000 7f9183fff700 1 -- 172.21.15.46:0/2004119299 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v43) v1 ==== 86+0+133 (secure 0 0 0) 0x7f918c099bc0 con 0x7f919c1008a0 2023-10-19T12:41:55.734 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:41:55.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:55.732+0000 7f91a123c700 1 -- 172.21.15.46:0/2004119299 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f91840a1590 msgr2=0x7f91840a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:55.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:55.732+0000 7f91a123c700 1 --2- 172.21.15.46:0/2004119299 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f91840a1590 0x7f91840a3a50 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f919c19a470 tx=0x7f9190009260 comp rx=0 tx=0).stop 2023-10-19T12:41:55.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:55.732+0000 7f91a123c700 1 -- 172.21.15.46:0/2004119299 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f919c1008a0 msgr2=0x7f919c198f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:55.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:55.732+0000 7f91a123c700 1 --2- 172.21.15.46:0/2004119299 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f919c1008a0 0x7f919c198f10 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f918c00e970 tx=0x7f918c00ec80 comp rx=0 tx=0).stop 2023-10-19T12:41:55.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:55.733+0000 7f91a123c700 1 -- 172.21.15.46:0/2004119299 shutdown_connections 2023-10-19T12:41:55.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:55.733+0000 7f91a123c700 1 --2- 172.21.15.46:0/2004119299 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f919c1057c0 0x7f919c19d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:55.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:55.733+0000 7f91a123c700 1 --2- 172.21.15.46:0/2004119299 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f919c1008a0 0x7f919c198f10 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:55.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:55.733+0000 7f91a123c700 1 --2- 172.21.15.46:0/2004119299 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f91840a1590 0x7f91840a3a50 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:55.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:55.733+0000 7f91a123c700 1 --2- 172.21.15.46:0/2004119299 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f919c101260 0x7f919c199450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:55.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:55.733+0000 7f91a123c700 1 -- 172.21.15.46:0/2004119299 >> 172.21.15.46:0/2004119299 conn(0x7f919c0779e0 msgr2=0x7f919c10ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:55.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:55.733+0000 7f91a123c700 1 -- 172.21.15.46:0/2004119299 shutdown_connections 2023-10-19T12:41:55.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:55.733+0000 7f91a123c700 1 -- 172.21.15.46:0/2004119299 wait complete. 2023-10-19T12:41:56.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:55 smithi157 ceph-mon[134109]: pgmap v302: 129 pgs: 129 active+clean; 621 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 7.7 KiB/s wr, 21 op/s 2023-10-19T12:41:56.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:55 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/2004119299' entity='client.admin' cmd=[{"prefix": "config log", "num": 1, "format": "json"}]: dispatch 2023-10-19T12:41:56.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:55 smithi195 ceph-mon[134493]: pgmap v302: 129 pgs: 129 active+clean; 621 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 7.7 KiB/s wr, 21 op/s 2023-10-19T12:41:56.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:55 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/2004119299' entity='client.admin' cmd=[{"prefix": "config log", "num": 1, "format": "json"}]: dispatch 2023-10-19T12:41:56.158 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:55 smithi046 ceph-mon[98509]: pgmap v302: 129 pgs: 129 active+clean; 621 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 7.7 KiB/s wr, 21 op/s 2023-10-19T12:41:56.158 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:55 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/2004119299' entity='client.admin' cmd=[{"prefix": "config log", "num": 1, "format": "json"}]: dispatch 2023-10-19T12:41:56.189 INFO:teuthology.orchestra.run.smithi046.stdout:[{"version":43,"timestamp":"2023-10-19T12:41:12.341301+0000","name":"","changes":[{"name":"mds.all/mds_join_fs","new_value":"all"}]}] 2023-10-19T12:41:56.189 INFO:tasks.ceph_manager:config epoch is 43 2023-10-19T12:41:56.190 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-19T12:41:56.190 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2023-10-19T12:41:56.191 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph mgr dump --format=json 2023-10-19T12:41:56.940 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-19T12:41:58.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:57 smithi157 ceph-mon[134109]: pgmap v303: 129 pgs: 129 active+clean; 630 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.7 KiB/s wr, 24 op/s 2023-10-19T12:41:58.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:57 smithi195 ceph-mon[134493]: pgmap v303: 129 pgs: 129 active+clean; 630 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.7 KiB/s wr, 24 op/s 2023-10-19T12:41:58.173 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:57 smithi046 ceph-mon[98509]: pgmap v303: 129 pgs: 129 active+clean; 630 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.7 KiB/s wr, 24 op/s 2023-10-19T12:41:58.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:58.424+0000 7fb89a6ac700 1 -- 172.21.15.46:0/2154259197 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8941008a0 msgr2=0x7fb894100d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:58.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:58.424+0000 7fb89a6ac700 1 --2- 172.21.15.46:0/2154259197 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8941008a0 0x7fb894100d20 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb888009990 tx=0x7fb888009ca0 comp rx=0 tx=0).stop 2023-10-19T12:41:58.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:58.425+0000 7fb89a6ac700 1 -- 172.21.15.46:0/2154259197 shutdown_connections 2023-10-19T12:41:58.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:58.425+0000 7fb89a6ac700 1 --2- 172.21.15.46:0/2154259197 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb894101260 0x7fb89410d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:58.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:58.425+0000 7fb89a6ac700 1 --2- 172.21.15.46:0/2154259197 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb8941057c0 0x7fb894105ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:58.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:58.425+0000 7fb89a6ac700 1 --2- 172.21.15.46:0/2154259197 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8941008a0 0x7fb894100d20 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:58.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:58.425+0000 7fb89a6ac700 1 -- 172.21.15.46:0/2154259197 >> 172.21.15.46:0/2154259197 conn(0x7fb8940779e0 msgr2=0x7fb894077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:58.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:58.425+0000 7fb89a6ac700 1 -- 172.21.15.46:0/2154259197 shutdown_connections 2023-10-19T12:41:58.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:58.425+0000 7fb89a6ac700 1 -- 172.21.15.46:0/2154259197 wait complete. 2023-10-19T12:41:58.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:58.426+0000 7fb89a6ac700 1 Processor -- start 2023-10-19T12:41:58.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:58.426+0000 7fb89a6ac700 1 -- start start 2023-10-19T12:41:58.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:58.426+0000 7fb89a6ac700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb8941008a0 0x7fb89419c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:58.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:58.426+0000 7fb89a6ac700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb894101260 0x7fb89419ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:58.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:58.426+0000 7fb89a6ac700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb8941057c0 0x7fb894196a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:58.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:58.426+0000 7fb89a6ac700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8941970d0 con 0x7fb894101260 2023-10-19T12:41:58.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:58.426+0000 7fb89a6ac700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb894197240 con 0x7fb8941057c0 2023-10-19T12:41:58.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:58.426+0000 7fb89a6ac700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb894197400 con 0x7fb8941008a0 2023-10-19T12:41:58.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:58.427+0000 7fb8937fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb894101260 0x7fb89419ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:58.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:58.427+0000 7fb893fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb8941008a0 0x7fb89419c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:58.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:58.427+0000 7fb8937fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb894101260 0x7fb89419ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37170/0 (socket says 172.21.15.46:37170) 2023-10-19T12:41:58.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:58.427+0000 7fb893fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb8941008a0 0x7fb89419c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:45982/0 (socket says 172.21.15.46:45982) 2023-10-19T12:41:58.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:58.427+0000 7fb8937fe700 1 -- 172.21.15.46:0/803121511 learned_addr learned my addr 172.21.15.46:0/803121511 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:41:58.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:58.427+0000 7fb898c49700 1 --2- 172.21.15.46:0/803121511 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb8941057c0 0x7fb894196a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:58.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:58.427+0000 7fb893fff700 1 -- 172.21.15.46:0/803121511 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb8941057c0 msgr2=0x7fb894196a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:58.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:58.427+0000 7fb893fff700 1 --2- 172.21.15.46:0/803121511 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb8941057c0 0x7fb894196a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:58.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:58.427+0000 7fb893fff700 1 -- 172.21.15.46:0/803121511 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb894101260 msgr2=0x7fb89419ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:58.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:58.427+0000 7fb893fff700 1 --2- 172.21.15.46:0/803121511 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb894101260 0x7fb89419ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:58.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:58.427+0000 7fb893fff700 1 -- 172.21.15.46:0/803121511 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8880095f0 con 0x7fb8941008a0 2023-10-19T12:41:58.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:58.427+0000 7fb8937fe700 1 --2- 172.21.15.46:0/803121511 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb894101260 0x7fb89419ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:41:58.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:58.427+0000 7fb893fff700 1 --2- 172.21.15.46:0/803121511 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb8941008a0 0x7fb89419c8d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb88400e9c0 tx=0x7fb88400ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:58.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:58.428+0000 7fb8917fa700 1 -- 172.21.15.46:0/803121511 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb884004220 con 0x7fb8941008a0 2023-10-19T12:41:58.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:58.428+0000 7fb8917fa700 1 -- 172.21.15.46:0/803121511 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb884004380 con 0x7fb8941008a0 2023-10-19T12:41:58.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:58.428+0000 7fb89a6ac700 1 -- 172.21.15.46:0/803121511 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8941976e0 con 0x7fb8941008a0 2023-10-19T12:41:58.437 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:58.428+0000 7fb8917fa700 1 -- 172.21.15.46:0/803121511 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb884003be0 con 0x7fb8941008a0 2023-10-19T12:41:58.437 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:58.428+0000 7fb89a6ac700 1 -- 172.21.15.46:0/803121511 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8941a38c0 con 0x7fb8941008a0 2023-10-19T12:41:58.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:58.429+0000 7fb89a6ac700 1 -- 172.21.15.46:0/803121511 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb894108da0 con 0x7fb8941008a0 2023-10-19T12:41:58.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:58.431+0000 7fb8917fa700 1 -- 172.21.15.46:0/803121511 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7fb884003d40 con 0x7fb8941008a0 2023-10-19T12:41:58.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:58.432+0000 7fb8917fa700 1 --2- 172.21.15.46:0/803121511 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fb87c0a1510 0x7fb87c0a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:41:58.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:58.433+0000 7fb8917fa700 1 -- 172.21.15.46:0/803121511 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fb884014070 con 0x7fb8941008a0 2023-10-19T12:41:58.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:58.433+0000 7fb8937fe700 1 --2- 172.21.15.46:0/803121511 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fb87c0a1510 0x7fb87c0a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:41:58.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:58.433+0000 7fb8937fe700 1 --2- 172.21.15.46:0/803121511 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fb87c0a1510 0x7fb87c0a39d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb894077ed0 tx=0x7fb88800b280 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:41:58.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:58.435+0000 7fb8917fa700 1 -- 172.21.15.46:0/803121511 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb8840965b0 con 0x7fb8941008a0 2023-10-19T12:41:58.710 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:58.707+0000 7fb89a6ac700 1 -- 172.21.15.46:0/803121511 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fb894101f30 con 0x7fb8941008a0 2023-10-19T12:41:58.715 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:58.712+0000 7fb8917fa700 1 -- 172.21.15.46:0/803121511 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) v1 ==== 74+0+260407 (secure 0 0 0) 0x7fb884017e90 con 0x7fb8941008a0 2023-10-19T12:41:58.720 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:41:58.722 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:58.717+0000 7fb89a6ac700 1 -- 172.21.15.46:0/803121511 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fb87c0a1510 msgr2=0x7fb87c0a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:58.722 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:58.717+0000 7fb89a6ac700 1 --2- 172.21.15.46:0/803121511 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fb87c0a1510 0x7fb87c0a39d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb894077ed0 tx=0x7fb88800b280 comp rx=0 tx=0).stop 2023-10-19T12:41:58.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:58.717+0000 7fb89a6ac700 1 -- 172.21.15.46:0/803121511 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb8941008a0 msgr2=0x7fb89419c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:41:58.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:58.717+0000 7fb89a6ac700 1 --2- 172.21.15.46:0/803121511 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb8941008a0 0x7fb89419c8d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb88400e9c0 tx=0x7fb88400ecd0 comp rx=0 tx=0).stop 2023-10-19T12:41:58.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:58.717+0000 7fb89a6ac700 1 -- 172.21.15.46:0/803121511 shutdown_connections 2023-10-19T12:41:58.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:58.717+0000 7fb89a6ac700 1 --2- 172.21.15.46:0/803121511 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb8941057c0 0x7fb894196a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:58.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:58.717+0000 7fb89a6ac700 1 --2- 172.21.15.46:0/803121511 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fb87c0a1510 0x7fb87c0a39d0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:58.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:58.717+0000 7fb89a6ac700 1 --2- 172.21.15.46:0/803121511 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb8941008a0 0x7fb89419c8d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:58.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:58.717+0000 7fb89a6ac700 1 --2- 172.21.15.46:0/803121511 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb894101260 0x7fb89419ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:41:58.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:58.717+0000 7fb89a6ac700 1 -- 172.21.15.46:0/803121511 >> 172.21.15.46:0/803121511 conn(0x7fb8940779e0 msgr2=0x7fb8940fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:41:58.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:58.717+0000 7fb89a6ac700 1 -- 172.21.15.46:0/803121511 shutdown_connections 2023-10-19T12:41:58.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:41:58.717+0000 7fb89a6ac700 1 -- 172.21.15.46:0/803121511 wait complete. 2023-10-19T12:41:59.240 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":17,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":3168073651},{"type":"v1","addr":"172.21.15.46:6801","nonce":3168073651}]},"active_addr":"172.21.15.46:6801/3168073651","active_change":"2023-10-19T12:34:26.552234+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":24109,"name":"z","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24116,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.46:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.46:0","nonce":1486483489}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.46:0","nonce":745338950}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.46:0","nonce":2009695275}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.46:0","nonce":3807180824}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.46:0","nonce":4280241859}]}]} 2023-10-19T12:41:59.246 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2023-10-19T12:41:59.247 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2023-10-19T12:41:59.247 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph osd dump --format=json 2023-10-19T12:41:59.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:59 smithi157 ceph-mon[134109]: pgmap v304: 129 pgs: 129 active+clean; 630 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.9 KiB/s wr, 20 op/s 2023-10-19T12:41:59.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:41:59 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/803121511' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-10-19T12:41:59.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:59 smithi195 ceph-mon[134493]: pgmap v304: 129 pgs: 129 active+clean; 630 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.9 KiB/s wr, 20 op/s 2023-10-19T12:41:59.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:41:59 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/803121511' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-10-19T12:41:59.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:59 smithi046 ceph-mon[98509]: pgmap v304: 129 pgs: 129 active+clean; 630 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.9 KiB/s wr, 20 op/s 2023-10-19T12:41:59.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:41:59 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/803121511' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-10-19T12:42:00.003 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-19T12:42:01.726 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:01.722+0000 7f0338159700 1 -- 172.21.15.46:0/3305166316 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f03301008a0 msgr2=0x7f0330100d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:01.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:01.722+0000 7f0338159700 1 --2- 172.21.15.46:0/3305166316 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f03301008a0 0x7f0330100d20 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f0320009990 tx=0x7f0320009ca0 comp rx=0 tx=0).stop 2023-10-19T12:42:01.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:01.722+0000 7f0338159700 1 -- 172.21.15.46:0/3305166316 shutdown_connections 2023-10-19T12:42:01.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:01.722+0000 7f0338159700 1 --2- 172.21.15.46:0/3305166316 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0330101260 0x7f033010d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:01.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:01.722+0000 7f0338159700 1 --2- 172.21.15.46:0/3305166316 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f03301057c0 0x7f0330105ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:01.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:01.722+0000 7f0338159700 1 --2- 172.21.15.46:0/3305166316 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f03301008a0 0x7f0330100d20 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:01.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:01.722+0000 7f0338159700 1 -- 172.21.15.46:0/3305166316 >> 172.21.15.46:0/3305166316 conn(0x7f03300779e0 msgr2=0x7f0330077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:01.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:01.722+0000 7f0338159700 1 -- 172.21.15.46:0/3305166316 shutdown_connections 2023-10-19T12:42:01.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:01.722+0000 7f0338159700 1 -- 172.21.15.46:0/3305166316 wait complete. 2023-10-19T12:42:01.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:01.723+0000 7f0338159700 1 Processor -- start 2023-10-19T12:42:01.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:01.723+0000 7f0338159700 1 -- start start 2023-10-19T12:42:01.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:01.724+0000 7f0338159700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f03301008a0 0x7f033019c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:01.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:01.724+0000 7f0338159700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0330101260 0x7f033019ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:01.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:01.724+0000 7f0338159700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f03301057c0 0x7f0330196a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:01.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:01.724+0000 7f0338159700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03301970d0 con 0x7f03301057c0 2023-10-19T12:42:01.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:01.724+0000 7f0338159700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0330197240 con 0x7f03301008a0 2023-10-19T12:42:01.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:01.724+0000 7f0338159700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0330197400 con 0x7f0330101260 2023-10-19T12:42:01.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:01.724+0000 7f03366f6700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f03301057c0 0x7f0330196a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:01.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:01.724+0000 7f03356f4700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0330101260 0x7f033019ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:01.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:01.724+0000 7f03366f6700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f03301057c0 0x7f0330196a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37198/0 (socket says 172.21.15.46:37198) 2023-10-19T12:42:01.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:01.724+0000 7f03366f6700 1 -- 172.21.15.46:0/2364248113 learned_addr learned my addr 172.21.15.46:0/2364248113 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:42:01.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:01.724+0000 7f0335ef5700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f03301008a0 0x7f033019c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:01.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:01.725+0000 7f03356f4700 1 -- 172.21.15.46:0/2364248113 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f03301008a0 msgr2=0x7f033019c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:01.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:01.725+0000 7f03356f4700 1 --2- 172.21.15.46:0/2364248113 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f03301008a0 0x7f033019c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:01.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:01.725+0000 7f03356f4700 1 -- 172.21.15.46:0/2364248113 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f03301057c0 msgr2=0x7f0330196a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:01.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:01.725+0000 7f03356f4700 1 --2- 172.21.15.46:0/2364248113 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f03301057c0 0x7f0330196a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:01.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:01.725+0000 7f03356f4700 1 -- 172.21.15.46:0/2364248113 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03200095f0 con 0x7f0330101260 2023-10-19T12:42:01.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:01.725+0000 7f03356f4700 1 --2- 172.21.15.46:0/2364248113 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0330101260 0x7f033019ce10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f03200098e0 tx=0x7f0320005740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:01.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:01.725+0000 7f0326ffd700 1 -- 172.21.15.46:0/2364248113 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f032001d070 con 0x7f0330101260 2023-10-19T12:42:01.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:01.725+0000 7f0326ffd700 1 -- 172.21.15.46:0/2364248113 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0320022470 con 0x7f0330101260 2023-10-19T12:42:01.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:01.725+0000 7f0338159700 1 -- 172.21.15.46:0/2364248113 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0330197680 con 0x7f0330101260 2023-10-19T12:42:01.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:01.725+0000 7f0326ffd700 1 -- 172.21.15.46:0/2364248113 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0320017650 con 0x7f0330101260 2023-10-19T12:42:01.735 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:01 smithi046 ceph-mon[98509]: pgmap v305: 129 pgs: 129 active+clean; 630 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.4 KiB/s wr, 17 op/s 2023-10-19T12:42:01.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:01.726+0000 7f0338159700 1 -- 172.21.15.46:0/2364248113 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03301a38c0 con 0x7f0330101260 2023-10-19T12:42:01.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:01.727+0000 7f0338159700 1 -- 172.21.15.46:0/2364248113 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0330108da0 con 0x7f0330101260 2023-10-19T12:42:01.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:01.728+0000 7f0326ffd700 1 -- 172.21.15.46:0/2364248113 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f03200225e0 con 0x7f0330101260 2023-10-19T12:42:01.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:01.730+0000 7f0326ffd700 1 --2- 172.21.15.46:0/2364248113 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f031c0a1590 0x7f031c0a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:01.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:01.730+0000 7f0326ffd700 1 -- 172.21.15.46:0/2364248113 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f03200ce3e0 con 0x7f0330101260 2023-10-19T12:42:01.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:01.730+0000 7f0335ef5700 1 --2- 172.21.15.46:0/2364248113 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f031c0a1590 0x7f031c0a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:01.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:01.731+0000 7f0335ef5700 1 --2- 172.21.15.46:0/2364248113 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f031c0a1590 0x7f031c0a3a50 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0330101930 tx=0x7f032c009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:01.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:01.734+0000 7f0326ffd700 1 -- 172.21.15.46:0/2364248113 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0320097840 con 0x7f0330101260 2023-10-19T12:42:01.948 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:01.945+0000 7f0338159700 1 -- 172.21.15.46:0/2364248113 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0330101f30 con 0x7f0330101260 2023-10-19T12:42:01.950 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:01.947+0000 7f0326ffd700 1 -- 172.21.15.46:0/2364248113 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+23953 (secure 0 0 0) 0x7f0320027020 con 0x7f0330101260 2023-10-19T12:42:01.951 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:42:01.951 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":88,"fsid":"96a8be3c-6e7b-11ee-8db6-212e2dc638e7","created":"2023-10-19T12:33:26.148713+0000","modified":"2023-10-19T12:41:23.831907+0000","last_up_change":"2023-10-19T12:40:30.761679+0000","last_in_change":"2023-10-19T12:40:13.663559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-19T12:37:07.175795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-19T12:41:16.895203+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-19T12:41:18.255601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-19T12:41:21.830455+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"346ce86b-a10a-4869-9fdb-c3c1d4161455","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6803","nonce":500237995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6805","nonce":500237995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6809","nonce":500237995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6807","nonce":500237995}]},"public_addr":"172.21.15.46:6803/500237995","cluster_addr":"172.21.15.46:6805/500237995","heartbeat_back_addr":"172.21.15.46:6809/500237995","heartbeat_front_addr":"172.21.15.46:6807/500237995","state":["exists","up"]},{"osd":1,"uuid":"02aae687-76c5-4124-bae4-9787ed571c28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6801","nonce":2496862790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6803","nonce":2496862790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6807","nonce":2496862790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6805","nonce":2496862790}]},"public_addr":"172.21.15.157:6801/2496862790","cluster_addr":"172.21.15.157:6803/2496862790","heartbeat_back_addr":"172.21.15.157:6807/2496862790","heartbeat_front_addr":"172.21.15.157:6805/2496862790","state":["exists","up"]},{"osd":2,"uuid":"d5360828-1f58-4380-b2ad-0c21ff850981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6801","nonce":4211767276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6803","nonce":4211767276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6807","nonce":4211767276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6805","nonce":4211767276}]},"public_addr":"172.21.15.195:6801/4211767276","cluster_addr":"172.21.15.195:6803/4211767276","heartbeat_back_addr":"172.21.15.195:6807/4211767276","heartbeat_front_addr":"172.21.15.195:6805/4211767276","state":["exists","up"]},{"osd":3,"uuid":"accb780f-49d0-43f8-b166-ee12c558ef00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6811","nonce":1964113352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6813","nonce":1964113352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6817","nonce":1964113352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6815","nonce":1964113352}]},"public_addr":"172.21.15.46:6811/1964113352","cluster_addr":"172.21.15.46:6813/1964113352","heartbeat_back_addr":"172.21.15.46:6817/1964113352","heartbeat_front_addr":"172.21.15.46:6815/1964113352","state":["exists","up"]},{"osd":4,"uuid":"e662886d-e989-4d02-8c1f-3c4671352b0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6809","nonce":3636910144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6811","nonce":3636910144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6815","nonce":3636910144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6813","nonce":3636910144}]},"public_addr":"172.21.15.157:6809/3636910144","cluster_addr":"172.21.15.157:6811/3636910144","heartbeat_back_addr":"172.21.15.157:6815/3636910144","heartbeat_front_addr":"172.21.15.157:6813/3636910144","state":["exists","up"]},{"osd":5,"uuid":"9597e0ce-14ea-407d-90fe-f74bccee38b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6809","nonce":4071287969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6811","nonce":4071287969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6815","nonce":4071287969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6813","nonce":4071287969}]},"public_addr":"172.21.15.195:6809/4071287969","cluster_addr":"172.21.15.195:6811/4071287969","heartbeat_back_addr":"172.21.15.195:6815/4071287969","heartbeat_front_addr":"172.21.15.195:6813/4071287969","state":["exists","up"]},{"osd":6,"uuid":"6b78ba38-f60e-4cb6-b01c-cecc1820e8e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6819","nonce":1842285555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6821","nonce":1842285555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6825","nonce":1842285555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6823","nonce":1842285555}]},"public_addr":"172.21.15.46:6819/1842285555","cluster_addr":"172.21.15.46:6821/1842285555","heartbeat_back_addr":"172.21.15.46:6825/1842285555","heartbeat_front_addr":"172.21.15.46:6823/1842285555","state":["exists","up"]},{"osd":7,"uuid":"59a0899f-3bcd-4db2-b544-24df3a536749","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6817","nonce":3498672588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6819","nonce":3498672588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6823","nonce":3498672588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6821","nonce":3498672588}]},"public_addr":"172.21.15.157:6817/3498672588","cluster_addr":"172.21.15.157:6819/3498672588","heartbeat_back_addr":"172.21.15.157:6823/3498672588","heartbeat_front_addr":"172.21.15.157:6821/3498672588","state":["exists","up"]},{"osd":8,"uuid":"9c3c9835-043a-4fb5-a9ee-edf8caf6b605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6817","nonce":74230104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6819","nonce":74230104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6823","nonce":74230104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6821","nonce":74230104}]},"public_addr":"172.21.15.195:6817/74230104","cluster_addr":"172.21.15.195:6819/74230104","heartbeat_back_addr":"172.21.15.195:6823/74230104","heartbeat_front_addr":"172.21.15.195:6821/74230104","state":["exists","up"]},{"osd":9,"uuid":"3f18f506-a577-4b7c-ae0d-9351c07e81f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6827","nonce":3472581046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6829","nonce":3472581046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6833","nonce":3472581046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6831","nonce":3472581046}]},"public_addr":"172.21.15.46:6827/3472581046","cluster_addr":"172.21.15.46:6829/3472581046","heartbeat_back_addr":"172.21.15.46:6833/3472581046","heartbeat_front_addr":"172.21.15.46:6831/3472581046","state":["exists","up"]},{"osd":10,"uuid":"1ed01854-443a-4acf-9293-7ca0d451a93d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6825","nonce":2378416559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6827","nonce":2378416559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6831","nonce":2378416559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6829","nonce":2378416559}]},"public_addr":"172.21.15.157:6825/2378416559","cluster_addr":"172.21.15.157:6827/2378416559","heartbeat_back_addr":"172.21.15.157:6831/2378416559","heartbeat_front_addr":"172.21.15.157:6829/2378416559","state":["exists","up"]},{"osd":11,"uuid":"021398c0-9184-4647-8220-e40f6705ca90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6825","nonce":3075632222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6827","nonce":3075632222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6831","nonce":3075632222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6829","nonce":3075632222}]},"public_addr":"172.21.15.195:6825/3075632222","cluster_addr":"172.21.15.195:6827/3075632222","heartbeat_back_addr":"172.21.15.195:6831/3075632222","heartbeat_front_addr":"172.21.15.195:6829/3075632222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:36:22.002614+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:36:44.098031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:37:04.518341+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:37:30.796462+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:37:52.756555+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:38:13.403168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:38:39.058472+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:39:01.106893+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:39:21.908334+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:39:46.843884+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:40:08.792020+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:40:29.282974+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.46:0/3248595150":"2023-10-20T12:34:26.552115+0000","172.21.15.46:0/3624849341":"2023-10-20T12:34:26.552115+0000","172.21.15.46:0/1844094590":"2023-10-20T12:34:26.552115+0000","172.21.15.46:6801/20022894":"2023-10-20T12:34:26.552115+0000","172.21.15.46:0/3969790632":"2023-10-20T12:34:00.135248+0000","172.21.15.46:0/2331135821":"2023-10-20T12:34:00.135248+0000","172.21.15.46:6800/51664346":"2023-10-20T12:34:00.135248+0000","172.21.15.46:6801/51664346":"2023-10-20T12:34:00.135248+0000","172.21.15.46:0/585851467":"2023-10-20T12:34:00.135248+0000","172.21.15.46:6800/20022894":"2023-10-20T12:34:26.552115+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-19T12:42:01.953 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:01.949+0000 7f0338159700 1 -- 172.21.15.46:0/2364248113 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f031c0a1590 msgr2=0x7f031c0a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:01.953 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:01.950+0000 7f0338159700 1 --2- 172.21.15.46:0/2364248113 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f031c0a1590 0x7f031c0a3a50 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0330101930 tx=0x7f032c009260 comp rx=0 tx=0).stop 2023-10-19T12:42:01.953 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:01.950+0000 7f0338159700 1 -- 172.21.15.46:0/2364248113 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0330101260 msgr2=0x7f033019ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:01.953 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:01.950+0000 7f0338159700 1 --2- 172.21.15.46:0/2364248113 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0330101260 0x7f033019ce10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f03200098e0 tx=0x7f0320005740 comp rx=0 tx=0).stop 2023-10-19T12:42:01.954 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:01.950+0000 7f0338159700 1 -- 172.21.15.46:0/2364248113 shutdown_connections 2023-10-19T12:42:01.954 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:01.950+0000 7f0338159700 1 --2- 172.21.15.46:0/2364248113 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f03301057c0 0x7f0330196a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:01.954 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:01.950+0000 7f0338159700 1 --2- 172.21.15.46:0/2364248113 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f03301008a0 0x7f033019c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:01.954 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:01.950+0000 7f0338159700 1 --2- 172.21.15.46:0/2364248113 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f031c0a1590 0x7f031c0a3a50 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:01.955 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:01.950+0000 7f0338159700 1 --2- 172.21.15.46:0/2364248113 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0330101260 0x7f033019ce10 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:01.955 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:01.950+0000 7f0338159700 1 -- 172.21.15.46:0/2364248113 >> 172.21.15.46:0/2364248113 conn(0x7f03300779e0 msgr2=0x7f03300fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:01.955 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:01.950+0000 7f0338159700 1 -- 172.21.15.46:0/2364248113 shutdown_connections 2023-10-19T12:42:01.955 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:01.950+0000 7f0338159700 1 -- 172.21.15.46:0/2364248113 wait complete. 2023-10-19T12:42:02.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:01 smithi157 ceph-mon[134109]: pgmap v305: 129 pgs: 129 active+clean; 630 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.4 KiB/s wr, 17 op/s 2023-10-19T12:42:02.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:01 smithi195 ceph-mon[134493]: pgmap v305: 129 pgs: 129 active+clean; 630 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.4 KiB/s wr, 17 op/s 2023-10-19T12:42:02.408 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2023-10-19T12:42:02.408 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph osd dump --format=json 2023-10-19T12:42:02.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:02 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/2364248113' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-19T12:42:03.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:02 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/2364248113' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-19T12:42:03.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:02 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/2364248113' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-19T12:42:03.156 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-19T12:42:03.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:03 smithi046 ceph-mon[98509]: pgmap v306: 129 pgs: 129 active+clean; 638 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.7 KiB/s wr, 15 op/s 2023-10-19T12:42:04.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:03 smithi157 ceph-mon[134109]: pgmap v306: 129 pgs: 129 active+clean; 638 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.7 KiB/s wr, 15 op/s 2023-10-19T12:42:04.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:03 smithi195 ceph-mon[134493]: pgmap v306: 129 pgs: 129 active+clean; 638 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.7 KiB/s wr, 15 op/s 2023-10-19T12:42:04.651 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:04.647+0000 7fa714452700 1 -- 172.21.15.46:0/304125047 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa70c068190 msgr2=0x7fa70c0685f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:04.651 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:04.647+0000 7fa714452700 1 --2- 172.21.15.46:0/304125047 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa70c068190 0x7fa70c0685f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa6fc0098f0 tx=0x7fa6fc009c00 comp rx=0 tx=0).stop 2023-10-19T12:42:04.651 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:04.647+0000 7fa714452700 1 -- 172.21.15.46:0/304125047 shutdown_connections 2023-10-19T12:42:04.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:04.647+0000 7fa714452700 1 --2- 172.21.15.46:0/304125047 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa70c068b30 0x7fa70c10d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:04.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:04.647+0000 7fa714452700 1 --2- 172.21.15.46:0/304125047 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa70c1067a0 0x7fa70c106b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:04.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:04.647+0000 7fa714452700 1 --2- 172.21.15.46:0/304125047 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa70c068190 0x7fa70c0685f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:04.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:04.647+0000 7fa714452700 1 -- 172.21.15.46:0/304125047 >> 172.21.15.46:0/304125047 conn(0x7fa70c075790 msgr2=0x7fa70c075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:04.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:04.647+0000 7fa714452700 1 -- 172.21.15.46:0/304125047 shutdown_connections 2023-10-19T12:42:04.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:04.647+0000 7fa714452700 1 -- 172.21.15.46:0/304125047 wait complete. 2023-10-19T12:42:04.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:04.648+0000 7fa714452700 1 Processor -- start 2023-10-19T12:42:04.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:04.648+0000 7fa714452700 1 -- start start 2023-10-19T12:42:04.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:04.649+0000 7fa714452700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa70c068190 0x7fa70c0ff820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:04.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:04.649+0000 7fa714452700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa70c068b30 0x7fa70c0ffd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:04.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:04.649+0000 7fa714452700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa70c1067a0 0x7fa70c1002a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:04.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:04.649+0000 7fa714452700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa70c1a5050 con 0x7fa70c1067a0 2023-10-19T12:42:04.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:04.649+0000 7fa714452700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa70c1a51c0 con 0x7fa70c068190 2023-10-19T12:42:04.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:04.649+0000 7fa714452700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa70c1a5380 con 0x7fa70c068b30 2023-10-19T12:42:04.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:04.649+0000 7fa7119ed700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa70c068b30 0x7fa70c0ffd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:04.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:04.649+0000 7fa7121ee700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa70c068190 0x7fa70c0ff820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:04.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:04.649+0000 7fa7119ed700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa70c068b30 0x7fa70c0ffd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:48754/0 (socket says 172.21.15.46:48754) 2023-10-19T12:42:04.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:04.649+0000 7fa7121ee700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa70c068190 0x7fa70c0ff820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:39790/0 (socket says 172.21.15.46:39790) 2023-10-19T12:42:04.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:04.649+0000 7fa7129ef700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa70c1067a0 0x7fa70c1002a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:04.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:04.649+0000 7fa7119ed700 1 -- 172.21.15.46:0/3323317088 learned_addr learned my addr 172.21.15.46:0/3323317088 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:42:04.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:04.649+0000 7fa7129ef700 1 -- 172.21.15.46:0/3323317088 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa70c068b30 msgr2=0x7fa70c0ffd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:04.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:04.649+0000 7fa7129ef700 1 --2- 172.21.15.46:0/3323317088 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa70c068b30 0x7fa70c0ffd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:04.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:04.650+0000 7fa7129ef700 1 -- 172.21.15.46:0/3323317088 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa70c068190 msgr2=0x7fa70c0ff820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:04.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:04.650+0000 7fa7129ef700 1 --2- 172.21.15.46:0/3323317088 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa70c068190 0x7fa70c0ff820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:04.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:04.650+0000 7fa7129ef700 1 -- 172.21.15.46:0/3323317088 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7080095f0 con 0x7fa70c1067a0 2023-10-19T12:42:04.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:04.650+0000 7fa7129ef700 1 --2- 172.21.15.46:0/3323317088 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa70c1067a0 0x7fa70c1002a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa70400efc0 tx=0x7fa70400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:04.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:04.650+0000 7fa7037fe700 1 -- 172.21.15.46:0/3323317088 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa704018070 con 0x7fa70c1067a0 2023-10-19T12:42:04.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:04.650+0000 7fa7037fe700 1 -- 172.21.15.46:0/3323317088 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa70400f040 con 0x7fa70c1067a0 2023-10-19T12:42:04.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:04.650+0000 7fa714452700 1 -- 172.21.15.46:0/3323317088 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6fc009520 con 0x7fa70c1067a0 2023-10-19T12:42:04.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:04.650+0000 7fa7037fe700 1 -- 172.21.15.46:0/3323317088 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa70400cd40 con 0x7fa70c1067a0 2023-10-19T12:42:04.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:04.650+0000 7fa714452700 1 -- 172.21.15.46:0/3323317088 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa70c1a59c0 con 0x7fa70c1067a0 2023-10-19T12:42:04.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:04.651+0000 7fa714452700 1 -- 172.21.15.46:0/3323317088 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa70c108d50 con 0x7fa70c1067a0 2023-10-19T12:42:04.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:04.653+0000 7fa7037fe700 1 -- 172.21.15.46:0/3323317088 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7fa704003a00 con 0x7fa70c1067a0 2023-10-19T12:42:04.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:04.655+0000 7fa7037fe700 1 --2- 172.21.15.46:0/3323317088 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fa6f80a1590 0x7fa6f80a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:04.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:04.655+0000 7fa7037fe700 1 -- 172.21.15.46:0/3323317088 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fa7040ccbe0 con 0x7fa70c1067a0 2023-10-19T12:42:04.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:04.655+0000 7fa7121ee700 1 --2- 172.21.15.46:0/3323317088 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fa6f80a1590 0x7fa6f80a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:04.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:04.655+0000 7fa7121ee700 1 --2- 172.21.15.46:0/3323317088 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fa6f80a1590 0x7fa6f80a3a50 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa708005fd0 tx=0x7fa708009310 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:04.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:04.659+0000 7fa7037fe700 1 -- 172.21.15.46:0/3323317088 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa704095f20 con 0x7fa70c1067a0 2023-10-19T12:42:04.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:04.871+0000 7fa714452700 1 -- 172.21.15.46:0/3323317088 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa70c101ee0 con 0x7fa70c1067a0 2023-10-19T12:42:04.876 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:04.872+0000 7fa7037fe700 1 -- 172.21.15.46:0/3323317088 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+23953 (secure 0 0 0) 0x7fa70401b320 con 0x7fa70c1067a0 2023-10-19T12:42:04.876 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:42:04.877 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":88,"fsid":"96a8be3c-6e7b-11ee-8db6-212e2dc638e7","created":"2023-10-19T12:33:26.148713+0000","modified":"2023-10-19T12:41:23.831907+0000","last_up_change":"2023-10-19T12:40:30.761679+0000","last_in_change":"2023-10-19T12:40:13.663559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-19T12:37:07.175795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-19T12:41:16.895203+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-19T12:41:18.255601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-19T12:41:21.830455+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"346ce86b-a10a-4869-9fdb-c3c1d4161455","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6803","nonce":500237995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6805","nonce":500237995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6809","nonce":500237995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6807","nonce":500237995}]},"public_addr":"172.21.15.46:6803/500237995","cluster_addr":"172.21.15.46:6805/500237995","heartbeat_back_addr":"172.21.15.46:6809/500237995","heartbeat_front_addr":"172.21.15.46:6807/500237995","state":["exists","up"]},{"osd":1,"uuid":"02aae687-76c5-4124-bae4-9787ed571c28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6801","nonce":2496862790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6803","nonce":2496862790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6807","nonce":2496862790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6805","nonce":2496862790}]},"public_addr":"172.21.15.157:6801/2496862790","cluster_addr":"172.21.15.157:6803/2496862790","heartbeat_back_addr":"172.21.15.157:6807/2496862790","heartbeat_front_addr":"172.21.15.157:6805/2496862790","state":["exists","up"]},{"osd":2,"uuid":"d5360828-1f58-4380-b2ad-0c21ff850981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6801","nonce":4211767276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6803","nonce":4211767276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6807","nonce":4211767276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6805","nonce":4211767276}]},"public_addr":"172.21.15.195:6801/4211767276","cluster_addr":"172.21.15.195:6803/4211767276","heartbeat_back_addr":"172.21.15.195:6807/4211767276","heartbeat_front_addr":"172.21.15.195:6805/4211767276","state":["exists","up"]},{"osd":3,"uuid":"accb780f-49d0-43f8-b166-ee12c558ef00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6811","nonce":1964113352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6813","nonce":1964113352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6817","nonce":1964113352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6815","nonce":1964113352}]},"public_addr":"172.21.15.46:6811/1964113352","cluster_addr":"172.21.15.46:6813/1964113352","heartbeat_back_addr":"172.21.15.46:6817/1964113352","heartbeat_front_addr":"172.21.15.46:6815/1964113352","state":["exists","up"]},{"osd":4,"uuid":"e662886d-e989-4d02-8c1f-3c4671352b0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6809","nonce":3636910144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6811","nonce":3636910144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6815","nonce":3636910144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6813","nonce":3636910144}]},"public_addr":"172.21.15.157:6809/3636910144","cluster_addr":"172.21.15.157:6811/3636910144","heartbeat_back_addr":"172.21.15.157:6815/3636910144","heartbeat_front_addr":"172.21.15.157:6813/3636910144","state":["exists","up"]},{"osd":5,"uuid":"9597e0ce-14ea-407d-90fe-f74bccee38b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6809","nonce":4071287969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6811","nonce":4071287969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6815","nonce":4071287969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6813","nonce":4071287969}]},"public_addr":"172.21.15.195:6809/4071287969","cluster_addr":"172.21.15.195:6811/4071287969","heartbeat_back_addr":"172.21.15.195:6815/4071287969","heartbeat_front_addr":"172.21.15.195:6813/4071287969","state":["exists","up"]},{"osd":6,"uuid":"6b78ba38-f60e-4cb6-b01c-cecc1820e8e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6819","nonce":1842285555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6821","nonce":1842285555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6825","nonce":1842285555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6823","nonce":1842285555}]},"public_addr":"172.21.15.46:6819/1842285555","cluster_addr":"172.21.15.46:6821/1842285555","heartbeat_back_addr":"172.21.15.46:6825/1842285555","heartbeat_front_addr":"172.21.15.46:6823/1842285555","state":["exists","up"]},{"osd":7,"uuid":"59a0899f-3bcd-4db2-b544-24df3a536749","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6817","nonce":3498672588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6819","nonce":3498672588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6823","nonce":3498672588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6821","nonce":3498672588}]},"public_addr":"172.21.15.157:6817/3498672588","cluster_addr":"172.21.15.157:6819/3498672588","heartbeat_back_addr":"172.21.15.157:6823/3498672588","heartbeat_front_addr":"172.21.15.157:6821/3498672588","state":["exists","up"]},{"osd":8,"uuid":"9c3c9835-043a-4fb5-a9ee-edf8caf6b605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6817","nonce":74230104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6819","nonce":74230104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6823","nonce":74230104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6821","nonce":74230104}]},"public_addr":"172.21.15.195:6817/74230104","cluster_addr":"172.21.15.195:6819/74230104","heartbeat_back_addr":"172.21.15.195:6823/74230104","heartbeat_front_addr":"172.21.15.195:6821/74230104","state":["exists","up"]},{"osd":9,"uuid":"3f18f506-a577-4b7c-ae0d-9351c07e81f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6827","nonce":3472581046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6829","nonce":3472581046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6833","nonce":3472581046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6831","nonce":3472581046}]},"public_addr":"172.21.15.46:6827/3472581046","cluster_addr":"172.21.15.46:6829/3472581046","heartbeat_back_addr":"172.21.15.46:6833/3472581046","heartbeat_front_addr":"172.21.15.46:6831/3472581046","state":["exists","up"]},{"osd":10,"uuid":"1ed01854-443a-4acf-9293-7ca0d451a93d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6825","nonce":2378416559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6827","nonce":2378416559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6831","nonce":2378416559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6829","nonce":2378416559}]},"public_addr":"172.21.15.157:6825/2378416559","cluster_addr":"172.21.15.157:6827/2378416559","heartbeat_back_addr":"172.21.15.157:6831/2378416559","heartbeat_front_addr":"172.21.15.157:6829/2378416559","state":["exists","up"]},{"osd":11,"uuid":"021398c0-9184-4647-8220-e40f6705ca90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6825","nonce":3075632222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6827","nonce":3075632222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6831","nonce":3075632222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6829","nonce":3075632222}]},"public_addr":"172.21.15.195:6825/3075632222","cluster_addr":"172.21.15.195:6827/3075632222","heartbeat_back_addr":"172.21.15.195:6831/3075632222","heartbeat_front_addr":"172.21.15.195:6829/3075632222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:36:22.002614+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:36:44.098031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:37:04.518341+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:37:30.796462+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:37:52.756555+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:38:13.403168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:38:39.058472+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:39:01.106893+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:39:21.908334+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:39:46.843884+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:40:08.792020+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:40:29.282974+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.46:0/3248595150":"2023-10-20T12:34:26.552115+0000","172.21.15.46:0/3624849341":"2023-10-20T12:34:26.552115+0000","172.21.15.46:0/1844094590":"2023-10-20T12:34:26.552115+0000","172.21.15.46:6801/20022894":"2023-10-20T12:34:26.552115+0000","172.21.15.46:0/3969790632":"2023-10-20T12:34:00.135248+0000","172.21.15.46:0/2331135821":"2023-10-20T12:34:00.135248+0000","172.21.15.46:6800/51664346":"2023-10-20T12:34:00.135248+0000","172.21.15.46:6801/51664346":"2023-10-20T12:34:00.135248+0000","172.21.15.46:0/585851467":"2023-10-20T12:34:00.135248+0000","172.21.15.46:6800/20022894":"2023-10-20T12:34:26.552115+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-19T12:42:04.878 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:04.875+0000 7fa714452700 1 -- 172.21.15.46:0/3323317088 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fa6f80a1590 msgr2=0x7fa6f80a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:04.878 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:04.875+0000 7fa714452700 1 --2- 172.21.15.46:0/3323317088 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fa6f80a1590 0x7fa6f80a3a50 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa708005fd0 tx=0x7fa708009310 comp rx=0 tx=0).stop 2023-10-19T12:42:04.879 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:04.875+0000 7fa714452700 1 -- 172.21.15.46:0/3323317088 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa70c1067a0 msgr2=0x7fa70c1002a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:04.879 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:04.875+0000 7fa714452700 1 --2- 172.21.15.46:0/3323317088 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa70c1067a0 0x7fa70c1002a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa70400efc0 tx=0x7fa70400c3a0 comp rx=0 tx=0).stop 2023-10-19T12:42:04.879 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:04.875+0000 7fa714452700 1 -- 172.21.15.46:0/3323317088 shutdown_connections 2023-10-19T12:42:04.879 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:04.875+0000 7fa714452700 1 --2- 172.21.15.46:0/3323317088 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa70c1067a0 0x7fa70c1002a0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:04.880 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:04.875+0000 7fa714452700 1 --2- 172.21.15.46:0/3323317088 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa70c068190 0x7fa70c0ff820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:04.880 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:04.875+0000 7fa714452700 1 --2- 172.21.15.46:0/3323317088 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fa6f80a1590 0x7fa6f80a3a50 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:04.880 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:04.875+0000 7fa714452700 1 --2- 172.21.15.46:0/3323317088 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa70c068b30 0x7fa70c0ffd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:04.880 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:04.875+0000 7fa714452700 1 -- 172.21.15.46:0/3323317088 >> 172.21.15.46:0/3323317088 conn(0x7fa70c075790 msgr2=0x7fa70c0fd960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:04.880 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:04.875+0000 7fa714452700 1 -- 172.21.15.46:0/3323317088 shutdown_connections 2023-10-19T12:42:04.880 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:04.875+0000 7fa714452700 1 -- 172.21.15.46:0/3323317088 wait complete. 2023-10-19T12:42:05.361 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph tell osd.0 flush_pg_stats 2023-10-19T12:42:05.361 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph tell osd.1 flush_pg_stats 2023-10-19T12:42:05.362 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph tell osd.2 flush_pg_stats 2023-10-19T12:42:05.362 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph tell osd.3 flush_pg_stats 2023-10-19T12:42:05.363 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph tell osd.4 flush_pg_stats 2023-10-19T12:42:05.363 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph tell osd.5 flush_pg_stats 2023-10-19T12:42:05.364 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph tell osd.6 flush_pg_stats 2023-10-19T12:42:05.364 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph tell osd.7 flush_pg_stats 2023-10-19T12:42:05.365 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph tell osd.8 flush_pg_stats 2023-10-19T12:42:05.365 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph tell osd.9 flush_pg_stats 2023-10-19T12:42:05.366 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph tell osd.10 flush_pg_stats 2023-10-19T12:42:05.367 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph tell osd.11 flush_pg_stats 2023-10-19T12:42:05.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:05 smithi046 ceph-mon[98509]: pgmap v307: 129 pgs: 129 active+clean; 638 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.9 KiB/s wr, 10 op/s 2023-10-19T12:42:05.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:05 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/3323317088' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-19T12:42:06.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:05 smithi157 ceph-mon[134109]: pgmap v307: 129 pgs: 129 active+clean; 638 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.9 KiB/s wr, 10 op/s 2023-10-19T12:42:06.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:05 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/3323317088' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-19T12:42:06.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:05 smithi195 ceph-mon[134493]: pgmap v307: 129 pgs: 129 active+clean; 638 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.9 KiB/s wr, 10 op/s 2023-10-19T12:42:06.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:05 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/3323317088' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-19T12:42:07.260 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-19T12:42:07.429 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-19T12:42:07.431 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-19T12:42:07.625 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-19T12:42:07.785 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-19T12:42:07.789 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-19T12:42:07.867 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:07 smithi046 ceph-mon[98509]: pgmap v308: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 2.2 KiB/s wr, 12 op/s 2023-10-19T12:42:08.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:07 smithi157 ceph-mon[134109]: pgmap v308: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 2.2 KiB/s wr, 12 op/s 2023-10-19T12:42:08.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:07 smithi195 ceph-mon[134493]: pgmap v308: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 2.2 KiB/s wr, 12 op/s 2023-10-19T12:42:08.754 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-19T12:42:09.533 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:09 smithi046 ceph-mon[98509]: pgmap v309: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.1 KiB/s wr, 9 op/s 2023-10-19T12:42:09.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:09 smithi157 ceph-mon[134109]: pgmap v309: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.1 KiB/s wr, 9 op/s 2023-10-19T12:42:09.604 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-19T12:42:09.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:09 smithi195 ceph-mon[134493]: pgmap v309: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.1 KiB/s wr, 9 op/s 2023-10-19T12:42:09.637 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-19T12:42:10.131 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-19T12:42:10.131 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-19T12:42:10.655 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-19T12:42:11.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:11.042+0000 7f8965030700 1 -- 172.21.15.46:0/369064683 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8960101260 msgr2=0x7f896010d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:11.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:11.042+0000 7f8965030700 1 --2- 172.21.15.46:0/369064683 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8960101260 0x7f896010d650 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f895800b0a0 tx=0x7f895800b3b0 comp rx=0 tx=0).stop 2023-10-19T12:42:11.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:11.042+0000 7f8965030700 1 -- 172.21.15.46:0/369064683 shutdown_connections 2023-10-19T12:42:11.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:11.042+0000 7f8965030700 1 --2- 172.21.15.46:0/369064683 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8960101260 0x7f896010d650 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:11.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:11.042+0000 7f8965030700 1 --2- 172.21.15.46:0/369064683 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f89601057c0 0x7f8960105ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:11.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:11.042+0000 7f8965030700 1 --2- 172.21.15.46:0/369064683 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f89601008a0 0x7f8960100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:11.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:11.042+0000 7f8965030700 1 -- 172.21.15.46:0/369064683 >> 172.21.15.46:0/369064683 conn(0x7f89600779e0 msgr2=0x7f8960077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:11.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:11.042+0000 7f8965030700 1 -- 172.21.15.46:0/369064683 shutdown_connections 2023-10-19T12:42:11.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:11.042+0000 7f8965030700 1 -- 172.21.15.46:0/369064683 wait complete. 2023-10-19T12:42:11.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:11.043+0000 7f8965030700 1 Processor -- start 2023-10-19T12:42:11.049 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:11.043+0000 7f8965030700 1 -- start start 2023-10-19T12:42:11.049 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:11.043+0000 7f8965030700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f89601008a0 0x7f8960196cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:11.049 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:11.043+0000 7f8965030700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8960101260 0x7f8960197230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:11.049 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:11.043+0000 7f8965030700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f89601057c0 0x7f896019a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:11.049 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:11.043+0000 7f8965030700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f896019ab30 con 0x7f89601008a0 2023-10-19T12:42:11.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:11.043+0000 7f8965030700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f896019aca0 con 0x7f89601057c0 2023-10-19T12:42:11.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:11.043+0000 7f8965030700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f896019ae60 con 0x7f8960101260 2023-10-19T12:42:11.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:11.044+0000 7f895ed9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f89601008a0 0x7f8960196cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:11.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:11.044+0000 7f895ed9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f89601008a0 0x7f8960196cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35974/0 (socket says 172.21.15.46:35974) 2023-10-19T12:42:11.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:11.044+0000 7f895ed9d700 1 -- 172.21.15.46:0/2707194342 learned_addr learned my addr 172.21.15.46:0/2707194342 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:42:11.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:11.044+0000 7f895e59c700 1 --2- 172.21.15.46:0/2707194342 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8960101260 0x7f8960197230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:11.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:11.044+0000 7f895f59e700 1 --2- 172.21.15.46:0/2707194342 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f89601057c0 0x7f896019a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:11.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:11.044+0000 7f895ed9d700 1 -- 172.21.15.46:0/2707194342 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8960101260 msgr2=0x7f8960197230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:11.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:11.044+0000 7f895ed9d700 1 --2- 172.21.15.46:0/2707194342 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8960101260 0x7f8960197230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:11.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:11.044+0000 7f895ed9d700 1 -- 172.21.15.46:0/2707194342 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f89601057c0 msgr2=0x7f896019a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:11.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:11.044+0000 7f895ed9d700 1 --2- 172.21.15.46:0/2707194342 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f89601057c0 0x7f896019a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:11.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:11.044+0000 7f895ed9d700 1 -- 172.21.15.46:0/2707194342 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8958009d00 con 0x7f89601008a0 2023-10-19T12:42:11.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:11.044+0000 7f895f59e700 1 --2- 172.21.15.46:0/2707194342 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f89601057c0 0x7f896019a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T12:42:11.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:11.044+0000 7f895ed9d700 1 --2- 172.21.15.46:0/2707194342 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f89601008a0 0x7f8960196cf0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f895000e970 tx=0x7f895000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:11.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:11.045+0000 7f8947fff700 1 -- 172.21.15.46:0/2707194342 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8950009790 con 0x7f89601008a0 2023-10-19T12:42:11.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:11.045+0000 7f8965030700 1 -- 172.21.15.46:0/2707194342 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f896019b140 con 0x7f89601008a0 2023-10-19T12:42:11.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:11.045+0000 7f8947fff700 1 -- 172.21.15.46:0/2707194342 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f895000eec0 con 0x7f89601008a0 2023-10-19T12:42:11.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:11.045+0000 7f8947fff700 1 -- 172.21.15.46:0/2707194342 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8950003cf0 con 0x7f89601008a0 2023-10-19T12:42:11.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:11.045+0000 7f8965030700 1 -- 172.21.15.46:0/2707194342 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89601a3a90 con 0x7f89601008a0 2023-10-19T12:42:11.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:11.046+0000 7f8965030700 1 -- 172.21.15.46:0/2707194342 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8960110a00 con 0x7f89601008a0 2023-10-19T12:42:11.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:11.048+0000 7f8947fff700 1 -- 172.21.15.46:0/2707194342 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f895000ccd0 con 0x7f89601008a0 2023-10-19T12:42:11.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:11.049+0000 7f8947fff700 1 --2- 172.21.15.46:0/2707194342 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f89480a1510 0x7f89480a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:11.055 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:11.050+0000 7f8947fff700 1 -- 172.21.15.46:0/2707194342 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f8950014070 con 0x7f89601008a0 2023-10-19T12:42:11.055 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:11.050+0000 7f895e59c700 1 --2- 172.21.15.46:0/2707194342 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f89480a1510 0x7f89480a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:11.055 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:11.050+0000 7f8947fff700 1 --2- 172.21.15.46:0/2707194342 >> [v2:172.21.15.195:6808/4071287969,v1:172.21.15.195:6809/4071287969] conn(0x7f89480ac090 0x7f89480ae4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:11.055 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:11.050+0000 7f8947fff700 1 -- 172.21.15.46:0/2707194342 --> [v2:172.21.15.195:6808/4071287969,v1:172.21.15.195:6809/4071287969] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f89480aeba0 con 0x7f89480ac090 2023-10-19T12:42:11.055 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:11.050+0000 7f8947fff700 1 -- 172.21.15.46:0/2707194342 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7f89500cf700 con 0x7f89601008a0 2023-10-19T12:42:11.055 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:11.050+0000 7f895f59e700 1 --2- 172.21.15.46:0/2707194342 >> [v2:172.21.15.195:6808/4071287969,v1:172.21.15.195:6809/4071287969] conn(0x7f89480ac090 0x7f89480ae4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:11.056 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:11.050+0000 7f895e59c700 1 --2- 172.21.15.46:0/2707194342 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f89480a1510 0x7f89480a39d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8960198210 tx=0x7f8954009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:11.056 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:11.051+0000 7f895f59e700 1 --2- 172.21.15.46:0/2707194342 >> [v2:172.21.15.195:6808/4071287969,v1:172.21.15.195:6809/4071287969] conn(0x7f89480ac090 0x7f89480ae4d0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:11.056 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:11.052+0000 7f8947fff700 1 -- 172.21.15.46:0/2707194342 <== osd.5 v2:172.21.15.195:6808/4071287969 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f89480aeba0 con 0x7f89480ac090 2023-10-19T12:42:11.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:11.069+0000 7f8965030700 1 -- 172.21.15.46:0/2707194342 --> [v2:172.21.15.195:6808/4071287969,v1:172.21.15.195:6809/4071287969] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8960101f30 con 0x7f89480ac090 2023-10-19T12:42:11.073 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:11.070+0000 7f8947fff700 1 -- 172.21.15.46:0/2707194342 <== osd.5 v2:172.21.15.195:6808/4071287969 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f8960101f30 con 0x7f89480ac090 2023-10-19T12:42:11.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:11.070+0000 7f8965030700 1 -- 172.21.15.46:0/2707194342 >> [v2:172.21.15.195:6808/4071287969,v1:172.21.15.195:6809/4071287969] conn(0x7f89480ac090 msgr2=0x7f89480ae4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:11.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:11.070+0000 7f8965030700 1 --2- 172.21.15.46:0/2707194342 >> [v2:172.21.15.195:6808/4071287969,v1:172.21.15.195:6809/4071287969] conn(0x7f89480ac090 0x7f89480ae4d0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:11.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:11.071+0000 7f8965030700 1 -- 172.21.15.46:0/2707194342 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f89480a1510 msgr2=0x7f89480a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:11.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:11.071+0000 7f8965030700 1 --2- 172.21.15.46:0/2707194342 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f89480a1510 0x7f89480a39d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8960198210 tx=0x7f8954009260 comp rx=0 tx=0).stop 2023-10-19T12:42:11.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:11.071+0000 7f8965030700 1 -- 172.21.15.46:0/2707194342 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f89601008a0 msgr2=0x7f8960196cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:11.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:11.071+0000 7f8965030700 1 --2- 172.21.15.46:0/2707194342 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f89601008a0 0x7f8960196cf0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f895000e970 tx=0x7f895000ec80 comp rx=0 tx=0).stop 2023-10-19T12:42:11.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:11.071+0000 7f895f59e700 1 -- 172.21.15.46:0/2707194342 reap_dead start 2023-10-19T12:42:11.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:11.071+0000 7f8965030700 1 -- 172.21.15.46:0/2707194342 shutdown_connections 2023-10-19T12:42:11.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:11.071+0000 7f8965030700 1 -- 172.21.15.46:0/2707194342 >> 172.21.15.46:0/2707194342 conn(0x7f89600779e0 msgr2=0x7f89600fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:11.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:11.071+0000 7f8965030700 1 -- 172.21.15.46:0/2707194342 shutdown_connections 2023-10-19T12:42:11.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:11.071+0000 7f8965030700 1 -- 172.21.15.46:0/2707194342 wait complete. 2023-10-19T12:42:11.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:11 smithi046 ceph-mon[98509]: pgmap v310: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.1 KiB/s wr, 9 op/s 2023-10-19T12:42:12.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:11 smithi157 ceph-mon[134109]: pgmap v310: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.1 KiB/s wr, 9 op/s 2023-10-19T12:42:12.096 INFO:teuthology.orchestra.run.smithi046.stdout:163208757298 2023-10-19T12:42:12.097 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph osd last-stat-seq osd.5 2023-10-19T12:42:12.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:11 smithi195 ceph-mon[134493]: pgmap v310: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.1 KiB/s wr, 9 op/s 2023-10-19T12:42:13.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.589+0000 7f3ade1d9700 1 -- 172.21.15.46:0/468414139 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3ad8068190 msgr2=0x7f3ad80685f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:13.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.589+0000 7f3ade1d9700 1 --2- 172.21.15.46:0/468414139 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3ad8068190 0x7f3ad80685f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f3acc009990 tx=0x7f3acc009ca0 comp rx=0 tx=0).stop 2023-10-19T12:42:13.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.589+0000 7f3ade1d9700 1 -- 172.21.15.46:0/468414139 shutdown_connections 2023-10-19T12:42:13.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.589+0000 7f3ade1d9700 1 --2- 172.21.15.46:0/468414139 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3ad8068b30 0x7f3ad810d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:13.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.589+0000 7f3ade1d9700 1 --2- 172.21.15.46:0/468414139 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3ad81067a0 0x7f3ad8106b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:13.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.589+0000 7f3ade1d9700 1 --2- 172.21.15.46:0/468414139 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3ad8068190 0x7f3ad80685f0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:13.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.589+0000 7f3ade1d9700 1 -- 172.21.15.46:0/468414139 >> 172.21.15.46:0/468414139 conn(0x7f3ad8075790 msgr2=0x7f3ad8075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:13.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.589+0000 7f3ade1d9700 1 -- 172.21.15.46:0/468414139 shutdown_connections 2023-10-19T12:42:13.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.589+0000 7f3ade1d9700 1 -- 172.21.15.46:0/468414139 wait complete. 2023-10-19T12:42:13.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.590+0000 7f3ade1d9700 1 Processor -- start 2023-10-19T12:42:13.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.590+0000 7f3ade1d9700 1 -- start start 2023-10-19T12:42:13.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.591+0000 7f3ade1d9700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3ad8068190 0x7f3ad8198e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:13.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.591+0000 7f3ade1d9700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3ad8068b30 0x7f3ad81993c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:13.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.591+0000 7f3ade1d9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3ad81067a0 0x7f3ad819d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:13.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.591+0000 7f3ade1d9700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad819dd80 con 0x7f3ad81067a0 2023-10-19T12:42:13.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.591+0000 7f3ade1d9700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad819def0 con 0x7f3ad8068b30 2023-10-19T12:42:13.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.591+0000 7f3ade1d9700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad819e0b0 con 0x7f3ad8068190 2023-10-19T12:42:13.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.591+0000 7f3ad77fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3ad8068190 0x7f3ad8198e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:13.201 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.591+0000 7f3ad7fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3ad81067a0 0x7f3ad819d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:13.201 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.592+0000 7f3ad7fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3ad81067a0 0x7f3ad819d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36006/0 (socket says 172.21.15.46:36006) 2023-10-19T12:42:13.201 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.592+0000 7f3ad7fff700 1 -- 172.21.15.46:0/1806741491 learned_addr learned my addr 172.21.15.46:0/1806741491 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:42:13.201 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.591+0000 7f3ad77fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3ad8068190 0x7f3ad8198e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:48808/0 (socket says 172.21.15.46:48808) 2023-10-19T12:42:13.201 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.592+0000 7f3ad6ffd700 1 --2- 172.21.15.46:0/1806741491 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3ad8068b30 0x7f3ad81993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:13.201 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.592+0000 7f3ad7fff700 1 -- 172.21.15.46:0/1806741491 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3ad8068190 msgr2=0x7f3ad8198e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:13.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.592+0000 7f3ad7fff700 1 --2- 172.21.15.46:0/1806741491 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3ad8068190 0x7f3ad8198e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:13.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.592+0000 7f3ad7fff700 1 -- 172.21.15.46:0/1806741491 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3ad8068b30 msgr2=0x7f3ad81993c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:13.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.592+0000 7f3ad7fff700 1 --2- 172.21.15.46:0/1806741491 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3ad8068b30 0x7f3ad81993c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:13.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.592+0000 7f3ad7fff700 1 -- 172.21.15.46:0/1806741491 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3acc0095f0 con 0x7f3ad81067a0 2023-10-19T12:42:13.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.592+0000 7f3ad7fff700 1 --2- 172.21.15.46:0/1806741491 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3ad81067a0 0x7f3ad819d770 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f3ad0007ee0 tx=0x7f3ad000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:13.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.592+0000 7f3ad4ff9700 1 -- 172.21.15.46:0/1806741491 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad0017070 con 0x7f3ad81067a0 2023-10-19T12:42:13.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.593+0000 7f3ade1d9700 1 -- 172.21.15.46:0/1806741491 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ad819e390 con 0x7f3ad81067a0 2023-10-19T12:42:13.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.593+0000 7f3ad4ff9700 1 -- 172.21.15.46:0/1806741491 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3ad000f040 con 0x7f3ad81067a0 2023-10-19T12:42:13.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.593+0000 7f3ad4ff9700 1 -- 172.21.15.46:0/1806741491 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad0005580 con 0x7f3ad81067a0 2023-10-19T12:42:13.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.593+0000 7f3ade1d9700 1 -- 172.21.15.46:0/1806741491 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ad81a5bf0 con 0x7f3ad81067a0 2023-10-19T12:42:13.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.594+0000 7f3ade1d9700 1 -- 172.21.15.46:0/1806741491 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3ad81109c0 con 0x7f3ad81067a0 2023-10-19T12:42:13.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.596+0000 7f3ad4ff9700 1 -- 172.21.15.46:0/1806741491 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f3ad000db20 con 0x7f3ad81067a0 2023-10-19T12:42:13.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.597+0000 7f3ad4ff9700 1 --2- 172.21.15.46:0/1806741491 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f3ac00a1590 0x7f3ac00a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:13.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.597+0000 7f3ad4ff9700 1 -- 172.21.15.46:0/1806741491 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f3ad00ccec0 con 0x7f3ad81067a0 2023-10-19T12:42:13.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.598+0000 7f3ad4ff9700 1 --2- 172.21.15.46:0/1806741491 >> [v2:172.21.15.157:6800/2496862790,v1:172.21.15.157:6801/2496862790] conn(0x7f3ac00ac110 0x7f3ac00ae550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:13.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.598+0000 7f3ad77fe700 1 --2- 172.21.15.46:0/1806741491 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f3ac00a1590 0x7f3ac00a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:13.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.598+0000 7f3ad4ff9700 1 -- 172.21.15.46:0/1806741491 --> [v2:172.21.15.157:6800/2496862790,v1:172.21.15.157:6801/2496862790] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3ac00aec20 con 0x7f3ac00ac110 2023-10-19T12:42:13.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.598+0000 7f3ad4ff9700 1 -- 172.21.15.46:0/1806741491 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3ad00cd230 con 0x7f3ad81067a0 2023-10-19T12:42:13.206 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.598+0000 7f3ad6ffd700 1 --2- 172.21.15.46:0/1806741491 >> [v2:172.21.15.157:6800/2496862790,v1:172.21.15.157:6801/2496862790] conn(0x7f3ac00ac110 0x7f3ac00ae550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:13.206 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.598+0000 7f3ad77fe700 1 --2- 172.21.15.46:0/1806741491 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f3ac00a1590 0x7f3ac00a3a50 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f3ac8007b60 tx=0x7f3ac80073d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:13.206 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.599+0000 7f3ad6ffd700 1 --2- 172.21.15.46:0/1806741491 >> [v2:172.21.15.157:6800/2496862790,v1:172.21.15.157:6801/2496862790] conn(0x7f3ac00ac110 0x7f3ac00ae550 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:13.206 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.600+0000 7f3ad4ff9700 1 -- 172.21.15.46:0/1806741491 <== osd.1 v2:172.21.15.157:6800/2496862790 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f3ac00aec20 con 0x7f3ac00ac110 2023-10-19T12:42:13.206 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.620+0000 7f3ade1d9700 1 -- 172.21.15.46:0/1806741491 --> [v2:172.21.15.157:6800/2496862790,v1:172.21.15.157:6801/2496862790] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3ad8101ee0 con 0x7f3ac00ac110 2023-10-19T12:42:13.207 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.621+0000 7f3ad4ff9700 1 -- 172.21.15.46:0/1806741491 <== osd.1 v2:172.21.15.157:6800/2496862790 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3ad8101ee0 con 0x7f3ac00ac110 2023-10-19T12:42:13.207 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.621+0000 7f3ade1d9700 1 -- 172.21.15.46:0/1806741491 >> [v2:172.21.15.157:6800/2496862790,v1:172.21.15.157:6801/2496862790] conn(0x7f3ac00ac110 msgr2=0x7f3ac00ae550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:13.207 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.621+0000 7f3ade1d9700 1 --2- 172.21.15.46:0/1806741491 >> [v2:172.21.15.157:6800/2496862790,v1:172.21.15.157:6801/2496862790] conn(0x7f3ac00ac110 0x7f3ac00ae550 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:13.207 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.621+0000 7f3ade1d9700 1 -- 172.21.15.46:0/1806741491 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f3ac00a1590 msgr2=0x7f3ac00a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:13.207 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.622+0000 7f3ade1d9700 1 --2- 172.21.15.46:0/1806741491 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f3ac00a1590 0x7f3ac00a3a50 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f3ac8007b60 tx=0x7f3ac80073d0 comp rx=0 tx=0).stop 2023-10-19T12:42:13.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.622+0000 7f3ade1d9700 1 -- 172.21.15.46:0/1806741491 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3ad81067a0 msgr2=0x7f3ad819d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:13.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.622+0000 7f3ade1d9700 1 --2- 172.21.15.46:0/1806741491 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3ad81067a0 0x7f3ad819d770 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f3ad0007ee0 tx=0x7f3ad000d3b0 comp rx=0 tx=0).stop 2023-10-19T12:42:13.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.622+0000 7f3ad7fff700 1 -- 172.21.15.46:0/1806741491 reap_dead start 2023-10-19T12:42:13.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.622+0000 7f3ade1d9700 1 -- 172.21.15.46:0/1806741491 shutdown_connections 2023-10-19T12:42:13.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.622+0000 7f3ade1d9700 1 -- 172.21.15.46:0/1806741491 >> 172.21.15.46:0/1806741491 conn(0x7f3ad8075790 msgr2=0x7f3ad810bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:13.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.622+0000 7f3ade1d9700 1 -- 172.21.15.46:0/1806741491 shutdown_connections 2023-10-19T12:42:13.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.622+0000 7f3ade1d9700 1 -- 172.21.15.46:0/1806741491 wait complete. 2023-10-19T12:42:13.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.906+0000 7f8395c9a700 1 -- 172.21.15.46:0/3422723514 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8390101260 msgr2=0x7f839010d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:13.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.906+0000 7f8395c9a700 1 --2- 172.21.15.46:0/3422723514 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8390101260 0x7f839010d650 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f838800b0a0 tx=0x7f838800b3b0 comp rx=0 tx=0).stop 2023-10-19T12:42:13.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.906+0000 7f8395c9a700 1 -- 172.21.15.46:0/3422723514 shutdown_connections 2023-10-19T12:42:13.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.906+0000 7f8395c9a700 1 --2- 172.21.15.46:0/3422723514 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8390101260 0x7f839010d650 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:13.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.906+0000 7f8395c9a700 1 --2- 172.21.15.46:0/3422723514 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f83901057c0 0x7f8390105ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:13.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.906+0000 7f8395c9a700 1 --2- 172.21.15.46:0/3422723514 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f83901008a0 0x7f8390100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:13.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.906+0000 7f8395c9a700 1 -- 172.21.15.46:0/3422723514 >> 172.21.15.46:0/3422723514 conn(0x7f83900779e0 msgr2=0x7f8390077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:13.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.906+0000 7f8395c9a700 1 -- 172.21.15.46:0/3422723514 shutdown_connections 2023-10-19T12:42:13.850 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.906+0000 7f8395c9a700 1 -- 172.21.15.46:0/3422723514 wait complete. 2023-10-19T12:42:13.850 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.908+0000 7f8395c9a700 1 Processor -- start 2023-10-19T12:42:13.850 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.908+0000 7f8395c9a700 1 -- start start 2023-10-19T12:42:13.850 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.909+0000 7f8395c9a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f83901008a0 0x7f8390199010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:13.850 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.909+0000 7f8395c9a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8390101260 0x7f8390199550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:13.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.909+0000 7f8395c9a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f83901057c0 0x7f839019d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:13.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.909+0000 7f8395c9a700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f839019dec0 con 0x7f8390101260 2023-10-19T12:42:13.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.909+0000 7f8395c9a700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f839019e030 con 0x7f83901008a0 2023-10-19T12:42:13.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.909+0000 7f8395c9a700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f839019e1f0 con 0x7f83901057c0 2023-10-19T12:42:13.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.910+0000 7f838effd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8390101260 0x7f8390199550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:13.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.910+0000 7f838ffff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f83901057c0 0x7f839019d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:13.852 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.910+0000 7f838effd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8390101260 0x7f8390199550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36022/0 (socket says 172.21.15.46:36022) 2023-10-19T12:42:13.852 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.910+0000 7f838effd700 1 -- 172.21.15.46:0/3345919192 learned_addr learned my addr 172.21.15.46:0/3345919192 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:42:13.852 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.910+0000 7f838f7fe700 1 --2- 172.21.15.46:0/3345919192 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f83901008a0 0x7f8390199010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:13.852 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.911+0000 7f838ffff700 1 -- 172.21.15.46:0/3345919192 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f83901008a0 msgr2=0x7f8390199010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:13.852 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.911+0000 7f838ffff700 1 --2- 172.21.15.46:0/3345919192 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f83901008a0 0x7f8390199010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:13.853 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.911+0000 7f838ffff700 1 -- 172.21.15.46:0/3345919192 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8390101260 msgr2=0x7f8390199550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:13.853 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.911+0000 7f838ffff700 1 --2- 172.21.15.46:0/3345919192 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8390101260 0x7f8390199550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:13.853 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.911+0000 7f838ffff700 1 -- 172.21.15.46:0/3345919192 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8388009d00 con 0x7f83901057c0 2023-10-19T12:42:13.853 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.911+0000 7f838effd700 1 --2- 172.21.15.46:0/3345919192 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8390101260 0x7f8390199550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:42:13.853 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.911+0000 7f838ffff700 1 --2- 172.21.15.46:0/3345919192 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f83901057c0 0x7f839019d8b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f838800b070 tx=0x7f8388007860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:13.853 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.912+0000 7f838cff9700 1 -- 172.21.15.46:0/3345919192 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f838800e040 con 0x7f83901057c0 2023-10-19T12:42:13.854 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.912+0000 7f8395c9a700 1 -- 172.21.15.46:0/3345919192 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f839019e470 con 0x7f83901057c0 2023-10-19T12:42:13.854 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.912+0000 7f838cff9700 1 -- 172.21.15.46:0/3345919192 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f838801d470 con 0x7f83901057c0 2023-10-19T12:42:13.854 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.912+0000 7f838cff9700 1 -- 172.21.15.46:0/3345919192 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8388005280 con 0x7f83901057c0 2023-10-19T12:42:13.854 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.912+0000 7f8395c9a700 1 -- 172.21.15.46:0/3345919192 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83901077d0 con 0x7f83901057c0 2023-10-19T12:42:13.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.913+0000 7f8395c9a700 1 -- 172.21.15.46:0/3345919192 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8390110a40 con 0x7f83901057c0 2023-10-19T12:42:13.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.915+0000 7f838cff9700 1 -- 172.21.15.46:0/3345919192 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f838801d5e0 con 0x7f83901057c0 2023-10-19T12:42:13.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.918+0000 7f838cff9700 1 --2- 172.21.15.46:0/3345919192 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f83780a1590 0x7f83780a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:13.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.918+0000 7f838cff9700 1 -- 172.21.15.46:0/3345919192 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f83880ce470 con 0x7f83901057c0 2023-10-19T12:42:13.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.918+0000 7f838cff9700 1 --2- 172.21.15.46:0/3345919192 >> [v2:172.21.15.195:6800/4211767276,v1:172.21.15.195:6801/4211767276] conn(0x7f83780ac110 0x7f83780ae550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:13.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.918+0000 7f838cff9700 1 -- 172.21.15.46:0/3345919192 --> [v2:172.21.15.195:6800/4211767276,v1:172.21.15.195:6801/4211767276] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f83780aec20 con 0x7f83780ac110 2023-10-19T12:42:13.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.918+0000 7f838cff9700 1 -- 172.21.15.46:0/3345919192 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7f83880ce7e0 con 0x7f83901057c0 2023-10-19T12:42:13.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.919+0000 7f838f7fe700 1 --2- 172.21.15.46:0/3345919192 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f83780a1590 0x7f83780a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:13.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.920+0000 7f838f7fe700 1 --2- 172.21.15.46:0/3345919192 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f83780a1590 0x7f83780a3a50 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f8390101930 tx=0x7f8380009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:13.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.921+0000 7f838effd700 1 --2- 172.21.15.46:0/3345919192 >> [v2:172.21.15.195:6800/4211767276,v1:172.21.15.195:6801/4211767276] conn(0x7f83780ac110 0x7f83780ae550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:13.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.922+0000 7f838effd700 1 --2- 172.21.15.46:0/3345919192 >> [v2:172.21.15.195:6800/4211767276,v1:172.21.15.195:6801/4211767276] conn(0x7f83780ac110 0x7f83780ae550 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:13.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.923+0000 7f838cff9700 1 -- 172.21.15.46:0/3345919192 <== osd.2 v2:172.21.15.195:6800/4211767276 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f83780aec20 con 0x7f83780ac110 2023-10-19T12:42:13.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.949+0000 7f8395c9a700 1 -- 172.21.15.46:0/3345919192 --> [v2:172.21.15.195:6800/4211767276,v1:172.21.15.195:6801/4211767276] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8390101f30 con 0x7f83780ac110 2023-10-19T12:42:13.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.950+0000 7f838cff9700 1 -- 172.21.15.46:0/3345919192 <== osd.2 v2:172.21.15.195:6800/4211767276 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8390101f30 con 0x7f83780ac110 2023-10-19T12:42:13.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.951+0000 7f8395c9a700 1 -- 172.21.15.46:0/3345919192 >> [v2:172.21.15.195:6800/4211767276,v1:172.21.15.195:6801/4211767276] conn(0x7f83780ac110 msgr2=0x7f83780ae550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:13.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.951+0000 7f8395c9a700 1 --2- 172.21.15.46:0/3345919192 >> [v2:172.21.15.195:6800/4211767276,v1:172.21.15.195:6801/4211767276] conn(0x7f83780ac110 0x7f83780ae550 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:13.858 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.951+0000 7f8395c9a700 1 -- 172.21.15.46:0/3345919192 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f83780a1590 msgr2=0x7f83780a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:13.858 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.951+0000 7f8395c9a700 1 --2- 172.21.15.46:0/3345919192 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f83780a1590 0x7f83780a3a50 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f8390101930 tx=0x7f8380009260 comp rx=0 tx=0).stop 2023-10-19T12:42:13.858 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.951+0000 7f8395c9a700 1 -- 172.21.15.46:0/3345919192 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f83901057c0 msgr2=0x7f839019d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:13.858 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.951+0000 7f8395c9a700 1 --2- 172.21.15.46:0/3345919192 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f83901057c0 0x7f839019d8b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f838800b070 tx=0x7f8388007860 comp rx=0 tx=0).stop 2023-10-19T12:42:13.858 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.951+0000 7f838ffff700 1 -- 172.21.15.46:0/3345919192 reap_dead start 2023-10-19T12:42:13.858 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.951+0000 7f8395c9a700 1 -- 172.21.15.46:0/3345919192 shutdown_connections 2023-10-19T12:42:13.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.951+0000 7f8395c9a700 1 -- 172.21.15.46:0/3345919192 >> 172.21.15.46:0/3345919192 conn(0x7f83900779e0 msgr2=0x7f839010ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:13.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.951+0000 7f8395c9a700 1 -- 172.21.15.46:0/3345919192 shutdown_connections 2023-10-19T12:42:13.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:12.951+0000 7f8395c9a700 1 -- 172.21.15.46:0/3345919192 wait complete. 2023-10-19T12:42:13.888 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:13 smithi046 ceph-mon[98509]: pgmap v311: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2023-10-19T12:42:13.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:13.614+0000 7f7bf0ace700 1 -- 172.21.15.46:0/3657434049 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7bec068190 msgr2=0x7f7bec0685f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:13.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:13.614+0000 7f7bf0ace700 1 --2- 172.21.15.46:0/3657434049 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7bec068190 0x7f7bec0685f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7be0009990 tx=0x7f7be0009ca0 comp rx=0 tx=0).stop 2023-10-19T12:42:13.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:13.614+0000 7f7bf0ace700 1 -- 172.21.15.46:0/3657434049 shutdown_connections 2023-10-19T12:42:13.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:13.614+0000 7f7bf0ace700 1 --2- 172.21.15.46:0/3657434049 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7bec068b30 0x7f7bec10d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:13.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:13.614+0000 7f7bf0ace700 1 --2- 172.21.15.46:0/3657434049 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7bec1067a0 0x7f7bec106b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:13.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:13.614+0000 7f7bf0ace700 1 --2- 172.21.15.46:0/3657434049 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7bec068190 0x7f7bec0685f0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:13.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:13.614+0000 7f7bf0ace700 1 -- 172.21.15.46:0/3657434049 >> 172.21.15.46:0/3657434049 conn(0x7f7bec075790 msgr2=0x7f7bec075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:13.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:13.614+0000 7f7bf0ace700 1 -- 172.21.15.46:0/3657434049 shutdown_connections 2023-10-19T12:42:13.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:13.614+0000 7f7bf0ace700 1 -- 172.21.15.46:0/3657434049 wait complete. 2023-10-19T12:42:13.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:13.615+0000 7f7bf0ace700 1 Processor -- start 2023-10-19T12:42:13.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:13.616+0000 7f7bf0ace700 1 -- start start 2023-10-19T12:42:14.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:13.616+0000 7f7bf0ace700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7bec068190 0x7f7bec198f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:14.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:13.616+0000 7f7bf0ace700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7bec068b30 0x7f7bec199460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:14.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:13.616+0000 7f7bf0ace700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7bec1067a0 0x7f7bec19d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:14.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:13.616+0000 7f7bf0ace700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bec19de20 con 0x7f7bec068b30 2023-10-19T12:42:14.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:13.616+0000 7f7bf0ace700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bec19df90 con 0x7f7bec1067a0 2023-10-19T12:42:14.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:13.616+0000 7f7bf0ace700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bec19e150 con 0x7f7bec068190 2023-10-19T12:42:14.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:13.616+0000 7f7be9d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7bec068b30 0x7f7bec199460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:14.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:13.617+0000 7f7bead9d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7bec1067a0 0x7f7bec19d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:14.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:13.617+0000 7f7bea59c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7bec068190 0x7f7bec198f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:14.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:13.617+0000 7f7bead9d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7bec1067a0 0x7f7bec19d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:40480/0 (socket says 172.21.15.46:40480) 2023-10-19T12:42:14.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:13.617+0000 7f7bea59c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7bec068190 0x7f7bec198f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:52068/0 (socket says 172.21.15.46:52068) 2023-10-19T12:42:14.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:13.617+0000 7f7bead9d700 1 -- 172.21.15.46:0/3629400695 learned_addr learned my addr 172.21.15.46:0/3629400695 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:42:14.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:13.617+0000 7f7bea59c700 1 -- 172.21.15.46:0/3629400695 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7bec1067a0 msgr2=0x7f7bec19d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:14.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:13.617+0000 7f7bea59c700 1 --2- 172.21.15.46:0/3629400695 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7bec1067a0 0x7f7bec19d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:14.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:13.617+0000 7f7bea59c700 1 -- 172.21.15.46:0/3629400695 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7bec068b30 msgr2=0x7f7bec199460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:14.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:13.617+0000 7f7bea59c700 1 --2- 172.21.15.46:0/3629400695 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7bec068b30 0x7f7bec199460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:14.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:13.617+0000 7f7bea59c700 1 -- 172.21.15.46:0/3629400695 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7be00095f0 con 0x7f7bec068190 2023-10-19T12:42:14.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:13.617+0000 7f7bea59c700 1 --2- 172.21.15.46:0/3629400695 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7bec068190 0x7f7bec198f20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc00e9f0 tx=0x7f7bdc00ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:14.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:13.618+0000 7f7bdb7fe700 1 -- 172.21.15.46:0/3629400695 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bdc0096d0 con 0x7f7bec068190 2023-10-19T12:42:14.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:13.618+0000 7f7bf0ace700 1 -- 172.21.15.46:0/3629400695 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bec19e430 con 0x7f7bec068190 2023-10-19T12:42:14.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:13.618+0000 7f7bdb7fe700 1 -- 172.21.15.46:0/3629400695 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7bdc00cbd0 con 0x7f7bec068190 2023-10-19T12:42:14.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:13.618+0000 7f7bf0ace700 1 -- 172.21.15.46:0/3629400695 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bec1a5c90 con 0x7f7bec068190 2023-10-19T12:42:14.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:13.618+0000 7f7bdb7fe700 1 -- 172.21.15.46:0/3629400695 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bdc018680 con 0x7f7bec068190 2023-10-19T12:42:14.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:13.619+0000 7f7bf0ace700 1 -- 172.21.15.46:0/3629400695 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7bec110a20 con 0x7f7bec068190 2023-10-19T12:42:14.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:13.622+0000 7f7bdb7fe700 1 -- 172.21.15.46:0/3629400695 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f7bdc00cd40 con 0x7f7bec068190 2023-10-19T12:42:14.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:13.623+0000 7f7bdb7fe700 1 --2- 172.21.15.46:0/3629400695 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f7bd40a15f0 0x7f7bd40a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:14.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:13.623+0000 7f7bdb7fe700 1 -- 172.21.15.46:0/3629400695 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f7bdc014070 con 0x7f7bec068190 2023-10-19T12:42:14.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:13.624+0000 7f7be9d9b700 1 --2- 172.21.15.46:0/3629400695 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f7bd40a15f0 0x7f7bd40a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:14.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:13.624+0000 7f7bdb7fe700 1 --2- 172.21.15.46:0/3629400695 >> [v2:172.21.15.157:6824/2378416559,v1:172.21.15.157:6825/2378416559] conn(0x7f7bd40ac170 0x7f7bd40ae5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:14.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:13.624+0000 7f7bdb7fe700 1 -- 172.21.15.46:0/3629400695 --> [v2:172.21.15.157:6824/2378416559,v1:172.21.15.157:6825/2378416559] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7bd40aec80 con 0x7f7bd40ac170 2023-10-19T12:42:14.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:13.624+0000 7f7bdb7fe700 1 -- 172.21.15.46:0/3629400695 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7bdc018680 con 0x7f7bec068190 2023-10-19T12:42:14.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:13.624+0000 7f7bead9d700 1 --2- 172.21.15.46:0/3629400695 >> [v2:172.21.15.157:6824/2378416559,v1:172.21.15.157:6825/2378416559] conn(0x7f7bd40ac170 0x7f7bd40ae5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:14.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:13.624+0000 7f7be9d9b700 1 --2- 172.21.15.46:0/3629400695 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f7bd40a15f0 0x7f7bd40a3ab0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7be0000c00 tx=0x7f7be000b260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:14.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:13.625+0000 7f7bead9d700 1 --2- 172.21.15.46:0/3629400695 >> [v2:172.21.15.157:6824/2378416559,v1:172.21.15.157:6825/2378416559] conn(0x7f7bd40ac170 0x7f7bd40ae5b0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:14.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:13.626+0000 7f7bdb7fe700 1 -- 172.21.15.46:0/3629400695 <== osd.10 v2:172.21.15.157:6824/2378416559 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f7bd40aec80 con 0x7f7bd40ac170 2023-10-19T12:42:14.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:13.645+0000 7f7bf0ace700 1 -- 172.21.15.46:0/3629400695 --> [v2:172.21.15.157:6824/2378416559,v1:172.21.15.157:6825/2378416559] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7bec101ee0 con 0x7f7bd40ac170 2023-10-19T12:42:14.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:13.646+0000 7f7bdb7fe700 1 -- 172.21.15.46:0/3629400695 <== osd.10 v2:172.21.15.157:6824/2378416559 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f7bec101ee0 con 0x7f7bd40ac170 2023-10-19T12:42:14.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:13.646+0000 7f7bf0ace700 1 -- 172.21.15.46:0/3629400695 >> [v2:172.21.15.157:6824/2378416559,v1:172.21.15.157:6825/2378416559] conn(0x7f7bd40ac170 msgr2=0x7f7bd40ae5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:14.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:13.646+0000 7f7bf0ace700 1 --2- 172.21.15.46:0/3629400695 >> [v2:172.21.15.157:6824/2378416559,v1:172.21.15.157:6825/2378416559] conn(0x7f7bd40ac170 0x7f7bd40ae5b0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:14.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:13.646+0000 7f7bf0ace700 1 -- 172.21.15.46:0/3629400695 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f7bd40a15f0 msgr2=0x7f7bd40a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:14.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:13.647+0000 7f7bf0ace700 1 --2- 172.21.15.46:0/3629400695 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f7bd40a15f0 0x7f7bd40a3ab0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7be0000c00 tx=0x7f7be000b260 comp rx=0 tx=0).stop 2023-10-19T12:42:14.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:13.647+0000 7f7bf0ace700 1 -- 172.21.15.46:0/3629400695 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7bec068190 msgr2=0x7f7bec198f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:14.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:13.647+0000 7f7bf0ace700 1 --2- 172.21.15.46:0/3629400695 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7bec068190 0x7f7bec198f20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc00e9f0 tx=0x7f7bdc00ed00 comp rx=0 tx=0).stop 2023-10-19T12:42:14.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:13.647+0000 7f7bead9d700 1 -- 172.21.15.46:0/3629400695 reap_dead start 2023-10-19T12:42:14.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:13.647+0000 7f7bf0ace700 1 -- 172.21.15.46:0/3629400695 shutdown_connections 2023-10-19T12:42:14.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:13.647+0000 7f7bf0ace700 1 -- 172.21.15.46:0/3629400695 >> 172.21.15.46:0/3629400695 conn(0x7f7bec075790 msgr2=0x7f7bec10bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:14.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:13.647+0000 7f7bf0ace700 1 -- 172.21.15.46:0/3629400695 shutdown_connections 2023-10-19T12:42:14.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:13.647+0000 7f7bf0ace700 1 -- 172.21.15.46:0/3629400695 wait complete. 2023-10-19T12:42:14.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:13 smithi157 ceph-mon[134109]: pgmap v311: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2023-10-19T12:42:14.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:13 smithi195 ceph-mon[134493]: pgmap v311: 129 pgs: 129 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2023-10-19T12:42:14.150 INFO:teuthology.orchestra.run.smithi046.stdout:55834574916 2023-10-19T12:42:14.151 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph osd last-stat-seq osd.1 2023-10-19T12:42:15.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:14.882+0000 7f91f2f1c700 1 -- 172.21.15.46:0/911645819 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f91ec1057c0 msgr2=0x7f91ec105ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:15.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:14.882+0000 7f91f2f1c700 1 --2- 172.21.15.46:0/911645819 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f91ec1057c0 0x7f91ec105ba0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f91e0009990 tx=0x7f91e0009ca0 comp rx=0 tx=0).stop 2023-10-19T12:42:15.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:14.882+0000 7f91f2f1c700 1 -- 172.21.15.46:0/911645819 shutdown_connections 2023-10-19T12:42:15.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:14.882+0000 7f91f2f1c700 1 --2- 172.21.15.46:0/911645819 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f91ec101260 0x7f91ec10d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:15.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:14.882+0000 7f91f2f1c700 1 --2- 172.21.15.46:0/911645819 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f91ec1057c0 0x7f91ec105ba0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:15.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:14.882+0000 7f91f2f1c700 1 --2- 172.21.15.46:0/911645819 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f91ec1008a0 0x7f91ec100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:15.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:14.882+0000 7f91f2f1c700 1 -- 172.21.15.46:0/911645819 >> 172.21.15.46:0/911645819 conn(0x7f91ec0779e0 msgr2=0x7f91ec077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:15.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:14.882+0000 7f91f2f1c700 1 -- 172.21.15.46:0/911645819 shutdown_connections 2023-10-19T12:42:15.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:14.882+0000 7f91f2f1c700 1 -- 172.21.15.46:0/911645819 wait complete. 2023-10-19T12:42:15.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:14.883+0000 7f91f2f1c700 1 Processor -- start 2023-10-19T12:42:15.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:14.884+0000 7f91f2f1c700 1 -- start start 2023-10-19T12:42:15.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:14.884+0000 7f91f2f1c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f91ec1008a0 0x7f91ec198ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:15.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:14.884+0000 7f91f2f1c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f91ec101260 0x7f91ec1993e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:15.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:14.884+0000 7f91f2f1c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f91ec1057c0 0x7f91ec19d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:15.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:14.884+0000 7f91f2f1c700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91ec19dda0 con 0x7f91ec1057c0 2023-10-19T12:42:15.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:14.884+0000 7f91f2f1c700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91ec19df10 con 0x7f91ec101260 2023-10-19T12:42:15.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:14.884+0000 7f91f2f1c700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91ec19e0d0 con 0x7f91ec1008a0 2023-10-19T12:42:15.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:14.884+0000 7f91f14b9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f91ec1057c0 0x7f91ec19d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:15.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:14.884+0000 7f91f14b9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f91ec1057c0 0x7f91ec19d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58880/0 (socket says 172.21.15.46:58880) 2023-10-19T12:42:15.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:14.884+0000 7f91f0cb8700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f91ec1008a0 0x7f91ec198ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:15.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:14.884+0000 7f91f14b9700 1 -- 172.21.15.46:0/2705009094 learned_addr learned my addr 172.21.15.46:0/2705009094 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:42:15.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:14.885+0000 7f91ebfff700 1 --2- 172.21.15.46:0/2705009094 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f91ec101260 0x7f91ec1993e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:15.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:14.885+0000 7f91f14b9700 1 -- 172.21.15.46:0/2705009094 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f91ec1008a0 msgr2=0x7f91ec198ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:15.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:14.885+0000 7f91f14b9700 1 --2- 172.21.15.46:0/2705009094 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f91ec1008a0 0x7f91ec198ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:15.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:14.885+0000 7f91f14b9700 1 -- 172.21.15.46:0/2705009094 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f91ec101260 msgr2=0x7f91ec1993e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:15.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:14.885+0000 7f91f14b9700 1 --2- 172.21.15.46:0/2705009094 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f91ec101260 0x7f91ec1993e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:15.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:14.885+0000 7f91f14b9700 1 -- 172.21.15.46:0/2705009094 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91e00095f0 con 0x7f91ec1057c0 2023-10-19T12:42:15.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:14.885+0000 7f91f14b9700 1 --2- 172.21.15.46:0/2705009094 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f91ec1057c0 0x7f91ec19d790 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f91e4007f10 tx=0x7f91e400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:15.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:14.885+0000 7f91e9ffb700 1 -- 172.21.15.46:0/2705009094 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e4009ea0 con 0x7f91ec1057c0 2023-10-19T12:42:15.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:14.885+0000 7f91e9ffb700 1 -- 172.21.15.46:0/2705009094 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f91e400f040 con 0x7f91ec1057c0 2023-10-19T12:42:15.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:14.885+0000 7f91f2f1c700 1 -- 172.21.15.46:0/2705009094 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91ec19e3b0 con 0x7f91ec1057c0 2023-10-19T12:42:15.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:14.885+0000 7f91e9ffb700 1 -- 172.21.15.46:0/2705009094 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e4004760 con 0x7f91ec1057c0 2023-10-19T12:42:15.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:14.886+0000 7f91f2f1c700 1 -- 172.21.15.46:0/2705009094 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91ec1a5c10 con 0x7f91ec1057c0 2023-10-19T12:42:15.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:14.887+0000 7f91f2f1c700 1 -- 172.21.15.46:0/2705009094 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f91ec110a20 con 0x7f91ec1057c0 2023-10-19T12:42:15.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:14.889+0000 7f91e9ffb700 1 -- 172.21.15.46:0/2705009094 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f91e4003a00 con 0x7f91ec1057c0 2023-10-19T12:42:15.013 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:14.890+0000 7f91e9ffb700 1 --2- 172.21.15.46:0/2705009094 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f91dc0a1510 0x7f91dc0a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:15.013 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:14.890+0000 7f91e9ffb700 1 -- 172.21.15.46:0/2705009094 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f91e40cd330 con 0x7f91ec1057c0 2023-10-19T12:42:15.013 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:14.890+0000 7f91f0cb8700 1 --2- 172.21.15.46:0/2705009094 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f91dc0a1510 0x7f91dc0a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:15.013 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:14.891+0000 7f91e9ffb700 1 --2- 172.21.15.46:0/2705009094 >> [v2:172.21.15.46:6810/1964113352,v1:172.21.15.46:6811/1964113352] conn(0x7f91dc0ac090 0x7f91dc0ae4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:15.013 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:14.891+0000 7f91e9ffb700 1 -- 172.21.15.46:0/2705009094 --> [v2:172.21.15.46:6810/1964113352,v1:172.21.15.46:6811/1964113352] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f91dc0aeba0 con 0x7f91dc0ac090 2023-10-19T12:42:15.014 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:14.891+0000 7f91e9ffb700 1 -- 172.21.15.46:0/2705009094 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7f91e40cd6a0 con 0x7f91ec1057c0 2023-10-19T12:42:15.014 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:14.891+0000 7f91ebfff700 1 --2- 172.21.15.46:0/2705009094 >> [v2:172.21.15.46:6810/1964113352,v1:172.21.15.46:6811/1964113352] conn(0x7f91dc0ac090 0x7f91dc0ae4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:15.014 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:14.891+0000 7f91f0cb8700 1 --2- 172.21.15.46:0/2705009094 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f91dc0a1510 0x7f91dc0a39d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f91e0006010 tx=0x7f91e000b540 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:15.014 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:14.891+0000 7f91ebfff700 1 --2- 172.21.15.46:0/2705009094 >> [v2:172.21.15.46:6810/1964113352,v1:172.21.15.46:6811/1964113352] conn(0x7f91dc0ac090 0x7f91dc0ae4d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:15.014 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:14.892+0000 7f91e9ffb700 1 -- 172.21.15.46:0/2705009094 <== osd.3 v2:172.21.15.46:6810/1964113352 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f91dc0aeba0 con 0x7f91dc0ac090 2023-10-19T12:42:15.014 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:14.909+0000 7f91f2f1c700 1 -- 172.21.15.46:0/2705009094 --> [v2:172.21.15.46:6810/1964113352,v1:172.21.15.46:6811/1964113352] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f91ec101f30 con 0x7f91dc0ac090 2023-10-19T12:42:15.015 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:14.910+0000 7f91e9ffb700 1 -- 172.21.15.46:0/2705009094 <== osd.3 v2:172.21.15.46:6810/1964113352 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f91ec101f30 con 0x7f91dc0ac090 2023-10-19T12:42:15.015 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:14.910+0000 7f91f2f1c700 1 -- 172.21.15.46:0/2705009094 >> [v2:172.21.15.46:6810/1964113352,v1:172.21.15.46:6811/1964113352] conn(0x7f91dc0ac090 msgr2=0x7f91dc0ae4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:15.015 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:14.910+0000 7f91f2f1c700 1 --2- 172.21.15.46:0/2705009094 >> [v2:172.21.15.46:6810/1964113352,v1:172.21.15.46:6811/1964113352] conn(0x7f91dc0ac090 0x7f91dc0ae4d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:15.015 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:14.910+0000 7f91f2f1c700 1 -- 172.21.15.46:0/2705009094 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f91dc0a1510 msgr2=0x7f91dc0a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:15.015 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:14.910+0000 7f91f2f1c700 1 --2- 172.21.15.46:0/2705009094 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f91dc0a1510 0x7f91dc0a39d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f91e0006010 tx=0x7f91e000b540 comp rx=0 tx=0).stop 2023-10-19T12:42:15.015 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:14.910+0000 7f91f2f1c700 1 -- 172.21.15.46:0/2705009094 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f91ec1057c0 msgr2=0x7f91ec19d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:15.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:14.910+0000 7f91f2f1c700 1 --2- 172.21.15.46:0/2705009094 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f91ec1057c0 0x7f91ec19d790 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f91e4007f10 tx=0x7f91e400d3b0 comp rx=0 tx=0).stop 2023-10-19T12:42:15.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:14.910+0000 7f91f14b9700 1 -- 172.21.15.46:0/2705009094 reap_dead start 2023-10-19T12:42:15.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:14.910+0000 7f91f2f1c700 1 -- 172.21.15.46:0/2705009094 shutdown_connections 2023-10-19T12:42:15.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:14.910+0000 7f91f2f1c700 1 -- 172.21.15.46:0/2705009094 >> 172.21.15.46:0/2705009094 conn(0x7f91ec0779e0 msgr2=0x7f91ec10ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:15.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:14.911+0000 7f91f2f1c700 1 -- 172.21.15.46:0/2705009094 shutdown_connections 2023-10-19T12:42:15.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:14.911+0000 7f91f2f1c700 1 -- 172.21.15.46:0/2705009094 wait complete. 2023-10-19T12:42:15.303 INFO:teuthology.orchestra.run.smithi046.stdout:77309411393 2023-10-19T12:42:15.303 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph osd last-stat-seq osd.2 2023-10-19T12:42:15.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:15.558+0000 7fcb0907f700 1 -- 172.21.15.46:0/821487567 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb041089c0 msgr2=0x7fcb04108da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:15.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:15.558+0000 7fcb0907f700 1 --2- 172.21.15.46:0/821487567 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb041089c0 0x7fcb04108da0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fcaf4009990 tx=0x7fcaf4009ca0 comp rx=0 tx=0).stop 2023-10-19T12:42:15.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:15.558+0000 7fcb0907f700 1 -- 172.21.15.46:0/821487567 shutdown_connections 2023-10-19T12:42:15.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:15.558+0000 7fcb0907f700 1 --2- 172.21.15.46:0/821487567 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcb04103380 0x7fcb0410f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:15.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:15.558+0000 7fcb0907f700 1 --2- 172.21.15.46:0/821487567 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb041089c0 0x7fcb04108da0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:15.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:15.558+0000 7fcb0907f700 1 --2- 172.21.15.46:0/821487567 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcb041029c0 0x7fcb04102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:15.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:15.558+0000 7fcb0907f700 1 -- 172.21.15.46:0/821487567 >> 172.21.15.46:0/821487567 conn(0x7fcb040fe4b0 msgr2=0x7fcb041008d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:15.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:15.558+0000 7fcb0907f700 1 -- 172.21.15.46:0/821487567 shutdown_connections 2023-10-19T12:42:15.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:15.558+0000 7fcb0907f700 1 -- 172.21.15.46:0/821487567 wait complete. 2023-10-19T12:42:15.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:15.559+0000 7fcb0907f700 1 Processor -- start 2023-10-19T12:42:15.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:15.559+0000 7fcb0907f700 1 -- start start 2023-10-19T12:42:15.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:15.560+0000 7fcb0907f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb041029c0 0x7fcb04198df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:15.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:15.560+0000 7fcb0907f700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcb04103380 0x7fcb04199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:15.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:15.560+0000 7fcb0907f700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcb041089c0 0x7fcb0419d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:15.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:15.560+0000 7fcb0907f700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0419dcf0 con 0x7fcb041029c0 2023-10-19T12:42:15.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:15.560+0000 7fcb0907f700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0419de60 con 0x7fcb041089c0 2023-10-19T12:42:15.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:15.560+0000 7fcb0907f700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0419e020 con 0x7fcb04103380 2023-10-19T12:42:15.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:15.560+0000 7fcb02d9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb041029c0 0x7fcb04198df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:15.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:15.560+0000 7fcb0259c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcb04103380 0x7fcb04199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:15.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:15.560+0000 7fcb0259c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcb04103380 0x7fcb04199330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:52106/0 (socket says 172.21.15.46:52106) 2023-10-19T12:42:15.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:15.560+0000 7fcb02d9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb041029c0 0x7fcb04198df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58894/0 (socket says 172.21.15.46:58894) 2023-10-19T12:42:15.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:15.560+0000 7fcb0259c700 1 -- 172.21.15.46:0/4121836642 learned_addr learned my addr 172.21.15.46:0/4121836642 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:42:15.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:15.560+0000 7fcb0359e700 1 --2- 172.21.15.46:0/4121836642 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcb041089c0 0x7fcb0419d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:15.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:15.561+0000 7fcb0259c700 1 -- 172.21.15.46:0/4121836642 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcb041089c0 msgr2=0x7fcb0419d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:15.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:15.561+0000 7fcb0259c700 1 --2- 172.21.15.46:0/4121836642 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcb041089c0 0x7fcb0419d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:15.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:15.561+0000 7fcb0259c700 1 -- 172.21.15.46:0/4121836642 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb041029c0 msgr2=0x7fcb04198df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:15.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:15.561+0000 7fcb0259c700 1 --2- 172.21.15.46:0/4121836642 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb041029c0 0x7fcb04198df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:15.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:15.561+0000 7fcb0259c700 1 -- 172.21.15.46:0/4121836642 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaf40095f0 con 0x7fcb04103380 2023-10-19T12:42:15.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:15.561+0000 7fcb0359e700 1 --2- 172.21.15.46:0/4121836642 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcb041089c0 0x7fcb0419d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:42:15.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:15.561+0000 7fcb0259c700 1 --2- 172.21.15.46:0/4121836642 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcb04103380 0x7fcb04199330 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fcaf800e9a0 tx=0x7fcaf800ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:15.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:15.561+0000 7fcaebfff700 1 -- 172.21.15.46:0/4121836642 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf8009790 con 0x7fcb04103380 2023-10-19T12:42:15.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:15.562+0000 7fcb0907f700 1 -- 172.21.15.46:0/4121836642 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb0419e300 con 0x7fcb04103380 2023-10-19T12:42:15.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:15.562+0000 7fcaebfff700 1 -- 172.21.15.46:0/4121836642 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcaf8010430 con 0x7fcb04103380 2023-10-19T12:42:15.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:15.562+0000 7fcaebfff700 1 -- 172.21.15.46:0/4121836642 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf8018680 con 0x7fcb04103380 2023-10-19T12:42:15.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:15.562+0000 7fcb0907f700 1 -- 172.21.15.46:0/4121836642 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb041a5b60 con 0x7fcb04103380 2023-10-19T12:42:15.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:15.563+0000 7fcb0907f700 1 -- 172.21.15.46:0/4121836642 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcb04112c20 con 0x7fcb04103380 2023-10-19T12:42:15.796 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:15.566+0000 7fcaebfff700 1 -- 172.21.15.46:0/4121836642 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7fcaf80105a0 con 0x7fcb04103380 2023-10-19T12:42:15.796 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:15.569+0000 7fcaebfff700 1 --2- 172.21.15.46:0/4121836642 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fcaec0a1510 0x7fcaec0a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:15.796 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:15.569+0000 7fcaebfff700 1 -- 172.21.15.46:0/4121836642 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fcaf8014070 con 0x7fcb04103380 2023-10-19T12:42:15.796 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:15.570+0000 7fcb02d9d700 1 --2- 172.21.15.46:0/4121836642 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fcaec0a1510 0x7fcaec0a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:15.796 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:15.570+0000 7fcaebfff700 1 --2- 172.21.15.46:0/4121836642 >> [v2:172.21.15.195:6816/74230104,v1:172.21.15.195:6817/74230104] conn(0x7fcaec0ac090 0x7fcaec0ae4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:15.796 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:15.570+0000 7fcaebfff700 1 -- 172.21.15.46:0/4121836642 --> [v2:172.21.15.195:6816/74230104,v1:172.21.15.195:6817/74230104] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcaec0aeba0 con 0x7fcaec0ac090 2023-10-19T12:42:15.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:15.570+0000 7fcaebfff700 1 -- 172.21.15.46:0/4121836642 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcaf80cd8b0 con 0x7fcb04103380 2023-10-19T12:42:15.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:15.570+0000 7fcb02d9d700 1 --2- 172.21.15.46:0/4121836642 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fcaec0a1510 0x7fcaec0a39d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fcaf400b2e0 tx=0x7fcaf4005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:15.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:15.570+0000 7fcb0359e700 1 --2- 172.21.15.46:0/4121836642 >> [v2:172.21.15.195:6816/74230104,v1:172.21.15.195:6817/74230104] conn(0x7fcaec0ac090 0x7fcaec0ae4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:15.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:15.571+0000 7fcb0359e700 1 --2- 172.21.15.46:0/4121836642 >> [v2:172.21.15.195:6816/74230104,v1:172.21.15.195:6817/74230104] conn(0x7fcaec0ac090 0x7fcaec0ae4d0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:15.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:15.572+0000 7fcaebfff700 1 -- 172.21.15.46:0/4121836642 <== osd.8 v2:172.21.15.195:6816/74230104 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fcaec0aeba0 con 0x7fcaec0ac090 2023-10-19T12:42:15.798 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:15.591+0000 7fcb0907f700 1 -- 172.21.15.46:0/4121836642 --> [v2:172.21.15.195:6816/74230104,v1:172.21.15.195:6817/74230104] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fcb04060e70 con 0x7fcaec0ac090 2023-10-19T12:42:15.798 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:15.592+0000 7fcaebfff700 1 -- 172.21.15.46:0/4121836642 <== osd.8 v2:172.21.15.195:6816/74230104 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fcb04060e70 con 0x7fcaec0ac090 2023-10-19T12:42:15.798 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:15.592+0000 7fcb0907f700 1 -- 172.21.15.46:0/4121836642 >> [v2:172.21.15.195:6816/74230104,v1:172.21.15.195:6817/74230104] conn(0x7fcaec0ac090 msgr2=0x7fcaec0ae4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:15.798 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:15.592+0000 7fcb0907f700 1 --2- 172.21.15.46:0/4121836642 >> [v2:172.21.15.195:6816/74230104,v1:172.21.15.195:6817/74230104] conn(0x7fcaec0ac090 0x7fcaec0ae4d0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:15.798 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:15.593+0000 7fcb0907f700 1 -- 172.21.15.46:0/4121836642 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fcaec0a1510 msgr2=0x7fcaec0a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:15.799 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:15.593+0000 7fcb0907f700 1 --2- 172.21.15.46:0/4121836642 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fcaec0a1510 0x7fcaec0a39d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fcaf400b2e0 tx=0x7fcaf4005fd0 comp rx=0 tx=0).stop 2023-10-19T12:42:15.799 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:15.593+0000 7fcb0907f700 1 -- 172.21.15.46:0/4121836642 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcb04103380 msgr2=0x7fcb04199330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:15.799 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:15.593+0000 7fcb0907f700 1 --2- 172.21.15.46:0/4121836642 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcb04103380 0x7fcb04199330 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fcaf800e9a0 tx=0x7fcaf800ecb0 comp rx=0 tx=0).stop 2023-10-19T12:42:15.799 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:15.593+0000 7fcb0359e700 1 -- 172.21.15.46:0/4121836642 reap_dead start 2023-10-19T12:42:15.799 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:15.593+0000 7fcb0907f700 1 -- 172.21.15.46:0/4121836642 shutdown_connections 2023-10-19T12:42:15.799 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:15.593+0000 7fcb0907f700 1 -- 172.21.15.46:0/4121836642 >> 172.21.15.46:0/4121836642 conn(0x7fcb040fe4b0 msgr2=0x7fcb040fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:15.800 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:15.593+0000 7fcb0907f700 1 -- 172.21.15.46:0/4121836642 shutdown_connections 2023-10-19T12:42:15.800 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:15.593+0000 7fcb0907f700 1 -- 172.21.15.46:0/4121836642 wait complete. 2023-10-19T12:42:15.921 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:15 smithi046 ceph-mon[98509]: pgmap v312: 129 pgs: 129 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 597 B/s wr, 10 op/s 2023-10-19T12:42:16.006 INFO:teuthology.orchestra.run.smithi046.stdout:309237645339 2023-10-19T12:42:16.006 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph osd last-stat-seq osd.10 2023-10-19T12:42:16.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.036+0000 7f2249e04700 1 -- 172.21.15.46:0/507000490 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2244068f60 msgr2=0x7f22440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:16.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.036+0000 7f2249e04700 1 --2- 172.21.15.46:0/507000490 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2244068f60 0x7f22440693e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2238009990 tx=0x7f2238009ca0 comp rx=0 tx=0).stop 2023-10-19T12:42:16.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.036+0000 7f2249e04700 1 -- 172.21.15.46:0/507000490 shutdown_connections 2023-10-19T12:42:16.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.036+0000 7f2249e04700 1 --2- 172.21.15.46:0/507000490 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2244103250 0x7f2244103700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:16.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.036+0000 7f2249e04700 1 --2- 172.21.15.46:0/507000490 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f22441056e0 0x7f2244068a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:16.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.036+0000 7f2249e04700 1 --2- 172.21.15.46:0/507000490 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2244068f60 0x7f22440693e0 secure :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2238009990 tx=0x7f2238009ca0 comp rx=0 tx=0).stop 2023-10-19T12:42:16.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.036+0000 7f2249e04700 1 -- 172.21.15.46:0/507000490 >> 172.21.15.46:0/507000490 conn(0x7f2244075790 msgr2=0x7f2244075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:16.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.036+0000 7f2249e04700 1 -- 172.21.15.46:0/507000490 shutdown_connections 2023-10-19T12:42:16.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.036+0000 7f2249e04700 1 -- 172.21.15.46:0/507000490 wait complete. 2023-10-19T12:42:16.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.039+0000 7f2249e04700 1 Processor -- start 2023-10-19T12:42:16.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.039+0000 7f2249e04700 1 -- start start 2023-10-19T12:42:16.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.039+0000 7f2249e04700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2244103250 0x7f224419d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:16.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.039+0000 7f2249e04700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f22441056e0 0x7f224419daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:16.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.039+0000 7f2249e04700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f22441a1e50 0x7f22441a22d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:16.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.039+0000 7f2249e04700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22441a2840 con 0x7f2244103250 2023-10-19T12:42:16.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.039+0000 7f2249e04700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22441a29b0 con 0x7f22441056e0 2023-10-19T12:42:16.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.039+0000 7f2249e04700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22441a2b70 con 0x7f22441a1e50 2023-10-19T12:42:16.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.039+0000 7f22437fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2244103250 0x7f224419d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:16.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.039+0000 7f22437fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2244103250 0x7f224419d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58916/0 (socket says 172.21.15.46:58916) 2023-10-19T12:42:16.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.039+0000 7f22437fe700 1 -- 172.21.15.46:0/2240762823 learned_addr learned my addr 172.21.15.46:0/2240762823 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:42:16.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.039+0000 7f2242ffd700 1 --2- 172.21.15.46:0/2240762823 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f22441056e0 0x7f224419daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:16.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.039+0000 7f22437fe700 1 -- 172.21.15.46:0/2240762823 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f22441a1e50 msgr2=0x7f22441a22d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-19T12:42:16.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.039+0000 7f22437fe700 1 --2- 172.21.15.46:0/2240762823 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f22441a1e50 0x7f22441a22d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:16.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.039+0000 7f22437fe700 1 -- 172.21.15.46:0/2240762823 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f22441056e0 msgr2=0x7f224419daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:16.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.039+0000 7f22437fe700 1 --2- 172.21.15.46:0/2240762823 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f22441056e0 0x7f224419daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:16.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.039+0000 7f22437fe700 1 -- 172.21.15.46:0/2240762823 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2234009520 con 0x7f2244103250 2023-10-19T12:42:16.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.039+0000 7f2242ffd700 1 --2- 172.21.15.46:0/2240762823 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f22441056e0 0x7f224419daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T12:42:16.049 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.039+0000 7f22437fe700 1 --2- 172.21.15.46:0/2240762823 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2244103250 0x7f224419d560 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f223400eb30 tx=0x7f223400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:16.049 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.039+0000 7f2240ff9700 1 -- 172.21.15.46:0/2240762823 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f223400cd40 con 0x7f2244103250 2023-10-19T12:42:16.049 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.039+0000 7f2240ff9700 1 -- 172.21.15.46:0/2240762823 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f223400cea0 con 0x7f2244103250 2023-10-19T12:42:16.049 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.039+0000 7f2240ff9700 1 -- 172.21.15.46:0/2240762823 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2234010430 con 0x7f2244103250 2023-10-19T12:42:16.049 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.039+0000 7f2249e04700 1 -- 172.21.15.46:0/2240762823 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22380095f0 con 0x7f2244103250 2023-10-19T12:42:16.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.039+0000 7f2249e04700 1 -- 172.21.15.46:0/2240762823 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2244106060 con 0x7f2244103250 2023-10-19T12:42:16.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.044+0000 7f2249e04700 1 -- 172.21.15.46:0/2240762823 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2244116fc0 con 0x7f2244103250 2023-10-19T12:42:16.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.046+0000 7f2240ff9700 1 -- 172.21.15.46:0/2240762823 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f2234003f40 con 0x7f2244103250 2023-10-19T12:42:16.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.046+0000 7f2240ff9700 1 --2- 172.21.15.46:0/2240762823 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f222c0a1590 0x7f222c0a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:16.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.046+0000 7f2240ff9700 1 -- 172.21.15.46:0/2240762823 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f2234014070 con 0x7f2244103250 2023-10-19T12:42:16.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.046+0000 7f2240ff9700 1 --2- 172.21.15.46:0/2240762823 >> [v2:172.21.15.157:6808/3636910144,v1:172.21.15.157:6809/3636910144] conn(0x7f222c0ac110 0x7f222c0ae550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:16.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.046+0000 7f2240ff9700 1 -- 172.21.15.46:0/2240762823 --> [v2:172.21.15.157:6808/3636910144,v1:172.21.15.157:6809/3636910144] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f222c0aec20 con 0x7f222c0ac110 2023-10-19T12:42:16.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.046+0000 7f2240ff9700 1 -- 172.21.15.46:0/2240762823 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7f22340cd920 con 0x7f2244103250 2023-10-19T12:42:16.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.046+0000 7f2242ffd700 1 --2- 172.21.15.46:0/2240762823 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f222c0a1590 0x7f222c0a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:16.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.046+0000 7f2243fff700 1 --2- 172.21.15.46:0/2240762823 >> [v2:172.21.15.157:6808/3636910144,v1:172.21.15.157:6809/3636910144] conn(0x7f222c0ac110 0x7f222c0ae550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:16.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.046+0000 7f2243fff700 1 --2- 172.21.15.46:0/2240762823 >> [v2:172.21.15.157:6808/3636910144,v1:172.21.15.157:6809/3636910144] conn(0x7f222c0ac110 0x7f222c0ae550 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:16.055 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.051+0000 7f2242ffd700 1 --2- 172.21.15.46:0/2240762823 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f222c0a1590 0x7f222c0a3a50 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2238000c00 tx=0x7f2238005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:16.055 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.051+0000 7f2240ff9700 1 -- 172.21.15.46:0/2240762823 <== osd.4 v2:172.21.15.157:6808/3636910144 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f222c0aec20 con 0x7f222c0ac110 2023-10-19T12:42:16.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.071+0000 7f2249e04700 1 -- 172.21.15.46:0/2240762823 --> [v2:172.21.15.157:6808/3636910144,v1:172.21.15.157:6809/3636910144] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f22440ffd30 con 0x7f222c0ac110 2023-10-19T12:42:16.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.072+0000 7f2240ff9700 1 -- 172.21.15.46:0/2240762823 <== osd.4 v2:172.21.15.157:6808/3636910144 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f22440ffd30 con 0x7f222c0ac110 2023-10-19T12:42:16.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.072+0000 7f2249e04700 1 -- 172.21.15.46:0/2240762823 >> [v2:172.21.15.157:6808/3636910144,v1:172.21.15.157:6809/3636910144] conn(0x7f222c0ac110 msgr2=0x7f222c0ae550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:16.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.072+0000 7f2249e04700 1 --2- 172.21.15.46:0/2240762823 >> [v2:172.21.15.157:6808/3636910144,v1:172.21.15.157:6809/3636910144] conn(0x7f222c0ac110 0x7f222c0ae550 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:16.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.073+0000 7f2249e04700 1 -- 172.21.15.46:0/2240762823 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f222c0a1590 msgr2=0x7f222c0a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:16.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.073+0000 7f2249e04700 1 --2- 172.21.15.46:0/2240762823 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f222c0a1590 0x7f222c0a3a50 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2238000c00 tx=0x7f2238005fb0 comp rx=0 tx=0).stop 2023-10-19T12:42:16.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.073+0000 7f2249e04700 1 -- 172.21.15.46:0/2240762823 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2244103250 msgr2=0x7f224419d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:16.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.073+0000 7f2249e04700 1 --2- 172.21.15.46:0/2240762823 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2244103250 0x7f224419d560 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f223400eb30 tx=0x7f223400eef0 comp rx=0 tx=0).stop 2023-10-19T12:42:16.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.073+0000 7f2243fff700 1 -- 172.21.15.46:0/2240762823 reap_dead start 2023-10-19T12:42:16.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.073+0000 7f2249e04700 1 -- 172.21.15.46:0/2240762823 shutdown_connections 2023-10-19T12:42:16.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.073+0000 7f2249e04700 1 -- 172.21.15.46:0/2240762823 >> 172.21.15.46:0/2240762823 conn(0x7f2244075790 msgr2=0x7f22440fe740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:16.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.073+0000 7f2249e04700 1 -- 172.21.15.46:0/2240762823 shutdown_connections 2023-10-19T12:42:16.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.073+0000 7f2249e04700 1 -- 172.21.15.46:0/2240762823 wait complete. 2023-10-19T12:42:16.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:15 smithi157 ceph-mon[134109]: pgmap v312: 129 pgs: 129 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 597 B/s wr, 10 op/s 2023-10-19T12:42:16.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:15 smithi195 ceph-mon[134493]: pgmap v312: 129 pgs: 129 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 597 B/s wr, 10 op/s 2023-10-19T12:42:16.496 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.493+0000 7f4c51e41700 1 -- 172.21.15.46:0/335018555 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4c4c072a20 msgr2=0x7f4c4c072e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:16.497 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.493+0000 7f4c51e41700 1 --2- 172.21.15.46:0/335018555 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4c4c072a20 0x7f4c4c072e00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c009990 tx=0x7f4c3c009ca0 comp rx=0 tx=0).stop 2023-10-19T12:42:16.497 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.493+0000 7f4c51e41700 1 -- 172.21.15.46:0/335018555 shutdown_connections 2023-10-19T12:42:16.497 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.493+0000 7f4c51e41700 1 --2- 172.21.15.46:0/335018555 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4c4c10d250 0x7f4c4c10f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:16.497 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.493+0000 7f4c51e41700 1 --2- 172.21.15.46:0/335018555 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4c4c072a20 0x7f4c4c072e00 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:16.497 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.493+0000 7f4c51e41700 1 --2- 172.21.15.46:0/335018555 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c4c073340 0x7f4c4c10cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:16.498 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.493+0000 7f4c51e41700 1 -- 172.21.15.46:0/335018555 >> 172.21.15.46:0/335018555 conn(0x7f4c4c0779e0 msgr2=0x7f4c4c077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:16.498 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.493+0000 7f4c51e41700 1 -- 172.21.15.46:0/335018555 shutdown_connections 2023-10-19T12:42:16.498 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.493+0000 7f4c51e41700 1 -- 172.21.15.46:0/335018555 wait complete. 2023-10-19T12:42:16.499 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.495+0000 7f4c51e41700 1 Processor -- start 2023-10-19T12:42:16.499 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.495+0000 7f4c51e41700 1 -- start start 2023-10-19T12:42:16.500 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.495+0000 7f4c51e41700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c4c072a20 0x7f4c4c198e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:16.500 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.495+0000 7f4c51e41700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4c4c073340 0x7f4c4c1993b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:16.500 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.495+0000 7f4c51e41700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4c4c10d250 0x7f4c4c19d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:16.500 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.495+0000 7f4c51e41700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c4c19dd70 con 0x7f4c4c072a20 2023-10-19T12:42:16.500 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.495+0000 7f4c51e41700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c4c19dee0 con 0x7f4c4c073340 2023-10-19T12:42:16.500 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.495+0000 7f4c51e41700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c4c19e0a0 con 0x7f4c4c10d250 2023-10-19T12:42:16.501 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.496+0000 7f4c4b7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c4c072a20 0x7f4c4c198e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:16.501 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.496+0000 7f4c4b7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c4c072a20 0x7f4c4c198e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58944/0 (socket says 172.21.15.46:58944) 2023-10-19T12:42:16.501 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.496+0000 7f4c4b7fe700 1 -- 172.21.15.46:0/3465211720 learned_addr learned my addr 172.21.15.46:0/3465211720 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:42:16.501 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.496+0000 7f4c4affd700 1 --2- 172.21.15.46:0/3465211720 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4c4c073340 0x7f4c4c1993b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:16.501 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.496+0000 7f4c4bfff700 1 --2- 172.21.15.46:0/3465211720 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4c4c10d250 0x7f4c4c19d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:16.502 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.496+0000 7f4c4b7fe700 1 -- 172.21.15.46:0/3465211720 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4c4c10d250 msgr2=0x7f4c4c19d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:16.502 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.496+0000 7f4c4b7fe700 1 --2- 172.21.15.46:0/3465211720 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4c4c10d250 0x7f4c4c19d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:16.502 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.496+0000 7f4c4b7fe700 1 -- 172.21.15.46:0/3465211720 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4c4c073340 msgr2=0x7f4c4c1993b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:16.502 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.496+0000 7f4c4b7fe700 1 --2- 172.21.15.46:0/3465211720 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4c4c073340 0x7f4c4c1993b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:16.502 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.496+0000 7f4c4b7fe700 1 -- 172.21.15.46:0/3465211720 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c40009520 con 0x7f4c4c072a20 2023-10-19T12:42:16.502 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.496+0000 7f4c4affd700 1 --2- 172.21.15.46:0/3465211720 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4c4c073340 0x7f4c4c1993b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T12:42:16.503 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.496+0000 7f4c4b7fe700 1 --2- 172.21.15.46:0/3465211720 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c4c072a20 0x7f4c4c198e70 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c005770 tx=0x7f4c3c005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:16.503 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.497+0000 7f4c48ff9700 1 -- 172.21.15.46:0/3465211720 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c3c01d070 con 0x7f4c4c072a20 2023-10-19T12:42:16.504 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.497+0000 7f4c48ff9700 1 -- 172.21.15.46:0/3465211720 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4c3c021410 con 0x7f4c4c072a20 2023-10-19T12:42:16.504 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.497+0000 7f4c51e41700 1 -- 172.21.15.46:0/3465211720 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c3c0095f0 con 0x7f4c4c072a20 2023-10-19T12:42:16.504 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.497+0000 7f4c48ff9700 1 -- 172.21.15.46:0/3465211720 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c3c017650 con 0x7f4c4c072a20 2023-10-19T12:42:16.504 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.497+0000 7f4c51e41700 1 -- 172.21.15.46:0/3465211720 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c4c1a5a10 con 0x7f4c4c072a20 2023-10-19T12:42:16.504 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.498+0000 7f4c51e41700 1 -- 172.21.15.46:0/3465211720 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4c4c112ca0 con 0x7f4c4c072a20 2023-10-19T12:42:16.505 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.500+0000 7f4c48ff9700 1 -- 172.21.15.46:0/3465211720 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f4c3c0217f0 con 0x7f4c4c072a20 2023-10-19T12:42:16.505 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.501+0000 7f4c48ff9700 1 --2- 172.21.15.46:0/3465211720 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f4c340a1510 0x7f4c340a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:16.506 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.502+0000 7f4c48ff9700 1 -- 172.21.15.46:0/3465211720 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f4c3c0cede0 con 0x7f4c4c072a20 2023-10-19T12:42:16.506 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.502+0000 7f4c4affd700 1 --2- 172.21.15.46:0/3465211720 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f4c340a1510 0x7f4c340a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:16.506 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.502+0000 7f4c48ff9700 1 --2- 172.21.15.46:0/3465211720 >> [v2:172.21.15.195:6824/3075632222,v1:172.21.15.195:6825/3075632222] conn(0x7f4c340ac090 0x7f4c340ae4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:16.506 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.502+0000 7f4c48ff9700 1 -- 172.21.15.46:0/3465211720 --> [v2:172.21.15.195:6824/3075632222,v1:172.21.15.195:6825/3075632222] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4c340aeba0 con 0x7f4c340ac090 2023-10-19T12:42:16.507 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.502+0000 7f4c48ff9700 1 -- 172.21.15.46:0/3465211720 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4c3c0cf150 con 0x7f4c4c072a20 2023-10-19T12:42:16.507 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.502+0000 7f4c4bfff700 1 --2- 172.21.15.46:0/3465211720 >> [v2:172.21.15.195:6824/3075632222,v1:172.21.15.195:6825/3075632222] conn(0x7f4c340ac090 0x7f4c340ae4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:16.507 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.503+0000 7f4c4affd700 1 --2- 172.21.15.46:0/3465211720 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f4c340a1510 0x7f4c340a39d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c19a3d0 tx=0x7f4c40009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:16.508 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.503+0000 7f4c4bfff700 1 --2- 172.21.15.46:0/3465211720 >> [v2:172.21.15.195:6824/3075632222,v1:172.21.15.195:6825/3075632222] conn(0x7f4c340ac090 0x7f4c340ae4d0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:16.508 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.504+0000 7f4c48ff9700 1 -- 172.21.15.46:0/3465211720 <== osd.11 v2:172.21.15.195:6824/3075632222 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f4c340aeba0 con 0x7f4c340ac090 2023-10-19T12:42:16.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.521+0000 7f4c51e41700 1 -- 172.21.15.46:0/3465211720 --> [v2:172.21.15.195:6824/3075632222,v1:172.21.15.195:6825/3075632222] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4c4c0740b0 con 0x7f4c340ac090 2023-10-19T12:42:16.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.522+0000 7f4c48ff9700 1 -- 172.21.15.46:0/3465211720 <== osd.11 v2:172.21.15.195:6824/3075632222 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f4c4c0740b0 con 0x7f4c340ac090 2023-10-19T12:42:16.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.522+0000 7f4c51e41700 1 -- 172.21.15.46:0/3465211720 >> [v2:172.21.15.195:6824/3075632222,v1:172.21.15.195:6825/3075632222] conn(0x7f4c340ac090 msgr2=0x7f4c340ae4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:16.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.522+0000 7f4c51e41700 1 --2- 172.21.15.46:0/3465211720 >> [v2:172.21.15.195:6824/3075632222,v1:172.21.15.195:6825/3075632222] conn(0x7f4c340ac090 0x7f4c340ae4d0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:16.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.523+0000 7f4c51e41700 1 -- 172.21.15.46:0/3465211720 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f4c340a1510 msgr2=0x7f4c340a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:16.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.523+0000 7f4c51e41700 1 --2- 172.21.15.46:0/3465211720 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f4c340a1510 0x7f4c340a39d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c19a3d0 tx=0x7f4c40009260 comp rx=0 tx=0).stop 2023-10-19T12:42:16.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.523+0000 7f4c51e41700 1 -- 172.21.15.46:0/3465211720 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c4c072a20 msgr2=0x7f4c4c198e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:16.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.523+0000 7f4c51e41700 1 --2- 172.21.15.46:0/3465211720 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c4c072a20 0x7f4c4c198e70 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c005770 tx=0x7f4c3c005e80 comp rx=0 tx=0).stop 2023-10-19T12:42:16.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.523+0000 7f4c4bfff700 1 -- 172.21.15.46:0/3465211720 reap_dead start 2023-10-19T12:42:16.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.523+0000 7f4c51e41700 1 -- 172.21.15.46:0/3465211720 shutdown_connections 2023-10-19T12:42:16.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.523+0000 7f4c51e41700 1 -- 172.21.15.46:0/3465211720 >> 172.21.15.46:0/3465211720 conn(0x7f4c4c0779e0 msgr2=0x7f4c4c0fdac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:16.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.523+0000 7f4c51e41700 1 -- 172.21.15.46:0/3465211720 shutdown_connections 2023-10-19T12:42:16.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:16.523+0000 7f4c51e41700 1 -- 172.21.15.46:0/3465211720 wait complete. 2023-10-19T12:42:17.592 INFO:teuthology.orchestra.run.smithi046.stdout:107374182460 2023-10-19T12:42:17.592 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph osd last-stat-seq osd.3 2023-10-19T12:42:17.934 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:17 smithi046 ceph-mon[98509]: pgmap v313: 129 pgs: 129 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 596 B/s wr, 11 op/s 2023-10-19T12:42:17.940 INFO:teuthology.orchestra.run.smithi046.stdout:339302416408 2023-10-19T12:42:17.940 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph osd last-stat-seq osd.11 2023-10-19T12:42:18.022 INFO:teuthology.orchestra.run.smithi046.stdout:141733920823 2023-10-19T12:42:18.023 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph osd last-stat-seq osd.4 2023-10-19T12:42:18.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:18.079+0000 7fbfde9b9700 1 -- 172.21.15.46:0/2449548075 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbfd81067a0 msgr2=0x7fbfd8106b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:18.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:18.079+0000 7fbfde9b9700 1 --2- 172.21.15.46:0/2449548075 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbfd81067a0 0x7fbfd8106b80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbfc8009990 tx=0x7fbfc8009ca0 comp rx=0 tx=0).stop 2023-10-19T12:42:18.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:18.079+0000 7fbfde9b9700 1 -- 172.21.15.46:0/2449548075 shutdown_connections 2023-10-19T12:42:18.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:18.079+0000 7fbfde9b9700 1 --2- 172.21.15.46:0/2449548075 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbfd8068b30 0x7fbfd810d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:18.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:18.079+0000 7fbfde9b9700 1 --2- 172.21.15.46:0/2449548075 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbfd81067a0 0x7fbfd8106b80 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:18.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:18.079+0000 7fbfde9b9700 1 --2- 172.21.15.46:0/2449548075 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbfd8068190 0x7fbfd80685f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:18.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:18.079+0000 7fbfde9b9700 1 -- 172.21.15.46:0/2449548075 >> 172.21.15.46:0/2449548075 conn(0x7fbfd8075790 msgr2=0x7fbfd8075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:18.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:18.079+0000 7fbfde9b9700 1 -- 172.21.15.46:0/2449548075 shutdown_connections 2023-10-19T12:42:18.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:18.080+0000 7fbfde9b9700 1 -- 172.21.15.46:0/2449548075 wait complete. 2023-10-19T12:42:18.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:18.081+0000 7fbfde9b9700 1 Processor -- start 2023-10-19T12:42:18.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:18.081+0000 7fbfde9b9700 1 -- start start 2023-10-19T12:42:18.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:18.082+0000 7fbfde9b9700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbfd8068190 0x7fbfd8107680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:18.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:18.082+0000 7fbfde9b9700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbfd8068b30 0x7fbfd8107bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:18.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:18.082+0000 7fbfde9b9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbfd81067a0 0x7fbfd8108100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:18.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:18.082+0000 7fbfde9b9700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd81a9520 con 0x7fbfd81067a0 2023-10-19T12:42:18.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:18.082+0000 7fbfde9b9700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd81a9660 con 0x7fbfd8068190 2023-10-19T12:42:18.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:18.082+0000 7fbfde9b9700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd81a97a0 con 0x7fbfd8068b30 2023-10-19T12:42:18.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:18.082+0000 7fbfd7fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbfd8068190 0x7fbfd8107680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:18.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:18.082+0000 7fbfd7fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbfd8068190 0x7fbfd8107680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:40606/0 (socket says 172.21.15.46:40606) 2023-10-19T12:42:18.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:18.082+0000 7fbfd7fff700 1 -- 172.21.15.46:0/2000140020 learned_addr learned my addr 172.21.15.46:0/2000140020 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:42:18.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:17 smithi157 ceph-mon[134109]: pgmap v313: 129 pgs: 129 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 596 B/s wr, 11 op/s 2023-10-19T12:42:18.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:18.082+0000 7fbfd77fe700 1 --2- 172.21.15.46:0/2000140020 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbfd8068b30 0x7fbfd8107bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:18.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:18.082+0000 7fbfdcf56700 1 --2- 172.21.15.46:0/2000140020 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbfd81067a0 0x7fbfd8108100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:18.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:18.083+0000 7fbfd7fff700 1 -- 172.21.15.46:0/2000140020 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbfd8068b30 msgr2=0x7fbfd8107bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:18.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:18.083+0000 7fbfd7fff700 1 --2- 172.21.15.46:0/2000140020 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbfd8068b30 0x7fbfd8107bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:18.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:18.083+0000 7fbfd7fff700 1 -- 172.21.15.46:0/2000140020 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbfd81067a0 msgr2=0x7fbfd8108100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:18.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:18.083+0000 7fbfd7fff700 1 --2- 172.21.15.46:0/2000140020 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbfd81067a0 0x7fbfd8108100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:18.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:18.083+0000 7fbfd7fff700 1 -- 172.21.15.46:0/2000140020 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfc80095f0 con 0x7fbfd8068190 2023-10-19T12:42:18.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:18.083+0000 7fbfd7fff700 1 --2- 172.21.15.46:0/2000140020 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbfd8068190 0x7fbfd8107680 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbfc8000c00 tx=0x7fbfc8005740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:18.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:18.084+0000 7fbfd57fa700 1 -- 172.21.15.46:0/2000140020 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc801d070 con 0x7fbfd8068190 2023-10-19T12:42:18.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:18.084+0000 7fbfd57fa700 1 -- 172.21.15.46:0/2000140020 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbfc8022470 con 0x7fbfd8068190 2023-10-19T12:42:18.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:18.084+0000 7fbfde9b9700 1 -- 172.21.15.46:0/2000140020 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfd81a9a20 con 0x7fbfd8068190 2023-10-19T12:42:18.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:18.084+0000 7fbfde9b9700 1 -- 172.21.15.46:0/2000140020 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfd81a9e30 con 0x7fbfd8068190 2023-10-19T12:42:18.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:18.084+0000 7fbfd57fa700 1 -- 172.21.15.46:0/2000140020 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc8017650 con 0x7fbfd8068190 2023-10-19T12:42:18.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:18.085+0000 7fbfde9b9700 1 -- 172.21.15.46:0/2000140020 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbfc4000fc0 con 0x7fbfd8068190 2023-10-19T12:42:18.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:18.088+0000 7fbfd57fa700 1 -- 172.21.15.46:0/2000140020 <== mon.2 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7fbfc800fb00 con 0x7fbfd8068190 2023-10-19T12:42:18.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:18.090+0000 7fbfd57fa700 1 --2- 172.21.15.46:0/2000140020 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fbfc00a16e0 0x7fbfc00a3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:18.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:18.091+0000 7fbfd57fa700 1 -- 172.21.15.46:0/2000140020 <== mon.2 v2:172.21.15.157:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fbfc80cebd0 con 0x7fbfd8068190 2023-10-19T12:42:18.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:18.091+0000 7fbfd57fa700 1 --2- 172.21.15.46:0/2000140020 >> [v2:172.21.15.46:6818/1842285555,v1:172.21.15.46:6819/1842285555] conn(0x7fbfc00ac260 0x7fbfc00ae6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:18.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:18.092+0000 7fbfd57fa700 1 -- 172.21.15.46:0/2000140020 --> [v2:172.21.15.46:6818/1842285555,v1:172.21.15.46:6819/1842285555] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbfc00aed70 con 0x7fbfc00ac260 2023-10-19T12:42:18.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:18.092+0000 7fbfd57fa700 1 -- 172.21.15.46:0/2000140020 <== mon.2 v2:172.21.15.157:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbfc80cef80 con 0x7fbfd8068190 2023-10-19T12:42:18.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:18.092+0000 7fbfd77fe700 1 --2- 172.21.15.46:0/2000140020 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fbfc00a16e0 0x7fbfc00a3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:18.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:18.092+0000 7fbfdcf56700 1 --2- 172.21.15.46:0/2000140020 >> [v2:172.21.15.46:6818/1842285555,v1:172.21.15.46:6819/1842285555] conn(0x7fbfc00ac260 0x7fbfc00ae6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:18.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:18.092+0000 7fbfd77fe700 1 --2- 172.21.15.46:0/2000140020 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fbfc00a16e0 0x7fbfc00a3ba0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fbfd8108db0 tx=0x7fbfcc009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:18.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:18.093+0000 7fbfdcf56700 1 --2- 172.21.15.46:0/2000140020 >> [v2:172.21.15.46:6818/1842285555,v1:172.21.15.46:6819/1842285555] conn(0x7fbfc00ac260 0x7fbfc00ae6a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:18.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:18.095+0000 7fbfd57fa700 1 -- 172.21.15.46:0/2000140020 <== osd.6 v2:172.21.15.46:6818/1842285555 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fbfc00aed70 con 0x7fbfc00ac260 2023-10-19T12:42:18.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:18.126+0000 7fbfde9b9700 1 -- 172.21.15.46:0/2000140020 --> [v2:172.21.15.46:6818/1842285555,v1:172.21.15.46:6819/1842285555] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbfc4002d40 con 0x7fbfc00ac260 2023-10-19T12:42:18.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:17 smithi195 ceph-mon[134493]: pgmap v313: 129 pgs: 129 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 596 B/s wr, 11 op/s 2023-10-19T12:42:18.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:18.127+0000 7fbfd57fa700 1 -- 172.21.15.46:0/2000140020 <== osd.6 v2:172.21.15.46:6818/1842285555 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fbfc4002d40 con 0x7fbfc00ac260 2023-10-19T12:42:18.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:18.130+0000 7fbfde9b9700 1 -- 172.21.15.46:0/2000140020 >> [v2:172.21.15.46:6818/1842285555,v1:172.21.15.46:6819/1842285555] conn(0x7fbfc00ac260 msgr2=0x7fbfc00ae6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:18.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:18.130+0000 7fbfde9b9700 1 --2- 172.21.15.46:0/2000140020 >> [v2:172.21.15.46:6818/1842285555,v1:172.21.15.46:6819/1842285555] conn(0x7fbfc00ac260 0x7fbfc00ae6a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:18.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:18.130+0000 7fbfde9b9700 1 -- 172.21.15.46:0/2000140020 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fbfc00a16e0 msgr2=0x7fbfc00a3ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:18.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:18.130+0000 7fbfde9b9700 1 --2- 172.21.15.46:0/2000140020 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fbfc00a16e0 0x7fbfc00a3ba0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fbfd8108db0 tx=0x7fbfcc009260 comp rx=0 tx=0).stop 2023-10-19T12:42:18.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:18.130+0000 7fbfde9b9700 1 -- 172.21.15.46:0/2000140020 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbfd8068190 msgr2=0x7fbfd8107680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:18.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:18.130+0000 7fbfde9b9700 1 --2- 172.21.15.46:0/2000140020 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbfd8068190 0x7fbfd8107680 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbfc8000c00 tx=0x7fbfc8005740 comp rx=0 tx=0).stop 2023-10-19T12:42:18.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:18.130+0000 7fbfdcf56700 1 -- 172.21.15.46:0/2000140020 reap_dead start 2023-10-19T12:42:18.135 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:18.130+0000 7fbfde9b9700 1 -- 172.21.15.46:0/2000140020 shutdown_connections 2023-10-19T12:42:18.135 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:18.130+0000 7fbfde9b9700 1 -- 172.21.15.46:0/2000140020 >> 172.21.15.46:0/2000140020 conn(0x7fbfd8075790 msgr2=0x7fbfd810bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:18.135 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:18.131+0000 7fbfde9b9700 1 -- 172.21.15.46:0/2000140020 shutdown_connections 2023-10-19T12:42:18.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:18.131+0000 7fbfde9b9700 1 -- 172.21.15.46:0/2000140020 wait complete. 2023-10-19T12:42:18.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:17.898+0000 7facbe573700 1 -- 172.21.15.46:0/934985413 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7facb8105730 msgr2=0x7facb81031c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:18.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:17.898+0000 7facbe573700 1 --2- 172.21.15.46:0/934985413 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7facb8105730 0x7facb81031c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7faca8009990 tx=0x7faca8009ca0 comp rx=0 tx=0).stop 2023-10-19T12:42:18.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:17.898+0000 7facbe573700 1 -- 172.21.15.46:0/934985413 shutdown_connections 2023-10-19T12:42:18.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:17.898+0000 7facbe573700 1 --2- 172.21.15.46:0/934985413 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7facb8068180 0x7facb8068600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:18.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:17.898+0000 7facbe573700 1 --2- 172.21.15.46:0/934985413 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7facb8105730 0x7facb81031c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:18.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:17.898+0000 7facbe573700 1 --2- 172.21.15.46:0/934985413 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7facb8103700 0x7facb8103b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:18.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:17.898+0000 7facbe573700 1 -- 172.21.15.46:0/934985413 >> 172.21.15.46:0/934985413 conn(0x7facb80767f0 msgr2=0x7facb8076c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:18.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:17.899+0000 7facbe573700 1 -- 172.21.15.46:0/934985413 shutdown_connections 2023-10-19T12:42:18.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:17.899+0000 7facbe573700 1 -- 172.21.15.46:0/934985413 wait complete. 2023-10-19T12:42:18.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:17.900+0000 7facbe573700 1 Processor -- start 2023-10-19T12:42:18.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:17.901+0000 7facbe573700 1 -- start start 2023-10-19T12:42:18.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:17.901+0000 7facbe573700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7facb8068180 0x7facb819d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:18.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:17.901+0000 7facbe573700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7facb8103700 0x7facb819d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:18.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:17.901+0000 7facbe573700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7facb8105730 0x7facb81a1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:18.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:17.901+0000 7facbe573700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb81a20c0 con 0x7facb8068180 2023-10-19T12:42:18.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:17.901+0000 7facbe573700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb81a2230 con 0x7facb8103700 2023-10-19T12:42:18.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:17.901+0000 7facbe573700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb81a23f0 con 0x7facb8105730 2023-10-19T12:42:18.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:17.902+0000 7facb77fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7facb8103700 0x7facb819d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:18.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:17.902+0000 7facb77fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7facb8103700 0x7facb819d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:40582/0 (socket says 172.21.15.46:40582) 2023-10-19T12:42:18.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:17.902+0000 7facb77fe700 1 -- 172.21.15.46:0/3659074361 learned_addr learned my addr 172.21.15.46:0/3659074361 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:42:18.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:17.902+0000 7facbcb10700 1 --2- 172.21.15.46:0/3659074361 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7facb8105730 0x7facb81a1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:18.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:17.902+0000 7facb7fff700 1 --2- 172.21.15.46:0/3659074361 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7facb8068180 0x7facb819d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:18.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:17.902+0000 7facb77fe700 1 -- 172.21.15.46:0/3659074361 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7facb8105730 msgr2=0x7facb81a1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:18.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:17.902+0000 7facb77fe700 1 --2- 172.21.15.46:0/3659074361 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7facb8105730 0x7facb81a1ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:18.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:17.902+0000 7facb77fe700 1 -- 172.21.15.46:0/3659074361 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7facb8068180 msgr2=0x7facb819d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:18.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:17.903+0000 7facb77fe700 1 --2- 172.21.15.46:0/3659074361 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7facb8068180 0x7facb819d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:18.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:17.903+0000 7facb77fe700 1 -- 172.21.15.46:0/3659074361 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facb0009c40 con 0x7facb8103700 2023-10-19T12:42:18.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:17.903+0000 7facb7fff700 1 --2- 172.21.15.46:0/3659074361 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7facb8068180 0x7facb819d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T12:42:18.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:17.903+0000 7facb77fe700 1 --2- 172.21.15.46:0/3659074361 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7facb8103700 0x7facb819d750 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7facac00e970 tx=0x7facac00ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:18.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:17.903+0000 7facb57fa700 1 -- 172.21.15.46:0/3659074361 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facac009790 con 0x7facb8103700 2023-10-19T12:42:18.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:17.903+0000 7facb57fa700 1 -- 172.21.15.46:0/3659074361 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7facac00eec0 con 0x7facb8103700 2023-10-19T12:42:18.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:17.903+0000 7facbe573700 1 -- 172.21.15.46:0/3659074361 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faca80095f0 con 0x7facb8103700 2023-10-19T12:42:18.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:17.903+0000 7facbe573700 1 -- 172.21.15.46:0/3659074361 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facb81a9d60 con 0x7facb8103700 2023-10-19T12:42:18.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:17.904+0000 7facb57fa700 1 -- 172.21.15.46:0/3659074361 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facac003cf0 con 0x7facb8103700 2023-10-19T12:42:18.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:17.904+0000 7facbe573700 1 -- 172.21.15.46:0/3659074361 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7facb8116fe0 con 0x7facb8103700 2023-10-19T12:42:18.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:17.907+0000 7facb57fa700 1 -- 172.21.15.46:0/3659074361 <== mon.2 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7facac00ccd0 con 0x7facb8103700 2023-10-19T12:42:18.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:17.909+0000 7facb57fa700 1 --2- 172.21.15.46:0/3659074361 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7faca00a15d0 0x7faca00a3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:18.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:17.909+0000 7facb57fa700 1 -- 172.21.15.46:0/3659074361 <== mon.2 v2:172.21.15.157:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7facac014070 con 0x7facb8103700 2023-10-19T12:42:18.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:17.910+0000 7facb7fff700 1 --2- 172.21.15.46:0/3659074361 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7faca00a15d0 0x7faca00a3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:18.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:17.910+0000 7facb57fa700 1 --2- 172.21.15.46:0/3659074361 >> [v2:172.21.15.46:6802/500237995,v1:172.21.15.46:6803/500237995] conn(0x7faca00ac150 0x7faca00ae590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:18.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:17.910+0000 7facb57fa700 1 -- 172.21.15.46:0/3659074361 --> [v2:172.21.15.46:6802/500237995,v1:172.21.15.46:6803/500237995] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7faca00aec60 con 0x7faca00ac150 2023-10-19T12:42:18.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:17.910+0000 7facb57fa700 1 -- 172.21.15.46:0/3659074361 <== mon.2 v2:172.21.15.157:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7facac0cd5c0 con 0x7facb8103700 2023-10-19T12:42:18.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:17.910+0000 7facbcb10700 1 --2- 172.21.15.46:0/3659074361 >> [v2:172.21.15.46:6802/500237995,v1:172.21.15.46:6803/500237995] conn(0x7faca00ac150 0x7faca00ae590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:18.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:17.911+0000 7facb7fff700 1 --2- 172.21.15.46:0/3659074361 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7faca00a15d0 0x7faca00a3a90 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7faca800b2e0 tx=0x7faca8005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:18.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:17.913+0000 7facbcb10700 1 --2- 172.21.15.46:0/3659074361 >> [v2:172.21.15.46:6802/500237995,v1:172.21.15.46:6803/500237995] conn(0x7faca00ac150 0x7faca00ae590 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:18.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:17.914+0000 7facb57fa700 1 -- 172.21.15.46:0/3659074361 <== osd.0 v2:172.21.15.46:6802/500237995 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7faca00aec60 con 0x7faca00ac150 2023-10-19T12:42:18.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:17.952+0000 7facbe573700 1 -- 172.21.15.46:0/3659074361 --> [v2:172.21.15.46:6802/500237995,v1:172.21.15.46:6803/500237995] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7facb80fde10 con 0x7faca00ac150 2023-10-19T12:42:18.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:17.953+0000 7facb57fa700 1 -- 172.21.15.46:0/3659074361 <== osd.0 v2:172.21.15.46:6802/500237995 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7facb80fde10 con 0x7faca00ac150 2023-10-19T12:42:18.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:17.954+0000 7facbe573700 1 -- 172.21.15.46:0/3659074361 >> [v2:172.21.15.46:6802/500237995,v1:172.21.15.46:6803/500237995] conn(0x7faca00ac150 msgr2=0x7faca00ae590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:18.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:17.954+0000 7facbe573700 1 --2- 172.21.15.46:0/3659074361 >> [v2:172.21.15.46:6802/500237995,v1:172.21.15.46:6803/500237995] conn(0x7faca00ac150 0x7faca00ae590 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:18.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:17.954+0000 7facbe573700 1 -- 172.21.15.46:0/3659074361 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7faca00a15d0 msgr2=0x7faca00a3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:18.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:17.954+0000 7facbe573700 1 --2- 172.21.15.46:0/3659074361 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7faca00a15d0 0x7faca00a3a90 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7faca800b2e0 tx=0x7faca8005fb0 comp rx=0 tx=0).stop 2023-10-19T12:42:18.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:17.954+0000 7facbe573700 1 -- 172.21.15.46:0/3659074361 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7facb8103700 msgr2=0x7facb819d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:18.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:17.954+0000 7facbe573700 1 --2- 172.21.15.46:0/3659074361 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7facb8103700 0x7facb819d750 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7facac00e970 tx=0x7facac00ec80 comp rx=0 tx=0).stop 2023-10-19T12:42:18.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:17.954+0000 7facbcb10700 1 -- 172.21.15.46:0/3659074361 reap_dead start 2023-10-19T12:42:18.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:17.960+0000 7facbe573700 1 -- 172.21.15.46:0/3659074361 shutdown_connections 2023-10-19T12:42:18.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:17.960+0000 7facbe573700 1 -- 172.21.15.46:0/3659074361 >> 172.21.15.46:0/3659074361 conn(0x7facb80767f0 msgr2=0x7facb80fd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:18.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:17.961+0000 7facbe573700 1 -- 172.21.15.46:0/3659074361 shutdown_connections 2023-10-19T12:42:18.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:17.961+0000 7facbe573700 1 -- 172.21.15.46:0/3659074361 wait complete. 2023-10-19T12:42:18.482 INFO:teuthology.orchestra.run.smithi046.stdout:253403070500 2023-10-19T12:42:18.612 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph osd last-stat-seq osd.8 2023-10-19T12:42:19.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.101+0000 7f63dea16700 1 -- 172.21.15.46:0/1634436148 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f63d8101260 msgr2=0x7f63d810d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:19.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.101+0000 7f63dea16700 1 --2- 172.21.15.46:0/1634436148 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f63d8101260 0x7f63d810d650 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f63d000b0a0 tx=0x7f63d000b3b0 comp rx=0 tx=0).stop 2023-10-19T12:42:19.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.101+0000 7f63dea16700 1 -- 172.21.15.46:0/1634436148 shutdown_connections 2023-10-19T12:42:19.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.101+0000 7f63dea16700 1 --2- 172.21.15.46:0/1634436148 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f63d8101260 0x7f63d810d650 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:19.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.101+0000 7f63dea16700 1 --2- 172.21.15.46:0/1634436148 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f63d81057c0 0x7f63d8105ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:19.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.101+0000 7f63dea16700 1 --2- 172.21.15.46:0/1634436148 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f63d81008a0 0x7f63d8100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:19.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.101+0000 7f63dea16700 1 -- 172.21.15.46:0/1634436148 >> 172.21.15.46:0/1634436148 conn(0x7f63d80779e0 msgr2=0x7f63d8077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:19.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.101+0000 7f63dea16700 1 -- 172.21.15.46:0/1634436148 shutdown_connections 2023-10-19T12:42:19.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.101+0000 7f63dea16700 1 -- 172.21.15.46:0/1634436148 wait complete. 2023-10-19T12:42:19.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.103+0000 7f63dea16700 1 Processor -- start 2023-10-19T12:42:19.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.103+0000 7f63dea16700 1 -- start start 2023-10-19T12:42:19.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.104+0000 7f63dea16700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f63d81008a0 0x7f63d819c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:19.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.104+0000 7f63dea16700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f63d8101260 0x7f63d819cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:19.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.104+0000 7f63dea16700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f63d81057c0 0x7f63d8196b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:19.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.104+0000 7f63dea16700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63d81971d0 con 0x7f63d81057c0 2023-10-19T12:42:19.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.104+0000 7f63dea16700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63d8197340 con 0x7f63d8101260 2023-10-19T12:42:19.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.104+0000 7f63dea16700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63d8197500 con 0x7f63d81008a0 2023-10-19T12:42:19.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.104+0000 7f63d77fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f63d8101260 0x7f63d819cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:19.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.104+0000 7f63d7fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f63d81008a0 0x7f63d819c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:19.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.104+0000 7f63d77fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f63d8101260 0x7f63d819cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:40630/0 (socket says 172.21.15.46:40630) 2023-10-19T12:42:19.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.104+0000 7f63d77fe700 1 -- 172.21.15.46:0/3662615761 learned_addr learned my addr 172.21.15.46:0/3662615761 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:42:19.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.104+0000 7f63dcfb3700 1 --2- 172.21.15.46:0/3662615761 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f63d81057c0 0x7f63d8196b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:19.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.105+0000 7f63d77fe700 1 -- 172.21.15.46:0/3662615761 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f63d81008a0 msgr2=0x7f63d819c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:19.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.105+0000 7f63d77fe700 1 --2- 172.21.15.46:0/3662615761 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f63d81008a0 0x7f63d819c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:19.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.105+0000 7f63d77fe700 1 -- 172.21.15.46:0/3662615761 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f63d81057c0 msgr2=0x7f63d8196b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:19.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.105+0000 7f63d77fe700 1 --2- 172.21.15.46:0/3662615761 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f63d81057c0 0x7f63d8196b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:19.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.105+0000 7f63d77fe700 1 -- 172.21.15.46:0/3662615761 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63d0009d00 con 0x7f63d8101260 2023-10-19T12:42:19.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.105+0000 7f63dcfb3700 1 --2- 172.21.15.46:0/3662615761 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f63d81057c0 0x7f63d8196b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T12:42:19.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.105+0000 7f63d77fe700 1 --2- 172.21.15.46:0/3662615761 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f63d8101260 0x7f63d819cf20 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f63cc00e9a0 tx=0x7f63cc00ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:19.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.105+0000 7f63d57fa700 1 -- 172.21.15.46:0/3662615761 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63cc009790 con 0x7f63d8101260 2023-10-19T12:42:19.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.105+0000 7f63d57fa700 1 -- 172.21.15.46:0/3662615761 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f63cc00cbd0 con 0x7f63d8101260 2023-10-19T12:42:19.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.105+0000 7f63d57fa700 1 -- 172.21.15.46:0/3662615761 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63cc018680 con 0x7f63d8101260 2023-10-19T12:42:19.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.106+0000 7f63dea16700 1 -- 172.21.15.46:0/3662615761 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63d81977e0 con 0x7f63d8101260 2023-10-19T12:42:19.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.106+0000 7f63dea16700 1 -- 172.21.15.46:0/3662615761 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63d8072bf0 con 0x7f63d8101260 2023-10-19T12:42:19.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.107+0000 7f63dea16700 1 -- 172.21.15.46:0/3662615761 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f63d81109f0 con 0x7f63d8101260 2023-10-19T12:42:19.114 INFO:teuthology.orchestra.run.smithi046.stdout:197568495662 2023-10-19T12:42:19.114 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph osd last-stat-seq osd.6 2023-10-19T12:42:19.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.109+0000 7f63d57fa700 1 -- 172.21.15.46:0/3662615761 <== mon.2 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f63cc00cd40 con 0x7f63d8101260 2023-10-19T12:42:19.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.110+0000 7f63d57fa700 1 --2- 172.21.15.46:0/3662615761 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f63c00a1590 0x7f63c00a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:19.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.111+0000 7f63d57fa700 1 -- 172.21.15.46:0/3662615761 <== mon.2 v2:172.21.15.157:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f63cc014070 con 0x7f63d8101260 2023-10-19T12:42:19.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.111+0000 7f63d7fff700 1 --2- 172.21.15.46:0/3662615761 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f63c00a1590 0x7f63c00a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:19.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.111+0000 7f63d57fa700 1 --2- 172.21.15.46:0/3662615761 >> [v2:172.21.15.157:6816/3498672588,v1:172.21.15.157:6817/3498672588] conn(0x7f63c00ac110 0x7f63c00ae550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:19.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.111+0000 7f63d57fa700 1 -- 172.21.15.46:0/3662615761 --> [v2:172.21.15.157:6816/3498672588,v1:172.21.15.157:6817/3498672588] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f63c00aec20 con 0x7f63c00ac110 2023-10-19T12:42:19.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.111+0000 7f63d57fa700 1 -- 172.21.15.46:0/3662615761 <== mon.2 v2:172.21.15.157:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7f63cc0cf740 con 0x7f63d8101260 2023-10-19T12:42:19.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.111+0000 7f63dcfb3700 1 --2- 172.21.15.46:0/3662615761 >> [v2:172.21.15.157:6816/3498672588,v1:172.21.15.157:6817/3498672588] conn(0x7f63c00ac110 0x7f63c00ae550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:19.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.111+0000 7f63d7fff700 1 --2- 172.21.15.46:0/3662615761 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f63c00a1590 0x7f63c00a3a50 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f63d8101930 tx=0x7f63c8009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:19.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.112+0000 7f63dcfb3700 1 --2- 172.21.15.46:0/3662615761 >> [v2:172.21.15.157:6816/3498672588,v1:172.21.15.157:6817/3498672588] conn(0x7f63c00ac110 0x7f63c00ae550 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:19.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.113+0000 7f63d57fa700 1 -- 172.21.15.46:0/3662615761 <== osd.7 v2:172.21.15.157:6816/3498672588 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f63c00aec20 con 0x7f63c00ac110 2023-10-19T12:42:19.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.133+0000 7f63dea16700 1 -- 172.21.15.46:0/3662615761 --> [v2:172.21.15.157:6816/3498672588,v1:172.21.15.157:6817/3498672588] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f63d8060ef0 con 0x7f63c00ac110 2023-10-19T12:42:19.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.134+0000 7f63d57fa700 1 -- 172.21.15.46:0/3662615761 <== osd.7 v2:172.21.15.157:6816/3498672588 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f63d8060ef0 con 0x7f63c00ac110 2023-10-19T12:42:19.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.135+0000 7f63dea16700 1 -- 172.21.15.46:0/3662615761 >> [v2:172.21.15.157:6816/3498672588,v1:172.21.15.157:6817/3498672588] conn(0x7f63c00ac110 msgr2=0x7f63c00ae550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:19.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.135+0000 7f63dea16700 1 --2- 172.21.15.46:0/3662615761 >> [v2:172.21.15.157:6816/3498672588,v1:172.21.15.157:6817/3498672588] conn(0x7f63c00ac110 0x7f63c00ae550 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:19.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.135+0000 7f63dea16700 1 -- 172.21.15.46:0/3662615761 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f63c00a1590 msgr2=0x7f63c00a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:19.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.135+0000 7f63dea16700 1 --2- 172.21.15.46:0/3662615761 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f63c00a1590 0x7f63c00a3a50 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f63d8101930 tx=0x7f63c8009260 comp rx=0 tx=0).stop 2023-10-19T12:42:19.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.135+0000 7f63dea16700 1 -- 172.21.15.46:0/3662615761 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f63d8101260 msgr2=0x7f63d819cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:19.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.135+0000 7f63dea16700 1 --2- 172.21.15.46:0/3662615761 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f63d8101260 0x7f63d819cf20 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f63cc00e9a0 tx=0x7f63cc00ecb0 comp rx=0 tx=0).stop 2023-10-19T12:42:19.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.135+0000 7f63dcfb3700 1 -- 172.21.15.46:0/3662615761 reap_dead start 2023-10-19T12:42:19.140 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.136+0000 7f63dea16700 1 -- 172.21.15.46:0/3662615761 shutdown_connections 2023-10-19T12:42:19.140 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.136+0000 7f63dea16700 1 -- 172.21.15.46:0/3662615761 >> 172.21.15.46:0/3662615761 conn(0x7f63d80779e0 msgr2=0x7f63d80fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:19.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.136+0000 7f63dea16700 1 -- 172.21.15.46:0/3662615761 shutdown_connections 2023-10-19T12:42:19.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.136+0000 7f63dea16700 1 -- 172.21.15.46:0/3662615761 wait complete. 2023-10-19T12:42:19.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:19 smithi046 ceph-mon[98509]: pgmap v314: 129 pgs: 129 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 255 B/s wr, 9 op/s 2023-10-19T12:42:19.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:19 smithi157 ceph-mon[134109]: pgmap v314: 129 pgs: 129 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 255 B/s wr, 9 op/s 2023-10-19T12:42:19.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:19 smithi195 ceph-mon[134493]: pgmap v314: 129 pgs: 129 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 255 B/s wr, 9 op/s 2023-10-19T12:42:19.755 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.682+0000 7ff309ada700 1 -- 172.21.15.46:0/1211151303 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff304101260 msgr2=0x7ff30410d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:19.755 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.682+0000 7ff309ada700 1 --2- 172.21.15.46:0/1211151303 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff304101260 0x7ff30410d650 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc00b0a0 tx=0x7ff2fc00b3b0 comp rx=0 tx=0).stop 2023-10-19T12:42:19.756 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.682+0000 7ff309ada700 1 -- 172.21.15.46:0/1211151303 shutdown_connections 2023-10-19T12:42:19.756 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.682+0000 7ff309ada700 1 --2- 172.21.15.46:0/1211151303 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff304101260 0x7ff30410d650 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:19.756 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.682+0000 7ff309ada700 1 --2- 172.21.15.46:0/1211151303 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3041057c0 0x7ff304105ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:19.756 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.682+0000 7ff309ada700 1 --2- 172.21.15.46:0/1211151303 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff3041008a0 0x7ff304100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:19.756 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.682+0000 7ff309ada700 1 -- 172.21.15.46:0/1211151303 >> 172.21.15.46:0/1211151303 conn(0x7ff3040779e0 msgr2=0x7ff304077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:19.756 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.682+0000 7ff309ada700 1 -- 172.21.15.46:0/1211151303 shutdown_connections 2023-10-19T12:42:19.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.682+0000 7ff309ada700 1 -- 172.21.15.46:0/1211151303 wait complete. 2023-10-19T12:42:19.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.683+0000 7ff309ada700 1 Processor -- start 2023-10-19T12:42:19.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.683+0000 7ff309ada700 1 -- start start 2023-10-19T12:42:19.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.684+0000 7ff309ada700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff3041008a0 0x7ff304198f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:19.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.684+0000 7ff309ada700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff304101260 0x7ff304199450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:19.758 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.684+0000 7ff309ada700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3041057c0 0x7ff30419d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:19.758 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.684+0000 7ff309ada700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff30419de10 con 0x7ff3041008a0 2023-10-19T12:42:19.758 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.684+0000 7ff309ada700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff30419df80 con 0x7ff304101260 2023-10-19T12:42:19.759 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.684+0000 7ff309ada700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff30419e140 con 0x7ff3041057c0 2023-10-19T12:42:19.759 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.684+0000 7ff3037fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff3041008a0 0x7ff304198f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:19.759 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.684+0000 7ff3037fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff3041008a0 0x7ff304198f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59010/0 (socket says 172.21.15.46:59010) 2023-10-19T12:42:19.759 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.684+0000 7ff3037fe700 1 -- 172.21.15.46:0/4191404475 learned_addr learned my addr 172.21.15.46:0/4191404475 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:42:19.759 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.684+0000 7ff303fff700 1 --2- 172.21.15.46:0/4191404475 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3041057c0 0x7ff30419d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:19.760 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.684+0000 7ff302ffd700 1 --2- 172.21.15.46:0/4191404475 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff304101260 0x7ff304199450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:19.760 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.684+0000 7ff3037fe700 1 -- 172.21.15.46:0/4191404475 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3041057c0 msgr2=0x7ff30419d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:19.760 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.684+0000 7ff3037fe700 1 --2- 172.21.15.46:0/4191404475 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3041057c0 0x7ff30419d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:19.760 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.684+0000 7ff3037fe700 1 -- 172.21.15.46:0/4191404475 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff304101260 msgr2=0x7ff304199450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:19.760 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.684+0000 7ff3037fe700 1 --2- 172.21.15.46:0/4191404475 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff304101260 0x7ff304199450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:19.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.684+0000 7ff3037fe700 1 -- 172.21.15.46:0/4191404475 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2fc009d00 con 0x7ff3041008a0 2023-10-19T12:42:19.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.684+0000 7ff302ffd700 1 --2- 172.21.15.46:0/4191404475 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff304101260 0x7ff304199450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T12:42:19.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.685+0000 7ff3037fe700 1 --2- 172.21.15.46:0/4191404475 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff3041008a0 0x7ff304198f10 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7ff2f400d980 tx=0x7ff2f400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:19.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.685+0000 7ff300ff9700 1 -- 172.21.15.46:0/4191404475 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2f400b950 con 0x7ff3041008a0 2023-10-19T12:42:19.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.685+0000 7ff300ff9700 1 -- 172.21.15.46:0/4191404475 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff2f4007620 con 0x7ff3041008a0 2023-10-19T12:42:19.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.685+0000 7ff300ff9700 1 -- 172.21.15.46:0/4191404475 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2f400f3c0 con 0x7ff3041008a0 2023-10-19T12:42:19.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.685+0000 7ff309ada700 1 -- 172.21.15.46:0/4191404475 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff30419e420 con 0x7ff3041008a0 2023-10-19T12:42:19.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.685+0000 7ff309ada700 1 -- 172.21.15.46:0/4191404475 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3041a5c80 con 0x7ff3041008a0 2023-10-19T12:42:19.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.686+0000 7ff309ada700 1 -- 172.21.15.46:0/4191404475 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff304110a40 con 0x7ff3041008a0 2023-10-19T12:42:19.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.689+0000 7ff300ff9700 1 -- 172.21.15.46:0/4191404475 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7ff2f4010640 con 0x7ff3041008a0 2023-10-19T12:42:19.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.690+0000 7ff300ff9700 1 --2- 172.21.15.46:0/4191404475 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7ff2ec0a1590 0x7ff2ec0a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:19.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.690+0000 7ff300ff9700 1 -- 172.21.15.46:0/4191404475 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7ff2f40cd790 con 0x7ff3041008a0 2023-10-19T12:42:19.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.691+0000 7ff302ffd700 1 --2- 172.21.15.46:0/4191404475 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7ff2ec0a1590 0x7ff2ec0a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:19.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.691+0000 7ff300ff9700 1 --2- 172.21.15.46:0/4191404475 >> [v2:172.21.15.46:6826/3472581046,v1:172.21.15.46:6827/3472581046] conn(0x7ff2ec0ac090 0x7ff2ec0ae4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:19.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.691+0000 7ff300ff9700 1 -- 172.21.15.46:0/4191404475 --> [v2:172.21.15.46:6826/3472581046,v1:172.21.15.46:6827/3472581046] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff2ec0aeba0 con 0x7ff2ec0ac090 2023-10-19T12:42:19.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.691+0000 7ff300ff9700 1 -- 172.21.15.46:0/4191404475 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff2f40cdb00 con 0x7ff3041008a0 2023-10-19T12:42:19.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.691+0000 7ff303fff700 1 --2- 172.21.15.46:0/4191404475 >> [v2:172.21.15.46:6826/3472581046,v1:172.21.15.46:6827/3472581046] conn(0x7ff2ec0ac090 0x7ff2ec0ae4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:19.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.691+0000 7ff302ffd700 1 --2- 172.21.15.46:0/4191404475 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7ff2ec0a1590 0x7ff2ec0a3a50 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff30419a470 tx=0x7ff2f8009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:19.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.692+0000 7ff303fff700 1 --2- 172.21.15.46:0/4191404475 >> [v2:172.21.15.46:6826/3472581046,v1:172.21.15.46:6827/3472581046] conn(0x7ff2ec0ac090 0x7ff2ec0ae4d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:19.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.692+0000 7ff300ff9700 1 -- 172.21.15.46:0/4191404475 <== osd.9 v2:172.21.15.46:6826/3472581046 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7ff2ec0aeba0 con 0x7ff2ec0ac090 2023-10-19T12:42:19.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.710+0000 7ff309ada700 1 -- 172.21.15.46:0/4191404475 --> [v2:172.21.15.46:6826/3472581046,v1:172.21.15.46:6827/3472581046] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff304101f30 con 0x7ff2ec0ac090 2023-10-19T12:42:19.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.710+0000 7ff300ff9700 1 -- 172.21.15.46:0/4191404475 <== osd.9 v2:172.21.15.46:6826/3472581046 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7ff304101f30 con 0x7ff2ec0ac090 2023-10-19T12:42:19.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.711+0000 7ff309ada700 1 -- 172.21.15.46:0/4191404475 >> [v2:172.21.15.46:6826/3472581046,v1:172.21.15.46:6827/3472581046] conn(0x7ff2ec0ac090 msgr2=0x7ff2ec0ae4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:19.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.711+0000 7ff309ada700 1 --2- 172.21.15.46:0/4191404475 >> [v2:172.21.15.46:6826/3472581046,v1:172.21.15.46:6827/3472581046] conn(0x7ff2ec0ac090 0x7ff2ec0ae4d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:19.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.711+0000 7ff309ada700 1 -- 172.21.15.46:0/4191404475 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7ff2ec0a1590 msgr2=0x7ff2ec0a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:19.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.711+0000 7ff309ada700 1 --2- 172.21.15.46:0/4191404475 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7ff2ec0a1590 0x7ff2ec0a3a50 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff30419a470 tx=0x7ff2f8009260 comp rx=0 tx=0).stop 2023-10-19T12:42:19.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.711+0000 7ff309ada700 1 -- 172.21.15.46:0/4191404475 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff3041008a0 msgr2=0x7ff304198f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:19.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.711+0000 7ff309ada700 1 --2- 172.21.15.46:0/4191404475 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff3041008a0 0x7ff304198f10 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7ff2f400d980 tx=0x7ff2f400dc90 comp rx=0 tx=0).stop 2023-10-19T12:42:19.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.711+0000 7ff303fff700 1 -- 172.21.15.46:0/4191404475 reap_dead start 2023-10-19T12:42:19.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.711+0000 7ff309ada700 1 -- 172.21.15.46:0/4191404475 shutdown_connections 2023-10-19T12:42:19.767 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.711+0000 7ff309ada700 1 -- 172.21.15.46:0/4191404475 >> 172.21.15.46:0/4191404475 conn(0x7ff3040779e0 msgr2=0x7ff30410ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:19.767 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.711+0000 7ff309ada700 1 -- 172.21.15.46:0/4191404475 shutdown_connections 2023-10-19T12:42:19.767 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:19.711+0000 7ff309ada700 1 -- 172.21.15.46:0/4191404475 wait complete. 2023-10-19T12:42:19.925 INFO:teuthology.orchestra.run.smithi046.stdout:34359738442 2023-10-19T12:42:19.926 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph osd last-stat-seq osd.0 2023-10-19T12:42:19.981 INFO:teuthology.orchestra.run.smithi046.stdout:219043332138 2023-10-19T12:42:19.981 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph osd last-stat-seq osd.7 2023-10-19T12:42:20.304 INFO:teuthology.orchestra.run.smithi046.stdout:287762808865 2023-10-19T12:42:20.304 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph osd last-stat-seq osd.9 2023-10-19T12:42:20.436 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-19T12:42:20.516 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-19T12:42:20.576 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-19T12:42:20.777 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-19T12:42:20.778 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-19T12:42:20.780 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-19T12:42:20.782 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-19T12:42:20.907 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-19T12:42:21.380 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-19T12:42:21.490 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-19T12:42:21.814 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:21 smithi046 ceph-mon[98509]: pgmap v315: 129 pgs: 129 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 255 B/s wr, 9 op/s 2023-10-19T12:42:21.814 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:21 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:42:22.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:21 smithi157 ceph-mon[134109]: pgmap v315: 129 pgs: 129 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 255 B/s wr, 9 op/s 2023-10-19T12:42:22.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:21 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:42:22.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:21 smithi195 ceph-mon[134493]: pgmap v315: 129 pgs: 129 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 255 B/s wr, 9 op/s 2023-10-19T12:42:22.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:21 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:42:22.347 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-19T12:42:23.926 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:23 smithi046 ceph-mon[98509]: pgmap v316: 129 pgs: 129 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 255 B/s wr, 11 op/s 2023-10-19T12:42:24.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:23 smithi157 ceph-mon[134109]: pgmap v316: 129 pgs: 129 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 255 B/s wr, 11 op/s 2023-10-19T12:42:24.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:23 smithi195 ceph-mon[134493]: pgmap v316: 129 pgs: 129 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 255 B/s wr, 11 op/s 2023-10-19T12:42:25.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.034+0000 7f0a81619700 1 -- 172.21.15.46:0/1285928222 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0a7c1067a0 msgr2=0x7f0a7c106b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:25.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.034+0000 7f0a81619700 1 --2- 172.21.15.46:0/1285928222 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0a7c1067a0 0x7f0a7c106b80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c0098f0 tx=0x7f0a6c009c00 comp rx=0 tx=0).stop 2023-10-19T12:42:25.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.034+0000 7f0a81619700 1 -- 172.21.15.46:0/1285928222 shutdown_connections 2023-10-19T12:42:25.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.034+0000 7f0a81619700 1 --2- 172.21.15.46:0/1285928222 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a7c068b30 0x7f0a7c10d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:25.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.034+0000 7f0a81619700 1 --2- 172.21.15.46:0/1285928222 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0a7c1067a0 0x7f0a7c106b80 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:25.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.034+0000 7f0a81619700 1 --2- 172.21.15.46:0/1285928222 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a7c068190 0x7f0a7c0685f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:25.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.034+0000 7f0a81619700 1 -- 172.21.15.46:0/1285928222 >> 172.21.15.46:0/1285928222 conn(0x7f0a7c075790 msgr2=0x7f0a7c075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:25.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.035+0000 7f0a81619700 1 -- 172.21.15.46:0/1285928222 shutdown_connections 2023-10-19T12:42:25.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.035+0000 7f0a81619700 1 -- 172.21.15.46:0/1285928222 wait complete. 2023-10-19T12:42:25.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.036+0000 7f0a81619700 1 Processor -- start 2023-10-19T12:42:25.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.037+0000 7f0a81619700 1 -- start start 2023-10-19T12:42:25.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.037+0000 7f0a81619700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0a7c068190 0x7f0a7c199740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:25.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.037+0000 7f0a81619700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a7c068b30 0x7f0a7c199c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:25.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.037+0000 7f0a81619700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a7c1067a0 0x7f0a7c10c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:25.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.038+0000 7f0a81619700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a7c10ced0 con 0x7f0a7c1067a0 2023-10-19T12:42:25.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.038+0000 7f0a81619700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a7c10d040 con 0x7f0a7c068b30 2023-10-19T12:42:25.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.038+0000 7f0a7affd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0a7c068190 0x7f0a7c199740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:25.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.038+0000 7f0a81619700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a7c10d200 con 0x7f0a7c068190 2023-10-19T12:42:25.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.038+0000 7f0a7a7fc700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a7c068b30 0x7f0a7c199c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:25.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.038+0000 7f0a7affd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0a7c068190 0x7f0a7c199740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:58054/0 (socket says 172.21.15.46:58054) 2023-10-19T12:42:25.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.038+0000 7f0a7affd700 1 -- 172.21.15.46:0/2083841434 learned_addr learned my addr 172.21.15.46:0/2083841434 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:42:25.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.038+0000 7f0a7b7fe700 1 --2- 172.21.15.46:0/2083841434 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a7c1067a0 0x7f0a7c10c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:25.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.039+0000 7f0a7b7fe700 1 -- 172.21.15.46:0/2083841434 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0a7c068190 msgr2=0x7f0a7c199740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:25.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.039+0000 7f0a7b7fe700 1 --2- 172.21.15.46:0/2083841434 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0a7c068190 0x7f0a7c199740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:25.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.039+0000 7f0a7b7fe700 1 -- 172.21.15.46:0/2083841434 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a7c068b30 msgr2=0x7f0a7c199c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:25.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.039+0000 7f0a7b7fe700 1 --2- 172.21.15.46:0/2083841434 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a7c068b30 0x7f0a7c199c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:25.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.039+0000 7f0a7b7fe700 1 -- 172.21.15.46:0/2083841434 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a6c009520 con 0x7f0a7c1067a0 2023-10-19T12:42:25.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.039+0000 7f0a7affd700 1 --2- 172.21.15.46:0/2083841434 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0a7c068190 0x7f0a7c199740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T12:42:25.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.039+0000 7f0a7b7fe700 1 --2- 172.21.15.46:0/2083841434 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a7c1067a0 0x7f0a7c10c750 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f0a7400efc0 tx=0x7f0a7400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:25.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.039+0000 7f0a63fff700 1 -- 172.21.15.46:0/2083841434 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a74018070 con 0x7f0a7c1067a0 2023-10-19T12:42:25.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.039+0000 7f0a81619700 1 -- 172.21.15.46:0/2083841434 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a7c10d480 con 0x7f0a7c1067a0 2023-10-19T12:42:25.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.039+0000 7f0a81619700 1 -- 172.21.15.46:0/2083841434 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a7c19d740 con 0x7f0a7c1067a0 2023-10-19T12:42:25.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.039+0000 7f0a63fff700 1 -- 172.21.15.46:0/2083841434 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0a7400f040 con 0x7f0a7c1067a0 2023-10-19T12:42:25.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.039+0000 7f0a63fff700 1 -- 172.21.15.46:0/2083841434 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a7400cc70 con 0x7f0a7c1067a0 2023-10-19T12:42:25.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.042+0000 7f0a81619700 1 -- 172.21.15.46:0/2083841434 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a680052f0 con 0x7f0a7c1067a0 2023-10-19T12:42:25.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.043+0000 7f0a63fff700 1 -- 172.21.15.46:0/2083841434 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f0a74004ad0 con 0x7f0a7c1067a0 2023-10-19T12:42:25.049 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.046+0000 7f0a63fff700 1 --2- 172.21.15.46:0/2083841434 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f0a640a1590 0x7f0a640a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:25.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.046+0000 7f0a63fff700 1 -- 172.21.15.46:0/2083841434 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f0a740ccb30 con 0x7f0a7c1067a0 2023-10-19T12:42:25.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.046+0000 7f0a7affd700 1 --2- 172.21.15.46:0/2083841434 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f0a640a1590 0x7f0a640a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:25.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.047+0000 7f0a7affd700 1 --2- 172.21.15.46:0/2083841434 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f0a640a1590 0x7f0a640a3a50 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c005e90 tx=0x7f0a6c019040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:25.055 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.052+0000 7f0a63fff700 1 -- 172.21.15.46:0/2083841434 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0a74095e70 con 0x7f0a7c1067a0 2023-10-19T12:42:25.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.292+0000 7f0a81619700 1 -- 172.21.15.46:0/2083841434 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) v1 -- 0x7f0a68005160 con 0x7f0a7c1067a0 2023-10-19T12:42:25.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.292+0000 7f0a63fff700 1 -- 172.21.15.46:0/2083841434 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0a74099490 con 0x7f0a7c1067a0 2023-10-19T12:42:25.296 INFO:teuthology.orchestra.run.smithi046.stdout:253403070501 2023-10-19T12:42:25.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.295+0000 7f0a81619700 1 -- 172.21.15.46:0/2083841434 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f0a640a1590 msgr2=0x7f0a640a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:25.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.295+0000 7f0a81619700 1 --2- 172.21.15.46:0/2083841434 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f0a640a1590 0x7f0a640a3a50 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c005e90 tx=0x7f0a6c019040 comp rx=0 tx=0).stop 2023-10-19T12:42:25.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.295+0000 7f0a81619700 1 -- 172.21.15.46:0/2083841434 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a7c1067a0 msgr2=0x7f0a7c10c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:25.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.295+0000 7f0a81619700 1 --2- 172.21.15.46:0/2083841434 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a7c1067a0 0x7f0a7c10c750 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f0a7400efc0 tx=0x7f0a7400c3a0 comp rx=0 tx=0).stop 2023-10-19T12:42:25.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.295+0000 7f0a81619700 1 -- 172.21.15.46:0/2083841434 shutdown_connections 2023-10-19T12:42:25.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.295+0000 7f0a81619700 1 --2- 172.21.15.46:0/2083841434 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a7c1067a0 0x7f0a7c10c750 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:25.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.295+0000 7f0a81619700 1 --2- 172.21.15.46:0/2083841434 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f0a640a1590 0x7f0a640a3a50 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:25.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.295+0000 7f0a81619700 1 --2- 172.21.15.46:0/2083841434 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0a7c068190 0x7f0a7c199740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:25.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.295+0000 7f0a81619700 1 --2- 172.21.15.46:0/2083841434 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0a7c068b30 0x7f0a7c199c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:25.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.295+0000 7f0a81619700 1 -- 172.21.15.46:0/2083841434 >> 172.21.15.46:0/2083841434 conn(0x7f0a7c075790 msgr2=0x7f0a7c103cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:25.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.295+0000 7f0a81619700 1 -- 172.21.15.46:0/2083841434 shutdown_connections 2023-10-19T12:42:25.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.295+0000 7f0a81619700 1 -- 172.21.15.46:0/2083841434 wait complete. 2023-10-19T12:42:25.321 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:25 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:42:25.321 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:25 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:42:25.322 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:25 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:42:25.322 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:25 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:42:25.322 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:25 smithi046 ceph-mon[98509]: pgmap v317: 129 pgs: 129 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 8 op/s 2023-10-19T12:42:25.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:25 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:42:25.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:25 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:42:25.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:25 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:42:25.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:25 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:42:25.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:25 smithi195 ceph-mon[134493]: pgmap v317: 129 pgs: 129 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 8 op/s 2023-10-19T12:42:25.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:25 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:42:25.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:25 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:42:25.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:25 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:42:25.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:25 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:42:25.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:25 smithi157 ceph-mon[134109]: pgmap v317: 129 pgs: 129 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 8 op/s 2023-10-19T12:42:25.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.348+0000 7f15b1255700 1 -- 172.21.15.46:0/3984760627 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15ac072a20 msgr2=0x7f15ac072e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:25.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.348+0000 7f15b1255700 1 --2- 172.21.15.46:0/3984760627 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15ac072a20 0x7f15ac072e00 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f159c009990 tx=0x7f159c009ca0 comp rx=0 tx=0).stop 2023-10-19T12:42:25.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.348+0000 7f15b1255700 1 -- 172.21.15.46:0/3984760627 shutdown_connections 2023-10-19T12:42:25.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.348+0000 7f15b1255700 1 --2- 172.21.15.46:0/3984760627 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f15ac10d250 0x7f15ac10f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:25.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.348+0000 7f15b1255700 1 --2- 172.21.15.46:0/3984760627 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15ac072a20 0x7f15ac072e00 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:25.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.348+0000 7f15b1255700 1 --2- 172.21.15.46:0/3984760627 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f15ac073340 0x7f15ac10cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:25.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.348+0000 7f15b1255700 1 -- 172.21.15.46:0/3984760627 >> 172.21.15.46:0/3984760627 conn(0x7f15ac0779e0 msgr2=0x7f15ac077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:25.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.348+0000 7f15b1255700 1 -- 172.21.15.46:0/3984760627 shutdown_connections 2023-10-19T12:42:25.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.349+0000 7f15b1255700 1 -- 172.21.15.46:0/3984760627 wait complete. 2023-10-19T12:42:25.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.350+0000 7f15b1255700 1 Processor -- start 2023-10-19T12:42:25.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.350+0000 7f15b1255700 1 -- start start 2023-10-19T12:42:25.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.351+0000 7f15b1255700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15ac072a20 0x7f15ac198e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:25.985 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.351+0000 7f15b1255700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f15ac073340 0x7f15ac1993d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:25.985 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.351+0000 7f15b1255700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f15ac10d250 0x7f15ac19d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:25.985 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.351+0000 7f15b1255700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ac19dd90 con 0x7f15ac072a20 2023-10-19T12:42:25.985 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.351+0000 7f15b1255700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ac19df00 con 0x7f15ac10d250 2023-10-19T12:42:25.985 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.351+0000 7f15b1255700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ac19e0c0 con 0x7f15ac073340 2023-10-19T12:42:25.985 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.351+0000 7f15aad9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15ac072a20 0x7f15ac198e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:25.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.351+0000 7f15aad9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15ac072a20 0x7f15ac198e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45568/0 (socket says 172.21.15.46:45568) 2023-10-19T12:42:25.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.351+0000 7f15aa59c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f15ac073340 0x7f15ac1993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:25.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.351+0000 7f15ab59e700 1 --2- 172.21.15.46:0/263623118 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f15ac10d250 0x7f15ac19d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:25.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.351+0000 7f15aad9d700 1 -- 172.21.15.46:0/263623118 learned_addr learned my addr 172.21.15.46:0/263623118 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:42:25.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.352+0000 7f15aa59c700 1 -- 172.21.15.46:0/263623118 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f15ac10d250 msgr2=0x7f15ac19d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:25.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.352+0000 7f15aa59c700 1 --2- 172.21.15.46:0/263623118 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f15ac10d250 0x7f15ac19d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:25.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.352+0000 7f15aa59c700 1 -- 172.21.15.46:0/263623118 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15ac072a20 msgr2=0x7f15ac198e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:25.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.352+0000 7f15aa59c700 1 --2- 172.21.15.46:0/263623118 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15ac072a20 0x7f15ac198e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:25.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.352+0000 7f15aa59c700 1 -- 172.21.15.46:0/263623118 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f159c0095f0 con 0x7f15ac073340 2023-10-19T12:42:25.988 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.352+0000 7f15aa59c700 1 --2- 172.21.15.46:0/263623118 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f15ac073340 0x7f15ac1993d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f15a000e9f0 tx=0x7f15a000ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:25.988 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.352+0000 7f1593fff700 1 -- 172.21.15.46:0/263623118 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a000c9c0 con 0x7f15ac073340 2023-10-19T12:42:25.988 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.352+0000 7f1593fff700 1 -- 172.21.15.46:0/263623118 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f15a0010430 con 0x7f15ac073340 2023-10-19T12:42:25.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.352+0000 7f1593fff700 1 -- 172.21.15.46:0/263623118 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a0018680 con 0x7f15ac073340 2023-10-19T12:42:25.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.352+0000 7f15b1255700 1 -- 172.21.15.46:0/263623118 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15ac19e3a0 con 0x7f15ac073340 2023-10-19T12:42:25.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.353+0000 7f15b1255700 1 -- 172.21.15.46:0/263623118 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15ac1a5c00 con 0x7f15ac073340 2023-10-19T12:42:25.990 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.354+0000 7f15b1255700 1 -- 172.21.15.46:0/263623118 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15ac108460 con 0x7f15ac073340 2023-10-19T12:42:25.990 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.356+0000 7f1593fff700 1 -- 172.21.15.46:0/263623118 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f15a0010860 con 0x7f15ac073340 2023-10-19T12:42:25.990 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.357+0000 7f1593fff700 1 --2- 172.21.15.46:0/263623118 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f15940a1510 0x7f15940a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:25.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.357+0000 7f1593fff700 1 -- 172.21.15.46:0/263623118 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f15a0014070 con 0x7f15ac073340 2023-10-19T12:42:25.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.357+0000 7f15aad9d700 1 --2- 172.21.15.46:0/263623118 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f15940a1510 0x7f15940a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:25.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.358+0000 7f15aad9d700 1 --2- 172.21.15.46:0/263623118 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f15940a1510 0x7f15940a39d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f159c00b6f0 tx=0x7f159c005bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:25.992 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.359+0000 7f1593fff700 1 -- 172.21.15.46:0/263623118 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f15a00964a0 con 0x7f15ac073340 2023-10-19T12:42:25.992 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.588+0000 7f15b1255700 1 -- 172.21.15.46:0/263623118 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) v1 -- 0x7f15ac04e4f0 con 0x7f15ac073340 2023-10-19T12:42:25.992 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.589+0000 7f1593fff700 1 -- 172.21.15.46:0/263623118 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7f15a0099ac0 con 0x7f15ac073340 2023-10-19T12:42:25.992 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.591+0000 7f15b1255700 1 -- 172.21.15.46:0/263623118 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f15940a1510 msgr2=0x7f15940a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:25.992 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.591+0000 7f15b1255700 1 --2- 172.21.15.46:0/263623118 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f15940a1510 0x7f15940a39d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f159c00b6f0 tx=0x7f159c005bc0 comp rx=0 tx=0).stop 2023-10-19T12:42:25.993 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.591+0000 7f15b1255700 1 -- 172.21.15.46:0/263623118 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f15ac073340 msgr2=0x7f15ac1993d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:25.993 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.591+0000 7f15b1255700 1 --2- 172.21.15.46:0/263623118 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f15ac073340 0x7f15ac1993d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f15a000e9f0 tx=0x7f15a000ed00 comp rx=0 tx=0).stop 2023-10-19T12:42:25.993 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.591+0000 7f15b1255700 1 -- 172.21.15.46:0/263623118 shutdown_connections 2023-10-19T12:42:25.993 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.591+0000 7f15b1255700 1 --2- 172.21.15.46:0/263623118 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f15ac10d250 0x7f15ac19d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:25.993 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.591+0000 7f15b1255700 1 --2- 172.21.15.46:0/263623118 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15ac072a20 0x7f15ac198e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:25.993 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.591+0000 7f15b1255700 1 --2- 172.21.15.46:0/263623118 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f15940a1510 0x7f15940a39d0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:25.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.591+0000 7f15b1255700 1 --2- 172.21.15.46:0/263623118 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f15ac073340 0x7f15ac1993d0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:25.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.591+0000 7f15b1255700 1 -- 172.21.15.46:0/263623118 >> 172.21.15.46:0/263623118 conn(0x7f15ac0779e0 msgr2=0x7f15ac0fda80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:25.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.591+0000 7f15b1255700 1 -- 172.21.15.46:0/263623118 shutdown_connections 2023-10-19T12:42:25.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:25.592+0000 7f15b1255700 1 -- 172.21.15.46:0/263623118 wait complete. 2023-10-19T12:42:25.995 INFO:teuthology.orchestra.run.smithi046.stdout:309237645341 2023-10-19T12:42:26.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:26 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/2083841434' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-10-19T12:42:26.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:26 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/263623118' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-10-19T12:42:26.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:26 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/2083841434' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-10-19T12:42:26.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:26 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/263623118' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-10-19T12:42:26.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:26 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/2083841434' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-10-19T12:42:26.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:26 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/263623118' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-10-19T12:42:26.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:26.922+0000 7f37fad59700 1 -- 172.21.15.46:0/4205416937 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37f41057a0 msgr2=0x7f37f4068e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:26.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:26.922+0000 7f37fad59700 1 --2- 172.21.15.46:0/4205416937 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37f41057a0 0x7f37f4068e80 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f37e8009990 tx=0x7f37e8009ca0 comp rx=0 tx=0).stop 2023-10-19T12:42:26.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:26.922+0000 7f37fad59700 1 -- 172.21.15.46:0/4205416937 shutdown_connections 2023-10-19T12:42:26.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:26.922+0000 7f37fad59700 1 --2- 172.21.15.46:0/4205416937 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37f4103210 0x7f37f41036c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:26.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:26.922+0000 7f37fad59700 1 --2- 172.21.15.46:0/4205416937 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37f41057a0 0x7f37f4068e80 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:26.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:26.922+0000 7f37fad59700 1 --2- 172.21.15.46:0/4205416937 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f37f40693c0 0x7f37f4069840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:26.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:26.922+0000 7f37fad59700 1 -- 172.21.15.46:0/4205416937 >> 172.21.15.46:0/4205416937 conn(0x7f37f40757d0 msgr2=0x7f37f4075be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:26.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:26.922+0000 7f37fad59700 1 -- 172.21.15.46:0/4205416937 shutdown_connections 2023-10-19T12:42:26.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:26.922+0000 7f37fad59700 1 -- 172.21.15.46:0/4205416937 wait complete. 2023-10-19T12:42:26.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:26.923+0000 7f37fad59700 1 Processor -- start 2023-10-19T12:42:26.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:26.923+0000 7f37fad59700 1 -- start start 2023-10-19T12:42:26.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:26.923+0000 7f37fad59700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f37f40693c0 0x7f37f419d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:26.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:26.923+0000 7f37fad59700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37f4103210 0x7f37f419d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:26.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:26.924+0000 7f37fad59700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37f41057a0 0x7f37f41a1a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:26.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:26.924+0000 7f37fad59700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37f41a20a0 con 0x7f37f4103210 2023-10-19T12:42:26.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:26.924+0000 7f37fad59700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37f41a2210 con 0x7f37f40693c0 2023-10-19T12:42:26.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:26.924+0000 7f37fad59700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37f41a23d0 con 0x7f37f41057a0 2023-10-19T12:42:26.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:26.924+0000 7f37f3fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37f4103210 0x7f37f419d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:26.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:26.924+0000 7f37f3fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37f4103210 0x7f37f419d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45588/0 (socket says 172.21.15.46:45588) 2023-10-19T12:42:27.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:26.924+0000 7f37f3fff700 1 -- 172.21.15.46:0/1503942784 learned_addr learned my addr 172.21.15.46:0/1503942784 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:42:27.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:26.924+0000 7f37f8af5700 1 --2- 172.21.15.46:0/1503942784 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f37f40693c0 0x7f37f419d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:27.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:26.924+0000 7f37f92f6700 1 --2- 172.21.15.46:0/1503942784 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37f41057a0 0x7f37f41a1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:27.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:26.924+0000 7f37f3fff700 1 -- 172.21.15.46:0/1503942784 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37f41057a0 msgr2=0x7f37f41a1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:27.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:26.924+0000 7f37f3fff700 1 --2- 172.21.15.46:0/1503942784 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37f41057a0 0x7f37f41a1a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:27.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:26.924+0000 7f37f3fff700 1 -- 172.21.15.46:0/1503942784 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f37f40693c0 msgr2=0x7f37f419d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:27.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:26.924+0000 7f37f3fff700 1 --2- 172.21.15.46:0/1503942784 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f37f40693c0 0x7f37f419d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:27.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:26.924+0000 7f37f3fff700 1 -- 172.21.15.46:0/1503942784 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37e80095f0 con 0x7f37f4103210 2023-10-19T12:42:27.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:26.924+0000 7f37f92f6700 1 --2- 172.21.15.46:0/1503942784 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37f41057a0 0x7f37f41a1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T12:42:27.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:26.925+0000 7f37f3fff700 1 --2- 172.21.15.46:0/1503942784 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37f4103210 0x7f37f419d6e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f37e000e9a0 tx=0x7f37e000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:27.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:26.925+0000 7f37f1ffb700 1 -- 172.21.15.46:0/1503942784 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e0009790 con 0x7f37f4103210 2023-10-19T12:42:27.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:26.925+0000 7f37f1ffb700 1 -- 172.21.15.46:0/1503942784 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f37e000cbd0 con 0x7f37f4103210 2023-10-19T12:42:27.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:26.925+0000 7f37fad59700 1 -- 172.21.15.46:0/1503942784 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37f41a26b0 con 0x7f37f4103210 2023-10-19T12:42:27.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:26.925+0000 7f37f1ffb700 1 -- 172.21.15.46:0/1503942784 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e0018680 con 0x7f37f4103210 2023-10-19T12:42:27.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:26.925+0000 7f37fad59700 1 -- 172.21.15.46:0/1503942784 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37f41a9f10 con 0x7f37f4103210 2023-10-19T12:42:27.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:26.927+0000 7f37fad59700 1 -- 172.21.15.46:0/1503942784 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37f40ffcf0 con 0x7f37f4103210 2023-10-19T12:42:27.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:26.928+0000 7f37f1ffb700 1 -- 172.21.15.46:0/1503942784 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f37e00187e0 con 0x7f37f4103210 2023-10-19T12:42:27.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:26.931+0000 7f37f1ffb700 1 --2- 172.21.15.46:0/1503942784 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f37e40a1510 0x7f37e40a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:27.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:26.931+0000 7f37f1ffb700 1 -- 172.21.15.46:0/1503942784 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f37e0014070 con 0x7f37f4103210 2023-10-19T12:42:27.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:26.931+0000 7f37f8af5700 1 --2- 172.21.15.46:0/1503942784 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f37e40a1510 0x7f37e40a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:27.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:26.932+0000 7f37f8af5700 1 --2- 172.21.15.46:0/1503942784 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f37e40a1510 0x7f37e40a39d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f37e8006010 tx=0x7f37e800b260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:27.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:26.937+0000 7f37f1ffb700 1 -- 172.21.15.46:0/1503942784 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f37e0052100 con 0x7f37f4103210 2023-10-19T12:42:27.231 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.227+0000 7f37fad59700 1 -- 172.21.15.46:0/1503942784 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) v1 -- 0x7f37f40686b0 con 0x7f37f4103210 2023-10-19T12:42:27.231 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.227+0000 7f37f1ffb700 1 -- 172.21.15.46:0/1503942784 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7f37e0096620 con 0x7f37f4103210 2023-10-19T12:42:27.231 INFO:teuthology.orchestra.run.smithi046.stdout:339302416410 2023-10-19T12:42:27.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.229+0000 7f37fad59700 1 -- 172.21.15.46:0/1503942784 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f37e40a1510 msgr2=0x7f37e40a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:27.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.229+0000 7f37fad59700 1 --2- 172.21.15.46:0/1503942784 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f37e40a1510 0x7f37e40a39d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f37e8006010 tx=0x7f37e800b260 comp rx=0 tx=0).stop 2023-10-19T12:42:27.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.229+0000 7f37fad59700 1 -- 172.21.15.46:0/1503942784 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37f4103210 msgr2=0x7f37f419d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:27.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.229+0000 7f37fad59700 1 --2- 172.21.15.46:0/1503942784 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37f4103210 0x7f37f419d6e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f37e000e9a0 tx=0x7f37e000ecb0 comp rx=0 tx=0).stop 2023-10-19T12:42:27.234 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.229+0000 7f37fad59700 1 -- 172.21.15.46:0/1503942784 shutdown_connections 2023-10-19T12:42:27.234 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.229+0000 7f37fad59700 1 --2- 172.21.15.46:0/1503942784 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f37e40a1510 0x7f37e40a39d0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:27.234 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.229+0000 7f37fad59700 1 --2- 172.21.15.46:0/1503942784 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37f41057a0 0x7f37f41a1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:27.234 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.229+0000 7f37fad59700 1 --2- 172.21.15.46:0/1503942784 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f37f40693c0 0x7f37f419d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:27.234 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.229+0000 7f37fad59700 1 --2- 172.21.15.46:0/1503942784 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37f4103210 0x7f37f419d6e0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:27.234 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.229+0000 7f37fad59700 1 -- 172.21.15.46:0/1503942784 >> 172.21.15.46:0/1503942784 conn(0x7f37f40757d0 msgr2=0x7f37f4101070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:27.235 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.230+0000 7f37fad59700 1 -- 172.21.15.46:0/1503942784 shutdown_connections 2023-10-19T12:42:27.235 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.230+0000 7f37fad59700 1 -- 172.21.15.46:0/1503942784 wait complete. 2023-10-19T12:42:27.256 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:27 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11]}]: dispatch 2023-10-19T12:42:27.256 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:27 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 4]}]: dispatch 2023-10-19T12:42:27.256 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:27 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 1]}]: dispatch 2023-10-19T12:42:27.256 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:27 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]: dispatch 2023-10-19T12:42:27.257 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:27 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]}]: dispatch 2023-10-19T12:42:27.257 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:27 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]: dispatch 2023-10-19T12:42:27.257 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:27 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [3, 6]}]: dispatch 2023-10-19T12:42:27.257 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:27 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]}]: dispatch 2023-10-19T12:42:27.257 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:27 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 8]}]: dispatch 2023-10-19T12:42:27.257 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:27 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]: dispatch 2023-10-19T12:42:27.258 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:27 smithi046 ceph-mon[98509]: pgmap v318: 129 pgs: 129 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-10-19T12:42:27.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:27 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11]}]: dispatch 2023-10-19T12:42:27.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:27 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 4]}]: dispatch 2023-10-19T12:42:27.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:27 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 1]}]: dispatch 2023-10-19T12:42:27.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:27 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]: dispatch 2023-10-19T12:42:27.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:27 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]}]: dispatch 2023-10-19T12:42:27.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:27 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]: dispatch 2023-10-19T12:42:27.382 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:27 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [3, 6]}]: dispatch 2023-10-19T12:42:27.382 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:27 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]}]: dispatch 2023-10-19T12:42:27.382 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:27 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 8]}]: dispatch 2023-10-19T12:42:27.382 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:27 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]: dispatch 2023-10-19T12:42:27.382 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:27 smithi195 ceph-mon[134493]: pgmap v318: 129 pgs: 129 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-10-19T12:42:27.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:27 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11]}]: dispatch 2023-10-19T12:42:27.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:27 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 4]}]: dispatch 2023-10-19T12:42:27.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:27 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 1]}]: dispatch 2023-10-19T12:42:27.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:27 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]: dispatch 2023-10-19T12:42:27.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:27 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]}]: dispatch 2023-10-19T12:42:27.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:27 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]: dispatch 2023-10-19T12:42:27.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:27 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [3, 6]}]: dispatch 2023-10-19T12:42:27.589 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:27 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]}]: dispatch 2023-10-19T12:42:27.589 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:27 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 8]}]: dispatch 2023-10-19T12:42:27.589 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:27 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]: dispatch 2023-10-19T12:42:27.589 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:27 smithi157 ceph-mon[134109]: pgmap v318: 129 pgs: 129 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-10-19T12:42:27.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.671+0000 7f5dad8d1700 1 -- 172.21.15.46:0/133104517 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5da81008a0 msgr2=0x7f5da8100d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:27.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.671+0000 7f5dad8d1700 1 --2- 172.21.15.46:0/133104517 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5da81008a0 0x7f5da8100d20 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c0098f0 tx=0x7f5d9c009c00 comp rx=0 tx=0).stop 2023-10-19T12:42:27.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.671+0000 7f5dad8d1700 1 -- 172.21.15.46:0/133104517 shutdown_connections 2023-10-19T12:42:27.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.671+0000 7f5dad8d1700 1 --2- 172.21.15.46:0/133104517 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5da8101260 0x7f5da810d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:27.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.671+0000 7f5dad8d1700 1 --2- 172.21.15.46:0/133104517 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5da81057c0 0x7f5da8105ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:27.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.671+0000 7f5dad8d1700 1 --2- 172.21.15.46:0/133104517 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5da81008a0 0x7f5da8100d20 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:27.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.671+0000 7f5dad8d1700 1 -- 172.21.15.46:0/133104517 >> 172.21.15.46:0/133104517 conn(0x7f5da80779e0 msgr2=0x7f5da8077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:27.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.671+0000 7f5dad8d1700 1 -- 172.21.15.46:0/133104517 shutdown_connections 2023-10-19T12:42:27.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.671+0000 7f5dad8d1700 1 -- 172.21.15.46:0/133104517 wait complete. 2023-10-19T12:42:27.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.672+0000 7f5dad8d1700 1 Processor -- start 2023-10-19T12:42:27.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.673+0000 7f5dad8d1700 1 -- start start 2023-10-19T12:42:27.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.673+0000 7f5dad8d1700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5da81008a0 0x7f5da8198fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:27.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.673+0000 7f5dad8d1700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5da8101260 0x7f5da8199520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:27.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.673+0000 7f5dad8d1700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5da81057c0 0x7f5da819d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:27.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.673+0000 7f5dad8d1700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5da819dd30 con 0x7f5da81008a0 2023-10-19T12:42:27.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.673+0000 7f5dad8d1700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5da819dea0 con 0x7f5da81057c0 2023-10-19T12:42:27.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.673+0000 7f5dad8d1700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5da819e060 con 0x7f5da8101260 2023-10-19T12:42:27.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.674+0000 7f5da6ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5da81008a0 0x7f5da8198fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:27.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.674+0000 7f5da67fc700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5da8101260 0x7f5da8199520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:27.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.674+0000 7f5da77fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5da81057c0 0x7f5da819d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:27.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.674+0000 7f5da67fc700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5da8101260 0x7f5da8199520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:58124/0 (socket says 172.21.15.46:58124) 2023-10-19T12:42:27.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.674+0000 7f5da67fc700 1 -- 172.21.15.46:0/3181494323 learned_addr learned my addr 172.21.15.46:0/3181494323 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:42:27.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.674+0000 7f5da6ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5da81008a0 0x7f5da8198fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45624/0 (socket says 172.21.15.46:45624) 2023-10-19T12:42:27.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.674+0000 7f5da67fc700 1 -- 172.21.15.46:0/3181494323 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5da81057c0 msgr2=0x7f5da819d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:27.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.674+0000 7f5da67fc700 1 --2- 172.21.15.46:0/3181494323 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5da81057c0 0x7f5da819d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:27.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.674+0000 7f5da67fc700 1 -- 172.21.15.46:0/3181494323 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5da81008a0 msgr2=0x7f5da8198fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:27.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.674+0000 7f5da67fc700 1 --2- 172.21.15.46:0/3181494323 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5da81008a0 0x7f5da8198fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:27.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.674+0000 7f5da67fc700 1 -- 172.21.15.46:0/3181494323 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d9c009520 con 0x7f5da8101260 2023-10-19T12:42:27.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.674+0000 7f5da6ffd700 1 --2- 172.21.15.46:0/3181494323 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5da81008a0 0x7f5da8198fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:42:27.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.675+0000 7f5da67fc700 1 --2- 172.21.15.46:0/3181494323 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5da8101260 0x7f5da8199520 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c00fad0 tx=0x7f5d9c00fb00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:27.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.675+0000 7f5dac8cf700 1 -- 172.21.15.46:0/3181494323 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d9c01c070 con 0x7f5da8101260 2023-10-19T12:42:27.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.675+0000 7f5dad8d1700 1 -- 172.21.15.46:0/3181494323 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5da819e2e0 con 0x7f5da8101260 2023-10-19T12:42:27.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.675+0000 7f5dac8cf700 1 -- 172.21.15.46:0/3181494323 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5d9c00bbd0 con 0x7f5da8101260 2023-10-19T12:42:27.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.675+0000 7f5dac8cf700 1 -- 172.21.15.46:0/3181494323 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d9c003d30 con 0x7f5da8101260 2023-10-19T12:42:27.683 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.675+0000 7f5dad8d1700 1 -- 172.21.15.46:0/3181494323 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5da81a5b50 con 0x7f5da8101260 2023-10-19T12:42:27.683 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.676+0000 7f5dad8d1700 1 -- 172.21.15.46:0/3181494323 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5da8101f30 con 0x7f5da8101260 2023-10-19T12:42:27.683 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.679+0000 7f5dac8cf700 1 -- 172.21.15.46:0/3181494323 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f5d9c00b710 con 0x7f5da8101260 2023-10-19T12:42:27.684 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.681+0000 7f5dac8cf700 1 --2- 172.21.15.46:0/3181494323 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f5d900a1510 0x7f5d900a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:27.684 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.681+0000 7f5dac8cf700 1 -- 172.21.15.46:0/3181494323 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f5d9c0ce200 con 0x7f5da8101260 2023-10-19T12:42:27.685 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.682+0000 7f5da6ffd700 1 --2- 172.21.15.46:0/3181494323 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f5d900a1510 0x7f5d900a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:27.685 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.683+0000 7f5da6ffd700 1 --2- 172.21.15.46:0/3181494323 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f5d900a1510 0x7f5d900a39d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5da819a380 tx=0x7f5d9800a400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:27.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.684+0000 7f5dac8cf700 1 -- 172.21.15.46:0/3181494323 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5d9c097420 con 0x7f5da8101260 2023-10-19T12:42:27.910 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.907+0000 7f5dad8d1700 1 -- 172.21.15.46:0/3181494323 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f5da819a080 con 0x7f5da8101260 2023-10-19T12:42:27.911 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.908+0000 7f5dac8cf700 1 -- 172.21.15.46:0/3181494323 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5d9c09aa40 con 0x7f5da8101260 2023-10-19T12:42:27.911 INFO:teuthology.orchestra.run.smithi046.stdout:219043332139 2023-10-19T12:42:27.913 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.910+0000 7f5dad8d1700 1 -- 172.21.15.46:0/3181494323 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f5d900a1510 msgr2=0x7f5d900a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:27.914 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.910+0000 7f5dad8d1700 1 --2- 172.21.15.46:0/3181494323 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f5d900a1510 0x7f5d900a39d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5da819a380 tx=0x7f5d9800a400 comp rx=0 tx=0).stop 2023-10-19T12:42:27.914 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.910+0000 7f5dad8d1700 1 -- 172.21.15.46:0/3181494323 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5da8101260 msgr2=0x7f5da8199520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:27.914 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.910+0000 7f5dad8d1700 1 --2- 172.21.15.46:0/3181494323 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5da8101260 0x7f5da8199520 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c00fad0 tx=0x7f5d9c00fb00 comp rx=0 tx=0).stop 2023-10-19T12:42:27.914 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.910+0000 7f5dad8d1700 1 -- 172.21.15.46:0/3181494323 shutdown_connections 2023-10-19T12:42:27.915 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.910+0000 7f5dad8d1700 1 --2- 172.21.15.46:0/3181494323 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5da81057c0 0x7f5da819d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:27.915 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.910+0000 7f5dad8d1700 1 --2- 172.21.15.46:0/3181494323 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5da81008a0 0x7f5da8198fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:27.915 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.910+0000 7f5dad8d1700 1 --2- 172.21.15.46:0/3181494323 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f5d900a1510 0x7f5d900a39d0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:27.915 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.910+0000 7f5dad8d1700 1 --2- 172.21.15.46:0/3181494323 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5da8101260 0x7f5da8199520 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:27.915 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.910+0000 7f5dad8d1700 1 -- 172.21.15.46:0/3181494323 >> 172.21.15.46:0/3181494323 conn(0x7f5da80779e0 msgr2=0x7f5da80ff0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:27.916 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.911+0000 7f5dad8d1700 1 -- 172.21.15.46:0/3181494323 shutdown_connections 2023-10-19T12:42:27.916 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.911+0000 7f5dad8d1700 1 -- 172.21.15.46:0/3181494323 wait complete. 2023-10-19T12:42:28.087 INFO:tasks.cephadm.ceph_manager.ceph:need seq 309237645339 got 309237645341 for osd.10 2023-10-19T12:42:28.088 DEBUG:teuthology.parallel:result is None 2023-10-19T12:42:28.088 INFO:tasks.cephadm.ceph_manager.ceph:need seq 253403070500 got 253403070501 for osd.8 2023-10-19T12:42:28.088 DEBUG:teuthology.parallel:result is None 2023-10-19T12:42:28.187 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.133+0000 7f4df6fd5700 1 -- 172.21.15.46:0/591233653 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4df01067a0 msgr2=0x7f4df0106b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:28.187 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.133+0000 7f4df6fd5700 1 --2- 172.21.15.46:0/591233653 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4df01067a0 0x7f4df0106b80 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f4de800b0a0 tx=0x7f4de800b3b0 comp rx=0 tx=0).stop 2023-10-19T12:42:28.188 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.133+0000 7f4df6fd5700 1 -- 172.21.15.46:0/591233653 shutdown_connections 2023-10-19T12:42:28.188 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.133+0000 7f4df6fd5700 1 --2- 172.21.15.46:0/591233653 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4df0068b30 0x7f4df010d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:28.188 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.133+0000 7f4df6fd5700 1 --2- 172.21.15.46:0/591233653 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4df01067a0 0x7f4df0106b80 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:28.188 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.133+0000 7f4df6fd5700 1 --2- 172.21.15.46:0/591233653 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4df0068190 0x7f4df00685f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:28.188 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.133+0000 7f4df6fd5700 1 -- 172.21.15.46:0/591233653 >> 172.21.15.46:0/591233653 conn(0x7f4df0075790 msgr2=0x7f4df0075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:28.188 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.133+0000 7f4df6fd5700 1 -- 172.21.15.46:0/591233653 shutdown_connections 2023-10-19T12:42:28.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.133+0000 7f4df6fd5700 1 -- 172.21.15.46:0/591233653 wait complete. 2023-10-19T12:42:28.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.134+0000 7f4df6fd5700 1 Processor -- start 2023-10-19T12:42:28.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.134+0000 7f4df6fd5700 1 -- start start 2023-10-19T12:42:28.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.135+0000 7f4df6fd5700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4df0068190 0x7f4df0199060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:28.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.135+0000 7f4df6fd5700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4df0068b30 0x7f4df01995a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:28.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.135+0000 7f4df6fd5700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4df01067a0 0x7f4df019d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:28.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.135+0000 7f4df6fd5700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4df019df60 con 0x7f4df0068190 2023-10-19T12:42:28.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.135+0000 7f4df6fd5700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4df019e0d0 con 0x7f4df01067a0 2023-10-19T12:42:28.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.135+0000 7f4df6fd5700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4df019e290 con 0x7f4df0068b30 2023-10-19T12:42:28.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.135+0000 7f4df4d71700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4df0068190 0x7f4df0199060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:28.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.135+0000 7f4df4d71700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4df0068190 0x7f4df0199060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45610/0 (socket says 172.21.15.46:45610) 2023-10-19T12:42:28.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.135+0000 7f4df4d71700 1 -- 172.21.15.46:0/2864699251 learned_addr learned my addr 172.21.15.46:0/2864699251 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:42:28.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.135+0000 7f4deffff700 1 --2- 172.21.15.46:0/2864699251 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4df0068b30 0x7f4df01995a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:28.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.135+0000 7f4df5572700 1 --2- 172.21.15.46:0/2864699251 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4df01067a0 0x7f4df019d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:28.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.135+0000 7f4df4d71700 1 -- 172.21.15.46:0/2864699251 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4df0068b30 msgr2=0x7f4df01995a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:28.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.135+0000 7f4df4d71700 1 --2- 172.21.15.46:0/2864699251 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4df0068b30 0x7f4df01995a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:28.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.135+0000 7f4df4d71700 1 -- 172.21.15.46:0/2864699251 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4df01067a0 msgr2=0x7f4df019d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:28.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.135+0000 7f4df4d71700 1 --2- 172.21.15.46:0/2864699251 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4df01067a0 0x7f4df019d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:28.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.136+0000 7f4df4d71700 1 -- 172.21.15.46:0/2864699251 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4de8009d00 con 0x7f4df0068190 2023-10-19T12:42:28.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.136+0000 7f4deffff700 1 --2- 172.21.15.46:0/2864699251 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4df0068b30 0x7f4df01995a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:42:28.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.136+0000 7f4df5572700 1 --2- 172.21.15.46:0/2864699251 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4df01067a0 0x7f4df019d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T12:42:28.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.136+0000 7f4df4d71700 1 --2- 172.21.15.46:0/2864699251 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4df0068190 0x7f4df0199060 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4de800b070 tx=0x7f4de80079b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:28.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.136+0000 7f4dedffb700 1 -- 172.21.15.46:0/2864699251 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de800e040 con 0x7f4df0068190 2023-10-19T12:42:28.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.136+0000 7f4dedffb700 1 -- 172.21.15.46:0/2864699251 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4de801d470 con 0x7f4df0068190 2023-10-19T12:42:28.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.136+0000 7f4dedffb700 1 -- 172.21.15.46:0/2864699251 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de801b6e0 con 0x7f4df0068190 2023-10-19T12:42:28.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.136+0000 7f4df6fd5700 1 -- 172.21.15.46:0/2864699251 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4df019e510 con 0x7f4df0068190 2023-10-19T12:42:28.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.136+0000 7f4df6fd5700 1 -- 172.21.15.46:0/2864699251 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4df01a5dd0 con 0x7f4df0068190 2023-10-19T12:42:28.195 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.138+0000 7f4df6fd5700 1 -- 172.21.15.46:0/2864699251 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4df0101ee0 con 0x7f4df0068190 2023-10-19T12:42:28.195 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.141+0000 7f4dedffb700 1 -- 172.21.15.46:0/2864699251 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f4de801d5e0 con 0x7f4df0068190 2023-10-19T12:42:28.195 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.143+0000 7f4dedffb700 1 --2- 172.21.15.46:0/2864699251 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f4dd80a1590 0x7f4dd80a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:28.195 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.143+0000 7f4dedffb700 1 -- 172.21.15.46:0/2864699251 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f4de80ce790 con 0x7f4df0068190 2023-10-19T12:42:28.195 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.143+0000 7f4deffff700 1 --2- 172.21.15.46:0/2864699251 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f4dd80a1590 0x7f4dd80a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:28.195 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.143+0000 7f4dedffb700 1 -- 172.21.15.46:0/2864699251 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f4de80979b0 con 0x7f4df0068190 2023-10-19T12:42:28.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.144+0000 7f4deffff700 1 --2- 172.21.15.46:0/2864699251 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f4dd80a1590 0x7f4dd80a3a50 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f4df019a5c0 tx=0x7f4de0009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:28.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.372+0000 7f4df6fd5700 1 -- 172.21.15.46:0/2864699251 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f4df019a370 con 0x7f4df0068190 2023-10-19T12:42:28.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.373+0000 7f4dedffb700 1 -- 172.21.15.46:0/2864699251 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4de801a3c0 con 0x7f4df0068190 2023-10-19T12:42:28.196 INFO:teuthology.orchestra.run.smithi046.stdout:163208757301 2023-10-19T12:42:28.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.375+0000 7f4df6fd5700 1 -- 172.21.15.46:0/2864699251 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f4dd80a1590 msgr2=0x7f4dd80a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:28.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.375+0000 7f4df6fd5700 1 --2- 172.21.15.46:0/2864699251 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f4dd80a1590 0x7f4dd80a3a50 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f4df019a5c0 tx=0x7f4de0009260 comp rx=0 tx=0).stop 2023-10-19T12:42:28.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.375+0000 7f4df6fd5700 1 -- 172.21.15.46:0/2864699251 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4df0068190 msgr2=0x7f4df0199060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:28.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.375+0000 7f4df6fd5700 1 --2- 172.21.15.46:0/2864699251 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4df0068190 0x7f4df0199060 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4de800b070 tx=0x7f4de80079b0 comp rx=0 tx=0).stop 2023-10-19T12:42:28.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.375+0000 7f4df6fd5700 1 -- 172.21.15.46:0/2864699251 shutdown_connections 2023-10-19T12:42:28.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.375+0000 7f4df6fd5700 1 --2- 172.21.15.46:0/2864699251 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4df01067a0 0x7f4df019d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:28.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.375+0000 7f4df6fd5700 1 --2- 172.21.15.46:0/2864699251 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4df0068190 0x7f4df0199060 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:28.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.375+0000 7f4df6fd5700 1 --2- 172.21.15.46:0/2864699251 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f4dd80a1590 0x7f4dd80a3a50 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:28.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.375+0000 7f4df6fd5700 1 --2- 172.21.15.46:0/2864699251 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4df0068b30 0x7f4df01995a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:28.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.375+0000 7f4df6fd5700 1 -- 172.21.15.46:0/2864699251 >> 172.21.15.46:0/2864699251 conn(0x7f4df0075790 msgr2=0x7f4df00fd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:28.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.376+0000 7f4df6fd5700 1 -- 172.21.15.46:0/2864699251 shutdown_connections 2023-10-19T12:42:28.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:27.376+0000 7f4df6fd5700 1 -- 172.21.15.46:0/2864699251 wait complete. 2023-10-19T12:42:28.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:28 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11]}]': finished 2023-10-19T12:42:28.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:28 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 4]}]': finished 2023-10-19T12:42:28.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:28 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 1]}]': finished 2023-10-19T12:42:28.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:28 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2023-10-19T12:42:28.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:28 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]}]': finished 2023-10-19T12:42:28.382 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:28 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]': finished 2023-10-19T12:42:28.382 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:28 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [3, 6]}]': finished 2023-10-19T12:42:28.382 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:28 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]}]': finished 2023-10-19T12:42:28.382 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:28 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 8]}]': finished 2023-10-19T12:42:28.382 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:28 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]': finished 2023-10-19T12:42:28.383 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:28 smithi195 ceph-mon[134493]: osdmap e89: 12 total, 12 up, 12 in 2023-10-19T12:42:28.383 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:28 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/1503942784' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-10-19T12:42:28.383 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:28 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/2864699251' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-10-19T12:42:28.383 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:28 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/3181494323' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-10-19T12:42:28.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.407+0000 7f52fc333700 1 -- 172.21.15.46:0/2439339699 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52f4072f60 msgr2=0x7f52f40733e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:28.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.407+0000 7f52fc333700 1 --2- 172.21.15.46:0/2439339699 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52f4072f60 0x7f52f40733e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f52e4009990 tx=0x7f52e4009ca0 comp rx=0 tx=0).stop 2023-10-19T12:42:28.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.407+0000 7f52fc333700 1 -- 172.21.15.46:0/2439339699 shutdown_connections 2023-10-19T12:42:28.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.407+0000 7f52fc333700 1 --2- 172.21.15.46:0/2439339699 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f52f4111570 0x7f52f41139a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:28.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.407+0000 7f52fc333700 1 --2- 172.21.15.46:0/2439339699 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f52f4074770 0x7f52f4072a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:28.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.407+0000 7f52fc333700 1 --2- 172.21.15.46:0/2439339699 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52f4072f60 0x7f52f40733e0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:28.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.407+0000 7f52fc333700 1 -- 172.21.15.46:0/2439339699 >> 172.21.15.46:0/2439339699 conn(0x7f52f40779e0 msgr2=0x7f52f4077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:28.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.407+0000 7f52fc333700 1 -- 172.21.15.46:0/2439339699 shutdown_connections 2023-10-19T12:42:28.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.407+0000 7f52fc333700 1 -- 172.21.15.46:0/2439339699 wait complete. 2023-10-19T12:42:28.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.408+0000 7f52fc333700 1 Processor -- start 2023-10-19T12:42:28.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.408+0000 7f52fc333700 1 -- start start 2023-10-19T12:42:28.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.409+0000 7f52fc333700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f52f4072f60 0x7f52f419d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:28.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.409+0000 7f52fc333700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f52f4074770 0x7f52f419d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:28.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.409+0000 7f52fc333700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52f4111570 0x7f52f41a1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:28.415 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.409+0000 7f52fc333700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52f41a21c0 con 0x7f52f4111570 2023-10-19T12:42:28.415 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.409+0000 7f52fc333700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52f41a2330 con 0x7f52f4072f60 2023-10-19T12:42:28.415 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.409+0000 7f52fc333700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52f41a24f0 con 0x7f52f4074770 2023-10-19T12:42:28.415 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.409+0000 7f52fa0cf700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f52f4072f60 0x7f52f419d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:28.415 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.409+0000 7f52fa0cf700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f52f4072f60 0x7f52f419d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:33530/0 (socket says 172.21.15.46:33530) 2023-10-19T12:42:28.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.409+0000 7f52fa0cf700 1 -- 172.21.15.46:0/1395815302 learned_addr learned my addr 172.21.15.46:0/1395815302 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:42:28.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.409+0000 7f52fa8d0700 1 --2- 172.21.15.46:0/1395815302 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52f4111570 0x7f52f41a1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:28.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.409+0000 7f52f98ce700 1 --2- 172.21.15.46:0/1395815302 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f52f4074770 0x7f52f419d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:28.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.410+0000 7f52fa0cf700 1 -- 172.21.15.46:0/1395815302 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f52f4074770 msgr2=0x7f52f419d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:28.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.410+0000 7f52fa0cf700 1 --2- 172.21.15.46:0/1395815302 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f52f4074770 0x7f52f419d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:28.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.410+0000 7f52fa0cf700 1 -- 172.21.15.46:0/1395815302 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52f4111570 msgr2=0x7f52f41a1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:28.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.410+0000 7f52fa0cf700 1 --2- 172.21.15.46:0/1395815302 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52f4111570 0x7f52f41a1bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:28.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.410+0000 7f52fa0cf700 1 -- 172.21.15.46:0/1395815302 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52e40095f0 con 0x7f52f4072f60 2023-10-19T12:42:28.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.410+0000 7f52f98ce700 1 --2- 172.21.15.46:0/1395815302 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f52f4074770 0x7f52f419d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T12:42:28.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.410+0000 7f52fa0cf700 1 --2- 172.21.15.46:0/1395815302 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f52f4072f60 0x7f52f419d2c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f52f000e9a0 tx=0x7f52f000ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:28.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.410+0000 7f52eb7fe700 1 -- 172.21.15.46:0/1395815302 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f0009790 con 0x7f52f4072f60 2023-10-19T12:42:28.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.410+0000 7f52eb7fe700 1 -- 172.21.15.46:0/1395815302 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f52f000cbd0 con 0x7f52f4072f60 2023-10-19T12:42:28.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.410+0000 7f52fc333700 1 -- 172.21.15.46:0/1395815302 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52f41a27d0 con 0x7f52f4072f60 2023-10-19T12:42:28.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.410+0000 7f52eb7fe700 1 -- 172.21.15.46:0/1395815302 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f0018680 con 0x7f52f4072f60 2023-10-19T12:42:28.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.411+0000 7f52fc333700 1 -- 172.21.15.46:0/1395815302 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52f41aa030 con 0x7f52f4072f60 2023-10-19T12:42:28.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.412+0000 7f52fc333700 1 -- 172.21.15.46:0/1395815302 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52f40740b0 con 0x7f52f4072f60 2023-10-19T12:42:28.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.413+0000 7f52eb7fe700 1 -- 172.21.15.46:0/1395815302 <== mon.2 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f52f000cd40 con 0x7f52f4072f60 2023-10-19T12:42:28.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.415+0000 7f52eb7fe700 1 --2- 172.21.15.46:0/1395815302 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f52e00a1590 0x7f52e00a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:28.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.415+0000 7f52eb7fe700 1 -- 172.21.15.46:0/1395815302 <== mon.2 v2:172.21.15.157:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f52f0014070 con 0x7f52f4072f60 2023-10-19T12:42:28.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.415+0000 7f52f98ce700 1 --2- 172.21.15.46:0/1395815302 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f52e00a1590 0x7f52e00a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:28.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.416+0000 7f52f98ce700 1 --2- 172.21.15.46:0/1395815302 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f52e00a1590 0x7f52e00a3a50 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f52e4006010 tx=0x7f52e400b260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:28.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.419+0000 7f52eb7fe700 1 -- 172.21.15.46:0/1395815302 <== mon.2 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f52f0096630 con 0x7f52f4072f60 2023-10-19T12:42:28.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:28 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11]}]': finished 2023-10-19T12:42:28.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:28 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 4]}]': finished 2023-10-19T12:42:28.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:28 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 1]}]': finished 2023-10-19T12:42:28.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:28 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2023-10-19T12:42:28.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:28 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]}]': finished 2023-10-19T12:42:28.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:28 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]': finished 2023-10-19T12:42:28.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:28 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [3, 6]}]': finished 2023-10-19T12:42:28.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:28 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]}]': finished 2023-10-19T12:42:28.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:28 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 8]}]': finished 2023-10-19T12:42:28.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:28 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]': finished 2023-10-19T12:42:28.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:28 smithi046 ceph-mon[98509]: osdmap e89: 12 total, 12 up, 12 in 2023-10-19T12:42:28.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:28 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/1503942784' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-10-19T12:42:28.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:28 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/2864699251' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-10-19T12:42:28.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:28 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/3181494323' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-10-19T12:42:28.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.540+0000 7fb65ee40700 1 -- 172.21.15.46:0/323850829 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb658072f60 msgr2=0x7fb6580733e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:28.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.540+0000 7fb65ee40700 1 --2- 172.21.15.46:0/323850829 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb658072f60 0x7fb6580733e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb6440098f0 tx=0x7fb644009c00 comp rx=0 tx=0).stop 2023-10-19T12:42:28.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.540+0000 7fb65ee40700 1 -- 172.21.15.46:0/323850829 shutdown_connections 2023-10-19T12:42:28.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.540+0000 7fb65ee40700 1 --2- 172.21.15.46:0/323850829 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb658111570 0x7fb6581139a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:28.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.540+0000 7fb65ee40700 1 --2- 172.21.15.46:0/323850829 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb658074770 0x7fb658072a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:28.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.540+0000 7fb65ee40700 1 --2- 172.21.15.46:0/323850829 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb658072f60 0x7fb6580733e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:28.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.540+0000 7fb65ee40700 1 -- 172.21.15.46:0/323850829 >> 172.21.15.46:0/323850829 conn(0x7fb6580779e0 msgr2=0x7fb658077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:28.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.540+0000 7fb65ee40700 1 -- 172.21.15.46:0/323850829 shutdown_connections 2023-10-19T12:42:28.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.540+0000 7fb65ee40700 1 -- 172.21.15.46:0/323850829 wait complete. 2023-10-19T12:42:28.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.541+0000 7fb65ee40700 1 Processor -- start 2023-10-19T12:42:28.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.542+0000 7fb65ee40700 1 -- start start 2023-10-19T12:42:28.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.542+0000 7fb65ee40700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb658072f60 0x7fb65819d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:28.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.542+0000 7fb65ee40700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb658074770 0x7fb65819d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:28.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.542+0000 7fb65ee40700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb658111570 0x7fb6581a1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:28.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.542+0000 7fb65ee40700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6581a2300 con 0x7fb658072f60 2023-10-19T12:42:28.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.542+0000 7fb65ee40700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6581a2470 con 0x7fb658111570 2023-10-19T12:42:28.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.542+0000 7fb65ee40700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6581a2630 con 0x7fb658074770 2023-10-19T12:42:28.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.542+0000 7fb65cbdc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb658072f60 0x7fb65819d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:28.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.543+0000 7fb65cbdc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb658072f60 0x7fb65819d400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45658/0 (socket says 172.21.15.46:45658) 2023-10-19T12:42:28.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.543+0000 7fb65cbdc700 1 -- 172.21.15.46:0/979342057 learned_addr learned my addr 172.21.15.46:0/979342057 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:42:28.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.543+0000 7fb65d3dd700 1 --2- 172.21.15.46:0/979342057 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb658111570 0x7fb6581a1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:28.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.543+0000 7fb657fff700 1 --2- 172.21.15.46:0/979342057 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb658074770 0x7fb65819d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:28.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.543+0000 7fb65d3dd700 1 -- 172.21.15.46:0/979342057 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb658074770 msgr2=0x7fb65819d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:28.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.543+0000 7fb65d3dd700 1 --2- 172.21.15.46:0/979342057 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb658074770 0x7fb65819d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:28.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.543+0000 7fb65d3dd700 1 -- 172.21.15.46:0/979342057 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb658072f60 msgr2=0x7fb65819d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:28.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.543+0000 7fb65d3dd700 1 --2- 172.21.15.46:0/979342057 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb658072f60 0x7fb65819d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:28.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.543+0000 7fb65d3dd700 1 -- 172.21.15.46:0/979342057 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb644009520 con 0x7fb658111570 2023-10-19T12:42:28.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.543+0000 7fb65cbdc700 1 --2- 172.21.15.46:0/979342057 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb658072f60 0x7fb65819d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:42:28.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.543+0000 7fb65d3dd700 1 --2- 172.21.15.46:0/979342057 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb658111570 0x7fb6581a1cf0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb65000ef90 tx=0x7fb65000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:28.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.544+0000 7fb655ffb700 1 -- 172.21.15.46:0/979342057 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb650018070 con 0x7fb658111570 2023-10-19T12:42:28.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.544+0000 7fb65ee40700 1 -- 172.21.15.46:0/979342057 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6581a28b0 con 0x7fb658111570 2023-10-19T12:42:28.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.544+0000 7fb655ffb700 1 -- 172.21.15.46:0/979342057 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb65000f040 con 0x7fb658111570 2023-10-19T12:42:28.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.544+0000 7fb655ffb700 1 -- 172.21.15.46:0/979342057 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb65000cb60 con 0x7fb658111570 2023-10-19T12:42:28.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.544+0000 7fb65ee40700 1 -- 172.21.15.46:0/979342057 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6581aa170 con 0x7fb658111570 2023-10-19T12:42:28.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.545+0000 7fb65ee40700 1 -- 172.21.15.46:0/979342057 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6580740b0 con 0x7fb658111570 2023-10-19T12:42:28.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.547+0000 7fb655ffb700 1 -- 172.21.15.46:0/979342057 <== mon.2 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7fb65000cd20 con 0x7fb658111570 2023-10-19T12:42:28.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.548+0000 7fb655ffb700 1 --2- 172.21.15.46:0/979342057 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fb6480a1510 0x7fb6480a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:28.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.549+0000 7fb655ffb700 1 -- 172.21.15.46:0/979342057 <== mon.2 v2:172.21.15.157:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fb6500ccd30 con 0x7fb658111570 2023-10-19T12:42:28.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.549+0000 7fb65cbdc700 1 --2- 172.21.15.46:0/979342057 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fb6480a1510 0x7fb6480a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:28.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.549+0000 7fb65cbdc700 1 --2- 172.21.15.46:0/979342057 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fb6480a1510 0x7fb6480a39d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb64c005950 tx=0x7fb64c009310 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:28.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.551+0000 7fb655ffb700 1 -- 172.21.15.46:0/979342057 <== mon.2 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb650095f50 con 0x7fb658111570 2023-10-19T12:42:28.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:28 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11]}]': finished 2023-10-19T12:42:28.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:28 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 4]}]': finished 2023-10-19T12:42:28.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:28 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 1]}]': finished 2023-10-19T12:42:28.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:28 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2023-10-19T12:42:28.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:28 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]}]': finished 2023-10-19T12:42:28.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:28 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]': finished 2023-10-19T12:42:28.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:28 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [3, 6]}]': finished 2023-10-19T12:42:28.589 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:28 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]}]': finished 2023-10-19T12:42:28.589 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:28 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 8]}]': finished 2023-10-19T12:42:28.589 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:28 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]': finished 2023-10-19T12:42:28.589 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:28 smithi157 ceph-mon[134109]: osdmap e89: 12 total, 12 up, 12 in 2023-10-19T12:42:28.589 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:28 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/1503942784' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-10-19T12:42:28.590 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:28 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/2864699251' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-10-19T12:42:28.590 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:28 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/3181494323' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-10-19T12:42:28.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.641+0000 7f52fc333700 1 -- 172.21.15.46:0/1395815302 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f52f419e5d0 con 0x7f52f4072f60 2023-10-19T12:42:28.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.642+0000 7f52eb7fe700 1 -- 172.21.15.46:0/1395815302 <== mon.2 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f52f0099c50 con 0x7f52f4072f60 2023-10-19T12:42:28.646 INFO:teuthology.orchestra.run.smithi046.stdout:34359738444 2023-10-19T12:42:28.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.645+0000 7f52fc333700 1 -- 172.21.15.46:0/1395815302 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f52e00a1590 msgr2=0x7f52e00a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:28.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.645+0000 7f52fc333700 1 --2- 172.21.15.46:0/1395815302 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f52e00a1590 0x7f52e00a3a50 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f52e4006010 tx=0x7f52e400b260 comp rx=0 tx=0).stop 2023-10-19T12:42:28.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.645+0000 7f52fc333700 1 -- 172.21.15.46:0/1395815302 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f52f4072f60 msgr2=0x7f52f419d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:28.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.645+0000 7f52fc333700 1 --2- 172.21.15.46:0/1395815302 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f52f4072f60 0x7f52f419d2c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f52f000e9a0 tx=0x7f52f000ed60 comp rx=0 tx=0).stop 2023-10-19T12:42:28.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.645+0000 7f52fc333700 1 -- 172.21.15.46:0/1395815302 shutdown_connections 2023-10-19T12:42:28.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.645+0000 7f52fc333700 1 --2- 172.21.15.46:0/1395815302 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52f4111570 0x7f52f41a1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:28.650 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.645+0000 7f52fc333700 1 --2- 172.21.15.46:0/1395815302 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f52f4072f60 0x7f52f419d2c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:28.650 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.645+0000 7f52fc333700 1 --2- 172.21.15.46:0/1395815302 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f52e00a1590 0x7f52e00a3a50 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:28.650 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.645+0000 7f52fc333700 1 --2- 172.21.15.46:0/1395815302 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f52f4074770 0x7f52f419d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:28.650 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.645+0000 7f52fc333700 1 -- 172.21.15.46:0/1395815302 >> 172.21.15.46:0/1395815302 conn(0x7f52f40779e0 msgr2=0x7f52f4110140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:28.650 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.645+0000 7f52fc333700 1 -- 172.21.15.46:0/1395815302 shutdown_connections 2023-10-19T12:42:28.651 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.645+0000 7f52fc333700 1 -- 172.21.15.46:0/1395815302 wait complete. 2023-10-19T12:42:28.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.781+0000 7fb65ee40700 1 -- 172.21.15.46:0/979342057 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fb65819e740 con 0x7fb658111570 2023-10-19T12:42:28.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.782+0000 7fb655ffb700 1 -- 172.21.15.46:0/979342057 <== mon.2 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb65001ce80 con 0x7fb658111570 2023-10-19T12:42:28.786 INFO:teuthology.orchestra.run.smithi046.stdout:141733920825 2023-10-19T12:42:28.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.785+0000 7fb65ee40700 1 -- 172.21.15.46:0/979342057 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fb6480a1510 msgr2=0x7fb6480a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:28.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.785+0000 7fb65ee40700 1 --2- 172.21.15.46:0/979342057 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fb6480a1510 0x7fb6480a39d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb64c005950 tx=0x7fb64c009310 comp rx=0 tx=0).stop 2023-10-19T12:42:28.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.785+0000 7fb65ee40700 1 -- 172.21.15.46:0/979342057 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb658111570 msgr2=0x7fb6581a1cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:28.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.785+0000 7fb65ee40700 1 --2- 172.21.15.46:0/979342057 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb658111570 0x7fb6581a1cf0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb65000ef90 tx=0x7fb65000c3a0 comp rx=0 tx=0).stop 2023-10-19T12:42:28.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.785+0000 7fb65ee40700 1 -- 172.21.15.46:0/979342057 shutdown_connections 2023-10-19T12:42:28.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.785+0000 7fb65ee40700 1 --2- 172.21.15.46:0/979342057 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb658111570 0x7fb6581a1cf0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:28.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.785+0000 7fb65ee40700 1 --2- 172.21.15.46:0/979342057 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb658072f60 0x7fb65819d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:28.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.785+0000 7fb65ee40700 1 --2- 172.21.15.46:0/979342057 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fb6480a1510 0x7fb6480a39d0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:28.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.785+0000 7fb65ee40700 1 --2- 172.21.15.46:0/979342057 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb658074770 0x7fb65819d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:28.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.785+0000 7fb65ee40700 1 -- 172.21.15.46:0/979342057 >> 172.21.15.46:0/979342057 conn(0x7fb6580779e0 msgr2=0x7fb658110240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:28.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.785+0000 7fb65ee40700 1 -- 172.21.15.46:0/979342057 shutdown_connections 2023-10-19T12:42:28.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:28.785+0000 7fb65ee40700 1 -- 172.21.15.46:0/979342057 wait complete. 2023-10-19T12:42:29.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:29 smithi046 ceph-mon[98509]: osdmap e90: 12 total, 12 up, 12 in 2023-10-19T12:42:29.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:29 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/1395815302' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-10-19T12:42:29.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:29 smithi046 ceph-mon[98509]: pgmap v321: 129 pgs: 1 peering, 128 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2023-10-19T12:42:29.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:29 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/979342057' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-10-19T12:42:29.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:29 smithi195 ceph-mon[134493]: osdmap e90: 12 total, 12 up, 12 in 2023-10-19T12:42:29.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:29 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/1395815302' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-10-19T12:42:29.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:29 smithi195 ceph-mon[134493]: pgmap v321: 129 pgs: 1 peering, 128 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2023-10-19T12:42:29.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:29 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/979342057' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-10-19T12:42:29.419 INFO:tasks.cephadm.ceph_manager.ceph:need seq 219043332138 got 219043332139 for osd.7 2023-10-19T12:42:29.419 DEBUG:teuthology.parallel:result is None 2023-10-19T12:42:29.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:29 smithi157 ceph-mon[134109]: osdmap e90: 12 total, 12 up, 12 in 2023-10-19T12:42:29.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:29 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/1395815302' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-10-19T12:42:29.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:29 smithi157 ceph-mon[134109]: pgmap v321: 129 pgs: 1 peering, 128 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2023-10-19T12:42:29.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:29 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/979342057' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-10-19T12:42:29.696 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738442 got 34359738444 for osd.0 2023-10-19T12:42:29.697 DEBUG:teuthology.parallel:result is None 2023-10-19T12:42:29.919 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:29.691+0000 7fabcb369700 1 -- 172.21.15.46:0/2992494468 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fabc40734e0 msgr2=0x7fabc410caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:29.919 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:29.691+0000 7fabcb369700 1 --2- 172.21.15.46:0/2992494468 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fabc40734e0 0x7fabc410caa0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fabb4009990 tx=0x7fabb4009ca0 comp rx=0 tx=0).stop 2023-10-19T12:42:29.919 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:29.692+0000 7fabcb369700 1 -- 172.21.15.46:0/2992494468 shutdown_connections 2023-10-19T12:42:29.920 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:29.692+0000 7fabcb369700 1 --2- 172.21.15.46:0/2992494468 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fabc410cfe0 0x7fabc410f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:29.920 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:29.692+0000 7fabcb369700 1 --2- 172.21.15.46:0/2992494468 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fabc4072bc0 0x7fabc4072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:29.920 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:29.692+0000 7fabcb369700 1 --2- 172.21.15.46:0/2992494468 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fabc40734e0 0x7fabc410caa0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:29.920 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:29.692+0000 7fabcb369700 1 -- 172.21.15.46:0/2992494468 >> 172.21.15.46:0/2992494468 conn(0x7fabc40fc1f0 msgr2=0x7fabc40fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:29.920 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:29.692+0000 7fabcb369700 1 -- 172.21.15.46:0/2992494468 shutdown_connections 2023-10-19T12:42:29.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:29.692+0000 7fabcb369700 1 -- 172.21.15.46:0/2992494468 wait complete. 2023-10-19T12:42:29.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:29.693+0000 7fabcb369700 1 Processor -- start 2023-10-19T12:42:29.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:29.693+0000 7fabcb369700 1 -- start start 2023-10-19T12:42:29.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:29.693+0000 7fabcb369700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fabc4072bc0 0x7fabc4198dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:29.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:29.693+0000 7fabcb369700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fabc40734e0 0x7fabc4199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:29.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:29.693+0000 7fabcb369700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fabc410cfe0 0x7fabc419d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:29.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:29.693+0000 7fabcb369700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabc419dcd0 con 0x7fabc410cfe0 2023-10-19T12:42:29.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:29.693+0000 7fabcb369700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabc419de40 con 0x7fabc4072bc0 2023-10-19T12:42:29.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:29.693+0000 7fabcb369700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabc419e000 con 0x7fabc40734e0 2023-10-19T12:42:29.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:29.694+0000 7fabc9906700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fabc410cfe0 0x7fabc419d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:29.923 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:29.694+0000 7fabc9105700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fabc4072bc0 0x7fabc4198dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:29.923 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:29.694+0000 7fabc9105700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fabc4072bc0 0x7fabc4198dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:33566/0 (socket says 172.21.15.46:33566) 2023-10-19T12:42:29.923 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:29.694+0000 7fabc9906700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fabc410cfe0 0x7fabc419d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45674/0 (socket says 172.21.15.46:45674) 2023-10-19T12:42:29.923 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:29.694+0000 7fabc9105700 1 -- 172.21.15.46:0/2991828226 learned_addr learned my addr 172.21.15.46:0/2991828226 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:42:29.923 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:29.694+0000 7fabc8904700 1 --2- 172.21.15.46:0/2991828226 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fabc40734e0 0x7fabc4199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:29.924 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:29.694+0000 7fabc9105700 1 -- 172.21.15.46:0/2991828226 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fabc40734e0 msgr2=0x7fabc4199310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:29.924 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:29.694+0000 7fabc9105700 1 --2- 172.21.15.46:0/2991828226 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fabc40734e0 0x7fabc4199310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:29.924 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:29.694+0000 7fabc9105700 1 -- 172.21.15.46:0/2991828226 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fabc410cfe0 msgr2=0x7fabc419d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:29.924 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:29.694+0000 7fabc9105700 1 --2- 172.21.15.46:0/2991828226 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fabc410cfe0 0x7fabc419d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:29.924 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:29.694+0000 7fabc9105700 1 -- 172.21.15.46:0/2991828226 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabc0009520 con 0x7fabc4072bc0 2023-10-19T12:42:29.925 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:29.694+0000 7fabc9906700 1 --2- 172.21.15.46:0/2991828226 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fabc410cfe0 0x7fabc419d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:42:29.925 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:29.694+0000 7fabc9105700 1 --2- 172.21.15.46:0/2991828226 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fabc4072bc0 0x7fabc4198dd0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fabc000eb30 tx=0x7fabc000ee40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:29.925 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:29.695+0000 7fabba7fc700 1 -- 172.21.15.46:0/2991828226 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc0009880 con 0x7fabc4072bc0 2023-10-19T12:42:29.925 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:29.695+0000 7fabcb369700 1 -- 172.21.15.46:0/2991828226 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabb40095f0 con 0x7fabc4072bc0 2023-10-19T12:42:29.925 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:29.695+0000 7fabba7fc700 1 -- 172.21.15.46:0/2991828226 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fabc00044e0 con 0x7fabc4072bc0 2023-10-19T12:42:29.926 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:29.695+0000 7fabba7fc700 1 -- 172.21.15.46:0/2991828226 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc0003d80 con 0x7fabc4072bc0 2023-10-19T12:42:29.926 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:29.695+0000 7fabcb369700 1 -- 172.21.15.46:0/2991828226 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabc41a5970 con 0x7fabc4072bc0 2023-10-19T12:42:29.926 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:29.696+0000 7fabcb369700 1 -- 172.21.15.46:0/2991828226 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabc41081f0 con 0x7fabc4072bc0 2023-10-19T12:42:29.926 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:29.698+0000 7fabba7fc700 1 -- 172.21.15.46:0/2991828226 <== mon.2 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7fabc0003f20 con 0x7fabc4072bc0 2023-10-19T12:42:29.926 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:29.699+0000 7fabba7fc700 1 --2- 172.21.15.46:0/2991828226 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fabb00a1510 0x7fabb00a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:29.927 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:29.700+0000 7fabba7fc700 1 -- 172.21.15.46:0/2991828226 <== mon.2 v2:172.21.15.157:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fabc0014070 con 0x7fabc4072bc0 2023-10-19T12:42:29.927 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:29.700+0000 7fabc8904700 1 --2- 172.21.15.46:0/2991828226 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fabb00a1510 0x7fabb00a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:29.927 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:29.700+0000 7fabc8904700 1 --2- 172.21.15.46:0/2991828226 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fabb00a1510 0x7fabb00a39d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fabb400b6f0 tx=0x7fabb400b280 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:29.927 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:29.702+0000 7fabba7fc700 1 -- 172.21.15.46:0/2991828226 <== mon.2 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fabc00968c0 con 0x7fabc4072bc0 2023-10-19T12:42:29.931 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:29.928+0000 7fabcb369700 1 -- 172.21.15.46:0/2991828226 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fabc4074270 con 0x7fabc4072bc0 2023-10-19T12:42:29.932 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:29.929+0000 7fabba7fc700 1 -- 172.21.15.46:0/2991828226 <== mon.2 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fabc0099ee0 con 0x7fabc4072bc0 2023-10-19T12:42:29.932 INFO:teuthology.orchestra.run.smithi046.stdout:77309411396 2023-10-19T12:42:29.935 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:29.931+0000 7fabcb369700 1 -- 172.21.15.46:0/2991828226 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fabb00a1510 msgr2=0x7fabb00a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:29.935 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:29.931+0000 7fabcb369700 1 --2- 172.21.15.46:0/2991828226 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fabb00a1510 0x7fabb00a39d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fabb400b6f0 tx=0x7fabb400b280 comp rx=0 tx=0).stop 2023-10-19T12:42:29.935 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:29.931+0000 7fabcb369700 1 -- 172.21.15.46:0/2991828226 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fabc4072bc0 msgr2=0x7fabc4198dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:29.935 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:29.931+0000 7fabcb369700 1 --2- 172.21.15.46:0/2991828226 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fabc4072bc0 0x7fabc4198dd0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fabc000eb30 tx=0x7fabc000ee40 comp rx=0 tx=0).stop 2023-10-19T12:42:29.935 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:29.931+0000 7fabcb369700 1 -- 172.21.15.46:0/2991828226 shutdown_connections 2023-10-19T12:42:29.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:29.931+0000 7fabcb369700 1 --2- 172.21.15.46:0/2991828226 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fabc410cfe0 0x7fabc419d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:29.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:29.931+0000 7fabcb369700 1 --2- 172.21.15.46:0/2991828226 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fabc4072bc0 0x7fabc4198dd0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:29.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:29.931+0000 7fabcb369700 1 --2- 172.21.15.46:0/2991828226 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fabb00a1510 0x7fabb00a39d0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:29.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:29.931+0000 7fabcb369700 1 --2- 172.21.15.46:0/2991828226 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fabc40734e0 0x7fabc4199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:29.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:29.931+0000 7fabcb369700 1 -- 172.21.15.46:0/2991828226 >> 172.21.15.46:0/2991828226 conn(0x7fabc40fc1f0 msgr2=0x7fabc40fdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:29.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:29.931+0000 7fabcb369700 1 -- 172.21.15.46:0/2991828226 shutdown_connections 2023-10-19T12:42:29.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:29.931+0000 7fabcb369700 1 -- 172.21.15.46:0/2991828226 wait complete. 2023-10-19T12:42:30.228 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:30 smithi046 ceph-mon[98509]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2023-10-19T12:42:30.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:30 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/2991828226' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-10-19T12:42:30.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:30 smithi195 ceph-mon[134493]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2023-10-19T12:42:30.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:30 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/2991828226' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-10-19T12:42:30.509 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757298 got 163208757301 for osd.5 2023-10-19T12:42:30.510 DEBUG:teuthology.parallel:result is None 2023-10-19T12:42:30.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:30 smithi157 ceph-mon[134109]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2023-10-19T12:42:30.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:30 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/2991828226' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-10-19T12:42:30.621 INFO:tasks.cephadm.ceph_manager.ceph:need seq 141733920823 got 141733920825 for osd.4 2023-10-19T12:42:30.622 DEBUG:teuthology.parallel:result is None 2023-10-19T12:42:30.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.748+0000 7f9f21e1e700 1 -- 172.21.15.46:0/1365435115 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f1c101260 msgr2=0x7f9f1c10d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:30.754 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.748+0000 7f9f21e1e700 1 --2- 172.21.15.46:0/1365435115 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f1c101260 0x7f9f1c10d650 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f9f1400b0a0 tx=0x7f9f1400b3b0 comp rx=0 tx=0).stop 2023-10-19T12:42:30.754 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.748+0000 7f9f21e1e700 1 -- 172.21.15.46:0/1365435115 shutdown_connections 2023-10-19T12:42:30.754 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.748+0000 7f9f21e1e700 1 --2- 172.21.15.46:0/1365435115 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f1c101260 0x7f9f1c10d650 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:30.754 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.748+0000 7f9f21e1e700 1 --2- 172.21.15.46:0/1365435115 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9f1c1057c0 0x7f9f1c105ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:30.755 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.748+0000 7f9f21e1e700 1 --2- 172.21.15.46:0/1365435115 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9f1c1008a0 0x7f9f1c100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:30.755 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.748+0000 7f9f21e1e700 1 -- 172.21.15.46:0/1365435115 >> 172.21.15.46:0/1365435115 conn(0x7f9f1c0779e0 msgr2=0x7f9f1c077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:30.755 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.748+0000 7f9f21e1e700 1 -- 172.21.15.46:0/1365435115 shutdown_connections 2023-10-19T12:42:30.755 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.748+0000 7f9f21e1e700 1 -- 172.21.15.46:0/1365435115 wait complete. 2023-10-19T12:42:30.755 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.750+0000 7f9f21e1e700 1 Processor -- start 2023-10-19T12:42:30.755 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.750+0000 7f9f21e1e700 1 -- start start 2023-10-19T12:42:30.756 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.750+0000 7f9f21e1e700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9f1c1008a0 0x7f9f1c198ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:30.756 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.750+0000 7f9f21e1e700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9f1c101260 0x7f9f1c199410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:30.756 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.750+0000 7f9f21e1e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f1c1057c0 0x7f9f1c19d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:30.756 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.750+0000 7f9f21e1e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1c19ddd0 con 0x7f9f1c1057c0 2023-10-19T12:42:30.756 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.750+0000 7f9f21e1e700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1c19df40 con 0x7f9f1c101260 2023-10-19T12:42:30.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.750+0000 7f9f21e1e700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1c19e100 con 0x7f9f1c1008a0 2023-10-19T12:42:30.758 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.751+0000 7f9f1b7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9f1c1008a0 0x7f9f1c198ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:30.758 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.751+0000 7f9f1bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f1c1057c0 0x7f9f1c19d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:30.758 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.751+0000 7f9f1b7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9f1c1008a0 0x7f9f1c198ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:58210/0 (socket says 172.21.15.46:58210) 2023-10-19T12:42:30.758 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.751+0000 7f9f1b7fe700 1 -- 172.21.15.46:0/198876359 learned_addr learned my addr 172.21.15.46:0/198876359 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:42:30.759 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.751+0000 7f9f1affd700 1 --2- 172.21.15.46:0/198876359 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9f1c101260 0x7f9f1c199410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:30.759 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.751+0000 7f9f1bfff700 1 -- 172.21.15.46:0/198876359 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9f1c1008a0 msgr2=0x7f9f1c198ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:30.759 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.751+0000 7f9f1bfff700 1 --2- 172.21.15.46:0/198876359 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9f1c1008a0 0x7f9f1c198ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:30.759 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.751+0000 7f9f1bfff700 1 -- 172.21.15.46:0/198876359 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9f1c101260 msgr2=0x7f9f1c199410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:30.759 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.751+0000 7f9f1bfff700 1 --2- 172.21.15.46:0/198876359 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9f1c101260 0x7f9f1c199410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:30.760 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.751+0000 7f9f1bfff700 1 -- 172.21.15.46:0/198876359 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f14009d00 con 0x7f9f1c1057c0 2023-10-19T12:42:30.760 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.751+0000 7f9f1affd700 1 --2- 172.21.15.46:0/198876359 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9f1c101260 0x7f9f1c199410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T12:42:30.760 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.751+0000 7f9f1bfff700 1 --2- 172.21.15.46:0/198876359 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f1c1057c0 0x7f9f1c19d7c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f9f1400b0a0 tx=0x7f9f14007990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:30.760 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.752+0000 7f9f18ff9700 1 -- 172.21.15.46:0/198876359 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f1400e040 con 0x7f9f1c1057c0 2023-10-19T12:42:30.760 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.752+0000 7f9f18ff9700 1 -- 172.21.15.46:0/198876359 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9f1400be40 con 0x7f9f1c1057c0 2023-10-19T12:42:30.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.752+0000 7f9f21e1e700 1 -- 172.21.15.46:0/198876359 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f1c19e380 con 0x7f9f1c1057c0 2023-10-19T12:42:30.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.752+0000 7f9f18ff9700 1 -- 172.21.15.46:0/198876359 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f140052a0 con 0x7f9f1c1057c0 2023-10-19T12:42:30.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.752+0000 7f9f21e1e700 1 -- 172.21.15.46:0/198876359 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f1c1a5c40 con 0x7f9f1c1057c0 2023-10-19T12:42:30.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.753+0000 7f9f21e1e700 1 -- 172.21.15.46:0/198876359 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f1c101f30 con 0x7f9f1c1057c0 2023-10-19T12:42:30.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.755+0000 7f9f18ff9700 1 -- 172.21.15.46:0/198876359 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f9f1401d470 con 0x7f9f1c1057c0 2023-10-19T12:42:30.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.757+0000 7f9f18ff9700 1 --2- 172.21.15.46:0/198876359 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f9f040a1590 0x7f9f040a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:30.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.757+0000 7f9f18ff9700 1 -- 172.21.15.46:0/198876359 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f9f140cec50 con 0x7f9f1c1057c0 2023-10-19T12:42:30.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.757+0000 7f9f1b7fe700 1 --2- 172.21.15.46:0/198876359 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f9f040a1590 0x7f9f040a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:30.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.758+0000 7f9f1b7fe700 1 --2- 172.21.15.46:0/198876359 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f9f040a1590 0x7f9f040a3a50 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c005950 tx=0x7f9f0c009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:30.767 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.764+0000 7f9f18ff9700 1 -- 172.21.15.46:0/198876359 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f9f14097e70 con 0x7f9f1c1057c0 2023-10-19T12:42:30.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.986+0000 7f9f21e1e700 1 -- 172.21.15.46:0/198876359 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f9f1c19a1e0 con 0x7f9f1c1057c0 2023-10-19T12:42:30.990 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.986+0000 7f9f18ff9700 1 -- 172.21.15.46:0/198876359 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9f1409b490 con 0x7f9f1c1057c0 2023-10-19T12:42:30.990 INFO:teuthology.orchestra.run.smithi046.stdout:197568495664 2023-10-19T12:42:30.992 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.989+0000 7f9f21e1e700 1 -- 172.21.15.46:0/198876359 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f9f040a1590 msgr2=0x7f9f040a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:30.993 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.989+0000 7f9f21e1e700 1 --2- 172.21.15.46:0/198876359 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f9f040a1590 0x7f9f040a3a50 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c005950 tx=0x7f9f0c009260 comp rx=0 tx=0).stop 2023-10-19T12:42:30.993 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.989+0000 7f9f21e1e700 1 -- 172.21.15.46:0/198876359 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f1c1057c0 msgr2=0x7f9f1c19d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:30.993 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.989+0000 7f9f21e1e700 1 --2- 172.21.15.46:0/198876359 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f1c1057c0 0x7f9f1c19d7c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f9f1400b0a0 tx=0x7f9f14007990 comp rx=0 tx=0).stop 2023-10-19T12:42:30.993 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.989+0000 7f9f21e1e700 1 -- 172.21.15.46:0/198876359 shutdown_connections 2023-10-19T12:42:30.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.989+0000 7f9f21e1e700 1 --2- 172.21.15.46:0/198876359 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f1c1057c0 0x7f9f1c19d7c0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:30.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.989+0000 7f9f21e1e700 1 --2- 172.21.15.46:0/198876359 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f9f040a1590 0x7f9f040a3a50 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:30.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.989+0000 7f9f21e1e700 1 --2- 172.21.15.46:0/198876359 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9f1c1008a0 0x7f9f1c198ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:30.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.989+0000 7f9f21e1e700 1 --2- 172.21.15.46:0/198876359 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9f1c101260 0x7f9f1c199410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:30.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.989+0000 7f9f21e1e700 1 -- 172.21.15.46:0/198876359 >> 172.21.15.46:0/198876359 conn(0x7f9f1c0779e0 msgr2=0x7f9f1c10ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:30.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.989+0000 7f9f21e1e700 1 -- 172.21.15.46:0/198876359 shutdown_connections 2023-10-19T12:42:30.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.989+0000 7f9f21e1e700 1 -- 172.21.15.46:0/198876359 wait complete. 2023-10-19T12:42:31.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.647+0000 7fca0c636700 1 -- 172.21.15.46:0/1253817915 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca041067a0 msgr2=0x7fca04106b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:31.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.647+0000 7fca0c636700 1 --2- 172.21.15.46:0/1253817915 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca041067a0 0x7fca04106b80 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fca00009990 tx=0x7fca00009ca0 comp rx=0 tx=0).stop 2023-10-19T12:42:31.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.647+0000 7fca0c636700 1 -- 172.21.15.46:0/1253817915 shutdown_connections 2023-10-19T12:42:31.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.647+0000 7fca0c636700 1 --2- 172.21.15.46:0/1253817915 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fca04068b30 0x7fca0410d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:31.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.647+0000 7fca0c636700 1 --2- 172.21.15.46:0/1253817915 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca041067a0 0x7fca04106b80 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:31.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.647+0000 7fca0c636700 1 --2- 172.21.15.46:0/1253817915 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fca04068190 0x7fca040685f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:31.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.647+0000 7fca0c636700 1 -- 172.21.15.46:0/1253817915 >> 172.21.15.46:0/1253817915 conn(0x7fca04075790 msgr2=0x7fca04075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:31.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.647+0000 7fca0c636700 1 -- 172.21.15.46:0/1253817915 shutdown_connections 2023-10-19T12:42:31.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.647+0000 7fca0c636700 1 -- 172.21.15.46:0/1253817915 wait complete. 2023-10-19T12:42:31.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.648+0000 7fca0c636700 1 Processor -- start 2023-10-19T12:42:31.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.648+0000 7fca0c636700 1 -- start start 2023-10-19T12:42:31.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.649+0000 7fca0c636700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fca04068190 0x7fca04198ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:31.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.649+0000 7fca0c636700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fca04068b30 0x7fca04199410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:31.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.649+0000 7fca0c636700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca041067a0 0x7fca0419d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:31.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.649+0000 7fca0c636700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca0419ddd0 con 0x7fca041067a0 2023-10-19T12:42:31.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.649+0000 7fca0c636700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca0419df40 con 0x7fca04068b30 2023-10-19T12:42:31.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.649+0000 7fca0c636700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca0419e100 con 0x7fca04068190 2023-10-19T12:42:31.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.649+0000 7fca0abd3700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca041067a0 0x7fca0419d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:31.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.649+0000 7fca0a3d2700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fca04068190 0x7fca04198ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:31.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.649+0000 7fca0abd3700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca041067a0 0x7fca0419d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45692/0 (socket says 172.21.15.46:45692) 2023-10-19T12:42:31.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.649+0000 7fca0abd3700 1 -- 172.21.15.46:0/2418644562 learned_addr learned my addr 172.21.15.46:0/2418644562 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:42:31.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.649+0000 7fca09bd1700 1 --2- 172.21.15.46:0/2418644562 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fca04068b30 0x7fca04199410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:31.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.650+0000 7fca0a3d2700 1 -- 172.21.15.46:0/2418644562 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fca04068b30 msgr2=0x7fca04199410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:31.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.650+0000 7fca0a3d2700 1 --2- 172.21.15.46:0/2418644562 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fca04068b30 0x7fca04199410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:31.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.650+0000 7fca0a3d2700 1 -- 172.21.15.46:0/2418644562 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca041067a0 msgr2=0x7fca0419d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:31.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.650+0000 7fca0a3d2700 1 --2- 172.21.15.46:0/2418644562 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca041067a0 0x7fca0419d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:31.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.650+0000 7fca0a3d2700 1 -- 172.21.15.46:0/2418644562 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca000095f0 con 0x7fca04068190 2023-10-19T12:42:31.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.650+0000 7fca0abd3700 1 --2- 172.21.15.46:0/2418644562 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca041067a0 0x7fca0419d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:42:31.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.650+0000 7fca09bd1700 1 --2- 172.21.15.46:0/2418644562 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fca04068b30 0x7fca04199410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:42:31.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.650+0000 7fca0a3d2700 1 --2- 172.21.15.46:0/2418644562 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fca04068190 0x7fca04198ed0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fca00006010 tx=0x7fca0000f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:31.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.651+0000 7fc9fb7fe700 1 -- 172.21.15.46:0/2418644562 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca0001d070 con 0x7fca04068190 2023-10-19T12:42:31.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.651+0000 7fca0c636700 1 -- 172.21.15.46:0/2418644562 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca0419e380 con 0x7fca04068190 2023-10-19T12:42:31.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.651+0000 7fca0c636700 1 -- 172.21.15.46:0/2418644562 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca041a5c40 con 0x7fca04068190 2023-10-19T12:42:31.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.651+0000 7fc9fb7fe700 1 -- 172.21.15.46:0/2418644562 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fca00005050 con 0x7fca04068190 2023-10-19T12:42:31.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.651+0000 7fc9fb7fe700 1 -- 172.21.15.46:0/2418644562 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca00004a90 con 0x7fca04068190 2023-10-19T12:42:31.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.652+0000 7fca0c636700 1 -- 172.21.15.46:0/2418644562 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9e8005320 con 0x7fca04068190 2023-10-19T12:42:31.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.656+0000 7fc9fb7fe700 1 -- 172.21.15.46:0/2418644562 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7fca00004bf0 con 0x7fca04068190 2023-10-19T12:42:31.013 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.658+0000 7fc9fb7fe700 1 --2- 172.21.15.46:0/2418644562 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fc9f00a1590 0x7fc9f00a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:31.013 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.658+0000 7fc9fb7fe700 1 -- 172.21.15.46:0/2418644562 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fca000ce1b0 con 0x7fca04068190 2023-10-19T12:42:31.013 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.658+0000 7fca09bd1700 1 --2- 172.21.15.46:0/2418644562 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fc9f00a1590 0x7fc9f00a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:31.013 INFO:teuthology.orchestra.run.smithi046.stdout:107374182463 2023-10-19T12:42:31.014 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.659+0000 7fc9fb7fe700 1 -- 172.21.15.46:0/2418644562 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fca000ce690 con 0x7fca04068190 2023-10-19T12:42:31.014 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.660+0000 7fca09bd1700 1 --2- 172.21.15.46:0/2418644562 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fc9f00a1590 0x7fc9f00a3a50 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fca0419a430 tx=0x7fc9f400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:31.014 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.912+0000 7fca0c636700 1 -- 172.21.15.46:0/2418644562 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc9e8005190 con 0x7fca04068190 2023-10-19T12:42:31.014 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.912+0000 7fc9fb7fe700 1 -- 172.21.15.46:0/2418644562 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fca00097430 con 0x7fca04068190 2023-10-19T12:42:31.015 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.915+0000 7fca0c636700 1 -- 172.21.15.46:0/2418644562 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fc9f00a1590 msgr2=0x7fc9f00a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:31.015 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.915+0000 7fca0c636700 1 --2- 172.21.15.46:0/2418644562 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fc9f00a1590 0x7fc9f00a3a50 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fca0419a430 tx=0x7fc9f400b410 comp rx=0 tx=0).stop 2023-10-19T12:42:31.015 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.915+0000 7fca0c636700 1 -- 172.21.15.46:0/2418644562 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fca04068190 msgr2=0x7fca04198ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:31.015 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.915+0000 7fca0c636700 1 --2- 172.21.15.46:0/2418644562 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fca04068190 0x7fca04198ed0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fca00006010 tx=0x7fca0000f690 comp rx=0 tx=0).stop 2023-10-19T12:42:31.015 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.915+0000 7fca0c636700 1 -- 172.21.15.46:0/2418644562 shutdown_connections 2023-10-19T12:42:31.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.915+0000 7fca0c636700 1 --2- 172.21.15.46:0/2418644562 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca041067a0 0x7fca0419d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:31.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.915+0000 7fca0c636700 1 --2- 172.21.15.46:0/2418644562 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fc9f00a1590 0x7fc9f00a3a50 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:31.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.915+0000 7fca0c636700 1 --2- 172.21.15.46:0/2418644562 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fca04068190 0x7fca04198ed0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:31.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.915+0000 7fca0c636700 1 --2- 172.21.15.46:0/2418644562 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fca04068b30 0x7fca04199410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:31.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.915+0000 7fca0c636700 1 -- 172.21.15.46:0/2418644562 >> 172.21.15.46:0/2418644562 conn(0x7fca04075790 msgr2=0x7fca0410bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:31.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.915+0000 7fca0c636700 1 -- 172.21.15.46:0/2418644562 shutdown_connections 2023-10-19T12:42:31.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:30.915+0000 7fca0c636700 1 -- 172.21.15.46:0/2418644562 wait complete. 2023-10-19T12:42:31.106 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-19T12:42:31.174 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411393 got 77309411396 for osd.2 2023-10-19T12:42:31.174 DEBUG:teuthology.parallel:result is None 2023-10-19T12:42:31.194 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:31 smithi046 ceph-mon[98509]: pgmap v322: 129 pgs: 1 peering, 128 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2023-10-19T12:42:31.195 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:31 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/2418644562' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-10-19T12:42:31.195 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:31 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/198876359' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-10-19T12:42:31.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:31 smithi157 ceph-mon[134109]: pgmap v322: 129 pgs: 1 peering, 128 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2023-10-19T12:42:31.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:31 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/2418644562' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-10-19T12:42:31.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:31 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/198876359' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-10-19T12:42:31.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:31 smithi195 ceph-mon[134493]: pgmap v322: 129 pgs: 1 peering, 128 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2023-10-19T12:42:31.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:31 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/2418644562' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-10-19T12:42:31.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:31 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/198876359' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-10-19T12:42:31.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:31.779+0000 7fa844c12700 1 -- 172.21.15.46:0/3500649007 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa840101260 msgr2=0x7fa84010d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:31.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:31.779+0000 7fa844c12700 1 --2- 172.21.15.46:0/3500649007 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa840101260 0x7fa84010d650 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa83800b0a0 tx=0x7fa83800b3b0 comp rx=0 tx=0).stop 2023-10-19T12:42:31.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:31.779+0000 7fa844c12700 1 -- 172.21.15.46:0/3500649007 shutdown_connections 2023-10-19T12:42:31.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:31.779+0000 7fa844c12700 1 --2- 172.21.15.46:0/3500649007 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa840101260 0x7fa84010d650 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:31.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:31.779+0000 7fa844c12700 1 --2- 172.21.15.46:0/3500649007 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa8401057c0 0x7fa840105ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:31.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:31.779+0000 7fa844c12700 1 --2- 172.21.15.46:0/3500649007 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa8401008a0 0x7fa840100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:31.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:31.779+0000 7fa844c12700 1 -- 172.21.15.46:0/3500649007 >> 172.21.15.46:0/3500649007 conn(0x7fa8400779e0 msgr2=0x7fa840077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:31.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:31.779+0000 7fa844c12700 1 -- 172.21.15.46:0/3500649007 shutdown_connections 2023-10-19T12:42:31.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:31.779+0000 7fa844c12700 1 -- 172.21.15.46:0/3500649007 wait complete. 2023-10-19T12:42:31.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:31.780+0000 7fa844c12700 1 Processor -- start 2023-10-19T12:42:31.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:31.781+0000 7fa844c12700 1 -- start start 2023-10-19T12:42:31.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:31.781+0000 7fa844c12700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa8401008a0 0x7fa840072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:31.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:31.781+0000 7fa844c12700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa840101260 0x7fa840073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:31.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:31.781+0000 7fa844c12700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa8401057c0 0x7fa840073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:31.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:31.781+0000 7fa844c12700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8401a50c0 con 0x7fa8401008a0 2023-10-19T12:42:31.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:31.781+0000 7fa844c12700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8401a5230 con 0x7fa8401057c0 2023-10-19T12:42:31.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:31.781+0000 7fa844c12700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8401a53f0 con 0x7fa840101260 2023-10-19T12:42:31.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:31.781+0000 7fa83e59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa8401008a0 0x7fa840072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:31.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:31.781+0000 7fa83e59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa8401008a0 0x7fa840072af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45728/0 (socket says 172.21.15.46:45728) 2023-10-19T12:42:31.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:31.781+0000 7fa83e59c700 1 -- 172.21.15.46:0/3300082953 learned_addr learned my addr 172.21.15.46:0/3300082953 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:42:31.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:31.781+0000 7fa83dd9b700 1 --2- 172.21.15.46:0/3300082953 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa840101260 0x7fa840073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:31.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:31.782+0000 7fa83ed9d700 1 --2- 172.21.15.46:0/3300082953 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa8401057c0 0x7fa840073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:31.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:31.782+0000 7fa83e59c700 1 -- 172.21.15.46:0/3300082953 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa840101260 msgr2=0x7fa840073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:31.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:31.782+0000 7fa83e59c700 1 --2- 172.21.15.46:0/3300082953 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa840101260 0x7fa840073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:31.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:31.782+0000 7fa83e59c700 1 -- 172.21.15.46:0/3300082953 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa8401057c0 msgr2=0x7fa840073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:31.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:31.782+0000 7fa83e59c700 1 --2- 172.21.15.46:0/3300082953 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa8401057c0 0x7fa840073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:31.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:31.782+0000 7fa83e59c700 1 -- 172.21.15.46:0/3300082953 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa830009520 con 0x7fa8401008a0 2023-10-19T12:42:31.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:31.782+0000 7fa83ed9d700 1 --2- 172.21.15.46:0/3300082953 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa8401057c0 0x7fa840073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T12:42:31.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:31.782+0000 7fa83e59c700 1 --2- 172.21.15.46:0/3300082953 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa8401008a0 0x7fa840072af0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa83000ea50 tx=0x7fa83000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:31.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:31.782+0000 7fa82f7fe700 1 -- 172.21.15.46:0/3300082953 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83000cbd0 con 0x7fa8401008a0 2023-10-19T12:42:31.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:31.783+0000 7fa844c12700 1 -- 172.21.15.46:0/3300082953 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa838009d00 con 0x7fa8401008a0 2023-10-19T12:42:31.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:31.783+0000 7fa82f7fe700 1 -- 172.21.15.46:0/3300082953 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa83000cd30 con 0x7fa8401008a0 2023-10-19T12:42:31.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:31.783+0000 7fa82f7fe700 1 -- 172.21.15.46:0/3300082953 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8300186c0 con 0x7fa8401008a0 2023-10-19T12:42:31.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:31.783+0000 7fa844c12700 1 -- 172.21.15.46:0/3300082953 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8401a5a40 con 0x7fa8401008a0 2023-10-19T12:42:31.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:31.784+0000 7fa844c12700 1 -- 172.21.15.46:0/3300082953 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa840108da0 con 0x7fa8401008a0 2023-10-19T12:42:31.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:31.786+0000 7fa82f7fe700 1 -- 172.21.15.46:0/3300082953 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7fa830018820 con 0x7fa8401008a0 2023-10-19T12:42:31.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:31.787+0000 7fa82f7fe700 1 --2- 172.21.15.46:0/3300082953 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fa8280a1510 0x7fa8280a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:31.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:31.787+0000 7fa82f7fe700 1 -- 172.21.15.46:0/3300082953 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fa830014070 con 0x7fa8401008a0 2023-10-19T12:42:31.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:31.787+0000 7fa83dd9b700 1 --2- 172.21.15.46:0/3300082953 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fa8280a1510 0x7fa8280a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:31.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:31.788+0000 7fa83dd9b700 1 --2- 172.21.15.46:0/3300082953 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fa8280a1510 0x7fa8280a39d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fa840074220 tx=0x7fa834009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:31.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:31.791+0000 7fa82f7fe700 1 -- 172.21.15.46:0/3300082953 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa830096830 con 0x7fa8401008a0 2023-10-19T12:42:32.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:32.031+0000 7fa844c12700 1 -- 172.21.15.46:0/3300082953 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa840101f30 con 0x7fa8401008a0 2023-10-19T12:42:32.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:32.032+0000 7fa82f7fe700 1 -- 172.21.15.46:0/3300082953 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa830099e50 con 0x7fa8401008a0 2023-10-19T12:42:32.036 INFO:teuthology.orchestra.run.smithi046.stdout:55834574919 2023-10-19T12:42:32.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:32.035+0000 7fa844c12700 1 -- 172.21.15.46:0/3300082953 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fa8280a1510 msgr2=0x7fa8280a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:32.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:32.035+0000 7fa844c12700 1 --2- 172.21.15.46:0/3300082953 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fa8280a1510 0x7fa8280a39d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fa840074220 tx=0x7fa834009260 comp rx=0 tx=0).stop 2023-10-19T12:42:32.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:32.035+0000 7fa844c12700 1 -- 172.21.15.46:0/3300082953 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa8401008a0 msgr2=0x7fa840072af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:32.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:32.035+0000 7fa844c12700 1 --2- 172.21.15.46:0/3300082953 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa8401008a0 0x7fa840072af0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa83000ea50 tx=0x7fa83000ed60 comp rx=0 tx=0).stop 2023-10-19T12:42:32.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:32.035+0000 7fa844c12700 1 -- 172.21.15.46:0/3300082953 shutdown_connections 2023-10-19T12:42:32.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:32.035+0000 7fa844c12700 1 --2- 172.21.15.46:0/3300082953 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa8401057c0 0x7fa840073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:32.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:32.035+0000 7fa844c12700 1 --2- 172.21.15.46:0/3300082953 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa8401008a0 0x7fa840072af0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:32.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:32.035+0000 7fa844c12700 1 --2- 172.21.15.46:0/3300082953 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fa8280a1510 0x7fa8280a39d0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:32.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:32.035+0000 7fa844c12700 1 --2- 172.21.15.46:0/3300082953 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa840101260 0x7fa840073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:32.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:32.035+0000 7fa844c12700 1 -- 172.21.15.46:0/3300082953 >> 172.21.15.46:0/3300082953 conn(0x7fa8400779e0 msgr2=0x7fa8400fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:32.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:32.035+0000 7fa844c12700 1 -- 172.21.15.46:0/3300082953 shutdown_connections 2023-10-19T12:42:32.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:32.035+0000 7fa844c12700 1 -- 172.21.15.46:0/3300082953 wait complete. 2023-10-19T12:42:32.043 INFO:tasks.cephadm.ceph_manager.ceph:need seq 339302416408 got 339302416410 for osd.11 2023-10-19T12:42:32.043 DEBUG:teuthology.parallel:result is None 2023-10-19T12:42:32.161 INFO:tasks.cephadm.ceph_manager.ceph:need seq 197568495662 got 197568495664 for osd.6 2023-10-19T12:42:32.161 DEBUG:teuthology.parallel:result is None 2023-10-19T12:42:32.228 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:32 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/3300082953' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-10-19T12:42:32.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:32 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/3300082953' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-10-19T12:42:32.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:32 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/3300082953' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-10-19T12:42:32.670 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182460 got 107374182463 for osd.3 2023-10-19T12:42:32.671 DEBUG:teuthology.parallel:result is None 2023-10-19T12:42:33.063 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574916 got 55834574919 for osd.1 2023-10-19T12:42:33.063 DEBUG:teuthology.parallel:result is None 2023-10-19T12:42:33.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:33 smithi046 ceph-mon[98509]: pgmap v323: 129 pgs: 129 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s; 150 B/s, 1 keys/s, 1 objects/s recovering 2023-10-19T12:42:33.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:33 smithi157 ceph-mon[134109]: pgmap v323: 129 pgs: 129 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s; 150 B/s, 1 keys/s, 1 objects/s recovering 2023-10-19T12:42:33.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:33 smithi195 ceph-mon[134493]: pgmap v323: 129 pgs: 129 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s; 150 B/s, 1 keys/s, 1 objects/s recovering 2023-10-19T12:42:33.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:33.799+0000 7fe920223700 1 -- 172.21.15.46:0/2281706524 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9181056f0 msgr2=0x7fe918068190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:33.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:33.799+0000 7fe920223700 1 --2- 172.21.15.46:0/2281706524 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9181056f0 0x7fe918068190 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe9140098f0 tx=0x7fe914009c00 comp rx=0 tx=0).stop 2023-10-19T12:42:33.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:33.799+0000 7fe920223700 1 -- 172.21.15.46:0/2281706524 shutdown_connections 2023-10-19T12:42:33.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:33.799+0000 7fe920223700 1 --2- 172.21.15.46:0/2281706524 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe918103250 0x7fe918103700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:33.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:33.799+0000 7fe920223700 1 --2- 172.21.15.46:0/2281706524 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9181056f0 0x7fe918068190 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:33.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:33.799+0000 7fe920223700 1 --2- 172.21.15.46:0/2281706524 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe9180686d0 0x7fe918068b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:33.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:33.799+0000 7fe920223700 1 -- 172.21.15.46:0/2281706524 >> 172.21.15.46:0/2281706524 conn(0x7fe918075790 msgr2=0x7fe918075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:33.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:33.800+0000 7fe920223700 1 -- 172.21.15.46:0/2281706524 shutdown_connections 2023-10-19T12:42:33.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:33.800+0000 7fe920223700 1 -- 172.21.15.46:0/2281706524 wait complete. 2023-10-19T12:42:33.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:33.801+0000 7fe920223700 1 Processor -- start 2023-10-19T12:42:33.806 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:33.802+0000 7fe920223700 1 -- start start 2023-10-19T12:42:33.806 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:33.802+0000 7fe920223700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9180686d0 0x7fe91819d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:33.806 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:33.802+0000 7fe920223700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe918103250 0x7fe91819d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:33.806 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:33.802+0000 7fe920223700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9181056f0 0x7fe9181a1c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:33.806 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:33.802+0000 7fe920223700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9181a2220 con 0x7fe9180686d0 2023-10-19T12:42:33.807 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:33.802+0000 7fe920223700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9181a2390 con 0x7fe918103250 2023-10-19T12:42:33.807 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:33.802+0000 7fe920223700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9181a2550 con 0x7fe9181056f0 2023-10-19T12:42:33.808 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:33.802+0000 7fe91e7c0700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9181056f0 0x7fe9181a1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:33.808 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:33.802+0000 7fe91dfbf700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9180686d0 0x7fe91819d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:33.808 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:33.802+0000 7fe91d7be700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe918103250 0x7fe91819d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:33.808 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:33.802+0000 7fe91e7c0700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9181056f0 0x7fe9181a1c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:45052/0 (socket says 172.21.15.46:45052) 2023-10-19T12:42:33.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:33.803+0000 7fe91e7c0700 1 -- 172.21.15.46:0/3576582686 learned_addr learned my addr 172.21.15.46:0/3576582686 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:42:33.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:33.802+0000 7fe91dfbf700 1 --2- 172.21.15.46:0/3576582686 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9180686d0 0x7fe91819d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50752/0 (socket says 172.21.15.46:50752) 2023-10-19T12:42:33.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:33.803+0000 7fe91dfbf700 1 -- 172.21.15.46:0/3576582686 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9181056f0 msgr2=0x7fe9181a1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:33.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:33.803+0000 7fe91dfbf700 1 --2- 172.21.15.46:0/3576582686 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9181056f0 0x7fe9181a1c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:33.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:33.803+0000 7fe91dfbf700 1 -- 172.21.15.46:0/3576582686 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe918103250 msgr2=0x7fe91819d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:33.810 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:33.803+0000 7fe91dfbf700 1 --2- 172.21.15.46:0/3576582686 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe918103250 0x7fe91819d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:33.810 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:33.803+0000 7fe91dfbf700 1 -- 172.21.15.46:0/3576582686 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9080095f0 con 0x7fe9180686d0 2023-10-19T12:42:33.810 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:33.803+0000 7fe91d7be700 1 --2- 172.21.15.46:0/3576582686 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe918103250 0x7fe91819d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:42:33.810 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:33.803+0000 7fe91dfbf700 1 --2- 172.21.15.46:0/3576582686 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9180686d0 0x7fe91819d320 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe914009fd0 tx=0x7fe91400fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:33.810 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:33.804+0000 7fe90effd700 1 -- 172.21.15.46:0/3576582686 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe91401c070 con 0x7fe9180686d0 2023-10-19T12:42:33.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:33.804+0000 7fe90effd700 1 -- 172.21.15.46:0/3576582686 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe91400baa0 con 0x7fe9180686d0 2023-10-19T12:42:33.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:33.804+0000 7fe90effd700 1 -- 172.21.15.46:0/3576582686 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9140038e0 con 0x7fe9180686d0 2023-10-19T12:42:33.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:33.804+0000 7fe920223700 1 -- 172.21.15.46:0/3576582686 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe914009520 con 0x7fe9180686d0 2023-10-19T12:42:33.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:33.804+0000 7fe920223700 1 -- 172.21.15.46:0/3576582686 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9181a9ec0 con 0x7fe9180686d0 2023-10-19T12:42:33.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:33.806+0000 7fe920223700 1 -- 172.21.15.46:0/3576582686 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9180ffd30 con 0x7fe9180686d0 2023-10-19T12:42:33.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:33.809+0000 7fe90effd700 1 -- 172.21.15.46:0/3576582686 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7fe914020030 con 0x7fe9180686d0 2023-10-19T12:42:33.814 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:33.811+0000 7fe90effd700 1 --2- 172.21.15.46:0/3576582686 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fe9040a16e0 0x7fe9040a3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:33.814 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:33.811+0000 7fe90effd700 1 -- 172.21.15.46:0/3576582686 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fe9140ce090 con 0x7fe9180686d0 2023-10-19T12:42:33.815 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:33.811+0000 7fe91d7be700 1 --2- 172.21.15.46:0/3576582686 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fe9040a16e0 0x7fe9040a3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:33.815 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:33.812+0000 7fe91d7be700 1 --2- 172.21.15.46:0/3576582686 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fe9040a16e0 0x7fe9040a3ba0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe91819e880 tx=0x7fe908009310 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:33.819 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:33.816+0000 7fe90effd700 1 -- 172.21.15.46:0/3576582686 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fe914097330 con 0x7fe9180686d0 2023-10-19T12:42:34.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:34.036+0000 7fe920223700 1 -- 172.21.15.46:0/3576582686 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) v1 -- 0x7fe91819e630 con 0x7fe9180686d0 2023-10-19T12:42:34.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:34.037+0000 7fe90effd700 1 -- 172.21.15.46:0/3576582686 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe91409a950 con 0x7fe9180686d0 2023-10-19T12:42:34.040 INFO:teuthology.orchestra.run.smithi046.stdout:287762808867 2023-10-19T12:42:34.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:34.039+0000 7fe920223700 1 -- 172.21.15.46:0/3576582686 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fe9040a16e0 msgr2=0x7fe9040a3ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:34.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:34.039+0000 7fe920223700 1 --2- 172.21.15.46:0/3576582686 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fe9040a16e0 0x7fe9040a3ba0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe91819e880 tx=0x7fe908009310 comp rx=0 tx=0).stop 2023-10-19T12:42:34.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:34.039+0000 7fe920223700 1 -- 172.21.15.46:0/3576582686 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9180686d0 msgr2=0x7fe91819d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:34.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:34.039+0000 7fe920223700 1 --2- 172.21.15.46:0/3576582686 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9180686d0 0x7fe91819d320 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe914009fd0 tx=0x7fe91400fa00 comp rx=0 tx=0).stop 2023-10-19T12:42:34.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:34.039+0000 7fe920223700 1 -- 172.21.15.46:0/3576582686 shutdown_connections 2023-10-19T12:42:34.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:34.039+0000 7fe920223700 1 --2- 172.21.15.46:0/3576582686 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fe9040a16e0 0x7fe9040a3ba0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:34.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:34.039+0000 7fe920223700 1 --2- 172.21.15.46:0/3576582686 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9181056f0 0x7fe9181a1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:34.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:34.039+0000 7fe920223700 1 --2- 172.21.15.46:0/3576582686 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9180686d0 0x7fe91819d320 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:34.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:34.039+0000 7fe920223700 1 --2- 172.21.15.46:0/3576582686 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe918103250 0x7fe91819d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:34.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:34.039+0000 7fe920223700 1 -- 172.21.15.46:0/3576582686 >> 172.21.15.46:0/3576582686 conn(0x7fe918075790 msgr2=0x7fe9180fc730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:34.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:34.039+0000 7fe920223700 1 -- 172.21.15.46:0/3576582686 shutdown_connections 2023-10-19T12:42:34.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:34.039+0000 7fe920223700 1 -- 172.21.15.46:0/3576582686 wait complete. 2023-10-19T12:42:34.364 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:34 smithi046 ceph-mon[98509]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2023-10-19T12:42:34.364 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:34 smithi046 ceph-mon[98509]: Cluster is now healthy 2023-10-19T12:42:34.365 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:34 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/3576582686' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-10-19T12:42:34.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:34 smithi157 ceph-mon[134109]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2023-10-19T12:42:34.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:34 smithi157 ceph-mon[134109]: Cluster is now healthy 2023-10-19T12:42:34.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:34 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/3576582686' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-10-19T12:42:34.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:34 smithi195 ceph-mon[134493]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2023-10-19T12:42:34.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:34 smithi195 ceph-mon[134493]: Cluster is now healthy 2023-10-19T12:42:34.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:34 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/3576582686' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-10-19T12:42:34.733 INFO:tasks.cephadm.ceph_manager.ceph:need seq 287762808865 got 287762808867 for osd.9 2023-10-19T12:42:34.733 DEBUG:teuthology.parallel:result is None 2023-10-19T12:42:34.733 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2023-10-19T12:42:34.734 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph pg dump --format=json 2023-10-19T12:42:35.478 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:35 smithi046 ceph-mon[98509]: pgmap v324: 129 pgs: 129 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s; 150 B/s, 1 keys/s, 1 objects/s recovering 2023-10-19T12:42:35.498 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-19T12:42:35.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:35 smithi157 ceph-mon[134109]: pgmap v324: 129 pgs: 129 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s; 150 B/s, 1 keys/s, 1 objects/s recovering 2023-10-19T12:42:35.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:35 smithi195 ceph-mon[134493]: pgmap v324: 129 pgs: 129 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s; 150 B/s, 1 keys/s, 1 objects/s recovering 2023-10-19T12:42:37.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:37.195+0000 7f9da0f42700 1 -- 172.21.15.46:0/4221175791 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9d9c074770 msgr2=0x7f9d9c072a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:37.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:37.195+0000 7f9da0f42700 1 --2- 172.21.15.46:0/4221175791 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9d9c074770 0x7f9d9c072a20 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c009990 tx=0x7f9d8c009ca0 comp rx=0 tx=0).stop 2023-10-19T12:42:37.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:37.195+0000 7f9da0f42700 1 -- 172.21.15.46:0/4221175791 shutdown_connections 2023-10-19T12:42:37.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:37.195+0000 7f9da0f42700 1 --2- 172.21.15.46:0/4221175791 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9d9c111570 0x7f9d9c1139a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:37.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:37.195+0000 7f9da0f42700 1 --2- 172.21.15.46:0/4221175791 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9d9c074770 0x7f9d9c072a20 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:37.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:37.195+0000 7f9da0f42700 1 --2- 172.21.15.46:0/4221175791 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9d9c072f60 0x7f9d9c0733e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:37.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:37.195+0000 7f9da0f42700 1 -- 172.21.15.46:0/4221175791 >> 172.21.15.46:0/4221175791 conn(0x7f9d9c0779e0 msgr2=0x7f9d9c077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:37.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:37.195+0000 7f9da0f42700 1 -- 172.21.15.46:0/4221175791 shutdown_connections 2023-10-19T12:42:37.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:37.195+0000 7f9da0f42700 1 -- 172.21.15.46:0/4221175791 wait complete. 2023-10-19T12:42:37.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:37.197+0000 7f9da0f42700 1 Processor -- start 2023-10-19T12:42:37.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:37.197+0000 7f9da0f42700 1 -- start start 2023-10-19T12:42:37.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:37.198+0000 7f9da0f42700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9d9c072f60 0x7f9d9c19d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:37.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:37.198+0000 7f9da0f42700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9d9c074770 0x7f9d9c19d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:37.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:37.198+0000 7f9da0f42700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9d9c111570 0x7f9d9c1a1b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:37.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:37.198+0000 7f9da0f42700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d9c1a2140 con 0x7f9d9c074770 2023-10-19T12:42:37.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:37.198+0000 7f9da0f42700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d9c1a22b0 con 0x7f9d9c072f60 2023-10-19T12:42:37.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:37.198+0000 7f9da0f42700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d9c1a2470 con 0x7f9d9c111570 2023-10-19T12:42:37.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:37.198+0000 7f9d99d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9d9c074770 0x7f9d9c19d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:37.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:37.198+0000 7f9d99d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9d9c074770 0x7f9d9c19d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50780/0 (socket says 172.21.15.46:50780) 2023-10-19T12:42:37.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:37.198+0000 7f9d99d9b700 1 -- 172.21.15.46:0/2767613998 learned_addr learned my addr 172.21.15.46:0/2767613998 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:42:37.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:37.198+0000 7f9d9a59c700 1 --2- 172.21.15.46:0/2767613998 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9d9c072f60 0x7f9d9c19d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:37.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:37.198+0000 7f9d9ad9d700 1 --2- 172.21.15.46:0/2767613998 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9d9c111570 0x7f9d9c1a1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:37.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:37.199+0000 7f9d99d9b700 1 -- 172.21.15.46:0/2767613998 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9d9c111570 msgr2=0x7f9d9c1a1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:37.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:37.199+0000 7f9d99d9b700 1 --2- 172.21.15.46:0/2767613998 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9d9c111570 0x7f9d9c1a1b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:37.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:37.199+0000 7f9d99d9b700 1 -- 172.21.15.46:0/2767613998 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9d9c072f60 msgr2=0x7f9d9c19d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:37.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:37.199+0000 7f9d99d9b700 1 --2- 172.21.15.46:0/2767613998 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9d9c072f60 0x7f9d9c19d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:37.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:37.199+0000 7f9d99d9b700 1 -- 172.21.15.46:0/2767613998 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d8c0095f0 con 0x7f9d9c074770 2023-10-19T12:42:37.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:37.199+0000 7f9d9ad9d700 1 --2- 172.21.15.46:0/2767613998 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9d9c111570 0x7f9d9c1a1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:42:37.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:37.199+0000 7f9d9a59c700 1 --2- 172.21.15.46:0/2767613998 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9d9c072f60 0x7f9d9c19d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:42:37.206 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:37.199+0000 7f9d99d9b700 1 --2- 172.21.15.46:0/2767613998 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9d9c074770 0x7f9d9c19d7f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f9d9000d980 tx=0x7f9d9000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:37.207 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:37.199+0000 7f9d8b7fe700 1 -- 172.21.15.46:0/2767613998 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d90004220 con 0x7f9d9c074770 2023-10-19T12:42:37.207 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:37.199+0000 7f9d8b7fe700 1 -- 172.21.15.46:0/2767613998 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9d90007640 con 0x7f9d9c074770 2023-10-19T12:42:37.207 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:37.199+0000 7f9d8b7fe700 1 -- 172.21.15.46:0/2767613998 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d90005690 con 0x7f9d9c074770 2023-10-19T12:42:37.207 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:37.199+0000 7f9da0f42700 1 -- 172.21.15.46:0/2767613998 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d9c1a2750 con 0x7f9d9c074770 2023-10-19T12:42:37.207 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:37.199+0000 7f9da0f42700 1 -- 172.21.15.46:0/2767613998 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d9c1a9fb0 con 0x7f9d9c074770 2023-10-19T12:42:37.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:37.201+0000 7f9da0f42700 1 -- 172.21.15.46:0/2767613998 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d9c0740b0 con 0x7f9d9c074770 2023-10-19T12:42:37.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:37.203+0000 7f9d8b7fe700 1 -- 172.21.15.46:0/2767613998 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f9d90004750 con 0x7f9d9c074770 2023-10-19T12:42:37.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:37.204+0000 7f9d8b7fe700 1 --2- 172.21.15.46:0/2767613998 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f9d840a1590 0x7f9d840a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:37.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:37.204+0000 7f9d8b7fe700 1 -- 172.21.15.46:0/2767613998 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f9d900ccf90 con 0x7f9d9c074770 2023-10-19T12:42:37.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:37.204+0000 7f9d9a59c700 1 --2- 172.21.15.46:0/2767613998 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f9d840a1590 0x7f9d840a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:37.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:37.205+0000 7f9d9a59c700 1 --2- 172.21.15.46:0/2767613998 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f9d840a1590 0x7f9d840a3a50 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c006010 tx=0x7f9d8c00b260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:37.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:37.208+0000 7f9d8b7fe700 1 -- 172.21.15.46:0/2767613998 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f9d90096120 con 0x7f9d9c074770 2023-10-19T12:42:37.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:37.418+0000 7f9da0f42700 1 -- 172.21.15.46:0/2767613998 --> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9d9c19e630 con 0x7f9d840a1590 2023-10-19T12:42:37.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:37.433+0000 7f9d8b7fe700 1 -- 172.21.15.46:0/2767613998 <== mgr.14150 v2:172.21.15.46:6800/3168073651 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+426659 (secure 0 0 0) 0x7f9d9c19e630 con 0x7f9d840a1590 2023-10-19T12:42:37.443 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:42:37.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:37.438+0000 7f9da0f42700 1 -- 172.21.15.46:0/2767613998 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f9d840a1590 msgr2=0x7f9d840a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:37.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:37.438+0000 7f9da0f42700 1 --2- 172.21.15.46:0/2767613998 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f9d840a1590 0x7f9d840a3a50 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c006010 tx=0x7f9d8c00b260 comp rx=0 tx=0).stop 2023-10-19T12:42:37.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:37.438+0000 7f9da0f42700 1 -- 172.21.15.46:0/2767613998 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9d9c074770 msgr2=0x7f9d9c19d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:37.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:37.438+0000 7f9da0f42700 1 --2- 172.21.15.46:0/2767613998 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9d9c074770 0x7f9d9c19d7f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f9d9000d980 tx=0x7f9d9000dc90 comp rx=0 tx=0).stop 2023-10-19T12:42:37.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:37.439+0000 7f9da0f42700 1 -- 172.21.15.46:0/2767613998 shutdown_connections 2023-10-19T12:42:37.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:37.439+0000 7f9da0f42700 1 --2- 172.21.15.46:0/2767613998 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f9d840a1590 0x7f9d840a3a50 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:37.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:37.439+0000 7f9da0f42700 1 --2- 172.21.15.46:0/2767613998 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9d9c111570 0x7f9d9c1a1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:37.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:37.439+0000 7f9da0f42700 1 --2- 172.21.15.46:0/2767613998 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9d9c072f60 0x7f9d9c19d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:37.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:37.439+0000 7f9da0f42700 1 --2- 172.21.15.46:0/2767613998 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9d9c074770 0x7f9d9c19d7f0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:37.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:37.439+0000 7f9da0f42700 1 -- 172.21.15.46:0/2767613998 >> 172.21.15.46:0/2767613998 conn(0x7f9d9c0779e0 msgr2=0x7f9d9c1101a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:37.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:37.439+0000 7f9da0f42700 1 -- 172.21.15.46:0/2767613998 shutdown_connections 2023-10-19T12:42:37.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:37.439+0000 7f9da0f42700 1 -- 172.21.15.46:0/2767613998 wait complete. 2023-10-19T12:42:37.449 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-10-19T12:42:37.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:37 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:42:37.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:37 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:42:37.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:37 smithi046 ceph-mon[98509]: pgmap v325: 129 pgs: 129 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s; 126 B/s, 1 keys/s, 1 objects/s recovering 2023-10-19T12:42:37.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:37 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:42:37.730 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:37 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:42:37.730 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:37 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:42:37.837 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:37 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:42:37.838 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:37 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:42:37.838 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:37 smithi157 ceph-mon[134109]: pgmap v325: 129 pgs: 129 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s; 126 B/s, 1 keys/s, 1 objects/s recovering 2023-10-19T12:42:37.838 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:37 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:42:37.838 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:37 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:42:37.838 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:37 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:42:37.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:37 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:42:37.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:37 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:42:37.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:37 smithi195 ceph-mon[134493]: pgmap v325: 129 pgs: 129 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s; 126 B/s, 1 keys/s, 1 objects/s recovering 2023-10-19T12:42:37.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:37 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:42:37.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:37 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:42:37.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:37 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:42:38.008 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":325,"stamp":"2023-10-19T12:42:36.656843+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":657867,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":634,"num_read_kb":441,"num_write":421,"num_write_kb":3077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":1181940,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":347,"ondisk_log_size":347,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":421,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":338300,"kb_used_data":14032,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124603524,"statfs":{"total":1151940427776,"available":1151594008576,"internally_reserved":0,"allocated":14368768,"data_stored":7871620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19130,"internal_metadata":331855174},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":47,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":1204,"num_keys_recovered":10,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.542087"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.123689+0000","last_change":"2023-10-19T12:41:19.300761+0000","last_active":"2023-10-19T12:42:27.123689+0000","last_peered":"2023-10-19T12:42:27.123689+0000","last_clean":"2023-10-19T12:42:27.123689+0000","last_became_active":"2023-10-19T12:41:19.300431+0000","last_became_peered":"2023-10-19T12:41:19.300431+0000","last_unstale":"2023-10-19T12:42:27.123689+0000","last_undegraded":"2023-10-19T12:42:27.123689+0000","last_fullsized":"2023-10-19T12:42:27.123689+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-21T00:36:29.735726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.129102+0000","last_change":"2023-10-19T12:41:19.300748+0000","last_active":"2023-10-19T12:42:27.129102+0000","last_peered":"2023-10-19T12:42:27.129102+0000","last_clean":"2023-10-19T12:42:27.129102+0000","last_became_active":"2023-10-19T12:41:19.294769+0000","last_became_peered":"2023-10-19T12:41:19.294769+0000","last_unstale":"2023-10-19T12:42:27.129102+0000","last_undegraded":"2023-10-19T12:42:27.129102+0000","last_fullsized":"2023-10-19T12:42:27.129102+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T23:04:58.055573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.128929+0000","last_change":"2023-10-19T12:41:19.294264+0000","last_active":"2023-10-19T12:42:27.128929+0000","last_peered":"2023-10-19T12:42:27.128929+0000","last_clean":"2023-10-19T12:42:27.128929+0000","last_became_active":"2023-10-19T12:41:19.293878+0000","last_became_peered":"2023-10-19T12:41:19.293878+0000","last_unstale":"2023-10-19T12:42:27.128929+0000","last_undegraded":"2023-10-19T12:42:27.128929+0000","last_fullsized":"2023-10-19T12:42:27.128929+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:11:01.049036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:28.129602+0000","last_change":"2023-10-19T12:42:28.129235+0000","last_active":"2023-10-19T12:42:28.129602+0000","last_peered":"2023-10-19T12:42:28.129602+0000","last_clean":"2023-10-19T12:42:28.129602+0000","last_became_active":"2023-10-19T12:42:28.128818+0000","last_became_peered":"2023-10-19T12:42:28.128818+0000","last_unstale":"2023-10-19T12:42:28.129602+0000","last_undegraded":"2023-10-19T12:42:28.129602+0000","last_fullsized":"2023-10-19T12:42:28.129602+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:16:26.558697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.121010+0000","last_change":"2023-10-19T12:41:19.301164+0000","last_active":"2023-10-19T12:42:27.121010+0000","last_peered":"2023-10-19T12:42:27.121010+0000","last_clean":"2023-10-19T12:42:27.121010+0000","last_became_active":"2023-10-19T12:41:19.300920+0000","last_became_peered":"2023-10-19T12:41:19.300920+0000","last_unstale":"2023-10-19T12:42:27.121010+0000","last_undegraded":"2023-10-19T12:42:27.121010+0000","last_fullsized":"2023-10-19T12:42:27.121010+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:15:40.211319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.124468+0000","last_change":"2023-10-19T12:41:19.292866+0000","last_active":"2023-10-19T12:42:27.124468+0000","last_peered":"2023-10-19T12:42:27.124468+0000","last_clean":"2023-10-19T12:42:27.124468+0000","last_became_active":"2023-10-19T12:41:19.292392+0000","last_became_peered":"2023-10-19T12:41:19.292392+0000","last_unstale":"2023-10-19T12:42:27.124468+0000","last_undegraded":"2023-10-19T12:42:27.124468+0000","last_fullsized":"2023-10-19T12:42:27.124468+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:37:34.373704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:28.127944+0000","last_change":"2023-10-19T12:42:28.127944+0000","last_active":"2023-10-19T12:42:28.127944+0000","last_peered":"2023-10-19T12:42:28.127944+0000","last_clean":"2023-10-19T12:42:28.127944+0000","last_became_active":"2023-10-19T12:42:28.127619+0000","last_became_peered":"2023-10-19T12:42:28.127619+0000","last_unstale":"2023-10-19T12:42:28.127944+0000","last_undegraded":"2023-10-19T12:42:28.127944+0000","last_fullsized":"2023-10-19T12:42:28.127944+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:01:27.131472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,8],"acting":[7,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.124187+0000","last_change":"2023-10-19T12:41:19.290501+0000","last_active":"2023-10-19T12:42:27.124187+0000","last_peered":"2023-10-19T12:42:27.124187+0000","last_clean":"2023-10-19T12:42:27.124187+0000","last_became_active":"2023-10-19T12:41:19.290080+0000","last_became_peered":"2023-10-19T12:41:19.290080+0000","last_unstale":"2023-10-19T12:42:27.124187+0000","last_undegraded":"2023-10-19T12:42:27.124187+0000","last_fullsized":"2023-10-19T12:42:27.124187+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:40:19.827896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.125228+0000","last_change":"2023-10-19T12:41:19.304631+0000","last_active":"2023-10-19T12:42:27.125228+0000","last_peered":"2023-10-19T12:42:27.125228+0000","last_clean":"2023-10-19T12:42:27.125228+0000","last_became_active":"2023-10-19T12:41:19.301990+0000","last_became_peered":"2023-10-19T12:41:19.301990+0000","last_unstale":"2023-10-19T12:42:27.125228+0000","last_undegraded":"2023-10-19T12:42:27.125228+0000","last_fullsized":"2023-10-19T12:42:27.125228+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:50:46.128888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.124659+0000","last_change":"2023-10-19T12:41:19.294366+0000","last_active":"2023-10-19T12:42:27.124659+0000","last_peered":"2023-10-19T12:42:27.124659+0000","last_clean":"2023-10-19T12:42:27.124659+0000","last_became_active":"2023-10-19T12:41:19.292644+0000","last_became_peered":"2023-10-19T12:41:19.292644+0000","last_unstale":"2023-10-19T12:42:27.124659+0000","last_undegraded":"2023-10-19T12:42:27.124659+0000","last_fullsized":"2023-10-19T12:42:27.124659+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:59:30.111950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.119177+0000","last_change":"2023-10-19T12:41:19.290054+0000","last_active":"2023-10-19T12:42:27.119177+0000","last_peered":"2023-10-19T12:42:27.119177+0000","last_clean":"2023-10-19T12:42:27.119177+0000","last_became_active":"2023-10-19T12:41:19.289739+0000","last_became_peered":"2023-10-19T12:41:19.289739+0000","last_unstale":"2023-10-19T12:42:27.119177+0000","last_undegraded":"2023-10-19T12:42:27.119177+0000","last_fullsized":"2023-10-19T12:42:27.119177+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:30:36.398762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.122485+0000","last_change":"2023-10-19T12:41:19.295309+0000","last_active":"2023-10-19T12:42:27.122485+0000","last_peered":"2023-10-19T12:42:27.122485+0000","last_clean":"2023-10-19T12:42:27.122485+0000","last_became_active":"2023-10-19T12:41:19.295009+0000","last_became_peered":"2023-10-19T12:41:19.295009+0000","last_unstale":"2023-10-19T12:42:27.122485+0000","last_undegraded":"2023-10-19T12:42:27.122485+0000","last_fullsized":"2023-10-19T12:42:27.122485+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:27:33.798071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.124779+0000","last_change":"2023-10-19T12:41:19.302920+0000","last_active":"2023-10-19T12:42:27.124779+0000","last_peered":"2023-10-19T12:42:27.124779+0000","last_clean":"2023-10-19T12:42:27.124779+0000","last_became_active":"2023-10-19T12:41:19.300250+0000","last_became_peered":"2023-10-19T12:41:19.300250+0000","last_unstale":"2023-10-19T12:42:27.124779+0000","last_undegraded":"2023-10-19T12:42:27.124779+0000","last_fullsized":"2023-10-19T12:42:27.124779+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:51:47.487907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.128543+0000","last_change":"2023-10-19T12:41:19.300654+0000","last_active":"2023-10-19T12:42:27.128543+0000","last_peered":"2023-10-19T12:42:27.128543+0000","last_clean":"2023-10-19T12:42:27.128543+0000","last_became_active":"2023-10-19T12:41:19.295408+0000","last_became_peered":"2023-10-19T12:41:19.295408+0000","last_unstale":"2023-10-19T12:42:27.128543+0000","last_undegraded":"2023-10-19T12:42:27.128543+0000","last_fullsized":"2023-10-19T12:42:27.128543+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:53:47.039077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.128371+0000","last_change":"2023-10-19T12:41:19.293141+0000","last_active":"2023-10-19T12:42:27.128371+0000","last_peered":"2023-10-19T12:42:27.128371+0000","last_clean":"2023-10-19T12:42:27.128371+0000","last_became_active":"2023-10-19T12:41:19.290790+0000","last_became_peered":"2023-10-19T12:41:19.290790+0000","last_unstale":"2023-10-19T12:42:27.128371+0000","last_undegraded":"2023-10-19T12:42:27.128371+0000","last_fullsized":"2023-10-19T12:42:27.128371+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:23:44.757080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.123994+0000","last_change":"2023-10-19T12:41:19.299670+0000","last_active":"2023-10-19T12:42:27.123994+0000","last_peered":"2023-10-19T12:42:27.123994+0000","last_clean":"2023-10-19T12:42:27.123994+0000","last_became_active":"2023-10-19T12:41:19.299375+0000","last_became_peered":"2023-10-19T12:41:19.299375+0000","last_unstale":"2023-10-19T12:42:27.123994+0000","last_undegraded":"2023-10-19T12:42:27.123994+0000","last_fullsized":"2023-10-19T12:42:27.123994+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:30:23.234790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.123761+0000","last_change":"2023-10-19T12:41:19.300359+0000","last_active":"2023-10-19T12:42:27.123761+0000","last_peered":"2023-10-19T12:42:27.123761+0000","last_clean":"2023-10-19T12:42:27.123761+0000","last_became_active":"2023-10-19T12:41:19.300032+0000","last_became_peered":"2023-10-19T12:41:19.300032+0000","last_unstale":"2023-10-19T12:42:27.123761+0000","last_undegraded":"2023-10-19T12:42:27.123761+0000","last_fullsized":"2023-10-19T12:42:27.123761+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-21T00:33:24.621723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.119382+0000","last_change":"2023-10-19T12:41:19.288276+0000","last_active":"2023-10-19T12:42:27.119382+0000","last_peered":"2023-10-19T12:42:27.119382+0000","last_clean":"2023-10-19T12:42:27.119382+0000","last_became_active":"2023-10-19T12:41:19.287905+0000","last_became_peered":"2023-10-19T12:41:19.287905+0000","last_unstale":"2023-10-19T12:42:27.119382+0000","last_undegraded":"2023-10-19T12:42:27.119382+0000","last_fullsized":"2023-10-19T12:42:27.119382+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:46:15.640987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.116978+0000","last_change":"2023-10-19T12:41:19.300682+0000","last_active":"2023-10-19T12:42:27.116978+0000","last_peered":"2023-10-19T12:42:27.116978+0000","last_clean":"2023-10-19T12:42:27.116978+0000","last_became_active":"2023-10-19T12:41:19.300347+0000","last_became_peered":"2023-10-19T12:41:19.300347+0000","last_unstale":"2023-10-19T12:42:27.116978+0000","last_undegraded":"2023-10-19T12:42:27.116978+0000","last_fullsized":"2023-10-19T12:42:27.116978+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T21:21:31.772556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.116324+0000","last_change":"2023-10-19T12:41:23.337419+0000","last_active":"2023-10-19T12:42:27.116324+0000","last_peered":"2023-10-19T12:42:27.116324+0000","last_clean":"2023-10-19T12:42:27.116324+0000","last_became_active":"2023-10-19T12:41:23.337046+0000","last_became_peered":"2023-10-19T12:41:23.337046+0000","last_unstale":"2023-10-19T12:42:27.116324+0000","last_undegraded":"2023-10-19T12:42:27.116324+0000","last_fullsized":"2023-10-19T12:42:27.116324+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-21T00:20:22.732851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"88'13","reported_seq":79,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:32.379376+0000","last_change":"2023-10-19T12:41:18.282453+0000","last_active":"2023-10-19T12:42:32.379376+0000","last_peered":"2023-10-19T12:42:32.379376+0000","last_clean":"2023-10-19T12:42:32.379376+0000","last_became_active":"2023-10-19T12:41:18.281705+0000","last_became_peered":"2023-10-19T12:41:18.281705+0000","last_unstale":"2023-10-19T12:42:32.379376+0000","last_undegraded":"2023-10-19T12:42:32.379376+0000","last_fullsized":"2023-10-19T12:42:32.379376+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T21:12:33.877631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.126139+0000","last_change":"2023-10-19T12:41:19.292175+0000","last_active":"2023-10-19T12:42:27.126139+0000","last_peered":"2023-10-19T12:42:27.126139+0000","last_clean":"2023-10-19T12:42:27.126139+0000","last_became_active":"2023-10-19T12:41:19.291867+0000","last_became_peered":"2023-10-19T12:41:19.291867+0000","last_unstale":"2023-10-19T12:42:27.126139+0000","last_undegraded":"2023-10-19T12:42:27.126139+0000","last_fullsized":"2023-10-19T12:42:27.126139+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:22:12.255839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.121154+0000","last_change":"2023-10-19T12:41:23.340447+0000","last_active":"2023-10-19T12:42:27.121154+0000","last_peered":"2023-10-19T12:42:27.121154+0000","last_clean":"2023-10-19T12:42:27.121154+0000","last_became_active":"2023-10-19T12:41:23.340074+0000","last_became_peered":"2023-10-19T12:41:23.340074+0000","last_unstale":"2023-10-19T12:42:27.121154+0000","last_undegraded":"2023-10-19T12:42:27.121154+0000","last_fullsized":"2023-10-19T12:42:27.121154+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:12:11.828854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"88'2","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.126237+0000","last_change":"2023-10-19T12:41:18.297822+0000","last_active":"2023-10-19T12:42:27.126237+0000","last_peered":"2023-10-19T12:42:27.126237+0000","last_clean":"2023-10-19T12:42:27.126237+0000","last_became_active":"2023-10-19T12:41:18.297526+0000","last_became_peered":"2023-10-19T12:41:18.297526+0000","last_unstale":"2023-10-19T12:42:27.126237+0000","last_undegraded":"2023-10-19T12:42:27.126237+0000","last_fullsized":"2023-10-19T12:42:27.126237+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:59:28.110110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.130229+0000","last_change":"2023-10-19T12:41:19.309918+0000","last_active":"2023-10-19T12:42:27.130229+0000","last_peered":"2023-10-19T12:42:27.130229+0000","last_clean":"2023-10-19T12:42:27.130229+0000","last_became_active":"2023-10-19T12:41:19.309391+0000","last_became_peered":"2023-10-19T12:41:19.309391+0000","last_unstale":"2023-10-19T12:42:27.130229+0000","last_undegraded":"2023-10-19T12:42:27.130229+0000","last_fullsized":"2023-10-19T12:42:27.130229+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:52:49.320469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.121566+0000","last_change":"2023-10-19T12:41:23.337296+0000","last_active":"2023-10-19T12:42:27.121566+0000","last_peered":"2023-10-19T12:42:27.121566+0000","last_clean":"2023-10-19T12:42:27.121566+0000","last_became_active":"2023-10-19T12:41:23.336836+0000","last_became_peered":"2023-10-19T12:41:23.336836+0000","last_unstale":"2023-10-19T12:42:27.121566+0000","last_undegraded":"2023-10-19T12:42:27.121566+0000","last_fullsized":"2023-10-19T12:42:27.121566+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:15:25.400517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"88'12","reported_seq":55,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:28.174505+0000","last_change":"2023-10-19T12:42:28.174505+0000","last_active":"2023-10-19T12:42:28.174505+0000","last_peered":"2023-10-19T12:42:28.174505+0000","last_clean":"2023-10-19T12:42:28.174505+0000","last_became_active":"2023-10-19T12:42:28.165270+0000","last_became_peered":"2023-10-19T12:42:28.165270+0000","last_unstale":"2023-10-19T12:42:28.174505+0000","last_undegraded":"2023-10-19T12:42:28.174505+0000","last_fullsized":"2023-10-19T12:42:28.174505+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:54:50.199916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.124813+0000","last_change":"2023-10-19T12:41:19.301628+0000","last_active":"2023-10-19T12:42:27.124813+0000","last_peered":"2023-10-19T12:42:27.124813+0000","last_clean":"2023-10-19T12:42:27.124813+0000","last_became_active":"2023-10-19T12:41:19.301343+0000","last_became_peered":"2023-10-19T12:41:19.301343+0000","last_unstale":"2023-10-19T12:42:27.124813+0000","last_undegraded":"2023-10-19T12:42:27.124813+0000","last_fullsized":"2023-10-19T12:42:27.124813+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:02:31.273024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.121333+0000","last_change":"2023-10-19T12:41:23.330222+0000","last_active":"2023-10-19T12:42:27.121333+0000","last_peered":"2023-10-19T12:42:27.121333+0000","last_clean":"2023-10-19T12:42:27.121333+0000","last_became_active":"2023-10-19T12:41:23.329838+0000","last_became_peered":"2023-10-19T12:41:23.329838+0000","last_unstale":"2023-10-19T12:42:27.121333+0000","last_undegraded":"2023-10-19T12:42:27.121333+0000","last_fullsized":"2023-10-19T12:42:27.121333+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T21:40:52.899198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"88'5","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:28.133876+0000","last_change":"2023-10-19T12:42:28.133484+0000","last_active":"2023-10-19T12:42:28.133876+0000","last_peered":"2023-10-19T12:42:28.133876+0000","last_clean":"2023-10-19T12:42:28.133876+0000","last_became_active":"2023-10-19T12:42:28.126495+0000","last_became_peered":"2023-10-19T12:42:28.126495+0000","last_unstale":"2023-10-19T12:42:28.133876+0000","last_undegraded":"2023-10-19T12:42:28.133876+0000","last_fullsized":"2023-10-19T12:42:28.133876+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T21:28:29.956191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:28.129032+0000","last_change":"2023-10-19T12:42:28.129032+0000","last_active":"2023-10-19T12:42:28.129032+0000","last_peered":"2023-10-19T12:42:28.129032+0000","last_clean":"2023-10-19T12:42:28.129032+0000","last_became_active":"2023-10-19T12:42:28.128562+0000","last_became_peered":"2023-10-19T12:42:28.128562+0000","last_unstale":"2023-10-19T12:42:28.129032+0000","last_undegraded":"2023-10-19T12:42:28.129032+0000","last_fullsized":"2023-10-19T12:42:28.129032+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:52:14.264191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.116859+0000","last_change":"2023-10-19T12:41:23.330626+0000","last_active":"2023-10-19T12:42:27.116859+0000","last_peered":"2023-10-19T12:42:27.116859+0000","last_clean":"2023-10-19T12:42:27.116859+0000","last_became_active":"2023-10-19T12:41:23.330250+0000","last_became_peered":"2023-10-19T12:41:23.330250+0000","last_unstale":"2023-10-19T12:42:27.116859+0000","last_undegraded":"2023-10-19T12:42:27.116859+0000","last_fullsized":"2023-10-19T12:42:27.116859+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:09:48.428636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"88'5","reported_seq":88,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:34.137378+0000","last_change":"2023-10-19T12:42:28.136196+0000","last_active":"2023-10-19T12:42:34.137378+0000","last_peered":"2023-10-19T12:42:34.137378+0000","last_clean":"2023-10-19T12:42:34.137378+0000","last_became_active":"2023-10-19T12:42:28.126762+0000","last_became_peered":"2023-10-19T12:42:28.126762+0000","last_unstale":"2023-10-19T12:42:34.137378+0000","last_undegraded":"2023-10-19T12:42:34.137378+0000","last_fullsized":"2023-10-19T12:42:34.137378+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:04:58.098356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":45,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":622,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.119573+0000","last_change":"2023-10-19T12:41:19.285423+0000","last_active":"2023-10-19T12:42:27.119573+0000","last_peered":"2023-10-19T12:42:27.119573+0000","last_clean":"2023-10-19T12:42:27.119573+0000","last_became_active":"2023-10-19T12:41:19.285110+0000","last_became_peered":"2023-10-19T12:41:19.285110+0000","last_unstale":"2023-10-19T12:42:27.119573+0000","last_undegraded":"2023-10-19T12:42:27.119573+0000","last_fullsized":"2023-10-19T12:42:27.119573+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:27:51.707594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.116601+0000","last_change":"2023-10-19T12:41:23.343240+0000","last_active":"2023-10-19T12:42:27.116601+0000","last_peered":"2023-10-19T12:42:27.116601+0000","last_clean":"2023-10-19T12:42:27.116601+0000","last_became_active":"2023-10-19T12:41:23.342778+0000","last_became_peered":"2023-10-19T12:41:23.342778+0000","last_unstale":"2023-10-19T12:42:27.116601+0000","last_undegraded":"2023-10-19T12:42:27.116601+0000","last_fullsized":"2023-10-19T12:42:27.116601+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:47:15.690193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"88'7","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:28.179078+0000","last_change":"2023-10-19T12:42:28.179078+0000","last_active":"2023-10-19T12:42:28.179078+0000","last_peered":"2023-10-19T12:42:28.179078+0000","last_clean":"2023-10-19T12:42:28.179078+0000","last_became_active":"2023-10-19T12:42:28.165372+0000","last_became_peered":"2023-10-19T12:42:28.165372+0000","last_unstale":"2023-10-19T12:42:28.179078+0000","last_undegraded":"2023-10-19T12:42:28.179078+0000","last_fullsized":"2023-10-19T12:42:28.179078+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T21:12:40.451182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,6],"acting":[10,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:28.164782+0000","last_change":"2023-10-19T12:42:28.164782+0000","last_active":"2023-10-19T12:42:28.164782+0000","last_peered":"2023-10-19T12:42:28.164782+0000","last_clean":"2023-10-19T12:42:28.164782+0000","last_became_active":"2023-10-19T12:42:28.164508+0000","last_became_peered":"2023-10-19T12:42:28.164508+0000","last_unstale":"2023-10-19T12:42:28.164782+0000","last_undegraded":"2023-10-19T12:42:28.164782+0000","last_fullsized":"2023-10-19T12:42:28.164782+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:37:30.278053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.123624+0000","last_change":"2023-10-19T12:41:23.338871+0000","last_active":"2023-10-19T12:42:27.123624+0000","last_peered":"2023-10-19T12:42:27.123624+0000","last_clean":"2023-10-19T12:42:27.123624+0000","last_became_active":"2023-10-19T12:41:23.338493+0000","last_became_peered":"2023-10-19T12:41:23.338493+0000","last_unstale":"2023-10-19T12:42:27.123624+0000","last_undegraded":"2023-10-19T12:42:27.123624+0000","last_fullsized":"2023-10-19T12:42:27.123624+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T22:49:12.948436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"88'3","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.125512+0000","last_change":"2023-10-19T12:41:18.291110+0000","last_active":"2023-10-19T12:42:27.125512+0000","last_peered":"2023-10-19T12:42:27.125512+0000","last_clean":"2023-10-19T12:42:27.125512+0000","last_became_active":"2023-10-19T12:41:18.290675+0000","last_became_peered":"2023-10-19T12:41:18.290675+0000","last_unstale":"2023-10-19T12:42:27.125512+0000","last_undegraded":"2023-10-19T12:42:27.125512+0000","last_fullsized":"2023-10-19T12:42:27.125512+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:57:44.713046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.124160+0000","last_change":"2023-10-19T12:41:19.299727+0000","last_active":"2023-10-19T12:42:27.124160+0000","last_peered":"2023-10-19T12:42:27.124160+0000","last_clean":"2023-10-19T12:42:27.124160+0000","last_became_active":"2023-10-19T12:41:19.299387+0000","last_became_peered":"2023-10-19T12:41:19.299387+0000","last_unstale":"2023-10-19T12:42:27.124160+0000","last_undegraded":"2023-10-19T12:42:27.124160+0000","last_fullsized":"2023-10-19T12:42:27.124160+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:34:03.783326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.129278+0000","last_change":"2023-10-19T12:41:23.331954+0000","last_active":"2023-10-19T12:42:27.129278+0000","last_peered":"2023-10-19T12:42:27.129278+0000","last_clean":"2023-10-19T12:42:27.129278+0000","last_became_active":"2023-10-19T12:41:23.328835+0000","last_became_peered":"2023-10-19T12:41:23.328835+0000","last_unstale":"2023-10-19T12:42:27.129278+0000","last_undegraded":"2023-10-19T12:42:27.129278+0000","last_fullsized":"2023-10-19T12:42:27.129278+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T21:49:10.473768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"88'3","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.120595+0000","last_change":"2023-10-19T12:41:18.280694+0000","last_active":"2023-10-19T12:42:27.120595+0000","last_peered":"2023-10-19T12:42:27.120595+0000","last_clean":"2023-10-19T12:42:27.120595+0000","last_became_active":"2023-10-19T12:41:18.280333+0000","last_became_peered":"2023-10-19T12:41:18.280333+0000","last_unstale":"2023-10-19T12:42:27.120595+0000","last_undegraded":"2023-10-19T12:42:27.120595+0000","last_fullsized":"2023-10-19T12:42:27.120595+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:06:02.944400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.115990+0000","last_change":"2023-10-19T12:41:19.288659+0000","last_active":"2023-10-19T12:42:27.115990+0000","last_peered":"2023-10-19T12:42:27.115990+0000","last_clean":"2023-10-19T12:42:27.115990+0000","last_became_active":"2023-10-19T12:41:19.288310+0000","last_became_peered":"2023-10-19T12:41:19.288310+0000","last_unstale":"2023-10-19T12:42:27.115990+0000","last_undegraded":"2023-10-19T12:42:27.115990+0000","last_fullsized":"2023-10-19T12:42:27.115990+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T23:15:05.772393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.125263+0000","last_change":"2023-10-19T12:41:23.333370+0000","last_active":"2023-10-19T12:42:27.125263+0000","last_peered":"2023-10-19T12:42:27.125263+0000","last_clean":"2023-10-19T12:42:27.125263+0000","last_became_active":"2023-10-19T12:41:23.332691+0000","last_became_peered":"2023-10-19T12:41:23.332691+0000","last_unstale":"2023-10-19T12:42:27.125263+0000","last_undegraded":"2023-10-19T12:42:27.125263+0000","last_fullsized":"2023-10-19T12:42:27.125263+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T21:28:45.414610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"88'4","reported_seq":119,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:35.138025+0000","last_change":"2023-10-19T12:41:18.287081+0000","last_active":"2023-10-19T12:42:35.138025+0000","last_peered":"2023-10-19T12:42:35.138025+0000","last_clean":"2023-10-19T12:42:35.138025+0000","last_became_active":"2023-10-19T12:41:18.286784+0000","last_became_peered":"2023-10-19T12:41:18.286784+0000","last_unstale":"2023-10-19T12:42:35.138025+0000","last_undegraded":"2023-10-19T12:42:35.138025+0000","last_fullsized":"2023-10-19T12:42:35.138025+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:49:10.167022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":97,"num_read_kb":97,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.124539+0000","last_change":"2023-10-19T12:41:19.300361+0000","last_active":"2023-10-19T12:42:27.124539+0000","last_peered":"2023-10-19T12:42:27.124539+0000","last_clean":"2023-10-19T12:42:27.124539+0000","last_became_active":"2023-10-19T12:41:19.299871+0000","last_became_peered":"2023-10-19T12:41:19.299871+0000","last_unstale":"2023-10-19T12:42:27.124539+0000","last_undegraded":"2023-10-19T12:42:27.124539+0000","last_fullsized":"2023-10-19T12:42:27.124539+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:46:31.437532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.115788+0000","last_change":"2023-10-19T12:41:23.338341+0000","last_active":"2023-10-19T12:42:27.115788+0000","last_peered":"2023-10-19T12:42:27.115788+0000","last_clean":"2023-10-19T12:42:27.115788+0000","last_became_active":"2023-10-19T12:41:23.336081+0000","last_became_peered":"2023-10-19T12:41:23.336081+0000","last_unstale":"2023-10-19T12:42:27.115788+0000","last_undegraded":"2023-10-19T12:42:27.115788+0000","last_fullsized":"2023-10-19T12:42:27.115788+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:02:35.474513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"88'4","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.118927+0000","last_change":"2023-10-19T12:41:18.280086+0000","last_active":"2023-10-19T12:42:27.118927+0000","last_peered":"2023-10-19T12:42:27.118927+0000","last_clean":"2023-10-19T12:42:27.118927+0000","last_became_active":"2023-10-19T12:41:18.279819+0000","last_became_peered":"2023-10-19T12:41:18.279819+0000","last_unstale":"2023-10-19T12:42:27.118927+0000","last_undegraded":"2023-10-19T12:42:27.118927+0000","last_fullsized":"2023-10-19T12:42:27.118927+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T23:02:28.723477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.130316+0000","last_change":"2023-10-19T12:41:19.306420+0000","last_active":"2023-10-19T12:42:27.130316+0000","last_peered":"2023-10-19T12:42:27.130316+0000","last_clean":"2023-10-19T12:42:27.130316+0000","last_became_active":"2023-10-19T12:41:19.301202+0000","last_became_peered":"2023-10-19T12:41:19.301202+0000","last_unstale":"2023-10-19T12:42:27.130316+0000","last_undegraded":"2023-10-19T12:42:27.130316+0000","last_fullsized":"2023-10-19T12:42:27.130316+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:56:16.765319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.121890+0000","last_change":"2023-10-19T12:41:23.337332+0000","last_active":"2023-10-19T12:42:27.121890+0000","last_peered":"2023-10-19T12:42:27.121890+0000","last_clean":"2023-10-19T12:42:27.121890+0000","last_became_active":"2023-10-19T12:41:23.336877+0000","last_became_peered":"2023-10-19T12:41:23.336877+0000","last_unstale":"2023-10-19T12:42:27.121890+0000","last_undegraded":"2023-10-19T12:42:27.121890+0000","last_fullsized":"2023-10-19T12:42:27.121890+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T22:47:23.795598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"88'5","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.121398+0000","last_change":"2023-10-19T12:41:18.285452+0000","last_active":"2023-10-19T12:42:27.121398+0000","last_peered":"2023-10-19T12:42:27.121398+0000","last_clean":"2023-10-19T12:42:27.121398+0000","last_became_active":"2023-10-19T12:41:18.285155+0000","last_became_peered":"2023-10-19T12:41:18.285155+0000","last_unstale":"2023-10-19T12:42:27.121398+0000","last_undegraded":"2023-10-19T12:42:27.121398+0000","last_fullsized":"2023-10-19T12:42:27.121398+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:30:41.041925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.124955+0000","last_change":"2023-10-19T12:41:19.284839+0000","last_active":"2023-10-19T12:42:27.124955+0000","last_peered":"2023-10-19T12:42:27.124955+0000","last_clean":"2023-10-19T12:42:27.124955+0000","last_became_active":"2023-10-19T12:41:19.284538+0000","last_became_peered":"2023-10-19T12:41:19.284538+0000","last_unstale":"2023-10-19T12:42:27.124955+0000","last_undegraded":"2023-10-19T12:42:27.124955+0000","last_fullsized":"2023-10-19T12:42:27.124955+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:29:12.288958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.115869+0000","last_change":"2023-10-19T12:41:23.339611+0000","last_active":"2023-10-19T12:42:27.115869+0000","last_peered":"2023-10-19T12:42:27.115869+0000","last_clean":"2023-10-19T12:42:27.115869+0000","last_became_active":"2023-10-19T12:41:23.337786+0000","last_became_peered":"2023-10-19T12:41:23.337786+0000","last_unstale":"2023-10-19T12:42:27.115869+0000","last_undegraded":"2023-10-19T12:42:27.115869+0000","last_fullsized":"2023-10-19T12:42:27.115869+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:56:01.219811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"88'35","reported_seq":156,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:35.137817+0000","last_change":"2023-10-19T12:41:18.279330+0000","last_active":"2023-10-19T12:42:35.137817+0000","last_peered":"2023-10-19T12:42:35.137817+0000","last_clean":"2023-10-19T12:42:35.137817+0000","last_became_active":"2023-10-19T12:41:18.278942+0000","last_became_peered":"2023-10-19T12:41:18.278942+0000","last_unstale":"2023-10-19T12:42:35.137817+0000","last_undegraded":"2023-10-19T12:42:35.137817+0000","last_fullsized":"2023-10-19T12:42:35.137817+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:40:23.340009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60441,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":103,"num_read_kb":110,"num_write":37,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.120304+0000","last_change":"2023-10-19T12:41:19.296103+0000","last_active":"2023-10-19T12:42:27.120304+0000","last_peered":"2023-10-19T12:42:27.120304+0000","last_clean":"2023-10-19T12:42:27.120304+0000","last_became_active":"2023-10-19T12:41:19.293432+0000","last_became_peered":"2023-10-19T12:41:19.293432+0000","last_unstale":"2023-10-19T12:42:27.120304+0000","last_undegraded":"2023-10-19T12:42:27.120304+0000","last_fullsized":"2023-10-19T12:42:27.120304+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:21:46.039560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.122205+0000","last_change":"2023-10-19T12:41:23.330711+0000","last_active":"2023-10-19T12:42:27.122205+0000","last_peered":"2023-10-19T12:42:27.122205+0000","last_clean":"2023-10-19T12:42:27.122205+0000","last_became_active":"2023-10-19T12:41:23.330115+0000","last_became_peered":"2023-10-19T12:41:23.330115+0000","last_unstale":"2023-10-19T12:42:27.122205+0000","last_undegraded":"2023-10-19T12:42:27.122205+0000","last_fullsized":"2023-10-19T12:42:27.122205+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:48:50.296265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"88'9","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.116428+0000","last_change":"2023-10-19T12:41:18.289434+0000","last_active":"2023-10-19T12:42:27.116428+0000","last_peered":"2023-10-19T12:42:27.116428+0000","last_clean":"2023-10-19T12:42:27.116428+0000","last_became_active":"2023-10-19T12:41:18.289226+0000","last_became_peered":"2023-10-19T12:41:18.289226+0000","last_unstale":"2023-10-19T12:42:27.116428+0000","last_undegraded":"2023-10-19T12:42:27.116428+0000","last_fullsized":"2023-10-19T12:42:27.116428+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T21:18:19.007202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.126351+0000","last_change":"2023-10-19T12:41:19.300555+0000","last_active":"2023-10-19T12:42:27.126351+0000","last_peered":"2023-10-19T12:42:27.126351+0000","last_clean":"2023-10-19T12:42:27.126351+0000","last_became_active":"2023-10-19T12:41:19.300162+0000","last_became_peered":"2023-10-19T12:41:19.300162+0000","last_unstale":"2023-10-19T12:42:27.126351+0000","last_undegraded":"2023-10-19T12:42:27.126351+0000","last_fullsized":"2023-10-19T12:42:27.126351+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:26:33.779562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.122864+0000","last_change":"2023-10-19T12:41:23.338750+0000","last_active":"2023-10-19T12:42:27.122864+0000","last_peered":"2023-10-19T12:42:27.122864+0000","last_clean":"2023-10-19T12:42:27.122864+0000","last_became_active":"2023-10-19T12:41:23.338318+0000","last_became_peered":"2023-10-19T12:41:23.338318+0000","last_unstale":"2023-10-19T12:42:27.122864+0000","last_undegraded":"2023-10-19T12:42:27.122864+0000","last_fullsized":"2023-10-19T12:42:27.122864+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:11:20.182270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"88'5","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.120277+0000","last_change":"2023-10-19T12:41:18.293923+0000","last_active":"2023-10-19T12:42:27.120277+0000","last_peered":"2023-10-19T12:42:27.120277+0000","last_clean":"2023-10-19T12:42:27.120277+0000","last_became_active":"2023-10-19T12:41:18.293688+0000","last_became_peered":"2023-10-19T12:41:18.293688+0000","last_unstale":"2023-10-19T12:42:27.120277+0000","last_undegraded":"2023-10-19T12:42:27.120277+0000","last_fullsized":"2023-10-19T12:42:27.120277+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:34:15.162178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.118566+0000","last_change":"2023-10-19T12:41:19.302733+0000","last_active":"2023-10-19T12:42:27.118566+0000","last_peered":"2023-10-19T12:42:27.118566+0000","last_clean":"2023-10-19T12:42:27.118566+0000","last_became_active":"2023-10-19T12:41:19.302401+0000","last_became_peered":"2023-10-19T12:41:19.302401+0000","last_unstale":"2023-10-19T12:42:27.118566+0000","last_undegraded":"2023-10-19T12:42:27.118566+0000","last_fullsized":"2023-10-19T12:42:27.118566+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:55:05.864499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.119269+0000","last_change":"2023-10-19T12:41:23.338999+0000","last_active":"2023-10-19T12:42:27.119269+0000","last_peered":"2023-10-19T12:42:27.119269+0000","last_clean":"2023-10-19T12:42:27.119269+0000","last_became_active":"2023-10-19T12:41:23.338067+0000","last_became_peered":"2023-10-19T12:41:23.338067+0000","last_unstale":"2023-10-19T12:42:27.119269+0000","last_undegraded":"2023-10-19T12:42:27.119269+0000","last_fullsized":"2023-10-19T12:42:27.119269+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:36:12.984006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"88'5","reported_seq":75,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:34.380188+0000","last_change":"2023-10-19T12:41:18.277563+0000","last_active":"2023-10-19T12:42:34.380188+0000","last_peered":"2023-10-19T12:42:34.380188+0000","last_clean":"2023-10-19T12:42:34.380188+0000","last_became_active":"2023-10-19T12:41:18.277255+0000","last_became_peered":"2023-10-19T12:41:18.277255+0000","last_unstale":"2023-10-19T12:42:34.380188+0000","last_undegraded":"2023-10-19T12:42:34.380188+0000","last_fullsized":"2023-10-19T12:42:34.380188+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:28:31.468355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":52,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.118229+0000","last_change":"2023-10-19T12:41:19.288939+0000","last_active":"2023-10-19T12:42:27.118229+0000","last_peered":"2023-10-19T12:42:27.118229+0000","last_clean":"2023-10-19T12:42:27.118229+0000","last_became_active":"2023-10-19T12:41:19.288612+0000","last_became_peered":"2023-10-19T12:41:19.288612+0000","last_unstale":"2023-10-19T12:42:27.118229+0000","last_undegraded":"2023-10-19T12:42:27.118229+0000","last_fullsized":"2023-10-19T12:42:27.118229+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:45:36.050331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.125921+0000","last_change":"2023-10-19T12:41:23.333823+0000","last_active":"2023-10-19T12:42:27.125921+0000","last_peered":"2023-10-19T12:42:27.125921+0000","last_clean":"2023-10-19T12:42:27.125921+0000","last_became_active":"2023-10-19T12:41:23.332698+0000","last_became_peered":"2023-10-19T12:41:23.332698+0000","last_unstale":"2023-10-19T12:42:27.125921+0000","last_undegraded":"2023-10-19T12:42:27.125921+0000","last_fullsized":"2023-10-19T12:42:27.125921+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:54:43.952531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"88'17","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.119493+0000","last_change":"2023-10-19T12:41:18.290426+0000","last_active":"2023-10-19T12:42:27.119493+0000","last_peered":"2023-10-19T12:42:27.119493+0000","last_clean":"2023-10-19T12:42:27.119493+0000","last_became_active":"2023-10-19T12:41:18.290096+0000","last_became_peered":"2023-10-19T12:41:18.290096+0000","last_unstale":"2023-10-19T12:42:27.119493+0000","last_undegraded":"2023-10-19T12:42:27.119493+0000","last_fullsized":"2023-10-19T12:42:27.119493+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:14:34.731869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.119815+0000","last_change":"2023-10-19T12:41:19.300423+0000","last_active":"2023-10-19T12:42:27.119815+0000","last_peered":"2023-10-19T12:42:27.119815+0000","last_clean":"2023-10-19T12:42:27.119815+0000","last_became_active":"2023-10-19T12:41:19.299999+0000","last_became_peered":"2023-10-19T12:41:19.299999+0000","last_unstale":"2023-10-19T12:42:27.119815+0000","last_undegraded":"2023-10-19T12:42:27.119815+0000","last_fullsized":"2023-10-19T12:42:27.119815+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:35:32.703396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.119720+0000","last_change":"2023-10-19T12:41:23.330091+0000","last_active":"2023-10-19T12:42:27.119720+0000","last_peered":"2023-10-19T12:42:27.119720+0000","last_clean":"2023-10-19T12:42:27.119720+0000","last_became_active":"2023-10-19T12:41:23.329695+0000","last_became_peered":"2023-10-19T12:41:23.329695+0000","last_unstale":"2023-10-19T12:42:27.119720+0000","last_undegraded":"2023-10-19T12:42:27.119720+0000","last_fullsized":"2023-10-19T12:42:27.119720+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:37:09.840232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"88'2","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.119237+0000","last_change":"2023-10-19T12:41:18.279761+0000","last_active":"2023-10-19T12:42:27.119237+0000","last_peered":"2023-10-19T12:42:27.119237+0000","last_clean":"2023-10-19T12:42:27.119237+0000","last_became_active":"2023-10-19T12:41:18.279430+0000","last_became_peered":"2023-10-19T12:41:18.279430+0000","last_unstale":"2023-10-19T12:42:27.119237+0000","last_undegraded":"2023-10-19T12:42:27.119237+0000","last_fullsized":"2023-10-19T12:42:27.119237+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:43:32.447842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.123526+0000","last_change":"2023-10-19T12:41:19.290406+0000","last_active":"2023-10-19T12:42:27.123526+0000","last_peered":"2023-10-19T12:42:27.123526+0000","last_clean":"2023-10-19T12:42:27.123526+0000","last_became_active":"2023-10-19T12:41:19.290032+0000","last_became_peered":"2023-10-19T12:41:19.290032+0000","last_unstale":"2023-10-19T12:42:27.123526+0000","last_undegraded":"2023-10-19T12:42:27.123526+0000","last_fullsized":"2023-10-19T12:42:27.123526+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:30:30.875800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.119428+0000","last_change":"2023-10-19T12:41:23.478036+0000","last_active":"2023-10-19T12:42:27.119428+0000","last_peered":"2023-10-19T12:42:27.119428+0000","last_clean":"2023-10-19T12:42:27.119428+0000","last_became_active":"2023-10-19T12:41:23.477542+0000","last_became_peered":"2023-10-19T12:41:23.477542+0000","last_unstale":"2023-10-19T12:42:27.119428+0000","last_undegraded":"2023-10-19T12:42:27.119428+0000","last_fullsized":"2023-10-19T12:42:27.119428+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:32:24.599591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"88'1","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.116660+0000","last_change":"2023-10-19T12:41:18.289254+0000","last_active":"2023-10-19T12:42:27.116660+0000","last_peered":"2023-10-19T12:42:27.116660+0000","last_clean":"2023-10-19T12:42:27.116660+0000","last_became_active":"2023-10-19T12:41:18.287036+0000","last_became_peered":"2023-10-19T12:41:18.287036+0000","last_unstale":"2023-10-19T12:42:27.116660+0000","last_undegraded":"2023-10-19T12:42:27.116660+0000","last_fullsized":"2023-10-19T12:42:27.116660+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T21:33:41.720725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.124774+0000","last_change":"2023-10-19T12:41:19.299711+0000","last_active":"2023-10-19T12:42:27.124774+0000","last_peered":"2023-10-19T12:42:27.124774+0000","last_clean":"2023-10-19T12:42:27.124774+0000","last_became_active":"2023-10-19T12:41:19.299367+0000","last_became_peered":"2023-10-19T12:41:19.299367+0000","last_unstale":"2023-10-19T12:42:27.124774+0000","last_undegraded":"2023-10-19T12:42:27.124774+0000","last_fullsized":"2023-10-19T12:42:27.124774+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:32:36.783990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.124886+0000","last_change":"2023-10-19T12:41:23.328301+0000","last_active":"2023-10-19T12:42:27.124886+0000","last_peered":"2023-10-19T12:42:27.124886+0000","last_clean":"2023-10-19T12:42:27.124886+0000","last_became_active":"2023-10-19T12:41:23.327866+0000","last_became_peered":"2023-10-19T12:41:23.327866+0000","last_unstale":"2023-10-19T12:42:27.124886+0000","last_undegraded":"2023-10-19T12:42:27.124886+0000","last_fullsized":"2023-10-19T12:42:27.124886+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T21:53:23.600196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"88'5","reported_seq":71,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:31.378758+0000","last_change":"2023-10-19T12:41:18.286635+0000","last_active":"2023-10-19T12:42:31.378758+0000","last_peered":"2023-10-19T12:42:31.378758+0000","last_clean":"2023-10-19T12:42:31.378758+0000","last_became_active":"2023-10-19T12:41:18.286310+0000","last_became_peered":"2023-10-19T12:41:18.286310+0000","last_unstale":"2023-10-19T12:42:31.378758+0000","last_undegraded":"2023-10-19T12:42:31.378758+0000","last_fullsized":"2023-10-19T12:42:31.378758+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:30:38.266038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":47,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.123996+0000","last_change":"2023-10-19T12:41:19.297989+0000","last_active":"2023-10-19T12:42:27.123996+0000","last_peered":"2023-10-19T12:42:27.123996+0000","last_clean":"2023-10-19T12:42:27.123996+0000","last_became_active":"2023-10-19T12:41:19.297680+0000","last_became_peered":"2023-10-19T12:41:19.297680+0000","last_unstale":"2023-10-19T12:42:27.123996+0000","last_undegraded":"2023-10-19T12:42:27.123996+0000","last_fullsized":"2023-10-19T12:42:27.123996+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:40:22.883804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.126049+0000","last_change":"2023-10-19T12:41:23.478723+0000","last_active":"2023-10-19T12:42:27.126049+0000","last_peered":"2023-10-19T12:42:27.126049+0000","last_clean":"2023-10-19T12:42:27.126049+0000","last_became_active":"2023-10-19T12:41:23.478063+0000","last_became_peered":"2023-10-19T12:41:23.478063+0000","last_unstale":"2023-10-19T12:42:27.126049+0000","last_undegraded":"2023-10-19T12:42:27.126049+0000","last_fullsized":"2023-10-19T12:42:27.126049+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:41:00.885308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.120871+0000","last_change":"2023-10-19T12:41:19.285478+0000","last_active":"2023-10-19T12:42:27.120871+0000","last_peered":"2023-10-19T12:42:27.120871+0000","last_clean":"2023-10-19T12:42:27.120871+0000","last_became_active":"2023-10-19T12:41:19.285175+0000","last_became_peered":"2023-10-19T12:41:19.285175+0000","last_unstale":"2023-10-19T12:42:27.120871+0000","last_undegraded":"2023-10-19T12:42:27.120871+0000","last_fullsized":"2023-10-19T12:42:27.120871+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:18:03.423712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"88'5","reported_seq":73,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:34.379421+0000","last_change":"2023-10-19T12:41:18.297207+0000","last_active":"2023-10-19T12:42:34.379421+0000","last_peered":"2023-10-19T12:42:34.379421+0000","last_clean":"2023-10-19T12:42:34.379421+0000","last_became_active":"2023-10-19T12:41:18.296490+0000","last_became_peered":"2023-10-19T12:41:18.296490+0000","last_unstale":"2023-10-19T12:42:34.379421+0000","last_undegraded":"2023-10-19T12:42:34.379421+0000","last_fullsized":"2023-10-19T12:42:34.379421+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:42:33.769810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"88'1","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.119053+0000","last_change":"2023-10-19T12:41:23.338803+0000","last_active":"2023-10-19T12:42:27.119053+0000","last_peered":"2023-10-19T12:42:27.119053+0000","last_clean":"2023-10-19T12:42:27.119053+0000","last_became_active":"2023-10-19T12:41:23.338383+0000","last_became_peered":"2023-10-19T12:41:23.338383+0000","last_unstale":"2023-10-19T12:42:27.119053+0000","last_undegraded":"2023-10-19T12:42:27.119053+0000","last_fullsized":"2023-10-19T12:42:27.119053+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:39:24.412323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.124366+0000","last_change":"2023-10-19T12:41:19.290536+0000","last_active":"2023-10-19T12:42:27.124366+0000","last_peered":"2023-10-19T12:42:27.124366+0000","last_clean":"2023-10-19T12:42:27.124366+0000","last_became_active":"2023-10-19T12:41:19.290141+0000","last_became_peered":"2023-10-19T12:41:19.290141+0000","last_unstale":"2023-10-19T12:42:27.124366+0000","last_undegraded":"2023-10-19T12:42:27.124366+0000","last_fullsized":"2023-10-19T12:42:27.124366+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:49:59.601767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"88'6","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.121577+0000","last_change":"2023-10-19T12:41:18.276568+0000","last_active":"2023-10-19T12:42:27.121577+0000","last_peered":"2023-10-19T12:42:27.121577+0000","last_clean":"2023-10-19T12:42:27.121577+0000","last_became_active":"2023-10-19T12:41:18.276216+0000","last_became_peered":"2023-10-19T12:41:18.276216+0000","last_unstale":"2023-10-19T12:42:27.121577+0000","last_undegraded":"2023-10-19T12:42:27.121577+0000","last_fullsized":"2023-10-19T12:42:27.121577+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T23:24:32.159972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":313,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.118130+0000","last_change":"2023-10-19T12:40:14.674594+0000","last_active":"2023-10-19T12:42:27.118130+0000","last_peered":"2023-10-19T12:42:27.118130+0000","last_clean":"2023-10-19T12:42:27.118130+0000","last_became_active":"2023-10-19T12:40:14.674234+0000","last_became_peered":"2023-10-19T12:40:14.674234+0000","last_unstale":"2023-10-19T12:42:27.118130+0000","last_undegraded":"2023-10-19T12:42:27.118130+0000","last_fullsized":"2023-10-19T12:42:27.118130+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:37:07.222565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:37:07.222565+0000","last_clean_scrub_stamp":"2023-10-19T12:37:07.222565+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-21T00:22:40.530907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.121767+0000","last_change":"2023-10-19T12:41:23.479328+0000","last_active":"2023-10-19T12:42:27.121767+0000","last_peered":"2023-10-19T12:42:27.121767+0000","last_clean":"2023-10-19T12:42:27.121767+0000","last_became_active":"2023-10-19T12:41:23.478972+0000","last_became_peered":"2023-10-19T12:41:23.478972+0000","last_unstale":"2023-10-19T12:42:27.121767+0000","last_undegraded":"2023-10-19T12:42:27.121767+0000","last_fullsized":"2023-10-19T12:42:27.121767+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:58:38.949721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.125381+0000","last_change":"2023-10-19T12:41:19.294132+0000","last_active":"2023-10-19T12:42:27.125381+0000","last_peered":"2023-10-19T12:42:27.125381+0000","last_clean":"2023-10-19T12:42:27.125381+0000","last_became_active":"2023-10-19T12:41:19.293800+0000","last_became_peered":"2023-10-19T12:41:19.293800+0000","last_unstale":"2023-10-19T12:42:27.125381+0000","last_undegraded":"2023-10-19T12:42:27.125381+0000","last_fullsized":"2023-10-19T12:42:27.125381+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:30:56.734581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"88'4","reported_seq":15,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:28.136072+0000","last_change":"2023-10-19T12:42:28.135694+0000","last_active":"2023-10-19T12:42:28.136072+0000","last_peered":"2023-10-19T12:42:28.136072+0000","last_clean":"2023-10-19T12:42:28.136072+0000","last_became_active":"2023-10-19T12:42:28.127322+0000","last_became_peered":"2023-10-19T12:42:28.127322+0000","last_unstale":"2023-10-19T12:42:28.136072+0000","last_undegraded":"2023-10-19T12:42:28.136072+0000","last_fullsized":"2023-10-19T12:42:28.136072+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T23:26:54.615667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.122348+0000","last_change":"2023-10-19T12:41:23.328605+0000","last_active":"2023-10-19T12:42:27.122348+0000","last_peered":"2023-10-19T12:42:27.122348+0000","last_clean":"2023-10-19T12:42:27.122348+0000","last_became_active":"2023-10-19T12:41:23.327992+0000","last_became_peered":"2023-10-19T12:41:23.327992+0000","last_unstale":"2023-10-19T12:42:27.122348+0000","last_undegraded":"2023-10-19T12:42:27.122348+0000","last_fullsized":"2023-10-19T12:42:27.122348+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:00:04.415235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"88'4","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.120421+0000","last_change":"2023-10-19T12:41:18.290347+0000","last_active":"2023-10-19T12:42:27.120421+0000","last_peered":"2023-10-19T12:42:27.120421+0000","last_clean":"2023-10-19T12:42:27.120421+0000","last_became_active":"2023-10-19T12:41:18.290050+0000","last_became_peered":"2023-10-19T12:41:18.290050+0000","last_unstale":"2023-10-19T12:42:27.120421+0000","last_undegraded":"2023-10-19T12:42:27.120421+0000","last_fullsized":"2023-10-19T12:42:27.120421+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:19:05.618338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.125049+0000","last_change":"2023-10-19T12:41:19.303753+0000","last_active":"2023-10-19T12:42:27.125049+0000","last_peered":"2023-10-19T12:42:27.125049+0000","last_clean":"2023-10-19T12:42:27.125049+0000","last_became_active":"2023-10-19T12:41:19.299710+0000","last_became_peered":"2023-10-19T12:41:19.299710+0000","last_unstale":"2023-10-19T12:42:27.125049+0000","last_undegraded":"2023-10-19T12:42:27.125049+0000","last_fullsized":"2023-10-19T12:42:27.125049+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:40:27.929956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.124095+0000","last_change":"2023-10-19T12:41:23.478159+0000","last_active":"2023-10-19T12:42:27.124095+0000","last_peered":"2023-10-19T12:42:27.124095+0000","last_clean":"2023-10-19T12:42:27.124095+0000","last_became_active":"2023-10-19T12:41:23.477647+0000","last_became_peered":"2023-10-19T12:41:23.477647+0000","last_unstale":"2023-10-19T12:42:27.124095+0000","last_undegraded":"2023-10-19T12:42:27.124095+0000","last_fullsized":"2023-10-19T12:42:27.124095+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:48:31.904477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"88'10","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.119328+0000","last_change":"2023-10-19T12:41:18.295746+0000","last_active":"2023-10-19T12:42:27.119328+0000","last_peered":"2023-10-19T12:42:27.119328+0000","last_clean":"2023-10-19T12:42:27.119328+0000","last_became_active":"2023-10-19T12:41:18.294855+0000","last_became_peered":"2023-10-19T12:41:18.294855+0000","last_unstale":"2023-10-19T12:42:27.119328+0000","last_undegraded":"2023-10-19T12:42:27.119328+0000","last_fullsized":"2023-10-19T12:42:27.119328+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:52:24.628136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.126402+0000","last_change":"2023-10-19T12:41:19.283960+0000","last_active":"2023-10-19T12:42:27.126402+0000","last_peered":"2023-10-19T12:42:27.126402+0000","last_clean":"2023-10-19T12:42:27.126402+0000","last_became_active":"2023-10-19T12:41:19.282544+0000","last_became_peered":"2023-10-19T12:41:19.282544+0000","last_unstale":"2023-10-19T12:42:27.126402+0000","last_undegraded":"2023-10-19T12:42:27.126402+0000","last_fullsized":"2023-10-19T12:42:27.126402+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T23:58:08.794192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.116192+0000","last_change":"2023-10-19T12:41:23.323593+0000","last_active":"2023-10-19T12:42:27.116192+0000","last_peered":"2023-10-19T12:42:27.116192+0000","last_clean":"2023-10-19T12:42:27.116192+0000","last_became_active":"2023-10-19T12:41:23.323204+0000","last_became_peered":"2023-10-19T12:41:23.323204+0000","last_unstale":"2023-10-19T12:42:27.116192+0000","last_undegraded":"2023-10-19T12:42:27.116192+0000","last_fullsized":"2023-10-19T12:42:27.116192+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:15:15.379085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"88'7","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.122418+0000","last_change":"2023-10-19T12:41:18.286231+0000","last_active":"2023-10-19T12:42:27.122418+0000","last_peered":"2023-10-19T12:42:27.122418+0000","last_clean":"2023-10-19T12:42:27.122418+0000","last_became_active":"2023-10-19T12:41:18.285932+0000","last_became_peered":"2023-10-19T12:41:18.285932+0000","last_unstale":"2023-10-19T12:42:27.122418+0000","last_undegraded":"2023-10-19T12:42:27.122418+0000","last_fullsized":"2023-10-19T12:42:27.122418+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:13:02.066468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:28.126438+0000","last_change":"2023-10-19T12:42:28.126438+0000","last_active":"2023-10-19T12:42:28.126438+0000","last_peered":"2023-10-19T12:42:28.126438+0000","last_clean":"2023-10-19T12:42:28.126438+0000","last_became_active":"2023-10-19T12:42:28.126115+0000","last_became_peered":"2023-10-19T12:42:28.126115+0000","last_unstale":"2023-10-19T12:42:28.126438+0000","last_undegraded":"2023-10-19T12:42:28.126438+0000","last_fullsized":"2023-10-19T12:42:28.126438+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:48:12.878420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.121969+0000","last_change":"2023-10-19T12:41:23.479129+0000","last_active":"2023-10-19T12:42:27.121969+0000","last_peered":"2023-10-19T12:42:27.121969+0000","last_clean":"2023-10-19T12:42:27.121969+0000","last_became_active":"2023-10-19T12:41:23.478518+0000","last_became_peered":"2023-10-19T12:41:23.478518+0000","last_unstale":"2023-10-19T12:42:27.121969+0000","last_undegraded":"2023-10-19T12:42:27.121969+0000","last_fullsized":"2023-10-19T12:42:27.121969+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:55:38.767504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"88'2","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.124117+0000","last_change":"2023-10-19T12:41:18.283269+0000","last_active":"2023-10-19T12:42:27.124117+0000","last_peered":"2023-10-19T12:42:27.124117+0000","last_clean":"2023-10-19T12:42:27.124117+0000","last_became_active":"2023-10-19T12:41:18.282913+0000","last_became_peered":"2023-10-19T12:41:18.282913+0000","last_unstale":"2023-10-19T12:42:27.124117+0000","last_undegraded":"2023-10-19T12:42:27.124117+0000","last_fullsized":"2023-10-19T12:42:27.124117+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:44:01.042312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.119590+0000","last_change":"2023-10-19T12:41:19.284222+0000","last_active":"2023-10-19T12:42:27.119590+0000","last_peered":"2023-10-19T12:42:27.119590+0000","last_clean":"2023-10-19T12:42:27.119590+0000","last_became_active":"2023-10-19T12:41:19.283914+0000","last_became_peered":"2023-10-19T12:41:19.283914+0000","last_unstale":"2023-10-19T12:42:27.119590+0000","last_undegraded":"2023-10-19T12:42:27.119590+0000","last_fullsized":"2023-10-19T12:42:27.119590+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:15:34.801502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.119367+0000","last_change":"2023-10-19T12:41:23.338071+0000","last_active":"2023-10-19T12:42:27.119367+0000","last_peered":"2023-10-19T12:42:27.119367+0000","last_clean":"2023-10-19T12:42:27.119367+0000","last_became_active":"2023-10-19T12:41:23.336265+0000","last_became_peered":"2023-10-19T12:41:23.336265+0000","last_unstale":"2023-10-19T12:42:27.119367+0000","last_undegraded":"2023-10-19T12:42:27.119367+0000","last_fullsized":"2023-10-19T12:42:27.119367+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:02:53.139468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"88'7","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.124460+0000","last_change":"2023-10-19T12:41:18.293027+0000","last_active":"2023-10-19T12:42:27.124460+0000","last_peered":"2023-10-19T12:42:27.124460+0000","last_clean":"2023-10-19T12:42:27.124460+0000","last_became_active":"2023-10-19T12:41:18.289478+0000","last_became_peered":"2023-10-19T12:41:18.289478+0000","last_unstale":"2023-10-19T12:42:27.124460+0000","last_undegraded":"2023-10-19T12:42:27.124460+0000","last_fullsized":"2023-10-19T12:42:27.124460+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:26:32.986754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.123173+0000","last_change":"2023-10-19T12:41:19.293206+0000","last_active":"2023-10-19T12:42:27.123173+0000","last_peered":"2023-10-19T12:42:27.123173+0000","last_clean":"2023-10-19T12:42:27.123173+0000","last_became_active":"2023-10-19T12:41:19.292898+0000","last_became_peered":"2023-10-19T12:41:19.292898+0000","last_unstale":"2023-10-19T12:42:27.123173+0000","last_undegraded":"2023-10-19T12:42:27.123173+0000","last_fullsized":"2023-10-19T12:42:27.123173+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T23:36:17.548859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"88'1","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.121720+0000","last_change":"2023-10-19T12:41:23.343048+0000","last_active":"2023-10-19T12:42:27.121720+0000","last_peered":"2023-10-19T12:42:27.121720+0000","last_clean":"2023-10-19T12:42:27.121720+0000","last_became_active":"2023-10-19T12:41:23.342696+0000","last_became_peered":"2023-10-19T12:41:23.342696+0000","last_unstale":"2023-10-19T12:42:27.121720+0000","last_undegraded":"2023-10-19T12:42:27.121720+0000","last_fullsized":"2023-10-19T12:42:27.121720+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:30:38.858947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"88'3","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.116387+0000","last_change":"2023-10-19T12:41:18.293079+0000","last_active":"2023-10-19T12:42:27.116387+0000","last_peered":"2023-10-19T12:42:27.116387+0000","last_clean":"2023-10-19T12:42:27.116387+0000","last_became_active":"2023-10-19T12:41:18.292803+0000","last_became_peered":"2023-10-19T12:41:18.292803+0000","last_unstale":"2023-10-19T12:42:27.116387+0000","last_undegraded":"2023-10-19T12:42:27.116387+0000","last_fullsized":"2023-10-19T12:42:27.116387+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T22:37:14.550800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.124697+0000","last_change":"2023-10-19T12:41:19.292921+0000","last_active":"2023-10-19T12:42:27.124697+0000","last_peered":"2023-10-19T12:42:27.124697+0000","last_clean":"2023-10-19T12:42:27.124697+0000","last_became_active":"2023-10-19T12:41:19.292498+0000","last_became_peered":"2023-10-19T12:41:19.292498+0000","last_unstale":"2023-10-19T12:42:27.124697+0000","last_undegraded":"2023-10-19T12:42:27.124697+0000","last_fullsized":"2023-10-19T12:42:27.124697+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T22:02:55.878154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.122200+0000","last_change":"2023-10-19T12:41:23.477894+0000","last_active":"2023-10-19T12:42:27.122200+0000","last_peered":"2023-10-19T12:42:27.122200+0000","last_clean":"2023-10-19T12:42:27.122200+0000","last_became_active":"2023-10-19T12:41:23.477478+0000","last_became_peered":"2023-10-19T12:41:23.477478+0000","last_unstale":"2023-10-19T12:42:27.122200+0000","last_undegraded":"2023-10-19T12:42:27.122200+0000","last_fullsized":"2023-10-19T12:42:27.122200+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:44:21.730215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"88'4","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.121089+0000","last_change":"2023-10-19T12:41:18.282474+0000","last_active":"2023-10-19T12:42:27.121089+0000","last_peered":"2023-10-19T12:42:27.121089+0000","last_clean":"2023-10-19T12:42:27.121089+0000","last_became_active":"2023-10-19T12:41:18.282124+0000","last_became_peered":"2023-10-19T12:41:18.282124+0000","last_unstale":"2023-10-19T12:42:27.121089+0000","last_undegraded":"2023-10-19T12:42:27.121089+0000","last_fullsized":"2023-10-19T12:42:27.121089+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T21:27:37.530324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.118468+0000","last_change":"2023-10-19T12:41:19.302928+0000","last_active":"2023-10-19T12:42:27.118468+0000","last_peered":"2023-10-19T12:42:27.118468+0000","last_clean":"2023-10-19T12:42:27.118468+0000","last_became_active":"2023-10-19T12:41:19.302641+0000","last_became_peered":"2023-10-19T12:41:19.302641+0000","last_unstale":"2023-10-19T12:42:27.118468+0000","last_undegraded":"2023-10-19T12:42:27.118468+0000","last_fullsized":"2023-10-19T12:42:27.118468+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:07:46.333875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.124012+0000","last_change":"2023-10-19T12:41:23.329079+0000","last_active":"2023-10-19T12:42:27.124012+0000","last_peered":"2023-10-19T12:42:27.124012+0000","last_clean":"2023-10-19T12:42:27.124012+0000","last_became_active":"2023-10-19T12:41:23.328407+0000","last_became_peered":"2023-10-19T12:41:23.328407+0000","last_unstale":"2023-10-19T12:42:27.124012+0000","last_undegraded":"2023-10-19T12:42:27.124012+0000","last_fullsized":"2023-10-19T12:42:27.124012+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:46:19.404922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"88'6","reported_seq":71,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:30.374835+0000","last_change":"2023-10-19T12:41:18.286336+0000","last_active":"2023-10-19T12:42:30.374835+0000","last_peered":"2023-10-19T12:42:30.374835+0000","last_clean":"2023-10-19T12:42:30.374835+0000","last_became_active":"2023-10-19T12:41:18.285921+0000","last_became_peered":"2023-10-19T12:41:18.285921+0000","last_unstale":"2023-10-19T12:42:30.374835+0000","last_undegraded":"2023-10-19T12:42:30.374835+0000","last_fullsized":"2023-10-19T12:42:30.374835+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T23:16:34.842143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1560,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":47,"num_read_kb":2,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.119294+0000","last_change":"2023-10-19T12:41:19.289466+0000","last_active":"2023-10-19T12:42:27.119294+0000","last_peered":"2023-10-19T12:42:27.119294+0000","last_clean":"2023-10-19T12:42:27.119294+0000","last_became_active":"2023-10-19T12:41:19.288669+0000","last_became_peered":"2023-10-19T12:41:19.288669+0000","last_unstale":"2023-10-19T12:42:27.119294+0000","last_undegraded":"2023-10-19T12:42:27.119294+0000","last_fullsized":"2023-10-19T12:42:27.119294+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T23:31:52.163958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.128490+0000","last_change":"2023-10-19T12:41:23.343521+0000","last_active":"2023-10-19T12:42:27.128490+0000","last_peered":"2023-10-19T12:42:27.128490+0000","last_clean":"2023-10-19T12:42:27.128490+0000","last_became_active":"2023-10-19T12:41:23.342288+0000","last_became_peered":"2023-10-19T12:41:23.342288+0000","last_unstale":"2023-10-19T12:42:27.128490+0000","last_undegraded":"2023-10-19T12:42:27.128490+0000","last_fullsized":"2023-10-19T12:42:27.128490+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:58:06.810552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"88'3","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.122056+0000","last_change":"2023-10-19T12:41:18.294999+0000","last_active":"2023-10-19T12:42:27.122056+0000","last_peered":"2023-10-19T12:42:27.122056+0000","last_clean":"2023-10-19T12:42:27.122056+0000","last_became_active":"2023-10-19T12:41:18.294776+0000","last_became_peered":"2023-10-19T12:41:18.294776+0000","last_unstale":"2023-10-19T12:42:27.122056+0000","last_undegraded":"2023-10-19T12:42:27.122056+0000","last_fullsized":"2023-10-19T12:42:27.122056+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:17:53.704739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.118684+0000","last_change":"2023-10-19T12:41:19.291753+0000","last_active":"2023-10-19T12:42:27.118684+0000","last_peered":"2023-10-19T12:42:27.118684+0000","last_clean":"2023-10-19T12:42:27.118684+0000","last_became_active":"2023-10-19T12:41:19.291475+0000","last_became_peered":"2023-10-19T12:41:19.291475+0000","last_unstale":"2023-10-19T12:42:27.118684+0000","last_undegraded":"2023-10-19T12:42:27.118684+0000","last_fullsized":"2023-10-19T12:42:27.118684+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:26:38.494864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.118754+0000","last_change":"2023-10-19T12:41:23.327966+0000","last_active":"2023-10-19T12:42:27.118754+0000","last_peered":"2023-10-19T12:42:27.118754+0000","last_clean":"2023-10-19T12:42:27.118754+0000","last_became_active":"2023-10-19T12:41:23.327555+0000","last_became_peered":"2023-10-19T12:41:23.327555+0000","last_unstale":"2023-10-19T12:42:27.118754+0000","last_undegraded":"2023-10-19T12:42:27.118754+0000","last_fullsized":"2023-10-19T12:42:27.118754+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:01:34.044012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"88'5","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.125824+0000","last_change":"2023-10-19T12:41:18.297472+0000","last_active":"2023-10-19T12:42:27.125824+0000","last_peered":"2023-10-19T12:42:27.125824+0000","last_clean":"2023-10-19T12:42:27.125824+0000","last_became_active":"2023-10-19T12:41:18.296410+0000","last_became_peered":"2023-10-19T12:41:18.296410+0000","last_unstale":"2023-10-19T12:42:27.125824+0000","last_undegraded":"2023-10-19T12:42:27.125824+0000","last_fullsized":"2023-10-19T12:42:27.125824+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:20:15.039332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.119122+0000","last_change":"2023-10-19T12:41:19.295136+0000","last_active":"2023-10-19T12:42:27.119122+0000","last_peered":"2023-10-19T12:42:27.119122+0000","last_clean":"2023-10-19T12:42:27.119122+0000","last_became_active":"2023-10-19T12:41:19.294836+0000","last_became_peered":"2023-10-19T12:41:19.294836+0000","last_unstale":"2023-10-19T12:42:27.119122+0000","last_undegraded":"2023-10-19T12:42:27.119122+0000","last_fullsized":"2023-10-19T12:42:27.119122+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:08:25.830396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.123261+0000","last_change":"2023-10-19T12:41:19.290047+0000","last_active":"2023-10-19T12:42:27.123261+0000","last_peered":"2023-10-19T12:42:27.123261+0000","last_clean":"2023-10-19T12:42:27.123261+0000","last_became_active":"2023-10-19T12:41:19.289792+0000","last_became_peered":"2023-10-19T12:41:19.289792+0000","last_unstale":"2023-10-19T12:42:27.123261+0000","last_undegraded":"2023-10-19T12:42:27.123261+0000","last_fullsized":"2023-10-19T12:42:27.123261+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:10:58.981643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.116433+0000","last_change":"2023-10-19T12:41:19.287973+0000","last_active":"2023-10-19T12:42:27.116433+0000","last_peered":"2023-10-19T12:42:27.116433+0000","last_clean":"2023-10-19T12:42:27.116433+0000","last_became_active":"2023-10-19T12:41:19.287508+0000","last_became_peered":"2023-10-19T12:41:19.287508+0000","last_unstale":"2023-10-19T12:42:27.116433+0000","last_undegraded":"2023-10-19T12:42:27.116433+0000","last_fullsized":"2023-10-19T12:42:27.116433+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:25:57.815032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.116496+0000","last_change":"2023-10-19T12:41:19.294154+0000","last_active":"2023-10-19T12:42:27.116496+0000","last_peered":"2023-10-19T12:42:27.116496+0000","last_clean":"2023-10-19T12:42:27.116496+0000","last_became_active":"2023-10-19T12:41:19.293873+0000","last_became_peered":"2023-10-19T12:41:19.293873+0000","last_unstale":"2023-10-19T12:42:27.116496+0000","last_undegraded":"2023-10-19T12:42:27.116496+0000","last_fullsized":"2023-10-19T12:42:27.116496+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:29:58.428571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.128735+0000","last_change":"2023-10-19T12:41:19.309512+0000","last_active":"2023-10-19T12:42:27.128735+0000","last_peered":"2023-10-19T12:42:27.128735+0000","last_clean":"2023-10-19T12:42:27.128735+0000","last_became_active":"2023-10-19T12:41:19.309149+0000","last_became_peered":"2023-10-19T12:41:19.309149+0000","last_unstale":"2023-10-19T12:42:27.128735+0000","last_undegraded":"2023-10-19T12:42:27.128735+0000","last_fullsized":"2023-10-19T12:42:27.128735+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:19:34.971413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.125576+0000","last_change":"2023-10-19T12:41:19.301496+0000","last_active":"2023-10-19T12:42:27.125576+0000","last_peered":"2023-10-19T12:42:27.125576+0000","last_clean":"2023-10-19T12:42:27.125576+0000","last_became_active":"2023-10-19T12:41:19.299697+0000","last_became_peered":"2023-10-19T12:41:19.299697+0000","last_unstale":"2023-10-19T12:42:27.125576+0000","last_undegraded":"2023-10-19T12:42:27.125576+0000","last_fullsized":"2023-10-19T12:42:27.125576+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T23:51:52.448215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.122410+0000","last_change":"2023-10-19T12:41:19.289995+0000","last_active":"2023-10-19T12:42:27.122410+0000","last_peered":"2023-10-19T12:42:27.122410+0000","last_clean":"2023-10-19T12:42:27.122410+0000","last_became_active":"2023-10-19T12:41:19.289471+0000","last_became_peered":"2023-10-19T12:41:19.289471+0000","last_unstale":"2023-10-19T12:42:27.122410+0000","last_undegraded":"2023-10-19T12:42:27.122410+0000","last_fullsized":"2023-10-19T12:42:27.122410+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:28:25.801772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.117119+0000","last_change":"2023-10-19T12:41:19.287620+0000","last_active":"2023-10-19T12:42:27.117119+0000","last_peered":"2023-10-19T12:42:27.117119+0000","last_clean":"2023-10-19T12:42:27.117119+0000","last_became_active":"2023-10-19T12:41:19.287298+0000","last_became_peered":"2023-10-19T12:41:19.287298+0000","last_unstale":"2023-10-19T12:42:27.117119+0000","last_undegraded":"2023-10-19T12:42:27.117119+0000","last_fullsized":"2023-10-19T12:42:27.117119+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:01:46.919580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.126548+0000","last_change":"2023-10-19T12:41:19.278455+0000","last_active":"2023-10-19T12:42:27.126548+0000","last_peered":"2023-10-19T12:42:27.126548+0000","last_clean":"2023-10-19T12:42:27.126548+0000","last_became_active":"2023-10-19T12:41:19.278093+0000","last_became_peered":"2023-10-19T12:41:19.278093+0000","last_unstale":"2023-10-19T12:42:27.126548+0000","last_undegraded":"2023-10-19T12:42:27.126548+0000","last_fullsized":"2023-10-19T12:42:27.126548+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T22:52:00.939409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.120697+0000","last_change":"2023-10-19T12:41:19.294478+0000","last_active":"2023-10-19T12:42:27.120697+0000","last_peered":"2023-10-19T12:42:27.120697+0000","last_clean":"2023-10-19T12:42:27.120697+0000","last_became_active":"2023-10-19T12:41:19.294136+0000","last_became_peered":"2023-10-19T12:41:19.294136+0000","last_unstale":"2023-10-19T12:42:27.120697+0000","last_undegraded":"2023-10-19T12:42:27.120697+0000","last_fullsized":"2023-10-19T12:42:27.120697+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:18:20.066346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.124555+0000","last_change":"2023-10-19T12:41:19.283014+0000","last_active":"2023-10-19T12:42:27.124555+0000","last_peered":"2023-10-19T12:42:27.124555+0000","last_clean":"2023-10-19T12:42:27.124555+0000","last_became_active":"2023-10-19T12:41:19.279958+0000","last_became_peered":"2023-10-19T12:41:19.279958+0000","last_unstale":"2023-10-19T12:42:27.124555+0000","last_undegraded":"2023-10-19T12:42:27.124555+0000","last_fullsized":"2023-10-19T12:42:27.124555+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-21T00:26:13.329031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.124617+0000","last_change":"2023-10-19T12:41:19.296507+0000","last_active":"2023-10-19T12:42:27.124617+0000","last_peered":"2023-10-19T12:42:27.124617+0000","last_clean":"2023-10-19T12:42:27.124617+0000","last_became_active":"2023-10-19T12:41:19.295960+0000","last_became_peered":"2023-10-19T12:41:19.295960+0000","last_unstale":"2023-10-19T12:42:27.124617+0000","last_undegraded":"2023-10-19T12:42:27.124617+0000","last_fullsized":"2023-10-19T12:42:27.124617+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T22:49:06.224425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.124927+0000","last_change":"2023-10-19T12:41:19.300262+0000","last_active":"2023-10-19T12:42:27.124927+0000","last_peered":"2023-10-19T12:42:27.124927+0000","last_clean":"2023-10-19T12:42:27.124927+0000","last_became_active":"2023-10-19T12:41:19.299702+0000","last_became_peered":"2023-10-19T12:41:19.299702+0000","last_unstale":"2023-10-19T12:42:27.124927+0000","last_undegraded":"2023-10-19T12:42:27.124927+0000","last_fullsized":"2023-10-19T12:42:27.124927+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:30:22.690228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.122957+0000","last_change":"2023-10-19T12:41:19.289863+0000","last_active":"2023-10-19T12:42:27.122957+0000","last_peered":"2023-10-19T12:42:27.122957+0000","last_clean":"2023-10-19T12:42:27.122957+0000","last_became_active":"2023-10-19T12:41:19.289556+0000","last_became_peered":"2023-10-19T12:41:19.289556+0000","last_unstale":"2023-10-19T12:42:27.122957+0000","last_undegraded":"2023-10-19T12:42:27.122957+0000","last_fullsized":"2023-10-19T12:42:27.122957+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:17:18.560081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":67253,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":508,"num_read_kb":332,"num_write":238,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":1204,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":201759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":208,"ondisk_log_size":208,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":79,"seq":339302416412,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1019904,"data_stored":495120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 19 12:41:32 2023","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":8.5449999999999999,"5min":8.5449999999999999,"15min":8.5449999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":7.641,"5min":7.641,"15min":7.641},"last":0.55100000000000005}]},{"osd":1,"last update":"Thu Oct 19 12:41:32 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.883,"5min":1.883,"15min":1.883},"last":0.61399999999999999}]},{"osd":2,"last update":"Thu Oct 19 12:41:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.496,"5min":1.496,"15min":1.496},"last":0.505},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.67900000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":4,"last update":"Thu Oct 19 12:41:32 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":3.5190000000000001,"5min":3.5190000000000001,"15min":3.5190000000000001},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.65800000000000003}]},{"osd":5,"last update":"Thu Oct 19 12:41:32 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.675,"5min":1.675,"15min":1.675},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":2.089,"5min":2.089,"15min":2.089},"last":0.63400000000000001}]},{"osd":6,"last update":"Thu Oct 19 12:41:32 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":2.004,"5min":2.004,"15min":2.004},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.704,"5min":1.704,"15min":1.704},"last":0.69399999999999995}]},{"osd":7,"last update":"Thu Oct 19 12:41:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":6.5590000000000002,"5min":6.5590000000000002,"15min":6.5590000000000002},"last":0.82799999999999996},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":7.3070000000000004,"5min":7.3070000000000004,"15min":7.3070000000000004},"last":0.81699999999999995}]},{"osd":8,"last update":"Thu Oct 19 12:42:20 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.79700000000000004}]},{"osd":9,"last update":"Thu Oct 19 12:41:32 2023","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":7.8440000000000003,"5min":7.8440000000000003,"15min":7.8440000000000003},"last":0.90700000000000003},{"interface":"front","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":5.0860000000000003,"5min":5.0860000000000003,"15min":5.0860000000000003},"last":0.996}]},{"osd":10,"last update":"Thu Oct 19 12:41:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":7.2619999999999996,"5min":7.2619999999999996,"15min":7.2619999999999996},"last":0.88700000000000001},{"interface":"front","average":{"1min":1.153,"5min":1.153,"15min":1.153},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":7.7619999999999996,"5min":7.7619999999999996,"15min":7.7619999999999996},"last":0.84899999999999998}]}]},{"osd":10,"up_from":72,"seq":309237645344,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28688,"kb_used_data":1664,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716464,"statfs":{"total":95995035648,"available":95965659136,"internally_reserved":0,"allocated":1703936,"data_stored":1141074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 19 12:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.501},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.626}]},{"osd":1,"last update":"Thu Oct 19 12:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.45500000000000002,"15min":0.45800000000000002},"min":{"1min":0.311,"5min":0.254,"15min":0.254},"max":{"1min":0.65700000000000003,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.441},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.46100000000000002,"15min":0.45900000000000002},"min":{"1min":0.32600000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.32200000000000001}]},{"osd":2,"last update":"Thu Oct 19 12:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.69599999999999995,"15min":0.70199999999999996},"min":{"1min":0.51700000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.83399999999999996,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.71099999999999997,"15min":0.71799999999999997},"min":{"1min":0.48799999999999999,"5min":0.433,"15min":0.433},"max":{"1min":0.91100000000000003,"5min":2.2050000000000001,"15min":2.2050000000000001},"last":0.54600000000000004}]},{"osd":3,"last update":"Thu Oct 19 12:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.65000000000000002,"15min":0.66000000000000003},"min":{"1min":0.46800000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.85799999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.65700000000000003,"15min":0.66400000000000003},"min":{"1min":0.502,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.81499999999999995,"5min":0.877,"15min":0.877},"last":0.47399999999999998}]},{"osd":4,"last update":"Thu Oct 19 12:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.38,"5min":0.37,"15min":0.37},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.56999999999999995,"15min":0.57199999999999995},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.95299999999999996,"5min":0.999,"15min":0.999},"last":0.56999999999999995}]},{"osd":5,"last update":"Thu Oct 19 12:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.82599999999999996,"15min":0.84399999999999997},"min":{"1min":0.505,"5min":0.434,"15min":0.434},"max":{"1min":1.2370000000000001,"5min":2.3940000000000001,"15min":2.3940000000000001},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.746,"5min":0.77800000000000002,"15min":0.78400000000000003},"min":{"1min":0.55900000000000005,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.0669999999999999,"5min":2.2530000000000001,"15min":2.2530000000000001},"last":0.58999999999999997}]},{"osd":6,"last update":"Thu Oct 19 12:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.75800000000000001,"15min":0.76600000000000001},"min":{"1min":0.47199999999999998,"5min":0.44,"15min":0.44},"max":{"1min":0.96899999999999997,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.54300000000000004,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.52300000000000002}]},{"osd":7,"last update":"Thu Oct 19 12:41:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":1.046}]},{"osd":8,"last update":"Thu Oct 19 12:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.84299999999999997,"15min":0.85499999999999998},"min":{"1min":0.57499999999999996,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.3089999999999999,"5min":2.012,"15min":2.012},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.90200000000000002,"15min":0.91800000000000004},"min":{"1min":0.621,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.2889999999999999,"5min":2.2290000000000001,"15min":2.2290000000000001},"last":0.67100000000000004}]},{"osd":9,"last update":"Thu Oct 19 12:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.81299999999999994,"15min":0.81599999999999995},"min":{"1min":0.57699999999999996,"5min":0.5,"15min":0.5},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.83199999999999996,"15min":0.83299999999999996},"min":{"1min":0.627,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.1699999999999999,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.74199999999999999}]},{"osd":11,"last update":"Thu Oct 19 12:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.65800000000000003}]}]},{"osd":9,"up_from":67,"seq":287762808868,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1044480,"data_stored":498174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 19 12:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.56399999999999995,"15min":0.58299999999999996},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.81999999999999995,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.501,"5min":0.56599999999999995,"15min":0.57699999999999996},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.77700000000000002,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.60299999999999998}]},{"osd":1,"last update":"Thu Oct 19 12:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.78100000000000003,"15min":0.79900000000000004},"min":{"1min":0.57399999999999995,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.77900000000000003,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.755,"15min":0.77100000000000002},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.81699999999999995,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":6.9279999999999999}]},{"osd":2,"last update":"Thu Oct 19 12:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.77100000000000002,"15min":0.78200000000000003},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.94299999999999995,"5min":1.117,"15min":1.117},"last":6.9420000000000002},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.77000000000000002,"15min":0.77700000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.95099999999999996,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.626}]},{"osd":3,"last update":"Thu Oct 19 12:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.746,"15min":0.76800000000000002},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.84499999999999997,"5min":1.196,"15min":1.196},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.83499999999999996,"15min":0.85699999999999998},"min":{"1min":0.52900000000000003,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.89900000000000002,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.57999999999999996}]},{"osd":4,"last update":"Thu Oct 19 12:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.83299999999999996,"15min":0.85599999999999998},"min":{"1min":0.50800000000000001,"5min":0.495,"15min":0.495},"max":{"1min":0.995,"5min":1.125,"15min":1.125},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.83099999999999996,"15min":0.84699999999999998},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.88700000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.50900000000000001}]},{"osd":5,"last update":"Thu Oct 19 12:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.873,"15min":0.89700000000000002},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.92400000000000004,"5min":1.141,"15min":1.141},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.85099999999999998,"15min":0.86499999999999999},"min":{"1min":0.54300000000000004,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.0920000000000001,"5min":1.177,"15min":1.177},"last":0.68899999999999995}]},{"osd":6,"last update":"Thu Oct 19 12:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.49399999999999999}]},{"osd":7,"last update":"Thu Oct 19 12:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.92200000000000004,"15min":0.93999999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0569999999999999,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.996,"15min":1.0229999999999999},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.034,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":0.64600000000000002}]},{"osd":8,"last update":"Thu Oct 19 12:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":1.0029999999999999,"15min":1.0329999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0640000000000001,"5min":1.3,"15min":1.3},"last":6.992},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.95899999999999996,"15min":0.97999999999999998},"min":{"1min":0.61299999999999999,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.0980000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.745}]},{"osd":10,"last update":"Thu Oct 19 12:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.96999999999999997,"15min":0.996},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.069,"5min":1.248,"15min":1.248},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.877,"5min":0.96099999999999997,"15min":0.97499999999999998},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.071,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.65500000000000003}]},{"osd":11,"last update":"Thu Oct 19 12:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":0.79000000000000004}]}]},{"osd":8,"up_from":59,"seq":253403070504,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1032192,"data_stored":493874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 19 12:42:28 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.60199999999999998,"15min":0.60599999999999998},"min":{"1min":0.375,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.627,"5min":0.59399999999999997,"15min":0.59299999999999997},"min":{"1min":0.48599999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.82099999999999995,"5min":0.872,"15min":0.872},"last":0.48399999999999999}]},{"osd":1,"last update":"Thu Oct 19 12:42:28 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.621,"15min":0.60399999999999998},"min":{"1min":0.504,"5min":0.378,"15min":0.378},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.61299999999999999,"15min":0.58999999999999997},"min":{"1min":0.51500000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.71899999999999997}]},{"osd":2,"last update":"Thu Oct 19 12:42:28 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.48099999999999998,"15min":0.47099999999999997},"min":{"1min":0.35599999999999998,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.624},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.48199999999999998,"15min":0.46800000000000003},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.46000000000000002}]},{"osd":3,"last update":"Thu Oct 19 12:42:28 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.63700000000000001,"15min":0.63300000000000001},"min":{"1min":0.48099999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.64100000000000001,"15min":0.65100000000000002},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.70199999999999996}]},{"osd":4,"last update":"Thu Oct 19 12:42:28 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.45500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.92900000000000005,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.67200000000000004,"15min":0.65600000000000003},"min":{"1min":0.58399999999999996,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.80700000000000005}]},{"osd":5,"last update":"Thu Oct 19 12:42:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.56399999999999995,"15min":0.55700000000000005},"min":{"1min":0.40200000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.84599999999999997,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.61199999999999999,"15min":0.61399999999999999},"min":{"1min":0.33600000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.93899999999999995,"5min":1.01,"15min":1.01},"last":0.82799999999999996}]},{"osd":6,"last update":"Thu Oct 19 12:42:28 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.73899999999999999,"15min":0.72899999999999998},"min":{"1min":0.53500000000000003,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":2.1520000000000001,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.72199999999999998,"15min":0.71799999999999997},"min":{"1min":0.53900000000000003,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.76600000000000001}]},{"osd":7,"last update":"Thu Oct 19 12:42:28 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.755,"15min":0.74099999999999999},"min":{"1min":0.497,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.77100000000000002,"15min":0.77200000000000002},"min":{"1min":0.57399999999999995,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.016,"5min":1.113,"15min":1.113},"last":0.91100000000000003}]},{"osd":9,"last update":"Thu Oct 19 12:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.76200000000000001,"15min":0.75700000000000001},"min":{"1min":0.56100000000000005,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0429999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.79500000000000004,"15min":0.78700000000000003},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.98199999999999998}]},{"osd":10,"last update":"Thu Oct 19 12:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.72999999999999998,"15min":0.70399999999999996},"min":{"1min":0.69399999999999995,"5min":0.434,"15min":0.434},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.78700000000000003,"15min":0.76600000000000001},"min":{"1min":0.65700000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.86899999999999999}]},{"osd":11,"last update":"Thu Oct 19 12:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.68500000000000005}]}]},{"osd":7,"up_from":51,"seq":219043332141,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28616,"kb_used_data":1596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716536,"statfs":{"total":95995035648,"available":95965732864,"internally_reserved":0,"allocated":1634304,"data_stored":1090562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 19 12:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.61899999999999999,"15min":0.60899999999999999},"min":{"1min":0.434,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.56699999999999995,"15min":0.56299999999999994},"min":{"1min":0.46400000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.76600000000000001,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.45400000000000001}]},{"osd":1,"last update":"Thu Oct 19 12:42:06 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.41499999999999998,"15min":0.40699999999999997},"min":{"1min":0.27700000000000002,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.55200000000000005,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.434,"15min":0.42599999999999999},"min":{"1min":0.29099999999999998,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.67900000000000005,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.44400000000000001}]},{"osd":2,"last update":"Thu Oct 19 12:42:06 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.59799999999999998,"15min":0.59599999999999997},"min":{"1min":0.38400000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.81200000000000006,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.60499999999999998,"15min":0.61499999999999999},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.80400000000000005,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.56699999999999995}]},{"osd":3,"last update":"Thu Oct 19 12:42:06 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.63900000000000001,"15min":0.63100000000000001},"min":{"1min":0.44600000000000001,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.86199999999999999,"5min":0.877,"15min":0.877},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.60299999999999998,"15min":0.60999999999999999},"min":{"1min":0.40300000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.72599999999999998,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.62}]},{"osd":4,"last update":"Thu Oct 19 12:42:06 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.51200000000000001,"15min":0.505},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.71399999999999997,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.49299999999999999,"15min":0.48299999999999998},"min":{"1min":0.32600000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.91500000000000004,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.745}]},{"osd":5,"last update":"Thu Oct 19 12:42:06 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.68200000000000005,"15min":0.67700000000000005},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.879,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.63900000000000001,"15min":0.63700000000000001},"min":{"1min":0.42599999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.86099999999999999,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.63400000000000001}]},{"osd":6,"last update":"Thu Oct 19 12:42:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.72399999999999998,"15min":0.72699999999999998},"min":{"1min":0.53500000000000003,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.82699999999999996,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.66200000000000003,"15min":0.66500000000000004},"min":{"1min":0.44,"5min":0.435,"15min":0.435},"max":{"1min":0.77000000000000002,"5min":1.006,"15min":1.006},"last":0.68999999999999995}]},{"osd":8,"last update":"Thu Oct 19 12:42:24 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.72099999999999997,"15min":0.72199999999999998},"min":{"1min":0.45600000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.89900000000000002,"5min":1.002,"15min":1.002},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.68799999999999994,"15min":0.68400000000000005},"min":{"1min":0.47599999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.89200000000000002,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.77300000000000002}]},{"osd":9,"last update":"Thu Oct 19 12:41:55 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.80100000000000005,"15min":0.78700000000000003},"min":{"1min":0.55800000000000005,"5min":0.504,"15min":0.504},"max":{"1min":2.9780000000000002,"5min":2.9780000000000002,"15min":2.9780000000000002},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.746,"15min":0.752},"min":{"1min":0.54100000000000004,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.79700000000000004,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.79500000000000004}]},{"osd":10,"last update":"Thu Oct 19 12:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.67900000000000005,"15min":0.68200000000000005},"min":{"1min":0.42299999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.78700000000000003,"5min":1.044,"15min":1.044},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.751,"5min":0.754,"15min":0.754},"min":{"1min":0.63700000000000001,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.91000000000000003,"5min":1.024,"15min":1.024},"last":0.83199999999999996}]},{"osd":11,"last update":"Thu Oct 19 12:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.65300000000000002}]}]},{"osd":6,"up_from":46,"seq":197568495666,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1015808,"data_stored":489582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 19 12:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.496,"15min":0.48599999999999999},"min":{"1min":0.33200000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.54000000000000004,"15min":0.54800000000000004},"min":{"1min":0.371,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.80700000000000005,"5min":1.107,"15min":1.107},"last":0.51100000000000001}]},{"osd":1,"last update":"Thu Oct 19 12:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.64000000000000001,"15min":0.62},"min":{"1min":0.45300000000000001,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.75,"5min":0.69699999999999995,"15min":0.67500000000000004},"min":{"1min":0.50900000000000001,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.83699999999999997}]},{"osd":2,"last update":"Thu Oct 19 12:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67800000000000005,"15min":0.67600000000000005},"min":{"1min":0.499,"5min":0.437,"15min":0.437},"max":{"1min":0.877,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.66500000000000004,"15min":0.65700000000000003},"min":{"1min":0.437,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.63100000000000001}]},{"osd":3,"last update":"Thu Oct 19 12:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.62,"15min":0.627},"min":{"1min":0.39800000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.69399999999999995,"15min":0.70099999999999996},"min":{"1min":0.43099999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.66500000000000004}]},{"osd":4,"last update":"Thu Oct 19 12:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.54300000000000004,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.1339999999999999,"5min":1.179,"15min":1.179},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77600000000000002,"15min":0.78300000000000003},"min":{"1min":0.54800000000000004,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.88300000000000001}]},{"osd":5,"last update":"Thu Oct 19 12:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.82099999999999995,"15min":0.81100000000000005},"min":{"1min":0.57199999999999995,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.0429999999999999,"5min":1.177,"15min":1.177},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.81299999999999994,"15min":0.82299999999999995},"min":{"1min":0.59399999999999997,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.0249999999999999,"5min":1.534,"15min":1.534},"last":0.90100000000000002}]},{"osd":7,"last update":"Thu Oct 19 12:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.83999999999999997,"15min":0.81399999999999995},"min":{"1min":0.55500000000000005,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.879,"5min":1.879,"15min":1.879},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.86699999999999999,"15min":0.85399999999999998},"min":{"1min":0.69499999999999995,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.8280000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":0.95199999999999996}]},{"osd":8,"last update":"Thu Oct 19 12:42:31 2023","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":0.90400000000000003,"15min":0.89400000000000002},"min":{"1min":0.61199999999999999,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.7210000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":1.111},{"interface":"front","average":{"1min":1.133,"5min":0.94199999999999995,"15min":0.92200000000000004},"min":{"1min":0.79200000000000004,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":3.5600000000000001,"5min":3.5600000000000001,"15min":3.5600000000000001},"last":1}]},{"osd":9,"last update":"Thu Oct 19 12:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.84899999999999998,"15min":0.85999999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":1.016},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.98399999999999999,"15min":1},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.1459999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":1.048}]},{"osd":10,"last update":"Thu Oct 19 12:42:15 2023","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":1.139},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.97699999999999998,"15min":0.97499999999999998},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.8640000000000001,"5min":1.8640000000000001,"15min":1.8640000000000001},"last":1.032}]},{"osd":11,"last update":"Thu Oct 19 12:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.8999999999999999,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":1.0680000000000001},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.93300000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574920,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28088,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717064,"statfs":{"total":95995035648,"available":95966273536,"internally_reserved":0,"allocated":1089536,"data_stored":551675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 19 12:41:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.64000000000000001,"15min":0.59099999999999997},"min":{"1min":0.38600000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.751,"5min":8.4559999999999995,"15min":8.4559999999999995},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.58799999999999997,"15min":0.56699999999999995},"min":{"1min":0.41399999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.82099999999999995,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.51100000000000001}]},{"osd":2,"last update":"Thu Oct 19 12:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.56699999999999995,"15min":0.60099999999999998},"min":{"1min":0.46800000000000003,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.81299999999999994,"5min":4.1710000000000003,"15min":4.1710000000000003},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.56499999999999995,"15min":0.51700000000000002},"min":{"1min":0.54200000000000004,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.86199999999999999,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.72599999999999998}]},{"osd":3,"last update":"Thu Oct 19 12:41:37 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60499999999999998,"15min":0.58899999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.83699999999999997,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.56599999999999995,"15min":0.55800000000000005},"min":{"1min":0.434,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.441}]},{"osd":4,"last update":"Thu Oct 19 12:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.42799999999999999,"15min":0.40300000000000002},"min":{"1min":0.317,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.85599999999999998,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.495,"5min":0.438,"15min":0.40699999999999997},"min":{"1min":0.28399999999999997,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.90200000000000002,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.39600000000000002}]},{"osd":5,"last update":"Thu Oct 19 12:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.54800000000000004,"15min":0.53800000000000003},"min":{"1min":0.44400000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.61099999999999999,"15min":0.57499999999999996},"min":{"1min":0.57399999999999995,"5min":0.378,"15min":0.378},"max":{"1min":0.95799999999999996,"5min":1.03,"15min":1.03},"last":0.80700000000000005}]},{"osd":6,"last update":"Thu Oct 19 12:41:49 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.69799999999999995,"15min":0.68999999999999995},"min":{"1min":0.48699999999999999,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0249999999999999,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.85599999999999998,"15min":0.95199999999999996},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.89000000000000001,"5min":8.4039999999999999,"15min":8.4039999999999999},"last":0.56299999999999994}]},{"osd":7,"last update":"Thu Oct 19 12:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.627,"15min":0.61499999999999999},"min":{"1min":0.35599999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.996,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.877,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.48199999999999998}]},{"osd":8,"last update":"Thu Oct 19 12:42:28 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.64400000000000002,"15min":0.628},"min":{"1min":0.51100000000000001,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.93799999999999994,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.751},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.752,"15min":0.73799999999999999},"min":{"1min":0.57999999999999996,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0409999999999999,"5min":1.117,"15min":1.117},"last":0.88400000000000001}]},{"osd":9,"last update":"Thu Oct 19 12:41:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.92200000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.70699999999999996}]},{"osd":10,"last update":"Thu Oct 19 12:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.68600000000000005,"15min":0.67400000000000004},"min":{"1min":0.434,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.76900000000000002,"15min":0.755},"min":{"1min":0.46300000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.84799999999999998}]},{"osd":11,"last update":"Thu Oct 19 12:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.90700000000000003}]}]},{"osd":0,"up_from":8,"seq":34359738446,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28040,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717112,"statfs":{"total":95995035648,"available":95966322688,"internally_reserved":0,"allocated":1040384,"data_stored":491428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Oct 19 12:41:50 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.61499999999999999,"15min":0.56999999999999995},"min":{"1min":0.45700000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.1830000000000001,"5min":1.405,"15min":1.405},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.61799999999999999,"15min":0.56799999999999995},"min":{"1min":0.495,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.94999999999999996,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.72499999999999998}]},{"osd":2,"last update":"Thu Oct 19 12:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.64800000000000002,"15min":0.61699999999999999},"min":{"1min":0.51700000000000002,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":2.1019999999999999,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.64400000000000002,"15min":0.57999999999999996},"min":{"1min":0.52200000000000002,"5min":0.379,"15min":0.379},"max":{"1min":1.0429999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.79400000000000004}]},{"osd":3,"last update":"Thu Oct 19 12:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.63}]},{"osd":4,"last update":"Thu Oct 19 12:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.68000000000000005,"15min":0.64000000000000001},"min":{"1min":0.48199999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.88,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.66300000000000003,"15min":0.63500000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.165,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.77500000000000002}]},{"osd":5,"last update":"Thu Oct 19 12:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.72199999999999998,"15min":0.67800000000000005},"min":{"1min":0.60499999999999998,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":2.8300000000000001,"5min":2.8300000000000001,"15min":2.8300000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.71699999999999997,"15min":0.69699999999999995},"min":{"1min":0.57299999999999995,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":2.145,"5min":2.145,"15min":2.145},"last":0.81200000000000006}]},{"osd":6,"last update":"Thu Oct 19 12:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.68700000000000006,"15min":0.66600000000000004},"min":{"1min":0.45100000000000001,"5min":0.375,"15min":0.375},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.67300000000000004,"15min":0.65500000000000003},"min":{"1min":0.42399999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.0840000000000001,"5min":1.6160000000000001,"15min":1.6160000000000001},"last":0.84599999999999997}]},{"osd":7,"last update":"Thu Oct 19 12:42:24 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":2.2349999999999999,"5min":2.2349999999999999,"15min":2.2349999999999999},"last":0.83799999999999997},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":5.524,"5min":5.524,"15min":5.524},"last":0.87}]},{"osd":8,"last update":"Thu Oct 19 12:42:29 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.89900000000000002,"15min":0.83099999999999996},"min":{"1min":0.61299999999999999,"5min":0.503,"15min":0.503},"max":{"1min":2.7949999999999999,"5min":6.8730000000000002,"15min":6.8730000000000002},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.84599999999999997,"15min":0.83499999999999996},"min":{"1min":0.60099999999999998,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":2.1760000000000002,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":0.85899999999999999}]},{"osd":9,"last update":"Thu Oct 19 12:41:55 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.76700000000000002,"15min":0.75700000000000001},"min":{"1min":0.56499999999999995,"5min":0.499,"15min":0.499},"max":{"1min":1.405,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.85199999999999998,"15min":0.84999999999999998},"min":{"1min":0.54100000000000004,"5min":0.442,"15min":0.442},"max":{"1min":1.1950000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.95899999999999996}]},{"osd":10,"last update":"Thu Oct 19 12:42:14 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":0.98599999999999999,"15min":0.97999999999999998},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":2.875,"5min":2.875,"15min":2.875},"last":0.99099999999999999},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.96199999999999997,"15min":0.96899999999999997},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":2.2639999999999998,"5min":2.2639999999999998,"15min":2.2639999999999998},"last":0.94999999999999996}]},{"osd":11,"last update":"Thu Oct 19 12:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.97599999999999998},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":1.012}]}]},{"osd":2,"up_from":18,"seq":77309411397,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28092,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717060,"statfs":{"total":95995035648,"available":95966269440,"internally_reserved":0,"allocated":1093632,"data_stored":551041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 19 12:42:15 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.57399999999999995,"15min":0.56899999999999995},"min":{"1min":0.36699999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.88400000000000001,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.496},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.61599999999999999,"15min":0.57799999999999996},"min":{"1min":0.40699999999999997,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":6.726,"5min":6.726,"15min":6.726},"last":1.3520000000000001}]},{"osd":1,"last update":"Thu Oct 19 12:42:15 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.58599999999999997,"15min":0.55800000000000005},"min":{"1min":0.315,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.99299999999999999,"5min":1.081,"15min":1.081},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.60199999999999998,"15min":0.56699999999999995},"min":{"1min":0.34499999999999997,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.98199999999999998,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.623}]},{"osd":3,"last update":"Thu Oct 19 12:41:38 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59899999999999998,"15min":0.58699999999999997},"min":{"1min":0.40899999999999997,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.82699999999999996,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.58999999999999997,"15min":0.60199999999999998},"min":{"1min":0.437,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.81599999999999995,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.42699999999999999}]},{"osd":4,"last update":"Thu Oct 19 12:42:22 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.64900000000000002}]},{"osd":5,"last update":"Thu Oct 19 12:42:27 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.47999999999999998,"15min":0.44900000000000001},"min":{"1min":0.29999999999999999,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.72699999999999998,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.50800000000000001,"15min":0.47299999999999998},"min":{"1min":0.35499999999999998,"5min":0.25,"15min":0.25},"max":{"1min":0.92900000000000005,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.35499999999999998}]},{"osd":6,"last update":"Thu Oct 19 12:41:46 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.66000000000000003,"15min":0.64100000000000001},"min":{"1min":0.56399999999999995,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.66800000000000004,"15min":0.66000000000000003},"min":{"1min":0.56299999999999994,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.88400000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.57799999999999996}]},{"osd":7,"last update":"Thu Oct 19 12:42:22 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.67600000000000005}]},{"osd":8,"last update":"Thu Oct 19 12:42:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.65600000000000003,"15min":0.66000000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.94699999999999995,"5min":1.429,"15min":1.429},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.67900000000000005,"15min":0.67000000000000004},"min":{"1min":0.45000000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.002,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.45000000000000001}]},{"osd":9,"last update":"Thu Oct 19 12:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.753,"15min":0.73899999999999999},"min":{"1min":0.628,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.72699999999999998,"15min":0.71599999999999997},"min":{"1min":0.60499999999999998,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":1.2829999999999999}]},{"osd":10,"last update":"Thu Oct 19 12:42:15 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.72599999999999998,"15min":0.70999999999999996},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.76000000000000001,"15min":0.73499999999999999},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.63600000000000001}]},{"osd":11,"last update":"Thu Oct 19 12:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.69299999999999995}]}]},{"osd":3,"up_from":25,"seq":107374182464,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1028096,"data_stored":489290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 19 12:41:39 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.44900000000000001,"15min":0.433},"min":{"1min":0.318,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.70499999999999996,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.432},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.45700000000000002,"15min":0.41499999999999998},"min":{"1min":0.38400000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.65100000000000002,"5min":1.044,"15min":1.044},"last":0.45700000000000002}]},{"osd":1,"last update":"Thu Oct 19 12:41:39 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.66500000000000004,"15min":0.61299999999999999},"min":{"1min":0.48699999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.61199999999999999,"15min":0.56799999999999995},"min":{"1min":0.50900000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.0049999999999999,"5min":1.228,"15min":1.228},"last":0.49099999999999999}]},{"osd":2,"last update":"Thu Oct 19 12:41:39 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.64100000000000001,"15min":0.60699999999999998},"min":{"1min":0.48499999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.91900000000000004,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.67100000000000004,"15min":0.60799999999999998},"min":{"1min":0.64500000000000002,"5min":0.374,"15min":0.374},"max":{"1min":1.004,"5min":1.056,"15min":1.056},"last":0.76700000000000002}]},{"osd":4,"last update":"Thu Oct 19 12:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.70699999999999996,"15min":0.65400000000000003},"min":{"1min":0.57799999999999996,"5min":0.435,"15min":0.435},"max":{"1min":0.92600000000000005,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.72599999999999998,"15min":0.65600000000000003},"min":{"1min":0.64100000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.042,"5min":1.228,"15min":1.228},"last":0.60199999999999998}]},{"osd":5,"last update":"Thu Oct 19 12:42:27 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.79800000000000004,"15min":0.746},"min":{"1min":0.63,"5min":0.501,"15min":0.501},"max":{"1min":1.0680000000000001,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.752,"5min":0.72599999999999998,"15min":0.69499999999999995},"min":{"1min":0.59999999999999998,"5min":0.443,"15min":0.443},"max":{"1min":0.96999999999999997,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.90000000000000002}]},{"osd":6,"last update":"Thu Oct 19 12:41:43 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.64100000000000001,"15min":0.623},"min":{"1min":0.53500000000000003,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.97599999999999998,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.745,"15min":0.70599999999999996},"min":{"1min":0.51300000000000001,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.157,"5min":1.45,"15min":1.45},"last":0.88500000000000001}]},{"osd":7,"last update":"Thu Oct 19 12:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.71099999999999997,"15min":0.69699999999999995},"min":{"1min":0.55600000000000005,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.0640000000000001,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76400000000000001,"15min":0.73599999999999999},"min":{"1min":0.61799999999999999,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":0.95999999999999996,"5min":1.127,"15min":1.127},"last":1.2809999999999999}]},{"osd":8,"last update":"Thu Oct 19 12:40:26 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.97599999999999998},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.998}]},{"osd":9,"last update":"Thu Oct 19 12:41:56 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.91400000000000003,"15min":0.91000000000000003},"min":{"1min":0.58799999999999997,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.222,"5min":1.478,"15min":1.478},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.79700000000000004,"15min":0.80300000000000005},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.57499999999999996}]},{"osd":10,"last update":"Thu Oct 19 12:42:18 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.88900000000000001,"15min":0.90500000000000003},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.1080000000000001,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.91500000000000004,"15min":0.93300000000000005},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.046,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.86899999999999999}]},{"osd":11,"last update":"Thu Oct 19 12:42:18 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.83199999999999996}]}]},{"osd":4,"up_from":33,"seq":141733920827,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1024000,"data_stored":493656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 19 12:40:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.51900000000000002,"15min":0.50700000000000001},"min":{"1min":0.38500000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.44},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.54900000000000004,"15min":0.52900000000000003},"min":{"1min":0.47999999999999998,"5min":0.37,"15min":0.37},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":2.1539999999999999}]},{"osd":1,"last update":"Thu Oct 19 12:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.42099999999999999,"15min":0.39200000000000002},"min":{"1min":0.29799999999999999,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":2.3559999999999999,"5min":2.3559999999999999,"15min":2.3559999999999999},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.436,"15min":0.40500000000000003},"min":{"1min":0.311,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":3.129,"5min":3.129,"15min":3.129},"last":0.44800000000000001}]},{"osd":2,"last update":"Thu Oct 19 12:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.63200000000000001,"15min":0.56499999999999995},"min":{"1min":0.41999999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":7.6470000000000002,"5min":7.6470000000000002,"15min":7.6470000000000002},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.60299999999999998,"15min":0.56599999999999995},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.84899999999999998,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.66800000000000004}]},{"osd":3,"last update":"Thu Oct 19 12:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.61099999999999999,"15min":0.57699999999999996},"min":{"1min":0.46100000000000002,"5min":0.376,"15min":0.376},"max":{"1min":3.1019999999999999,"5min":3.1019999999999999,"15min":3.1019999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.66300000000000003,"15min":0.61299999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":7.444,"5min":7.444,"15min":7.444},"last":0.55400000000000005}]},{"osd":5,"last update":"Thu Oct 19 12:42:22 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.65100000000000002,"15min":0.622},"min":{"1min":0.48599999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.93700000000000006,"5min":1.732,"15min":1.732},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.69099999999999995,"15min":0.622},"min":{"1min":0.44400000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.98699999999999999,"5min":6.8390000000000004,"15min":6.8390000000000004},"last":0.76100000000000001}]},{"osd":6,"last update":"Thu Oct 19 12:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.69799999999999995,"15min":0.65000000000000002},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":6.5309999999999997,"5min":6.5309999999999997,"15min":6.5309999999999997},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.69399999999999995,"15min":0.66400000000000003},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":2.2250000000000001,"5min":2.2250000000000001,"15min":2.2250000000000001},"last":0.56499999999999995}]},{"osd":7,"last update":"Thu Oct 19 12:42:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.59799999999999998,"15min":0.57699999999999996},"min":{"1min":0.32300000000000001,"5min":0.308,"15min":0.308},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.58499999999999996,"15min":0.55500000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.61399999999999999}]},{"osd":8,"last update":"Thu Oct 19 12:42:28 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.73199999999999998,"15min":0.69799999999999995},"min":{"1min":0.48699999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.0629999999999999,"5min":2.2719999999999998,"15min":2.2719999999999998},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.72499999999999998,"15min":0.68799999999999994},"min":{"1min":0.54900000000000004,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.117,"5min":2.504,"15min":2.504},"last":0.80000000000000004}]},{"osd":9,"last update":"Thu Oct 19 12:41:55 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.78100000000000003,"15min":0.748},"min":{"1min":0.56100000000000005,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":4.5800000000000001,"5min":4.5800000000000001,"15min":4.5800000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":1.085,"5min":0.86099999999999999,"15min":0.82299999999999995},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":3.8300000000000001,"5min":3.8300000000000001,"15min":3.8300000000000001},"last":0.86299999999999999}]},{"osd":10,"last update":"Thu Oct 19 12:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.80500000000000005,"15min":0.80000000000000004},"min":{"1min":0.42599999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.538,"5min":1.538,"15min":1.538},"last":0.89800000000000002},{"interface":"front","average":{"1min":1.0549999999999999,"5min":0.81499999999999995,"15min":0.77500000000000002},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":6.8780000000000001,"5min":6.8780000000000001,"15min":6.8780000000000001},"last":0.84099999999999997}]},{"osd":11,"last update":"Thu Oct 19 12:42:18 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":3.0350000000000001,"5min":3.0350000000000001,"15min":3.0350000000000001},"last":0.88},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":7.3010000000000002,"5min":7.3010000000000002,"15min":7.3010000000000002},"last":0.746}]}]},{"osd":5,"up_from":38,"seq":163208757303,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28620,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716532,"statfs":{"total":95995035648,"available":95965728768,"internally_reserved":0,"allocated":1642496,"data_stored":1086144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 19 12:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53600000000000003,"15min":0.52600000000000002},"min":{"1min":0.35699999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.496,"5min":0.55000000000000004,"15min":0.53800000000000003},"min":{"1min":0.376,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.63900000000000001,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.56899999999999995}]},{"osd":1,"last update":"Thu Oct 19 12:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.56000000000000005,"15min":0.53200000000000003},"min":{"1min":0.50800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.56699999999999995,"15min":0.54700000000000004},"min":{"1min":0.45100000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.71199999999999997}]},{"osd":2,"last update":"Thu Oct 19 12:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.41599999999999998,"15min":0.39000000000000001},"min":{"1min":0.35999999999999999,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.45400000000000001,"15min":0.434},"min":{"1min":0.32600000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.60899999999999999}]},{"osd":3,"last update":"Thu Oct 19 12:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.59099999999999997,"15min":0.57899999999999996},"min":{"1min":0.40899999999999997,"5min":0.317,"15min":0.317},"max":{"1min":0.77600000000000002,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.624,"15min":0.61499999999999999},"min":{"1min":0.49199999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.72999999999999998}]},{"osd":4,"last update":"Thu Oct 19 12:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.60899999999999999,"15min":0.57899999999999996},"min":{"1min":0.55300000000000005,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.85799999999999998,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.874},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.59399999999999997,"15min":0.57199999999999995},"min":{"1min":0.55900000000000005,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.80300000000000005}]},{"osd":6,"last update":"Thu Oct 19 12:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.66600000000000004,"15min":0.66800000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.91400000000000003,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.753},{"interface":"front","average":{"1min":0.62,"5min":0.66800000000000004,"15min":0.67400000000000004},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.82499999999999996,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.85599999999999998}]},{"osd":7,"last update":"Thu Oct 19 12:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.66800000000000004,"15min":0.66600000000000004},"min":{"1min":0.50600000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.90900000000000003,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.68100000000000005,"15min":0.66600000000000004},"min":{"1min":0.54200000000000004,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.034,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.89500000000000002}]},{"osd":8,"last update":"Thu Oct 19 12:42:28 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.63400000000000001,"15min":0.626},"min":{"1min":0.44900000000000001,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.89400000000000002,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.68700000000000006,"15min":0.68100000000000005},"min":{"1min":0.436,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.0129999999999999,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.91300000000000003}]},{"osd":9,"last update":"Thu Oct 19 12:41:52 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.75900000000000001,"15min":0.76100000000000001},"min":{"1min":0.54900000000000004,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.91400000000000003,"5min":1.292,"15min":1.292},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.75900000000000001,"15min":0.76300000000000001},"min":{"1min":0.59099999999999997,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.92500000000000004,"5min":1.115,"15min":1.115},"last":0.83999999999999997}]},{"osd":10,"last update":"Thu Oct 19 12:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.755,"15min":0.74199999999999999},"min":{"1min":0.59999999999999998,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.73199999999999998,"15min":0.71999999999999997},"min":{"1min":0.65600000000000003,"5min":0.438,"15min":0.438},"max":{"1min":1.0580000000000001,"5min":1.145,"15min":1.145},"last":0.92700000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":62815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":62181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":62177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-19T12:42:38.017 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph pg dump --format=json 2023-10-19T12:42:38.766 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-19T12:42:38.837 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:38 smithi157 ceph-mon[134109]: from='client.15123 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-19T12:42:38.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:38 smithi195 ceph-mon[134493]: from='client.15123 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-19T12:42:38.978 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:38 smithi046 ceph-mon[98509]: from='client.15123 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-19T12:42:39.723 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:39 smithi046 ceph-mon[98509]: pgmap v326: 129 pgs: 129 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s; 114 B/s, 0 keys/s, 1 objects/s recovering 2023-10-19T12:42:39.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:39 smithi195 ceph-mon[134493]: pgmap v326: 129 pgs: 129 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s; 114 B/s, 0 keys/s, 1 objects/s recovering 2023-10-19T12:42:40.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:39 smithi157 ceph-mon[134109]: pgmap v326: 129 pgs: 129 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s; 114 B/s, 0 keys/s, 1 objects/s recovering 2023-10-19T12:42:40.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:40.282+0000 7fa4913e4700 1 -- 172.21.15.46:0/3129418771 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa48c072f60 msgr2=0x7fa48c0733e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:40.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:40.282+0000 7fa4913e4700 1 --2- 172.21.15.46:0/3129418771 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa48c072f60 0x7fa48c0733e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fa480009990 tx=0x7fa480009ca0 comp rx=0 tx=0).stop 2023-10-19T12:42:40.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:40.283+0000 7fa4913e4700 1 -- 172.21.15.46:0/3129418771 shutdown_connections 2023-10-19T12:42:40.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:40.283+0000 7fa4913e4700 1 --2- 172.21.15.46:0/3129418771 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa48c111570 0x7fa48c1139a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:40.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:40.283+0000 7fa4913e4700 1 --2- 172.21.15.46:0/3129418771 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa48c074770 0x7fa48c072a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:40.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:40.283+0000 7fa4913e4700 1 --2- 172.21.15.46:0/3129418771 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa48c072f60 0x7fa48c0733e0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:40.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:40.283+0000 7fa4913e4700 1 -- 172.21.15.46:0/3129418771 >> 172.21.15.46:0/3129418771 conn(0x7fa48c0779e0 msgr2=0x7fa48c077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:40.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:40.283+0000 7fa4913e4700 1 -- 172.21.15.46:0/3129418771 shutdown_connections 2023-10-19T12:42:40.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:40.283+0000 7fa4913e4700 1 -- 172.21.15.46:0/3129418771 wait complete. 2023-10-19T12:42:40.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:40.284+0000 7fa4913e4700 1 Processor -- start 2023-10-19T12:42:40.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:40.284+0000 7fa4913e4700 1 -- start start 2023-10-19T12:42:40.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:40.284+0000 7fa4913e4700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa48c072f60 0x7fa48c19d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:40.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:40.284+0000 7fa4913e4700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa48c074770 0x7fa48c19d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:40.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:40.284+0000 7fa4913e4700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa48c111570 0x7fa48c1a1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:40.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:40.284+0000 7fa4913e4700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa48c1a21c0 con 0x7fa48c111570 2023-10-19T12:42:40.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:40.284+0000 7fa4913e4700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa48c1a2330 con 0x7fa48c074770 2023-10-19T12:42:40.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:40.284+0000 7fa4913e4700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa48c1a24f0 con 0x7fa48c072f60 2023-10-19T12:42:40.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:40.285+0000 7fa48affd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa48c072f60 0x7fa48c19d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:40.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:40.285+0000 7fa48a7fc700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa48c074770 0x7fa48c19d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:40.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:40.285+0000 7fa48affd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa48c072f60 0x7fa48c19d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:45088/0 (socket says 172.21.15.46:45088) 2023-10-19T12:42:40.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:40.285+0000 7fa48affd700 1 -- 172.21.15.46:0/2552470470 learned_addr learned my addr 172.21.15.46:0/2552470470 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:42:40.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:40.285+0000 7fa48b7fe700 1 --2- 172.21.15.46:0/2552470470 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa48c111570 0x7fa48c1a1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:40.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:40.285+0000 7fa48a7fc700 1 -- 172.21.15.46:0/2552470470 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa48c072f60 msgr2=0x7fa48c19d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:40.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:40.285+0000 7fa48a7fc700 1 --2- 172.21.15.46:0/2552470470 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa48c072f60 0x7fa48c19d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:40.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:40.285+0000 7fa48a7fc700 1 -- 172.21.15.46:0/2552470470 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa48c111570 msgr2=0x7fa48c1a1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:40.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:40.285+0000 7fa48a7fc700 1 --2- 172.21.15.46:0/2552470470 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa48c111570 0x7fa48c1a1bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:40.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:40.285+0000 7fa48a7fc700 1 -- 172.21.15.46:0/2552470470 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4800095f0 con 0x7fa48c074770 2023-10-19T12:42:40.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:40.285+0000 7fa48affd700 1 --2- 172.21.15.46:0/2552470470 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa48c072f60 0x7fa48c19d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:42:40.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:40.285+0000 7fa48a7fc700 1 --2- 172.21.15.46:0/2552470470 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa48c074770 0x7fa48c19d800 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa4800098e0 tx=0x7fa480005740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:40.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:40.286+0000 7fa473fff700 1 -- 172.21.15.46:0/2552470470 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa48001d070 con 0x7fa48c074770 2023-10-19T12:42:40.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:40.286+0000 7fa473fff700 1 -- 172.21.15.46:0/2552470470 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa480022470 con 0x7fa48c074770 2023-10-19T12:42:40.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:40.286+0000 7fa4913e4700 1 -- 172.21.15.46:0/2552470470 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa48c1a2770 con 0x7fa48c074770 2023-10-19T12:42:40.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:40.286+0000 7fa473fff700 1 -- 172.21.15.46:0/2552470470 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa480017650 con 0x7fa48c074770 2023-10-19T12:42:40.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:40.286+0000 7fa4913e4700 1 -- 172.21.15.46:0/2552470470 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa48c1aa030 con 0x7fa48c074770 2023-10-19T12:42:40.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:40.287+0000 7fa4913e4700 1 -- 172.21.15.46:0/2552470470 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa48c0740b0 con 0x7fa48c074770 2023-10-19T12:42:40.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:40.289+0000 7fa473fff700 1 -- 172.21.15.46:0/2552470470 <== mon.2 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7fa4800225e0 con 0x7fa48c074770 2023-10-19T12:42:40.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:40.290+0000 7fa473fff700 1 --2- 172.21.15.46:0/2552470470 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fa4740a1510 0x7fa4740a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:40.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:40.290+0000 7fa473fff700 1 -- 172.21.15.46:0/2552470470 <== mon.2 v2:172.21.15.157:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fa4800cec40 con 0x7fa48c074770 2023-10-19T12:42:40.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:40.291+0000 7fa48affd700 1 --2- 172.21.15.46:0/2552470470 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fa4740a1510 0x7fa4740a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:40.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:40.291+0000 7fa48affd700 1 --2- 172.21.15.46:0/2552470470 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fa4740a1510 0x7fa4740a39d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa47c005950 tx=0x7fa47c00b500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:40.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:40.293+0000 7fa473fff700 1 -- 172.21.15.46:0/2552470470 <== mon.2 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa480097e60 con 0x7fa48c074770 2023-10-19T12:42:40.502 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:40.499+0000 7fa4913e4700 1 -- 172.21.15.46:0/2552470470 --> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa48c04e560 con 0x7fa4740a1510 2023-10-19T12:42:40.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:40.513+0000 7fa473fff700 1 -- 172.21.15.46:0/2552470470 <== mgr.14150 v2:172.21.15.46:6800/3168073651 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+426740 (secure 0 0 0) 0x7fa48c04e560 con 0x7fa4740a1510 2023-10-19T12:42:40.526 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:42:40.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:40.518+0000 7fa4913e4700 1 -- 172.21.15.46:0/2552470470 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fa4740a1510 msgr2=0x7fa4740a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:40.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:40.518+0000 7fa4913e4700 1 --2- 172.21.15.46:0/2552470470 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fa4740a1510 0x7fa4740a39d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa47c005950 tx=0x7fa47c00b500 comp rx=0 tx=0).stop 2023-10-19T12:42:40.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:40.518+0000 7fa4913e4700 1 -- 172.21.15.46:0/2552470470 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa48c074770 msgr2=0x7fa48c19d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:40.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:40.518+0000 7fa4913e4700 1 --2- 172.21.15.46:0/2552470470 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa48c074770 0x7fa48c19d800 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa4800098e0 tx=0x7fa480005740 comp rx=0 tx=0).stop 2023-10-19T12:42:40.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:40.518+0000 7fa4913e4700 1 -- 172.21.15.46:0/2552470470 shutdown_connections 2023-10-19T12:42:40.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:40.518+0000 7fa4913e4700 1 --2- 172.21.15.46:0/2552470470 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa48c111570 0x7fa48c1a1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:40.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:40.518+0000 7fa4913e4700 1 --2- 172.21.15.46:0/2552470470 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fa4740a1510 0x7fa4740a39d0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:40.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:40.518+0000 7fa4913e4700 1 --2- 172.21.15.46:0/2552470470 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa48c072f60 0x7fa48c19d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:40.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:40.518+0000 7fa4913e4700 1 --2- 172.21.15.46:0/2552470470 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa48c074770 0x7fa48c19d800 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:40.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:40.518+0000 7fa4913e4700 1 -- 172.21.15.46:0/2552470470 >> 172.21.15.46:0/2552470470 conn(0x7fa48c0779e0 msgr2=0x7fa48c110140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:40.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:40.518+0000 7fa4913e4700 1 -- 172.21.15.46:0/2552470470 shutdown_connections 2023-10-19T12:42:40.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:40.518+0000 7fa4913e4700 1 -- 172.21.15.46:0/2552470470 wait complete. 2023-10-19T12:42:40.535 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-10-19T12:42:40.972 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":326,"stamp":"2023-10-19T12:42:38.657516+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":657867,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":644,"num_read_kb":441,"num_write":421,"num_write_kb":3077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":1181940,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":347,"ondisk_log_size":347,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":338300,"kb_used_data":14032,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124603524,"statfs":{"total":1151940427776,"available":1151594008576,"internally_reserved":0,"allocated":14368768,"data_stored":7871620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19130,"internal_metadata":331855174},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":47,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":1204,"num_keys_recovered":10,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.541879"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.123689+0000","last_change":"2023-10-19T12:41:19.300761+0000","last_active":"2023-10-19T12:42:27.123689+0000","last_peered":"2023-10-19T12:42:27.123689+0000","last_clean":"2023-10-19T12:42:27.123689+0000","last_became_active":"2023-10-19T12:41:19.300431+0000","last_became_peered":"2023-10-19T12:41:19.300431+0000","last_unstale":"2023-10-19T12:42:27.123689+0000","last_undegraded":"2023-10-19T12:42:27.123689+0000","last_fullsized":"2023-10-19T12:42:27.123689+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-21T00:36:29.735726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.129102+0000","last_change":"2023-10-19T12:41:19.300748+0000","last_active":"2023-10-19T12:42:27.129102+0000","last_peered":"2023-10-19T12:42:27.129102+0000","last_clean":"2023-10-19T12:42:27.129102+0000","last_became_active":"2023-10-19T12:41:19.294769+0000","last_became_peered":"2023-10-19T12:41:19.294769+0000","last_unstale":"2023-10-19T12:42:27.129102+0000","last_undegraded":"2023-10-19T12:42:27.129102+0000","last_fullsized":"2023-10-19T12:42:27.129102+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T23:04:58.055573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.128929+0000","last_change":"2023-10-19T12:41:19.294264+0000","last_active":"2023-10-19T12:42:27.128929+0000","last_peered":"2023-10-19T12:42:27.128929+0000","last_clean":"2023-10-19T12:42:27.128929+0000","last_became_active":"2023-10-19T12:41:19.293878+0000","last_became_peered":"2023-10-19T12:41:19.293878+0000","last_unstale":"2023-10-19T12:42:27.128929+0000","last_undegraded":"2023-10-19T12:42:27.128929+0000","last_fullsized":"2023-10-19T12:42:27.128929+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:11:01.049036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:28.129602+0000","last_change":"2023-10-19T12:42:28.129235+0000","last_active":"2023-10-19T12:42:28.129602+0000","last_peered":"2023-10-19T12:42:28.129602+0000","last_clean":"2023-10-19T12:42:28.129602+0000","last_became_active":"2023-10-19T12:42:28.128818+0000","last_became_peered":"2023-10-19T12:42:28.128818+0000","last_unstale":"2023-10-19T12:42:28.129602+0000","last_undegraded":"2023-10-19T12:42:28.129602+0000","last_fullsized":"2023-10-19T12:42:28.129602+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:16:26.558697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.121010+0000","last_change":"2023-10-19T12:41:19.301164+0000","last_active":"2023-10-19T12:42:27.121010+0000","last_peered":"2023-10-19T12:42:27.121010+0000","last_clean":"2023-10-19T12:42:27.121010+0000","last_became_active":"2023-10-19T12:41:19.300920+0000","last_became_peered":"2023-10-19T12:41:19.300920+0000","last_unstale":"2023-10-19T12:42:27.121010+0000","last_undegraded":"2023-10-19T12:42:27.121010+0000","last_fullsized":"2023-10-19T12:42:27.121010+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:15:40.211319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.124468+0000","last_change":"2023-10-19T12:41:19.292866+0000","last_active":"2023-10-19T12:42:27.124468+0000","last_peered":"2023-10-19T12:42:27.124468+0000","last_clean":"2023-10-19T12:42:27.124468+0000","last_became_active":"2023-10-19T12:41:19.292392+0000","last_became_peered":"2023-10-19T12:41:19.292392+0000","last_unstale":"2023-10-19T12:42:27.124468+0000","last_undegraded":"2023-10-19T12:42:27.124468+0000","last_fullsized":"2023-10-19T12:42:27.124468+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:37:34.373704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:28.127944+0000","last_change":"2023-10-19T12:42:28.127944+0000","last_active":"2023-10-19T12:42:28.127944+0000","last_peered":"2023-10-19T12:42:28.127944+0000","last_clean":"2023-10-19T12:42:28.127944+0000","last_became_active":"2023-10-19T12:42:28.127619+0000","last_became_peered":"2023-10-19T12:42:28.127619+0000","last_unstale":"2023-10-19T12:42:28.127944+0000","last_undegraded":"2023-10-19T12:42:28.127944+0000","last_fullsized":"2023-10-19T12:42:28.127944+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:01:27.131472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,8],"acting":[7,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.124187+0000","last_change":"2023-10-19T12:41:19.290501+0000","last_active":"2023-10-19T12:42:27.124187+0000","last_peered":"2023-10-19T12:42:27.124187+0000","last_clean":"2023-10-19T12:42:27.124187+0000","last_became_active":"2023-10-19T12:41:19.290080+0000","last_became_peered":"2023-10-19T12:41:19.290080+0000","last_unstale":"2023-10-19T12:42:27.124187+0000","last_undegraded":"2023-10-19T12:42:27.124187+0000","last_fullsized":"2023-10-19T12:42:27.124187+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:40:19.827896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.125228+0000","last_change":"2023-10-19T12:41:19.304631+0000","last_active":"2023-10-19T12:42:27.125228+0000","last_peered":"2023-10-19T12:42:27.125228+0000","last_clean":"2023-10-19T12:42:27.125228+0000","last_became_active":"2023-10-19T12:41:19.301990+0000","last_became_peered":"2023-10-19T12:41:19.301990+0000","last_unstale":"2023-10-19T12:42:27.125228+0000","last_undegraded":"2023-10-19T12:42:27.125228+0000","last_fullsized":"2023-10-19T12:42:27.125228+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:50:46.128888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.124659+0000","last_change":"2023-10-19T12:41:19.294366+0000","last_active":"2023-10-19T12:42:27.124659+0000","last_peered":"2023-10-19T12:42:27.124659+0000","last_clean":"2023-10-19T12:42:27.124659+0000","last_became_active":"2023-10-19T12:41:19.292644+0000","last_became_peered":"2023-10-19T12:41:19.292644+0000","last_unstale":"2023-10-19T12:42:27.124659+0000","last_undegraded":"2023-10-19T12:42:27.124659+0000","last_fullsized":"2023-10-19T12:42:27.124659+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:59:30.111950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.119177+0000","last_change":"2023-10-19T12:41:19.290054+0000","last_active":"2023-10-19T12:42:27.119177+0000","last_peered":"2023-10-19T12:42:27.119177+0000","last_clean":"2023-10-19T12:42:27.119177+0000","last_became_active":"2023-10-19T12:41:19.289739+0000","last_became_peered":"2023-10-19T12:41:19.289739+0000","last_unstale":"2023-10-19T12:42:27.119177+0000","last_undegraded":"2023-10-19T12:42:27.119177+0000","last_fullsized":"2023-10-19T12:42:27.119177+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:30:36.398762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.122485+0000","last_change":"2023-10-19T12:41:19.295309+0000","last_active":"2023-10-19T12:42:27.122485+0000","last_peered":"2023-10-19T12:42:27.122485+0000","last_clean":"2023-10-19T12:42:27.122485+0000","last_became_active":"2023-10-19T12:41:19.295009+0000","last_became_peered":"2023-10-19T12:41:19.295009+0000","last_unstale":"2023-10-19T12:42:27.122485+0000","last_undegraded":"2023-10-19T12:42:27.122485+0000","last_fullsized":"2023-10-19T12:42:27.122485+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:27:33.798071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.124779+0000","last_change":"2023-10-19T12:41:19.302920+0000","last_active":"2023-10-19T12:42:27.124779+0000","last_peered":"2023-10-19T12:42:27.124779+0000","last_clean":"2023-10-19T12:42:27.124779+0000","last_became_active":"2023-10-19T12:41:19.300250+0000","last_became_peered":"2023-10-19T12:41:19.300250+0000","last_unstale":"2023-10-19T12:42:27.124779+0000","last_undegraded":"2023-10-19T12:42:27.124779+0000","last_fullsized":"2023-10-19T12:42:27.124779+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:51:47.487907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.128543+0000","last_change":"2023-10-19T12:41:19.300654+0000","last_active":"2023-10-19T12:42:27.128543+0000","last_peered":"2023-10-19T12:42:27.128543+0000","last_clean":"2023-10-19T12:42:27.128543+0000","last_became_active":"2023-10-19T12:41:19.295408+0000","last_became_peered":"2023-10-19T12:41:19.295408+0000","last_unstale":"2023-10-19T12:42:27.128543+0000","last_undegraded":"2023-10-19T12:42:27.128543+0000","last_fullsized":"2023-10-19T12:42:27.128543+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:53:47.039077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.128371+0000","last_change":"2023-10-19T12:41:19.293141+0000","last_active":"2023-10-19T12:42:27.128371+0000","last_peered":"2023-10-19T12:42:27.128371+0000","last_clean":"2023-10-19T12:42:27.128371+0000","last_became_active":"2023-10-19T12:41:19.290790+0000","last_became_peered":"2023-10-19T12:41:19.290790+0000","last_unstale":"2023-10-19T12:42:27.128371+0000","last_undegraded":"2023-10-19T12:42:27.128371+0000","last_fullsized":"2023-10-19T12:42:27.128371+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:23:44.757080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.123994+0000","last_change":"2023-10-19T12:41:19.299670+0000","last_active":"2023-10-19T12:42:27.123994+0000","last_peered":"2023-10-19T12:42:27.123994+0000","last_clean":"2023-10-19T12:42:27.123994+0000","last_became_active":"2023-10-19T12:41:19.299375+0000","last_became_peered":"2023-10-19T12:41:19.299375+0000","last_unstale":"2023-10-19T12:42:27.123994+0000","last_undegraded":"2023-10-19T12:42:27.123994+0000","last_fullsized":"2023-10-19T12:42:27.123994+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:30:23.234790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.123761+0000","last_change":"2023-10-19T12:41:19.300359+0000","last_active":"2023-10-19T12:42:27.123761+0000","last_peered":"2023-10-19T12:42:27.123761+0000","last_clean":"2023-10-19T12:42:27.123761+0000","last_became_active":"2023-10-19T12:41:19.300032+0000","last_became_peered":"2023-10-19T12:41:19.300032+0000","last_unstale":"2023-10-19T12:42:27.123761+0000","last_undegraded":"2023-10-19T12:42:27.123761+0000","last_fullsized":"2023-10-19T12:42:27.123761+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-21T00:33:24.621723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.119382+0000","last_change":"2023-10-19T12:41:19.288276+0000","last_active":"2023-10-19T12:42:27.119382+0000","last_peered":"2023-10-19T12:42:27.119382+0000","last_clean":"2023-10-19T12:42:27.119382+0000","last_became_active":"2023-10-19T12:41:19.287905+0000","last_became_peered":"2023-10-19T12:41:19.287905+0000","last_unstale":"2023-10-19T12:42:27.119382+0000","last_undegraded":"2023-10-19T12:42:27.119382+0000","last_fullsized":"2023-10-19T12:42:27.119382+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:46:15.640987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.116978+0000","last_change":"2023-10-19T12:41:19.300682+0000","last_active":"2023-10-19T12:42:27.116978+0000","last_peered":"2023-10-19T12:42:27.116978+0000","last_clean":"2023-10-19T12:42:27.116978+0000","last_became_active":"2023-10-19T12:41:19.300347+0000","last_became_peered":"2023-10-19T12:41:19.300347+0000","last_unstale":"2023-10-19T12:42:27.116978+0000","last_undegraded":"2023-10-19T12:42:27.116978+0000","last_fullsized":"2023-10-19T12:42:27.116978+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T21:21:31.772556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.116324+0000","last_change":"2023-10-19T12:41:23.337419+0000","last_active":"2023-10-19T12:42:27.116324+0000","last_peered":"2023-10-19T12:42:27.116324+0000","last_clean":"2023-10-19T12:42:27.116324+0000","last_became_active":"2023-10-19T12:41:23.337046+0000","last_became_peered":"2023-10-19T12:41:23.337046+0000","last_unstale":"2023-10-19T12:42:27.116324+0000","last_undegraded":"2023-10-19T12:42:27.116324+0000","last_fullsized":"2023-10-19T12:42:27.116324+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-21T00:20:22.732851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"88'13","reported_seq":79,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:32.379376+0000","last_change":"2023-10-19T12:41:18.282453+0000","last_active":"2023-10-19T12:42:32.379376+0000","last_peered":"2023-10-19T12:42:32.379376+0000","last_clean":"2023-10-19T12:42:32.379376+0000","last_became_active":"2023-10-19T12:41:18.281705+0000","last_became_peered":"2023-10-19T12:41:18.281705+0000","last_unstale":"2023-10-19T12:42:32.379376+0000","last_undegraded":"2023-10-19T12:42:32.379376+0000","last_fullsized":"2023-10-19T12:42:32.379376+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T21:12:33.877631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.126139+0000","last_change":"2023-10-19T12:41:19.292175+0000","last_active":"2023-10-19T12:42:27.126139+0000","last_peered":"2023-10-19T12:42:27.126139+0000","last_clean":"2023-10-19T12:42:27.126139+0000","last_became_active":"2023-10-19T12:41:19.291867+0000","last_became_peered":"2023-10-19T12:41:19.291867+0000","last_unstale":"2023-10-19T12:42:27.126139+0000","last_undegraded":"2023-10-19T12:42:27.126139+0000","last_fullsized":"2023-10-19T12:42:27.126139+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:22:12.255839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.121154+0000","last_change":"2023-10-19T12:41:23.340447+0000","last_active":"2023-10-19T12:42:27.121154+0000","last_peered":"2023-10-19T12:42:27.121154+0000","last_clean":"2023-10-19T12:42:27.121154+0000","last_became_active":"2023-10-19T12:41:23.340074+0000","last_became_peered":"2023-10-19T12:41:23.340074+0000","last_unstale":"2023-10-19T12:42:27.121154+0000","last_undegraded":"2023-10-19T12:42:27.121154+0000","last_fullsized":"2023-10-19T12:42:27.121154+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:12:11.828854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"88'2","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.126237+0000","last_change":"2023-10-19T12:41:18.297822+0000","last_active":"2023-10-19T12:42:27.126237+0000","last_peered":"2023-10-19T12:42:27.126237+0000","last_clean":"2023-10-19T12:42:27.126237+0000","last_became_active":"2023-10-19T12:41:18.297526+0000","last_became_peered":"2023-10-19T12:41:18.297526+0000","last_unstale":"2023-10-19T12:42:27.126237+0000","last_undegraded":"2023-10-19T12:42:27.126237+0000","last_fullsized":"2023-10-19T12:42:27.126237+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:59:28.110110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.130229+0000","last_change":"2023-10-19T12:41:19.309918+0000","last_active":"2023-10-19T12:42:27.130229+0000","last_peered":"2023-10-19T12:42:27.130229+0000","last_clean":"2023-10-19T12:42:27.130229+0000","last_became_active":"2023-10-19T12:41:19.309391+0000","last_became_peered":"2023-10-19T12:41:19.309391+0000","last_unstale":"2023-10-19T12:42:27.130229+0000","last_undegraded":"2023-10-19T12:42:27.130229+0000","last_fullsized":"2023-10-19T12:42:27.130229+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:52:49.320469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.121566+0000","last_change":"2023-10-19T12:41:23.337296+0000","last_active":"2023-10-19T12:42:27.121566+0000","last_peered":"2023-10-19T12:42:27.121566+0000","last_clean":"2023-10-19T12:42:27.121566+0000","last_became_active":"2023-10-19T12:41:23.336836+0000","last_became_peered":"2023-10-19T12:41:23.336836+0000","last_unstale":"2023-10-19T12:42:27.121566+0000","last_undegraded":"2023-10-19T12:42:27.121566+0000","last_fullsized":"2023-10-19T12:42:27.121566+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:15:25.400517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"88'12","reported_seq":55,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:28.174505+0000","last_change":"2023-10-19T12:42:28.174505+0000","last_active":"2023-10-19T12:42:28.174505+0000","last_peered":"2023-10-19T12:42:28.174505+0000","last_clean":"2023-10-19T12:42:28.174505+0000","last_became_active":"2023-10-19T12:42:28.165270+0000","last_became_peered":"2023-10-19T12:42:28.165270+0000","last_unstale":"2023-10-19T12:42:28.174505+0000","last_undegraded":"2023-10-19T12:42:28.174505+0000","last_fullsized":"2023-10-19T12:42:28.174505+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:54:50.199916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.124813+0000","last_change":"2023-10-19T12:41:19.301628+0000","last_active":"2023-10-19T12:42:27.124813+0000","last_peered":"2023-10-19T12:42:27.124813+0000","last_clean":"2023-10-19T12:42:27.124813+0000","last_became_active":"2023-10-19T12:41:19.301343+0000","last_became_peered":"2023-10-19T12:41:19.301343+0000","last_unstale":"2023-10-19T12:42:27.124813+0000","last_undegraded":"2023-10-19T12:42:27.124813+0000","last_fullsized":"2023-10-19T12:42:27.124813+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:02:31.273024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.121333+0000","last_change":"2023-10-19T12:41:23.330222+0000","last_active":"2023-10-19T12:42:27.121333+0000","last_peered":"2023-10-19T12:42:27.121333+0000","last_clean":"2023-10-19T12:42:27.121333+0000","last_became_active":"2023-10-19T12:41:23.329838+0000","last_became_peered":"2023-10-19T12:41:23.329838+0000","last_unstale":"2023-10-19T12:42:27.121333+0000","last_undegraded":"2023-10-19T12:42:27.121333+0000","last_fullsized":"2023-10-19T12:42:27.121333+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T21:40:52.899198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"88'5","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:28.133876+0000","last_change":"2023-10-19T12:42:28.133484+0000","last_active":"2023-10-19T12:42:28.133876+0000","last_peered":"2023-10-19T12:42:28.133876+0000","last_clean":"2023-10-19T12:42:28.133876+0000","last_became_active":"2023-10-19T12:42:28.126495+0000","last_became_peered":"2023-10-19T12:42:28.126495+0000","last_unstale":"2023-10-19T12:42:28.133876+0000","last_undegraded":"2023-10-19T12:42:28.133876+0000","last_fullsized":"2023-10-19T12:42:28.133876+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T21:28:29.956191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:28.129032+0000","last_change":"2023-10-19T12:42:28.129032+0000","last_active":"2023-10-19T12:42:28.129032+0000","last_peered":"2023-10-19T12:42:28.129032+0000","last_clean":"2023-10-19T12:42:28.129032+0000","last_became_active":"2023-10-19T12:42:28.128562+0000","last_became_peered":"2023-10-19T12:42:28.128562+0000","last_unstale":"2023-10-19T12:42:28.129032+0000","last_undegraded":"2023-10-19T12:42:28.129032+0000","last_fullsized":"2023-10-19T12:42:28.129032+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:52:14.264191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.116859+0000","last_change":"2023-10-19T12:41:23.330626+0000","last_active":"2023-10-19T12:42:27.116859+0000","last_peered":"2023-10-19T12:42:27.116859+0000","last_clean":"2023-10-19T12:42:27.116859+0000","last_became_active":"2023-10-19T12:41:23.330250+0000","last_became_peered":"2023-10-19T12:41:23.330250+0000","last_unstale":"2023-10-19T12:42:27.116859+0000","last_undegraded":"2023-10-19T12:42:27.116859+0000","last_fullsized":"2023-10-19T12:42:27.116859+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:09:48.428636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"88'5","reported_seq":88,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:34.137378+0000","last_change":"2023-10-19T12:42:28.136196+0000","last_active":"2023-10-19T12:42:34.137378+0000","last_peered":"2023-10-19T12:42:34.137378+0000","last_clean":"2023-10-19T12:42:34.137378+0000","last_became_active":"2023-10-19T12:42:28.126762+0000","last_became_peered":"2023-10-19T12:42:28.126762+0000","last_unstale":"2023-10-19T12:42:34.137378+0000","last_undegraded":"2023-10-19T12:42:34.137378+0000","last_fullsized":"2023-10-19T12:42:34.137378+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:04:58.098356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":45,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":622,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.119573+0000","last_change":"2023-10-19T12:41:19.285423+0000","last_active":"2023-10-19T12:42:27.119573+0000","last_peered":"2023-10-19T12:42:27.119573+0000","last_clean":"2023-10-19T12:42:27.119573+0000","last_became_active":"2023-10-19T12:41:19.285110+0000","last_became_peered":"2023-10-19T12:41:19.285110+0000","last_unstale":"2023-10-19T12:42:27.119573+0000","last_undegraded":"2023-10-19T12:42:27.119573+0000","last_fullsized":"2023-10-19T12:42:27.119573+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:27:51.707594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.116601+0000","last_change":"2023-10-19T12:41:23.343240+0000","last_active":"2023-10-19T12:42:27.116601+0000","last_peered":"2023-10-19T12:42:27.116601+0000","last_clean":"2023-10-19T12:42:27.116601+0000","last_became_active":"2023-10-19T12:41:23.342778+0000","last_became_peered":"2023-10-19T12:41:23.342778+0000","last_unstale":"2023-10-19T12:42:27.116601+0000","last_undegraded":"2023-10-19T12:42:27.116601+0000","last_fullsized":"2023-10-19T12:42:27.116601+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:47:15.690193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"88'7","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:28.179078+0000","last_change":"2023-10-19T12:42:28.179078+0000","last_active":"2023-10-19T12:42:28.179078+0000","last_peered":"2023-10-19T12:42:28.179078+0000","last_clean":"2023-10-19T12:42:28.179078+0000","last_became_active":"2023-10-19T12:42:28.165372+0000","last_became_peered":"2023-10-19T12:42:28.165372+0000","last_unstale":"2023-10-19T12:42:28.179078+0000","last_undegraded":"2023-10-19T12:42:28.179078+0000","last_fullsized":"2023-10-19T12:42:28.179078+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T21:12:40.451182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,6],"acting":[10,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:28.164782+0000","last_change":"2023-10-19T12:42:28.164782+0000","last_active":"2023-10-19T12:42:28.164782+0000","last_peered":"2023-10-19T12:42:28.164782+0000","last_clean":"2023-10-19T12:42:28.164782+0000","last_became_active":"2023-10-19T12:42:28.164508+0000","last_became_peered":"2023-10-19T12:42:28.164508+0000","last_unstale":"2023-10-19T12:42:28.164782+0000","last_undegraded":"2023-10-19T12:42:28.164782+0000","last_fullsized":"2023-10-19T12:42:28.164782+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:37:30.278053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.123624+0000","last_change":"2023-10-19T12:41:23.338871+0000","last_active":"2023-10-19T12:42:27.123624+0000","last_peered":"2023-10-19T12:42:27.123624+0000","last_clean":"2023-10-19T12:42:27.123624+0000","last_became_active":"2023-10-19T12:41:23.338493+0000","last_became_peered":"2023-10-19T12:41:23.338493+0000","last_unstale":"2023-10-19T12:42:27.123624+0000","last_undegraded":"2023-10-19T12:42:27.123624+0000","last_fullsized":"2023-10-19T12:42:27.123624+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T22:49:12.948436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"88'3","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.125512+0000","last_change":"2023-10-19T12:41:18.291110+0000","last_active":"2023-10-19T12:42:27.125512+0000","last_peered":"2023-10-19T12:42:27.125512+0000","last_clean":"2023-10-19T12:42:27.125512+0000","last_became_active":"2023-10-19T12:41:18.290675+0000","last_became_peered":"2023-10-19T12:41:18.290675+0000","last_unstale":"2023-10-19T12:42:27.125512+0000","last_undegraded":"2023-10-19T12:42:27.125512+0000","last_fullsized":"2023-10-19T12:42:27.125512+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:57:44.713046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.124160+0000","last_change":"2023-10-19T12:41:19.299727+0000","last_active":"2023-10-19T12:42:27.124160+0000","last_peered":"2023-10-19T12:42:27.124160+0000","last_clean":"2023-10-19T12:42:27.124160+0000","last_became_active":"2023-10-19T12:41:19.299387+0000","last_became_peered":"2023-10-19T12:41:19.299387+0000","last_unstale":"2023-10-19T12:42:27.124160+0000","last_undegraded":"2023-10-19T12:42:27.124160+0000","last_fullsized":"2023-10-19T12:42:27.124160+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:34:03.783326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.129278+0000","last_change":"2023-10-19T12:41:23.331954+0000","last_active":"2023-10-19T12:42:27.129278+0000","last_peered":"2023-10-19T12:42:27.129278+0000","last_clean":"2023-10-19T12:42:27.129278+0000","last_became_active":"2023-10-19T12:41:23.328835+0000","last_became_peered":"2023-10-19T12:41:23.328835+0000","last_unstale":"2023-10-19T12:42:27.129278+0000","last_undegraded":"2023-10-19T12:42:27.129278+0000","last_fullsized":"2023-10-19T12:42:27.129278+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T21:49:10.473768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"88'3","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.120595+0000","last_change":"2023-10-19T12:41:18.280694+0000","last_active":"2023-10-19T12:42:27.120595+0000","last_peered":"2023-10-19T12:42:27.120595+0000","last_clean":"2023-10-19T12:42:27.120595+0000","last_became_active":"2023-10-19T12:41:18.280333+0000","last_became_peered":"2023-10-19T12:41:18.280333+0000","last_unstale":"2023-10-19T12:42:27.120595+0000","last_undegraded":"2023-10-19T12:42:27.120595+0000","last_fullsized":"2023-10-19T12:42:27.120595+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:06:02.944400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.115990+0000","last_change":"2023-10-19T12:41:19.288659+0000","last_active":"2023-10-19T12:42:27.115990+0000","last_peered":"2023-10-19T12:42:27.115990+0000","last_clean":"2023-10-19T12:42:27.115990+0000","last_became_active":"2023-10-19T12:41:19.288310+0000","last_became_peered":"2023-10-19T12:41:19.288310+0000","last_unstale":"2023-10-19T12:42:27.115990+0000","last_undegraded":"2023-10-19T12:42:27.115990+0000","last_fullsized":"2023-10-19T12:42:27.115990+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T23:15:05.772393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.125263+0000","last_change":"2023-10-19T12:41:23.333370+0000","last_active":"2023-10-19T12:42:27.125263+0000","last_peered":"2023-10-19T12:42:27.125263+0000","last_clean":"2023-10-19T12:42:27.125263+0000","last_became_active":"2023-10-19T12:41:23.332691+0000","last_became_peered":"2023-10-19T12:41:23.332691+0000","last_unstale":"2023-10-19T12:42:27.125263+0000","last_undegraded":"2023-10-19T12:42:27.125263+0000","last_fullsized":"2023-10-19T12:42:27.125263+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T21:28:45.414610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"88'4","reported_seq":119,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:35.138025+0000","last_change":"2023-10-19T12:41:18.287081+0000","last_active":"2023-10-19T12:42:35.138025+0000","last_peered":"2023-10-19T12:42:35.138025+0000","last_clean":"2023-10-19T12:42:35.138025+0000","last_became_active":"2023-10-19T12:41:18.286784+0000","last_became_peered":"2023-10-19T12:41:18.286784+0000","last_unstale":"2023-10-19T12:42:35.138025+0000","last_undegraded":"2023-10-19T12:42:35.138025+0000","last_fullsized":"2023-10-19T12:42:35.138025+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:49:10.167022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":97,"num_read_kb":97,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.124539+0000","last_change":"2023-10-19T12:41:19.300361+0000","last_active":"2023-10-19T12:42:27.124539+0000","last_peered":"2023-10-19T12:42:27.124539+0000","last_clean":"2023-10-19T12:42:27.124539+0000","last_became_active":"2023-10-19T12:41:19.299871+0000","last_became_peered":"2023-10-19T12:41:19.299871+0000","last_unstale":"2023-10-19T12:42:27.124539+0000","last_undegraded":"2023-10-19T12:42:27.124539+0000","last_fullsized":"2023-10-19T12:42:27.124539+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:46:31.437532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.115788+0000","last_change":"2023-10-19T12:41:23.338341+0000","last_active":"2023-10-19T12:42:27.115788+0000","last_peered":"2023-10-19T12:42:27.115788+0000","last_clean":"2023-10-19T12:42:27.115788+0000","last_became_active":"2023-10-19T12:41:23.336081+0000","last_became_peered":"2023-10-19T12:41:23.336081+0000","last_unstale":"2023-10-19T12:42:27.115788+0000","last_undegraded":"2023-10-19T12:42:27.115788+0000","last_fullsized":"2023-10-19T12:42:27.115788+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:02:35.474513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"88'4","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.118927+0000","last_change":"2023-10-19T12:41:18.280086+0000","last_active":"2023-10-19T12:42:27.118927+0000","last_peered":"2023-10-19T12:42:27.118927+0000","last_clean":"2023-10-19T12:42:27.118927+0000","last_became_active":"2023-10-19T12:41:18.279819+0000","last_became_peered":"2023-10-19T12:41:18.279819+0000","last_unstale":"2023-10-19T12:42:27.118927+0000","last_undegraded":"2023-10-19T12:42:27.118927+0000","last_fullsized":"2023-10-19T12:42:27.118927+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T23:02:28.723477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.130316+0000","last_change":"2023-10-19T12:41:19.306420+0000","last_active":"2023-10-19T12:42:27.130316+0000","last_peered":"2023-10-19T12:42:27.130316+0000","last_clean":"2023-10-19T12:42:27.130316+0000","last_became_active":"2023-10-19T12:41:19.301202+0000","last_became_peered":"2023-10-19T12:41:19.301202+0000","last_unstale":"2023-10-19T12:42:27.130316+0000","last_undegraded":"2023-10-19T12:42:27.130316+0000","last_fullsized":"2023-10-19T12:42:27.130316+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:56:16.765319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.121890+0000","last_change":"2023-10-19T12:41:23.337332+0000","last_active":"2023-10-19T12:42:27.121890+0000","last_peered":"2023-10-19T12:42:27.121890+0000","last_clean":"2023-10-19T12:42:27.121890+0000","last_became_active":"2023-10-19T12:41:23.336877+0000","last_became_peered":"2023-10-19T12:41:23.336877+0000","last_unstale":"2023-10-19T12:42:27.121890+0000","last_undegraded":"2023-10-19T12:42:27.121890+0000","last_fullsized":"2023-10-19T12:42:27.121890+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T22:47:23.795598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"88'5","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.121398+0000","last_change":"2023-10-19T12:41:18.285452+0000","last_active":"2023-10-19T12:42:27.121398+0000","last_peered":"2023-10-19T12:42:27.121398+0000","last_clean":"2023-10-19T12:42:27.121398+0000","last_became_active":"2023-10-19T12:41:18.285155+0000","last_became_peered":"2023-10-19T12:41:18.285155+0000","last_unstale":"2023-10-19T12:42:27.121398+0000","last_undegraded":"2023-10-19T12:42:27.121398+0000","last_fullsized":"2023-10-19T12:42:27.121398+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:30:41.041925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.124955+0000","last_change":"2023-10-19T12:41:19.284839+0000","last_active":"2023-10-19T12:42:27.124955+0000","last_peered":"2023-10-19T12:42:27.124955+0000","last_clean":"2023-10-19T12:42:27.124955+0000","last_became_active":"2023-10-19T12:41:19.284538+0000","last_became_peered":"2023-10-19T12:41:19.284538+0000","last_unstale":"2023-10-19T12:42:27.124955+0000","last_undegraded":"2023-10-19T12:42:27.124955+0000","last_fullsized":"2023-10-19T12:42:27.124955+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:29:12.288958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.115869+0000","last_change":"2023-10-19T12:41:23.339611+0000","last_active":"2023-10-19T12:42:27.115869+0000","last_peered":"2023-10-19T12:42:27.115869+0000","last_clean":"2023-10-19T12:42:27.115869+0000","last_became_active":"2023-10-19T12:41:23.337786+0000","last_became_peered":"2023-10-19T12:41:23.337786+0000","last_unstale":"2023-10-19T12:42:27.115869+0000","last_undegraded":"2023-10-19T12:42:27.115869+0000","last_fullsized":"2023-10-19T12:42:27.115869+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:56:01.219811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"88'35","reported_seq":156,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:35.137817+0000","last_change":"2023-10-19T12:41:18.279330+0000","last_active":"2023-10-19T12:42:35.137817+0000","last_peered":"2023-10-19T12:42:35.137817+0000","last_clean":"2023-10-19T12:42:35.137817+0000","last_became_active":"2023-10-19T12:41:18.278942+0000","last_became_peered":"2023-10-19T12:41:18.278942+0000","last_unstale":"2023-10-19T12:42:35.137817+0000","last_undegraded":"2023-10-19T12:42:35.137817+0000","last_fullsized":"2023-10-19T12:42:35.137817+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:40:23.340009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60441,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":103,"num_read_kb":110,"num_write":37,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.120304+0000","last_change":"2023-10-19T12:41:19.296103+0000","last_active":"2023-10-19T12:42:27.120304+0000","last_peered":"2023-10-19T12:42:27.120304+0000","last_clean":"2023-10-19T12:42:27.120304+0000","last_became_active":"2023-10-19T12:41:19.293432+0000","last_became_peered":"2023-10-19T12:41:19.293432+0000","last_unstale":"2023-10-19T12:42:27.120304+0000","last_undegraded":"2023-10-19T12:42:27.120304+0000","last_fullsized":"2023-10-19T12:42:27.120304+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:21:46.039560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.122205+0000","last_change":"2023-10-19T12:41:23.330711+0000","last_active":"2023-10-19T12:42:27.122205+0000","last_peered":"2023-10-19T12:42:27.122205+0000","last_clean":"2023-10-19T12:42:27.122205+0000","last_became_active":"2023-10-19T12:41:23.330115+0000","last_became_peered":"2023-10-19T12:41:23.330115+0000","last_unstale":"2023-10-19T12:42:27.122205+0000","last_undegraded":"2023-10-19T12:42:27.122205+0000","last_fullsized":"2023-10-19T12:42:27.122205+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:48:50.296265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"88'9","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.116428+0000","last_change":"2023-10-19T12:41:18.289434+0000","last_active":"2023-10-19T12:42:27.116428+0000","last_peered":"2023-10-19T12:42:27.116428+0000","last_clean":"2023-10-19T12:42:27.116428+0000","last_became_active":"2023-10-19T12:41:18.289226+0000","last_became_peered":"2023-10-19T12:41:18.289226+0000","last_unstale":"2023-10-19T12:42:27.116428+0000","last_undegraded":"2023-10-19T12:42:27.116428+0000","last_fullsized":"2023-10-19T12:42:27.116428+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T21:18:19.007202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.126351+0000","last_change":"2023-10-19T12:41:19.300555+0000","last_active":"2023-10-19T12:42:27.126351+0000","last_peered":"2023-10-19T12:42:27.126351+0000","last_clean":"2023-10-19T12:42:27.126351+0000","last_became_active":"2023-10-19T12:41:19.300162+0000","last_became_peered":"2023-10-19T12:41:19.300162+0000","last_unstale":"2023-10-19T12:42:27.126351+0000","last_undegraded":"2023-10-19T12:42:27.126351+0000","last_fullsized":"2023-10-19T12:42:27.126351+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:26:33.779562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.122864+0000","last_change":"2023-10-19T12:41:23.338750+0000","last_active":"2023-10-19T12:42:27.122864+0000","last_peered":"2023-10-19T12:42:27.122864+0000","last_clean":"2023-10-19T12:42:27.122864+0000","last_became_active":"2023-10-19T12:41:23.338318+0000","last_became_peered":"2023-10-19T12:41:23.338318+0000","last_unstale":"2023-10-19T12:42:27.122864+0000","last_undegraded":"2023-10-19T12:42:27.122864+0000","last_fullsized":"2023-10-19T12:42:27.122864+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:11:20.182270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"88'5","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.120277+0000","last_change":"2023-10-19T12:41:18.293923+0000","last_active":"2023-10-19T12:42:27.120277+0000","last_peered":"2023-10-19T12:42:27.120277+0000","last_clean":"2023-10-19T12:42:27.120277+0000","last_became_active":"2023-10-19T12:41:18.293688+0000","last_became_peered":"2023-10-19T12:41:18.293688+0000","last_unstale":"2023-10-19T12:42:27.120277+0000","last_undegraded":"2023-10-19T12:42:27.120277+0000","last_fullsized":"2023-10-19T12:42:27.120277+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:34:15.162178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.118566+0000","last_change":"2023-10-19T12:41:19.302733+0000","last_active":"2023-10-19T12:42:27.118566+0000","last_peered":"2023-10-19T12:42:27.118566+0000","last_clean":"2023-10-19T12:42:27.118566+0000","last_became_active":"2023-10-19T12:41:19.302401+0000","last_became_peered":"2023-10-19T12:41:19.302401+0000","last_unstale":"2023-10-19T12:42:27.118566+0000","last_undegraded":"2023-10-19T12:42:27.118566+0000","last_fullsized":"2023-10-19T12:42:27.118566+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:55:05.864499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.119269+0000","last_change":"2023-10-19T12:41:23.338999+0000","last_active":"2023-10-19T12:42:27.119269+0000","last_peered":"2023-10-19T12:42:27.119269+0000","last_clean":"2023-10-19T12:42:27.119269+0000","last_became_active":"2023-10-19T12:41:23.338067+0000","last_became_peered":"2023-10-19T12:41:23.338067+0000","last_unstale":"2023-10-19T12:42:27.119269+0000","last_undegraded":"2023-10-19T12:42:27.119269+0000","last_fullsized":"2023-10-19T12:42:27.119269+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:36:12.984006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"88'5","reported_seq":75,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:34.380188+0000","last_change":"2023-10-19T12:41:18.277563+0000","last_active":"2023-10-19T12:42:34.380188+0000","last_peered":"2023-10-19T12:42:34.380188+0000","last_clean":"2023-10-19T12:42:34.380188+0000","last_became_active":"2023-10-19T12:41:18.277255+0000","last_became_peered":"2023-10-19T12:41:18.277255+0000","last_unstale":"2023-10-19T12:42:34.380188+0000","last_undegraded":"2023-10-19T12:42:34.380188+0000","last_fullsized":"2023-10-19T12:42:34.380188+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:28:31.468355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":52,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.118229+0000","last_change":"2023-10-19T12:41:19.288939+0000","last_active":"2023-10-19T12:42:27.118229+0000","last_peered":"2023-10-19T12:42:27.118229+0000","last_clean":"2023-10-19T12:42:27.118229+0000","last_became_active":"2023-10-19T12:41:19.288612+0000","last_became_peered":"2023-10-19T12:41:19.288612+0000","last_unstale":"2023-10-19T12:42:27.118229+0000","last_undegraded":"2023-10-19T12:42:27.118229+0000","last_fullsized":"2023-10-19T12:42:27.118229+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:45:36.050331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.125921+0000","last_change":"2023-10-19T12:41:23.333823+0000","last_active":"2023-10-19T12:42:27.125921+0000","last_peered":"2023-10-19T12:42:27.125921+0000","last_clean":"2023-10-19T12:42:27.125921+0000","last_became_active":"2023-10-19T12:41:23.332698+0000","last_became_peered":"2023-10-19T12:41:23.332698+0000","last_unstale":"2023-10-19T12:42:27.125921+0000","last_undegraded":"2023-10-19T12:42:27.125921+0000","last_fullsized":"2023-10-19T12:42:27.125921+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:54:43.952531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"88'17","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.119493+0000","last_change":"2023-10-19T12:41:18.290426+0000","last_active":"2023-10-19T12:42:27.119493+0000","last_peered":"2023-10-19T12:42:27.119493+0000","last_clean":"2023-10-19T12:42:27.119493+0000","last_became_active":"2023-10-19T12:41:18.290096+0000","last_became_peered":"2023-10-19T12:41:18.290096+0000","last_unstale":"2023-10-19T12:42:27.119493+0000","last_undegraded":"2023-10-19T12:42:27.119493+0000","last_fullsized":"2023-10-19T12:42:27.119493+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:14:34.731869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.119815+0000","last_change":"2023-10-19T12:41:19.300423+0000","last_active":"2023-10-19T12:42:27.119815+0000","last_peered":"2023-10-19T12:42:27.119815+0000","last_clean":"2023-10-19T12:42:27.119815+0000","last_became_active":"2023-10-19T12:41:19.299999+0000","last_became_peered":"2023-10-19T12:41:19.299999+0000","last_unstale":"2023-10-19T12:42:27.119815+0000","last_undegraded":"2023-10-19T12:42:27.119815+0000","last_fullsized":"2023-10-19T12:42:27.119815+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:35:32.703396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.119720+0000","last_change":"2023-10-19T12:41:23.330091+0000","last_active":"2023-10-19T12:42:27.119720+0000","last_peered":"2023-10-19T12:42:27.119720+0000","last_clean":"2023-10-19T12:42:27.119720+0000","last_became_active":"2023-10-19T12:41:23.329695+0000","last_became_peered":"2023-10-19T12:41:23.329695+0000","last_unstale":"2023-10-19T12:42:27.119720+0000","last_undegraded":"2023-10-19T12:42:27.119720+0000","last_fullsized":"2023-10-19T12:42:27.119720+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:37:09.840232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"88'2","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.119237+0000","last_change":"2023-10-19T12:41:18.279761+0000","last_active":"2023-10-19T12:42:27.119237+0000","last_peered":"2023-10-19T12:42:27.119237+0000","last_clean":"2023-10-19T12:42:27.119237+0000","last_became_active":"2023-10-19T12:41:18.279430+0000","last_became_peered":"2023-10-19T12:41:18.279430+0000","last_unstale":"2023-10-19T12:42:27.119237+0000","last_undegraded":"2023-10-19T12:42:27.119237+0000","last_fullsized":"2023-10-19T12:42:27.119237+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:43:32.447842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.123526+0000","last_change":"2023-10-19T12:41:19.290406+0000","last_active":"2023-10-19T12:42:27.123526+0000","last_peered":"2023-10-19T12:42:27.123526+0000","last_clean":"2023-10-19T12:42:27.123526+0000","last_became_active":"2023-10-19T12:41:19.290032+0000","last_became_peered":"2023-10-19T12:41:19.290032+0000","last_unstale":"2023-10-19T12:42:27.123526+0000","last_undegraded":"2023-10-19T12:42:27.123526+0000","last_fullsized":"2023-10-19T12:42:27.123526+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:30:30.875800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.119428+0000","last_change":"2023-10-19T12:41:23.478036+0000","last_active":"2023-10-19T12:42:27.119428+0000","last_peered":"2023-10-19T12:42:27.119428+0000","last_clean":"2023-10-19T12:42:27.119428+0000","last_became_active":"2023-10-19T12:41:23.477542+0000","last_became_peered":"2023-10-19T12:41:23.477542+0000","last_unstale":"2023-10-19T12:42:27.119428+0000","last_undegraded":"2023-10-19T12:42:27.119428+0000","last_fullsized":"2023-10-19T12:42:27.119428+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:32:24.599591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"88'1","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.116660+0000","last_change":"2023-10-19T12:41:18.289254+0000","last_active":"2023-10-19T12:42:27.116660+0000","last_peered":"2023-10-19T12:42:27.116660+0000","last_clean":"2023-10-19T12:42:27.116660+0000","last_became_active":"2023-10-19T12:41:18.287036+0000","last_became_peered":"2023-10-19T12:41:18.287036+0000","last_unstale":"2023-10-19T12:42:27.116660+0000","last_undegraded":"2023-10-19T12:42:27.116660+0000","last_fullsized":"2023-10-19T12:42:27.116660+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T21:33:41.720725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.124774+0000","last_change":"2023-10-19T12:41:19.299711+0000","last_active":"2023-10-19T12:42:27.124774+0000","last_peered":"2023-10-19T12:42:27.124774+0000","last_clean":"2023-10-19T12:42:27.124774+0000","last_became_active":"2023-10-19T12:41:19.299367+0000","last_became_peered":"2023-10-19T12:41:19.299367+0000","last_unstale":"2023-10-19T12:42:27.124774+0000","last_undegraded":"2023-10-19T12:42:27.124774+0000","last_fullsized":"2023-10-19T12:42:27.124774+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:32:36.783990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.124886+0000","last_change":"2023-10-19T12:41:23.328301+0000","last_active":"2023-10-19T12:42:27.124886+0000","last_peered":"2023-10-19T12:42:27.124886+0000","last_clean":"2023-10-19T12:42:27.124886+0000","last_became_active":"2023-10-19T12:41:23.327866+0000","last_became_peered":"2023-10-19T12:41:23.327866+0000","last_unstale":"2023-10-19T12:42:27.124886+0000","last_undegraded":"2023-10-19T12:42:27.124886+0000","last_fullsized":"2023-10-19T12:42:27.124886+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T21:53:23.600196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"88'5","reported_seq":76,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:36.384840+0000","last_change":"2023-10-19T12:41:18.286635+0000","last_active":"2023-10-19T12:42:36.384840+0000","last_peered":"2023-10-19T12:42:36.384840+0000","last_clean":"2023-10-19T12:42:36.384840+0000","last_became_active":"2023-10-19T12:41:18.286310+0000","last_became_peered":"2023-10-19T12:41:18.286310+0000","last_unstale":"2023-10-19T12:42:36.384840+0000","last_undegraded":"2023-10-19T12:42:36.384840+0000","last_fullsized":"2023-10-19T12:42:36.384840+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:30:38.266038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":52,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.123996+0000","last_change":"2023-10-19T12:41:19.297989+0000","last_active":"2023-10-19T12:42:27.123996+0000","last_peered":"2023-10-19T12:42:27.123996+0000","last_clean":"2023-10-19T12:42:27.123996+0000","last_became_active":"2023-10-19T12:41:19.297680+0000","last_became_peered":"2023-10-19T12:41:19.297680+0000","last_unstale":"2023-10-19T12:42:27.123996+0000","last_undegraded":"2023-10-19T12:42:27.123996+0000","last_fullsized":"2023-10-19T12:42:27.123996+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:40:22.883804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.126049+0000","last_change":"2023-10-19T12:41:23.478723+0000","last_active":"2023-10-19T12:42:27.126049+0000","last_peered":"2023-10-19T12:42:27.126049+0000","last_clean":"2023-10-19T12:42:27.126049+0000","last_became_active":"2023-10-19T12:41:23.478063+0000","last_became_peered":"2023-10-19T12:41:23.478063+0000","last_unstale":"2023-10-19T12:42:27.126049+0000","last_undegraded":"2023-10-19T12:42:27.126049+0000","last_fullsized":"2023-10-19T12:42:27.126049+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:41:00.885308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.120871+0000","last_change":"2023-10-19T12:41:19.285478+0000","last_active":"2023-10-19T12:42:27.120871+0000","last_peered":"2023-10-19T12:42:27.120871+0000","last_clean":"2023-10-19T12:42:27.120871+0000","last_became_active":"2023-10-19T12:41:19.285175+0000","last_became_peered":"2023-10-19T12:41:19.285175+0000","last_unstale":"2023-10-19T12:42:27.120871+0000","last_undegraded":"2023-10-19T12:42:27.120871+0000","last_fullsized":"2023-10-19T12:42:27.120871+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:18:03.423712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"88'5","reported_seq":73,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:34.379421+0000","last_change":"2023-10-19T12:41:18.297207+0000","last_active":"2023-10-19T12:42:34.379421+0000","last_peered":"2023-10-19T12:42:34.379421+0000","last_clean":"2023-10-19T12:42:34.379421+0000","last_became_active":"2023-10-19T12:41:18.296490+0000","last_became_peered":"2023-10-19T12:41:18.296490+0000","last_unstale":"2023-10-19T12:42:34.379421+0000","last_undegraded":"2023-10-19T12:42:34.379421+0000","last_fullsized":"2023-10-19T12:42:34.379421+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:42:33.769810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"88'1","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.119053+0000","last_change":"2023-10-19T12:41:23.338803+0000","last_active":"2023-10-19T12:42:27.119053+0000","last_peered":"2023-10-19T12:42:27.119053+0000","last_clean":"2023-10-19T12:42:27.119053+0000","last_became_active":"2023-10-19T12:41:23.338383+0000","last_became_peered":"2023-10-19T12:41:23.338383+0000","last_unstale":"2023-10-19T12:42:27.119053+0000","last_undegraded":"2023-10-19T12:42:27.119053+0000","last_fullsized":"2023-10-19T12:42:27.119053+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:39:24.412323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.124366+0000","last_change":"2023-10-19T12:41:19.290536+0000","last_active":"2023-10-19T12:42:27.124366+0000","last_peered":"2023-10-19T12:42:27.124366+0000","last_clean":"2023-10-19T12:42:27.124366+0000","last_became_active":"2023-10-19T12:41:19.290141+0000","last_became_peered":"2023-10-19T12:41:19.290141+0000","last_unstale":"2023-10-19T12:42:27.124366+0000","last_undegraded":"2023-10-19T12:42:27.124366+0000","last_fullsized":"2023-10-19T12:42:27.124366+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:49:59.601767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"88'6","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.121577+0000","last_change":"2023-10-19T12:41:18.276568+0000","last_active":"2023-10-19T12:42:27.121577+0000","last_peered":"2023-10-19T12:42:27.121577+0000","last_clean":"2023-10-19T12:42:27.121577+0000","last_became_active":"2023-10-19T12:41:18.276216+0000","last_became_peered":"2023-10-19T12:41:18.276216+0000","last_unstale":"2023-10-19T12:42:27.121577+0000","last_undegraded":"2023-10-19T12:42:27.121577+0000","last_fullsized":"2023-10-19T12:42:27.121577+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T23:24:32.159972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":313,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.118130+0000","last_change":"2023-10-19T12:40:14.674594+0000","last_active":"2023-10-19T12:42:27.118130+0000","last_peered":"2023-10-19T12:42:27.118130+0000","last_clean":"2023-10-19T12:42:27.118130+0000","last_became_active":"2023-10-19T12:40:14.674234+0000","last_became_peered":"2023-10-19T12:40:14.674234+0000","last_unstale":"2023-10-19T12:42:27.118130+0000","last_undegraded":"2023-10-19T12:42:27.118130+0000","last_fullsized":"2023-10-19T12:42:27.118130+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:37:07.222565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:37:07.222565+0000","last_clean_scrub_stamp":"2023-10-19T12:37:07.222565+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-21T00:22:40.530907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.121767+0000","last_change":"2023-10-19T12:41:23.479328+0000","last_active":"2023-10-19T12:42:27.121767+0000","last_peered":"2023-10-19T12:42:27.121767+0000","last_clean":"2023-10-19T12:42:27.121767+0000","last_became_active":"2023-10-19T12:41:23.478972+0000","last_became_peered":"2023-10-19T12:41:23.478972+0000","last_unstale":"2023-10-19T12:42:27.121767+0000","last_undegraded":"2023-10-19T12:42:27.121767+0000","last_fullsized":"2023-10-19T12:42:27.121767+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:58:38.949721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.125381+0000","last_change":"2023-10-19T12:41:19.294132+0000","last_active":"2023-10-19T12:42:27.125381+0000","last_peered":"2023-10-19T12:42:27.125381+0000","last_clean":"2023-10-19T12:42:27.125381+0000","last_became_active":"2023-10-19T12:41:19.293800+0000","last_became_peered":"2023-10-19T12:41:19.293800+0000","last_unstale":"2023-10-19T12:42:27.125381+0000","last_undegraded":"2023-10-19T12:42:27.125381+0000","last_fullsized":"2023-10-19T12:42:27.125381+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:30:56.734581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"88'4","reported_seq":15,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:28.136072+0000","last_change":"2023-10-19T12:42:28.135694+0000","last_active":"2023-10-19T12:42:28.136072+0000","last_peered":"2023-10-19T12:42:28.136072+0000","last_clean":"2023-10-19T12:42:28.136072+0000","last_became_active":"2023-10-19T12:42:28.127322+0000","last_became_peered":"2023-10-19T12:42:28.127322+0000","last_unstale":"2023-10-19T12:42:28.136072+0000","last_undegraded":"2023-10-19T12:42:28.136072+0000","last_fullsized":"2023-10-19T12:42:28.136072+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T23:26:54.615667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.122348+0000","last_change":"2023-10-19T12:41:23.328605+0000","last_active":"2023-10-19T12:42:27.122348+0000","last_peered":"2023-10-19T12:42:27.122348+0000","last_clean":"2023-10-19T12:42:27.122348+0000","last_became_active":"2023-10-19T12:41:23.327992+0000","last_became_peered":"2023-10-19T12:41:23.327992+0000","last_unstale":"2023-10-19T12:42:27.122348+0000","last_undegraded":"2023-10-19T12:42:27.122348+0000","last_fullsized":"2023-10-19T12:42:27.122348+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:00:04.415235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"88'4","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.120421+0000","last_change":"2023-10-19T12:41:18.290347+0000","last_active":"2023-10-19T12:42:27.120421+0000","last_peered":"2023-10-19T12:42:27.120421+0000","last_clean":"2023-10-19T12:42:27.120421+0000","last_became_active":"2023-10-19T12:41:18.290050+0000","last_became_peered":"2023-10-19T12:41:18.290050+0000","last_unstale":"2023-10-19T12:42:27.120421+0000","last_undegraded":"2023-10-19T12:42:27.120421+0000","last_fullsized":"2023-10-19T12:42:27.120421+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:19:05.618338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.125049+0000","last_change":"2023-10-19T12:41:19.303753+0000","last_active":"2023-10-19T12:42:27.125049+0000","last_peered":"2023-10-19T12:42:27.125049+0000","last_clean":"2023-10-19T12:42:27.125049+0000","last_became_active":"2023-10-19T12:41:19.299710+0000","last_became_peered":"2023-10-19T12:41:19.299710+0000","last_unstale":"2023-10-19T12:42:27.125049+0000","last_undegraded":"2023-10-19T12:42:27.125049+0000","last_fullsized":"2023-10-19T12:42:27.125049+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:40:27.929956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.124095+0000","last_change":"2023-10-19T12:41:23.478159+0000","last_active":"2023-10-19T12:42:27.124095+0000","last_peered":"2023-10-19T12:42:27.124095+0000","last_clean":"2023-10-19T12:42:27.124095+0000","last_became_active":"2023-10-19T12:41:23.477647+0000","last_became_peered":"2023-10-19T12:41:23.477647+0000","last_unstale":"2023-10-19T12:42:27.124095+0000","last_undegraded":"2023-10-19T12:42:27.124095+0000","last_fullsized":"2023-10-19T12:42:27.124095+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:48:31.904477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"88'10","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.119328+0000","last_change":"2023-10-19T12:41:18.295746+0000","last_active":"2023-10-19T12:42:27.119328+0000","last_peered":"2023-10-19T12:42:27.119328+0000","last_clean":"2023-10-19T12:42:27.119328+0000","last_became_active":"2023-10-19T12:41:18.294855+0000","last_became_peered":"2023-10-19T12:41:18.294855+0000","last_unstale":"2023-10-19T12:42:27.119328+0000","last_undegraded":"2023-10-19T12:42:27.119328+0000","last_fullsized":"2023-10-19T12:42:27.119328+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:52:24.628136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.126402+0000","last_change":"2023-10-19T12:41:19.283960+0000","last_active":"2023-10-19T12:42:27.126402+0000","last_peered":"2023-10-19T12:42:27.126402+0000","last_clean":"2023-10-19T12:42:27.126402+0000","last_became_active":"2023-10-19T12:41:19.282544+0000","last_became_peered":"2023-10-19T12:41:19.282544+0000","last_unstale":"2023-10-19T12:42:27.126402+0000","last_undegraded":"2023-10-19T12:42:27.126402+0000","last_fullsized":"2023-10-19T12:42:27.126402+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T23:58:08.794192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.116192+0000","last_change":"2023-10-19T12:41:23.323593+0000","last_active":"2023-10-19T12:42:27.116192+0000","last_peered":"2023-10-19T12:42:27.116192+0000","last_clean":"2023-10-19T12:42:27.116192+0000","last_became_active":"2023-10-19T12:41:23.323204+0000","last_became_peered":"2023-10-19T12:41:23.323204+0000","last_unstale":"2023-10-19T12:42:27.116192+0000","last_undegraded":"2023-10-19T12:42:27.116192+0000","last_fullsized":"2023-10-19T12:42:27.116192+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:15:15.379085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"88'7","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.122418+0000","last_change":"2023-10-19T12:41:18.286231+0000","last_active":"2023-10-19T12:42:27.122418+0000","last_peered":"2023-10-19T12:42:27.122418+0000","last_clean":"2023-10-19T12:42:27.122418+0000","last_became_active":"2023-10-19T12:41:18.285932+0000","last_became_peered":"2023-10-19T12:41:18.285932+0000","last_unstale":"2023-10-19T12:42:27.122418+0000","last_undegraded":"2023-10-19T12:42:27.122418+0000","last_fullsized":"2023-10-19T12:42:27.122418+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:13:02.066468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:28.126438+0000","last_change":"2023-10-19T12:42:28.126438+0000","last_active":"2023-10-19T12:42:28.126438+0000","last_peered":"2023-10-19T12:42:28.126438+0000","last_clean":"2023-10-19T12:42:28.126438+0000","last_became_active":"2023-10-19T12:42:28.126115+0000","last_became_peered":"2023-10-19T12:42:28.126115+0000","last_unstale":"2023-10-19T12:42:28.126438+0000","last_undegraded":"2023-10-19T12:42:28.126438+0000","last_fullsized":"2023-10-19T12:42:28.126438+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:48:12.878420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.121969+0000","last_change":"2023-10-19T12:41:23.479129+0000","last_active":"2023-10-19T12:42:27.121969+0000","last_peered":"2023-10-19T12:42:27.121969+0000","last_clean":"2023-10-19T12:42:27.121969+0000","last_became_active":"2023-10-19T12:41:23.478518+0000","last_became_peered":"2023-10-19T12:41:23.478518+0000","last_unstale":"2023-10-19T12:42:27.121969+0000","last_undegraded":"2023-10-19T12:42:27.121969+0000","last_fullsized":"2023-10-19T12:42:27.121969+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:55:38.767504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"88'2","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.124117+0000","last_change":"2023-10-19T12:41:18.283269+0000","last_active":"2023-10-19T12:42:27.124117+0000","last_peered":"2023-10-19T12:42:27.124117+0000","last_clean":"2023-10-19T12:42:27.124117+0000","last_became_active":"2023-10-19T12:41:18.282913+0000","last_became_peered":"2023-10-19T12:41:18.282913+0000","last_unstale":"2023-10-19T12:42:27.124117+0000","last_undegraded":"2023-10-19T12:42:27.124117+0000","last_fullsized":"2023-10-19T12:42:27.124117+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:44:01.042312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.119590+0000","last_change":"2023-10-19T12:41:19.284222+0000","last_active":"2023-10-19T12:42:27.119590+0000","last_peered":"2023-10-19T12:42:27.119590+0000","last_clean":"2023-10-19T12:42:27.119590+0000","last_became_active":"2023-10-19T12:41:19.283914+0000","last_became_peered":"2023-10-19T12:41:19.283914+0000","last_unstale":"2023-10-19T12:42:27.119590+0000","last_undegraded":"2023-10-19T12:42:27.119590+0000","last_fullsized":"2023-10-19T12:42:27.119590+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:15:34.801502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.119367+0000","last_change":"2023-10-19T12:41:23.338071+0000","last_active":"2023-10-19T12:42:27.119367+0000","last_peered":"2023-10-19T12:42:27.119367+0000","last_clean":"2023-10-19T12:42:27.119367+0000","last_became_active":"2023-10-19T12:41:23.336265+0000","last_became_peered":"2023-10-19T12:41:23.336265+0000","last_unstale":"2023-10-19T12:42:27.119367+0000","last_undegraded":"2023-10-19T12:42:27.119367+0000","last_fullsized":"2023-10-19T12:42:27.119367+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:02:53.139468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"88'7","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.124460+0000","last_change":"2023-10-19T12:41:18.293027+0000","last_active":"2023-10-19T12:42:27.124460+0000","last_peered":"2023-10-19T12:42:27.124460+0000","last_clean":"2023-10-19T12:42:27.124460+0000","last_became_active":"2023-10-19T12:41:18.289478+0000","last_became_peered":"2023-10-19T12:41:18.289478+0000","last_unstale":"2023-10-19T12:42:27.124460+0000","last_undegraded":"2023-10-19T12:42:27.124460+0000","last_fullsized":"2023-10-19T12:42:27.124460+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:26:32.986754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.123173+0000","last_change":"2023-10-19T12:41:19.293206+0000","last_active":"2023-10-19T12:42:27.123173+0000","last_peered":"2023-10-19T12:42:27.123173+0000","last_clean":"2023-10-19T12:42:27.123173+0000","last_became_active":"2023-10-19T12:41:19.292898+0000","last_became_peered":"2023-10-19T12:41:19.292898+0000","last_unstale":"2023-10-19T12:42:27.123173+0000","last_undegraded":"2023-10-19T12:42:27.123173+0000","last_fullsized":"2023-10-19T12:42:27.123173+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T23:36:17.548859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"88'1","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.121720+0000","last_change":"2023-10-19T12:41:23.343048+0000","last_active":"2023-10-19T12:42:27.121720+0000","last_peered":"2023-10-19T12:42:27.121720+0000","last_clean":"2023-10-19T12:42:27.121720+0000","last_became_active":"2023-10-19T12:41:23.342696+0000","last_became_peered":"2023-10-19T12:41:23.342696+0000","last_unstale":"2023-10-19T12:42:27.121720+0000","last_undegraded":"2023-10-19T12:42:27.121720+0000","last_fullsized":"2023-10-19T12:42:27.121720+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:30:38.858947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"88'3","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.116387+0000","last_change":"2023-10-19T12:41:18.293079+0000","last_active":"2023-10-19T12:42:27.116387+0000","last_peered":"2023-10-19T12:42:27.116387+0000","last_clean":"2023-10-19T12:42:27.116387+0000","last_became_active":"2023-10-19T12:41:18.292803+0000","last_became_peered":"2023-10-19T12:41:18.292803+0000","last_unstale":"2023-10-19T12:42:27.116387+0000","last_undegraded":"2023-10-19T12:42:27.116387+0000","last_fullsized":"2023-10-19T12:42:27.116387+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T22:37:14.550800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.124697+0000","last_change":"2023-10-19T12:41:19.292921+0000","last_active":"2023-10-19T12:42:27.124697+0000","last_peered":"2023-10-19T12:42:27.124697+0000","last_clean":"2023-10-19T12:42:27.124697+0000","last_became_active":"2023-10-19T12:41:19.292498+0000","last_became_peered":"2023-10-19T12:41:19.292498+0000","last_unstale":"2023-10-19T12:42:27.124697+0000","last_undegraded":"2023-10-19T12:42:27.124697+0000","last_fullsized":"2023-10-19T12:42:27.124697+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T22:02:55.878154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.122200+0000","last_change":"2023-10-19T12:41:23.477894+0000","last_active":"2023-10-19T12:42:27.122200+0000","last_peered":"2023-10-19T12:42:27.122200+0000","last_clean":"2023-10-19T12:42:27.122200+0000","last_became_active":"2023-10-19T12:41:23.477478+0000","last_became_peered":"2023-10-19T12:41:23.477478+0000","last_unstale":"2023-10-19T12:42:27.122200+0000","last_undegraded":"2023-10-19T12:42:27.122200+0000","last_fullsized":"2023-10-19T12:42:27.122200+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:44:21.730215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"88'4","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.121089+0000","last_change":"2023-10-19T12:41:18.282474+0000","last_active":"2023-10-19T12:42:27.121089+0000","last_peered":"2023-10-19T12:42:27.121089+0000","last_clean":"2023-10-19T12:42:27.121089+0000","last_became_active":"2023-10-19T12:41:18.282124+0000","last_became_peered":"2023-10-19T12:41:18.282124+0000","last_unstale":"2023-10-19T12:42:27.121089+0000","last_undegraded":"2023-10-19T12:42:27.121089+0000","last_fullsized":"2023-10-19T12:42:27.121089+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T21:27:37.530324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.118468+0000","last_change":"2023-10-19T12:41:19.302928+0000","last_active":"2023-10-19T12:42:27.118468+0000","last_peered":"2023-10-19T12:42:27.118468+0000","last_clean":"2023-10-19T12:42:27.118468+0000","last_became_active":"2023-10-19T12:41:19.302641+0000","last_became_peered":"2023-10-19T12:41:19.302641+0000","last_unstale":"2023-10-19T12:42:27.118468+0000","last_undegraded":"2023-10-19T12:42:27.118468+0000","last_fullsized":"2023-10-19T12:42:27.118468+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:07:46.333875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.124012+0000","last_change":"2023-10-19T12:41:23.329079+0000","last_active":"2023-10-19T12:42:27.124012+0000","last_peered":"2023-10-19T12:42:27.124012+0000","last_clean":"2023-10-19T12:42:27.124012+0000","last_became_active":"2023-10-19T12:41:23.328407+0000","last_became_peered":"2023-10-19T12:41:23.328407+0000","last_unstale":"2023-10-19T12:42:27.124012+0000","last_undegraded":"2023-10-19T12:42:27.124012+0000","last_fullsized":"2023-10-19T12:42:27.124012+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:46:19.404922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"88'6","reported_seq":76,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:35.382546+0000","last_change":"2023-10-19T12:41:18.286336+0000","last_active":"2023-10-19T12:42:35.382546+0000","last_peered":"2023-10-19T12:42:35.382546+0000","last_clean":"2023-10-19T12:42:35.382546+0000","last_became_active":"2023-10-19T12:41:18.285921+0000","last_became_peered":"2023-10-19T12:41:18.285921+0000","last_unstale":"2023-10-19T12:42:35.382546+0000","last_undegraded":"2023-10-19T12:42:35.382546+0000","last_fullsized":"2023-10-19T12:42:35.382546+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T23:16:34.842143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1560,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":52,"num_read_kb":2,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.119294+0000","last_change":"2023-10-19T12:41:19.289466+0000","last_active":"2023-10-19T12:42:27.119294+0000","last_peered":"2023-10-19T12:42:27.119294+0000","last_clean":"2023-10-19T12:42:27.119294+0000","last_became_active":"2023-10-19T12:41:19.288669+0000","last_became_peered":"2023-10-19T12:41:19.288669+0000","last_unstale":"2023-10-19T12:42:27.119294+0000","last_undegraded":"2023-10-19T12:42:27.119294+0000","last_fullsized":"2023-10-19T12:42:27.119294+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T23:31:52.163958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.128490+0000","last_change":"2023-10-19T12:41:23.343521+0000","last_active":"2023-10-19T12:42:27.128490+0000","last_peered":"2023-10-19T12:42:27.128490+0000","last_clean":"2023-10-19T12:42:27.128490+0000","last_became_active":"2023-10-19T12:41:23.342288+0000","last_became_peered":"2023-10-19T12:41:23.342288+0000","last_unstale":"2023-10-19T12:42:27.128490+0000","last_undegraded":"2023-10-19T12:42:27.128490+0000","last_fullsized":"2023-10-19T12:42:27.128490+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:58:06.810552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"88'3","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.122056+0000","last_change":"2023-10-19T12:41:18.294999+0000","last_active":"2023-10-19T12:42:27.122056+0000","last_peered":"2023-10-19T12:42:27.122056+0000","last_clean":"2023-10-19T12:42:27.122056+0000","last_became_active":"2023-10-19T12:41:18.294776+0000","last_became_peered":"2023-10-19T12:41:18.294776+0000","last_unstale":"2023-10-19T12:42:27.122056+0000","last_undegraded":"2023-10-19T12:42:27.122056+0000","last_fullsized":"2023-10-19T12:42:27.122056+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:17:53.704739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.118684+0000","last_change":"2023-10-19T12:41:19.291753+0000","last_active":"2023-10-19T12:42:27.118684+0000","last_peered":"2023-10-19T12:42:27.118684+0000","last_clean":"2023-10-19T12:42:27.118684+0000","last_became_active":"2023-10-19T12:41:19.291475+0000","last_became_peered":"2023-10-19T12:41:19.291475+0000","last_unstale":"2023-10-19T12:42:27.118684+0000","last_undegraded":"2023-10-19T12:42:27.118684+0000","last_fullsized":"2023-10-19T12:42:27.118684+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:26:38.494864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.118754+0000","last_change":"2023-10-19T12:41:23.327966+0000","last_active":"2023-10-19T12:42:27.118754+0000","last_peered":"2023-10-19T12:42:27.118754+0000","last_clean":"2023-10-19T12:42:27.118754+0000","last_became_active":"2023-10-19T12:41:23.327555+0000","last_became_peered":"2023-10-19T12:41:23.327555+0000","last_unstale":"2023-10-19T12:42:27.118754+0000","last_undegraded":"2023-10-19T12:42:27.118754+0000","last_fullsized":"2023-10-19T12:42:27.118754+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:01:34.044012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"88'5","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.125824+0000","last_change":"2023-10-19T12:41:18.297472+0000","last_active":"2023-10-19T12:42:27.125824+0000","last_peered":"2023-10-19T12:42:27.125824+0000","last_clean":"2023-10-19T12:42:27.125824+0000","last_became_active":"2023-10-19T12:41:18.296410+0000","last_became_peered":"2023-10-19T12:41:18.296410+0000","last_unstale":"2023-10-19T12:42:27.125824+0000","last_undegraded":"2023-10-19T12:42:27.125824+0000","last_fullsized":"2023-10-19T12:42:27.125824+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:20:15.039332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.119122+0000","last_change":"2023-10-19T12:41:19.295136+0000","last_active":"2023-10-19T12:42:27.119122+0000","last_peered":"2023-10-19T12:42:27.119122+0000","last_clean":"2023-10-19T12:42:27.119122+0000","last_became_active":"2023-10-19T12:41:19.294836+0000","last_became_peered":"2023-10-19T12:41:19.294836+0000","last_unstale":"2023-10-19T12:42:27.119122+0000","last_undegraded":"2023-10-19T12:42:27.119122+0000","last_fullsized":"2023-10-19T12:42:27.119122+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:08:25.830396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.123261+0000","last_change":"2023-10-19T12:41:19.290047+0000","last_active":"2023-10-19T12:42:27.123261+0000","last_peered":"2023-10-19T12:42:27.123261+0000","last_clean":"2023-10-19T12:42:27.123261+0000","last_became_active":"2023-10-19T12:41:19.289792+0000","last_became_peered":"2023-10-19T12:41:19.289792+0000","last_unstale":"2023-10-19T12:42:27.123261+0000","last_undegraded":"2023-10-19T12:42:27.123261+0000","last_fullsized":"2023-10-19T12:42:27.123261+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:10:58.981643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.116433+0000","last_change":"2023-10-19T12:41:19.287973+0000","last_active":"2023-10-19T12:42:27.116433+0000","last_peered":"2023-10-19T12:42:27.116433+0000","last_clean":"2023-10-19T12:42:27.116433+0000","last_became_active":"2023-10-19T12:41:19.287508+0000","last_became_peered":"2023-10-19T12:41:19.287508+0000","last_unstale":"2023-10-19T12:42:27.116433+0000","last_undegraded":"2023-10-19T12:42:27.116433+0000","last_fullsized":"2023-10-19T12:42:27.116433+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:25:57.815032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.116496+0000","last_change":"2023-10-19T12:41:19.294154+0000","last_active":"2023-10-19T12:42:27.116496+0000","last_peered":"2023-10-19T12:42:27.116496+0000","last_clean":"2023-10-19T12:42:27.116496+0000","last_became_active":"2023-10-19T12:41:19.293873+0000","last_became_peered":"2023-10-19T12:41:19.293873+0000","last_unstale":"2023-10-19T12:42:27.116496+0000","last_undegraded":"2023-10-19T12:42:27.116496+0000","last_fullsized":"2023-10-19T12:42:27.116496+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:29:58.428571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.128735+0000","last_change":"2023-10-19T12:41:19.309512+0000","last_active":"2023-10-19T12:42:27.128735+0000","last_peered":"2023-10-19T12:42:27.128735+0000","last_clean":"2023-10-19T12:42:27.128735+0000","last_became_active":"2023-10-19T12:41:19.309149+0000","last_became_peered":"2023-10-19T12:41:19.309149+0000","last_unstale":"2023-10-19T12:42:27.128735+0000","last_undegraded":"2023-10-19T12:42:27.128735+0000","last_fullsized":"2023-10-19T12:42:27.128735+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:19:34.971413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.125576+0000","last_change":"2023-10-19T12:41:19.301496+0000","last_active":"2023-10-19T12:42:27.125576+0000","last_peered":"2023-10-19T12:42:27.125576+0000","last_clean":"2023-10-19T12:42:27.125576+0000","last_became_active":"2023-10-19T12:41:19.299697+0000","last_became_peered":"2023-10-19T12:41:19.299697+0000","last_unstale":"2023-10-19T12:42:27.125576+0000","last_undegraded":"2023-10-19T12:42:27.125576+0000","last_fullsized":"2023-10-19T12:42:27.125576+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T23:51:52.448215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.122410+0000","last_change":"2023-10-19T12:41:19.289995+0000","last_active":"2023-10-19T12:42:27.122410+0000","last_peered":"2023-10-19T12:42:27.122410+0000","last_clean":"2023-10-19T12:42:27.122410+0000","last_became_active":"2023-10-19T12:41:19.289471+0000","last_became_peered":"2023-10-19T12:41:19.289471+0000","last_unstale":"2023-10-19T12:42:27.122410+0000","last_undegraded":"2023-10-19T12:42:27.122410+0000","last_fullsized":"2023-10-19T12:42:27.122410+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:28:25.801772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.117119+0000","last_change":"2023-10-19T12:41:19.287620+0000","last_active":"2023-10-19T12:42:27.117119+0000","last_peered":"2023-10-19T12:42:27.117119+0000","last_clean":"2023-10-19T12:42:27.117119+0000","last_became_active":"2023-10-19T12:41:19.287298+0000","last_became_peered":"2023-10-19T12:41:19.287298+0000","last_unstale":"2023-10-19T12:42:27.117119+0000","last_undegraded":"2023-10-19T12:42:27.117119+0000","last_fullsized":"2023-10-19T12:42:27.117119+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:01:46.919580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.126548+0000","last_change":"2023-10-19T12:41:19.278455+0000","last_active":"2023-10-19T12:42:27.126548+0000","last_peered":"2023-10-19T12:42:27.126548+0000","last_clean":"2023-10-19T12:42:27.126548+0000","last_became_active":"2023-10-19T12:41:19.278093+0000","last_became_peered":"2023-10-19T12:41:19.278093+0000","last_unstale":"2023-10-19T12:42:27.126548+0000","last_undegraded":"2023-10-19T12:42:27.126548+0000","last_fullsized":"2023-10-19T12:42:27.126548+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T22:52:00.939409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.120697+0000","last_change":"2023-10-19T12:41:19.294478+0000","last_active":"2023-10-19T12:42:27.120697+0000","last_peered":"2023-10-19T12:42:27.120697+0000","last_clean":"2023-10-19T12:42:27.120697+0000","last_became_active":"2023-10-19T12:41:19.294136+0000","last_became_peered":"2023-10-19T12:41:19.294136+0000","last_unstale":"2023-10-19T12:42:27.120697+0000","last_undegraded":"2023-10-19T12:42:27.120697+0000","last_fullsized":"2023-10-19T12:42:27.120697+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:18:20.066346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.124555+0000","last_change":"2023-10-19T12:41:19.283014+0000","last_active":"2023-10-19T12:42:27.124555+0000","last_peered":"2023-10-19T12:42:27.124555+0000","last_clean":"2023-10-19T12:42:27.124555+0000","last_became_active":"2023-10-19T12:41:19.279958+0000","last_became_peered":"2023-10-19T12:41:19.279958+0000","last_unstale":"2023-10-19T12:42:27.124555+0000","last_undegraded":"2023-10-19T12:42:27.124555+0000","last_fullsized":"2023-10-19T12:42:27.124555+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-21T00:26:13.329031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.124617+0000","last_change":"2023-10-19T12:41:19.296507+0000","last_active":"2023-10-19T12:42:27.124617+0000","last_peered":"2023-10-19T12:42:27.124617+0000","last_clean":"2023-10-19T12:42:27.124617+0000","last_became_active":"2023-10-19T12:41:19.295960+0000","last_became_peered":"2023-10-19T12:41:19.295960+0000","last_unstale":"2023-10-19T12:42:27.124617+0000","last_undegraded":"2023-10-19T12:42:27.124617+0000","last_fullsized":"2023-10-19T12:42:27.124617+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T22:49:06.224425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.124927+0000","last_change":"2023-10-19T12:41:19.300262+0000","last_active":"2023-10-19T12:42:27.124927+0000","last_peered":"2023-10-19T12:42:27.124927+0000","last_clean":"2023-10-19T12:42:27.124927+0000","last_became_active":"2023-10-19T12:41:19.299702+0000","last_became_peered":"2023-10-19T12:41:19.299702+0000","last_unstale":"2023-10-19T12:42:27.124927+0000","last_undegraded":"2023-10-19T12:42:27.124927+0000","last_fullsized":"2023-10-19T12:42:27.124927+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:30:22.690228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.122957+0000","last_change":"2023-10-19T12:41:19.289863+0000","last_active":"2023-10-19T12:42:27.122957+0000","last_peered":"2023-10-19T12:42:27.122957+0000","last_clean":"2023-10-19T12:42:27.122957+0000","last_became_active":"2023-10-19T12:41:19.289556+0000","last_became_peered":"2023-10-19T12:41:19.289556+0000","last_unstale":"2023-10-19T12:42:27.122957+0000","last_undegraded":"2023-10-19T12:42:27.122957+0000","last_fullsized":"2023-10-19T12:42:27.122957+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:17:18.560081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":67253,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":518,"num_read_kb":332,"num_write":238,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":1204,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":201759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":208,"ondisk_log_size":208,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":79,"seq":339302416413,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1019904,"data_stored":495120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 19 12:42:35 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.86699999999999999,"15min":0.91500000000000004},"min":{"1min":0.39600000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.84399999999999997,"5min":8.5449999999999999,"15min":8.5449999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.84499999999999997,"15min":0.88500000000000001},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.90700000000000003,"5min":7.641,"15min":7.641},"last":0.752}]},{"osd":1,"last update":"Thu Oct 19 12:42:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.70499999999999996,"15min":0.71299999999999997},"min":{"1min":0.49299999999999999,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.85099999999999998,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.70799999999999996,"15min":0.71199999999999997},"min":{"1min":0.47299999999999998,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.83699999999999997,"5min":1.883,"15min":1.883},"last":0.83399999999999996}]},{"osd":2,"last update":"Thu Oct 19 12:42:35 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.54800000000000004,"15min":0.55700000000000005},"min":{"1min":0.39600000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.64700000000000002,"5min":1.496,"15min":1.496},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.55300000000000005,"15min":0.55100000000000005},"min":{"1min":0.35499999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.92700000000000005,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.496}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":4,"last update":"Thu Oct 19 12:42:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.83499999999999996,"15min":0.85499999999999998},"min":{"1min":0.57099999999999995,"5min":0.495,"15min":0.495},"max":{"1min":0.95499999999999996,"5min":3.5190000000000001,"15min":3.5190000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.75700000000000001,"15min":0.76900000000000002},"min":{"1min":0.55700000000000005,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.90200000000000002,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.57799999999999996}]},{"osd":5,"last update":"Thu Oct 19 12:42:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63900000000000001,"15min":0.64000000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.02,"5min":1.675,"15min":1.675},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.69599999999999995,"15min":0.69799999999999995},"min":{"1min":0.45800000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0920000000000001,"5min":2.089,"15min":2.089},"last":0.65400000000000003}]},{"osd":6,"last update":"Thu Oct 19 12:42:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.75700000000000001,"15min":0.76400000000000001},"min":{"1min":0.48899999999999999,"5min":0.438,"15min":0.438},"max":{"1min":1.0609999999999999,"5min":2.004,"15min":2.004},"last":0.872},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.75900000000000001,"15min":0.76700000000000002},"min":{"1min":0.51100000000000001,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.641,"5min":1.704,"15min":1.704},"last":1.641}]},{"osd":7,"last update":"Thu Oct 19 12:42:35 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":1.0029999999999999,"15min":1.0449999999999999},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.98199999999999998,"5min":6.5590000000000002,"15min":6.5590000000000002},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.78500000000000003,"5min":1.0620000000000001,"15min":1.1080000000000001},"min":{"1min":0.60099999999999998,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.99199999999999999,"5min":7.3070000000000004,"15min":7.3070000000000004},"last":0.69899999999999995}]},{"osd":8,"last update":"Thu Oct 19 12:42:20 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.67200000000000004}]},{"osd":9,"last update":"Thu Oct 19 12:42:35 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":1.0529999999999999,"15min":1.095},"min":{"1min":0.60899999999999999,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.96999999999999997,"5min":7.8440000000000003,"15min":7.8440000000000003},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.96799999999999997,"15min":0.99199999999999999},"min":{"1min":0.621,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.0269999999999999,"5min":5.0860000000000003,"15min":5.0860000000000003},"last":0.81499999999999995}]},{"osd":10,"last update":"Thu Oct 19 12:42:35 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":1.0920000000000001,"15min":1.1299999999999999},"min":{"1min":0.72899999999999998,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.0269999999999999,"5min":7.2619999999999996,"15min":7.2619999999999996},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.81299999999999994,"5min":1.085,"15min":1.1299999999999999},"min":{"1min":0.65600000000000003,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.008,"5min":7.7619999999999996,"15min":7.7619999999999996},"last":0.77500000000000002}]}]},{"osd":10,"up_from":72,"seq":309237645344,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28688,"kb_used_data":1664,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716464,"statfs":{"total":95995035648,"available":95965659136,"internally_reserved":0,"allocated":1703936,"data_stored":1141074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 19 12:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.501},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.626}]},{"osd":1,"last update":"Thu Oct 19 12:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.45500000000000002,"15min":0.45800000000000002},"min":{"1min":0.311,"5min":0.254,"15min":0.254},"max":{"1min":0.65700000000000003,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.441},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.46100000000000002,"15min":0.45900000000000002},"min":{"1min":0.32600000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.32200000000000001}]},{"osd":2,"last update":"Thu Oct 19 12:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.69599999999999995,"15min":0.70199999999999996},"min":{"1min":0.51700000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.83399999999999996,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.71099999999999997,"15min":0.71799999999999997},"min":{"1min":0.48799999999999999,"5min":0.433,"15min":0.433},"max":{"1min":0.91100000000000003,"5min":2.2050000000000001,"15min":2.2050000000000001},"last":0.54600000000000004}]},{"osd":3,"last update":"Thu Oct 19 12:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.65000000000000002,"15min":0.66000000000000003},"min":{"1min":0.46800000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.85799999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.65700000000000003,"15min":0.66400000000000003},"min":{"1min":0.502,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.81499999999999995,"5min":0.877,"15min":0.877},"last":0.47399999999999998}]},{"osd":4,"last update":"Thu Oct 19 12:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.38,"5min":0.37,"15min":0.37},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.56999999999999995,"15min":0.57199999999999995},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.95299999999999996,"5min":0.999,"15min":0.999},"last":0.56999999999999995}]},{"osd":5,"last update":"Thu Oct 19 12:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.82599999999999996,"15min":0.84399999999999997},"min":{"1min":0.505,"5min":0.434,"15min":0.434},"max":{"1min":1.2370000000000001,"5min":2.3940000000000001,"15min":2.3940000000000001},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.746,"5min":0.77800000000000002,"15min":0.78400000000000003},"min":{"1min":0.55900000000000005,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.0669999999999999,"5min":2.2530000000000001,"15min":2.2530000000000001},"last":0.58999999999999997}]},{"osd":6,"last update":"Thu Oct 19 12:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.75800000000000001,"15min":0.76600000000000001},"min":{"1min":0.47199999999999998,"5min":0.44,"15min":0.44},"max":{"1min":0.96899999999999997,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.54300000000000004,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.52300000000000002}]},{"osd":7,"last update":"Thu Oct 19 12:41:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":1.046}]},{"osd":8,"last update":"Thu Oct 19 12:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.84299999999999997,"15min":0.85499999999999998},"min":{"1min":0.57499999999999996,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.3089999999999999,"5min":2.012,"15min":2.012},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.90200000000000002,"15min":0.91800000000000004},"min":{"1min":0.621,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.2889999999999999,"5min":2.2290000000000001,"15min":2.2290000000000001},"last":0.67100000000000004}]},{"osd":9,"last update":"Thu Oct 19 12:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.81299999999999994,"15min":0.81599999999999995},"min":{"1min":0.57699999999999996,"5min":0.5,"15min":0.5},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.83199999999999996,"15min":0.83299999999999996},"min":{"1min":0.627,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.1699999999999999,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.74199999999999999}]},{"osd":11,"last update":"Thu Oct 19 12:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.65800000000000003}]}]},{"osd":9,"up_from":67,"seq":287762808868,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1044480,"data_stored":498174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 19 12:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.56399999999999995,"15min":0.58299999999999996},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.81999999999999995,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.501,"5min":0.56599999999999995,"15min":0.57699999999999996},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.77700000000000002,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.60299999999999998}]},{"osd":1,"last update":"Thu Oct 19 12:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.78100000000000003,"15min":0.79900000000000004},"min":{"1min":0.57399999999999995,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.77900000000000003,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.755,"15min":0.77100000000000002},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.81699999999999995,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":6.9279999999999999}]},{"osd":2,"last update":"Thu Oct 19 12:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.77100000000000002,"15min":0.78200000000000003},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.94299999999999995,"5min":1.117,"15min":1.117},"last":6.9420000000000002},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.77000000000000002,"15min":0.77700000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.95099999999999996,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.626}]},{"osd":3,"last update":"Thu Oct 19 12:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.746,"15min":0.76800000000000002},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.84499999999999997,"5min":1.196,"15min":1.196},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.83499999999999996,"15min":0.85699999999999998},"min":{"1min":0.52900000000000003,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.89900000000000002,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.57999999999999996}]},{"osd":4,"last update":"Thu Oct 19 12:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.83299999999999996,"15min":0.85599999999999998},"min":{"1min":0.50800000000000001,"5min":0.495,"15min":0.495},"max":{"1min":0.995,"5min":1.125,"15min":1.125},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.83099999999999996,"15min":0.84699999999999998},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.88700000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.50900000000000001}]},{"osd":5,"last update":"Thu Oct 19 12:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.873,"15min":0.89700000000000002},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.92400000000000004,"5min":1.141,"15min":1.141},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.85099999999999998,"15min":0.86499999999999999},"min":{"1min":0.54300000000000004,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.0920000000000001,"5min":1.177,"15min":1.177},"last":0.68899999999999995}]},{"osd":6,"last update":"Thu Oct 19 12:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.49399999999999999}]},{"osd":7,"last update":"Thu Oct 19 12:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.92200000000000004,"15min":0.93999999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0569999999999999,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.996,"15min":1.0229999999999999},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.034,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":0.64600000000000002}]},{"osd":8,"last update":"Thu Oct 19 12:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":1.0029999999999999,"15min":1.0329999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0640000000000001,"5min":1.3,"15min":1.3},"last":6.992},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.95899999999999996,"15min":0.97999999999999998},"min":{"1min":0.61299999999999999,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.0980000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.745}]},{"osd":10,"last update":"Thu Oct 19 12:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.96999999999999997,"15min":0.996},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.069,"5min":1.248,"15min":1.248},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.877,"5min":0.96099999999999997,"15min":0.97499999999999998},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.071,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.65500000000000003}]},{"osd":11,"last update":"Thu Oct 19 12:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":0.79000000000000004}]}]},{"osd":8,"up_from":59,"seq":253403070504,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1032192,"data_stored":493874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 19 12:42:28 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.60199999999999998,"15min":0.60599999999999998},"min":{"1min":0.375,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.627,"5min":0.59399999999999997,"15min":0.59299999999999997},"min":{"1min":0.48599999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.82099999999999995,"5min":0.872,"15min":0.872},"last":0.48399999999999999}]},{"osd":1,"last update":"Thu Oct 19 12:42:28 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.621,"15min":0.60399999999999998},"min":{"1min":0.504,"5min":0.378,"15min":0.378},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.61299999999999999,"15min":0.58999999999999997},"min":{"1min":0.51500000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.71899999999999997}]},{"osd":2,"last update":"Thu Oct 19 12:42:28 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.48099999999999998,"15min":0.47099999999999997},"min":{"1min":0.35599999999999998,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.624},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.48199999999999998,"15min":0.46800000000000003},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.46000000000000002}]},{"osd":3,"last update":"Thu Oct 19 12:42:28 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.63700000000000001,"15min":0.63300000000000001},"min":{"1min":0.48099999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.64100000000000001,"15min":0.65100000000000002},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.70199999999999996}]},{"osd":4,"last update":"Thu Oct 19 12:42:28 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.45500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.92900000000000005,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.67200000000000004,"15min":0.65600000000000003},"min":{"1min":0.58399999999999996,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.80700000000000005}]},{"osd":5,"last update":"Thu Oct 19 12:42:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.56399999999999995,"15min":0.55700000000000005},"min":{"1min":0.40200000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.84599999999999997,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.61199999999999999,"15min":0.61399999999999999},"min":{"1min":0.33600000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.93899999999999995,"5min":1.01,"15min":1.01},"last":0.82799999999999996}]},{"osd":6,"last update":"Thu Oct 19 12:42:28 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.73899999999999999,"15min":0.72899999999999998},"min":{"1min":0.53500000000000003,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":2.1520000000000001,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.72199999999999998,"15min":0.71799999999999997},"min":{"1min":0.53900000000000003,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.76600000000000001}]},{"osd":7,"last update":"Thu Oct 19 12:42:28 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.755,"15min":0.74099999999999999},"min":{"1min":0.497,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.77100000000000002,"15min":0.77200000000000002},"min":{"1min":0.57399999999999995,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.016,"5min":1.113,"15min":1.113},"last":0.91100000000000003}]},{"osd":9,"last update":"Thu Oct 19 12:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.76200000000000001,"15min":0.75700000000000001},"min":{"1min":0.56100000000000005,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0429999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.79500000000000004,"15min":0.78700000000000003},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.98199999999999998}]},{"osd":10,"last update":"Thu Oct 19 12:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.72999999999999998,"15min":0.70399999999999996},"min":{"1min":0.69399999999999995,"5min":0.434,"15min":0.434},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.78700000000000003,"15min":0.76600000000000001},"min":{"1min":0.65700000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.86899999999999999}]},{"osd":11,"last update":"Thu Oct 19 12:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.68500000000000005}]}]},{"osd":7,"up_from":51,"seq":219043332142,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28616,"kb_used_data":1596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716536,"statfs":{"total":95995035648,"available":95965732864,"internally_reserved":0,"allocated":1634304,"data_stored":1090562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 19 12:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.61899999999999999,"15min":0.60899999999999999},"min":{"1min":0.434,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.56699999999999995,"15min":0.56299999999999994},"min":{"1min":0.46400000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.76600000000000001,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.45400000000000001}]},{"osd":1,"last update":"Thu Oct 19 12:42:06 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.41499999999999998,"15min":0.40699999999999997},"min":{"1min":0.27700000000000002,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.55200000000000005,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.503},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.434,"15min":0.42599999999999999},"min":{"1min":0.29099999999999998,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.67900000000000005,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.46200000000000002}]},{"osd":2,"last update":"Thu Oct 19 12:42:06 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.59799999999999998,"15min":0.59599999999999997},"min":{"1min":0.38400000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.81200000000000006,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.60499999999999998,"15min":0.61499999999999999},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.80400000000000005,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.66700000000000004}]},{"osd":3,"last update":"Thu Oct 19 12:42:06 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.63900000000000001,"15min":0.63100000000000001},"min":{"1min":0.44600000000000001,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.86199999999999999,"5min":0.877,"15min":0.877},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.60299999999999998,"15min":0.60999999999999999},"min":{"1min":0.40300000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.72599999999999998,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.60799999999999998}]},{"osd":4,"last update":"Thu Oct 19 12:42:06 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.51200000000000001,"15min":0.505},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.71399999999999997,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.49299999999999999,"15min":0.48299999999999998},"min":{"1min":0.32600000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.91500000000000004,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.53600000000000003}]},{"osd":5,"last update":"Thu Oct 19 12:42:06 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.68200000000000005,"15min":0.67700000000000005},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.879,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.63900000000000001,"15min":0.63700000000000001},"min":{"1min":0.42599999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.86099999999999999,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.746}]},{"osd":6,"last update":"Thu Oct 19 12:42:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.72399999999999998,"15min":0.72699999999999998},"min":{"1min":0.53500000000000003,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.82699999999999996,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.66200000000000003,"15min":0.66500000000000004},"min":{"1min":0.44,"5min":0.435,"15min":0.435},"max":{"1min":0.77000000000000002,"5min":1.006,"15min":1.006},"last":0.626}]},{"osd":8,"last update":"Thu Oct 19 12:42:24 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.72099999999999997,"15min":0.72199999999999998},"min":{"1min":0.45600000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.89900000000000002,"5min":1.002,"15min":1.002},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.68799999999999994,"15min":0.68400000000000005},"min":{"1min":0.47599999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.89200000000000002,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.68999999999999995}]},{"osd":9,"last update":"Thu Oct 19 12:41:55 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.80100000000000005,"15min":0.78700000000000003},"min":{"1min":0.55800000000000005,"5min":0.504,"15min":0.504},"max":{"1min":2.9780000000000002,"5min":2.9780000000000002,"15min":2.9780000000000002},"last":0.874},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.746,"15min":0.752},"min":{"1min":0.54100000000000004,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.79700000000000004,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.72299999999999998}]},{"osd":10,"last update":"Thu Oct 19 12:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.67900000000000005,"15min":0.68200000000000005},"min":{"1min":0.42299999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.78700000000000003,"5min":1.044,"15min":1.044},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.751,"5min":0.754,"15min":0.754},"min":{"1min":0.63700000000000001,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.91000000000000003,"5min":1.024,"15min":1.024},"last":0.76600000000000001}]},{"osd":11,"last update":"Thu Oct 19 12:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.754}]}]},{"osd":6,"up_from":46,"seq":197568495666,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1015808,"data_stored":489582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 19 12:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.496,"15min":0.48599999999999999},"min":{"1min":0.33200000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.54000000000000004,"15min":0.54800000000000004},"min":{"1min":0.371,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.80700000000000005,"5min":1.107,"15min":1.107},"last":0.51100000000000001}]},{"osd":1,"last update":"Thu Oct 19 12:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.64000000000000001,"15min":0.62},"min":{"1min":0.45300000000000001,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.75,"5min":0.69699999999999995,"15min":0.67500000000000004},"min":{"1min":0.50900000000000001,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.83699999999999997}]},{"osd":2,"last update":"Thu Oct 19 12:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67800000000000005,"15min":0.67600000000000005},"min":{"1min":0.499,"5min":0.437,"15min":0.437},"max":{"1min":0.877,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.66500000000000004,"15min":0.65700000000000003},"min":{"1min":0.437,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.63100000000000001}]},{"osd":3,"last update":"Thu Oct 19 12:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.62,"15min":0.627},"min":{"1min":0.39800000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.69399999999999995,"15min":0.70099999999999996},"min":{"1min":0.43099999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.66500000000000004}]},{"osd":4,"last update":"Thu Oct 19 12:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.54300000000000004,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.1339999999999999,"5min":1.179,"15min":1.179},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77600000000000002,"15min":0.78300000000000003},"min":{"1min":0.54800000000000004,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.88300000000000001}]},{"osd":5,"last update":"Thu Oct 19 12:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.82099999999999995,"15min":0.81100000000000005},"min":{"1min":0.57199999999999995,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.0429999999999999,"5min":1.177,"15min":1.177},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.81299999999999994,"15min":0.82299999999999995},"min":{"1min":0.59399999999999997,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.0249999999999999,"5min":1.534,"15min":1.534},"last":0.90100000000000002}]},{"osd":7,"last update":"Thu Oct 19 12:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.83999999999999997,"15min":0.81399999999999995},"min":{"1min":0.55500000000000005,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.879,"5min":1.879,"15min":1.879},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.86699999999999999,"15min":0.85399999999999998},"min":{"1min":0.69499999999999995,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.8280000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":0.95199999999999996}]},{"osd":8,"last update":"Thu Oct 19 12:42:31 2023","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":0.90400000000000003,"15min":0.89400000000000002},"min":{"1min":0.61199999999999999,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.7210000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":1.111},{"interface":"front","average":{"1min":1.133,"5min":0.94199999999999995,"15min":0.92200000000000004},"min":{"1min":0.79200000000000004,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":3.5600000000000001,"5min":3.5600000000000001,"15min":3.5600000000000001},"last":1}]},{"osd":9,"last update":"Thu Oct 19 12:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.84899999999999998,"15min":0.85999999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":1.016},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.98399999999999999,"15min":1},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.1459999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":1.048}]},{"osd":10,"last update":"Thu Oct 19 12:42:15 2023","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":1.139},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.97699999999999998,"15min":0.97499999999999998},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.8640000000000001,"5min":1.8640000000000001,"15min":1.8640000000000001},"last":1.032}]},{"osd":11,"last update":"Thu Oct 19 12:42:23 2023","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.8999999999999999,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":1.0680000000000001},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.93300000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574921,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28088,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717064,"statfs":{"total":95995035648,"available":95966273536,"internally_reserved":0,"allocated":1089536,"data_stored":551675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 19 12:41:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.64000000000000001,"15min":0.59099999999999997},"min":{"1min":0.38600000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.751,"5min":8.4559999999999995,"15min":8.4559999999999995},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.58799999999999997,"15min":0.56699999999999995},"min":{"1min":0.41399999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.82099999999999995,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.77800000000000002}]},{"osd":2,"last update":"Thu Oct 19 12:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.56699999999999995,"15min":0.60099999999999998},"min":{"1min":0.46800000000000003,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.81299999999999994,"5min":4.1710000000000003,"15min":4.1710000000000003},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.56499999999999995,"15min":0.51700000000000002},"min":{"1min":0.54200000000000004,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.86199999999999999,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.56899999999999995}]},{"osd":3,"last update":"Thu Oct 19 12:41:37 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60499999999999998,"15min":0.58899999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.83699999999999997,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.56599999999999995,"15min":0.55800000000000005},"min":{"1min":0.434,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.53300000000000003}]},{"osd":4,"last update":"Thu Oct 19 12:42:05 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.42799999999999999,"15min":0.40300000000000002},"min":{"1min":0.317,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.85599999999999998,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.495,"5min":0.438,"15min":0.40699999999999997},"min":{"1min":0.28399999999999997,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.90200000000000002,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.45600000000000002}]},{"osd":5,"last update":"Thu Oct 19 12:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.54800000000000004,"15min":0.53800000000000003},"min":{"1min":0.44400000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.61099999999999999,"15min":0.57499999999999996},"min":{"1min":0.57399999999999995,"5min":0.378,"15min":0.378},"max":{"1min":0.95799999999999996,"5min":1.03,"15min":1.03},"last":0.747}]},{"osd":6,"last update":"Thu Oct 19 12:41:49 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.69799999999999995,"15min":0.68999999999999995},"min":{"1min":0.48699999999999999,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0249999999999999,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.85599999999999998,"15min":0.95199999999999996},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.89000000000000001,"5min":8.4039999999999999,"15min":8.4039999999999999},"last":0.60699999999999998}]},{"osd":7,"last update":"Thu Oct 19 12:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.627,"15min":0.61499999999999999},"min":{"1min":0.35599999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.996,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.877,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.66200000000000003}]},{"osd":8,"last update":"Thu Oct 19 12:42:28 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.64400000000000002,"15min":0.628},"min":{"1min":0.51100000000000001,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.93799999999999994,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.623},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.752,"15min":0.73799999999999999},"min":{"1min":0.57999999999999996,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0409999999999999,"5min":1.117,"15min":1.117},"last":0.84599999999999997}]},{"osd":9,"last update":"Thu Oct 19 12:41:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.92200000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.76400000000000001}]},{"osd":10,"last update":"Thu Oct 19 12:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.68600000000000005,"15min":0.67400000000000004},"min":{"1min":0.434,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.76900000000000002,"15min":0.755},"min":{"1min":0.46300000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.871}]},{"osd":11,"last update":"Thu Oct 19 12:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.89400000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738446,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28040,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717112,"statfs":{"total":95995035648,"available":95966322688,"internally_reserved":0,"allocated":1040384,"data_stored":491428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Oct 19 12:41:50 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.61499999999999999,"15min":0.56999999999999995},"min":{"1min":0.45700000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.1830000000000001,"5min":1.405,"15min":1.405},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.61799999999999999,"15min":0.56799999999999995},"min":{"1min":0.495,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.94999999999999996,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.72499999999999998}]},{"osd":2,"last update":"Thu Oct 19 12:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.64800000000000002,"15min":0.61699999999999999},"min":{"1min":0.51700000000000002,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":2.1019999999999999,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.64400000000000002,"15min":0.57999999999999996},"min":{"1min":0.52200000000000002,"5min":0.379,"15min":0.379},"max":{"1min":1.0429999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.79400000000000004}]},{"osd":3,"last update":"Thu Oct 19 12:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.63}]},{"osd":4,"last update":"Thu Oct 19 12:42:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.68000000000000005,"15min":0.64000000000000001},"min":{"1min":0.48199999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.88,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.66300000000000003,"15min":0.63500000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.165,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.77500000000000002}]},{"osd":5,"last update":"Thu Oct 19 12:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.72199999999999998,"15min":0.67800000000000005},"min":{"1min":0.60499999999999998,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":2.8300000000000001,"5min":2.8300000000000001,"15min":2.8300000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.71699999999999997,"15min":0.69699999999999995},"min":{"1min":0.57299999999999995,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":2.145,"5min":2.145,"15min":2.145},"last":0.81200000000000006}]},{"osd":6,"last update":"Thu Oct 19 12:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.68700000000000006,"15min":0.66600000000000004},"min":{"1min":0.45100000000000001,"5min":0.375,"15min":0.375},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.67300000000000004,"15min":0.65500000000000003},"min":{"1min":0.42399999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.0840000000000001,"5min":1.6160000000000001,"15min":1.6160000000000001},"last":0.84599999999999997}]},{"osd":7,"last update":"Thu Oct 19 12:42:24 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":2.2349999999999999,"5min":2.2349999999999999,"15min":2.2349999999999999},"last":0.83799999999999997},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":5.524,"5min":5.524,"15min":5.524},"last":0.87}]},{"osd":8,"last update":"Thu Oct 19 12:42:29 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.89900000000000002,"15min":0.83099999999999996},"min":{"1min":0.61299999999999999,"5min":0.503,"15min":0.503},"max":{"1min":2.7949999999999999,"5min":6.8730000000000002,"15min":6.8730000000000002},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.84599999999999997,"15min":0.83499999999999996},"min":{"1min":0.60099999999999998,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":2.1760000000000002,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":0.85899999999999999}]},{"osd":9,"last update":"Thu Oct 19 12:41:55 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.76700000000000002,"15min":0.75700000000000001},"min":{"1min":0.56499999999999995,"5min":0.499,"15min":0.499},"max":{"1min":1.405,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.85199999999999998,"15min":0.84999999999999998},"min":{"1min":0.54100000000000004,"5min":0.442,"15min":0.442},"max":{"1min":1.1950000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.95899999999999996}]},{"osd":10,"last update":"Thu Oct 19 12:42:14 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":0.98599999999999999,"15min":0.97999999999999998},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":2.875,"5min":2.875,"15min":2.875},"last":0.99099999999999999},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.96199999999999997,"15min":0.96899999999999997},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":2.2639999999999998,"5min":2.2639999999999998,"15min":2.2639999999999998},"last":0.94999999999999996}]},{"osd":11,"last update":"Thu Oct 19 12:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.97599999999999998},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":1.012}]}]},{"osd":2,"up_from":18,"seq":77309411398,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28092,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717060,"statfs":{"total":95995035648,"available":95966269440,"internally_reserved":0,"allocated":1093632,"data_stored":551041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 19 12:42:15 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.57399999999999995,"15min":0.56899999999999995},"min":{"1min":0.36699999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.88400000000000001,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.439},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.61599999999999999,"15min":0.57799999999999996},"min":{"1min":0.40699999999999997,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":6.726,"5min":6.726,"15min":6.726},"last":0.48699999999999999}]},{"osd":1,"last update":"Thu Oct 19 12:42:15 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.58599999999999997,"15min":0.55800000000000005},"min":{"1min":0.315,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.99299999999999999,"5min":1.081,"15min":1.081},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.60199999999999998,"15min":0.56699999999999995},"min":{"1min":0.34499999999999997,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.98199999999999998,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.70099999999999996}]},{"osd":3,"last update":"Thu Oct 19 12:41:38 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59899999999999998,"15min":0.58699999999999997},"min":{"1min":0.40899999999999997,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.82699999999999996,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.58999999999999997,"15min":0.60199999999999998},"min":{"1min":0.437,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.81599999999999995,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.57499999999999996}]},{"osd":4,"last update":"Thu Oct 19 12:42:22 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.76300000000000001}]},{"osd":5,"last update":"Thu Oct 19 12:42:27 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.47999999999999998,"15min":0.44900000000000001},"min":{"1min":0.29999999999999999,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.72699999999999998,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.50800000000000001,"15min":0.47299999999999998},"min":{"1min":0.35499999999999998,"5min":0.25,"15min":0.25},"max":{"1min":0.92900000000000005,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.67800000000000005}]},{"osd":6,"last update":"Thu Oct 19 12:41:46 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.66000000000000003,"15min":0.64100000000000001},"min":{"1min":0.56399999999999995,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.66800000000000004,"15min":0.66000000000000003},"min":{"1min":0.56299999999999994,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.88400000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.63600000000000001}]},{"osd":7,"last update":"Thu Oct 19 12:42:22 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.753},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.81499999999999995}]},{"osd":8,"last update":"Thu Oct 19 12:42:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.65600000000000003,"15min":0.66000000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.94699999999999995,"5min":1.429,"15min":1.429},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.67900000000000005,"15min":0.67000000000000004},"min":{"1min":0.45000000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.002,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.60099999999999998}]},{"osd":9,"last update":"Thu Oct 19 12:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.753,"15min":0.73899999999999999},"min":{"1min":0.628,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.72699999999999998,"15min":0.71599999999999997},"min":{"1min":0.60499999999999998,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.80300000000000005}]},{"osd":10,"last update":"Thu Oct 19 12:42:15 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.72599999999999998,"15min":0.70999999999999996},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.76000000000000001,"15min":0.73499999999999999},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.86099999999999999}]},{"osd":11,"last update":"Thu Oct 19 12:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.79400000000000004}]}]},{"osd":3,"up_from":25,"seq":107374182465,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1028096,"data_stored":489290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 19 12:41:39 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.44900000000000001,"15min":0.433},"min":{"1min":0.318,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.70499999999999996,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.45700000000000002,"15min":0.41499999999999998},"min":{"1min":0.38400000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.65100000000000002,"5min":1.044,"15min":1.044},"last":0.52800000000000002}]},{"osd":1,"last update":"Thu Oct 19 12:41:39 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.66500000000000004,"15min":0.61299999999999999},"min":{"1min":0.48699999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.61199999999999999,"15min":0.56799999999999995},"min":{"1min":0.50900000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.0049999999999999,"5min":1.228,"15min":1.228},"last":0.78600000000000003}]},{"osd":2,"last update":"Thu Oct 19 12:41:39 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.64100000000000001,"15min":0.60699999999999998},"min":{"1min":0.48499999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.91900000000000004,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.67100000000000004,"15min":0.60799999999999998},"min":{"1min":0.64500000000000002,"5min":0.374,"15min":0.374},"max":{"1min":1.004,"5min":1.056,"15min":1.056},"last":0.80300000000000005}]},{"osd":4,"last update":"Thu Oct 19 12:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.70699999999999996,"15min":0.65400000000000003},"min":{"1min":0.57799999999999996,"5min":0.435,"15min":0.435},"max":{"1min":0.92600000000000005,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.72599999999999998,"15min":0.65600000000000003},"min":{"1min":0.64100000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.042,"5min":1.228,"15min":1.228},"last":0.71999999999999997}]},{"osd":5,"last update":"Thu Oct 19 12:42:27 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.79800000000000004,"15min":0.746},"min":{"1min":0.63,"5min":0.501,"15min":0.501},"max":{"1min":1.0680000000000001,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.752,"5min":0.72599999999999998,"15min":0.69499999999999995},"min":{"1min":0.59999999999999998,"5min":0.443,"15min":0.443},"max":{"1min":0.96999999999999997,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.754}]},{"osd":6,"last update":"Thu Oct 19 12:41:43 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.64100000000000001,"15min":0.623},"min":{"1min":0.53500000000000003,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.97599999999999998,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.745,"15min":0.70599999999999996},"min":{"1min":0.51300000000000001,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.157,"5min":1.45,"15min":1.45},"last":0.76400000000000001}]},{"osd":7,"last update":"Thu Oct 19 12:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.71099999999999997,"15min":0.69699999999999995},"min":{"1min":0.55600000000000005,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.0640000000000001,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76400000000000001,"15min":0.73599999999999999},"min":{"1min":0.61799999999999999,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":0.95999999999999996,"5min":1.127,"15min":1.127},"last":0.82199999999999995}]},{"osd":8,"last update":"Thu Oct 19 12:40:26 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.97599999999999998},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.998}]},{"osd":9,"last update":"Thu Oct 19 12:41:56 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.91400000000000003,"15min":0.91000000000000003},"min":{"1min":0.58799999999999997,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.222,"5min":1.478,"15min":1.478},"last":1.0029999999999999},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.79700000000000004,"15min":0.80300000000000005},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.97699999999999998}]},{"osd":10,"last update":"Thu Oct 19 12:42:18 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.88900000000000001,"15min":0.90500000000000003},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.1080000000000001,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.91500000000000004,"15min":0.93300000000000005},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.046,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.877}]},{"osd":11,"last update":"Thu Oct 19 12:42:18 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.89200000000000002}]}]},{"osd":4,"up_from":33,"seq":141733920827,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1024000,"data_stored":493656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 19 12:40:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.51900000000000002,"15min":0.50700000000000001},"min":{"1min":0.38500000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.44},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.54900000000000004,"15min":0.52900000000000003},"min":{"1min":0.47999999999999998,"5min":0.37,"15min":0.37},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":2.1539999999999999}]},{"osd":1,"last update":"Thu Oct 19 12:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.42099999999999999,"15min":0.39200000000000002},"min":{"1min":0.29799999999999999,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":2.3559999999999999,"5min":2.3559999999999999,"15min":2.3559999999999999},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.436,"15min":0.40500000000000003},"min":{"1min":0.311,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":3.129,"5min":3.129,"15min":3.129},"last":0.44800000000000001}]},{"osd":2,"last update":"Thu Oct 19 12:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.63200000000000001,"15min":0.56499999999999995},"min":{"1min":0.41999999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":7.6470000000000002,"5min":7.6470000000000002,"15min":7.6470000000000002},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.60299999999999998,"15min":0.56599999999999995},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.84899999999999998,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.66800000000000004}]},{"osd":3,"last update":"Thu Oct 19 12:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.61099999999999999,"15min":0.57699999999999996},"min":{"1min":0.46100000000000002,"5min":0.376,"15min":0.376},"max":{"1min":3.1019999999999999,"5min":3.1019999999999999,"15min":3.1019999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.66300000000000003,"15min":0.61299999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":7.444,"5min":7.444,"15min":7.444},"last":0.55400000000000005}]},{"osd":5,"last update":"Thu Oct 19 12:42:22 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.65100000000000002,"15min":0.622},"min":{"1min":0.48599999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.93700000000000006,"5min":1.732,"15min":1.732},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.69099999999999995,"15min":0.622},"min":{"1min":0.44400000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.98699999999999999,"5min":6.8390000000000004,"15min":6.8390000000000004},"last":0.76100000000000001}]},{"osd":6,"last update":"Thu Oct 19 12:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.69799999999999995,"15min":0.65000000000000002},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":6.5309999999999997,"5min":6.5309999999999997,"15min":6.5309999999999997},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.69399999999999995,"15min":0.66400000000000003},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":2.2250000000000001,"5min":2.2250000000000001,"15min":2.2250000000000001},"last":0.56499999999999995}]},{"osd":7,"last update":"Thu Oct 19 12:42:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.59799999999999998,"15min":0.57699999999999996},"min":{"1min":0.32300000000000001,"5min":0.308,"15min":0.308},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.58499999999999996,"15min":0.55500000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.61399999999999999}]},{"osd":8,"last update":"Thu Oct 19 12:42:28 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.73199999999999998,"15min":0.69799999999999995},"min":{"1min":0.48699999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.0629999999999999,"5min":2.2719999999999998,"15min":2.2719999999999998},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.72499999999999998,"15min":0.68799999999999994},"min":{"1min":0.54900000000000004,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.117,"5min":2.504,"15min":2.504},"last":0.80000000000000004}]},{"osd":9,"last update":"Thu Oct 19 12:41:55 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.78100000000000003,"15min":0.748},"min":{"1min":0.56100000000000005,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":4.5800000000000001,"5min":4.5800000000000001,"15min":4.5800000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":1.085,"5min":0.86099999999999999,"15min":0.82299999999999995},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":3.8300000000000001,"5min":3.8300000000000001,"15min":3.8300000000000001},"last":0.86299999999999999}]},{"osd":10,"last update":"Thu Oct 19 12:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.80500000000000005,"15min":0.80000000000000004},"min":{"1min":0.42599999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.538,"5min":1.538,"15min":1.538},"last":0.89800000000000002},{"interface":"front","average":{"1min":1.0549999999999999,"5min":0.81499999999999995,"15min":0.77500000000000002},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":6.8780000000000001,"5min":6.8780000000000001,"15min":6.8780000000000001},"last":0.84099999999999997}]},{"osd":11,"last update":"Thu Oct 19 12:42:18 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":3.0350000000000001,"5min":3.0350000000000001,"15min":3.0350000000000001},"last":0.88},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":7.3010000000000002,"5min":7.3010000000000002,"15min":7.3010000000000002},"last":0.746}]}]},{"osd":5,"up_from":38,"seq":163208757303,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28620,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716532,"statfs":{"total":95995035648,"available":95965728768,"internally_reserved":0,"allocated":1642496,"data_stored":1086144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 19 12:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53600000000000003,"15min":0.52600000000000002},"min":{"1min":0.35699999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.496,"5min":0.55000000000000004,"15min":0.53800000000000003},"min":{"1min":0.376,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.63900000000000001,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.56899999999999995}]},{"osd":1,"last update":"Thu Oct 19 12:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.56000000000000005,"15min":0.53200000000000003},"min":{"1min":0.50800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.56699999999999995,"15min":0.54700000000000004},"min":{"1min":0.45100000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.71199999999999997}]},{"osd":2,"last update":"Thu Oct 19 12:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.41599999999999998,"15min":0.39000000000000001},"min":{"1min":0.35999999999999999,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.45400000000000001,"15min":0.434},"min":{"1min":0.32600000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.60899999999999999}]},{"osd":3,"last update":"Thu Oct 19 12:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.59099999999999997,"15min":0.57899999999999996},"min":{"1min":0.40899999999999997,"5min":0.317,"15min":0.317},"max":{"1min":0.77600000000000002,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.624,"15min":0.61499999999999999},"min":{"1min":0.49199999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.72999999999999998}]},{"osd":4,"last update":"Thu Oct 19 12:42:21 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.60899999999999999,"15min":0.57899999999999996},"min":{"1min":0.55300000000000005,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.85799999999999998,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.874},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.59399999999999997,"15min":0.57199999999999995},"min":{"1min":0.55900000000000005,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.80300000000000005}]},{"osd":6,"last update":"Thu Oct 19 12:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.66600000000000004,"15min":0.66800000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.91400000000000003,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.753},{"interface":"front","average":{"1min":0.62,"5min":0.66800000000000004,"15min":0.67400000000000004},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.82499999999999996,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.85599999999999998}]},{"osd":7,"last update":"Thu Oct 19 12:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.66800000000000004,"15min":0.66600000000000004},"min":{"1min":0.50600000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.90900000000000003,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.68100000000000005,"15min":0.66600000000000004},"min":{"1min":0.54200000000000004,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.034,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.89500000000000002}]},{"osd":8,"last update":"Thu Oct 19 12:42:28 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.63400000000000001,"15min":0.626},"min":{"1min":0.44900000000000001,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.89400000000000002,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.68700000000000006,"15min":0.68100000000000005},"min":{"1min":0.436,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.0129999999999999,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.91300000000000003}]},{"osd":9,"last update":"Thu Oct 19 12:41:52 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.75900000000000001,"15min":0.76100000000000001},"min":{"1min":0.54900000000000004,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.91400000000000003,"5min":1.292,"15min":1.292},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.75900000000000001,"15min":0.76300000000000001},"min":{"1min":0.59099999999999997,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.92500000000000004,"5min":1.115,"15min":1.115},"last":0.83999999999999997}]},{"osd":10,"last update":"Thu Oct 19 12:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.755,"15min":0.74199999999999999},"min":{"1min":0.59999999999999998,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.73199999999999998,"15min":0.71999999999999997},"min":{"1min":0.65600000000000003,"5min":0.438,"15min":0.438},"max":{"1min":1.0580000000000001,"5min":1.145,"15min":1.145},"last":0.92700000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":62815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":62181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":62177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-19T12:42:40.980 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2023-10-19T12:42:40.981 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-19T12:42:40.981 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2023-10-19T12:42:40.981 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph health --format=json 2023-10-19T12:42:41.731 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-19T12:42:41.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:41 smithi046 ceph-mon[98509]: from='client.25142 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-19T12:42:41.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:41 smithi046 ceph-mon[98509]: pgmap v327: 129 pgs: 129 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s; 100 B/s, 0 keys/s, 1 objects/s recovering 2023-10-19T12:42:42.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:41 smithi157 ceph-mon[134109]: from='client.25142 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-19T12:42:42.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:41 smithi157 ceph-mon[134109]: pgmap v327: 129 pgs: 129 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s; 100 B/s, 0 keys/s, 1 objects/s recovering 2023-10-19T12:42:42.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:41 smithi195 ceph-mon[134493]: from='client.25142 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-19T12:42:42.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:41 smithi195 ceph-mon[134493]: pgmap v327: 129 pgs: 129 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s; 100 B/s, 0 keys/s, 1 objects/s recovering 2023-10-19T12:42:43.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:43.255+0000 7effc2798700 1 -- 172.21.15.46:0/635629607 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7effbc1057c0 msgr2=0x7effbc105ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:43.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:43.255+0000 7effc2798700 1 --2- 172.21.15.46:0/635629607 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7effbc1057c0 0x7effbc105ba0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7effac009990 tx=0x7effac009ca0 comp rx=0 tx=0).stop 2023-10-19T12:42:43.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:43.255+0000 7effc2798700 1 -- 172.21.15.46:0/635629607 shutdown_connections 2023-10-19T12:42:43.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:43.255+0000 7effc2798700 1 --2- 172.21.15.46:0/635629607 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7effbc101260 0x7effbc10d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:43.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:43.255+0000 7effc2798700 1 --2- 172.21.15.46:0/635629607 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7effbc1057c0 0x7effbc105ba0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:43.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:43.255+0000 7effc2798700 1 --2- 172.21.15.46:0/635629607 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7effbc1008a0 0x7effbc100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:43.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:43.255+0000 7effc2798700 1 -- 172.21.15.46:0/635629607 >> 172.21.15.46:0/635629607 conn(0x7effbc0779e0 msgr2=0x7effbc077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:43.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:43.255+0000 7effc2798700 1 -- 172.21.15.46:0/635629607 shutdown_connections 2023-10-19T12:42:43.262 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:43.255+0000 7effc2798700 1 -- 172.21.15.46:0/635629607 wait complete. 2023-10-19T12:42:43.262 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:43.256+0000 7effc2798700 1 Processor -- start 2023-10-19T12:42:43.262 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:43.257+0000 7effc2798700 1 -- start start 2023-10-19T12:42:43.264 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:43.257+0000 7effc2798700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7effbc1008a0 0x7effbc072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:43.264 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:43.257+0000 7effc2798700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7effbc101260 0x7effbc073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:43.264 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:43.257+0000 7effc2798700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7effbc1057c0 0x7effbc073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:43.264 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:43.257+0000 7effc2798700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effbc1a4fc0 con 0x7effbc1057c0 2023-10-19T12:42:43.264 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:43.257+0000 7effc2798700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effbc1a5130 con 0x7effbc101260 2023-10-19T12:42:43.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:43.257+0000 7effc2798700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effbc1a52f0 con 0x7effbc1008a0 2023-10-19T12:42:43.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:43.257+0000 7effc0d35700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7effbc1057c0 0x7effbc073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:43.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:43.257+0000 7effbb7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7effbc101260 0x7effbc073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:43.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:43.257+0000 7effbbfff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7effbc1008a0 0x7effbc072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:43.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:43.257+0000 7effc0d35700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7effbc1057c0 0x7effbc073570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38708/0 (socket says 172.21.15.46:38708) 2023-10-19T12:42:43.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:43.257+0000 7effc0d35700 1 -- 172.21.15.46:0/1465182574 learned_addr learned my addr 172.21.15.46:0/1465182574 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:42:43.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:43.258+0000 7effbb7fe700 1 -- 172.21.15.46:0/1465182574 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7effbc1008a0 msgr2=0x7effbc072af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:43.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:43.258+0000 7effbb7fe700 1 --2- 172.21.15.46:0/1465182574 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7effbc1008a0 0x7effbc072af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:43.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:43.258+0000 7effbb7fe700 1 -- 172.21.15.46:0/1465182574 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7effbc1057c0 msgr2=0x7effbc073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:43.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:43.258+0000 7effbb7fe700 1 --2- 172.21.15.46:0/1465182574 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7effbc1057c0 0x7effbc073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:43.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:43.258+0000 7effbb7fe700 1 -- 172.21.15.46:0/1465182574 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effac0095f0 con 0x7effbc101260 2023-10-19T12:42:43.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:43.258+0000 7effc0d35700 1 --2- 172.21.15.46:0/1465182574 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7effbc1057c0 0x7effbc073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:42:43.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:43.258+0000 7effbb7fe700 1 --2- 172.21.15.46:0/1465182574 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7effbc101260 0x7effbc073030 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7effb000e9f0 tx=0x7effb000ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:43.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:43.258+0000 7effb97fa700 1 -- 172.21.15.46:0/1465182574 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb000c9c0 con 0x7effbc101260 2023-10-19T12:42:43.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:43.258+0000 7effc2798700 1 -- 172.21.15.46:0/1465182574 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effbc1a55d0 con 0x7effbc101260 2023-10-19T12:42:43.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:43.258+0000 7effb97fa700 1 -- 172.21.15.46:0/1465182574 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7effb0010430 con 0x7effbc101260 2023-10-19T12:42:43.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:43.258+0000 7effb97fa700 1 -- 172.21.15.46:0/1465182574 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb0018680 con 0x7effbc101260 2023-10-19T12:42:43.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:43.259+0000 7effc2798700 1 -- 172.21.15.46:0/1465182574 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effbc1a5b20 con 0x7effbc101260 2023-10-19T12:42:43.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:43.260+0000 7effc2798700 1 -- 172.21.15.46:0/1465182574 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effbc108d80 con 0x7effbc101260 2023-10-19T12:42:43.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:43.262+0000 7effb97fa700 1 -- 172.21.15.46:0/1465182574 <== mon.2 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7effb0010860 con 0x7effbc101260 2023-10-19T12:42:43.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:43.263+0000 7effb97fa700 1 --2- 172.21.15.46:0/1465182574 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7effa40a1590 0x7effa40a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:43.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:43.263+0000 7effb97fa700 1 -- 172.21.15.46:0/1465182574 <== mon.2 v2:172.21.15.157:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9020+0+0 (secure 0 0 0) 0x7effb0014070 con 0x7effbc101260 2023-10-19T12:42:43.270 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:43.263+0000 7effbbfff700 1 --2- 172.21.15.46:0/1465182574 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7effa40a1590 0x7effa40a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:43.270 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:43.264+0000 7effbbfff700 1 --2- 172.21.15.46:0/1465182574 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7effa40a1590 0x7effa40a3a50 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7effac00b2e0 tx=0x7effac005960 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:43.270 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:43.265+0000 7effb97fa700 1 -- 172.21.15.46:0/1465182574 <== mon.2 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7effb0096420 con 0x7effbc101260 2023-10-19T12:42:43.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:43.527+0000 7effc2798700 1 -- 172.21.15.46:0/1465182574 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7effbc101f30 con 0x7effbc101260 2023-10-19T12:42:43.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:43.527+0000 7effb97fa700 1 -- 172.21.15.46:0/1465182574 <== mon.2 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7effb0099a40 con 0x7effbc101260 2023-10-19T12:42:43.531 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:42:43.531 INFO:teuthology.orchestra.run.smithi046.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-19T12:42:43.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:43.530+0000 7effc2798700 1 -- 172.21.15.46:0/1465182574 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7effa40a1590 msgr2=0x7effa40a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:43.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:43.530+0000 7effc2798700 1 --2- 172.21.15.46:0/1465182574 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7effa40a1590 0x7effa40a3a50 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7effac00b2e0 tx=0x7effac005960 comp rx=0 tx=0).stop 2023-10-19T12:42:43.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:43.530+0000 7effc2798700 1 -- 172.21.15.46:0/1465182574 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7effbc101260 msgr2=0x7effbc073030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:43.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:43.530+0000 7effc2798700 1 --2- 172.21.15.46:0/1465182574 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7effbc101260 0x7effbc073030 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7effb000e9f0 tx=0x7effb000ed00 comp rx=0 tx=0).stop 2023-10-19T12:42:43.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:43.530+0000 7effc2798700 1 -- 172.21.15.46:0/1465182574 shutdown_connections 2023-10-19T12:42:43.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:43.530+0000 7effc2798700 1 --2- 172.21.15.46:0/1465182574 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7effbc1057c0 0x7effbc073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:43.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:43.530+0000 7effc2798700 1 --2- 172.21.15.46:0/1465182574 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7effa40a1590 0x7effa40a3a50 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:43.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:43.530+0000 7effc2798700 1 --2- 172.21.15.46:0/1465182574 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7effbc1008a0 0x7effbc072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:43.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:43.530+0000 7effc2798700 1 --2- 172.21.15.46:0/1465182574 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7effbc101260 0x7effbc073030 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:43.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:43.530+0000 7effc2798700 1 -- 172.21.15.46:0/1465182574 >> 172.21.15.46:0/1465182574 conn(0x7effbc0779e0 msgr2=0x7effbc0fe990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:43.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:43.530+0000 7effc2798700 1 -- 172.21.15.46:0/1465182574 shutdown_connections 2023-10-19T12:42:43.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:43.530+0000 7effc2798700 1 -- 172.21.15.46:0/1465182574 wait complete. 2023-10-19T12:42:43.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:43 smithi046 ceph-mon[98509]: pgmap v328: 129 pgs: 129 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s; 100 B/s, 0 objects/s recovering 2023-10-19T12:42:43.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:43 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/1465182574' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-10-19T12:42:44.033 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2023-10-19T12:42:44.034 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-19T12:42:44.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:43 smithi157 ceph-mon[134109]: pgmap v328: 129 pgs: 129 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s; 100 B/s, 0 objects/s recovering 2023-10-19T12:42:44.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:43 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/1465182574' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-10-19T12:42:44.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:43 smithi195 ceph-mon[134493]: pgmap v328: 129 pgs: 129 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s; 100 B/s, 0 objects/s recovering 2023-10-19T12:42:44.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:43 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/1465182574' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-10-19T12:42:44.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.242+0000 7f5c021ff700 1 -- 172.21.15.46:0/1696047807 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5bfc0731f0 msgr2=0x7f5bfc073670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:44.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.242+0000 7f5c021ff700 1 --2- 172.21.15.46:0/1696047807 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5bfc0731f0 0x7f5bfc073670 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f5bf0009990 tx=0x7f5bf0009ca0 comp rx=0 tx=0).stop 2023-10-19T12:42:44.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.242+0000 7f5c021ff700 1 -- 172.21.15.46:0/1696047807 shutdown_connections 2023-10-19T12:42:44.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.242+0000 7f5c021ff700 1 --2- 172.21.15.46:0/1696047807 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5bfc108610 0x7f5bfc10aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:44.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.242+0000 7f5c021ff700 1 --2- 172.21.15.46:0/1696047807 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5bfc0747d0 0x7f5bfc072c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:44.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.242+0000 7f5c021ff700 1 --2- 172.21.15.46:0/1696047807 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5bfc0731f0 0x7f5bfc073670 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:44.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.242+0000 7f5c021ff700 1 -- 172.21.15.46:0/1696047807 >> 172.21.15.46:0/1696047807 conn(0x7f5bfc0fbc90 msgr2=0x7f5bfc0fe0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:44.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.242+0000 7f5c021ff700 1 -- 172.21.15.46:0/1696047807 shutdown_connections 2023-10-19T12:42:44.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.242+0000 7f5c021ff700 1 -- 172.21.15.46:0/1696047807 wait complete. 2023-10-19T12:42:44.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.243+0000 7f5c021ff700 1 Processor -- start 2023-10-19T12:42:44.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.243+0000 7f5c021ff700 1 -- start start 2023-10-19T12:42:44.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.243+0000 7f5c021ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5bfc0731f0 0x7f5bfc198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:44.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.243+0000 7f5c021ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5bfc0747d0 0x7f5bfc198ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:44.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.243+0000 7f5c021ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5bfc108610 0x7f5bfc19fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:44.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.243+0000 7f5c021ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bfc1a0440 con 0x7f5bfc0747d0 2023-10-19T12:42:44.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.243+0000 7f5c021ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bfc1a0580 con 0x7f5bfc0731f0 2023-10-19T12:42:44.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.243+0000 7f5c021ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bfc1a0710 con 0x7f5bfc108610 2023-10-19T12:42:44.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.244+0000 7f5bfaffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5bfc0747d0 0x7f5bfc198ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:44.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.244+0000 7f5bfaffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5bfc0747d0 0x7f5bfc198ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38728/0 (socket says 172.21.15.46:38728) 2023-10-19T12:42:44.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.244+0000 7f5bfaffd700 1 -- 172.21.15.46:0/2336333405 learned_addr learned my addr 172.21.15.46:0/2336333405 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:42:44.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.244+0000 7f5bfb7fe700 1 --2- 172.21.15.46:0/2336333405 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5bfc0731f0 0x7f5bfc198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:44.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.244+0000 7f5bfbfff700 1 --2- 172.21.15.46:0/2336333405 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5bfc108610 0x7f5bfc19fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:44.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.244+0000 7f5bfaffd700 1 -- 172.21.15.46:0/2336333405 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5bfc108610 msgr2=0x7f5bfc19fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:44.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.244+0000 7f5bfaffd700 1 --2- 172.21.15.46:0/2336333405 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5bfc108610 0x7f5bfc19fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:44.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.244+0000 7f5bfaffd700 1 -- 172.21.15.46:0/2336333405 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5bfc0731f0 msgr2=0x7f5bfc198960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:44.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.244+0000 7f5bfaffd700 1 --2- 172.21.15.46:0/2336333405 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5bfc0731f0 0x7f5bfc198960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:44.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.244+0000 7f5bfaffd700 1 -- 172.21.15.46:0/2336333405 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bf00095f0 con 0x7f5bfc0747d0 2023-10-19T12:42:44.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.245+0000 7f5bfaffd700 1 --2- 172.21.15.46:0/2336333405 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5bfc0747d0 0x7f5bfc198ea0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f5bf000b680 tx=0x7f5bf0009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:44.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.245+0000 7f5bf8ff9700 1 -- 172.21.15.46:0/2336333405 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf001d070 con 0x7f5bfc0747d0 2023-10-19T12:42:44.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.245+0000 7f5bf8ff9700 1 -- 172.21.15.46:0/2336333405 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5bf0022470 con 0x7f5bfc0747d0 2023-10-19T12:42:44.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.245+0000 7f5c021ff700 1 -- 172.21.15.46:0/2336333405 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bfc1a0990 con 0x7f5bfc0747d0 2023-10-19T12:42:44.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.245+0000 7f5bf8ff9700 1 -- 172.21.15.46:0/2336333405 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf0017650 con 0x7f5bfc0747d0 2023-10-19T12:42:44.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.245+0000 7f5c021ff700 1 -- 172.21.15.46:0/2336333405 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bfc1a0e10 con 0x7f5bfc0747d0 2023-10-19T12:42:44.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.246+0000 7f5c021ff700 1 -- 172.21.15.46:0/2336333405 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bfc107420 con 0x7f5bfc0747d0 2023-10-19T12:42:44.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.248+0000 7f5bf8ff9700 1 -- 172.21.15.46:0/2336333405 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f5bf00225e0 con 0x7f5bfc0747d0 2023-10-19T12:42:44.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.250+0000 7f5bf8ff9700 1 --2- 172.21.15.46:0/2336333405 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f5be40a1590 0x7f5be40a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:44.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.250+0000 7f5bf8ff9700 1 -- 172.21.15.46:0/2336333405 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f5bf00ce440 con 0x7f5bfc0747d0 2023-10-19T12:42:44.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.250+0000 7f5bfb7fe700 1 --2- 172.21.15.46:0/2336333405 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f5be40a1590 0x7f5be40a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:44.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.251+0000 7f5bfb7fe700 1 --2- 172.21.15.46:0/2336333405 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f5be40a1590 0x7f5be40a3a50 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f5bec009c60 tx=0x7f5bec009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:44.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.254+0000 7f5bf8ff9700 1 -- 172.21.15.46:0/2336333405 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5bf0097660 con 0x7f5bfc0747d0 2023-10-19T12:42:44.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.467+0000 7f5c021ff700 1 -- 172.21.15.46:0/2336333405 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5bfc10e180 con 0x7f5bfc0747d0 2023-10-19T12:42:44.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.469+0000 7f5bf8ff9700 1 -- 172.21.15.46:0/2336333405 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+24481 (secure 0 0 0) 0x7f5bf009ac80 con 0x7f5bfc0747d0 2023-10-19T12:42:44.472 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:42:44.472 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":90,"fsid":"96a8be3c-6e7b-11ee-8db6-212e2dc638e7","created":"2023-10-19T12:33:26.148713+0000","modified":"2023-10-19T12:42:28.113339+0000","last_up_change":"2023-10-19T12:40:30.761679+0000","last_in_change":"2023-10-19T12:40:13.663559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-19T12:37:07.175795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-19T12:41:16.895203+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-19T12:41:18.255601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-19T12:41:21.830455+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"346ce86b-a10a-4869-9fdb-c3c1d4161455","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6803","nonce":500237995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6805","nonce":500237995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6809","nonce":500237995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6807","nonce":500237995}]},"public_addr":"172.21.15.46:6803/500237995","cluster_addr":"172.21.15.46:6805/500237995","heartbeat_back_addr":"172.21.15.46:6809/500237995","heartbeat_front_addr":"172.21.15.46:6807/500237995","state":["exists","up"]},{"osd":1,"uuid":"02aae687-76c5-4124-bae4-9787ed571c28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6801","nonce":2496862790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6803","nonce":2496862790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6807","nonce":2496862790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6805","nonce":2496862790}]},"public_addr":"172.21.15.157:6801/2496862790","cluster_addr":"172.21.15.157:6803/2496862790","heartbeat_back_addr":"172.21.15.157:6807/2496862790","heartbeat_front_addr":"172.21.15.157:6805/2496862790","state":["exists","up"]},{"osd":2,"uuid":"d5360828-1f58-4380-b2ad-0c21ff850981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6801","nonce":4211767276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6803","nonce":4211767276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6807","nonce":4211767276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6805","nonce":4211767276}]},"public_addr":"172.21.15.195:6801/4211767276","cluster_addr":"172.21.15.195:6803/4211767276","heartbeat_back_addr":"172.21.15.195:6807/4211767276","heartbeat_front_addr":"172.21.15.195:6805/4211767276","state":["exists","up"]},{"osd":3,"uuid":"accb780f-49d0-43f8-b166-ee12c558ef00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6811","nonce":1964113352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6813","nonce":1964113352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6817","nonce":1964113352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6815","nonce":1964113352}]},"public_addr":"172.21.15.46:6811/1964113352","cluster_addr":"172.21.15.46:6813/1964113352","heartbeat_back_addr":"172.21.15.46:6817/1964113352","heartbeat_front_addr":"172.21.15.46:6815/1964113352","state":["exists","up"]},{"osd":4,"uuid":"e662886d-e989-4d02-8c1f-3c4671352b0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6809","nonce":3636910144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6811","nonce":3636910144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6815","nonce":3636910144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6813","nonce":3636910144}]},"public_addr":"172.21.15.157:6809/3636910144","cluster_addr":"172.21.15.157:6811/3636910144","heartbeat_back_addr":"172.21.15.157:6815/3636910144","heartbeat_front_addr":"172.21.15.157:6813/3636910144","state":["exists","up"]},{"osd":5,"uuid":"9597e0ce-14ea-407d-90fe-f74bccee38b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6809","nonce":4071287969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6811","nonce":4071287969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6815","nonce":4071287969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6813","nonce":4071287969}]},"public_addr":"172.21.15.195:6809/4071287969","cluster_addr":"172.21.15.195:6811/4071287969","heartbeat_back_addr":"172.21.15.195:6815/4071287969","heartbeat_front_addr":"172.21.15.195:6813/4071287969","state":["exists","up"]},{"osd":6,"uuid":"6b78ba38-f60e-4cb6-b01c-cecc1820e8e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6819","nonce":1842285555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6821","nonce":1842285555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6825","nonce":1842285555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6823","nonce":1842285555}]},"public_addr":"172.21.15.46:6819/1842285555","cluster_addr":"172.21.15.46:6821/1842285555","heartbeat_back_addr":"172.21.15.46:6825/1842285555","heartbeat_front_addr":"172.21.15.46:6823/1842285555","state":["exists","up"]},{"osd":7,"uuid":"59a0899f-3bcd-4db2-b544-24df3a536749","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6817","nonce":3498672588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6819","nonce":3498672588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6823","nonce":3498672588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6821","nonce":3498672588}]},"public_addr":"172.21.15.157:6817/3498672588","cluster_addr":"172.21.15.157:6819/3498672588","heartbeat_back_addr":"172.21.15.157:6823/3498672588","heartbeat_front_addr":"172.21.15.157:6821/3498672588","state":["exists","up"]},{"osd":8,"uuid":"9c3c9835-043a-4fb5-a9ee-edf8caf6b605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6817","nonce":74230104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6819","nonce":74230104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6823","nonce":74230104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6821","nonce":74230104}]},"public_addr":"172.21.15.195:6817/74230104","cluster_addr":"172.21.15.195:6819/74230104","heartbeat_back_addr":"172.21.15.195:6823/74230104","heartbeat_front_addr":"172.21.15.195:6821/74230104","state":["exists","up"]},{"osd":9,"uuid":"3f18f506-a577-4b7c-ae0d-9351c07e81f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6827","nonce":3472581046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6829","nonce":3472581046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6833","nonce":3472581046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6831","nonce":3472581046}]},"public_addr":"172.21.15.46:6827/3472581046","cluster_addr":"172.21.15.46:6829/3472581046","heartbeat_back_addr":"172.21.15.46:6833/3472581046","heartbeat_front_addr":"172.21.15.46:6831/3472581046","state":["exists","up"]},{"osd":10,"uuid":"1ed01854-443a-4acf-9293-7ca0d451a93d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6825","nonce":2378416559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6827","nonce":2378416559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6831","nonce":2378416559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6829","nonce":2378416559}]},"public_addr":"172.21.15.157:6825/2378416559","cluster_addr":"172.21.15.157:6827/2378416559","heartbeat_back_addr":"172.21.15.157:6831/2378416559","heartbeat_front_addr":"172.21.15.157:6829/2378416559","state":["exists","up"]},{"osd":11,"uuid":"021398c0-9184-4647-8220-e40f6705ca90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6825","nonce":3075632222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6827","nonce":3075632222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6831","nonce":3075632222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6829","nonce":3075632222}]},"public_addr":"172.21.15.195:6825/3075632222","cluster_addr":"172.21.15.195:6827/3075632222","heartbeat_back_addr":"172.21.15.195:6831/3075632222","heartbeat_front_addr":"172.21.15.195:6829/3075632222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:36:22.002614+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:36:44.098031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:37:04.518341+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:37:30.796462+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:37:52.756555+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:38:13.403168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:38:39.058472+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:39:01.106893+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:39:21.908334+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:39:46.843884+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:40:08.792020+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:40:29.282974+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":3,"to":6}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.39","mappings":[{"from":5,"to":8}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.46:0/3248595150":"2023-10-20T12:34:26.552115+0000","172.21.15.46:0/3624849341":"2023-10-20T12:34:26.552115+0000","172.21.15.46:0/1844094590":"2023-10-20T12:34:26.552115+0000","172.21.15.46:6801/20022894":"2023-10-20T12:34:26.552115+0000","172.21.15.46:0/3969790632":"2023-10-20T12:34:00.135248+0000","172.21.15.46:0/2331135821":"2023-10-20T12:34:00.135248+0000","172.21.15.46:6800/51664346":"2023-10-20T12:34:00.135248+0000","172.21.15.46:6801/51664346":"2023-10-20T12:34:00.135248+0000","172.21.15.46:0/585851467":"2023-10-20T12:34:00.135248+0000","172.21.15.46:6800/20022894":"2023-10-20T12:34:26.552115+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-19T12:42:44.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.471+0000 7f5c021ff700 1 -- 172.21.15.46:0/2336333405 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f5be40a1590 msgr2=0x7f5be40a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:44.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.471+0000 7f5c021ff700 1 --2- 172.21.15.46:0/2336333405 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f5be40a1590 0x7f5be40a3a50 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f5bec009c60 tx=0x7f5bec009260 comp rx=0 tx=0).stop 2023-10-19T12:42:44.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.471+0000 7f5c021ff700 1 -- 172.21.15.46:0/2336333405 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5bfc0747d0 msgr2=0x7f5bfc198ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:44.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.471+0000 7f5c021ff700 1 --2- 172.21.15.46:0/2336333405 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5bfc0747d0 0x7f5bfc198ea0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f5bf000b680 tx=0x7f5bf0009580 comp rx=0 tx=0).stop 2023-10-19T12:42:44.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.471+0000 7f5c021ff700 1 -- 172.21.15.46:0/2336333405 shutdown_connections 2023-10-19T12:42:44.476 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.471+0000 7f5c021ff700 1 --2- 172.21.15.46:0/2336333405 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f5be40a1590 0x7f5be40a3a50 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:44.476 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.471+0000 7f5c021ff700 1 --2- 172.21.15.46:0/2336333405 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5bfc108610 0x7f5bfc19fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:44.476 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.471+0000 7f5c021ff700 1 --2- 172.21.15.46:0/2336333405 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5bfc0731f0 0x7f5bfc198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:44.476 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.471+0000 7f5c021ff700 1 --2- 172.21.15.46:0/2336333405 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5bfc0747d0 0x7f5bfc198ea0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:44.476 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.471+0000 7f5c021ff700 1 -- 172.21.15.46:0/2336333405 >> 172.21.15.46:0/2336333405 conn(0x7f5bfc0fbc90 msgr2=0x7f5bfc104560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:44.476 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.472+0000 7f5c021ff700 1 -- 172.21.15.46:0/2336333405 shutdown_connections 2023-10-19T12:42:44.477 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.472+0000 7f5c021ff700 1 -- 172.21.15.46:0/2336333405 wait complete. 2023-10-19T12:42:44.494 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-19T12:37:07.175795+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-19T12:41:16.895203+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-19T12:41:18.255601+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-19T12:41:21.830455+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-19T12:42:44.495 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-19T12:42:44.705 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.701+0000 7f3e5cdff700 1 -- 172.21.15.46:0/3684867634 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3e58102330 msgr2=0x7f3e58108be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:44.705 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.701+0000 7f3e5cdff700 1 --2- 172.21.15.46:0/3684867634 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3e58102330 0x7f3e58108be0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3e5000b0a0 tx=0x7f3e5000b3b0 comp rx=0 tx=0).stop 2023-10-19T12:42:44.705 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.701+0000 7f3e5cdff700 1 -- 172.21.15.46:0/3684867634 shutdown_connections 2023-10-19T12:42:44.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.701+0000 7f3e5cdff700 1 --2- 172.21.15.46:0/3684867634 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3e58102330 0x7f3e58108be0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:44.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.701+0000 7f3e5cdff700 1 --2- 172.21.15.46:0/3684867634 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3e581007a0 0x7f3e58100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:44.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.701+0000 7f3e5cdff700 1 --2- 172.21.15.46:0/3684867634 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e58101990 0x7f3e58101df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:44.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.701+0000 7f3e5cdff700 1 -- 172.21.15.46:0/3684867634 >> 172.21.15.46:0/3684867634 conn(0x7f3e580fbcf0 msgr2=0x7f3e580fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:44.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.701+0000 7f3e5cdff700 1 -- 172.21.15.46:0/3684867634 shutdown_connections 2023-10-19T12:42:44.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.701+0000 7f3e5cdff700 1 -- 172.21.15.46:0/3684867634 wait complete. 2023-10-19T12:42:44.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.702+0000 7f3e5cdff700 1 Processor -- start 2023-10-19T12:42:44.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.703+0000 7f3e5cdff700 1 -- start start 2023-10-19T12:42:44.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.703+0000 7f3e5cdff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3e581007a0 0x7f3e58196840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:44.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.703+0000 7f3e5cdff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3e58101990 0x7f3e58196d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:44.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.703+0000 7f3e5cdff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e58102330 0x7f3e5819dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:44.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.703+0000 7f3e5cdff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e5819e370 con 0x7f3e58102330 2023-10-19T12:42:44.710 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.703+0000 7f3e5cdff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e5819e4b0 con 0x7f3e58101990 2023-10-19T12:42:44.710 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.703+0000 7f3e5cdff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e5819e640 con 0x7f3e581007a0 2023-10-19T12:42:44.710 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.703+0000 7f3e5659c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3e581007a0 0x7f3e58196840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:44.710 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.703+0000 7f3e56d9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e58102330 0x7f3e5819dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:44.710 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.703+0000 7f3e55d9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3e58101990 0x7f3e58196d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:44.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.703+0000 7f3e55d9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3e58101990 0x7f3e58196d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:43412/0 (socket says 172.21.15.46:43412) 2023-10-19T12:42:44.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.703+0000 7f3e5659c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3e581007a0 0x7f3e58196840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:41718/0 (socket says 172.21.15.46:41718) 2023-10-19T12:42:44.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.703+0000 7f3e55d9b700 1 -- 172.21.15.46:0/3145263245 learned_addr learned my addr 172.21.15.46:0/3145263245 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:42:44.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.704+0000 7f3e5659c700 1 -- 172.21.15.46:0/3145263245 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3e58101990 msgr2=0x7f3e58196d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:44.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.704+0000 7f3e5659c700 1 --2- 172.21.15.46:0/3145263245 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3e58101990 0x7f3e58196d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:44.712 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.704+0000 7f3e5659c700 1 -- 172.21.15.46:0/3145263245 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e58102330 msgr2=0x7f3e5819dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:44.712 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.704+0000 7f3e5659c700 1 --2- 172.21.15.46:0/3145263245 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e58102330 0x7f3e5819dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:44.712 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.704+0000 7f3e5659c700 1 -- 172.21.15.46:0/3145263245 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e50009d00 con 0x7f3e581007a0 2023-10-19T12:42:44.712 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.704+0000 7f3e56d9d700 1 --2- 172.21.15.46:0/3145263245 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e58102330 0x7f3e5819dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:42:44.712 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.704+0000 7f3e5659c700 1 --2- 172.21.15.46:0/3145263245 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3e581007a0 0x7f3e58196840 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3e4800e9c0 tx=0x7f3e4800ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:44.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.704+0000 7f3e477fe700 1 -- 172.21.15.46:0/3145263245 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e48004220 con 0x7f3e581007a0 2023-10-19T12:42:44.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.704+0000 7f3e5cdff700 1 -- 172.21.15.46:0/3145263245 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e5819e920 con 0x7f3e581007a0 2023-10-19T12:42:44.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.704+0000 7f3e477fe700 1 -- 172.21.15.46:0/3145263245 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3e48004380 con 0x7f3e581007a0 2023-10-19T12:42:44.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.704+0000 7f3e477fe700 1 -- 172.21.15.46:0/3145263245 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e48003be0 con 0x7f3e581007a0 2023-10-19T12:42:44.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.704+0000 7f3e5cdff700 1 -- 172.21.15.46:0/3145263245 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e5819ee30 con 0x7f3e581007a0 2023-10-19T12:42:44.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.705+0000 7f3e5cdff700 1 -- 172.21.15.46:0/3145263245 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e58107c20 con 0x7f3e581007a0 2023-10-19T12:42:44.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.708+0000 7f3e477fe700 1 -- 172.21.15.46:0/3145263245 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f3e48003d40 con 0x7f3e581007a0 2023-10-19T12:42:44.715 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.709+0000 7f3e477fe700 1 --2- 172.21.15.46:0/3145263245 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f3e400a1510 0x7f3e400a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:44.715 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.709+0000 7f3e477fe700 1 -- 172.21.15.46:0/3145263245 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f3e48014070 con 0x7f3e581007a0 2023-10-19T12:42:44.715 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.709+0000 7f3e55d9b700 1 --2- 172.21.15.46:0/3145263245 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f3e400a1510 0x7f3e400a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:44.715 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.710+0000 7f3e55d9b700 1 --2- 172.21.15.46:0/3145263245 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f3e400a1510 0x7f3e400a39d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c009d20 tx=0x7f3e4c009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:44.715 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.711+0000 7f3e477fe700 1 -- 172.21.15.46:0/3145263245 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3e480967b0 con 0x7f3e581007a0 2023-10-19T12:42:44.925 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.922+0000 7f3e5cdff700 1 -- 172.21.15.46:0/3145263245 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3e5810c120 con 0x7f3e581007a0 2023-10-19T12:42:44.926 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.923+0000 7f3e477fe700 1 -- 172.21.15.46:0/3145263245 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v90) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3e48099dd0 con 0x7f3e581007a0 2023-10-19T12:42:44.926 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2023-10-19T12:42:44.928 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.925+0000 7f3e5cdff700 1 -- 172.21.15.46:0/3145263245 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f3e400a1510 msgr2=0x7f3e400a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:44.928 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.925+0000 7f3e5cdff700 1 --2- 172.21.15.46:0/3145263245 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f3e400a1510 0x7f3e400a39d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c009d20 tx=0x7f3e4c009260 comp rx=0 tx=0).stop 2023-10-19T12:42:44.929 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.925+0000 7f3e5cdff700 1 -- 172.21.15.46:0/3145263245 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3e581007a0 msgr2=0x7f3e58196840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:44.929 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.925+0000 7f3e5cdff700 1 --2- 172.21.15.46:0/3145263245 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3e581007a0 0x7f3e58196840 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3e4800e9c0 tx=0x7f3e4800ecd0 comp rx=0 tx=0).stop 2023-10-19T12:42:44.929 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.925+0000 7f3e5cdff700 1 -- 172.21.15.46:0/3145263245 shutdown_connections 2023-10-19T12:42:44.929 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.925+0000 7f3e5cdff700 1 --2- 172.21.15.46:0/3145263245 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e58102330 0x7f3e5819dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:44.929 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.925+0000 7f3e5cdff700 1 --2- 172.21.15.46:0/3145263245 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f3e400a1510 0x7f3e400a39d0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:44.930 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.925+0000 7f3e5cdff700 1 --2- 172.21.15.46:0/3145263245 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3e581007a0 0x7f3e58196840 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:44.930 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.925+0000 7f3e5cdff700 1 --2- 172.21.15.46:0/3145263245 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3e58101990 0x7f3e58196d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:44.930 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.925+0000 7f3e5cdff700 1 -- 172.21.15.46:0/3145263245 >> 172.21.15.46:0/3145263245 conn(0x7f3e580fbcf0 msgr2=0x7f3e58104d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:44.930 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.925+0000 7f3e5cdff700 1 -- 172.21.15.46:0/3145263245 shutdown_connections 2023-10-19T12:42:44.930 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:44.925+0000 7f3e5cdff700 1 -- 172.21.15.46:0/3145263245 wait complete. 2023-10-19T12:42:44.945 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:44 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/2336333405' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-19T12:42:44.947 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-19T12:42:45.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:44 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/2336333405' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-19T12:42:45.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:44 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/2336333405' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-19T12:42:45.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.153+0000 7fb8853ff700 1 -- 172.21.15.46:0/3660824159 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb880101990 msgr2=0x7fb880101df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:45.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.153+0000 7fb8853ff700 1 --2- 172.21.15.46:0/3660824159 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb880101990 0x7fb880101df0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb8680099c0 tx=0x7fb868009cd0 comp rx=0 tx=0).stop 2023-10-19T12:42:45.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.153+0000 7fb8853ff700 1 -- 172.21.15.46:0/3660824159 shutdown_connections 2023-10-19T12:42:45.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.153+0000 7fb8853ff700 1 --2- 172.21.15.46:0/3660824159 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb880102330 0x7fb880108be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:45.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.153+0000 7fb8853ff700 1 --2- 172.21.15.46:0/3660824159 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb8801007a0 0x7fb880100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:45.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.153+0000 7fb8853ff700 1 --2- 172.21.15.46:0/3660824159 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb880101990 0x7fb880101df0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:45.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.153+0000 7fb8853ff700 1 -- 172.21.15.46:0/3660824159 >> 172.21.15.46:0/3660824159 conn(0x7fb8800fbcf0 msgr2=0x7fb8800fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:45.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.153+0000 7fb8853ff700 1 -- 172.21.15.46:0/3660824159 shutdown_connections 2023-10-19T12:42:45.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.153+0000 7fb8853ff700 1 -- 172.21.15.46:0/3660824159 wait complete. 2023-10-19T12:42:45.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.154+0000 7fb8853ff700 1 Processor -- start 2023-10-19T12:42:45.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.154+0000 7fb8853ff700 1 -- start start 2023-10-19T12:42:45.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.155+0000 7fb8853ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb8801007a0 0x7fb880196700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:45.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.155+0000 7fb8853ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb880101990 0x7fb880196c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:45.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.155+0000 7fb8853ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb880102330 0x7fb88019dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:45.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.155+0000 7fb8853ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb88019e230 con 0x7fb880101990 2023-10-19T12:42:45.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.155+0000 7fb8853ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb88019e370 con 0x7fb880102330 2023-10-19T12:42:45.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.155+0000 7fb8853ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb88019e500 con 0x7fb8801007a0 2023-10-19T12:42:45.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.155+0000 7fb877fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb880101990 0x7fb880196c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:45.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.155+0000 7fb877fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb880101990 0x7fb880196c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38766/0 (socket says 172.21.15.46:38766) 2023-10-19T12:42:45.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.155+0000 7fb877fff700 1 -- 172.21.15.46:0/1394459719 learned_addr learned my addr 172.21.15.46:0/1394459719 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:42:45.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.155+0000 7fb87f7fe700 1 --2- 172.21.15.46:0/1394459719 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb880102330 0x7fb88019dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:45.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.155+0000 7fb87effd700 1 --2- 172.21.15.46:0/1394459719 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb8801007a0 0x7fb880196700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:45.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.155+0000 7fb877fff700 1 -- 172.21.15.46:0/1394459719 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb8801007a0 msgr2=0x7fb880196700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:45.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.155+0000 7fb877fff700 1 --2- 172.21.15.46:0/1394459719 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb8801007a0 0x7fb880196700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:45.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.155+0000 7fb877fff700 1 -- 172.21.15.46:0/1394459719 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb880102330 msgr2=0x7fb88019dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:45.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.155+0000 7fb877fff700 1 --2- 172.21.15.46:0/1394459719 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb880102330 0x7fb88019dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:45.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.155+0000 7fb877fff700 1 -- 172.21.15.46:0/1394459719 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb870009520 con 0x7fb880101990 2023-10-19T12:42:45.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.156+0000 7fb877fff700 1 --2- 172.21.15.46:0/1394459719 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb880101990 0x7fb880196c40 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fb868003730 tx=0x7fb86800f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:45.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.156+0000 7fb87cff9700 1 -- 172.21.15.46:0/1394459719 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86801d070 con 0x7fb880101990 2023-10-19T12:42:45.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.156+0000 7fb8853ff700 1 -- 172.21.15.46:0/1394459719 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8680095f0 con 0x7fb880101990 2023-10-19T12:42:45.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.156+0000 7fb87cff9700 1 -- 172.21.15.46:0/1394459719 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb868005050 con 0x7fb880101990 2023-10-19T12:42:45.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.156+0000 7fb87cff9700 1 -- 172.21.15.46:0/1394459719 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb868004b10 con 0x7fb880101990 2023-10-19T12:42:45.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.156+0000 7fb8853ff700 1 -- 172.21.15.46:0/1394459719 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb88019ea70 con 0x7fb880101990 2023-10-19T12:42:45.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.157+0000 7fb8853ff700 1 -- 172.21.15.46:0/1394459719 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb880107c40 con 0x7fb880101990 2023-10-19T12:42:45.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.159+0000 7fb87cff9700 1 -- 172.21.15.46:0/1394459719 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7fb8680051c0 con 0x7fb880101990 2023-10-19T12:42:45.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.161+0000 7fb87cff9700 1 --2- 172.21.15.46:0/1394459719 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fb86c0a1510 0x7fb86c0a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:45.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.162+0000 7fb87cff9700 1 -- 172.21.15.46:0/1394459719 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fb8680ce2e0 con 0x7fb880101990 2023-10-19T12:42:45.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.162+0000 7fb87effd700 1 --2- 172.21.15.46:0/1394459719 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fb86c0a1510 0x7fb86c0a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:45.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.162+0000 7fb87effd700 1 --2- 172.21.15.46:0/1394459719 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fb86c0a1510 0x7fb86c0a39d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb8801017f0 tx=0x7fb870009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:45.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.164+0000 7fb87cff9700 1 -- 172.21.15.46:0/1394459719 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb868097500 con 0x7fb880101990 2023-10-19T12:42:45.378 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.375+0000 7fb8853ff700 1 -- 172.21.15.46:0/1394459719 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb8800675a0 con 0x7fb880101990 2023-10-19T12:42:45.379 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.376+0000 7fb87cff9700 1 -- 172.21.15.46:0/1394459719 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v90) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb86809ab20 con 0x7fb880101990 2023-10-19T12:42:45.379 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2023-10-19T12:42:45.382 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.378+0000 7fb8853ff700 1 -- 172.21.15.46:0/1394459719 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fb86c0a1510 msgr2=0x7fb86c0a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:45.382 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.378+0000 7fb8853ff700 1 --2- 172.21.15.46:0/1394459719 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fb86c0a1510 0x7fb86c0a39d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb8801017f0 tx=0x7fb870009260 comp rx=0 tx=0).stop 2023-10-19T12:42:45.382 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.378+0000 7fb8853ff700 1 -- 172.21.15.46:0/1394459719 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb880101990 msgr2=0x7fb880196c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:45.382 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.378+0000 7fb8853ff700 1 --2- 172.21.15.46:0/1394459719 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb880101990 0x7fb880196c40 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fb868003730 tx=0x7fb86800f690 comp rx=0 tx=0).stop 2023-10-19T12:42:45.382 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.378+0000 7fb8853ff700 1 -- 172.21.15.46:0/1394459719 shutdown_connections 2023-10-19T12:42:45.383 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.378+0000 7fb8853ff700 1 --2- 172.21.15.46:0/1394459719 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb880102330 0x7fb88019dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:45.383 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.378+0000 7fb8853ff700 1 --2- 172.21.15.46:0/1394459719 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fb86c0a1510 0x7fb86c0a39d0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:45.383 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.378+0000 7fb8853ff700 1 --2- 172.21.15.46:0/1394459719 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb8801007a0 0x7fb880196700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:45.383 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.378+0000 7fb8853ff700 1 --2- 172.21.15.46:0/1394459719 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb880101990 0x7fb880196c40 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:45.383 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.378+0000 7fb8853ff700 1 -- 172.21.15.46:0/1394459719 >> 172.21.15.46:0/1394459719 conn(0x7fb8800fbcf0 msgr2=0x7fb880104d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:45.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.378+0000 7fb8853ff700 1 -- 172.21.15.46:0/1394459719 shutdown_connections 2023-10-19T12:42:45.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.378+0000 7fb8853ff700 1 -- 172.21.15.46:0/1394459719 wait complete. 2023-10-19T12:42:45.400 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-19T12:42:45.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.604+0000 7f5b1adff700 1 -- 172.21.15.46:0/3068208694 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5b14101990 msgr2=0x7f5b14101df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:45.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.604+0000 7f5b1adff700 1 --2- 172.21.15.46:0/3068208694 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5b14101990 0x7f5b14101df0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5b00009990 tx=0x7f5b00009ca0 comp rx=0 tx=0).stop 2023-10-19T12:42:45.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.605+0000 7f5b1adff700 1 -- 172.21.15.46:0/3068208694 shutdown_connections 2023-10-19T12:42:45.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.605+0000 7f5b1adff700 1 --2- 172.21.15.46:0/3068208694 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5b14102330 0x7f5b14108be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:45.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.605+0000 7f5b1adff700 1 --2- 172.21.15.46:0/3068208694 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5b141007a0 0x7f5b14100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:45.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.605+0000 7f5b1adff700 1 --2- 172.21.15.46:0/3068208694 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5b14101990 0x7f5b14101df0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:45.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.605+0000 7f5b1adff700 1 -- 172.21.15.46:0/3068208694 >> 172.21.15.46:0/3068208694 conn(0x7f5b140fbcf0 msgr2=0x7f5b140fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:45.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.605+0000 7f5b1adff700 1 -- 172.21.15.46:0/3068208694 shutdown_connections 2023-10-19T12:42:45.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.605+0000 7f5b1adff700 1 -- 172.21.15.46:0/3068208694 wait complete. 2023-10-19T12:42:45.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.606+0000 7f5b1adff700 1 Processor -- start 2023-10-19T12:42:45.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.606+0000 7f5b1adff700 1 -- start start 2023-10-19T12:42:45.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.607+0000 7f5b1adff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5b141007a0 0x7f5b14196700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:45.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.607+0000 7f5b1adff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5b14101990 0x7f5b14196c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:45.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.607+0000 7f5b1adff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5b14102330 0x7f5b1419dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:45.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.607+0000 7f5b1adff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1419e230 con 0x7f5b14101990 2023-10-19T12:42:45.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.607+0000 7f5b1adff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1419e370 con 0x7f5b141007a0 2023-10-19T12:42:45.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.607+0000 7f5b1adff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1419e500 con 0x7f5b14102330 2023-10-19T12:42:45.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.607+0000 7f5b13fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5b14101990 0x7f5b14196c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:45.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.607+0000 7f5b13fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5b14101990 0x7f5b14196c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38796/0 (socket says 172.21.15.46:38796) 2023-10-19T12:42:45.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.607+0000 7f5b13fff700 1 -- 172.21.15.46:0/3682657653 learned_addr learned my addr 172.21.15.46:0/3682657653 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:42:45.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.607+0000 7f5b18b9b700 1 --2- 172.21.15.46:0/3682657653 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5b141007a0 0x7f5b14196700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:45.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.607+0000 7f5b1939c700 1 --2- 172.21.15.46:0/3682657653 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5b14102330 0x7f5b1419dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:45.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.607+0000 7f5b13fff700 1 -- 172.21.15.46:0/3682657653 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5b14102330 msgr2=0x7f5b1419dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:45.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.607+0000 7f5b13fff700 1 --2- 172.21.15.46:0/3682657653 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5b14102330 0x7f5b1419dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:45.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.607+0000 7f5b13fff700 1 -- 172.21.15.46:0/3682657653 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5b141007a0 msgr2=0x7f5b14196700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:45.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.607+0000 7f5b13fff700 1 --2- 172.21.15.46:0/3682657653 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5b141007a0 0x7f5b14196700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:45.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.608+0000 7f5b13fff700 1 -- 172.21.15.46:0/3682657653 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b000095f0 con 0x7f5b14101990 2023-10-19T12:42:45.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.608+0000 7f5b13fff700 1 --2- 172.21.15.46:0/3682657653 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5b14101990 0x7f5b14196c40 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f5b00005910 tx=0x7f5b00009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:45.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.608+0000 7f5b11ffb700 1 -- 172.21.15.46:0/3682657653 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0001d070 con 0x7f5b14101990 2023-10-19T12:42:45.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.608+0000 7f5b11ffb700 1 -- 172.21.15.46:0/3682657653 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5b00021410 con 0x7f5b14101990 2023-10-19T12:42:45.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.608+0000 7f5b1adff700 1 -- 172.21.15.46:0/3682657653 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b1419e780 con 0x7f5b14101990 2023-10-19T12:42:45.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.608+0000 7f5b11ffb700 1 -- 172.21.15.46:0/3682657653 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b00017650 con 0x7f5b14101990 2023-10-19T12:42:45.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.608+0000 7f5b1adff700 1 -- 172.21.15.46:0/3682657653 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b1419eba0 con 0x7f5b14101990 2023-10-19T12:42:45.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.609+0000 7f5b1adff700 1 -- 172.21.15.46:0/3682657653 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b14107c20 con 0x7f5b14101990 2023-10-19T12:42:45.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.611+0000 7f5b11ffb700 1 -- 172.21.15.46:0/3682657653 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f5b00021580 con 0x7f5b14101990 2023-10-19T12:42:45.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.613+0000 7f5b11ffb700 1 --2- 172.21.15.46:0/3682657653 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f5b040a1510 0x7f5b040a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:45.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.613+0000 7f5b11ffb700 1 -- 172.21.15.46:0/3682657653 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f5b000ce480 con 0x7f5b14101990 2023-10-19T12:42:45.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.613+0000 7f5b18b9b700 1 --2- 172.21.15.46:0/3682657653 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f5b040a1510 0x7f5b040a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:45.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.614+0000 7f5b18b9b700 1 --2- 172.21.15.46:0/3682657653 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f5b040a1510 0x7f5b040a39d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f5b141017f0 tx=0x7f5b08009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:45.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.617+0000 7f5b11ffb700 1 -- 172.21.15.46:0/3682657653 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5b000976a0 con 0x7f5b14101990 2023-10-19T12:42:45.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.832+0000 7f5b1adff700 1 -- 172.21.15.46:0/3682657653 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5b1410bfc0 con 0x7f5b14101990 2023-10-19T12:42:45.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.832+0000 7f5b11ffb700 1 -- 172.21.15.46:0/3682657653 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v90) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5b00021880 con 0x7f5b14101990 2023-10-19T12:42:45.836 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2023-10-19T12:42:45.838 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.835+0000 7f5b1adff700 1 -- 172.21.15.46:0/3682657653 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f5b040a1510 msgr2=0x7f5b040a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:45.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.835+0000 7f5b1adff700 1 --2- 172.21.15.46:0/3682657653 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f5b040a1510 0x7f5b040a39d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f5b141017f0 tx=0x7f5b08009260 comp rx=0 tx=0).stop 2023-10-19T12:42:45.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.835+0000 7f5b1adff700 1 -- 172.21.15.46:0/3682657653 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5b14101990 msgr2=0x7f5b14196c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:45.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.835+0000 7f5b1adff700 1 --2- 172.21.15.46:0/3682657653 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5b14101990 0x7f5b14196c40 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f5b00005910 tx=0x7f5b00009580 comp rx=0 tx=0).stop 2023-10-19T12:42:45.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.835+0000 7f5b1adff700 1 -- 172.21.15.46:0/3682657653 shutdown_connections 2023-10-19T12:42:45.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.835+0000 7f5b1adff700 1 --2- 172.21.15.46:0/3682657653 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f5b040a1510 0x7f5b040a39d0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:45.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.835+0000 7f5b1adff700 1 --2- 172.21.15.46:0/3682657653 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5b14102330 0x7f5b1419dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:45.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.835+0000 7f5b1adff700 1 --2- 172.21.15.46:0/3682657653 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5b141007a0 0x7f5b14196700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:45.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.835+0000 7f5b1adff700 1 --2- 172.21.15.46:0/3682657653 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5b14101990 0x7f5b14196c40 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:45.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.835+0000 7f5b1adff700 1 -- 172.21.15.46:0/3682657653 >> 172.21.15.46:0/3682657653 conn(0x7f5b140fbcf0 msgr2=0x7f5b14104d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:45.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.835+0000 7f5b1adff700 1 -- 172.21.15.46:0/3682657653 shutdown_connections 2023-10-19T12:42:45.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:45.835+0000 7f5b1adff700 1 -- 172.21.15.46:0/3682657653 wait complete. 2023-10-19T12:42:45.857 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-19T12:42:45.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:45 smithi046 ceph-mon[98509]: pgmap v329: 129 pgs: 129 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-10-19T12:42:45.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:45 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/3145263245' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-19T12:42:45.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:45 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/1394459719' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-19T12:42:46.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.063+0000 7f7ab27ff700 1 -- 172.21.15.46:0/2369184946 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7aac1007a0 msgr2=0x7f7aac100bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:46.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.063+0000 7f7ab27ff700 1 --2- 172.21.15.46:0/2369184946 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7aac1007a0 0x7f7aac100bc0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c0098f0 tx=0x7f7a9c009c00 comp rx=0 tx=0).stop 2023-10-19T12:42:46.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.064+0000 7f7ab27ff700 1 -- 172.21.15.46:0/2369184946 shutdown_connections 2023-10-19T12:42:46.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.064+0000 7f7ab27ff700 1 --2- 172.21.15.46:0/2369184946 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7aac102330 0x7f7aac108be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:46.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.064+0000 7f7ab27ff700 1 --2- 172.21.15.46:0/2369184946 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7aac1007a0 0x7f7aac100bc0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:46.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.064+0000 7f7ab27ff700 1 --2- 172.21.15.46:0/2369184946 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7aac101990 0x7f7aac101df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:46.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.064+0000 7f7ab27ff700 1 -- 172.21.15.46:0/2369184946 >> 172.21.15.46:0/2369184946 conn(0x7f7aac0fbcf0 msgr2=0x7f7aac0fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:46.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.064+0000 7f7ab27ff700 1 -- 172.21.15.46:0/2369184946 shutdown_connections 2023-10-19T12:42:46.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.064+0000 7f7ab27ff700 1 -- 172.21.15.46:0/2369184946 wait complete. 2023-10-19T12:42:46.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.065+0000 7f7ab27ff700 1 Processor -- start 2023-10-19T12:42:46.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.065+0000 7f7ab27ff700 1 -- start start 2023-10-19T12:42:46.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.065+0000 7f7ab27ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7aac1007a0 0x7f7aac1989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:46.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.065+0000 7f7ab27ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7aac101990 0x7f7aac198f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:46.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.065+0000 7f7ab27ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7aac102330 0x7f7aac19ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:46.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.065+0000 7f7ab27ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aac1a0510 con 0x7f7aac1007a0 2023-10-19T12:42:46.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.065+0000 7f7ab27ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aac1a0650 con 0x7f7aac101990 2023-10-19T12:42:46.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.065+0000 7f7ab27ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aac1a07e0 con 0x7f7aac102330 2023-10-19T12:42:46.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.065+0000 7f7aabfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7aac1007a0 0x7f7aac1989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:46.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.065+0000 7f7aabfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7aac1007a0 0x7f7aac1989e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38800/0 (socket says 172.21.15.46:38800) 2023-10-19T12:42:46.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.066+0000 7f7aabfff700 1 -- 172.21.15.46:0/4189186031 learned_addr learned my addr 172.21.15.46:0/4189186031 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:42:46.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.066+0000 7f7aab7fe700 1 --2- 172.21.15.46:0/4189186031 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7aac101990 0x7f7aac198f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:46.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.066+0000 7f7ab0d9c700 1 --2- 172.21.15.46:0/4189186031 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7aac102330 0x7f7aac19ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:46.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.066+0000 7f7aabfff700 1 -- 172.21.15.46:0/4189186031 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7aac102330 msgr2=0x7f7aac19ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:46.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.066+0000 7f7aabfff700 1 --2- 172.21.15.46:0/4189186031 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7aac102330 0x7f7aac19ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:46.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.066+0000 7f7aabfff700 1 -- 172.21.15.46:0/4189186031 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7aac101990 msgr2=0x7f7aac198f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:46.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.066+0000 7f7aabfff700 1 --2- 172.21.15.46:0/4189186031 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7aac101990 0x7f7aac198f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:46.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.066+0000 7f7aabfff700 1 -- 172.21.15.46:0/4189186031 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aa4009d00 con 0x7f7aac1007a0 2023-10-19T12:42:46.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.066+0000 7f7ab0d9c700 1 --2- 172.21.15.46:0/4189186031 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7aac102330 0x7f7aac19ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T12:42:46.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.066+0000 7f7aab7fe700 1 --2- 172.21.15.46:0/4189186031 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7aac101990 0x7f7aac198f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T12:42:46.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.066+0000 7f7aabfff700 1 --2- 172.21.15.46:0/4189186031 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7aac1007a0 0x7f7aac1989e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c009810 tx=0x7f7a9c00b560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:46.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.066+0000 7f7aa97fa700 1 -- 172.21.15.46:0/4189186031 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a9c01c070 con 0x7f7aac1007a0 2023-10-19T12:42:46.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.066+0000 7f7ab27ff700 1 -- 172.21.15.46:0/4189186031 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a9c009520 con 0x7f7aac1007a0 2023-10-19T12:42:46.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.066+0000 7f7aa97fa700 1 -- 172.21.15.46:0/4189186031 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7a9c005040 con 0x7f7aac1007a0 2023-10-19T12:42:46.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.066+0000 7f7aa97fa700 1 -- 172.21.15.46:0/4189186031 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a9c003ac0 con 0x7f7aac1007a0 2023-10-19T12:42:46.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.067+0000 7f7ab27ff700 1 -- 172.21.15.46:0/4189186031 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7aac1a0d00 con 0x7f7aac1007a0 2023-10-19T12:42:46.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.068+0000 7f7ab27ff700 1 -- 172.21.15.46:0/4189186031 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7aac193000 con 0x7f7aac1007a0 2023-10-19T12:42:46.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.069+0000 7f7aa97fa700 1 -- 172.21.15.46:0/4189186031 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f7a9c020030 con 0x7f7aac1007a0 2023-10-19T12:42:46.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.071+0000 7f7aa97fa700 1 --2- 172.21.15.46:0/4189186031 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f7a940a1510 0x7f7a940a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:46.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.071+0000 7f7aa97fa700 1 -- 172.21.15.46:0/4189186031 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f7a9c0ce210 con 0x7f7aac1007a0 2023-10-19T12:42:46.080 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.071+0000 7f7aab7fe700 1 --2- 172.21.15.46:0/4189186031 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f7a940a1510 0x7f7a940a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:46.080 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.072+0000 7f7aab7fe700 1 --2- 172.21.15.46:0/4189186031 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f7a940a1510 0x7f7a940a39d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7aa0009cb0 tx=0x7f7aa0009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:46.080 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.075+0000 7f7aa97fa700 1 -- 172.21.15.46:0/4189186031 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7a9c097430 con 0x7f7aac1007a0 2023-10-19T12:42:46.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:45 smithi157 ceph-mon[134109]: pgmap v329: 129 pgs: 129 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-10-19T12:42:46.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:45 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/3145263245' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-19T12:42:46.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:45 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/1394459719' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-19T12:42:46.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:45 smithi195 ceph-mon[134493]: pgmap v329: 129 pgs: 129 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-10-19T12:42:46.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:45 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/3145263245' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-19T12:42:46.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:45 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/1394459719' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-19T12:42:46.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.291+0000 7f7ab27ff700 1 -- 172.21.15.46:0/4189186031 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f7aac1929e0 con 0x7f7aac1007a0 2023-10-19T12:42:46.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.292+0000 7f7aa97fa700 1 -- 172.21.15.46:0/4189186031 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v90) v1 ==== 103+0+11 (secure 0 0 0) 0x7f7a9c09aa50 con 0x7f7aac1007a0 2023-10-19T12:42:46.296 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2023-10-19T12:42:46.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.294+0000 7f7ab27ff700 1 -- 172.21.15.46:0/4189186031 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f7a940a1510 msgr2=0x7f7a940a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:46.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.294+0000 7f7ab27ff700 1 --2- 172.21.15.46:0/4189186031 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f7a940a1510 0x7f7a940a39d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7aa0009cb0 tx=0x7f7aa0009260 comp rx=0 tx=0).stop 2023-10-19T12:42:46.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.294+0000 7f7ab27ff700 1 -- 172.21.15.46:0/4189186031 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7aac1007a0 msgr2=0x7f7aac1989e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:46.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.294+0000 7f7ab27ff700 1 --2- 172.21.15.46:0/4189186031 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7aac1007a0 0x7f7aac1989e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c009810 tx=0x7f7a9c00b560 comp rx=0 tx=0).stop 2023-10-19T12:42:46.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.294+0000 7f7ab27ff700 1 -- 172.21.15.46:0/4189186031 shutdown_connections 2023-10-19T12:42:46.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.294+0000 7f7ab27ff700 1 --2- 172.21.15.46:0/4189186031 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f7a940a1510 0x7f7a940a39d0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:46.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.294+0000 7f7ab27ff700 1 --2- 172.21.15.46:0/4189186031 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7aac102330 0x7f7aac19ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:46.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.294+0000 7f7ab27ff700 1 --2- 172.21.15.46:0/4189186031 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7aac1007a0 0x7f7aac1989e0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:46.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.294+0000 7f7ab27ff700 1 --2- 172.21.15.46:0/4189186031 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7aac101990 0x7f7aac198f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:46.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.294+0000 7f7ab27ff700 1 -- 172.21.15.46:0/4189186031 >> 172.21.15.46:0/4189186031 conn(0x7f7aac0fbcf0 msgr2=0x7f7aac107250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:46.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.295+0000 7f7ab27ff700 1 -- 172.21.15.46:0/4189186031 shutdown_connections 2023-10-19T12:42:46.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.295+0000 7f7ab27ff700 1 -- 172.21.15.46:0/4189186031 wait complete. 2023-10-19T12:42:46.317 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-19T12:42:46.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.521+0000 7fb7c97ff700 1 -- 172.21.15.46:0/147489433 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7c41022d0 msgr2=0x7fb7c4108b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:46.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.521+0000 7fb7c97ff700 1 --2- 172.21.15.46:0/147489433 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7c41022d0 0x7fb7c4108b80 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc00b0d0 tx=0x7fb7bc00b3e0 comp rx=0 tx=0).stop 2023-10-19T12:42:46.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.521+0000 7fb7c97ff700 1 -- 172.21.15.46:0/147489433 shutdown_connections 2023-10-19T12:42:46.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.521+0000 7fb7c97ff700 1 --2- 172.21.15.46:0/147489433 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7c41022d0 0x7fb7c4108b80 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:46.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.521+0000 7fb7c97ff700 1 --2- 172.21.15.46:0/147489433 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb7c4100740 0x7fb7c4100b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:46.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.521+0000 7fb7c97ff700 1 --2- 172.21.15.46:0/147489433 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7c4101930 0x7fb7c4101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:46.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.521+0000 7fb7c97ff700 1 -- 172.21.15.46:0/147489433 >> 172.21.15.46:0/147489433 conn(0x7fb7c40fbc90 msgr2=0x7fb7c40fe0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:46.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.521+0000 7fb7c97ff700 1 -- 172.21.15.46:0/147489433 shutdown_connections 2023-10-19T12:42:46.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.521+0000 7fb7c97ff700 1 -- 172.21.15.46:0/147489433 wait complete. 2023-10-19T12:42:46.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.522+0000 7fb7c97ff700 1 Processor -- start 2023-10-19T12:42:46.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.522+0000 7fb7c97ff700 1 -- start start 2023-10-19T12:42:46.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.522+0000 7fb7c97ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7c4100740 0x7fb7c4198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:46.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.523+0000 7fb7c97ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7c4101930 0x7fb7c4198f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:46.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.523+0000 7fb7c97ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb7c41022d0 0x7fb7c419ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:46.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.523+0000 7fb7c97ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c41a0550 con 0x7fb7c4100740 2023-10-19T12:42:46.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.523+0000 7fb7c97ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c41a0690 con 0x7fb7c41022d0 2023-10-19T12:42:46.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.523+0000 7fb7c97ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c41a0820 con 0x7fb7c4101930 2023-10-19T12:42:46.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.523+0000 7fb7c2ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7c4100740 0x7fb7c4198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:46.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.523+0000 7fb7c2ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7c4100740 0x7fb7c4198a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38810/0 (socket says 172.21.15.46:38810) 2023-10-19T12:42:46.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.523+0000 7fb7c2ffd700 1 -- 172.21.15.46:0/2118008465 learned_addr learned my addr 172.21.15.46:0/2118008465 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:42:46.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.523+0000 7fb7c27fc700 1 --2- 172.21.15.46:0/2118008465 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7c4101930 0x7fb7c4198f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:46.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.523+0000 7fb7c37fe700 1 --2- 172.21.15.46:0/2118008465 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb7c41022d0 0x7fb7c419ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:46.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.523+0000 7fb7c2ffd700 1 -- 172.21.15.46:0/2118008465 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7c4101930 msgr2=0x7fb7c4198f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:46.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.523+0000 7fb7c2ffd700 1 --2- 172.21.15.46:0/2118008465 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7c4101930 0x7fb7c4198f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:46.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.523+0000 7fb7c2ffd700 1 -- 172.21.15.46:0/2118008465 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb7c41022d0 msgr2=0x7fb7c419ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:46.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.523+0000 7fb7c2ffd700 1 --2- 172.21.15.46:0/2118008465 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb7c41022d0 0x7fb7c419ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:46.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.523+0000 7fb7c2ffd700 1 -- 172.21.15.46:0/2118008465 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7bc009d00 con 0x7fb7c4100740 2023-10-19T12:42:46.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.524+0000 7fb7c2ffd700 1 --2- 172.21.15.46:0/2118008465 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7c4100740 0x7fb7c4198a20 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fb7b400e970 tx=0x7fb7b400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:46.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.524+0000 7fb7abfff700 1 -- 172.21.15.46:0/2118008465 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7b4009790 con 0x7fb7c4100740 2023-10-19T12:42:46.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.524+0000 7fb7abfff700 1 -- 172.21.15.46:0/2118008465 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb7b400c7e0 con 0x7fb7c4100740 2023-10-19T12:42:46.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.524+0000 7fb7c97ff700 1 -- 172.21.15.46:0/2118008465 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7c41a0b00 con 0x7fb7c4100740 2023-10-19T12:42:46.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.524+0000 7fb7abfff700 1 -- 172.21.15.46:0/2118008465 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7b4003c70 con 0x7fb7c4100740 2023-10-19T12:42:46.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.524+0000 7fb7c97ff700 1 -- 172.21.15.46:0/2118008465 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7c41a0fc0 con 0x7fb7c4100740 2023-10-19T12:42:46.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.525+0000 7fb7c97ff700 1 -- 172.21.15.46:0/2118008465 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7c4067530 con 0x7fb7c4100740 2023-10-19T12:42:46.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.527+0000 7fb7abfff700 1 -- 172.21.15.46:0/2118008465 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7fb7b400cc50 con 0x7fb7c4100740 2023-10-19T12:42:46.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.528+0000 7fb7abfff700 1 --2- 172.21.15.46:0/2118008465 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fb7ac0a1510 0x7fb7ac0a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:46.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.528+0000 7fb7abfff700 1 -- 172.21.15.46:0/2118008465 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fb7b4014070 con 0x7fb7c4100740 2023-10-19T12:42:46.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.529+0000 7fb7c27fc700 1 --2- 172.21.15.46:0/2118008465 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fb7ac0a1510 0x7fb7ac0a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:46.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.529+0000 7fb7c27fc700 1 --2- 172.21.15.46:0/2118008465 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fb7ac0a1510 0x7fb7ac0a39d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb7b8009a10 tx=0x7fb7b8009190 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:46.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.532+0000 7fb7abfff700 1 -- 172.21.15.46:0/2118008465 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb7b4096560 con 0x7fb7c4100740 2023-10-19T12:42:46.800 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.797+0000 7fb7c97ff700 1 -- 172.21.15.46:0/2118008465 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb7c410c020 con 0x7fb7c4100740 2023-10-19T12:42:46.800 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.798+0000 7fb7abfff700 1 -- 172.21.15.46:0/2118008465 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+11372 (secure 0 0 0) 0x7fb7b4003dd0 con 0x7fb7c4100740 2023-10-19T12:42:46.801 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:42:46.801 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14580,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/2235286008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":2235286008},{"type":"v1","addr":"172.21.15.46:6835","nonce":2235286008}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14592,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/339398444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":339398444},{"type":"v1","addr":"172.21.15.46:6837","nonce":339398444}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-19T12:41:18.815780+0000","modified":"2023-10-19T12:41:47.301944+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24680,"mds_1":24655,"mds_2":24643,"mds_3":24631,"mds_4":24629},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14640":{"gid":14640,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.46:6839/1655843965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":1655843965},{"type":"v1","addr":"172.21.15.46:6839","nonce":1655843965}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14652":{"gid":14652,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.46:6841/4204925553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6840","nonce":4204925553},{"type":"v1","addr":"172.21.15.46:6841","nonce":4204925553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24560":{"gid":24560,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.157:6833/1687745569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":1687745569},{"type":"v1","addr":"172.21.15.157:6833","nonce":1687745569}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24574":{"gid":24574,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.195:6833/3629933235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3629933235},{"type":"v1","addr":"172.21.15.195:6833","nonce":3629933235}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24602":{"gid":24602,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.157:6835/108432552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":108432552},{"type":"v1","addr":"172.21.15.157:6835","nonce":108432552}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24629":{"gid":24629,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":13,"addr":"172.21.15.157:6837/2629536514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6836","nonce":2629536514},{"type":"v1","addr":"172.21.15.157:6837","nonce":2629536514}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24631":{"gid":24631,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.195:6835/1406909915","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":1406909915},{"type":"v1","addr":"172.21.15.195:6835","nonce":1406909915}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24643":{"gid":24643,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":13,"addr":"172.21.15.195:6837/293916188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":293916188},{"type":"v1","addr":"172.21.15.195:6837","nonce":293916188}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24655":{"gid":24655,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":11,"addr":"172.21.15.195:6839/4094901934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6838","nonce":4094901934},{"type":"v1","addr":"172.21.15.195:6839","nonce":4094901934}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24680":{"gid":24680,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.157:6839/552718978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6838","nonce":552718978},{"type":"v1","addr":"172.21.15.157:6839","nonce":552718978}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-19T12:42:46.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.800+0000 7fb7c97ff700 1 -- 172.21.15.46:0/2118008465 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fb7ac0a1510 msgr2=0x7fb7ac0a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:46.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.800+0000 7fb7c97ff700 1 --2- 172.21.15.46:0/2118008465 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fb7ac0a1510 0x7fb7ac0a39d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb7b8009a10 tx=0x7fb7b8009190 comp rx=0 tx=0).stop 2023-10-19T12:42:46.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.800+0000 7fb7c97ff700 1 -- 172.21.15.46:0/2118008465 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7c4100740 msgr2=0x7fb7c4198a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:46.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.800+0000 7fb7c97ff700 1 --2- 172.21.15.46:0/2118008465 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7c4100740 0x7fb7c4198a20 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fb7b400e970 tx=0x7fb7b400ec80 comp rx=0 tx=0).stop 2023-10-19T12:42:46.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.800+0000 7fb7c97ff700 1 -- 172.21.15.46:0/2118008465 shutdown_connections 2023-10-19T12:42:46.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.800+0000 7fb7c97ff700 1 --2- 172.21.15.46:0/2118008465 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb7c41022d0 0x7fb7c419ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:46.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.800+0000 7fb7c97ff700 1 --2- 172.21.15.46:0/2118008465 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7c4100740 0x7fb7c4198a20 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:46.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.801+0000 7fb7c97ff700 1 --2- 172.21.15.46:0/2118008465 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fb7ac0a1510 0x7fb7ac0a39d0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:46.806 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.801+0000 7fb7c97ff700 1 --2- 172.21.15.46:0/2118008465 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7c4101930 0x7fb7c4198f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:46.806 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.801+0000 7fb7c97ff700 1 -- 172.21.15.46:0/2118008465 >> 172.21.15.46:0/2118008465 conn(0x7fb7c40fbc90 msgr2=0x7fb7c4072a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:46.806 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.801+0000 7fb7c97ff700 1 -- 172.21.15.46:0/2118008465 shutdown_connections 2023-10-19T12:42:46.806 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:46.801+0000 7fb7c97ff700 1 -- 172.21.15.46:0/2118008465 wait complete. 2023-10-19T12:42:46.806 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 27 2023-10-19T12:42:46.823 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-19T12:42:47.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.025+0000 7f06e6d9d700 1 -- 172.21.15.46:0/1460915934 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06e0100520 msgr2=0x7f06e0100940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:47.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.025+0000 7f06e6d9d700 1 --2- 172.21.15.46:0/1460915934 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06e0100520 0x7f06e0100940 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f06dc0099c0 tx=0x7f06dc009cd0 comp rx=0 tx=0).stop 2023-10-19T12:42:47.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.026+0000 7f06e6d9d700 1 -- 172.21.15.46:0/1460915934 shutdown_connections 2023-10-19T12:42:47.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.026+0000 7f06e6d9d700 1 --2- 172.21.15.46:0/1460915934 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f06e01020b0 0x7f06e0108960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:47.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.026+0000 7f06e6d9d700 1 --2- 172.21.15.46:0/1460915934 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06e0100520 0x7f06e0100940 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:47.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.026+0000 7f06e6d9d700 1 --2- 172.21.15.46:0/1460915934 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f06e0101710 0x7f06e0101b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:47.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.026+0000 7f06e6d9d700 1 -- 172.21.15.46:0/1460915934 >> 172.21.15.46:0/1460915934 conn(0x7f06e00fba70 msgr2=0x7f06e00fded0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:47.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.026+0000 7f06e6d9d700 1 -- 172.21.15.46:0/1460915934 shutdown_connections 2023-10-19T12:42:47.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.026+0000 7f06e6d9d700 1 -- 172.21.15.46:0/1460915934 wait complete. 2023-10-19T12:42:47.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.027+0000 7f06e6d9d700 1 Processor -- start 2023-10-19T12:42:47.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.027+0000 7f06e6d9d700 1 -- start start 2023-10-19T12:42:47.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.027+0000 7f06e6d9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f06e0100520 0x7f06e01964d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:47.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.027+0000 7f06e6d9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06e0101710 0x7f06e0196a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:47.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.027+0000 7f06e6d9d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f06e01020b0 0x7f06e019da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:47.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.027+0000 7f06e6d9d700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06e019e000 con 0x7f06e0101710 2023-10-19T12:42:47.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.027+0000 7f06e6d9d700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06e019e140 con 0x7f06e01020b0 2023-10-19T12:42:47.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.027+0000 7f06e6d9d700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06e019e2d0 con 0x7f06e0100520 2023-10-19T12:42:47.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.027+0000 7f06e559a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06e0101710 0x7f06e0196a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:47.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.027+0000 7f06e559a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06e0101710 0x7f06e0196a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38818/0 (socket says 172.21.15.46:38818) 2023-10-19T12:42:47.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.027+0000 7f06e559a700 1 -- 172.21.15.46:0/3074022753 learned_addr learned my addr 172.21.15.46:0/3074022753 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:42:47.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.027+0000 7f06e5d9b700 1 --2- 172.21.15.46:0/3074022753 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f06e0100520 0x7f06e01964d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:47.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.027+0000 7f06e659c700 1 --2- 172.21.15.46:0/3074022753 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f06e01020b0 0x7f06e019da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:47.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.028+0000 7f06e559a700 1 -- 172.21.15.46:0/3074022753 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f06e0100520 msgr2=0x7f06e01964d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:47.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.028+0000 7f06e559a700 1 --2- 172.21.15.46:0/3074022753 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f06e0100520 0x7f06e01964d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:47.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.028+0000 7f06e559a700 1 -- 172.21.15.46:0/3074022753 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f06e01020b0 msgr2=0x7f06e019da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:47.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.028+0000 7f06e559a700 1 --2- 172.21.15.46:0/3074022753 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f06e01020b0 0x7f06e019da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:47.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.028+0000 7f06e559a700 1 -- 172.21.15.46:0/3074022753 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06dc0095f0 con 0x7f06e0101710 2023-10-19T12:42:47.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.028+0000 7f06e559a700 1 --2- 172.21.15.46:0/3074022753 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06e0101710 0x7f06e0196a10 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f06d000d950 tx=0x7f06d000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:47.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.028+0000 7f06d6ffd700 1 -- 172.21.15.46:0/3074022753 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d000f890 con 0x7f06e0101710 2023-10-19T12:42:47.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.028+0000 7f06d6ffd700 1 -- 172.21.15.46:0/3074022753 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f06d0010460 con 0x7f06e0101710 2023-10-19T12:42:47.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.028+0000 7f06e6d9d700 1 -- 172.21.15.46:0/3074022753 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06e019e5b0 con 0x7f06e0101710 2023-10-19T12:42:47.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.028+0000 7f06d6ffd700 1 -- 172.21.15.46:0/3074022753 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d000e610 con 0x7f06e0101710 2023-10-19T12:42:47.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.028+0000 7f06e6d9d700 1 -- 172.21.15.46:0/3074022753 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06e019eb10 con 0x7f06e0101710 2023-10-19T12:42:47.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.029+0000 7f06e6d9d700 1 -- 172.21.15.46:0/3074022753 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06e01079c0 con 0x7f06e0101710 2023-10-19T12:42:47.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.032+0000 7f06d6ffd700 1 -- 172.21.15.46:0/3074022753 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f06d00108d0 con 0x7f06e0101710 2023-10-19T12:42:47.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.033+0000 7f06d6ffd700 1 --2- 172.21.15.46:0/3074022753 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f06cc0a1590 0x7f06cc0a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:47.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.033+0000 7f06d6ffd700 1 -- 172.21.15.46:0/3074022753 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f06d00ccf20 con 0x7f06e0101710 2023-10-19T12:42:47.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.033+0000 7f06e5d9b700 1 --2- 172.21.15.46:0/3074022753 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f06cc0a1590 0x7f06cc0a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:47.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.034+0000 7f06e5d9b700 1 --2- 172.21.15.46:0/3074022753 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f06cc0a1590 0x7f06cc0a3a50 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f06dc006010 tx=0x7f06dc00b540 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:47.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.035+0000 7f06d6ffd700 1 -- 172.21.15.46:0/3074022753 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f06d00960b0 con 0x7f06e0101710 2023-10-19T12:42:47.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:46 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/3682657653' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-19T12:42:47.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:46 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/4189186031' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-19T12:42:47.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:46 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/3682657653' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-19T12:42:47.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:46 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/4189186031' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-19T12:42:47.228 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:46 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/3682657653' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-19T12:42:47.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:46 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/4189186031' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-19T12:42:47.248 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.245+0000 7f06e6d9d700 1 -- 172.21.15.46:0/3074022753 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f06e00673e0 con 0x7f06e0101710 2023-10-19T12:42:47.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.247+0000 7f06d6ffd700 1 -- 172.21.15.46:0/3074022753 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+24481 (secure 0 0 0) 0x7f06d0020090 con 0x7f06e0101710 2023-10-19T12:42:47.250 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:42:47.251 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":90,"fsid":"96a8be3c-6e7b-11ee-8db6-212e2dc638e7","created":"2023-10-19T12:33:26.148713+0000","modified":"2023-10-19T12:42:28.113339+0000","last_up_change":"2023-10-19T12:40:30.761679+0000","last_in_change":"2023-10-19T12:40:13.663559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-19T12:37:07.175795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-19T12:41:16.895203+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-19T12:41:18.255601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-19T12:41:21.830455+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"346ce86b-a10a-4869-9fdb-c3c1d4161455","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6803","nonce":500237995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6805","nonce":500237995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6809","nonce":500237995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6807","nonce":500237995}]},"public_addr":"172.21.15.46:6803/500237995","cluster_addr":"172.21.15.46:6805/500237995","heartbeat_back_addr":"172.21.15.46:6809/500237995","heartbeat_front_addr":"172.21.15.46:6807/500237995","state":["exists","up"]},{"osd":1,"uuid":"02aae687-76c5-4124-bae4-9787ed571c28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6801","nonce":2496862790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6803","nonce":2496862790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6807","nonce":2496862790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6805","nonce":2496862790}]},"public_addr":"172.21.15.157:6801/2496862790","cluster_addr":"172.21.15.157:6803/2496862790","heartbeat_back_addr":"172.21.15.157:6807/2496862790","heartbeat_front_addr":"172.21.15.157:6805/2496862790","state":["exists","up"]},{"osd":2,"uuid":"d5360828-1f58-4380-b2ad-0c21ff850981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6801","nonce":4211767276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6803","nonce":4211767276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6807","nonce":4211767276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6805","nonce":4211767276}]},"public_addr":"172.21.15.195:6801/4211767276","cluster_addr":"172.21.15.195:6803/4211767276","heartbeat_back_addr":"172.21.15.195:6807/4211767276","heartbeat_front_addr":"172.21.15.195:6805/4211767276","state":["exists","up"]},{"osd":3,"uuid":"accb780f-49d0-43f8-b166-ee12c558ef00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6811","nonce":1964113352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6813","nonce":1964113352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6817","nonce":1964113352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6815","nonce":1964113352}]},"public_addr":"172.21.15.46:6811/1964113352","cluster_addr":"172.21.15.46:6813/1964113352","heartbeat_back_addr":"172.21.15.46:6817/1964113352","heartbeat_front_addr":"172.21.15.46:6815/1964113352","state":["exists","up"]},{"osd":4,"uuid":"e662886d-e989-4d02-8c1f-3c4671352b0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6809","nonce":3636910144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6811","nonce":3636910144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6815","nonce":3636910144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6813","nonce":3636910144}]},"public_addr":"172.21.15.157:6809/3636910144","cluster_addr":"172.21.15.157:6811/3636910144","heartbeat_back_addr":"172.21.15.157:6815/3636910144","heartbeat_front_addr":"172.21.15.157:6813/3636910144","state":["exists","up"]},{"osd":5,"uuid":"9597e0ce-14ea-407d-90fe-f74bccee38b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6809","nonce":4071287969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6811","nonce":4071287969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6815","nonce":4071287969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6813","nonce":4071287969}]},"public_addr":"172.21.15.195:6809/4071287969","cluster_addr":"172.21.15.195:6811/4071287969","heartbeat_back_addr":"172.21.15.195:6815/4071287969","heartbeat_front_addr":"172.21.15.195:6813/4071287969","state":["exists","up"]},{"osd":6,"uuid":"6b78ba38-f60e-4cb6-b01c-cecc1820e8e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6819","nonce":1842285555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6821","nonce":1842285555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6825","nonce":1842285555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6823","nonce":1842285555}]},"public_addr":"172.21.15.46:6819/1842285555","cluster_addr":"172.21.15.46:6821/1842285555","heartbeat_back_addr":"172.21.15.46:6825/1842285555","heartbeat_front_addr":"172.21.15.46:6823/1842285555","state":["exists","up"]},{"osd":7,"uuid":"59a0899f-3bcd-4db2-b544-24df3a536749","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6817","nonce":3498672588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6819","nonce":3498672588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6823","nonce":3498672588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6821","nonce":3498672588}]},"public_addr":"172.21.15.157:6817/3498672588","cluster_addr":"172.21.15.157:6819/3498672588","heartbeat_back_addr":"172.21.15.157:6823/3498672588","heartbeat_front_addr":"172.21.15.157:6821/3498672588","state":["exists","up"]},{"osd":8,"uuid":"9c3c9835-043a-4fb5-a9ee-edf8caf6b605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6817","nonce":74230104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6819","nonce":74230104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6823","nonce":74230104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6821","nonce":74230104}]},"public_addr":"172.21.15.195:6817/74230104","cluster_addr":"172.21.15.195:6819/74230104","heartbeat_back_addr":"172.21.15.195:6823/74230104","heartbeat_front_addr":"172.21.15.195:6821/74230104","state":["exists","up"]},{"osd":9,"uuid":"3f18f506-a577-4b7c-ae0d-9351c07e81f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6827","nonce":3472581046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6829","nonce":3472581046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6833","nonce":3472581046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6831","nonce":3472581046}]},"public_addr":"172.21.15.46:6827/3472581046","cluster_addr":"172.21.15.46:6829/3472581046","heartbeat_back_addr":"172.21.15.46:6833/3472581046","heartbeat_front_addr":"172.21.15.46:6831/3472581046","state":["exists","up"]},{"osd":10,"uuid":"1ed01854-443a-4acf-9293-7ca0d451a93d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6825","nonce":2378416559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6827","nonce":2378416559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6831","nonce":2378416559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6829","nonce":2378416559}]},"public_addr":"172.21.15.157:6825/2378416559","cluster_addr":"172.21.15.157:6827/2378416559","heartbeat_back_addr":"172.21.15.157:6831/2378416559","heartbeat_front_addr":"172.21.15.157:6829/2378416559","state":["exists","up"]},{"osd":11,"uuid":"021398c0-9184-4647-8220-e40f6705ca90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6825","nonce":3075632222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6827","nonce":3075632222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6831","nonce":3075632222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6829","nonce":3075632222}]},"public_addr":"172.21.15.195:6825/3075632222","cluster_addr":"172.21.15.195:6827/3075632222","heartbeat_back_addr":"172.21.15.195:6831/3075632222","heartbeat_front_addr":"172.21.15.195:6829/3075632222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:36:22.002614+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:36:44.098031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:37:04.518341+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:37:30.796462+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:37:52.756555+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:38:13.403168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:38:39.058472+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:39:01.106893+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:39:21.908334+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:39:46.843884+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:40:08.792020+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:40:29.282974+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":3,"to":6}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.39","mappings":[{"from":5,"to":8}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.46:0/3248595150":"2023-10-20T12:34:26.552115+0000","172.21.15.46:0/3624849341":"2023-10-20T12:34:26.552115+0000","172.21.15.46:0/1844094590":"2023-10-20T12:34:26.552115+0000","172.21.15.46:6801/20022894":"2023-10-20T12:34:26.552115+0000","172.21.15.46:0/3969790632":"2023-10-20T12:34:00.135248+0000","172.21.15.46:0/2331135821":"2023-10-20T12:34:00.135248+0000","172.21.15.46:6800/51664346":"2023-10-20T12:34:00.135248+0000","172.21.15.46:6801/51664346":"2023-10-20T12:34:00.135248+0000","172.21.15.46:0/585851467":"2023-10-20T12:34:00.135248+0000","172.21.15.46:6800/20022894":"2023-10-20T12:34:26.552115+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-19T12:42:47.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.249+0000 7f06e6d9d700 1 -- 172.21.15.46:0/3074022753 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f06cc0a1590 msgr2=0x7f06cc0a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:47.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.249+0000 7f06e6d9d700 1 --2- 172.21.15.46:0/3074022753 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f06cc0a1590 0x7f06cc0a3a50 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f06dc006010 tx=0x7f06dc00b540 comp rx=0 tx=0).stop 2023-10-19T12:42:47.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.249+0000 7f06e6d9d700 1 -- 172.21.15.46:0/3074022753 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06e0101710 msgr2=0x7f06e0196a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:47.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.249+0000 7f06e6d9d700 1 --2- 172.21.15.46:0/3074022753 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06e0101710 0x7f06e0196a10 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f06d000d950 tx=0x7f06d000dc60 comp rx=0 tx=0).stop 2023-10-19T12:42:47.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.250+0000 7f06e6d9d700 1 -- 172.21.15.46:0/3074022753 shutdown_connections 2023-10-19T12:42:47.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.250+0000 7f06e6d9d700 1 --2- 172.21.15.46:0/3074022753 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f06e01020b0 0x7f06e019da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:47.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.250+0000 7f06e6d9d700 1 --2- 172.21.15.46:0/3074022753 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f06cc0a1590 0x7f06cc0a3a50 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:47.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.250+0000 7f06e6d9d700 1 --2- 172.21.15.46:0/3074022753 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f06e0100520 0x7f06e01964d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:47.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.250+0000 7f06e6d9d700 1 --2- 172.21.15.46:0/3074022753 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06e0101710 0x7f06e0196a10 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:47.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.250+0000 7f06e6d9d700 1 -- 172.21.15.46:0/3074022753 >> 172.21.15.46:0/3074022753 conn(0x7f06e00fba70 msgr2=0x7f06e0104b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:47.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.250+0000 7f06e6d9d700 1 -- 172.21.15.46:0/3074022753 shutdown_connections 2023-10-19T12:42:47.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.250+0000 7f06e6d9d700 1 -- 172.21.15.46:0/3074022753 wait complete. 2023-10-19T12:42:47.273 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-19T12:37:07.175795+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-19T12:41:16.895203+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-19T12:41:18.255601+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-19T12:41:21.830455+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-19T12:42:47.274 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-19T12:42:47.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.485+0000 7f95155ff700 1 -- 172.21.15.46:0/3938817472 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95101007a0 msgr2=0x7f9510100bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:47.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.485+0000 7f95155ff700 1 --2- 172.21.15.46:0/3938817472 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95101007a0 0x7f9510100bc0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f95000099c0 tx=0x7f9500009cd0 comp rx=0 tx=0).stop 2023-10-19T12:42:47.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.485+0000 7f95155ff700 1 -- 172.21.15.46:0/3938817472 shutdown_connections 2023-10-19T12:42:47.490 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.485+0000 7f95155ff700 1 --2- 172.21.15.46:0/3938817472 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9510102330 0x7f9510108be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:47.490 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.485+0000 7f95155ff700 1 --2- 172.21.15.46:0/3938817472 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95101007a0 0x7f9510100bc0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:47.490 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.485+0000 7f95155ff700 1 --2- 172.21.15.46:0/3938817472 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9510101990 0x7f9510101df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:47.490 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.485+0000 7f95155ff700 1 -- 172.21.15.46:0/3938817472 >> 172.21.15.46:0/3938817472 conn(0x7f95100fbcf0 msgr2=0x7f95100fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:47.491 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.485+0000 7f95155ff700 1 -- 172.21.15.46:0/3938817472 shutdown_connections 2023-10-19T12:42:47.491 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.485+0000 7f95155ff700 1 -- 172.21.15.46:0/3938817472 wait complete. 2023-10-19T12:42:47.493 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.486+0000 7f95155ff700 1 Processor -- start 2023-10-19T12:42:47.493 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.486+0000 7f95155ff700 1 -- start start 2023-10-19T12:42:47.493 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.487+0000 7f95155ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f95101007a0 0x7f9510196700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:47.494 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.487+0000 7f95155ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9510101990 0x7f9510196c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:47.494 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.487+0000 7f95155ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9510102330 0x7f951019dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:47.494 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.487+0000 7f95155ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f951019e230 con 0x7f9510102330 2023-10-19T12:42:47.494 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.487+0000 7f95155ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f951019e370 con 0x7f95101007a0 2023-10-19T12:42:47.495 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.487+0000 7f95155ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f951019e500 con 0x7f9510101990 2023-10-19T12:42:47.495 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.487+0000 7f950f7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9510102330 0x7f951019dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:47.495 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.487+0000 7f950effd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f95101007a0 0x7f9510196700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:47.495 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.487+0000 7f950f7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9510102330 0x7f951019dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38842/0 (socket says 172.21.15.46:38842) 2023-10-19T12:42:47.496 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.487+0000 7f950f7fe700 1 -- 172.21.15.46:0/1950561786 learned_addr learned my addr 172.21.15.46:0/1950561786 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:42:47.496 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.487+0000 7f950effd700 1 --2- 172.21.15.46:0/1950561786 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f95101007a0 0x7f9510196700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:43506/0 (socket says 172.21.15.46:43506) 2023-10-19T12:42:47.496 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.487+0000 7f950e7fc700 1 --2- 172.21.15.46:0/1950561786 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9510101990 0x7f9510196c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:47.496 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.488+0000 7f950f7fe700 1 -- 172.21.15.46:0/1950561786 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9510101990 msgr2=0x7f9510196c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:47.496 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.488+0000 7f950f7fe700 1 --2- 172.21.15.46:0/1950561786 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9510101990 0x7f9510196c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:47.497 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.488+0000 7f950f7fe700 1 -- 172.21.15.46:0/1950561786 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f95101007a0 msgr2=0x7f9510196700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:47.497 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.488+0000 7f950f7fe700 1 --2- 172.21.15.46:0/1950561786 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f95101007a0 0x7f9510196700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:47.497 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.488+0000 7f950f7fe700 1 -- 172.21.15.46:0/1950561786 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95000095f0 con 0x7f9510102330 2023-10-19T12:42:47.497 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.488+0000 7f950f7fe700 1 --2- 172.21.15.46:0/1950561786 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9510102330 0x7f951019dc60 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f950800ef30 tx=0x7f950800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:47.498 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.488+0000 7f94f7fff700 1 -- 172.21.15.46:0/1950561786 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9508018070 con 0x7f9510102330 2023-10-19T12:42:47.498 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.488+0000 7f94f7fff700 1 -- 172.21.15.46:0/1950561786 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f950800f040 con 0x7f9510102330 2023-10-19T12:42:47.498 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.488+0000 7f95155ff700 1 -- 172.21.15.46:0/1950561786 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f951019e780 con 0x7f9510102330 2023-10-19T12:42:47.498 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.488+0000 7f94f7fff700 1 -- 172.21.15.46:0/1950561786 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f950800cd00 con 0x7f9510102330 2023-10-19T12:42:47.499 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.488+0000 7f95155ff700 1 -- 172.21.15.46:0/1950561786 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f951019ec90 con 0x7f9510102330 2023-10-19T12:42:47.499 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.490+0000 7f95155ff700 1 -- 172.21.15.46:0/1950561786 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9510107bf0 con 0x7f9510102330 2023-10-19T12:42:47.500 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.491+0000 7f94f7fff700 1 -- 172.21.15.46:0/1950561786 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f9508003a00 con 0x7f9510102330 2023-10-19T12:42:47.500 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.493+0000 7f94f7fff700 1 --2- 172.21.15.46:0/1950561786 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f94f80a1590 0x7f94f80a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:47.500 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.493+0000 7f94f7fff700 1 -- 172.21.15.46:0/1950561786 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f95080ccd20 con 0x7f9510102330 2023-10-19T12:42:47.500 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.493+0000 7f950effd700 1 --2- 172.21.15.46:0/1950561786 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f94f80a1590 0x7f94f80a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:47.501 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.494+0000 7f950effd700 1 --2- 172.21.15.46:0/1950561786 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f94f80a1590 0x7f94f80a3a50 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f9500003730 tx=0x7f9500000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:47.501 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.497+0000 7f94f7fff700 1 -- 172.21.15.46:0/1950561786 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f9508095f40 con 0x7f9510102330 2023-10-19T12:42:47.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.710+0000 7f95155ff700 1 -- 172.21.15.46:0/1950561786 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f951010bfc0 con 0x7f9510102330 2023-10-19T12:42:47.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.711+0000 7f94f7fff700 1 -- 172.21.15.46:0/1950561786 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v90) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9508099560 con 0x7f9510102330 2023-10-19T12:42:47.714 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2023-10-19T12:42:47.716 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.713+0000 7f95155ff700 1 -- 172.21.15.46:0/1950561786 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f94f80a1590 msgr2=0x7f94f80a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:47.717 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.713+0000 7f95155ff700 1 --2- 172.21.15.46:0/1950561786 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f94f80a1590 0x7f94f80a3a50 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f9500003730 tx=0x7f9500000bc0 comp rx=0 tx=0).stop 2023-10-19T12:42:47.717 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.713+0000 7f95155ff700 1 -- 172.21.15.46:0/1950561786 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9510102330 msgr2=0x7f951019dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:47.717 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.713+0000 7f95155ff700 1 --2- 172.21.15.46:0/1950561786 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9510102330 0x7f951019dc60 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f950800ef30 tx=0x7f950800c3a0 comp rx=0 tx=0).stop 2023-10-19T12:42:47.717 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.713+0000 7f95155ff700 1 -- 172.21.15.46:0/1950561786 shutdown_connections 2023-10-19T12:42:47.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.713+0000 7f95155ff700 1 --2- 172.21.15.46:0/1950561786 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9510102330 0x7f951019dc60 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:47.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.713+0000 7f95155ff700 1 --2- 172.21.15.46:0/1950561786 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f95101007a0 0x7f9510196700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:47.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.713+0000 7f95155ff700 1 --2- 172.21.15.46:0/1950561786 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f94f80a1590 0x7f94f80a3a50 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:47.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.713+0000 7f95155ff700 1 --2- 172.21.15.46:0/1950561786 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9510101990 0x7f9510196c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:47.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.713+0000 7f95155ff700 1 -- 172.21.15.46:0/1950561786 >> 172.21.15.46:0/1950561786 conn(0x7f95100fbcf0 msgr2=0x7f9510104d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:47.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.713+0000 7f95155ff700 1 -- 172.21.15.46:0/1950561786 shutdown_connections 2023-10-19T12:42:47.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.713+0000 7f95155ff700 1 -- 172.21.15.46:0/1950561786 wait complete. 2023-10-19T12:42:47.736 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-19T12:42:47.945 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.941+0000 7f2d523ff700 1 -- 172.21.15.46:0/961423427 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2d4c101990 msgr2=0x7f2d4c101df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:47.945 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.941+0000 7f2d523ff700 1 --2- 172.21.15.46:0/961423427 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2d4c101990 0x7f2d4c101df0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2d40009990 tx=0x7f2d40009ca0 comp rx=0 tx=0).stop 2023-10-19T12:42:47.945 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.941+0000 7f2d523ff700 1 -- 172.21.15.46:0/961423427 shutdown_connections 2023-10-19T12:42:47.946 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.941+0000 7f2d523ff700 1 --2- 172.21.15.46:0/961423427 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d4c102330 0x7f2d4c108be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:47.946 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.941+0000 7f2d523ff700 1 --2- 172.21.15.46:0/961423427 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2d4c1007a0 0x7f2d4c100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:47.946 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.941+0000 7f2d523ff700 1 --2- 172.21.15.46:0/961423427 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2d4c101990 0x7f2d4c101df0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:47.946 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.941+0000 7f2d523ff700 1 -- 172.21.15.46:0/961423427 >> 172.21.15.46:0/961423427 conn(0x7f2d4c0fbcf0 msgr2=0x7f2d4c0fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:47.946 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.941+0000 7f2d523ff700 1 -- 172.21.15.46:0/961423427 shutdown_connections 2023-10-19T12:42:47.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.942+0000 7f2d523ff700 1 -- 172.21.15.46:0/961423427 wait complete. 2023-10-19T12:42:47.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.942+0000 7f2d523ff700 1 Processor -- start 2023-10-19T12:42:47.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.943+0000 7f2d523ff700 1 -- start start 2023-10-19T12:42:47.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.943+0000 7f2d523ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2d4c1007a0 0x7f2d4c196700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:47.950 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.943+0000 7f2d523ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2d4c101990 0x7f2d4c196c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:47.950 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.943+0000 7f2d523ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d4c102330 0x7f2d4c19dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:47.950 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.943+0000 7f2d523ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d4c19e230 con 0x7f2d4c102330 2023-10-19T12:42:47.950 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.943+0000 7f2d523ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d4c19e370 con 0x7f2d4c101990 2023-10-19T12:42:47.950 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.943+0000 7f2d523ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d4c19e500 con 0x7f2d4c1007a0 2023-10-19T12:42:47.951 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.943+0000 7f2d4bfff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2d4c1007a0 0x7f2d4c196700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:47.951 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.943+0000 7f2d4bfff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2d4c1007a0 0x7f2d4c196700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:41834/0 (socket says 172.21.15.46:41834) 2023-10-19T12:42:47.951 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.943+0000 7f2d4bfff700 1 -- 172.21.15.46:0/3748891198 learned_addr learned my addr 172.21.15.46:0/3748891198 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:42:47.951 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.943+0000 7f2d4b7fe700 1 --2- 172.21.15.46:0/3748891198 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2d4c101990 0x7f2d4c196c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:47.952 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.943+0000 7f2d5099c700 1 --2- 172.21.15.46:0/3748891198 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d4c102330 0x7f2d4c19dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:47.952 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.944+0000 7f2d4bfff700 1 -- 172.21.15.46:0/3748891198 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2d4c101990 msgr2=0x7f2d4c196c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:47.952 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.944+0000 7f2d4bfff700 1 --2- 172.21.15.46:0/3748891198 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2d4c101990 0x7f2d4c196c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:47.952 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.944+0000 7f2d4bfff700 1 -- 172.21.15.46:0/3748891198 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d4c102330 msgr2=0x7f2d4c19dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:47.952 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.944+0000 7f2d4bfff700 1 --2- 172.21.15.46:0/3748891198 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d4c102330 0x7f2d4c19dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:47.953 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.944+0000 7f2d4bfff700 1 -- 172.21.15.46:0/3748891198 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d400095f0 con 0x7f2d4c1007a0 2023-10-19T12:42:47.953 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.944+0000 7f2d4bfff700 1 --2- 172.21.15.46:0/3748891198 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2d4c1007a0 0x7f2d4c196700 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c00e970 tx=0x7f2d3c00ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:47.953 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.944+0000 7f2d497fa700 1 -- 172.21.15.46:0/3748891198 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d3c009790 con 0x7f2d4c1007a0 2023-10-19T12:42:47.953 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.944+0000 7f2d497fa700 1 -- 172.21.15.46:0/3748891198 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2d3c00c7e0 con 0x7f2d4c1007a0 2023-10-19T12:42:47.954 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.944+0000 7f2d497fa700 1 -- 172.21.15.46:0/3748891198 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d3c003c70 con 0x7f2d4c1007a0 2023-10-19T12:42:47.954 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.944+0000 7f2d523ff700 1 -- 172.21.15.46:0/3748891198 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d4c19e7e0 con 0x7f2d4c1007a0 2023-10-19T12:42:47.954 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.944+0000 7f2d523ff700 1 -- 172.21.15.46:0/3748891198 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d4c19eca0 con 0x7f2d4c1007a0 2023-10-19T12:42:47.954 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.945+0000 7f2d523ff700 1 -- 172.21.15.46:0/3748891198 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d4c107c20 con 0x7f2d4c1007a0 2023-10-19T12:42:47.955 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.947+0000 7f2d497fa700 1 -- 172.21.15.46:0/3748891198 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f2d3c00cc50 con 0x7f2d4c1007a0 2023-10-19T12:42:47.955 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.948+0000 7f2d497fa700 1 --2- 172.21.15.46:0/3748891198 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f2d340a1590 0x7f2d340a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:47.955 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.949+0000 7f2d497fa700 1 -- 172.21.15.46:0/3748891198 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f2d3c014070 con 0x7f2d4c1007a0 2023-10-19T12:42:47.956 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.949+0000 7f2d4b7fe700 1 --2- 172.21.15.46:0/3748891198 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f2d340a1590 0x7f2d340a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:47.956 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.949+0000 7f2d4b7fe700 1 --2- 172.21.15.46:0/3748891198 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f2d340a1590 0x7f2d340a3a50 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2d4000b2e0 tx=0x7f2d4000b750 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:47.956 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:47.953+0000 7f2d497fa700 1 -- 172.21.15.46:0/3748891198 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f2d3c0964d0 con 0x7f2d4c1007a0 2023-10-19T12:42:48.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:47 smithi157 ceph-mon[134109]: pgmap v330: 129 pgs: 129 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-19T12:42:48.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:47 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/2118008465' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-19T12:42:48.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:47 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/3074022753' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-19T12:42:48.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:47 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/1950561786' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-19T12:42:48.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:47 smithi195 ceph-mon[134493]: pgmap v330: 129 pgs: 129 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-19T12:42:48.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:47 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/2118008465' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-19T12:42:48.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:47 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/3074022753' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-19T12:42:48.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:47 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/1950561786' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-19T12:42:48.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.164+0000 7f2d523ff700 1 -- 172.21.15.46:0/3748891198 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2d4c10c150 con 0x7f2d4c1007a0 2023-10-19T12:42:48.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.165+0000 7f2d497fa700 1 -- 172.21.15.46:0/3748891198 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v90) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2d3c003dd0 con 0x7f2d4c1007a0 2023-10-19T12:42:48.168 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2023-10-19T12:42:48.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.167+0000 7f2d523ff700 1 -- 172.21.15.46:0/3748891198 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f2d340a1590 msgr2=0x7f2d340a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:48.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.168+0000 7f2d523ff700 1 --2- 172.21.15.46:0/3748891198 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f2d340a1590 0x7f2d340a3a50 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2d4000b2e0 tx=0x7f2d4000b750 comp rx=0 tx=0).stop 2023-10-19T12:42:48.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.168+0000 7f2d523ff700 1 -- 172.21.15.46:0/3748891198 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2d4c1007a0 msgr2=0x7f2d4c196700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:48.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.168+0000 7f2d523ff700 1 --2- 172.21.15.46:0/3748891198 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2d4c1007a0 0x7f2d4c196700 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c00e970 tx=0x7f2d3c00ec80 comp rx=0 tx=0).stop 2023-10-19T12:42:48.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.168+0000 7f2d523ff700 1 -- 172.21.15.46:0/3748891198 shutdown_connections 2023-10-19T12:42:48.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.168+0000 7f2d523ff700 1 --2- 172.21.15.46:0/3748891198 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d4c102330 0x7f2d4c19dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:48.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.168+0000 7f2d523ff700 1 --2- 172.21.15.46:0/3748891198 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f2d340a1590 0x7f2d340a3a50 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:48.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.168+0000 7f2d523ff700 1 --2- 172.21.15.46:0/3748891198 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2d4c1007a0 0x7f2d4c196700 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:48.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.168+0000 7f2d523ff700 1 --2- 172.21.15.46:0/3748891198 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2d4c101990 0x7f2d4c196c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:48.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.168+0000 7f2d523ff700 1 -- 172.21.15.46:0/3748891198 >> 172.21.15.46:0/3748891198 conn(0x7f2d4c0fbcf0 msgr2=0x7f2d4c104d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:48.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.168+0000 7f2d523ff700 1 -- 172.21.15.46:0/3748891198 shutdown_connections 2023-10-19T12:42:48.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.168+0000 7f2d523ff700 1 -- 172.21.15.46:0/3748891198 wait complete. 2023-10-19T12:42:48.188 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:47 smithi046 ceph-mon[98509]: pgmap v330: 129 pgs: 129 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-19T12:42:48.188 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:47 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/2118008465' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-19T12:42:48.188 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:47 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/3074022753' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-19T12:42:48.188 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:47 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/1950561786' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-19T12:42:48.190 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-19T12:42:48.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.395+0000 7fd9171ff700 1 -- 172.21.15.46:0/2479557106 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd910102330 msgr2=0x7fd910108be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:48.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.395+0000 7fd9171ff700 1 --2- 172.21.15.46:0/2479557106 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd910102330 0x7fd910108be0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fd90800b0d0 tx=0x7fd90800b3e0 comp rx=0 tx=0).stop 2023-10-19T12:42:48.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.396+0000 7fd9171ff700 1 -- 172.21.15.46:0/2479557106 shutdown_connections 2023-10-19T12:42:48.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.396+0000 7fd9171ff700 1 --2- 172.21.15.46:0/2479557106 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd910102330 0x7fd910108be0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:48.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.396+0000 7fd9171ff700 1 --2- 172.21.15.46:0/2479557106 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd9101007a0 0x7fd910100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:48.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.396+0000 7fd9171ff700 1 --2- 172.21.15.46:0/2479557106 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd910101990 0x7fd910101df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:48.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.396+0000 7fd9171ff700 1 -- 172.21.15.46:0/2479557106 >> 172.21.15.46:0/2479557106 conn(0x7fd9100fbcf0 msgr2=0x7fd9100fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:48.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.396+0000 7fd9171ff700 1 -- 172.21.15.46:0/2479557106 shutdown_connections 2023-10-19T12:42:48.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.396+0000 7fd9171ff700 1 -- 172.21.15.46:0/2479557106 wait complete. 2023-10-19T12:42:48.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.397+0000 7fd9171ff700 1 Processor -- start 2023-10-19T12:42:48.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.397+0000 7fd9171ff700 1 -- start start 2023-10-19T12:42:48.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.397+0000 7fd9171ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd9101007a0 0x7fd910196830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:48.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.397+0000 7fd9171ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd910101990 0x7fd910196d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:48.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.397+0000 7fd9171ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd910102330 0x7fd91019dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:48.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.397+0000 7fd9171ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd91019e360 con 0x7fd910102330 2023-10-19T12:42:48.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.397+0000 7fd9171ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd91019e4a0 con 0x7fd9101007a0 2023-10-19T12:42:48.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.397+0000 7fd9171ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd91019e630 con 0x7fd910101990 2023-10-19T12:42:48.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.397+0000 7fd914f9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd9101007a0 0x7fd910196830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:48.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.397+0000 7fd91579c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd910102330 0x7fd91019dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:48.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.397+0000 7fd914f9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd9101007a0 0x7fd910196830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:43536/0 (socket says 172.21.15.46:43536) 2023-10-19T12:42:48.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.397+0000 7fd914f9b700 1 -- 172.21.15.46:0/3106296935 learned_addr learned my addr 172.21.15.46:0/3106296935 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:42:48.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.397+0000 7fd91579c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd910102330 0x7fd91019dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38866/0 (socket says 172.21.15.46:38866) 2023-10-19T12:42:48.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.397+0000 7fd90ffff700 1 --2- 172.21.15.46:0/3106296935 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd910101990 0x7fd910196d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:48.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.398+0000 7fd91579c700 1 -- 172.21.15.46:0/3106296935 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd910101990 msgr2=0x7fd910196d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:48.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.398+0000 7fd91579c700 1 --2- 172.21.15.46:0/3106296935 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd910101990 0x7fd910196d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:48.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.398+0000 7fd91579c700 1 -- 172.21.15.46:0/3106296935 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd9101007a0 msgr2=0x7fd910196830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:48.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.398+0000 7fd91579c700 1 --2- 172.21.15.46:0/3106296935 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd9101007a0 0x7fd910196830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:48.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.398+0000 7fd91579c700 1 -- 172.21.15.46:0/3106296935 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd908009d00 con 0x7fd910102330 2023-10-19T12:42:48.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.398+0000 7fd91579c700 1 --2- 172.21.15.46:0/3106296935 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd910102330 0x7fd91019dd90 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fd908007b60 tx=0x7fd908008e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:48.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.398+0000 7fd90dffb700 1 -- 172.21.15.46:0/3106296935 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90800e040 con 0x7fd910102330 2023-10-19T12:42:48.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.398+0000 7fd90dffb700 1 -- 172.21.15.46:0/3106296935 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd908005070 con 0x7fd910102330 2023-10-19T12:42:48.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.398+0000 7fd90dffb700 1 -- 172.21.15.46:0/3106296935 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90801d6d0 con 0x7fd910102330 2023-10-19T12:42:48.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.399+0000 7fd9171ff700 1 -- 172.21.15.46:0/3106296935 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd910072a20 con 0x7fd910102330 2023-10-19T12:42:48.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.399+0000 7fd9171ff700 1 -- 172.21.15.46:0/3106296935 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd910072e80 con 0x7fd910102330 2023-10-19T12:42:48.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.400+0000 7fd9171ff700 1 -- 172.21.15.46:0/3106296935 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd910107b70 con 0x7fd910102330 2023-10-19T12:42:48.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.402+0000 7fd90dffb700 1 -- 172.21.15.46:0/3106296935 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7fd9080051e0 con 0x7fd910102330 2023-10-19T12:42:48.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.403+0000 7fd90dffb700 1 --2- 172.21.15.46:0/3106296935 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fd9000a1590 0x7fd9000a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:48.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.403+0000 7fd90dffb700 1 -- 172.21.15.46:0/3106296935 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fd9080cdff0 con 0x7fd910102330 2023-10-19T12:42:48.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.404+0000 7fd914f9b700 1 --2- 172.21.15.46:0/3106296935 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fd9000a1590 0x7fd9000a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:48.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.404+0000 7fd914f9b700 1 --2- 172.21.15.46:0/3106296935 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fd9000a1590 0x7fd9000a3a50 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd904005950 tx=0x7fd904012040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:48.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.408+0000 7fd90dffb700 1 -- 172.21.15.46:0/3106296935 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd908101100 con 0x7fd910102330 2023-10-19T12:42:48.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.618+0000 7fd9171ff700 1 -- 172.21.15.46:0/3106296935 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd91010c1a0 con 0x7fd910102330 2023-10-19T12:42:48.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.618+0000 7fd90dffb700 1 -- 172.21.15.46:0/3106296935 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v90) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd9080972c0 con 0x7fd910102330 2023-10-19T12:42:48.622 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2023-10-19T12:42:48.624 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.621+0000 7fd9171ff700 1 -- 172.21.15.46:0/3106296935 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fd9000a1590 msgr2=0x7fd9000a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:48.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.621+0000 7fd9171ff700 1 --2- 172.21.15.46:0/3106296935 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fd9000a1590 0x7fd9000a3a50 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd904005950 tx=0x7fd904012040 comp rx=0 tx=0).stop 2023-10-19T12:42:48.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.621+0000 7fd9171ff700 1 -- 172.21.15.46:0/3106296935 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd910102330 msgr2=0x7fd91019dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:48.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.621+0000 7fd9171ff700 1 --2- 172.21.15.46:0/3106296935 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd910102330 0x7fd91019dd90 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fd908007b60 tx=0x7fd908008e40 comp rx=0 tx=0).stop 2023-10-19T12:42:48.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.621+0000 7fd9171ff700 1 -- 172.21.15.46:0/3106296935 shutdown_connections 2023-10-19T12:42:48.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.621+0000 7fd9171ff700 1 --2- 172.21.15.46:0/3106296935 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd910102330 0x7fd91019dd90 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:48.626 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.621+0000 7fd9171ff700 1 --2- 172.21.15.46:0/3106296935 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd9101007a0 0x7fd910196830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:48.626 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.621+0000 7fd9171ff700 1 --2- 172.21.15.46:0/3106296935 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fd9000a1590 0x7fd9000a3a50 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:48.626 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.621+0000 7fd9171ff700 1 --2- 172.21.15.46:0/3106296935 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd910101990 0x7fd910196d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:48.626 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.621+0000 7fd9171ff700 1 -- 172.21.15.46:0/3106296935 >> 172.21.15.46:0/3106296935 conn(0x7fd9100fbcf0 msgr2=0x7fd910104cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:48.626 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.621+0000 7fd9171ff700 1 -- 172.21.15.46:0/3106296935 shutdown_connections 2023-10-19T12:42:48.627 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.621+0000 7fd9171ff700 1 -- 172.21.15.46:0/3106296935 wait complete. 2023-10-19T12:42:48.643 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-19T12:42:48.853 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.850+0000 7fd7077ff700 1 -- 172.21.15.46:0/1456654305 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7001007a0 msgr2=0x7fd700100bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:48.853 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.850+0000 7fd7077ff700 1 --2- 172.21.15.46:0/1456654305 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7001007a0 0x7fd700100bc0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc0099c0 tx=0x7fd6fc009cd0 comp rx=0 tx=0).stop 2023-10-19T12:42:48.854 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.850+0000 7fd7077ff700 1 -- 172.21.15.46:0/1456654305 shutdown_connections 2023-10-19T12:42:48.854 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.850+0000 7fd7077ff700 1 --2- 172.21.15.46:0/1456654305 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd700102330 0x7fd700108be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:48.854 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.850+0000 7fd7077ff700 1 --2- 172.21.15.46:0/1456654305 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7001007a0 0x7fd700100bc0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:48.854 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.850+0000 7fd7077ff700 1 --2- 172.21.15.46:0/1456654305 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd700101990 0x7fd700101df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:48.854 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.850+0000 7fd7077ff700 1 -- 172.21.15.46:0/1456654305 >> 172.21.15.46:0/1456654305 conn(0x7fd7000fbcf0 msgr2=0x7fd7000fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:48.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.850+0000 7fd7077ff700 1 -- 172.21.15.46:0/1456654305 shutdown_connections 2023-10-19T12:42:48.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.850+0000 7fd7077ff700 1 -- 172.21.15.46:0/1456654305 wait complete. 2023-10-19T12:42:48.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.851+0000 7fd7077ff700 1 Processor -- start 2023-10-19T12:42:48.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.851+0000 7fd7077ff700 1 -- start start 2023-10-19T12:42:48.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.851+0000 7fd7077ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd7001007a0 0x7fd700198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:48.858 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.851+0000 7fd7077ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd700101990 0x7fd700198e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:48.858 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.851+0000 7fd7077ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd700102330 0x7fd70019fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:48.858 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.851+0000 7fd7077ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7001a0450 con 0x7fd700102330 2023-10-19T12:42:48.858 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.851+0000 7fd7077ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7001a0590 con 0x7fd700101990 2023-10-19T12:42:48.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.851+0000 7fd7077ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7001a0720 con 0x7fd7001007a0 2023-10-19T12:42:48.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.852+0000 7fd705d9c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd700102330 0x7fd70019fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:48.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.852+0000 7fd705d9c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd700102330 0x7fd70019fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38886/0 (socket says 172.21.15.46:38886) 2023-10-19T12:42:48.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.852+0000 7fd704d9a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd700101990 0x7fd700198e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:48.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.852+0000 7fd705d9c700 1 -- 172.21.15.46:0/1981430057 learned_addr learned my addr 172.21.15.46:0/1981430057 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:42:48.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.852+0000 7fd70559b700 1 --2- 172.21.15.46:0/1981430057 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd7001007a0 0x7fd700198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:48.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.852+0000 7fd705d9c700 1 -- 172.21.15.46:0/1981430057 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd7001007a0 msgr2=0x7fd700198920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:48.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.852+0000 7fd705d9c700 1 --2- 172.21.15.46:0/1981430057 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd7001007a0 0x7fd700198920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:48.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.852+0000 7fd705d9c700 1 -- 172.21.15.46:0/1981430057 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd700101990 msgr2=0x7fd700198e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:48.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.852+0000 7fd705d9c700 1 --2- 172.21.15.46:0/1981430057 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd700101990 0x7fd700198e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:48.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.852+0000 7fd705d9c700 1 -- 172.21.15.46:0/1981430057 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6fc0095f0 con 0x7fd700102330 2023-10-19T12:42:48.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.852+0000 7fd704d9a700 1 --2- 172.21.15.46:0/1981430057 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd700101990 0x7fd700198e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:42:48.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.853+0000 7fd705d9c700 1 --2- 172.21.15.46:0/1981430057 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd700102330 0x7fd70019fe80 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd6f800ef30 tx=0x7fd6f800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:48.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.853+0000 7fd6f67fc700 1 -- 172.21.15.46:0/1981430057 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f8018070 con 0x7fd700102330 2023-10-19T12:42:48.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.853+0000 7fd6f67fc700 1 -- 172.21.15.46:0/1981430057 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd6f800f040 con 0x7fd700102330 2023-10-19T12:42:48.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.853+0000 7fd7077ff700 1 -- 172.21.15.46:0/1981430057 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7001a09a0 con 0x7fd700102330 2023-10-19T12:42:48.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.853+0000 7fd6f67fc700 1 -- 172.21.15.46:0/1981430057 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f800cd00 con 0x7fd700102330 2023-10-19T12:42:48.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.853+0000 7fd7077ff700 1 -- 172.21.15.46:0/1981430057 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7001a0e60 con 0x7fd700102330 2023-10-19T12:42:48.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.854+0000 7fd7077ff700 1 -- 172.21.15.46:0/1981430057 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7000675a0 con 0x7fd700102330 2023-10-19T12:42:48.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.856+0000 7fd6f67fc700 1 -- 172.21.15.46:0/1981430057 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7fd6f8003a00 con 0x7fd700102330 2023-10-19T12:42:48.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.857+0000 7fd6f67fc700 1 --2- 172.21.15.46:0/1981430057 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fd6ec0a1510 0x7fd6ec0a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:48.864 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.857+0000 7fd6f67fc700 1 -- 172.21.15.46:0/1981430057 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fd6f80cd6b0 con 0x7fd700102330 2023-10-19T12:42:48.864 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.858+0000 7fd70559b700 1 --2- 172.21.15.46:0/1981430057 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fd6ec0a1510 0x7fd6ec0a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:48.864 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.858+0000 7fd70559b700 1 --2- 172.21.15.46:0/1981430057 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fd6ec0a1510 0x7fd6ec0a39d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc003730 tx=0x7fd6fc000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:48.864 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:48.860+0000 7fd6f67fc700 1 -- 172.21.15.46:0/1981430057 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd6f80968d0 con 0x7fd700102330 2023-10-19T12:42:48.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:48 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/3748891198' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-19T12:42:48.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:48 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/3106296935' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-19T12:42:49.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.074+0000 7fd7077ff700 1 -- 172.21.15.46:0/1981430057 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fd70010c190 con 0x7fd700102330 2023-10-19T12:42:49.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.075+0000 7fd6f67fc700 1 -- 172.21.15.46:0/1981430057 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v90) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd6f8099ef0 con 0x7fd700102330 2023-10-19T12:42:49.078 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2023-10-19T12:42:49.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.077+0000 7fd7077ff700 1 -- 172.21.15.46:0/1981430057 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fd6ec0a1510 msgr2=0x7fd6ec0a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:49.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.077+0000 7fd7077ff700 1 --2- 172.21.15.46:0/1981430057 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fd6ec0a1510 0x7fd6ec0a39d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc003730 tx=0x7fd6fc000bc0 comp rx=0 tx=0).stop 2023-10-19T12:42:49.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.077+0000 7fd7077ff700 1 -- 172.21.15.46:0/1981430057 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd700102330 msgr2=0x7fd70019fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:49.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.077+0000 7fd7077ff700 1 --2- 172.21.15.46:0/1981430057 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd700102330 0x7fd70019fe80 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd6f800ef30 tx=0x7fd6f800c3a0 comp rx=0 tx=0).stop 2023-10-19T12:42:49.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.077+0000 7fd7077ff700 1 -- 172.21.15.46:0/1981430057 shutdown_connections 2023-10-19T12:42:49.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.077+0000 7fd7077ff700 1 --2- 172.21.15.46:0/1981430057 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd700102330 0x7fd70019fe80 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:49.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.077+0000 7fd7077ff700 1 --2- 172.21.15.46:0/1981430057 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fd6ec0a1510 0x7fd6ec0a39d0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:49.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.077+0000 7fd7077ff700 1 --2- 172.21.15.46:0/1981430057 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd7001007a0 0x7fd700198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:49.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.077+0000 7fd7077ff700 1 --2- 172.21.15.46:0/1981430057 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd700101990 0x7fd700198e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:49.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.077+0000 7fd7077ff700 1 -- 172.21.15.46:0/1981430057 >> 172.21.15.46:0/1981430057 conn(0x7fd7000fbcf0 msgr2=0x7fd700072a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:49.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.078+0000 7fd7077ff700 1 -- 172.21.15.46:0/1981430057 shutdown_connections 2023-10-19T12:42:49.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.078+0000 7fd7077ff700 1 -- 172.21.15.46:0/1981430057 wait complete. 2023-10-19T12:42:49.138 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:48 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/3748891198' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-19T12:42:49.138 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:48 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/3106296935' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-19T12:42:49.138 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:48 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/3748891198' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-19T12:42:49.138 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:48 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/3106296935' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-19T12:42:49.140 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-19T12:42:49.346 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.342+0000 7f96617ff700 1 -- 172.21.15.46:0/1105835214 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f965c0731f0 msgr2=0x7f965c073670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:49.346 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.342+0000 7f96617ff700 1 --2- 172.21.15.46:0/1105835214 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f965c0731f0 0x7f965c073670 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f9644009990 tx=0x7f9644009ca0 comp rx=0 tx=0).stop 2023-10-19T12:42:49.347 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.343+0000 7f96617ff700 1 -- 172.21.15.46:0/1105835214 shutdown_connections 2023-10-19T12:42:49.347 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.343+0000 7f96617ff700 1 --2- 172.21.15.46:0/1105835214 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f965c108610 0x7f965c10aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:49.347 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.343+0000 7f96617ff700 1 --2- 172.21.15.46:0/1105835214 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f965c0747d0 0x7f965c072c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:49.347 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.343+0000 7f96617ff700 1 --2- 172.21.15.46:0/1105835214 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f965c0731f0 0x7f965c073670 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:49.347 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.343+0000 7f96617ff700 1 -- 172.21.15.46:0/1105835214 >> 172.21.15.46:0/1105835214 conn(0x7f965c0fbc90 msgr2=0x7f965c0fe0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:49.348 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.343+0000 7f96617ff700 1 -- 172.21.15.46:0/1105835214 shutdown_connections 2023-10-19T12:42:49.348 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.343+0000 7f96617ff700 1 -- 172.21.15.46:0/1105835214 wait complete. 2023-10-19T12:42:49.350 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.344+0000 7f96617ff700 1 Processor -- start 2023-10-19T12:42:49.350 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.344+0000 7f96617ff700 1 -- start start 2023-10-19T12:42:49.350 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.344+0000 7f96617ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f965c0731f0 0x7f965c198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:49.351 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.344+0000 7f96617ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f965c0747d0 0x7f965c198e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:49.351 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.344+0000 7f96617ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f965c108610 0x7f965c19fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:49.351 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.344+0000 7f96617ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f965c1a0450 con 0x7f965c0747d0 2023-10-19T12:42:49.351 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.344+0000 7f96617ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f965c1a0590 con 0x7f965c108610 2023-10-19T12:42:49.351 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.344+0000 7f96617ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f965c1a0720 con 0x7f965c0731f0 2023-10-19T12:42:49.352 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.344+0000 7f9653fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f965c0747d0 0x7f965c198e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:49.352 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.345+0000 7f9653fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f965c0747d0 0x7f965c198e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38910/0 (socket says 172.21.15.46:38910) 2023-10-19T12:42:49.352 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.345+0000 7f9653fff700 1 -- 172.21.15.46:0/887937666 learned_addr learned my addr 172.21.15.46:0/887937666 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:42:49.352 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.345+0000 7f965affd700 1 --2- 172.21.15.46:0/887937666 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f965c0731f0 0x7f965c198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:49.352 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.345+0000 7f965b7fe700 1 --2- 172.21.15.46:0/887937666 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f965c108610 0x7f965c19fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:49.353 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.345+0000 7f9653fff700 1 -- 172.21.15.46:0/887937666 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f965c0731f0 msgr2=0x7f965c198920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:49.353 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.345+0000 7f9653fff700 1 --2- 172.21.15.46:0/887937666 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f965c0731f0 0x7f965c198920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:49.353 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.345+0000 7f9653fff700 1 -- 172.21.15.46:0/887937666 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f965c108610 msgr2=0x7f965c19fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:49.353 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.345+0000 7f9653fff700 1 --2- 172.21.15.46:0/887937666 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f965c108610 0x7f965c19fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:49.353 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.345+0000 7f9653fff700 1 -- 172.21.15.46:0/887937666 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96440095f0 con 0x7f965c0747d0 2023-10-19T12:42:49.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.345+0000 7f9653fff700 1 --2- 172.21.15.46:0/887937666 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f965c0747d0 0x7f965c198e60 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f9644006010 tx=0x7f9644004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:49.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.345+0000 7f9658ff9700 1 -- 172.21.15.46:0/887937666 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f964401d070 con 0x7f965c0747d0 2023-10-19T12:42:49.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.346+0000 7f9658ff9700 1 -- 172.21.15.46:0/887937666 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9644005030 con 0x7f965c0747d0 2023-10-19T12:42:49.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.346+0000 7f96617ff700 1 -- 172.21.15.46:0/887937666 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f965c1a09a0 con 0x7f965c0747d0 2023-10-19T12:42:49.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.346+0000 7f9658ff9700 1 -- 172.21.15.46:0/887937666 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9644004b40 con 0x7f965c0747d0 2023-10-19T12:42:49.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.346+0000 7f96617ff700 1 -- 172.21.15.46:0/887937666 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f965c1a0e20 con 0x7f965c0747d0 2023-10-19T12:42:49.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.347+0000 7f96617ff700 1 -- 172.21.15.46:0/887937666 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f965c107420 con 0x7f965c0747d0 2023-10-19T12:42:49.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.349+0000 7f9658ff9700 1 -- 172.21.15.46:0/887937666 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f9644004d20 con 0x7f965c0747d0 2023-10-19T12:42:49.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.350+0000 7f9658ff9700 1 --2- 172.21.15.46:0/887937666 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f96480a1590 0x7f96480a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:49.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.350+0000 7f9658ff9700 1 -- 172.21.15.46:0/887937666 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f96440ce260 con 0x7f965c0747d0 2023-10-19T12:42:49.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.350+0000 7f965affd700 1 --2- 172.21.15.46:0/887937666 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f96480a1590 0x7f96480a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:49.357 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.351+0000 7f965affd700 1 --2- 172.21.15.46:0/887937666 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f96480a1590 0x7f96480a3a50 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f964c009c60 tx=0x7f964c009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:49.357 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.354+0000 7f9658ff9700 1 -- 172.21.15.46:0/887937666 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f9644097480 con 0x7f965c0747d0 2023-10-19T12:42:49.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.615+0000 7f96617ff700 1 -- 172.21.15.46:0/887937666 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f965c067500 con 0x7f965c0747d0 2023-10-19T12:42:49.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.616+0000 7f9658ff9700 1 -- 172.21.15.46:0/887937666 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+11372 (secure 0 0 0) 0x7f964409aaa0 con 0x7f965c0747d0 2023-10-19T12:42:49.619 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:42:49.619 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14580,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/2235286008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":2235286008},{"type":"v1","addr":"172.21.15.46:6835","nonce":2235286008}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14592,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/339398444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":339398444},{"type":"v1","addr":"172.21.15.46:6837","nonce":339398444}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-19T12:41:18.815780+0000","modified":"2023-10-19T12:41:47.301944+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24680,"mds_1":24655,"mds_2":24643,"mds_3":24631,"mds_4":24629},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14640":{"gid":14640,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.46:6839/1655843965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":1655843965},{"type":"v1","addr":"172.21.15.46:6839","nonce":1655843965}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14652":{"gid":14652,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.46:6841/4204925553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6840","nonce":4204925553},{"type":"v1","addr":"172.21.15.46:6841","nonce":4204925553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24560":{"gid":24560,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.157:6833/1687745569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":1687745569},{"type":"v1","addr":"172.21.15.157:6833","nonce":1687745569}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24574":{"gid":24574,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.195:6833/3629933235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3629933235},{"type":"v1","addr":"172.21.15.195:6833","nonce":3629933235}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24602":{"gid":24602,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.157:6835/108432552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":108432552},{"type":"v1","addr":"172.21.15.157:6835","nonce":108432552}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24629":{"gid":24629,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":13,"addr":"172.21.15.157:6837/2629536514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6836","nonce":2629536514},{"type":"v1","addr":"172.21.15.157:6837","nonce":2629536514}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24631":{"gid":24631,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.195:6835/1406909915","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":1406909915},{"type":"v1","addr":"172.21.15.195:6835","nonce":1406909915}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24643":{"gid":24643,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":13,"addr":"172.21.15.195:6837/293916188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":293916188},{"type":"v1","addr":"172.21.15.195:6837","nonce":293916188}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24655":{"gid":24655,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":11,"addr":"172.21.15.195:6839/4094901934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6838","nonce":4094901934},{"type":"v1","addr":"172.21.15.195:6839","nonce":4094901934}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24680":{"gid":24680,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.157:6839/552718978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6838","nonce":552718978},{"type":"v1","addr":"172.21.15.157:6839","nonce":552718978}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-19T12:42:49.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.618+0000 7f96617ff700 1 -- 172.21.15.46:0/887937666 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f96480a1590 msgr2=0x7f96480a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:49.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.618+0000 7f96617ff700 1 --2- 172.21.15.46:0/887937666 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f96480a1590 0x7f96480a3a50 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f964c009c60 tx=0x7f964c009260 comp rx=0 tx=0).stop 2023-10-19T12:42:49.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.618+0000 7f96617ff700 1 -- 172.21.15.46:0/887937666 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f965c0747d0 msgr2=0x7f965c198e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:49.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.618+0000 7f96617ff700 1 --2- 172.21.15.46:0/887937666 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f965c0747d0 0x7f965c198e60 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f9644006010 tx=0x7f9644004730 comp rx=0 tx=0).stop 2023-10-19T12:42:49.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.618+0000 7f96617ff700 1 -- 172.21.15.46:0/887937666 shutdown_connections 2023-10-19T12:42:49.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.618+0000 7f96617ff700 1 --2- 172.21.15.46:0/887937666 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f965c108610 0x7f965c19fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:49.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.618+0000 7f96617ff700 1 --2- 172.21.15.46:0/887937666 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f96480a1590 0x7f96480a3a50 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:49.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.618+0000 7f96617ff700 1 --2- 172.21.15.46:0/887937666 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f965c0731f0 0x7f965c198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:49.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.618+0000 7f96617ff700 1 --2- 172.21.15.46:0/887937666 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f965c0747d0 0x7f965c198e60 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:49.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.618+0000 7f96617ff700 1 -- 172.21.15.46:0/887937666 >> 172.21.15.46:0/887937666 conn(0x7f965c0fbc90 msgr2=0x7f965c104560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:49.624 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.619+0000 7f96617ff700 1 -- 172.21.15.46:0/887937666 shutdown_connections 2023-10-19T12:42:49.624 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.619+0000 7f96617ff700 1 -- 172.21.15.46:0/887937666 wait complete. 2023-10-19T12:42:49.624 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 27 2023-10-19T12:42:49.641 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-19T12:42:49.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.844+0000 7f57359ff700 1 -- 172.21.15.46:0/1251066389 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5730108610 msgr2=0x7f573010aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:49.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.844+0000 7f57359ff700 1 --2- 172.21.15.46:0/1251066389 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5730108610 0x7f573010aa80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f572800b0a0 tx=0x7f572800b3b0 comp rx=0 tx=0).stop 2023-10-19T12:42:49.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.844+0000 7f57359ff700 1 -- 172.21.15.46:0/1251066389 shutdown_connections 2023-10-19T12:42:49.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.844+0000 7f57359ff700 1 --2- 172.21.15.46:0/1251066389 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5730108610 0x7f573010aa80 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:49.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.844+0000 7f57359ff700 1 --2- 172.21.15.46:0/1251066389 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f57300747d0 0x7f5730072c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:49.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.844+0000 7f57359ff700 1 --2- 172.21.15.46:0/1251066389 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f57300731f0 0x7f5730073670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:49.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.844+0000 7f57359ff700 1 -- 172.21.15.46:0/1251066389 >> 172.21.15.46:0/1251066389 conn(0x7f57300fbc90 msgr2=0x7f57300fe0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:49.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.844+0000 7f57359ff700 1 -- 172.21.15.46:0/1251066389 shutdown_connections 2023-10-19T12:42:49.850 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.844+0000 7f57359ff700 1 -- 172.21.15.46:0/1251066389 wait complete. 2023-10-19T12:42:49.852 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.846+0000 7f57359ff700 1 Processor -- start 2023-10-19T12:42:49.852 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.846+0000 7f57359ff700 1 -- start start 2023-10-19T12:42:49.852 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.846+0000 7f57359ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f57300731f0 0x7f5730198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:49.853 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.846+0000 7f57359ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f57300747d0 0x7f5730198f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:49.853 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.847+0000 7f57359ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5730108610 0x7f573019ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:49.853 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.847+0000 7f57359ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57301a0510 con 0x7f57300747d0 2023-10-19T12:42:49.853 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.847+0000 7f57359ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57301a0650 con 0x7f5730108610 2023-10-19T12:42:49.853 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.847+0000 7f57359ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57301a07e0 con 0x7f57300731f0 2023-10-19T12:42:49.853 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.847+0000 7f5727fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f57300747d0 0x7f5730198f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:49.854 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.847+0000 7f5727fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f57300747d0 0x7f5730198f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38914/0 (socket says 172.21.15.46:38914) 2023-10-19T12:42:49.854 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.847+0000 7f5727fff700 1 -- 172.21.15.46:0/268118897 learned_addr learned my addr 172.21.15.46:0/268118897 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:42:49.854 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.847+0000 7f572effd700 1 --2- 172.21.15.46:0/268118897 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f57300731f0 0x7f5730198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:49.854 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.847+0000 7f572f7fe700 1 --2- 172.21.15.46:0/268118897 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5730108610 0x7f573019ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:49.854 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.847+0000 7f5727fff700 1 -- 172.21.15.46:0/268118897 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f57300731f0 msgr2=0x7f5730198a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:49.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.847+0000 7f5727fff700 1 --2- 172.21.15.46:0/268118897 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f57300731f0 0x7f5730198a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:49.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.847+0000 7f5727fff700 1 -- 172.21.15.46:0/268118897 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5730108610 msgr2=0x7f573019ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:49.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.847+0000 7f5727fff700 1 --2- 172.21.15.46:0/268118897 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5730108610 0x7f573019ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:49.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.847+0000 7f5727fff700 1 -- 172.21.15.46:0/268118897 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5718009520 con 0x7f57300747d0 2023-10-19T12:42:49.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.847+0000 7f5727fff700 1 --2- 172.21.15.46:0/268118897 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f57300747d0 0x7f5730198f70 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f571800eb30 tx=0x7f571800ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:49.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.848+0000 7f57349fd700 1 -- 172.21.15.46:0/268118897 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5718009880 con 0x7f57300747d0 2023-10-19T12:42:49.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.848+0000 7f57349fd700 1 -- 172.21.15.46:0/268118897 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f57180044e0 con 0x7f57300747d0 2023-10-19T12:42:49.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.848+0000 7f57359ff700 1 -- 172.21.15.46:0/268118897 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5728009d00 con 0x7f57300747d0 2023-10-19T12:42:49.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.848+0000 7f57349fd700 1 -- 172.21.15.46:0/268118897 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5718003e90 con 0x7f57300747d0 2023-10-19T12:42:49.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.848+0000 7f57359ff700 1 -- 172.21.15.46:0/268118897 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57301a0e90 con 0x7f57300747d0 2023-10-19T12:42:49.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.849+0000 7f57359ff700 1 -- 172.21.15.46:0/268118897 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5730107420 con 0x7f57300747d0 2023-10-19T12:42:49.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.851+0000 7f57349fd700 1 -- 172.21.15.46:0/268118897 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f5718004000 con 0x7f57300747d0 2023-10-19T12:42:49.858 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.854+0000 7f57349fd700 1 --2- 172.21.15.46:0/268118897 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f571c0a1590 0x7f571c0a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:49.858 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.855+0000 7f57349fd700 1 -- 172.21.15.46:0/268118897 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f5718014070 con 0x7f57300747d0 2023-10-19T12:42:49.858 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.855+0000 7f572effd700 1 --2- 172.21.15.46:0/268118897 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f571c0a1590 0x7f571c0a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:49.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.855+0000 7f572effd700 1 --2- 172.21.15.46:0/268118897 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f571c0a1590 0x7f571c0a3a50 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5720009c60 tx=0x7f5720009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:49.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:49.858+0000 7f57349fd700 1 -- 172.21.15.46:0/268118897 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5718096780 con 0x7f57300747d0 2023-10-19T12:42:49.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:49 smithi046 ceph-mon[98509]: pgmap v331: 129 pgs: 129 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-19T12:42:49.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:49 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/1981430057' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-19T12:42:49.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:49 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/887937666' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-19T12:42:50.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.072+0000 7f57359ff700 1 -- 172.21.15.46:0/268118897 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5730067530 con 0x7f57300747d0 2023-10-19T12:42:50.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.074+0000 7f57349fd700 1 -- 172.21.15.46:0/268118897 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+24481 (secure 0 0 0) 0x7f5718099da0 con 0x7f57300747d0 2023-10-19T12:42:50.077 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:42:50.078 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":90,"fsid":"96a8be3c-6e7b-11ee-8db6-212e2dc638e7","created":"2023-10-19T12:33:26.148713+0000","modified":"2023-10-19T12:42:28.113339+0000","last_up_change":"2023-10-19T12:40:30.761679+0000","last_in_change":"2023-10-19T12:40:13.663559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-19T12:37:07.175795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-19T12:41:16.895203+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-19T12:41:18.255601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-19T12:41:21.830455+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"346ce86b-a10a-4869-9fdb-c3c1d4161455","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6803","nonce":500237995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6805","nonce":500237995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6809","nonce":500237995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6807","nonce":500237995}]},"public_addr":"172.21.15.46:6803/500237995","cluster_addr":"172.21.15.46:6805/500237995","heartbeat_back_addr":"172.21.15.46:6809/500237995","heartbeat_front_addr":"172.21.15.46:6807/500237995","state":["exists","up"]},{"osd":1,"uuid":"02aae687-76c5-4124-bae4-9787ed571c28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6801","nonce":2496862790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6803","nonce":2496862790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6807","nonce":2496862790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6805","nonce":2496862790}]},"public_addr":"172.21.15.157:6801/2496862790","cluster_addr":"172.21.15.157:6803/2496862790","heartbeat_back_addr":"172.21.15.157:6807/2496862790","heartbeat_front_addr":"172.21.15.157:6805/2496862790","state":["exists","up"]},{"osd":2,"uuid":"d5360828-1f58-4380-b2ad-0c21ff850981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6801","nonce":4211767276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6803","nonce":4211767276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6807","nonce":4211767276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6805","nonce":4211767276}]},"public_addr":"172.21.15.195:6801/4211767276","cluster_addr":"172.21.15.195:6803/4211767276","heartbeat_back_addr":"172.21.15.195:6807/4211767276","heartbeat_front_addr":"172.21.15.195:6805/4211767276","state":["exists","up"]},{"osd":3,"uuid":"accb780f-49d0-43f8-b166-ee12c558ef00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6811","nonce":1964113352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6813","nonce":1964113352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6817","nonce":1964113352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6815","nonce":1964113352}]},"public_addr":"172.21.15.46:6811/1964113352","cluster_addr":"172.21.15.46:6813/1964113352","heartbeat_back_addr":"172.21.15.46:6817/1964113352","heartbeat_front_addr":"172.21.15.46:6815/1964113352","state":["exists","up"]},{"osd":4,"uuid":"e662886d-e989-4d02-8c1f-3c4671352b0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6809","nonce":3636910144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6811","nonce":3636910144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6815","nonce":3636910144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6813","nonce":3636910144}]},"public_addr":"172.21.15.157:6809/3636910144","cluster_addr":"172.21.15.157:6811/3636910144","heartbeat_back_addr":"172.21.15.157:6815/3636910144","heartbeat_front_addr":"172.21.15.157:6813/3636910144","state":["exists","up"]},{"osd":5,"uuid":"9597e0ce-14ea-407d-90fe-f74bccee38b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6809","nonce":4071287969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6811","nonce":4071287969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6815","nonce":4071287969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6813","nonce":4071287969}]},"public_addr":"172.21.15.195:6809/4071287969","cluster_addr":"172.21.15.195:6811/4071287969","heartbeat_back_addr":"172.21.15.195:6815/4071287969","heartbeat_front_addr":"172.21.15.195:6813/4071287969","state":["exists","up"]},{"osd":6,"uuid":"6b78ba38-f60e-4cb6-b01c-cecc1820e8e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6819","nonce":1842285555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6821","nonce":1842285555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6825","nonce":1842285555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6823","nonce":1842285555}]},"public_addr":"172.21.15.46:6819/1842285555","cluster_addr":"172.21.15.46:6821/1842285555","heartbeat_back_addr":"172.21.15.46:6825/1842285555","heartbeat_front_addr":"172.21.15.46:6823/1842285555","state":["exists","up"]},{"osd":7,"uuid":"59a0899f-3bcd-4db2-b544-24df3a536749","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6817","nonce":3498672588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6819","nonce":3498672588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6823","nonce":3498672588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6821","nonce":3498672588}]},"public_addr":"172.21.15.157:6817/3498672588","cluster_addr":"172.21.15.157:6819/3498672588","heartbeat_back_addr":"172.21.15.157:6823/3498672588","heartbeat_front_addr":"172.21.15.157:6821/3498672588","state":["exists","up"]},{"osd":8,"uuid":"9c3c9835-043a-4fb5-a9ee-edf8caf6b605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6817","nonce":74230104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6819","nonce":74230104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6823","nonce":74230104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6821","nonce":74230104}]},"public_addr":"172.21.15.195:6817/74230104","cluster_addr":"172.21.15.195:6819/74230104","heartbeat_back_addr":"172.21.15.195:6823/74230104","heartbeat_front_addr":"172.21.15.195:6821/74230104","state":["exists","up"]},{"osd":9,"uuid":"3f18f506-a577-4b7c-ae0d-9351c07e81f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6827","nonce":3472581046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6829","nonce":3472581046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6833","nonce":3472581046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6831","nonce":3472581046}]},"public_addr":"172.21.15.46:6827/3472581046","cluster_addr":"172.21.15.46:6829/3472581046","heartbeat_back_addr":"172.21.15.46:6833/3472581046","heartbeat_front_addr":"172.21.15.46:6831/3472581046","state":["exists","up"]},{"osd":10,"uuid":"1ed01854-443a-4acf-9293-7ca0d451a93d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6825","nonce":2378416559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6827","nonce":2378416559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6831","nonce":2378416559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6829","nonce":2378416559}]},"public_addr":"172.21.15.157:6825/2378416559","cluster_addr":"172.21.15.157:6827/2378416559","heartbeat_back_addr":"172.21.15.157:6831/2378416559","heartbeat_front_addr":"172.21.15.157:6829/2378416559","state":["exists","up"]},{"osd":11,"uuid":"021398c0-9184-4647-8220-e40f6705ca90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6825","nonce":3075632222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6827","nonce":3075632222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6831","nonce":3075632222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6829","nonce":3075632222}]},"public_addr":"172.21.15.195:6825/3075632222","cluster_addr":"172.21.15.195:6827/3075632222","heartbeat_back_addr":"172.21.15.195:6831/3075632222","heartbeat_front_addr":"172.21.15.195:6829/3075632222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:36:22.002614+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:36:44.098031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:37:04.518341+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:37:30.796462+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:37:52.756555+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:38:13.403168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:38:39.058472+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:39:01.106893+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:39:21.908334+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:39:46.843884+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:40:08.792020+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:40:29.282974+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":3,"to":6}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.39","mappings":[{"from":5,"to":8}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.46:0/3248595150":"2023-10-20T12:34:26.552115+0000","172.21.15.46:0/3624849341":"2023-10-20T12:34:26.552115+0000","172.21.15.46:0/1844094590":"2023-10-20T12:34:26.552115+0000","172.21.15.46:6801/20022894":"2023-10-20T12:34:26.552115+0000","172.21.15.46:0/3969790632":"2023-10-20T12:34:00.135248+0000","172.21.15.46:0/2331135821":"2023-10-20T12:34:00.135248+0000","172.21.15.46:6800/51664346":"2023-10-20T12:34:00.135248+0000","172.21.15.46:6801/51664346":"2023-10-20T12:34:00.135248+0000","172.21.15.46:0/585851467":"2023-10-20T12:34:00.135248+0000","172.21.15.46:6800/20022894":"2023-10-20T12:34:26.552115+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-19T12:42:50.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.076+0000 7f57359ff700 1 -- 172.21.15.46:0/268118897 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f571c0a1590 msgr2=0x7f571c0a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:50.080 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.076+0000 7f57359ff700 1 --2- 172.21.15.46:0/268118897 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f571c0a1590 0x7f571c0a3a50 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5720009c60 tx=0x7f5720009260 comp rx=0 tx=0).stop 2023-10-19T12:42:50.080 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.076+0000 7f57359ff700 1 -- 172.21.15.46:0/268118897 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f57300747d0 msgr2=0x7f5730198f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:50.080 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.076+0000 7f57359ff700 1 --2- 172.21.15.46:0/268118897 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f57300747d0 0x7f5730198f70 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f571800eb30 tx=0x7f571800ee40 comp rx=0 tx=0).stop 2023-10-19T12:42:50.080 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.076+0000 7f57359ff700 1 -- 172.21.15.46:0/268118897 shutdown_connections 2023-10-19T12:42:50.080 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.076+0000 7f57359ff700 1 --2- 172.21.15.46:0/268118897 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5730108610 0x7f573019ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:50.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.076+0000 7f57359ff700 1 --2- 172.21.15.46:0/268118897 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f571c0a1590 0x7f571c0a3a50 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:50.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.076+0000 7f57359ff700 1 --2- 172.21.15.46:0/268118897 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f57300731f0 0x7f5730198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:50.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.076+0000 7f57359ff700 1 --2- 172.21.15.46:0/268118897 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f57300747d0 0x7f5730198f70 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:50.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.076+0000 7f57359ff700 1 -- 172.21.15.46:0/268118897 >> 172.21.15.46:0/268118897 conn(0x7f57300fbc90 msgr2=0x7f5730104560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:50.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.076+0000 7f57359ff700 1 -- 172.21.15.46:0/268118897 shutdown_connections 2023-10-19T12:42:50.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.076+0000 7f57359ff700 1 -- 172.21.15.46:0/268118897 wait complete. 2023-10-19T12:42:50.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:49 smithi157 ceph-mon[134109]: pgmap v331: 129 pgs: 129 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-19T12:42:50.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:49 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/1981430057' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-19T12:42:50.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:49 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/887937666' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-19T12:42:50.099 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-19T12:42:50.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:49 smithi195 ceph-mon[134493]: pgmap v331: 129 pgs: 129 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-19T12:42:50.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:49 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/1981430057' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-19T12:42:50.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:49 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/887937666' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-19T12:42:50.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.301+0000 7fb5f83ff700 1 -- 172.21.15.46:0/793441040 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb5f0100740 msgr2=0x7fb5f0100b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:50.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.301+0000 7fb5f83ff700 1 --2- 172.21.15.46:0/793441040 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb5f0100740 0x7fb5f0100b60 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec0099c0 tx=0x7fb5ec009cd0 comp rx=0 tx=0).stop 2023-10-19T12:42:50.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.301+0000 7fb5f83ff700 1 -- 172.21.15.46:0/793441040 shutdown_connections 2023-10-19T12:42:50.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.301+0000 7fb5f83ff700 1 --2- 172.21.15.46:0/793441040 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb5f01022d0 0x7fb5f0108b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:50.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.301+0000 7fb5f83ff700 1 --2- 172.21.15.46:0/793441040 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb5f0100740 0x7fb5f0100b60 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:50.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.301+0000 7fb5f83ff700 1 --2- 172.21.15.46:0/793441040 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb5f0101930 0x7fb5f0101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:50.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.301+0000 7fb5f83ff700 1 -- 172.21.15.46:0/793441040 >> 172.21.15.46:0/793441040 conn(0x7fb5f00fbc90 msgr2=0x7fb5f00fe0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:50.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.301+0000 7fb5f83ff700 1 -- 172.21.15.46:0/793441040 shutdown_connections 2023-10-19T12:42:50.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.301+0000 7fb5f83ff700 1 -- 172.21.15.46:0/793441040 wait complete. 2023-10-19T12:42:50.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.302+0000 7fb5f83ff700 1 Processor -- start 2023-10-19T12:42:50.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.302+0000 7fb5f83ff700 1 -- start start 2023-10-19T12:42:50.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.303+0000 7fb5f83ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb5f0100740 0x7fb5f01988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:50.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.303+0000 7fb5f83ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb5f0101930 0x7fb5f0198e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:50.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.303+0000 7fb5f83ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb5f01022d0 0x7fb5f019fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:50.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.303+0000 7fb5f83ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f01a0420 con 0x7fb5f0100740 2023-10-19T12:42:50.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.303+0000 7fb5f83ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f01a0560 con 0x7fb5f0101930 2023-10-19T12:42:50.311 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.303+0000 7fb5f83ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f01a06f0 con 0x7fb5f01022d0 2023-10-19T12:42:50.311 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.303+0000 7fb5f619b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb5f0100740 0x7fb5f01988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:50.311 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.303+0000 7fb5f619b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb5f0100740 0x7fb5f01988f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38928/0 (socket says 172.21.15.46:38928) 2023-10-19T12:42:50.311 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.303+0000 7fb5f619b700 1 -- 172.21.15.46:0/200763394 learned_addr learned my addr 172.21.15.46:0/200763394 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:42:50.311 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.303+0000 7fb5f599a700 1 --2- 172.21.15.46:0/200763394 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb5f0101930 0x7fb5f0198e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:50.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.303+0000 7fb5f699c700 1 --2- 172.21.15.46:0/200763394 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb5f01022d0 0x7fb5f019fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:50.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.303+0000 7fb5f619b700 1 -- 172.21.15.46:0/200763394 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb5f01022d0 msgr2=0x7fb5f019fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:50.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.303+0000 7fb5f619b700 1 --2- 172.21.15.46:0/200763394 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb5f01022d0 0x7fb5f019fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:50.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.303+0000 7fb5f619b700 1 -- 172.21.15.46:0/200763394 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb5f0101930 msgr2=0x7fb5f0198e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:50.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.303+0000 7fb5f619b700 1 --2- 172.21.15.46:0/200763394 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb5f0101930 0x7fb5f0198e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:50.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.303+0000 7fb5f619b700 1 -- 172.21.15.46:0/200763394 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5ec0095f0 con 0x7fb5f0100740 2023-10-19T12:42:50.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.303+0000 7fb5f699c700 1 --2- 172.21.15.46:0/200763394 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb5f01022d0 0x7fb5f019fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T12:42:50.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.304+0000 7fb5f619b700 1 --2- 172.21.15.46:0/200763394 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb5f0100740 0x7fb5f01988f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec003730 tx=0x7fb5ec00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:50.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.304+0000 7fb5e77fe700 1 -- 172.21.15.46:0/200763394 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5ec01d070 con 0x7fb5f0100740 2023-10-19T12:42:50.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.304+0000 7fb5e77fe700 1 -- 172.21.15.46:0/200763394 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb5ec005050 con 0x7fb5f0100740 2023-10-19T12:42:50.314 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.304+0000 7fb5f83ff700 1 -- 172.21.15.46:0/200763394 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5f01a0970 con 0x7fb5f0100740 2023-10-19T12:42:50.314 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.304+0000 7fb5e77fe700 1 -- 172.21.15.46:0/200763394 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5ec004af0 con 0x7fb5f0100740 2023-10-19T12:42:50.314 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.304+0000 7fb5f83ff700 1 -- 172.21.15.46:0/200763394 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5f01a0df0 con 0x7fb5f0100740 2023-10-19T12:42:50.314 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.305+0000 7fb5f83ff700 1 -- 172.21.15.46:0/200763394 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5f0067530 con 0x7fb5f0100740 2023-10-19T12:42:50.315 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.307+0000 7fb5e77fe700 1 -- 172.21.15.46:0/200763394 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7fb5ec0051c0 con 0x7fb5f0100740 2023-10-19T12:42:50.315 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.309+0000 7fb5e77fe700 1 --2- 172.21.15.46:0/200763394 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fb5dc0a1590 0x7fb5dc0a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:50.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.309+0000 7fb5e77fe700 1 -- 172.21.15.46:0/200763394 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fb5ec0cdf60 con 0x7fb5f0100740 2023-10-19T12:42:50.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.310+0000 7fb5f599a700 1 --2- 172.21.15.46:0/200763394 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fb5dc0a1590 0x7fb5dc0a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:50.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.310+0000 7fb5f599a700 1 --2- 172.21.15.46:0/200763394 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fb5dc0a1590 0x7fb5dc0a3a50 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb5e0009c60 tx=0x7fb5e0009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:50.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.313+0000 7fb5e77fe700 1 -- 172.21.15.46:0/200763394 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb5ec097180 con 0x7fb5f0100740 2023-10-19T12:42:50.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.569+0000 7fb5f83ff700 1 -- 172.21.15.46:0/200763394 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb5f010bfb0 con 0x7fb5f0100740 2023-10-19T12:42:50.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.570+0000 7fb5e77fe700 1 -- 172.21.15.46:0/200763394 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+11372 (secure 0 0 0) 0x7fb5ec09a7a0 con 0x7fb5f0100740 2023-10-19T12:42:50.574 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:42:50.574 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14580,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/2235286008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":2235286008},{"type":"v1","addr":"172.21.15.46:6835","nonce":2235286008}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14592,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/339398444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":339398444},{"type":"v1","addr":"172.21.15.46:6837","nonce":339398444}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-19T12:41:18.815780+0000","modified":"2023-10-19T12:41:47.301944+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24680,"mds_1":24655,"mds_2":24643,"mds_3":24631,"mds_4":24629},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14640":{"gid":14640,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.46:6839/1655843965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":1655843965},{"type":"v1","addr":"172.21.15.46:6839","nonce":1655843965}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14652":{"gid":14652,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.46:6841/4204925553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6840","nonce":4204925553},{"type":"v1","addr":"172.21.15.46:6841","nonce":4204925553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24560":{"gid":24560,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.157:6833/1687745569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":1687745569},{"type":"v1","addr":"172.21.15.157:6833","nonce":1687745569}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24574":{"gid":24574,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.195:6833/3629933235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3629933235},{"type":"v1","addr":"172.21.15.195:6833","nonce":3629933235}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24602":{"gid":24602,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.157:6835/108432552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":108432552},{"type":"v1","addr":"172.21.15.157:6835","nonce":108432552}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24629":{"gid":24629,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":13,"addr":"172.21.15.157:6837/2629536514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6836","nonce":2629536514},{"type":"v1","addr":"172.21.15.157:6837","nonce":2629536514}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24631":{"gid":24631,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.195:6835/1406909915","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":1406909915},{"type":"v1","addr":"172.21.15.195:6835","nonce":1406909915}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24643":{"gid":24643,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":13,"addr":"172.21.15.195:6837/293916188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":293916188},{"type":"v1","addr":"172.21.15.195:6837","nonce":293916188}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24655":{"gid":24655,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":11,"addr":"172.21.15.195:6839/4094901934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6838","nonce":4094901934},{"type":"v1","addr":"172.21.15.195:6839","nonce":4094901934}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24680":{"gid":24680,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.157:6839/552718978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6838","nonce":552718978},{"type":"v1","addr":"172.21.15.157:6839","nonce":552718978}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-19T12:42:50.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.572+0000 7fb5f83ff700 1 -- 172.21.15.46:0/200763394 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fb5dc0a1590 msgr2=0x7fb5dc0a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:50.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.572+0000 7fb5f83ff700 1 --2- 172.21.15.46:0/200763394 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fb5dc0a1590 0x7fb5dc0a3a50 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb5e0009c60 tx=0x7fb5e0009260 comp rx=0 tx=0).stop 2023-10-19T12:42:50.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.572+0000 7fb5f83ff700 1 -- 172.21.15.46:0/200763394 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb5f0100740 msgr2=0x7fb5f01988f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:50.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.572+0000 7fb5f83ff700 1 --2- 172.21.15.46:0/200763394 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb5f0100740 0x7fb5f01988f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec003730 tx=0x7fb5ec00f690 comp rx=0 tx=0).stop 2023-10-19T12:42:50.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.572+0000 7fb5f83ff700 1 -- 172.21.15.46:0/200763394 shutdown_connections 2023-10-19T12:42:50.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.572+0000 7fb5f83ff700 1 --2- 172.21.15.46:0/200763394 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fb5dc0a1590 0x7fb5dc0a3a50 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:50.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.572+0000 7fb5f83ff700 1 --2- 172.21.15.46:0/200763394 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb5f01022d0 0x7fb5f019fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:50.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.572+0000 7fb5f83ff700 1 --2- 172.21.15.46:0/200763394 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb5f0100740 0x7fb5f01988f0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:50.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.572+0000 7fb5f83ff700 1 --2- 172.21.15.46:0/200763394 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb5f0101930 0x7fb5f0198e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:50.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.572+0000 7fb5f83ff700 1 -- 172.21.15.46:0/200763394 >> 172.21.15.46:0/200763394 conn(0x7fb5f00fbc90 msgr2=0x7fb5f0107150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:50.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.573+0000 7fb5f83ff700 1 -- 172.21.15.46:0/200763394 shutdown_connections 2023-10-19T12:42:50.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.573+0000 7fb5f83ff700 1 -- 172.21.15.46:0/200763394 wait complete. 2023-10-19T12:42:50.579 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 27 2023-10-19T12:42:50.595 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2023-10-19T12:41:18.815780+0000', 'modified': '2023-10-19T12:41:47.301944+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24680, 'mds_1': 24655, 'mds_2': 24643, 'mds_3': 24631, 'mds_4': 24629}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14640': {'gid': 14640, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.46:6839/1655843965', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.46:6838', 'nonce': 1655843965}, {'type': 'v1', 'addr': '172.21.15.46:6839', 'nonce': 1655843965}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_14652': {'gid': 14652, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.46:6841/4204925553', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.46:6840', 'nonce': 4204925553}, {'type': 'v1', 'addr': '172.21.15.46:6841', 'nonce': 4204925553}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24560': {'gid': 24560, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.157:6833/1687745569', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6832', 'nonce': 1687745569}, {'type': 'v1', 'addr': '172.21.15.157:6833', 'nonce': 1687745569}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24574': {'gid': 24574, 'name': 'l', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.195:6833/3629933235', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.195:6832', 'nonce': 3629933235}, {'type': 'v1', 'addr': '172.21.15.195:6833', 'nonce': 3629933235}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24602': {'gid': 24602, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.157:6835/108432552', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6834', 'nonce': 108432552}, {'type': 'v1', 'addr': '172.21.15.157:6835', 'nonce': 108432552}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24629': {'gid': 24629, 'name': 'h', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.157:6837/2629536514', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6836', 'nonce': 2629536514}, {'type': 'v1', 'addr': '172.21.15.157:6837', 'nonce': 2629536514}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24631': {'gid': 24631, 'name': 'f', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 14, 'addr': '172.21.15.195:6835/1406909915', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.195:6834', 'nonce': 1406909915}, {'type': 'v1', 'addr': '172.21.15.195:6835', 'nonce': 1406909915}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24643': {'gid': 24643, 'name': 'c', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.195:6837/293916188', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.195:6836', 'nonce': 293916188}, {'type': 'v1', 'addr': '172.21.15.195:6837', 'nonce': 293916188}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24655': {'gid': 24655, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.195:6839/4094901934', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.195:6838', 'nonce': 4094901934}, {'type': 'v1', 'addr': '172.21.15.195:6839', 'nonce': 4094901934}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24680': {'gid': 24680, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.157:6839/552718978', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6838', 'nonce': 552718978}, {'type': 'v1', 'addr': '172.21.15.157:6839', 'nonce': 552718978}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-19T12:42:50.595 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2023-10-19T12:42:50.596 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.h status 2023-10-19T12:42:50.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.800+0000 7f6d423ff700 1 -- 172.21.15.46:0/4068650434 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6d3c100750 msgr2=0x7f6d3c100b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:50.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.800+0000 7f6d423ff700 1 --2- 172.21.15.46:0/4068650434 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6d3c100750 0x7f6d3c100b70 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c0098f0 tx=0x7f6d2c009c00 comp rx=0 tx=0).stop 2023-10-19T12:42:50.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.800+0000 7f6d423ff700 1 -- 172.21.15.46:0/4068650434 shutdown_connections 2023-10-19T12:42:50.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.800+0000 7f6d423ff700 1 --2- 172.21.15.46:0/4068650434 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d3c1022e0 0x7f6d3c108b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:50.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.800+0000 7f6d423ff700 1 --2- 172.21.15.46:0/4068650434 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6d3c100750 0x7f6d3c100b70 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:50.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.800+0000 7f6d423ff700 1 --2- 172.21.15.46:0/4068650434 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6d3c101940 0x7f6d3c101da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:50.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.800+0000 7f6d423ff700 1 -- 172.21.15.46:0/4068650434 >> 172.21.15.46:0/4068650434 conn(0x7f6d3c0fbcc0 msgr2=0x7f6d3c0fe100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:50.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.800+0000 7f6d423ff700 1 -- 172.21.15.46:0/4068650434 shutdown_connections 2023-10-19T12:42:50.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.800+0000 7f6d423ff700 1 -- 172.21.15.46:0/4068650434 wait complete. 2023-10-19T12:42:50.807 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.801+0000 7f6d423ff700 1 Processor -- start 2023-10-19T12:42:50.807 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.801+0000 7f6d423ff700 1 -- start start 2023-10-19T12:42:50.808 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.802+0000 7f6d423ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6d3c100750 0x7f6d3c198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:50.808 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.802+0000 7f6d423ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d3c101940 0x7f6d3c198eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:50.808 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.802+0000 7f6d423ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6d3c1022e0 0x7f6d3c19fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:50.808 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.802+0000 7f6d423ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d3c1a04a0 con 0x7f6d3c101940 2023-10-19T12:42:50.808 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.802+0000 7f6d423ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d3c1a05e0 con 0x7f6d3c100750 2023-10-19T12:42:50.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.802+0000 7f6d423ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d3c1a0770 con 0x7f6d3c1022e0 2023-10-19T12:42:50.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.802+0000 7f6d3b7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d3c101940 0x7f6d3c198eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:50.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.802+0000 7f6d4099c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6d3c1022e0 0x7f6d3c19fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:50.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.802+0000 7f6d3b7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d3c101940 0x7f6d3c198eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38948/0 (socket says 172.21.15.46:38948) 2023-10-19T12:42:50.810 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.802+0000 7f6d3bfff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6d3c100750 0x7f6d3c198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:50.810 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.802+0000 7f6d3b7fe700 1 -- 172.21.15.46:0/126938806 learned_addr learned my addr 172.21.15.46:0/126938806 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:42:50.810 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.803+0000 7f6d3b7fe700 1 -- 172.21.15.46:0/126938806 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6d3c1022e0 msgr2=0x7f6d3c19fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:50.810 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.803+0000 7f6d3b7fe700 1 --2- 172.21.15.46:0/126938806 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6d3c1022e0 0x7f6d3c19fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:50.810 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.803+0000 7f6d3b7fe700 1 -- 172.21.15.46:0/126938806 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6d3c100750 msgr2=0x7f6d3c198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:50.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.803+0000 7f6d3b7fe700 1 --2- 172.21.15.46:0/126938806 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6d3c100750 0x7f6d3c198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:50.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.803+0000 7f6d3b7fe700 1 -- 172.21.15.46:0/126938806 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d34009d00 con 0x7f6d3c101940 2023-10-19T12:42:50.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.803+0000 7f6d4099c700 1 --2- 172.21.15.46:0/126938806 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6d3c1022e0 0x7f6d3c19fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:42:50.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.803+0000 7f6d3b7fe700 1 --2- 172.21.15.46:0/126938806 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d3c101940 0x7f6d3c198eb0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6d3000d950 tx=0x7f6d3000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:50.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.803+0000 7f6d397fa700 1 -- 172.21.15.46:0/126938806 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d3000f890 con 0x7f6d3c101940 2023-10-19T12:42:50.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.803+0000 7f6d423ff700 1 -- 172.21.15.46:0/126938806 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d2c009520 con 0x7f6d3c101940 2023-10-19T12:42:50.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.803+0000 7f6d397fa700 1 -- 172.21.15.46:0/126938806 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6d30010460 con 0x7f6d3c101940 2023-10-19T12:42:50.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.803+0000 7f6d423ff700 1 -- 172.21.15.46:0/126938806 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d3c1a0e20 con 0x7f6d3c101940 2023-10-19T12:42:50.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.803+0000 7f6d397fa700 1 -- 172.21.15.46:0/126938806 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d3001b650 con 0x7f6d3c101940 2023-10-19T12:42:50.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.806+0000 7f6d397fa700 1 -- 172.21.15.46:0/126938806 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f6d300108d0 con 0x7f6d3c101940 2023-10-19T12:42:50.818 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.807+0000 7f6d55c52b80 1 Processor -- start 2023-10-19T12:42:50.818 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.808+0000 7f6d55c52b80 1 -- start start 2023-10-19T12:42:50.818 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.808+0000 7f6d397fa700 1 --2- 172.21.15.46:0/126938806 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f6d240a1510 0x7f6d240a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:50.818 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.808+0000 7f6d55c52b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5648291a2280 0x5648291a26a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:50.819 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.808+0000 7f6d55c52b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5648291a2be0 0x5648291a1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:50.819 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.808+0000 7f6d55c52b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5648291a1580 0x5648291a1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:50.819 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.808+0000 7f6d55c52b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x564829114690 con 0x5648291a2be0 2023-10-19T12:42:50.819 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.808+0000 7f6d55c52b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648290fac10 con 0x5648291a1580 2023-10-19T12:42:50.819 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.808+0000 7f6d55c52b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648290f8530 con 0x5648291a2280 2023-10-19T12:42:50.820 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.808+0000 7f6d397fa700 1 -- 172.21.15.46:0/126938806 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f6d300cd310 con 0x7f6d3c101940 2023-10-19T12:42:50.820 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.808+0000 7f6d3b7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5648291a2be0 0x5648291a1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:50.820 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.808+0000 7f6d3b7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5648291a2be0 0x5648291a1040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38962/0 (socket says 172.21.15.46:38962) 2023-10-19T12:42:50.820 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.808+0000 7f6d3bfff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5648291a2280 0x5648291a26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:50.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.808+0000 7f6d3b7fe700 1 -- 172.21.15.46:0/2192736365 learned_addr learned my addr 172.21.15.46:0/2192736365 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:42:50.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.808+0000 7f6d4099c700 1 --2- 172.21.15.46:0/126938806 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f6d240a1510 0x7f6d240a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:50.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.809+0000 7f6d4099c700 1 --2- 172.21.15.46:0/2192736365 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5648291a1580 0x5648291a1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:50.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.809+0000 7f6d3bfff700 1 -- 172.21.15.46:0/2192736365 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5648291a1580 msgr2=0x5648291a1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:42:50.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.809+0000 7f6d3bfff700 1 --2- 172.21.15.46:0/2192736365 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5648291a1580 0x5648291a1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:50.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.809+0000 7f6d3bfff700 1 -- 172.21.15.46:0/2192736365 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5648291a2be0 msgr2=0x5648291a1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:42:50.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.809+0000 7f6d3bfff700 1 --2- 172.21.15.46:0/2192736365 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5648291a2be0 0x5648291a1040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:50.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.809+0000 7f6d3bfff700 1 -- 172.21.15.46:0/2192736365 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5648290b13a0 con 0x5648291a2280 2023-10-19T12:42:50.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.809+0000 7f6d3b7fe700 1 --2- 172.21.15.46:0/2192736365 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5648291a2be0 0x5648291a1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:42:50.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.809+0000 7f6d3bfff700 1 --2- 172.21.15.46:0/2192736365 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5648291a2280 0x5648291a26a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c009230 tx=0x7f6d2c009f50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=856af2dacb32570e server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:50.823 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.809+0000 7f6d4099c700 1 --2- 172.21.15.46:0/126938806 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f6d240a1510 0x7f6d240a39d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f6d34009fd0 tx=0x7f6d340099e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:50.823 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.809+0000 7f6d227fc700 1 -- 172.21.15.46:0/2192736365 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d2c00f720 con 0x5648291a2280 2023-10-19T12:42:50.823 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.809+0000 7f6d227fc700 1 -- 172.21.15.46:0/2192736365 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6d2c01d040 con 0x5648291a2280 2023-10-19T12:42:50.823 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.809+0000 7f6d227fc700 1 -- 172.21.15.46:0/2192736365 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d2c005590 con 0x5648291a2280 2023-10-19T12:42:50.823 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.810+0000 7f6d55c52b80 1 -- 172.21.15.46:0/2192736365 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5648291a2280 msgr2=0x5648291a26a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:50.824 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.810+0000 7f6d55c52b80 1 --2- 172.21.15.46:0/2192736365 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5648291a2280 0x5648291a26a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c009230 tx=0x7f6d2c009f50 comp rx=0 tx=0).stop 2023-10-19T12:42:50.824 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.810+0000 7f6d55c52b80 1 -- 172.21.15.46:0/2192736365 shutdown_connections 2023-10-19T12:42:50.824 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.810+0000 7f6d55c52b80 1 --2- 172.21.15.46:0/2192736365 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5648291a1580 0x5648291a1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:50.824 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.810+0000 7f6d55c52b80 1 --2- 172.21.15.46:0/2192736365 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5648291a2280 0x5648291a26a0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:50.824 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.810+0000 7f6d55c52b80 1 --2- 172.21.15.46:0/2192736365 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5648291a2be0 0x5648291a1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:50.825 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.810+0000 7f6d55c52b80 1 -- 172.21.15.46:0/2192736365 >> 172.21.15.46:0/2192736365 conn(0x5648291156d0 msgr2=0x56482919bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:50.825 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.810+0000 7f6d55c52b80 1 -- 172.21.15.46:0/2192736365 shutdown_connections 2023-10-19T12:42:50.825 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.810+0000 7f6d55c52b80 1 -- 172.21.15.46:0/2192736365 wait complete. 2023-10-19T12:42:50.825 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.811+0000 7f6d55c52b80 1 -- start start 2023-10-19T12:42:50.825 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.811+0000 7f6d55c52b80 1 Processor -- start 2023-10-19T12:42:50.826 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.811+0000 7f6d55c52b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5648291a1580 0x5648291aaa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:50.826 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.811+0000 7f6d55c52b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5648291a2280 0x5648291aafb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:50.826 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.811+0000 7f6d55c52b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5648291a2be0 0x5648291b1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:50.826 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.812+0000 7f6d55c52b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648290f3e20 con 0x5648291a2280 2023-10-19T12:42:50.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.812+0000 7f6d55c52b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648290906c0 con 0x5648291a2be0 2023-10-19T12:42:50.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.812+0000 7f6d55c52b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x564829090360 con 0x5648291a1580 2023-10-19T12:42:50.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.812+0000 7f6d55c52b80 10 client.0 _ll_register_callbacks cb 0x564828fdaa30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:42:50.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.812+0000 7f6d4099c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5648291a2be0 0x5648291b1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:50.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.812+0000 7f6d3b7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5648291a2280 0x5648291aafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:50.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.812+0000 7f6d3bfff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5648291a1580 0x5648291aaa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:50.828 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.812+0000 7f6d4099c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5648291a2be0 0x5648291b1ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:43632/0 (socket says 172.21.15.46:43632) 2023-10-19T12:42:50.828 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.812+0000 7f6d3bfff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5648291a1580 0x5648291aaa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:41968/0 (socket says 172.21.15.46:41968) 2023-10-19T12:42:50.828 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.812+0000 7f6d4099c700 1 -- 172.21.15.46:0/2165818349 learned_addr learned my addr 172.21.15.46:0/2165818349 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:42:50.828 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.812+0000 7f6d3bfff700 1 -- 172.21.15.46:0/2165818349 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5648291a2be0 msgr2=0x5648291b1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:42:50.828 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.812+0000 7f6d3bfff700 1 --2- 172.21.15.46:0/2165818349 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5648291a2be0 0x5648291b1ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:50.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.812+0000 7f6d3bfff700 1 -- 172.21.15.46:0/2165818349 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5648291a2280 msgr2=0x5648291aafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:42:50.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.812+0000 7f6d3bfff700 1 --2- 172.21.15.46:0/2165818349 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5648291a2280 0x5648291aafb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:50.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.812+0000 7f6d3bfff700 1 -- 172.21.15.46:0/2165818349 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d3c1a0e20 con 0x5648291a1580 2023-10-19T12:42:50.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.813+0000 7f6d3bfff700 1 --2- 172.21.15.46:0/2165818349 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5648291a1580 0x5648291aaa70 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c005c10 tx=0x7f6d2c0054c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4c95397a7fc6d1b server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:50.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.813+0000 7f6d1b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-10-19T12:42:50.830 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.813+0000 7f6d1b7fe700 1 -- 172.21.15.46:0/2165818349 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d2c00b970 con 0x5648291a1580 2023-10-19T12:42:50.830 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.813+0000 7f6d55c52b80 1 -- 172.21.15.46:0/2165818349 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5648290f8ea0 con 0x5648291a1580 2023-10-19T12:42:50.830 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.813+0000 7f6d1b7fe700 1 -- 172.21.15.46:0/2165818349 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f6d2c00bbb0 con 0x5648291a1580 2023-10-19T12:42:50.830 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.813+0000 7f6d1b7fe700 1 -- 172.21.15.46:0/2165818349 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6d2c0056f0 con 0x5648291a1580 2023-10-19T12:42:50.830 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.813+0000 7f6d55c52b80 10 client.25258 fetch_fsmap learned FSMap version 27 2023-10-19T12:42:50.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.813+0000 7f6d55c52b80 1 -- 172.21.15.46:0/2165818349 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7f6d3c1094e0 con 0x5648291a1580 2023-10-19T12:42:50.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.814+0000 7f6d1b7fe700 1 -- 172.21.15.46:0/2165818349 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5648290f8ea0 con 0x5648291a1580 2023-10-19T12:42:50.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.814+0000 7f6d1b7fe700 1 -- 172.21.15.46:0/2165818349 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f6d2c015020 con 0x5648291a1580 2023-10-19T12:42:50.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.814+0000 7f6d55c52b80 10 client.25258 fetch_fsmap finished waiting for FSMap version 27 2023-10-19T12:42:50.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.814+0000 7f6d55c52b80 10 client.25258 resolve_mds: resolved name 'h' to daemon mds.h 2023-10-19T12:42:50.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.814+0000 7f6d55c52b80 20 client.25258 populate_metadata read hostname 'smithi046' 2023-10-19T12:42:50.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.814+0000 7f6d55c52b80 1 --2- 172.21.15.46:0/2165818349 >> [v2:172.21.15.157:6836/2629536514,v1:172.21.15.157:6837/2629536514] conn(0x5648291b6220 0x5648291b4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:50.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.814+0000 7f6d55c52b80 4 client.25258 mds_command: new command op to 24629 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-19T12:42:50.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.814+0000 7f6d55c52b80 1 -- 172.21.15.46:0/2165818349 --> [v2:172.21.15.157:6836/2629536514,v1:172.21.15.157:6837/2629536514] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564829170860 con 0x5648291b6220 2023-10-19T12:42:50.833 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.814+0000 7f6d3b7fe700 1 --2- 172.21.15.46:0/2165818349 >> [v2:172.21.15.157:6836/2629536514,v1:172.21.15.157:6837/2629536514] conn(0x5648291b6220 0x5648291b4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:50.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.815+0000 7f6d3b7fe700 1 --2- 172.21.15.46:0/2165818349 >> [v2:172.21.15.157:6836/2629536514,v1:172.21.15.157:6837/2629536514] conn(0x5648291b6220 0x5648291b4fc0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=b016ec2c217d8a88 server_cookie=6f8443f96b060d41 in_seq=0 out_seq=0 2023-10-19T12:42:50.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.815+0000 7f6d1b7fe700 10 client.25258 ms_handle_connect on v2:172.21.15.157:6836/2629536514 2023-10-19T12:42:50.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.816+0000 7f6d1b7fe700 1 -- 172.21.15.46:0/2165818349 <== mds.4 v2:172.21.15.157:6836/2629536514 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x564829170860 con 0x5648291b6220 2023-10-19T12:42:50.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.816+0000 7f6d1b7fe700 10 client.25258 handle_command_reply: tid=0 2023-10-19T12:42:50.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.816+0000 7f6d55c52b80 1 client.25258 shutdown 2023-10-19T12:42:50.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.816+0000 7f6d55c52b80 1 -- 172.21.15.46:0/2165818349 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5648291a1580 msgr2=0x5648291aaa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:50.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.816+0000 7f6d55c52b80 1 --2- 172.21.15.46:0/2165818349 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5648291a1580 0x5648291aaa70 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c005c10 tx=0x7f6d2c0054c0 comp rx=0 tx=0).stop 2023-10-19T12:42:50.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.816+0000 7f6d55c52b80 1 -- 172.21.15.46:0/2165818349 shutdown_connections 2023-10-19T12:42:50.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.816+0000 7f6d55c52b80 1 --2- 172.21.15.46:0/2165818349 >> [v2:172.21.15.157:6836/2629536514,v1:172.21.15.157:6837/2629536514] conn(0x5648291b6220 0x5648291b4fc0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:50.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.816+0000 7f6d55c52b80 1 --2- 172.21.15.46:0/2165818349 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5648291a2be0 0x5648291b1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:50.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.816+0000 7f6d55c52b80 1 --2- 172.21.15.46:0/2165818349 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5648291a1580 0x5648291aaa70 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:50.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.816+0000 7f6d55c52b80 1 --2- 172.21.15.46:0/2165818349 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5648291a2280 0x5648291aafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:50.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.816+0000 7f6d1b7fe700 0 client.25258 ms_handle_reset on v2:172.21.15.157:6836/2629536514 2023-10-19T12:42:50.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.816+0000 7f6d55c52b80 1 -- 172.21.15.46:0/2165818349 >> 172.21.15.46:0/2165818349 conn(0x5648291156d0 msgr2=0x5648291a0030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:50.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.816+0000 7f6d55c52b80 1 -- 172.21.15.46:0/2165818349 shutdown_connections 2023-10-19T12:42:50.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.816+0000 7f6d55c52b80 1 -- 172.21.15.46:0/2165818349 wait complete. 2023-10-19T12:42:50.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.816+0000 7f6d55c52b80 20 client.25258 trim_cache size 0 max 16384 2023-10-19T12:42:50.838 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.835+0000 7f6d55c52b80 1 Processor -- start 2023-10-19T12:42:50.838 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.835+0000 7f6d55c52b80 1 -- start start 2023-10-19T12:42:50.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.835+0000 7f6d55c52b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5648291a1580 0x56482919c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:50.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.835+0000 7f6d55c52b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5648291a2280 0x5648291b1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:50.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.835+0000 7f6d55c52b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5648291a2be0 0x5648291a5280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:50.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.835+0000 7f6d55c52b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x564828f748d0 con 0x5648291a2280 2023-10-19T12:42:50.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.835+0000 7f6d55c52b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648291b3d00 con 0x5648291a1580 2023-10-19T12:42:50.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.835+0000 7f6d55c52b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x564829170860 con 0x5648291a2be0 2023-10-19T12:42:50.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.836+0000 7f6d4099c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5648291a2be0 0x5648291a5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:50.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.836+0000 7f6d3b7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5648291a2280 0x5648291b1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:50.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.836+0000 7f6d4099c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5648291a2be0 0x5648291a5280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:41974/0 (socket says 172.21.15.46:41974) 2023-10-19T12:42:50.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.836+0000 7f6d3bfff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5648291a1580 0x56482919c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:50.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.836+0000 7f6d4099c700 1 -- 172.21.15.46:0/1481086533 learned_addr learned my addr 172.21.15.46:0/1481086533 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:42:50.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.836+0000 7f6d4099c700 1 -- 172.21.15.46:0/1481086533 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5648291a1580 msgr2=0x56482919c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:42:50.846 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.836+0000 7f6d4099c700 1 --2- 172.21.15.46:0/1481086533 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5648291a1580 0x56482919c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:50.846 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.836+0000 7f6d4099c700 1 -- 172.21.15.46:0/1481086533 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5648291a2280 msgr2=0x5648291b1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:42:50.846 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.836+0000 7f6d4099c700 1 --2- 172.21.15.46:0/1481086533 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5648291a2280 0x5648291b1fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:50.846 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.836+0000 7f6d4099c700 1 -- 172.21.15.46:0/1481086533 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564828f1ed90 con 0x5648291a2be0 2023-10-19T12:42:50.846 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.836+0000 7f6d4099c700 1 --2- 172.21.15.46:0/1481086533 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5648291a2be0 0x5648291a5280 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6d34008300 tx=0x7f6d3400b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c942abe04b3cadae server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:50.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.837+0000 7f6d22ffd700 1 -- 172.21.15.46:0/1481086533 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d3400e020 con 0x5648291a2be0 2023-10-19T12:42:50.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.837+0000 7f6d22ffd700 1 -- 172.21.15.46:0/1481086533 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6d3400f040 con 0x5648291a2be0 2023-10-19T12:42:50.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.837+0000 7f6d22ffd700 1 -- 172.21.15.46:0/1481086533 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d340255c0 con 0x5648291a2be0 2023-10-19T12:42:50.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.837+0000 7f6d55c52b80 1 -- 172.21.15.46:0/1481086533 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5648291a2be0 msgr2=0x5648291a5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:50.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.837+0000 7f6d55c52b80 1 --2- 172.21.15.46:0/1481086533 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5648291a2be0 0x5648291a5280 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6d34008300 tx=0x7f6d3400b040 comp rx=0 tx=0).stop 2023-10-19T12:42:50.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.837+0000 7f6d55c52b80 1 -- 172.21.15.46:0/1481086533 shutdown_connections 2023-10-19T12:42:50.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.837+0000 7f6d55c52b80 1 --2- 172.21.15.46:0/1481086533 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5648291a2be0 0x5648291a5280 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:50.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.837+0000 7f6d55c52b80 1 --2- 172.21.15.46:0/1481086533 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5648291a1580 0x56482919c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:50.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.837+0000 7f6d55c52b80 1 --2- 172.21.15.46:0/1481086533 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5648291a2280 0x5648291b1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:50.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.837+0000 7f6d55c52b80 1 -- 172.21.15.46:0/1481086533 >> 172.21.15.46:0/1481086533 conn(0x5648291156d0 msgr2=0x5648291a8b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:50.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.837+0000 7f6d55c52b80 1 -- 172.21.15.46:0/1481086533 shutdown_connections 2023-10-19T12:42:50.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.837+0000 7f6d55c52b80 1 -- 172.21.15.46:0/1481086533 wait complete. 2023-10-19T12:42:50.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.838+0000 7f6d55c52b80 1 -- start start 2023-10-19T12:42:50.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.838+0000 7f6d55c52b80 1 Processor -- start 2023-10-19T12:42:50.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.838+0000 7f6d55c52b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5648291a1580 0x5648291af320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:50.850 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.838+0000 7f6d55c52b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5648291a2280 0x5648291af860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:50.850 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.838+0000 7f6d55c52b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5648291a2be0 0x5648291b0730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:50.850 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.838+0000 7f6d55c52b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648291b0c70 con 0x5648291a2be0 2023-10-19T12:42:50.850 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.838+0000 7f6d55c52b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648291b0de0 con 0x5648291a2280 2023-10-19T12:42:50.850 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.838+0000 7f6d55c52b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648291b0fa0 con 0x5648291a1580 2023-10-19T12:42:50.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.838+0000 7f6d55c52b80 10 client.0 _ll_register_callbacks cb 0x564828fdaa30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:42:50.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.839+0000 7f6d3b7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5648291a2280 0x5648291af860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:50.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.839+0000 7f6d4099c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5648291a2be0 0x5648291b0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:50.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.839+0000 7f6d3bfff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5648291a1580 0x5648291af320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:50.852 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.839+0000 7f6d3b7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5648291a2280 0x5648291af860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:43654/0 (socket says 172.21.15.46:43654) 2023-10-19T12:42:50.852 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.839+0000 7f6d3b7fe700 1 -- 172.21.15.46:0/355927839 learned_addr learned my addr 172.21.15.46:0/355927839 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:42:50.852 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.839+0000 7f6d3bfff700 1 -- 172.21.15.46:0/355927839 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5648291a2280 msgr2=0x5648291af860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:42:50.852 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.839+0000 7f6d3bfff700 1 --2- 172.21.15.46:0/355927839 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5648291a2280 0x5648291af860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:50.852 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.839+0000 7f6d3bfff700 1 -- 172.21.15.46:0/355927839 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5648291a2be0 msgr2=0x5648291b0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:42:50.853 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.839+0000 7f6d3bfff700 1 --2- 172.21.15.46:0/355927839 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5648291a2be0 0x5648291b0730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:50.853 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.839+0000 7f6d3bfff700 1 -- 172.21.15.46:0/355927839 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d34008040 con 0x5648291a1580 2023-10-19T12:42:50.853 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.839+0000 7f6d3b7fe700 1 --2- 172.21.15.46:0/355927839 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5648291a2280 0x5648291af860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:42:50.853 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.839+0000 7f6d3bfff700 1 --2- 172.21.15.46:0/355927839 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5648291a1580 0x5648291af320 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c02c660 tx=0x7f6d2c0094b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=756a529058fd8ff4 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:50.854 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.839+0000 7f6d1b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-10-19T12:42:50.854 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.840+0000 7f6d1b7fe700 1 -- 172.21.15.46:0/355927839 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d2c00bb80 con 0x5648291a1580 2023-10-19T12:42:50.854 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.840+0000 7f6d55c52b80 1 -- 172.21.15.46:0/355927839 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6d2c01d040 con 0x5648291a1580 2023-10-19T12:42:50.854 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.840+0000 7f6d1b7fe700 1 -- 172.21.15.46:0/355927839 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f6d2c02c450 con 0x5648291a1580 2023-10-19T12:42:50.854 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.840+0000 7f6d1b7fe700 1 -- 172.21.15.46:0/355927839 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6d2c00f870 con 0x5648291a1580 2023-10-19T12:42:50.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.840+0000 7f6d55c52b80 10 client.25264 fetch_fsmap learned FSMap version 27 2023-10-19T12:42:50.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.840+0000 7f6d55c52b80 1 -- 172.21.15.46:0/355927839 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x564828f07c10 con 0x5648291a1580 2023-10-19T12:42:50.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.840+0000 7f6d1b7fe700 1 -- 172.21.15.46:0/355927839 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6d2c01d040 con 0x5648291a1580 2023-10-19T12:42:50.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.840+0000 7f6d1b7fe700 1 -- 172.21.15.46:0/355927839 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f6d2c036070 con 0x5648291a1580 2023-10-19T12:42:50.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.840+0000 7f6d55c52b80 10 client.25264 fetch_fsmap finished waiting for FSMap version 27 2023-10-19T12:42:50.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.841+0000 7f6d55c52b80 10 client.25264 resolve_mds: resolved name 'h' to daemon mds.h 2023-10-19T12:42:50.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.841+0000 7f6d55c52b80 20 client.25264 populate_metadata read hostname 'smithi046' 2023-10-19T12:42:50.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.841+0000 7f6d55c52b80 1 --2- 172.21.15.46:0/355927839 >> [v2:172.21.15.157:6836/2629536514,v1:172.21.15.157:6837/2629536514] conn(0x564829217d90 0x564829214430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:50.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.841+0000 7f6d55c52b80 4 client.25264 mds_command: new command op to 24629 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-19T12:42:50.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.841+0000 7f6d55c52b80 1 -- 172.21.15.46:0/355927839 --> [v2:172.21.15.157:6836/2629536514,v1:172.21.15.157:6837/2629536514] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5648290ece00 con 0x564829217d90 2023-10-19T12:42:50.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.841+0000 7f6d3b7fe700 1 --2- 172.21.15.46:0/355927839 >> [v2:172.21.15.157:6836/2629536514,v1:172.21.15.157:6837/2629536514] conn(0x564829217d90 0x564829214430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:50.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.841+0000 7f6d3b7fe700 1 --2- 172.21.15.46:0/355927839 >> [v2:172.21.15.157:6836/2629536514,v1:172.21.15.157:6837/2629536514] conn(0x564829217d90 0x564829214430 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=698098c4cd5a6ac3 server_cookie=52322946eda09e6f in_seq=0 out_seq=0 2023-10-19T12:42:50.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.841+0000 7f6d1b7fe700 10 client.25264 ms_handle_connect on v2:172.21.15.157:6836/2629536514 2023-10-19T12:42:50.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.842+0000 7f6d1b7fe700 1 -- 172.21.15.46:0/355927839 <== mds.4 v2:172.21.15.157:6836/2629536514 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x5648290ece00 con 0x564829217d90 2023-10-19T12:42:50.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.842+0000 7f6d1b7fe700 10 client.25264 handle_command_reply: tid=0 2023-10-19T12:42:50.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.842+0000 7f6d55c52b80 1 client.25264 shutdown 2023-10-19T12:42:50.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.842+0000 7f6d55c52b80 1 -- 172.21.15.46:0/355927839 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5648291a1580 msgr2=0x5648291af320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:50.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.842+0000 7f6d55c52b80 1 --2- 172.21.15.46:0/355927839 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5648291a1580 0x5648291af320 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c02c660 tx=0x7f6d2c0094b0 comp rx=0 tx=0).stop 2023-10-19T12:42:50.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.842+0000 7f6d55c52b80 1 -- 172.21.15.46:0/355927839 shutdown_connections 2023-10-19T12:42:50.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.842+0000 7f6d55c52b80 1 --2- 172.21.15.46:0/355927839 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5648291a2be0 0x5648291b0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:50.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.842+0000 7f6d55c52b80 1 --2- 172.21.15.46:0/355927839 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5648291a1580 0x5648291af320 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:50.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.842+0000 7f6d55c52b80 1 --2- 172.21.15.46:0/355927839 >> [v2:172.21.15.157:6836/2629536514,v1:172.21.15.157:6837/2629536514] conn(0x564829217d90 0x564829214430 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:50.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.842+0000 7f6d55c52b80 1 --2- 172.21.15.46:0/355927839 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5648291a2280 0x5648291af860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:50.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.842+0000 7f6d55c52b80 1 -- 172.21.15.46:0/355927839 >> 172.21.15.46:0/355927839 conn(0x5648291156d0 msgr2=0x5648291a5280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:50.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.842+0000 7f6d1b7fe700 0 client.25264 ms_handle_reset on v2:172.21.15.157:6836/2629536514 2023-10-19T12:42:50.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.842+0000 7f6d55c52b80 1 -- 172.21.15.46:0/355927839 shutdown_connections 2023-10-19T12:42:50.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.842+0000 7f6d55c52b80 1 -- 172.21.15.46:0/355927839 wait complete. 2023-10-19T12:42:50.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.842+0000 7f6d55c52b80 20 client.25264 trim_cache size 0 max 16384 2023-10-19T12:42:50.862 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-10-19T12:42:50.862 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_fsid": "96a8be3c-6e7b-11ee-8db6-212e2dc638e7", 2023-10-19T12:42:50.863 INFO:teuthology.orchestra.run.smithi046.stdout: "whoami": 4, 2023-10-19T12:42:50.863 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 24629, 2023-10-19T12:42:50.863 INFO:teuthology.orchestra.run.smithi046.stdout: "want_state": "up:active", 2023-10-19T12:42:50.863 INFO:teuthology.orchestra.run.smithi046.stdout: "state": "up:active", 2023-10-19T12:42:50.863 INFO:teuthology.orchestra.run.smithi046.stdout: "fs_name": "cephfs", 2023-10-19T12:42:50.864 INFO:teuthology.orchestra.run.smithi046.stdout: "rank_uptime": 64.547424574999994, 2023-10-19T12:42:50.864 INFO:teuthology.orchestra.run.smithi046.stdout: "mdsmap_epoch": 27, 2023-10-19T12:42:50.864 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch": 90, 2023-10-19T12:42:50.864 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch_barrier": 88, 2023-10-19T12:42:50.864 INFO:teuthology.orchestra.run.smithi046.stdout: "uptime": 109.48244567499999 2023-10-19T12:42:50.865 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-10-19T12:42:50.865 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.843+0000 7f6d423ff700 1 -- 172.21.15.46:0/126938806 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f6d240a1510 msgr2=0x7f6d240a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:50.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.843+0000 7f6d423ff700 1 --2- 172.21.15.46:0/126938806 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f6d240a1510 0x7f6d240a39d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f6d34009fd0 tx=0x7f6d340099e0 comp rx=0 tx=0).stop 2023-10-19T12:42:50.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.843+0000 7f6d423ff700 1 -- 172.21.15.46:0/126938806 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d3c101940 msgr2=0x7f6d3c198eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:50.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.843+0000 7f6d423ff700 1 --2- 172.21.15.46:0/126938806 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d3c101940 0x7f6d3c198eb0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6d3000d950 tx=0x7f6d3000dc60 comp rx=0 tx=0).stop 2023-10-19T12:42:50.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.843+0000 7f6d423ff700 1 -- 172.21.15.46:0/126938806 shutdown_connections 2023-10-19T12:42:50.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.843+0000 7f6d423ff700 1 --2- 172.21.15.46:0/126938806 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f6d240a1510 0x7f6d240a39d0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:50.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.843+0000 7f6d423ff700 1 --2- 172.21.15.46:0/126938806 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6d3c1022e0 0x7f6d3c19fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:50.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.843+0000 7f6d423ff700 1 --2- 172.21.15.46:0/126938806 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6d3c100750 0x7f6d3c198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:50.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.843+0000 7f6d423ff700 1 --2- 172.21.15.46:0/126938806 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d3c101940 0x7f6d3c198eb0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:50.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.843+0000 7f6d423ff700 1 -- 172.21.15.46:0/126938806 >> 172.21.15.46:0/126938806 conn(0x7f6d3c0fbcc0 msgr2=0x7f6d3c072a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:50.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.843+0000 7f6d423ff700 1 -- 172.21.15.46:0/126938806 shutdown_connections 2023-10-19T12:42:50.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:50.843+0000 7f6d423ff700 1 -- 172.21.15.46:0/126938806 wait complete. 2023-10-19T12:42:50.868 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:50 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/268118897' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-19T12:42:50.868 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:50 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/200763394' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-19T12:42:50.869 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2023-10-19T12:42:51.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.073+0000 7f21bd1ff700 1 -- 172.21.15.46:0/1701840097 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f21b80747d0 msgr2=0x7f21b8072c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:51.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.073+0000 7f21bd1ff700 1 --2- 172.21.15.46:0/1701840097 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f21b80747d0 0x7f21b8072c20 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f21a8009990 tx=0x7f21a8009ca0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.073+0000 7f21bd1ff700 1 -- 172.21.15.46:0/1701840097 shutdown_connections 2023-10-19T12:42:51.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.073+0000 7f21bd1ff700 1 --2- 172.21.15.46:0/1701840097 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f21b81085f0 0x7f21b810aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.073+0000 7f21bd1ff700 1 --2- 172.21.15.46:0/1701840097 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f21b80747d0 0x7f21b8072c20 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.073+0000 7f21bd1ff700 1 --2- 172.21.15.46:0/1701840097 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f21b80731f0 0x7f21b8073670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.073+0000 7f21bd1ff700 1 -- 172.21.15.46:0/1701840097 >> 172.21.15.46:0/1701840097 conn(0x7f21b80fbc90 msgr2=0x7f21b80fe0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:51.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.073+0000 7f21bd1ff700 1 -- 172.21.15.46:0/1701840097 shutdown_connections 2023-10-19T12:42:51.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.073+0000 7f21bd1ff700 1 -- 172.21.15.46:0/1701840097 wait complete. 2023-10-19T12:42:51.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.074+0000 7f21bd1ff700 1 Processor -- start 2023-10-19T12:42:51.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.075+0000 7f21bd1ff700 1 -- start start 2023-10-19T12:42:51.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.075+0000 7f21bd1ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f21b80731f0 0x7f21b8198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:51.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.075+0000 7f21bd1ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f21b80747d0 0x7f21b8198db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:51.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.075+0000 7f21bd1ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f21b81085f0 0x7f21b819fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:51.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.075+0000 7f21bd1ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21b81a03a0 con 0x7f21b80747d0 2023-10-19T12:42:51.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.075+0000 7f21bd1ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21b81a04e0 con 0x7f21b81085f0 2023-10-19T12:42:51.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.075+0000 7f21bd1ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21b81a0670 con 0x7f21b80731f0 2023-10-19T12:42:51.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.075+0000 7f21b659c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f21b80747d0 0x7f21b8198db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:51.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.076+0000 7f21b659c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f21b80747d0 0x7f21b8198db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39000/0 (socket says 172.21.15.46:39000) 2023-10-19T12:42:51.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.076+0000 7f21b659c700 1 -- 172.21.15.46:0/3186933967 learned_addr learned my addr 172.21.15.46:0/3186933967 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:42:51.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.076+0000 7f21b6d9d700 1 --2- 172.21.15.46:0/3186933967 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f21b80731f0 0x7f21b8198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:51.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.076+0000 7f21b759e700 1 --2- 172.21.15.46:0/3186933967 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f21b81085f0 0x7f21b819fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:51.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.076+0000 7f21b659c700 1 -- 172.21.15.46:0/3186933967 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f21b80731f0 msgr2=0x7f21b8198870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:51.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.076+0000 7f21b659c700 1 --2- 172.21.15.46:0/3186933967 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f21b80731f0 0x7f21b8198870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.076+0000 7f21b659c700 1 -- 172.21.15.46:0/3186933967 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f21b81085f0 msgr2=0x7f21b819fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:51.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.076+0000 7f21b659c700 1 --2- 172.21.15.46:0/3186933967 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f21b81085f0 0x7f21b819fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.076+0000 7f21b659c700 1 -- 172.21.15.46:0/3186933967 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21a80095f0 con 0x7f21b80747d0 2023-10-19T12:42:51.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.076+0000 7f21b759e700 1 --2- 172.21.15.46:0/3186933967 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f21b81085f0 0x7f21b819fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T12:42:51.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.076+0000 7f21b659c700 1 --2- 172.21.15.46:0/3186933967 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f21b80747d0 0x7f21b8198db0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f21ac00e9a0 tx=0x7f21ac00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:51.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.076+0000 7f219ffff700 1 -- 172.21.15.46:0/3186933967 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21ac009790 con 0x7f21b80747d0 2023-10-19T12:42:51.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.076+0000 7f21bd1ff700 1 -- 172.21.15.46:0/3186933967 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21b81a0950 con 0x7f21b80747d0 2023-10-19T12:42:51.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.077+0000 7f219ffff700 1 -- 172.21.15.46:0/3186933967 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f21ac00cbd0 con 0x7f21b80747d0 2023-10-19T12:42:51.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.077+0000 7f219ffff700 1 -- 172.21.15.46:0/3186933967 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21ac018680 con 0x7f21b80747d0 2023-10-19T12:42:51.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.077+0000 7f21bd1ff700 1 -- 172.21.15.46:0/3186933967 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21b81a0e60 con 0x7f21b80747d0 2023-10-19T12:42:51.092 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:50 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/268118897' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-19T12:42:51.092 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:50 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/200763394' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-19T12:42:51.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.080+0000 7f219ffff700 1 -- 172.21.15.46:0/3186933967 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f21ac00cd40 con 0x7f21b80747d0 2023-10-19T12:42:51.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.081+0000 7f21d0a40b80 1 Processor -- start 2023-10-19T12:42:51.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.081+0000 7f21d0a40b80 1 -- start start 2023-10-19T12:42:51.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.082+0000 7f219ffff700 1 --2- 172.21.15.46:0/3186933967 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f21a00a1510 0x7f21a00a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:51.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.082+0000 7f21d0a40b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557442dd0280 0x557442dd06a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:51.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.082+0000 7f21d0a40b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557442dd0be0 0x557442dcf040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:51.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.082+0000 7f219ffff700 1 -- 172.21.15.46:0/3186933967 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f21ac014070 con 0x7f21b80747d0 2023-10-19T12:42:51.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.082+0000 7f21b759e700 1 --2- 172.21.15.46:0/3186933967 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f21a00a1510 0x7f21a00a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:51.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.082+0000 7f21d0a40b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557442dcf580 0x557442dcfa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:51.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.082+0000 7f21d0a40b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x557442d42690 con 0x557442dd0be0 2023-10-19T12:42:51.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.082+0000 7f21d0a40b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x557442d28c10 con 0x557442dcf580 2023-10-19T12:42:51.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.082+0000 7f21d0a40b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x557442d26530 con 0x557442dd0280 2023-10-19T12:42:51.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.082+0000 7f21b6d9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557442dd0280 0x557442dd06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:51.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.082+0000 7f21b6d9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557442dd0280 0x557442dd06a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:42022/0 (socket says 172.21.15.46:42022) 2023-10-19T12:42:51.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.082+0000 7f21b6d9d700 1 -- 172.21.15.46:0/2401335556 learned_addr learned my addr 172.21.15.46:0/2401335556 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:42:51.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.082+0000 7f21b659c700 1 --2- 172.21.15.46:0/2401335556 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557442dd0be0 0x557442dcf040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:51.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.083+0000 7f21b759e700 1 --2- 172.21.15.46:0/2401335556 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557442dcf580 0x557442dcfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:51.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.083+0000 7f21b659c700 1 -- 172.21.15.46:0/2401335556 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557442dd0280 msgr2=0x557442dd06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:42:51.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.083+0000 7f21b659c700 1 --2- 172.21.15.46:0/2401335556 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557442dd0280 0x557442dd06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.083+0000 7f21b659c700 1 -- 172.21.15.46:0/2401335556 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557442dcf580 msgr2=0x557442dcfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:42:51.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.083+0000 7f21b659c700 1 --2- 172.21.15.46:0/2401335556 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557442dcf580 0x557442dcfa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.083+0000 7f21b659c700 1 -- 172.21.15.46:0/2401335556 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557442cdf3a0 con 0x557442dd0be0 2023-10-19T12:42:51.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.083+0000 7f21b759e700 1 --2- 172.21.15.46:0/2401335556 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557442dcf580 0x557442dcfa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T12:42:51.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.083+0000 7f21b759e700 1 --2- 172.21.15.46:0/3186933967 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f21a00a1510 0x7f21a00a39d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f21b00093c0 tx=0x7f21b0009920 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:51.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.083+0000 7f21b659c700 1 --2- 172.21.15.46:0/2401335556 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557442dd0be0 0x557442dcf040 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f21ac0caae0 tx=0x7f21ac099cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=763ddbbdd5558074 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:51.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.083+0000 7f219d7fa700 1 -- 172.21.15.46:0/2401335556 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21ac09e440 con 0x557442dd0be0 2023-10-19T12:42:51.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.083+0000 7f219d7fa700 1 -- 172.21.15.46:0/2401335556 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f21ac0a2680 con 0x557442dd0be0 2023-10-19T12:42:51.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.083+0000 7f219d7fa700 1 -- 172.21.15.46:0/2401335556 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21ac0997e0 con 0x557442dd0be0 2023-10-19T12:42:51.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.084+0000 7f21d0a40b80 1 -- 172.21.15.46:0/2401335556 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557442dd0be0 msgr2=0x557442dcf040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:51.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.084+0000 7f21d0a40b80 1 --2- 172.21.15.46:0/2401335556 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557442dd0be0 0x557442dcf040 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f21ac0caae0 tx=0x7f21ac099cd0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.084+0000 7f21d0a40b80 1 -- 172.21.15.46:0/2401335556 shutdown_connections 2023-10-19T12:42:51.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.084+0000 7f21d0a40b80 1 --2- 172.21.15.46:0/2401335556 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557442dcf580 0x557442dcfa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.084+0000 7f21d0a40b80 1 --2- 172.21.15.46:0/2401335556 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557442dd0280 0x557442dd06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.084+0000 7f21d0a40b80 1 --2- 172.21.15.46:0/2401335556 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557442dd0be0 0x557442dcf040 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.084+0000 7f21d0a40b80 1 -- 172.21.15.46:0/2401335556 >> 172.21.15.46:0/2401335556 conn(0x557442d436d0 msgr2=0x557442dc9b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:51.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.084+0000 7f21d0a40b80 1 -- 172.21.15.46:0/2401335556 shutdown_connections 2023-10-19T12:42:51.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.084+0000 7f21d0a40b80 1 -- 172.21.15.46:0/2401335556 wait complete. 2023-10-19T12:42:51.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.085+0000 7f21d0a40b80 1 -- start start 2023-10-19T12:42:51.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.085+0000 7f21d0a40b80 1 Processor -- start 2023-10-19T12:42:51.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.085+0000 7f21d0a40b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557442dcf580 0x557442dd8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:51.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.085+0000 7f21d0a40b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557442dd0280 0x557442dd8f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:51.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.085+0000 7f21d0a40b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557442dd0be0 0x557442ddffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:51.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.085+0000 7f21d0a40b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x557442d21e20 con 0x557442dd0280 2023-10-19T12:42:51.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.085+0000 7f21d0a40b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x557442cbe6c0 con 0x557442dd0be0 2023-10-19T12:42:51.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.085+0000 7f21d0a40b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x557442cbe360 con 0x557442dcf580 2023-10-19T12:42:51.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.085+0000 7f21d0a40b80 10 client.0 _ll_register_callbacks cb 0x557442c08a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:42:51.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.086+0000 7f21b659c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557442dd0280 0x557442dd8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:51.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.086+0000 7f21b659c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557442dd0280 0x557442dd8f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39014/0 (socket says 172.21.15.46:39014) 2023-10-19T12:42:51.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.086+0000 7f21b659c700 1 -- 172.21.15.46:0/2529973493 learned_addr learned my addr 172.21.15.46:0/2529973493 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:42:51.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.086+0000 7f21b6d9d700 1 --2- 172.21.15.46:0/2529973493 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557442dcf580 0x557442dd8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:51.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.086+0000 7f21b759e700 1 --2- 172.21.15.46:0/2529973493 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557442dd0be0 0x557442ddffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:51.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.086+0000 7f21b659c700 1 -- 172.21.15.46:0/2529973493 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557442dcf580 msgr2=0x557442dd8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:42:51.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.086+0000 7f21b659c700 1 --2- 172.21.15.46:0/2529973493 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557442dcf580 0x557442dd8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.086+0000 7f21b659c700 1 -- 172.21.15.46:0/2529973493 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557442dd0be0 msgr2=0x557442ddffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:42:51.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.086+0000 7f21b659c700 1 --2- 172.21.15.46:0/2529973493 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557442dd0be0 0x557442ddffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.086+0000 7f21b659c700 1 -- 172.21.15.46:0/2529973493 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21b81a0e60 con 0x557442dd0280 2023-10-19T12:42:51.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.086+0000 7f21b759e700 1 --2- 172.21.15.46:0/2529973493 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557442dd0be0 0x557442ddffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T12:42:51.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.086+0000 7f21b659c700 1 --2- 172.21.15.46:0/2529973493 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557442dd0280 0x557442dd8f70 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f21ac096070 tx=0x7f21ac00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc9171048ee35b20 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:51.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.086+0000 7f219aff5700 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2023-10-19T12:42:51.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.086+0000 7f219aff5700 1 -- 172.21.15.46:0/2529973493 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21ac09e440 con 0x557442dd0280 2023-10-19T12:42:51.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.087+0000 7f21d0a40b80 1 -- 172.21.15.46:0/2529973493 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557442d26ea0 con 0x557442dd0280 2023-10-19T12:42:51.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.087+0000 7f219aff5700 1 -- 172.21.15.46:0/2529973493 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f21ac0cd050 con 0x557442dd0280 2023-10-19T12:42:51.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.087+0000 7f219aff5700 1 -- 172.21.15.46:0/2529973493 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f21ac0cae10 con 0x557442dd0280 2023-10-19T12:42:51.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.087+0000 7f21d0a40b80 10 client.15249 fetch_fsmap learned FSMap version 27 2023-10-19T12:42:51.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.087+0000 7f21d0a40b80 1 -- 172.21.15.46:0/2529973493 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x557442b4cd90 con 0x557442dd0280 2023-10-19T12:42:51.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.087+0000 7f219aff5700 1 -- 172.21.15.46:0/2529973493 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x557442d26ea0 con 0x557442dd0280 2023-10-19T12:42:51.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.087+0000 7f219aff5700 1 -- 172.21.15.46:0/2529973493 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f21ac099250 con 0x557442dd0280 2023-10-19T12:42:51.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.087+0000 7f21d0a40b80 10 client.15249 fetch_fsmap finished waiting for FSMap version 27 2023-10-19T12:42:51.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.087+0000 7f21d0a40b80 10 client.15249 resolve_mds: resolved name 'f' to daemon mds.f 2023-10-19T12:42:51.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.087+0000 7f21d0a40b80 20 client.15249 populate_metadata read hostname 'smithi046' 2023-10-19T12:42:51.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.087+0000 7f21d0a40b80 1 --2- 172.21.15.46:0/2529973493 >> [v2:172.21.15.195:6834/1406909915,v1:172.21.15.195:6835/1406909915] conn(0x557442de4340 0x557442de2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:51.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.087+0000 7f21d0a40b80 4 client.15249 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-19T12:42:51.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.087+0000 7f21d0a40b80 1 -- 172.21.15.46:0/2529973493 --> [v2:172.21.15.195:6834/1406909915,v1:172.21.15.195:6835/1406909915] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557442d9e860 con 0x557442de4340 2023-10-19T12:42:51.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.088+0000 7f21b6d9d700 1 --2- 172.21.15.46:0/2529973493 >> [v2:172.21.15.195:6834/1406909915,v1:172.21.15.195:6835/1406909915] conn(0x557442de4340 0x557442de2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:51.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.088+0000 7f21b6d9d700 1 --2- 172.21.15.46:0/2529973493 >> [v2:172.21.15.195:6834/1406909915,v1:172.21.15.195:6835/1406909915] conn(0x557442de4340 0x557442de2ef0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=2e0e54ea2598fc2e server_cookie=e6c973e1cc8ba28c in_seq=0 out_seq=0 2023-10-19T12:42:51.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.088+0000 7f219aff5700 10 client.15249 ms_handle_connect on v2:172.21.15.195:6834/1406909915 2023-10-19T12:42:51.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.089+0000 7f219aff5700 1 -- 172.21.15.46:0/2529973493 <== mds.3 v2:172.21.15.195:6834/1406909915 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x557442d9e860 con 0x557442de4340 2023-10-19T12:42:51.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.089+0000 7f219aff5700 10 client.15249 handle_command_reply: tid=0 2023-10-19T12:42:51.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.089+0000 7f21d0a40b80 1 client.15249 shutdown 2023-10-19T12:42:51.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.089+0000 7f21d0a40b80 1 -- 172.21.15.46:0/2529973493 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557442dd0280 msgr2=0x557442dd8f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:51.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.089+0000 7f21d0a40b80 1 --2- 172.21.15.46:0/2529973493 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557442dd0280 0x557442dd8f70 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f21ac096070 tx=0x7f21ac00ef60 comp rx=0 tx=0).stop 2023-10-19T12:42:51.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.089+0000 7f21d0a40b80 1 -- 172.21.15.46:0/2529973493 shutdown_connections 2023-10-19T12:42:51.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.089+0000 7f21d0a40b80 1 --2- 172.21.15.46:0/2529973493 >> [v2:172.21.15.195:6834/1406909915,v1:172.21.15.195:6835/1406909915] conn(0x557442de4340 0x557442de2ef0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.089+0000 7f21d0a40b80 1 --2- 172.21.15.46:0/2529973493 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557442dd0be0 0x557442ddffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.089+0000 7f21d0a40b80 1 --2- 172.21.15.46:0/2529973493 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557442dcf580 0x557442dd8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.089+0000 7f21d0a40b80 1 --2- 172.21.15.46:0/2529973493 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557442dd0280 0x557442dd8f70 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.089+0000 7f21d0a40b80 1 -- 172.21.15.46:0/2529973493 >> 172.21.15.46:0/2529973493 conn(0x557442d436d0 msgr2=0x557442dce030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:51.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.089+0000 7f219aff5700 0 client.15249 ms_handle_reset on v2:172.21.15.195:6834/1406909915 2023-10-19T12:42:51.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.090+0000 7f21d0a40b80 1 -- 172.21.15.46:0/2529973493 shutdown_connections 2023-10-19T12:42:51.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.090+0000 7f21d0a40b80 1 -- 172.21.15.46:0/2529973493 wait complete. 2023-10-19T12:42:51.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.090+0000 7f21d0a40b80 20 client.15249 trim_cache size 0 max 16384 2023-10-19T12:42:51.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.108+0000 7f21d0a40b80 1 Processor -- start 2023-10-19T12:42:51.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.108+0000 7f21d0a40b80 1 -- start start 2023-10-19T12:42:51.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.108+0000 7f21d0a40b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557442dcf580 0x557442de2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:51.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.108+0000 7f21d0a40b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557442dd0280 0x557442ddff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:51.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.108+0000 7f21d0a40b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557442dd0be0 0x557442de3430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:51.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.108+0000 7f21d0a40b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x557442ba28d0 con 0x557442dd0be0 2023-10-19T12:42:51.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.108+0000 7f21d0a40b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x557442dc6500 con 0x557442dcf580 2023-10-19T12:42:51.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.108+0000 7f21d0a40b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x557442d26ea0 con 0x557442dd0280 2023-10-19T12:42:51.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.109+0000 7f21b759e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557442dd0be0 0x557442de3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:51.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.109+0000 7f21b759e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557442dd0be0 0x557442de3430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39026/0 (socket says 172.21.15.46:39026) 2023-10-19T12:42:51.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.109+0000 7f21b759e700 1 -- 172.21.15.46:0/72845627 learned_addr learned my addr 172.21.15.46:0/72845627 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:42:51.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.109+0000 7f21b6d9d700 1 --2- 172.21.15.46:0/72845627 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557442dcf580 0x557442de2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:51.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.109+0000 7f21b659c700 1 --2- 172.21.15.46:0/72845627 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557442dd0280 0x557442ddff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:51.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.109+0000 7f21b759e700 1 -- 172.21.15.46:0/72845627 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557442dd0280 msgr2=0x557442ddff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:42:51.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.109+0000 7f21b759e700 1 --2- 172.21.15.46:0/72845627 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557442dd0280 0x557442ddff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.109+0000 7f21b759e700 1 -- 172.21.15.46:0/72845627 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557442dcf580 msgr2=0x557442de2ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:42:51.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.109+0000 7f21b759e700 1 --2- 172.21.15.46:0/72845627 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557442dcf580 0x557442de2ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.109+0000 7f21b759e700 1 -- 172.21.15.46:0/72845627 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557442b35c10 con 0x557442dd0be0 2023-10-19T12:42:51.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.109+0000 7f21b759e700 1 --2- 172.21.15.46:0/72845627 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557442dd0be0 0x557442de3430 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f21b0017500 tx=0x7f21b0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24f9d2e8872499ef server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:51.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.109+0000 7f219dffb700 1 -- 172.21.15.46:0/72845627 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b000e050 con 0x557442dd0be0 2023-10-19T12:42:51.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.109+0000 7f219dffb700 1 -- 172.21.15.46:0/72845627 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f21b000f040 con 0x557442dd0be0 2023-10-19T12:42:51.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.109+0000 7f219dffb700 1 -- 172.21.15.46:0/72845627 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b0018670 con 0x557442dd0be0 2023-10-19T12:42:51.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.110+0000 7f21d0a40b80 1 -- 172.21.15.46:0/72845627 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557442dd0be0 msgr2=0x557442de3430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:51.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.110+0000 7f21d0a40b80 1 --2- 172.21.15.46:0/72845627 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557442dd0be0 0x557442de3430 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f21b0017500 tx=0x7f21b0018000 comp rx=0 tx=0).stop 2023-10-19T12:42:51.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.110+0000 7f21d0a40b80 1 -- 172.21.15.46:0/72845627 shutdown_connections 2023-10-19T12:42:51.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.110+0000 7f21d0a40b80 1 --2- 172.21.15.46:0/72845627 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557442dd0be0 0x557442de3430 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.110+0000 7f21d0a40b80 1 --2- 172.21.15.46:0/72845627 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557442dcf580 0x557442de2ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.110+0000 7f21d0a40b80 1 --2- 172.21.15.46:0/72845627 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557442dd0280 0x557442ddff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.110+0000 7f21d0a40b80 1 -- 172.21.15.46:0/72845627 >> 172.21.15.46:0/72845627 conn(0x557442d436d0 msgr2=0x557442dd7f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:51.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.110+0000 7f21d0a40b80 1 -- 172.21.15.46:0/72845627 shutdown_connections 2023-10-19T12:42:51.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.110+0000 7f21d0a40b80 1 -- 172.21.15.46:0/72845627 wait complete. 2023-10-19T12:42:51.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.110+0000 7f21d0a40b80 1 -- start start 2023-10-19T12:42:51.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.111+0000 7f21d0a40b80 1 Processor -- start 2023-10-19T12:42:51.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.111+0000 7f21d0a40b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557442dcf580 0x557442ddf160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:51.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.111+0000 7f21d0a40b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557442dd0280 0x557442ddf6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:51.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.111+0000 7f21d0a40b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557442dd0be0 0x557442ddfc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:51.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.111+0000 7f21d0a40b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x557442de0350 con 0x557442dd0be0 2023-10-19T12:42:51.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.111+0000 7f21d0a40b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x557442e37d30 con 0x557442dd0280 2023-10-19T12:42:51.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.111+0000 7f21d0a40b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x557442e37ec0 con 0x557442dcf580 2023-10-19T12:42:51.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.111+0000 7f21d0a40b80 10 client.0 _ll_register_callbacks cb 0x557442c08a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:42:51.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.111+0000 7f21b759e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557442dd0be0 0x557442ddfc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:51.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.111+0000 7f21b659c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557442dd0280 0x557442ddf6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:51.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.111+0000 7f21b759e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557442dd0be0 0x557442ddfc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39038/0 (socket says 172.21.15.46:39038) 2023-10-19T12:42:51.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.112+0000 7f21b759e700 1 -- 172.21.15.46:0/1989004257 learned_addr learned my addr 172.21.15.46:0/1989004257 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:42:51.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.112+0000 7f21b659c700 1 --2- 172.21.15.46:0/1989004257 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557442dd0280 0x557442ddf6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:43700/0 (socket says 172.21.15.46:43700) 2023-10-19T12:42:51.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.112+0000 7f21b6d9d700 1 --2- 172.21.15.46:0/1989004257 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557442dcf580 0x557442ddf160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:51.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.112+0000 7f21b659c700 1 -- 172.21.15.46:0/1989004257 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557442dcf580 msgr2=0x557442ddf160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:42:51.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.112+0000 7f21b659c700 1 --2- 172.21.15.46:0/1989004257 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557442dcf580 0x557442ddf160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.112+0000 7f21b659c700 1 -- 172.21.15.46:0/1989004257 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557442dd0be0 msgr2=0x557442ddfc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:42:51.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.112+0000 7f21b659c700 1 --2- 172.21.15.46:0/1989004257 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557442dd0be0 0x557442ddfc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.112+0000 7f21b659c700 1 -- 172.21.15.46:0/1989004257 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21b0020040 con 0x557442dd0280 2023-10-19T12:42:51.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.112+0000 7f21b759e700 1 --2- 172.21.15.46:0/1989004257 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557442dd0be0 0x557442ddfc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:42:51.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.112+0000 7f21b659c700 1 --2- 172.21.15.46:0/1989004257 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557442dd0280 0x557442ddf6a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f21ac00c5b0 tx=0x7f21ac099730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=82ed2d1b36a62ca5 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:51.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.112+0000 7f219aff5700 10 client.0 ms_handle_connect on v2:172.21.15.157:3300/0 2023-10-19T12:42:51.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.112+0000 7f219aff5700 1 -- 172.21.15.46:0/1989004257 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21ac09f570 con 0x557442dd0280 2023-10-19T12:42:51.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.112+0000 7f21d0a40b80 1 -- 172.21.15.46:0/1989004257 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f21ac0a2680 con 0x557442dd0280 2023-10-19T12:42:51.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.112+0000 7f219aff5700 1 -- 172.21.15.46:0/1989004257 <== mon.2 v2:172.21.15.157:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f21ac09e440 con 0x557442dd0280 2023-10-19T12:42:51.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.113+0000 7f219aff5700 1 -- 172.21.15.46:0/1989004257 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f21ac0b82c0 con 0x557442dd0280 2023-10-19T12:42:51.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.113+0000 7f21d0a40b80 10 client.25265 fetch_fsmap learned FSMap version 27 2023-10-19T12:42:51.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.113+0000 7f21d0a40b80 1 -- 172.21.15.46:0/1989004257 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x557442b73200 con 0x557442dd0280 2023-10-19T12:42:51.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.113+0000 7f219aff5700 1 -- 172.21.15.46:0/1989004257 <== mon.2 v2:172.21.15.157:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f21ac0a2680 con 0x557442dd0280 2023-10-19T12:42:51.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.113+0000 7f219aff5700 1 -- 172.21.15.46:0/1989004257 <== mon.2 v2:172.21.15.157:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f21ac0a21f0 con 0x557442dd0280 2023-10-19T12:42:51.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.113+0000 7f21d0a40b80 10 client.25265 fetch_fsmap finished waiting for FSMap version 27 2023-10-19T12:42:51.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.113+0000 7f21d0a40b80 10 client.25265 resolve_mds: resolved name 'f' to daemon mds.f 2023-10-19T12:42:51.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.113+0000 7f21d0a40b80 20 client.25265 populate_metadata read hostname 'smithi046' 2023-10-19T12:42:51.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.113+0000 7f21d0a40b80 1 --2- 172.21.15.46:0/1989004257 >> [v2:172.21.15.195:6834/1406909915,v1:172.21.15.195:6835/1406909915] conn(0x557442e3cd80 0x557442e39200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:51.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.113+0000 7f21d0a40b80 4 client.25265 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-19T12:42:51.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.113+0000 7f21d0a40b80 1 -- 172.21.15.46:0/1989004257 --> [v2:172.21.15.195:6834/1406909915,v1:172.21.15.195:6835/1406909915] -- command(tid 0: {"prefix": "status"}) v1 -- 0x557442d1ae00 con 0x557442e3cd80 2023-10-19T12:42:51.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.113+0000 7f21b6d9d700 1 --2- 172.21.15.46:0/1989004257 >> [v2:172.21.15.195:6834/1406909915,v1:172.21.15.195:6835/1406909915] conn(0x557442e3cd80 0x557442e39200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:51.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.114+0000 7f21b6d9d700 1 --2- 172.21.15.46:0/1989004257 >> [v2:172.21.15.195:6834/1406909915,v1:172.21.15.195:6835/1406909915] conn(0x557442e3cd80 0x557442e39200 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=b3c991631dac7539 server_cookie=6325b563f4ba48da in_seq=0 out_seq=0 2023-10-19T12:42:51.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.114+0000 7f219aff5700 10 client.25265 ms_handle_connect on v2:172.21.15.195:6834/1406909915 2023-10-19T12:42:51.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.114+0000 7f219aff5700 1 -- 172.21.15.46:0/1989004257 <== mds.3 v2:172.21.15.195:6834/1406909915 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x557442d1ae00 con 0x557442e3cd80 2023-10-19T12:42:51.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.114+0000 7f219aff5700 10 client.25265 handle_command_reply: tid=0 2023-10-19T12:42:51.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.114+0000 7f21d0a40b80 1 client.25265 shutdown 2023-10-19T12:42:51.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.114+0000 7f21d0a40b80 1 -- 172.21.15.46:0/1989004257 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557442dd0280 msgr2=0x557442ddf6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:51.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.114+0000 7f21d0a40b80 1 --2- 172.21.15.46:0/1989004257 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557442dd0280 0x557442ddf6a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f21ac00c5b0 tx=0x7f21ac099730 comp rx=0 tx=0).stop 2023-10-19T12:42:51.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.114+0000 7f21d0a40b80 1 -- 172.21.15.46:0/1989004257 shutdown_connections 2023-10-19T12:42:51.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.114+0000 7f21d0a40b80 1 --2- 172.21.15.46:0/1989004257 >> [v2:172.21.15.195:6834/1406909915,v1:172.21.15.195:6835/1406909915] conn(0x557442e3cd80 0x557442e39200 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.114+0000 7f21d0a40b80 1 --2- 172.21.15.46:0/1989004257 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557442dd0be0 0x557442ddfc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.114+0000 7f219aff5700 0 client.25265 ms_handle_reset on v2:172.21.15.195:6834/1406909915 2023-10-19T12:42:51.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.114+0000 7f21d0a40b80 1 --2- 172.21.15.46:0/1989004257 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557442dcf580 0x557442ddf160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.114+0000 7f21d0a40b80 1 --2- 172.21.15.46:0/1989004257 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557442dd0280 0x557442ddf6a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.114+0000 7f21d0a40b80 1 -- 172.21.15.46:0/1989004257 >> 172.21.15.46:0/1989004257 conn(0x557442d436d0 msgr2=0x557442de2ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:51.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.115+0000 7f21d0a40b80 1 -- 172.21.15.46:0/1989004257 shutdown_connections 2023-10-19T12:42:51.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.115+0000 7f21d0a40b80 1 -- 172.21.15.46:0/1989004257 wait complete. 2023-10-19T12:42:51.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.115+0000 7f21d0a40b80 20 client.25265 trim_cache size 0 max 16384 2023-10-19T12:42:51.133 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-10-19T12:42:51.133 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_fsid": "96a8be3c-6e7b-11ee-8db6-212e2dc638e7", 2023-10-19T12:42:51.133 INFO:teuthology.orchestra.run.smithi046.stdout: "whoami": 3, 2023-10-19T12:42:51.133 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 24631, 2023-10-19T12:42:51.134 INFO:teuthology.orchestra.run.smithi046.stdout: "want_state": "up:active", 2023-10-19T12:42:51.134 INFO:teuthology.orchestra.run.smithi046.stdout: "state": "up:active", 2023-10-19T12:42:51.134 INFO:teuthology.orchestra.run.smithi046.stdout: "fs_name": "cephfs", 2023-10-19T12:42:51.134 INFO:teuthology.orchestra.run.smithi046.stdout: "rank_uptime": 65.827080812000005, 2023-10-19T12:42:51.134 INFO:teuthology.orchestra.run.smithi046.stdout: "mdsmap_epoch": 27, 2023-10-19T12:42:51.135 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch": 90, 2023-10-19T12:42:51.135 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch_barrier": 88, 2023-10-19T12:42:51.135 INFO:teuthology.orchestra.run.smithi046.stdout: "uptime": 114.278017448 2023-10-19T12:42:51.135 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-10-19T12:42:51.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.115+0000 7f21bd1ff700 1 -- 172.21.15.46:0/3186933967 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f21a00a1510 msgr2=0x7f21a00a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:51.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.115+0000 7f21bd1ff700 1 --2- 172.21.15.46:0/3186933967 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f21a00a1510 0x7f21a00a39d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f21b00093c0 tx=0x7f21b0009920 comp rx=0 tx=0).stop 2023-10-19T12:42:51.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.115+0000 7f21bd1ff700 1 -- 172.21.15.46:0/3186933967 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f21b80747d0 msgr2=0x7f21b8198db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:51.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.115+0000 7f21bd1ff700 1 --2- 172.21.15.46:0/3186933967 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f21b80747d0 0x7f21b8198db0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f21ac00e9a0 tx=0x7f21ac00ecb0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.115+0000 7f21bd1ff700 1 -- 172.21.15.46:0/3186933967 shutdown_connections 2023-10-19T12:42:51.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.115+0000 7f21bd1ff700 1 --2- 172.21.15.46:0/3186933967 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f21b81085f0 0x7f21b819fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.115+0000 7f21bd1ff700 1 --2- 172.21.15.46:0/3186933967 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f21a00a1510 0x7f21a00a39d0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.115+0000 7f21bd1ff700 1 --2- 172.21.15.46:0/3186933967 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f21b80731f0 0x7f21b8198870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.115+0000 7f21bd1ff700 1 --2- 172.21.15.46:0/3186933967 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f21b80747d0 0x7f21b8198db0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.115+0000 7f21bd1ff700 1 -- 172.21.15.46:0/3186933967 >> 172.21.15.46:0/3186933967 conn(0x7f21b80fbc90 msgr2=0x7f21b8104540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:51.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.116+0000 7f21bd1ff700 1 -- 172.21.15.46:0/3186933967 shutdown_connections 2023-10-19T12:42:51.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.116+0000 7f21bd1ff700 1 -- 172.21.15.46:0/3186933967 wait complete. 2023-10-19T12:42:51.138 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:50 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/268118897' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-19T12:42:51.138 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:50 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/200763394' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-19T12:42:51.139 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-19T12:42:51.347 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.344+0000 7f06283ff700 1 -- 172.21.15.46:0/2278689072 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06200731f0 msgr2=0x7f0620073670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:51.348 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.344+0000 7f06283ff700 1 --2- 172.21.15.46:0/2278689072 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06200731f0 0x7f0620073670 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f0610009990 tx=0x7f0610009ca0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.348 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.344+0000 7f06283ff700 1 -- 172.21.15.46:0/2278689072 shutdown_connections 2023-10-19T12:42:51.348 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.344+0000 7f06283ff700 1 --2- 172.21.15.46:0/2278689072 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f06201085f0 0x7f062010aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.348 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.344+0000 7f06283ff700 1 --2- 172.21.15.46:0/2278689072 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f06200747d0 0x7f0620072c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.344+0000 7f06283ff700 1 --2- 172.21.15.46:0/2278689072 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06200731f0 0x7f0620073670 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.344+0000 7f06283ff700 1 -- 172.21.15.46:0/2278689072 >> 172.21.15.46:0/2278689072 conn(0x7f06200fbc90 msgr2=0x7f06200fe0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:51.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.344+0000 7f06283ff700 1 -- 172.21.15.46:0/2278689072 shutdown_connections 2023-10-19T12:42:51.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.344+0000 7f06283ff700 1 -- 172.21.15.46:0/2278689072 wait complete. 2023-10-19T12:42:51.351 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.346+0000 7f06283ff700 1 Processor -- start 2023-10-19T12:42:51.351 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.346+0000 7f06283ff700 1 -- start start 2023-10-19T12:42:51.352 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.346+0000 7f06283ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f06200731f0 0x7f0620198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:51.352 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.346+0000 7f06283ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06200747d0 0x7f0620198db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:51.352 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.346+0000 7f06283ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f06201085f0 0x7f062019fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:51.352 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.346+0000 7f06283ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06201a03a0 con 0x7f06200747d0 2023-10-19T12:42:51.352 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.346+0000 7f06283ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06201a04e0 con 0x7f06200731f0 2023-10-19T12:42:51.353 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.346+0000 7f06283ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06201a0670 con 0x7f06201085f0 2023-10-19T12:42:51.353 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.347+0000 7f062619b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f06200731f0 0x7f0620198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:51.353 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.347+0000 7f062619b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f06200731f0 0x7f0620198870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:43714/0 (socket says 172.21.15.46:43714) 2023-10-19T12:42:51.353 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.347+0000 7f062619b700 1 -- 172.21.15.46:0/3977970272 learned_addr learned my addr 172.21.15.46:0/3977970272 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:42:51.353 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.347+0000 7f062699c700 1 --2- 172.21.15.46:0/3977970272 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f06201085f0 0x7f062019fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:51.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.347+0000 7f062599a700 1 --2- 172.21.15.46:0/3977970272 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06200747d0 0x7f0620198db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:51.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.347+0000 7f062619b700 1 -- 172.21.15.46:0/3977970272 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f06201085f0 msgr2=0x7f062019fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:51.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.347+0000 7f062619b700 1 --2- 172.21.15.46:0/3977970272 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f06201085f0 0x7f062019fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.347+0000 7f062619b700 1 -- 172.21.15.46:0/3977970272 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06200747d0 msgr2=0x7f0620198db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:51.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.347+0000 7f062619b700 1 --2- 172.21.15.46:0/3977970272 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06200747d0 0x7f0620198db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.347+0000 7f062619b700 1 -- 172.21.15.46:0/3977970272 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06100095f0 con 0x7f06200731f0 2023-10-19T12:42:51.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.347+0000 7f062619b700 1 --2- 172.21.15.46:0/3977970272 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f06200731f0 0x7f0620198870 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f061c00e9a0 tx=0x7f061c00ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:51.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.348+0000 7f06177fe700 1 -- 172.21.15.46:0/3977970272 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f061c009790 con 0x7f06200731f0 2023-10-19T12:42:51.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.348+0000 7f06283ff700 1 -- 172.21.15.46:0/3977970272 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06201a0950 con 0x7f06200731f0 2023-10-19T12:42:51.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.348+0000 7f06177fe700 1 -- 172.21.15.46:0/3977970272 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f061c00cbd0 con 0x7f06200731f0 2023-10-19T12:42:51.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.348+0000 7f06177fe700 1 -- 172.21.15.46:0/3977970272 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f061c018680 con 0x7f06200731f0 2023-10-19T12:42:51.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.348+0000 7f06283ff700 1 -- 172.21.15.46:0/3977970272 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06201a0e60 con 0x7f06200731f0 2023-10-19T12:42:51.358 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.353+0000 7f06177fe700 1 -- 172.21.15.46:0/3977970272 <== mon.2 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f061c00cd40 con 0x7f06200731f0 2023-10-19T12:42:51.358 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.353+0000 7f063bd34b80 1 Processor -- start 2023-10-19T12:42:51.358 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.354+0000 7f063bd34b80 1 -- start start 2023-10-19T12:42:51.358 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.354+0000 7f063bd34b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b3e0144280 0x55b3e01446a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:51.358 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.354+0000 7f063bd34b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b3e0144be0 0x55b3e0143040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:51.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.354+0000 7f063bd34b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b3e0143580 0x55b3e0143a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:51.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.354+0000 7f063bd34b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3e00b6690 con 0x55b3e0143580 2023-10-19T12:42:51.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.354+0000 7f063bd34b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3e009cc10 con 0x55b3e0144280 2023-10-19T12:42:51.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.354+0000 7f063bd34b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3e009a530 con 0x55b3e0144be0 2023-10-19T12:42:51.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.354+0000 7f062599a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b3e0143580 0x55b3e0143a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:51.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.354+0000 7f062619b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b3e0144be0 0x55b3e0143040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:51.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.354+0000 7f062699c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b3e0144280 0x55b3e01446a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:51.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.354+0000 7f062599a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b3e0143580 0x55b3e0143a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39058/0 (socket says 172.21.15.46:39058) 2023-10-19T12:42:51.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.354+0000 7f062599a700 1 -- 172.21.15.46:0/2411942062 learned_addr learned my addr 172.21.15.46:0/2411942062 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:42:51.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.355+0000 7f062699c700 1 -- 172.21.15.46:0/2411942062 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b3e0144be0 msgr2=0x55b3e0143040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:42:51.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.355+0000 7f062699c700 1 --2- 172.21.15.46:0/2411942062 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b3e0144be0 0x55b3e0143040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.355+0000 7f062699c700 1 -- 172.21.15.46:0/2411942062 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b3e0143580 msgr2=0x55b3e0143a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:42:51.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.355+0000 7f062699c700 1 --2- 172.21.15.46:0/2411942062 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b3e0143580 0x55b3e0143a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.355+0000 7f062699c700 1 -- 172.21.15.46:0/2411942062 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b3e00533a0 con 0x55b3e0144280 2023-10-19T12:42:51.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.355+0000 7f062599a700 1 --2- 172.21.15.46:0/2411942062 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b3e0143580 0x55b3e0143a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:42:51.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.355+0000 7f06177fe700 1 --2- 172.21.15.46:0/3977970272 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f060c0a1510 0x7f060c0a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:51.366 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.355+0000 7f062699c700 1 --2- 172.21.15.46:0/2411942062 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b3e0144280 0x55b3e01446a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0618011580 tx=0x7f0618009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a023cf9f1d9b126a server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:51.366 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.355+0000 7f06177fe700 1 -- 172.21.15.46:0/3977970272 <== mon.2 v2:172.21.15.157:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f061c014070 con 0x7f06200731f0 2023-10-19T12:42:51.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.355+0000 7f062619b700 1 --2- 172.21.15.46:0/3977970272 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f060c0a1510 0x7f060c0a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:51.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.355+0000 7f0614bfe700 1 -- 172.21.15.46:0/2411942062 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f061800e040 con 0x55b3e0144280 2023-10-19T12:42:51.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.355+0000 7f0614bfe700 1 -- 172.21.15.46:0/2411942062 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f061800f040 con 0x55b3e0144280 2023-10-19T12:42:51.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.355+0000 7f0614bfe700 1 -- 172.21.15.46:0/2411942062 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06180044f0 con 0x55b3e0144280 2023-10-19T12:42:51.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.356+0000 7f063bd34b80 1 -- 172.21.15.46:0/2411942062 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b3e0144280 msgr2=0x55b3e01446a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:51.368 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.356+0000 7f063bd34b80 1 --2- 172.21.15.46:0/2411942062 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b3e0144280 0x55b3e01446a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0618011580 tx=0x7f0618009920 comp rx=0 tx=0).stop 2023-10-19T12:42:51.368 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.356+0000 7f062619b700 1 --2- 172.21.15.46:0/3977970272 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f060c0a1510 0x7f060c0a39d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f061c0d0fd0 tx=0x7f061c0d0d80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:51.368 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.356+0000 7f063bd34b80 1 -- 172.21.15.46:0/2411942062 shutdown_connections 2023-10-19T12:42:51.368 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.356+0000 7f063bd34b80 1 --2- 172.21.15.46:0/2411942062 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b3e0143580 0x55b3e0143a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.368 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.356+0000 7f063bd34b80 1 --2- 172.21.15.46:0/2411942062 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b3e0144280 0x55b3e01446a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.356+0000 7f063bd34b80 1 --2- 172.21.15.46:0/2411942062 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b3e0144be0 0x55b3e0143040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.356+0000 7f063bd34b80 1 -- 172.21.15.46:0/2411942062 >> 172.21.15.46:0/2411942062 conn(0x55b3e00b76d0 msgr2=0x55b3e013db00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:51.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.356+0000 7f063bd34b80 1 -- 172.21.15.46:0/2411942062 shutdown_connections 2023-10-19T12:42:51.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.356+0000 7f063bd34b80 1 -- 172.21.15.46:0/2411942062 wait complete. 2023-10-19T12:42:51.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.357+0000 7f063bd34b80 1 -- start start 2023-10-19T12:42:51.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.357+0000 7f063bd34b80 1 Processor -- start 2023-10-19T12:42:51.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.358+0000 7f063bd34b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b3e0143580 0x55b3e014caf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:51.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.358+0000 7f063bd34b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b3e0144280 0x55b3e014d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:51.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.358+0000 7f063bd34b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b3e0144be0 0x55b3e0154070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:51.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.358+0000 7f063bd34b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3e0095e20 con 0x55b3e0144280 2023-10-19T12:42:51.370 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.358+0000 7f063bd34b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3e00326c0 con 0x55b3e0143580 2023-10-19T12:42:51.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.358+0000 7f063bd34b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3e0032360 con 0x55b3e0144be0 2023-10-19T12:42:51.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.358+0000 7f063bd34b80 10 client.0 _ll_register_callbacks cb 0x55b3dff7ca30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:42:51.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.358+0000 7f062699c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b3e0143580 0x55b3e014caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:51.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.358+0000 7f062699c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b3e0143580 0x55b3e014caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:43730/0 (socket says 172.21.15.46:43730) 2023-10-19T12:42:51.371 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.358+0000 7f062699c700 1 -- 172.21.15.46:0/3353519626 learned_addr learned my addr 172.21.15.46:0/3353519626 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:42:51.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.358+0000 7f062599a700 1 --2- 172.21.15.46:0/3353519626 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b3e0144280 0x55b3e014d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:51.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.358+0000 7f062699c700 1 --2- 172.21.15.46:0/3353519626 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b3e0144be0 0x55b3e0154070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:51.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.359+0000 7f062699c700 1 -- 172.21.15.46:0/3353519626 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b3e0144be0 msgr2=0x55b3e0154070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:42:51.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.359+0000 7f062699c700 1 --2- 172.21.15.46:0/3353519626 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b3e0144be0 0x55b3e0154070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.359+0000 7f062699c700 1 -- 172.21.15.46:0/3353519626 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b3e0144280 msgr2=0x55b3e014d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:42:51.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.359+0000 7f062699c700 1 --2- 172.21.15.46:0/3353519626 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b3e0144280 0x55b3e014d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.359+0000 7f062699c700 1 -- 172.21.15.46:0/3353519626 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f062010b680 con 0x55b3e0143580 2023-10-19T12:42:51.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.359+0000 7f062699c700 1 --2- 172.21.15.46:0/3353519626 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b3e0143580 0x55b3e014caf0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0618004f50 tx=0x7f0618009e10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd71deefc802b503 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:51.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.359+0000 7f0609ffb700 10 client.0 ms_handle_connect on v2:172.21.15.157:3300/0 2023-10-19T12:42:51.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.359+0000 7f0609ffb700 1 -- 172.21.15.46:0/3353519626 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f061800e070 con 0x55b3e0143580 2023-10-19T12:42:51.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.359+0000 7f063bd34b80 1 -- 172.21.15.46:0/3353519626 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b3e009aea0 con 0x55b3e0143580 2023-10-19T12:42:51.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.359+0000 7f0609ffb700 1 -- 172.21.15.46:0/3353519626 <== mon.2 v2:172.21.15.157:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f0618004480 con 0x55b3e0143580 2023-10-19T12:42:51.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.359+0000 7f0609ffb700 1 -- 172.21.15.46:0/3353519626 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0618004c70 con 0x55b3e0143580 2023-10-19T12:42:51.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.359+0000 7f063bd34b80 10 client.25277 fetch_fsmap learned FSMap version 27 2023-10-19T12:42:51.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.359+0000 7f063bd34b80 1 -- 172.21.15.46:0/3353519626 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7f0618011230 con 0x55b3e0143580 2023-10-19T12:42:51.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.360+0000 7f0609ffb700 1 -- 172.21.15.46:0/3353519626 <== mon.2 v2:172.21.15.157:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55b3e009aea0 con 0x55b3e0143580 2023-10-19T12:42:51.375 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.360+0000 7f0609ffb700 1 -- 172.21.15.46:0/3353519626 <== mon.2 v2:172.21.15.157:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f061801b020 con 0x55b3e0143580 2023-10-19T12:42:51.375 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.360+0000 7f063bd34b80 10 client.25277 fetch_fsmap finished waiting for FSMap version 27 2023-10-19T12:42:51.375 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.360+0000 7f063bd34b80 10 client.25277 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-19T12:42:51.375 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.360+0000 7f063bd34b80 20 client.25277 populate_metadata read hostname 'smithi046' 2023-10-19T12:42:51.375 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.360+0000 7f063bd34b80 1 --2- 172.21.15.46:0/3353519626 >> [v2:172.21.15.195:6836/293916188,v1:172.21.15.195:6837/293916188] conn(0x55b3e0158610 0x55b3e01571c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:51.375 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.360+0000 7f063bd34b80 4 client.25277 mds_command: new command op to 24643 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-19T12:42:51.376 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.360+0000 7f063bd34b80 1 -- 172.21.15.46:0/3353519626 --> [v2:172.21.15.195:6836/293916188,v1:172.21.15.195:6837/293916188] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b3e0112860 con 0x55b3e0158610 2023-10-19T12:42:51.376 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.360+0000 7f062599a700 1 --2- 172.21.15.46:0/3353519626 >> [v2:172.21.15.195:6836/293916188,v1:172.21.15.195:6837/293916188] conn(0x55b3e0158610 0x55b3e01571c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:51.376 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.361+0000 7f0609ffb700 10 client.25277 ms_handle_connect on v2:172.21.15.195:6836/293916188 2023-10-19T12:42:51.376 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.361+0000 7f062599a700 1 --2- 172.21.15.46:0/3353519626 >> [v2:172.21.15.195:6836/293916188,v1:172.21.15.195:6837/293916188] conn(0x55b3e0158610 0x55b3e01571c0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b36d9186ef26eb43 server_cookie=23d127a1e1bdc138 in_seq=0 out_seq=0 2023-10-19T12:42:51.376 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.362+0000 7f0609ffb700 1 -- 172.21.15.46:0/3353519626 <== mds.2 v2:172.21.15.195:6836/293916188 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b3e0112860 con 0x55b3e0158610 2023-10-19T12:42:51.377 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.362+0000 7f0609ffb700 10 client.25277 handle_command_reply: tid=0 2023-10-19T12:42:51.377 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.362+0000 7f063bd34b80 1 client.25277 shutdown 2023-10-19T12:42:51.377 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.362+0000 7f063bd34b80 1 -- 172.21.15.46:0/3353519626 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b3e0143580 msgr2=0x55b3e014caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:51.377 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.362+0000 7f063bd34b80 1 --2- 172.21.15.46:0/3353519626 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b3e0143580 0x55b3e014caf0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0618004f50 tx=0x7f0618009e10 comp rx=0 tx=0).stop 2023-10-19T12:42:51.377 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.362+0000 7f063bd34b80 1 -- 172.21.15.46:0/3353519626 shutdown_connections 2023-10-19T12:42:51.378 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.362+0000 7f063bd34b80 1 --2- 172.21.15.46:0/3353519626 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b3e0144be0 0x55b3e0154070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.378 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.362+0000 7f063bd34b80 1 --2- 172.21.15.46:0/3353519626 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b3e0143580 0x55b3e014caf0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.378 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.362+0000 7f063bd34b80 1 --2- 172.21.15.46:0/3353519626 >> [v2:172.21.15.195:6836/293916188,v1:172.21.15.195:6837/293916188] conn(0x55b3e0158610 0x55b3e01571c0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.378 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.362+0000 7f063bd34b80 1 --2- 172.21.15.46:0/3353519626 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b3e0144280 0x55b3e014d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.378 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.362+0000 7f063bd34b80 1 -- 172.21.15.46:0/3353519626 >> 172.21.15.46:0/3353519626 conn(0x55b3e00b76d0 msgr2=0x55b3e0142030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:51.379 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.362+0000 7f0609ffb700 0 client.25277 ms_handle_reset on v2:172.21.15.195:6836/293916188 2023-10-19T12:42:51.379 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.362+0000 7f063bd34b80 1 -- 172.21.15.46:0/3353519626 shutdown_connections 2023-10-19T12:42:51.379 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.362+0000 7f063bd34b80 1 -- 172.21.15.46:0/3353519626 wait complete. 2023-10-19T12:42:51.379 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.363+0000 7f063bd34b80 20 client.25277 trim_cache size 0 max 16384 2023-10-19T12:42:51.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.381+0000 7f063bd34b80 1 Processor -- start 2023-10-19T12:42:51.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.381+0000 7f063bd34b80 1 -- start start 2023-10-19T12:42:51.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.381+0000 7f063bd34b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b3e0143580 0x55b3e01578d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:51.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.381+0000 7f063bd34b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b3e0144280 0x55b3e0154000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:51.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.381+0000 7f063bd34b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b3e0144be0 0x55b3e0147280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:51.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.381+0000 7f063bd34b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3dff168d0 con 0x55b3e0144280 2023-10-19T12:42:51.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.381+0000 7f063bd34b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3e0091f10 con 0x55b3e0144be0 2023-10-19T12:42:51.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.381+0000 7f063bd34b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3e0054590 con 0x55b3e0143580 2023-10-19T12:42:51.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.381+0000 7f062599a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b3e0144280 0x55b3e0154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:51.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.381+0000 7f062599a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b3e0144280 0x55b3e0154000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39076/0 (socket says 172.21.15.46:39076) 2023-10-19T12:42:51.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.381+0000 7f062599a700 1 -- 172.21.15.46:0/2056141286 learned_addr learned my addr 172.21.15.46:0/2056141286 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:42:51.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.381+0000 7f062699c700 1 --2- 172.21.15.46:0/2056141286 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b3e0143580 0x55b3e01578d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:51.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.381+0000 7f062699c700 1 --2- 172.21.15.46:0/2056141286 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b3e0144be0 0x55b3e0147280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:51.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.382+0000 7f062599a700 1 -- 172.21.15.46:0/2056141286 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b3e0143580 msgr2=0x55b3e01578d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:42:51.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.382+0000 7f062599a700 1 --2- 172.21.15.46:0/2056141286 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b3e0143580 0x55b3e01578d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.382+0000 7f062599a700 1 -- 172.21.15.46:0/2056141286 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b3e0144be0 msgr2=0x55b3e0147280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:42:51.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.382+0000 7f062599a700 1 --2- 172.21.15.46:0/2056141286 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b3e0144be0 0x55b3e0147280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.382+0000 7f062599a700 1 -- 172.21.15.46:0/2056141286 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b3dfec0d90 con 0x55b3e0144280 2023-10-19T12:42:51.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.382+0000 7f062699c700 1 --2- 172.21.15.46:0/2056141286 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b3e0144be0 0x55b3e0147280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T12:42:51.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.382+0000 7f062599a700 1 --2- 172.21.15.46:0/2056141286 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b3e0144280 0x55b3e0154000 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f061000b7b0 tx=0x7f061000b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4015a63e1a551041 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:51.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.382+0000 7f06153ff700 1 -- 172.21.15.46:0/2056141286 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0610005040 con 0x55b3e0144280 2023-10-19T12:42:51.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.382+0000 7f06153ff700 1 -- 172.21.15.46:0/2056141286 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f061001e040 con 0x55b3e0144280 2023-10-19T12:42:51.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.382+0000 7f06153ff700 1 -- 172.21.15.46:0/2056141286 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0610004ca0 con 0x55b3e0144280 2023-10-19T12:42:51.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.383+0000 7f063bd34b80 1 -- 172.21.15.46:0/2056141286 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b3e0144280 msgr2=0x55b3e0154000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:51.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.383+0000 7f063bd34b80 1 --2- 172.21.15.46:0/2056141286 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b3e0144280 0x55b3e0154000 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f061000b7b0 tx=0x7f061000b260 comp rx=0 tx=0).stop 2023-10-19T12:42:51.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.383+0000 7f063bd34b80 1 -- 172.21.15.46:0/2056141286 shutdown_connections 2023-10-19T12:42:51.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.383+0000 7f063bd34b80 1 --2- 172.21.15.46:0/2056141286 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b3e0144be0 0x55b3e0147280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.383+0000 7f063bd34b80 1 --2- 172.21.15.46:0/2056141286 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b3e0143580 0x55b3e01578d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.383+0000 7f063bd34b80 1 --2- 172.21.15.46:0/2056141286 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b3e0144280 0x55b3e0154000 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.383+0000 7f063bd34b80 1 -- 172.21.15.46:0/2056141286 >> 172.21.15.46:0/2056141286 conn(0x55b3e00b76d0 msgr2=0x55b3e01571c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:51.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.383+0000 7f063bd34b80 1 -- 172.21.15.46:0/2056141286 shutdown_connections 2023-10-19T12:42:51.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.383+0000 7f063bd34b80 1 -- 172.21.15.46:0/2056141286 wait complete. 2023-10-19T12:42:51.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.383+0000 7f063bd34b80 1 -- start start 2023-10-19T12:42:51.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.383+0000 7f063bd34b80 1 Processor -- start 2023-10-19T12:42:51.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.384+0000 7f063bd34b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b3e0143580 0x55b3e0151980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:51.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.384+0000 7f063bd34b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b3e0144280 0x55b3e0151ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:51.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.384+0000 7f063bd34b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b3e0144be0 0x55b3e0152de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:51.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.384+0000 7f063bd34b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3e0153320 con 0x55b3e0144be0 2023-10-19T12:42:51.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.384+0000 7f063bd34b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3e0153490 con 0x55b3e0144280 2023-10-19T12:42:51.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.384+0000 7f063bd34b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3e0153650 con 0x55b3e0143580 2023-10-19T12:42:51.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.384+0000 7f063bd34b80 10 client.0 _ll_register_callbacks cb 0x55b3dff7ca30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:42:51.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.384+0000 7f062699c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b3e0143580 0x55b3e0151980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:51.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.384+0000 7f062699c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b3e0143580 0x55b3e0151980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:42084/0 (socket says 172.21.15.46:42084) 2023-10-19T12:42:51.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.384+0000 7f062699c700 1 -- 172.21.15.46:0/2857198524 learned_addr learned my addr 172.21.15.46:0/2857198524 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:42:51.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.384+0000 7f062599a700 1 --2- 172.21.15.46:0/2857198524 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b3e0144280 0x55b3e0151ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:51.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.384+0000 7f062699c700 1 --2- 172.21.15.46:0/2857198524 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b3e0144be0 0x55b3e0152de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:51.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.385+0000 7f062699c700 1 -- 172.21.15.46:0/2857198524 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b3e0144280 msgr2=0x55b3e0151ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:42:51.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.385+0000 7f062699c700 1 --2- 172.21.15.46:0/2857198524 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b3e0144280 0x55b3e0151ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.385+0000 7f062699c700 1 -- 172.21.15.46:0/2857198524 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b3e0144be0 msgr2=0x55b3e0152de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:42:51.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.385+0000 7f062699c700 1 --2- 172.21.15.46:0/2857198524 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b3e0144be0 0x55b3e0152de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.385+0000 7f062699c700 1 -- 172.21.15.46:0/2857198524 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f061000bab0 con 0x55b3e0143580 2023-10-19T12:42:51.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.385+0000 7f062699c700 1 --2- 172.21.15.46:0/2857198524 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b3e0143580 0x55b3e0151980 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0618011580 tx=0x7f0618009ac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63b88edac474c931 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:51.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.385+0000 7f0609ffb700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-10-19T12:42:51.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.385+0000 7f0609ffb700 1 -- 172.21.15.46:0/2857198524 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f061800e040 con 0x55b3e0143580 2023-10-19T12:42:51.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.385+0000 7f063bd34b80 1 -- 172.21.15.46:0/2857198524 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f061800f040 con 0x55b3e0143580 2023-10-19T12:42:51.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.385+0000 7f0609ffb700 1 -- 172.21.15.46:0/2857198524 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f06180073e0 con 0x55b3e0143580 2023-10-19T12:42:51.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.385+0000 7f0609ffb700 1 -- 172.21.15.46:0/2857198524 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f06180075a0 con 0x55b3e0143580 2023-10-19T12:42:51.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.385+0000 7f063bd34b80 10 client.25300 fetch_fsmap learned FSMap version 27 2023-10-19T12:42:51.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.385+0000 7f063bd34b80 1 -- 172.21.15.46:0/2857198524 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55b3dfea9c10 con 0x55b3e0143580 2023-10-19T12:42:51.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.386+0000 7f0609ffb700 1 -- 172.21.15.46:0/2857198524 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f061800f040 con 0x55b3e0143580 2023-10-19T12:42:51.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.386+0000 7f0609ffb700 1 -- 172.21.15.46:0/2857198524 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f061801b070 con 0x55b3e0143580 2023-10-19T12:42:51.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.386+0000 7f063bd34b80 10 client.25300 fetch_fsmap finished waiting for FSMap version 27 2023-10-19T12:42:51.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.386+0000 7f063bd34b80 10 client.25300 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-19T12:42:51.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.386+0000 7f063bd34b80 20 client.25300 populate_metadata read hostname 'smithi046' 2023-10-19T12:42:51.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.386+0000 7f063bd34b80 1 --2- 172.21.15.46:0/2857198524 >> [v2:172.21.15.195:6836/293916188,v1:172.21.15.195:6837/293916188] conn(0x55b3e01b1e80 0x55b3e01ae350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:51.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.386+0000 7f063bd34b80 4 client.25300 mds_command: new command op to 24643 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-19T12:42:51.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.386+0000 7f063bd34b80 1 -- 172.21.15.46:0/2857198524 --> [v2:172.21.15.195:6836/293916188,v1:172.21.15.195:6837/293916188] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55b3e008ee00 con 0x55b3e01b1e80 2023-10-19T12:42:51.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.386+0000 7f062599a700 1 --2- 172.21.15.46:0/2857198524 >> [v2:172.21.15.195:6836/293916188,v1:172.21.15.195:6837/293916188] conn(0x55b3e01b1e80 0x55b3e01ae350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:51.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.387+0000 7f062599a700 1 --2- 172.21.15.46:0/2857198524 >> [v2:172.21.15.195:6836/293916188,v1:172.21.15.195:6837/293916188] conn(0x55b3e01b1e80 0x55b3e01ae350 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7b146aec069f72b6 server_cookie=c32589d69e65f42a in_seq=0 out_seq=0 2023-10-19T12:42:51.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.387+0000 7f0609ffb700 10 client.25300 ms_handle_connect on v2:172.21.15.195:6836/293916188 2023-10-19T12:42:51.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.387+0000 7f0609ffb700 1 -- 172.21.15.46:0/2857198524 <== mds.2 v2:172.21.15.195:6836/293916188 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55b3e008ee00 con 0x55b3e01b1e80 2023-10-19T12:42:51.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.387+0000 7f0609ffb700 10 client.25300 handle_command_reply: tid=0 2023-10-19T12:42:51.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.387+0000 7f063bd34b80 1 client.25300 shutdown 2023-10-19T12:42:51.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.387+0000 7f063bd34b80 1 -- 172.21.15.46:0/2857198524 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b3e0143580 msgr2=0x55b3e0151980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:51.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.387+0000 7f063bd34b80 1 --2- 172.21.15.46:0/2857198524 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b3e0143580 0x55b3e0151980 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0618011580 tx=0x7f0618009ac0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.387+0000 7f063bd34b80 1 -- 172.21.15.46:0/2857198524 shutdown_connections 2023-10-19T12:42:51.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.387+0000 7f063bd34b80 1 --2- 172.21.15.46:0/2857198524 >> [v2:172.21.15.195:6836/293916188,v1:172.21.15.195:6837/293916188] conn(0x55b3e01b1e80 0x55b3e01ae350 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.387+0000 7f063bd34b80 1 --2- 172.21.15.46:0/2857198524 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b3e0144be0 0x55b3e0152de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.387+0000 7f063bd34b80 1 --2- 172.21.15.46:0/2857198524 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b3e0143580 0x55b3e0151980 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.387+0000 7f063bd34b80 1 --2- 172.21.15.46:0/2857198524 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55b3e0144280 0x55b3e0151ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.387+0000 7f063bd34b80 1 -- 172.21.15.46:0/2857198524 >> 172.21.15.46:0/2857198524 conn(0x55b3e00b76d0 msgr2=0x55b3e0147280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:51.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.387+0000 7f0609ffb700 0 client.25300 ms_handle_reset on v2:172.21.15.195:6836/293916188 2023-10-19T12:42:51.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.387+0000 7f063bd34b80 1 -- 172.21.15.46:0/2857198524 shutdown_connections 2023-10-19T12:42:51.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.387+0000 7f063bd34b80 1 -- 172.21.15.46:0/2857198524 wait complete. 2023-10-19T12:42:51.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.388+0000 7f063bd34b80 20 client.25300 trim_cache size 0 max 16384 2023-10-19T12:42:51.405 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-10-19T12:42:51.405 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_fsid": "96a8be3c-6e7b-11ee-8db6-212e2dc638e7", 2023-10-19T12:42:51.405 INFO:teuthology.orchestra.run.smithi046.stdout: "whoami": 2, 2023-10-19T12:42:51.406 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 24643, 2023-10-19T12:42:51.406 INFO:teuthology.orchestra.run.smithi046.stdout: "want_state": "up:active", 2023-10-19T12:42:51.406 INFO:teuthology.orchestra.run.smithi046.stdout: "state": "up:active", 2023-10-19T12:42:51.406 INFO:teuthology.orchestra.run.smithi046.stdout: "fs_name": "cephfs", 2023-10-19T12:42:51.406 INFO:teuthology.orchestra.run.smithi046.stdout: "rank_uptime": 67.109928495000005, 2023-10-19T12:42:51.407 INFO:teuthology.orchestra.run.smithi046.stdout: "mdsmap_epoch": 27, 2023-10-19T12:42:51.407 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch": 90, 2023-10-19T12:42:51.407 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch_barrier": 88, 2023-10-19T12:42:51.407 INFO:teuthology.orchestra.run.smithi046.stdout: "uptime": 112.351817969 2023-10-19T12:42:51.407 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-10-19T12:42:51.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.388+0000 7f06283ff700 1 -- 172.21.15.46:0/3977970272 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f060c0a1510 msgr2=0x7f060c0a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:51.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.388+0000 7f06283ff700 1 --2- 172.21.15.46:0/3977970272 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f060c0a1510 0x7f060c0a39d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f061c0d0fd0 tx=0x7f061c0d0d80 comp rx=0 tx=0).stop 2023-10-19T12:42:51.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.388+0000 7f06283ff700 1 -- 172.21.15.46:0/3977970272 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f06200731f0 msgr2=0x7f0620198870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:51.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.388+0000 7f06283ff700 1 --2- 172.21.15.46:0/3977970272 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f06200731f0 0x7f0620198870 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f061c00e9a0 tx=0x7f061c00ecb0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.388+0000 7f06283ff700 1 -- 172.21.15.46:0/3977970272 shutdown_connections 2023-10-19T12:42:51.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.388+0000 7f06283ff700 1 --2- 172.21.15.46:0/3977970272 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f060c0a1510 0x7f060c0a39d0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.388+0000 7f06283ff700 1 --2- 172.21.15.46:0/3977970272 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f06201085f0 0x7f062019fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.388+0000 7f06283ff700 1 --2- 172.21.15.46:0/3977970272 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f06200731f0 0x7f0620198870 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.388+0000 7f06283ff700 1 --2- 172.21.15.46:0/3977970272 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06200747d0 0x7f0620198db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.388+0000 7f06283ff700 1 -- 172.21.15.46:0/3977970272 >> 172.21.15.46:0/3977970272 conn(0x7f06200fbc90 msgr2=0x7f0620104540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:51.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.388+0000 7f06283ff700 1 -- 172.21.15.46:0/3977970272 shutdown_connections 2023-10-19T12:42:51.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.388+0000 7f06283ff700 1 -- 172.21.15.46:0/3977970272 wait complete. 2023-10-19T12:42:51.411 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2023-10-19T12:42:51.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.615+0000 7fc8149ff700 1 -- 172.21.15.46:0/3401951682 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc8100731f0 msgr2=0x7fc810073670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:51.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.615+0000 7fc8149ff700 1 --2- 172.21.15.46:0/3401951682 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc8100731f0 0x7fc810073670 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc7f8009990 tx=0x7fc7f8009ca0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.615+0000 7fc8149ff700 1 -- 172.21.15.46:0/3401951682 shutdown_connections 2023-10-19T12:42:51.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.615+0000 7fc8149ff700 1 --2- 172.21.15.46:0/3401951682 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc8101085f0 0x7fc81010aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.615+0000 7fc8149ff700 1 --2- 172.21.15.46:0/3401951682 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc8100747d0 0x7fc810072c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.615+0000 7fc8149ff700 1 --2- 172.21.15.46:0/3401951682 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc8100731f0 0x7fc810073670 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.615+0000 7fc8149ff700 1 -- 172.21.15.46:0/3401951682 >> 172.21.15.46:0/3401951682 conn(0x7fc8100fbc90 msgr2=0x7fc8100fe0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:51.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.616+0000 7fc8149ff700 1 -- 172.21.15.46:0/3401951682 shutdown_connections 2023-10-19T12:42:51.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.616+0000 7fc8149ff700 1 -- 172.21.15.46:0/3401951682 wait complete. 2023-10-19T12:42:51.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.616+0000 7fc8149ff700 1 Processor -- start 2023-10-19T12:42:51.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.617+0000 7fc8149ff700 1 -- start start 2023-10-19T12:42:51.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.617+0000 7fc8149ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc8100731f0 0x7fc810198860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:51.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.617+0000 7fc8149ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc8100747d0 0x7fc810198da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:51.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.617+0000 7fc8149ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc8101085f0 0x7fc81019fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:51.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.617+0000 7fc8149ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8101a0390 con 0x7fc8101085f0 2023-10-19T12:42:51.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.617+0000 7fc8149ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8101a04d0 con 0x7fc8100731f0 2023-10-19T12:42:51.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.617+0000 7fc8149ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8101a0660 con 0x7fc8100747d0 2023-10-19T12:42:51.624 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.618+0000 7fc807fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc8100747d0 0x7fc810198da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:51.624 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.618+0000 7fc80ed9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc8101085f0 0x7fc81019fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:51.624 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.618+0000 7fc807fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc8100747d0 0x7fc810198da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:42100/0 (socket says 172.21.15.46:42100) 2023-10-19T12:42:51.624 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.618+0000 7fc807fff700 1 -- 172.21.15.46:0/3178937157 learned_addr learned my addr 172.21.15.46:0/3178937157 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:42:51.624 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.618+0000 7fc80e59c700 1 --2- 172.21.15.46:0/3178937157 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc8100731f0 0x7fc810198860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:51.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.618+0000 7fc807fff700 1 -- 172.21.15.46:0/3178937157 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc8100731f0 msgr2=0x7fc810198860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:51.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.618+0000 7fc807fff700 1 --2- 172.21.15.46:0/3178937157 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc8100731f0 0x7fc810198860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.618+0000 7fc807fff700 1 -- 172.21.15.46:0/3178937157 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc8101085f0 msgr2=0x7fc81019fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:51.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.618+0000 7fc807fff700 1 --2- 172.21.15.46:0/3178937157 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc8101085f0 0x7fc81019fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.618+0000 7fc807fff700 1 -- 172.21.15.46:0/3178937157 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7f80095f0 con 0x7fc8100747d0 2023-10-19T12:42:51.626 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.618+0000 7fc807fff700 1 --2- 172.21.15.46:0/3178937157 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc8100747d0 0x7fc810198da0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc7f80098e0 tx=0x7fc7f8005720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:51.626 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.618+0000 7fc8077fe700 1 -- 172.21.15.46:0/3178937157 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f801d070 con 0x7fc8100747d0 2023-10-19T12:42:51.626 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.619+0000 7fc8149ff700 1 -- 172.21.15.46:0/3178937157 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8101a08e0 con 0x7fc8100747d0 2023-10-19T12:42:51.626 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.619+0000 7fc8077fe700 1 -- 172.21.15.46:0/3178937157 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc7f8022470 con 0x7fc8100747d0 2023-10-19T12:42:51.626 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.619+0000 7fc8077fe700 1 -- 172.21.15.46:0/3178937157 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f8017650 con 0x7fc8100747d0 2023-10-19T12:42:51.627 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.619+0000 7fc8149ff700 1 -- 172.21.15.46:0/3178937157 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8101a0d60 con 0x7fc8100747d0 2023-10-19T12:42:51.631 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.622+0000 7fc8077fe700 1 -- 172.21.15.46:0/3178937157 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7fc7f80225e0 con 0x7fc8100747d0 2023-10-19T12:42:51.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.623+0000 7fc82836eb80 1 Processor -- start 2023-10-19T12:42:51.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.623+0000 7fc82836eb80 1 -- start start 2023-10-19T12:42:51.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.623+0000 7fc82836eb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563fc62c4280 0x563fc62c46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:51.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.623+0000 7fc82836eb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563fc62c4be0 0x563fc62c3040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:51.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.623+0000 7fc82836eb80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563fc62c3580 0x563fc62c3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:51.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.623+0000 7fc82836eb80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fc6236690 con 0x563fc62c3580 2023-10-19T12:42:51.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.623+0000 7fc82836eb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fc621cc10 con 0x563fc62c4be0 2023-10-19T12:42:51.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.623+0000 7fc82836eb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fc621a530 con 0x563fc62c4280 2023-10-19T12:42:51.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.624+0000 7fc8077fe700 1 --2- 172.21.15.46:0/3178937157 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fc7fc0a1510 0x7fc7fc0a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:51.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.624+0000 7fc807fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563fc62c3580 0x563fc62c3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:51.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.624+0000 7fc807fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563fc62c3580 0x563fc62c3a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39124/0 (socket says 172.21.15.46:39124) 2023-10-19T12:42:51.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.624+0000 7fc807fff700 1 -- 172.21.15.46:0/3016476796 learned_addr learned my addr 172.21.15.46:0/3016476796 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:42:51.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.624+0000 7fc80ed9d700 1 --2- 172.21.15.46:0/3016476796 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563fc62c4280 0x563fc62c46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:51.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.624+0000 7fc80e59c700 1 --2- 172.21.15.46:0/3016476796 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563fc62c4be0 0x563fc62c3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:51.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.624+0000 7fc8077fe700 1 -- 172.21.15.46:0/3178937157 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fc7f80ce660 con 0x7fc8100747d0 2023-10-19T12:42:51.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.624+0000 7fc80ed9d700 1 --2- 172.21.15.46:0/3178937157 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fc7fc0a1510 0x7fc7fc0a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:51.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.624+0000 7fc807fff700 1 -- 172.21.15.46:0/3016476796 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563fc62c4280 msgr2=0x563fc62c46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:42:51.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.624+0000 7fc807fff700 1 --2- 172.21.15.46:0/3016476796 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563fc62c4280 0x563fc62c46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.624+0000 7fc807fff700 1 -- 172.21.15.46:0/3016476796 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563fc62c4be0 msgr2=0x563fc62c3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:42:51.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.624+0000 7fc807fff700 1 --2- 172.21.15.46:0/3016476796 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563fc62c4be0 0x563fc62c3040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.624+0000 7fc807fff700 1 -- 172.21.15.46:0/3016476796 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563fc61d33a0 con 0x563fc62c3580 2023-10-19T12:42:51.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.624+0000 7fc80ed9d700 1 --2- 172.21.15.46:0/3016476796 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563fc62c4280 0x563fc62c46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:42:51.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.625+0000 7fc807fff700 1 --2- 172.21.15.46:0/3016476796 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563fc62c3580 0x563fc62c3a00 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fc7f80cbd60 tx=0x7fc7f80c5bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e1f3e4b51e956ef server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:51.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.625+0000 7fc804ff9700 1 -- 172.21.15.46:0/3016476796 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f809b050 con 0x563fc62c3580 2023-10-19T12:42:51.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.625+0000 7fc80ed9d700 1 --2- 172.21.15.46:0/3178937157 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fc7fc0a1510 0x7fc7fc0a39d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc808009ec0 tx=0x7fc80800b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:51.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.625+0000 7fc804ff9700 1 -- 172.21.15.46:0/3016476796 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc7f809bdf0 con 0x563fc62c3580 2023-10-19T12:42:51.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.625+0000 7fc804ff9700 1 -- 172.21.15.46:0/3016476796 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f8099b20 con 0x563fc62c3580 2023-10-19T12:42:51.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.625+0000 7fc82836eb80 1 -- 172.21.15.46:0/3016476796 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563fc62c3580 msgr2=0x563fc62c3a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:51.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.625+0000 7fc82836eb80 1 --2- 172.21.15.46:0/3016476796 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563fc62c3580 0x563fc62c3a00 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fc7f80cbd60 tx=0x7fc7f80c5bd0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.626+0000 7fc82836eb80 1 -- 172.21.15.46:0/3016476796 shutdown_connections 2023-10-19T12:42:51.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.626+0000 7fc82836eb80 1 --2- 172.21.15.46:0/3016476796 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563fc62c3580 0x563fc62c3a00 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.626+0000 7fc82836eb80 1 --2- 172.21.15.46:0/3016476796 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563fc62c4280 0x563fc62c46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.626+0000 7fc82836eb80 1 --2- 172.21.15.46:0/3016476796 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563fc62c4be0 0x563fc62c3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.626+0000 7fc82836eb80 1 -- 172.21.15.46:0/3016476796 >> 172.21.15.46:0/3016476796 conn(0x563fc62376d0 msgr2=0x563fc62bdb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:51.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.626+0000 7fc82836eb80 1 -- 172.21.15.46:0/3016476796 shutdown_connections 2023-10-19T12:42:51.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.626+0000 7fc82836eb80 1 -- 172.21.15.46:0/3016476796 wait complete. 2023-10-19T12:42:51.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.626+0000 7fc82836eb80 1 -- start start 2023-10-19T12:42:51.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.626+0000 7fc82836eb80 1 Processor -- start 2023-10-19T12:42:51.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.627+0000 7fc82836eb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563fc62c3580 0x563fc62d4e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:51.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.627+0000 7fc82836eb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563fc62c4280 0x563fc62d5360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:51.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.627+0000 7fc82836eb80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563fc62c4be0 0x563fc62dc3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:51.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.627+0000 7fc82836eb80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fc6215e20 con 0x563fc62c4be0 2023-10-19T12:42:51.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.627+0000 7fc82836eb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fc61b26c0 con 0x563fc62c4280 2023-10-19T12:42:51.640 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.627+0000 7fc82836eb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fc61b2360 con 0x563fc62c3580 2023-10-19T12:42:51.640 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.627+0000 7fc82836eb80 10 client.0 _ll_register_callbacks cb 0x563fc60fca30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:42:51.640 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.627+0000 7fc80e59c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563fc62c3580 0x563fc62d4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:51.640 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.627+0000 7fc80ed9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563fc62c4be0 0x563fc62dc3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:51.640 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.627+0000 7fc80e59c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563fc62c3580 0x563fc62d4e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:42118/0 (socket says 172.21.15.46:42118) 2023-10-19T12:42:51.640 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.627+0000 7fc80e59c700 1 -- 172.21.15.46:0/2198514247 learned_addr learned my addr 172.21.15.46:0/2198514247 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:42:51.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.627+0000 7fc807fff700 1 --2- 172.21.15.46:0/2198514247 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563fc62c4280 0x563fc62d5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:51.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.628+0000 7fc80e59c700 1 -- 172.21.15.46:0/2198514247 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563fc62c4280 msgr2=0x563fc62d5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:42:51.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.628+0000 7fc80e59c700 1 --2- 172.21.15.46:0/2198514247 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563fc62c4280 0x563fc62d5360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.628+0000 7fc80e59c700 1 -- 172.21.15.46:0/2198514247 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563fc62c4be0 msgr2=0x563fc62dc3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:42:51.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.628+0000 7fc80e59c700 1 --2- 172.21.15.46:0/2198514247 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563fc62c4be0 0x563fc62dc3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.628+0000 7fc80e59c700 1 -- 172.21.15.46:0/2198514247 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc808008570 con 0x563fc62c3580 2023-10-19T12:42:51.642 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.628+0000 7fc80e59c700 1 --2- 172.21.15.46:0/2198514247 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563fc62c3580 0x563fc62d4e20 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc800012860 tx=0x7fc800012b70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ceabd697ac81c4f server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:51.642 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.628+0000 7fc7f5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-10-19T12:42:51.642 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.628+0000 7fc7f5ffb700 1 -- 172.21.15.46:0/2198514247 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc800017070 con 0x563fc62c3580 2023-10-19T12:42:51.642 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.628+0000 7fc82836eb80 1 -- 172.21.15.46:0/2198514247 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563fc621aea0 con 0x563fc62c3580 2023-10-19T12:42:51.642 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.628+0000 7fc7f5ffb700 1 -- 172.21.15.46:0/2198514247 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fc80000f540 con 0x563fc62c3580 2023-10-19T12:42:51.642 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.628+0000 7fc7f5ffb700 1 -- 172.21.15.46:0/2198514247 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc8000122e0 con 0x563fc62c3580 2023-10-19T12:42:51.643 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.629+0000 7fc82836eb80 10 client.25312 fetch_fsmap learned FSMap version 27 2023-10-19T12:42:51.643 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.629+0000 7fc82836eb80 1 -- 172.21.15.46:0/2198514247 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7fc8101a0d60 con 0x563fc62c3580 2023-10-19T12:42:51.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.629+0000 7fc7f5ffb700 1 -- 172.21.15.46:0/2198514247 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x563fc621aea0 con 0x563fc62c3580 2023-10-19T12:42:51.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.629+0000 7fc7f5ffb700 1 -- 172.21.15.46:0/2198514247 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fc8000108a0 con 0x563fc62c3580 2023-10-19T12:42:51.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.629+0000 7fc82836eb80 10 client.25312 fetch_fsmap finished waiting for FSMap version 27 2023-10-19T12:42:51.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.629+0000 7fc82836eb80 10 client.25312 resolve_mds: resolved name 'i' to daemon mds.i 2023-10-19T12:42:51.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.629+0000 7fc82836eb80 20 client.25312 populate_metadata read hostname 'smithi046' 2023-10-19T12:42:51.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.629+0000 7fc82836eb80 1 --2- 172.21.15.46:0/2198514247 >> [v2:172.21.15.195:6838/4094901934,v1:172.21.15.195:6839/4094901934] conn(0x563fc62e0be0 0x563fc62df5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:51.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.629+0000 7fc82836eb80 4 client.25312 mds_command: new command op to 24655 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-19T12:42:51.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.629+0000 7fc82836eb80 1 -- 172.21.15.46:0/2198514247 --> [v2:172.21.15.195:6838/4094901934,v1:172.21.15.195:6839/4094901934] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563fc6292860 con 0x563fc62e0be0 2023-10-19T12:42:51.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.630+0000 7fc807fff700 1 --2- 172.21.15.46:0/2198514247 >> [v2:172.21.15.195:6838/4094901934,v1:172.21.15.195:6839/4094901934] conn(0x563fc62e0be0 0x563fc62df5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:51.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.630+0000 7fc807fff700 1 --2- 172.21.15.46:0/2198514247 >> [v2:172.21.15.195:6838/4094901934,v1:172.21.15.195:6839/4094901934] conn(0x563fc62e0be0 0x563fc62df5f0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=415a1eae81c17393 server_cookie=1319cf78baa13939 in_seq=0 out_seq=0 2023-10-19T12:42:51.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.630+0000 7fc7f5ffb700 10 client.25312 ms_handle_connect on v2:172.21.15.195:6838/4094901934 2023-10-19T12:42:51.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.631+0000 7fc7f5ffb700 1 -- 172.21.15.46:0/2198514247 <== mds.1 v2:172.21.15.195:6838/4094901934 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x563fc6292860 con 0x563fc62e0be0 2023-10-19T12:42:51.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.631+0000 7fc7f5ffb700 10 client.25312 handle_command_reply: tid=0 2023-10-19T12:42:51.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.631+0000 7fc82836eb80 1 client.25312 shutdown 2023-10-19T12:42:51.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.631+0000 7fc82836eb80 1 -- 172.21.15.46:0/2198514247 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563fc62c3580 msgr2=0x563fc62d4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:51.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.631+0000 7fc82836eb80 1 --2- 172.21.15.46:0/2198514247 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563fc62c3580 0x563fc62d4e20 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc800012860 tx=0x7fc800012b70 comp rx=0 tx=0).stop 2023-10-19T12:42:51.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.631+0000 7fc82836eb80 1 -- 172.21.15.46:0/2198514247 shutdown_connections 2023-10-19T12:42:51.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.631+0000 7fc82836eb80 1 --2- 172.21.15.46:0/2198514247 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563fc62c4be0 0x563fc62dc3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.631+0000 7fc82836eb80 1 --2- 172.21.15.46:0/2198514247 >> [v2:172.21.15.195:6838/4094901934,v1:172.21.15.195:6839/4094901934] conn(0x563fc62e0be0 0x563fc62df5f0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.631+0000 7fc82836eb80 1 --2- 172.21.15.46:0/2198514247 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563fc62c3580 0x563fc62d4e20 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.631+0000 7fc82836eb80 1 --2- 172.21.15.46:0/2198514247 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563fc62c4280 0x563fc62d5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.631+0000 7fc7f5ffb700 0 client.25312 ms_handle_reset on v2:172.21.15.195:6838/4094901934 2023-10-19T12:42:51.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.631+0000 7fc82836eb80 1 -- 172.21.15.46:0/2198514247 >> 172.21.15.46:0/2198514247 conn(0x563fc62376d0 msgr2=0x563fc62c2030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:51.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.631+0000 7fc82836eb80 1 -- 172.21.15.46:0/2198514247 shutdown_connections 2023-10-19T12:42:51.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.631+0000 7fc82836eb80 1 -- 172.21.15.46:0/2198514247 wait complete. 2023-10-19T12:42:51.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.632+0000 7fc82836eb80 20 client.25312 trim_cache size 0 max 16384 2023-10-19T12:42:51.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.650+0000 7fc82836eb80 1 Processor -- start 2023-10-19T12:42:51.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.650+0000 7fc82836eb80 1 -- start start 2023-10-19T12:42:51.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.650+0000 7fc82836eb80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563fc62c3580 0x563fc62d4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:51.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.650+0000 7fc82836eb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563fc62c4280 0x563fc62dc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:51.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.650+0000 7fc82836eb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563fc62c4be0 0x563fc62caa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:51.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.650+0000 7fc82836eb80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fc60968d0 con 0x563fc62c3580 2023-10-19T12:42:51.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.650+0000 7fc82836eb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fc6292860 con 0x563fc62c4280 2023-10-19T12:42:51.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.650+0000 7fc82836eb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fc621aea0 con 0x563fc62c4be0 2023-10-19T12:42:51.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.650+0000 7fc80e59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563fc62c3580 0x563fc62d4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:51.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.650+0000 7fc80ed9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563fc62c4be0 0x563fc62caa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:51.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.650+0000 7fc80e59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563fc62c3580 0x563fc62d4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39132/0 (socket says 172.21.15.46:39132) 2023-10-19T12:42:51.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.650+0000 7fc80e59c700 1 -- 172.21.15.46:0/3051947789 learned_addr learned my addr 172.21.15.46:0/3051947789 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:42:51.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.650+0000 7fc807fff700 1 --2- 172.21.15.46:0/3051947789 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563fc62c4280 0x563fc62dc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:51.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.651+0000 7fc80e59c700 1 -- 172.21.15.46:0/3051947789 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563fc62c4be0 msgr2=0x563fc62caa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:42:51.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.651+0000 7fc80e59c700 1 --2- 172.21.15.46:0/3051947789 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563fc62c4be0 0x563fc62caa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.651+0000 7fc80e59c700 1 -- 172.21.15.46:0/3051947789 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563fc62c4280 msgr2=0x563fc62dc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:42:51.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.651+0000 7fc80e59c700 1 --2- 172.21.15.46:0/3051947789 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563fc62c4280 0x563fc62dc2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.651+0000 7fc80e59c700 1 -- 172.21.15.46:0/3051947789 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563fc6040d90 con 0x563fc62c3580 2023-10-19T12:42:51.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.651+0000 7fc807fff700 1 --2- 172.21.15.46:0/3051947789 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563fc62c4280 0x563fc62dc2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T12:42:51.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.651+0000 7fc80e59c700 1 --2- 172.21.15.46:0/3051947789 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563fc62c3580 0x563fc62d4330 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fc800012830 tx=0x7fc800012360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11041ea786e0e606 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:51.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.651+0000 7fc8057fa700 1 -- 172.21.15.46:0/3051947789 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc800017040 con 0x563fc62c3580 2023-10-19T12:42:51.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.651+0000 7fc8057fa700 1 -- 172.21.15.46:0/3051947789 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc8000050d0 con 0x563fc62c3580 2023-10-19T12:42:51.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.651+0000 7fc8057fa700 1 -- 172.21.15.46:0/3051947789 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8000038e0 con 0x563fc62c3580 2023-10-19T12:42:51.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.652+0000 7fc82836eb80 1 -- 172.21.15.46:0/3051947789 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563fc62c3580 msgr2=0x563fc62d4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:51.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.652+0000 7fc82836eb80 1 --2- 172.21.15.46:0/3051947789 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563fc62c3580 0x563fc62d4330 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fc800012830 tx=0x7fc800012360 comp rx=0 tx=0).stop 2023-10-19T12:42:51.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.652+0000 7fc82836eb80 1 -- 172.21.15.46:0/3051947789 shutdown_connections 2023-10-19T12:42:51.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.652+0000 7fc82836eb80 1 --2- 172.21.15.46:0/3051947789 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563fc62c4be0 0x563fc62caa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.652+0000 7fc82836eb80 1 --2- 172.21.15.46:0/3051947789 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563fc62c3580 0x563fc62d4330 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.652+0000 7fc82836eb80 1 --2- 172.21.15.46:0/3051947789 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563fc62c4280 0x563fc62dc2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.652+0000 7fc82836eb80 1 -- 172.21.15.46:0/3051947789 >> 172.21.15.46:0/3051947789 conn(0x563fc62376d0 msgr2=0x563fc62c3960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:51.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.652+0000 7fc82836eb80 1 -- 172.21.15.46:0/3051947789 shutdown_connections 2023-10-19T12:42:51.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.652+0000 7fc82836eb80 1 -- 172.21.15.46:0/3051947789 wait complete. 2023-10-19T12:42:51.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.652+0000 7fc82836eb80 1 -- start start 2023-10-19T12:42:51.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.653+0000 7fc82836eb80 1 Processor -- start 2023-10-19T12:42:51.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.653+0000 7fc82836eb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563fc62c3580 0x563fc62db300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:51.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.653+0000 7fc82836eb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563fc62c4280 0x563fc62db840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:51.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.653+0000 7fc82836eb80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563fc62c4be0 0x563fc62dbd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:51.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.653+0000 7fc82836eb80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fc62dc300 con 0x563fc62c4be0 2023-10-19T12:42:51.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.653+0000 7fc82836eb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fc62dc470 con 0x563fc62c3580 2023-10-19T12:42:51.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.653+0000 7fc82836eb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fc62dc630 con 0x563fc62c4280 2023-10-19T12:42:51.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.653+0000 7fc82836eb80 10 client.0 _ll_register_callbacks cb 0x563fc60fca30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:42:51.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.654+0000 7fc80ed9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563fc62c4be0 0x563fc62dbd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:51.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.654+0000 7fc80ed9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563fc62c4be0 0x563fc62dbd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39144/0 (socket says 172.21.15.46:39144) 2023-10-19T12:42:51.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.654+0000 7fc80ed9d700 1 -- 172.21.15.46:0/730314371 learned_addr learned my addr 172.21.15.46:0/730314371 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:42:51.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.654+0000 7fc80e59c700 1 --2- 172.21.15.46:0/730314371 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563fc62c3580 0x563fc62db300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:51.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.654+0000 7fc807fff700 1 --2- 172.21.15.46:0/730314371 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563fc62c4280 0x563fc62db840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:51.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.654+0000 7fc80e59c700 1 -- 172.21.15.46:0/730314371 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563fc62c4280 msgr2=0x563fc62db840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:42:51.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.654+0000 7fc80e59c700 1 --2- 172.21.15.46:0/730314371 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563fc62c4280 0x563fc62db840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.654+0000 7fc80e59c700 1 -- 172.21.15.46:0/730314371 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563fc62c4be0 msgr2=0x563fc62dbd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:42:51.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.654+0000 7fc80e59c700 1 --2- 172.21.15.46:0/730314371 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563fc62c4be0 0x563fc62dbd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.654+0000 7fc80e59c700 1 -- 172.21.15.46:0/730314371 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8101a0d60 con 0x563fc62c3580 2023-10-19T12:42:51.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.654+0000 7fc80ed9d700 1 --2- 172.21.15.46:0/730314371 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563fc62c4be0 0x563fc62dbd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:42:51.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.654+0000 7fc80e59c700 1 --2- 172.21.15.46:0/730314371 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563fc62c3580 0x563fc62db300 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc800012860 tx=0x7fc800009f80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8fcd336b92cabc8 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:51.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.654+0000 7fc7f5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.157:3300/0 2023-10-19T12:42:51.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.655+0000 7fc7f5ffb700 1 -- 172.21.15.46:0/730314371 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc800017040 con 0x563fc62c3580 2023-10-19T12:42:51.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.655+0000 7fc82836eb80 1 -- 172.21.15.46:0/730314371 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc7f809bdf0 con 0x563fc62c3580 2023-10-19T12:42:51.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.655+0000 7fc7f5ffb700 1 -- 172.21.15.46:0/730314371 <== mon.2 v2:172.21.15.157:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fc800000e40 con 0x563fc62c3580 2023-10-19T12:42:51.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.655+0000 7fc7f5ffb700 1 -- 172.21.15.46:0/730314371 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc800010a80 con 0x563fc62c3580 2023-10-19T12:42:51.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.655+0000 7fc82836eb80 10 client.25301 fetch_fsmap learned FSMap version 27 2023-10-19T12:42:51.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.655+0000 7fc82836eb80 1 -- 172.21.15.46:0/730314371 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x563fc6029c10 con 0x563fc62c3580 2023-10-19T12:42:51.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.655+0000 7fc7f5ffb700 1 -- 172.21.15.46:0/730314371 <== mon.2 v2:172.21.15.157:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc7f809bdf0 con 0x563fc62c3580 2023-10-19T12:42:51.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.655+0000 7fc7f5ffb700 1 -- 172.21.15.46:0/730314371 <== mon.2 v2:172.21.15.157:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fc800033070 con 0x563fc62c3580 2023-10-19T12:42:51.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.655+0000 7fc82836eb80 10 client.25301 fetch_fsmap finished waiting for FSMap version 27 2023-10-19T12:42:51.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.655+0000 7fc82836eb80 10 client.25301 resolve_mds: resolved name 'i' to daemon mds.i 2023-10-19T12:42:51.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.655+0000 7fc82836eb80 20 client.25301 populate_metadata read hostname 'smithi046' 2023-10-19T12:42:51.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.655+0000 7fc82836eb80 1 --2- 172.21.15.46:0/730314371 >> [v2:172.21.15.195:6838/4094901934,v1:172.21.15.195:6839/4094901934] conn(0x563fc63392b0 0x563fc6335730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:51.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.656+0000 7fc82836eb80 4 client.25301 mds_command: new command op to 24655 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-19T12:42:51.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.656+0000 7fc82836eb80 1 -- 172.21.15.46:0/730314371 --> [v2:172.21.15.195:6838/4094901934,v1:172.21.15.195:6839/4094901934] -- command(tid 0: {"prefix": "status"}) v1 -- 0x563fc620ee00 con 0x563fc63392b0 2023-10-19T12:42:51.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.656+0000 7fc807fff700 1 --2- 172.21.15.46:0/730314371 >> [v2:172.21.15.195:6838/4094901934,v1:172.21.15.195:6839/4094901934] conn(0x563fc63392b0 0x563fc6335730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:51.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.656+0000 7fc807fff700 1 --2- 172.21.15.46:0/730314371 >> [v2:172.21.15.195:6838/4094901934,v1:172.21.15.195:6839/4094901934] conn(0x563fc63392b0 0x563fc6335730 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=20fc7d86bd38c183 server_cookie=b68fc444d700d366 in_seq=0 out_seq=0 2023-10-19T12:42:51.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.656+0000 7fc7f5ffb700 10 client.25301 ms_handle_connect on v2:172.21.15.195:6838/4094901934 2023-10-19T12:42:51.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.657+0000 7fc7f5ffb700 1 -- 172.21.15.46:0/730314371 <== mds.1 v2:172.21.15.195:6838/4094901934 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+321 (crc 0 0 0) 0x563fc620ee00 con 0x563fc63392b0 2023-10-19T12:42:51.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.657+0000 7fc7f5ffb700 10 client.25301 handle_command_reply: tid=0 2023-10-19T12:42:51.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.657+0000 7fc82836eb80 1 client.25301 shutdown 2023-10-19T12:42:51.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.657+0000 7fc82836eb80 1 -- 172.21.15.46:0/730314371 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563fc62c3580 msgr2=0x563fc62db300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:51.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.657+0000 7fc82836eb80 1 --2- 172.21.15.46:0/730314371 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563fc62c3580 0x563fc62db300 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc800012860 tx=0x7fc800009f80 comp rx=0 tx=0).stop 2023-10-19T12:42:51.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.657+0000 7fc82836eb80 1 -- 172.21.15.46:0/730314371 shutdown_connections 2023-10-19T12:42:51.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.657+0000 7fc82836eb80 1 --2- 172.21.15.46:0/730314371 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563fc62c4be0 0x563fc62dbd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.657+0000 7fc82836eb80 1 --2- 172.21.15.46:0/730314371 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563fc62c3580 0x563fc62db300 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.657+0000 7fc82836eb80 1 --2- 172.21.15.46:0/730314371 >> [v2:172.21.15.195:6838/4094901934,v1:172.21.15.195:6839/4094901934] conn(0x563fc63392b0 0x563fc6335730 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.657+0000 7fc82836eb80 1 --2- 172.21.15.46:0/730314371 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563fc62c4280 0x563fc62db840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.657+0000 7fc82836eb80 1 -- 172.21.15.46:0/730314371 >> 172.21.15.46:0/730314371 conn(0x563fc62376d0 msgr2=0x563fc62d4330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:51.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.657+0000 7fc7f5ffb700 0 client.25301 ms_handle_reset on v2:172.21.15.195:6838/4094901934 2023-10-19T12:42:51.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.657+0000 7fc82836eb80 1 -- 172.21.15.46:0/730314371 shutdown_connections 2023-10-19T12:42:51.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.657+0000 7fc82836eb80 1 -- 172.21.15.46:0/730314371 wait complete. 2023-10-19T12:42:51.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.657+0000 7fc82836eb80 20 client.25301 trim_cache size 0 max 16384 2023-10-19T12:42:51.675 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-10-19T12:42:51.675 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_fsid": "96a8be3c-6e7b-11ee-8db6-212e2dc638e7", 2023-10-19T12:42:51.676 INFO:teuthology.orchestra.run.smithi046.stdout: "whoami": 1, 2023-10-19T12:42:51.676 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 24655, 2023-10-19T12:42:51.676 INFO:teuthology.orchestra.run.smithi046.stdout: "want_state": "up:active", 2023-10-19T12:42:51.676 INFO:teuthology.orchestra.run.smithi046.stdout: "state": "up:active", 2023-10-19T12:42:51.676 INFO:teuthology.orchestra.run.smithi046.stdout: "fs_name": "cephfs", 2023-10-19T12:42:51.677 INFO:teuthology.orchestra.run.smithi046.stdout: "rank_uptime": 68.390071182, 2023-10-19T12:42:51.677 INFO:teuthology.orchestra.run.smithi046.stdout: "mdsmap_epoch": 27, 2023-10-19T12:42:51.677 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch": 90, 2023-10-19T12:42:51.677 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch_barrier": 88, 2023-10-19T12:42:51.677 INFO:teuthology.orchestra.run.smithi046.stdout: "uptime": 107.976197543 2023-10-19T12:42:51.677 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-10-19T12:42:51.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.657+0000 7fc8149ff700 1 -- 172.21.15.46:0/3178937157 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fc7fc0a1510 msgr2=0x7fc7fc0a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:51.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.658+0000 7fc8149ff700 1 --2- 172.21.15.46:0/3178937157 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fc7fc0a1510 0x7fc7fc0a39d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc808009ec0 tx=0x7fc80800b040 comp rx=0 tx=0).stop 2023-10-19T12:42:51.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.658+0000 7fc8149ff700 1 -- 172.21.15.46:0/3178937157 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc8100747d0 msgr2=0x7fc810198da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:51.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.658+0000 7fc8149ff700 1 --2- 172.21.15.46:0/3178937157 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc8100747d0 0x7fc810198da0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc7f80098e0 tx=0x7fc7f8005720 comp rx=0 tx=0).stop 2023-10-19T12:42:51.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.658+0000 7fc8149ff700 1 -- 172.21.15.46:0/3178937157 shutdown_connections 2023-10-19T12:42:51.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.658+0000 7fc8149ff700 1 --2- 172.21.15.46:0/3178937157 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc8101085f0 0x7fc81019fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.658+0000 7fc8149ff700 1 --2- 172.21.15.46:0/3178937157 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc8100731f0 0x7fc810198860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.658+0000 7fc8149ff700 1 --2- 172.21.15.46:0/3178937157 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fc7fc0a1510 0x7fc7fc0a39d0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.658+0000 7fc8149ff700 1 --2- 172.21.15.46:0/3178937157 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc8100747d0 0x7fc810198da0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.658+0000 7fc8149ff700 1 -- 172.21.15.46:0/3178937157 >> 172.21.15.46:0/3178937157 conn(0x7fc8100fbc90 msgr2=0x7fc810104540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:51.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.658+0000 7fc8149ff700 1 -- 172.21.15.46:0/3178937157 shutdown_connections 2023-10-19T12:42:51.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.658+0000 7fc8149ff700 1 -- 172.21.15.46:0/3178937157 wait complete. 2023-10-19T12:42:51.681 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-19T12:42:51.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.886+0000 7fdd669ff700 1 -- 172.21.15.46:0/364822691 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd600731f0 msgr2=0x7fdd60073670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:51.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.886+0000 7fdd669ff700 1 --2- 172.21.15.46:0/364822691 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd600731f0 0x7fdd60073670 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fdd54009990 tx=0x7fdd54009ca0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.886+0000 7fdd669ff700 1 -- 172.21.15.46:0/364822691 shutdown_connections 2023-10-19T12:42:51.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.886+0000 7fdd669ff700 1 --2- 172.21.15.46:0/364822691 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdd601085f0 0x7fdd6010aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.886+0000 7fdd669ff700 1 --2- 172.21.15.46:0/364822691 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdd600747d0 0x7fdd60072c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.886+0000 7fdd669ff700 1 --2- 172.21.15.46:0/364822691 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd600731f0 0x7fdd60073670 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.886+0000 7fdd669ff700 1 -- 172.21.15.46:0/364822691 >> 172.21.15.46:0/364822691 conn(0x7fdd600fbc90 msgr2=0x7fdd600fe0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:51.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.886+0000 7fdd669ff700 1 -- 172.21.15.46:0/364822691 shutdown_connections 2023-10-19T12:42:51.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.886+0000 7fdd669ff700 1 -- 172.21.15.46:0/364822691 wait complete. 2023-10-19T12:42:51.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.887+0000 7fdd669ff700 1 Processor -- start 2023-10-19T12:42:51.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.887+0000 7fdd669ff700 1 -- start start 2023-10-19T12:42:51.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.887+0000 7fdd669ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdd600731f0 0x7fdd60198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:51.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.887+0000 7fdd669ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd600747d0 0x7fdd60198db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:51.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.887+0000 7fdd669ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdd601085f0 0x7fdd6019fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:51.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.887+0000 7fdd669ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd601a03a0 con 0x7fdd600747d0 2023-10-19T12:42:51.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.887+0000 7fdd669ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd601a04e0 con 0x7fdd601085f0 2023-10-19T12:42:51.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.887+0000 7fdd669ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd601a0670 con 0x7fdd600731f0 2023-10-19T12:42:51.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.888+0000 7fdd5f7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd600747d0 0x7fdd60198db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:51.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.888+0000 7fdd5f7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd600747d0 0x7fdd60198db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39166/0 (socket says 172.21.15.46:39166) 2023-10-19T12:42:51.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.888+0000 7fdd64f9c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdd601085f0 0x7fdd6019fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:51.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.888+0000 7fdd5f7fe700 1 -- 172.21.15.46:0/3148003600 learned_addr learned my addr 172.21.15.46:0/3148003600 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:42:51.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.888+0000 7fdd5ffff700 1 --2- 172.21.15.46:0/3148003600 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdd600731f0 0x7fdd60198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:51.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.888+0000 7fdd5f7fe700 1 -- 172.21.15.46:0/3148003600 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdd600731f0 msgr2=0x7fdd60198870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:51.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.888+0000 7fdd5f7fe700 1 --2- 172.21.15.46:0/3148003600 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdd600731f0 0x7fdd60198870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.888+0000 7fdd5f7fe700 1 -- 172.21.15.46:0/3148003600 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdd601085f0 msgr2=0x7fdd6019fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:51.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.888+0000 7fdd5f7fe700 1 --2- 172.21.15.46:0/3148003600 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdd601085f0 0x7fdd6019fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.888+0000 7fdd5f7fe700 1 -- 172.21.15.46:0/3148003600 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd540095f0 con 0x7fdd600747d0 2023-10-19T12:42:51.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.888+0000 7fdd64f9c700 1 --2- 172.21.15.46:0/3148003600 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdd601085f0 0x7fdd6019fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:42:51.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.888+0000 7fdd5f7fe700 1 --2- 172.21.15.46:0/3148003600 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd600747d0 0x7fdd60198db0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fdd5400b680 tx=0x7fdd54009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:51.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.889+0000 7fdd5d7fa700 1 -- 172.21.15.46:0/3148003600 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd5401d070 con 0x7fdd600747d0 2023-10-19T12:42:51.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.889+0000 7fdd5d7fa700 1 -- 172.21.15.46:0/3148003600 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdd54022470 con 0x7fdd600747d0 2023-10-19T12:42:51.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.889+0000 7fdd669ff700 1 -- 172.21.15.46:0/3148003600 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd601a08f0 con 0x7fdd600747d0 2023-10-19T12:42:51.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.889+0000 7fdd5d7fa700 1 -- 172.21.15.46:0/3148003600 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd54017650 con 0x7fdd600747d0 2023-10-19T12:42:51.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.889+0000 7fdd669ff700 1 -- 172.21.15.46:0/3148003600 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd601a0d10 con 0x7fdd600747d0 2023-10-19T12:42:51.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.892+0000 7fdd5d7fa700 1 -- 172.21.15.46:0/3148003600 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7fdd540225e0 con 0x7fdd600747d0 2023-10-19T12:42:51.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.893+0000 7fdd5d7fa700 1 --2- 172.21.15.46:0/3148003600 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fdd480a1510 0x7fdd480a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:51.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.893+0000 7fdd7a38eb80 1 Processor -- start 2023-10-19T12:42:51.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.893+0000 7fdd5d7fa700 1 -- 172.21.15.46:0/3148003600 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fdd540ce490 con 0x7fdd600747d0 2023-10-19T12:42:51.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.893+0000 7fdd7a38eb80 1 -- start start 2023-10-19T12:42:51.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.893+0000 7fdd5ffff700 1 --2- 172.21.15.46:0/3148003600 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fdd480a1510 0x7fdd480a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:51.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.894+0000 7fdd7a38eb80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5599e6597280 0x5599e65976a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:51.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.894+0000 7fdd7a38eb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5599e6597be0 0x5599e6596040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:51.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.894+0000 7fdd7a38eb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5599e6596580 0x5599e6596a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:51.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.894+0000 7fdd7a38eb80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599e6509690 con 0x5599e6597280 2023-10-19T12:42:51.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.894+0000 7fdd7a38eb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599e64efc10 con 0x5599e6597be0 2023-10-19T12:42:51.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.894+0000 7fdd7a38eb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599e64ed530 con 0x5599e6596580 2023-10-19T12:42:51.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.894+0000 7fdd5ffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5599e6597280 0x5599e65976a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:51.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.894+0000 7fdd5f7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5599e6597be0 0x5599e6596040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:51.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.894+0000 7fdd5ffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5599e6597280 0x5599e65976a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39174/0 (socket says 172.21.15.46:39174) 2023-10-19T12:42:51.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.894+0000 7fdd64f9c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5599e6596580 0x5599e6596a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:51.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.894+0000 7fdd5f7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5599e6597be0 0x5599e6596040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:43830/0 (socket says 172.21.15.46:43830) 2023-10-19T12:42:51.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.894+0000 7fdd5ffff700 1 -- 172.21.15.46:0/1643579520 learned_addr learned my addr 172.21.15.46:0/1643579520 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:42:51.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.894+0000 7fdd5ffff700 1 --2- 172.21.15.46:0/3148003600 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fdd480a1510 0x7fdd480a39d0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fdd50009c60 tx=0x7fdd50009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:51.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.895+0000 7fdd5f7fe700 1 -- 172.21.15.46:0/1643579520 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5599e6596580 msgr2=0x5599e6596a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:42:51.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.895+0000 7fdd5f7fe700 1 --2- 172.21.15.46:0/1643579520 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5599e6596580 0x5599e6596a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.895+0000 7fdd5f7fe700 1 -- 172.21.15.46:0/1643579520 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5599e6597280 msgr2=0x5599e65976a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:42:51.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.895+0000 7fdd5f7fe700 1 --2- 172.21.15.46:0/1643579520 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5599e6597280 0x5599e65976a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.895+0000 7fdd5f7fe700 1 -- 172.21.15.46:0/1643579520 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5599e64a63a0 con 0x5599e6597be0 2023-10-19T12:42:51.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.895+0000 7fdd64f9c700 1 --2- 172.21.15.46:0/1643579520 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5599e6596580 0x5599e6596a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:42:51.905 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.895+0000 7fdd5ffff700 1 --2- 172.21.15.46:0/1643579520 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5599e6597280 0x5599e65976a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:42:51.905 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.895+0000 7fdd5f7fe700 1 --2- 172.21.15.46:0/1643579520 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5599e6597be0 0x5599e6596040 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fdd540cbad0 tx=0x7fdd54022c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7487422d65f8296d server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:51.905 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.895+0000 7fdd467fc700 1 -- 172.21.15.46:0/1643579520 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd5409ba70 con 0x5599e6597be0 2023-10-19T12:42:51.905 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.895+0000 7fdd467fc700 1 -- 172.21.15.46:0/1643579520 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdd5409b370 con 0x5599e6597be0 2023-10-19T12:42:51.905 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.895+0000 7fdd467fc700 1 -- 172.21.15.46:0/1643579520 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd540cbe20 con 0x5599e6597be0 2023-10-19T12:42:51.906 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.896+0000 7fdd7a38eb80 1 -- 172.21.15.46:0/1643579520 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5599e6597be0 msgr2=0x5599e6596040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:51.906 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.896+0000 7fdd7a38eb80 1 --2- 172.21.15.46:0/1643579520 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5599e6597be0 0x5599e6596040 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fdd540cbad0 tx=0x7fdd54022c80 comp rx=0 tx=0).stop 2023-10-19T12:42:51.906 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.896+0000 7fdd7a38eb80 1 -- 172.21.15.46:0/1643579520 shutdown_connections 2023-10-19T12:42:51.906 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.896+0000 7fdd7a38eb80 1 --2- 172.21.15.46:0/1643579520 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5599e6596580 0x5599e6596a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.906 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.896+0000 7fdd7a38eb80 1 --2- 172.21.15.46:0/1643579520 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5599e6597280 0x5599e65976a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.906 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.896+0000 7fdd7a38eb80 1 --2- 172.21.15.46:0/1643579520 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5599e6597be0 0x5599e6596040 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.907 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.896+0000 7fdd7a38eb80 1 -- 172.21.15.46:0/1643579520 >> 172.21.15.46:0/1643579520 conn(0x5599e650a6d0 msgr2=0x5599e6590b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:51.907 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.896+0000 7fdd7a38eb80 1 -- 172.21.15.46:0/1643579520 shutdown_connections 2023-10-19T12:42:51.907 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.896+0000 7fdd7a38eb80 1 -- 172.21.15.46:0/1643579520 wait complete. 2023-10-19T12:42:51.907 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.897+0000 7fdd7a38eb80 1 -- start start 2023-10-19T12:42:51.907 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.897+0000 7fdd7a38eb80 1 Processor -- start 2023-10-19T12:42:51.910 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.898+0000 7fdd7a38eb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5599e6596580 0x5599e659f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:51.911 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.898+0000 7fdd7a38eb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5599e6597280 0x5599e659fd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:51.911 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.898+0000 7fdd7a38eb80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5599e6597be0 0x5599e65a6d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:51.911 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.898+0000 7fdd7a38eb80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599e64e8e20 con 0x5599e6597be0 2023-10-19T12:42:51.911 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.898+0000 7fdd7a38eb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599e64856c0 con 0x5599e6596580 2023-10-19T12:42:51.911 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.898+0000 7fdd7a38eb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599e6485360 con 0x5599e6597280 2023-10-19T12:42:51.912 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.898+0000 7fdd7a38eb80 10 client.0 _ll_register_callbacks cb 0x5599e63cfa30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:42:51.912 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.898+0000 7fdd64f9c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5599e6597be0 0x5599e65a6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:51.912 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.898+0000 7fdd64f9c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5599e6597be0 0x5599e65a6d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39180/0 (socket says 172.21.15.46:39180) 2023-10-19T12:42:51.912 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.898+0000 7fdd64f9c700 1 -- 172.21.15.46:0/3116212491 learned_addr learned my addr 172.21.15.46:0/3116212491 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:42:51.912 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.898+0000 7fdd5ffff700 1 --2- 172.21.15.46:0/3116212491 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5599e6596580 0x5599e659f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:51.913 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.898+0000 7fdd5f7fe700 1 --2- 172.21.15.46:0/3116212491 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5599e6597280 0x5599e659fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:51.913 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.898+0000 7fdd64f9c700 1 -- 172.21.15.46:0/3116212491 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5599e6597280 msgr2=0x5599e659fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:42:51.913 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.898+0000 7fdd64f9c700 1 --2- 172.21.15.46:0/3116212491 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5599e6597280 0x5599e659fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.913 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.899+0000 7fdd64f9c700 1 -- 172.21.15.46:0/3116212491 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5599e6596580 msgr2=0x5599e659f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:42:51.914 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.899+0000 7fdd64f9c700 1 --2- 172.21.15.46:0/3116212491 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5599e6596580 0x5599e659f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.914 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.899+0000 7fdd64f9c700 1 -- 172.21.15.46:0/3116212491 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd50017070 con 0x5599e6597be0 2023-10-19T12:42:51.914 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.899+0000 7fdd5ffff700 1 --2- 172.21.15.46:0/3116212491 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5599e6596580 0x5599e659f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:42:51.914 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.899+0000 7fdd64f9c700 1 --2- 172.21.15.46:0/3116212491 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5599e6597be0 0x5599e65a6d00 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fdd580046e0 tx=0x7fdd580049f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54ed4565f71a9f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:51.914 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.899+0000 7fdd3f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2023-10-19T12:42:51.915 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.899+0000 7fdd3f7fe700 1 -- 172.21.15.46:0/3116212491 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd5800ea50 con 0x5599e6597be0 2023-10-19T12:42:51.915 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.899+0000 7fdd3f7fe700 1 -- 172.21.15.46:0/3116212491 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fdd5800ebb0 con 0x5599e6597be0 2023-10-19T12:42:51.915 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.899+0000 7fdd7a38eb80 1 -- 172.21.15.46:0/3116212491 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5599e64edea0 con 0x5599e6597be0 2023-10-19T12:42:51.915 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.899+0000 7fdd3f7fe700 1 -- 172.21.15.46:0/3116212491 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdd5800ed70 con 0x5599e6597be0 2023-10-19T12:42:51.915 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.899+0000 7fdd7a38eb80 10 client.15303 fetch_fsmap learned FSMap version 27 2023-10-19T12:42:51.915 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.899+0000 7fdd7a38eb80 1 -- 172.21.15.46:0/3116212491 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7fdd601a0d10 con 0x5599e6597be0 2023-10-19T12:42:51.916 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.900+0000 7fdd3f7fe700 1 -- 172.21.15.46:0/3116212491 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5599e64edea0 con 0x5599e6597be0 2023-10-19T12:42:51.916 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.900+0000 7fdd3f7fe700 1 -- 172.21.15.46:0/3116212491 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fdd5801c020 con 0x5599e6597be0 2023-10-19T12:42:51.916 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.900+0000 7fdd7a38eb80 10 client.15303 fetch_fsmap finished waiting for FSMap version 27 2023-10-19T12:42:51.916 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.900+0000 7fdd7a38eb80 10 client.15303 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-19T12:42:51.916 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.900+0000 7fdd7a38eb80 20 client.15303 populate_metadata read hostname 'smithi046' 2023-10-19T12:42:51.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.900+0000 7fdd7a38eb80 1 --2- 172.21.15.46:0/3116212491 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x5599e65ab480 0x5599e65a9f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:51.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.900+0000 7fdd7a38eb80 4 client.15303 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-19T12:42:51.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.900+0000 7fdd7a38eb80 1 -- 172.21.15.46:0/3116212491 --> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5599e6565860 con 0x5599e65ab480 2023-10-19T12:42:51.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.900+0000 7fdd5ffff700 1 --2- 172.21.15.46:0/3116212491 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x5599e65ab480 0x5599e65a9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:51.918 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.901+0000 7fdd5ffff700 1 --2- 172.21.15.46:0/3116212491 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x5599e65ab480 0x5599e65a9f50 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9bc286c191652a3 server_cookie=bdcc2d305827b165 in_seq=0 out_seq=0 2023-10-19T12:42:51.918 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.901+0000 7fdd3f7fe700 10 client.15303 ms_handle_connect on v2:172.21.15.157:6838/552718978 2023-10-19T12:42:51.918 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.902+0000 7fdd3f7fe700 1 -- 172.21.15.46:0/3116212491 <== mds.0 v2:172.21.15.157:6838/552718978 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5599e6565860 con 0x5599e65ab480 2023-10-19T12:42:51.918 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.902+0000 7fdd3f7fe700 10 client.15303 handle_command_reply: tid=0 2023-10-19T12:42:51.918 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.902+0000 7fdd7a38eb80 1 client.15303 shutdown 2023-10-19T12:42:51.918 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.902+0000 7fdd7a38eb80 1 -- 172.21.15.46:0/3116212491 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5599e6597be0 msgr2=0x5599e65a6d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:51.919 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.902+0000 7fdd7a38eb80 1 --2- 172.21.15.46:0/3116212491 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5599e6597be0 0x5599e65a6d00 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fdd580046e0 tx=0x7fdd580049f0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.919 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.902+0000 7fdd7a38eb80 1 -- 172.21.15.46:0/3116212491 shutdown_connections 2023-10-19T12:42:51.919 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.902+0000 7fdd7a38eb80 1 --2- 172.21.15.46:0/3116212491 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x5599e65ab480 0x5599e65a9f50 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.919 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.902+0000 7fdd7a38eb80 1 --2- 172.21.15.46:0/3116212491 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5599e6597be0 0x5599e65a6d00 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.920 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.902+0000 7fdd7a38eb80 1 --2- 172.21.15.46:0/3116212491 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5599e6596580 0x5599e659f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.920 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.902+0000 7fdd3f7fe700 0 client.15303 ms_handle_reset on v2:172.21.15.157:6838/552718978 2023-10-19T12:42:51.920 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.902+0000 7fdd7a38eb80 1 --2- 172.21.15.46:0/3116212491 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5599e6597280 0x5599e659fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.920 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.902+0000 7fdd7a38eb80 1 -- 172.21.15.46:0/3116212491 >> 172.21.15.46:0/3116212491 conn(0x5599e650a6d0 msgr2=0x5599e6595030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:51.920 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.902+0000 7fdd7a38eb80 1 -- 172.21.15.46:0/3116212491 shutdown_connections 2023-10-19T12:42:51.920 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.902+0000 7fdd7a38eb80 1 -- 172.21.15.46:0/3116212491 wait complete. 2023-10-19T12:42:51.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.903+0000 7fdd7a38eb80 20 client.15303 trim_cache size 0 max 16384 2023-10-19T12:42:51.924 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.921+0000 7fdd7a38eb80 1 Processor -- start 2023-10-19T12:42:51.924 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.921+0000 7fdd7a38eb80 1 -- start start 2023-10-19T12:42:51.924 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.921+0000 7fdd7a38eb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5599e6596580 0x5599e658b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:51.925 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.921+0000 7fdd7a38eb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5599e6597280 0x5599e65a6c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:51.925 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.921+0000 7fdd7a38eb80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5599e6597be0 0x5599e659db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:51.925 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.921+0000 7fdd7a38eb80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599e63698d0 con 0x5599e6597be0 2023-10-19T12:42:51.925 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.921+0000 7fdd7a38eb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599e6591070 con 0x5599e6596580 2023-10-19T12:42:51.925 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.921+0000 7fdd7a38eb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599e64edea0 con 0x5599e6597280 2023-10-19T12:42:51.929 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.921+0000 7fdd64f9c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5599e6597be0 0x5599e659db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:51.929 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.921+0000 7fdd64f9c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5599e6597be0 0x5599e659db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39196/0 (socket says 172.21.15.46:39196) 2023-10-19T12:42:51.929 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.921+0000 7fdd5f7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5599e6597280 0x5599e65a6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:51.929 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.921+0000 7fdd64f9c700 1 -- 172.21.15.46:0/4200826446 learned_addr learned my addr 172.21.15.46:0/4200826446 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:42:51.930 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.921+0000 7fdd5ffff700 1 --2- 172.21.15.46:0/4200826446 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5599e6596580 0x5599e658b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:51.930 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.922+0000 7fdd5f7fe700 1 -- 172.21.15.46:0/4200826446 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5599e6596580 msgr2=0x5599e658b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:42:51.930 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.922+0000 7fdd5f7fe700 1 --2- 172.21.15.46:0/4200826446 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5599e6596580 0x5599e658b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.930 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.922+0000 7fdd5f7fe700 1 -- 172.21.15.46:0/4200826446 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5599e6597be0 msgr2=0x5599e659db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:42:51.930 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.922+0000 7fdd5f7fe700 1 --2- 172.21.15.46:0/4200826446 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5599e6597be0 0x5599e659db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.931 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.922+0000 7fdd5f7fe700 1 -- 172.21.15.46:0/4200826446 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5599e6313d90 con 0x5599e6597280 2023-10-19T12:42:51.931 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.922+0000 7fdd5f7fe700 1 --2- 172.21.15.46:0/4200826446 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5599e6597280 0x5599e65a6c20 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fdd54022890 tx=0x7fdd5401a040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c6c25fe6eb58c0e server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:51.931 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.922+0000 7fdd46ffd700 1 -- 172.21.15.46:0/4200826446 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd5409ba70 con 0x5599e6597280 2023-10-19T12:42:51.931 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.922+0000 7fdd46ffd700 1 -- 172.21.15.46:0/4200826446 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdd5409f4c0 con 0x5599e6597280 2023-10-19T12:42:51.931 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.922+0000 7fdd46ffd700 1 -- 172.21.15.46:0/4200826446 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd5409f2f0 con 0x5599e6597280 2023-10-19T12:42:51.932 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.923+0000 7fdd7a38eb80 1 -- 172.21.15.46:0/4200826446 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5599e6597280 msgr2=0x5599e65a6c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:51.932 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.923+0000 7fdd7a38eb80 1 --2- 172.21.15.46:0/4200826446 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5599e6597280 0x5599e65a6c20 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fdd54022890 tx=0x7fdd5401a040 comp rx=0 tx=0).stop 2023-10-19T12:42:51.932 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.923+0000 7fdd7a38eb80 1 -- 172.21.15.46:0/4200826446 shutdown_connections 2023-10-19T12:42:51.932 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.923+0000 7fdd7a38eb80 1 --2- 172.21.15.46:0/4200826446 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5599e6597be0 0x5599e659db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.932 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.923+0000 7fdd7a38eb80 1 --2- 172.21.15.46:0/4200826446 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5599e6596580 0x5599e658b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.932 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.923+0000 7fdd7a38eb80 1 --2- 172.21.15.46:0/4200826446 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5599e6597280 0x5599e65a6c20 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.933 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.923+0000 7fdd7a38eb80 1 -- 172.21.15.46:0/4200826446 >> 172.21.15.46:0/4200826446 conn(0x5599e650a6d0 msgr2=0x5599e6596960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:51.933 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.923+0000 7fdd7a38eb80 1 -- 172.21.15.46:0/4200826446 shutdown_connections 2023-10-19T12:42:51.933 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.923+0000 7fdd7a38eb80 1 -- 172.21.15.46:0/4200826446 wait complete. 2023-10-19T12:42:51.933 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.923+0000 7fdd7a38eb80 1 -- start start 2023-10-19T12:42:51.933 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.924+0000 7fdd7a38eb80 1 Processor -- start 2023-10-19T12:42:51.934 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.924+0000 7fdd7a38eb80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5599e6596580 0x5599e658acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:51.934 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.924+0000 7fdd7a38eb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5599e6597280 0x5599e65a5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:51.934 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.924+0000 7fdd7a38eb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5599e6597be0 0x5599e65a6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:51.934 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.924+0000 7fdd7a38eb80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599e65a6940 con 0x5599e6596580 2023-10-19T12:42:51.934 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.924+0000 7fdd7a38eb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599e65a6ab0 con 0x5599e6597280 2023-10-19T12:42:51.935 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.924+0000 7fdd7a38eb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599e65a6c70 con 0x5599e6597be0 2023-10-19T12:42:51.935 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.924+0000 7fdd7a38eb80 10 client.0 _ll_register_callbacks cb 0x5599e63cfa30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:42:51.935 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.924+0000 7fdd5f7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5599e6597280 0x5599e65a5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:51.935 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.924+0000 7fdd64f9c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5599e6597be0 0x5599e65a6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:51.935 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.924+0000 7fdd5f7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5599e6597280 0x5599e65a5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:43854/0 (socket says 172.21.15.46:43854) 2023-10-19T12:42:51.935 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.924+0000 7fdd5f7fe700 1 -- 172.21.15.46:0/475159034 learned_addr learned my addr 172.21.15.46:0/475159034 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:42:51.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.924+0000 7fdd5ffff700 1 --2- 172.21.15.46:0/475159034 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5599e6596580 0x5599e658acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:51.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.925+0000 7fdd5f7fe700 1 -- 172.21.15.46:0/475159034 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5599e6597be0 msgr2=0x5599e65a6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:42:51.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.925+0000 7fdd5f7fe700 1 --2- 172.21.15.46:0/475159034 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5599e6597be0 0x5599e65a6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.925+0000 7fdd5f7fe700 1 -- 172.21.15.46:0/475159034 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5599e6596580 msgr2=0x5599e658acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:42:51.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.925+0000 7fdd5f7fe700 1 --2- 172.21.15.46:0/475159034 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5599e6596580 0x5599e658acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.925+0000 7fdd5f7fe700 1 -- 172.21.15.46:0/475159034 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5599e64a63a0 con 0x5599e6597280 2023-10-19T12:42:51.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.925+0000 7fdd5ffff700 1 --2- 172.21.15.46:0/475159034 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5599e6596580 0x5599e658acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:42:51.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.925+0000 7fdd5f7fe700 1 --2- 172.21.15.46:0/475159034 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5599e6597280 0x5599e65a5c60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fdd540a3140 tx=0x7fdd540976b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf98dd5f3b7affe4 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:51.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.925+0000 7fdd3f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.157:3300/0 2023-10-19T12:42:51.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.925+0000 7fdd3f7fe700 1 -- 172.21.15.46:0/475159034 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd5409b7d0 con 0x5599e6597280 2023-10-19T12:42:51.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.925+0000 7fdd3f7fe700 1 -- 172.21.15.46:0/475159034 <== mon.2 v2:172.21.15.157:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fdd5409f290 con 0x5599e6597280 2023-10-19T12:42:51.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.925+0000 7fdd7a38eb80 1 -- 172.21.15.46:0/475159034 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdd5409b370 con 0x5599e6597280 2023-10-19T12:42:51.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.925+0000 7fdd3f7fe700 1 -- 172.21.15.46:0/475159034 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdd5409a860 con 0x5599e6597280 2023-10-19T12:42:51.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.925+0000 7fdd7a38eb80 10 client.25319 fetch_fsmap learned FSMap version 27 2023-10-19T12:42:51.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.925+0000 7fdd7a38eb80 1 -- 172.21.15.46:0/475159034 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5599e62fcc10 con 0x5599e6597280 2023-10-19T12:42:51.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.926+0000 7fdd3f7fe700 1 -- 172.21.15.46:0/475159034 <== mon.2 v2:172.21.15.157:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdd5409b370 con 0x5599e6597280 2023-10-19T12:42:51.939 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.926+0000 7fdd3f7fe700 1 -- 172.21.15.46:0/475159034 <== mon.2 v2:172.21.15.157:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fdd540a1270 con 0x5599e6597280 2023-10-19T12:42:51.939 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.926+0000 7fdd7a38eb80 10 client.25319 fetch_fsmap finished waiting for FSMap version 27 2023-10-19T12:42:51.939 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.926+0000 7fdd7a38eb80 10 client.25319 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-19T12:42:51.939 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.926+0000 7fdd7a38eb80 20 client.25319 populate_metadata read hostname 'smithi046' 2023-10-19T12:42:51.939 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.926+0000 7fdd7a38eb80 1 --2- 172.21.15.46:0/475159034 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x5599e6603530 0x5599e65ffab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:51.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.926+0000 7fdd7a38eb80 4 client.25319 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-19T12:42:51.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.926+0000 7fdd7a38eb80 1 -- 172.21.15.46:0/475159034 --> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5599e64e1e00 con 0x5599e6603530 2023-10-19T12:42:51.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.926+0000 7fdd5ffff700 1 --2- 172.21.15.46:0/475159034 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x5599e6603530 0x5599e65ffab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:51.941 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.927+0000 7fdd5ffff700 1 --2- 172.21.15.46:0/475159034 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x5599e6603530 0x5599e65ffab0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f9f80569ac7aa12f server_cookie=a0629398ce086549 in_seq=0 out_seq=0 2023-10-19T12:42:51.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.927+0000 7fdd3f7fe700 10 client.25319 ms_handle_connect on v2:172.21.15.157:6838/552718978 2023-10-19T12:42:51.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.927+0000 7fdd3f7fe700 1 -- 172.21.15.46:0/475159034 <== mds.0 v2:172.21.15.157:6838/552718978 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x5599e64e1e00 con 0x5599e6603530 2023-10-19T12:42:51.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.927+0000 7fdd3f7fe700 10 client.25319 handle_command_reply: tid=0 2023-10-19T12:42:51.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.927+0000 7fdd7a38eb80 1 client.25319 shutdown 2023-10-19T12:42:51.943 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.927+0000 7fdd7a38eb80 1 -- 172.21.15.46:0/475159034 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5599e6597280 msgr2=0x5599e65a5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:51.943 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.927+0000 7fdd7a38eb80 1 --2- 172.21.15.46:0/475159034 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5599e6597280 0x5599e65a5c60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fdd540a3140 tx=0x7fdd540976b0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.943 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.927+0000 7fdd7a38eb80 1 -- 172.21.15.46:0/475159034 shutdown_connections 2023-10-19T12:42:51.943 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.927+0000 7fdd7a38eb80 1 --2- 172.21.15.46:0/475159034 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5599e6597be0 0x5599e65a6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.943 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.927+0000 7fdd7a38eb80 1 --2- 172.21.15.46:0/475159034 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x5599e6603530 0x5599e65ffab0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.944 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.927+0000 7fdd7a38eb80 1 --2- 172.21.15.46:0/475159034 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5599e6596580 0x5599e658acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.944 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.927+0000 7fdd7a38eb80 1 --2- 172.21.15.46:0/475159034 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5599e6597280 0x5599e65a5c60 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.944 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.927+0000 7fdd3f7fe700 0 client.25319 ms_handle_reset on v2:172.21.15.157:6838/552718978 2023-10-19T12:42:51.944 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.927+0000 7fdd7a38eb80 1 -- 172.21.15.46:0/475159034 >> 172.21.15.46:0/475159034 conn(0x5599e650a6d0 msgr2=0x5599e65a9f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:51.944 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.927+0000 7fdd7a38eb80 1 -- 172.21.15.46:0/475159034 shutdown_connections 2023-10-19T12:42:51.945 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.927+0000 7fdd7a38eb80 1 -- 172.21.15.46:0/475159034 wait complete. 2023-10-19T12:42:51.945 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.927+0000 7fdd7a38eb80 20 client.25319 trim_cache size 0 max 16384 2023-10-19T12:42:51.945 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-10-19T12:42:51.945 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_fsid": "96a8be3c-6e7b-11ee-8db6-212e2dc638e7", 2023-10-19T12:42:51.946 INFO:teuthology.orchestra.run.smithi046.stdout: "whoami": 0, 2023-10-19T12:42:51.946 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 24680, 2023-10-19T12:42:51.946 INFO:teuthology.orchestra.run.smithi046.stdout: "want_state": "up:active", 2023-10-19T12:42:51.946 INFO:teuthology.orchestra.run.smithi046.stdout: "state": "up:active", 2023-10-19T12:42:51.946 INFO:teuthology.orchestra.run.smithi046.stdout: "fs_name": "cephfs", 2023-10-19T12:42:51.947 INFO:teuthology.orchestra.run.smithi046.stdout: "rank_uptime": 92.660629870999998, 2023-10-19T12:42:51.947 INFO:teuthology.orchestra.run.smithi046.stdout: "mdsmap_epoch": 27, 2023-10-19T12:42:51.947 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch": 90, 2023-10-19T12:42:51.947 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch_barrier": 88, 2023-10-19T12:42:51.947 INFO:teuthology.orchestra.run.smithi046.stdout: "uptime": 99.687084870999996 2023-10-19T12:42:51.948 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-10-19T12:42:51.948 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.928+0000 7fdd669ff700 1 -- 172.21.15.46:0/3148003600 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fdd480a1510 msgr2=0x7fdd480a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:51.948 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.928+0000 7fdd669ff700 1 --2- 172.21.15.46:0/3148003600 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fdd480a1510 0x7fdd480a39d0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fdd50009c60 tx=0x7fdd50009260 comp rx=0 tx=0).stop 2023-10-19T12:42:51.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.928+0000 7fdd669ff700 1 -- 172.21.15.46:0/3148003600 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd600747d0 msgr2=0x7fdd60198db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:51.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.928+0000 7fdd669ff700 1 --2- 172.21.15.46:0/3148003600 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd600747d0 0x7fdd60198db0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fdd5400b680 tx=0x7fdd54009580 comp rx=0 tx=0).stop 2023-10-19T12:42:51.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.928+0000 7fdd669ff700 1 -- 172.21.15.46:0/3148003600 shutdown_connections 2023-10-19T12:42:51.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.928+0000 7fdd669ff700 1 --2- 172.21.15.46:0/3148003600 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdd601085f0 0x7fdd6019fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.928+0000 7fdd669ff700 1 --2- 172.21.15.46:0/3148003600 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fdd480a1510 0x7fdd480a39d0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.950 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.928+0000 7fdd669ff700 1 --2- 172.21.15.46:0/3148003600 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdd600731f0 0x7fdd60198870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.950 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.928+0000 7fdd669ff700 1 --2- 172.21.15.46:0/3148003600 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd600747d0 0x7fdd60198db0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:51.950 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.928+0000 7fdd669ff700 1 -- 172.21.15.46:0/3148003600 >> 172.21.15.46:0/3148003600 conn(0x7fdd600fbc90 msgr2=0x7fdd60104540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:51.950 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.928+0000 7fdd669ff700 1 -- 172.21.15.46:0/3148003600 shutdown_connections 2023-10-19T12:42:51.950 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:51.928+0000 7fdd669ff700 1 -- 172.21.15.46:0/3148003600 wait complete. 2023-10-19T12:42:51.951 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:51 smithi046 ceph-mon[98509]: pgmap v332: 129 pgs: 129 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-19T12:42:51.952 INFO:tasks.cephadm:Setup complete, yielding 2023-10-19T12:42:51.952 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-10-19T12:42:51.961 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi046.front.sepia.ceph.com 2023-10-19T12:42:51.962 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- bash -c 'ceph orch status' 2023-10-19T12:42:52.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:51 smithi157 ceph-mon[134109]: pgmap v332: 129 pgs: 129 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-19T12:42:52.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:51 smithi195 ceph-mon[134493]: pgmap v332: 129 pgs: 129 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-19T12:42:52.706 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-19T12:42:53.961 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:53 smithi046 ceph-mon[98509]: pgmap v333: 129 pgs: 129 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-19T12:42:54.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:53 smithi157 ceph-mon[134109]: pgmap v333: 129 pgs: 129 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-19T12:42:54.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:53 smithi195 ceph-mon[134493]: pgmap v333: 129 pgs: 129 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-19T12:42:54.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:54.216+0000 7fd91bbf5700 1 -- 172.21.15.46:0/2200110286 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd914100840 msgr2=0x7fd914100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:54.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:54.216+0000 7fd91bbf5700 1 --2- 172.21.15.46:0/2200110286 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd914100840 0x7fd914100c60 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd9100098f0 tx=0x7fd910009c00 comp rx=0 tx=0).stop 2023-10-19T12:42:54.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:54.216+0000 7fd91bbf5700 1 -- 172.21.15.46:0/2200110286 shutdown_connections 2023-10-19T12:42:54.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:54.216+0000 7fd91bbf5700 1 --2- 172.21.15.46:0/2200110286 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd9141023e0 0x7fd914108c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:54.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:54.216+0000 7fd91bbf5700 1 --2- 172.21.15.46:0/2200110286 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd914100840 0x7fd914100c60 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:54.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:54.216+0000 7fd91bbf5700 1 --2- 172.21.15.46:0/2200110286 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd914101a40 0x7fd914101ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:54.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:54.216+0000 7fd91bbf5700 1 -- 172.21.15.46:0/2200110286 >> 172.21.15.46:0/2200110286 conn(0x7fd9140fbe00 msgr2=0x7fd9140fe220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:54.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:54.216+0000 7fd91bbf5700 1 -- 172.21.15.46:0/2200110286 shutdown_connections 2023-10-19T12:42:54.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:54.216+0000 7fd91bbf5700 1 -- 172.21.15.46:0/2200110286 wait complete. 2023-10-19T12:42:54.223 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:54.217+0000 7fd91bbf5700 1 Processor -- start 2023-10-19T12:42:54.223 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:54.217+0000 7fd91bbf5700 1 -- start start 2023-10-19T12:42:54.223 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:54.218+0000 7fd91bbf5700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd914100840 0x7fd9140744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:54.223 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:54.218+0000 7fd91bbf5700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd914101a40 0x7fd914072be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:54.224 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:54.218+0000 7fd91bbf5700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd9141023e0 0x7fd914073120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:54.224 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:54.218+0000 7fd91bbf5700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd914073800 con 0x7fd914101a40 2023-10-19T12:42:54.224 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:54.218+0000 7fd91bbf5700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd914073970 con 0x7fd914100840 2023-10-19T12:42:54.224 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:54.218+0000 7fd91bbf5700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9141a08e0 con 0x7fd9141023e0 2023-10-19T12:42:54.225 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:54.218+0000 7fd919190700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd914101a40 0x7fd914072be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:54.225 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:54.218+0000 7fd919190700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd914101a40 0x7fd914072be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51332/0 (socket says 172.21.15.46:51332) 2023-10-19T12:42:54.225 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:54.218+0000 7fd919190700 1 -- 172.21.15.46:0/3469423477 learned_addr learned my addr 172.21.15.46:0/3469423477 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:42:54.225 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:54.218+0000 7fd919991700 1 --2- 172.21.15.46:0/3469423477 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd914100840 0x7fd9140744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:54.225 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:54.218+0000 7fd91a192700 1 --2- 172.21.15.46:0/3469423477 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd9141023e0 0x7fd914073120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:54.226 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:54.218+0000 7fd919190700 1 -- 172.21.15.46:0/3469423477 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd9141023e0 msgr2=0x7fd914073120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:54.226 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:54.218+0000 7fd919190700 1 --2- 172.21.15.46:0/3469423477 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd9141023e0 0x7fd914073120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:54.226 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:54.218+0000 7fd919190700 1 -- 172.21.15.46:0/3469423477 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd914100840 msgr2=0x7fd9140744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:54.226 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:54.218+0000 7fd919190700 1 --2- 172.21.15.46:0/3469423477 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd914100840 0x7fd9140744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:54.226 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:54.218+0000 7fd919190700 1 -- 172.21.15.46:0/3469423477 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9040095f0 con 0x7fd914101a40 2023-10-19T12:42:54.227 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:54.218+0000 7fd91a192700 1 --2- 172.21.15.46:0/3469423477 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd9141023e0 0x7fd914073120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T12:42:54.227 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:54.219+0000 7fd919190700 1 --2- 172.21.15.46:0/3469423477 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd914101a40 0x7fd914072be0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fd90400ec10 tx=0x7fd90400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:54.227 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:54.219+0000 7fd90affd700 1 -- 172.21.15.46:0/3469423477 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90400cd40 con 0x7fd914101a40 2023-10-19T12:42:54.227 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:54.219+0000 7fd91bbf5700 1 -- 172.21.15.46:0/3469423477 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd910009520 con 0x7fd914101a40 2023-10-19T12:42:54.227 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:54.219+0000 7fd90affd700 1 -- 172.21.15.46:0/3469423477 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd9040044e0 con 0x7fd914101a40 2023-10-19T12:42:54.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:54.219+0000 7fd90affd700 1 -- 172.21.15.46:0/3469423477 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd904010690 con 0x7fd914101a40 2023-10-19T12:42:54.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:54.219+0000 7fd91bbf5700 1 -- 172.21.15.46:0/3469423477 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9141a0ed0 con 0x7fd914101a40 2023-10-19T12:42:54.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:54.220+0000 7fd91bbf5700 1 -- 172.21.15.46:0/3469423477 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd914107e30 con 0x7fd914101a40 2023-10-19T12:42:54.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:54.222+0000 7fd90affd700 1 -- 172.21.15.46:0/3469423477 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7fd904003710 con 0x7fd914101a40 2023-10-19T12:42:54.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:54.224+0000 7fd90affd700 1 --2- 172.21.15.46:0/3469423477 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fd9000a1590 0x7fd9000a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:54.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:54.225+0000 7fd90affd700 1 -- 172.21.15.46:0/3469423477 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fd904014070 con 0x7fd914101a40 2023-10-19T12:42:54.230 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:54.225+0000 7fd919991700 1 --2- 172.21.15.46:0/3469423477 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fd9000a1590 0x7fd9000a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:54.230 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:54.225+0000 7fd919991700 1 --2- 172.21.15.46:0/3469423477 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fd9000a1590 0x7fd9000a3a50 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd9100098c0 tx=0x7fd910019040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:54.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:54.229+0000 7fd90affd700 1 -- 172.21.15.46:0/3469423477 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd9040968a0 con 0x7fd914101a40 2023-10-19T12:42:54.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:54.460+0000 7fd91bbf5700 1 -- 172.21.15.46:0/3469423477 --> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd91402cf80 con 0x7fd9000a1590 2023-10-19T12:42:54.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:54.461+0000 7fd90affd700 1 -- 172.21.15.46:0/3469423477 <== mgr.14150 v2:172.21.15.46:6800/3168073651 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fd91402cf80 con 0x7fd9000a1590 2023-10-19T12:42:54.465 INFO:teuthology.orchestra.run.smithi046.stdout:Backend: cephadm 2023-10-19T12:42:54.465 INFO:teuthology.orchestra.run.smithi046.stdout:Available: Yes 2023-10-19T12:42:54.465 INFO:teuthology.orchestra.run.smithi046.stdout:Paused: No 2023-10-19T12:42:54.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:54.463+0000 7fd91bbf5700 1 -- 172.21.15.46:0/3469423477 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fd9000a1590 msgr2=0x7fd9000a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:54.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:54.463+0000 7fd91bbf5700 1 --2- 172.21.15.46:0/3469423477 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fd9000a1590 0x7fd9000a3a50 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd9100098c0 tx=0x7fd910019040 comp rx=0 tx=0).stop 2023-10-19T12:42:54.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:54.463+0000 7fd91bbf5700 1 -- 172.21.15.46:0/3469423477 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd914101a40 msgr2=0x7fd914072be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:54.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:54.463+0000 7fd91bbf5700 1 --2- 172.21.15.46:0/3469423477 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd914101a40 0x7fd914072be0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fd90400ec10 tx=0x7fd90400ef20 comp rx=0 tx=0).stop 2023-10-19T12:42:54.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:54.464+0000 7fd91bbf5700 1 -- 172.21.15.46:0/3469423477 shutdown_connections 2023-10-19T12:42:54.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:54.464+0000 7fd91bbf5700 1 --2- 172.21.15.46:0/3469423477 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fd9000a1590 0x7fd9000a3a50 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:54.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:54.464+0000 7fd91bbf5700 1 --2- 172.21.15.46:0/3469423477 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd9141023e0 0x7fd914073120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:54.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:54.464+0000 7fd91bbf5700 1 --2- 172.21.15.46:0/3469423477 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd914100840 0x7fd9140744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:54.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:54.464+0000 7fd91bbf5700 1 --2- 172.21.15.46:0/3469423477 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd914101a40 0x7fd914072be0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:54.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:54.464+0000 7fd91bbf5700 1 -- 172.21.15.46:0/3469423477 >> 172.21.15.46:0/3469423477 conn(0x7fd9140fbe00 msgr2=0x7fd914104f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:54.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:54.464+0000 7fd91bbf5700 1 -- 172.21.15.46:0/3469423477 shutdown_connections 2023-10-19T12:42:54.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:54.464+0000 7fd91bbf5700 1 -- 172.21.15.46:0/3469423477 wait complete. 2023-10-19T12:42:54.903 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- bash -c 'ceph orch ps' 2023-10-19T12:42:55.654 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-19T12:42:56.007 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:55 smithi046 ceph-mon[98509]: from='client.15315 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-19T12:42:56.007 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:55 smithi046 ceph-mon[98509]: pgmap v334: 129 pgs: 129 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-10-19T12:42:56.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:55 smithi157 ceph-mon[134109]: from='client.15315 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-19T12:42:56.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:55 smithi157 ceph-mon[134109]: pgmap v334: 129 pgs: 129 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-10-19T12:42:56.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:55 smithi195 ceph-mon[134493]: from='client.15315 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-19T12:42:56.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:55 smithi195 ceph-mon[134493]: pgmap v334: 129 pgs: 129 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-10-19T12:42:57.195 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:57.191+0000 7f3940e46700 1 -- 172.21.15.46:0/3678675958 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f393c1023e0 msgr2=0x7f393c108c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:57.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:57.191+0000 7f3940e46700 1 --2- 172.21.15.46:0/3678675958 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f393c1023e0 0x7f393c108c90 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f393400b0a0 tx=0x7f393400b3b0 comp rx=0 tx=0).stop 2023-10-19T12:42:57.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:57.191+0000 7f3940e46700 1 -- 172.21.15.46:0/3678675958 shutdown_connections 2023-10-19T12:42:57.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:57.191+0000 7f3940e46700 1 --2- 172.21.15.46:0/3678675958 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f393c1023e0 0x7f393c108c90 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:57.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:57.191+0000 7f3940e46700 1 --2- 172.21.15.46:0/3678675958 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f393c100840 0x7f393c100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:57.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:57.191+0000 7f3940e46700 1 --2- 172.21.15.46:0/3678675958 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f393c101a40 0x7f393c101ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:57.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:57.191+0000 7f3940e46700 1 -- 172.21.15.46:0/3678675958 >> 172.21.15.46:0/3678675958 conn(0x7f393c0fbe00 msgr2=0x7f393c0fe220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:57.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:57.191+0000 7f3940e46700 1 -- 172.21.15.46:0/3678675958 shutdown_connections 2023-10-19T12:42:57.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:57.191+0000 7f3940e46700 1 -- 172.21.15.46:0/3678675958 wait complete. 2023-10-19T12:42:57.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:57.192+0000 7f3940e46700 1 Processor -- start 2023-10-19T12:42:57.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:57.193+0000 7f3940e46700 1 -- start start 2023-10-19T12:42:57.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:57.193+0000 7f3940e46700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f393c100840 0x7f393c074540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:57.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:57.193+0000 7f3940e46700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f393c101a40 0x7f393c072be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:57.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:57.193+0000 7f3940e46700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f393c1023e0 0x7f393c073120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:57.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:57.193+0000 7f3940e46700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f393c0738c0 con 0x7f393c101a40 2023-10-19T12:42:57.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:57.193+0000 7f3940e46700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f393c073a30 con 0x7f393c1023e0 2023-10-19T12:42:57.201 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:57.193+0000 7f3940e46700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f393c1a08d0 con 0x7f393c100840 2023-10-19T12:42:57.201 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:57.193+0000 7f3939d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f393c101a40 0x7f393c072be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:57.201 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:57.193+0000 7f3939d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f393c101a40 0x7f393c072be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51354/0 (socket says 172.21.15.46:51354) 2023-10-19T12:42:57.201 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:57.193+0000 7f3939d9b700 1 -- 172.21.15.46:0/4165386635 learned_addr learned my addr 172.21.15.46:0/4165386635 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:42:57.201 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:57.193+0000 7f393a59c700 1 --2- 172.21.15.46:0/4165386635 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f393c100840 0x7f393c074540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:57.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:57.194+0000 7f393ad9d700 1 --2- 172.21.15.46:0/4165386635 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f393c1023e0 0x7f393c073120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:57.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:57.194+0000 7f3939d9b700 1 -- 172.21.15.46:0/4165386635 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f393c100840 msgr2=0x7f393c074540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:57.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:57.194+0000 7f3939d9b700 1 --2- 172.21.15.46:0/4165386635 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f393c100840 0x7f393c074540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:57.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:57.194+0000 7f3939d9b700 1 -- 172.21.15.46:0/4165386635 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f393c1023e0 msgr2=0x7f393c073120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:57.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:57.194+0000 7f3939d9b700 1 --2- 172.21.15.46:0/4165386635 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f393c1023e0 0x7f393c073120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:57.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:57.194+0000 7f3939d9b700 1 -- 172.21.15.46:0/4165386635 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f392c009520 con 0x7f393c101a40 2023-10-19T12:42:57.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:57.194+0000 7f3939d9b700 1 --2- 172.21.15.46:0/4165386635 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f393c101a40 0x7f393c072be0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f393000e9a0 tx=0x7f393000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:57.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:57.194+0000 7f392b7fe700 1 -- 172.21.15.46:0/4165386635 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3930009790 con 0x7f393c101a40 2023-10-19T12:42:57.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:57.194+0000 7f3940e46700 1 -- 172.21.15.46:0/4165386635 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3934009d00 con 0x7f393c101a40 2023-10-19T12:42:57.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:57.194+0000 7f392b7fe700 1 -- 172.21.15.46:0/4165386635 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3930010430 con 0x7f393c101a40 2023-10-19T12:42:57.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:57.194+0000 7f392b7fe700 1 -- 172.21.15.46:0/4165386635 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3930018680 con 0x7f393c101a40 2023-10-19T12:42:57.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:57.195+0000 7f3940e46700 1 -- 172.21.15.46:0/4165386635 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f393c1a0f20 con 0x7f393c101a40 2023-10-19T12:42:57.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:57.195+0000 7f3940e46700 1 -- 172.21.15.46:0/4165386635 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f393c107d20 con 0x7f393c101a40 2023-10-19T12:42:57.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:57.198+0000 7f392b7fe700 1 -- 172.21.15.46:0/4165386635 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f39300105a0 con 0x7f393c101a40 2023-10-19T12:42:57.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:57.199+0000 7f392b7fe700 1 --2- 172.21.15.46:0/4165386635 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f39240a1590 0x7f39240a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:42:57.206 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:57.199+0000 7f392b7fe700 1 -- 172.21.15.46:0/4165386635 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f3930014070 con 0x7f393c101a40 2023-10-19T12:42:57.206 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:57.199+0000 7f393a59c700 1 --2- 172.21.15.46:0/4165386635 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f39240a1590 0x7f39240a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:42:57.206 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:57.200+0000 7f393a59c700 1 --2- 172.21.15.46:0/4165386635 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f39240a1590 0x7f39240a3a50 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f393c1018a0 tx=0x7f392c009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:42:57.206 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:57.201+0000 7f392b7fe700 1 -- 172.21.15.46:0/4165386635 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3930096e10 con 0x7f393c101a40 2023-10-19T12:42:57.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:57.426+0000 7f3940e46700 1 -- 172.21.15.46:0/4165386635 --> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f393c02cf80 con 0x7f39240a1590 2023-10-19T12:42:57.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:57.440+0000 7f392b7fe700 1 -- 172.21.15.46:0/4165386635 <== mgr.14150 v2:172.21.15.46:6800/3168073651 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+4185 (secure 0 0 0) 0x7f393c02cf80 con 0x7f39240a1590 2023-10-19T12:42:57.444 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-19T12:42:57.444 INFO:teuthology.orchestra.run.smithi046.stdout:mds.a smithi046 running (107s) 20s ago 107s 16.3M - 18.0.0-6786-gf7420d7f 34f3475ed6c6 2b3b1b004d20 2023-10-19T12:42:57.444 INFO:teuthology.orchestra.run.smithi046.stdout:mds.b smithi157 running (105s) 33s ago 105s 30.2M - 18.0.0-6786-gf7420d7f 34f3475ed6c6 8960b246aab3 2023-10-19T12:42:57.445 INFO:teuthology.orchestra.run.smithi046.stdout:mds.c smithi195 running (118s) 33s ago 118s 18.0M - 18.0.0-6786-gf7420d7f 34f3475ed6c6 0d72d06d4b1b 2023-10-19T12:42:57.445 INFO:teuthology.orchestra.run.smithi046.stdout:mds.d smithi046 running (2m) 20s ago 2m 13.8M - 18.0.0-6786-gf7420d7f 34f3475ed6c6 723b463aa29b 2023-10-19T12:42:57.445 INFO:teuthology.orchestra.run.smithi046.stdout:mds.e smithi157 running (2m) 33s ago 2m 20.0M - 18.0.0-6786-gf7420d7f 34f3475ed6c6 1d795adccf5b 2023-10-19T12:42:57.446 INFO:teuthology.orchestra.run.smithi046.stdout:mds.f smithi195 running (2m) 33s ago 2m 18.9M - 18.0.0-6786-gf7420d7f 34f3475ed6c6 68490d82705b 2023-10-19T12:42:57.446 INFO:teuthology.orchestra.run.smithi046.stdout:mds.g smithi046 running (110s) 20s ago 110s 16.6M - 18.0.0-6786-gf7420d7f 34f3475ed6c6 5423dd7a569b 2023-10-19T12:42:57.447 INFO:teuthology.orchestra.run.smithi046.stdout:mds.h smithi157 running (116s) 33s ago 115s 18.4M - 18.0.0-6786-gf7420d7f 34f3475ed6c6 a4f66750f659 2023-10-19T12:42:57.447 INFO:teuthology.orchestra.run.smithi046.stdout:mds.i smithi195 running (114s) 33s ago 113s 19.1M - 18.0.0-6786-gf7420d7f 34f3475ed6c6 6d8cc1b0ad32 2023-10-19T12:42:57.447 INFO:teuthology.orchestra.run.smithi046.stdout:mds.j smithi046 running (2m) 20s ago 2m 13.9M - 18.0.0-6786-gf7420d7f 34f3475ed6c6 e0ecfe5111dc 2023-10-19T12:42:57.448 INFO:teuthology.orchestra.run.smithi046.stdout:mds.k smithi157 running (2m) 33s ago 2m 16.5M - 18.0.0-6786-gf7420d7f 34f3475ed6c6 537efbcd3c78 2023-10-19T12:42:57.448 INFO:teuthology.orchestra.run.smithi046.stdout:mds.l smithi195 running (2m) 33s ago 2m 17.5M - 18.0.0-6786-gf7420d7f 34f3475ed6c6 ff2a9bcd5d4f 2023-10-19T12:42:57.448 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.x smithi046 *:9283,8765 running (9m) 20s ago 9m 530M - 18.0.0-6786-gf7420d7f 34f3475ed6c6 e8035e7006c7 2023-10-19T12:42:57.449 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.y smithi157 *:8443,8765 running (7m) 33s ago 7m 452M - 18.0.0-6786-gf7420d7f 34f3475ed6c6 eaec17f64043 2023-10-19T12:42:57.449 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.z smithi195 *:8443,8765 running (7m) 33s ago 7m 449M - 18.0.0-6786-gf7420d7f 34f3475ed6c6 4993a77183c9 2023-10-19T12:42:57.449 INFO:teuthology.orchestra.run.smithi046.stdout:mon.a smithi046 running (9m) 20s ago 9m 98.8M 2048M 18.0.0-6786-gf7420d7f 34f3475ed6c6 3a02a7e82f19 2023-10-19T12:42:57.449 INFO:teuthology.orchestra.run.smithi046.stdout:mon.b smithi157 running (7m) 33s ago 7m 68.0M 2048M 18.0.0-6786-gf7420d7f 34f3475ed6c6 46dcfd43ad43 2023-10-19T12:42:57.450 INFO:teuthology.orchestra.run.smithi046.stdout:mon.c smithi195 running (7m) 33s ago 7m 71.3M 2048M 18.0.0-6786-gf7420d7f 34f3475ed6c6 a46a0539746f 2023-10-19T12:42:57.450 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (6m) 20s ago 6m 70.6M 4319M 18.0.0-6786-gf7420d7f 34f3475ed6c6 3169c19fb0fc 2023-10-19T12:42:57.450 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi157 running (6m) 33s ago 6m 79.9M 4292M 18.0.0-6786-gf7420d7f 34f3475ed6c6 dc2723966980 2023-10-19T12:42:57.451 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi195 running (5m) 33s ago 5m 77.5M 4292M 18.0.0-6786-gf7420d7f 34f3475ed6c6 94ba8674d850 2023-10-19T12:42:57.451 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi046 running (5m) 20s ago 5m 66.6M 4319M 18.0.0-6786-gf7420d7f 34f3475ed6c6 c8d9eba1eba5 2023-10-19T12:42:57.451 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi157 running (5m) 33s ago 5m 64.1M 4292M 18.0.0-6786-gf7420d7f 34f3475ed6c6 4534a58c4c58 2023-10-19T12:42:57.452 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi195 running (4m) 33s ago 4m 71.6M 4292M 18.0.0-6786-gf7420d7f 34f3475ed6c6 40fd701d1b78 2023-10-19T12:42:57.452 INFO:teuthology.orchestra.run.smithi046.stdout:osd.6 smithi046 running (4m) 20s ago 4m 62.8M 4319M 18.0.0-6786-gf7420d7f 34f3475ed6c6 417da31c32a7 2023-10-19T12:42:57.452 INFO:teuthology.orchestra.run.smithi046.stdout:osd.7 smithi157 running (4m) 33s ago 4m 65.1M 4292M 18.0.0-6786-gf7420d7f 34f3475ed6c6 3711d87a2049 2023-10-19T12:42:57.453 INFO:teuthology.orchestra.run.smithi046.stdout:osd.8 smithi195 running (3m) 33s ago 3m 63.9M 4292M 18.0.0-6786-gf7420d7f 34f3475ed6c6 553e5357d566 2023-10-19T12:42:57.453 INFO:teuthology.orchestra.run.smithi046.stdout:osd.9 smithi046 running (3m) 20s ago 3m 63.7M 4319M 18.0.0-6786-gf7420d7f 34f3475ed6c6 a51ec6daca08 2023-10-19T12:42:57.453 INFO:teuthology.orchestra.run.smithi046.stdout:osd.10 smithi157 running (2m) 33s ago 2m 62.4M 4292M 18.0.0-6786-gf7420d7f 34f3475ed6c6 0c7e3f98ec49 2023-10-19T12:42:57.454 INFO:teuthology.orchestra.run.smithi046.stdout:osd.11 smithi195 running (2m) 33s ago 2m 54.6M 4292M 18.0.0-6786-gf7420d7f 34f3475ed6c6 ccf7dd59bfa6 2023-10-19T12:42:57.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:57.442+0000 7f3940e46700 1 -- 172.21.15.46:0/4165386635 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f39240a1590 msgr2=0x7f39240a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:57.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:57.443+0000 7f3940e46700 1 --2- 172.21.15.46:0/4165386635 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f39240a1590 0x7f39240a3a50 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f393c1018a0 tx=0x7f392c009260 comp rx=0 tx=0).stop 2023-10-19T12:42:57.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:57.443+0000 7f3940e46700 1 -- 172.21.15.46:0/4165386635 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f393c101a40 msgr2=0x7f393c072be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:42:57.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:57.443+0000 7f3940e46700 1 --2- 172.21.15.46:0/4165386635 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f393c101a40 0x7f393c072be0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f393000e9a0 tx=0x7f393000ecb0 comp rx=0 tx=0).stop 2023-10-19T12:42:57.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:57.443+0000 7f3940e46700 1 -- 172.21.15.46:0/4165386635 shutdown_connections 2023-10-19T12:42:57.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:57.443+0000 7f3940e46700 1 --2- 172.21.15.46:0/4165386635 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f393c1023e0 0x7f393c073120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:57.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:57.443+0000 7f3940e46700 1 --2- 172.21.15.46:0/4165386635 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f39240a1590 0x7f39240a3a50 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:57.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:57.443+0000 7f3940e46700 1 --2- 172.21.15.46:0/4165386635 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f393c100840 0x7f393c074540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:57.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:57.443+0000 7f3940e46700 1 --2- 172.21.15.46:0/4165386635 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f393c101a40 0x7f393c072be0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:42:57.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:57.443+0000 7f3940e46700 1 -- 172.21.15.46:0/4165386635 >> 172.21.15.46:0/4165386635 conn(0x7f393c0fbe00 msgr2=0x7f393c104e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:42:57.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:57.443+0000 7f3940e46700 1 -- 172.21.15.46:0/4165386635 shutdown_connections 2023-10-19T12:42:57.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:42:57.443+0000 7f3940e46700 1 -- 172.21.15.46:0/4165386635 wait complete. 2023-10-19T12:42:57.881 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- bash -c 'ceph orch ls' 2023-10-19T12:42:58.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:57 smithi157 ceph-mon[134109]: pgmap v335: 129 pgs: 129 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-19T12:42:58.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:57 smithi195 ceph-mon[134493]: pgmap v335: 129 pgs: 129 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-19T12:42:58.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:57 smithi046 ceph-mon[98509]: pgmap v335: 129 pgs: 129 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-19T12:42:58.632 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-19T12:42:59.052 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:58 smithi046 ceph-mon[98509]: from='client.15321 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-19T12:42:59.052 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:58 smithi046 ceph-mon[98509]: mgrmap e18: x(active, since 8m), standbys: z, y 2023-10-19T12:42:59.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:58 smithi157 ceph-mon[134109]: from='client.15321 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-19T12:42:59.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:58 smithi157 ceph-mon[134109]: mgrmap e18: x(active, since 8m), standbys: z, y 2023-10-19T12:42:59.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:58 smithi195 ceph-mon[134493]: from='client.15321 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-19T12:42:59.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:58 smithi195 ceph-mon[134493]: mgrmap e18: x(active, since 8m), standbys: z, y 2023-10-19T12:43:00.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:42:59 smithi157 ceph-mon[134109]: pgmap v336: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 9 op/s 2023-10-19T12:43:00.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:42:59 smithi195 ceph-mon[134493]: pgmap v336: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 9 op/s 2023-10-19T12:43:00.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:00.199+0000 7f7249b7a700 1 -- 172.21.15.46:0/260316042 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7244100840 msgr2=0x7f7244100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:00.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:00.199+0000 7f7249b7a700 1 --2- 172.21.15.46:0/260316042 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7244100840 0x7f7244100c60 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f72340099c0 tx=0x7f7234009cd0 comp rx=0 tx=0).stop 2023-10-19T12:43:00.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:00.199+0000 7f7249b7a700 1 -- 172.21.15.46:0/260316042 shutdown_connections 2023-10-19T12:43:00.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:00.199+0000 7f7249b7a700 1 --2- 172.21.15.46:0/260316042 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f72441023e0 0x7f7244108c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:00.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:00.199+0000 7f7249b7a700 1 --2- 172.21.15.46:0/260316042 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7244100840 0x7f7244100c60 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:00.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:00.199+0000 7f7249b7a700 1 --2- 172.21.15.46:0/260316042 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7244101a40 0x7f7244101ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:00.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:00.199+0000 7f7249b7a700 1 -- 172.21.15.46:0/260316042 >> 172.21.15.46:0/260316042 conn(0x7f72440fbe00 msgr2=0x7f72440fe220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:00.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:00.199+0000 7f7249b7a700 1 -- 172.21.15.46:0/260316042 shutdown_connections 2023-10-19T12:43:00.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:00.199+0000 7f7249b7a700 1 -- 172.21.15.46:0/260316042 wait complete. 2023-10-19T12:43:00.207 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:00.200+0000 7f7249b7a700 1 Processor -- start 2023-10-19T12:43:00.207 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:00.200+0000 7f7249b7a700 1 -- start start 2023-10-19T12:43:00.207 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:00.200+0000 7f7249b7a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7244100840 0x7f7244196750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:00.207 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:00.200+0000 7f7249b7a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7244101a40 0x7f7244196c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:00.207 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:00.200+0000 7f7249b7a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72441023e0 0x7f724419dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:00.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:00.200+0000 7f7249b7a700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f724419e290 con 0x7f7244100840 2023-10-19T12:43:00.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:00.200+0000 7f7249b7a700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f724419e3d0 con 0x7f7244101a40 2023-10-19T12:43:00.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:00.200+0000 7f7249b7a700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f724419e560 con 0x7f72441023e0 2023-10-19T12:43:00.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:00.201+0000 7f72437fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7244100840 0x7f7244196750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:00.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:00.201+0000 7f72437fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7244100840 0x7f7244196750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51368/0 (socket says 172.21.15.46:51368) 2023-10-19T12:43:00.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:00.201+0000 7f72437fe700 1 -- 172.21.15.46:0/546134888 learned_addr learned my addr 172.21.15.46:0/546134888 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:43:00.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:00.201+0000 7f7242ffd700 1 --2- 172.21.15.46:0/546134888 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7244101a40 0x7f7244196c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:00.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:00.201+0000 7f7243fff700 1 --2- 172.21.15.46:0/546134888 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72441023e0 0x7f724419dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:00.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:00.201+0000 7f72437fe700 1 -- 172.21.15.46:0/546134888 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72441023e0 msgr2=0x7f724419dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:00.210 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:00.201+0000 7f72437fe700 1 --2- 172.21.15.46:0/546134888 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72441023e0 0x7f724419dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:00.210 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:00.201+0000 7f72437fe700 1 -- 172.21.15.46:0/546134888 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7244101a40 msgr2=0x7f7244196c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:00.210 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:00.201+0000 7f72437fe700 1 --2- 172.21.15.46:0/546134888 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7244101a40 0x7f7244196c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:00.210 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:00.201+0000 7f72437fe700 1 -- 172.21.15.46:0/546134888 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72340095f0 con 0x7f7244100840 2023-10-19T12:43:00.210 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:00.201+0000 7f72437fe700 1 --2- 172.21.15.46:0/546134888 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7244100840 0x7f7244196750 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f7234009fd0 tx=0x7f723400f670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:00.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:00.202+0000 7f7240ff9700 1 -- 172.21.15.46:0/546134888 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f723401d070 con 0x7f7244100840 2023-10-19T12:43:00.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:00.202+0000 7f7240ff9700 1 -- 172.21.15.46:0/546134888 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f72340059a0 con 0x7f7244100840 2023-10-19T12:43:00.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:00.202+0000 7f7249b7a700 1 -- 172.21.15.46:0/546134888 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f724419e7e0 con 0x7f7244100840 2023-10-19T12:43:00.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:00.202+0000 7f7240ff9700 1 -- 172.21.15.46:0/546134888 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72340049e0 con 0x7f7244100840 2023-10-19T12:43:00.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:00.202+0000 7f7249b7a700 1 -- 172.21.15.46:0/546134888 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f724419ec80 con 0x7f7244100840 2023-10-19T12:43:00.212 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:00.203+0000 7f7249b7a700 1 -- 172.21.15.46:0/546134888 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7244107dc0 con 0x7f7244100840 2023-10-19T12:43:00.212 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:00.205+0000 7f7240ff9700 1 -- 172.21.15.46:0/546134888 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f7234005230 con 0x7f7244100840 2023-10-19T12:43:00.213 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:00.206+0000 7f7240ff9700 1 --2- 172.21.15.46:0/546134888 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f722c0a1480 0x7f722c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:00.213 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:00.206+0000 7f7240ff9700 1 -- 172.21.15.46:0/546134888 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f72340cdbe0 con 0x7f7244100840 2023-10-19T12:43:00.213 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:00.207+0000 7f7242ffd700 1 --2- 172.21.15.46:0/546134888 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f722c0a1480 0x7f722c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:00.213 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:00.207+0000 7f7242ffd700 1 --2- 172.21.15.46:0/546134888 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f722c0a1480 0x7f722c0a3940 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f7238009c60 tx=0x7f7238009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:00.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:00.211+0000 7f7240ff9700 1 -- 172.21.15.46:0/546134888 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7234096f60 con 0x7f7244100840 2023-10-19T12:43:00.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:42:59 smithi046 ceph-mon[98509]: pgmap v336: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 9 op/s 2023-10-19T12:43:00.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:00.430+0000 7f7249b7a700 1 -- 172.21.15.46:0/546134888 --> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f7244060c30 con 0x7f722c0a1480 2023-10-19T12:43:00.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:00.437+0000 7f7240ff9700 1 -- 172.21.15.46:0/546134888 <== mgr.14150 v2:172.21.15.46:6800/3168073651 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+980 (secure 0 0 0) 0x7f7244060c30 con 0x7f722c0a1480 2023-10-19T12:43:00.440 INFO:teuthology.orchestra.run.smithi046.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2023-10-19T12:43:00.440 INFO:teuthology.orchestra.run.smithi046.stdout:mds.all 12/12 36s ago 2m smithi046=a;smithi046=d;smithi046=g;smithi046=j;smithi157=b;smithi157=e;smithi157=h;smithi157=k;smithi195=c;smithi195=f;smithi195=i;smithi195=l;count:12 2023-10-19T12:43:00.440 INFO:teuthology.orchestra.run.smithi046.stdout:mgr 3/3 36s ago 7m smithi046=x;smithi157=y;smithi195=z;count:3 2023-10-19T12:43:00.441 INFO:teuthology.orchestra.run.smithi046.stdout:mon 3/3 36s ago 7m smithi046:172.21.15.46=a;smithi157:172.21.15.157=b;smithi195:172.21.15.195=c;count:3 2023-10-19T12:43:00.441 INFO:teuthology.orchestra.run.smithi046.stdout:osd 12 36s ago - 2023-10-19T12:43:00.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:00.439+0000 7f7249b7a700 1 -- 172.21.15.46:0/546134888 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f722c0a1480 msgr2=0x7f722c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:00.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:00.439+0000 7f7249b7a700 1 --2- 172.21.15.46:0/546134888 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f722c0a1480 0x7f722c0a3940 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f7238009c60 tx=0x7f7238009260 comp rx=0 tx=0).stop 2023-10-19T12:43:00.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:00.439+0000 7f7249b7a700 1 -- 172.21.15.46:0/546134888 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7244100840 msgr2=0x7f7244196750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:00.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:00.439+0000 7f7249b7a700 1 --2- 172.21.15.46:0/546134888 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7244100840 0x7f7244196750 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f7234009fd0 tx=0x7f723400f670 comp rx=0 tx=0).stop 2023-10-19T12:43:00.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:00.439+0000 7f7249b7a700 1 -- 172.21.15.46:0/546134888 shutdown_connections 2023-10-19T12:43:00.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:00.439+0000 7f7249b7a700 1 --2- 172.21.15.46:0/546134888 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f722c0a1480 0x7f722c0a3940 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:00.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:00.439+0000 7f7249b7a700 1 --2- 172.21.15.46:0/546134888 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72441023e0 0x7f724419dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:00.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:00.439+0000 7f7249b7a700 1 --2- 172.21.15.46:0/546134888 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7244100840 0x7f7244196750 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:00.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:00.439+0000 7f7249b7a700 1 --2- 172.21.15.46:0/546134888 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7244101a40 0x7f7244196c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:00.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:00.440+0000 7f7249b7a700 1 -- 172.21.15.46:0/546134888 >> 172.21.15.46:0/546134888 conn(0x7f72440fbe00 msgr2=0x7f7244104f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:00.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:00.440+0000 7f7249b7a700 1 -- 172.21.15.46:0/546134888 shutdown_connections 2023-10-19T12:43:00.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:00.440+0000 7f7249b7a700 1 -- 172.21.15.46:0/546134888 wait complete. 2023-10-19T12:43:00.932 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- bash -c 'ceph orch host ls' 2023-10-19T12:43:01.680 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-19T12:43:02.056 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:01 smithi046 ceph-mon[98509]: from='client.15327 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-19T12:43:02.056 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:01 smithi046 ceph-mon[98509]: pgmap v337: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 85 B/s wr, 9 op/s 2023-10-19T12:43:02.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:01 smithi157 ceph-mon[134109]: from='client.15327 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-19T12:43:02.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:01 smithi157 ceph-mon[134109]: pgmap v337: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 85 B/s wr, 9 op/s 2023-10-19T12:43:02.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:01 smithi195 ceph-mon[134493]: from='client.15327 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-19T12:43:02.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:01 smithi195 ceph-mon[134493]: pgmap v337: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 85 B/s wr, 9 op/s 2023-10-19T12:43:03.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:03.293+0000 7f4a53b3b700 1 -- 172.21.15.46:0/1483390552 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4a4c100840 msgr2=0x7f4a4c100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:03.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:03.293+0000 7f4a53b3b700 1 --2- 172.21.15.46:0/1483390552 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4a4c100840 0x7f4a4c100c60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4a480099c0 tx=0x7f4a48009cd0 comp rx=0 tx=0).stop 2023-10-19T12:43:03.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:03.293+0000 7f4a53b3b700 1 -- 172.21.15.46:0/1483390552 shutdown_connections 2023-10-19T12:43:03.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:03.293+0000 7f4a53b3b700 1 --2- 172.21.15.46:0/1483390552 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a4c1023e0 0x7f4a4c108c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:03.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:03.293+0000 7f4a53b3b700 1 --2- 172.21.15.46:0/1483390552 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4a4c100840 0x7f4a4c100c60 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:03.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:03.293+0000 7f4a53b3b700 1 --2- 172.21.15.46:0/1483390552 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4a4c101a40 0x7f4a4c101ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:03.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:03.293+0000 7f4a53b3b700 1 -- 172.21.15.46:0/1483390552 >> 172.21.15.46:0/1483390552 conn(0x7f4a4c0fbe00 msgr2=0x7f4a4c0fe220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:03.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:03.293+0000 7f4a53b3b700 1 -- 172.21.15.46:0/1483390552 shutdown_connections 2023-10-19T12:43:03.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:03.293+0000 7f4a53b3b700 1 -- 172.21.15.46:0/1483390552 wait complete. 2023-10-19T12:43:03.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:03.294+0000 7f4a53b3b700 1 Processor -- start 2023-10-19T12:43:03.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:03.295+0000 7f4a53b3b700 1 -- start start 2023-10-19T12:43:03.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:03.295+0000 7f4a53b3b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4a4c100840 0x7f4a4c106580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:03.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:03.295+0000 7f4a53b3b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4a4c101a40 0x7f4a4c106ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:03.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:03.295+0000 7f4a53b3b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a4c1023e0 0x7f4a4c103100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:03.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:03.295+0000 7f4a53b3b700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a4c1038a0 con 0x7f4a4c1023e0 2023-10-19T12:43:03.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:03.295+0000 7f4a53b3b700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a4c103a10 con 0x7f4a4c100840 2023-10-19T12:43:03.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:03.295+0000 7f4a53b3b700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a4c103bd0 con 0x7f4a4c101a40 2023-10-19T12:43:03.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:03.295+0000 7f4a510d6700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4a4c101a40 0x7f4a4c106ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:03.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:03.296+0000 7f4a510d6700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4a4c101a40 0x7f4a4c106ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:58970/0 (socket says 172.21.15.46:58970) 2023-10-19T12:43:03.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:03.296+0000 7f4a510d6700 1 -- 172.21.15.46:0/3641683317 learned_addr learned my addr 172.21.15.46:0/3641683317 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:43:03.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:03.295+0000 7f4a518d7700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4a4c100840 0x7f4a4c106580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:03.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:03.296+0000 7f4a520d8700 1 --2- 172.21.15.46:0/3641683317 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a4c1023e0 0x7f4a4c103100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:03.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:03.296+0000 7f4a510d6700 1 -- 172.21.15.46:0/3641683317 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4a4c100840 msgr2=0x7f4a4c106580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:03.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:03.296+0000 7f4a510d6700 1 --2- 172.21.15.46:0/3641683317 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4a4c100840 0x7f4a4c106580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:03.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:03.296+0000 7f4a510d6700 1 -- 172.21.15.46:0/3641683317 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a4c1023e0 msgr2=0x7f4a4c103100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:03.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:03.296+0000 7f4a510d6700 1 --2- 172.21.15.46:0/3641683317 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a4c1023e0 0x7f4a4c103100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:03.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:03.296+0000 7f4a510d6700 1 -- 172.21.15.46:0/3641683317 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a480095f0 con 0x7f4a4c101a40 2023-10-19T12:43:03.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:03.296+0000 7f4a520d8700 1 --2- 172.21.15.46:0/3641683317 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a4c1023e0 0x7f4a4c103100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T12:43:03.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:03.297+0000 7f4a510d6700 1 --2- 172.21.15.46:0/3641683317 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4a4c101a40 0x7f4a4c106ac0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4a3c00e9a0 tx=0x7f4a3c00ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:03.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:03.297+0000 7f4a42ffd700 1 -- 172.21.15.46:0/3641683317 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a3c009790 con 0x7f4a4c101a40 2023-10-19T12:43:03.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:03.297+0000 7f4a53b3b700 1 -- 172.21.15.46:0/3641683317 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a4c1a4f20 con 0x7f4a4c101a40 2023-10-19T12:43:03.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:03.297+0000 7f4a42ffd700 1 -- 172.21.15.46:0/3641683317 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4a3c00cbd0 con 0x7f4a4c101a40 2023-10-19T12:43:03.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:03.297+0000 7f4a42ffd700 1 -- 172.21.15.46:0/3641683317 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a3c018680 con 0x7f4a4c101a40 2023-10-19T12:43:03.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:03.297+0000 7f4a53b3b700 1 -- 172.21.15.46:0/3641683317 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a4c1a53e0 con 0x7f4a4c101a40 2023-10-19T12:43:03.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:03.298+0000 7f4a53b3b700 1 -- 172.21.15.46:0/3641683317 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a4c04e4c0 con 0x7f4a4c101a40 2023-10-19T12:43:03.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:03.301+0000 7f4a42ffd700 1 -- 172.21.15.46:0/3641683317 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f4a3c00cd40 con 0x7f4a4c101a40 2023-10-19T12:43:03.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:03.302+0000 7f4a42ffd700 1 --2- 172.21.15.46:0/3641683317 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f4a380a1500 0x7f4a380a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:03.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:03.303+0000 7f4a42ffd700 1 -- 172.21.15.46:0/3641683317 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f4a3c014070 con 0x7f4a4c101a40 2023-10-19T12:43:03.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:03.303+0000 7f4a518d7700 1 --2- 172.21.15.46:0/3641683317 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f4a380a1500 0x7f4a380a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:03.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:03.303+0000 7f4a518d7700 1 --2- 172.21.15.46:0/3641683317 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f4a380a1500 0x7f4a380a39c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f4a48003730 tx=0x7f4a48000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:03.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:03.307+0000 7f4a42ffd700 1 -- 172.21.15.46:0/3641683317 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f4a3c052100 con 0x7f4a4c101a40 2023-10-19T12:43:03.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:03.526+0000 7f4a53b3b700 1 -- 172.21.15.46:0/3641683317 --> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f4a4c108930 con 0x7f4a380a1500 2023-10-19T12:43:03.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:03.527+0000 7f4a42ffd700 1 -- 172.21.15.46:0/3641683317 <== mgr.14150 v2:172.21.15.46:6800/3168073651 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+191 (secure 0 0 0) 0x7f4a4c108930 con 0x7f4a380a1500 2023-10-19T12:43:03.531 INFO:teuthology.orchestra.run.smithi046.stdout:HOST ADDR LABELS STATUS 2023-10-19T12:43:03.531 INFO:teuthology.orchestra.run.smithi046.stdout:smithi046 172.21.15.46 2023-10-19T12:43:03.531 INFO:teuthology.orchestra.run.smithi046.stdout:smithi157 172.21.15.157 2023-10-19T12:43:03.531 INFO:teuthology.orchestra.run.smithi046.stdout:smithi195 172.21.15.195 2023-10-19T12:43:03.531 INFO:teuthology.orchestra.run.smithi046.stdout:3 hosts in cluster 2023-10-19T12:43:03.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:03.530+0000 7f4a53b3b700 1 -- 172.21.15.46:0/3641683317 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f4a380a1500 msgr2=0x7f4a380a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:03.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:03.530+0000 7f4a53b3b700 1 --2- 172.21.15.46:0/3641683317 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f4a380a1500 0x7f4a380a39c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f4a48003730 tx=0x7f4a48000bc0 comp rx=0 tx=0).stop 2023-10-19T12:43:03.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:03.530+0000 7f4a53b3b700 1 -- 172.21.15.46:0/3641683317 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4a4c101a40 msgr2=0x7f4a4c106ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:03.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:03.530+0000 7f4a53b3b700 1 --2- 172.21.15.46:0/3641683317 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4a4c101a40 0x7f4a4c106ac0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4a3c00e9a0 tx=0x7f4a3c00ecb0 comp rx=0 tx=0).stop 2023-10-19T12:43:03.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:03.530+0000 7f4a53b3b700 1 -- 172.21.15.46:0/3641683317 shutdown_connections 2023-10-19T12:43:03.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:03.530+0000 7f4a53b3b700 1 --2- 172.21.15.46:0/3641683317 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a4c1023e0 0x7f4a4c103100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:03.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:03.530+0000 7f4a53b3b700 1 --2- 172.21.15.46:0/3641683317 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4a4c100840 0x7f4a4c106580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:03.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:03.530+0000 7f4a53b3b700 1 --2- 172.21.15.46:0/3641683317 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f4a380a1500 0x7f4a380a39c0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:03.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:03.530+0000 7f4a53b3b700 1 --2- 172.21.15.46:0/3641683317 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4a4c101a40 0x7f4a4c106ac0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:03.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:03.530+0000 7f4a53b3b700 1 -- 172.21.15.46:0/3641683317 >> 172.21.15.46:0/3641683317 conn(0x7f4a4c0fbe00 msgr2=0x7f4a4c107210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:03.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:03.530+0000 7f4a53b3b700 1 -- 172.21.15.46:0/3641683317 shutdown_connections 2023-10-19T12:43:03.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:03.530+0000 7f4a53b3b700 1 -- 172.21.15.46:0/3641683317 wait complete. 2023-10-19T12:43:03.965 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:03 smithi046 ceph-mon[98509]: pgmap v338: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 426 B/s wr, 12 op/s 2023-10-19T12:43:03.983 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- bash -c 'ceph orch device ls' 2023-10-19T12:43:04.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:03 smithi157 ceph-mon[134109]: pgmap v338: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 426 B/s wr, 12 op/s 2023-10-19T12:43:04.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:03 smithi195 ceph-mon[134493]: pgmap v338: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 426 B/s wr, 12 op/s 2023-10-19T12:43:04.732 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-19T12:43:05.039 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:04 smithi046 ceph-mon[98509]: from='client.25360 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-19T12:43:05.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:04 smithi157 ceph-mon[134109]: from='client.25360 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-19T12:43:05.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:04 smithi195 ceph-mon[134493]: from='client.25360 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-19T12:43:05.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:05 smithi046 ceph-mon[98509]: pgmap v339: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 9 op/s 2023-10-19T12:43:06.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:05 smithi157 ceph-mon[134109]: pgmap v339: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 9 op/s 2023-10-19T12:43:06.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:05 smithi195 ceph-mon[134493]: pgmap v339: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 9 op/s 2023-10-19T12:43:06.262 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:06.259+0000 7f3477ea5700 1 -- 172.21.15.46:0/3018432800 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f34701023e0 msgr2=0x7f3470108c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:06.263 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:06.259+0000 7f3477ea5700 1 --2- 172.21.15.46:0/3018432800 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f34701023e0 0x7f3470108c90 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f346800b0d0 tx=0x7f346800b3e0 comp rx=0 tx=0).stop 2023-10-19T12:43:06.263 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:06.259+0000 7f3477ea5700 1 -- 172.21.15.46:0/3018432800 shutdown_connections 2023-10-19T12:43:06.263 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:06.259+0000 7f3477ea5700 1 --2- 172.21.15.46:0/3018432800 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f34701023e0 0x7f3470108c90 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:06.263 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:06.259+0000 7f3477ea5700 1 --2- 172.21.15.46:0/3018432800 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3470100840 0x7f3470100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:06.263 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:06.259+0000 7f3477ea5700 1 --2- 172.21.15.46:0/3018432800 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3470101a40 0x7f3470101ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:06.264 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:06.259+0000 7f3477ea5700 1 -- 172.21.15.46:0/3018432800 >> 172.21.15.46:0/3018432800 conn(0x7f34700fbe00 msgr2=0x7f34700fe220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:06.264 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:06.259+0000 7f3477ea5700 1 -- 172.21.15.46:0/3018432800 shutdown_connections 2023-10-19T12:43:06.264 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:06.259+0000 7f3477ea5700 1 -- 172.21.15.46:0/3018432800 wait complete. 2023-10-19T12:43:06.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:06.260+0000 7f3477ea5700 1 Processor -- start 2023-10-19T12:43:06.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:06.261+0000 7f3477ea5700 1 -- start start 2023-10-19T12:43:06.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:06.261+0000 7f3477ea5700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3470100840 0x7f3470074540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:06.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:06.261+0000 7f3477ea5700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3470101a40 0x7f3470072be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:06.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:06.261+0000 7f3477ea5700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34701023e0 0x7f3470073120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:06.270 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:06.261+0000 7f3477ea5700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34700738c0 con 0x7f3470101a40 2023-10-19T12:43:06.270 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:06.261+0000 7f3477ea5700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3470073a30 con 0x7f3470100840 2023-10-19T12:43:06.270 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:06.261+0000 7f3477ea5700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34701a0910 con 0x7f34701023e0 2023-10-19T12:43:06.270 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:06.261+0000 7f3475440700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3470101a40 0x7f3470072be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:06.270 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:06.261+0000 7f3475440700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3470101a40 0x7f3470072be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54846/0 (socket says 172.21.15.46:54846) 2023-10-19T12:43:06.271 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:06.261+0000 7f3475440700 1 -- 172.21.15.46:0/2793430472 learned_addr learned my addr 172.21.15.46:0/2793430472 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:43:06.271 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:06.261+0000 7f3475c41700 1 --2- 172.21.15.46:0/2793430472 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3470100840 0x7f3470074540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:06.271 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:06.261+0000 7f3476442700 1 --2- 172.21.15.46:0/2793430472 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34701023e0 0x7f3470073120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:06.271 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:06.262+0000 7f3475440700 1 -- 172.21.15.46:0/2793430472 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34701023e0 msgr2=0x7f3470073120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:06.271 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:06.262+0000 7f3475440700 1 --2- 172.21.15.46:0/2793430472 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34701023e0 0x7f3470073120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:06.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:06.262+0000 7f3475440700 1 -- 172.21.15.46:0/2793430472 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3470100840 msgr2=0x7f3470074540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:06.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:06.262+0000 7f3475440700 1 --2- 172.21.15.46:0/2793430472 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3470100840 0x7f3470074540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:06.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:06.262+0000 7f3475440700 1 -- 172.21.15.46:0/2793430472 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3468009d00 con 0x7f3470101a40 2023-10-19T12:43:06.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:06.262+0000 7f3475440700 1 --2- 172.21.15.46:0/2793430472 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3470101a40 0x7f3470072be0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f346000e9a0 tx=0x7f346000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:06.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:06.262+0000 7f3466ffd700 1 -- 172.21.15.46:0/2793430472 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3460009790 con 0x7f3470101a40 2023-10-19T12:43:06.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:06.262+0000 7f3466ffd700 1 -- 172.21.15.46:0/2793430472 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f346000cbd0 con 0x7f3470101a40 2023-10-19T12:43:06.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:06.262+0000 7f3466ffd700 1 -- 172.21.15.46:0/2793430472 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3460018680 con 0x7f3470101a40 2023-10-19T12:43:06.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:06.262+0000 7f3477ea5700 1 -- 172.21.15.46:0/2793430472 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34701a0ba0 con 0x7f3470101a40 2023-10-19T12:43:06.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:06.262+0000 7f3477ea5700 1 -- 172.21.15.46:0/2793430472 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34701a10a0 con 0x7f3470101a40 2023-10-19T12:43:06.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:06.263+0000 7f3477ea5700 1 -- 172.21.15.46:0/2793430472 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3470107c70 con 0x7f3470101a40 2023-10-19T12:43:06.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:06.265+0000 7f3466ffd700 1 -- 172.21.15.46:0/2793430472 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f346000cd40 con 0x7f3470101a40 2023-10-19T12:43:06.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:06.267+0000 7f3466ffd700 1 --2- 172.21.15.46:0/2793430472 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f345c0a1500 0x7f345c0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:06.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:06.267+0000 7f3466ffd700 1 -- 172.21.15.46:0/2793430472 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f3460014070 con 0x7f3470101a40 2023-10-19T12:43:06.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:06.267+0000 7f3475c41700 1 --2- 172.21.15.46:0/2793430472 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f345c0a1500 0x7f345c0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:06.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:06.268+0000 7f3475c41700 1 --2- 172.21.15.46:0/2793430472 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f345c0a1500 0x7f345c0a39c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f34701018a0 tx=0x7f346c00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:06.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:06.271+0000 7f3466ffd700 1 -- 172.21.15.46:0/2793430472 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3460052100 con 0x7f3470101a40 2023-10-19T12:43:06.493 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:06.490+0000 7f3477ea5700 1 -- 172.21.15.46:0/2793430472 --> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f347002d020 con 0x7f345c0a1500 2023-10-19T12:43:06.495 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:06.492+0000 7f3466ffd700 1 -- 172.21.15.46:0/2793430472 <== mgr.14150 v2:172.21.15.46:6800/3168073651 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+532 (secure 0 0 0) 0x7f347002d020 con 0x7f345c0a1500 2023-10-19T12:43:06.495 INFO:teuthology.orchestra.run.smithi046.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2023-10-19T12:43:06.495 INFO:teuthology.orchestra.run.smithi046.stdout:smithi046 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB7512009A480DGN 447G No 3m ago Has a FileSystem, LVM detected 2023-10-19T12:43:06.495 INFO:teuthology.orchestra.run.smithi046.stdout:smithi157 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB7476002V480DGN 447G No 2m ago Has a FileSystem, LVM detected 2023-10-19T12:43:06.496 INFO:teuthology.orchestra.run.smithi046.stdout:smithi195 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB751300FS480DGN 447G No 2m ago Has a FileSystem, LVM detected 2023-10-19T12:43:06.497 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:06.494+0000 7f3477ea5700 1 -- 172.21.15.46:0/2793430472 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f345c0a1500 msgr2=0x7f345c0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:06.498 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:06.494+0000 7f3477ea5700 1 --2- 172.21.15.46:0/2793430472 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f345c0a1500 0x7f345c0a39c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f34701018a0 tx=0x7f346c00b410 comp rx=0 tx=0).stop 2023-10-19T12:43:06.498 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:06.494+0000 7f3477ea5700 1 -- 172.21.15.46:0/2793430472 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3470101a40 msgr2=0x7f3470072be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:06.498 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:06.494+0000 7f3477ea5700 1 --2- 172.21.15.46:0/2793430472 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3470101a40 0x7f3470072be0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f346000e9a0 tx=0x7f346000ecb0 comp rx=0 tx=0).stop 2023-10-19T12:43:06.498 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:06.494+0000 7f3477ea5700 1 -- 172.21.15.46:0/2793430472 shutdown_connections 2023-10-19T12:43:06.498 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:06.494+0000 7f3477ea5700 1 --2- 172.21.15.46:0/2793430472 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f345c0a1500 0x7f345c0a39c0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:06.499 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:06.494+0000 7f3477ea5700 1 --2- 172.21.15.46:0/2793430472 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34701023e0 0x7f3470073120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:06.499 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:06.494+0000 7f3477ea5700 1 --2- 172.21.15.46:0/2793430472 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3470100840 0x7f3470074540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:06.499 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:06.494+0000 7f3477ea5700 1 --2- 172.21.15.46:0/2793430472 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3470101a40 0x7f3470072be0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:06.499 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:06.494+0000 7f3477ea5700 1 -- 172.21.15.46:0/2793430472 >> 172.21.15.46:0/2793430472 conn(0x7f34700fbe00 msgr2=0x7f3470104db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:06.499 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:06.494+0000 7f3477ea5700 1 -- 172.21.15.46:0/2793430472 shutdown_connections 2023-10-19T12:43:06.500 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:06.494+0000 7f3477ea5700 1 -- 172.21.15.46:0/2793430472 wait complete. 2023-10-19T12:43:07.034 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-10-19T12:43:07.043 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi046.front.sepia.ceph.com 2023-10-19T12:43:07.044 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- bash -c 'ceph fs dump' 2023-10-19T12:43:07.790 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-19T12:43:08.064 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:07 smithi046 ceph-mon[98509]: from='client.15339 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-19T12:43:08.064 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:07 smithi046 ceph-mon[98509]: pgmap v340: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 426 B/s wr, 11 op/s 2023-10-19T12:43:08.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:07 smithi157 ceph-mon[134109]: from='client.15339 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-19T12:43:08.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:07 smithi157 ceph-mon[134109]: pgmap v340: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 426 B/s wr, 11 op/s 2023-10-19T12:43:08.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:07 smithi195 ceph-mon[134493]: from='client.15339 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-19T12:43:08.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:07 smithi195 ceph-mon[134493]: pgmap v340: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 426 B/s wr, 11 op/s 2023-10-19T12:43:09.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:09.309+0000 7f21f1b53700 1 -- 172.21.15.46:0/3327317842 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f21ec100840 msgr2=0x7f21ec100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:09.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:09.309+0000 7f21f1b53700 1 --2- 172.21.15.46:0/3327317842 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f21ec100840 0x7f21ec100c60 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f21dc0099c0 tx=0x7f21dc009cd0 comp rx=0 tx=0).stop 2023-10-19T12:43:09.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:09.309+0000 7f21f1b53700 1 -- 172.21.15.46:0/3327317842 shutdown_connections 2023-10-19T12:43:09.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:09.309+0000 7f21f1b53700 1 --2- 172.21.15.46:0/3327317842 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f21ec1023e0 0x7f21ec108c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:09.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:09.309+0000 7f21f1b53700 1 --2- 172.21.15.46:0/3327317842 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f21ec100840 0x7f21ec100c60 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:09.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:09.309+0000 7f21f1b53700 1 --2- 172.21.15.46:0/3327317842 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f21ec101a40 0x7f21ec101ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:09.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:09.309+0000 7f21f1b53700 1 -- 172.21.15.46:0/3327317842 >> 172.21.15.46:0/3327317842 conn(0x7f21ec0fbe00 msgr2=0x7f21ec0fe220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:09.314 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:09.309+0000 7f21f1b53700 1 -- 172.21.15.46:0/3327317842 shutdown_connections 2023-10-19T12:43:09.314 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:09.309+0000 7f21f1b53700 1 -- 172.21.15.46:0/3327317842 wait complete. 2023-10-19T12:43:09.315 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:09.310+0000 7f21f1b53700 1 Processor -- start 2023-10-19T12:43:09.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:09.310+0000 7f21f1b53700 1 -- start start 2023-10-19T12:43:09.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:09.310+0000 7f21f1b53700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f21ec100840 0x7f21ec1989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:09.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:09.311+0000 7f21f1b53700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f21ec101a40 0x7f21ec198ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:09.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:09.311+0000 7f21f1b53700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f21ec1023e0 0x7f21ec19ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:09.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:09.311+0000 7f21f1b53700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21ec1a04f0 con 0x7f21ec101a40 2023-10-19T12:43:09.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:09.311+0000 7f21f1b53700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21ec1a0630 con 0x7f21ec100840 2023-10-19T12:43:09.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:09.311+0000 7f21f1b53700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21ec1a07c0 con 0x7f21ec1023e0 2023-10-19T12:43:09.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:09.311+0000 7f21eaffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f21ec101a40 0x7f21ec198ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:09.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:09.311+0000 7f21eaffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f21ec101a40 0x7f21ec198ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54858/0 (socket says 172.21.15.46:54858) 2023-10-19T12:43:09.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:09.311+0000 7f21eaffd700 1 -- 172.21.15.46:0/1536766847 learned_addr learned my addr 172.21.15.46:0/1536766847 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:43:09.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:09.311+0000 7f21eb7fe700 1 --2- 172.21.15.46:0/1536766847 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f21ec100840 0x7f21ec1989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:09.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:09.311+0000 7f21ebfff700 1 --2- 172.21.15.46:0/1536766847 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f21ec1023e0 0x7f21ec19ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:09.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:09.311+0000 7f21eaffd700 1 -- 172.21.15.46:0/1536766847 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f21ec1023e0 msgr2=0x7f21ec19ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:09.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:09.311+0000 7f21eaffd700 1 --2- 172.21.15.46:0/1536766847 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f21ec1023e0 0x7f21ec19ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:09.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:09.311+0000 7f21eaffd700 1 -- 172.21.15.46:0/1536766847 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f21ec100840 msgr2=0x7f21ec1989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:09.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:09.311+0000 7f21eaffd700 1 --2- 172.21.15.46:0/1536766847 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f21ec100840 0x7f21ec1989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:09.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:09.311+0000 7f21eaffd700 1 -- 172.21.15.46:0/1536766847 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21dc0095f0 con 0x7f21ec101a40 2023-10-19T12:43:09.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:09.312+0000 7f21eaffd700 1 --2- 172.21.15.46:0/1536766847 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f21ec101a40 0x7f21ec198ef0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f21e000d980 tx=0x7f21e000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:09.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:09.312+0000 7f21e8ff9700 1 -- 172.21.15.46:0/1536766847 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e00098d0 con 0x7f21ec101a40 2023-10-19T12:43:09.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:09.312+0000 7f21f1b53700 1 -- 172.21.15.46:0/1536766847 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21ec1a0aa0 con 0x7f21ec101a40 2023-10-19T12:43:09.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:09.312+0000 7f21e8ff9700 1 -- 172.21.15.46:0/1536766847 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f21e0010460 con 0x7f21ec101a40 2023-10-19T12:43:09.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:09.312+0000 7f21e8ff9700 1 -- 172.21.15.46:0/1536766847 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e000f620 con 0x7f21ec101a40 2023-10-19T12:43:09.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:09.312+0000 7f21f1b53700 1 -- 172.21.15.46:0/1536766847 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21ec1a0ff0 con 0x7f21ec101a40 2023-10-19T12:43:09.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:09.313+0000 7f21f1b53700 1 -- 172.21.15.46:0/1536766847 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21ec04e4c0 con 0x7f21ec101a40 2023-10-19T12:43:09.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:09.315+0000 7f21e8ff9700 1 -- 172.21.15.46:0/1536766847 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f21e0010860 con 0x7f21ec101a40 2023-10-19T12:43:09.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:09.317+0000 7f21e8ff9700 1 --2- 172.21.15.46:0/1536766847 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f21d40a1500 0x7f21d40a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:09.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:09.318+0000 7f21e8ff9700 1 -- 172.21.15.46:0/1536766847 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f21e00ccd30 con 0x7f21ec101a40 2023-10-19T12:43:09.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:09.318+0000 7f21eb7fe700 1 --2- 172.21.15.46:0/1536766847 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f21d40a1500 0x7f21d40a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:09.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:09.318+0000 7f21eb7fe700 1 --2- 172.21.15.46:0/1536766847 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f21d40a1500 0x7f21d40a39c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f21dc009f50 tx=0x7f21dc005ea0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:09.324 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:09.322+0000 7f21e8ff9700 1 -- 172.21.15.46:0/1536766847 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f21e0096020 con 0x7f21ec101a40 2023-10-19T12:43:09.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:09 smithi046 ceph-mon[98509]: pgmap v341: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 426 B/s wr, 9 op/s 2023-10-19T12:43:09.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:09.577+0000 7f21f1b53700 1 -- 172.21.15.46:0/1536766847 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f21ec10c090 con 0x7f21ec101a40 2023-10-19T12:43:09.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:09.578+0000 7f21e8ff9700 1 -- 172.21.15.46:0/1536766847 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 27 v27) v1 ==== 76+0+2975 (secure 0 0 0) 0x7f21e0020bb0 con 0x7f21ec101a40 2023-10-19T12:43:09.581 INFO:teuthology.orchestra.run.smithi046.stdout:e27 2023-10-19T12:43:09.581 INFO:teuthology.orchestra.run.smithi046.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-19T12:43:09.581 INFO:teuthology.orchestra.run.smithi046.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-10-19T12:43:09.581 INFO:teuthology.orchestra.run.smithi046.stdout:legacy client fscid: 1 2023-10-19T12:43:09.582 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:43:09.582 INFO:teuthology.orchestra.run.smithi046.stdout:Filesystem 'cephfs' (1) 2023-10-19T12:43:09.582 INFO:teuthology.orchestra.run.smithi046.stdout:fs_name cephfs 2023-10-19T12:43:09.582 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 27 2023-10-19T12:43:09.582 INFO:teuthology.orchestra.run.smithi046.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2023-10-19T12:43:09.583 INFO:teuthology.orchestra.run.smithi046.stdout:created 2023-10-19T12:41:18.815780+0000 2023-10-19T12:43:09.583 INFO:teuthology.orchestra.run.smithi046.stdout:modified 2023-10-19T12:41:47.301944+0000 2023-10-19T12:43:09.583 INFO:teuthology.orchestra.run.smithi046.stdout:tableserver 0 2023-10-19T12:43:09.583 INFO:teuthology.orchestra.run.smithi046.stdout:root 0 2023-10-19T12:43:09.583 INFO:teuthology.orchestra.run.smithi046.stdout:session_timeout 300 2023-10-19T12:43:09.584 INFO:teuthology.orchestra.run.smithi046.stdout:session_autoclose 300 2023-10-19T12:43:09.584 INFO:teuthology.orchestra.run.smithi046.stdout:max_file_size 1099511627776 2023-10-19T12:43:09.584 INFO:teuthology.orchestra.run.smithi046.stdout:max_xattr_size 65536 2023-10-19T12:43:09.584 INFO:teuthology.orchestra.run.smithi046.stdout:required_client_features {} 2023-10-19T12:43:09.584 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure 0 2023-10-19T12:43:09.585 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure_osd_epoch 0 2023-10-19T12:43:09.585 INFO:teuthology.orchestra.run.smithi046.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-10-19T12:43:09.585 INFO:teuthology.orchestra.run.smithi046.stdout:max_mds 5 2023-10-19T12:43:09.585 INFO:teuthology.orchestra.run.smithi046.stdout:in 0,1,2,3,4 2023-10-19T12:43:09.585 INFO:teuthology.orchestra.run.smithi046.stdout:up {0=24680,1=24655,2=24643,3=24631,4=24629} 2023-10-19T12:43:09.585 INFO:teuthology.orchestra.run.smithi046.stdout:failed 2023-10-19T12:43:09.586 INFO:teuthology.orchestra.run.smithi046.stdout:damaged 2023-10-19T12:43:09.586 INFO:teuthology.orchestra.run.smithi046.stdout:stopped 2023-10-19T12:43:09.586 INFO:teuthology.orchestra.run.smithi046.stdout:data_pools [3,4] 2023-10-19T12:43:09.586 INFO:teuthology.orchestra.run.smithi046.stdout:metadata_pool 2 2023-10-19T12:43:09.586 INFO:teuthology.orchestra.run.smithi046.stdout:inline_data disabled 2023-10-19T12:43:09.587 INFO:teuthology.orchestra.run.smithi046.stdout:balancer 2023-10-19T12:43:09.587 INFO:teuthology.orchestra.run.smithi046.stdout:bal_rank_mask -1 2023-10-19T12:43:09.587 INFO:teuthology.orchestra.run.smithi046.stdout:standby_count_wanted 0 2023-10-19T12:43:09.587 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.b{0:24680} state up:active seq 3 addr [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] compat {c=[1],r=[1],i=[fff]}] 2023-10-19T12:43:09.587 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.e{0:24602} state up:standby-replay seq 1 addr [v2:172.21.15.157:6834/108432552,v1:172.21.15.157:6835/108432552] compat {c=[1],r=[1],i=[fff]}] 2023-10-19T12:43:09.587 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.i{1:24655} state up:active seq 11 addr [v2:172.21.15.195:6838/4094901934,v1:172.21.15.195:6839/4094901934] compat {c=[1],r=[1],i=[fff]}] 2023-10-19T12:43:09.588 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.l{1:24574} state up:standby-replay seq 1 addr [v2:172.21.15.195:6832/3629933235,v1:172.21.15.195:6833/3629933235] compat {c=[1],r=[1],i=[fff]}] 2023-10-19T12:43:09.588 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.c{2:24643} state up:active seq 13 addr [v2:172.21.15.195:6836/293916188,v1:172.21.15.195:6837/293916188] compat {c=[1],r=[1],i=[fff]}] 2023-10-19T12:43:09.588 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.k{2:24560} state up:standby-replay seq 1 addr [v2:172.21.15.157:6832/1687745569,v1:172.21.15.157:6833/1687745569] compat {c=[1],r=[1],i=[fff]}] 2023-10-19T12:43:09.588 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.f{3:24631} state up:active seq 14 addr [v2:172.21.15.195:6834/1406909915,v1:172.21.15.195:6835/1406909915] compat {c=[1],r=[1],i=[fff]}] 2023-10-19T12:43:09.588 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.a{3:14652} state up:standby-replay seq 1 addr [v2:172.21.15.46:6840/4204925553,v1:172.21.15.46:6841/4204925553] compat {c=[1],r=[1],i=[fff]}] 2023-10-19T12:43:09.589 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.h{4:24629} state up:active seq 13 addr [v2:172.21.15.157:6836/2629536514,v1:172.21.15.157:6837/2629536514] compat {c=[1],r=[1],i=[fff]}] 2023-10-19T12:43:09.589 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.g{4:14640} state up:standby-replay seq 1 addr [v2:172.21.15.46:6838/1655843965,v1:172.21.15.46:6839/1655843965] compat {c=[1],r=[1],i=[fff]}] 2023-10-19T12:43:09.589 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:43:09.589 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:43:09.589 INFO:teuthology.orchestra.run.smithi046.stdout:Standby daemons: 2023-10-19T12:43:09.590 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:43:09.590 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.j{-1:14580} state up:standby seq 1 addr [v2:172.21.15.46:6834/2235286008,v1:172.21.15.46:6835/2235286008] compat {c=[1],r=[1],i=[fff]}] 2023-10-19T12:43:09.590 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.d{-1:14592} state up:standby seq 1 addr [v2:172.21.15.46:6836/339398444,v1:172.21.15.46:6837/339398444] compat {c=[1],r=[1],i=[fff]}] 2023-10-19T12:43:09.591 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:09 smithi157 ceph-mon[134109]: pgmap v341: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 426 B/s wr, 9 op/s 2023-10-19T12:43:09.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:09.580+0000 7f21f1b53700 1 -- 172.21.15.46:0/1536766847 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f21d40a1500 msgr2=0x7f21d40a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:09.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:09.580+0000 7f21f1b53700 1 --2- 172.21.15.46:0/1536766847 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f21d40a1500 0x7f21d40a39c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f21dc009f50 tx=0x7f21dc005ea0 comp rx=0 tx=0).stop 2023-10-19T12:43:09.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:09.580+0000 7f21f1b53700 1 -- 172.21.15.46:0/1536766847 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f21ec101a40 msgr2=0x7f21ec198ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:09.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:09.580+0000 7f21f1b53700 1 --2- 172.21.15.46:0/1536766847 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f21ec101a40 0x7f21ec198ef0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f21e000d980 tx=0x7f21e000dc90 comp rx=0 tx=0).stop 2023-10-19T12:43:09.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:09.581+0000 7f21f1b53700 1 -- 172.21.15.46:0/1536766847 shutdown_connections 2023-10-19T12:43:09.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:09.581+0000 7f21f1b53700 1 --2- 172.21.15.46:0/1536766847 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f21d40a1500 0x7f21d40a39c0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:09.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:09.581+0000 7f21f1b53700 1 --2- 172.21.15.46:0/1536766847 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f21ec1023e0 0x7f21ec19ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:09.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:09.581+0000 7f21f1b53700 1 --2- 172.21.15.46:0/1536766847 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f21ec100840 0x7f21ec1989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:09.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:09.581+0000 7f21f1b53700 1 --2- 172.21.15.46:0/1536766847 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f21ec101a40 0x7f21ec198ef0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:09.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:09.581+0000 7f21f1b53700 1 -- 172.21.15.46:0/1536766847 >> 172.21.15.46:0/1536766847 conn(0x7f21ec0fbe00 msgr2=0x7f21ec107260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:09.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:09.581+0000 7f21f1b53700 1 -- 172.21.15.46:0/1536766847 shutdown_connections 2023-10-19T12:43:09.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:09.581+0000 7f21f1b53700 1 -- 172.21.15.46:0/1536766847 wait complete. 2023-10-19T12:43:09.594 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 27 2023-10-19T12:43:09.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:09 smithi195 ceph-mon[134493]: pgmap v341: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 426 B/s wr, 9 op/s 2023-10-19T12:43:10.091 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- bash -c 'ceph osd dump' 2023-10-19T12:43:10.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:10 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/1536766847' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-19T12:43:10.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:10 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/1536766847' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-19T12:43:10.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:10 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/1536766847' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-19T12:43:10.843 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-19T12:43:11.434 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:11 smithi046 ceph-mon[98509]: pgmap v342: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 341 B/s wr, 9 op/s 2023-10-19T12:43:11.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:11 smithi157 ceph-mon[134109]: pgmap v342: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 341 B/s wr, 9 op/s 2023-10-19T12:43:11.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:11 smithi195 ceph-mon[134493]: pgmap v342: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 341 B/s wr, 9 op/s 2023-10-19T12:43:12.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:12.397+0000 7ff7f772f700 1 -- 172.21.15.46:0/2247777897 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff7f01023e0 msgr2=0x7ff7f0108c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:12.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:12.397+0000 7ff7f772f700 1 --2- 172.21.15.46:0/2247777897 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff7f01023e0 0x7ff7f0108c90 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7ff7e800b0d0 tx=0x7ff7e800b3e0 comp rx=0 tx=0).stop 2023-10-19T12:43:12.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:12.397+0000 7ff7f772f700 1 -- 172.21.15.46:0/2247777897 shutdown_connections 2023-10-19T12:43:12.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:12.397+0000 7ff7f772f700 1 --2- 172.21.15.46:0/2247777897 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff7f01023e0 0x7ff7f0108c90 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:12.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:12.397+0000 7ff7f772f700 1 --2- 172.21.15.46:0/2247777897 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff7f0100840 0x7ff7f0100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:12.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:12.397+0000 7ff7f772f700 1 --2- 172.21.15.46:0/2247777897 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff7f0101a40 0x7ff7f0101ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:12.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:12.397+0000 7ff7f772f700 1 -- 172.21.15.46:0/2247777897 >> 172.21.15.46:0/2247777897 conn(0x7ff7f00fbe00 msgr2=0x7ff7f00fe220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:12.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:12.397+0000 7ff7f772f700 1 -- 172.21.15.46:0/2247777897 shutdown_connections 2023-10-19T12:43:12.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:12.397+0000 7ff7f772f700 1 -- 172.21.15.46:0/2247777897 wait complete. 2023-10-19T12:43:12.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:12.398+0000 7ff7f772f700 1 Processor -- start 2023-10-19T12:43:12.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:12.399+0000 7ff7f772f700 1 -- start start 2023-10-19T12:43:12.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:12.399+0000 7ff7f772f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff7f0100840 0x7ff7f0198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:12.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:12.399+0000 7ff7f772f700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff7f0101a40 0x7ff7f0199040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:12.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:12.399+0000 7ff7f772f700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff7f01023e0 0x7ff7f01a0020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:12.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:12.399+0000 7ff7f772f700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f01a05f0 con 0x7ff7f0100840 2023-10-19T12:43:12.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:12.399+0000 7ff7f772f700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f01a0730 con 0x7ff7f01023e0 2023-10-19T12:43:12.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:12.399+0000 7ff7f772f700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f01a08c0 con 0x7ff7f0101a40 2023-10-19T12:43:12.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:12.399+0000 7ff7f54cb700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff7f0100840 0x7ff7f0198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:12.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:12.399+0000 7ff7f54cb700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff7f0100840 0x7ff7f0198b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54890/0 (socket says 172.21.15.46:54890) 2023-10-19T12:43:12.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:12.399+0000 7ff7f54cb700 1 -- 172.21.15.46:0/3857572037 learned_addr learned my addr 172.21.15.46:0/3857572037 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:43:12.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:12.399+0000 7ff7f4cca700 1 --2- 172.21.15.46:0/3857572037 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff7f0101a40 0x7ff7f0199040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:12.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:12.399+0000 7ff7f5ccc700 1 --2- 172.21.15.46:0/3857572037 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff7f01023e0 0x7ff7f01a0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:12.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:12.400+0000 7ff7f54cb700 1 -- 172.21.15.46:0/3857572037 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff7f0101a40 msgr2=0x7ff7f0199040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:12.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:12.400+0000 7ff7f54cb700 1 --2- 172.21.15.46:0/3857572037 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff7f0101a40 0x7ff7f0199040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:12.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:12.400+0000 7ff7f54cb700 1 -- 172.21.15.46:0/3857572037 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff7f01023e0 msgr2=0x7ff7f01a0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:12.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:12.400+0000 7ff7f54cb700 1 --2- 172.21.15.46:0/3857572037 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff7f01023e0 0x7ff7f01a0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:12.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:12.400+0000 7ff7f54cb700 1 -- 172.21.15.46:0/3857572037 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7e8009d00 con 0x7ff7f0100840 2023-10-19T12:43:12.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:12.400+0000 7ff7f54cb700 1 --2- 172.21.15.46:0/3857572037 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff7f0100840 0x7ff7f0198b00 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ff7ec00d9b0 tx=0x7ff7ec00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:12.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:12.400+0000 7ff7e67fc700 1 -- 172.21.15.46:0/3857572037 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7ec004020 con 0x7ff7f0100840 2023-10-19T12:43:12.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:12.400+0000 7ff7e67fc700 1 -- 172.21.15.46:0/3857572037 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff7ec009730 con 0x7ff7f0100840 2023-10-19T12:43:12.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:12.400+0000 7ff7f772f700 1 -- 172.21.15.46:0/3857572037 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7f01a0ba0 con 0x7ff7f0100840 2023-10-19T12:43:12.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:12.400+0000 7ff7e67fc700 1 -- 172.21.15.46:0/3857572037 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7ec0039e0 con 0x7ff7f0100840 2023-10-19T12:43:12.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:12.400+0000 7ff7f772f700 1 -- 172.21.15.46:0/3857572037 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7f01a10f0 con 0x7ff7f0100840 2023-10-19T12:43:12.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:12.401+0000 7ff7f772f700 1 -- 172.21.15.46:0/3857572037 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7f004e4c0 con 0x7ff7f0100840 2023-10-19T12:43:12.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:12.403+0000 7ff7e67fc700 1 -- 172.21.15.46:0/3857572037 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7ff7ec0098a0 con 0x7ff7f0100840 2023-10-19T12:43:12.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:12.404+0000 7ff7e67fc700 1 --2- 172.21.15.46:0/3857572037 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7ff7dc0a1500 0x7ff7dc0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:12.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:12.405+0000 7ff7e67fc700 1 -- 172.21.15.46:0/3857572037 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9020+0+0 (secure 0 0 0) 0x7ff7ec0ccc20 con 0x7ff7f0100840 2023-10-19T12:43:12.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:12.405+0000 7ff7f4cca700 1 --2- 172.21.15.46:0/3857572037 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7ff7dc0a1500 0x7ff7dc0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:12.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:12.405+0000 7ff7f4cca700 1 --2- 172.21.15.46:0/3857572037 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7ff7dc0a1500 0x7ff7dc0a39c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff7e0005950 tx=0x7ff7e000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:12.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:12.409+0000 7ff7e67fc700 1 -- 172.21.15.46:0/3857572037 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff7ec095f10 con 0x7ff7f0100840 2023-10-19T12:43:12.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:12.622+0000 7ff7f772f700 1 -- 172.21.15.46:0/3857572037 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump"} v 0) v1 -- 0x7ff7f01a14d0 con 0x7ff7f0100840 2023-10-19T12:43:12.626 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:12.623+0000 7ff7e67fc700 1 -- 172.21.15.46:0/3857572037 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v90) v1 ==== 56+0+5595 (secure 0 0 0) 0x7ff7ec099530 con 0x7ff7f0100840 2023-10-19T12:43:12.626 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 90 2023-10-19T12:43:12.627 INFO:teuthology.orchestra.run.smithi046.stdout:fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 2023-10-19T12:43:12.627 INFO:teuthology.orchestra.run.smithi046.stdout:created 2023-10-19T12:33:26.148713+0000 2023-10-19T12:43:12.627 INFO:teuthology.orchestra.run.smithi046.stdout:modified 2023-10-19T12:42:28.113339+0000 2023-10-19T12:43:12.627 INFO:teuthology.orchestra.run.smithi046.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2023-10-19T12:43:12.627 INFO:teuthology.orchestra.run.smithi046.stdout:crush_version 27 2023-10-19T12:43:12.628 INFO:teuthology.orchestra.run.smithi046.stdout:full_ratio 0.95 2023-10-19T12:43:12.628 INFO:teuthology.orchestra.run.smithi046.stdout:backfillfull_ratio 0.9 2023-10-19T12:43:12.628 INFO:teuthology.orchestra.run.smithi046.stdout:nearfull_ratio 0.85 2023-10-19T12:43:12.628 INFO:teuthology.orchestra.run.smithi046.stdout:require_min_compat_client luminous 2023-10-19T12:43:12.629 INFO:teuthology.orchestra.run.smithi046.stdout:min_compat_client luminous 2023-10-19T12:43:12.629 INFO:teuthology.orchestra.run.smithi046.stdout:require_osd_release reef 2023-10-19T12:43:12.629 INFO:teuthology.orchestra.run.smithi046.stdout:stretch_mode_enabled false 2023-10-19T12:43:12.629 INFO:teuthology.orchestra.run.smithi046.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2023-10-19T12:43:12.629 INFO:teuthology.orchestra.run.smithi046.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 83 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2023-10-19T12:43:12.629 INFO:teuthology.orchestra.run.smithi046.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 84 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.05 application cephfs read_balance_score 1.50 2023-10-19T12:43:12.630 INFO:teuthology.orchestra.run.smithi046.stdout:pool 4 'cephfs_data_ec' erasure profile cephfs_data_ec size 4 min_size 3 crush_rule 1 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 88 flags hashpspool,ec_overwrites stripe_width 8192 pg_num_min 64 target_size_ratio 0.9 application cephfs 2023-10-19T12:43:12.630 INFO:teuthology.orchestra.run.smithi046.stdout:max_osd 12 2023-10-19T12:43:12.630 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 up in weight 1 up_from 8 up_thru 89 down_at 0 last_clean_interval [0,0) [v2:172.21.15.46:6802/500237995,v1:172.21.15.46:6803/500237995] [v2:172.21.15.46:6804/500237995,v1:172.21.15.46:6805/500237995] exists,up 346ce86b-a10a-4869-9fdb-c3c1d4161455 2023-10-19T12:43:12.630 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 up in weight 1 up_from 13 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.157:6800/2496862790,v1:172.21.15.157:6801/2496862790] [v2:172.21.15.157:6802/2496862790,v1:172.21.15.157:6803/2496862790] exists,up 02aae687-76c5-4124-bae4-9787ed571c28 2023-10-19T12:43:12.630 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 up in weight 1 up_from 18 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.195:6800/4211767276,v1:172.21.15.195:6801/4211767276] [v2:172.21.15.195:6802/4211767276,v1:172.21.15.195:6803/4211767276] exists,up d5360828-1f58-4380-b2ad-0c21ff850981 2023-10-19T12:43:12.631 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 up in weight 1 up_from 25 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.46:6810/1964113352,v1:172.21.15.46:6811/1964113352] [v2:172.21.15.46:6812/1964113352,v1:172.21.15.46:6813/1964113352] exists,up accb780f-49d0-43f8-b166-ee12c558ef00 2023-10-19T12:43:12.631 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 up in weight 1 up_from 33 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.157:6808/3636910144,v1:172.21.15.157:6809/3636910144] [v2:172.21.15.157:6810/3636910144,v1:172.21.15.157:6811/3636910144] exists,up e662886d-e989-4d02-8c1f-3c4671352b0b 2023-10-19T12:43:12.631 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 up in weight 1 up_from 38 up_thru 89 down_at 0 last_clean_interval [0,0) [v2:172.21.15.195:6808/4071287969,v1:172.21.15.195:6809/4071287969] [v2:172.21.15.195:6810/4071287969,v1:172.21.15.195:6811/4071287969] exists,up 9597e0ce-14ea-407d-90fe-f74bccee38b2 2023-10-19T12:43:12.631 INFO:teuthology.orchestra.run.smithi046.stdout:osd.6 up in weight 1 up_from 46 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.46:6818/1842285555,v1:172.21.15.46:6819/1842285555] [v2:172.21.15.46:6820/1842285555,v1:172.21.15.46:6821/1842285555] exists,up 6b78ba38-f60e-4cb6-b01c-cecc1820e8e9 2023-10-19T12:43:12.631 INFO:teuthology.orchestra.run.smithi046.stdout:osd.7 up in weight 1 up_from 51 up_thru 89 down_at 0 last_clean_interval [0,0) [v2:172.21.15.157:6816/3498672588,v1:172.21.15.157:6817/3498672588] [v2:172.21.15.157:6818/3498672588,v1:172.21.15.157:6819/3498672588] exists,up 59a0899f-3bcd-4db2-b544-24df3a536749 2023-10-19T12:43:12.631 INFO:teuthology.orchestra.run.smithi046.stdout:osd.8 up in weight 1 up_from 59 up_thru 89 down_at 0 last_clean_interval [0,0) [v2:172.21.15.195:6816/74230104,v1:172.21.15.195:6817/74230104] [v2:172.21.15.195:6818/74230104,v1:172.21.15.195:6819/74230104] exists,up 9c3c9835-043a-4fb5-a9ee-edf8caf6b605 2023-10-19T12:43:12.632 INFO:teuthology.orchestra.run.smithi046.stdout:osd.9 up in weight 1 up_from 67 up_thru 89 down_at 0 last_clean_interval [0,0) [v2:172.21.15.46:6826/3472581046,v1:172.21.15.46:6827/3472581046] [v2:172.21.15.46:6828/3472581046,v1:172.21.15.46:6829/3472581046] exists,up 3f18f506-a577-4b7c-ae0d-9351c07e81f8 2023-10-19T12:43:12.632 INFO:teuthology.orchestra.run.smithi046.stdout:osd.10 up in weight 1 up_from 72 up_thru 89 down_at 0 last_clean_interval [0,0) [v2:172.21.15.157:6824/2378416559,v1:172.21.15.157:6825/2378416559] [v2:172.21.15.157:6826/2378416559,v1:172.21.15.157:6827/2378416559] exists,up 1ed01854-443a-4acf-9293-7ca0d451a93d 2023-10-19T12:43:12.632 INFO:teuthology.orchestra.run.smithi046.stdout:osd.11 up in weight 1 up_from 79 up_thru 89 down_at 0 last_clean_interval [0,0) [v2:172.21.15.195:6824/3075632222,v1:172.21.15.195:6825/3075632222] [v2:172.21.15.195:6826/3075632222,v1:172.21.15.195:6827/3075632222] exists,up 021398c0-9184-4647-8220-e40f6705ca90 2023-10-19T12:43:12.632 INFO:teuthology.orchestra.run.smithi046.stdout:pg_upmap_items 2.0 [7,11] 2023-10-19T12:43:12.632 INFO:teuthology.orchestra.run.smithi046.stdout:pg_upmap_items 2.1a [8,4] 2023-10-19T12:43:12.632 INFO:teuthology.orchestra.run.smithi046.stdout:pg_upmap_items 2.1b [2,1] 2023-10-19T12:43:12.633 INFO:teuthology.orchestra.run.smithi046.stdout:pg_upmap_items 2.1c [8,11] 2023-10-19T12:43:12.633 INFO:teuthology.orchestra.run.smithi046.stdout:pg_upmap_items 2.1d [2,4] 2023-10-19T12:43:12.633 INFO:teuthology.orchestra.run.smithi046.stdout:pg_upmap_items 3.6 [4,6] 2023-10-19T12:43:12.633 INFO:teuthology.orchestra.run.smithi046.stdout:pg_upmap_items 3.1b [3,6] 2023-10-19T12:43:12.633 INFO:teuthology.orchestra.run.smithi046.stdout:pg_upmap_items 3.1d [4,8] 2023-10-19T12:43:12.634 INFO:teuthology.orchestra.run.smithi046.stdout:pg_upmap_items 3.39 [5,8] 2023-10-19T12:43:12.634 INFO:teuthology.orchestra.run.smithi046.stdout:pg_upmap_items 3.3c [4,9] 2023-10-19T12:43:12.634 INFO:teuthology.orchestra.run.smithi046.stdout:blocklist 172.21.15.46:0/3248595150 expires 2023-10-20T12:34:26.552115+0000 2023-10-19T12:43:12.634 INFO:teuthology.orchestra.run.smithi046.stdout:blocklist 172.21.15.46:0/3624849341 expires 2023-10-20T12:34:26.552115+0000 2023-10-19T12:43:12.634 INFO:teuthology.orchestra.run.smithi046.stdout:blocklist 172.21.15.46:0/1844094590 expires 2023-10-20T12:34:26.552115+0000 2023-10-19T12:43:12.634 INFO:teuthology.orchestra.run.smithi046.stdout:blocklist 172.21.15.46:6801/20022894 expires 2023-10-20T12:34:26.552115+0000 2023-10-19T12:43:12.635 INFO:teuthology.orchestra.run.smithi046.stdout:blocklist 172.21.15.46:0/3969790632 expires 2023-10-20T12:34:00.135248+0000 2023-10-19T12:43:12.635 INFO:teuthology.orchestra.run.smithi046.stdout:blocklist 172.21.15.46:0/2331135821 expires 2023-10-20T12:34:00.135248+0000 2023-10-19T12:43:12.635 INFO:teuthology.orchestra.run.smithi046.stdout:blocklist 172.21.15.46:6800/51664346 expires 2023-10-20T12:34:00.135248+0000 2023-10-19T12:43:12.635 INFO:teuthology.orchestra.run.smithi046.stdout:blocklist 172.21.15.46:6801/51664346 expires 2023-10-20T12:34:00.135248+0000 2023-10-19T12:43:12.635 INFO:teuthology.orchestra.run.smithi046.stdout:blocklist 172.21.15.46:0/585851467 expires 2023-10-20T12:34:00.135248+0000 2023-10-19T12:43:12.635 INFO:teuthology.orchestra.run.smithi046.stdout:blocklist 172.21.15.46:6800/20022894 expires 2023-10-20T12:34:26.552115+0000 2023-10-19T12:43:12.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:12.625+0000 7ff7f772f700 1 -- 172.21.15.46:0/3857572037 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7ff7dc0a1500 msgr2=0x7ff7dc0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:12.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:12.625+0000 7ff7f772f700 1 --2- 172.21.15.46:0/3857572037 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7ff7dc0a1500 0x7ff7dc0a39c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff7e0005950 tx=0x7ff7e000b410 comp rx=0 tx=0).stop 2023-10-19T12:43:12.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:12.625+0000 7ff7f772f700 1 -- 172.21.15.46:0/3857572037 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff7f0100840 msgr2=0x7ff7f0198b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:12.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:12.625+0000 7ff7f772f700 1 --2- 172.21.15.46:0/3857572037 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff7f0100840 0x7ff7f0198b00 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ff7ec00d9b0 tx=0x7ff7ec00dcc0 comp rx=0 tx=0).stop 2023-10-19T12:43:12.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:12.625+0000 7ff7f772f700 1 -- 172.21.15.46:0/3857572037 shutdown_connections 2023-10-19T12:43:12.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:12.625+0000 7ff7f772f700 1 --2- 172.21.15.46:0/3857572037 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff7f01023e0 0x7ff7f01a0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:12.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:12.625+0000 7ff7f772f700 1 --2- 172.21.15.46:0/3857572037 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff7f0100840 0x7ff7f0198b00 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:12.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:12.625+0000 7ff7f772f700 1 --2- 172.21.15.46:0/3857572037 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7ff7dc0a1500 0x7ff7dc0a39c0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:12.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:12.625+0000 7ff7f772f700 1 --2- 172.21.15.46:0/3857572037 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff7f0101a40 0x7ff7f0199040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:12.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:12.625+0000 7ff7f772f700 1 -- 172.21.15.46:0/3857572037 >> 172.21.15.46:0/3857572037 conn(0x7ff7f00fbe00 msgr2=0x7ff7f0072a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:12.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:12.626+0000 7ff7f772f700 1 -- 172.21.15.46:0/3857572037 shutdown_connections 2023-10-19T12:43:12.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:12.626+0000 7ff7f772f700 1 -- 172.21.15.46:0/3857572037 wait complete. 2023-10-19T12:43:12.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:12 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/3857572037' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-10-19T12:43:13.041 INFO:teuthology.run_tasks:Running task fs.ready... 2023-10-19T12:43:13.053 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-19T12:43:13.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:12 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/3857572037' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-10-19T12:43:13.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:12 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/3857572037' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-10-19T12:43:13.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.281+0000 7fb5b73ff700 1 -- 172.21.15.46:0/4286547958 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb5b0100740 msgr2=0x7fb5b0100b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:13.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.281+0000 7fb5b73ff700 1 --2- 172.21.15.46:0/4286547958 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb5b0100740 0x7fb5b0100b60 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac0099c0 tx=0x7fb5ac009cd0 comp rx=0 tx=0).stop 2023-10-19T12:43:13.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.281+0000 7fb5b73ff700 1 -- 172.21.15.46:0/4286547958 shutdown_connections 2023-10-19T12:43:13.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.281+0000 7fb5b73ff700 1 --2- 172.21.15.46:0/4286547958 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb5b01022d0 0x7fb5b0108b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:13.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.281+0000 7fb5b73ff700 1 --2- 172.21.15.46:0/4286547958 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb5b0100740 0x7fb5b0100b60 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:13.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.281+0000 7fb5b73ff700 1 --2- 172.21.15.46:0/4286547958 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb5b0101930 0x7fb5b0101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:13.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.281+0000 7fb5b73ff700 1 -- 172.21.15.46:0/4286547958 >> 172.21.15.46:0/4286547958 conn(0x7fb5b00fbc90 msgr2=0x7fb5b00fe0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:13.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.281+0000 7fb5b73ff700 1 -- 172.21.15.46:0/4286547958 shutdown_connections 2023-10-19T12:43:13.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.281+0000 7fb5b73ff700 1 -- 172.21.15.46:0/4286547958 wait complete. 2023-10-19T12:43:13.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.282+0000 7fb5b73ff700 1 Processor -- start 2023-10-19T12:43:13.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.283+0000 7fb5b73ff700 1 -- start start 2023-10-19T12:43:13.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.283+0000 7fb5b73ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb5b0100740 0x7fb5b0196700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:13.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.283+0000 7fb5b73ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb5b0101930 0x7fb5b0196c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:13.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.283+0000 7fb5b73ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb5b01022d0 0x7fb5b019dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:13.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.283+0000 7fb5b73ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b019e230 con 0x7fb5b01022d0 2023-10-19T12:43:13.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.283+0000 7fb5b73ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b019e370 con 0x7fb5b0100740 2023-10-19T12:43:13.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.283+0000 7fb5b73ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b019e500 con 0x7fb5b0101930 2023-10-19T12:43:13.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.283+0000 7fb5b519b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb5b0100740 0x7fb5b0196700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:13.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.283+0000 7fb5b599c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb5b01022d0 0x7fb5b019dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:13.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.283+0000 7fb5b519b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb5b0100740 0x7fb5b0196700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:53840/0 (socket says 172.21.15.46:53840) 2023-10-19T12:43:13.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.283+0000 7fb5b519b700 1 -- 172.21.15.46:0/1346314665 learned_addr learned my addr 172.21.15.46:0/1346314665 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:43:13.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.283+0000 7fb5b499a700 1 --2- 172.21.15.46:0/1346314665 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb5b0101930 0x7fb5b0196c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:13.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.284+0000 7fb5b599c700 1 -- 172.21.15.46:0/1346314665 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb5b0101930 msgr2=0x7fb5b0196c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:13.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.284+0000 7fb5b599c700 1 --2- 172.21.15.46:0/1346314665 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb5b0101930 0x7fb5b0196c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:13.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.284+0000 7fb5b599c700 1 -- 172.21.15.46:0/1346314665 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb5b0100740 msgr2=0x7fb5b0196700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:13.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.284+0000 7fb5b599c700 1 --2- 172.21.15.46:0/1346314665 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb5b0100740 0x7fb5b0196700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:13.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.284+0000 7fb5b599c700 1 -- 172.21.15.46:0/1346314665 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5ac0095f0 con 0x7fb5b01022d0 2023-10-19T12:43:13.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.284+0000 7fb5b599c700 1 --2- 172.21.15.46:0/1346314665 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb5b01022d0 0x7fb5b019dc60 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fb5a8007f10 tx=0x7fb5a800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:13.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.284+0000 7fb5a67fc700 1 -- 172.21.15.46:0/1346314665 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5a8004db0 con 0x7fb5b01022d0 2023-10-19T12:43:13.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.284+0000 7fb5b73ff700 1 -- 172.21.15.46:0/1346314665 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5b019e7e0 con 0x7fb5b01022d0 2023-10-19T12:43:13.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.284+0000 7fb5a67fc700 1 -- 172.21.15.46:0/1346314665 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb5a800f040 con 0x7fb5b01022d0 2023-10-19T12:43:13.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.284+0000 7fb5a67fc700 1 -- 172.21.15.46:0/1346314665 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5a8005990 con 0x7fb5b01022d0 2023-10-19T12:43:13.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.285+0000 7fb5b73ff700 1 -- 172.21.15.46:0/1346314665 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5b019ecf0 con 0x7fb5b01022d0 2023-10-19T12:43:13.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.286+0000 7fb5b73ff700 1 -- 172.21.15.46:0/1346314665 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5b0107c30 con 0x7fb5b01022d0 2023-10-19T12:43:13.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.287+0000 7fb5a67fc700 1 -- 172.21.15.46:0/1346314665 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fb5a800db20 con 0x7fb5b01022d0 2023-10-19T12:43:13.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.289+0000 7fb5a67fc700 1 --2- 172.21.15.46:0/1346314665 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fb59c0a1500 0x7fb59c0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:13.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.289+0000 7fb5a67fc700 1 -- 172.21.15.46:0/1346314665 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fb5a80cc870 con 0x7fb5b01022d0 2023-10-19T12:43:13.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.289+0000 7fb5b519b700 1 --2- 172.21.15.46:0/1346314665 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fb59c0a1500 0x7fb59c0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:13.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.290+0000 7fb5b519b700 1 --2- 172.21.15.46:0/1346314665 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fb59c0a1500 0x7fb59c0a39c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac000c00 tx=0x7fb5ac005a90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:13.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.294+0000 7fb5a67fc700 1 -- 172.21.15.46:0/1346314665 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb5a804f100 con 0x7fb5b01022d0 2023-10-19T12:43:13.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.508+0000 7fb5b73ff700 1 -- 172.21.15.46:0/1346314665 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb5b0067530 con 0x7fb5b01022d0 2023-10-19T12:43:13.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.509+0000 7fb5a67fc700 1 -- 172.21.15.46:0/1346314665 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+24481 (secure 0 0 0) 0x7fb5a8095b60 con 0x7fb5b01022d0 2023-10-19T12:43:13.513 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:43:13.513 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":90,"fsid":"96a8be3c-6e7b-11ee-8db6-212e2dc638e7","created":"2023-10-19T12:33:26.148713+0000","modified":"2023-10-19T12:42:28.113339+0000","last_up_change":"2023-10-19T12:40:30.761679+0000","last_in_change":"2023-10-19T12:40:13.663559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-19T12:37:07.175795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-19T12:41:16.895203+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-19T12:41:18.255601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-19T12:41:21.830455+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"346ce86b-a10a-4869-9fdb-c3c1d4161455","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6803","nonce":500237995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6805","nonce":500237995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6809","nonce":500237995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6807","nonce":500237995}]},"public_addr":"172.21.15.46:6803/500237995","cluster_addr":"172.21.15.46:6805/500237995","heartbeat_back_addr":"172.21.15.46:6809/500237995","heartbeat_front_addr":"172.21.15.46:6807/500237995","state":["exists","up"]},{"osd":1,"uuid":"02aae687-76c5-4124-bae4-9787ed571c28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6801","nonce":2496862790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6803","nonce":2496862790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6807","nonce":2496862790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6805","nonce":2496862790}]},"public_addr":"172.21.15.157:6801/2496862790","cluster_addr":"172.21.15.157:6803/2496862790","heartbeat_back_addr":"172.21.15.157:6807/2496862790","heartbeat_front_addr":"172.21.15.157:6805/2496862790","state":["exists","up"]},{"osd":2,"uuid":"d5360828-1f58-4380-b2ad-0c21ff850981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6801","nonce":4211767276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6803","nonce":4211767276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6807","nonce":4211767276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6805","nonce":4211767276}]},"public_addr":"172.21.15.195:6801/4211767276","cluster_addr":"172.21.15.195:6803/4211767276","heartbeat_back_addr":"172.21.15.195:6807/4211767276","heartbeat_front_addr":"172.21.15.195:6805/4211767276","state":["exists","up"]},{"osd":3,"uuid":"accb780f-49d0-43f8-b166-ee12c558ef00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6811","nonce":1964113352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6813","nonce":1964113352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6817","nonce":1964113352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6815","nonce":1964113352}]},"public_addr":"172.21.15.46:6811/1964113352","cluster_addr":"172.21.15.46:6813/1964113352","heartbeat_back_addr":"172.21.15.46:6817/1964113352","heartbeat_front_addr":"172.21.15.46:6815/1964113352","state":["exists","up"]},{"osd":4,"uuid":"e662886d-e989-4d02-8c1f-3c4671352b0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6809","nonce":3636910144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6811","nonce":3636910144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6815","nonce":3636910144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6813","nonce":3636910144}]},"public_addr":"172.21.15.157:6809/3636910144","cluster_addr":"172.21.15.157:6811/3636910144","heartbeat_back_addr":"172.21.15.157:6815/3636910144","heartbeat_front_addr":"172.21.15.157:6813/3636910144","state":["exists","up"]},{"osd":5,"uuid":"9597e0ce-14ea-407d-90fe-f74bccee38b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6809","nonce":4071287969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6811","nonce":4071287969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6815","nonce":4071287969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6813","nonce":4071287969}]},"public_addr":"172.21.15.195:6809/4071287969","cluster_addr":"172.21.15.195:6811/4071287969","heartbeat_back_addr":"172.21.15.195:6815/4071287969","heartbeat_front_addr":"172.21.15.195:6813/4071287969","state":["exists","up"]},{"osd":6,"uuid":"6b78ba38-f60e-4cb6-b01c-cecc1820e8e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6819","nonce":1842285555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6821","nonce":1842285555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6825","nonce":1842285555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6823","nonce":1842285555}]},"public_addr":"172.21.15.46:6819/1842285555","cluster_addr":"172.21.15.46:6821/1842285555","heartbeat_back_addr":"172.21.15.46:6825/1842285555","heartbeat_front_addr":"172.21.15.46:6823/1842285555","state":["exists","up"]},{"osd":7,"uuid":"59a0899f-3bcd-4db2-b544-24df3a536749","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6817","nonce":3498672588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6819","nonce":3498672588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6823","nonce":3498672588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6821","nonce":3498672588}]},"public_addr":"172.21.15.157:6817/3498672588","cluster_addr":"172.21.15.157:6819/3498672588","heartbeat_back_addr":"172.21.15.157:6823/3498672588","heartbeat_front_addr":"172.21.15.157:6821/3498672588","state":["exists","up"]},{"osd":8,"uuid":"9c3c9835-043a-4fb5-a9ee-edf8caf6b605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6817","nonce":74230104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6819","nonce":74230104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6823","nonce":74230104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6821","nonce":74230104}]},"public_addr":"172.21.15.195:6817/74230104","cluster_addr":"172.21.15.195:6819/74230104","heartbeat_back_addr":"172.21.15.195:6823/74230104","heartbeat_front_addr":"172.21.15.195:6821/74230104","state":["exists","up"]},{"osd":9,"uuid":"3f18f506-a577-4b7c-ae0d-9351c07e81f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6827","nonce":3472581046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6829","nonce":3472581046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6833","nonce":3472581046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6831","nonce":3472581046}]},"public_addr":"172.21.15.46:6827/3472581046","cluster_addr":"172.21.15.46:6829/3472581046","heartbeat_back_addr":"172.21.15.46:6833/3472581046","heartbeat_front_addr":"172.21.15.46:6831/3472581046","state":["exists","up"]},{"osd":10,"uuid":"1ed01854-443a-4acf-9293-7ca0d451a93d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6825","nonce":2378416559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6827","nonce":2378416559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6831","nonce":2378416559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6829","nonce":2378416559}]},"public_addr":"172.21.15.157:6825/2378416559","cluster_addr":"172.21.15.157:6827/2378416559","heartbeat_back_addr":"172.21.15.157:6831/2378416559","heartbeat_front_addr":"172.21.15.157:6829/2378416559","state":["exists","up"]},{"osd":11,"uuid":"021398c0-9184-4647-8220-e40f6705ca90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6825","nonce":3075632222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6827","nonce":3075632222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6831","nonce":3075632222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6829","nonce":3075632222}]},"public_addr":"172.21.15.195:6825/3075632222","cluster_addr":"172.21.15.195:6827/3075632222","heartbeat_back_addr":"172.21.15.195:6831/3075632222","heartbeat_front_addr":"172.21.15.195:6829/3075632222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:36:22.002614+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:36:44.098031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:37:04.518341+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:37:30.796462+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:37:52.756555+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:38:13.403168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:38:39.058472+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:39:01.106893+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:39:21.908334+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:39:46.843884+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:40:08.792020+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:40:29.282974+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":3,"to":6}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.39","mappings":[{"from":5,"to":8}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.46:0/3248595150":"2023-10-20T12:34:26.552115+0000","172.21.15.46:0/3624849341":"2023-10-20T12:34:26.552115+0000","172.21.15.46:0/1844094590":"2023-10-20T12:34:26.552115+0000","172.21.15.46:6801/20022894":"2023-10-20T12:34:26.552115+0000","172.21.15.46:0/3969790632":"2023-10-20T12:34:00.135248+0000","172.21.15.46:0/2331135821":"2023-10-20T12:34:00.135248+0000","172.21.15.46:6800/51664346":"2023-10-20T12:34:00.135248+0000","172.21.15.46:6801/51664346":"2023-10-20T12:34:00.135248+0000","172.21.15.46:0/585851467":"2023-10-20T12:34:00.135248+0000","172.21.15.46:6800/20022894":"2023-10-20T12:34:26.552115+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-19T12:43:13.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.512+0000 7fb5b73ff700 1 -- 172.21.15.46:0/1346314665 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fb59c0a1500 msgr2=0x7fb59c0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:13.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.512+0000 7fb5b73ff700 1 --2- 172.21.15.46:0/1346314665 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fb59c0a1500 0x7fb59c0a39c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac000c00 tx=0x7fb5ac005a90 comp rx=0 tx=0).stop 2023-10-19T12:43:13.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.512+0000 7fb5b73ff700 1 -- 172.21.15.46:0/1346314665 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb5b01022d0 msgr2=0x7fb5b019dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:13.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.512+0000 7fb5b73ff700 1 --2- 172.21.15.46:0/1346314665 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb5b01022d0 0x7fb5b019dc60 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fb5a8007f10 tx=0x7fb5a800d3b0 comp rx=0 tx=0).stop 2023-10-19T12:43:13.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.512+0000 7fb5b73ff700 1 -- 172.21.15.46:0/1346314665 shutdown_connections 2023-10-19T12:43:13.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.512+0000 7fb5b73ff700 1 --2- 172.21.15.46:0/1346314665 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb5b01022d0 0x7fb5b019dc60 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:13.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.512+0000 7fb5b73ff700 1 --2- 172.21.15.46:0/1346314665 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb5b0100740 0x7fb5b0196700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:13.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.512+0000 7fb5b73ff700 1 --2- 172.21.15.46:0/1346314665 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fb59c0a1500 0x7fb59c0a39c0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:13.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.512+0000 7fb5b73ff700 1 --2- 172.21.15.46:0/1346314665 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb5b0101930 0x7fb5b0196c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:13.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.512+0000 7fb5b73ff700 1 -- 172.21.15.46:0/1346314665 >> 172.21.15.46:0/1346314665 conn(0x7fb5b00fbc90 msgr2=0x7fb5b0104d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:13.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.512+0000 7fb5b73ff700 1 -- 172.21.15.46:0/1346314665 shutdown_connections 2023-10-19T12:43:13.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.512+0000 7fb5b73ff700 1 -- 172.21.15.46:0/1346314665 wait complete. 2023-10-19T12:43:13.535 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-19T12:37:07.175795+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-19T12:41:16.895203+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-19T12:41:18.255601+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-19T12:41:21.830455+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-19T12:43:13.535 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-19T12:43:13.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.743+0000 7fecb23ff700 1 -- 172.21.15.46:0/3636586797 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fecac102360 msgr2=0x7fecac108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:13.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.743+0000 7fecb23ff700 1 --2- 172.21.15.46:0/3636586797 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fecac102360 0x7fecac108c10 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7feca400b0d0 tx=0x7feca400b3e0 comp rx=0 tx=0).stop 2023-10-19T12:43:13.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.743+0000 7fecb23ff700 1 -- 172.21.15.46:0/3636586797 shutdown_connections 2023-10-19T12:43:13.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.743+0000 7fecb23ff700 1 --2- 172.21.15.46:0/3636586797 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fecac102360 0x7fecac108c10 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:13.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.743+0000 7fecb23ff700 1 --2- 172.21.15.46:0/3636586797 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fecac1007d0 0x7fecac100bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:13.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.743+0000 7fecb23ff700 1 --2- 172.21.15.46:0/3636586797 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fecac1019c0 0x7fecac101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:13.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.743+0000 7fecb23ff700 1 -- 172.21.15.46:0/3636586797 >> 172.21.15.46:0/3636586797 conn(0x7fecac0fbd40 msgr2=0x7fecac0fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:13.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.743+0000 7fecb23ff700 1 -- 172.21.15.46:0/3636586797 shutdown_connections 2023-10-19T12:43:13.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.743+0000 7fecb23ff700 1 -- 172.21.15.46:0/3636586797 wait complete. 2023-10-19T12:43:13.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.744+0000 7fecb23ff700 1 Processor -- start 2023-10-19T12:43:13.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.744+0000 7fecb23ff700 1 -- start start 2023-10-19T12:43:13.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.745+0000 7fecb23ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fecac1007d0 0x7fecac198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:13.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.745+0000 7fecb23ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fecac1019c0 0x7fecac198f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:13.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.745+0000 7fecb23ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fecac102360 0x7fecac19ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:13.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.745+0000 7fecb23ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecac1a0570 con 0x7fecac102360 2023-10-19T12:43:13.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.745+0000 7fecb23ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecac1a06b0 con 0x7fecac1019c0 2023-10-19T12:43:13.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.745+0000 7fecb23ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecac1a0840 con 0x7fecac1007d0 2023-10-19T12:43:13.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.745+0000 7fecb099c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fecac102360 0x7fecac19ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:13.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.745+0000 7fecb099c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fecac102360 0x7fecac19ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57098/0 (socket says 172.21.15.46:57098) 2023-10-19T12:43:13.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.745+0000 7fecabfff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fecac1007d0 0x7fecac198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:13.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.745+0000 7fecb099c700 1 -- 172.21.15.46:0/2894171749 learned_addr learned my addr 172.21.15.46:0/2894171749 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:43:13.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.745+0000 7fecab7fe700 1 --2- 172.21.15.46:0/2894171749 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fecac1019c0 0x7fecac198f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:13.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.745+0000 7fecb099c700 1 -- 172.21.15.46:0/2894171749 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fecac1007d0 msgr2=0x7fecac198a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:13.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.745+0000 7fecb099c700 1 --2- 172.21.15.46:0/2894171749 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fecac1007d0 0x7fecac198a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:13.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.745+0000 7fecb099c700 1 -- 172.21.15.46:0/2894171749 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fecac1019c0 msgr2=0x7fecac198f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:13.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.745+0000 7fecb099c700 1 --2- 172.21.15.46:0/2894171749 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fecac1019c0 0x7fecac198f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:13.754 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.745+0000 7fecb099c700 1 -- 172.21.15.46:0/2894171749 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feca4009d00 con 0x7fecac102360 2023-10-19T12:43:13.754 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.746+0000 7fecb099c700 1 --2- 172.21.15.46:0/2894171749 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fecac102360 0x7fecac19ffa0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7feca4007b60 tx=0x7feca4008e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:13.754 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.746+0000 7feca97fa700 1 -- 172.21.15.46:0/2894171749 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca400e040 con 0x7fecac102360 2023-10-19T12:43:13.754 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.746+0000 7feca97fa700 1 -- 172.21.15.46:0/2894171749 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7feca400be30 con 0x7fecac102360 2023-10-19T12:43:13.754 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.746+0000 7feca97fa700 1 -- 172.21.15.46:0/2894171749 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca401bb90 con 0x7fecac102360 2023-10-19T12:43:13.755 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.746+0000 7fecb23ff700 1 -- 172.21.15.46:0/2894171749 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecac1a0ac0 con 0x7fecac102360 2023-10-19T12:43:13.755 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.746+0000 7fecb23ff700 1 -- 172.21.15.46:0/2894171749 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecac1a0f40 con 0x7fecac102360 2023-10-19T12:43:13.755 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.747+0000 7fecb23ff700 1 -- 172.21.15.46:0/2894171749 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecac0675a0 con 0x7fecac102360 2023-10-19T12:43:13.756 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.749+0000 7feca97fa700 1 -- 172.21.15.46:0/2894171749 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7feca401d670 con 0x7fecac102360 2023-10-19T12:43:13.756 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.750+0000 7feca97fa700 1 --2- 172.21.15.46:0/2894171749 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fec940a1500 0x7fec940a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:13.756 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.751+0000 7feca97fa700 1 -- 172.21.15.46:0/2894171749 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9020+0+0 (secure 0 0 0) 0x7feca40ce530 con 0x7fecac102360 2023-10-19T12:43:13.756 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.751+0000 7fecabfff700 1 --2- 172.21.15.46:0/2894171749 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fec940a1500 0x7fec940a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:13.756 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.751+0000 7fecabfff700 1 --2- 172.21.15.46:0/2894171749 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fec940a1500 0x7fec940a39c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fecac101820 tx=0x7fec9c009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:13.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.754+0000 7feca97fa700 1 -- 172.21.15.46:0/2894171749 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7feca40978b0 con 0x7fecac102360 2023-10-19T12:43:13.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.963+0000 7fecb23ff700 1 -- 172.21.15.46:0/2894171749 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fecac1a1280 con 0x7fecac102360 2023-10-19T12:43:13.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.963+0000 7feca97fa700 1 -- 172.21.15.46:0/2894171749 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v90) v1 ==== 93+0+10 (secure 0 0 0) 0x7feca409aed0 con 0x7fecac102360 2023-10-19T12:43:13.967 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2023-10-19T12:43:13.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.965+0000 7fecb23ff700 1 -- 172.21.15.46:0/2894171749 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fec940a1500 msgr2=0x7fec940a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:13.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.965+0000 7fecb23ff700 1 --2- 172.21.15.46:0/2894171749 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fec940a1500 0x7fec940a39c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fecac101820 tx=0x7fec9c009260 comp rx=0 tx=0).stop 2023-10-19T12:43:13.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.965+0000 7fecb23ff700 1 -- 172.21.15.46:0/2894171749 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fecac102360 msgr2=0x7fecac19ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:13.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.965+0000 7fecb23ff700 1 --2- 172.21.15.46:0/2894171749 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fecac102360 0x7fecac19ffa0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7feca4007b60 tx=0x7feca4008e90 comp rx=0 tx=0).stop 2023-10-19T12:43:13.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.966+0000 7fecb23ff700 1 -- 172.21.15.46:0/2894171749 shutdown_connections 2023-10-19T12:43:13.970 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.966+0000 7fecb23ff700 1 --2- 172.21.15.46:0/2894171749 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fecac102360 0x7fecac19ffa0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:13.970 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.966+0000 7fecb23ff700 1 --2- 172.21.15.46:0/2894171749 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fec940a1500 0x7fec940a39c0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:13.970 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.966+0000 7fecb23ff700 1 --2- 172.21.15.46:0/2894171749 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fecac1007d0 0x7fecac198a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:13.970 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.966+0000 7fecb23ff700 1 --2- 172.21.15.46:0/2894171749 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fecac1019c0 0x7fecac198f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:13.970 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.966+0000 7fecb23ff700 1 -- 172.21.15.46:0/2894171749 >> 172.21.15.46:0/2894171749 conn(0x7fecac0fbd40 msgr2=0x7fecac072a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:13.971 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.966+0000 7fecb23ff700 1 -- 172.21.15.46:0/2894171749 shutdown_connections 2023-10-19T12:43:13.971 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:13.966+0000 7fecb23ff700 1 -- 172.21.15.46:0/2894171749 wait complete. 2023-10-19T12:43:13.978 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:13 smithi046 ceph-mon[98509]: pgmap v343: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 341 B/s wr, 12 op/s 2023-10-19T12:43:13.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:13 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/1346314665' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-19T12:43:13.988 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-19T12:43:14.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:13 smithi157 ceph-mon[134109]: pgmap v343: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 341 B/s wr, 12 op/s 2023-10-19T12:43:14.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:13 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/1346314665' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-19T12:43:14.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:13 smithi195 ceph-mon[134493]: pgmap v343: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 341 B/s wr, 12 op/s 2023-10-19T12:43:14.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:13 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/1346314665' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-19T12:43:14.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.193+0000 7f67b71ff700 1 -- 172.21.15.46:0/2269028081 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f67b01007a0 msgr2=0x7f67b0100bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:14.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.193+0000 7f67b71ff700 1 --2- 172.21.15.46:0/2269028081 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f67b01007a0 0x7f67b0100bc0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f67a40099c0 tx=0x7f67a4009cd0 comp rx=0 tx=0).stop 2023-10-19T12:43:14.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.193+0000 7f67b71ff700 1 -- 172.21.15.46:0/2269028081 shutdown_connections 2023-10-19T12:43:14.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.193+0000 7f67b71ff700 1 --2- 172.21.15.46:0/2269028081 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f67b0102330 0x7f67b0108be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:14.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.193+0000 7f67b71ff700 1 --2- 172.21.15.46:0/2269028081 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f67b01007a0 0x7f67b0100bc0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:14.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.193+0000 7f67b71ff700 1 --2- 172.21.15.46:0/2269028081 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f67b0101990 0x7f67b0101df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:14.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.193+0000 7f67b71ff700 1 -- 172.21.15.46:0/2269028081 >> 172.21.15.46:0/2269028081 conn(0x7f67b00fbcf0 msgr2=0x7f67b00fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:14.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.193+0000 7f67b71ff700 1 -- 172.21.15.46:0/2269028081 shutdown_connections 2023-10-19T12:43:14.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.193+0000 7f67b71ff700 1 -- 172.21.15.46:0/2269028081 wait complete. 2023-10-19T12:43:14.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.195+0000 7f67b71ff700 1 Processor -- start 2023-10-19T12:43:14.201 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.195+0000 7f67b71ff700 1 -- start start 2023-10-19T12:43:14.201 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.195+0000 7f67b71ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f67b01007a0 0x7f67b0196750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:14.201 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.195+0000 7f67b71ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f67b0101990 0x7f67b0196c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:14.201 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.196+0000 7f67b71ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f67b0102330 0x7f67b019dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:14.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.196+0000 7f67b71ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67b019e280 con 0x7f67b0102330 2023-10-19T12:43:14.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.196+0000 7f67b71ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67b019e3c0 con 0x7f67b01007a0 2023-10-19T12:43:14.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.196+0000 7f67b71ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67b019e550 con 0x7f67b0101990 2023-10-19T12:43:14.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.196+0000 7f67affff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f67b0101990 0x7f67b0196c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:14.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.196+0000 7f67b4f9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f67b01007a0 0x7f67b0196750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:14.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.196+0000 7f67b579c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f67b0102330 0x7f67b019dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:14.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.196+0000 7f67affff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f67b0101990 0x7f67b0196c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:53748/0 (socket says 172.21.15.46:53748) 2023-10-19T12:43:14.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.196+0000 7f67b4f9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f67b01007a0 0x7f67b0196750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:53878/0 (socket says 172.21.15.46:53878) 2023-10-19T12:43:14.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.196+0000 7f67affff700 1 -- 172.21.15.46:0/275741867 learned_addr learned my addr 172.21.15.46:0/275741867 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:43:14.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.196+0000 7f67b4f9b700 1 -- 172.21.15.46:0/275741867 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f67b0101990 msgr2=0x7f67b0196c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:14.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.196+0000 7f67b4f9b700 1 --2- 172.21.15.46:0/275741867 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f67b0101990 0x7f67b0196c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:14.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.196+0000 7f67b4f9b700 1 -- 172.21.15.46:0/275741867 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f67b0102330 msgr2=0x7f67b019dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:14.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.196+0000 7f67b4f9b700 1 --2- 172.21.15.46:0/275741867 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f67b0102330 0x7f67b019dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:14.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.196+0000 7f67b4f9b700 1 -- 172.21.15.46:0/275741867 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67a40095f0 con 0x7f67b01007a0 2023-10-19T12:43:14.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.196+0000 7f67b579c700 1 --2- 172.21.15.46:0/275741867 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f67b0102330 0x7f67b019dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:43:14.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.196+0000 7f67affff700 1 --2- 172.21.15.46:0/275741867 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f67b0101990 0x7f67b0196c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:43:14.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.197+0000 7f67b4f9b700 1 --2- 172.21.15.46:0/275741867 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f67b01007a0 0x7f67b0196750 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f67a40098e0 tx=0x7f67a4005b00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:14.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.197+0000 7f67adffb700 1 -- 172.21.15.46:0/275741867 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67a401c070 con 0x7f67b01007a0 2023-10-19T12:43:14.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.197+0000 7f67b71ff700 1 -- 172.21.15.46:0/275741867 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67b019e7d0 con 0x7f67b01007a0 2023-10-19T12:43:14.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.197+0000 7f67b71ff700 1 -- 172.21.15.46:0/275741867 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67b019ec50 con 0x7f67b01007a0 2023-10-19T12:43:14.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.197+0000 7f67adffb700 1 -- 172.21.15.46:0/275741867 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f67a400fd10 con 0x7f67b01007a0 2023-10-19T12:43:14.206 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.197+0000 7f67adffb700 1 -- 172.21.15.46:0/275741867 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67a4022bd0 con 0x7f67b01007a0 2023-10-19T12:43:14.206 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.198+0000 7f67b71ff700 1 -- 172.21.15.46:0/275741867 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67b0107bc0 con 0x7f67b01007a0 2023-10-19T12:43:14.207 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.200+0000 7f67adffb700 1 -- 172.21.15.46:0/275741867 <== mon.2 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f67a4020070 con 0x7f67b01007a0 2023-10-19T12:43:14.207 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.202+0000 7f67adffb700 1 --2- 172.21.15.46:0/275741867 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f67a00a1500 0x7f67a00a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:14.207 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.202+0000 7f67adffb700 1 -- 172.21.15.46:0/275741867 <== mon.2 v2:172.21.15.157:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f67a40ce270 con 0x7f67b01007a0 2023-10-19T12:43:14.207 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.202+0000 7f67affff700 1 --2- 172.21.15.46:0/275741867 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f67a00a1500 0x7f67a00a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:14.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.202+0000 7f67affff700 1 --2- 172.21.15.46:0/275741867 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f67a00a1500 0x7f67a00a39c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f679c011550 tx=0x7f679c009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:14.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.204+0000 7f67adffb700 1 -- 172.21.15.46:0/275741867 <== mon.2 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f67a40975f0 con 0x7f67b01007a0 2023-10-19T12:43:14.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.414+0000 7f67b71ff700 1 -- 172.21.15.46:0/275741867 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f67b010c110 con 0x7f67b01007a0 2023-10-19T12:43:14.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.415+0000 7f67adffb700 1 -- 172.21.15.46:0/275741867 <== mon.2 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v90) v1 ==== 104+0+11 (secure 0 0 0) 0x7f67a4031020 con 0x7f67b01007a0 2023-10-19T12:43:14.418 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2023-10-19T12:43:14.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.417+0000 7f67b71ff700 1 -- 172.21.15.46:0/275741867 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f67a00a1500 msgr2=0x7f67a00a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:14.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.417+0000 7f67b71ff700 1 --2- 172.21.15.46:0/275741867 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f67a00a1500 0x7f67a00a39c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f679c011550 tx=0x7f679c009260 comp rx=0 tx=0).stop 2023-10-19T12:43:14.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.417+0000 7f67b71ff700 1 -- 172.21.15.46:0/275741867 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f67b01007a0 msgr2=0x7f67b0196750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:14.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.417+0000 7f67b71ff700 1 --2- 172.21.15.46:0/275741867 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f67b01007a0 0x7f67b0196750 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f67a40098e0 tx=0x7f67a4005b00 comp rx=0 tx=0).stop 2023-10-19T12:43:14.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.417+0000 7f67b71ff700 1 -- 172.21.15.46:0/275741867 shutdown_connections 2023-10-19T12:43:14.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.417+0000 7f67b71ff700 1 --2- 172.21.15.46:0/275741867 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f67b0102330 0x7f67b019dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:14.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.417+0000 7f67b71ff700 1 --2- 172.21.15.46:0/275741867 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f67b01007a0 0x7f67b0196750 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:14.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.417+0000 7f67b71ff700 1 --2- 172.21.15.46:0/275741867 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f67a00a1500 0x7f67a00a39c0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:14.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.417+0000 7f67b71ff700 1 --2- 172.21.15.46:0/275741867 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f67b0101990 0x7f67b0196c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:14.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.417+0000 7f67b71ff700 1 -- 172.21.15.46:0/275741867 >> 172.21.15.46:0/275741867 conn(0x7f67b00fbcf0 msgr2=0x7f67b0104d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:14.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.417+0000 7f67b71ff700 1 -- 172.21.15.46:0/275741867 shutdown_connections 2023-10-19T12:43:14.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.417+0000 7f67b71ff700 1 -- 172.21.15.46:0/275741867 wait complete. 2023-10-19T12:43:14.440 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-19T12:43:14.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.645+0000 7f32ce9ff700 1 -- 172.21.15.46:0/3539357430 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32c8101990 msgr2=0x7f32c8101df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:14.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.645+0000 7f32ce9ff700 1 --2- 172.21.15.46:0/3539357430 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32c8101990 0x7f32c8101df0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f32bc0099c0 tx=0x7f32bc009cd0 comp rx=0 tx=0).stop 2023-10-19T12:43:14.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.645+0000 7f32ce9ff700 1 -- 172.21.15.46:0/3539357430 shutdown_connections 2023-10-19T12:43:14.650 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.645+0000 7f32ce9ff700 1 --2- 172.21.15.46:0/3539357430 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f32c8102330 0x7f32c8108be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:14.650 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.645+0000 7f32ce9ff700 1 --2- 172.21.15.46:0/3539357430 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f32c81007a0 0x7f32c8100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:14.650 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.645+0000 7f32ce9ff700 1 --2- 172.21.15.46:0/3539357430 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32c8101990 0x7f32c8101df0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:14.650 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.645+0000 7f32ce9ff700 1 -- 172.21.15.46:0/3539357430 >> 172.21.15.46:0/3539357430 conn(0x7f32c80fbcf0 msgr2=0x7f32c80fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:14.650 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.645+0000 7f32ce9ff700 1 -- 172.21.15.46:0/3539357430 shutdown_connections 2023-10-19T12:43:14.651 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.645+0000 7f32ce9ff700 1 -- 172.21.15.46:0/3539357430 wait complete. 2023-10-19T12:43:14.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.646+0000 7f32ce9ff700 1 Processor -- start 2023-10-19T12:43:14.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.647+0000 7f32ce9ff700 1 -- start start 2023-10-19T12:43:14.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.647+0000 7f32ce9ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f32c81007a0 0x7f32c8074550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:14.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.647+0000 7f32ce9ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32c8101990 0x7f32c8072be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:14.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.647+0000 7f32ce9ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f32c8102330 0x7f32c8073120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:14.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.647+0000 7f32ce9ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c819a5a0 con 0x7f32c8101990 2023-10-19T12:43:14.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.647+0000 7f32ce9ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c8073660 con 0x7f32c8102330 2023-10-19T12:43:14.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.647+0000 7f32ce9ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c8073820 con 0x7f32c81007a0 2023-10-19T12:43:14.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.647+0000 7f32c77fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32c8101990 0x7f32c8072be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:14.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.647+0000 7f32c7fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f32c81007a0 0x7f32c8074550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:14.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.647+0000 7f32c77fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32c8101990 0x7f32c8072be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57126/0 (socket says 172.21.15.46:57126) 2023-10-19T12:43:14.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.647+0000 7f32c77fe700 1 -- 172.21.15.46:0/4229034203 learned_addr learned my addr 172.21.15.46:0/4229034203 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:43:14.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.647+0000 7f32ccf9c700 1 --2- 172.21.15.46:0/4229034203 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f32c8102330 0x7f32c8073120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:14.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.648+0000 7f32c77fe700 1 -- 172.21.15.46:0/4229034203 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f32c81007a0 msgr2=0x7f32c8074550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:14.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.648+0000 7f32c77fe700 1 --2- 172.21.15.46:0/4229034203 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f32c81007a0 0x7f32c8074550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:14.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.648+0000 7f32c77fe700 1 -- 172.21.15.46:0/4229034203 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f32c8102330 msgr2=0x7f32c8073120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:14.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.648+0000 7f32c77fe700 1 --2- 172.21.15.46:0/4229034203 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f32c8102330 0x7f32c8073120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:14.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.648+0000 7f32c77fe700 1 -- 172.21.15.46:0/4229034203 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32bc0095f0 con 0x7f32c8101990 2023-10-19T12:43:14.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.648+0000 7f32c77fe700 1 --2- 172.21.15.46:0/4229034203 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32c8101990 0x7f32c8072be0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f32bc006010 tx=0x7f32bc00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:14.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.648+0000 7f32c57fa700 1 -- 172.21.15.46:0/4229034203 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32bc01d070 con 0x7f32c8101990 2023-10-19T12:43:14.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.648+0000 7f32c57fa700 1 -- 172.21.15.46:0/4229034203 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f32bc005030 con 0x7f32c8101990 2023-10-19T12:43:14.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.648+0000 7f32ce9ff700 1 -- 172.21.15.46:0/4229034203 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32c8073a40 con 0x7f32c8101990 2023-10-19T12:43:14.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.648+0000 7f32c57fa700 1 -- 172.21.15.46:0/4229034203 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32bc004b10 con 0x7f32c8101990 2023-10-19T12:43:14.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.648+0000 7f32ce9ff700 1 -- 172.21.15.46:0/4229034203 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32c81a5190 con 0x7f32c8101990 2023-10-19T12:43:14.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.649+0000 7f32ce9ff700 1 -- 172.21.15.46:0/4229034203 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32c8107c40 con 0x7f32c8101990 2023-10-19T12:43:14.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.653+0000 7f32c57fa700 1 -- 172.21.15.46:0/4229034203 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f32bc0051a0 con 0x7f32c8101990 2023-10-19T12:43:14.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.654+0000 7f32c57fa700 1 --2- 172.21.15.46:0/4229034203 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f32b00a1480 0x7f32b00a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:14.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.654+0000 7f32c57fa700 1 -- 172.21.15.46:0/4229034203 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f32bc0ce0f0 con 0x7f32c8101990 2023-10-19T12:43:14.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.654+0000 7f32c7fff700 1 --2- 172.21.15.46:0/4229034203 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f32b00a1480 0x7f32b00a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:14.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.655+0000 7f32c7fff700 1 --2- 172.21.15.46:0/4229034203 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f32b00a1480 0x7f32b00a3940 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f32c81017f0 tx=0x7f32b8009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:14.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.656+0000 7f32c57fa700 1 -- 172.21.15.46:0/4229034203 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f32bc097470 con 0x7f32c8101990 2023-10-19T12:43:14.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.870+0000 7f32ce9ff700 1 -- 172.21.15.46:0/4229034203 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f32c810c110 con 0x7f32c8101990 2023-10-19T12:43:14.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.870+0000 7f32c57fa700 1 -- 172.21.15.46:0/4229034203 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v90) v1 ==== 100+0+11 (secure 0 0 0) 0x7f32bc09aa90 con 0x7f32c8101990 2023-10-19T12:43:14.874 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2023-10-19T12:43:14.876 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.873+0000 7f32ce9ff700 1 -- 172.21.15.46:0/4229034203 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f32b00a1480 msgr2=0x7f32b00a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:14.876 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.873+0000 7f32ce9ff700 1 --2- 172.21.15.46:0/4229034203 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f32b00a1480 0x7f32b00a3940 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f32c81017f0 tx=0x7f32b8009260 comp rx=0 tx=0).stop 2023-10-19T12:43:14.877 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.873+0000 7f32ce9ff700 1 -- 172.21.15.46:0/4229034203 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32c8101990 msgr2=0x7f32c8072be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:14.877 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.873+0000 7f32ce9ff700 1 --2- 172.21.15.46:0/4229034203 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32c8101990 0x7f32c8072be0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f32bc006010 tx=0x7f32bc00f690 comp rx=0 tx=0).stop 2023-10-19T12:43:14.877 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.873+0000 7f32ce9ff700 1 -- 172.21.15.46:0/4229034203 shutdown_connections 2023-10-19T12:43:14.877 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.873+0000 7f32ce9ff700 1 --2- 172.21.15.46:0/4229034203 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f32c8102330 0x7f32c8073120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:14.877 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.873+0000 7f32ce9ff700 1 --2- 172.21.15.46:0/4229034203 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f32b00a1480 0x7f32b00a3940 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:14.877 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.873+0000 7f32ce9ff700 1 --2- 172.21.15.46:0/4229034203 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f32c81007a0 0x7f32c8074550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:14.878 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.873+0000 7f32ce9ff700 1 --2- 172.21.15.46:0/4229034203 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32c8101990 0x7f32c8072be0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:14.878 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.873+0000 7f32ce9ff700 1 -- 172.21.15.46:0/4229034203 >> 172.21.15.46:0/4229034203 conn(0x7f32c80fbcf0 msgr2=0x7f32c8104d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:14.878 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.873+0000 7f32ce9ff700 1 -- 172.21.15.46:0/4229034203 shutdown_connections 2023-10-19T12:43:14.878 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:14.873+0000 7f32ce9ff700 1 -- 172.21.15.46:0/4229034203 wait complete. 2023-10-19T12:43:14.895 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-19T12:43:15.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:14 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/2894171749' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-19T12:43:15.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:14 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/275741867' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-19T12:43:15.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.100+0000 7f306c3ff700 1 -- 172.21.15.46:0/1746030815 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f30640731f0 msgr2=0x7f3064073670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:15.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.100+0000 7f306c3ff700 1 --2- 172.21.15.46:0/1746030815 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f30640731f0 0x7f3064073670 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f3054009990 tx=0x7f3054009ca0 comp rx=0 tx=0).stop 2023-10-19T12:43:15.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.100+0000 7f306c3ff700 1 -- 172.21.15.46:0/1746030815 shutdown_connections 2023-10-19T12:43:15.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.100+0000 7f306c3ff700 1 --2- 172.21.15.46:0/1746030815 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3064108670 0x7f306410aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:15.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.100+0000 7f306c3ff700 1 --2- 172.21.15.46:0/1746030815 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f30640747d0 0x7f3064072c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:15.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.100+0000 7f306c3ff700 1 --2- 172.21.15.46:0/1746030815 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f30640731f0 0x7f3064073670 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:15.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.100+0000 7f306c3ff700 1 -- 172.21.15.46:0/1746030815 >> 172.21.15.46:0/1746030815 conn(0x7f30640fbcf0 msgr2=0x7f30640fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:15.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.100+0000 7f306c3ff700 1 -- 172.21.15.46:0/1746030815 shutdown_connections 2023-10-19T12:43:15.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.100+0000 7f306c3ff700 1 -- 172.21.15.46:0/1746030815 wait complete. 2023-10-19T12:43:15.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.101+0000 7f306c3ff700 1 Processor -- start 2023-10-19T12:43:15.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.102+0000 7f306c3ff700 1 -- start start 2023-10-19T12:43:15.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.102+0000 7f306c3ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f30640731f0 0x7f3064198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:15.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.102+0000 7f306c3ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f30640747d0 0x7f3064198e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:15.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.102+0000 7f306c3ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3064108670 0x7f306419fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:15.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.102+0000 7f306c3ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30641a0430 con 0x7f3064108670 2023-10-19T12:43:15.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.102+0000 7f306c3ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30641a0570 con 0x7f30640731f0 2023-10-19T12:43:15.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.102+0000 7f306c3ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30641a0700 con 0x7f30640747d0 2023-10-19T12:43:15.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.102+0000 7f306a99c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3064108670 0x7f306419fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:15.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.103+0000 7f306a19b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f30640731f0 0x7f3064198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:15.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.103+0000 7f306a19b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f30640731f0 0x7f3064198900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:53902/0 (socket says 172.21.15.46:53902) 2023-10-19T12:43:15.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.103+0000 7f306999a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f30640747d0 0x7f3064198e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:15.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.103+0000 7f306a19b700 1 -- 172.21.15.46:0/4192010376 learned_addr learned my addr 172.21.15.46:0/4192010376 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:43:15.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.103+0000 7f306a19b700 1 -- 172.21.15.46:0/4192010376 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f30640747d0 msgr2=0x7f3064198e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:15.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.103+0000 7f306a19b700 1 --2- 172.21.15.46:0/4192010376 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f30640747d0 0x7f3064198e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:15.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.103+0000 7f306a19b700 1 -- 172.21.15.46:0/4192010376 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3064108670 msgr2=0x7f306419fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:15.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.103+0000 7f306a19b700 1 --2- 172.21.15.46:0/4192010376 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3064108670 0x7f306419fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:15.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.103+0000 7f306a19b700 1 -- 172.21.15.46:0/4192010376 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30540095f0 con 0x7f30640731f0 2023-10-19T12:43:15.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.103+0000 7f306a19b700 1 --2- 172.21.15.46:0/4192010376 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f30640731f0 0x7f3064198900 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f306000e9a0 tx=0x7f306000ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:15.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.103+0000 7f305b7fe700 1 -- 172.21.15.46:0/4192010376 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3060009790 con 0x7f30640731f0 2023-10-19T12:43:15.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.104+0000 7f306c3ff700 1 -- 172.21.15.46:0/4192010376 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30641a09e0 con 0x7f30640731f0 2023-10-19T12:43:15.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.104+0000 7f305b7fe700 1 -- 172.21.15.46:0/4192010376 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3060010430 con 0x7f30640731f0 2023-10-19T12:43:15.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.104+0000 7f305b7fe700 1 -- 172.21.15.46:0/4192010376 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3060018680 con 0x7f30640731f0 2023-10-19T12:43:15.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.104+0000 7f306c3ff700 1 -- 172.21.15.46:0/4192010376 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30641a0ef0 con 0x7f30640731f0 2023-10-19T12:43:15.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.105+0000 7f306c3ff700 1 -- 172.21.15.46:0/4192010376 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3064107480 con 0x7f30640731f0 2023-10-19T12:43:15.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.107+0000 7f305b7fe700 1 -- 172.21.15.46:0/4192010376 <== mon.2 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f30600105a0 con 0x7f30640731f0 2023-10-19T12:43:15.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.108+0000 7f305b7fe700 1 --2- 172.21.15.46:0/4192010376 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f30500a1480 0x7f30500a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:15.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.108+0000 7f305b7fe700 1 -- 172.21.15.46:0/4192010376 <== mon.2 v2:172.21.15.157:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f3060014070 con 0x7f30640731f0 2023-10-19T12:43:15.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.108+0000 7f306999a700 1 --2- 172.21.15.46:0/4192010376 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f30500a1480 0x7f30500a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:15.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.109+0000 7f306999a700 1 --2- 172.21.15.46:0/4192010376 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f30500a1480 0x7f30500a3940 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f305400b2e0 tx=0x7f305400b750 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:15.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.110+0000 7f305b7fe700 1 -- 172.21.15.46:0/4192010376 <== mon.2 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3060096510 con 0x7f30640731f0 2023-10-19T12:43:15.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:14 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/2894171749' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-19T12:43:15.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:14 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/275741867' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-19T12:43:15.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:14 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/2894171749' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-19T12:43:15.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:14 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/275741867' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-19T12:43:15.324 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.321+0000 7f306c3ff700 1 -- 172.21.15.46:0/4192010376 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f306410e190 con 0x7f30640731f0 2023-10-19T12:43:15.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.322+0000 7f305b7fe700 1 -- 172.21.15.46:0/4192010376 <== mon.2 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v90) v1 ==== 103+0+11 (secure 0 0 0) 0x7f3060099b30 con 0x7f30640731f0 2023-10-19T12:43:15.325 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2023-10-19T12:43:15.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.324+0000 7f306c3ff700 1 -- 172.21.15.46:0/4192010376 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f30500a1480 msgr2=0x7f30500a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:15.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.324+0000 7f306c3ff700 1 --2- 172.21.15.46:0/4192010376 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f30500a1480 0x7f30500a3940 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f305400b2e0 tx=0x7f305400b750 comp rx=0 tx=0).stop 2023-10-19T12:43:15.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.324+0000 7f306c3ff700 1 -- 172.21.15.46:0/4192010376 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f30640731f0 msgr2=0x7f3064198900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:15.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.324+0000 7f306c3ff700 1 --2- 172.21.15.46:0/4192010376 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f30640731f0 0x7f3064198900 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f306000e9a0 tx=0x7f306000ecb0 comp rx=0 tx=0).stop 2023-10-19T12:43:15.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.324+0000 7f306c3ff700 1 -- 172.21.15.46:0/4192010376 shutdown_connections 2023-10-19T12:43:15.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.324+0000 7f306c3ff700 1 --2- 172.21.15.46:0/4192010376 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3064108670 0x7f306419fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:15.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.324+0000 7f306c3ff700 1 --2- 172.21.15.46:0/4192010376 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f30640731f0 0x7f3064198900 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:15.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.324+0000 7f306c3ff700 1 --2- 172.21.15.46:0/4192010376 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f30500a1480 0x7f30500a3940 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:15.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.324+0000 7f306c3ff700 1 --2- 172.21.15.46:0/4192010376 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f30640747d0 0x7f3064198e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:15.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.324+0000 7f306c3ff700 1 -- 172.21.15.46:0/4192010376 >> 172.21.15.46:0/4192010376 conn(0x7f30640fbcf0 msgr2=0x7f30641045c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:15.330 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.325+0000 7f306c3ff700 1 -- 172.21.15.46:0/4192010376 shutdown_connections 2023-10-19T12:43:15.330 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.325+0000 7f306c3ff700 1 -- 172.21.15.46:0/4192010376 wait complete. 2023-10-19T12:43:15.349 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-19T12:43:15.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.551+0000 7f9f989ff700 1 -- 172.21.15.46:0/4047319689 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f94108630 msgr2=0x7f9f9410aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:15.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.551+0000 7f9f989ff700 1 --2- 172.21.15.46:0/4047319689 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f94108630 0x7f9f9410aac0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c00b0a0 tx=0x7f9f8c00b3b0 comp rx=0 tx=0).stop 2023-10-19T12:43:15.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.551+0000 7f9f989ff700 1 -- 172.21.15.46:0/4047319689 shutdown_connections 2023-10-19T12:43:15.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.551+0000 7f9f989ff700 1 --2- 172.21.15.46:0/4047319689 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f94108630 0x7f9f9410aac0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:15.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.551+0000 7f9f989ff700 1 --2- 172.21.15.46:0/4047319689 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9f940747b0 0x7f9f94072c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:15.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.551+0000 7f9f989ff700 1 --2- 172.21.15.46:0/4047319689 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9f940731d0 0x7f9f94073650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:15.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.551+0000 7f9f989ff700 1 -- 172.21.15.46:0/4047319689 >> 172.21.15.46:0/4047319689 conn(0x7f9f940fbc90 msgr2=0x7f9f940fe0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:15.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.551+0000 7f9f989ff700 1 -- 172.21.15.46:0/4047319689 shutdown_connections 2023-10-19T12:43:15.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.551+0000 7f9f989ff700 1 -- 172.21.15.46:0/4047319689 wait complete. 2023-10-19T12:43:15.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.552+0000 7f9f989ff700 1 Processor -- start 2023-10-19T12:43:15.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.552+0000 7f9f989ff700 1 -- start start 2023-10-19T12:43:15.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.553+0000 7f9f989ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f940731d0 0x7f9f941989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:15.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.553+0000 7f9f989ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9f940747b0 0x7f9f94198ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:15.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.553+0000 7f9f989ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9f94108630 0x7f9f9419fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:15.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.553+0000 7f9f989ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f941a0490 con 0x7f9f940731d0 2023-10-19T12:43:15.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.553+0000 7f9f989ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f941a05d0 con 0x7f9f94108630 2023-10-19T12:43:15.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.553+0000 7f9f989ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f941a0760 con 0x7f9f940747b0 2023-10-19T12:43:15.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.553+0000 7f9f9259c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f940731d0 0x7f9f941989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:15.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.553+0000 7f9f9259c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f940731d0 0x7f9f941989b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57172/0 (socket says 172.21.15.46:57172) 2023-10-19T12:43:15.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.553+0000 7f9f9259c700 1 -- 172.21.15.46:0/786689227 learned_addr learned my addr 172.21.15.46:0/786689227 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:43:15.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.553+0000 7f9f8bfff700 1 --2- 172.21.15.46:0/786689227 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9f940747b0 0x7f9f94198ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:15.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.553+0000 7f9f92d9d700 1 --2- 172.21.15.46:0/786689227 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9f94108630 0x7f9f9419fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:15.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.553+0000 7f9f9259c700 1 -- 172.21.15.46:0/786689227 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9f940747b0 msgr2=0x7f9f94198ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:15.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.553+0000 7f9f9259c700 1 --2- 172.21.15.46:0/786689227 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9f940747b0 0x7f9f94198ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:15.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.553+0000 7f9f9259c700 1 -- 172.21.15.46:0/786689227 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9f94108630 msgr2=0x7f9f9419fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:15.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.553+0000 7f9f9259c700 1 --2- 172.21.15.46:0/786689227 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9f94108630 0x7f9f9419fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:15.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.553+0000 7f9f9259c700 1 -- 172.21.15.46:0/786689227 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f84009520 con 0x7f9f940731d0 2023-10-19T12:43:15.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.554+0000 7f9f9259c700 1 --2- 172.21.15.46:0/786689227 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f940731d0 0x7f9f941989b0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f9f8400eb30 tx=0x7f9f8400ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:15.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.554+0000 7f9f8b7fe700 1 -- 172.21.15.46:0/786689227 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f84009880 con 0x7f9f940731d0 2023-10-19T12:43:15.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.554+0000 7f9f8b7fe700 1 -- 172.21.15.46:0/786689227 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9f840044e0 con 0x7f9f940731d0 2023-10-19T12:43:15.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.554+0000 7f9f989ff700 1 -- 172.21.15.46:0/786689227 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f8c009d00 con 0x7f9f940731d0 2023-10-19T12:43:15.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.554+0000 7f9f8b7fe700 1 -- 172.21.15.46:0/786689227 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f84003e90 con 0x7f9f940731d0 2023-10-19T12:43:15.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.554+0000 7f9f989ff700 1 -- 172.21.15.46:0/786689227 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f941a0dc0 con 0x7f9f940731d0 2023-10-19T12:43:15.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.555+0000 7f9f989ff700 1 -- 172.21.15.46:0/786689227 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f94107440 con 0x7f9f940731d0 2023-10-19T12:43:15.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.557+0000 7f9f8b7fe700 1 -- 172.21.15.46:0/786689227 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f9f84004000 con 0x7f9f940731d0 2023-10-19T12:43:15.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.558+0000 7f9f8b7fe700 1 --2- 172.21.15.46:0/786689227 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f9f800a1480 0x7f9f800a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:15.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.559+0000 7f9f8b7fe700 1 -- 172.21.15.46:0/786689227 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f9f84014070 con 0x7f9f940731d0 2023-10-19T12:43:15.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.559+0000 7f9f8bfff700 1 --2- 172.21.15.46:0/786689227 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f9f800a1480 0x7f9f800a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:15.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.559+0000 7f9f8bfff700 1 --2- 172.21.15.46:0/786689227 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f9f800a1480 0x7f9f800a3940 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c009c60 tx=0x7f9f7c009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:15.566 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.562+0000 7f9f8b7fe700 1 -- 172.21.15.46:0/786689227 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f9f840967e0 con 0x7f9f940731d0 2023-10-19T12:43:15.824 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.821+0000 7f9f989ff700 1 -- 172.21.15.46:0/786689227 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9f94067530 con 0x7f9f940731d0 2023-10-19T12:43:15.825 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.822+0000 7f9f8b7fe700 1 -- 172.21.15.46:0/786689227 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+11372 (secure 0 0 0) 0x7f9f84099e00 con 0x7f9f940731d0 2023-10-19T12:43:15.825 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:43:15.826 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14580,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/2235286008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":2235286008},{"type":"v1","addr":"172.21.15.46:6835","nonce":2235286008}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14592,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/339398444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":339398444},{"type":"v1","addr":"172.21.15.46:6837","nonce":339398444}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-19T12:41:18.815780+0000","modified":"2023-10-19T12:41:47.301944+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24680,"mds_1":24655,"mds_2":24643,"mds_3":24631,"mds_4":24629},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14640":{"gid":14640,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.46:6839/1655843965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":1655843965},{"type":"v1","addr":"172.21.15.46:6839","nonce":1655843965}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14652":{"gid":14652,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.46:6841/4204925553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6840","nonce":4204925553},{"type":"v1","addr":"172.21.15.46:6841","nonce":4204925553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24560":{"gid":24560,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.157:6833/1687745569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":1687745569},{"type":"v1","addr":"172.21.15.157:6833","nonce":1687745569}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24574":{"gid":24574,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.195:6833/3629933235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3629933235},{"type":"v1","addr":"172.21.15.195:6833","nonce":3629933235}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24602":{"gid":24602,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.157:6835/108432552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":108432552},{"type":"v1","addr":"172.21.15.157:6835","nonce":108432552}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24629":{"gid":24629,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":13,"addr":"172.21.15.157:6837/2629536514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6836","nonce":2629536514},{"type":"v1","addr":"172.21.15.157:6837","nonce":2629536514}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24631":{"gid":24631,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.195:6835/1406909915","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":1406909915},{"type":"v1","addr":"172.21.15.195:6835","nonce":1406909915}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24643":{"gid":24643,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":13,"addr":"172.21.15.195:6837/293916188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":293916188},{"type":"v1","addr":"172.21.15.195:6837","nonce":293916188}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24655":{"gid":24655,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":11,"addr":"172.21.15.195:6839/4094901934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6838","nonce":4094901934},{"type":"v1","addr":"172.21.15.195:6839","nonce":4094901934}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24680":{"gid":24680,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.157:6839/552718978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6838","nonce":552718978},{"type":"v1","addr":"172.21.15.157:6839","nonce":552718978}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-19T12:43:15.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.824+0000 7f9f989ff700 1 -- 172.21.15.46:0/786689227 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f9f800a1480 msgr2=0x7f9f800a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:15.828 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.824+0000 7f9f989ff700 1 --2- 172.21.15.46:0/786689227 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f9f800a1480 0x7f9f800a3940 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c009c60 tx=0x7f9f7c009260 comp rx=0 tx=0).stop 2023-10-19T12:43:15.828 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.824+0000 7f9f989ff700 1 -- 172.21.15.46:0/786689227 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f940731d0 msgr2=0x7f9f941989b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:15.828 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.824+0000 7f9f989ff700 1 --2- 172.21.15.46:0/786689227 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f940731d0 0x7f9f941989b0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f9f8400eb30 tx=0x7f9f8400ee40 comp rx=0 tx=0).stop 2023-10-19T12:43:15.828 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.824+0000 7f9f989ff700 1 -- 172.21.15.46:0/786689227 shutdown_connections 2023-10-19T12:43:15.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.824+0000 7f9f989ff700 1 --2- 172.21.15.46:0/786689227 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9f94108630 0x7f9f9419fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:15.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.824+0000 7f9f989ff700 1 --2- 172.21.15.46:0/786689227 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f940731d0 0x7f9f941989b0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:15.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.824+0000 7f9f989ff700 1 --2- 172.21.15.46:0/786689227 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f9f800a1480 0x7f9f800a3940 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:15.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.824+0000 7f9f989ff700 1 --2- 172.21.15.46:0/786689227 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9f940747b0 0x7f9f94198ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:15.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.824+0000 7f9f989ff700 1 -- 172.21.15.46:0/786689227 >> 172.21.15.46:0/786689227 conn(0x7f9f940fbc90 msgr2=0x7f9f94104580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:15.830 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.825+0000 7f9f989ff700 1 -- 172.21.15.46:0/786689227 shutdown_connections 2023-10-19T12:43:15.830 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:15.825+0000 7f9f989ff700 1 -- 172.21.15.46:0/786689227 wait complete. 2023-10-19T12:43:15.830 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 27 2023-10-19T12:43:15.847 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-19T12:43:16.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.048+0000 7f739edff700 1 -- 172.21.15.46:0/1829482587 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7398108610 msgr2=0x7f739810aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:16.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.048+0000 7f739edff700 1 --2- 172.21.15.46:0/1829482587 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7398108610 0x7f739810aa80 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f739000b0a0 tx=0x7f739000b3b0 comp rx=0 tx=0).stop 2023-10-19T12:43:16.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.048+0000 7f739edff700 1 -- 172.21.15.46:0/1829482587 shutdown_connections 2023-10-19T12:43:16.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.048+0000 7f739edff700 1 --2- 172.21.15.46:0/1829482587 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7398108610 0x7f739810aa80 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:16.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.048+0000 7f739edff700 1 --2- 172.21.15.46:0/1829482587 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f73980747d0 0x7f7398072c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:16.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.048+0000 7f739edff700 1 --2- 172.21.15.46:0/1829482587 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f73980731f0 0x7f7398073670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:16.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.048+0000 7f739edff700 1 -- 172.21.15.46:0/1829482587 >> 172.21.15.46:0/1829482587 conn(0x7f73980fbc90 msgr2=0x7f73980fe0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:16.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.048+0000 7f739edff700 1 -- 172.21.15.46:0/1829482587 shutdown_connections 2023-10-19T12:43:16.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.048+0000 7f739edff700 1 -- 172.21.15.46:0/1829482587 wait complete. 2023-10-19T12:43:16.055 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.049+0000 7f739edff700 1 Processor -- start 2023-10-19T12:43:16.055 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.049+0000 7f739edff700 1 -- start start 2023-10-19T12:43:16.056 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.050+0000 7f739edff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f73980731f0 0x7f7398198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:16.056 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.050+0000 7f739edff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f73980747d0 0x7f7398198ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:16.056 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.050+0000 7f739edff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7398108610 0x7f739819fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:16.056 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.050+0000 7f739edff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73981a04c0 con 0x7f7398108610 2023-10-19T12:43:16.056 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.050+0000 7f739edff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73981a0600 con 0x7f73980731f0 2023-10-19T12:43:16.057 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.050+0000 7f739edff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73981a0790 con 0x7f73980747d0 2023-10-19T12:43:16.057 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.050+0000 7f739d39c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7398108610 0x7f739819fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:16.057 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.050+0000 7f739cb9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f73980731f0 0x7f7398198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:16.057 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.050+0000 7f739d39c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7398108610 0x7f739819fef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57182/0 (socket says 172.21.15.46:57182) 2023-10-19T12:43:16.057 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.050+0000 7f739d39c700 1 -- 172.21.15.46:0/2242584295 learned_addr learned my addr 172.21.15.46:0/2242584295 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:43:16.058 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.050+0000 7f7397fff700 1 --2- 172.21.15.46:0/2242584295 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f73980747d0 0x7f7398198ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:16.058 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.050+0000 7f739d39c700 1 -- 172.21.15.46:0/2242584295 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f73980747d0 msgr2=0x7f7398198ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:16.058 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.050+0000 7f739d39c700 1 --2- 172.21.15.46:0/2242584295 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f73980747d0 0x7f7398198ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:16.058 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.051+0000 7f739d39c700 1 -- 172.21.15.46:0/2242584295 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f73980731f0 msgr2=0x7f7398198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:16.059 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.051+0000 7f739d39c700 1 --2- 172.21.15.46:0/2242584295 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f73980731f0 0x7f7398198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:16.059 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.051+0000 7f739d39c700 1 -- 172.21.15.46:0/2242584295 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7390009d00 con 0x7f7398108610 2023-10-19T12:43:16.059 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.051+0000 7f739d39c700 1 --2- 172.21.15.46:0/2242584295 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7398108610 0x7f739819fef0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f7390007a60 tx=0x7f7390007930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:16.059 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.051+0000 7f7395ffb700 1 -- 172.21.15.46:0/2242584295 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f739000e040 con 0x7f7398108610 2023-10-19T12:43:16.059 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.051+0000 7f7395ffb700 1 -- 172.21.15.46:0/2242584295 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7390004c50 con 0x7f7398108610 2023-10-19T12:43:16.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.051+0000 7f739edff700 1 -- 172.21.15.46:0/2242584295 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73981a0a10 con 0x7f7398108610 2023-10-19T12:43:16.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.051+0000 7f7395ffb700 1 -- 172.21.15.46:0/2242584295 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f739001b6c0 con 0x7f7398108610 2023-10-19T12:43:16.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.051+0000 7f739edff700 1 -- 172.21.15.46:0/2242584295 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73981a0e90 con 0x7f7398108610 2023-10-19T12:43:16.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.052+0000 7f739edff700 1 -- 172.21.15.46:0/2242584295 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7398107420 con 0x7f7398108610 2023-10-19T12:43:16.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.054+0000 7f7395ffb700 1 -- 172.21.15.46:0/2242584295 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f739001d470 con 0x7f7398108610 2023-10-19T12:43:16.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.055+0000 7f7395ffb700 1 --2- 172.21.15.46:0/2242584295 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f73880a1500 0x7f73880a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:16.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.056+0000 7f7395ffb700 1 -- 172.21.15.46:0/2242584295 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f73900cdfe0 con 0x7f7398108610 2023-10-19T12:43:16.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.056+0000 7f739cb9b700 1 --2- 172.21.15.46:0/2242584295 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f73880a1500 0x7f73880a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:16.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.056+0000 7f739cb9b700 1 --2- 172.21.15.46:0/2242584295 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f73880a1500 0x7f73880a39c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f738c009c60 tx=0x7f738c009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:16.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.060+0000 7f7395ffb700 1 -- 172.21.15.46:0/2242584295 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7390097360 con 0x7f7398108610 2023-10-19T12:43:16.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:15 smithi157 ceph-mon[134109]: pgmap v344: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-10-19T12:43:16.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:15 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/4229034203' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-19T12:43:16.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:15 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/4192010376' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-19T12:43:16.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:15 smithi195 ceph-mon[134493]: pgmap v344: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-10-19T12:43:16.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:15 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/4229034203' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-19T12:43:16.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:15 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/4192010376' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-19T12:43:16.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:15 smithi046 ceph-mon[98509]: pgmap v344: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-10-19T12:43:16.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:15 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/4229034203' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-19T12:43:16.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:15 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/4192010376' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-19T12:43:16.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.274+0000 7f739edff700 1 -- 172.21.15.46:0/2242584295 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7398067530 con 0x7f7398108610 2023-10-19T12:43:16.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.276+0000 7f7395ffb700 1 -- 172.21.15.46:0/2242584295 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+24481 (secure 0 0 0) 0x7f739009a980 con 0x7f7398108610 2023-10-19T12:43:16.280 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:43:16.281 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":90,"fsid":"96a8be3c-6e7b-11ee-8db6-212e2dc638e7","created":"2023-10-19T12:33:26.148713+0000","modified":"2023-10-19T12:42:28.113339+0000","last_up_change":"2023-10-19T12:40:30.761679+0000","last_in_change":"2023-10-19T12:40:13.663559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-19T12:37:07.175795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-19T12:41:16.895203+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-19T12:41:18.255601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-19T12:41:21.830455+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"346ce86b-a10a-4869-9fdb-c3c1d4161455","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6803","nonce":500237995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6805","nonce":500237995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6809","nonce":500237995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6807","nonce":500237995}]},"public_addr":"172.21.15.46:6803/500237995","cluster_addr":"172.21.15.46:6805/500237995","heartbeat_back_addr":"172.21.15.46:6809/500237995","heartbeat_front_addr":"172.21.15.46:6807/500237995","state":["exists","up"]},{"osd":1,"uuid":"02aae687-76c5-4124-bae4-9787ed571c28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6801","nonce":2496862790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6803","nonce":2496862790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6807","nonce":2496862790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6805","nonce":2496862790}]},"public_addr":"172.21.15.157:6801/2496862790","cluster_addr":"172.21.15.157:6803/2496862790","heartbeat_back_addr":"172.21.15.157:6807/2496862790","heartbeat_front_addr":"172.21.15.157:6805/2496862790","state":["exists","up"]},{"osd":2,"uuid":"d5360828-1f58-4380-b2ad-0c21ff850981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6801","nonce":4211767276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6803","nonce":4211767276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6807","nonce":4211767276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6805","nonce":4211767276}]},"public_addr":"172.21.15.195:6801/4211767276","cluster_addr":"172.21.15.195:6803/4211767276","heartbeat_back_addr":"172.21.15.195:6807/4211767276","heartbeat_front_addr":"172.21.15.195:6805/4211767276","state":["exists","up"]},{"osd":3,"uuid":"accb780f-49d0-43f8-b166-ee12c558ef00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6811","nonce":1964113352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6813","nonce":1964113352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6817","nonce":1964113352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6815","nonce":1964113352}]},"public_addr":"172.21.15.46:6811/1964113352","cluster_addr":"172.21.15.46:6813/1964113352","heartbeat_back_addr":"172.21.15.46:6817/1964113352","heartbeat_front_addr":"172.21.15.46:6815/1964113352","state":["exists","up"]},{"osd":4,"uuid":"e662886d-e989-4d02-8c1f-3c4671352b0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6809","nonce":3636910144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6811","nonce":3636910144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6815","nonce":3636910144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6813","nonce":3636910144}]},"public_addr":"172.21.15.157:6809/3636910144","cluster_addr":"172.21.15.157:6811/3636910144","heartbeat_back_addr":"172.21.15.157:6815/3636910144","heartbeat_front_addr":"172.21.15.157:6813/3636910144","state":["exists","up"]},{"osd":5,"uuid":"9597e0ce-14ea-407d-90fe-f74bccee38b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6809","nonce":4071287969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6811","nonce":4071287969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6815","nonce":4071287969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6813","nonce":4071287969}]},"public_addr":"172.21.15.195:6809/4071287969","cluster_addr":"172.21.15.195:6811/4071287969","heartbeat_back_addr":"172.21.15.195:6815/4071287969","heartbeat_front_addr":"172.21.15.195:6813/4071287969","state":["exists","up"]},{"osd":6,"uuid":"6b78ba38-f60e-4cb6-b01c-cecc1820e8e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6819","nonce":1842285555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6821","nonce":1842285555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6825","nonce":1842285555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6823","nonce":1842285555}]},"public_addr":"172.21.15.46:6819/1842285555","cluster_addr":"172.21.15.46:6821/1842285555","heartbeat_back_addr":"172.21.15.46:6825/1842285555","heartbeat_front_addr":"172.21.15.46:6823/1842285555","state":["exists","up"]},{"osd":7,"uuid":"59a0899f-3bcd-4db2-b544-24df3a536749","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6817","nonce":3498672588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6819","nonce":3498672588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6823","nonce":3498672588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6821","nonce":3498672588}]},"public_addr":"172.21.15.157:6817/3498672588","cluster_addr":"172.21.15.157:6819/3498672588","heartbeat_back_addr":"172.21.15.157:6823/3498672588","heartbeat_front_addr":"172.21.15.157:6821/3498672588","state":["exists","up"]},{"osd":8,"uuid":"9c3c9835-043a-4fb5-a9ee-edf8caf6b605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6817","nonce":74230104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6819","nonce":74230104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6823","nonce":74230104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6821","nonce":74230104}]},"public_addr":"172.21.15.195:6817/74230104","cluster_addr":"172.21.15.195:6819/74230104","heartbeat_back_addr":"172.21.15.195:6823/74230104","heartbeat_front_addr":"172.21.15.195:6821/74230104","state":["exists","up"]},{"osd":9,"uuid":"3f18f506-a577-4b7c-ae0d-9351c07e81f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6827","nonce":3472581046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6829","nonce":3472581046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6833","nonce":3472581046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6831","nonce":3472581046}]},"public_addr":"172.21.15.46:6827/3472581046","cluster_addr":"172.21.15.46:6829/3472581046","heartbeat_back_addr":"172.21.15.46:6833/3472581046","heartbeat_front_addr":"172.21.15.46:6831/3472581046","state":["exists","up"]},{"osd":10,"uuid":"1ed01854-443a-4acf-9293-7ca0d451a93d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6825","nonce":2378416559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6827","nonce":2378416559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6831","nonce":2378416559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6829","nonce":2378416559}]},"public_addr":"172.21.15.157:6825/2378416559","cluster_addr":"172.21.15.157:6827/2378416559","heartbeat_back_addr":"172.21.15.157:6831/2378416559","heartbeat_front_addr":"172.21.15.157:6829/2378416559","state":["exists","up"]},{"osd":11,"uuid":"021398c0-9184-4647-8220-e40f6705ca90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6825","nonce":3075632222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6827","nonce":3075632222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6831","nonce":3075632222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6829","nonce":3075632222}]},"public_addr":"172.21.15.195:6825/3075632222","cluster_addr":"172.21.15.195:6827/3075632222","heartbeat_back_addr":"172.21.15.195:6831/3075632222","heartbeat_front_addr":"172.21.15.195:6829/3075632222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:36:22.002614+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:36:44.098031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:37:04.518341+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:37:30.796462+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:37:52.756555+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:38:13.403168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:38:39.058472+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:39:01.106893+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:39:21.908334+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:39:46.843884+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:40:08.792020+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:40:29.282974+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":3,"to":6}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.39","mappings":[{"from":5,"to":8}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.46:0/3248595150":"2023-10-20T12:34:26.552115+0000","172.21.15.46:0/3624849341":"2023-10-20T12:34:26.552115+0000","172.21.15.46:0/1844094590":"2023-10-20T12:34:26.552115+0000","172.21.15.46:6801/20022894":"2023-10-20T12:34:26.552115+0000","172.21.15.46:0/3969790632":"2023-10-20T12:34:00.135248+0000","172.21.15.46:0/2331135821":"2023-10-20T12:34:00.135248+0000","172.21.15.46:6800/51664346":"2023-10-20T12:34:00.135248+0000","172.21.15.46:6801/51664346":"2023-10-20T12:34:00.135248+0000","172.21.15.46:0/585851467":"2023-10-20T12:34:00.135248+0000","172.21.15.46:6800/20022894":"2023-10-20T12:34:26.552115+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-19T12:43:16.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.278+0000 7f739edff700 1 -- 172.21.15.46:0/2242584295 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f73880a1500 msgr2=0x7f73880a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:16.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.278+0000 7f739edff700 1 --2- 172.21.15.46:0/2242584295 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f73880a1500 0x7f73880a39c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f738c009c60 tx=0x7f738c009260 comp rx=0 tx=0).stop 2023-10-19T12:43:16.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.278+0000 7f739edff700 1 -- 172.21.15.46:0/2242584295 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7398108610 msgr2=0x7f739819fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:16.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.278+0000 7f739edff700 1 --2- 172.21.15.46:0/2242584295 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7398108610 0x7f739819fef0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f7390007a60 tx=0x7f7390007930 comp rx=0 tx=0).stop 2023-10-19T12:43:16.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.278+0000 7f739edff700 1 -- 172.21.15.46:0/2242584295 shutdown_connections 2023-10-19T12:43:16.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.278+0000 7f739edff700 1 --2- 172.21.15.46:0/2242584295 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7398108610 0x7f739819fef0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:16.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.278+0000 7f739edff700 1 --2- 172.21.15.46:0/2242584295 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f73980731f0 0x7f7398198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:16.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.278+0000 7f739edff700 1 --2- 172.21.15.46:0/2242584295 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f73880a1500 0x7f73880a39c0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:16.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.278+0000 7f739edff700 1 --2- 172.21.15.46:0/2242584295 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f73980747d0 0x7f7398198ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:16.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.278+0000 7f739edff700 1 -- 172.21.15.46:0/2242584295 >> 172.21.15.46:0/2242584295 conn(0x7f73980fbc90 msgr2=0x7f7398104560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:16.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.278+0000 7f739edff700 1 -- 172.21.15.46:0/2242584295 shutdown_connections 2023-10-19T12:43:16.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.279+0000 7f739edff700 1 -- 172.21.15.46:0/2242584295 wait complete. 2023-10-19T12:43:16.302 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-19T12:37:07.175795+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-19T12:41:16.895203+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-19T12:41:18.255601+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-19T12:41:21.830455+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-19T12:43:16.303 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-19T12:43:16.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.508+0000 7f3d3a5ff700 1 -- 172.21.15.46:0/2250170639 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d341007a0 msgr2=0x7f3d34100bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:16.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.508+0000 7f3d3a5ff700 1 --2- 172.21.15.46:0/2250170639 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d341007a0 0x7f3d34100bc0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f3d240099c0 tx=0x7f3d24009cd0 comp rx=0 tx=0).stop 2023-10-19T12:43:16.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.508+0000 7f3d3a5ff700 1 -- 172.21.15.46:0/2250170639 shutdown_connections 2023-10-19T12:43:16.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.508+0000 7f3d3a5ff700 1 --2- 172.21.15.46:0/2250170639 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d34102330 0x7f3d34108be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:16.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.508+0000 7f3d3a5ff700 1 --2- 172.21.15.46:0/2250170639 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d341007a0 0x7f3d34100bc0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:16.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.508+0000 7f3d3a5ff700 1 --2- 172.21.15.46:0/2250170639 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3d34101990 0x7f3d34101df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:16.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.508+0000 7f3d3a5ff700 1 -- 172.21.15.46:0/2250170639 >> 172.21.15.46:0/2250170639 conn(0x7f3d340fbcf0 msgr2=0x7f3d340fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:16.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.508+0000 7f3d3a5ff700 1 -- 172.21.15.46:0/2250170639 shutdown_connections 2023-10-19T12:43:16.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.508+0000 7f3d3a5ff700 1 -- 172.21.15.46:0/2250170639 wait complete. 2023-10-19T12:43:16.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.509+0000 7f3d3a5ff700 1 Processor -- start 2023-10-19T12:43:16.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.509+0000 7f3d3a5ff700 1 -- start start 2023-10-19T12:43:16.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.509+0000 7f3d3a5ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d341007a0 0x7f3d341989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:16.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.509+0000 7f3d3a5ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d34101990 0x7f3d34198f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:16.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.509+0000 7f3d3a5ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3d34102330 0x7f3d3419fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:16.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.509+0000 7f3d3a5ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d341a04c0 con 0x7f3d341007a0 2023-10-19T12:43:16.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.510+0000 7f3d3a5ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d341a0600 con 0x7f3d34102330 2023-10-19T12:43:16.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.510+0000 7f3d3a5ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d341a0790 con 0x7f3d34101990 2023-10-19T12:43:16.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.510+0000 7f3d33fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d341007a0 0x7f3d341989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:16.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.510+0000 7f3d33fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d341007a0 0x7f3d341989e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57210/0 (socket says 172.21.15.46:57210) 2023-10-19T12:43:16.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.510+0000 7f3d33fff700 1 -- 172.21.15.46:0/3561416614 learned_addr learned my addr 172.21.15.46:0/3561416614 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:43:16.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.510+0000 7f3d337fe700 1 --2- 172.21.15.46:0/3561416614 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d34101990 0x7f3d34198f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:16.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.510+0000 7f3d38b9c700 1 --2- 172.21.15.46:0/3561416614 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3d34102330 0x7f3d3419fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:16.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.510+0000 7f3d33fff700 1 -- 172.21.15.46:0/3561416614 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d34101990 msgr2=0x7f3d34198f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:16.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.510+0000 7f3d33fff700 1 --2- 172.21.15.46:0/3561416614 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d34101990 0x7f3d34198f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:16.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.510+0000 7f3d33fff700 1 -- 172.21.15.46:0/3561416614 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3d34102330 msgr2=0x7f3d3419fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:16.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.510+0000 7f3d33fff700 1 --2- 172.21.15.46:0/3561416614 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3d34102330 0x7f3d3419fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:16.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.510+0000 7f3d33fff700 1 -- 172.21.15.46:0/3561416614 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d240095f0 con 0x7f3d341007a0 2023-10-19T12:43:16.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.510+0000 7f3d337fe700 1 --2- 172.21.15.46:0/3561416614 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d34101990 0x7f3d34198f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T12:43:16.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.510+0000 7f3d33fff700 1 --2- 172.21.15.46:0/3561416614 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d341007a0 0x7f3d341989e0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f3d24003730 tx=0x7f3d2400fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:16.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.511+0000 7f3d317fa700 1 -- 172.21.15.46:0/3561416614 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d2401d070 con 0x7f3d341007a0 2023-10-19T12:43:16.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.511+0000 7f3d317fa700 1 -- 172.21.15.46:0/3561416614 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3d2400bda0 con 0x7f3d341007a0 2023-10-19T12:43:16.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.511+0000 7f3d317fa700 1 -- 172.21.15.46:0/3561416614 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d24004c70 con 0x7f3d341007a0 2023-10-19T12:43:16.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.511+0000 7f3d3a5ff700 1 -- 172.21.15.46:0/3561416614 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d341a0a10 con 0x7f3d341007a0 2023-10-19T12:43:16.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.511+0000 7f3d3a5ff700 1 -- 172.21.15.46:0/3561416614 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d341a0de0 con 0x7f3d341007a0 2023-10-19T12:43:16.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.512+0000 7f3d3a5ff700 1 -- 172.21.15.46:0/3561416614 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d340675a0 con 0x7f3d341007a0 2023-10-19T12:43:16.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.514+0000 7f3d317fa700 1 -- 172.21.15.46:0/3561416614 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f3d24005050 con 0x7f3d341007a0 2023-10-19T12:43:16.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.515+0000 7f3d317fa700 1 --2- 172.21.15.46:0/3561416614 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f3d1c0a1500 0x7f3d1c0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:16.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.515+0000 7f3d317fa700 1 -- 172.21.15.46:0/3561416614 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f3d240ce280 con 0x7f3d341007a0 2023-10-19T12:43:16.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.515+0000 7f3d337fe700 1 --2- 172.21.15.46:0/3561416614 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f3d1c0a1500 0x7f3d1c0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:16.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.516+0000 7f3d337fe700 1 --2- 172.21.15.46:0/3561416614 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f3d1c0a1500 0x7f3d1c0a39c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f3d28009cb0 tx=0x7f3d28009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:16.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.517+0000 7f3d317fa700 1 -- 172.21.15.46:0/3561416614 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3d24097600 con 0x7f3d341007a0 2023-10-19T12:43:16.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.727+0000 7f3d3a5ff700 1 -- 172.21.15.46:0/3561416614 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3d3410c190 con 0x7f3d341007a0 2023-10-19T12:43:16.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.727+0000 7f3d317fa700 1 -- 172.21.15.46:0/3561416614 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v90) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3d2409ac20 con 0x7f3d341007a0 2023-10-19T12:43:16.731 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2023-10-19T12:43:16.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.730+0000 7f3d3a5ff700 1 -- 172.21.15.46:0/3561416614 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f3d1c0a1500 msgr2=0x7f3d1c0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:16.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.730+0000 7f3d3a5ff700 1 --2- 172.21.15.46:0/3561416614 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f3d1c0a1500 0x7f3d1c0a39c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f3d28009cb0 tx=0x7f3d28009260 comp rx=0 tx=0).stop 2023-10-19T12:43:16.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.730+0000 7f3d3a5ff700 1 -- 172.21.15.46:0/3561416614 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d341007a0 msgr2=0x7f3d341989e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:16.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.730+0000 7f3d3a5ff700 1 --2- 172.21.15.46:0/3561416614 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d341007a0 0x7f3d341989e0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f3d24003730 tx=0x7f3d2400fab0 comp rx=0 tx=0).stop 2023-10-19T12:43:16.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.730+0000 7f3d3a5ff700 1 -- 172.21.15.46:0/3561416614 shutdown_connections 2023-10-19T12:43:16.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.730+0000 7f3d3a5ff700 1 --2- 172.21.15.46:0/3561416614 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3d34102330 0x7f3d3419fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:16.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.730+0000 7f3d3a5ff700 1 --2- 172.21.15.46:0/3561416614 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d341007a0 0x7f3d341989e0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:16.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.730+0000 7f3d3a5ff700 1 --2- 172.21.15.46:0/3561416614 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f3d1c0a1500 0x7f3d1c0a39c0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:16.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.730+0000 7f3d3a5ff700 1 --2- 172.21.15.46:0/3561416614 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d34101990 0x7f3d34198f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:16.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.730+0000 7f3d3a5ff700 1 -- 172.21.15.46:0/3561416614 >> 172.21.15.46:0/3561416614 conn(0x7f3d340fbcf0 msgr2=0x7f3d34072a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:16.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.730+0000 7f3d3a5ff700 1 -- 172.21.15.46:0/3561416614 shutdown_connections 2023-10-19T12:43:16.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.730+0000 7f3d3a5ff700 1 -- 172.21.15.46:0/3561416614 wait complete. 2023-10-19T12:43:16.753 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-19T12:43:16.961 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.958+0000 7f692a3ff700 1 -- 172.21.15.46:0/1740059673 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f69241007a0 msgr2=0x7f6924100bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:16.962 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.958+0000 7f692a3ff700 1 --2- 172.21.15.46:0/1740059673 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f69241007a0 0x7f6924100bc0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f69140099c0 tx=0x7f6914009cd0 comp rx=0 tx=0).stop 2023-10-19T12:43:16.962 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.958+0000 7f692a3ff700 1 -- 172.21.15.46:0/1740059673 shutdown_connections 2023-10-19T12:43:16.962 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.958+0000 7f692a3ff700 1 --2- 172.21.15.46:0/1740059673 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6924102330 0x7f6924108be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:16.962 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.958+0000 7f692a3ff700 1 --2- 172.21.15.46:0/1740059673 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f69241007a0 0x7f6924100bc0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:16.963 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.958+0000 7f692a3ff700 1 --2- 172.21.15.46:0/1740059673 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6924101990 0x7f6924101df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:16.963 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.958+0000 7f692a3ff700 1 -- 172.21.15.46:0/1740059673 >> 172.21.15.46:0/1740059673 conn(0x7f69240fbcf0 msgr2=0x7f69240fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:16.963 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.958+0000 7f692a3ff700 1 -- 172.21.15.46:0/1740059673 shutdown_connections 2023-10-19T12:43:16.963 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.958+0000 7f692a3ff700 1 -- 172.21.15.46:0/1740059673 wait complete. 2023-10-19T12:43:16.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.959+0000 7f692a3ff700 1 Processor -- start 2023-10-19T12:43:16.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.959+0000 7f692a3ff700 1 -- start start 2023-10-19T12:43:16.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.959+0000 7f692a3ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f69241007a0 0x7f6924198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:16.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.960+0000 7f692a3ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6924101990 0x7f6924198eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:16.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.960+0000 7f692a3ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6924102330 0x7f692419fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:16.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.960+0000 7f692a3ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69241a04a0 con 0x7f69241007a0 2023-10-19T12:43:16.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.960+0000 7f692a3ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69241a05e0 con 0x7f6924102330 2023-10-19T12:43:16.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.960+0000 7f692a3ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69241a0770 con 0x7f6924101990 2023-10-19T12:43:16.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.960+0000 7f6923fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f69241007a0 0x7f6924198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:16.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.960+0000 7f6923fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f69241007a0 0x7f6924198970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57236/0 (socket says 172.21.15.46:57236) 2023-10-19T12:43:16.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.960+0000 7f6923fff700 1 -- 172.21.15.46:0/1120276363 learned_addr learned my addr 172.21.15.46:0/1120276363 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:43:16.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.960+0000 7f69237fe700 1 --2- 172.21.15.46:0/1120276363 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6924101990 0x7f6924198eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:16.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.960+0000 7f692899c700 1 --2- 172.21.15.46:0/1120276363 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6924102330 0x7f692419fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:16.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.960+0000 7f6923fff700 1 -- 172.21.15.46:0/1120276363 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6924101990 msgr2=0x7f6924198eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:16.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.960+0000 7f6923fff700 1 --2- 172.21.15.46:0/1120276363 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6924101990 0x7f6924198eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:16.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.960+0000 7f6923fff700 1 -- 172.21.15.46:0/1120276363 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6924102330 msgr2=0x7f692419fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:16.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.960+0000 7f6923fff700 1 --2- 172.21.15.46:0/1120276363 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6924102330 0x7f692419fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:16.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.960+0000 7f6923fff700 1 -- 172.21.15.46:0/1120276363 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69140095f0 con 0x7f69241007a0 2023-10-19T12:43:16.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.960+0000 7f692899c700 1 --2- 172.21.15.46:0/1120276363 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6924102330 0x7f692419fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T12:43:16.970 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.961+0000 7f6923fff700 1 --2- 172.21.15.46:0/1120276363 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f69241007a0 0x7f6924198970 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f6914003730 tx=0x7f691400fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:16.970 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.961+0000 7f69217fa700 1 -- 172.21.15.46:0/1120276363 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691401d070 con 0x7f69241007a0 2023-10-19T12:43:16.970 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.961+0000 7f69217fa700 1 -- 172.21.15.46:0/1120276363 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f691400fe70 con 0x7f69241007a0 2023-10-19T12:43:16.970 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.961+0000 7f692a3ff700 1 -- 172.21.15.46:0/1120276363 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69241a09f0 con 0x7f69241007a0 2023-10-19T12:43:16.971 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.961+0000 7f69217fa700 1 -- 172.21.15.46:0/1120276363 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69140173f0 con 0x7f69241007a0 2023-10-19T12:43:16.971 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.961+0000 7f692a3ff700 1 -- 172.21.15.46:0/1120276363 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69241a0e10 con 0x7f69241007a0 2023-10-19T12:43:16.971 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.962+0000 7f692a3ff700 1 -- 172.21.15.46:0/1120276363 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69240675a0 con 0x7f69241007a0 2023-10-19T12:43:16.972 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.964+0000 7f69217fa700 1 -- 172.21.15.46:0/1120276363 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f6914022470 con 0x7f69241007a0 2023-10-19T12:43:16.972 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.966+0000 7f69217fa700 1 --2- 172.21.15.46:0/1120276363 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f690c0a1480 0x7f690c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:16.972 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.966+0000 7f69217fa700 1 -- 172.21.15.46:0/1120276363 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f69140ce280 con 0x7f69241007a0 2023-10-19T12:43:16.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.967+0000 7f69237fe700 1 --2- 172.21.15.46:0/1120276363 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f690c0a1480 0x7f690c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:16.973 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.967+0000 7f69237fe700 1 --2- 172.21.15.46:0/1120276363 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f690c0a1480 0x7f690c0a3940 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6918009c60 tx=0x7f6918009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:16.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:16.970+0000 7f69217fa700 1 -- 172.21.15.46:0/1120276363 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6914097600 con 0x7f69241007a0 2023-10-19T12:43:17.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:16 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/786689227' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-19T12:43:17.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:16 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/2242584295' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-19T12:43:17.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:16 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/3561416614' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-19T12:43:17.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:16 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/786689227' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-19T12:43:17.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:16 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/2242584295' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-19T12:43:17.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:16 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/3561416614' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-19T12:43:17.186 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.183+0000 7f692a3ff700 1 -- 172.21.15.46:0/1120276363 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f69241a1100 con 0x7f69241007a0 2023-10-19T12:43:17.187 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.183+0000 7f69217fa700 1 -- 172.21.15.46:0/1120276363 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v90) v1 ==== 104+0+11 (secure 0 0 0) 0x7f691409ac20 con 0x7f69241007a0 2023-10-19T12:43:17.187 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2023-10-19T12:43:17.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.186+0000 7f692a3ff700 1 -- 172.21.15.46:0/1120276363 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f690c0a1480 msgr2=0x7f690c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:17.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.186+0000 7f692a3ff700 1 --2- 172.21.15.46:0/1120276363 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f690c0a1480 0x7f690c0a3940 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6918009c60 tx=0x7f6918009260 comp rx=0 tx=0).stop 2023-10-19T12:43:17.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.186+0000 7f692a3ff700 1 -- 172.21.15.46:0/1120276363 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f69241007a0 msgr2=0x7f6924198970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:17.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.186+0000 7f692a3ff700 1 --2- 172.21.15.46:0/1120276363 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f69241007a0 0x7f6924198970 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f6914003730 tx=0x7f691400fa00 comp rx=0 tx=0).stop 2023-10-19T12:43:17.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.186+0000 7f692a3ff700 1 -- 172.21.15.46:0/1120276363 shutdown_connections 2023-10-19T12:43:17.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.186+0000 7f692a3ff700 1 --2- 172.21.15.46:0/1120276363 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6924102330 0x7f692419fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:17.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.186+0000 7f692a3ff700 1 --2- 172.21.15.46:0/1120276363 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f69241007a0 0x7f6924198970 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:17.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.186+0000 7f692a3ff700 1 --2- 172.21.15.46:0/1120276363 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f690c0a1480 0x7f690c0a3940 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:17.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.186+0000 7f692a3ff700 1 --2- 172.21.15.46:0/1120276363 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6924101990 0x7f6924198eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:17.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.186+0000 7f692a3ff700 1 -- 172.21.15.46:0/1120276363 >> 172.21.15.46:0/1120276363 conn(0x7f69240fbcf0 msgr2=0x7f69241071b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:17.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.186+0000 7f692a3ff700 1 -- 172.21.15.46:0/1120276363 shutdown_connections 2023-10-19T12:43:17.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.186+0000 7f692a3ff700 1 -- 172.21.15.46:0/1120276363 wait complete. 2023-10-19T12:43:17.206 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:16 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/786689227' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-19T12:43:17.206 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:16 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/2242584295' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-19T12:43:17.206 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:16 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/3561416614' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-19T12:43:17.208 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-19T12:43:17.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.414+0000 7f8fe7fff700 1 -- 172.21.15.46:0/3874071409 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8fe01007a0 msgr2=0x7f8fe0100bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:17.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.414+0000 7f8fe7fff700 1 --2- 172.21.15.46:0/3874071409 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8fe01007a0 0x7f8fe0100bc0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc009920 tx=0x7f8fdc009c30 comp rx=0 tx=0).stop 2023-10-19T12:43:17.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.414+0000 7f8fe7fff700 1 -- 172.21.15.46:0/3874071409 shutdown_connections 2023-10-19T12:43:17.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.414+0000 7f8fe7fff700 1 --2- 172.21.15.46:0/3874071409 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8fe0102330 0x7f8fe0108be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:17.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.414+0000 7f8fe7fff700 1 --2- 172.21.15.46:0/3874071409 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8fe01007a0 0x7f8fe0100bc0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:17.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.414+0000 7f8fe7fff700 1 --2- 172.21.15.46:0/3874071409 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8fe0101990 0x7f8fe0101df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:17.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.414+0000 7f8fe7fff700 1 -- 172.21.15.46:0/3874071409 >> 172.21.15.46:0/3874071409 conn(0x7f8fe00fbcf0 msgr2=0x7f8fe00fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:17.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.415+0000 7f8fe7fff700 1 -- 172.21.15.46:0/3874071409 shutdown_connections 2023-10-19T12:43:17.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.415+0000 7f8fe7fff700 1 -- 172.21.15.46:0/3874071409 wait complete. 2023-10-19T12:43:17.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.416+0000 7f8fe7fff700 1 Processor -- start 2023-10-19T12:43:17.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.416+0000 7f8fe7fff700 1 -- start start 2023-10-19T12:43:17.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.416+0000 7f8fe7fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8fe01007a0 0x7f8fe0074500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:17.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.416+0000 7f8fe7fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8fe0101990 0x7f8fe0072be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:17.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.416+0000 7f8fe7fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8fe0102330 0x7f8fe0073120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:17.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.416+0000 7f8fe7fff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe0073820 con 0x7f8fe0101990 2023-10-19T12:43:17.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.416+0000 7f8fe7fff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe0073990 con 0x7f8fe0102330 2023-10-19T12:43:17.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.416+0000 7f8fe7fff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe01a0890 con 0x7f8fe01007a0 2023-10-19T12:43:17.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.416+0000 7f8fe559a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8fe0101990 0x7f8fe0072be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:17.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.416+0000 7f8fe5d9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8fe01007a0 0x7f8fe0074500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:17.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.416+0000 7f8fe559a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8fe0101990 0x7f8fe0072be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57250/0 (socket says 172.21.15.46:57250) 2023-10-19T12:43:17.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.416+0000 7f8fe559a700 1 -- 172.21.15.46:0/2489295992 learned_addr learned my addr 172.21.15.46:0/2489295992 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:43:17.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.416+0000 7f8fe659c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8fe0102330 0x7f8fe0073120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:17.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.417+0000 7f8fe659c700 1 -- 172.21.15.46:0/2489295992 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8fe01007a0 msgr2=0x7f8fe0074500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:17.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.417+0000 7f8fe659c700 1 --2- 172.21.15.46:0/2489295992 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8fe01007a0 0x7f8fe0074500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:17.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.417+0000 7f8fe659c700 1 -- 172.21.15.46:0/2489295992 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8fe0101990 msgr2=0x7f8fe0072be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:17.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.417+0000 7f8fe659c700 1 --2- 172.21.15.46:0/2489295992 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8fe0101990 0x7f8fe0072be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:17.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.417+0000 7f8fe659c700 1 -- 172.21.15.46:0/2489295992 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fdc009520 con 0x7f8fe0102330 2023-10-19T12:43:17.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.417+0000 7f8fe5d9b700 1 --2- 172.21.15.46:0/2489295992 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8fe01007a0 0x7f8fe0074500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:43:17.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.417+0000 7f8fe559a700 1 --2- 172.21.15.46:0/2489295992 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8fe0101990 0x7f8fe0072be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:43:17.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.417+0000 7f8fe659c700 1 --2- 172.21.15.46:0/2489295992 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8fe0102330 0x7f8fe0073120 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8fd800efc0 tx=0x7f8fd800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:17.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.417+0000 7f8fd6ffd700 1 -- 172.21.15.46:0/2489295992 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd8018070 con 0x7f8fe0102330 2023-10-19T12:43:17.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.417+0000 7f8fe7fff700 1 -- 172.21.15.46:0/2489295992 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fe01a0a90 con 0x7f8fe0102330 2023-10-19T12:43:17.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.417+0000 7f8fd6ffd700 1 -- 172.21.15.46:0/2489295992 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8fd800f040 con 0x7f8fe0102330 2023-10-19T12:43:17.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.417+0000 7f8fd6ffd700 1 -- 172.21.15.46:0/2489295992 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd800ccb0 con 0x7f8fe0102330 2023-10-19T12:43:17.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.418+0000 7f8fe7fff700 1 -- 172.21.15.46:0/2489295992 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fe01a0f50 con 0x7f8fe0102330 2023-10-19T12:43:17.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.418+0000 7f8fe7fff700 1 -- 172.21.15.46:0/2489295992 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fe0107d10 con 0x7f8fe0102330 2023-10-19T12:43:17.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.421+0000 7f8fd6ffd700 1 -- 172.21.15.46:0/2489295992 <== mon.2 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f8fd8003a00 con 0x7f8fe0102330 2023-10-19T12:43:17.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.422+0000 7f8fd6ffd700 1 --2- 172.21.15.46:0/2489295992 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f8fcc0a1480 0x7f8fcc0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:17.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.422+0000 7f8fd6ffd700 1 -- 172.21.15.46:0/2489295992 <== mon.2 v2:172.21.15.157:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f8fd80cd470 con 0x7f8fe0102330 2023-10-19T12:43:17.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.422+0000 7f8fe5d9b700 1 --2- 172.21.15.46:0/2489295992 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f8fcc0a1480 0x7f8fcc0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:17.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.423+0000 7f8fe5d9b700 1 --2- 172.21.15.46:0/2489295992 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f8fcc0a1480 0x7f8fcc0a3940 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc0098f0 tx=0x7f8fdc019040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:17.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.424+0000 7f8fd6ffd700 1 -- 172.21.15.46:0/2489295992 <== mon.2 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f8fd80967f0 con 0x7f8fe0102330 2023-10-19T12:43:17.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.634+0000 7f8fe7fff700 1 -- 172.21.15.46:0/2489295992 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8fe010c000 con 0x7f8fe0102330 2023-10-19T12:43:17.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.635+0000 7f8fd6ffd700 1 -- 172.21.15.46:0/2489295992 <== mon.2 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v90) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8fd8099e10 con 0x7f8fe0102330 2023-10-19T12:43:17.638 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2023-10-19T12:43:17.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.637+0000 7f8fe7fff700 1 -- 172.21.15.46:0/2489295992 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f8fcc0a1480 msgr2=0x7f8fcc0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:17.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.637+0000 7f8fe7fff700 1 --2- 172.21.15.46:0/2489295992 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f8fcc0a1480 0x7f8fcc0a3940 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc0098f0 tx=0x7f8fdc019040 comp rx=0 tx=0).stop 2023-10-19T12:43:17.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.637+0000 7f8fe7fff700 1 -- 172.21.15.46:0/2489295992 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8fe0102330 msgr2=0x7f8fe0073120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:17.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.637+0000 7f8fe7fff700 1 --2- 172.21.15.46:0/2489295992 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8fe0102330 0x7f8fe0073120 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8fd800efc0 tx=0x7f8fd800c3a0 comp rx=0 tx=0).stop 2023-10-19T12:43:17.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.637+0000 7f8fe7fff700 1 -- 172.21.15.46:0/2489295992 shutdown_connections 2023-10-19T12:43:17.642 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.637+0000 7f8fe7fff700 1 --2- 172.21.15.46:0/2489295992 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8fe0102330 0x7f8fe0073120 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:17.642 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.637+0000 7f8fe7fff700 1 --2- 172.21.15.46:0/2489295992 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f8fcc0a1480 0x7f8fcc0a3940 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:17.642 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.637+0000 7f8fe7fff700 1 --2- 172.21.15.46:0/2489295992 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8fe01007a0 0x7f8fe0074500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:17.642 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.637+0000 7f8fe7fff700 1 --2- 172.21.15.46:0/2489295992 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8fe0101990 0x7f8fe0072be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:17.642 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.637+0000 7f8fe7fff700 1 -- 172.21.15.46:0/2489295992 >> 172.21.15.46:0/2489295992 conn(0x7f8fe00fbcf0 msgr2=0x7f8fe0104e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:17.643 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.638+0000 7f8fe7fff700 1 -- 172.21.15.46:0/2489295992 shutdown_connections 2023-10-19T12:43:17.643 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.638+0000 7f8fe7fff700 1 -- 172.21.15.46:0/2489295992 wait complete. 2023-10-19T12:43:17.660 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-19T12:43:17.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.865+0000 7f85041ff700 1 -- 172.21.15.46:0/432852558 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84fc103be0 msgr2=0x7f84fc105fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:17.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.865+0000 7f85041ff700 1 --2- 172.21.15.46:0/432852558 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84fc103be0 0x7f84fc105fd0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f84ec009990 tx=0x7f84ec009ca0 comp rx=0 tx=0).stop 2023-10-19T12:43:17.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.865+0000 7f85041ff700 1 -- 172.21.15.46:0/432852558 shutdown_connections 2023-10-19T12:43:17.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.865+0000 7f85041ff700 1 --2- 172.21.15.46:0/432852558 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84fc106510 0x7f84fc108900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:17.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.865+0000 7f85041ff700 1 --2- 172.21.15.46:0/432852558 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f84fc1012b0 0x7f84fc1036a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:17.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.865+0000 7f85041ff700 1 --2- 172.21.15.46:0/432852558 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84fc103be0 0x7f84fc105fd0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:17.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.865+0000 7f85041ff700 1 -- 172.21.15.46:0/432852558 >> 172.21.15.46:0/432852558 conn(0x7f84fc0fac00 msgr2=0x7f84fc0fd040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:17.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.865+0000 7f85041ff700 1 -- 172.21.15.46:0/432852558 shutdown_connections 2023-10-19T12:43:17.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.865+0000 7f85041ff700 1 -- 172.21.15.46:0/432852558 wait complete. 2023-10-19T12:43:17.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.866+0000 7f85041ff700 1 Processor -- start 2023-10-19T12:43:17.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.866+0000 7f85041ff700 1 -- start start 2023-10-19T12:43:17.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.866+0000 7f85041ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84fc1012b0 0x7f84fc198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:17.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.866+0000 7f85041ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84fc103be0 0x7f84fc198e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:17.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.866+0000 7f85041ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f84fc106510 0x7f84fc19fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:17.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.866+0000 7f85041ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84fc1a0450 con 0x7f84fc103be0 2023-10-19T12:43:17.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.866+0000 7f85041ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84fc1a0590 con 0x7f84fc1012b0 2023-10-19T12:43:17.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.866+0000 7f85041ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84fc1a0720 con 0x7f84fc106510 2023-10-19T12:43:17.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.867+0000 7f850179a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84fc103be0 0x7f84fc198e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:17.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.867+0000 7f850179a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84fc103be0 0x7f84fc198e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57260/0 (socket says 172.21.15.46:57260) 2023-10-19T12:43:17.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.867+0000 7f850179a700 1 -- 172.21.15.46:0/721226640 learned_addr learned my addr 172.21.15.46:0/721226640 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:43:17.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.867+0000 7f8501f9b700 1 --2- 172.21.15.46:0/721226640 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84fc1012b0 0x7f84fc198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:17.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.867+0000 7f850279c700 1 --2- 172.21.15.46:0/721226640 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f84fc106510 0x7f84fc19fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:17.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.867+0000 7f850179a700 1 -- 172.21.15.46:0/721226640 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f84fc106510 msgr2=0x7f84fc19fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:17.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.867+0000 7f850179a700 1 --2- 172.21.15.46:0/721226640 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f84fc106510 0x7f84fc19fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:17.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.867+0000 7f850179a700 1 -- 172.21.15.46:0/721226640 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84fc1012b0 msgr2=0x7f84fc198920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:17.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.867+0000 7f850179a700 1 --2- 172.21.15.46:0/721226640 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84fc1012b0 0x7f84fc198920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:17.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.867+0000 7f850179a700 1 -- 172.21.15.46:0/721226640 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84ec0095f0 con 0x7f84fc103be0 2023-10-19T12:43:17.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.867+0000 7f850279c700 1 --2- 172.21.15.46:0/721226640 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f84fc106510 0x7f84fc19fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T12:43:17.876 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.867+0000 7f850179a700 1 --2- 172.21.15.46:0/721226640 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84fc103be0 0x7f84fc198e60 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f84ec0098e0 tx=0x7f84ec00f670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:17.876 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.868+0000 7f84f2ffd700 1 -- 172.21.15.46:0/721226640 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84ec01d070 con 0x7f84fc103be0 2023-10-19T12:43:17.876 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.868+0000 7f84f2ffd700 1 -- 172.21.15.46:0/721226640 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f84ec005050 con 0x7f84fc103be0 2023-10-19T12:43:17.876 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.868+0000 7f85041ff700 1 -- 172.21.15.46:0/721226640 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84fc1a09a0 con 0x7f84fc103be0 2023-10-19T12:43:17.876 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.868+0000 7f84f2ffd700 1 -- 172.21.15.46:0/721226640 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84ec004bd0 con 0x7f84fc103be0 2023-10-19T12:43:17.877 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.868+0000 7f85041ff700 1 -- 172.21.15.46:0/721226640 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84fc1a0e20 con 0x7f84fc103be0 2023-10-19T12:43:17.877 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.869+0000 7f85041ff700 1 -- 172.21.15.46:0/721226640 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84fc108090 con 0x7f84fc103be0 2023-10-19T12:43:17.878 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.871+0000 7f84f2ffd700 1 -- 172.21.15.46:0/721226640 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f84ec004d30 con 0x7f84fc103be0 2023-10-19T12:43:17.878 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.873+0000 7f84f2ffd700 1 --2- 172.21.15.46:0/721226640 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f84e80a1500 0x7f84e80a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:17.878 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.873+0000 7f84f2ffd700 1 -- 172.21.15.46:0/721226640 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f84ec0ce390 con 0x7f84fc103be0 2023-10-19T12:43:17.878 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.873+0000 7f8501f9b700 1 --2- 172.21.15.46:0/721226640 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f84e80a1500 0x7f84e80a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:17.879 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.874+0000 7f8501f9b700 1 --2- 172.21.15.46:0/721226640 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f84e80a1500 0x7f84e80a39c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f84f8005950 tx=0x7f84f800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:17.879 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:17.875+0000 7f84f2ffd700 1 -- 172.21.15.46:0/721226640 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f84ec097710 con 0x7f84fc103be0 2023-10-19T12:43:17.978 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:17 smithi046 ceph-mon[98509]: pgmap v345: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-19T12:43:17.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:17 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/1120276363' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-19T12:43:17.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:17 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/2489295992' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-19T12:43:18.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:17 smithi157 ceph-mon[134109]: pgmap v345: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-19T12:43:18.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:17 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/1120276363' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-19T12:43:18.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:17 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/2489295992' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-19T12:43:18.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.092+0000 7f85041ff700 1 -- 172.21.15.46:0/721226640 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f84fc10bfd0 con 0x7f84fc103be0 2023-10-19T12:43:18.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.092+0000 7f84f2ffd700 1 -- 172.21.15.46:0/721226640 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v90) v1 ==== 103+0+11 (secure 0 0 0) 0x7f84ec09ad30 con 0x7f84fc103be0 2023-10-19T12:43:18.096 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2023-10-19T12:43:18.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.095+0000 7f85041ff700 1 -- 172.21.15.46:0/721226640 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f84e80a1500 msgr2=0x7f84e80a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:18.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.095+0000 7f85041ff700 1 --2- 172.21.15.46:0/721226640 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f84e80a1500 0x7f84e80a39c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f84f8005950 tx=0x7f84f800b410 comp rx=0 tx=0).stop 2023-10-19T12:43:18.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.095+0000 7f85041ff700 1 -- 172.21.15.46:0/721226640 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84fc103be0 msgr2=0x7f84fc198e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:18.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.095+0000 7f85041ff700 1 --2- 172.21.15.46:0/721226640 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84fc103be0 0x7f84fc198e60 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f84ec0098e0 tx=0x7f84ec00f670 comp rx=0 tx=0).stop 2023-10-19T12:43:18.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.095+0000 7f85041ff700 1 -- 172.21.15.46:0/721226640 shutdown_connections 2023-10-19T12:43:18.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.095+0000 7f85041ff700 1 --2- 172.21.15.46:0/721226640 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f84e80a1500 0x7f84e80a39c0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:18.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.095+0000 7f85041ff700 1 --2- 172.21.15.46:0/721226640 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f84fc106510 0x7f84fc19fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:18.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.095+0000 7f85041ff700 1 --2- 172.21.15.46:0/721226640 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84fc1012b0 0x7f84fc198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:18.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.095+0000 7f85041ff700 1 --2- 172.21.15.46:0/721226640 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84fc103be0 0x7f84fc198e60 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:18.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.095+0000 7f85041ff700 1 -- 172.21.15.46:0/721226640 >> 172.21.15.46:0/721226640 conn(0x7f84fc0fac00 msgr2=0x7f84fc100ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:18.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.095+0000 7f85041ff700 1 -- 172.21.15.46:0/721226640 shutdown_connections 2023-10-19T12:43:18.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.095+0000 7f85041ff700 1 -- 172.21.15.46:0/721226640 wait complete. 2023-10-19T12:43:18.117 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-19T12:43:18.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:17 smithi195 ceph-mon[134493]: pgmap v345: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-19T12:43:18.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:17 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/1120276363' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-19T12:43:18.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:17 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/2489295992' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-19T12:43:18.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.323+0000 7f95485ff700 1 -- 172.21.15.46:0/2929116805 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95401044e0 msgr2=0x7f954010ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:18.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.323+0000 7f95485ff700 1 --2- 172.21.15.46:0/2929116805 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95401044e0 0x7f954010ad90 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f95380099c0 tx=0x7f9538009cd0 comp rx=0 tx=0).stop 2023-10-19T12:43:18.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.323+0000 7f95485ff700 1 -- 172.21.15.46:0/2929116805 shutdown_connections 2023-10-19T12:43:18.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.323+0000 7f95485ff700 1 --2- 172.21.15.46:0/2929116805 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95401044e0 0x7f954010ad90 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:18.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.323+0000 7f95485ff700 1 --2- 172.21.15.46:0/2929116805 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9540102950 0x7f9540102d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:18.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.323+0000 7f95485ff700 1 --2- 172.21.15.46:0/2929116805 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9540103b40 0x7f9540103fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:18.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.323+0000 7f95485ff700 1 -- 172.21.15.46:0/2929116805 >> 172.21.15.46:0/2929116805 conn(0x7f95400fdec0 msgr2=0x7f9540100300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:18.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.323+0000 7f95485ff700 1 -- 172.21.15.46:0/2929116805 shutdown_connections 2023-10-19T12:43:18.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.323+0000 7f95485ff700 1 -- 172.21.15.46:0/2929116805 wait complete. 2023-10-19T12:43:18.331 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.324+0000 7f95485ff700 1 Processor -- start 2023-10-19T12:43:18.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.325+0000 7f95485ff700 1 -- start start 2023-10-19T12:43:18.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.325+0000 7f95485ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9540102950 0x7f9540198860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:18.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.325+0000 7f95485ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9540103b40 0x7f9540198da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:18.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.325+0000 7f95485ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f95401044e0 0x7f954019fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:18.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.325+0000 7f95485ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95401a0390 con 0x7f9540102950 2023-10-19T12:43:18.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.325+0000 7f95485ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95401a04d0 con 0x7f9540103b40 2023-10-19T12:43:18.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.325+0000 7f95485ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95401a0660 con 0x7f95401044e0 2023-10-19T12:43:18.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.325+0000 7f954639b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9540102950 0x7f9540198860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:18.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.325+0000 7f954639b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9540102950 0x7f9540198860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57282/0 (socket says 172.21.15.46:57282) 2023-10-19T12:43:18.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.325+0000 7f954639b700 1 -- 172.21.15.46:0/1883885978 learned_addr learned my addr 172.21.15.46:0/1883885978 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:43:18.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.326+0000 7f9545b9a700 1 --2- 172.21.15.46:0/1883885978 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9540103b40 0x7f9540198da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:18.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.326+0000 7f9546b9c700 1 --2- 172.21.15.46:0/1883885978 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f95401044e0 0x7f954019fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:18.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.326+0000 7f954639b700 1 -- 172.21.15.46:0/1883885978 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f95401044e0 msgr2=0x7f954019fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:18.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.326+0000 7f954639b700 1 --2- 172.21.15.46:0/1883885978 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f95401044e0 0x7f954019fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:18.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.326+0000 7f954639b700 1 -- 172.21.15.46:0/1883885978 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9540103b40 msgr2=0x7f9540198da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:18.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.326+0000 7f954639b700 1 --2- 172.21.15.46:0/1883885978 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9540103b40 0x7f9540198da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:18.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.326+0000 7f954639b700 1 -- 172.21.15.46:0/1883885978 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95380095f0 con 0x7f9540102950 2023-10-19T12:43:18.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.326+0000 7f9546b9c700 1 --2- 172.21.15.46:0/1883885978 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f95401044e0 0x7f954019fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T12:43:18.336 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.326+0000 7f954639b700 1 --2- 172.21.15.46:0/1883885978 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9540102950 0x7f9540198860 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f953c00efc0 tx=0x7f953c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:18.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.326+0000 7f95377fe700 1 -- 172.21.15.46:0/1883885978 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f953c018070 con 0x7f9540102950 2023-10-19T12:43:18.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.326+0000 7f95377fe700 1 -- 172.21.15.46:0/1883885978 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f953c00f040 con 0x7f9540102950 2023-10-19T12:43:18.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.326+0000 7f95485ff700 1 -- 172.21.15.46:0/1883885978 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95401a08e0 con 0x7f9540102950 2023-10-19T12:43:18.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.326+0000 7f95377fe700 1 -- 172.21.15.46:0/1883885978 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f953c004310 con 0x7f9540102950 2023-10-19T12:43:18.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.326+0000 7f95485ff700 1 -- 172.21.15.46:0/1883885978 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95401a0df0 con 0x7f9540102950 2023-10-19T12:43:18.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.327+0000 7f95485ff700 1 -- 172.21.15.46:0/1883885978 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9540109d00 con 0x7f9540102950 2023-10-19T12:43:18.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.329+0000 7f95377fe700 1 -- 172.21.15.46:0/1883885978 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f953c00ca70 con 0x7f9540102950 2023-10-19T12:43:18.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.331+0000 7f95377fe700 1 --2- 172.21.15.46:0/1883885978 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f952c0a1480 0x7f952c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:18.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.331+0000 7f95377fe700 1 -- 172.21.15.46:0/1883885978 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f953c0ccf70 con 0x7f9540102950 2023-10-19T12:43:18.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.331+0000 7f9545b9a700 1 --2- 172.21.15.46:0/1883885978 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f952c0a1480 0x7f952c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:18.341 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.332+0000 7f9545b9a700 1 --2- 172.21.15.46:0/1883885978 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f952c0a1480 0x7f952c0a3940 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f9530009c60 tx=0x7f9530009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:18.341 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.336+0000 7f95377fe700 1 -- 172.21.15.46:0/1883885978 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f953c0962f0 con 0x7f9540102950 2023-10-19T12:43:18.598 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.595+0000 7f95485ff700 1 -- 172.21.15.46:0/1883885978 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9540067980 con 0x7f9540102950 2023-10-19T12:43:18.599 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.596+0000 7f95377fe700 1 -- 172.21.15.46:0/1883885978 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+11372 (secure 0 0 0) 0x7f953c099910 con 0x7f9540102950 2023-10-19T12:43:18.599 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:43:18.600 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14580,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/2235286008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":2235286008},{"type":"v1","addr":"172.21.15.46:6835","nonce":2235286008}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14592,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/339398444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":339398444},{"type":"v1","addr":"172.21.15.46:6837","nonce":339398444}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-19T12:41:18.815780+0000","modified":"2023-10-19T12:41:47.301944+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24680,"mds_1":24655,"mds_2":24643,"mds_3":24631,"mds_4":24629},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14640":{"gid":14640,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.46:6839/1655843965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":1655843965},{"type":"v1","addr":"172.21.15.46:6839","nonce":1655843965}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14652":{"gid":14652,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.46:6841/4204925553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6840","nonce":4204925553},{"type":"v1","addr":"172.21.15.46:6841","nonce":4204925553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24560":{"gid":24560,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.157:6833/1687745569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":1687745569},{"type":"v1","addr":"172.21.15.157:6833","nonce":1687745569}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24574":{"gid":24574,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.195:6833/3629933235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3629933235},{"type":"v1","addr":"172.21.15.195:6833","nonce":3629933235}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24602":{"gid":24602,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.157:6835/108432552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":108432552},{"type":"v1","addr":"172.21.15.157:6835","nonce":108432552}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24629":{"gid":24629,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":13,"addr":"172.21.15.157:6837/2629536514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6836","nonce":2629536514},{"type":"v1","addr":"172.21.15.157:6837","nonce":2629536514}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24631":{"gid":24631,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.195:6835/1406909915","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":1406909915},{"type":"v1","addr":"172.21.15.195:6835","nonce":1406909915}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24643":{"gid":24643,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":13,"addr":"172.21.15.195:6837/293916188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":293916188},{"type":"v1","addr":"172.21.15.195:6837","nonce":293916188}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24655":{"gid":24655,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":11,"addr":"172.21.15.195:6839/4094901934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6838","nonce":4094901934},{"type":"v1","addr":"172.21.15.195:6839","nonce":4094901934}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24680":{"gid":24680,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.157:6839/552718978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6838","nonce":552718978},{"type":"v1","addr":"172.21.15.157:6839","nonce":552718978}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-19T12:43:18.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.599+0000 7f95485ff700 1 -- 172.21.15.46:0/1883885978 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f952c0a1480 msgr2=0x7f952c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:18.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.599+0000 7f95485ff700 1 --2- 172.21.15.46:0/1883885978 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f952c0a1480 0x7f952c0a3940 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f9530009c60 tx=0x7f9530009260 comp rx=0 tx=0).stop 2023-10-19T12:43:18.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.599+0000 7f95485ff700 1 -- 172.21.15.46:0/1883885978 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9540102950 msgr2=0x7f9540198860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:18.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.599+0000 7f95485ff700 1 --2- 172.21.15.46:0/1883885978 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9540102950 0x7f9540198860 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f953c00efc0 tx=0x7f953c00c3a0 comp rx=0 tx=0).stop 2023-10-19T12:43:18.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.599+0000 7f95485ff700 1 -- 172.21.15.46:0/1883885978 shutdown_connections 2023-10-19T12:43:18.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.599+0000 7f95485ff700 1 --2- 172.21.15.46:0/1883885978 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f952c0a1480 0x7f952c0a3940 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:18.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.599+0000 7f95485ff700 1 --2- 172.21.15.46:0/1883885978 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f95401044e0 0x7f954019fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:18.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.599+0000 7f95485ff700 1 --2- 172.21.15.46:0/1883885978 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9540102950 0x7f9540198860 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:18.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.599+0000 7f95485ff700 1 --2- 172.21.15.46:0/1883885978 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9540103b40 0x7f9540198da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:18.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.599+0000 7f95485ff700 1 -- 172.21.15.46:0/1883885978 >> 172.21.15.46:0/1883885978 conn(0x7f95400fdec0 msgr2=0x7f9540106e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:18.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.599+0000 7f95485ff700 1 -- 172.21.15.46:0/1883885978 shutdown_connections 2023-10-19T12:43:18.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.599+0000 7f95485ff700 1 -- 172.21.15.46:0/1883885978 wait complete. 2023-10-19T12:43:18.605 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 27 2023-10-19T12:43:18.622 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-19T12:43:18.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.825+0000 7f824e7ff700 1 -- 172.21.15.46:0/1069412510 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f82481022d0 msgr2=0x7f8248108b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:18.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.825+0000 7f824e7ff700 1 --2- 172.21.15.46:0/1069412510 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f82481022d0 0x7f8248108b80 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f824000b0d0 tx=0x7f824000b3e0 comp rx=0 tx=0).stop 2023-10-19T12:43:18.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.825+0000 7f824e7ff700 1 -- 172.21.15.46:0/1069412510 shutdown_connections 2023-10-19T12:43:18.830 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.825+0000 7f824e7ff700 1 --2- 172.21.15.46:0/1069412510 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f82481022d0 0x7f8248108b80 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:18.830 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.825+0000 7f824e7ff700 1 --2- 172.21.15.46:0/1069412510 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8248100740 0x7f8248100b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:18.830 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.825+0000 7f824e7ff700 1 --2- 172.21.15.46:0/1069412510 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8248101930 0x7f8248101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:18.830 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.825+0000 7f824e7ff700 1 -- 172.21.15.46:0/1069412510 >> 172.21.15.46:0/1069412510 conn(0x7f82480fbc90 msgr2=0x7f82480fe0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:18.830 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.826+0000 7f824e7ff700 1 -- 172.21.15.46:0/1069412510 shutdown_connections 2023-10-19T12:43:18.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.826+0000 7f824e7ff700 1 -- 172.21.15.46:0/1069412510 wait complete. 2023-10-19T12:43:18.833 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.827+0000 7f824e7ff700 1 Processor -- start 2023-10-19T12:43:18.833 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.827+0000 7f824e7ff700 1 -- start start 2023-10-19T12:43:18.833 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.827+0000 7f824e7ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8248100740 0x7f8248198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:18.833 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.827+0000 7f824e7ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8248101930 0x7f8248198e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:18.833 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.827+0000 7f824e7ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f82481022d0 0x7f824819feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:18.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.827+0000 7f824e7ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82481a0480 con 0x7f8248101930 2023-10-19T12:43:18.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.827+0000 7f824e7ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82481a05c0 con 0x7f82481022d0 2023-10-19T12:43:18.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.827+0000 7f824e7ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82481a0750 con 0x7f8248100740 2023-10-19T12:43:18.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.827+0000 7f82477fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8248101930 0x7f8248198e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:18.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.827+0000 7f82477fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8248101930 0x7f8248198e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57300/0 (socket says 172.21.15.46:57300) 2023-10-19T12:43:18.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.827+0000 7f82477fe700 1 -- 172.21.15.46:0/1267937771 learned_addr learned my addr 172.21.15.46:0/1267937771 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:43:18.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.827+0000 7f8247fff700 1 --2- 172.21.15.46:0/1267937771 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8248100740 0x7f8248198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:18.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.827+0000 7f824cd9c700 1 --2- 172.21.15.46:0/1267937771 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f82481022d0 0x7f824819feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:18.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.828+0000 7f82477fe700 1 -- 172.21.15.46:0/1267937771 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8248100740 msgr2=0x7f8248198950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:18.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.828+0000 7f82477fe700 1 --2- 172.21.15.46:0/1267937771 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8248100740 0x7f8248198950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:18.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.828+0000 7f82477fe700 1 -- 172.21.15.46:0/1267937771 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f82481022d0 msgr2=0x7f824819feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:18.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.828+0000 7f82477fe700 1 --2- 172.21.15.46:0/1267937771 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f82481022d0 0x7f824819feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:18.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.828+0000 7f82477fe700 1 -- 172.21.15.46:0/1267937771 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8240009d00 con 0x7f8248101930 2023-10-19T12:43:18.838 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.828+0000 7f82477fe700 1 --2- 172.21.15.46:0/1267937771 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8248101930 0x7f8248198e90 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f823c00e9a0 tx=0x7f823c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:18.838 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.828+0000 7f82457fa700 1 -- 172.21.15.46:0/1267937771 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f823c009790 con 0x7f8248101930 2023-10-19T12:43:18.838 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.828+0000 7f82457fa700 1 -- 172.21.15.46:0/1267937771 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f823c010430 con 0x7f8248101930 2023-10-19T12:43:18.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.828+0000 7f82457fa700 1 -- 172.21.15.46:0/1267937771 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f823c018680 con 0x7f8248101930 2023-10-19T12:43:18.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.828+0000 7f824e7ff700 1 -- 172.21.15.46:0/1267937771 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82481a0a30 con 0x7f8248101930 2023-10-19T12:43:18.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.828+0000 7f824e7ff700 1 -- 172.21.15.46:0/1267937771 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82481a0ef0 con 0x7f8248101930 2023-10-19T12:43:18.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.829+0000 7f824e7ff700 1 -- 172.21.15.46:0/1267937771 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f824810bfb0 con 0x7f8248101930 2023-10-19T12:43:18.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.831+0000 7f82457fa700 1 -- 172.21.15.46:0/1267937771 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f823c0105a0 con 0x7f8248101930 2023-10-19T12:43:18.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.833+0000 7f82457fa700 1 --2- 172.21.15.46:0/1267937771 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f82300a1500 0x7f82300a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:18.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.833+0000 7f82457fa700 1 -- 172.21.15.46:0/1267937771 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f823c014070 con 0x7f8248101930 2023-10-19T12:43:18.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.833+0000 7f8247fff700 1 --2- 172.21.15.46:0/1267937771 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f82300a1500 0x7f82300a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:18.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.834+0000 7f8247fff700 1 --2- 172.21.15.46:0/1267937771 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f82300a1500 0x7f82300a39c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f8248101790 tx=0x7f8238009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:18.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:18.837+0000 7f82457fa700 1 -- 172.21.15.46:0/1267937771 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f823c0964b0 con 0x7f8248101930 2023-10-19T12:43:18.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:18 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/721226640' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-19T12:43:18.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:18 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/1883885978' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-19T12:43:19.055 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.052+0000 7f824e7ff700 1 -- 172.21.15.46:0/1267937771 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f824810c190 con 0x7f8248101930 2023-10-19T12:43:19.056 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.053+0000 7f82457fa700 1 -- 172.21.15.46:0/1267937771 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+24481 (secure 0 0 0) 0x7f823c099ad0 con 0x7f8248101930 2023-10-19T12:43:19.057 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:43:19.057 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":90,"fsid":"96a8be3c-6e7b-11ee-8db6-212e2dc638e7","created":"2023-10-19T12:33:26.148713+0000","modified":"2023-10-19T12:42:28.113339+0000","last_up_change":"2023-10-19T12:40:30.761679+0000","last_in_change":"2023-10-19T12:40:13.663559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-19T12:37:07.175795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-19T12:41:16.895203+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-19T12:41:18.255601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-19T12:41:21.830455+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"346ce86b-a10a-4869-9fdb-c3c1d4161455","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6803","nonce":500237995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6805","nonce":500237995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6809","nonce":500237995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6807","nonce":500237995}]},"public_addr":"172.21.15.46:6803/500237995","cluster_addr":"172.21.15.46:6805/500237995","heartbeat_back_addr":"172.21.15.46:6809/500237995","heartbeat_front_addr":"172.21.15.46:6807/500237995","state":["exists","up"]},{"osd":1,"uuid":"02aae687-76c5-4124-bae4-9787ed571c28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6801","nonce":2496862790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6803","nonce":2496862790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6807","nonce":2496862790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6805","nonce":2496862790}]},"public_addr":"172.21.15.157:6801/2496862790","cluster_addr":"172.21.15.157:6803/2496862790","heartbeat_back_addr":"172.21.15.157:6807/2496862790","heartbeat_front_addr":"172.21.15.157:6805/2496862790","state":["exists","up"]},{"osd":2,"uuid":"d5360828-1f58-4380-b2ad-0c21ff850981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6801","nonce":4211767276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6803","nonce":4211767276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6807","nonce":4211767276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6805","nonce":4211767276}]},"public_addr":"172.21.15.195:6801/4211767276","cluster_addr":"172.21.15.195:6803/4211767276","heartbeat_back_addr":"172.21.15.195:6807/4211767276","heartbeat_front_addr":"172.21.15.195:6805/4211767276","state":["exists","up"]},{"osd":3,"uuid":"accb780f-49d0-43f8-b166-ee12c558ef00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6811","nonce":1964113352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6813","nonce":1964113352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6817","nonce":1964113352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6815","nonce":1964113352}]},"public_addr":"172.21.15.46:6811/1964113352","cluster_addr":"172.21.15.46:6813/1964113352","heartbeat_back_addr":"172.21.15.46:6817/1964113352","heartbeat_front_addr":"172.21.15.46:6815/1964113352","state":["exists","up"]},{"osd":4,"uuid":"e662886d-e989-4d02-8c1f-3c4671352b0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6809","nonce":3636910144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6811","nonce":3636910144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6815","nonce":3636910144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6813","nonce":3636910144}]},"public_addr":"172.21.15.157:6809/3636910144","cluster_addr":"172.21.15.157:6811/3636910144","heartbeat_back_addr":"172.21.15.157:6815/3636910144","heartbeat_front_addr":"172.21.15.157:6813/3636910144","state":["exists","up"]},{"osd":5,"uuid":"9597e0ce-14ea-407d-90fe-f74bccee38b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6809","nonce":4071287969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6811","nonce":4071287969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6815","nonce":4071287969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6813","nonce":4071287969}]},"public_addr":"172.21.15.195:6809/4071287969","cluster_addr":"172.21.15.195:6811/4071287969","heartbeat_back_addr":"172.21.15.195:6815/4071287969","heartbeat_front_addr":"172.21.15.195:6813/4071287969","state":["exists","up"]},{"osd":6,"uuid":"6b78ba38-f60e-4cb6-b01c-cecc1820e8e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6819","nonce":1842285555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6821","nonce":1842285555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6825","nonce":1842285555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6823","nonce":1842285555}]},"public_addr":"172.21.15.46:6819/1842285555","cluster_addr":"172.21.15.46:6821/1842285555","heartbeat_back_addr":"172.21.15.46:6825/1842285555","heartbeat_front_addr":"172.21.15.46:6823/1842285555","state":["exists","up"]},{"osd":7,"uuid":"59a0899f-3bcd-4db2-b544-24df3a536749","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6817","nonce":3498672588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6819","nonce":3498672588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6823","nonce":3498672588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6821","nonce":3498672588}]},"public_addr":"172.21.15.157:6817/3498672588","cluster_addr":"172.21.15.157:6819/3498672588","heartbeat_back_addr":"172.21.15.157:6823/3498672588","heartbeat_front_addr":"172.21.15.157:6821/3498672588","state":["exists","up"]},{"osd":8,"uuid":"9c3c9835-043a-4fb5-a9ee-edf8caf6b605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6817","nonce":74230104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6819","nonce":74230104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6823","nonce":74230104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6821","nonce":74230104}]},"public_addr":"172.21.15.195:6817/74230104","cluster_addr":"172.21.15.195:6819/74230104","heartbeat_back_addr":"172.21.15.195:6823/74230104","heartbeat_front_addr":"172.21.15.195:6821/74230104","state":["exists","up"]},{"osd":9,"uuid":"3f18f506-a577-4b7c-ae0d-9351c07e81f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6827","nonce":3472581046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6829","nonce":3472581046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6833","nonce":3472581046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6831","nonce":3472581046}]},"public_addr":"172.21.15.46:6827/3472581046","cluster_addr":"172.21.15.46:6829/3472581046","heartbeat_back_addr":"172.21.15.46:6833/3472581046","heartbeat_front_addr":"172.21.15.46:6831/3472581046","state":["exists","up"]},{"osd":10,"uuid":"1ed01854-443a-4acf-9293-7ca0d451a93d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6825","nonce":2378416559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6827","nonce":2378416559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6831","nonce":2378416559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6829","nonce":2378416559}]},"public_addr":"172.21.15.157:6825/2378416559","cluster_addr":"172.21.15.157:6827/2378416559","heartbeat_back_addr":"172.21.15.157:6831/2378416559","heartbeat_front_addr":"172.21.15.157:6829/2378416559","state":["exists","up"]},{"osd":11,"uuid":"021398c0-9184-4647-8220-e40f6705ca90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6825","nonce":3075632222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6827","nonce":3075632222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6831","nonce":3075632222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6829","nonce":3075632222}]},"public_addr":"172.21.15.195:6825/3075632222","cluster_addr":"172.21.15.195:6827/3075632222","heartbeat_back_addr":"172.21.15.195:6831/3075632222","heartbeat_front_addr":"172.21.15.195:6829/3075632222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:36:22.002614+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:36:44.098031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:37:04.518341+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:37:30.796462+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:37:52.756555+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:38:13.403168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:38:39.058472+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:39:01.106893+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:39:21.908334+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:39:46.843884+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:40:08.792020+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:40:29.282974+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":3,"to":6}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.39","mappings":[{"from":5,"to":8}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.46:0/3248595150":"2023-10-20T12:34:26.552115+0000","172.21.15.46:0/3624849341":"2023-10-20T12:34:26.552115+0000","172.21.15.46:0/1844094590":"2023-10-20T12:34:26.552115+0000","172.21.15.46:6801/20022894":"2023-10-20T12:34:26.552115+0000","172.21.15.46:0/3969790632":"2023-10-20T12:34:00.135248+0000","172.21.15.46:0/2331135821":"2023-10-20T12:34:00.135248+0000","172.21.15.46:6800/51664346":"2023-10-20T12:34:00.135248+0000","172.21.15.46:6801/51664346":"2023-10-20T12:34:00.135248+0000","172.21.15.46:0/585851467":"2023-10-20T12:34:00.135248+0000","172.21.15.46:6800/20022894":"2023-10-20T12:34:26.552115+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-19T12:43:19.059 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.056+0000 7f824e7ff700 1 -- 172.21.15.46:0/1267937771 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f82300a1500 msgr2=0x7f82300a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:19.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.056+0000 7f824e7ff700 1 --2- 172.21.15.46:0/1267937771 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f82300a1500 0x7f82300a39c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f8248101790 tx=0x7f8238009260 comp rx=0 tx=0).stop 2023-10-19T12:43:19.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.056+0000 7f824e7ff700 1 -- 172.21.15.46:0/1267937771 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8248101930 msgr2=0x7f8248198e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:19.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.056+0000 7f824e7ff700 1 --2- 172.21.15.46:0/1267937771 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8248101930 0x7f8248198e90 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f823c00e9a0 tx=0x7f823c00ecb0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.056+0000 7f824e7ff700 1 -- 172.21.15.46:0/1267937771 shutdown_connections 2023-10-19T12:43:19.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.056+0000 7f824e7ff700 1 --2- 172.21.15.46:0/1267937771 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f82481022d0 0x7f824819feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.056+0000 7f824e7ff700 1 --2- 172.21.15.46:0/1267937771 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f82300a1500 0x7f82300a39c0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.056+0000 7f824e7ff700 1 --2- 172.21.15.46:0/1267937771 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8248100740 0x7f8248198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.056+0000 7f824e7ff700 1 --2- 172.21.15.46:0/1267937771 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8248101930 0x7f8248198e90 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.056+0000 7f824e7ff700 1 -- 172.21.15.46:0/1267937771 >> 172.21.15.46:0/1267937771 conn(0x7f82480fbc90 msgr2=0x7f8248072a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:19.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.056+0000 7f824e7ff700 1 -- 172.21.15.46:0/1267937771 shutdown_connections 2023-10-19T12:43:19.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.056+0000 7f824e7ff700 1 -- 172.21.15.46:0/1267937771 wait complete. 2023-10-19T12:43:19.080 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2023-10-19T12:41:18.815780+0000', 'modified': '2023-10-19T12:41:47.301944+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24680, 'mds_1': 24655, 'mds_2': 24643, 'mds_3': 24631, 'mds_4': 24629}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14640': {'gid': 14640, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.46:6839/1655843965', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.46:6838', 'nonce': 1655843965}, {'type': 'v1', 'addr': '172.21.15.46:6839', 'nonce': 1655843965}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_14652': {'gid': 14652, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.46:6841/4204925553', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.46:6840', 'nonce': 4204925553}, {'type': 'v1', 'addr': '172.21.15.46:6841', 'nonce': 4204925553}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24560': {'gid': 24560, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.157:6833/1687745569', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6832', 'nonce': 1687745569}, {'type': 'v1', 'addr': '172.21.15.157:6833', 'nonce': 1687745569}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24574': {'gid': 24574, 'name': 'l', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.195:6833/3629933235', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.195:6832', 'nonce': 3629933235}, {'type': 'v1', 'addr': '172.21.15.195:6833', 'nonce': 3629933235}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24602': {'gid': 24602, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.157:6835/108432552', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6834', 'nonce': 108432552}, {'type': 'v1', 'addr': '172.21.15.157:6835', 'nonce': 108432552}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24629': {'gid': 24629, 'name': 'h', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.157:6837/2629536514', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6836', 'nonce': 2629536514}, {'type': 'v1', 'addr': '172.21.15.157:6837', 'nonce': 2629536514}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24631': {'gid': 24631, 'name': 'f', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 14, 'addr': '172.21.15.195:6835/1406909915', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.195:6834', 'nonce': 1406909915}, {'type': 'v1', 'addr': '172.21.15.195:6835', 'nonce': 1406909915}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24643': {'gid': 24643, 'name': 'c', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.195:6837/293916188', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.195:6836', 'nonce': 293916188}, {'type': 'v1', 'addr': '172.21.15.195:6837', 'nonce': 293916188}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24655': {'gid': 24655, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.195:6839/4094901934', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.195:6838', 'nonce': 4094901934}, {'type': 'v1', 'addr': '172.21.15.195:6839', 'nonce': 4094901934}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24680': {'gid': 24680, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.157:6839/552718978', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6838', 'nonce': 552718978}, {'type': 'v1', 'addr': '172.21.15.157:6839', 'nonce': 552718978}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-19T12:43:19.080 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2023-10-19T12:43:19.081 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.h status 2023-10-19T12:43:19.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:18 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/721226640' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-19T12:43:19.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:18 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/1883885978' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-19T12:43:19.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:18 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/721226640' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-19T12:43:19.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:18 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/1883885978' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-19T12:43:19.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.284+0000 7f4379fff700 1 -- 172.21.15.46:0/454935941 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43740747d0 msgr2=0x7f4374072c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:19.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.284+0000 7f4379fff700 1 --2- 172.21.15.46:0/454935941 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43740747d0 0x7f4374072c20 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4364009990 tx=0x7f4364009ca0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.284+0000 7f4379fff700 1 -- 172.21.15.46:0/454935941 shutdown_connections 2023-10-19T12:43:19.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.284+0000 7f4379fff700 1 --2- 172.21.15.46:0/454935941 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f43741085f0 0x7f437410aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.284+0000 7f4379fff700 1 --2- 172.21.15.46:0/454935941 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43740747d0 0x7f4374072c20 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.284+0000 7f4379fff700 1 --2- 172.21.15.46:0/454935941 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f43740731f0 0x7f4374073670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.284+0000 7f4379fff700 1 -- 172.21.15.46:0/454935941 >> 172.21.15.46:0/454935941 conn(0x7f43740fbc90 msgr2=0x7f43740fe0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:19.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.284+0000 7f4379fff700 1 -- 172.21.15.46:0/454935941 shutdown_connections 2023-10-19T12:43:19.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.284+0000 7f4379fff700 1 -- 172.21.15.46:0/454935941 wait complete. 2023-10-19T12:43:19.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.285+0000 7f4379fff700 1 Processor -- start 2023-10-19T12:43:19.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.285+0000 7f4379fff700 1 -- start start 2023-10-19T12:43:19.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.286+0000 7f4379fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43740731f0 0x7f4374198860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:19.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.286+0000 7f4379fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f43740747d0 0x7f4374198da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:19.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.286+0000 7f4379fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f43741085f0 0x7f437419fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:19.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.286+0000 7f4379fff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43741a0390 con 0x7f43740747d0 2023-10-19T12:43:19.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.286+0000 7f4379fff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43741a04d0 con 0x7f43741085f0 2023-10-19T12:43:19.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.286+0000 7f4379fff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43741a0660 con 0x7f43740731f0 2023-10-19T12:43:19.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.286+0000 7f43737fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43740731f0 0x7f4374198860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:19.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.286+0000 7f4372ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f43740747d0 0x7f4374198da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:19.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.286+0000 7f43737fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43740731f0 0x7f4374198860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:53958/0 (socket says 172.21.15.46:53958) 2023-10-19T12:43:19.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.286+0000 7f43737fe700 1 -- 172.21.15.46:0/976109578 learned_addr learned my addr 172.21.15.46:0/976109578 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:43:19.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.286+0000 7f4373fff700 1 --2- 172.21.15.46:0/976109578 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f43741085f0 0x7f437419fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:19.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.286+0000 7f43737fe700 1 -- 172.21.15.46:0/976109578 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f43741085f0 msgr2=0x7f437419fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:19.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.286+0000 7f43737fe700 1 --2- 172.21.15.46:0/976109578 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f43741085f0 0x7f437419fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.286+0000 7f43737fe700 1 -- 172.21.15.46:0/976109578 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f43740747d0 msgr2=0x7f4374198da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:19.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.286+0000 7f43737fe700 1 --2- 172.21.15.46:0/976109578 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f43740747d0 0x7f4374198da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.286+0000 7f43737fe700 1 -- 172.21.15.46:0/976109578 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4368009520 con 0x7f43740731f0 2023-10-19T12:43:19.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.286+0000 7f4373fff700 1 --2- 172.21.15.46:0/976109578 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f43741085f0 0x7f437419fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T12:43:19.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.287+0000 7f43737fe700 1 --2- 172.21.15.46:0/976109578 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43740731f0 0x7f4374198860 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f436400b680 tx=0x7f4364009580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:19.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.287+0000 7f4370ff9700 1 -- 172.21.15.46:0/976109578 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436401d070 con 0x7f43740731f0 2023-10-19T12:43:19.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.287+0000 7f4370ff9700 1 -- 172.21.15.46:0/976109578 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4364022470 con 0x7f43740731f0 2023-10-19T12:43:19.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.287+0000 7f4379fff700 1 -- 172.21.15.46:0/976109578 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43640095f0 con 0x7f43740731f0 2023-10-19T12:43:19.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.287+0000 7f4370ff9700 1 -- 172.21.15.46:0/976109578 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4364017650 con 0x7f43740731f0 2023-10-19T12:43:19.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.287+0000 7f4379fff700 1 -- 172.21.15.46:0/976109578 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43741a0bd0 con 0x7f43740731f0 2023-10-19T12:43:19.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.291+0000 7f4370ff9700 1 -- 172.21.15.46:0/976109578 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f4364022870 con 0x7f43740731f0 2023-10-19T12:43:19.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.292+0000 7f438da00b80 1 Processor -- start 2023-10-19T12:43:19.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.292+0000 7f438da00b80 1 -- start start 2023-10-19T12:43:19.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.293+0000 7f438da00b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55739cc8b280 0x55739cc8b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:19.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.293+0000 7f438da00b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55739cc8bbe0 0x55739cc8a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:19.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.293+0000 7f438da00b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55739cc8a580 0x55739cc8aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:19.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.293+0000 7f438da00b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55739cbfd690 con 0x55739cc8bbe0 2023-10-19T12:43:19.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.293+0000 7f438da00b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55739cbe3c10 con 0x55739cc8b280 2023-10-19T12:43:19.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.293+0000 7f438da00b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55739cbe1530 con 0x55739cc8a580 2023-10-19T12:43:19.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.293+0000 7f4370ff9700 1 --2- 172.21.15.46:0/976109578 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f435c0a1500 0x7f435c0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:19.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.293+0000 7f4372ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55739cc8a580 0x55739cc8aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:19.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.293+0000 7f4372ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55739cc8a580 0x55739cc8aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:53960/0 (socket says 172.21.15.46:53960) 2023-10-19T12:43:19.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.293+0000 7f4372ffd700 1 -- 172.21.15.46:0/3964399688 learned_addr learned my addr 172.21.15.46:0/3964399688 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:43:19.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.293+0000 7f43737fe700 1 --2- 172.21.15.46:0/3964399688 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55739cc8bbe0 0x55739cc8a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:19.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.293+0000 7f4373fff700 1 --2- 172.21.15.46:0/976109578 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f435c0a1500 0x7f435c0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:19.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.293+0000 7f4370ff9700 1 -- 172.21.15.46:0/976109578 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f43640ce390 con 0x7f43740731f0 2023-10-19T12:43:19.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.294+0000 7f4373fff700 1 --2- 172.21.15.46:0/3964399688 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55739cc8b280 0x55739cc8b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:19.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.294+0000 7f4372ffd700 1 -- 172.21.15.46:0/3964399688 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55739cc8b280 msgr2=0x55739cc8b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:43:19.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.294+0000 7f4372ffd700 1 --2- 172.21.15.46:0/3964399688 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55739cc8b280 0x55739cc8b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.294+0000 7f4372ffd700 1 -- 172.21.15.46:0/3964399688 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55739cc8bbe0 msgr2=0x55739cc8a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:43:19.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.294+0000 7f4372ffd700 1 --2- 172.21.15.46:0/3964399688 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55739cc8bbe0 0x55739cc8a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.294+0000 7f4372ffd700 1 -- 172.21.15.46:0/3964399688 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55739cb9a3a0 con 0x55739cc8a580 2023-10-19T12:43:19.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.294+0000 7f4372ffd700 1 --2- 172.21.15.46:0/3964399688 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55739cc8a580 0x55739cc8aa00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4368009f10 tx=0x7f4368011720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c5a929c7b34a8568 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:19.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.294+0000 7f4373fff700 1 --2- 172.21.15.46:0/976109578 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f435c0a1500 0x7f435c0a39c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f436c007920 tx=0x7f436c009920 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:19.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.296+0000 7f4359ffb700 1 -- 172.21.15.46:0/3964399688 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4368019630 con 0x55739cc8a580 2023-10-19T12:43:19.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.296+0000 7f4359ffb700 1 -- 172.21.15.46:0/3964399688 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4368019c50 con 0x55739cc8a580 2023-10-19T12:43:19.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.296+0000 7f4359ffb700 1 -- 172.21.15.46:0/3964399688 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436800ecd0 con 0x55739cc8a580 2023-10-19T12:43:19.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.297+0000 7f438da00b80 1 -- 172.21.15.46:0/3964399688 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55739cc8a580 msgr2=0x55739cc8aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:19.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.297+0000 7f438da00b80 1 --2- 172.21.15.46:0/3964399688 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55739cc8a580 0x55739cc8aa00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4368009f10 tx=0x7f4368011720 comp rx=0 tx=0).stop 2023-10-19T12:43:19.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.297+0000 7f438da00b80 1 -- 172.21.15.46:0/3964399688 shutdown_connections 2023-10-19T12:43:19.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.297+0000 7f438da00b80 1 --2- 172.21.15.46:0/3964399688 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55739cc8a580 0x55739cc8aa00 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.297+0000 7f438da00b80 1 --2- 172.21.15.46:0/3964399688 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55739cc8b280 0x55739cc8b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.297+0000 7f438da00b80 1 --2- 172.21.15.46:0/3964399688 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55739cc8bbe0 0x55739cc8a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.297+0000 7f438da00b80 1 -- 172.21.15.46:0/3964399688 >> 172.21.15.46:0/3964399688 conn(0x55739cbfe6d0 msgr2=0x55739cc84b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:19.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.297+0000 7f438da00b80 1 -- 172.21.15.46:0/3964399688 shutdown_connections 2023-10-19T12:43:19.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.297+0000 7f438da00b80 1 -- 172.21.15.46:0/3964399688 wait complete. 2023-10-19T12:43:19.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.298+0000 7f438da00b80 1 -- start start 2023-10-19T12:43:19.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.298+0000 7f438da00b80 1 Processor -- start 2023-10-19T12:43:19.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.298+0000 7f438da00b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55739cc8a580 0x55739cc93ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:19.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.298+0000 7f438da00b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55739cc8b280 0x55739cc93ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:19.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.298+0000 7f438da00b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55739cc8bbe0 0x55739cc9b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:19.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.298+0000 7f438da00b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55739cbdce20 con 0x55739cc8b280 2023-10-19T12:43:19.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.298+0000 7f438da00b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55739cb796c0 con 0x55739cc8a580 2023-10-19T12:43:19.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.298+0000 7f438da00b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55739cb79360 con 0x55739cc8bbe0 2023-10-19T12:43:19.310 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.298+0000 7f438da00b80 10 client.0 _ll_register_callbacks cb 0x55739cac3a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:43:19.311 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.299+0000 7f4373fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55739cc8bbe0 0x55739cc9b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:19.311 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.299+0000 7f43737fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55739cc8a580 0x55739cc93ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:19.311 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.299+0000 7f4372ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55739cc8b280 0x55739cc93ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:19.311 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.299+0000 7f43737fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55739cc8a580 0x55739cc93ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:54084/0 (socket says 172.21.15.46:54084) 2023-10-19T12:43:19.311 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.299+0000 7f4373fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55739cc8bbe0 0x55739cc9b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:53972/0 (socket says 172.21.15.46:53972) 2023-10-19T12:43:19.311 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.299+0000 7f43737fe700 1 -- 172.21.15.46:0/1012418381 learned_addr learned my addr 172.21.15.46:0/1012418381 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:43:19.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.299+0000 7f4372ffd700 1 -- 172.21.15.46:0/1012418381 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55739cc8bbe0 msgr2=0x55739cc9b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:43:19.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.299+0000 7f4372ffd700 1 --2- 172.21.15.46:0/1012418381 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55739cc8bbe0 0x55739cc9b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.299+0000 7f4372ffd700 1 -- 172.21.15.46:0/1012418381 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55739cc8a580 msgr2=0x55739cc93ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:43:19.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.299+0000 7f4372ffd700 1 --2- 172.21.15.46:0/1012418381 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55739cc8a580 0x55739cc93ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.299+0000 7f4372ffd700 1 -- 172.21.15.46:0/1012418381 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4368009b70 con 0x55739cc8b280 2023-10-19T12:43:19.314 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.299+0000 7f4372ffd700 1 --2- 172.21.15.46:0/1012418381 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55739cc8b280 0x55739cc93ff0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f4368011a70 tx=0x7f4368005dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d6d818f2af4523b server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:19.315 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.300+0000 7f4352ffd700 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2023-10-19T12:43:19.315 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.300+0000 7f4352ffd700 1 -- 172.21.15.46:0/1012418381 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4368019840 con 0x55739cc8b280 2023-10-19T12:43:19.315 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.300+0000 7f438da00b80 1 -- 172.21.15.46:0/1012418381 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55739cbe1ea0 con 0x55739cc8b280 2023-10-19T12:43:19.315 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.300+0000 7f4352ffd700 1 -- 172.21.15.46:0/1012418381 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f436800e3b0 con 0x55739cc8b280 2023-10-19T12:43:19.315 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.300+0000 7f4352ffd700 1 -- 172.21.15.46:0/1012418381 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f436800eea0 con 0x55739cc8b280 2023-10-19T12:43:19.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.300+0000 7f438da00b80 10 client.15441 fetch_fsmap learned FSMap version 27 2023-10-19T12:43:19.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.300+0000 7f438da00b80 1 -- 172.21.15.46:0/1012418381 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55739ca07d90 con 0x55739cc8b280 2023-10-19T12:43:19.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.301+0000 7f4352ffd700 1 -- 172.21.15.46:0/1012418381 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55739cbe1ea0 con 0x55739cc8b280 2023-10-19T12:43:19.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.301+0000 7f4352ffd700 1 -- 172.21.15.46:0/1012418381 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f4368005480 con 0x55739cc8b280 2023-10-19T12:43:19.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.301+0000 7f438da00b80 10 client.15441 fetch_fsmap finished waiting for FSMap version 27 2023-10-19T12:43:19.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.301+0000 7f438da00b80 10 client.15441 resolve_mds: resolved name 'h' to daemon mds.h 2023-10-19T12:43:19.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.301+0000 7f438da00b80 20 client.15441 populate_metadata read hostname 'smithi046' 2023-10-19T12:43:19.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.301+0000 7f438da00b80 1 --2- 172.21.15.46:0/1012418381 >> [v2:172.21.15.157:6836/2629536514,v1:172.21.15.157:6837/2629536514] conn(0x55739cc9f5b0 0x55739cc9e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:19.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.301+0000 7f438da00b80 4 client.15441 mds_command: new command op to 24629 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-19T12:43:19.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.301+0000 7f438da00b80 1 -- 172.21.15.46:0/1012418381 --> [v2:172.21.15.157:6836/2629536514,v1:172.21.15.157:6837/2629536514] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55739cc59860 con 0x55739cc9f5b0 2023-10-19T12:43:19.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.302+0000 7f43737fe700 1 --2- 172.21.15.46:0/1012418381 >> [v2:172.21.15.157:6836/2629536514,v1:172.21.15.157:6837/2629536514] conn(0x55739cc9f5b0 0x55739cc9e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:19.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.302+0000 7f43737fe700 1 --2- 172.21.15.46:0/1012418381 >> [v2:172.21.15.157:6836/2629536514,v1:172.21.15.157:6837/2629536514] conn(0x55739cc9f5b0 0x55739cc9e0c0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=fa3ae1f8f6ab8fc9 server_cookie=818c9c89e6c1ecac in_seq=0 out_seq=0 2023-10-19T12:43:19.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.302+0000 7f4352ffd700 10 client.15441 ms_handle_connect on v2:172.21.15.157:6836/2629536514 2023-10-19T12:43:19.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.303+0000 7f4352ffd700 1 -- 172.21.15.46:0/1012418381 <== mds.4 v2:172.21.15.157:6836/2629536514 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55739cc59860 con 0x55739cc9f5b0 2023-10-19T12:43:19.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.303+0000 7f4352ffd700 10 client.15441 handle_command_reply: tid=0 2023-10-19T12:43:19.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.303+0000 7f438da00b80 1 client.15441 shutdown 2023-10-19T12:43:19.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.303+0000 7f438da00b80 1 -- 172.21.15.46:0/1012418381 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55739cc8b280 msgr2=0x55739cc93ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:19.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.303+0000 7f438da00b80 1 --2- 172.21.15.46:0/1012418381 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55739cc8b280 0x55739cc93ff0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f4368011a70 tx=0x7f4368005dc0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.303+0000 7f438da00b80 1 -- 172.21.15.46:0/1012418381 shutdown_connections 2023-10-19T12:43:19.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.303+0000 7f438da00b80 1 --2- 172.21.15.46:0/1012418381 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55739cc8bbe0 0x55739cc9b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.303+0000 7f438da00b80 1 --2- 172.21.15.46:0/1012418381 >> [v2:172.21.15.157:6836/2629536514,v1:172.21.15.157:6837/2629536514] conn(0x55739cc9f5b0 0x55739cc9e0c0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.303+0000 7f438da00b80 1 --2- 172.21.15.46:0/1012418381 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55739cc8a580 0x55739cc93ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.304+0000 7f438da00b80 1 --2- 172.21.15.46:0/1012418381 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55739cc8b280 0x55739cc93ff0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.304+0000 7f438da00b80 1 -- 172.21.15.46:0/1012418381 >> 172.21.15.46:0/1012418381 conn(0x55739cbfe6d0 msgr2=0x55739cc84ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:19.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.304+0000 7f4352ffd700 0 client.15441 ms_handle_reset on v2:172.21.15.157:6836/2629536514 2023-10-19T12:43:19.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.304+0000 7f438da00b80 1 -- 172.21.15.46:0/1012418381 shutdown_connections 2023-10-19T12:43:19.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.304+0000 7f438da00b80 1 -- 172.21.15.46:0/1012418381 wait complete. 2023-10-19T12:43:19.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.304+0000 7f438da00b80 20 client.15441 trim_cache size 0 max 16384 2023-10-19T12:43:19.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.322+0000 7f438da00b80 1 Processor -- start 2023-10-19T12:43:19.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.322+0000 7f438da00b80 1 -- start start 2023-10-19T12:43:19.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.323+0000 7f438da00b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55739cc8a580 0x55739cc8a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:19.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.323+0000 7f438da00b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55739cc8b280 0x55739cc9aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:19.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.323+0000 7f438da00b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55739cc8bbe0 0x55739cc7f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:19.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.323+0000 7f438da00b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55739ca5d8d0 con 0x55739cc8bbe0 2023-10-19T12:43:19.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.323+0000 7f438da00b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55739cb834d0 con 0x55739cc8b280 2023-10-19T12:43:19.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.323+0000 7f438da00b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55739cc93620 con 0x55739cc8a580 2023-10-19T12:43:19.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.323+0000 7f4373fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55739cc8bbe0 0x55739cc7f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:19.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.323+0000 7f43737fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55739cc8a580 0x55739cc8a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:19.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.323+0000 7f4373fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55739cc8bbe0 0x55739cc7f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57338/0 (socket says 172.21.15.46:57338) 2023-10-19T12:43:19.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.323+0000 7f4373fff700 1 -- 172.21.15.46:0/1900816210 learned_addr learned my addr 172.21.15.46:0/1900816210 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:43:19.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.323+0000 7f4372ffd700 1 --2- 172.21.15.46:0/1900816210 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55739cc8b280 0x55739cc9aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:19.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.323+0000 7f43737fe700 1 -- 172.21.15.46:0/1900816210 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55739cc8b280 msgr2=0x55739cc9aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:43:19.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.323+0000 7f43737fe700 1 --2- 172.21.15.46:0/1900816210 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55739cc8b280 0x55739cc9aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.336 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.323+0000 7f43737fe700 1 -- 172.21.15.46:0/1900816210 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55739cc8bbe0 msgr2=0x55739cc7f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:43:19.336 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.323+0000 7f43737fe700 1 --2- 172.21.15.46:0/1900816210 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55739cc8bbe0 0x55739cc7f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.336 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.323+0000 7f43737fe700 1 -- 172.21.15.46:0/1900816210 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55739c9f0c10 con 0x55739cc8a580 2023-10-19T12:43:19.336 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.324+0000 7f43737fe700 1 --2- 172.21.15.46:0/1900816210 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55739cc8a580 0x55739cc8a040 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f43640ce5f0 tx=0x7f43640285f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b348fb882bdb4dc server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:19.336 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.324+0000 7f435a7fc700 1 -- 172.21.15.46:0/1900816210 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436409bad0 con 0x55739cc8a580 2023-10-19T12:43:19.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.324+0000 7f435a7fc700 1 -- 172.21.15.46:0/1900816210 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f43640a36d0 con 0x55739cc8a580 2023-10-19T12:43:19.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.324+0000 7f435a7fc700 1 -- 172.21.15.46:0/1900816210 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4364099580 con 0x55739cc8a580 2023-10-19T12:43:19.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.325+0000 7f438da00b80 1 -- 172.21.15.46:0/1900816210 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55739cc8a580 msgr2=0x55739cc8a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:19.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.325+0000 7f438da00b80 1 --2- 172.21.15.46:0/1900816210 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55739cc8a580 0x55739cc8a040 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f43640ce5f0 tx=0x7f43640285f0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.325+0000 7f438da00b80 1 -- 172.21.15.46:0/1900816210 shutdown_connections 2023-10-19T12:43:19.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.325+0000 7f438da00b80 1 --2- 172.21.15.46:0/1900816210 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55739cc8bbe0 0x55739cc7f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.325+0000 7f438da00b80 1 --2- 172.21.15.46:0/1900816210 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55739cc8a580 0x55739cc8a040 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.325+0000 7f438da00b80 1 --2- 172.21.15.46:0/1900816210 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55739cc8b280 0x55739cc9aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.325+0000 7f438da00b80 1 -- 172.21.15.46:0/1900816210 >> 172.21.15.46:0/1900816210 conn(0x55739cbfe6d0 msgr2=0x55739cc8a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:19.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.325+0000 7f438da00b80 1 -- 172.21.15.46:0/1900816210 shutdown_connections 2023-10-19T12:43:19.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.325+0000 7f438da00b80 1 -- 172.21.15.46:0/1900816210 wait complete. 2023-10-19T12:43:19.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.325+0000 7f438da00b80 1 -- start start 2023-10-19T12:43:19.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.325+0000 7f438da00b80 1 Processor -- start 2023-10-19T12:43:19.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.326+0000 7f438da00b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55739cc8a580 0x55739cc7edf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:19.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.326+0000 7f438da00b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55739cc8b280 0x55739cc9af50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:19.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.326+0000 7f438da00b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55739cc8bbe0 0x55739cc904d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:19.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.326+0000 7f438da00b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55739cc90bf0 con 0x55739cc8a580 2023-10-19T12:43:19.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.326+0000 7f438da00b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55739cc90d60 con 0x55739cc8bbe0 2023-10-19T12:43:19.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.326+0000 7f438da00b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55739cc90f20 con 0x55739cc8b280 2023-10-19T12:43:19.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.326+0000 7f438da00b80 10 client.0 _ll_register_callbacks cb 0x55739cac3a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:43:19.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.326+0000 7f4373fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55739cc8bbe0 0x55739cc904d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:19.341 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.326+0000 7f4372ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55739cc8b280 0x55739cc9af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:19.341 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.326+0000 7f43737fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55739cc8a580 0x55739cc7edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:19.341 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.326+0000 7f4373fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55739cc8bbe0 0x55739cc904d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:54102/0 (socket says 172.21.15.46:54102) 2023-10-19T12:43:19.341 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.327+0000 7f4373fff700 1 -- 172.21.15.46:0/455518719 learned_addr learned my addr 172.21.15.46:0/455518719 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:43:19.341 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.327+0000 7f4372ffd700 1 -- 172.21.15.46:0/455518719 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55739cc8bbe0 msgr2=0x55739cc904d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:43:19.342 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.327+0000 7f4372ffd700 1 --2- 172.21.15.46:0/455518719 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55739cc8bbe0 0x55739cc904d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.342 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.327+0000 7f4372ffd700 1 -- 172.21.15.46:0/455518719 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55739cc8a580 msgr2=0x55739cc7edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:43:19.342 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.327+0000 7f4372ffd700 1 --2- 172.21.15.46:0/455518719 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55739cc8a580 0x55739cc7edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.342 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.327+0000 7f4372ffd700 1 -- 172.21.15.46:0/455518719 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43741a0bd0 con 0x55739cc8b280 2023-10-19T12:43:19.342 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.327+0000 7f4372ffd700 1 --2- 172.21.15.46:0/455518719 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55739cc8b280 0x55739cc9af50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4368000c00 tx=0x7f43680098e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e53a93283c3fbed4 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:19.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.327+0000 7f4352ffd700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-10-19T12:43:19.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.327+0000 7f4352ffd700 1 -- 172.21.15.46:0/455518719 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4368019840 con 0x55739cc8b280 2023-10-19T12:43:19.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.327+0000 7f438da00b80 1 -- 172.21.15.46:0/455518719 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4368019c50 con 0x55739cc8b280 2023-10-19T12:43:19.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.327+0000 7f4352ffd700 1 -- 172.21.15.46:0/455518719 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f4368000e40 con 0x55739cc8b280 2023-10-19T12:43:19.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.328+0000 7f4352ffd700 1 -- 172.21.15.46:0/455518719 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f436800e3b0 con 0x55739cc8b280 2023-10-19T12:43:19.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.328+0000 7f438da00b80 10 client.25474 fetch_fsmap learned FSMap version 27 2023-10-19T12:43:19.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.328+0000 7f438da00b80 1 -- 172.21.15.46:0/455518719 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55739ca2e200 con 0x55739cc8b280 2023-10-19T12:43:19.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.328+0000 7f4352ffd700 1 -- 172.21.15.46:0/455518719 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4368019c50 con 0x55739cc8b280 2023-10-19T12:43:19.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.328+0000 7f4352ffd700 1 -- 172.21.15.46:0/455518719 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f4368003880 con 0x55739cc8b280 2023-10-19T12:43:19.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.328+0000 7f438da00b80 10 client.25474 fetch_fsmap finished waiting for FSMap version 27 2023-10-19T12:43:19.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.328+0000 7f438da00b80 10 client.25474 resolve_mds: resolved name 'h' to daemon mds.h 2023-10-19T12:43:19.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.328+0000 7f438da00b80 20 client.25474 populate_metadata read hostname 'smithi046' 2023-10-19T12:43:19.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.328+0000 7f438da00b80 1 --2- 172.21.15.46:0/455518719 >> [v2:172.21.15.157:6836/2629536514,v1:172.21.15.157:6837/2629536514] conn(0x55739ccf7980 0x55739ccf3e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:19.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.328+0000 7f438da00b80 4 client.25474 mds_command: new command op to 24629 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-19T12:43:19.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.328+0000 7f438da00b80 1 -- 172.21.15.46:0/455518719 --> [v2:172.21.15.157:6836/2629536514,v1:172.21.15.157:6837/2629536514] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55739cbd5e00 con 0x55739ccf7980 2023-10-19T12:43:19.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.329+0000 7f43737fe700 1 --2- 172.21.15.46:0/455518719 >> [v2:172.21.15.157:6836/2629536514,v1:172.21.15.157:6837/2629536514] conn(0x55739ccf7980 0x55739ccf3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:19.346 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.329+0000 7f43737fe700 1 --2- 172.21.15.46:0/455518719 >> [v2:172.21.15.157:6836/2629536514,v1:172.21.15.157:6837/2629536514] conn(0x55739ccf7980 0x55739ccf3e50 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=38c3eb03a9e5b8af server_cookie=740dcae49ad152d6 in_seq=0 out_seq=0 2023-10-19T12:43:19.346 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.329+0000 7f4352ffd700 10 client.25474 ms_handle_connect on v2:172.21.15.157:6836/2629536514 2023-10-19T12:43:19.346 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.329+0000 7f4352ffd700 1 -- 172.21.15.46:0/455518719 <== mds.4 v2:172.21.15.157:6836/2629536514 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55739cbd5e00 con 0x55739ccf7980 2023-10-19T12:43:19.346 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.329+0000 7f4352ffd700 10 client.25474 handle_command_reply: tid=0 2023-10-19T12:43:19.346 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.329+0000 7f438da00b80 1 client.25474 shutdown 2023-10-19T12:43:19.347 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.330+0000 7f438da00b80 1 -- 172.21.15.46:0/455518719 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55739cc8b280 msgr2=0x55739cc9af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:19.347 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.330+0000 7f438da00b80 1 --2- 172.21.15.46:0/455518719 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55739cc8b280 0x55739cc9af50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4368000c00 tx=0x7f43680098e0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.347 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.330+0000 7f438da00b80 1 -- 172.21.15.46:0/455518719 shutdown_connections 2023-10-19T12:43:19.347 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.330+0000 7f438da00b80 1 --2- 172.21.15.46:0/455518719 >> [v2:172.21.15.157:6836/2629536514,v1:172.21.15.157:6837/2629536514] conn(0x55739ccf7980 0x55739ccf3e50 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.347 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.330+0000 7f438da00b80 1 --2- 172.21.15.46:0/455518719 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55739cc8bbe0 0x55739cc904d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.348 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.330+0000 7f4352ffd700 0 client.25474 ms_handle_reset on v2:172.21.15.157:6836/2629536514 2023-10-19T12:43:19.348 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.330+0000 7f438da00b80 1 --2- 172.21.15.46:0/455518719 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55739cc8a580 0x55739cc7edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.348 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.330+0000 7f438da00b80 1 --2- 172.21.15.46:0/455518719 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55739cc8b280 0x55739cc9af50 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.348 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.330+0000 7f438da00b80 1 -- 172.21.15.46:0/455518719 >> 172.21.15.46:0/455518719 conn(0x55739cbfe6d0 msgr2=0x55739cc85400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:19.348 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.330+0000 7f438da00b80 1 -- 172.21.15.46:0/455518719 shutdown_connections 2023-10-19T12:43:19.348 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.330+0000 7f438da00b80 1 -- 172.21.15.46:0/455518719 wait complete. 2023-10-19T12:43:19.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.330+0000 7f438da00b80 20 client.25474 trim_cache size 0 max 16384 2023-10-19T12:43:19.349 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-10-19T12:43:19.349 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_fsid": "96a8be3c-6e7b-11ee-8db6-212e2dc638e7", 2023-10-19T12:43:19.349 INFO:teuthology.orchestra.run.smithi046.stdout: "whoami": 4, 2023-10-19T12:43:19.350 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 24629, 2023-10-19T12:43:19.350 INFO:teuthology.orchestra.run.smithi046.stdout: "want_state": "up:active", 2023-10-19T12:43:19.350 INFO:teuthology.orchestra.run.smithi046.stdout: "state": "up:active", 2023-10-19T12:43:19.350 INFO:teuthology.orchestra.run.smithi046.stdout: "fs_name": "cephfs", 2023-10-19T12:43:19.350 INFO:teuthology.orchestra.run.smithi046.stdout: "rank_uptime": 93.035155942000003, 2023-10-19T12:43:19.351 INFO:teuthology.orchestra.run.smithi046.stdout: "mdsmap_epoch": 27, 2023-10-19T12:43:19.351 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch": 90, 2023-10-19T12:43:19.351 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch_barrier": 88, 2023-10-19T12:43:19.351 INFO:teuthology.orchestra.run.smithi046.stdout: "uptime": 137.970176845 2023-10-19T12:43:19.351 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-10-19T12:43:19.352 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.330+0000 7f4379fff700 1 -- 172.21.15.46:0/976109578 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f435c0a1500 msgr2=0x7f435c0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:19.353 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.330+0000 7f4379fff700 1 --2- 172.21.15.46:0/976109578 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f435c0a1500 0x7f435c0a39c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f436c007920 tx=0x7f436c009920 comp rx=0 tx=0).stop 2023-10-19T12:43:19.353 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.330+0000 7f4379fff700 1 -- 172.21.15.46:0/976109578 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43740731f0 msgr2=0x7f4374198860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:19.353 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.330+0000 7f4379fff700 1 --2- 172.21.15.46:0/976109578 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43740731f0 0x7f4374198860 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f436400b680 tx=0x7f4364009580 comp rx=0 tx=0).stop 2023-10-19T12:43:19.353 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.331+0000 7f4379fff700 1 -- 172.21.15.46:0/976109578 shutdown_connections 2023-10-19T12:43:19.353 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.331+0000 7f4379fff700 1 --2- 172.21.15.46:0/976109578 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f43741085f0 0x7f437419fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.331+0000 7f4379fff700 1 --2- 172.21.15.46:0/976109578 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f435c0a1500 0x7f435c0a39c0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.331+0000 7f4379fff700 1 --2- 172.21.15.46:0/976109578 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43740731f0 0x7f4374198860 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.331+0000 7f4379fff700 1 --2- 172.21.15.46:0/976109578 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f43740747d0 0x7f4374198da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.331+0000 7f4379fff700 1 -- 172.21.15.46:0/976109578 >> 172.21.15.46:0/976109578 conn(0x7f43740fbc90 msgr2=0x7f4374104540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:19.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.331+0000 7f4379fff700 1 -- 172.21.15.46:0/976109578 shutdown_connections 2023-10-19T12:43:19.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.331+0000 7f4379fff700 1 -- 172.21.15.46:0/976109578 wait complete. 2023-10-19T12:43:19.355 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2023-10-19T12:43:19.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.557+0000 7f27dc7ff700 1 -- 172.21.15.46:0/3601597503 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27d40731f0 msgr2=0x7f27d4073670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:19.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.557+0000 7f27dc7ff700 1 --2- 172.21.15.46:0/3601597503 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27d40731f0 0x7f27d4073670 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f27c4009990 tx=0x7f27c4009ca0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.557+0000 7f27dc7ff700 1 -- 172.21.15.46:0/3601597503 shutdown_connections 2023-10-19T12:43:19.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.557+0000 7f27dc7ff700 1 --2- 172.21.15.46:0/3601597503 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f27d41085f0 0x7f27d410aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.557+0000 7f27dc7ff700 1 --2- 172.21.15.46:0/3601597503 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f27d40747d0 0x7f27d4072c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.557+0000 7f27dc7ff700 1 --2- 172.21.15.46:0/3601597503 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27d40731f0 0x7f27d4073670 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.557+0000 7f27dc7ff700 1 -- 172.21.15.46:0/3601597503 >> 172.21.15.46:0/3601597503 conn(0x7f27d40fbc90 msgr2=0x7f27d40fe0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:19.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.557+0000 7f27dc7ff700 1 -- 172.21.15.46:0/3601597503 shutdown_connections 2023-10-19T12:43:19.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.557+0000 7f27dc7ff700 1 -- 172.21.15.46:0/3601597503 wait complete. 2023-10-19T12:43:19.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.559+0000 7f27dc7ff700 1 Processor -- start 2023-10-19T12:43:19.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.559+0000 7f27dc7ff700 1 -- start start 2023-10-19T12:43:19.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.559+0000 7f27dc7ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f27d40731f0 0x7f27d4198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:19.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.559+0000 7f27dc7ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27d40747d0 0x7f27d4198db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:19.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.559+0000 7f27dc7ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f27d41085f0 0x7f27d419fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:19.566 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.559+0000 7f27dc7ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d41a03a0 con 0x7f27d40747d0 2023-10-19T12:43:19.566 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.559+0000 7f27dc7ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d41a04e0 con 0x7f27d40731f0 2023-10-19T12:43:19.566 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.559+0000 7f27dc7ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d41a0670 con 0x7f27d41085f0 2023-10-19T12:43:19.566 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.560+0000 7f27d9d9a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27d40747d0 0x7f27d4198db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:19.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.560+0000 7f27d9d9a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27d40747d0 0x7f27d4198db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57366/0 (socket says 172.21.15.46:57366) 2023-10-19T12:43:19.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.560+0000 7f27d9d9a700 1 -- 172.21.15.46:0/2967618178 learned_addr learned my addr 172.21.15.46:0/2967618178 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:43:19.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.560+0000 7f27da59b700 1 --2- 172.21.15.46:0/2967618178 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f27d40731f0 0x7f27d4198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:19.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.560+0000 7f27dad9c700 1 --2- 172.21.15.46:0/2967618178 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f27d41085f0 0x7f27d419fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:19.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.560+0000 7f27da59b700 1 -- 172.21.15.46:0/2967618178 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f27d41085f0 msgr2=0x7f27d419fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:19.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.560+0000 7f27da59b700 1 --2- 172.21.15.46:0/2967618178 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f27d41085f0 0x7f27d419fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.560+0000 7f27da59b700 1 -- 172.21.15.46:0/2967618178 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27d40747d0 msgr2=0x7f27d4198db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:19.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.560+0000 7f27da59b700 1 --2- 172.21.15.46:0/2967618178 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27d40747d0 0x7f27d4198db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.560+0000 7f27da59b700 1 -- 172.21.15.46:0/2967618178 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27c40095f0 con 0x7f27d40731f0 2023-10-19T12:43:19.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.560+0000 7f27d9d9a700 1 --2- 172.21.15.46:0/2967618178 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27d40747d0 0x7f27d4198db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:43:19.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.561+0000 7f27da59b700 1 --2- 172.21.15.46:0/2967618178 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f27d40731f0 0x7f27d4198870 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f27d000e9f0 tx=0x7f27d000ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:19.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.561+0000 7f27cb7fe700 1 -- 172.21.15.46:0/2967618178 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d000c9c0 con 0x7f27d40731f0 2023-10-19T12:43:19.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.561+0000 7f27dc7ff700 1 -- 172.21.15.46:0/2967618178 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27d41a0950 con 0x7f27d40731f0 2023-10-19T12:43:19.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.561+0000 7f27cb7fe700 1 -- 172.21.15.46:0/2967618178 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f27d0010430 con 0x7f27d40731f0 2023-10-19T12:43:19.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.561+0000 7f27cb7fe700 1 -- 172.21.15.46:0/2967618178 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d0018680 con 0x7f27d40731f0 2023-10-19T12:43:19.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.561+0000 7f27dc7ff700 1 -- 172.21.15.46:0/2967618178 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27d41a0e60 con 0x7f27d40731f0 2023-10-19T12:43:19.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.566+0000 7f27cb7fe700 1 -- 172.21.15.46:0/2967618178 <== mon.2 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f27d0010860 con 0x7f27d40731f0 2023-10-19T12:43:19.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.566+0000 7f27f0081b80 1 Processor -- start 2023-10-19T12:43:19.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.567+0000 7f27f0081b80 1 -- start start 2023-10-19T12:43:19.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.567+0000 7f27f0081b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557b478d6280 0x557b478d66a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:19.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.567+0000 7f27f0081b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557b478d6be0 0x557b478d5040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:19.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.567+0000 7f27f0081b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557b478d5580 0x557b478d5a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:19.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.567+0000 7f27f0081b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b47848690 con 0x557b478d6280 2023-10-19T12:43:19.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.567+0000 7f27f0081b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b4782ec10 con 0x557b478d5580 2023-10-19T12:43:19.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.567+0000 7f27f0081b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b4782c530 con 0x557b478d6be0 2023-10-19T12:43:19.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.567+0000 7f27dad9c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557b478d6280 0x557b478d66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:19.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.567+0000 7f27dad9c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557b478d6280 0x557b478d66a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57372/0 (socket says 172.21.15.46:57372) 2023-10-19T12:43:19.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.567+0000 7f27dad9c700 1 -- 172.21.15.46:0/3841147386 learned_addr learned my addr 172.21.15.46:0/3841147386 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:43:19.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.567+0000 7f27da59b700 1 --2- 172.21.15.46:0/3841147386 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557b478d6be0 0x557b478d5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:19.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.567+0000 7f27d9d9a700 1 --2- 172.21.15.46:0/3841147386 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557b478d5580 0x557b478d5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:19.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.568+0000 7f27dad9c700 1 -- 172.21.15.46:0/3841147386 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557b478d6be0 msgr2=0x557b478d5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:43:19.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.568+0000 7f27dad9c700 1 --2- 172.21.15.46:0/3841147386 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557b478d6be0 0x557b478d5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.568+0000 7f27dad9c700 1 -- 172.21.15.46:0/3841147386 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557b478d5580 msgr2=0x557b478d5a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:43:19.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.568+0000 7f27dad9c700 1 --2- 172.21.15.46:0/3841147386 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557b478d5580 0x557b478d5a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.568+0000 7f27dad9c700 1 -- 172.21.15.46:0/3841147386 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557b477e53a0 con 0x557b478d6280 2023-10-19T12:43:19.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.568+0000 7f27dad9c700 1 --2- 172.21.15.46:0/3841147386 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557b478d6280 0x557b478d66a0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f27cc011680 tx=0x7f27cc009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e278a12d315f2aa server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:19.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.568+0000 7f27cb7fe700 1 --2- 172.21.15.46:0/2967618178 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f27c00a1480 0x7f27c00a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:19.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.568+0000 7f27c8ff9700 1 -- 172.21.15.46:0/3841147386 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27cc00e040 con 0x557b478d6280 2023-10-19T12:43:19.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.568+0000 7f27c8ff9700 1 -- 172.21.15.46:0/3841147386 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f27cc00f040 con 0x557b478d6280 2023-10-19T12:43:19.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.568+0000 7f27c8ff9700 1 -- 172.21.15.46:0/3841147386 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27cc0048c0 con 0x557b478d6280 2023-10-19T12:43:19.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.568+0000 7f27cb7fe700 1 -- 172.21.15.46:0/2967618178 <== mon.2 v2:172.21.15.157:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f27d0014070 con 0x7f27d40731f0 2023-10-19T12:43:19.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.568+0000 7f27da59b700 1 --2- 172.21.15.46:0/2967618178 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f27c00a1480 0x7f27c00a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:19.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.569+0000 7f27f0081b80 1 -- 172.21.15.46:0/3841147386 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557b478d6280 msgr2=0x557b478d66a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:19.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.569+0000 7f27f0081b80 1 --2- 172.21.15.46:0/3841147386 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557b478d6280 0x557b478d66a0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f27cc011680 tx=0x7f27cc009920 comp rx=0 tx=0).stop 2023-10-19T12:43:19.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.569+0000 7f27f0081b80 1 -- 172.21.15.46:0/3841147386 shutdown_connections 2023-10-19T12:43:19.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.569+0000 7f27da59b700 1 --2- 172.21.15.46:0/2967618178 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f27c00a1480 0x7f27c00a3940 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f27d00a1fa0 tx=0x7f27d00d09d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:19.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.569+0000 7f27f0081b80 1 --2- 172.21.15.46:0/3841147386 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557b478d5580 0x557b478d5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.569+0000 7f27f0081b80 1 --2- 172.21.15.46:0/3841147386 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557b478d6280 0x557b478d66a0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.569+0000 7f27f0081b80 1 --2- 172.21.15.46:0/3841147386 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557b478d6be0 0x557b478d5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.569+0000 7f27f0081b80 1 -- 172.21.15.46:0/3841147386 >> 172.21.15.46:0/3841147386 conn(0x557b478496d0 msgr2=0x557b478cfb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:19.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.569+0000 7f27f0081b80 1 -- 172.21.15.46:0/3841147386 shutdown_connections 2023-10-19T12:43:19.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.569+0000 7f27f0081b80 1 -- 172.21.15.46:0/3841147386 wait complete. 2023-10-19T12:43:19.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.570+0000 7f27f0081b80 1 -- start start 2023-10-19T12:43:19.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.570+0000 7f27f0081b80 1 Processor -- start 2023-10-19T12:43:19.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.571+0000 7f27f0081b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557b478d5580 0x557b478dea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:19.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.571+0000 7f27f0081b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557b478d6280 0x557b478defb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:19.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.571+0000 7f27f0081b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557b478d6be0 0x557b478e5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:19.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.571+0000 7f27f0081b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b47827e20 con 0x557b478d6be0 2023-10-19T12:43:19.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.571+0000 7f27f0081b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b477c46c0 con 0x557b478d6280 2023-10-19T12:43:19.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.571+0000 7f27f0081b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b477c4360 con 0x557b478d5580 2023-10-19T12:43:19.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.571+0000 7f27f0081b80 10 client.0 _ll_register_callbacks cb 0x557b4770ea30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:43:19.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.571+0000 7f27dad9c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557b478d5580 0x557b478dea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:19.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.571+0000 7f27dad9c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557b478d5580 0x557b478dea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:54034/0 (socket says 172.21.15.46:54034) 2023-10-19T12:43:19.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.571+0000 7f27dad9c700 1 -- 172.21.15.46:0/2378240455 learned_addr learned my addr 172.21.15.46:0/2378240455 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:43:19.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.571+0000 7f27d9d9a700 1 --2- 172.21.15.46:0/2378240455 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557b478d6280 0x557b478defb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:19.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.571+0000 7f27dad9c700 1 --2- 172.21.15.46:0/2378240455 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557b478d6be0 0x557b478e5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:19.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.572+0000 7f27d9d9a700 1 -- 172.21.15.46:0/2378240455 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557b478d5580 msgr2=0x557b478dea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:43:19.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.572+0000 7f27d9d9a700 1 --2- 172.21.15.46:0/2378240455 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557b478d5580 0x557b478dea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.572+0000 7f27d9d9a700 1 -- 172.21.15.46:0/2378240455 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557b478d6be0 msgr2=0x557b478e5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:43:19.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.572+0000 7f27d9d9a700 1 --2- 172.21.15.46:0/2378240455 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557b478d6be0 0x557b478e5ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.572+0000 7f27d9d9a700 1 -- 172.21.15.46:0/2378240455 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27cc011330 con 0x557b478d6280 2023-10-19T12:43:19.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.572+0000 7f27d9d9a700 1 --2- 172.21.15.46:0/2378240455 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557b478d6280 0x557b478defb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f27c4006010 tx=0x7f27c40052c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=acd9230e93b74c2e server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:19.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.572+0000 7f27bdffb700 10 client.0 ms_handle_connect on v2:172.21.15.157:3300/0 2023-10-19T12:43:19.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.572+0000 7f27bdffb700 1 -- 172.21.15.46:0/2378240455 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c401d070 con 0x557b478d6280 2023-10-19T12:43:19.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.572+0000 7f27f0081b80 1 -- 172.21.15.46:0/2378240455 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557b4782cea0 con 0x557b478d6280 2023-10-19T12:43:19.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.572+0000 7f27bdffb700 1 -- 172.21.15.46:0/2378240455 <== mon.2 v2:172.21.15.157:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f27c4004910 con 0x557b478d6280 2023-10-19T12:43:19.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.572+0000 7f27bdffb700 1 -- 172.21.15.46:0/2378240455 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f27c4004ad0 con 0x557b478d6280 2023-10-19T12:43:19.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.573+0000 7f27f0081b80 10 client.25469 fetch_fsmap learned FSMap version 27 2023-10-19T12:43:19.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.573+0000 7f27f0081b80 1 -- 172.21.15.46:0/2378240455 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x557b47652d90 con 0x557b478d6280 2023-10-19T12:43:19.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.573+0000 7f27bdffb700 1 -- 172.21.15.46:0/2378240455 <== mon.2 v2:172.21.15.157:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x557b4782cea0 con 0x557b478d6280 2023-10-19T12:43:19.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.573+0000 7f27bdffb700 1 -- 172.21.15.46:0/2378240455 <== mon.2 v2:172.21.15.157:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f27c4024450 con 0x557b478d6280 2023-10-19T12:43:19.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.573+0000 7f27f0081b80 10 client.25469 fetch_fsmap finished waiting for FSMap version 27 2023-10-19T12:43:19.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.573+0000 7f27f0081b80 10 client.25469 resolve_mds: resolved name 'f' to daemon mds.f 2023-10-19T12:43:19.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.573+0000 7f27f0081b80 20 client.25469 populate_metadata read hostname 'smithi046' 2023-10-19T12:43:19.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.573+0000 7f27f0081b80 1 --2- 172.21.15.46:0/2378240455 >> [v2:172.21.15.195:6834/1406909915,v1:172.21.15.195:6835/1406909915] conn(0x557b478ea710 0x557b478e9190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:19.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.573+0000 7f27f0081b80 4 client.25469 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-19T12:43:19.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.573+0000 7f27f0081b80 1 -- 172.21.15.46:0/2378240455 --> [v2:172.21.15.195:6834/1406909915,v1:172.21.15.195:6835/1406909915] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557b478a4860 con 0x557b478ea710 2023-10-19T12:43:19.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.574+0000 7f27dad9c700 1 --2- 172.21.15.46:0/2378240455 >> [v2:172.21.15.195:6834/1406909915,v1:172.21.15.195:6835/1406909915] conn(0x557b478ea710 0x557b478e9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:19.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.574+0000 7f27dad9c700 1 --2- 172.21.15.46:0/2378240455 >> [v2:172.21.15.195:6834/1406909915,v1:172.21.15.195:6835/1406909915] conn(0x557b478ea710 0x557b478e9190 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=1dd2aca8ed40c418 server_cookie=5049abd9683d5253 in_seq=0 out_seq=0 2023-10-19T12:43:19.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.574+0000 7f27bdffb700 10 client.25469 ms_handle_connect on v2:172.21.15.195:6834/1406909915 2023-10-19T12:43:19.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.575+0000 7f27bdffb700 1 -- 172.21.15.46:0/2378240455 <== mds.3 v2:172.21.15.195:6834/1406909915 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x557b478a4860 con 0x557b478ea710 2023-10-19T12:43:19.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.575+0000 7f27bdffb700 10 client.25469 handle_command_reply: tid=0 2023-10-19T12:43:19.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.575+0000 7f27f0081b80 1 client.25469 shutdown 2023-10-19T12:43:19.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.575+0000 7f27f0081b80 1 -- 172.21.15.46:0/2378240455 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557b478d6280 msgr2=0x557b478defb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:19.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.575+0000 7f27f0081b80 1 --2- 172.21.15.46:0/2378240455 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557b478d6280 0x557b478defb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f27c4006010 tx=0x7f27c40052c0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.575+0000 7f27f0081b80 1 -- 172.21.15.46:0/2378240455 shutdown_connections 2023-10-19T12:43:19.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.575+0000 7f27f0081b80 1 --2- 172.21.15.46:0/2378240455 >> [v2:172.21.15.195:6834/1406909915,v1:172.21.15.195:6835/1406909915] conn(0x557b478ea710 0x557b478e9190 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.575+0000 7f27f0081b80 1 --2- 172.21.15.46:0/2378240455 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557b478d6be0 0x557b478e5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.575+0000 7f27f0081b80 1 --2- 172.21.15.46:0/2378240455 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557b478d5580 0x557b478dea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.575+0000 7f27bdffb700 0 client.25469 ms_handle_reset on v2:172.21.15.195:6834/1406909915 2023-10-19T12:43:19.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.575+0000 7f27f0081b80 1 --2- 172.21.15.46:0/2378240455 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557b478d6280 0x557b478defb0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.575+0000 7f27f0081b80 1 -- 172.21.15.46:0/2378240455 >> 172.21.15.46:0/2378240455 conn(0x557b478496d0 msgr2=0x557b478d4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:19.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.575+0000 7f27f0081b80 1 -- 172.21.15.46:0/2378240455 shutdown_connections 2023-10-19T12:43:19.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.575+0000 7f27f0081b80 1 -- 172.21.15.46:0/2378240455 wait complete. 2023-10-19T12:43:19.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.575+0000 7f27f0081b80 20 client.25469 trim_cache size 0 max 16384 2023-10-19T12:43:19.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.593+0000 7f27f0081b80 1 Processor -- start 2023-10-19T12:43:19.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.594+0000 7f27f0081b80 1 -- start start 2023-10-19T12:43:19.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.594+0000 7f27f0081b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557b478d5580 0x557b478e9190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:19.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.594+0000 7f27f0081b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557b478d6280 0x557b478e5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:19.598 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.594+0000 7f27f0081b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557b478d6be0 0x557b478e96d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:19.598 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.594+0000 7f27f0081b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b476a88d0 con 0x557b478d6280 2023-10-19T12:43:19.598 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.594+0000 7f27f0081b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b4782cea0 con 0x557b478d5580 2023-10-19T12:43:19.598 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.594+0000 7f27f0081b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b47823f10 con 0x557b478d6be0 2023-10-19T12:43:19.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.594+0000 7f27d9d9a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557b478d6280 0x557b478e5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:19.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.594+0000 7f27d9d9a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557b478d6280 0x557b478e5fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57380/0 (socket says 172.21.15.46:57380) 2023-10-19T12:43:19.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.594+0000 7f27d9d9a700 1 -- 172.21.15.46:0/3832266135 learned_addr learned my addr 172.21.15.46:0/3832266135 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:43:19.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.594+0000 7f27dad9c700 1 --2- 172.21.15.46:0/3832266135 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557b478d5580 0x557b478e9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:19.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.594+0000 7f27dad9c700 1 --2- 172.21.15.46:0/3832266135 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557b478d6be0 0x557b478e96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:19.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.595+0000 7f27d9d9a700 1 -- 172.21.15.46:0/3832266135 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557b478d6be0 msgr2=0x557b478e96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:43:19.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.595+0000 7f27d9d9a700 1 --2- 172.21.15.46:0/3832266135 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557b478d6be0 0x557b478e96d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.595+0000 7f27d9d9a700 1 -- 172.21.15.46:0/3832266135 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557b478d5580 msgr2=0x557b478e9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:43:19.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.595+0000 7f27d9d9a700 1 --2- 172.21.15.46:0/3832266135 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557b478d5580 0x557b478e9190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.595+0000 7f27d9d9a700 1 -- 172.21.15.46:0/3832266135 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557b4763bc10 con 0x557b478d6280 2023-10-19T12:43:19.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.595+0000 7f27d9d9a700 1 --2- 172.21.15.46:0/3832266135 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557b478d6280 0x557b478e5fb0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f27c4005810 tx=0x7f27c4009290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed90205bec3c3469 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:19.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.595+0000 7f27c97fa700 1 -- 172.21.15.46:0/3832266135 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c403a070 con 0x557b478d6280 2023-10-19T12:43:19.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.595+0000 7f27c97fa700 1 -- 172.21.15.46:0/3832266135 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f27c401e040 con 0x557b478d6280 2023-10-19T12:43:19.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.595+0000 7f27c97fa700 1 -- 172.21.15.46:0/3832266135 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c401d070 con 0x557b478d6280 2023-10-19T12:43:19.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.596+0000 7f27f0081b80 1 -- 172.21.15.46:0/3832266135 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557b478d6280 msgr2=0x557b478e5fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:19.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.596+0000 7f27f0081b80 1 --2- 172.21.15.46:0/3832266135 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557b478d6280 0x557b478e5fb0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f27c4005810 tx=0x7f27c4009290 comp rx=0 tx=0).stop 2023-10-19T12:43:19.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.596+0000 7f27f0081b80 1 -- 172.21.15.46:0/3832266135 shutdown_connections 2023-10-19T12:43:19.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.596+0000 7f27f0081b80 1 --2- 172.21.15.46:0/3832266135 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557b478d6be0 0x557b478e96d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.596+0000 7f27f0081b80 1 --2- 172.21.15.46:0/3832266135 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557b478d5580 0x557b478e9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.596+0000 7f27f0081b80 1 --2- 172.21.15.46:0/3832266135 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557b478d6280 0x557b478e5fb0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.596+0000 7f27f0081b80 1 -- 172.21.15.46:0/3832266135 >> 172.21.15.46:0/3832266135 conn(0x557b478496d0 msgr2=0x557b478cfad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:19.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.596+0000 7f27f0081b80 1 -- 172.21.15.46:0/3832266135 shutdown_connections 2023-10-19T12:43:19.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.596+0000 7f27f0081b80 1 -- 172.21.15.46:0/3832266135 wait complete. 2023-10-19T12:43:19.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.596+0000 7f27f0081b80 1 -- start start 2023-10-19T12:43:19.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.596+0000 7f27f0081b80 1 Processor -- start 2023-10-19T12:43:19.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.597+0000 7f27f0081b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557b478d5580 0x557b478e5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:19.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.597+0000 7f27f0081b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557b478d6280 0x557b478e2b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:19.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.597+0000 7f27f0081b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557b478d6be0 0x557b478e3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:19.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.597+0000 7f27f0081b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b4793e100 con 0x557b478d6280 2023-10-19T12:43:19.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.597+0000 7f27f0081b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b4793e240 con 0x557b478d6be0 2023-10-19T12:43:19.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.597+0000 7f27f0081b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b4793e380 con 0x557b478d5580 2023-10-19T12:43:19.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.597+0000 7f27f0081b80 10 client.0 _ll_register_callbacks cb 0x557b4770ea30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:43:19.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.597+0000 7f27d9d9a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557b478d6280 0x557b478e2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:19.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.597+0000 7f27d9d9a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557b478d6280 0x557b478e2b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57386/0 (socket says 172.21.15.46:57386) 2023-10-19T12:43:19.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.597+0000 7f27d9d9a700 1 -- 172.21.15.46:0/729521389 learned_addr learned my addr 172.21.15.46:0/729521389 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:43:19.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.597+0000 7f27dad9c700 1 --2- 172.21.15.46:0/729521389 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557b478d5580 0x557b478e5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:19.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.597+0000 7f27dad9c700 1 --2- 172.21.15.46:0/729521389 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557b478d6be0 0x557b478e3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:19.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.597+0000 7f27d9d9a700 1 -- 172.21.15.46:0/729521389 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557b478d5580 msgr2=0x557b478e5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:43:19.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.597+0000 7f27d9d9a700 1 --2- 172.21.15.46:0/729521389 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557b478d5580 0x557b478e5fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.597+0000 7f27d9d9a700 1 -- 172.21.15.46:0/729521389 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557b478d6be0 msgr2=0x557b478e3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:43:19.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.597+0000 7f27d9d9a700 1 --2- 172.21.15.46:0/729521389 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557b478d6be0 0x557b478e3110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.597+0000 7f27d9d9a700 1 -- 172.21.15.46:0/729521389 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557b47652d90 con 0x557b478d6280 2023-10-19T12:43:19.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.597+0000 7f27dad9c700 1 --2- 172.21.15.46:0/729521389 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557b478d6be0 0x557b478e3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T12:43:19.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.598+0000 7f27d9d9a700 1 --2- 172.21.15.46:0/729521389 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557b478d6280 0x557b478e2b70 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f27c4005b00 tx=0x7f27c4024bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3479930e6165a6d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:19.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.598+0000 7f27bdffb700 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2023-10-19T12:43:19.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.598+0000 7f27bdffb700 1 -- 172.21.15.46:0/729521389 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c403a040 con 0x557b478d6280 2023-10-19T12:43:19.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.598+0000 7f27f0081b80 1 -- 172.21.15.46:0/729521389 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f27cc00f040 con 0x557b478d6280 2023-10-19T12:43:19.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.598+0000 7f27bdffb700 1 -- 172.21.15.46:0/729521389 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f27c4000e40 con 0x557b478d6280 2023-10-19T12:43:19.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.598+0000 7f27bdffb700 1 -- 172.21.15.46:0/729521389 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f27c401d040 con 0x557b478d6280 2023-10-19T12:43:19.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.598+0000 7f27f0081b80 10 client.15465 fetch_fsmap learned FSMap version 27 2023-10-19T12:43:19.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.598+0000 7f27f0081b80 1 -- 172.21.15.46:0/729521389 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x557b47679200 con 0x557b478d6280 2023-10-19T12:43:19.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.599+0000 7f27bdffb700 1 -- 172.21.15.46:0/729521389 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f27cc00f040 con 0x557b478d6280 2023-10-19T12:43:19.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.599+0000 7f27bdffb700 1 -- 172.21.15.46:0/729521389 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f27c402e070 con 0x557b478d6280 2023-10-19T12:43:19.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.599+0000 7f27f0081b80 10 client.15465 fetch_fsmap finished waiting for FSMap version 27 2023-10-19T12:43:19.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.599+0000 7f27f0081b80 10 client.15465 resolve_mds: resolved name 'f' to daemon mds.f 2023-10-19T12:43:19.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.599+0000 7f27f0081b80 20 client.15465 populate_metadata read hostname 'smithi046' 2023-10-19T12:43:19.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.599+0000 7f27f0081b80 1 --2- 172.21.15.46:0/729521389 >> [v2:172.21.15.195:6834/1406909915,v1:172.21.15.195:6835/1406909915] conn(0x557b479432a0 0x557b4793f710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:19.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.599+0000 7f27f0081b80 4 client.15465 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-19T12:43:19.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.599+0000 7f27f0081b80 1 -- 172.21.15.46:0/729521389 --> [v2:172.21.15.195:6834/1406909915,v1:172.21.15.195:6835/1406909915] -- command(tid 0: {"prefix": "status"}) v1 -- 0x557b47820e00 con 0x557b479432a0 2023-10-19T12:43:19.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.599+0000 7f27dad9c700 1 --2- 172.21.15.46:0/729521389 >> [v2:172.21.15.195:6834/1406909915,v1:172.21.15.195:6835/1406909915] conn(0x557b479432a0 0x557b4793f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:19.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.600+0000 7f27dad9c700 1 --2- 172.21.15.46:0/729521389 >> [v2:172.21.15.195:6834/1406909915,v1:172.21.15.195:6835/1406909915] conn(0x557b479432a0 0x557b4793f710 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=1f1c127f5b94f8eb server_cookie=f47d1dabb25d64a4 in_seq=0 out_seq=0 2023-10-19T12:43:19.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.600+0000 7f27bdffb700 10 client.15465 ms_handle_connect on v2:172.21.15.195:6834/1406909915 2023-10-19T12:43:19.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.600+0000 7f27bdffb700 1 -- 172.21.15.46:0/729521389 <== mds.3 v2:172.21.15.195:6834/1406909915 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x557b47820e00 con 0x557b479432a0 2023-10-19T12:43:19.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.600+0000 7f27bdffb700 10 client.15465 handle_command_reply: tid=0 2023-10-19T12:43:19.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.600+0000 7f27f0081b80 1 client.15465 shutdown 2023-10-19T12:43:19.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.600+0000 7f27f0081b80 1 -- 172.21.15.46:0/729521389 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557b478d6280 msgr2=0x557b478e2b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:19.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.600+0000 7f27f0081b80 1 --2- 172.21.15.46:0/729521389 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557b478d6280 0x557b478e2b70 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f27c4005b00 tx=0x7f27c4024bf0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.600+0000 7f27f0081b80 1 -- 172.21.15.46:0/729521389 shutdown_connections 2023-10-19T12:43:19.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.600+0000 7f27f0081b80 1 --2- 172.21.15.46:0/729521389 >> [v2:172.21.15.195:6834/1406909915,v1:172.21.15.195:6835/1406909915] conn(0x557b479432a0 0x557b4793f710 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.600+0000 7f27f0081b80 1 --2- 172.21.15.46:0/729521389 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557b478d6be0 0x557b478e3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.600+0000 7f27f0081b80 1 --2- 172.21.15.46:0/729521389 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557b478d5580 0x557b478e5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.600+0000 7f27f0081b80 1 --2- 172.21.15.46:0/729521389 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557b478d6280 0x557b478e2b70 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.600+0000 7f27bdffb700 0 client.15465 ms_handle_reset on v2:172.21.15.195:6834/1406909915 2023-10-19T12:43:19.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.600+0000 7f27f0081b80 1 -- 172.21.15.46:0/729521389 >> 172.21.15.46:0/729521389 conn(0x557b478496d0 msgr2=0x557b478e9190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:19.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.600+0000 7f27f0081b80 1 -- 172.21.15.46:0/729521389 shutdown_connections 2023-10-19T12:43:19.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.600+0000 7f27f0081b80 1 -- 172.21.15.46:0/729521389 wait complete. 2023-10-19T12:43:19.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.601+0000 7f27f0081b80 20 client.15465 trim_cache size 0 max 16384 2023-10-19T12:43:19.618 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-10-19T12:43:19.618 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_fsid": "96a8be3c-6e7b-11ee-8db6-212e2dc638e7", 2023-10-19T12:43:19.619 INFO:teuthology.orchestra.run.smithi046.stdout: "whoami": 3, 2023-10-19T12:43:19.619 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 24631, 2023-10-19T12:43:19.619 INFO:teuthology.orchestra.run.smithi046.stdout: "want_state": "up:active", 2023-10-19T12:43:19.619 INFO:teuthology.orchestra.run.smithi046.stdout: "state": "up:active", 2023-10-19T12:43:19.619 INFO:teuthology.orchestra.run.smithi046.stdout: "fs_name": "cephfs", 2023-10-19T12:43:19.620 INFO:teuthology.orchestra.run.smithi046.stdout: "rank_uptime": 94.312883224999993, 2023-10-19T12:43:19.620 INFO:teuthology.orchestra.run.smithi046.stdout: "mdsmap_epoch": 27, 2023-10-19T12:43:19.620 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch": 90, 2023-10-19T12:43:19.620 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch_barrier": 88, 2023-10-19T12:43:19.620 INFO:teuthology.orchestra.run.smithi046.stdout: "uptime": 142.763821729 2023-10-19T12:43:19.620 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-10-19T12:43:19.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.601+0000 7f27dc7ff700 1 -- 172.21.15.46:0/2967618178 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f27c00a1480 msgr2=0x7f27c00a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:19.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.601+0000 7f27dc7ff700 1 --2- 172.21.15.46:0/2967618178 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f27c00a1480 0x7f27c00a3940 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f27d00a1fa0 tx=0x7f27d00d09d0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.601+0000 7f27dc7ff700 1 -- 172.21.15.46:0/2967618178 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f27d40731f0 msgr2=0x7f27d4198870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:19.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.601+0000 7f27dc7ff700 1 --2- 172.21.15.46:0/2967618178 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f27d40731f0 0x7f27d4198870 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f27d000e9f0 tx=0x7f27d000ed00 comp rx=0 tx=0).stop 2023-10-19T12:43:19.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.601+0000 7f27dc7ff700 1 -- 172.21.15.46:0/2967618178 shutdown_connections 2023-10-19T12:43:19.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.601+0000 7f27dc7ff700 1 --2- 172.21.15.46:0/2967618178 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f27c00a1480 0x7f27c00a3940 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.601+0000 7f27dc7ff700 1 --2- 172.21.15.46:0/2967618178 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f27d41085f0 0x7f27d419fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.601+0000 7f27dc7ff700 1 --2- 172.21.15.46:0/2967618178 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f27d40731f0 0x7f27d4198870 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.601+0000 7f27dc7ff700 1 --2- 172.21.15.46:0/2967618178 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27d40747d0 0x7f27d4198db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.601+0000 7f27dc7ff700 1 -- 172.21.15.46:0/2967618178 >> 172.21.15.46:0/2967618178 conn(0x7f27d40fbc90 msgr2=0x7f27d4104540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:19.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.601+0000 7f27dc7ff700 1 -- 172.21.15.46:0/2967618178 shutdown_connections 2023-10-19T12:43:19.624 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.601+0000 7f27dc7ff700 1 -- 172.21.15.46:0/2967618178 wait complete. 2023-10-19T12:43:19.625 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-19T12:43:19.833 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.830+0000 7f71f89ff700 1 -- 172.21.15.46:0/1503546644 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f71f4108600 msgr2=0x7f71f410aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:19.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.830+0000 7f71f89ff700 1 --2- 172.21.15.46:0/1503546644 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f71f4108600 0x7f71f410aa70 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f71ec00b0a0 tx=0x7f71ec00b3b0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.830+0000 7f71f89ff700 1 -- 172.21.15.46:0/1503546644 shutdown_connections 2023-10-19T12:43:19.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.830+0000 7f71f89ff700 1 --2- 172.21.15.46:0/1503546644 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f71f4108600 0x7f71f410aa70 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.830+0000 7f71f89ff700 1 --2- 172.21.15.46:0/1503546644 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f71f40747d0 0x7f71f4072c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.830+0000 7f71f89ff700 1 --2- 172.21.15.46:0/1503546644 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f71f40731f0 0x7f71f4073670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.830+0000 7f71f89ff700 1 -- 172.21.15.46:0/1503546644 >> 172.21.15.46:0/1503546644 conn(0x7f71f40fbcc0 msgr2=0x7f71f40fe0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:19.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.830+0000 7f71f89ff700 1 -- 172.21.15.46:0/1503546644 shutdown_connections 2023-10-19T12:43:19.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.830+0000 7f71f89ff700 1 -- 172.21.15.46:0/1503546644 wait complete. 2023-10-19T12:43:19.853 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.831+0000 7f71f89ff700 1 Processor -- start 2023-10-19T12:43:19.853 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.831+0000 7f71f89ff700 1 -- start start 2023-10-19T12:43:19.853 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.832+0000 7f71f89ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f71f40731f0 0x7f71f4198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:19.853 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.832+0000 7f71f89ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f71f40747d0 0x7f71f4198ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:19.853 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.832+0000 7f71f89ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f71f4108600 0x7f71f419fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:19.854 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.832+0000 7f71f89ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f41a04b0 con 0x7f71f4108600 2023-10-19T12:43:19.854 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.832+0000 7f71f89ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f41a05f0 con 0x7f71f40731f0 2023-10-19T12:43:19.854 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.832+0000 7f71f89ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f41a0780 con 0x7f71f40747d0 2023-10-19T12:43:19.854 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.832+0000 7f71f2d9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f71f4108600 0x7f71f419fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:19.854 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.832+0000 7f71f1d9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f71f40747d0 0x7f71f4198ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:19.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.832+0000 7f71f259c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f71f40731f0 0x7f71f4198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:19.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.832+0000 7f71f1d9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f71f40747d0 0x7f71f4198ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:54072/0 (socket says 172.21.15.46:54072) 2023-10-19T12:43:19.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.832+0000 7f71f259c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f71f40731f0 0x7f71f4198980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:54194/0 (socket says 172.21.15.46:54194) 2023-10-19T12:43:19.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.832+0000 7f71f2d9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f71f4108600 0x7f71f419fee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57412/0 (socket says 172.21.15.46:57412) 2023-10-19T12:43:19.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.832+0000 7f71f1d9b700 1 -- 172.21.15.46:0/1758419107 learned_addr learned my addr 172.21.15.46:0/1758419107 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:43:19.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.833+0000 7f71f259c700 1 -- 172.21.15.46:0/1758419107 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f71f40747d0 msgr2=0x7f71f4198ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:19.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.833+0000 7f71f259c700 1 --2- 172.21.15.46:0/1758419107 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f71f40747d0 0x7f71f4198ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.833+0000 7f71f259c700 1 -- 172.21.15.46:0/1758419107 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f71f4108600 msgr2=0x7f71f419fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:19.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.833+0000 7f71f259c700 1 --2- 172.21.15.46:0/1758419107 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f71f4108600 0x7f71f419fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.833+0000 7f71f259c700 1 -- 172.21.15.46:0/1758419107 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71e8009520 con 0x7f71f40731f0 2023-10-19T12:43:19.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.833+0000 7f71f2d9d700 1 --2- 172.21.15.46:0/1758419107 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f71f4108600 0x7f71f419fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:43:19.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.833+0000 7f71f259c700 1 --2- 172.21.15.46:0/1758419107 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f71f40731f0 0x7f71f4198980 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f71e400e9f0 tx=0x7f71e400ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:19.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.833+0000 7f71e37fe700 1 -- 172.21.15.46:0/1758419107 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e400c9c0 con 0x7f71f40731f0 2023-10-19T12:43:19.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.833+0000 7f71e37fe700 1 -- 172.21.15.46:0/1758419107 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f71e4010430 con 0x7f71f40731f0 2023-10-19T12:43:19.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.833+0000 7f71f89ff700 1 -- 172.21.15.46:0/1758419107 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71ec009d00 con 0x7f71f40731f0 2023-10-19T12:43:19.858 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.834+0000 7f71e37fe700 1 -- 172.21.15.46:0/1758419107 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e4018680 con 0x7f71f40731f0 2023-10-19T12:43:19.858 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.834+0000 7f71f89ff700 1 -- 172.21.15.46:0/1758419107 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71f41a0e30 con 0x7f71f40731f0 2023-10-19T12:43:19.858 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.838+0000 7f71e37fe700 1 -- 172.21.15.46:0/1758419107 <== mon.2 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f71e4010860 con 0x7f71f40731f0 2023-10-19T12:43:19.858 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.839+0000 7f720c287b80 1 Processor -- start 2023-10-19T12:43:19.858 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.840+0000 7f720c287b80 1 -- start start 2023-10-19T12:43:19.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.840+0000 7f71e37fe700 1 --2- 172.21.15.46:0/1758419107 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f71dc0a1500 0x7f71dc0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:19.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.840+0000 7f71e37fe700 1 -- 172.21.15.46:0/1758419107 <== mon.2 v2:172.21.15.157:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f71e4014070 con 0x7f71f40731f0 2023-10-19T12:43:19.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.840+0000 7f720c287b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a9a7f4f280 0x55a9a7f4f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:19.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.840+0000 7f720c287b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a9a7f4fbe0 0x55a9a7f4e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:19.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.840+0000 7f720c287b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a9a7f4e580 0x55a9a7f4ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:19.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.840+0000 7f720c287b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9a7ec1690 con 0x55a9a7f4e580 2023-10-19T12:43:19.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.840+0000 7f720c287b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9a7ea7c10 con 0x55a9a7f4fbe0 2023-10-19T12:43:19.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.840+0000 7f720c287b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9a7ea5530 con 0x55a9a7f4f280 2023-10-19T12:43:19.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.840+0000 7f71f2d9d700 1 --2- 172.21.15.46:0/1758419107 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f71dc0a1500 0x7f71dc0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:19.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.840+0000 7f71f259c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a9a7f4f280 0x55a9a7f4f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:19.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.840+0000 7f71f259c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a9a7f4f280 0x55a9a7f4f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:54084/0 (socket says 172.21.15.46:54084) 2023-10-19T12:43:19.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.840+0000 7f71f259c700 1 -- 172.21.15.46:0/2871579946 learned_addr learned my addr 172.21.15.46:0/2871579946 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:43:19.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.840+0000 7f71f2d9d700 1 --2- 172.21.15.46:0/2871579946 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a9a7f4e580 0x55a9a7f4ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:19.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.840+0000 7f71f1d9b700 1 --2- 172.21.15.46:0/2871579946 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a9a7f4fbe0 0x55a9a7f4e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:19.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.841+0000 7f71f259c700 1 -- 172.21.15.46:0/2871579946 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a9a7f4fbe0 msgr2=0x55a9a7f4e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:43:19.861 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.841+0000 7f71f259c700 1 --2- 172.21.15.46:0/2871579946 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a9a7f4fbe0 0x55a9a7f4e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.841+0000 7f71f259c700 1 -- 172.21.15.46:0/2871579946 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a9a7f4e580 msgr2=0x55a9a7f4ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:43:19.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.841+0000 7f71f259c700 1 --2- 172.21.15.46:0/2871579946 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a9a7f4e580 0x55a9a7f4ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.841+0000 7f71f259c700 1 -- 172.21.15.46:0/2871579946 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a9a7e5e3a0 con 0x55a9a7f4f280 2023-10-19T12:43:19.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.841+0000 7f71f259c700 1 --2- 172.21.15.46:0/2871579946 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a9a7f4f280 0x55a9a7f4f6a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f71e40965c0 tx=0x7f71e4099aa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26f6825967f625a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:19.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.841+0000 7f71f2d9d700 1 --2- 172.21.15.46:0/1758419107 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f71dc0a1500 0x7f71dc0a39c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f71ec009fd0 tx=0x7f71ec009410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:19.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.841+0000 7f71e0ff9700 1 -- 172.21.15.46:0/2871579946 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e40adea0 con 0x55a9a7f4f280 2023-10-19T12:43:19.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.841+0000 7f71e0ff9700 1 -- 172.21.15.46:0/2871579946 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f71e409e210 con 0x55a9a7f4f280 2023-10-19T12:43:19.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.841+0000 7f71e0ff9700 1 -- 172.21.15.46:0/2871579946 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e4099810 con 0x55a9a7f4f280 2023-10-19T12:43:19.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.842+0000 7f720c287b80 1 -- 172.21.15.46:0/2871579946 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a9a7f4f280 msgr2=0x55a9a7f4f6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:19.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.842+0000 7f720c287b80 1 --2- 172.21.15.46:0/2871579946 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a9a7f4f280 0x55a9a7f4f6a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f71e40965c0 tx=0x7f71e4099aa0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.864 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.842+0000 7f720c287b80 1 -- 172.21.15.46:0/2871579946 shutdown_connections 2023-10-19T12:43:19.864 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.842+0000 7f720c287b80 1 --2- 172.21.15.46:0/2871579946 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a9a7f4e580 0x55a9a7f4ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.864 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.842+0000 7f720c287b80 1 --2- 172.21.15.46:0/2871579946 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a9a7f4f280 0x55a9a7f4f6a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.864 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.842+0000 7f720c287b80 1 --2- 172.21.15.46:0/2871579946 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a9a7f4fbe0 0x55a9a7f4e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.864 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.842+0000 7f720c287b80 1 -- 172.21.15.46:0/2871579946 >> 172.21.15.46:0/2871579946 conn(0x55a9a7ec26d0 msgr2=0x55a9a7f48b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:19.864 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.842+0000 7f720c287b80 1 -- 172.21.15.46:0/2871579946 shutdown_connections 2023-10-19T12:43:19.865 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.842+0000 7f720c287b80 1 -- 172.21.15.46:0/2871579946 wait complete. 2023-10-19T12:43:19.865 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.843+0000 7f720c287b80 1 -- start start 2023-10-19T12:43:19.865 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.843+0000 7f720c287b80 1 Processor -- start 2023-10-19T12:43:19.865 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.843+0000 7f720c287b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a9a7f4e580 0x55a9a7f57a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:19.865 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.843+0000 7f720c287b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a9a7f4f280 0x55a9a7f57fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:19.865 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.843+0000 7f720c287b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a9a7f4fbe0 0x55a9a7f5efe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:19.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.843+0000 7f720c287b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9a7ea0e20 con 0x55a9a7f4fbe0 2023-10-19T12:43:19.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.843+0000 7f720c287b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9a7e3d6c0 con 0x55a9a7f4f280 2023-10-19T12:43:19.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.843+0000 7f720c287b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9a7e3d360 con 0x55a9a7f4e580 2023-10-19T12:43:19.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.843+0000 7f720c287b80 10 client.0 _ll_register_callbacks cb 0x55a9a7d87a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:43:19.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.844+0000 7f71f2d9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a9a7f4fbe0 0x55a9a7f5efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:19.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.844+0000 7f71f2d9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a9a7f4fbe0 0x55a9a7f5efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57442/0 (socket says 172.21.15.46:57442) 2023-10-19T12:43:19.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.844+0000 7f71f2d9d700 1 -- 172.21.15.46:0/2183752214 learned_addr learned my addr 172.21.15.46:0/2183752214 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:43:19.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.844+0000 7f71f1d9b700 1 --2- 172.21.15.46:0/2183752214 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a9a7f4f280 0x55a9a7f57fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:19.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.844+0000 7f71f259c700 1 --2- 172.21.15.46:0/2183752214 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a9a7f4e580 0x55a9a7f57a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:19.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.844+0000 7f71f2d9d700 1 -- 172.21.15.46:0/2183752214 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a9a7f4e580 msgr2=0x55a9a7f57a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:43:19.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.844+0000 7f71f2d9d700 1 --2- 172.21.15.46:0/2183752214 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a9a7f4e580 0x55a9a7f57a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.844+0000 7f71f2d9d700 1 -- 172.21.15.46:0/2183752214 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a9a7f4f280 msgr2=0x55a9a7f57fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:43:19.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.844+0000 7f71f2d9d700 1 --2- 172.21.15.46:0/2183752214 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a9a7f4f280 0x55a9a7f57fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.844+0000 7f71f2d9d700 1 -- 172.21.15.46:0/2183752214 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71f41a0e30 con 0x55a9a7f4fbe0 2023-10-19T12:43:19.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.844+0000 7f71f2d9d700 1 --2- 172.21.15.46:0/2183752214 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a9a7f4fbe0 0x55a9a7f5efe0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f71ec015000 tx=0x7f71ec00b740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be252528f8c38915 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:19.868 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.844+0000 7f71d9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2023-10-19T12:43:19.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.845+0000 7f71d9ffb700 1 -- 172.21.15.46:0/2183752214 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ec026070 con 0x55a9a7f4fbe0 2023-10-19T12:43:19.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.845+0000 7f720c287b80 1 -- 172.21.15.46:0/2183752214 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a9a7ea5ea0 con 0x55a9a7f4fbe0 2023-10-19T12:43:19.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.845+0000 7f71d9ffb700 1 -- 172.21.15.46:0/2183752214 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f71ec0217f0 con 0x55a9a7f4fbe0 2023-10-19T12:43:19.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.845+0000 7f71d9ffb700 1 -- 172.21.15.46:0/2183752214 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f71ec00e040 con 0x55a9a7f4fbe0 2023-10-19T12:43:19.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.845+0000 7f720c287b80 10 client.15477 fetch_fsmap learned FSMap version 27 2023-10-19T12:43:19.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.845+0000 7f720c287b80 1 -- 172.21.15.46:0/2183752214 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55a9a7ccbd90 con 0x55a9a7f4fbe0 2023-10-19T12:43:19.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.845+0000 7f71d9ffb700 1 -- 172.21.15.46:0/2183752214 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55a9a7ea5ea0 con 0x55a9a7f4fbe0 2023-10-19T12:43:19.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.845+0000 7f71d9ffb700 1 -- 172.21.15.46:0/2183752214 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f71ec02ca90 con 0x55a9a7f4fbe0 2023-10-19T12:43:19.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.845+0000 7f720c287b80 10 client.15477 fetch_fsmap finished waiting for FSMap version 27 2023-10-19T12:43:19.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.845+0000 7f720c287b80 10 client.15477 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-19T12:43:19.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.845+0000 7f720c287b80 20 client.15477 populate_metadata read hostname 'smithi046' 2023-10-19T12:43:19.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.846+0000 7f720c287b80 1 --2- 172.21.15.46:0/2183752214 >> [v2:172.21.15.195:6836/293916188,v1:172.21.15.195:6837/293916188] conn(0x55a9a7f63770 0x55a9a7f621d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:19.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.846+0000 7f720c287b80 4 client.15477 mds_command: new command op to 24643 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-19T12:43:19.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.846+0000 7f720c287b80 1 -- 172.21.15.46:0/2183752214 --> [v2:172.21.15.195:6836/293916188,v1:172.21.15.195:6837/293916188] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a9a7f1d860 con 0x55a9a7f63770 2023-10-19T12:43:19.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.846+0000 7f71f259c700 1 --2- 172.21.15.46:0/2183752214 >> [v2:172.21.15.195:6836/293916188,v1:172.21.15.195:6837/293916188] conn(0x55a9a7f63770 0x55a9a7f621d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:19.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.846+0000 7f71f259c700 1 --2- 172.21.15.46:0/2183752214 >> [v2:172.21.15.195:6836/293916188,v1:172.21.15.195:6837/293916188] conn(0x55a9a7f63770 0x55a9a7f621d0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=583dea5bb0d433b5 server_cookie=12ce03a4db6ad1a3 in_seq=0 out_seq=0 2023-10-19T12:43:19.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.846+0000 7f71d9ffb700 10 client.15477 ms_handle_connect on v2:172.21.15.195:6836/293916188 2023-10-19T12:43:19.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.847+0000 7f71d9ffb700 1 -- 172.21.15.46:0/2183752214 <== mds.2 v2:172.21.15.195:6836/293916188 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a9a7f1d860 con 0x55a9a7f63770 2023-10-19T12:43:19.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.847+0000 7f71d9ffb700 10 client.15477 handle_command_reply: tid=0 2023-10-19T12:43:19.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.847+0000 7f720c287b80 1 client.15477 shutdown 2023-10-19T12:43:19.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.847+0000 7f720c287b80 1 -- 172.21.15.46:0/2183752214 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a9a7f4fbe0 msgr2=0x55a9a7f5efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:19.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.847+0000 7f720c287b80 1 --2- 172.21.15.46:0/2183752214 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a9a7f4fbe0 0x55a9a7f5efe0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f71ec015000 tx=0x7f71ec00b740 comp rx=0 tx=0).stop 2023-10-19T12:43:19.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.848+0000 7f720c287b80 1 -- 172.21.15.46:0/2183752214 shutdown_connections 2023-10-19T12:43:19.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.848+0000 7f720c287b80 1 --2- 172.21.15.46:0/2183752214 >> [v2:172.21.15.195:6836/293916188,v1:172.21.15.195:6837/293916188] conn(0x55a9a7f63770 0x55a9a7f621d0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.848+0000 7f720c287b80 1 --2- 172.21.15.46:0/2183752214 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a9a7f4fbe0 0x55a9a7f5efe0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.848+0000 7f720c287b80 1 --2- 172.21.15.46:0/2183752214 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a9a7f4e580 0x55a9a7f57a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.848+0000 7f720c287b80 1 --2- 172.21.15.46:0/2183752214 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a9a7f4f280 0x55a9a7f57fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.848+0000 7f71d9ffb700 0 client.15477 ms_handle_reset on v2:172.21.15.195:6836/293916188 2023-10-19T12:43:19.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.848+0000 7f720c287b80 1 -- 172.21.15.46:0/2183752214 >> 172.21.15.46:0/2183752214 conn(0x55a9a7ec26d0 msgr2=0x55a9a7f4d030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:19.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.848+0000 7f720c287b80 1 -- 172.21.15.46:0/2183752214 shutdown_connections 2023-10-19T12:43:19.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.848+0000 7f720c287b80 1 -- 172.21.15.46:0/2183752214 wait complete. 2023-10-19T12:43:19.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.848+0000 7f720c287b80 20 client.15477 trim_cache size 0 max 16384 2023-10-19T12:43:19.880 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.866+0000 7f720c287b80 1 Processor -- start 2023-10-19T12:43:19.880 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.866+0000 7f720c287b80 1 -- start start 2023-10-19T12:43:19.880 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.867+0000 7f720c287b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a9a7f4e580 0x55a9a7f52b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:19.881 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.867+0000 7f720c287b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a9a7f4f280 0x55a9a7f5ef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:19.881 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.867+0000 7f720c287b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a9a7f4fbe0 0x55a9a7f56f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:19.881 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.867+0000 7f720c287b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9a7d218d0 con 0x55a9a7f4e580 2023-10-19T12:43:19.881 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.867+0000 7f720c287b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9a7ea20b0 con 0x55a9a7f4f280 2023-10-19T12:43:19.881 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.867+0000 7f720c287b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9a7e9cf10 con 0x55a9a7f4fbe0 2023-10-19T12:43:19.882 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.867+0000 7f71f259c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a9a7f4e580 0x55a9a7f52b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:19.882 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.867+0000 7f71f259c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a9a7f4e580 0x55a9a7f52b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57458/0 (socket says 172.21.15.46:57458) 2023-10-19T12:43:19.882 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.867+0000 7f71f259c700 1 -- 172.21.15.46:0/4122110589 learned_addr learned my addr 172.21.15.46:0/4122110589 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:43:19.882 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.867+0000 7f71f1d9b700 1 --2- 172.21.15.46:0/4122110589 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a9a7f4f280 0x55a9a7f5ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:19.882 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.867+0000 7f71f2d9d700 1 --2- 172.21.15.46:0/4122110589 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a9a7f4fbe0 0x55a9a7f56f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:19.883 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.867+0000 7f71f259c700 1 -- 172.21.15.46:0/4122110589 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a9a7f4fbe0 msgr2=0x55a9a7f56f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:43:19.883 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.867+0000 7f71f259c700 1 --2- 172.21.15.46:0/4122110589 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a9a7f4fbe0 0x55a9a7f56f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.883 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.867+0000 7f71f259c700 1 -- 172.21.15.46:0/4122110589 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a9a7f4f280 msgr2=0x55a9a7f5ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:43:19.883 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.867+0000 7f71f259c700 1 --2- 172.21.15.46:0/4122110589 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a9a7f4f280 0x55a9a7f5ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.883 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.868+0000 7f71f259c700 1 -- 172.21.15.46:0/4122110589 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a9a7cb4c10 con 0x55a9a7f4e580 2023-10-19T12:43:19.884 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.868+0000 7f71f2d9d700 1 --2- 172.21.15.46:0/4122110589 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a9a7f4fbe0 0x55a9a7f56f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T12:43:19.884 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.868+0000 7f71f259c700 1 --2- 172.21.15.46:0/4122110589 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a9a7f4e580 0x55a9a7f52b10 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f71e409a970 tx=0x7f71e409a900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43796a6ca28f94ac server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:19.884 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.868+0000 7f71e17fa700 1 -- 172.21.15.46:0/4122110589 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e40adea0 con 0x55a9a7f4e580 2023-10-19T12:43:19.884 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.868+0000 7f71e17fa700 1 -- 172.21.15.46:0/4122110589 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f71e40a2450 con 0x55a9a7f4e580 2023-10-19T12:43:19.884 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.868+0000 7f71e17fa700 1 -- 172.21.15.46:0/4122110589 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e40a2220 con 0x55a9a7f4e580 2023-10-19T12:43:19.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.868+0000 7f720c287b80 1 -- 172.21.15.46:0/4122110589 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a9a7f4e580 msgr2=0x55a9a7f52b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:19.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.868+0000 7f720c287b80 1 --2- 172.21.15.46:0/4122110589 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a9a7f4e580 0x55a9a7f52b10 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f71e409a970 tx=0x7f71e409a900 comp rx=0 tx=0).stop 2023-10-19T12:43:19.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.869+0000 7f720c287b80 1 -- 172.21.15.46:0/4122110589 shutdown_connections 2023-10-19T12:43:19.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.869+0000 7f720c287b80 1 --2- 172.21.15.46:0/4122110589 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a9a7f4fbe0 0x55a9a7f56f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.869+0000 7f720c287b80 1 --2- 172.21.15.46:0/4122110589 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a9a7f4e580 0x55a9a7f52b10 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.869+0000 7f720c287b80 1 --2- 172.21.15.46:0/4122110589 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a9a7f4f280 0x55a9a7f5ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.886 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.869+0000 7f720c287b80 1 -- 172.21.15.46:0/4122110589 >> 172.21.15.46:0/4122110589 conn(0x55a9a7ec26d0 msgr2=0x55a9a7f48ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:19.886 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.869+0000 7f720c287b80 1 -- 172.21.15.46:0/4122110589 shutdown_connections 2023-10-19T12:43:19.886 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.869+0000 7f720c287b80 1 -- 172.21.15.46:0/4122110589 wait complete. 2023-10-19T12:43:19.886 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.869+0000 7f720c287b80 1 -- start start 2023-10-19T12:43:19.887 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.869+0000 7f720c287b80 1 Processor -- start 2023-10-19T12:43:19.887 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.870+0000 7f720c287b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a9a7f4e580 0x55a9a7f5c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:19.887 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.870+0000 7f720c287b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a9a7f4f280 0x55a9a7f5c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:19.887 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.870+0000 7f720c287b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a9a7f4fbe0 0x55a9a7fb7160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:19.887 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.870+0000 7f720c287b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9a7f5cd40 con 0x55a9a7f4fbe0 2023-10-19T12:43:19.887 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.870+0000 7f720c287b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9a7fb76a0 con 0x55a9a7f4e580 2023-10-19T12:43:19.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.870+0000 7f720c287b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9a7fb77e0 con 0x55a9a7f4f280 2023-10-19T12:43:19.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.870+0000 7f720c287b80 10 client.0 _ll_register_callbacks cb 0x55a9a7d87a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:43:19.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.870+0000 7f71f2d9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a9a7f4fbe0 0x55a9a7fb7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:19.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.870+0000 7f71f259c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a9a7f4e580 0x55a9a7f5c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:19.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.870+0000 7f71f259c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a9a7f4e580 0x55a9a7f5c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:54222/0 (socket says 172.21.15.46:54222) 2023-10-19T12:43:19.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.870+0000 7f71f259c700 1 -- 172.21.15.46:0/3511603995 learned_addr learned my addr 172.21.15.46:0/3511603995 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:43:19.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.870+0000 7f71f1d9b700 1 --2- 172.21.15.46:0/3511603995 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a9a7f4f280 0x55a9a7f5c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:19.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.871+0000 7f71f259c700 1 -- 172.21.15.46:0/3511603995 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a9a7f4f280 msgr2=0x55a9a7f5c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:43:19.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.871+0000 7f71f259c700 1 --2- 172.21.15.46:0/3511603995 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a9a7f4f280 0x55a9a7f5c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.871+0000 7f71f259c700 1 -- 172.21.15.46:0/3511603995 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a9a7f4fbe0 msgr2=0x55a9a7fb7160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:43:19.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.871+0000 7f71f259c700 1 --2- 172.21.15.46:0/3511603995 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a9a7f4fbe0 0x55a9a7fb7160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.871+0000 7f71f259c700 1 -- 172.21.15.46:0/3511603995 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a9a7e5e3a0 con 0x55a9a7f4e580 2023-10-19T12:43:19.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.871+0000 7f71f259c700 1 --2- 172.21.15.46:0/3511603995 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a9a7f4e580 0x55a9a7f5c180 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f71e409a050 tx=0x7f71e4099a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=feda6b99f036c011 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:19.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.871+0000 7f71d9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.157:3300/0 2023-10-19T12:43:19.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.871+0000 7f71d9ffb700 1 -- 172.21.15.46:0/3511603995 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e40adea0 con 0x55a9a7f4e580 2023-10-19T12:43:19.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.871+0000 7f720c287b80 1 -- 172.21.15.46:0/3511603995 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f71e409e210 con 0x55a9a7f4e580 2023-10-19T12:43:19.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.871+0000 7f71d9ffb700 1 -- 172.21.15.46:0/3511603995 <== mon.2 v2:172.21.15.157:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f71e4098460 con 0x55a9a7f4e580 2023-10-19T12:43:19.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.871+0000 7f71d9ffb700 1 -- 172.21.15.46:0/3511603995 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f71e4099830 con 0x55a9a7f4e580 2023-10-19T12:43:19.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.871+0000 7f720c287b80 10 client.25493 fetch_fsmap learned FSMap version 27 2023-10-19T12:43:19.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.871+0000 7f720c287b80 1 -- 172.21.15.46:0/3511603995 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55a9a7cf2200 con 0x55a9a7f4e580 2023-10-19T12:43:19.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.872+0000 7f71d9ffb700 1 -- 172.21.15.46:0/3511603995 <== mon.2 v2:172.21.15.157:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f71e409e210 con 0x55a9a7f4e580 2023-10-19T12:43:19.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.872+0000 7f71d9ffb700 1 -- 172.21.15.46:0/3511603995 <== mon.2 v2:172.21.15.157:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f71e4080070 con 0x55a9a7f4e580 2023-10-19T12:43:19.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.872+0000 7f720c287b80 10 client.25493 fetch_fsmap finished waiting for FSMap version 27 2023-10-19T12:43:19.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.872+0000 7f720c287b80 10 client.25493 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-19T12:43:19.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.872+0000 7f720c287b80 20 client.25493 populate_metadata read hostname 'smithi046' 2023-10-19T12:43:19.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.872+0000 7f720c287b80 1 --2- 172.21.15.46:0/3511603995 >> [v2:172.21.15.195:6836/293916188,v1:172.21.15.195:6837/293916188] conn(0x55a9a7fbc610 0x55a9a7fb8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:19.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.872+0000 7f720c287b80 4 client.25493 mds_command: new command op to 24643 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-19T12:43:19.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.872+0000 7f720c287b80 1 -- 172.21.15.46:0/3511603995 --> [v2:172.21.15.195:6836/293916188,v1:172.21.15.195:6837/293916188] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a9a7e99e00 con 0x55a9a7fbc610 2023-10-19T12:43:19.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.872+0000 7f71f1d9b700 1 --2- 172.21.15.46:0/3511603995 >> [v2:172.21.15.195:6836/293916188,v1:172.21.15.195:6837/293916188] conn(0x55a9a7fbc610 0x55a9a7fb8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:19.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.873+0000 7f71d9ffb700 10 client.25493 ms_handle_connect on v2:172.21.15.195:6836/293916188 2023-10-19T12:43:19.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.873+0000 7f71f1d9b700 1 --2- 172.21.15.46:0/3511603995 >> [v2:172.21.15.195:6836/293916188,v1:172.21.15.195:6837/293916188] conn(0x55a9a7fbc610 0x55a9a7fb8ab0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4065428a6e53228a server_cookie=149847f2e0d67c05 in_seq=0 out_seq=0 2023-10-19T12:43:19.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.873+0000 7f71d9ffb700 1 -- 172.21.15.46:0/3511603995 <== mds.2 v2:172.21.15.195:6836/293916188 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x55a9a7e99e00 con 0x55a9a7fbc610 2023-10-19T12:43:19.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.873+0000 7f71d9ffb700 10 client.25493 handle_command_reply: tid=0 2023-10-19T12:43:19.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.873+0000 7f720c287b80 1 client.25493 shutdown 2023-10-19T12:43:19.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.873+0000 7f720c287b80 1 -- 172.21.15.46:0/3511603995 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a9a7f4e580 msgr2=0x55a9a7f5c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:19.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.873+0000 7f720c287b80 1 --2- 172.21.15.46:0/3511603995 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a9a7f4e580 0x55a9a7f5c180 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f71e409a050 tx=0x7f71e4099a20 comp rx=0 tx=0).stop 2023-10-19T12:43:19.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.874+0000 7f720c287b80 1 -- 172.21.15.46:0/3511603995 shutdown_connections 2023-10-19T12:43:19.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.874+0000 7f720c287b80 1 --2- 172.21.15.46:0/3511603995 >> [v2:172.21.15.195:6836/293916188,v1:172.21.15.195:6837/293916188] conn(0x55a9a7fbc610 0x55a9a7fb8ab0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.874+0000 7f720c287b80 1 --2- 172.21.15.46:0/3511603995 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a9a7f4fbe0 0x55a9a7fb7160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.874+0000 7f720c287b80 1 --2- 172.21.15.46:0/3511603995 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a9a7f4e580 0x55a9a7f5c180 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.874+0000 7f720c287b80 1 --2- 172.21.15.46:0/3511603995 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a9a7f4f280 0x55a9a7f5c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.874+0000 7f71d9ffb700 0 client.25493 ms_handle_reset on v2:172.21.15.195:6836/293916188 2023-10-19T12:43:19.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.874+0000 7f720c287b80 1 -- 172.21.15.46:0/3511603995 >> 172.21.15.46:0/3511603995 conn(0x55a9a7ec26d0 msgr2=0x55a9a7f56f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:19.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.874+0000 7f720c287b80 1 -- 172.21.15.46:0/3511603995 shutdown_connections 2023-10-19T12:43:19.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.874+0000 7f720c287b80 1 -- 172.21.15.46:0/3511603995 wait complete. 2023-10-19T12:43:19.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.874+0000 7f720c287b80 20 client.25493 trim_cache size 0 max 16384 2023-10-19T12:43:19.897 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-10-19T12:43:19.897 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_fsid": "96a8be3c-6e7b-11ee-8db6-212e2dc638e7", 2023-10-19T12:43:19.898 INFO:teuthology.orchestra.run.smithi046.stdout: "whoami": 2, 2023-10-19T12:43:19.898 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 24643, 2023-10-19T12:43:19.898 INFO:teuthology.orchestra.run.smithi046.stdout: "want_state": "up:active", 2023-10-19T12:43:19.898 INFO:teuthology.orchestra.run.smithi046.stdout: "state": "up:active", 2023-10-19T12:43:19.898 INFO:teuthology.orchestra.run.smithi046.stdout: "fs_name": "cephfs", 2023-10-19T12:43:19.899 INFO:teuthology.orchestra.run.smithi046.stdout: "rank_uptime": 95.596054396, 2023-10-19T12:43:19.899 INFO:teuthology.orchestra.run.smithi046.stdout: "mdsmap_epoch": 27, 2023-10-19T12:43:19.899 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch": 90, 2023-10-19T12:43:19.899 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch_barrier": 88, 2023-10-19T12:43:19.899 INFO:teuthology.orchestra.run.smithi046.stdout: "uptime": 140.83794372899999 2023-10-19T12:43:19.900 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-10-19T12:43:19.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.874+0000 7f71f89ff700 1 -- 172.21.15.46:0/1758419107 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f71dc0a1500 msgr2=0x7f71dc0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:19.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.874+0000 7f71f89ff700 1 --2- 172.21.15.46:0/1758419107 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f71dc0a1500 0x7f71dc0a39c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f71ec009fd0 tx=0x7f71ec009410 comp rx=0 tx=0).stop 2023-10-19T12:43:19.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.874+0000 7f71f89ff700 1 -- 172.21.15.46:0/1758419107 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f71f40731f0 msgr2=0x7f71f4198980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:19.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.874+0000 7f71f89ff700 1 --2- 172.21.15.46:0/1758419107 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f71f40731f0 0x7f71f4198980 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f71e400e9f0 tx=0x7f71e400ed00 comp rx=0 tx=0).stop 2023-10-19T12:43:19.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.875+0000 7f71f89ff700 1 -- 172.21.15.46:0/1758419107 shutdown_connections 2023-10-19T12:43:19.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.875+0000 7f71f89ff700 1 --2- 172.21.15.46:0/1758419107 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f71f4108600 0x7f71f419fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.875+0000 7f71f89ff700 1 --2- 172.21.15.46:0/1758419107 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f71f40731f0 0x7f71f4198980 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.875+0000 7f71f89ff700 1 --2- 172.21.15.46:0/1758419107 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f71dc0a1500 0x7f71dc0a39c0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.875+0000 7f71f89ff700 1 --2- 172.21.15.46:0/1758419107 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f71f40747d0 0x7f71f4198ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:19.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.875+0000 7f71f89ff700 1 -- 172.21.15.46:0/1758419107 >> 172.21.15.46:0/1758419107 conn(0x7f71f40fbcc0 msgr2=0x7f71f4104550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:19.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.875+0000 7f71f89ff700 1 -- 172.21.15.46:0/1758419107 shutdown_connections 2023-10-19T12:43:19.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:19.875+0000 7f71f89ff700 1 -- 172.21.15.46:0/1758419107 wait complete. 2023-10-19T12:43:19.903 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:19 smithi046 ceph-mon[98509]: pgmap v346: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-19T12:43:19.903 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:19 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/1267937771' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-19T12:43:19.904 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2023-10-19T12:43:20.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:19 smithi157 ceph-mon[134109]: pgmap v346: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-19T12:43:20.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:19 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/1267937771' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-19T12:43:20.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.107+0000 7f8b435ff700 1 -- 172.21.15.46:0/871939456 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b3c1085f0 msgr2=0x7f8b3c10aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:20.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.107+0000 7f8b435ff700 1 --2- 172.21.15.46:0/871939456 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b3c1085f0 0x7f8b3c10aa60 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f8b3400b0a0 tx=0x7f8b3400b3b0 comp rx=0 tx=0).stop 2023-10-19T12:43:20.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.107+0000 7f8b435ff700 1 -- 172.21.15.46:0/871939456 shutdown_connections 2023-10-19T12:43:20.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.107+0000 7f8b435ff700 1 --2- 172.21.15.46:0/871939456 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b3c1085f0 0x7f8b3c10aa60 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:20.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.107+0000 7f8b435ff700 1 --2- 172.21.15.46:0/871939456 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8b3c0747d0 0x7f8b3c072c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:20.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.107+0000 7f8b435ff700 1 --2- 172.21.15.46:0/871939456 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8b3c0731f0 0x7f8b3c073670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:20.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.107+0000 7f8b435ff700 1 -- 172.21.15.46:0/871939456 >> 172.21.15.46:0/871939456 conn(0x7f8b3c0fbc90 msgr2=0x7f8b3c0fe0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:20.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.107+0000 7f8b435ff700 1 -- 172.21.15.46:0/871939456 shutdown_connections 2023-10-19T12:43:20.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.107+0000 7f8b435ff700 1 -- 172.21.15.46:0/871939456 wait complete. 2023-10-19T12:43:20.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.108+0000 7f8b435ff700 1 Processor -- start 2023-10-19T12:43:20.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.108+0000 7f8b435ff700 1 -- start start 2023-10-19T12:43:20.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.109+0000 7f8b435ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8b3c0731f0 0x7f8b3c198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:20.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.109+0000 7f8b435ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b3c0747d0 0x7f8b3c198eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:20.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.109+0000 7f8b435ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8b3c1085f0 0x7f8b3c19fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:20.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.109+0000 7f8b435ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3c1a04a0 con 0x7f8b3c0747d0 2023-10-19T12:43:20.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.109+0000 7f8b435ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3c1a05e0 con 0x7f8b3c0731f0 2023-10-19T12:43:20.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.109+0000 7f8b435ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3c1a0770 con 0x7f8b3c1085f0 2023-10-19T12:43:20.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.109+0000 7f8b40b9a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b3c0747d0 0x7f8b3c198eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:20.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.109+0000 7f8b40b9a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b3c0747d0 0x7f8b3c198eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57476/0 (socket says 172.21.15.46:57476) 2023-10-19T12:43:20.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.109+0000 7f8b40b9a700 1 -- 172.21.15.46:0/3881394999 learned_addr learned my addr 172.21.15.46:0/3881394999 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:43:20.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.109+0000 7f8b41b9c700 1 --2- 172.21.15.46:0/3881394999 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8b3c1085f0 0x7f8b3c19fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:20.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.109+0000 7f8b4139b700 1 --2- 172.21.15.46:0/3881394999 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8b3c0731f0 0x7f8b3c198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:20.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.110+0000 7f8b40b9a700 1 -- 172.21.15.46:0/3881394999 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8b3c1085f0 msgr2=0x7f8b3c19fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:20.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.110+0000 7f8b40b9a700 1 --2- 172.21.15.46:0/3881394999 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8b3c1085f0 0x7f8b3c19fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:20.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.110+0000 7f8b40b9a700 1 -- 172.21.15.46:0/3881394999 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8b3c0731f0 msgr2=0x7f8b3c198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:20.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.110+0000 7f8b40b9a700 1 --2- 172.21.15.46:0/3881394999 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8b3c0731f0 0x7f8b3c198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:20.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.110+0000 7f8b40b9a700 1 -- 172.21.15.46:0/3881394999 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b2c009520 con 0x7f8b3c0747d0 2023-10-19T12:43:20.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.110+0000 7f8b41b9c700 1 --2- 172.21.15.46:0/3881394999 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8b3c1085f0 0x7f8b3c19fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:43:20.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.110+0000 7f8b40b9a700 1 --2- 172.21.15.46:0/3881394999 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b3c0747d0 0x7f8b3c198eb0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c00eb30 tx=0x7f8b2c00ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:20.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.110+0000 7f8b327fc700 1 -- 172.21.15.46:0/3881394999 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b2c009880 con 0x7f8b3c0747d0 2023-10-19T12:43:20.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.110+0000 7f8b327fc700 1 -- 172.21.15.46:0/3881394999 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8b2c0044e0 con 0x7f8b3c0747d0 2023-10-19T12:43:20.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.110+0000 7f8b435ff700 1 -- 172.21.15.46:0/3881394999 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b34009d00 con 0x7f8b3c0747d0 2023-10-19T12:43:20.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.110+0000 7f8b327fc700 1 -- 172.21.15.46:0/3881394999 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b2c003d80 con 0x7f8b3c0747d0 2023-10-19T12:43:20.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.110+0000 7f8b435ff700 1 -- 172.21.15.46:0/3881394999 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b3c1a0e20 con 0x7f8b3c0747d0 2023-10-19T12:43:20.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.113+0000 7f8b327fc700 1 -- 172.21.15.46:0/3881394999 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f8b2c003f20 con 0x7f8b3c0747d0 2023-10-19T12:43:20.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.114+0000 7f8b56f58b80 1 Processor -- start 2023-10-19T12:43:20.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.115+0000 7f8b56f58b80 1 -- start start 2023-10-19T12:43:20.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.115+0000 7f8b327fc700 1 --2- 172.21.15.46:0/3881394999 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f8b280a1500 0x7f8b280a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:20.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.115+0000 7f8b56f58b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5604cb7f3280 0x5604cb7f36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:20.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.115+0000 7f8b56f58b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5604cb7f3be0 0x5604cb7f2040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:20.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.115+0000 7f8b56f58b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5604cb7f2580 0x5604cb7f2a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:20.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.115+0000 7f8b56f58b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604cb765690 con 0x5604cb7f2580 2023-10-19T12:43:20.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.115+0000 7f8b56f58b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604cb74bc10 con 0x5604cb7f3be0 2023-10-19T12:43:20.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.115+0000 7f8b56f58b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604cb749530 con 0x5604cb7f3280 2023-10-19T12:43:20.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.115+0000 7f8b327fc700 1 -- 172.21.15.46:0/3881394999 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f8b2c014070 con 0x7f8b3c0747d0 2023-10-19T12:43:20.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.115+0000 7f8b41b9c700 1 --2- 172.21.15.46:0/3881394999 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f8b280a1500 0x7f8b280a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:20.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.115+0000 7f8b4139b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5604cb7f3280 0x5604cb7f36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:20.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.115+0000 7f8b40b9a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5604cb7f3be0 0x5604cb7f2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:20.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.116+0000 7f8b41b9c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5604cb7f2580 0x5604cb7f2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:20.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.116+0000 7f8b4139b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5604cb7f3280 0x5604cb7f36a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:54122/0 (socket says 172.21.15.46:54122) 2023-10-19T12:43:20.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.116+0000 7f8b40b9a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5604cb7f3be0 0x5604cb7f2040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:54254/0 (socket says 172.21.15.46:54254) 2023-10-19T12:43:20.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.116+0000 7f8b4139b700 1 -- 172.21.15.46:0/1776801895 learned_addr learned my addr 172.21.15.46:0/1776801895 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:43:20.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.116+0000 7f8b40b9a700 1 -- 172.21.15.46:0/1776801895 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5604cb7f3280 msgr2=0x5604cb7f36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:43:20.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.116+0000 7f8b40b9a700 1 --2- 172.21.15.46:0/1776801895 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5604cb7f3280 0x5604cb7f36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:20.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.116+0000 7f8b40b9a700 1 -- 172.21.15.46:0/1776801895 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5604cb7f2580 msgr2=0x5604cb7f2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:43:20.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.116+0000 7f8b40b9a700 1 --2- 172.21.15.46:0/1776801895 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5604cb7f2580 0x5604cb7f2a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:20.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.116+0000 7f8b40b9a700 1 -- 172.21.15.46:0/1776801895 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5604cb7023a0 con 0x5604cb7f3be0 2023-10-19T12:43:20.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.116+0000 7f8b41b9c700 1 --2- 172.21.15.46:0/3881394999 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f8b280a1500 0x7f8b280a39c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f8b34009fd0 tx=0x7f8b34009410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:20.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.116+0000 7f8b40b9a700 1 --2- 172.21.15.46:0/1776801895 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5604cb7f3be0 0x5604cb7f2040 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c0cacc0 tx=0x7f8b2c09a0a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e276172763ff60b3 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:20.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.116+0000 7f8b277fe700 1 -- 172.21.15.46:0/1776801895 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b2c092070 con 0x5604cb7f3be0 2023-10-19T12:43:20.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.116+0000 7f8b277fe700 1 -- 172.21.15.46:0/1776801895 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8b2c09abe0 con 0x5604cb7f3be0 2023-10-19T12:43:20.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.117+0000 7f8b277fe700 1 -- 172.21.15.46:0/1776801895 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b2c098880 con 0x5604cb7f3be0 2023-10-19T12:43:20.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.117+0000 7f8b56f58b80 1 -- 172.21.15.46:0/1776801895 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5604cb7f3be0 msgr2=0x5604cb7f2040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:20.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.117+0000 7f8b56f58b80 1 --2- 172.21.15.46:0/1776801895 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5604cb7f3be0 0x5604cb7f2040 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c0cacc0 tx=0x7f8b2c09a0a0 comp rx=0 tx=0).stop 2023-10-19T12:43:20.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.117+0000 7f8b56f58b80 1 -- 172.21.15.46:0/1776801895 shutdown_connections 2023-10-19T12:43:20.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.117+0000 7f8b56f58b80 1 --2- 172.21.15.46:0/1776801895 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5604cb7f2580 0x5604cb7f2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:20.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.117+0000 7f8b56f58b80 1 --2- 172.21.15.46:0/1776801895 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5604cb7f3280 0x5604cb7f36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:20.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.117+0000 7f8b56f58b80 1 --2- 172.21.15.46:0/1776801895 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5604cb7f3be0 0x5604cb7f2040 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:20.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.117+0000 7f8b56f58b80 1 -- 172.21.15.46:0/1776801895 >> 172.21.15.46:0/1776801895 conn(0x5604cb7666d0 msgr2=0x5604cb7ecb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:20.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.117+0000 7f8b56f58b80 1 -- 172.21.15.46:0/1776801895 shutdown_connections 2023-10-19T12:43:20.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.117+0000 7f8b56f58b80 1 -- 172.21.15.46:0/1776801895 wait complete. 2023-10-19T12:43:20.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.118+0000 7f8b56f58b80 1 -- start start 2023-10-19T12:43:20.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.118+0000 7f8b56f58b80 1 Processor -- start 2023-10-19T12:43:20.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.119+0000 7f8b56f58b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5604cb7f2580 0x5604cb7fbac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:20.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.119+0000 7f8b56f58b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5604cb7f3280 0x5604cb7fc000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:20.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.119+0000 7f8b56f58b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5604cb7f3be0 0x5604cb803040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:20.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.119+0000 7f8b56f58b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604cb744e20 con 0x5604cb7f3be0 2023-10-19T12:43:20.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.119+0000 7f8b56f58b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604cb6e16c0 con 0x5604cb7f2580 2023-10-19T12:43:20.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.119+0000 7f8b56f58b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604cb6e1360 con 0x5604cb7f3280 2023-10-19T12:43:20.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.119+0000 7f8b56f58b80 10 client.0 _ll_register_callbacks cb 0x5604cb62ba30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:43:20.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.119+0000 7f8b41b9c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5604cb7f3be0 0x5604cb803040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:20.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.119+0000 7f8b40b9a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5604cb7f3280 0x5604cb7fc000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:20.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.119+0000 7f8b41b9c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5604cb7f3be0 0x5604cb803040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57486/0 (socket says 172.21.15.46:57486) 2023-10-19T12:43:20.135 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.119+0000 7f8b4139b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5604cb7f2580 0x5604cb7fbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:20.135 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.119+0000 7f8b41b9c700 1 -- 172.21.15.46:0/3899927233 learned_addr learned my addr 172.21.15.46:0/3899927233 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:43:20.135 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.119+0000 7f8b40b9a700 1 -- 172.21.15.46:0/3899927233 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5604cb7f2580 msgr2=0x5604cb7fbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:43:20.135 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.119+0000 7f8b40b9a700 1 --2- 172.21.15.46:0/3899927233 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5604cb7f2580 0x5604cb7fbac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:20.135 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.119+0000 7f8b40b9a700 1 -- 172.21.15.46:0/3899927233 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5604cb7f3be0 msgr2=0x5604cb803040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:43:20.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.119+0000 7f8b40b9a700 1 --2- 172.21.15.46:0/3899927233 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5604cb7f3be0 0x5604cb803040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:20.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.119+0000 7f8b40b9a700 1 -- 172.21.15.46:0/3899927233 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b3c1a0e20 con 0x5604cb7f3280 2023-10-19T12:43:20.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.119+0000 7f8b41b9c700 1 --2- 172.21.15.46:0/3899927233 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5604cb7f3be0 0x5604cb803040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:43:20.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.120+0000 7f8b40b9a700 1 --2- 172.21.15.46:0/3899927233 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5604cb7f3280 0x5604cb7fc000 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x5604cb7f3020 tx=0x7f8b2c003790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f869f28805e2a62 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:20.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.120+0000 7f8b24ff9700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-10-19T12:43:20.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.120+0000 7f8b24ff9700 1 -- 172.21.15.46:0/3899927233 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b2c092070 con 0x5604cb7f3280 2023-10-19T12:43:20.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.120+0000 7f8b56f58b80 1 -- 172.21.15.46:0/3899927233 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5604cb749ea0 con 0x5604cb7f3280 2023-10-19T12:43:20.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.120+0000 7f8b24ff9700 1 -- 172.21.15.46:0/3899927233 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f8b2c09e630 con 0x5604cb7f3280 2023-10-19T12:43:20.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.120+0000 7f8b24ff9700 1 -- 172.21.15.46:0/3899927233 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8b2c0cadd0 con 0x5604cb7f3280 2023-10-19T12:43:20.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.120+0000 7f8b56f58b80 10 client.25519 fetch_fsmap learned FSMap version 27 2023-10-19T12:43:20.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.120+0000 7f8b56f58b80 1 -- 172.21.15.46:0/3899927233 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5604cb56fd90 con 0x5604cb7f3280 2023-10-19T12:43:20.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.120+0000 7f8b24ff9700 1 -- 172.21.15.46:0/3899927233 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5604cb749ea0 con 0x5604cb7f3280 2023-10-19T12:43:20.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.121+0000 7f8b24ff9700 1 -- 172.21.15.46:0/3899927233 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f8b2c0999d0 con 0x5604cb7f3280 2023-10-19T12:43:20.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.121+0000 7f8b56f58b80 10 client.25519 fetch_fsmap finished waiting for FSMap version 27 2023-10-19T12:43:20.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.121+0000 7f8b56f58b80 10 client.25519 resolve_mds: resolved name 'i' to daemon mds.i 2023-10-19T12:43:20.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.121+0000 7f8b56f58b80 20 client.25519 populate_metadata read hostname 'smithi046' 2023-10-19T12:43:20.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.121+0000 7f8b56f58b80 1 --2- 172.21.15.46:0/3899927233 >> [v2:172.21.15.195:6838/4094901934,v1:172.21.15.195:6839/4094901934] conn(0x5604cb8072c0 0x5604cb806010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:20.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.121+0000 7f8b56f58b80 4 client.25519 mds_command: new command op to 24655 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-19T12:43:20.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.121+0000 7f8b56f58b80 1 -- 172.21.15.46:0/3899927233 --> [v2:172.21.15.195:6838/4094901934,v1:172.21.15.195:6839/4094901934] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5604cb7c1860 con 0x5604cb8072c0 2023-10-19T12:43:20.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.121+0000 7f8b4139b700 1 --2- 172.21.15.46:0/3899927233 >> [v2:172.21.15.195:6838/4094901934,v1:172.21.15.195:6839/4094901934] conn(0x5604cb8072c0 0x5604cb806010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:20.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.122+0000 7f8b4139b700 1 --2- 172.21.15.46:0/3899927233 >> [v2:172.21.15.195:6838/4094901934,v1:172.21.15.195:6839/4094901934] conn(0x5604cb8072c0 0x5604cb806010 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=41020fe9d8be5f46 server_cookie=d1df392364c71687 in_seq=0 out_seq=0 2023-10-19T12:43:20.140 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.122+0000 7f8b24ff9700 10 client.25519 ms_handle_connect on v2:172.21.15.195:6838/4094901934 2023-10-19T12:43:20.140 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:19 smithi195 ceph-mon[134493]: pgmap v346: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-19T12:43:20.141 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:19 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/1267937771' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-19T12:43:20.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.122+0000 7f8b24ff9700 1 -- 172.21.15.46:0/3899927233 <== mds.1 v2:172.21.15.195:6838/4094901934 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5604cb7c1860 con 0x5604cb8072c0 2023-10-19T12:43:20.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.122+0000 7f8b24ff9700 10 client.25519 handle_command_reply: tid=0 2023-10-19T12:43:20.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.122+0000 7f8b56f58b80 1 client.25519 shutdown 2023-10-19T12:43:20.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.123+0000 7f8b56f58b80 1 -- 172.21.15.46:0/3899927233 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5604cb7f3280 msgr2=0x5604cb7fc000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:20.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.123+0000 7f8b56f58b80 1 --2- 172.21.15.46:0/3899927233 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5604cb7f3280 0x5604cb7fc000 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x5604cb7f3020 tx=0x7f8b2c003790 comp rx=0 tx=0).stop 2023-10-19T12:43:20.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.123+0000 7f8b56f58b80 1 -- 172.21.15.46:0/3899927233 shutdown_connections 2023-10-19T12:43:20.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.123+0000 7f8b56f58b80 1 --2- 172.21.15.46:0/3899927233 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5604cb7f3be0 0x5604cb803040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:20.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.123+0000 7f8b56f58b80 1 --2- 172.21.15.46:0/3899927233 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5604cb7f2580 0x5604cb7fbac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:20.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.123+0000 7f8b56f58b80 1 --2- 172.21.15.46:0/3899927233 >> [v2:172.21.15.195:6838/4094901934,v1:172.21.15.195:6839/4094901934] conn(0x5604cb8072c0 0x5604cb806010 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:20.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.123+0000 7f8b56f58b80 1 --2- 172.21.15.46:0/3899927233 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5604cb7f3280 0x5604cb7fc000 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:20.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.123+0000 7f8b24ff9700 0 client.25519 ms_handle_reset on v2:172.21.15.195:6838/4094901934 2023-10-19T12:43:20.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.123+0000 7f8b56f58b80 1 -- 172.21.15.46:0/3899927233 >> 172.21.15.46:0/3899927233 conn(0x5604cb7666d0 msgr2=0x5604cb7f1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:20.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.123+0000 7f8b56f58b80 1 -- 172.21.15.46:0/3899927233 shutdown_connections 2023-10-19T12:43:20.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.123+0000 7f8b56f58b80 1 -- 172.21.15.46:0/3899927233 wait complete. 2023-10-19T12:43:20.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.123+0000 7f8b56f58b80 20 client.25519 trim_cache size 0 max 16384 2023-10-19T12:43:20.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.142+0000 7f8b56f58b80 1 Processor -- start 2023-10-19T12:43:20.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.142+0000 7f8b56f58b80 1 -- start start 2023-10-19T12:43:20.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.142+0000 7f8b56f58b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5604cb7f2580 0x5604cb7f2040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:20.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.142+0000 7f8b56f58b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5604cb7f3280 0x5604cb803000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:20.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.142+0000 7f8b56f58b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5604cb7f3be0 0x5604cb7fafd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:20.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.142+0000 7f8b56f58b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604cb5c58d0 con 0x5604cb7f3280 2023-10-19T12:43:20.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.142+0000 7f8b56f58b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604cb749ea0 con 0x5604cb7f3be0 2023-10-19T12:43:20.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.142+0000 7f8b56f58b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604cb7e5080 con 0x5604cb7f2580 2023-10-19T12:43:20.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.142+0000 7f8b4139b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5604cb7f2580 0x5604cb7f2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:20.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.142+0000 7f8b40b9a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5604cb7f3280 0x5604cb803000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:20.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.142+0000 7f8b4139b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5604cb7f2580 0x5604cb7f2040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:54134/0 (socket says 172.21.15.46:54134) 2023-10-19T12:43:20.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.142+0000 7f8b4139b700 1 -- 172.21.15.46:0/726846488 learned_addr learned my addr 172.21.15.46:0/726846488 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:43:20.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.142+0000 7f8b41b9c700 1 --2- 172.21.15.46:0/726846488 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5604cb7f3be0 0x5604cb7fafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:20.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.143+0000 7f8b4139b700 1 -- 172.21.15.46:0/726846488 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5604cb7f3be0 msgr2=0x5604cb7fafd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:43:20.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.143+0000 7f8b4139b700 1 --2- 172.21.15.46:0/726846488 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5604cb7f3be0 0x5604cb7fafd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:20.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.143+0000 7f8b4139b700 1 -- 172.21.15.46:0/726846488 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5604cb7f3280 msgr2=0x5604cb803000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:43:20.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.143+0000 7f8b4139b700 1 --2- 172.21.15.46:0/726846488 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5604cb7f3280 0x5604cb803000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:20.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.143+0000 7f8b4139b700 1 -- 172.21.15.46:0/726846488 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5604cb7f2c30 con 0x5604cb7f2580 2023-10-19T12:43:20.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.143+0000 7f8b41b9c700 1 --2- 172.21.15.46:0/726846488 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5604cb7f3be0 0x5604cb7fafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T12:43:20.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.143+0000 7f8b40b9a700 1 --2- 172.21.15.46:0/726846488 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5604cb7f3280 0x5604cb803000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:43:20.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.143+0000 7f8b4139b700 1 --2- 172.21.15.46:0/726846488 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5604cb7f2580 0x5604cb7f2040 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8b38004790 tx=0x7f8b38009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a040a405e6a0eba8 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:20.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.143+0000 7f8b27fff700 1 -- 172.21.15.46:0/726846488 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b38017040 con 0x5604cb7f2580 2023-10-19T12:43:20.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.143+0000 7f8b27fff700 1 -- 172.21.15.46:0/726846488 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8b38018040 con 0x5604cb7f2580 2023-10-19T12:43:20.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.143+0000 7f8b27fff700 1 -- 172.21.15.46:0/726846488 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b38004d60 con 0x5604cb7f2580 2023-10-19T12:43:20.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.144+0000 7f8b56f58b80 1 -- 172.21.15.46:0/726846488 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5604cb7f2580 msgr2=0x5604cb7f2040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:20.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.144+0000 7f8b56f58b80 1 --2- 172.21.15.46:0/726846488 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5604cb7f2580 0x5604cb7f2040 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8b38004790 tx=0x7f8b38009260 comp rx=0 tx=0).stop 2023-10-19T12:43:20.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.144+0000 7f8b56f58b80 1 -- 172.21.15.46:0/726846488 shutdown_connections 2023-10-19T12:43:20.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.144+0000 7f8b56f58b80 1 --2- 172.21.15.46:0/726846488 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5604cb7f3be0 0x5604cb7fafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:20.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.144+0000 7f8b56f58b80 1 --2- 172.21.15.46:0/726846488 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5604cb7f2580 0x5604cb7f2040 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:20.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.144+0000 7f8b56f58b80 1 --2- 172.21.15.46:0/726846488 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5604cb7f3280 0x5604cb803000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:20.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.144+0000 7f8b56f58b80 1 -- 172.21.15.46:0/726846488 >> 172.21.15.46:0/726846488 conn(0x5604cb7666d0 msgr2=0x5604cb7f9b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:20.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.144+0000 7f8b56f58b80 1 -- 172.21.15.46:0/726846488 shutdown_connections 2023-10-19T12:43:20.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.144+0000 7f8b56f58b80 1 -- 172.21.15.46:0/726846488 wait complete. 2023-10-19T12:43:20.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.144+0000 7f8b56f58b80 1 -- start start 2023-10-19T12:43:20.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.145+0000 7f8b56f58b80 1 Processor -- start 2023-10-19T12:43:20.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.145+0000 7f8b56f58b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5604cb7f2580 0x5604cb7ffca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:20.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.145+0000 7f8b56f58b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5604cb7f3280 0x5604cb8001e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:20.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.145+0000 7f8b56f58b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5604cb7f3be0 0x5604cb85acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:20.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.145+0000 7f8b56f58b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604cb803110 con 0x5604cb7f3be0 2023-10-19T12:43:20.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.145+0000 7f8b56f58b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604cb803280 con 0x5604cb7f3280 2023-10-19T12:43:20.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.145+0000 7f8b56f58b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604cb85b1f0 con 0x5604cb7f2580 2023-10-19T12:43:20.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.145+0000 7f8b56f58b80 10 client.0 _ll_register_callbacks cb 0x5604cb62ba30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:43:20.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.145+0000 7f8b41b9c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5604cb7f3be0 0x5604cb85acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:20.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.146+0000 7f8b4139b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5604cb7f2580 0x5604cb7ffca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:20.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.146+0000 7f8b41b9c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5604cb7f3be0 0x5604cb85acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57512/0 (socket says 172.21.15.46:57512) 2023-10-19T12:43:20.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.146+0000 7f8b41b9c700 1 -- 172.21.15.46:0/371716204 learned_addr learned my addr 172.21.15.46:0/371716204 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:43:20.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.146+0000 7f8b40b9a700 1 --2- 172.21.15.46:0/371716204 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5604cb7f3280 0x5604cb8001e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:20.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.146+0000 7f8b40b9a700 1 -- 172.21.15.46:0/371716204 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5604cb7f2580 msgr2=0x5604cb7ffca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:43:20.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.146+0000 7f8b40b9a700 1 --2- 172.21.15.46:0/371716204 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5604cb7f2580 0x5604cb7ffca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:20.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.146+0000 7f8b40b9a700 1 -- 172.21.15.46:0/371716204 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5604cb7f3be0 msgr2=0x5604cb85acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:43:20.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.146+0000 7f8b40b9a700 1 --2- 172.21.15.46:0/371716204 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5604cb7f3be0 0x5604cb85acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:20.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.146+0000 7f8b40b9a700 1 -- 172.21.15.46:0/371716204 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5604cb56fd90 con 0x5604cb7f3280 2023-10-19T12:43:20.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.146+0000 7f8b41b9c700 1 --2- 172.21.15.46:0/371716204 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5604cb7f3be0 0x5604cb85acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:43:20.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.146+0000 7f8b40b9a700 1 --2- 172.21.15.46:0/371716204 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5604cb7f3280 0x5604cb8001e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c098830 tx=0x7f8b2c096820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d66545c1cc1811d server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:20.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.146+0000 7f8b24ff9700 10 client.0 ms_handle_connect on v2:172.21.15.157:3300/0 2023-10-19T12:43:20.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.146+0000 7f8b24ff9700 1 -- 172.21.15.46:0/371716204 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b2c092020 con 0x5604cb7f3280 2023-10-19T12:43:20.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.146+0000 7f8b56f58b80 1 -- 172.21.15.46:0/371716204 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8b2c09abe0 con 0x5604cb7f3280 2023-10-19T12:43:20.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.146+0000 7f8b24ff9700 1 -- 172.21.15.46:0/371716204 <== mon.2 v2:172.21.15.157:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f8b2c09e630 con 0x5604cb7f3280 2023-10-19T12:43:20.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.147+0000 7f8b24ff9700 1 -- 172.21.15.46:0/371716204 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8b2c09a020 con 0x5604cb7f3280 2023-10-19T12:43:20.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.147+0000 7f8b56f58b80 10 client.25511 fetch_fsmap learned FSMap version 27 2023-10-19T12:43:20.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.147+0000 7f8b56f58b80 1 -- 172.21.15.46:0/371716204 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7f8b38009bc0 con 0x5604cb7f3280 2023-10-19T12:43:20.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.147+0000 7f8b24ff9700 1 -- 172.21.15.46:0/371716204 <== mon.2 v2:172.21.15.157:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8b2c082030 con 0x5604cb7f3280 2023-10-19T12:43:20.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.147+0000 7f8b24ff9700 1 -- 172.21.15.46:0/371716204 <== mon.2 v2:172.21.15.157:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f8b2c094250 con 0x5604cb7f3280 2023-10-19T12:43:20.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.147+0000 7f8b56f58b80 10 client.25511 fetch_fsmap finished waiting for FSMap version 27 2023-10-19T12:43:20.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.147+0000 7f8b56f58b80 10 client.25511 resolve_mds: resolved name 'i' to daemon mds.i 2023-10-19T12:43:20.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.147+0000 7f8b56f58b80 20 client.25511 populate_metadata read hostname 'smithi046' 2023-10-19T12:43:20.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.147+0000 7f8b56f58b80 1 --2- 172.21.15.46:0/371716204 >> [v2:172.21.15.195:6838/4094901934,v1:172.21.15.195:6839/4094901934] conn(0x5604cb860000 0x5604cb85c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:20.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.147+0000 7f8b56f58b80 4 client.25511 mds_command: new command op to 24655 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-19T12:43:20.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.147+0000 7f8b56f58b80 1 -- 172.21.15.46:0/371716204 --> [v2:172.21.15.195:6838/4094901934,v1:172.21.15.195:6839/4094901934] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5604cb73de00 con 0x5604cb860000 2023-10-19T12:43:20.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.148+0000 7f8b4139b700 1 --2- 172.21.15.46:0/371716204 >> [v2:172.21.15.195:6838/4094901934,v1:172.21.15.195:6839/4094901934] conn(0x5604cb860000 0x5604cb85c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:20.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.148+0000 7f8b4139b700 1 --2- 172.21.15.46:0/371716204 >> [v2:172.21.15.195:6838/4094901934,v1:172.21.15.195:6839/4094901934] conn(0x5604cb860000 0x5604cb85c480 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=437ff73bfe82772e server_cookie=4b26bcbd0bc89951 in_seq=0 out_seq=0 2023-10-19T12:43:20.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.148+0000 7f8b24ff9700 10 client.25511 ms_handle_connect on v2:172.21.15.195:6838/4094901934 2023-10-19T12:43:20.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.148+0000 7f8b24ff9700 1 -- 172.21.15.46:0/371716204 <== mds.1 v2:172.21.15.195:6838/4094901934 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x5604cb73de00 con 0x5604cb860000 2023-10-19T12:43:20.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.148+0000 7f8b24ff9700 10 client.25511 handle_command_reply: tid=0 2023-10-19T12:43:20.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.148+0000 7f8b56f58b80 1 client.25511 shutdown 2023-10-19T12:43:20.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.149+0000 7f8b56f58b80 1 -- 172.21.15.46:0/371716204 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5604cb7f3280 msgr2=0x5604cb8001e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:20.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.149+0000 7f8b56f58b80 1 --2- 172.21.15.46:0/371716204 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5604cb7f3280 0x5604cb8001e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c098830 tx=0x7f8b2c096820 comp rx=0 tx=0).stop 2023-10-19T12:43:20.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.149+0000 7f8b56f58b80 1 -- 172.21.15.46:0/371716204 shutdown_connections 2023-10-19T12:43:20.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.149+0000 7f8b56f58b80 1 --2- 172.21.15.46:0/371716204 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5604cb7f3be0 0x5604cb85acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:20.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.149+0000 7f8b56f58b80 1 --2- 172.21.15.46:0/371716204 >> [v2:172.21.15.195:6838/4094901934,v1:172.21.15.195:6839/4094901934] conn(0x5604cb860000 0x5604cb85c480 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:20.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.149+0000 7f8b56f58b80 1 --2- 172.21.15.46:0/371716204 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5604cb7f2580 0x5604cb7ffca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:20.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.149+0000 7f8b56f58b80 1 --2- 172.21.15.46:0/371716204 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5604cb7f3280 0x5604cb8001e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:20.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.149+0000 7f8b24ff9700 0 client.25511 ms_handle_reset on v2:172.21.15.195:6838/4094901934 2023-10-19T12:43:20.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.149+0000 7f8b56f58b80 1 -- 172.21.15.46:0/371716204 >> 172.21.15.46:0/371716204 conn(0x5604cb7666d0 msgr2=0x5604cb7f99c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:20.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.149+0000 7f8b56f58b80 1 -- 172.21.15.46:0/371716204 shutdown_connections 2023-10-19T12:43:20.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.149+0000 7f8b56f58b80 1 -- 172.21.15.46:0/371716204 wait complete. 2023-10-19T12:43:20.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.149+0000 7f8b56f58b80 20 client.25511 trim_cache size 0 max 16384 2023-10-19T12:43:20.167 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-10-19T12:43:20.168 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_fsid": "96a8be3c-6e7b-11ee-8db6-212e2dc638e7", 2023-10-19T12:43:20.168 INFO:teuthology.orchestra.run.smithi046.stdout: "whoami": 1, 2023-10-19T12:43:20.168 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 24655, 2023-10-19T12:43:20.168 INFO:teuthology.orchestra.run.smithi046.stdout: "want_state": "up:active", 2023-10-19T12:43:20.168 INFO:teuthology.orchestra.run.smithi046.stdout: "state": "up:active", 2023-10-19T12:43:20.169 INFO:teuthology.orchestra.run.smithi046.stdout: "fs_name": "cephfs", 2023-10-19T12:43:20.169 INFO:teuthology.orchestra.run.smithi046.stdout: "rank_uptime": 96.881939231999993, 2023-10-19T12:43:20.169 INFO:teuthology.orchestra.run.smithi046.stdout: "mdsmap_epoch": 27, 2023-10-19T12:43:20.169 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch": 90, 2023-10-19T12:43:20.169 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch_barrier": 88, 2023-10-19T12:43:20.169 INFO:teuthology.orchestra.run.smithi046.stdout: "uptime": 136.46806581600001 2023-10-19T12:43:20.170 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-10-19T12:43:20.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.149+0000 7f8b435ff700 1 -- 172.21.15.46:0/3881394999 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f8b280a1500 msgr2=0x7f8b280a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:20.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.149+0000 7f8b435ff700 1 --2- 172.21.15.46:0/3881394999 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f8b280a1500 0x7f8b280a39c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f8b34009fd0 tx=0x7f8b34009410 comp rx=0 tx=0).stop 2023-10-19T12:43:20.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.149+0000 7f8b435ff700 1 -- 172.21.15.46:0/3881394999 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b3c0747d0 msgr2=0x7f8b3c198eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:20.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.149+0000 7f8b435ff700 1 --2- 172.21.15.46:0/3881394999 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b3c0747d0 0x7f8b3c198eb0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c00eb30 tx=0x7f8b2c00ee40 comp rx=0 tx=0).stop 2023-10-19T12:43:20.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.150+0000 7f8b435ff700 1 -- 172.21.15.46:0/3881394999 shutdown_connections 2023-10-19T12:43:20.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.150+0000 7f8b435ff700 1 --2- 172.21.15.46:0/3881394999 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f8b280a1500 0x7f8b280a39c0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:20.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.150+0000 7f8b435ff700 1 --2- 172.21.15.46:0/3881394999 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8b3c1085f0 0x7f8b3c19fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:20.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.150+0000 7f8b435ff700 1 --2- 172.21.15.46:0/3881394999 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8b3c0731f0 0x7f8b3c198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:20.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.150+0000 7f8b435ff700 1 --2- 172.21.15.46:0/3881394999 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b3c0747d0 0x7f8b3c198eb0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:20.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.150+0000 7f8b435ff700 1 -- 172.21.15.46:0/3881394999 >> 172.21.15.46:0/3881394999 conn(0x7f8b3c0fbc90 msgr2=0x7f8b3c104540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:20.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.150+0000 7f8b435ff700 1 -- 172.21.15.46:0/3881394999 shutdown_connections 2023-10-19T12:43:20.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.150+0000 7f8b435ff700 1 -- 172.21.15.46:0/3881394999 wait complete. 2023-10-19T12:43:20.174 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-19T12:43:20.383 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.376+0000 7fae9579d700 1 -- 172.21.15.46:0/2550117393 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae901005c0 msgr2=0x7fae901009e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:20.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.376+0000 7fae9579d700 1 --2- 172.21.15.46:0/2550117393 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae901005c0 0x7fae901009e0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fae800099c0 tx=0x7fae80009cd0 comp rx=0 tx=0).stop 2023-10-19T12:43:20.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.376+0000 7fae9579d700 1 -- 172.21.15.46:0/2550117393 shutdown_connections 2023-10-19T12:43:20.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.376+0000 7fae9579d700 1 --2- 172.21.15.46:0/2550117393 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fae90102150 0x7fae90108a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:20.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.376+0000 7fae9579d700 1 --2- 172.21.15.46:0/2550117393 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae901005c0 0x7fae901009e0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:20.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.376+0000 7fae9579d700 1 --2- 172.21.15.46:0/2550117393 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fae901017b0 0x7fae90101c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:20.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.376+0000 7fae9579d700 1 -- 172.21.15.46:0/2550117393 >> 172.21.15.46:0/2550117393 conn(0x7fae900fbb30 msgr2=0x7fae900fdf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:20.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.376+0000 7fae9579d700 1 -- 172.21.15.46:0/2550117393 shutdown_connections 2023-10-19T12:43:20.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.376+0000 7fae9579d700 1 -- 172.21.15.46:0/2550117393 wait complete. 2023-10-19T12:43:20.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.377+0000 7fae9579d700 1 Processor -- start 2023-10-19T12:43:20.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.378+0000 7fae9579d700 1 -- start start 2023-10-19T12:43:20.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.378+0000 7fae9579d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fae901005c0 0x7fae90198780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:20.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.378+0000 7fae9579d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fae901017b0 0x7fae90198cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:20.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.378+0000 7fae9579d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae90102150 0x7fae9019fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:20.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.378+0000 7fae9579d700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae901a02b0 con 0x7fae90102150 2023-10-19T12:43:20.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.378+0000 7fae9579d700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae901a03f0 con 0x7fae901005c0 2023-10-19T12:43:20.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.378+0000 7fae9579d700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae901a0580 con 0x7fae901017b0 2023-10-19T12:43:20.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.378+0000 7fae8f7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fae901017b0 0x7fae90198cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:20.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.378+0000 7fae94f9c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae90102150 0x7fae9019fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:20.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.378+0000 7fae8f7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fae901017b0 0x7fae90198cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:54164/0 (socket says 172.21.15.46:54164) 2023-10-19T12:43:20.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.378+0000 7fae8f7fe700 1 -- 172.21.15.46:0/2333437955 learned_addr learned my addr 172.21.15.46:0/2333437955 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:43:20.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.378+0000 7fae8ffff700 1 --2- 172.21.15.46:0/2333437955 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fae901005c0 0x7fae90198780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:20.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.379+0000 7fae8f7fe700 1 -- 172.21.15.46:0/2333437955 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fae901005c0 msgr2=0x7fae90198780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:20.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.379+0000 7fae8f7fe700 1 --2- 172.21.15.46:0/2333437955 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fae901005c0 0x7fae90198780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:20.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.379+0000 7fae8f7fe700 1 -- 172.21.15.46:0/2333437955 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae90102150 msgr2=0x7fae9019fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:20.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.379+0000 7fae8f7fe700 1 --2- 172.21.15.46:0/2333437955 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae90102150 0x7fae9019fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:20.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.379+0000 7fae8f7fe700 1 -- 172.21.15.46:0/2333437955 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae800095f0 con 0x7fae901017b0 2023-10-19T12:43:20.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.379+0000 7fae94f9c700 1 --2- 172.21.15.46:0/2333437955 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae90102150 0x7fae9019fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:43:20.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.379+0000 7fae8f7fe700 1 --2- 172.21.15.46:0/2333437955 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fae901017b0 0x7fae90198cc0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fae8400e9a0 tx=0x7fae8400ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:20.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.379+0000 7fae8d7fa700 1 -- 172.21.15.46:0/2333437955 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae84009790 con 0x7fae901017b0 2023-10-19T12:43:20.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.379+0000 7fae8d7fa700 1 -- 172.21.15.46:0/2333437955 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fae84010430 con 0x7fae901017b0 2023-10-19T12:43:20.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.379+0000 7fae9579d700 1 -- 172.21.15.46:0/2333437955 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae901a0860 con 0x7fae901017b0 2023-10-19T12:43:20.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.379+0000 7fae8d7fa700 1 -- 172.21.15.46:0/2333437955 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae84018680 con 0x7fae901017b0 2023-10-19T12:43:20.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.379+0000 7fae9579d700 1 -- 172.21.15.46:0/2333437955 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae901a0d70 con 0x7fae901017b0 2023-10-19T12:43:20.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.383+0000 7fae8d7fa700 1 -- 172.21.15.46:0/2333437955 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fae840105a0 con 0x7fae901017b0 2023-10-19T12:43:20.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.384+0000 7faeaa368b80 1 Processor -- start 2023-10-19T12:43:20.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.384+0000 7faeaa368b80 1 -- start start 2023-10-19T12:43:20.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.384+0000 7faeaa368b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x555d65a46480 0x555d65a468a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:20.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.384+0000 7faeaa368b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555d65a46de0 0x555d65a47260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:20.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.384+0000 7faeaa368b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555d65a477a0 0x555d65a47c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:20.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.384+0000 7faeaa368b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d659b9690 con 0x555d65a46de0 2023-10-19T12:43:20.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.384+0000 7faeaa368b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d6599fc10 con 0x555d65a46480 2023-10-19T12:43:20.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.384+0000 7faeaa368b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d6599d530 con 0x555d65a477a0 2023-10-19T12:43:20.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.384+0000 7fae8d7fa700 1 --2- 172.21.15.46:0/2333437955 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fae780a1480 0x7fae780a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:20.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.384+0000 7fae8ffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555d65a46de0 0x555d65a47260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:20.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.384+0000 7fae8ffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555d65a46de0 0x555d65a47260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57542/0 (socket says 172.21.15.46:57542) 2023-10-19T12:43:20.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.384+0000 7fae8ffff700 1 -- 172.21.15.46:0/1082044091 learned_addr learned my addr 172.21.15.46:0/1082044091 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:43:20.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.384+0000 7fae94f9c700 1 --2- 172.21.15.46:0/1082044091 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x555d65a46480 0x555d65a468a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:20.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.385+0000 7fae8d7fa700 1 -- 172.21.15.46:0/2333437955 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fae84014070 con 0x7fae901017b0 2023-10-19T12:43:20.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.385+0000 7fae8f7fe700 1 --2- 172.21.15.46:0/1082044091 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555d65a477a0 0x555d65a47c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:20.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.385+0000 7fae94f9c700 1 --2- 172.21.15.46:0/2333437955 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fae780a1480 0x7fae780a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:20.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.385+0000 7fae8ffff700 1 -- 172.21.15.46:0/1082044091 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555d65a477a0 msgr2=0x555d65a47c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:43:20.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.385+0000 7fae8ffff700 1 --2- 172.21.15.46:0/1082044091 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555d65a477a0 0x555d65a47c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:20.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.385+0000 7fae8ffff700 1 -- 172.21.15.46:0/1082044091 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x555d65a46480 msgr2=0x555d65a468a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:43:20.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.385+0000 7fae8ffff700 1 --2- 172.21.15.46:0/1082044091 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x555d65a46480 0x555d65a468a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:20.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.385+0000 7fae8ffff700 1 -- 172.21.15.46:0/1082044091 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555d659563a0 con 0x555d65a46de0 2023-10-19T12:43:20.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.385+0000 7fae8ffff700 1 --2- 172.21.15.46:0/1082044091 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555d65a46de0 0x555d65a47260 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fae80006010 tx=0x7fae80005bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b89a6ec5e35621c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:20.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.385+0000 7fae94f9c700 1 --2- 172.21.15.46:0/2333437955 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fae780a1480 0x7fae780a3940 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fae88009550 tx=0x7fae8800b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:20.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.385+0000 7fae767fc700 1 -- 172.21.15.46:0/1082044091 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae8000ba10 con 0x555d65a46de0 2023-10-19T12:43:20.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.386+0000 7fae767fc700 1 -- 172.21.15.46:0/1082044091 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fae8001e040 con 0x555d65a46de0 2023-10-19T12:43:20.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.386+0000 7fae767fc700 1 -- 172.21.15.46:0/1082044091 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae80003b10 con 0x555d65a46de0 2023-10-19T12:43:20.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.386+0000 7faeaa368b80 1 -- 172.21.15.46:0/1082044091 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555d65a46de0 msgr2=0x555d65a47260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:20.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.386+0000 7faeaa368b80 1 --2- 172.21.15.46:0/1082044091 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555d65a46de0 0x555d65a47260 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fae80006010 tx=0x7fae80005bc0 comp rx=0 tx=0).stop 2023-10-19T12:43:20.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.386+0000 7faeaa368b80 1 -- 172.21.15.46:0/1082044091 shutdown_connections 2023-10-19T12:43:20.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.386+0000 7faeaa368b80 1 --2- 172.21.15.46:0/1082044091 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555d65a477a0 0x555d65a47c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:20.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.386+0000 7faeaa368b80 1 --2- 172.21.15.46:0/1082044091 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x555d65a46480 0x555d65a468a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:20.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.386+0000 7faeaa368b80 1 --2- 172.21.15.46:0/1082044091 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555d65a46de0 0x555d65a47260 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:20.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.386+0000 7faeaa368b80 1 -- 172.21.15.46:0/1082044091 >> 172.21.15.46:0/1082044091 conn(0x555d659ba6d0 msgr2=0x555d65a40cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:20.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.386+0000 7faeaa368b80 1 -- 172.21.15.46:0/1082044091 shutdown_connections 2023-10-19T12:43:20.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.386+0000 7faeaa368b80 1 -- 172.21.15.46:0/1082044091 wait complete. 2023-10-19T12:43:20.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.387+0000 7faeaa368b80 1 -- start start 2023-10-19T12:43:20.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.387+0000 7faeaa368b80 1 Processor -- start 2023-10-19T12:43:20.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.388+0000 7faeaa368b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555d65a46480 0x555d65a4fc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:20.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.388+0000 7faeaa368b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x555d65a46de0 0x555d65a50160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:20.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.388+0000 7faeaa368b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555d65a477a0 0x555d65a571a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:20.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.388+0000 7faeaa368b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d65998e20 con 0x555d65a46480 2023-10-19T12:43:20.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.388+0000 7faeaa368b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d659356c0 con 0x555d65a46de0 2023-10-19T12:43:20.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.388+0000 7faeaa368b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d65935360 con 0x555d65a477a0 2023-10-19T12:43:20.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.388+0000 7faeaa368b80 10 client.0 _ll_register_callbacks cb 0x555d6587fa30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:43:20.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.388+0000 7fae8ffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555d65a46480 0x555d65a4fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:20.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.388+0000 7fae8ffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555d65a46480 0x555d65a4fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57556/0 (socket says 172.21.15.46:57556) 2023-10-19T12:43:20.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.388+0000 7fae8ffff700 1 -- 172.21.15.46:0/925162473 learned_addr learned my addr 172.21.15.46:0/925162473 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:43:20.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.388+0000 7fae94f9c700 1 --2- 172.21.15.46:0/925162473 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555d65a477a0 0x555d65a571a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:20.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.388+0000 7fae8f7fe700 1 --2- 172.21.15.46:0/925162473 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x555d65a46de0 0x555d65a50160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:20.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.388+0000 7fae8ffff700 1 -- 172.21.15.46:0/925162473 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555d65a477a0 msgr2=0x555d65a571a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:43:20.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.388+0000 7fae8ffff700 1 --2- 172.21.15.46:0/925162473 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555d65a477a0 0x555d65a571a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:20.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.388+0000 7fae8ffff700 1 -- 172.21.15.46:0/925162473 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x555d65a46de0 msgr2=0x555d65a50160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:43:20.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.388+0000 7fae8ffff700 1 --2- 172.21.15.46:0/925162473 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x555d65a46de0 0x555d65a50160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:20.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.388+0000 7fae8ffff700 1 -- 172.21.15.46:0/925162473 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae90109350 con 0x555d65a46480 2023-10-19T12:43:20.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.388+0000 7fae8f7fe700 1 --2- 172.21.15.46:0/925162473 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x555d65a46de0 0x555d65a50160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T12:43:20.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.389+0000 7fae8ffff700 1 --2- 172.21.15.46:0/925162473 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555d65a46480 0x555d65a4fc20 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fae80000c00 tx=0x7fae80009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94263ccc642c9c1f server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:20.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.389+0000 7fae6f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2023-10-19T12:43:20.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.389+0000 7fae6f7fe700 1 -- 172.21.15.46:0/925162473 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae80003cc0 con 0x555d65a46480 2023-10-19T12:43:20.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.389+0000 7faeaa368b80 1 -- 172.21.15.46:0/925162473 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555d6599dea0 con 0x555d65a46480 2023-10-19T12:43:20.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.389+0000 7fae6f7fe700 1 -- 172.21.15.46:0/925162473 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fae80003e20 con 0x555d65a46480 2023-10-19T12:43:20.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.389+0000 7fae6f7fe700 1 -- 172.21.15.46:0/925162473 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fae800050d0 con 0x555d65a46480 2023-10-19T12:43:20.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.389+0000 7faeaa368b80 10 client.15513 fetch_fsmap learned FSMap version 27 2023-10-19T12:43:20.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.389+0000 7faeaa368b80 1 -- 172.21.15.46:0/925162473 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x555d657c3d90 con 0x555d65a46480 2023-10-19T12:43:20.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.389+0000 7fae6f7fe700 1 -- 172.21.15.46:0/925162473 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x555d6599dea0 con 0x555d65a46480 2023-10-19T12:43:20.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.390+0000 7fae6f7fe700 1 -- 172.21.15.46:0/925162473 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fae800223f0 con 0x555d65a46480 2023-10-19T12:43:20.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.390+0000 7faeaa368b80 10 client.15513 fetch_fsmap finished waiting for FSMap version 27 2023-10-19T12:43:20.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.390+0000 7faeaa368b80 10 client.15513 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-19T12:43:20.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.390+0000 7faeaa368b80 20 client.15513 populate_metadata read hostname 'smithi046' 2023-10-19T12:43:20.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.390+0000 7faeaa368b80 1 --2- 172.21.15.46:0/925162473 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x555d65a5b480 0x555d65a5a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:20.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.390+0000 7faeaa368b80 4 client.15513 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-19T12:43:20.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.390+0000 7faeaa368b80 1 -- 172.21.15.46:0/925162473 --> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555d65a15860 con 0x555d65a5b480 2023-10-19T12:43:20.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.390+0000 7fae8f7fe700 1 --2- 172.21.15.46:0/925162473 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x555d65a5b480 0x555d65a5a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:20.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.390+0000 7fae6f7fe700 10 client.15513 ms_handle_connect on v2:172.21.15.157:6838/552718978 2023-10-19T12:43:20.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.390+0000 7fae8f7fe700 1 --2- 172.21.15.46:0/925162473 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x555d65a5b480 0x555d65a5a170 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6355785b734d4b16 server_cookie=6c04610976eda04a in_seq=0 out_seq=0 2023-10-19T12:43:20.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.391+0000 7fae6f7fe700 1 -- 172.21.15.46:0/925162473 <== mds.0 v2:172.21.15.157:6838/552718978 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x555d65a15860 con 0x555d65a5b480 2023-10-19T12:43:20.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.391+0000 7fae6f7fe700 10 client.15513 handle_command_reply: tid=0 2023-10-19T12:43:20.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.391+0000 7faeaa368b80 1 client.15513 shutdown 2023-10-19T12:43:20.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.392+0000 7faeaa368b80 1 -- 172.21.15.46:0/925162473 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555d65a46480 msgr2=0x555d65a4fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:20.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.392+0000 7faeaa368b80 1 --2- 172.21.15.46:0/925162473 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555d65a46480 0x555d65a4fc20 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fae80000c00 tx=0x7fae80009cd0 comp rx=0 tx=0).stop 2023-10-19T12:43:20.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.392+0000 7faeaa368b80 1 -- 172.21.15.46:0/925162473 shutdown_connections 2023-10-19T12:43:20.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.392+0000 7faeaa368b80 1 --2- 172.21.15.46:0/925162473 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555d65a477a0 0x555d65a571a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:20.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.392+0000 7faeaa368b80 1 --2- 172.21.15.46:0/925162473 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x555d65a5b480 0x555d65a5a170 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:20.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.392+0000 7faeaa368b80 1 --2- 172.21.15.46:0/925162473 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555d65a46480 0x555d65a4fc20 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:20.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.392+0000 7faeaa368b80 1 --2- 172.21.15.46:0/925162473 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x555d65a46de0 0x555d65a50160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:20.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.392+0000 7fae6f7fe700 0 client.15513 ms_handle_reset on v2:172.21.15.157:6838/552718978 2023-10-19T12:43:20.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.392+0000 7faeaa368b80 1 -- 172.21.15.46:0/925162473 >> 172.21.15.46:0/925162473 conn(0x555d659ba6d0 msgr2=0x555d65a45280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:20.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.392+0000 7faeaa368b80 1 -- 172.21.15.46:0/925162473 shutdown_connections 2023-10-19T12:43:20.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.392+0000 7faeaa368b80 1 -- 172.21.15.46:0/925162473 wait complete. 2023-10-19T12:43:20.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.392+0000 7faeaa368b80 20 client.15513 trim_cache size 0 max 16384 2023-10-19T12:43:20.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.410+0000 7faeaa368b80 1 Processor -- start 2023-10-19T12:43:20.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.410+0000 7faeaa368b80 1 -- start start 2023-10-19T12:43:20.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.411+0000 7faeaa368b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555d65a46480 0x555d65a45280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:20.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.411+0000 7faeaa368b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555d65a46de0 0x555d65a457c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:20.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.411+0000 7faeaa368b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x555d65a477a0 0x555d65a570c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:20.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.411+0000 7faeaa368b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d658198d0 con 0x555d65a46480 2023-10-19T12:43:20.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.411+0000 7faeaa368b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d65a15890 con 0x555d65a477a0 2023-10-19T12:43:20.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.411+0000 7faeaa368b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d65a5c210 con 0x555d65a46de0 2023-10-19T12:43:20.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.411+0000 7fae8ffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555d65a46480 0x555d65a45280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:20.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.411+0000 7fae8ffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555d65a46480 0x555d65a45280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57560/0 (socket says 172.21.15.46:57560) 2023-10-19T12:43:20.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.411+0000 7fae8ffff700 1 -- 172.21.15.46:0/1861331179 learned_addr learned my addr 172.21.15.46:0/1861331179 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:43:20.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.411+0000 7fae8f7fe700 1 --2- 172.21.15.46:0/1861331179 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555d65a46de0 0x555d65a457c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:20.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.411+0000 7fae94f9c700 1 --2- 172.21.15.46:0/1861331179 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x555d65a477a0 0x555d65a570c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:20.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.411+0000 7fae8ffff700 1 -- 172.21.15.46:0/1861331179 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555d65a46de0 msgr2=0x555d65a457c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:43:20.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.411+0000 7fae8ffff700 1 --2- 172.21.15.46:0/1861331179 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555d65a46de0 0x555d65a457c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:20.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.411+0000 7fae8ffff700 1 -- 172.21.15.46:0/1861331179 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x555d65a477a0 msgr2=0x555d65a570c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:43:20.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.411+0000 7fae8ffff700 1 --2- 172.21.15.46:0/1861331179 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x555d65a477a0 0x555d65a570c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:20.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.411+0000 7fae8ffff700 1 -- 172.21.15.46:0/1861331179 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555d657acc10 con 0x555d65a46480 2023-10-19T12:43:20.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.412+0000 7fae8ffff700 1 --2- 172.21.15.46:0/1861331179 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555d65a46480 0x555d65a45280 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fae800058e0 tx=0x7fae800037d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1af8eed02e2a1717 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:20.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.412+0000 7fae76ffd700 1 -- 172.21.15.46:0/1861331179 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae800225f0 con 0x555d65a46480 2023-10-19T12:43:20.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.412+0000 7fae76ffd700 1 -- 172.21.15.46:0/1861331179 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fae80005bc0 con 0x555d65a46480 2023-10-19T12:43:20.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.412+0000 7fae76ffd700 1 -- 172.21.15.46:0/1861331179 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae8000f6c0 con 0x555d65a46480 2023-10-19T12:43:20.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.413+0000 7faeaa368b80 1 -- 172.21.15.46:0/1861331179 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555d65a46480 msgr2=0x555d65a45280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:20.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.413+0000 7faeaa368b80 1 --2- 172.21.15.46:0/1861331179 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555d65a46480 0x555d65a45280 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fae800058e0 tx=0x7fae800037d0 comp rx=0 tx=0).stop 2023-10-19T12:43:20.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.413+0000 7faeaa368b80 1 -- 172.21.15.46:0/1861331179 shutdown_connections 2023-10-19T12:43:20.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.413+0000 7faeaa368b80 1 --2- 172.21.15.46:0/1861331179 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x555d65a477a0 0x555d65a570c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:20.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.413+0000 7faeaa368b80 1 --2- 172.21.15.46:0/1861331179 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555d65a46480 0x555d65a45280 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:20.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.413+0000 7faeaa368b80 1 --2- 172.21.15.46:0/1861331179 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555d65a46de0 0x555d65a457c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:20.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.413+0000 7faeaa368b80 1 -- 172.21.15.46:0/1861331179 >> 172.21.15.46:0/1861331179 conn(0x555d659ba6d0 msgr2=0x555d65a4dc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:20.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.413+0000 7faeaa368b80 1 -- 172.21.15.46:0/1861331179 shutdown_connections 2023-10-19T12:43:20.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.413+0000 7faeaa368b80 1 -- 172.21.15.46:0/1861331179 wait complete. 2023-10-19T12:43:20.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.413+0000 7faeaa368b80 1 -- start start 2023-10-19T12:43:20.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.413+0000 7faeaa368b80 1 Processor -- start 2023-10-19T12:43:20.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.414+0000 7faeaa368b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555d65a46480 0x555d65a563d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:20.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.414+0000 7faeaa368b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x555d65a46de0 0x555d65a56910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:20.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.414+0000 7faeaa368b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555d65a477a0 0x555d65a56f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:20.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.414+0000 7faeaa368b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d65aaee70 con 0x555d65a46480 2023-10-19T12:43:20.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.414+0000 7faeaa368b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d65aaefb0 con 0x555d65a46de0 2023-10-19T12:43:20.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.414+0000 7faeaa368b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d65aaf0f0 con 0x555d65a477a0 2023-10-19T12:43:20.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.414+0000 7faeaa368b80 10 client.0 _ll_register_callbacks cb 0x555d6587fa30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:43:20.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.414+0000 7fae8ffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555d65a46480 0x555d65a563d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:20.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.414+0000 7fae8f7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x555d65a46de0 0x555d65a56910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:20.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.414+0000 7fae8ffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555d65a46480 0x555d65a563d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57568/0 (socket says 172.21.15.46:57568) 2023-10-19T12:43:20.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.414+0000 7fae8ffff700 1 -- 172.21.15.46:0/4194336432 learned_addr learned my addr 172.21.15.46:0/4194336432 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:43:20.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.414+0000 7fae94f9c700 1 --2- 172.21.15.46:0/4194336432 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555d65a477a0 0x555d65a56f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:20.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.414+0000 7fae8ffff700 1 -- 172.21.15.46:0/4194336432 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555d65a477a0 msgr2=0x555d65a56f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:43:20.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.414+0000 7fae8ffff700 1 --2- 172.21.15.46:0/4194336432 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555d65a477a0 0x555d65a56f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:20.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.414+0000 7fae8ffff700 1 -- 172.21.15.46:0/4194336432 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x555d65a46de0 msgr2=0x555d65a56910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:43:20.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.414+0000 7fae8ffff700 1 --2- 172.21.15.46:0/4194336432 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x555d65a46de0 0x555d65a56910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:20.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.414+0000 7fae8ffff700 1 -- 172.21.15.46:0/4194336432 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555d657c3d90 con 0x555d65a46480 2023-10-19T12:43:20.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.414+0000 7fae94f9c700 1 --2- 172.21.15.46:0/4194336432 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555d65a477a0 0x555d65a56f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T12:43:20.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.414+0000 7fae8f7fe700 1 --2- 172.21.15.46:0/4194336432 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x555d65a46de0 0x555d65a56910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:43:20.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.415+0000 7fae8ffff700 1 --2- 172.21.15.46:0/4194336432 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555d65a46480 0x555d65a563d0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fae80006010 tx=0x7fae80003840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8a67344ad1cbd9b server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:20.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.415+0000 7fae6f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2023-10-19T12:43:20.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.415+0000 7fae6f7fe700 1 -- 172.21.15.46:0/4194336432 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae80022880 con 0x555d65a46480 2023-10-19T12:43:20.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.415+0000 7fae6f7fe700 1 -- 172.21.15.46:0/4194336432 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fae80000e40 con 0x555d65a46480 2023-10-19T12:43:20.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.415+0000 7faeaa368b80 1 -- 172.21.15.46:0/4194336432 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fae8001e040 con 0x555d65a46480 2023-10-19T12:43:20.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.415+0000 7fae6f7fe700 1 -- 172.21.15.46:0/4194336432 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fae80003cd0 con 0x555d65a46480 2023-10-19T12:43:20.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.415+0000 7faeaa368b80 10 client.15519 fetch_fsmap learned FSMap version 27 2023-10-19T12:43:20.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.415+0000 7faeaa368b80 1 -- 172.21.15.46:0/4194336432 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x555d657ea200 con 0x555d65a46480 2023-10-19T12:43:20.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.415+0000 7fae6f7fe700 1 -- 172.21.15.46:0/4194336432 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fae8001e040 con 0x555d65a46480 2023-10-19T12:43:20.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.416+0000 7fae6f7fe700 1 -- 172.21.15.46:0/4194336432 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fae80034040 con 0x555d65a46480 2023-10-19T12:43:20.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.416+0000 7faeaa368b80 10 client.15519 fetch_fsmap finished waiting for FSMap version 27 2023-10-19T12:43:20.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.416+0000 7faeaa368b80 10 client.15519 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-19T12:43:20.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.416+0000 7faeaa368b80 20 client.15519 populate_metadata read hostname 'smithi046' 2023-10-19T12:43:20.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.416+0000 7faeaa368b80 1 --2- 172.21.15.46:0/4194336432 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x555d65ab3ee0 0x555d65ab0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:20.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.416+0000 7faeaa368b80 4 client.15519 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-19T12:43:20.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.416+0000 7faeaa368b80 1 -- 172.21.15.46:0/4194336432 --> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] -- command(tid 0: {"prefix": "status"}) v1 -- 0x555d65991e00 con 0x555d65ab3ee0 2023-10-19T12:43:20.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.416+0000 7fae8f7fe700 1 --2- 172.21.15.46:0/4194336432 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x555d65ab3ee0 0x555d65ab0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:20.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.417+0000 7fae8f7fe700 1 --2- 172.21.15.46:0/4194336432 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x555d65ab3ee0 0x555d65ab0390 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=492be8671e9f346d server_cookie=b21c9c1020241083 in_seq=0 out_seq=0 2023-10-19T12:43:20.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.417+0000 7fae6f7fe700 10 client.15519 ms_handle_connect on v2:172.21.15.157:6838/552718978 2023-10-19T12:43:20.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.417+0000 7fae6f7fe700 1 -- 172.21.15.46:0/4194336432 <== mds.0 v2:172.21.15.157:6838/552718978 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x555d65991e00 con 0x555d65ab3ee0 2023-10-19T12:43:20.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.417+0000 7fae6f7fe700 10 client.15519 handle_command_reply: tid=0 2023-10-19T12:43:20.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.417+0000 7faeaa368b80 1 client.15519 shutdown 2023-10-19T12:43:20.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.417+0000 7faeaa368b80 1 -- 172.21.15.46:0/4194336432 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555d65a46480 msgr2=0x555d65a563d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:20.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.417+0000 7faeaa368b80 1 --2- 172.21.15.46:0/4194336432 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555d65a46480 0x555d65a563d0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fae80006010 tx=0x7fae80003840 comp rx=0 tx=0).stop 2023-10-19T12:43:20.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.417+0000 7faeaa368b80 1 -- 172.21.15.46:0/4194336432 shutdown_connections 2023-10-19T12:43:20.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.417+0000 7faeaa368b80 1 --2- 172.21.15.46:0/4194336432 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555d65a477a0 0x555d65a56f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:20.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.417+0000 7faeaa368b80 1 --2- 172.21.15.46:0/4194336432 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x555d65ab3ee0 0x555d65ab0390 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:20.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.417+0000 7faeaa368b80 1 --2- 172.21.15.46:0/4194336432 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555d65a46480 0x555d65a563d0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:20.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.417+0000 7faeaa368b80 1 --2- 172.21.15.46:0/4194336432 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x555d65a46de0 0x555d65a56910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:20.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.417+0000 7fae6f7fe700 0 client.15519 ms_handle_reset on v2:172.21.15.157:6838/552718978 2023-10-19T12:43:20.434 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.417+0000 7faeaa368b80 1 -- 172.21.15.46:0/4194336432 >> 172.21.15.46:0/4194336432 conn(0x555d659ba6d0 msgr2=0x555d65a5a170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:20.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.417+0000 7faeaa368b80 1 -- 172.21.15.46:0/4194336432 shutdown_connections 2023-10-19T12:43:20.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.417+0000 7faeaa368b80 1 -- 172.21.15.46:0/4194336432 wait complete. 2023-10-19T12:43:20.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.418+0000 7faeaa368b80 20 client.15519 trim_cache size 0 max 16384 2023-10-19T12:43:20.435 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-10-19T12:43:20.436 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_fsid": "96a8be3c-6e7b-11ee-8db6-212e2dc638e7", 2023-10-19T12:43:20.436 INFO:teuthology.orchestra.run.smithi046.stdout: "whoami": 0, 2023-10-19T12:43:20.436 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 24680, 2023-10-19T12:43:20.436 INFO:teuthology.orchestra.run.smithi046.stdout: "want_state": "up:active", 2023-10-19T12:43:20.436 INFO:teuthology.orchestra.run.smithi046.stdout: "state": "up:active", 2023-10-19T12:43:20.436 INFO:teuthology.orchestra.run.smithi046.stdout: "fs_name": "cephfs", 2023-10-19T12:43:20.437 INFO:teuthology.orchestra.run.smithi046.stdout: "rank_uptime": 121.150660931, 2023-10-19T12:43:20.437 INFO:teuthology.orchestra.run.smithi046.stdout: "mdsmap_epoch": 27, 2023-10-19T12:43:20.437 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch": 90, 2023-10-19T12:43:20.437 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch_barrier": 88, 2023-10-19T12:43:20.437 INFO:teuthology.orchestra.run.smithi046.stdout: "uptime": 128.17711370699999 2023-10-19T12:43:20.438 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-10-19T12:43:20.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.418+0000 7fae9579d700 1 -- 172.21.15.46:0/2333437955 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fae780a1480 msgr2=0x7fae780a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:20.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.418+0000 7fae9579d700 1 --2- 172.21.15.46:0/2333437955 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fae780a1480 0x7fae780a3940 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fae88009550 tx=0x7fae8800b040 comp rx=0 tx=0).stop 2023-10-19T12:43:20.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.418+0000 7fae9579d700 1 -- 172.21.15.46:0/2333437955 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fae901017b0 msgr2=0x7fae90198cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:20.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.418+0000 7fae9579d700 1 --2- 172.21.15.46:0/2333437955 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fae901017b0 0x7fae90198cc0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fae8400e9a0 tx=0x7fae8400ecb0 comp rx=0 tx=0).stop 2023-10-19T12:43:20.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.418+0000 7fae9579d700 1 -- 172.21.15.46:0/2333437955 shutdown_connections 2023-10-19T12:43:20.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.418+0000 7fae9579d700 1 --2- 172.21.15.46:0/2333437955 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae90102150 0x7fae9019fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:20.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.418+0000 7fae9579d700 1 --2- 172.21.15.46:0/2333437955 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fae901005c0 0x7fae90198780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:20.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.418+0000 7fae9579d700 1 --2- 172.21.15.46:0/2333437955 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fae780a1480 0x7fae780a3940 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:20.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.418+0000 7fae9579d700 1 --2- 172.21.15.46:0/2333437955 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fae901017b0 0x7fae90198cc0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:20.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.418+0000 7fae9579d700 1 -- 172.21.15.46:0/2333437955 >> 172.21.15.46:0/2333437955 conn(0x7fae900fbb30 msgr2=0x7fae90072a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:20.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.418+0000 7fae9579d700 1 -- 172.21.15.46:0/2333437955 shutdown_connections 2023-10-19T12:43:20.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:20.418+0000 7fae9579d700 1 -- 172.21.15.46:0/2333437955 wait complete. 2023-10-19T12:43:20.441 INFO:teuthology.run_tasks:Running task kclient... 2023-10-19T12:43:20.456 INFO:tasks.kclient:Mounting kernel clients... 2023-10-19T12:43:20.456 INFO:tasks.kclient:config is {'client.0': {}} 2023-10-19T12:43:20.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T12:43:20.457 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list 2023-10-19T12:43:20.502 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-10-19T12:43:20.503 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T12:43:20.503 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-19T12:43:20.614 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T12:43:20.614 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link delete ceph-brx 2023-10-19T12:43:20.721 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=legacy', 'wsync', 'context=system_u:object_r:postgresql_db_t:s0'], 'syntax': 'v2', 'mount_subvol_num': 1, 'mountpoint': '/tmp/cephfs'} 2023-10-19T12:43:20.721 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-19T12:43:20.722 INFO:tasks.cephfs.mount:using client_config["hostfs_mntpt"] = /tmp/cephfs 2023-10-19T12:43:20.722 INFO:tasks.cephfs.mount:hostfs_mntpt = /tmp/cephfs 2023-10-19T12:43:20.722 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph fs ls 2023-10-19T12:43:21.473 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-19T12:43:22.058 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:21 smithi046 ceph-mon[98509]: pgmap v347: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-19T12:43:22.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:21 smithi157 ceph-mon[134109]: pgmap v347: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-19T12:43:22.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:21 smithi195 ceph-mon[134493]: pgmap v347: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-19T12:43:23.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:22.996+0000 7fbf46ab2700 1 -- 172.21.15.46:0/4110772028 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbf401008a0 msgr2=0x7fbf40100d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:23.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:22.996+0000 7fbf46ab2700 1 --2- 172.21.15.46:0/4110772028 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbf401008a0 0x7fbf40100d20 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c009990 tx=0x7fbf2c009ca0 comp rx=0 tx=0).stop 2023-10-19T12:43:23.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:22.996+0000 7fbf46ab2700 1 -- 172.21.15.46:0/4110772028 shutdown_connections 2023-10-19T12:43:23.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:22.996+0000 7fbf46ab2700 1 --2- 172.21.15.46:0/4110772028 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbf40101260 0x7fbf4010d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:23.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:22.996+0000 7fbf46ab2700 1 --2- 172.21.15.46:0/4110772028 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbf401057c0 0x7fbf40105ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:23.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:22.996+0000 7fbf46ab2700 1 --2- 172.21.15.46:0/4110772028 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbf401008a0 0x7fbf40100d20 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:23.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:22.996+0000 7fbf46ab2700 1 -- 172.21.15.46:0/4110772028 >> 172.21.15.46:0/4110772028 conn(0x7fbf400779e0 msgr2=0x7fbf40077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:23.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:22.996+0000 7fbf46ab2700 1 -- 172.21.15.46:0/4110772028 shutdown_connections 2023-10-19T12:43:23.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:22.996+0000 7fbf46ab2700 1 -- 172.21.15.46:0/4110772028 wait complete. 2023-10-19T12:43:23.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:22.997+0000 7fbf46ab2700 1 Processor -- start 2023-10-19T12:43:23.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:22.997+0000 7fbf46ab2700 1 -- start start 2023-10-19T12:43:23.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:22.998+0000 7fbf46ab2700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbf401008a0 0x7fbf40198e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:23.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:22.998+0000 7fbf46ab2700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbf40101260 0x7fbf40199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:23.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:22.998+0000 7fbf46ab2700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbf401057c0 0x7fbf4019d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:23.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:22.998+0000 7fbf46ab2700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4019dd20 con 0x7fbf40101260 2023-10-19T12:43:23.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:22.998+0000 7fbf46ab2700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4019de90 con 0x7fbf401057c0 2023-10-19T12:43:23.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:22.998+0000 7fbf46ab2700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4019e050 con 0x7fbf401008a0 2023-10-19T12:43:23.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:22.998+0000 7fbf4484e700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbf401008a0 0x7fbf40198e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:23.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:22.998+0000 7fbf4484e700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbf401008a0 0x7fbf40198e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:39340/0 (socket says 172.21.15.46:39340) 2023-10-19T12:43:23.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:22.998+0000 7fbf4504f700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbf401057c0 0x7fbf4019d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:23.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:22.998+0000 7fbf4484e700 1 -- 172.21.15.46:0/1427752065 learned_addr learned my addr 172.21.15.46:0/1427752065 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:43:23.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:22.998+0000 7fbf3ffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbf40101260 0x7fbf40199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:23.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:22.999+0000 7fbf4484e700 1 -- 172.21.15.46:0/1427752065 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbf401057c0 msgr2=0x7fbf4019d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:23.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:22.999+0000 7fbf4484e700 1 --2- 172.21.15.46:0/1427752065 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbf401057c0 0x7fbf4019d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:23.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:22.999+0000 7fbf4484e700 1 -- 172.21.15.46:0/1427752065 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbf40101260 msgr2=0x7fbf40199360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:23.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:22.999+0000 7fbf4484e700 1 --2- 172.21.15.46:0/1427752065 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbf40101260 0x7fbf40199360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:23.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:22.999+0000 7fbf4484e700 1 -- 172.21.15.46:0/1427752065 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf2c0095f0 con 0x7fbf401008a0 2023-10-19T12:43:23.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:22.999+0000 7fbf3ffff700 1 --2- 172.21.15.46:0/1427752065 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbf40101260 0x7fbf40199360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:43:23.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:22.999+0000 7fbf4484e700 1 --2- 172.21.15.46:0/1427752065 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbf401008a0 0x7fbf40198e20 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fbf3400d980 tx=0x7fbf3400dc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:23.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:22.999+0000 7fbf3dffb700 1 -- 172.21.15.46:0/1427752065 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf34004020 con 0x7fbf401008a0 2023-10-19T12:43:23.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:22.999+0000 7fbf46ab2700 1 -- 172.21.15.46:0/1427752065 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf4019e330 con 0x7fbf401008a0 2023-10-19T12:43:23.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:22.999+0000 7fbf3dffb700 1 -- 172.21.15.46:0/1427752065 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbf3400f690 con 0x7fbf401008a0 2023-10-19T12:43:23.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:22.999+0000 7fbf3dffb700 1 -- 172.21.15.46:0/1427752065 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf34003a60 con 0x7fbf401008a0 2023-10-19T12:43:23.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:22.999+0000 7fbf46ab2700 1 -- 172.21.15.46:0/1427752065 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf401a5b90 con 0x7fbf401008a0 2023-10-19T12:43:23.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:23.000+0000 7fbf46ab2700 1 -- 172.21.15.46:0/1427752065 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf40101f30 con 0x7fbf401008a0 2023-10-19T12:43:23.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:23.002+0000 7fbf3dffb700 1 -- 172.21.15.46:0/1427752065 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fbf3400fb00 con 0x7fbf401008a0 2023-10-19T12:43:23.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:23.004+0000 7fbf3dffb700 1 --2- 172.21.15.46:0/1427752065 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fbf300a1500 0x7fbf300a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:23.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:23.004+0000 7fbf3dffb700 1 -- 172.21.15.46:0/1427752065 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fbf340ccae0 con 0x7fbf401008a0 2023-10-19T12:43:23.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:23.004+0000 7fbf3ffff700 1 --2- 172.21.15.46:0/1427752065 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fbf300a1500 0x7fbf300a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:23.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:23.004+0000 7fbf3ffff700 1 --2- 172.21.15.46:0/1427752065 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fbf300a1500 0x7fbf300a39c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fbf4019a380 tx=0x7fbf2c00b540 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:23.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:23.006+0000 7fbf3dffb700 1 -- 172.21.15.46:0/1427752065 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fbf34095e50 con 0x7fbf401008a0 2023-10-19T12:43:23.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:23.264+0000 7fbf46ab2700 1 -- 172.21.15.46:0/1427752065 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fbf401107a0 con 0x7fbf401008a0 2023-10-19T12:43:23.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:23.265+0000 7fbf3dffb700 1 -- 172.21.15.46:0/1427752065 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v27) v1 ==== 53+0+88 (secure 0 0 0) 0x7fbf34017070 con 0x7fbf401008a0 2023-10-19T12:43:23.269 INFO:teuthology.orchestra.run.smithi046.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-19T12:43:23.271 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:23.267+0000 7fbf46ab2700 1 -- 172.21.15.46:0/1427752065 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fbf300a1500 msgr2=0x7fbf300a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:23.271 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:23.267+0000 7fbf46ab2700 1 --2- 172.21.15.46:0/1427752065 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fbf300a1500 0x7fbf300a39c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fbf4019a380 tx=0x7fbf2c00b540 comp rx=0 tx=0).stop 2023-10-19T12:43:23.271 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:23.267+0000 7fbf46ab2700 1 -- 172.21.15.46:0/1427752065 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbf401008a0 msgr2=0x7fbf40198e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:23.271 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:23.267+0000 7fbf46ab2700 1 --2- 172.21.15.46:0/1427752065 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbf401008a0 0x7fbf40198e20 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fbf3400d980 tx=0x7fbf3400dc90 comp rx=0 tx=0).stop 2023-10-19T12:43:23.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:23.267+0000 7fbf46ab2700 1 -- 172.21.15.46:0/1427752065 shutdown_connections 2023-10-19T12:43:23.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:23.267+0000 7fbf46ab2700 1 --2- 172.21.15.46:0/1427752065 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbf401057c0 0x7fbf4019d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:23.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:23.267+0000 7fbf46ab2700 1 --2- 172.21.15.46:0/1427752065 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fbf300a1500 0x7fbf300a39c0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:23.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:23.267+0000 7fbf46ab2700 1 --2- 172.21.15.46:0/1427752065 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbf401008a0 0x7fbf40198e20 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:23.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:23.267+0000 7fbf46ab2700 1 --2- 172.21.15.46:0/1427752065 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbf40101260 0x7fbf40199360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:23.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:23.267+0000 7fbf46ab2700 1 -- 172.21.15.46:0/1427752065 >> 172.21.15.46:0/1427752065 conn(0x7fbf400779e0 msgr2=0x7fbf400fe710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:23.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:23.268+0000 7fbf46ab2700 1 -- 172.21.15.46:0/1427752065 shutdown_connections 2023-10-19T12:43:23.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:23.268+0000 7fbf46ab2700 1 -- 172.21.15.46:0/1427752065 wait complete. 2023-10-19T12:43:23.766 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-19T12:43:23.766 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-19T12:43:23.767 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi046.front.sepia.ceph.com 2023-10-19T12:43:23.767 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-19T12:43:23.767 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /tmp/cephfs 2023-10-19T12:43:23.767 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-19T12:43:23.768 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-19T12:43:23.768 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-19T12:43:23.768 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/tmp/cephfs' 2023-10-19T12:43:23.768 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T12:43:23.769 DEBUG:teuthology.orchestra.run.smithi046:> ip addr 2023-10-19T12:43:23.814 INFO:teuthology.orchestra.run.smithi046.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-19T12:43:23.815 INFO:teuthology.orchestra.run.smithi046.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-19T12:43:23.815 INFO:teuthology.orchestra.run.smithi046.stdout: inet 127.0.0.1/8 scope host lo 2023-10-19T12:43:23.815 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-19T12:43:23.815 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 ::1/128 scope host 2023-10-19T12:43:23.816 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-19T12:43:23.816 INFO:teuthology.orchestra.run.smithi046.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-19T12:43:23.816 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:6b:f6:10 brd ff:ff:ff:ff:ff:ff 2023-10-19T12:43:23.816 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp7s0f0 2023-10-19T12:43:23.816 INFO:teuthology.orchestra.run.smithi046.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-19T12:43:23.817 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:6b:f6:11 brd ff:ff:ff:ff:ff:ff 2023-10-19T12:43:23.817 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp7s0f1 2023-10-19T12:43:23.817 INFO:teuthology.orchestra.run.smithi046.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-19T12:43:23.817 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:bd:15:f8 brd ff:ff:ff:ff:ff:ff 2023-10-19T12:43:23.817 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp1s0f0 2023-10-19T12:43:23.818 INFO:teuthology.orchestra.run.smithi046.stdout: inet 172.21.15.46/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-19T12:43:23.818 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft 41528sec preferred_lft 41528sec 2023-10-19T12:43:23.818 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::ec4:7aff:febd:15f8/64 scope link 2023-10-19T12:43:23.818 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2023-10-19T12:43:23.818 INFO:teuthology.orchestra.run.smithi046.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-19T12:43:23.819 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:bd:15:f9 brd ff:ff:ff:ff:ff:ff 2023-10-19T12:43:23.819 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp1s0f1 2023-10-19T12:43:23.820 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-19T12:43:23.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T12:43:23.821 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2023-10-19T12:43:23.821 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2023-10-19T12:43:23.821 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link add name ceph-brx type bridge 2023-10-19T12:43:23.821 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip addr flush dev ceph-brx 2023-10-19T12:43:23.822 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set ceph-brx up 2023-10-19T12:43:23.822 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-19T12:43:23.822 DEBUG:teuthology.orchestra.run.smithi046:> ') 2023-10-19T12:43:23.965 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:23 smithi046 ceph-mon[98509]: pgmap v348: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-19T12:43:23.965 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:23 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/1427752065' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-10-19T12:43:24.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T12:43:24.072 DEBUG:teuthology.orchestra.run.smithi046:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-19T12:43:24.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:23 smithi157 ceph-mon[134109]: pgmap v348: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-19T12:43:24.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:23 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/1427752065' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-10-19T12:43:24.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:23 smithi195 ceph-mon[134493]: pgmap v348: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-19T12:43:24.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:23 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/1427752065' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-10-19T12:43:24.144 INFO:teuthology.orchestra.run.smithi046.stdout:1 2023-10-19T12:43:24.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T12:43:24.148 DEBUG:teuthology.orchestra.run.smithi046:> route 2023-10-19T12:43:24.195 INFO:teuthology.orchestra.run.smithi046.stdout:Kernel IP routing table 2023-10-19T12:43:24.196 INFO:teuthology.orchestra.run.smithi046.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-19T12:43:24.196 INFO:teuthology.orchestra.run.smithi046.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-19T12:43:24.196 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-19T12:43:24.196 INFO:teuthology.orchestra.run.smithi046.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-19T12:43:24.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T12:43:24.198 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2023-10-19T12:43:24.198 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2023-10-19T12:43:24.199 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-19T12:43:24.199 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-19T12:43:24.199 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-19T12:43:24.199 DEBUG:teuthology.orchestra.run.smithi046:> ') 2023-10-19T12:43:24.377 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T12:43:24.378 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list 2023-10-19T12:43:24.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T12:43:24.424 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list-id 2023-10-19T12:43:24.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T12:43:24.509 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2023-10-19T12:43:24.509 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2023-10-19T12:43:24.510 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns add ceph-ns--tmp-cephfs 2023-10-19T12:43:24.510 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns set ceph-ns--tmp-cephfs 0 2023-10-19T12:43:24.510 DEBUG:teuthology.orchestra.run.smithi046:> ') 2023-10-19T12:43:24.698 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--tmp-cephfs' with 192.168.0.1/16 2023-10-19T12:43:24.698 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T12:43:24.699 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2023-10-19T12:43:24.699 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2023-10-19T12:43:24.700 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link add veth0 netns ceph-ns--tmp-cephfs type veth peer name brx.0 2023-10-19T12:43:24.700 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--tmp-cephfs ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-19T12:43:24.700 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--tmp-cephfs ip link set veth0 up 2023-10-19T12:43:24.701 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--tmp-cephfs ip link set lo up 2023-10-19T12:43:24.701 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--tmp-cephfs ip route add default via 192.168.255.254 2023-10-19T12:43:24.701 DEBUG:teuthology.orchestra.run.smithi046:> ') 2023-10-19T12:43:24.953 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T12:43:24.954 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2023-10-19T12:43:24.954 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2023-10-19T12:43:24.954 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set brx.0 up 2023-10-19T12:43:24.955 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set dev brx.0 master ceph-brx 2023-10-19T12:43:24.955 DEBUG:teuthology.orchestra.run.smithi046:> ') 2023-10-19T12:43:25.133 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-19T12:43:25.133 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -p -v /tmp/cephfs 2023-10-19T12:43:25.177 INFO:teuthology.orchestra.run.smithi046.stdout:mkdir: created directory '/tmp/cephfs' 2023-10-19T12:43:25.178 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-19T12:43:25.178 DEBUG:teuthology.orchestra.run.smithi046:> chmod 0000 /tmp/cephfs 2023-10-19T12:43:25.261 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2023-10-19T12:43:25.262 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2023-10-19T12:43:25.262 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/volumes/_nogroup/sv_1/6e0973be-51e9-4268-9cb0-a3e0d00ea81e 2023-10-19T12:43:25.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T12:43:25.263 DEBUG:teuthology.orchestra.run.smithi046:> sudo nsenter --net=/var/run/netns/ceph-ns--tmp-cephfs adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/volumes/_nogroup/sv_1/6e0973be-51e9-4268-9cb0-a3e0d00ea81e /tmp/cephfs -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=legacy,wsync,context=system_u:object_r:postgresql_db_t:s0,nofallback 2023-10-19T12:43:25.412 INFO:teuthology.orchestra.run.smithi046.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=legacy,wsync,context="system_u:object_r:postgresql_db_t:s0",nofallback 2023-10-19T12:43:25.412 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=legacy,wsync,context="system_u:object_r:postgresql_db_t:s0"". 2023-10-19T12:43:25.873 INFO:teuthology.orchestra.run.smithi046.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=legacy,wsync,context="system_u:object_r:postgresql_db_t:s0",nofallback 2023-10-19T12:43:25.874 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=legacy,wsync,context="system_u:object_r:postgresql_db_t:s0"". 2023-10-19T12:43:25.874 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: resolved to: "172.21.15.46:6789,172.21.15.157:6789,172.21.15.195:6789" 2023-10-19T12:43:25.874 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: trying mount with new device syntax: 0@96a8be3c-6e7b-11ee-8db6-212e2dc638e7.cephfs=/volumes/_nogroup/sv_1/6e0973be-51e9-4268-9cb0-a3e0d00ea81e 2023-10-19T12:43:25.874 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=legacy,wsync,context="system_u:object_r:postgresql_db_t:s0",name=0,key=0,mon_addr=172.21.15.46:6789/172.21.15.157:6789/172.21.15.195:6789" will pass to kernel 2023-10-19T12:43:25.882 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-19T12:43:25.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T12:43:25.882 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 1777 /tmp/cephfs 2023-10-19T12:43:25.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T12:43:25.956 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/cephfs && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-19T12:43:26.044 INFO:teuthology.orchestra.run.smithi046.stdout:client25538 2023-10-19T12:43:26.044 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-10-19T12:43:26.045 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-19T12:43:26.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:25 smithi157 ceph-mon[134109]: pgmap v349: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-10-19T12:43:26.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T12:43:26.090 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/cephfs && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-19T12:43:26.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:25 smithi195 ceph-mon[134493]: pgmap v349: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-10-19T12:43:26.216 INFO:teuthology.orchestra.run.smithi046.stdout:client25538 2023-10-19T12:43:26.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T12:43:26.217 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/cephfs && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-19T12:43:26.228 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:25 smithi046 ceph-mon[98509]: pgmap v349: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-10-19T12:43:26.306 INFO:teuthology.orchestra.run.smithi046.stdout:client25538 2023-10-19T12:43:26.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T12:43:26.306 DEBUG:teuthology.orchestra.run.smithi046:> (cd /tmp/cephfs && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7.client25538/status') 2023-10-19T12:43:26.455 INFO:teuthology.orchestra.run.smithi046.stdout:instance: client.25538 (3)172.21.15.46:0/2060268940 2023-10-19T12:43:26.455 INFO:teuthology.orchestra.run.smithi046.stdout:blocklisted: false 2023-10-19T12:43:26.455 INFO:teuthology.orchestra.run.smithi046.stderr:0+1 records in 2023-10-19T12:43:26.456 INFO:teuthology.orchestra.run.smithi046.stderr:0+1 records out 2023-10-19T12:43:26.456 INFO:teuthology.orchestra.run.smithi046.stderr:71 bytes copied, 5.7551e-05 s, 1.2 MB/s 2023-10-19T12:43:26.459 INFO:teuthology.run_tasks:Running task check-counter... 2023-10-19T12:43:26.470 INFO:teuthology.run_tasks:Running task fwd_scrub... 2023-10-19T12:43:26.481 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-19T12:43:26.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:26.684+0000 7f68befff700 1 -- 172.21.15.46:0/255830971 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f68b80747d0 msgr2=0x7f68b8072c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:26.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:26.684+0000 7f68befff700 1 --2- 172.21.15.46:0/255830971 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f68b80747d0 0x7f68b8072c20 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f68ac009990 tx=0x7f68ac009ca0 comp rx=0 tx=0).stop 2023-10-19T12:43:26.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:26.684+0000 7f68befff700 1 -- 172.21.15.46:0/255830971 shutdown_connections 2023-10-19T12:43:26.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:26.684+0000 7f68befff700 1 --2- 172.21.15.46:0/255830971 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f68b8108610 0x7f68b810aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:26.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:26.685+0000 7f68befff700 1 --2- 172.21.15.46:0/255830971 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f68b80747d0 0x7f68b8072c20 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:26.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:26.685+0000 7f68befff700 1 --2- 172.21.15.46:0/255830971 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68b80731f0 0x7f68b8073670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:26.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:26.685+0000 7f68befff700 1 -- 172.21.15.46:0/255830971 >> 172.21.15.46:0/255830971 conn(0x7f68b80fbc90 msgr2=0x7f68b80fe0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:26.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:26.685+0000 7f68befff700 1 -- 172.21.15.46:0/255830971 shutdown_connections 2023-10-19T12:43:26.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:26.685+0000 7f68befff700 1 -- 172.21.15.46:0/255830971 wait complete. 2023-10-19T12:43:26.692 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:26.686+0000 7f68befff700 1 Processor -- start 2023-10-19T12:43:26.692 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:26.686+0000 7f68befff700 1 -- start start 2023-10-19T12:43:26.692 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:26.686+0000 7f68befff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f68b80731f0 0x7f68b8198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:26.692 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:26.686+0000 7f68befff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68b80747d0 0x7f68b8198e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:26.692 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:26.686+0000 7f68befff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f68b8108610 0x7f68b819fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:26.693 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:26.686+0000 7f68befff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b81a0430 con 0x7f68b8108610 2023-10-19T12:43:26.693 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:26.686+0000 7f68befff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b81a0570 con 0x7f68b80747d0 2023-10-19T12:43:26.693 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:26.686+0000 7f68befff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b81a0700 con 0x7f68b80731f0 2023-10-19T12:43:26.693 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:26.687+0000 7f68bd59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f68b8108610 0x7f68b819fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:26.693 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:26.687+0000 7f68bcd9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f68b80731f0 0x7f68b8198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:26.694 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:26.687+0000 7f68bcd9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f68b80731f0 0x7f68b8198950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:39352/0 (socket says 172.21.15.46:39352) 2023-10-19T12:43:26.694 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:26.687+0000 7f68bcd9b700 1 -- 172.21.15.46:0/1533024111 learned_addr learned my addr 172.21.15.46:0/1533024111 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:43:26.694 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:26.687+0000 7f68b7fff700 1 --2- 172.21.15.46:0/1533024111 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68b80747d0 0x7f68b8198e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:26.694 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:26.687+0000 7f68bd59c700 1 -- 172.21.15.46:0/1533024111 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f68b80731f0 msgr2=0x7f68b8198950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:26.694 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:26.687+0000 7f68bd59c700 1 --2- 172.21.15.46:0/1533024111 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f68b80731f0 0x7f68b8198950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:26.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:26.687+0000 7f68bd59c700 1 -- 172.21.15.46:0/1533024111 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68b80747d0 msgr2=0x7f68b8198e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:26.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:26.687+0000 7f68bd59c700 1 --2- 172.21.15.46:0/1533024111 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68b80747d0 0x7f68b8198e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:26.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:26.687+0000 7f68bd59c700 1 -- 172.21.15.46:0/1533024111 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68ac0095f0 con 0x7f68b8108610 2023-10-19T12:43:26.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:26.687+0000 7f68bd59c700 1 --2- 172.21.15.46:0/1533024111 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f68b8108610 0x7f68b819fe60 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f68b000efc0 tx=0x7f68b000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:26.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:26.687+0000 7f68b5ffb700 1 -- 172.21.15.46:0/1533024111 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b0018070 con 0x7f68b8108610 2023-10-19T12:43:26.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:26.687+0000 7f68b5ffb700 1 -- 172.21.15.46:0/1533024111 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f68b000f040 con 0x7f68b8108610 2023-10-19T12:43:26.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:26.687+0000 7f68befff700 1 -- 172.21.15.46:0/1533024111 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68b81a0980 con 0x7f68b8108610 2023-10-19T12:43:26.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:26.688+0000 7f68b5ffb700 1 -- 172.21.15.46:0/1533024111 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b000cd40 con 0x7f68b8108610 2023-10-19T12:43:26.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:26.688+0000 7f68befff700 1 -- 172.21.15.46:0/1533024111 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68b81a0e40 con 0x7f68b8108610 2023-10-19T12:43:26.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:26.689+0000 7f68befff700 1 -- 172.21.15.46:0/1533024111 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68b8107420 con 0x7f68b8108610 2023-10-19T12:43:26.697 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:26.691+0000 7f68b5ffb700 1 -- 172.21.15.46:0/1533024111 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f68b0003a00 con 0x7f68b8108610 2023-10-19T12:43:26.697 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:26.692+0000 7f68b5ffb700 1 --2- 172.21.15.46:0/1533024111 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f68a80a1480 0x7f68a80a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:26.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:26.692+0000 7f68b5ffb700 1 -- 172.21.15.46:0/1533024111 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f68b00ccc70 con 0x7f68b8108610 2023-10-19T12:43:26.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:26.692+0000 7f68bcd9b700 1 --2- 172.21.15.46:0/1533024111 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f68a80a1480 0x7f68a80a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:26.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:26.693+0000 7f68bcd9b700 1 --2- 172.21.15.46:0/1533024111 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f68a80a1480 0x7f68a80a3940 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f68ac00b2e0 tx=0x7f68ac00b750 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:26.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:26.696+0000 7f68b5ffb700 1 -- 172.21.15.46:0/1533024111 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f68b0095ff0 con 0x7f68b8108610 2023-10-19T12:43:26.915 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:26.912+0000 7f68befff700 1 -- 172.21.15.46:0/1533024111 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f68b8067530 con 0x7f68b8108610 2023-10-19T12:43:26.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:26.914+0000 7f68b5ffb700 1 -- 172.21.15.46:0/1533024111 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+24481 (secure 0 0 0) 0x7f68b0099610 con 0x7f68b8108610 2023-10-19T12:43:26.918 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:43:26.918 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":90,"fsid":"96a8be3c-6e7b-11ee-8db6-212e2dc638e7","created":"2023-10-19T12:33:26.148713+0000","modified":"2023-10-19T12:42:28.113339+0000","last_up_change":"2023-10-19T12:40:30.761679+0000","last_in_change":"2023-10-19T12:40:13.663559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-19T12:37:07.175795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-19T12:41:16.895203+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-19T12:41:18.255601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-19T12:41:21.830455+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"346ce86b-a10a-4869-9fdb-c3c1d4161455","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6803","nonce":500237995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6805","nonce":500237995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6809","nonce":500237995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6807","nonce":500237995}]},"public_addr":"172.21.15.46:6803/500237995","cluster_addr":"172.21.15.46:6805/500237995","heartbeat_back_addr":"172.21.15.46:6809/500237995","heartbeat_front_addr":"172.21.15.46:6807/500237995","state":["exists","up"]},{"osd":1,"uuid":"02aae687-76c5-4124-bae4-9787ed571c28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6801","nonce":2496862790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6803","nonce":2496862790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6807","nonce":2496862790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6805","nonce":2496862790}]},"public_addr":"172.21.15.157:6801/2496862790","cluster_addr":"172.21.15.157:6803/2496862790","heartbeat_back_addr":"172.21.15.157:6807/2496862790","heartbeat_front_addr":"172.21.15.157:6805/2496862790","state":["exists","up"]},{"osd":2,"uuid":"d5360828-1f58-4380-b2ad-0c21ff850981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6801","nonce":4211767276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6803","nonce":4211767276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6807","nonce":4211767276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6805","nonce":4211767276}]},"public_addr":"172.21.15.195:6801/4211767276","cluster_addr":"172.21.15.195:6803/4211767276","heartbeat_back_addr":"172.21.15.195:6807/4211767276","heartbeat_front_addr":"172.21.15.195:6805/4211767276","state":["exists","up"]},{"osd":3,"uuid":"accb780f-49d0-43f8-b166-ee12c558ef00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6811","nonce":1964113352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6813","nonce":1964113352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6817","nonce":1964113352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6815","nonce":1964113352}]},"public_addr":"172.21.15.46:6811/1964113352","cluster_addr":"172.21.15.46:6813/1964113352","heartbeat_back_addr":"172.21.15.46:6817/1964113352","heartbeat_front_addr":"172.21.15.46:6815/1964113352","state":["exists","up"]},{"osd":4,"uuid":"e662886d-e989-4d02-8c1f-3c4671352b0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6809","nonce":3636910144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6811","nonce":3636910144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6815","nonce":3636910144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6813","nonce":3636910144}]},"public_addr":"172.21.15.157:6809/3636910144","cluster_addr":"172.21.15.157:6811/3636910144","heartbeat_back_addr":"172.21.15.157:6815/3636910144","heartbeat_front_addr":"172.21.15.157:6813/3636910144","state":["exists","up"]},{"osd":5,"uuid":"9597e0ce-14ea-407d-90fe-f74bccee38b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6809","nonce":4071287969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6811","nonce":4071287969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6815","nonce":4071287969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6813","nonce":4071287969}]},"public_addr":"172.21.15.195:6809/4071287969","cluster_addr":"172.21.15.195:6811/4071287969","heartbeat_back_addr":"172.21.15.195:6815/4071287969","heartbeat_front_addr":"172.21.15.195:6813/4071287969","state":["exists","up"]},{"osd":6,"uuid":"6b78ba38-f60e-4cb6-b01c-cecc1820e8e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6819","nonce":1842285555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6821","nonce":1842285555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6825","nonce":1842285555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6823","nonce":1842285555}]},"public_addr":"172.21.15.46:6819/1842285555","cluster_addr":"172.21.15.46:6821/1842285555","heartbeat_back_addr":"172.21.15.46:6825/1842285555","heartbeat_front_addr":"172.21.15.46:6823/1842285555","state":["exists","up"]},{"osd":7,"uuid":"59a0899f-3bcd-4db2-b544-24df3a536749","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6817","nonce":3498672588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6819","nonce":3498672588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6823","nonce":3498672588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6821","nonce":3498672588}]},"public_addr":"172.21.15.157:6817/3498672588","cluster_addr":"172.21.15.157:6819/3498672588","heartbeat_back_addr":"172.21.15.157:6823/3498672588","heartbeat_front_addr":"172.21.15.157:6821/3498672588","state":["exists","up"]},{"osd":8,"uuid":"9c3c9835-043a-4fb5-a9ee-edf8caf6b605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6817","nonce":74230104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6819","nonce":74230104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6823","nonce":74230104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6821","nonce":74230104}]},"public_addr":"172.21.15.195:6817/74230104","cluster_addr":"172.21.15.195:6819/74230104","heartbeat_back_addr":"172.21.15.195:6823/74230104","heartbeat_front_addr":"172.21.15.195:6821/74230104","state":["exists","up"]},{"osd":9,"uuid":"3f18f506-a577-4b7c-ae0d-9351c07e81f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6827","nonce":3472581046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6829","nonce":3472581046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6833","nonce":3472581046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6831","nonce":3472581046}]},"public_addr":"172.21.15.46:6827/3472581046","cluster_addr":"172.21.15.46:6829/3472581046","heartbeat_back_addr":"172.21.15.46:6833/3472581046","heartbeat_front_addr":"172.21.15.46:6831/3472581046","state":["exists","up"]},{"osd":10,"uuid":"1ed01854-443a-4acf-9293-7ca0d451a93d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6825","nonce":2378416559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6827","nonce":2378416559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6831","nonce":2378416559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6829","nonce":2378416559}]},"public_addr":"172.21.15.157:6825/2378416559","cluster_addr":"172.21.15.157:6827/2378416559","heartbeat_back_addr":"172.21.15.157:6831/2378416559","heartbeat_front_addr":"172.21.15.157:6829/2378416559","state":["exists","up"]},{"osd":11,"uuid":"021398c0-9184-4647-8220-e40f6705ca90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6825","nonce":3075632222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6827","nonce":3075632222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6831","nonce":3075632222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6829","nonce":3075632222}]},"public_addr":"172.21.15.195:6825/3075632222","cluster_addr":"172.21.15.195:6827/3075632222","heartbeat_back_addr":"172.21.15.195:6831/3075632222","heartbeat_front_addr":"172.21.15.195:6829/3075632222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:36:22.002614+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:36:44.098031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:37:04.518341+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:37:30.796462+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:37:52.756555+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:38:13.403168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:38:39.058472+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:39:01.106893+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:39:21.908334+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:39:46.843884+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:40:08.792020+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:40:29.282974+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":3,"to":6}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.39","mappings":[{"from":5,"to":8}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.46:0/3248595150":"2023-10-20T12:34:26.552115+0000","172.21.15.46:0/3624849341":"2023-10-20T12:34:26.552115+0000","172.21.15.46:0/1844094590":"2023-10-20T12:34:26.552115+0000","172.21.15.46:6801/20022894":"2023-10-20T12:34:26.552115+0000","172.21.15.46:0/3969790632":"2023-10-20T12:34:00.135248+0000","172.21.15.46:0/2331135821":"2023-10-20T12:34:00.135248+0000","172.21.15.46:6800/51664346":"2023-10-20T12:34:00.135248+0000","172.21.15.46:6801/51664346":"2023-10-20T12:34:00.135248+0000","172.21.15.46:0/585851467":"2023-10-20T12:34:00.135248+0000","172.21.15.46:6800/20022894":"2023-10-20T12:34:26.552115+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-19T12:43:26.920 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:26.917+0000 7f68befff700 1 -- 172.21.15.46:0/1533024111 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f68a80a1480 msgr2=0x7f68a80a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:26.920 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:26.917+0000 7f68befff700 1 --2- 172.21.15.46:0/1533024111 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f68a80a1480 0x7f68a80a3940 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f68ac00b2e0 tx=0x7f68ac00b750 comp rx=0 tx=0).stop 2023-10-19T12:43:26.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:26.917+0000 7f68befff700 1 -- 172.21.15.46:0/1533024111 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f68b8108610 msgr2=0x7f68b819fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:26.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:26.917+0000 7f68befff700 1 --2- 172.21.15.46:0/1533024111 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f68b8108610 0x7f68b819fe60 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f68b000efc0 tx=0x7f68b000c3a0 comp rx=0 tx=0).stop 2023-10-19T12:43:26.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:26.917+0000 7f68befff700 1 -- 172.21.15.46:0/1533024111 shutdown_connections 2023-10-19T12:43:26.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:26.917+0000 7f68befff700 1 --2- 172.21.15.46:0/1533024111 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f68b8108610 0x7f68b819fe60 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:26.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:26.917+0000 7f68befff700 1 --2- 172.21.15.46:0/1533024111 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f68a80a1480 0x7f68a80a3940 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:26.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:26.917+0000 7f68befff700 1 --2- 172.21.15.46:0/1533024111 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f68b80731f0 0x7f68b8198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:26.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:26.917+0000 7f68befff700 1 --2- 172.21.15.46:0/1533024111 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68b80747d0 0x7f68b8198e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:26.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:26.917+0000 7f68befff700 1 -- 172.21.15.46:0/1533024111 >> 172.21.15.46:0/1533024111 conn(0x7f68b80fbc90 msgr2=0x7f68b8104560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:26.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:26.917+0000 7f68befff700 1 -- 172.21.15.46:0/1533024111 shutdown_connections 2023-10-19T12:43:26.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:26.917+0000 7f68befff700 1 -- 172.21.15.46:0/1533024111 wait complete. 2023-10-19T12:43:26.939 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-19T12:37:07.175795+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-19T12:41:16.895203+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-19T12:41:18.255601+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-19T12:41:21.830455+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-19T12:43:26.940 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-19T12:43:27.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.147+0000 7fe9173ff700 1 -- 172.21.15.46:0/1406242026 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe910102330 msgr2=0x7fe910108be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:27.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.147+0000 7fe9173ff700 1 --2- 172.21.15.46:0/1406242026 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe910102330 0x7fe910108be0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fe90800b0d0 tx=0x7fe90800b3e0 comp rx=0 tx=0).stop 2023-10-19T12:43:27.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.147+0000 7fe9173ff700 1 -- 172.21.15.46:0/1406242026 shutdown_connections 2023-10-19T12:43:27.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.147+0000 7fe9173ff700 1 --2- 172.21.15.46:0/1406242026 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe910102330 0x7fe910108be0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:27.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.147+0000 7fe9173ff700 1 --2- 172.21.15.46:0/1406242026 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe9101007a0 0x7fe910100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:27.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.147+0000 7fe9173ff700 1 --2- 172.21.15.46:0/1406242026 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe910101990 0x7fe910101df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:27.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.147+0000 7fe9173ff700 1 -- 172.21.15.46:0/1406242026 >> 172.21.15.46:0/1406242026 conn(0x7fe9100fbcf0 msgr2=0x7fe9100fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:27.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.147+0000 7fe9173ff700 1 -- 172.21.15.46:0/1406242026 shutdown_connections 2023-10-19T12:43:27.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.147+0000 7fe9173ff700 1 -- 172.21.15.46:0/1406242026 wait complete. 2023-10-19T12:43:27.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.148+0000 7fe9173ff700 1 Processor -- start 2023-10-19T12:43:27.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.148+0000 7fe9173ff700 1 -- start start 2023-10-19T12:43:27.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.148+0000 7fe9173ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9101007a0 0x7fe910074550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:27.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.148+0000 7fe9173ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe910101990 0x7fe910072be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:27.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.148+0000 7fe9173ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe910102330 0x7fe910073120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:27.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.148+0000 7fe9173ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9100738c0 con 0x7fe910102330 2023-10-19T12:43:27.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.148+0000 7fe9173ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe910073a30 con 0x7fe910101990 2023-10-19T12:43:27.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.148+0000 7fe9173ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9101a0890 con 0x7fe9101007a0 2023-10-19T12:43:27.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.149+0000 7fe91599c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe910102330 0x7fe910073120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:27.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.149+0000 7fe91599c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe910102330 0x7fe910073120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60600/0 (socket says 172.21.15.46:60600) 2023-10-19T12:43:27.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.149+0000 7fe91519b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9101007a0 0x7fe910074550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:27.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.149+0000 7fe91599c700 1 -- 172.21.15.46:0/3353192179 learned_addr learned my addr 172.21.15.46:0/3353192179 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:43:27.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.149+0000 7fe91499a700 1 --2- 172.21.15.46:0/3353192179 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe910101990 0x7fe910072be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:27.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.149+0000 7fe91599c700 1 -- 172.21.15.46:0/3353192179 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9101007a0 msgr2=0x7fe910074550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:27.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.149+0000 7fe91599c700 1 --2- 172.21.15.46:0/3353192179 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9101007a0 0x7fe910074550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:27.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.149+0000 7fe91599c700 1 -- 172.21.15.46:0/3353192179 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe910101990 msgr2=0x7fe910072be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:27.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.149+0000 7fe91599c700 1 --2- 172.21.15.46:0/3353192179 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe910101990 0x7fe910072be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:27.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.149+0000 7fe91599c700 1 -- 172.21.15.46:0/3353192179 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe90c009520 con 0x7fe910102330 2023-10-19T12:43:27.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.149+0000 7fe91599c700 1 --2- 172.21.15.46:0/3353192179 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe910102330 0x7fe910073120 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fe908007b60 tx=0x7fe908008e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:27.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.150+0000 7fe9067fc700 1 -- 172.21.15.46:0/3353192179 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe90800e040 con 0x7fe910102330 2023-10-19T12:43:27.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.150+0000 7fe9067fc700 1 -- 172.21.15.46:0/3353192179 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe90801d930 con 0x7fe910102330 2023-10-19T12:43:27.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.150+0000 7fe9173ff700 1 -- 172.21.15.46:0/3353192179 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe908009d00 con 0x7fe910102330 2023-10-19T12:43:27.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.150+0000 7fe9067fc700 1 -- 172.21.15.46:0/3353192179 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe90801b9f0 con 0x7fe910102330 2023-10-19T12:43:27.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.150+0000 7fe9173ff700 1 -- 172.21.15.46:0/3353192179 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9101a0d50 con 0x7fe910102330 2023-10-19T12:43:27.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.151+0000 7fe9173ff700 1 -- 172.21.15.46:0/3353192179 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe910107b70 con 0x7fe910102330 2023-10-19T12:43:27.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.153+0000 7fe9067fc700 1 -- 172.21.15.46:0/3353192179 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fe90801daa0 con 0x7fe910102330 2023-10-19T12:43:27.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.154+0000 7fe9067fc700 1 --2- 172.21.15.46:0/3353192179 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fe8fc0a1480 0x7fe8fc0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:27.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.154+0000 7fe9067fc700 1 -- 172.21.15.46:0/3353192179 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fe9080ce490 con 0x7fe910102330 2023-10-19T12:43:27.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.154+0000 7fe91519b700 1 --2- 172.21.15.46:0/3353192179 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fe8fc0a1480 0x7fe8fc0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:27.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.155+0000 7fe91519b700 1 --2- 172.21.15.46:0/3353192179 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fe8fc0a1480 0x7fe8fc0a3940 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe9101017f0 tx=0x7fe90c009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:27.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.158+0000 7fe9067fc700 1 -- 172.21.15.46:0/3353192179 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fe908097810 con 0x7fe910102330 2023-10-19T12:43:27.377 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.374+0000 7fe9173ff700 1 -- 172.21.15.46:0/3353192179 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe910107550 con 0x7fe910102330 2023-10-19T12:43:27.378 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.375+0000 7fe9067fc700 1 -- 172.21.15.46:0/3353192179 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v90) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe90809ae30 con 0x7fe910102330 2023-10-19T12:43:27.379 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2023-10-19T12:43:27.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.377+0000 7fe9173ff700 1 -- 172.21.15.46:0/3353192179 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fe8fc0a1480 msgr2=0x7fe8fc0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:27.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.377+0000 7fe9173ff700 1 --2- 172.21.15.46:0/3353192179 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fe8fc0a1480 0x7fe8fc0a3940 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe9101017f0 tx=0x7fe90c009260 comp rx=0 tx=0).stop 2023-10-19T12:43:27.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.377+0000 7fe9173ff700 1 -- 172.21.15.46:0/3353192179 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe910102330 msgr2=0x7fe910073120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:27.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.377+0000 7fe9173ff700 1 --2- 172.21.15.46:0/3353192179 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe910102330 0x7fe910073120 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fe908007b60 tx=0x7fe908008e40 comp rx=0 tx=0).stop 2023-10-19T12:43:27.382 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.377+0000 7fe9173ff700 1 -- 172.21.15.46:0/3353192179 shutdown_connections 2023-10-19T12:43:27.382 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.377+0000 7fe9173ff700 1 --2- 172.21.15.46:0/3353192179 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe910102330 0x7fe910073120 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:27.382 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.377+0000 7fe9173ff700 1 --2- 172.21.15.46:0/3353192179 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fe8fc0a1480 0x7fe8fc0a3940 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:27.382 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.377+0000 7fe9173ff700 1 --2- 172.21.15.46:0/3353192179 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9101007a0 0x7fe910074550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:27.382 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.377+0000 7fe9173ff700 1 --2- 172.21.15.46:0/3353192179 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe910101990 0x7fe910072be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:27.383 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.377+0000 7fe9173ff700 1 -- 172.21.15.46:0/3353192179 >> 172.21.15.46:0/3353192179 conn(0x7fe9100fbcf0 msgr2=0x7fe910104cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:27.383 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.377+0000 7fe9173ff700 1 -- 172.21.15.46:0/3353192179 shutdown_connections 2023-10-19T12:43:27.383 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.377+0000 7fe9173ff700 1 -- 172.21.15.46:0/3353192179 wait complete. 2023-10-19T12:43:27.400 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-19T12:43:27.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.605+0000 7f99021ff700 1 -- 172.21.15.46:0/317716514 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98fc101990 msgr2=0x7f98fc101df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:27.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.605+0000 7f99021ff700 1 --2- 172.21.15.46:0/317716514 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98fc101990 0x7f98fc101df0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f98f00099c0 tx=0x7f98f0009cd0 comp rx=0 tx=0).stop 2023-10-19T12:43:27.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.605+0000 7f99021ff700 1 -- 172.21.15.46:0/317716514 shutdown_connections 2023-10-19T12:43:27.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.605+0000 7f99021ff700 1 --2- 172.21.15.46:0/317716514 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98fc102330 0x7f98fc108be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:27.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.605+0000 7f99021ff700 1 --2- 172.21.15.46:0/317716514 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f98fc1007a0 0x7f98fc100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:27.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.605+0000 7f99021ff700 1 --2- 172.21.15.46:0/317716514 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98fc101990 0x7f98fc101df0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:27.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.605+0000 7f99021ff700 1 -- 172.21.15.46:0/317716514 >> 172.21.15.46:0/317716514 conn(0x7f98fc0fbcf0 msgr2=0x7f98fc0fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:27.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.605+0000 7f99021ff700 1 -- 172.21.15.46:0/317716514 shutdown_connections 2023-10-19T12:43:27.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.605+0000 7f99021ff700 1 -- 172.21.15.46:0/317716514 wait complete. 2023-10-19T12:43:27.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.606+0000 7f99021ff700 1 Processor -- start 2023-10-19T12:43:27.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.607+0000 7f99021ff700 1 -- start start 2023-10-19T12:43:27.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.607+0000 7f99021ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98fc1007a0 0x7f98fc074550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:27.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.607+0000 7f99021ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f98fc101990 0x7f98fc072be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:27.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.607+0000 7f99021ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98fc102330 0x7f98fc073120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:27.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.607+0000 7f99021ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98fc0738c0 con 0x7f98fc102330 2023-10-19T12:43:27.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.607+0000 7f99021ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98fc073a30 con 0x7f98fc101990 2023-10-19T12:43:27.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.607+0000 7f99021ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98fc1a0760 con 0x7f98fc1007a0 2023-10-19T12:43:27.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.607+0000 7f98fbfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98fc102330 0x7f98fc073120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:27.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.607+0000 7f98faffd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f98fc101990 0x7f98fc072be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:27.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.607+0000 7f98fb7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98fc1007a0 0x7f98fc074550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:27.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.607+0000 7f98fbfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98fc102330 0x7f98fc073120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60626/0 (socket says 172.21.15.46:60626) 2023-10-19T12:43:27.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.607+0000 7f98fbfff700 1 -- 172.21.15.46:0/2993636987 learned_addr learned my addr 172.21.15.46:0/2993636987 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:43:27.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.608+0000 7f98faffd700 1 -- 172.21.15.46:0/2993636987 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98fc1007a0 msgr2=0x7f98fc074550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:27.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.608+0000 7f98faffd700 1 --2- 172.21.15.46:0/2993636987 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98fc1007a0 0x7f98fc074550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:27.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.608+0000 7f98faffd700 1 -- 172.21.15.46:0/2993636987 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98fc102330 msgr2=0x7f98fc073120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:27.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.608+0000 7f98faffd700 1 --2- 172.21.15.46:0/2993636987 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98fc102330 0x7f98fc073120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:27.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.608+0000 7f98faffd700 1 -- 172.21.15.46:0/2993636987 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98f00095f0 con 0x7f98fc101990 2023-10-19T12:43:27.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.608+0000 7f98fbfff700 1 --2- 172.21.15.46:0/2993636987 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98fc102330 0x7f98fc073120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:43:27.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.608+0000 7f98faffd700 1 --2- 172.21.15.46:0/2993636987 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f98fc101990 0x7f98fc072be0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f98f00098e0 tx=0x7f98f000fa00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:27.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.608+0000 7f98f8ff9700 1 -- 172.21.15.46:0/2993636987 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f001d070 con 0x7f98fc101990 2023-10-19T12:43:27.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.608+0000 7f98f8ff9700 1 -- 172.21.15.46:0/2993636987 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f98f000bda0 con 0x7f98fc101990 2023-10-19T12:43:27.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.608+0000 7f99021ff700 1 -- 172.21.15.46:0/2993636987 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98fc1a0990 con 0x7f98fc101990 2023-10-19T12:43:27.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.608+0000 7f98f8ff9700 1 -- 172.21.15.46:0/2993636987 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f00173f0 con 0x7f98fc101990 2023-10-19T12:43:27.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.608+0000 7f99021ff700 1 -- 172.21.15.46:0/2993636987 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98fc1a0d50 con 0x7f98fc101990 2023-10-19T12:43:27.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.609+0000 7f99021ff700 1 -- 172.21.15.46:0/2993636987 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98fc107c40 con 0x7f98fc101990 2023-10-19T12:43:27.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.611+0000 7f98f8ff9700 1 -- 172.21.15.46:0/2993636987 <== mon.2 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f98f0022470 con 0x7f98fc101990 2023-10-19T12:43:27.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.613+0000 7f98f8ff9700 1 --2- 172.21.15.46:0/2993636987 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f98e40a1480 0x7f98e40a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:27.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.613+0000 7f98f8ff9700 1 -- 172.21.15.46:0/2993636987 <== mon.2 v2:172.21.15.157:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f98f00ce970 con 0x7f98fc101990 2023-10-19T12:43:27.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.613+0000 7f98fb7fe700 1 --2- 172.21.15.46:0/2993636987 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f98e40a1480 0x7f98e40a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:27.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.614+0000 7f98fb7fe700 1 --2- 172.21.15.46:0/2993636987 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f98e40a1480 0x7f98e40a3940 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f98fc1017f0 tx=0x7f98ec009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:27.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.615+0000 7f98f8ff9700 1 -- 172.21.15.46:0/2993636987 <== mon.2 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f98f0097cf0 con 0x7f98fc101990 2023-10-19T12:43:27.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.832+0000 7f99021ff700 1 -- 172.21.15.46:0/2993636987 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f98fc10c000 con 0x7f98fc101990 2023-10-19T12:43:27.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.832+0000 7f98f8ff9700 1 -- 172.21.15.46:0/2993636987 <== mon.2 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v91) v1 ==== 104+0+11 (secure 0 0 0) 0x7f98f009b310 con 0x7f98fc101990 2023-10-19T12:43:27.836 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2023-10-19T12:43:27.838 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.835+0000 7f99021ff700 1 -- 172.21.15.46:0/2993636987 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f98e40a1480 msgr2=0x7f98e40a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:27.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.835+0000 7f99021ff700 1 --2- 172.21.15.46:0/2993636987 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f98e40a1480 0x7f98e40a3940 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f98fc1017f0 tx=0x7f98ec009260 comp rx=0 tx=0).stop 2023-10-19T12:43:27.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.835+0000 7f99021ff700 1 -- 172.21.15.46:0/2993636987 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f98fc101990 msgr2=0x7f98fc072be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:27.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.835+0000 7f99021ff700 1 --2- 172.21.15.46:0/2993636987 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f98fc101990 0x7f98fc072be0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f98f00098e0 tx=0x7f98f000fa00 comp rx=0 tx=0).stop 2023-10-19T12:43:27.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.835+0000 7f99021ff700 1 -- 172.21.15.46:0/2993636987 shutdown_connections 2023-10-19T12:43:27.839 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.835+0000 7f99021ff700 1 --2- 172.21.15.46:0/2993636987 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98fc102330 0x7f98fc073120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:27.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.835+0000 7f99021ff700 1 --2- 172.21.15.46:0/2993636987 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f98e40a1480 0x7f98e40a3940 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:27.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.835+0000 7f99021ff700 1 --2- 172.21.15.46:0/2993636987 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98fc1007a0 0x7f98fc074550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:27.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.835+0000 7f99021ff700 1 --2- 172.21.15.46:0/2993636987 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f98fc101990 0x7f98fc072be0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:27.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.835+0000 7f99021ff700 1 -- 172.21.15.46:0/2993636987 >> 172.21.15.46:0/2993636987 conn(0x7f98fc0fbcf0 msgr2=0x7f98fc104d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:27.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.835+0000 7f99021ff700 1 -- 172.21.15.46:0/2993636987 shutdown_connections 2023-10-19T12:43:27.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:27.835+0000 7f99021ff700 1 -- 172.21.15.46:0/2993636987 wait complete. 2023-10-19T12:43:27.857 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-19T12:43:28.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.062+0000 7fcfe45ff700 1 -- 172.21.15.46:0/3062822889 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcfdc102330 msgr2=0x7fcfdc108be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:28.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.062+0000 7fcfe45ff700 1 --2- 172.21.15.46:0/3062822889 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcfdc102330 0x7fcfdc108be0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fcfd400b0d0 tx=0x7fcfd400b3e0 comp rx=0 tx=0).stop 2023-10-19T12:43:28.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.062+0000 7fcfe45ff700 1 -- 172.21.15.46:0/3062822889 shutdown_connections 2023-10-19T12:43:28.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.062+0000 7fcfe45ff700 1 --2- 172.21.15.46:0/3062822889 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcfdc102330 0x7fcfdc108be0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:28.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.062+0000 7fcfe45ff700 1 --2- 172.21.15.46:0/3062822889 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcfdc1007a0 0x7fcfdc100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:28.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.062+0000 7fcfe45ff700 1 --2- 172.21.15.46:0/3062822889 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcfdc101990 0x7fcfdc101df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:28.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.062+0000 7fcfe45ff700 1 -- 172.21.15.46:0/3062822889 >> 172.21.15.46:0/3062822889 conn(0x7fcfdc0fbcf0 msgr2=0x7fcfdc0fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:28.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.063+0000 7fcfe45ff700 1 -- 172.21.15.46:0/3062822889 shutdown_connections 2023-10-19T12:43:28.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.063+0000 7fcfe45ff700 1 -- 172.21.15.46:0/3062822889 wait complete. 2023-10-19T12:43:28.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.064+0000 7fcfe45ff700 1 Processor -- start 2023-10-19T12:43:28.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.064+0000 7fcfe45ff700 1 -- start start 2023-10-19T12:43:28.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.064+0000 7fcfe45ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcfdc1007a0 0x7fcfdc1989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:28.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.064+0000 7fcfe45ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcfdc101990 0x7fcfdc198f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:28.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.064+0000 7fcfe45ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcfdc102330 0x7fcfdc19ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:28.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.064+0000 7fcfe45ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfdc1a0520 con 0x7fcfdc1007a0 2023-10-19T12:43:28.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.064+0000 7fcfe45ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfdc1a0660 con 0x7fcfdc102330 2023-10-19T12:43:28.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.064+0000 7fcfe45ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfdc1a07f0 con 0x7fcfdc101990 2023-10-19T12:43:28.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.064+0000 7fcfe239b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcfdc1007a0 0x7fcfdc1989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:28.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.064+0000 7fcfe239b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcfdc1007a0 0x7fcfdc1989f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60644/0 (socket says 172.21.15.46:60644) 2023-10-19T12:43:28.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.064+0000 7fcfe239b700 1 -- 172.21.15.46:0/3392874359 learned_addr learned my addr 172.21.15.46:0/3392874359 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:43:28.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.065+0000 7fcfe2b9c700 1 --2- 172.21.15.46:0/3392874359 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcfdc102330 0x7fcfdc19ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:28.073 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.065+0000 7fcfe1b9a700 1 --2- 172.21.15.46:0/3392874359 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcfdc101990 0x7fcfdc198f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:28.073 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.065+0000 7fcfe239b700 1 -- 172.21.15.46:0/3392874359 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcfdc101990 msgr2=0x7fcfdc198f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:28.073 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.065+0000 7fcfe239b700 1 --2- 172.21.15.46:0/3392874359 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcfdc101990 0x7fcfdc198f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:28.073 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.065+0000 7fcfe239b700 1 -- 172.21.15.46:0/3392874359 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcfdc102330 msgr2=0x7fcfdc19ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:28.073 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.065+0000 7fcfe239b700 1 --2- 172.21.15.46:0/3392874359 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcfdc102330 0x7fcfdc19ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:28.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.065+0000 7fcfe239b700 1 -- 172.21.15.46:0/3392874359 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfd4009d00 con 0x7fcfdc1007a0 2023-10-19T12:43:28.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.065+0000 7fcfe2b9c700 1 --2- 172.21.15.46:0/3392874359 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcfdc102330 0x7fcfdc19ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T12:43:28.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.065+0000 7fcfe239b700 1 --2- 172.21.15.46:0/3392874359 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcfdc1007a0 0x7fcfdc1989f0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fcfd800e970 tx=0x7fcfd800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:28.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.065+0000 7fcfd37fe700 1 -- 172.21.15.46:0/3392874359 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd8009790 con 0x7fcfdc1007a0 2023-10-19T12:43:28.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.065+0000 7fcfd37fe700 1 -- 172.21.15.46:0/3392874359 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcfd800eec0 con 0x7fcfdc1007a0 2023-10-19T12:43:28.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.065+0000 7fcfd37fe700 1 -- 172.21.15.46:0/3392874359 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd8003cf0 con 0x7fcfdc1007a0 2023-10-19T12:43:28.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.065+0000 7fcfe45ff700 1 -- 172.21.15.46:0/3392874359 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfdc1a0ad0 con 0x7fcfdc1007a0 2023-10-19T12:43:28.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.066+0000 7fcfe45ff700 1 -- 172.21.15.46:0/3392874359 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfdc1a0f90 con 0x7fcfdc1007a0 2023-10-19T12:43:28.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.066+0000 7fcfe45ff700 1 -- 172.21.15.46:0/3392874359 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfdc0675a0 con 0x7fcfdc1007a0 2023-10-19T12:43:28.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.068+0000 7fcfd37fe700 1 -- 172.21.15.46:0/3392874359 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fcfd800ccd0 con 0x7fcfdc1007a0 2023-10-19T12:43:28.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.070+0000 7fcfd37fe700 1 --2- 172.21.15.46:0/3392874359 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fcfc80a1480 0x7fcfc80a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:28.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.070+0000 7fcfd37fe700 1 -- 172.21.15.46:0/3392874359 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9202+0+0 (secure 0 0 0) 0x7fcfd8014070 con 0x7fcfdc1007a0 2023-10-19T12:43:28.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.070+0000 7fcfe1b9a700 1 --2- 172.21.15.46:0/3392874359 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fcfc80a1480 0x7fcfc80a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:28.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.071+0000 7fcfe1b9a700 1 --2- 172.21.15.46:0/3392874359 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fcfc80a1480 0x7fcfc80a3940 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc009c60 tx=0x7fcfcc009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:28.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.074+0000 7fcfd37fe700 1 -- 172.21.15.46:0/3392874359 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fcfd80965d0 con 0x7fcfdc1007a0 2023-10-19T12:43:28.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:27 smithi157 ceph-mon[134109]: pgmap v350: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-19T12:43:28.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:27 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/1533024111' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-19T12:43:28.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:27 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]: dispatch 2023-10-19T12:43:28.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:27 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 7]}]: dispatch 2023-10-19T12:43:28.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:27 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [3, 6, 5, 9]}]: dispatch 2023-10-19T12:43:28.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:27 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [5, 8]}]: dispatch 2023-10-19T12:43:28.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:27 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [9, 10]}]: dispatch 2023-10-19T12:43:28.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:27 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]: dispatch 2023-10-19T12:43:28.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:27 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]}]: dispatch 2023-10-19T12:43:28.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:27 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/3353192179' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-19T12:43:28.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:27 smithi195 ceph-mon[134493]: pgmap v350: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-19T12:43:28.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:27 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/1533024111' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-19T12:43:28.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:27 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]: dispatch 2023-10-19T12:43:28.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:27 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 7]}]: dispatch 2023-10-19T12:43:28.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:27 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [3, 6, 5, 9]}]: dispatch 2023-10-19T12:43:28.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:27 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [5, 8]}]: dispatch 2023-10-19T12:43:28.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:27 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [9, 10]}]: dispatch 2023-10-19T12:43:28.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:27 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]: dispatch 2023-10-19T12:43:28.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:27 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]}]: dispatch 2023-10-19T12:43:28.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:27 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/3353192179' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-19T12:43:28.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:27 smithi046 ceph-mon[98509]: pgmap v350: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-19T12:43:28.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:27 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/1533024111' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-19T12:43:28.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:27 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]: dispatch 2023-10-19T12:43:28.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:27 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 7]}]: dispatch 2023-10-19T12:43:28.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:27 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [3, 6, 5, 9]}]: dispatch 2023-10-19T12:43:28.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:27 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [5, 8]}]: dispatch 2023-10-19T12:43:28.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:27 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [9, 10]}]: dispatch 2023-10-19T12:43:28.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:27 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]: dispatch 2023-10-19T12:43:28.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:27 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]}]: dispatch 2023-10-19T12:43:28.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:27 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/3353192179' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-19T12:43:28.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.288+0000 7fcfe45ff700 1 -- 172.21.15.46:0/3392874359 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcfdc1a1330 con 0x7fcfdc1007a0 2023-10-19T12:43:28.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.288+0000 7fcfd37fe700 1 -- 172.21.15.46:0/3392874359 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v91) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcfd8099bf0 con 0x7fcfdc1007a0 2023-10-19T12:43:28.292 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2023-10-19T12:43:28.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.291+0000 7fcfe45ff700 1 -- 172.21.15.46:0/3392874359 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fcfc80a1480 msgr2=0x7fcfc80a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:28.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.291+0000 7fcfe45ff700 1 --2- 172.21.15.46:0/3392874359 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fcfc80a1480 0x7fcfc80a3940 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc009c60 tx=0x7fcfcc009260 comp rx=0 tx=0).stop 2023-10-19T12:43:28.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.291+0000 7fcfe45ff700 1 -- 172.21.15.46:0/3392874359 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcfdc1007a0 msgr2=0x7fcfdc1989f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:28.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.291+0000 7fcfe45ff700 1 --2- 172.21.15.46:0/3392874359 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcfdc1007a0 0x7fcfdc1989f0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fcfd800e970 tx=0x7fcfd800ec80 comp rx=0 tx=0).stop 2023-10-19T12:43:28.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.291+0000 7fcfe45ff700 1 -- 172.21.15.46:0/3392874359 shutdown_connections 2023-10-19T12:43:28.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.291+0000 7fcfe45ff700 1 --2- 172.21.15.46:0/3392874359 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcfdc102330 0x7fcfdc19ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:28.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.291+0000 7fcfe45ff700 1 --2- 172.21.15.46:0/3392874359 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcfdc1007a0 0x7fcfdc1989f0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:28.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.291+0000 7fcfe45ff700 1 --2- 172.21.15.46:0/3392874359 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fcfc80a1480 0x7fcfc80a3940 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:28.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.291+0000 7fcfe45ff700 1 --2- 172.21.15.46:0/3392874359 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcfdc101990 0x7fcfdc198f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:28.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.291+0000 7fcfe45ff700 1 -- 172.21.15.46:0/3392874359 >> 172.21.15.46:0/3392874359 conn(0x7fcfdc0fbcf0 msgr2=0x7fcfdc072a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:28.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.291+0000 7fcfe45ff700 1 -- 172.21.15.46:0/3392874359 shutdown_connections 2023-10-19T12:43:28.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.291+0000 7fcfe45ff700 1 -- 172.21.15.46:0/3392874359 wait complete. 2023-10-19T12:43:28.314 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-19T12:43:28.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.518+0000 7fe4289ff700 1 -- 172.21.15.46:0/3853866830 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe4241007a0 msgr2=0x7fe424100bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:28.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.518+0000 7fe4289ff700 1 --2- 172.21.15.46:0/3853866830 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe4241007a0 0x7fe424100bc0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fe4140099c0 tx=0x7fe414009cd0 comp rx=0 tx=0).stop 2023-10-19T12:43:28.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.518+0000 7fe4289ff700 1 -- 172.21.15.46:0/3853866830 shutdown_connections 2023-10-19T12:43:28.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.518+0000 7fe4289ff700 1 --2- 172.21.15.46:0/3853866830 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe424102330 0x7fe424108be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:28.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.518+0000 7fe4289ff700 1 --2- 172.21.15.46:0/3853866830 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe4241007a0 0x7fe424100bc0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:28.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.518+0000 7fe4289ff700 1 --2- 172.21.15.46:0/3853866830 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe424101990 0x7fe424101df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:28.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.518+0000 7fe4289ff700 1 -- 172.21.15.46:0/3853866830 >> 172.21.15.46:0/3853866830 conn(0x7fe4240fbcf0 msgr2=0x7fe4240fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:28.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.519+0000 7fe4289ff700 1 -- 172.21.15.46:0/3853866830 shutdown_connections 2023-10-19T12:43:28.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.519+0000 7fe4289ff700 1 -- 172.21.15.46:0/3853866830 wait complete. 2023-10-19T12:43:28.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.520+0000 7fe4289ff700 1 Processor -- start 2023-10-19T12:43:28.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.520+0000 7fe4289ff700 1 -- start start 2023-10-19T12:43:28.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.521+0000 7fe4289ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe4241007a0 0x7fe424196750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:28.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.521+0000 7fe4289ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe424101990 0x7fe424196c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:28.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.521+0000 7fe4289ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe424102330 0x7fe42419dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:28.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.521+0000 7fe4289ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe42419e280 con 0x7fe4241007a0 2023-10-19T12:43:28.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.521+0000 7fe4289ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe42419e3c0 con 0x7fe424101990 2023-10-19T12:43:28.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.521+0000 7fe4289ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe42419e550 con 0x7fe424102330 2023-10-19T12:43:28.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.521+0000 7fe42259c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe4241007a0 0x7fe424196750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:28.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.521+0000 7fe42259c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe4241007a0 0x7fe424196750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60652/0 (socket says 172.21.15.46:60652) 2023-10-19T12:43:28.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.521+0000 7fe42259c700 1 -- 172.21.15.46:0/3971165846 learned_addr learned my addr 172.21.15.46:0/3971165846 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:43:28.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.521+0000 7fe421d9b700 1 --2- 172.21.15.46:0/3971165846 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe424101990 0x7fe424196c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:28.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.521+0000 7fe422d9d700 1 --2- 172.21.15.46:0/3971165846 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe424102330 0x7fe42419dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:28.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.521+0000 7fe42259c700 1 -- 172.21.15.46:0/3971165846 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe424102330 msgr2=0x7fe42419dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:28.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.521+0000 7fe42259c700 1 --2- 172.21.15.46:0/3971165846 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe424102330 0x7fe42419dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:28.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.521+0000 7fe42259c700 1 -- 172.21.15.46:0/3971165846 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe424101990 msgr2=0x7fe424196c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:28.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.521+0000 7fe42259c700 1 --2- 172.21.15.46:0/3971165846 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe424101990 0x7fe424196c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:28.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.521+0000 7fe42259c700 1 -- 172.21.15.46:0/3971165846 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4140095f0 con 0x7fe4241007a0 2023-10-19T12:43:28.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.521+0000 7fe422d9d700 1 --2- 172.21.15.46:0/3971165846 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe424102330 0x7fe42419dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T12:43:28.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.522+0000 7fe42259c700 1 --2- 172.21.15.46:0/3971165846 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe4241007a0 0x7fe424196750 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fe414003730 tx=0x7fe41400fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:28.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.522+0000 7fe4137fe700 1 -- 172.21.15.46:0/3971165846 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe41401d070 con 0x7fe4241007a0 2023-10-19T12:43:28.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.522+0000 7fe4137fe700 1 -- 172.21.15.46:0/3971165846 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe41400fe70 con 0x7fe4241007a0 2023-10-19T12:43:28.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.522+0000 7fe4289ff700 1 -- 172.21.15.46:0/3971165846 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe42419e7d0 con 0x7fe4241007a0 2023-10-19T12:43:28.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.522+0000 7fe4137fe700 1 -- 172.21.15.46:0/3971165846 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4140173f0 con 0x7fe4241007a0 2023-10-19T12:43:28.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.522+0000 7fe4289ff700 1 -- 172.21.15.46:0/3971165846 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe42419ec50 con 0x7fe4241007a0 2023-10-19T12:43:28.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.523+0000 7fe4289ff700 1 -- 172.21.15.46:0/3971165846 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe424107bc0 con 0x7fe4241007a0 2023-10-19T12:43:28.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.525+0000 7fe4137fe700 1 -- 172.21.15.46:0/3971165846 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fe414022470 con 0x7fe4241007a0 2023-10-19T12:43:28.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.526+0000 7fe4137fe700 1 --2- 172.21.15.46:0/3971165846 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fe40c0a1500 0x7fe40c0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:28.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.527+0000 7fe4137fe700 1 -- 172.21.15.46:0/3971165846 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9202+0+0 (secure 0 0 0) 0x7fe4140ce6e0 con 0x7fe4241007a0 2023-10-19T12:43:28.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.527+0000 7fe421d9b700 1 --2- 172.21.15.46:0/3971165846 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fe40c0a1500 0x7fe40c0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:28.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.527+0000 7fe421d9b700 1 --2- 172.21.15.46:0/3971165846 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fe40c0a1500 0x7fe40c0a39c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe418007c60 tx=0x7fe4180073d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:28.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.529+0000 7fe4137fe700 1 -- 172.21.15.46:0/3971165846 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fe4140979a0 con 0x7fe4241007a0 2023-10-19T12:43:28.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.741+0000 7fe4289ff700 1 -- 172.21.15.46:0/3971165846 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fe42410c000 con 0x7fe4241007a0 2023-10-19T12:43:28.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.741+0000 7fe4137fe700 1 -- 172.21.15.46:0/3971165846 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v91) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe41409afc0 con 0x7fe4241007a0 2023-10-19T12:43:28.745 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2023-10-19T12:43:28.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.744+0000 7fe4289ff700 1 -- 172.21.15.46:0/3971165846 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fe40c0a1500 msgr2=0x7fe40c0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:28.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.744+0000 7fe4289ff700 1 --2- 172.21.15.46:0/3971165846 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fe40c0a1500 0x7fe40c0a39c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe418007c60 tx=0x7fe4180073d0 comp rx=0 tx=0).stop 2023-10-19T12:43:28.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.744+0000 7fe4289ff700 1 -- 172.21.15.46:0/3971165846 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe4241007a0 msgr2=0x7fe424196750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:28.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.744+0000 7fe4289ff700 1 --2- 172.21.15.46:0/3971165846 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe4241007a0 0x7fe424196750 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fe414003730 tx=0x7fe41400fa00 comp rx=0 tx=0).stop 2023-10-19T12:43:28.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.744+0000 7fe4289ff700 1 -- 172.21.15.46:0/3971165846 shutdown_connections 2023-10-19T12:43:28.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.744+0000 7fe4289ff700 1 --2- 172.21.15.46:0/3971165846 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fe40c0a1500 0x7fe40c0a39c0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:28.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.744+0000 7fe4289ff700 1 --2- 172.21.15.46:0/3971165846 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe424102330 0x7fe42419dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:28.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.744+0000 7fe4289ff700 1 --2- 172.21.15.46:0/3971165846 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe4241007a0 0x7fe424196750 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:28.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.744+0000 7fe4289ff700 1 --2- 172.21.15.46:0/3971165846 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe424101990 0x7fe424196c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:28.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.744+0000 7fe4289ff700 1 -- 172.21.15.46:0/3971165846 >> 172.21.15.46:0/3971165846 conn(0x7fe4240fbcf0 msgr2=0x7fe424104d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:28.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.744+0000 7fe4289ff700 1 -- 172.21.15.46:0/3971165846 shutdown_connections 2023-10-19T12:43:28.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.744+0000 7fe4289ff700 1 -- 172.21.15.46:0/3971165846 wait complete. 2023-10-19T12:43:28.766 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-19T12:43:28.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.975+0000 7efd26dff700 1 -- 172.21.15.46:0/943093291 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd200731f0 msgr2=0x7efd20073670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:28.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.975+0000 7efd26dff700 1 --2- 172.21.15.46:0/943093291 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd200731f0 0x7efd20073670 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7efd0c009990 tx=0x7efd0c009ca0 comp rx=0 tx=0).stop 2023-10-19T12:43:28.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.975+0000 7efd26dff700 1 -- 172.21.15.46:0/943093291 shutdown_connections 2023-10-19T12:43:28.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.975+0000 7efd26dff700 1 --2- 172.21.15.46:0/943093291 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efd20108610 0x7efd2010aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:28.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.975+0000 7efd26dff700 1 --2- 172.21.15.46:0/943093291 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efd200747d0 0x7efd20072c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:28.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.975+0000 7efd26dff700 1 --2- 172.21.15.46:0/943093291 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd200731f0 0x7efd20073670 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:28.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.975+0000 7efd26dff700 1 -- 172.21.15.46:0/943093291 >> 172.21.15.46:0/943093291 conn(0x7efd200fbc90 msgr2=0x7efd200fe0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:28.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.975+0000 7efd26dff700 1 -- 172.21.15.46:0/943093291 shutdown_connections 2023-10-19T12:43:28.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.975+0000 7efd26dff700 1 -- 172.21.15.46:0/943093291 wait complete. 2023-10-19T12:43:28.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.976+0000 7efd26dff700 1 Processor -- start 2023-10-19T12:43:28.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.976+0000 7efd26dff700 1 -- start start 2023-10-19T12:43:28.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.976+0000 7efd26dff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efd200731f0 0x7efd20198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:28.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.976+0000 7efd26dff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efd200747d0 0x7efd20198e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:28.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.976+0000 7efd26dff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd20108610 0x7efd2019fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:28.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.976+0000 7efd26dff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd201a0430 con 0x7efd20108610 2023-10-19T12:43:28.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.976+0000 7efd26dff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd201a0570 con 0x7efd200731f0 2023-10-19T12:43:28.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.976+0000 7efd26dff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd201a0700 con 0x7efd200747d0 2023-10-19T12:43:28.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.977+0000 7efd2539c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd20108610 0x7efd2019fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:28.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.977+0000 7efd24b9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efd200731f0 0x7efd20198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:28.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.977+0000 7efd24b9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efd200731f0 0x7efd20198950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:34670/0 (socket says 172.21.15.46:34670) 2023-10-19T12:43:28.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.977+0000 7efd24b9b700 1 -- 172.21.15.46:0/1014465480 learned_addr learned my addr 172.21.15.46:0/1014465480 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:43:28.985 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.977+0000 7efd1ffff700 1 --2- 172.21.15.46:0/1014465480 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efd200747d0 0x7efd20198e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:28.985 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.977+0000 7efd2539c700 1 -- 172.21.15.46:0/1014465480 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efd200747d0 msgr2=0x7efd20198e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:28.985 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.977+0000 7efd2539c700 1 --2- 172.21.15.46:0/1014465480 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efd200747d0 0x7efd20198e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:28.985 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.977+0000 7efd2539c700 1 -- 172.21.15.46:0/1014465480 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efd200731f0 msgr2=0x7efd20198950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:28.985 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.977+0000 7efd2539c700 1 --2- 172.21.15.46:0/1014465480 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efd200731f0 0x7efd20198950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:28.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.977+0000 7efd2539c700 1 -- 172.21.15.46:0/1014465480 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd0c0095f0 con 0x7efd20108610 2023-10-19T12:43:28.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.977+0000 7efd2539c700 1 --2- 172.21.15.46:0/1014465480 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd20108610 0x7efd2019fe60 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7efd18007f10 tx=0x7efd1800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:28.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.977+0000 7efd1dffb700 1 -- 172.21.15.46:0/1014465480 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd18009ea0 con 0x7efd20108610 2023-10-19T12:43:28.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.977+0000 7efd26dff700 1 -- 172.21.15.46:0/1014465480 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd201a09e0 con 0x7efd20108610 2023-10-19T12:43:28.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.978+0000 7efd1dffb700 1 -- 172.21.15.46:0/1014465480 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efd1800f040 con 0x7efd20108610 2023-10-19T12:43:28.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.978+0000 7efd1dffb700 1 -- 172.21.15.46:0/1014465480 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd180042f0 con 0x7efd20108610 2023-10-19T12:43:28.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.978+0000 7efd26dff700 1 -- 172.21.15.46:0/1014465480 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd201a0ea0 con 0x7efd20108610 2023-10-19T12:43:28.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.979+0000 7efd26dff700 1 -- 172.21.15.46:0/1014465480 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd20107420 con 0x7efd20108610 2023-10-19T12:43:28.988 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.981+0000 7efd1dffb700 1 -- 172.21.15.46:0/1014465480 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7efd1800db20 con 0x7efd20108610 2023-10-19T12:43:28.988 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.982+0000 7efd1dffb700 1 --2- 172.21.15.46:0/1014465480 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7efd100a1480 0x7efd100a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:28.988 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.982+0000 7efd1dffb700 1 -- 172.21.15.46:0/1014465480 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7efd180cc9b0 con 0x7efd20108610 2023-10-19T12:43:28.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.982+0000 7efd24b9b700 1 --2- 172.21.15.46:0/1014465480 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7efd100a1480 0x7efd100a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:28.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.983+0000 7efd24b9b700 1 --2- 172.21.15.46:0/1014465480 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7efd100a1480 0x7efd100a3940 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7efd14009d20 tx=0x7efd14009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:28.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:28.986+0000 7efd1dffb700 1 -- 172.21.15.46:0/1014465480 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7efd18095be0 con 0x7efd20108610 2023-10-19T12:43:29.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:28 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]': finished 2023-10-19T12:43:29.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:28 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 7]}]': finished 2023-10-19T12:43:29.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:28 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [3, 6, 5, 9]}]': finished 2023-10-19T12:43:29.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:28 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [5, 8]}]': finished 2023-10-19T12:43:29.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:28 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [9, 10]}]': finished 2023-10-19T12:43:29.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:28 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]': finished 2023-10-19T12:43:29.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:28 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]}]': finished 2023-10-19T12:43:29.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:28 smithi157 ceph-mon[134109]: osdmap e91: 12 total, 12 up, 12 in 2023-10-19T12:43:29.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:28 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/2993636987' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-19T12:43:29.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:28 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/3392874359' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-19T12:43:29.090 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:28 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/3971165846' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-19T12:43:29.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:28 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]': finished 2023-10-19T12:43:29.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:28 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 7]}]': finished 2023-10-19T12:43:29.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:28 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [3, 6, 5, 9]}]': finished 2023-10-19T12:43:29.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:28 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [5, 8]}]': finished 2023-10-19T12:43:29.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:28 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [9, 10]}]': finished 2023-10-19T12:43:29.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:28 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]': finished 2023-10-19T12:43:29.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:28 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]}]': finished 2023-10-19T12:43:29.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:28 smithi195 ceph-mon[134493]: osdmap e91: 12 total, 12 up, 12 in 2023-10-19T12:43:29.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:28 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/2993636987' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-19T12:43:29.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:28 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/3392874359' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-19T12:43:29.133 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:28 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/3971165846' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-19T12:43:29.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.200+0000 7efd26dff700 1 -- 172.21.15.46:0/1014465480 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efd20067530 con 0x7efd20108610 2023-10-19T12:43:29.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.202+0000 7efd1dffb700 1 -- 172.21.15.46:0/1014465480 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) v1 ==== 74+0+24780 (secure 0 0 0) 0x7efd18099200 con 0x7efd20108610 2023-10-19T12:43:29.206 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:43:29.206 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":92,"fsid":"96a8be3c-6e7b-11ee-8db6-212e2dc638e7","created":"2023-10-19T12:33:26.148713+0000","modified":"2023-10-19T12:43:28.761367+0000","last_up_change":"2023-10-19T12:40:30.761679+0000","last_in_change":"2023-10-19T12:40:13.663559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-19T12:37:07.175795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-19T12:41:16.895203+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-19T12:41:18.255601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-19T12:41:21.830455+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"346ce86b-a10a-4869-9fdb-c3c1d4161455","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6803","nonce":500237995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6805","nonce":500237995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6809","nonce":500237995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6807","nonce":500237995}]},"public_addr":"172.21.15.46:6803/500237995","cluster_addr":"172.21.15.46:6805/500237995","heartbeat_back_addr":"172.21.15.46:6809/500237995","heartbeat_front_addr":"172.21.15.46:6807/500237995","state":["exists","up"]},{"osd":1,"uuid":"02aae687-76c5-4124-bae4-9787ed571c28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6801","nonce":2496862790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6803","nonce":2496862790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6807","nonce":2496862790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6805","nonce":2496862790}]},"public_addr":"172.21.15.157:6801/2496862790","cluster_addr":"172.21.15.157:6803/2496862790","heartbeat_back_addr":"172.21.15.157:6807/2496862790","heartbeat_front_addr":"172.21.15.157:6805/2496862790","state":["exists","up"]},{"osd":2,"uuid":"d5360828-1f58-4380-b2ad-0c21ff850981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6801","nonce":4211767276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6803","nonce":4211767276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6807","nonce":4211767276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6805","nonce":4211767276}]},"public_addr":"172.21.15.195:6801/4211767276","cluster_addr":"172.21.15.195:6803/4211767276","heartbeat_back_addr":"172.21.15.195:6807/4211767276","heartbeat_front_addr":"172.21.15.195:6805/4211767276","state":["exists","up"]},{"osd":3,"uuid":"accb780f-49d0-43f8-b166-ee12c558ef00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6811","nonce":1964113352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6813","nonce":1964113352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6817","nonce":1964113352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6815","nonce":1964113352}]},"public_addr":"172.21.15.46:6811/1964113352","cluster_addr":"172.21.15.46:6813/1964113352","heartbeat_back_addr":"172.21.15.46:6817/1964113352","heartbeat_front_addr":"172.21.15.46:6815/1964113352","state":["exists","up"]},{"osd":4,"uuid":"e662886d-e989-4d02-8c1f-3c4671352b0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6809","nonce":3636910144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6811","nonce":3636910144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6815","nonce":3636910144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6813","nonce":3636910144}]},"public_addr":"172.21.15.157:6809/3636910144","cluster_addr":"172.21.15.157:6811/3636910144","heartbeat_back_addr":"172.21.15.157:6815/3636910144","heartbeat_front_addr":"172.21.15.157:6813/3636910144","state":["exists","up"]},{"osd":5,"uuid":"9597e0ce-14ea-407d-90fe-f74bccee38b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6809","nonce":4071287969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6811","nonce":4071287969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6815","nonce":4071287969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6813","nonce":4071287969}]},"public_addr":"172.21.15.195:6809/4071287969","cluster_addr":"172.21.15.195:6811/4071287969","heartbeat_back_addr":"172.21.15.195:6815/4071287969","heartbeat_front_addr":"172.21.15.195:6813/4071287969","state":["exists","up"]},{"osd":6,"uuid":"6b78ba38-f60e-4cb6-b01c-cecc1820e8e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6819","nonce":1842285555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6821","nonce":1842285555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6825","nonce":1842285555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6823","nonce":1842285555}]},"public_addr":"172.21.15.46:6819/1842285555","cluster_addr":"172.21.15.46:6821/1842285555","heartbeat_back_addr":"172.21.15.46:6825/1842285555","heartbeat_front_addr":"172.21.15.46:6823/1842285555","state":["exists","up"]},{"osd":7,"uuid":"59a0899f-3bcd-4db2-b544-24df3a536749","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6817","nonce":3498672588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6819","nonce":3498672588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6823","nonce":3498672588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6821","nonce":3498672588}]},"public_addr":"172.21.15.157:6817/3498672588","cluster_addr":"172.21.15.157:6819/3498672588","heartbeat_back_addr":"172.21.15.157:6823/3498672588","heartbeat_front_addr":"172.21.15.157:6821/3498672588","state":["exists","up"]},{"osd":8,"uuid":"9c3c9835-043a-4fb5-a9ee-edf8caf6b605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6817","nonce":74230104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6819","nonce":74230104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6823","nonce":74230104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6821","nonce":74230104}]},"public_addr":"172.21.15.195:6817/74230104","cluster_addr":"172.21.15.195:6819/74230104","heartbeat_back_addr":"172.21.15.195:6823/74230104","heartbeat_front_addr":"172.21.15.195:6821/74230104","state":["exists","up"]},{"osd":9,"uuid":"3f18f506-a577-4b7c-ae0d-9351c07e81f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6827","nonce":3472581046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6829","nonce":3472581046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6833","nonce":3472581046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6831","nonce":3472581046}]},"public_addr":"172.21.15.46:6827/3472581046","cluster_addr":"172.21.15.46:6829/3472581046","heartbeat_back_addr":"172.21.15.46:6833/3472581046","heartbeat_front_addr":"172.21.15.46:6831/3472581046","state":["exists","up"]},{"osd":10,"uuid":"1ed01854-443a-4acf-9293-7ca0d451a93d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6825","nonce":2378416559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6827","nonce":2378416559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6831","nonce":2378416559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6829","nonce":2378416559}]},"public_addr":"172.21.15.157:6825/2378416559","cluster_addr":"172.21.15.157:6827/2378416559","heartbeat_back_addr":"172.21.15.157:6831/2378416559","heartbeat_front_addr":"172.21.15.157:6829/2378416559","state":["exists","up"]},{"osd":11,"uuid":"021398c0-9184-4647-8220-e40f6705ca90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6825","nonce":3075632222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6827","nonce":3075632222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6831","nonce":3075632222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6829","nonce":3075632222}]},"public_addr":"172.21.15.195:6825/3075632222","cluster_addr":"172.21.15.195:6827/3075632222","heartbeat_back_addr":"172.21.15.195:6831/3075632222","heartbeat_front_addr":"172.21.15.195:6829/3075632222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:36:22.002614+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:36:44.098031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:37:04.518341+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:37:30.796462+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:37:52.756555+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:38:13.403168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:38:39.058472+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:39:01.106893+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:39:21.908334+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:39:46.843884+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:40:08.792020+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:40:29.282974+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":7}]},{"pgid":"3.1b","mappings":[{"from":3,"to":6},{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.39","mappings":[{"from":5,"to":8}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]},{"pgid":"4.6","mappings":[{"from":5,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.46:0/3248595150":"2023-10-20T12:34:26.552115+0000","172.21.15.46:0/3624849341":"2023-10-20T12:34:26.552115+0000","172.21.15.46:0/1844094590":"2023-10-20T12:34:26.552115+0000","172.21.15.46:6801/20022894":"2023-10-20T12:34:26.552115+0000","172.21.15.46:0/3969790632":"2023-10-20T12:34:00.135248+0000","172.21.15.46:0/2331135821":"2023-10-20T12:34:00.135248+0000","172.21.15.46:6800/51664346":"2023-10-20T12:34:00.135248+0000","172.21.15.46:6801/51664346":"2023-10-20T12:34:00.135248+0000","172.21.15.46:0/585851467":"2023-10-20T12:34:00.135248+0000","172.21.15.46:6800/20022894":"2023-10-20T12:34:26.552115+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-19T12:43:29.207 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.204+0000 7efd26dff700 1 -- 172.21.15.46:0/1014465480 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7efd100a1480 msgr2=0x7efd100a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:29.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.204+0000 7efd26dff700 1 --2- 172.21.15.46:0/1014465480 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7efd100a1480 0x7efd100a3940 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7efd14009d20 tx=0x7efd14009260 comp rx=0 tx=0).stop 2023-10-19T12:43:29.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.204+0000 7efd26dff700 1 -- 172.21.15.46:0/1014465480 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd20108610 msgr2=0x7efd2019fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:29.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.204+0000 7efd26dff700 1 --2- 172.21.15.46:0/1014465480 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd20108610 0x7efd2019fe60 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7efd18007f10 tx=0x7efd1800d3b0 comp rx=0 tx=0).stop 2023-10-19T12:43:29.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.204+0000 7efd26dff700 1 -- 172.21.15.46:0/1014465480 shutdown_connections 2023-10-19T12:43:29.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.204+0000 7efd26dff700 1 --2- 172.21.15.46:0/1014465480 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd20108610 0x7efd2019fe60 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:29.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.204+0000 7efd26dff700 1 --2- 172.21.15.46:0/1014465480 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efd200731f0 0x7efd20198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:29.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.204+0000 7efd26dff700 1 --2- 172.21.15.46:0/1014465480 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7efd100a1480 0x7efd100a3940 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:29.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.204+0000 7efd26dff700 1 --2- 172.21.15.46:0/1014465480 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efd200747d0 0x7efd20198e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:29.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.204+0000 7efd26dff700 1 -- 172.21.15.46:0/1014465480 >> 172.21.15.46:0/1014465480 conn(0x7efd200fbc90 msgr2=0x7efd20104560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:29.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.204+0000 7efd26dff700 1 -- 172.21.15.46:0/1014465480 shutdown_connections 2023-10-19T12:43:29.210 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.204+0000 7efd26dff700 1 -- 172.21.15.46:0/1014465480 wait complete. 2023-10-19T12:43:29.224 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:28 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]': finished 2023-10-19T12:43:29.225 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:28 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 7]}]': finished 2023-10-19T12:43:29.225 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:28 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [3, 6, 5, 9]}]': finished 2023-10-19T12:43:29.225 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:28 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [5, 8]}]': finished 2023-10-19T12:43:29.225 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:28 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [9, 10]}]': finished 2023-10-19T12:43:29.225 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:28 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]': finished 2023-10-19T12:43:29.226 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:28 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]}]': finished 2023-10-19T12:43:29.226 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:28 smithi046 ceph-mon[98509]: osdmap e91: 12 total, 12 up, 12 in 2023-10-19T12:43:29.226 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:28 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/2993636987' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-19T12:43:29.226 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:28 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/3392874359' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-19T12:43:29.226 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:28 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/3971165846' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-19T12:43:29.228 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-19T12:37:07.175795+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-19T12:41:16.895203+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-19T12:41:18.255601+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-19T12:41:21.830455+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-19T12:43:29.229 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-19T12:43:29.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.435+0000 7fcd773ff700 1 -- 172.21.15.46:0/2786370845 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd701007a0 msgr2=0x7fcd70100bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:29.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.435+0000 7fcd773ff700 1 --2- 172.21.15.46:0/2786370845 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd701007a0 0x7fcd70100bc0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c0099c0 tx=0x7fcd6c009cd0 comp rx=0 tx=0).stop 2023-10-19T12:43:29.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.435+0000 7fcd773ff700 1 -- 172.21.15.46:0/2786370845 shutdown_connections 2023-10-19T12:43:29.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.435+0000 7fcd773ff700 1 --2- 172.21.15.46:0/2786370845 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcd70102330 0x7fcd70108be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:29.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.435+0000 7fcd773ff700 1 --2- 172.21.15.46:0/2786370845 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd701007a0 0x7fcd70100bc0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:29.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.435+0000 7fcd773ff700 1 --2- 172.21.15.46:0/2786370845 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcd70101990 0x7fcd70101df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:29.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.435+0000 7fcd773ff700 1 -- 172.21.15.46:0/2786370845 >> 172.21.15.46:0/2786370845 conn(0x7fcd700fbcf0 msgr2=0x7fcd700fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:29.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.435+0000 7fcd773ff700 1 -- 172.21.15.46:0/2786370845 shutdown_connections 2023-10-19T12:43:29.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.435+0000 7fcd773ff700 1 -- 172.21.15.46:0/2786370845 wait complete. 2023-10-19T12:43:29.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.436+0000 7fcd773ff700 1 Processor -- start 2023-10-19T12:43:29.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.436+0000 7fcd773ff700 1 -- start start 2023-10-19T12:43:29.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.436+0000 7fcd773ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd701007a0 0x7fcd70196750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:29.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.437+0000 7fcd773ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcd70101990 0x7fcd70196c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:29.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.437+0000 7fcd773ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcd70102330 0x7fcd7019dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:29.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.437+0000 7fcd773ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7019e280 con 0x7fcd701007a0 2023-10-19T12:43:29.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.437+0000 7fcd773ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7019e3c0 con 0x7fcd70101990 2023-10-19T12:43:29.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.437+0000 7fcd773ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7019e550 con 0x7fcd70102330 2023-10-19T12:43:29.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.437+0000 7fcd7519b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd701007a0 0x7fcd70196750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:29.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.437+0000 7fcd7519b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd701007a0 0x7fcd70196750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60682/0 (socket says 172.21.15.46:60682) 2023-10-19T12:43:29.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.437+0000 7fcd7519b700 1 -- 172.21.15.46:0/3917559986 learned_addr learned my addr 172.21.15.46:0/3917559986 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:43:29.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.437+0000 7fcd7499a700 1 --2- 172.21.15.46:0/3917559986 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcd70101990 0x7fcd70196c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:29.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.437+0000 7fcd7599c700 1 --2- 172.21.15.46:0/3917559986 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcd70102330 0x7fcd7019dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:29.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.437+0000 7fcd7519b700 1 -- 172.21.15.46:0/3917559986 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcd70102330 msgr2=0x7fcd7019dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:29.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.437+0000 7fcd7519b700 1 --2- 172.21.15.46:0/3917559986 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcd70102330 0x7fcd7019dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:29.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.437+0000 7fcd7519b700 1 -- 172.21.15.46:0/3917559986 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcd70101990 msgr2=0x7fcd70196c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:29.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.437+0000 7fcd7519b700 1 --2- 172.21.15.46:0/3917559986 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcd70101990 0x7fcd70196c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:29.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.437+0000 7fcd7519b700 1 -- 172.21.15.46:0/3917559986 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd68009c40 con 0x7fcd701007a0 2023-10-19T12:43:29.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.437+0000 7fcd7599c700 1 --2- 172.21.15.46:0/3917559986 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcd70102330 0x7fcd7019dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T12:43:29.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.438+0000 7fcd7519b700 1 --2- 172.21.15.46:0/3917559986 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd701007a0 0x7fcd70196750 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c003730 tx=0x7fcd6c00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:29.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.438+0000 7fcd667fc700 1 -- 172.21.15.46:0/3917559986 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd6c01d070 con 0x7fcd701007a0 2023-10-19T12:43:29.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.438+0000 7fcd667fc700 1 -- 172.21.15.46:0/3917559986 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcd6c005050 con 0x7fcd701007a0 2023-10-19T12:43:29.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.438+0000 7fcd773ff700 1 -- 172.21.15.46:0/3917559986 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd6c0095f0 con 0x7fcd701007a0 2023-10-19T12:43:29.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.438+0000 7fcd667fc700 1 -- 172.21.15.46:0/3917559986 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd6c004af0 con 0x7fcd701007a0 2023-10-19T12:43:29.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.438+0000 7fcd773ff700 1 -- 172.21.15.46:0/3917559986 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd7019ea60 con 0x7fcd701007a0 2023-10-19T12:43:29.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.439+0000 7fcd773ff700 1 -- 172.21.15.46:0/3917559986 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd70107bc0 con 0x7fcd701007a0 2023-10-19T12:43:29.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.441+0000 7fcd667fc700 1 -- 172.21.15.46:0/3917559986 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fcd6c0051c0 con 0x7fcd701007a0 2023-10-19T12:43:29.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.442+0000 7fcd667fc700 1 --2- 172.21.15.46:0/3917559986 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fcd5c0a1480 0x7fcd5c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:29.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.442+0000 7fcd667fc700 1 -- 172.21.15.46:0/3917559986 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7fcd6c0cdf80 con 0x7fcd701007a0 2023-10-19T12:43:29.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.443+0000 7fcd7499a700 1 --2- 172.21.15.46:0/3917559986 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fcd5c0a1480 0x7fcd5c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:29.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.443+0000 7fcd7499a700 1 --2- 172.21.15.46:0/3917559986 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fcd5c0a1480 0x7fcd5c0a3940 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fcd60009c60 tx=0x7fcd60009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:29.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.446+0000 7fcd667fc700 1 -- 172.21.15.46:0/3917559986 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fcd6c097240 con 0x7fcd701007a0 2023-10-19T12:43:29.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.661+0000 7fcd773ff700 1 -- 172.21.15.46:0/3917559986 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcd701075a0 con 0x7fcd701007a0 2023-10-19T12:43:29.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.662+0000 7fcd667fc700 1 -- 172.21.15.46:0/3917559986 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v92) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcd6c09a860 con 0x7fcd701007a0 2023-10-19T12:43:29.665 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2023-10-19T12:43:29.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.664+0000 7fcd773ff700 1 -- 172.21.15.46:0/3917559986 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fcd5c0a1480 msgr2=0x7fcd5c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:29.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.664+0000 7fcd773ff700 1 --2- 172.21.15.46:0/3917559986 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fcd5c0a1480 0x7fcd5c0a3940 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fcd60009c60 tx=0x7fcd60009260 comp rx=0 tx=0).stop 2023-10-19T12:43:29.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.664+0000 7fcd773ff700 1 -- 172.21.15.46:0/3917559986 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd701007a0 msgr2=0x7fcd70196750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:29.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.664+0000 7fcd773ff700 1 --2- 172.21.15.46:0/3917559986 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd701007a0 0x7fcd70196750 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c003730 tx=0x7fcd6c00f690 comp rx=0 tx=0).stop 2023-10-19T12:43:29.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.664+0000 7fcd773ff700 1 -- 172.21.15.46:0/3917559986 shutdown_connections 2023-10-19T12:43:29.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.664+0000 7fcd773ff700 1 --2- 172.21.15.46:0/3917559986 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fcd5c0a1480 0x7fcd5c0a3940 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:29.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.664+0000 7fcd773ff700 1 --2- 172.21.15.46:0/3917559986 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcd70102330 0x7fcd7019dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:29.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.664+0000 7fcd773ff700 1 --2- 172.21.15.46:0/3917559986 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd701007a0 0x7fcd70196750 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:29.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.664+0000 7fcd773ff700 1 --2- 172.21.15.46:0/3917559986 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcd70101990 0x7fcd70196c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:29.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.664+0000 7fcd773ff700 1 -- 172.21.15.46:0/3917559986 >> 172.21.15.46:0/3917559986 conn(0x7fcd700fbcf0 msgr2=0x7fcd70104d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:29.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.664+0000 7fcd773ff700 1 -- 172.21.15.46:0/3917559986 shutdown_connections 2023-10-19T12:43:29.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.664+0000 7fcd773ff700 1 -- 172.21.15.46:0/3917559986 wait complete. 2023-10-19T12:43:29.686 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-19T12:43:29.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.892+0000 7f056559d700 1 -- 172.21.15.46:0/2087534687 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0560101830 msgr2=0x7f0560101c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:29.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.892+0000 7f056559d700 1 --2- 172.21.15.46:0/2087534687 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0560101830 0x7f0560101c90 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f05540099c0 tx=0x7f0554009cd0 comp rx=0 tx=0).stop 2023-10-19T12:43:29.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.893+0000 7f056559d700 1 -- 172.21.15.46:0/2087534687 shutdown_connections 2023-10-19T12:43:29.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.893+0000 7f056559d700 1 --2- 172.21.15.46:0/2087534687 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05601021d0 0x7f0560108a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:29.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.893+0000 7f056559d700 1 --2- 172.21.15.46:0/2087534687 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0560100640 0x7f0560100a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:29.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.893+0000 7f056559d700 1 --2- 172.21.15.46:0/2087534687 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0560101830 0x7f0560101c90 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:29.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.893+0000 7f056559d700 1 -- 172.21.15.46:0/2087534687 >> 172.21.15.46:0/2087534687 conn(0x7f05600fbbd0 msgr2=0x7f05600fdff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:29.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.893+0000 7f056559d700 1 -- 172.21.15.46:0/2087534687 shutdown_connections 2023-10-19T12:43:29.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.893+0000 7f056559d700 1 -- 172.21.15.46:0/2087534687 wait complete. 2023-10-19T12:43:29.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.894+0000 7f056559d700 1 Processor -- start 2023-10-19T12:43:29.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.894+0000 7f056559d700 1 -- start start 2023-10-19T12:43:29.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.894+0000 7f056559d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0560100640 0x7f0560198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:29.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.894+0000 7f056559d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0560101830 0x7f0560198d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:29.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.894+0000 7f056559d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f05601021d0 0x7f056019fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:29.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.894+0000 7f056559d700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05601a0300 con 0x7f0560101830 2023-10-19T12:43:29.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.894+0000 7f056559d700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05601a0440 con 0x7f0560100640 2023-10-19T12:43:29.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.894+0000 7f056559d700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05601a05d0 con 0x7f05601021d0 2023-10-19T12:43:29.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.894+0000 7f055f7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0560101830 0x7f0560198d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:29.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.894+0000 7f055f7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0560101830 0x7f0560198d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60700/0 (socket says 172.21.15.46:60700) 2023-10-19T12:43:29.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.894+0000 7f055f7fe700 1 -- 172.21.15.46:0/446439558 learned_addr learned my addr 172.21.15.46:0/446439558 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:43:29.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.894+0000 7f055ffff700 1 --2- 172.21.15.46:0/446439558 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0560100640 0x7f0560198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:29.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.895+0000 7f0564d9c700 1 --2- 172.21.15.46:0/446439558 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f05601021d0 0x7f056019fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:29.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.895+0000 7f055f7fe700 1 -- 172.21.15.46:0/446439558 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f05601021d0 msgr2=0x7f056019fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:29.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.895+0000 7f055f7fe700 1 --2- 172.21.15.46:0/446439558 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f05601021d0 0x7f056019fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:29.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.895+0000 7f055f7fe700 1 -- 172.21.15.46:0/446439558 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0560100640 msgr2=0x7f0560198820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:29.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.895+0000 7f055f7fe700 1 --2- 172.21.15.46:0/446439558 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0560100640 0x7f0560198820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:29.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.895+0000 7f055f7fe700 1 -- 172.21.15.46:0/446439558 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05540095f0 con 0x7f0560101830 2023-10-19T12:43:29.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.895+0000 7f055f7fe700 1 --2- 172.21.15.46:0/446439558 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0560101830 0x7f0560198d60 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f0554003730 tx=0x7f055400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:29.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.895+0000 7f055d7fa700 1 -- 172.21.15.46:0/446439558 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055401d070 con 0x7f0560101830 2023-10-19T12:43:29.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.895+0000 7f056559d700 1 -- 172.21.15.46:0/446439558 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05601a0850 con 0x7f0560101830 2023-10-19T12:43:29.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.895+0000 7f055d7fa700 1 -- 172.21.15.46:0/446439558 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0554005050 con 0x7f0560101830 2023-10-19T12:43:29.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.895+0000 7f055d7fa700 1 -- 172.21.15.46:0/446439558 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0554004b10 con 0x7f0560101830 2023-10-19T12:43:29.905 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.896+0000 7f056559d700 1 -- 172.21.15.46:0/446439558 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05601a0cd0 con 0x7f0560101830 2023-10-19T12:43:29.905 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.897+0000 7f056559d700 1 -- 172.21.15.46:0/446439558 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05600673e0 con 0x7f0560101830 2023-10-19T12:43:29.906 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.898+0000 7f055d7fa700 1 -- 172.21.15.46:0/446439558 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f05540051c0 con 0x7f0560101830 2023-10-19T12:43:29.906 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.900+0000 7f055d7fa700 1 --2- 172.21.15.46:0/446439558 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f05480a1480 0x7f05480a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:29.906 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.900+0000 7f055d7fa700 1 -- 172.21.15.46:0/446439558 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f05540cde40 con 0x7f0560101830 2023-10-19T12:43:29.907 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.900+0000 7f055ffff700 1 --2- 172.21.15.46:0/446439558 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f05480a1480 0x7f05480a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:29.907 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.901+0000 7f055ffff700 1 --2- 172.21.15.46:0/446439558 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f05480a1480 0x7f05480a3940 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f0560101690 tx=0x7f0550009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:29.907 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:29.904+0000 7f055d7fa700 1 -- 172.21.15.46:0/446439558 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0554097100 con 0x7f0560101830 2023-10-19T12:43:29.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:29 smithi046 ceph-mon[98509]: pgmap v352: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-10-19T12:43:29.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:29 smithi046 ceph-mon[98509]: osdmap e92: 12 total, 12 up, 12 in 2023-10-19T12:43:29.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:29 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/1014465480' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-19T12:43:29.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:29 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/3917559986' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-19T12:43:30.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:29 smithi157 ceph-mon[134109]: pgmap v352: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-10-19T12:43:30.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:29 smithi157 ceph-mon[134109]: osdmap e92: 12 total, 12 up, 12 in 2023-10-19T12:43:30.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:29 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/1014465480' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-19T12:43:30.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:29 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/3917559986' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-19T12:43:30.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.120+0000 7f056559d700 1 -- 172.21.15.46:0/446439558 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f05601a0ef0 con 0x7f0560101830 2023-10-19T12:43:30.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.121+0000 7f055d7fa700 1 -- 172.21.15.46:0/446439558 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v92) v1 ==== 104+0+11 (secure 0 0 0) 0x7f055409a720 con 0x7f0560101830 2023-10-19T12:43:30.124 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2023-10-19T12:43:30.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.123+0000 7f056559d700 1 -- 172.21.15.46:0/446439558 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f05480a1480 msgr2=0x7f05480a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:30.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.123+0000 7f056559d700 1 --2- 172.21.15.46:0/446439558 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f05480a1480 0x7f05480a3940 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f0560101690 tx=0x7f0550009260 comp rx=0 tx=0).stop 2023-10-19T12:43:30.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.123+0000 7f056559d700 1 -- 172.21.15.46:0/446439558 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0560101830 msgr2=0x7f0560198d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:30.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.123+0000 7f056559d700 1 --2- 172.21.15.46:0/446439558 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0560101830 0x7f0560198d60 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f0554003730 tx=0x7f055400f690 comp rx=0 tx=0).stop 2023-10-19T12:43:30.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.123+0000 7f056559d700 1 -- 172.21.15.46:0/446439558 shutdown_connections 2023-10-19T12:43:30.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.123+0000 7f056559d700 1 --2- 172.21.15.46:0/446439558 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f05480a1480 0x7f05480a3940 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:30.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.123+0000 7f056559d700 1 --2- 172.21.15.46:0/446439558 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f05601021d0 0x7f056019fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:30.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.123+0000 7f056559d700 1 --2- 172.21.15.46:0/446439558 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0560100640 0x7f0560198820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:30.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.123+0000 7f056559d700 1 --2- 172.21.15.46:0/446439558 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0560101830 0x7f0560198d60 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:30.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.123+0000 7f056559d700 1 -- 172.21.15.46:0/446439558 >> 172.21.15.46:0/446439558 conn(0x7f05600fbbd0 msgr2=0x7f0560072a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:30.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.124+0000 7f056559d700 1 -- 172.21.15.46:0/446439558 shutdown_connections 2023-10-19T12:43:30.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.124+0000 7f056559d700 1 -- 172.21.15.46:0/446439558 wait complete. 2023-10-19T12:43:30.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:29 smithi195 ceph-mon[134493]: pgmap v352: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-10-19T12:43:30.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:29 smithi195 ceph-mon[134493]: osdmap e92: 12 total, 12 up, 12 in 2023-10-19T12:43:30.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:29 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/1014465480' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-19T12:43:30.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:29 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/3917559986' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-19T12:43:30.145 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-19T12:43:30.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.351+0000 7efd763ff700 1 -- 172.21.15.46:0/1437676003 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efd701007a0 msgr2=0x7efd70100bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:30.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.351+0000 7efd763ff700 1 --2- 172.21.15.46:0/1437676003 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efd701007a0 0x7efd70100bc0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7efd60009990 tx=0x7efd60009ca0 comp rx=0 tx=0).stop 2023-10-19T12:43:30.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.351+0000 7efd763ff700 1 -- 172.21.15.46:0/1437676003 shutdown_connections 2023-10-19T12:43:30.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.351+0000 7efd763ff700 1 --2- 172.21.15.46:0/1437676003 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd70102330 0x7efd70108be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:30.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.351+0000 7efd763ff700 1 --2- 172.21.15.46:0/1437676003 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efd701007a0 0x7efd70100bc0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:30.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.351+0000 7efd763ff700 1 --2- 172.21.15.46:0/1437676003 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efd70101990 0x7efd70101df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:30.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.351+0000 7efd763ff700 1 -- 172.21.15.46:0/1437676003 >> 172.21.15.46:0/1437676003 conn(0x7efd700fbcf0 msgr2=0x7efd700fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:30.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.351+0000 7efd763ff700 1 -- 172.21.15.46:0/1437676003 shutdown_connections 2023-10-19T12:43:30.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.351+0000 7efd763ff700 1 -- 172.21.15.46:0/1437676003 wait complete. 2023-10-19T12:43:30.358 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.352+0000 7efd763ff700 1 Processor -- start 2023-10-19T12:43:30.358 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.352+0000 7efd763ff700 1 -- start start 2023-10-19T12:43:30.358 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.352+0000 7efd763ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efd701007a0 0x7efd70198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:30.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.352+0000 7efd763ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efd70101990 0x7efd70198ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:30.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.352+0000 7efd763ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd70102330 0x7efd7019fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:30.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.352+0000 7efd763ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd701a0490 con 0x7efd70102330 2023-10-19T12:43:30.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.352+0000 7efd763ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd701a05d0 con 0x7efd70101990 2023-10-19T12:43:30.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.352+0000 7efd763ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd701a0760 con 0x7efd701007a0 2023-10-19T12:43:30.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.353+0000 7efd7499c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd70102330 0x7efd7019fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:30.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.353+0000 7efd6ffff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efd701007a0 0x7efd70198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:30.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.353+0000 7efd7499c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd70102330 0x7efd7019fec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60716/0 (socket says 172.21.15.46:60716) 2023-10-19T12:43:30.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.353+0000 7efd7499c700 1 -- 172.21.15.46:0/3613589734 learned_addr learned my addr 172.21.15.46:0/3613589734 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:43:30.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.353+0000 7efd6f7fe700 1 --2- 172.21.15.46:0/3613589734 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efd70101990 0x7efd70198ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:30.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.353+0000 7efd6ffff700 1 -- 172.21.15.46:0/3613589734 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efd70101990 msgr2=0x7efd70198ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:30.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.353+0000 7efd6ffff700 1 --2- 172.21.15.46:0/3613589734 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efd70101990 0x7efd70198ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:30.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.353+0000 7efd6ffff700 1 -- 172.21.15.46:0/3613589734 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd70102330 msgr2=0x7efd7019fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:30.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.353+0000 7efd6ffff700 1 --2- 172.21.15.46:0/3613589734 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd70102330 0x7efd7019fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:30.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.353+0000 7efd6ffff700 1 -- 172.21.15.46:0/3613589734 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd600095f0 con 0x7efd701007a0 2023-10-19T12:43:30.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.353+0000 7efd7499c700 1 --2- 172.21.15.46:0/3613589734 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd70102330 0x7efd7019fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:43:30.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.353+0000 7efd6ffff700 1 --2- 172.21.15.46:0/3613589734 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efd701007a0 0x7efd70198960 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7efd600098e0 tx=0x7efd60009580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:30.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.353+0000 7efd6d7fa700 1 -- 172.21.15.46:0/3613589734 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd6001d070 con 0x7efd701007a0 2023-10-19T12:43:30.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.354+0000 7efd6d7fa700 1 -- 172.21.15.46:0/3613589734 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efd60021410 con 0x7efd701007a0 2023-10-19T12:43:30.363 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.354+0000 7efd6d7fa700 1 -- 172.21.15.46:0/3613589734 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd60017650 con 0x7efd701007a0 2023-10-19T12:43:30.363 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.354+0000 7efd763ff700 1 -- 172.21.15.46:0/3613589734 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd701a09e0 con 0x7efd701007a0 2023-10-19T12:43:30.363 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.354+0000 7efd763ff700 1 -- 172.21.15.46:0/3613589734 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd701a0db0 con 0x7efd701007a0 2023-10-19T12:43:30.363 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.355+0000 7efd763ff700 1 -- 172.21.15.46:0/3613589734 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd700675a0 con 0x7efd701007a0 2023-10-19T12:43:30.364 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.357+0000 7efd6d7fa700 1 -- 172.21.15.46:0/3613589734 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7efd60021580 con 0x7efd701007a0 2023-10-19T12:43:30.364 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.358+0000 7efd6d7fa700 1 --2- 172.21.15.46:0/3613589734 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7efd580a1480 0x7efd580a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:30.365 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.358+0000 7efd6d7fa700 1 -- 172.21.15.46:0/3613589734 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7efd600cea80 con 0x7efd701007a0 2023-10-19T12:43:30.365 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.359+0000 7efd6f7fe700 1 --2- 172.21.15.46:0/3613589734 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7efd580a1480 0x7efd580a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:30.365 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.359+0000 7efd6f7fe700 1 --2- 172.21.15.46:0/3613589734 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7efd580a1480 0x7efd580a3940 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7efd64009c60 tx=0x7efd64009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:30.365 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.360+0000 7efd6d7fa700 1 -- 172.21.15.46:0/3613589734 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7efd60097d40 con 0x7efd701007a0 2023-10-19T12:43:30.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.576+0000 7efd763ff700 1 -- 172.21.15.46:0/3613589734 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7efd7010c150 con 0x7efd701007a0 2023-10-19T12:43:30.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.577+0000 7efd6d7fa700 1 -- 172.21.15.46:0/3613589734 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v92) v1 ==== 100+0+11 (secure 0 0 0) 0x7efd60005740 con 0x7efd701007a0 2023-10-19T12:43:30.580 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2023-10-19T12:43:30.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.579+0000 7efd763ff700 1 -- 172.21.15.46:0/3613589734 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7efd580a1480 msgr2=0x7efd580a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:30.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.579+0000 7efd763ff700 1 --2- 172.21.15.46:0/3613589734 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7efd580a1480 0x7efd580a3940 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7efd64009c60 tx=0x7efd64009260 comp rx=0 tx=0).stop 2023-10-19T12:43:30.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.579+0000 7efd763ff700 1 -- 172.21.15.46:0/3613589734 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efd701007a0 msgr2=0x7efd70198960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:30.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.579+0000 7efd763ff700 1 --2- 172.21.15.46:0/3613589734 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efd701007a0 0x7efd70198960 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7efd600098e0 tx=0x7efd60009580 comp rx=0 tx=0).stop 2023-10-19T12:43:30.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.579+0000 7efd763ff700 1 -- 172.21.15.46:0/3613589734 shutdown_connections 2023-10-19T12:43:30.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.579+0000 7efd763ff700 1 --2- 172.21.15.46:0/3613589734 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd70102330 0x7efd7019fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:30.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.579+0000 7efd763ff700 1 --2- 172.21.15.46:0/3613589734 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7efd580a1480 0x7efd580a3940 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:30.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.579+0000 7efd763ff700 1 --2- 172.21.15.46:0/3613589734 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efd701007a0 0x7efd70198960 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:30.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.579+0000 7efd763ff700 1 --2- 172.21.15.46:0/3613589734 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efd70101990 0x7efd70198ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:30.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.579+0000 7efd763ff700 1 -- 172.21.15.46:0/3613589734 >> 172.21.15.46:0/3613589734 conn(0x7efd700fbcf0 msgr2=0x7efd70072a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:30.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.579+0000 7efd763ff700 1 -- 172.21.15.46:0/3613589734 shutdown_connections 2023-10-19T12:43:30.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.579+0000 7efd763ff700 1 -- 172.21.15.46:0/3613589734 wait complete. 2023-10-19T12:43:30.602 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-19T12:43:30.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.807+0000 7fb9859ff700 1 -- 172.21.15.46:0/509220942 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb980101990 msgr2=0x7fb980101df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:30.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.807+0000 7fb9859ff700 1 --2- 172.21.15.46:0/509220942 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb980101990 0x7fb980101df0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fb9680099c0 tx=0x7fb968009cd0 comp rx=0 tx=0).stop 2023-10-19T12:43:30.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.807+0000 7fb9859ff700 1 -- 172.21.15.46:0/509220942 shutdown_connections 2023-10-19T12:43:30.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.807+0000 7fb9859ff700 1 --2- 172.21.15.46:0/509220942 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb980102330 0x7fb980108be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:30.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.807+0000 7fb9859ff700 1 --2- 172.21.15.46:0/509220942 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb9801007a0 0x7fb980100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:30.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.807+0000 7fb9859ff700 1 --2- 172.21.15.46:0/509220942 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb980101990 0x7fb980101df0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:30.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.807+0000 7fb9859ff700 1 -- 172.21.15.46:0/509220942 >> 172.21.15.46:0/509220942 conn(0x7fb9800fbcf0 msgr2=0x7fb9800fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:30.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.807+0000 7fb9859ff700 1 -- 172.21.15.46:0/509220942 shutdown_connections 2023-10-19T12:43:30.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.807+0000 7fb9859ff700 1 -- 172.21.15.46:0/509220942 wait complete. 2023-10-19T12:43:30.815 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.809+0000 7fb9859ff700 1 Processor -- start 2023-10-19T12:43:30.815 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.809+0000 7fb9859ff700 1 -- start start 2023-10-19T12:43:30.815 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.809+0000 7fb9859ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9801007a0 0x7fb980198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:30.815 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.809+0000 7fb9859ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb980101990 0x7fb980198ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:30.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.809+0000 7fb9859ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb980102330 0x7fb98019fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:30.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.809+0000 7fb9859ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9801a0410 con 0x7fb9801007a0 2023-10-19T12:43:30.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.809+0000 7fb9859ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9801a0550 con 0x7fb980102330 2023-10-19T12:43:30.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.809+0000 7fb9859ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9801a06e0 con 0x7fb980101990 2023-10-19T12:43:30.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.810+0000 7fb97effd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9801007a0 0x7fb980198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:30.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.810+0000 7fb97effd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9801007a0 0x7fb980198980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60732/0 (socket says 172.21.15.46:60732) 2023-10-19T12:43:30.818 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.810+0000 7fb97effd700 1 -- 172.21.15.46:0/655324033 learned_addr learned my addr 172.21.15.46:0/655324033 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:43:30.818 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.810+0000 7fb977fff700 1 --2- 172.21.15.46:0/655324033 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb980101990 0x7fb980198ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:30.818 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.810+0000 7fb97f7fe700 1 --2- 172.21.15.46:0/655324033 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb980102330 0x7fb98019fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:30.819 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.810+0000 7fb97effd700 1 -- 172.21.15.46:0/655324033 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb980101990 msgr2=0x7fb980198ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:30.819 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.810+0000 7fb97effd700 1 --2- 172.21.15.46:0/655324033 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb980101990 0x7fb980198ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:30.820 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.810+0000 7fb97effd700 1 -- 172.21.15.46:0/655324033 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb980102330 msgr2=0x7fb98019fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:30.820 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.810+0000 7fb97effd700 1 --2- 172.21.15.46:0/655324033 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb980102330 0x7fb98019fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:30.820 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.810+0000 7fb97effd700 1 -- 172.21.15.46:0/655324033 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9680095f0 con 0x7fb9801007a0 2023-10-19T12:43:30.820 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.810+0000 7fb97effd700 1 --2- 172.21.15.46:0/655324033 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9801007a0 0x7fb980198980 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fb97000e970 tx=0x7fb97000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:30.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.811+0000 7fb9849fd700 1 -- 172.21.15.46:0/655324033 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb970009790 con 0x7fb9801007a0 2023-10-19T12:43:30.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.811+0000 7fb9849fd700 1 -- 172.21.15.46:0/655324033 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb97000eec0 con 0x7fb9801007a0 2023-10-19T12:43:30.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.811+0000 7fb9849fd700 1 -- 172.21.15.46:0/655324033 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb970003cf0 con 0x7fb9801007a0 2023-10-19T12:43:30.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.811+0000 7fb9859ff700 1 -- 172.21.15.46:0/655324033 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9801a09c0 con 0x7fb9801007a0 2023-10-19T12:43:30.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.811+0000 7fb9859ff700 1 -- 172.21.15.46:0/655324033 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9801a0ed0 con 0x7fb9801007a0 2023-10-19T12:43:30.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.812+0000 7fb9859ff700 1 -- 172.21.15.46:0/655324033 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9800675a0 con 0x7fb9801007a0 2023-10-19T12:43:30.823 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.814+0000 7fb9849fd700 1 -- 172.21.15.46:0/655324033 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fb97000ccd0 con 0x7fb9801007a0 2023-10-19T12:43:30.823 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.817+0000 7fb9849fd700 1 --2- 172.21.15.46:0/655324033 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fb96c0a1500 0x7fb96c0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:30.824 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.818+0000 7fb9849fd700 1 -- 172.21.15.46:0/655324033 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7fb970014070 con 0x7fb9801007a0 2023-10-19T12:43:30.824 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.818+0000 7fb977fff700 1 --2- 172.21.15.46:0/655324033 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fb96c0a1500 0x7fb96c0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:30.824 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.818+0000 7fb977fff700 1 --2- 172.21.15.46:0/655324033 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fb96c0a1500 0x7fb96c0a39c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fb968003730 tx=0x7fb96800b540 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:30.825 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:30.821+0000 7fb9849fd700 1 -- 172.21.15.46:0/655324033 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb970096550 con 0x7fb9801007a0 2023-10-19T12:43:30.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:30 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/446439558' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-19T12:43:30.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:30 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/3613589734' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-19T12:43:31.049 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.046+0000 7fb9859ff700 1 -- 172.21.15.46:0/655324033 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fb9801a1230 con 0x7fb9801007a0 2023-10-19T12:43:31.049 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.046+0000 7fb9849fd700 1 -- 172.21.15.46:0/655324033 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v92) v1 ==== 103+0+11 (secure 0 0 0) 0x7fb970099b70 con 0x7fb9801007a0 2023-10-19T12:43:31.050 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2023-10-19T12:43:31.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.049+0000 7fb9859ff700 1 -- 172.21.15.46:0/655324033 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fb96c0a1500 msgr2=0x7fb96c0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:31.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.049+0000 7fb9859ff700 1 --2- 172.21.15.46:0/655324033 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fb96c0a1500 0x7fb96c0a39c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fb968003730 tx=0x7fb96800b540 comp rx=0 tx=0).stop 2023-10-19T12:43:31.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.049+0000 7fb9859ff700 1 -- 172.21.15.46:0/655324033 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9801007a0 msgr2=0x7fb980198980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:31.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.049+0000 7fb9859ff700 1 --2- 172.21.15.46:0/655324033 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9801007a0 0x7fb980198980 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fb97000e970 tx=0x7fb97000ec80 comp rx=0 tx=0).stop 2023-10-19T12:43:31.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.049+0000 7fb9859ff700 1 -- 172.21.15.46:0/655324033 shutdown_connections 2023-10-19T12:43:31.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.049+0000 7fb9859ff700 1 --2- 172.21.15.46:0/655324033 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb980102330 0x7fb98019fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:31.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.049+0000 7fb9859ff700 1 --2- 172.21.15.46:0/655324033 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9801007a0 0x7fb980198980 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:31.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.049+0000 7fb9859ff700 1 --2- 172.21.15.46:0/655324033 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fb96c0a1500 0x7fb96c0a39c0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:31.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.049+0000 7fb9859ff700 1 --2- 172.21.15.46:0/655324033 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb980101990 0x7fb980198ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:31.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.049+0000 7fb9859ff700 1 -- 172.21.15.46:0/655324033 >> 172.21.15.46:0/655324033 conn(0x7fb9800fbcf0 msgr2=0x7fb980072a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:31.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.049+0000 7fb9859ff700 1 -- 172.21.15.46:0/655324033 shutdown_connections 2023-10-19T12:43:31.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.049+0000 7fb9859ff700 1 -- 172.21.15.46:0/655324033 wait complete. 2023-10-19T12:43:31.071 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2023-10-19T12:43:31.071 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-19T12:43:31.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:30 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/446439558' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-19T12:43:31.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:30 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/3613589734' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-19T12:43:31.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:30 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/446439558' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-19T12:43:31.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:30 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/3613589734' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-19T12:43:31.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.274+0000 7f409e5ff700 1 -- 172.21.15.46:0/2199549655 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4098100740 msgr2=0x7f4098100b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:31.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.274+0000 7f409e5ff700 1 --2- 172.21.15.46:0/2199549655 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4098100740 0x7f4098100b60 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f40880099c0 tx=0x7f4088009cd0 comp rx=0 tx=0).stop 2023-10-19T12:43:31.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.274+0000 7f409e5ff700 1 -- 172.21.15.46:0/2199549655 shutdown_connections 2023-10-19T12:43:31.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.274+0000 7f409e5ff700 1 --2- 172.21.15.46:0/2199549655 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f40981022d0 0x7f4098108b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:31.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.274+0000 7f409e5ff700 1 --2- 172.21.15.46:0/2199549655 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4098100740 0x7f4098100b60 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:31.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.274+0000 7f409e5ff700 1 --2- 172.21.15.46:0/2199549655 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4098101930 0x7f4098101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:31.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.274+0000 7f409e5ff700 1 -- 172.21.15.46:0/2199549655 >> 172.21.15.46:0/2199549655 conn(0x7f40980fbc90 msgr2=0x7f40980fe0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:31.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.274+0000 7f409e5ff700 1 -- 172.21.15.46:0/2199549655 shutdown_connections 2023-10-19T12:43:31.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.274+0000 7f409e5ff700 1 -- 172.21.15.46:0/2199549655 wait complete. 2023-10-19T12:43:31.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.275+0000 7f409e5ff700 1 Processor -- start 2023-10-19T12:43:31.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.275+0000 7f409e5ff700 1 -- start start 2023-10-19T12:43:31.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.275+0000 7f409e5ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4098100740 0x7f4098196700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:31.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.275+0000 7f409e5ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4098101930 0x7f4098196c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:31.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.275+0000 7f409e5ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f40981022d0 0x7f409819dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:31.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.275+0000 7f409e5ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f409819e230 con 0x7f4098101930 2023-10-19T12:43:31.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.275+0000 7f409e5ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f409819e370 con 0x7f4098100740 2023-10-19T12:43:31.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.275+0000 7f409e5ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f409819e500 con 0x7f40981022d0 2023-10-19T12:43:31.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.276+0000 7f4097fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4098100740 0x7f4098196700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:31.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.276+0000 7f4097fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4098100740 0x7f4098196700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:34770/0 (socket says 172.21.15.46:34770) 2023-10-19T12:43:31.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.276+0000 7f4097fff700 1 -- 172.21.15.46:0/2516366941 learned_addr learned my addr 172.21.15.46:0/2516366941 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:43:31.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.276+0000 7f40977fe700 1 --2- 172.21.15.46:0/2516366941 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4098101930 0x7f4098196c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:31.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.276+0000 7f409cb9c700 1 --2- 172.21.15.46:0/2516366941 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f40981022d0 0x7f409819dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:31.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.276+0000 7f4097fff700 1 -- 172.21.15.46:0/2516366941 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f40981022d0 msgr2=0x7f409819dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:31.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.276+0000 7f4097fff700 1 --2- 172.21.15.46:0/2516366941 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f40981022d0 0x7f409819dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:31.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.276+0000 7f4097fff700 1 -- 172.21.15.46:0/2516366941 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4098101930 msgr2=0x7f4098196c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:31.284 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.276+0000 7f4097fff700 1 --2- 172.21.15.46:0/2516366941 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4098101930 0x7f4098196c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:31.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.276+0000 7f4097fff700 1 -- 172.21.15.46:0/2516366941 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40880095f0 con 0x7f4098100740 2023-10-19T12:43:31.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.276+0000 7f4097fff700 1 --2- 172.21.15.46:0/2516366941 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4098100740 0x7f4098196700 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4088003730 tx=0x7f408800f690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:31.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.277+0000 7f40957fa700 1 -- 172.21.15.46:0/2516366941 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f408801d070 con 0x7f4098100740 2023-10-19T12:43:31.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.277+0000 7f409e5ff700 1 -- 172.21.15.46:0/2516366941 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f409819e780 con 0x7f4098100740 2023-10-19T12:43:31.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.277+0000 7f40957fa700 1 -- 172.21.15.46:0/2516366941 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4088005050 con 0x7f4098100740 2023-10-19T12:43:31.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.277+0000 7f40957fa700 1 -- 172.21.15.46:0/2516366941 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4088004a50 con 0x7f4098100740 2023-10-19T12:43:31.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.277+0000 7f409e5ff700 1 -- 172.21.15.46:0/2516366941 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f409819ec00 con 0x7f4098100740 2023-10-19T12:43:31.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.278+0000 7f409e5ff700 1 -- 172.21.15.46:0/2516366941 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4098107c30 con 0x7f4098100740 2023-10-19T12:43:31.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.280+0000 7f40957fa700 1 -- 172.21.15.46:0/2516366941 <== mon.2 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f40880051c0 con 0x7f4098100740 2023-10-19T12:43:31.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.281+0000 7f40957fa700 1 --2- 172.21.15.46:0/2516366941 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f40800a1480 0x7f40800a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:31.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.281+0000 7f40957fa700 1 -- 172.21.15.46:0/2516366941 <== mon.2 v2:172.21.15.157:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f40880ce240 con 0x7f4098100740 2023-10-19T12:43:31.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.282+0000 7f40977fe700 1 --2- 172.21.15.46:0/2516366941 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f40800a1480 0x7f40800a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:31.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.282+0000 7f40977fe700 1 --2- 172.21.15.46:0/2516366941 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f40800a1480 0x7f40800a3940 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f408c009c60 tx=0x7f408c009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:31.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.284+0000 7f40957fa700 1 -- 172.21.15.46:0/2516366941 <== mon.2 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f4088097500 con 0x7f4098100740 2023-10-19T12:43:31.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.548+0000 7f409e5ff700 1 -- 172.21.15.46:0/2516366941 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4098067530 con 0x7f4098100740 2023-10-19T12:43:31.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.549+0000 7f40957fa700 1 -- 172.21.15.46:0/2516366941 <== mon.2 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+11372 (secure 0 0 0) 0x7f408809ab20 con 0x7f4098100740 2023-10-19T12:43:31.553 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:43:31.553 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14580,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/2235286008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":2235286008},{"type":"v1","addr":"172.21.15.46:6835","nonce":2235286008}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14592,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/339398444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":339398444},{"type":"v1","addr":"172.21.15.46:6837","nonce":339398444}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-19T12:41:18.815780+0000","modified":"2023-10-19T12:41:47.301944+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24680,"mds_1":24655,"mds_2":24643,"mds_3":24631,"mds_4":24629},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14640":{"gid":14640,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.46:6839/1655843965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":1655843965},{"type":"v1","addr":"172.21.15.46:6839","nonce":1655843965}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14652":{"gid":14652,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.46:6841/4204925553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6840","nonce":4204925553},{"type":"v1","addr":"172.21.15.46:6841","nonce":4204925553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24560":{"gid":24560,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.157:6833/1687745569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":1687745569},{"type":"v1","addr":"172.21.15.157:6833","nonce":1687745569}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24574":{"gid":24574,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.195:6833/3629933235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3629933235},{"type":"v1","addr":"172.21.15.195:6833","nonce":3629933235}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24602":{"gid":24602,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.157:6835/108432552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":108432552},{"type":"v1","addr":"172.21.15.157:6835","nonce":108432552}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24629":{"gid":24629,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":13,"addr":"172.21.15.157:6837/2629536514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6836","nonce":2629536514},{"type":"v1","addr":"172.21.15.157:6837","nonce":2629536514}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24631":{"gid":24631,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.195:6835/1406909915","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":1406909915},{"type":"v1","addr":"172.21.15.195:6835","nonce":1406909915}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24643":{"gid":24643,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":13,"addr":"172.21.15.195:6837/293916188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":293916188},{"type":"v1","addr":"172.21.15.195:6837","nonce":293916188}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24655":{"gid":24655,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":11,"addr":"172.21.15.195:6839/4094901934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6838","nonce":4094901934},{"type":"v1","addr":"172.21.15.195:6839","nonce":4094901934}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24680":{"gid":24680,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.157:6839/552718978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6838","nonce":552718978},{"type":"v1","addr":"172.21.15.157:6839","nonce":552718978}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-19T12:43:31.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.552+0000 7f409e5ff700 1 -- 172.21.15.46:0/2516366941 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f40800a1480 msgr2=0x7f40800a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:31.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.552+0000 7f409e5ff700 1 --2- 172.21.15.46:0/2516366941 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f40800a1480 0x7f40800a3940 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f408c009c60 tx=0x7f408c009260 comp rx=0 tx=0).stop 2023-10-19T12:43:31.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.552+0000 7f409e5ff700 1 -- 172.21.15.46:0/2516366941 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4098100740 msgr2=0x7f4098196700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:31.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.552+0000 7f409e5ff700 1 --2- 172.21.15.46:0/2516366941 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4098100740 0x7f4098196700 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4088003730 tx=0x7f408800f690 comp rx=0 tx=0).stop 2023-10-19T12:43:31.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.552+0000 7f409e5ff700 1 -- 172.21.15.46:0/2516366941 shutdown_connections 2023-10-19T12:43:31.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.552+0000 7f409e5ff700 1 --2- 172.21.15.46:0/2516366941 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f40800a1480 0x7f40800a3940 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:31.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.552+0000 7f409e5ff700 1 --2- 172.21.15.46:0/2516366941 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f40981022d0 0x7f409819dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:31.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.552+0000 7f409e5ff700 1 --2- 172.21.15.46:0/2516366941 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4098100740 0x7f4098196700 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:31.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.552+0000 7f409e5ff700 1 --2- 172.21.15.46:0/2516366941 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4098101930 0x7f4098196c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:31.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.552+0000 7f409e5ff700 1 -- 172.21.15.46:0/2516366941 >> 172.21.15.46:0/2516366941 conn(0x7f40980fbc90 msgr2=0x7f4098104d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:31.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.552+0000 7f409e5ff700 1 -- 172.21.15.46:0/2516366941 shutdown_connections 2023-10-19T12:43:31.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.552+0000 7f409e5ff700 1 -- 172.21.15.46:0/2516366941 wait complete. 2023-10-19T12:43:31.558 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 27 2023-10-19T12:43:31.574 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2023-10-19T12:43:31.575 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2023-10-19T12:43:31.575 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-19T12:43:31.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.779+0000 7f39e6dff700 1 -- 172.21.15.46:0/98289231 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f39e01011f0 msgr2=0x7f39e01035e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:31.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.779+0000 7f39e6dff700 1 --2- 172.21.15.46:0/98289231 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f39e01011f0 0x7f39e01035e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f39d4009990 tx=0x7f39d4009ca0 comp rx=0 tx=0).stop 2023-10-19T12:43:31.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.779+0000 7f39e6dff700 1 -- 172.21.15.46:0/98289231 shutdown_connections 2023-10-19T12:43:31.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.779+0000 7f39e6dff700 1 --2- 172.21.15.46:0/98289231 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f39e0106450 0x7f39e0108860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:31.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.779+0000 7f39e6dff700 1 --2- 172.21.15.46:0/98289231 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f39e01011f0 0x7f39e01035e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:31.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.779+0000 7f39e6dff700 1 --2- 172.21.15.46:0/98289231 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f39e0103b20 0x7f39e0105f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:31.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.779+0000 7f39e6dff700 1 -- 172.21.15.46:0/98289231 >> 172.21.15.46:0/98289231 conn(0x7f39e00faba0 msgr2=0x7f39e00fcfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:31.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.779+0000 7f39e6dff700 1 -- 172.21.15.46:0/98289231 shutdown_connections 2023-10-19T12:43:31.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.779+0000 7f39e6dff700 1 -- 172.21.15.46:0/98289231 wait complete. 2023-10-19T12:43:31.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.780+0000 7f39e6dff700 1 Processor -- start 2023-10-19T12:43:31.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.781+0000 7f39e6dff700 1 -- start start 2023-10-19T12:43:31.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.781+0000 7f39e6dff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f39e01011f0 0x7f39e01988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:31.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.781+0000 7f39e6dff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f39e0103b20 0x7f39e0198df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:31.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.781+0000 7f39e6dff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f39e0106450 0x7f39e019fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:31.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.781+0000 7f39e6dff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39e01a03e0 con 0x7f39e0103b20 2023-10-19T12:43:31.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.781+0000 7f39e6dff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39e01a0520 con 0x7f39e01011f0 2023-10-19T12:43:31.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.781+0000 7f39e6dff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39e01a06b0 con 0x7f39e0106450 2023-10-19T12:43:31.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.781+0000 7f39e4b9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f39e01011f0 0x7f39e01988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:31.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.781+0000 7f39e4b9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f39e01011f0 0x7f39e01988b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:34780/0 (socket says 172.21.15.46:34780) 2023-10-19T12:43:31.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.781+0000 7f39e4b9b700 1 -- 172.21.15.46:0/1126194360 learned_addr learned my addr 172.21.15.46:0/1126194360 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:43:31.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.781+0000 7f39dffff700 1 --2- 172.21.15.46:0/1126194360 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f39e0103b20 0x7f39e0198df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:31.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.781+0000 7f39e539c700 1 --2- 172.21.15.46:0/1126194360 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f39e0106450 0x7f39e019fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:31.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.782+0000 7f39e4b9b700 1 -- 172.21.15.46:0/1126194360 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f39e0106450 msgr2=0x7f39e019fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:31.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.782+0000 7f39e4b9b700 1 --2- 172.21.15.46:0/1126194360 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f39e0106450 0x7f39e019fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:31.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.782+0000 7f39e4b9b700 1 -- 172.21.15.46:0/1126194360 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f39e0103b20 msgr2=0x7f39e0198df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:31.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.782+0000 7f39e4b9b700 1 --2- 172.21.15.46:0/1126194360 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f39e0103b20 0x7f39e0198df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:31.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.782+0000 7f39e4b9b700 1 -- 172.21.15.46:0/1126194360 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39d40095f0 con 0x7f39e01011f0 2023-10-19T12:43:31.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.782+0000 7f39e4b9b700 1 --2- 172.21.15.46:0/1126194360 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f39e01011f0 0x7f39e01988b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f39d400b680 tx=0x7f39d4009580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:31.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.782+0000 7f39ddffb700 1 -- 172.21.15.46:0/1126194360 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d401d070 con 0x7f39e01011f0 2023-10-19T12:43:31.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.782+0000 7f39e6dff700 1 -- 172.21.15.46:0/1126194360 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39e01a0930 con 0x7f39e01011f0 2023-10-19T12:43:31.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.782+0000 7f39ddffb700 1 -- 172.21.15.46:0/1126194360 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f39d4022470 con 0x7f39e01011f0 2023-10-19T12:43:31.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.782+0000 7f39ddffb700 1 -- 172.21.15.46:0/1126194360 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d4017650 con 0x7f39e01011f0 2023-10-19T12:43:31.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.782+0000 7f39e6dff700 1 -- 172.21.15.46:0/1126194360 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39e01a0d50 con 0x7f39e01011f0 2023-10-19T12:43:31.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.783+0000 7f39e6dff700 1 -- 172.21.15.46:0/1126194360 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39e0107fd0 con 0x7f39e01011f0 2023-10-19T12:43:31.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.785+0000 7f39ddffb700 1 -- 172.21.15.46:0/1126194360 <== mon.2 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f39d4022870 con 0x7f39e01011f0 2023-10-19T12:43:31.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.787+0000 7f39ddffb700 1 --2- 172.21.15.46:0/1126194360 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f39d00a1480 0x7f39d00a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:31.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.787+0000 7f39ddffb700 1 -- 172.21.15.46:0/1126194360 <== mon.2 v2:172.21.15.157:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f39d40ce4d0 con 0x7f39e01011f0 2023-10-19T12:43:31.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.787+0000 7f39dffff700 1 --2- 172.21.15.46:0/1126194360 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f39d00a1480 0x7f39d00a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:31.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.788+0000 7f39dffff700 1 --2- 172.21.15.46:0/1126194360 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f39d00a1480 0x7f39d00a3940 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f39cc009c60 tx=0x7f39cc009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:31.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.791+0000 7f39ddffb700 1 -- 172.21.15.46:0/1126194360 <== mon.2 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f39d4097790 con 0x7f39e01011f0 2023-10-19T12:43:31.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:31 smithi046 ceph-mon[98509]: pgmap v354: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 255 B/s wr, 7 op/s 2023-10-19T12:43:31.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:31 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/655324033' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-19T12:43:31.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:31 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/2516366941' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-19T12:43:32.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:31.999+0000 7f39e6dff700 1 -- 172.21.15.46:0/1126194360 --> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f39e0067500 con 0x7f39d00a1480 2023-10-19T12:43:32.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.013+0000 7f39ddffb700 1 -- 172.21.15.46:0/1126194360 <== mgr.14150 v2:172.21.15.46:6800/3168073651 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+426729 (secure 0 0 0) 0x7f39e0067500 con 0x7f39d00a1480 2023-10-19T12:43:32.021 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:43:32.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.018+0000 7f39e6dff700 1 -- 172.21.15.46:0/1126194360 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f39d00a1480 msgr2=0x7f39d00a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:32.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.018+0000 7f39e6dff700 1 --2- 172.21.15.46:0/1126194360 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f39d00a1480 0x7f39d00a3940 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f39cc009c60 tx=0x7f39cc009260 comp rx=0 tx=0).stop 2023-10-19T12:43:32.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.018+0000 7f39e6dff700 1 -- 172.21.15.46:0/1126194360 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f39e01011f0 msgr2=0x7f39e01988b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:32.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.018+0000 7f39e6dff700 1 --2- 172.21.15.46:0/1126194360 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f39e01011f0 0x7f39e01988b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f39d400b680 tx=0x7f39d4009580 comp rx=0 tx=0).stop 2023-10-19T12:43:32.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.018+0000 7f39e6dff700 1 -- 172.21.15.46:0/1126194360 shutdown_connections 2023-10-19T12:43:32.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.018+0000 7f39e6dff700 1 --2- 172.21.15.46:0/1126194360 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f39d00a1480 0x7f39d00a3940 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:32.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.018+0000 7f39e6dff700 1 --2- 172.21.15.46:0/1126194360 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f39e0106450 0x7f39e019fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:32.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.018+0000 7f39e6dff700 1 --2- 172.21.15.46:0/1126194360 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f39e01011f0 0x7f39e01988b0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:32.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.018+0000 7f39e6dff700 1 --2- 172.21.15.46:0/1126194360 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f39e0103b20 0x7f39e0198df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:32.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.018+0000 7f39e6dff700 1 -- 172.21.15.46:0/1126194360 >> 172.21.15.46:0/1126194360 conn(0x7f39e00faba0 msgr2=0x7f39e0100a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:32.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.018+0000 7f39e6dff700 1 -- 172.21.15.46:0/1126194360 shutdown_connections 2023-10-19T12:43:32.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.018+0000 7f39e6dff700 1 -- 172.21.15.46:0/1126194360 wait complete. 2023-10-19T12:43:32.027 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-10-19T12:43:32.041 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":354,"stamp":"2023-10-19T12:43:30.672366+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658573,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1157,"num_read_kb":699,"num_write":431,"num_write_kb":3084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":1181940,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":855,"ondisk_log_size":855,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":422,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":338380,"kb_used_data":14160,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124603444,"statfs":{"total":1151940427776,"available":1151593926656,"internally_reserved":0,"allocated":14499840,"data_stored":7953190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19130,"internal_metadata":331855174},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":316,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":31,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001986"},"pg_stats":[{"pgid":"3.3f","version":"90'8","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:56.693361+0000","last_change":"2023-10-19T12:41:19.300761+0000","last_active":"2023-10-19T12:42:56.693361+0000","last_peered":"2023-10-19T12:42:56.693361+0000","last_clean":"2023-10-19T12:42:56.693361+0000","last_became_active":"2023-10-19T12:41:19.300431+0000","last_became_peered":"2023-10-19T12:41:19.300431+0000","last_unstale":"2023-10-19T12:42:56.693361+0000","last_undegraded":"2023-10-19T12:42:56.693361+0000","last_fullsized":"2023-10-19T12:42:56.693361+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-21T00:36:29.735726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"90'4","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.769387+0000","last_change":"2023-10-19T12:41:19.300748+0000","last_active":"2023-10-19T12:43:27.769387+0000","last_peered":"2023-10-19T12:43:27.769387+0000","last_clean":"2023-10-19T12:43:27.769387+0000","last_became_active":"2023-10-19T12:41:19.294769+0000","last_became_peered":"2023-10-19T12:41:19.294769+0000","last_unstale":"2023-10-19T12:43:27.769387+0000","last_undegraded":"2023-10-19T12:43:27.769387+0000","last_fullsized":"2023-10-19T12:43:27.769387+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T23:04:58.055573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"90'7","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.769281+0000","last_change":"2023-10-19T12:41:19.294264+0000","last_active":"2023-10-19T12:43:27.769281+0000","last_peered":"2023-10-19T12:43:27.769281+0000","last_clean":"2023-10-19T12:43:27.769281+0000","last_became_active":"2023-10-19T12:41:19.293878+0000","last_became_peered":"2023-10-19T12:41:19.293878+0000","last_unstale":"2023-10-19T12:43:27.769281+0000","last_undegraded":"2023-10-19T12:43:27.769281+0000","last_fullsized":"2023-10-19T12:43:27.769281+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:11:01.049036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"90'8","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.758729+0000","last_change":"2023-10-19T12:42:28.129235+0000","last_active":"2023-10-19T12:43:27.758729+0000","last_peered":"2023-10-19T12:43:27.758729+0000","last_clean":"2023-10-19T12:43:27.758729+0000","last_became_active":"2023-10-19T12:42:28.128818+0000","last_became_peered":"2023-10-19T12:42:28.128818+0000","last_unstale":"2023-10-19T12:43:27.758729+0000","last_undegraded":"2023-10-19T12:43:27.758729+0000","last_fullsized":"2023-10-19T12:43:27.758729+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:16:26.558697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"90'4","reported_seq":23,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.762818+0000","last_change":"2023-10-19T12:41:19.301164+0000","last_active":"2023-10-19T12:43:27.762818+0000","last_peered":"2023-10-19T12:43:27.762818+0000","last_clean":"2023-10-19T12:43:27.762818+0000","last_became_active":"2023-10-19T12:41:19.300920+0000","last_became_peered":"2023-10-19T12:41:19.300920+0000","last_unstale":"2023-10-19T12:43:27.762818+0000","last_undegraded":"2023-10-19T12:43:27.762818+0000","last_fullsized":"2023-10-19T12:43:27.762818+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:15:40.211319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"90'6","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:56.663084+0000","last_change":"2023-10-19T12:41:19.292866+0000","last_active":"2023-10-19T12:42:56.663084+0000","last_peered":"2023-10-19T12:42:56.663084+0000","last_clean":"2023-10-19T12:42:56.663084+0000","last_became_active":"2023-10-19T12:41:19.292392+0000","last_became_peered":"2023-10-19T12:41:19.292392+0000","last_unstale":"2023-10-19T12:42:56.663084+0000","last_undegraded":"2023-10-19T12:42:56.663084+0000","last_fullsized":"2023-10-19T12:42:56.663084+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:37:34.373704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"90'5","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:56.681290+0000","last_change":"2023-10-19T12:42:28.127944+0000","last_active":"2023-10-19T12:42:56.681290+0000","last_peered":"2023-10-19T12:42:56.681290+0000","last_clean":"2023-10-19T12:42:56.681290+0000","last_became_active":"2023-10-19T12:42:28.127619+0000","last_became_peered":"2023-10-19T12:42:28.127619+0000","last_unstale":"2023-10-19T12:42:56.681290+0000","last_undegraded":"2023-10-19T12:42:56.681290+0000","last_fullsized":"2023-10-19T12:42:56.681290+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:01:27.131472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,8],"acting":[7,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"90'9","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:56.694775+0000","last_change":"2023-10-19T12:41:19.290501+0000","last_active":"2023-10-19T12:42:56.694775+0000","last_peered":"2023-10-19T12:42:56.694775+0000","last_clean":"2023-10-19T12:42:56.694775+0000","last_became_active":"2023-10-19T12:41:19.290080+0000","last_became_peered":"2023-10-19T12:41:19.290080+0000","last_unstale":"2023-10-19T12:42:56.694775+0000","last_undegraded":"2023-10-19T12:42:56.694775+0000","last_fullsized":"2023-10-19T12:42:56.694775+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:40:19.827896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"90'11","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:56.679528+0000","last_change":"2023-10-19T12:41:19.304631+0000","last_active":"2023-10-19T12:42:56.679528+0000","last_peered":"2023-10-19T12:42:56.679528+0000","last_clean":"2023-10-19T12:42:56.679528+0000","last_became_active":"2023-10-19T12:41:19.301990+0000","last_became_peered":"2023-10-19T12:41:19.301990+0000","last_unstale":"2023-10-19T12:42:56.679528+0000","last_undegraded":"2023-10-19T12:42:56.679528+0000","last_fullsized":"2023-10-19T12:42:56.679528+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:50:46.128888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"90'16","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:56.672240+0000","last_change":"2023-10-19T12:41:19.294366+0000","last_active":"2023-10-19T12:42:56.672240+0000","last_peered":"2023-10-19T12:42:56.672240+0000","last_clean":"2023-10-19T12:42:56.672240+0000","last_became_active":"2023-10-19T12:41:19.292644+0000","last_became_peered":"2023-10-19T12:41:19.292644+0000","last_unstale":"2023-10-19T12:42:56.672240+0000","last_undegraded":"2023-10-19T12:42:56.672240+0000","last_fullsized":"2023-10-19T12:42:56.672240+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:59:30.111950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"90'6","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:56.684890+0000","last_change":"2023-10-19T12:41:19.290054+0000","last_active":"2023-10-19T12:42:56.684890+0000","last_peered":"2023-10-19T12:42:56.684890+0000","last_clean":"2023-10-19T12:42:56.684890+0000","last_became_active":"2023-10-19T12:41:19.289739+0000","last_became_peered":"2023-10-19T12:41:19.289739+0000","last_unstale":"2023-10-19T12:42:56.684890+0000","last_undegraded":"2023-10-19T12:42:56.684890+0000","last_fullsized":"2023-10-19T12:42:56.684890+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:30:36.398762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"90'7","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.763700+0000","last_change":"2023-10-19T12:41:19.295309+0000","last_active":"2023-10-19T12:43:27.763700+0000","last_peered":"2023-10-19T12:43:27.763700+0000","last_clean":"2023-10-19T12:43:27.763700+0000","last_became_active":"2023-10-19T12:41:19.295009+0000","last_became_peered":"2023-10-19T12:41:19.295009+0000","last_unstale":"2023-10-19T12:43:27.763700+0000","last_undegraded":"2023-10-19T12:43:27.763700+0000","last_fullsized":"2023-10-19T12:43:27.763700+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:27:33.798071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"90'10","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:56.677115+0000","last_change":"2023-10-19T12:41:19.302920+0000","last_active":"2023-10-19T12:42:56.677115+0000","last_peered":"2023-10-19T12:42:56.677115+0000","last_clean":"2023-10-19T12:42:56.677115+0000","last_became_active":"2023-10-19T12:41:19.300250+0000","last_became_peered":"2023-10-19T12:41:19.300250+0000","last_unstale":"2023-10-19T12:42:56.677115+0000","last_undegraded":"2023-10-19T12:42:56.677115+0000","last_fullsized":"2023-10-19T12:42:56.677115+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:51:47.487907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"90'7","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.765252+0000","last_change":"2023-10-19T12:41:19.300654+0000","last_active":"2023-10-19T12:43:27.765252+0000","last_peered":"2023-10-19T12:43:27.765252+0000","last_clean":"2023-10-19T12:43:27.765252+0000","last_became_active":"2023-10-19T12:41:19.295408+0000","last_became_peered":"2023-10-19T12:41:19.295408+0000","last_unstale":"2023-10-19T12:43:27.765252+0000","last_undegraded":"2023-10-19T12:43:27.765252+0000","last_fullsized":"2023-10-19T12:43:27.765252+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:53:47.039077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"90'7","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.765000+0000","last_change":"2023-10-19T12:41:19.293141+0000","last_active":"2023-10-19T12:43:27.765000+0000","last_peered":"2023-10-19T12:43:27.765000+0000","last_clean":"2023-10-19T12:43:27.765000+0000","last_became_active":"2023-10-19T12:41:19.290790+0000","last_became_peered":"2023-10-19T12:41:19.290790+0000","last_unstale":"2023-10-19T12:43:27.765000+0000","last_undegraded":"2023-10-19T12:43:27.765000+0000","last_fullsized":"2023-10-19T12:43:27.765000+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:23:44.757080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"90'9","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:56.682686+0000","last_change":"2023-10-19T12:41:19.299670+0000","last_active":"2023-10-19T12:42:56.682686+0000","last_peered":"2023-10-19T12:42:56.682686+0000","last_clean":"2023-10-19T12:42:56.682686+0000","last_became_active":"2023-10-19T12:41:19.299375+0000","last_became_peered":"2023-10-19T12:41:19.299375+0000","last_unstale":"2023-10-19T12:42:56.682686+0000","last_undegraded":"2023-10-19T12:42:56.682686+0000","last_fullsized":"2023-10-19T12:42:56.682686+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:30:23.234790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"90'8","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:56.693273+0000","last_change":"2023-10-19T12:41:19.300359+0000","last_active":"2023-10-19T12:42:56.693273+0000","last_peered":"2023-10-19T12:42:56.693273+0000","last_clean":"2023-10-19T12:42:56.693273+0000","last_became_active":"2023-10-19T12:41:19.300032+0000","last_became_peered":"2023-10-19T12:41:19.300032+0000","last_unstale":"2023-10-19T12:42:56.693273+0000","last_undegraded":"2023-10-19T12:42:56.693273+0000","last_fullsized":"2023-10-19T12:42:56.693273+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-21T00:33:24.621723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"90'10","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.759359+0000","last_change":"2023-10-19T12:41:19.288276+0000","last_active":"2023-10-19T12:43:27.759359+0000","last_peered":"2023-10-19T12:43:27.759359+0000","last_clean":"2023-10-19T12:43:27.759359+0000","last_became_active":"2023-10-19T12:41:19.287905+0000","last_became_peered":"2023-10-19T12:41:19.287905+0000","last_unstale":"2023-10-19T12:43:27.759359+0000","last_undegraded":"2023-10-19T12:43:27.759359+0000","last_fullsized":"2023-10-19T12:43:27.759359+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:46:15.640987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"90'7","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:56.677232+0000","last_change":"2023-10-19T12:41:19.300682+0000","last_active":"2023-10-19T12:42:56.677232+0000","last_peered":"2023-10-19T12:42:56.677232+0000","last_clean":"2023-10-19T12:42:56.677232+0000","last_became_active":"2023-10-19T12:41:19.300347+0000","last_became_peered":"2023-10-19T12:41:19.300347+0000","last_unstale":"2023-10-19T12:42:56.677232+0000","last_undegraded":"2023-10-19T12:42:56.677232+0000","last_fullsized":"2023-10-19T12:42:56.677232+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T21:21:31.772556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.116324+0000","last_change":"2023-10-19T12:41:23.337419+0000","last_active":"2023-10-19T12:42:27.116324+0000","last_peered":"2023-10-19T12:42:27.116324+0000","last_clean":"2023-10-19T12:42:27.116324+0000","last_became_active":"2023-10-19T12:41:23.337046+0000","last_became_peered":"2023-10-19T12:41:23.337046+0000","last_unstale":"2023-10-19T12:42:27.116324+0000","last_undegraded":"2023-10-19T12:42:27.116324+0000","last_fullsized":"2023-10-19T12:42:27.116324+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-21T00:20:22.732851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"88'13","reported_seq":137,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:28.456753+0000","last_change":"2023-10-19T12:41:18.282453+0000","last_active":"2023-10-19T12:43:28.456753+0000","last_peered":"2023-10-19T12:43:28.456753+0000","last_clean":"2023-10-19T12:43:28.456753+0000","last_became_active":"2023-10-19T12:41:18.281705+0000","last_became_peered":"2023-10-19T12:41:18.281705+0000","last_unstale":"2023-10-19T12:43:28.456753+0000","last_undegraded":"2023-10-19T12:43:28.456753+0000","last_fullsized":"2023-10-19T12:43:28.456753+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T21:12:33.877631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":103,"num_read_kb":103,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"90'5","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:43:18.559101+0000","last_change":"2023-10-19T12:41:19.292175+0000","last_active":"2023-10-19T12:43:18.559101+0000","last_peered":"2023-10-19T12:43:18.559101+0000","last_clean":"2023-10-19T12:43:18.559101+0000","last_became_active":"2023-10-19T12:41:19.291867+0000","last_became_peered":"2023-10-19T12:41:19.291867+0000","last_unstale":"2023-10-19T12:43:18.559101+0000","last_undegraded":"2023-10-19T12:43:18.559101+0000","last_fullsized":"2023-10-19T12:43:18.559101+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:22:12.255839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.760975+0000","last_change":"2023-10-19T12:41:23.340447+0000","last_active":"2023-10-19T12:43:27.760975+0000","last_peered":"2023-10-19T12:43:27.760975+0000","last_clean":"2023-10-19T12:43:27.760975+0000","last_became_active":"2023-10-19T12:41:23.340074+0000","last_became_peered":"2023-10-19T12:41:23.340074+0000","last_unstale":"2023-10-19T12:43:27.760975+0000","last_undegraded":"2023-10-19T12:43:27.760975+0000","last_fullsized":"2023-10-19T12:43:27.760975+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:12:11.828854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"88'2","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:43:18.559114+0000","last_change":"2023-10-19T12:41:18.297822+0000","last_active":"2023-10-19T12:43:18.559114+0000","last_peered":"2023-10-19T12:43:18.559114+0000","last_clean":"2023-10-19T12:43:18.559114+0000","last_became_active":"2023-10-19T12:41:18.297526+0000","last_became_peered":"2023-10-19T12:41:18.297526+0000","last_unstale":"2023-10-19T12:43:18.559114+0000","last_undegraded":"2023-10-19T12:43:18.559114+0000","last_fullsized":"2023-10-19T12:43:18.559114+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:59:28.110110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"90'6","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.769273+0000","last_change":"2023-10-19T12:41:19.309918+0000","last_active":"2023-10-19T12:43:27.769273+0000","last_peered":"2023-10-19T12:43:27.769273+0000","last_clean":"2023-10-19T12:43:27.769273+0000","last_became_active":"2023-10-19T12:41:19.309391+0000","last_became_peered":"2023-10-19T12:41:19.309391+0000","last_unstale":"2023-10-19T12:43:27.769273+0000","last_undegraded":"2023-10-19T12:43:27.769273+0000","last_fullsized":"2023-10-19T12:43:27.769273+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:52:49.320469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.762033+0000","last_change":"2023-10-19T12:41:23.337296+0000","last_active":"2023-10-19T12:43:27.762033+0000","last_peered":"2023-10-19T12:43:27.762033+0000","last_clean":"2023-10-19T12:43:27.762033+0000","last_became_active":"2023-10-19T12:41:23.336836+0000","last_became_peered":"2023-10-19T12:41:23.336836+0000","last_unstale":"2023-10-19T12:43:27.762033+0000","last_undegraded":"2023-10-19T12:43:27.762033+0000","last_fullsized":"2023-10-19T12:43:27.762033+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:15:25.400517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"88'12","reported_seq":57,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.763007+0000","last_change":"2023-10-19T12:42:28.174505+0000","last_active":"2023-10-19T12:43:27.763007+0000","last_peered":"2023-10-19T12:43:27.763007+0000","last_clean":"2023-10-19T12:43:27.763007+0000","last_became_active":"2023-10-19T12:42:28.165270+0000","last_became_peered":"2023-10-19T12:42:28.165270+0000","last_unstale":"2023-10-19T12:43:27.763007+0000","last_undegraded":"2023-10-19T12:43:27.763007+0000","last_fullsized":"2023-10-19T12:43:27.763007+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:54:50.199916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"90'9","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:56.680250+0000","last_change":"2023-10-19T12:41:19.301628+0000","last_active":"2023-10-19T12:42:56.680250+0000","last_peered":"2023-10-19T12:42:56.680250+0000","last_clean":"2023-10-19T12:42:56.680250+0000","last_became_active":"2023-10-19T12:41:19.301343+0000","last_became_peered":"2023-10-19T12:41:19.301343+0000","last_unstale":"2023-10-19T12:42:56.680250+0000","last_undegraded":"2023-10-19T12:42:56.680250+0000","last_fullsized":"2023-10-19T12:42:56.680250+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:02:31.273024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.761159+0000","last_change":"2023-10-19T12:41:23.330222+0000","last_active":"2023-10-19T12:43:27.761159+0000","last_peered":"2023-10-19T12:43:27.761159+0000","last_clean":"2023-10-19T12:43:27.761159+0000","last_became_active":"2023-10-19T12:41:23.329838+0000","last_became_peered":"2023-10-19T12:41:23.329838+0000","last_unstale":"2023-10-19T12:43:27.761159+0000","last_undegraded":"2023-10-19T12:43:27.761159+0000","last_fullsized":"2023-10-19T12:43:27.761159+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T21:40:52.899198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"88'5","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:28.133876+0000","last_change":"2023-10-19T12:42:28.133484+0000","last_active":"2023-10-19T12:42:28.133876+0000","last_peered":"2023-10-19T12:42:28.133876+0000","last_clean":"2023-10-19T12:42:28.133876+0000","last_became_active":"2023-10-19T12:42:28.126495+0000","last_became_peered":"2023-10-19T12:42:28.126495+0000","last_unstale":"2023-10-19T12:42:28.133876+0000","last_undegraded":"2023-10-19T12:42:28.133876+0000","last_fullsized":"2023-10-19T12:42:28.133876+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T21:28:29.956191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"90'15","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:56.677905+0000","last_change":"2023-10-19T12:42:28.129032+0000","last_active":"2023-10-19T12:42:56.677905+0000","last_peered":"2023-10-19T12:42:56.677905+0000","last_clean":"2023-10-19T12:42:56.677905+0000","last_became_active":"2023-10-19T12:42:28.128562+0000","last_became_peered":"2023-10-19T12:42:28.128562+0000","last_unstale":"2023-10-19T12:42:56.677905+0000","last_undegraded":"2023-10-19T12:42:56.677905+0000","last_fullsized":"2023-10-19T12:42:56.677905+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:52:14.264191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.116859+0000","last_change":"2023-10-19T12:41:23.330626+0000","last_active":"2023-10-19T12:42:27.116859+0000","last_peered":"2023-10-19T12:42:27.116859+0000","last_clean":"2023-10-19T12:42:27.116859+0000","last_became_active":"2023-10-19T12:41:23.330250+0000","last_became_peered":"2023-10-19T12:41:23.330250+0000","last_unstale":"2023-10-19T12:42:27.116859+0000","last_undegraded":"2023-10-19T12:42:27.116859+0000","last_fullsized":"2023-10-19T12:42:27.116859+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:09:48.428636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"88'5","reported_seq":138,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:43:24.208746+0000","last_change":"2023-10-19T12:42:28.136196+0000","last_active":"2023-10-19T12:43:24.208746+0000","last_peered":"2023-10-19T12:43:24.208746+0000","last_clean":"2023-10-19T12:43:24.208746+0000","last_became_active":"2023-10-19T12:42:28.126762+0000","last_became_peered":"2023-10-19T12:42:28.126762+0000","last_unstale":"2023-10-19T12:43:24.208746+0000","last_undegraded":"2023-10-19T12:43:24.208746+0000","last_fullsized":"2023-10-19T12:43:24.208746+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:04:58.098356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":95,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":622,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"90'7","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.762744+0000","last_change":"2023-10-19T12:41:19.285423+0000","last_active":"2023-10-19T12:43:27.762744+0000","last_peered":"2023-10-19T12:43:27.762744+0000","last_clean":"2023-10-19T12:43:27.762744+0000","last_became_active":"2023-10-19T12:41:19.285110+0000","last_became_peered":"2023-10-19T12:41:19.285110+0000","last_unstale":"2023-10-19T12:43:27.762744+0000","last_undegraded":"2023-10-19T12:43:27.762744+0000","last_fullsized":"2023-10-19T12:43:27.762744+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:27:51.707594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.116601+0000","last_change":"2023-10-19T12:41:23.343240+0000","last_active":"2023-10-19T12:42:27.116601+0000","last_peered":"2023-10-19T12:42:27.116601+0000","last_clean":"2023-10-19T12:42:27.116601+0000","last_became_active":"2023-10-19T12:41:23.342778+0000","last_became_peered":"2023-10-19T12:41:23.342778+0000","last_unstale":"2023-10-19T12:42:27.116601+0000","last_undegraded":"2023-10-19T12:42:27.116601+0000","last_fullsized":"2023-10-19T12:42:27.116601+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:47:15.690193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"88'7","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:28.179078+0000","last_change":"2023-10-19T12:42:28.179078+0000","last_active":"2023-10-19T12:42:28.179078+0000","last_peered":"2023-10-19T12:42:28.179078+0000","last_clean":"2023-10-19T12:42:28.179078+0000","last_became_active":"2023-10-19T12:42:28.165372+0000","last_became_peered":"2023-10-19T12:42:28.165372+0000","last_unstale":"2023-10-19T12:42:28.179078+0000","last_undegraded":"2023-10-19T12:42:28.179078+0000","last_fullsized":"2023-10-19T12:42:28.179078+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T21:12:40.451182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,6],"acting":[10,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"90'8","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-19T12:43:28.779471+0000","last_change":"2023-10-19T12:43:28.777892+0000","last_active":"2023-10-19T12:43:28.779471+0000","last_peered":"2023-10-19T12:43:28.779471+0000","last_clean":"2023-10-19T12:43:28.779471+0000","last_became_active":"2023-10-19T12:43:28.777514+0000","last_became_peered":"2023-10-19T12:43:28.777514+0000","last_unstale":"2023-10-19T12:43:28.779471+0000","last_undegraded":"2023-10-19T12:43:28.779471+0000","last_fullsized":"2023-10-19T12:43:28.779471+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T22:10:03.226531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,6],"acting":[9,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.123624+0000","last_change":"2023-10-19T12:41:23.338871+0000","last_active":"2023-10-19T12:42:27.123624+0000","last_peered":"2023-10-19T12:42:27.123624+0000","last_clean":"2023-10-19T12:42:27.123624+0000","last_became_active":"2023-10-19T12:41:23.338493+0000","last_became_peered":"2023-10-19T12:41:23.338493+0000","last_unstale":"2023-10-19T12:42:27.123624+0000","last_undegraded":"2023-10-19T12:42:27.123624+0000","last_fullsized":"2023-10-19T12:42:27.123624+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T22:49:12.948436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"88'3","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.125512+0000","last_change":"2023-10-19T12:41:18.291110+0000","last_active":"2023-10-19T12:42:27.125512+0000","last_peered":"2023-10-19T12:42:27.125512+0000","last_clean":"2023-10-19T12:42:27.125512+0000","last_became_active":"2023-10-19T12:41:18.290675+0000","last_became_peered":"2023-10-19T12:41:18.290675+0000","last_unstale":"2023-10-19T12:42:27.125512+0000","last_undegraded":"2023-10-19T12:42:27.125512+0000","last_fullsized":"2023-10-19T12:42:27.125512+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:57:44.713046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"90'8","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:56.694839+0000","last_change":"2023-10-19T12:41:19.299727+0000","last_active":"2023-10-19T12:42:56.694839+0000","last_peered":"2023-10-19T12:42:56.694839+0000","last_clean":"2023-10-19T12:42:56.694839+0000","last_became_active":"2023-10-19T12:41:19.299387+0000","last_became_peered":"2023-10-19T12:41:19.299387+0000","last_unstale":"2023-10-19T12:42:56.694839+0000","last_undegraded":"2023-10-19T12:42:56.694839+0000","last_fullsized":"2023-10-19T12:42:56.694839+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:34:03.783326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.769294+0000","last_change":"2023-10-19T12:41:23.331954+0000","last_active":"2023-10-19T12:43:27.769294+0000","last_peered":"2023-10-19T12:43:27.769294+0000","last_clean":"2023-10-19T12:43:27.769294+0000","last_became_active":"2023-10-19T12:41:23.328835+0000","last_became_peered":"2023-10-19T12:41:23.328835+0000","last_unstale":"2023-10-19T12:43:27.769294+0000","last_undegraded":"2023-10-19T12:43:27.769294+0000","last_fullsized":"2023-10-19T12:43:27.769294+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T21:49:10.473768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"88'3","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.120595+0000","last_change":"2023-10-19T12:41:18.280694+0000","last_active":"2023-10-19T12:42:27.120595+0000","last_peered":"2023-10-19T12:42:27.120595+0000","last_clean":"2023-10-19T12:42:27.120595+0000","last_became_active":"2023-10-19T12:41:18.280333+0000","last_became_peered":"2023-10-19T12:41:18.280333+0000","last_unstale":"2023-10-19T12:42:27.120595+0000","last_undegraded":"2023-10-19T12:42:27.120595+0000","last_fullsized":"2023-10-19T12:42:27.120595+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:06:02.944400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"90'11","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.758598+0000","last_change":"2023-10-19T12:41:19.288659+0000","last_active":"2023-10-19T12:43:27.758598+0000","last_peered":"2023-10-19T12:43:27.758598+0000","last_clean":"2023-10-19T12:43:27.758598+0000","last_became_active":"2023-10-19T12:41:19.288310+0000","last_became_peered":"2023-10-19T12:41:19.288310+0000","last_unstale":"2023-10-19T12:43:27.758598+0000","last_undegraded":"2023-10-19T12:43:27.758598+0000","last_fullsized":"2023-10-19T12:43:27.758598+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T23:15:05.772393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:28.118079+0000","last_change":"2023-10-19T12:41:23.333370+0000","last_active":"2023-10-19T12:42:28.118079+0000","last_peered":"2023-10-19T12:42:28.118079+0000","last_clean":"2023-10-19T12:42:28.118079+0000","last_became_active":"2023-10-19T12:41:23.332691+0000","last_became_peered":"2023-10-19T12:41:23.332691+0000","last_unstale":"2023-10-19T12:42:28.118079+0000","last_undegraded":"2023-10-19T12:42:28.118079+0000","last_fullsized":"2023-10-19T12:42:28.118079+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T21:28:45.414610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"90'5","reported_seq":220,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:43:25.209373+0000","last_change":"2023-10-19T12:41:18.287081+0000","last_active":"2023-10-19T12:43:25.209373+0000","last_peered":"2023-10-19T12:43:25.209373+0000","last_clean":"2023-10-19T12:43:25.209373+0000","last_became_active":"2023-10-19T12:41:18.286784+0000","last_became_peered":"2023-10-19T12:41:18.286784+0000","last_unstale":"2023-10-19T12:43:25.209373+0000","last_undegraded":"2023-10-19T12:43:25.209373+0000","last_fullsized":"2023-10-19T12:43:25.209373+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:49:10.167022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":197,"num_read_kb":197,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"90'10","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:56.683027+0000","last_change":"2023-10-19T12:41:19.300361+0000","last_active":"2023-10-19T12:42:56.683027+0000","last_peered":"2023-10-19T12:42:56.683027+0000","last_clean":"2023-10-19T12:42:56.683027+0000","last_became_active":"2023-10-19T12:41:19.299871+0000","last_became_peered":"2023-10-19T12:41:19.299871+0000","last_unstale":"2023-10-19T12:42:56.683027+0000","last_undegraded":"2023-10-19T12:42:56.683027+0000","last_fullsized":"2023-10-19T12:42:56.683027+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:46:31.437532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.758403+0000","last_change":"2023-10-19T12:41:23.338341+0000","last_active":"2023-10-19T12:43:27.758403+0000","last_peered":"2023-10-19T12:43:27.758403+0000","last_clean":"2023-10-19T12:43:27.758403+0000","last_became_active":"2023-10-19T12:41:23.336081+0000","last_became_peered":"2023-10-19T12:41:23.336081+0000","last_unstale":"2023-10-19T12:43:27.758403+0000","last_undegraded":"2023-10-19T12:43:27.758403+0000","last_fullsized":"2023-10-19T12:43:27.758403+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:02:35.474513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"88'4","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.118927+0000","last_change":"2023-10-19T12:41:18.280086+0000","last_active":"2023-10-19T12:42:27.118927+0000","last_peered":"2023-10-19T12:42:27.118927+0000","last_clean":"2023-10-19T12:42:27.118927+0000","last_became_active":"2023-10-19T12:41:18.279819+0000","last_became_peered":"2023-10-19T12:41:18.279819+0000","last_unstale":"2023-10-19T12:42:27.118927+0000","last_undegraded":"2023-10-19T12:42:27.118927+0000","last_fullsized":"2023-10-19T12:42:27.118927+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T23:02:28.723477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"90'9","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-19T12:43:28.781603+0000","last_change":"2023-10-19T12:43:28.781603+0000","last_active":"2023-10-19T12:43:28.781603+0000","last_peered":"2023-10-19T12:43:28.781603+0000","last_clean":"2023-10-19T12:43:28.781603+0000","last_became_active":"2023-10-19T12:43:28.781189+0000","last_became_peered":"2023-10-19T12:43:28.781189+0000","last_unstale":"2023-10-19T12:43:28.781603+0000","last_undegraded":"2023-10-19T12:43:28.781603+0000","last_fullsized":"2023-10-19T12:43:28.781603+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:53:26.785127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,5],"acting":[0,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-19T12:43:28.784130+0000","last_change":"2023-10-19T12:43:28.784130+0000","last_active":"2023-10-19T12:43:28.784130+0000","last_peered":"2023-10-19T12:43:28.784130+0000","last_clean":"2023-10-19T12:43:28.784130+0000","last_became_active":"2023-10-19T12:43:28.783623+0000","last_became_peered":"2023-10-19T12:43:28.783623+0000","last_unstale":"2023-10-19T12:43:28.784130+0000","last_undegraded":"2023-10-19T12:43:28.784130+0000","last_fullsized":"2023-10-19T12:43:28.784130+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:02:21.375104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,8],"acting":[4,1,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"88'5","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.121398+0000","last_change":"2023-10-19T12:41:18.285452+0000","last_active":"2023-10-19T12:42:27.121398+0000","last_peered":"2023-10-19T12:42:27.121398+0000","last_clean":"2023-10-19T12:42:27.121398+0000","last_became_active":"2023-10-19T12:41:18.285155+0000","last_became_peered":"2023-10-19T12:41:18.285155+0000","last_unstale":"2023-10-19T12:42:27.121398+0000","last_undegraded":"2023-10-19T12:42:27.121398+0000","last_fullsized":"2023-10-19T12:42:27.121398+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:30:41.041925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"90'11","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:56.680490+0000","last_change":"2023-10-19T12:41:19.284839+0000","last_active":"2023-10-19T12:42:56.680490+0000","last_peered":"2023-10-19T12:42:56.680490+0000","last_clean":"2023-10-19T12:42:56.680490+0000","last_became_active":"2023-10-19T12:41:19.284538+0000","last_became_peered":"2023-10-19T12:41:19.284538+0000","last_unstale":"2023-10-19T12:42:56.680490+0000","last_undegraded":"2023-10-19T12:42:56.680490+0000","last_fullsized":"2023-10-19T12:42:56.680490+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:29:12.288958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.115869+0000","last_change":"2023-10-19T12:41:23.339611+0000","last_active":"2023-10-19T12:42:27.115869+0000","last_peered":"2023-10-19T12:42:27.115869+0000","last_clean":"2023-10-19T12:42:27.115869+0000","last_became_active":"2023-10-19T12:41:23.337786+0000","last_became_peered":"2023-10-19T12:41:23.337786+0000","last_unstale":"2023-10-19T12:42:27.115869+0000","last_undegraded":"2023-10-19T12:42:27.115869+0000","last_fullsized":"2023-10-19T12:42:27.115869+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:56:01.219811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"90'38","reported_seq":260,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:43:25.209266+0000","last_change":"2023-10-19T12:41:18.279330+0000","last_active":"2023-10-19T12:43:25.209266+0000","last_peered":"2023-10-19T12:43:25.209266+0000","last_clean":"2023-10-19T12:43:25.209266+0000","last_became_active":"2023-10-19T12:41:18.278942+0000","last_became_peered":"2023-10-19T12:41:18.278942+0000","last_unstale":"2023-10-19T12:43:25.209266+0000","last_undegraded":"2023-10-19T12:43:25.209266+0000","last_fullsized":"2023-10-19T12:43:25.209266+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:40:23.340009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60690,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":204,"num_read_kb":161,"num_write":40,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"90'6","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.763252+0000","last_change":"2023-10-19T12:41:19.296103+0000","last_active":"2023-10-19T12:43:27.763252+0000","last_peered":"2023-10-19T12:43:27.763252+0000","last_clean":"2023-10-19T12:43:27.763252+0000","last_became_active":"2023-10-19T12:41:19.293432+0000","last_became_peered":"2023-10-19T12:41:19.293432+0000","last_unstale":"2023-10-19T12:43:27.763252+0000","last_undegraded":"2023-10-19T12:43:27.763252+0000","last_fullsized":"2023-10-19T12:43:27.763252+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:21:46.039560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.122205+0000","last_change":"2023-10-19T12:41:23.330711+0000","last_active":"2023-10-19T12:42:27.122205+0000","last_peered":"2023-10-19T12:42:27.122205+0000","last_clean":"2023-10-19T12:42:27.122205+0000","last_became_active":"2023-10-19T12:41:23.330115+0000","last_became_peered":"2023-10-19T12:41:23.330115+0000","last_unstale":"2023-10-19T12:42:27.122205+0000","last_undegraded":"2023-10-19T12:42:27.122205+0000","last_fullsized":"2023-10-19T12:42:27.122205+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:48:50.296265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"88'9","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.116428+0000","last_change":"2023-10-19T12:41:18.289434+0000","last_active":"2023-10-19T12:42:27.116428+0000","last_peered":"2023-10-19T12:42:27.116428+0000","last_clean":"2023-10-19T12:42:27.116428+0000","last_became_active":"2023-10-19T12:41:18.289226+0000","last_became_peered":"2023-10-19T12:41:18.289226+0000","last_unstale":"2023-10-19T12:42:27.116428+0000","last_undegraded":"2023-10-19T12:42:27.116428+0000","last_fullsized":"2023-10-19T12:42:27.116428+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T21:18:19.007202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"90'9","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:56.692393+0000","last_change":"2023-10-19T12:41:19.300555+0000","last_active":"2023-10-19T12:42:56.692393+0000","last_peered":"2023-10-19T12:42:56.692393+0000","last_clean":"2023-10-19T12:42:56.692393+0000","last_became_active":"2023-10-19T12:41:19.300162+0000","last_became_peered":"2023-10-19T12:41:19.300162+0000","last_unstale":"2023-10-19T12:42:56.692393+0000","last_undegraded":"2023-10-19T12:42:56.692393+0000","last_fullsized":"2023-10-19T12:42:56.692393+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:26:33.779562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.122864+0000","last_change":"2023-10-19T12:41:23.338750+0000","last_active":"2023-10-19T12:42:27.122864+0000","last_peered":"2023-10-19T12:42:27.122864+0000","last_clean":"2023-10-19T12:42:27.122864+0000","last_became_active":"2023-10-19T12:41:23.338318+0000","last_became_peered":"2023-10-19T12:41:23.338318+0000","last_unstale":"2023-10-19T12:42:27.122864+0000","last_undegraded":"2023-10-19T12:42:27.122864+0000","last_fullsized":"2023-10-19T12:42:27.122864+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:11:20.182270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"88'5","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.120277+0000","last_change":"2023-10-19T12:41:18.293923+0000","last_active":"2023-10-19T12:42:27.120277+0000","last_peered":"2023-10-19T12:42:27.120277+0000","last_clean":"2023-10-19T12:42:27.120277+0000","last_became_active":"2023-10-19T12:41:18.293688+0000","last_became_peered":"2023-10-19T12:41:18.293688+0000","last_unstale":"2023-10-19T12:42:27.120277+0000","last_undegraded":"2023-10-19T12:42:27.120277+0000","last_fullsized":"2023-10-19T12:42:27.120277+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:34:15.162178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"90'15","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:56.694051+0000","last_change":"2023-10-19T12:41:19.302733+0000","last_active":"2023-10-19T12:42:56.694051+0000","last_peered":"2023-10-19T12:42:56.694051+0000","last_clean":"2023-10-19T12:42:56.694051+0000","last_became_active":"2023-10-19T12:41:19.302401+0000","last_became_peered":"2023-10-19T12:41:19.302401+0000","last_unstale":"2023-10-19T12:42:56.694051+0000","last_undegraded":"2023-10-19T12:42:56.694051+0000","last_fullsized":"2023-10-19T12:42:56.694051+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:55:05.864499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-19T12:43:28.780788+0000","last_change":"2023-10-19T12:43:28.780007+0000","last_active":"2023-10-19T12:43:28.780788+0000","last_peered":"2023-10-19T12:43:28.780788+0000","last_clean":"2023-10-19T12:43:28.780788+0000","last_became_active":"2023-10-19T12:43:28.779620+0000","last_became_peered":"2023-10-19T12:43:28.779620+0000","last_unstale":"2023-10-19T12:43:28.780788+0000","last_undegraded":"2023-10-19T12:43:28.780788+0000","last_fullsized":"2023-10-19T12:43:28.780788+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:01:36.931162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7,0,3],"acting":[8,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.11","version":"90'6","reported_seq":134,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-19T12:43:29.463894+0000","last_change":"2023-10-19T12:41:18.277563+0000","last_active":"2023-10-19T12:43:29.463894+0000","last_peered":"2023-10-19T12:43:29.463894+0000","last_clean":"2023-10-19T12:43:29.463894+0000","last_became_active":"2023-10-19T12:41:18.277255+0000","last_became_peered":"2023-10-19T12:41:18.277255+0000","last_unstale":"2023-10-19T12:43:29.463894+0000","last_undegraded":"2023-10-19T12:43:29.463894+0000","last_fullsized":"2023-10-19T12:43:29.463894+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:28:31.468355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":108,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"90'6","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:56.675483+0000","last_change":"2023-10-19T12:41:19.288939+0000","last_active":"2023-10-19T12:42:56.675483+0000","last_peered":"2023-10-19T12:42:56.675483+0000","last_clean":"2023-10-19T12:42:56.675483+0000","last_became_active":"2023-10-19T12:41:19.288612+0000","last_became_peered":"2023-10-19T12:41:19.288612+0000","last_unstale":"2023-10-19T12:42:56.675483+0000","last_undegraded":"2023-10-19T12:42:56.675483+0000","last_fullsized":"2023-10-19T12:42:56.675483+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:45:36.050331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.125921+0000","last_change":"2023-10-19T12:41:23.333823+0000","last_active":"2023-10-19T12:42:27.125921+0000","last_peered":"2023-10-19T12:42:27.125921+0000","last_clean":"2023-10-19T12:42:27.125921+0000","last_became_active":"2023-10-19T12:41:23.332698+0000","last_became_peered":"2023-10-19T12:41:23.332698+0000","last_unstale":"2023-10-19T12:42:27.125921+0000","last_undegraded":"2023-10-19T12:42:27.125921+0000","last_fullsized":"2023-10-19T12:42:27.125921+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:54:43.952531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"88'17","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.762439+0000","last_change":"2023-10-19T12:41:18.290426+0000","last_active":"2023-10-19T12:43:27.762439+0000","last_peered":"2023-10-19T12:43:27.762439+0000","last_clean":"2023-10-19T12:43:27.762439+0000","last_became_active":"2023-10-19T12:41:18.290096+0000","last_became_peered":"2023-10-19T12:41:18.290096+0000","last_unstale":"2023-10-19T12:43:27.762439+0000","last_undegraded":"2023-10-19T12:43:27.762439+0000","last_fullsized":"2023-10-19T12:43:27.762439+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:14:34.731869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"90'6","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:56.672893+0000","last_change":"2023-10-19T12:41:19.300423+0000","last_active":"2023-10-19T12:42:56.672893+0000","last_peered":"2023-10-19T12:42:56.672893+0000","last_clean":"2023-10-19T12:42:56.672893+0000","last_became_active":"2023-10-19T12:41:19.299999+0000","last_became_peered":"2023-10-19T12:41:19.299999+0000","last_unstale":"2023-10-19T12:42:56.672893+0000","last_undegraded":"2023-10-19T12:42:56.672893+0000","last_fullsized":"2023-10-19T12:42:56.672893+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:35:32.703396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.119720+0000","last_change":"2023-10-19T12:41:23.330091+0000","last_active":"2023-10-19T12:42:27.119720+0000","last_peered":"2023-10-19T12:42:27.119720+0000","last_clean":"2023-10-19T12:42:27.119720+0000","last_became_active":"2023-10-19T12:41:23.329695+0000","last_became_peered":"2023-10-19T12:41:23.329695+0000","last_unstale":"2023-10-19T12:42:27.119720+0000","last_undegraded":"2023-10-19T12:42:27.119720+0000","last_fullsized":"2023-10-19T12:42:27.119720+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:37:09.840232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"88'2","reported_seq":23,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.765619+0000","last_change":"2023-10-19T12:41:18.279761+0000","last_active":"2023-10-19T12:43:27.765619+0000","last_peered":"2023-10-19T12:43:27.765619+0000","last_clean":"2023-10-19T12:43:27.765619+0000","last_became_active":"2023-10-19T12:41:18.279430+0000","last_became_peered":"2023-10-19T12:41:18.279430+0000","last_unstale":"2023-10-19T12:43:27.765619+0000","last_undegraded":"2023-10-19T12:43:27.765619+0000","last_fullsized":"2023-10-19T12:43:27.765619+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:43:32.447842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"90'5","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:56.675356+0000","last_change":"2023-10-19T12:41:19.290406+0000","last_active":"2023-10-19T12:42:56.675356+0000","last_peered":"2023-10-19T12:42:56.675356+0000","last_clean":"2023-10-19T12:42:56.675356+0000","last_became_active":"2023-10-19T12:41:19.290032+0000","last_became_peered":"2023-10-19T12:41:19.290032+0000","last_unstale":"2023-10-19T12:42:56.675356+0000","last_undegraded":"2023-10-19T12:42:56.675356+0000","last_fullsized":"2023-10-19T12:42:56.675356+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:30:30.875800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-19T12:43:28.770421+0000","last_change":"2023-10-19T12:41:23.478036+0000","last_active":"2023-10-19T12:43:28.770421+0000","last_peered":"2023-10-19T12:43:28.770421+0000","last_clean":"2023-10-19T12:43:28.770421+0000","last_became_active":"2023-10-19T12:41:23.477542+0000","last_became_peered":"2023-10-19T12:41:23.477542+0000","last_unstale":"2023-10-19T12:43:28.770421+0000","last_undegraded":"2023-10-19T12:43:28.770421+0000","last_fullsized":"2023-10-19T12:43:28.770421+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:32:24.599591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"88'1","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.758692+0000","last_change":"2023-10-19T12:41:18.289254+0000","last_active":"2023-10-19T12:43:27.758692+0000","last_peered":"2023-10-19T12:43:27.758692+0000","last_clean":"2023-10-19T12:43:27.758692+0000","last_became_active":"2023-10-19T12:41:18.287036+0000","last_became_peered":"2023-10-19T12:41:18.287036+0000","last_unstale":"2023-10-19T12:43:27.758692+0000","last_undegraded":"2023-10-19T12:43:27.758692+0000","last_fullsized":"2023-10-19T12:43:27.758692+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T21:33:41.720725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"90'4","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:56.693437+0000","last_change":"2023-10-19T12:41:19.299711+0000","last_active":"2023-10-19T12:42:56.693437+0000","last_peered":"2023-10-19T12:42:56.693437+0000","last_clean":"2023-10-19T12:42:56.693437+0000","last_became_active":"2023-10-19T12:41:19.299367+0000","last_became_peered":"2023-10-19T12:41:19.299367+0000","last_unstale":"2023-10-19T12:42:56.693437+0000","last_undegraded":"2023-10-19T12:42:56.693437+0000","last_fullsized":"2023-10-19T12:42:56.693437+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:32:36.783990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.124886+0000","last_change":"2023-10-19T12:41:23.328301+0000","last_active":"2023-10-19T12:42:27.124886+0000","last_peered":"2023-10-19T12:42:27.124886+0000","last_clean":"2023-10-19T12:42:27.124886+0000","last_became_active":"2023-10-19T12:41:23.327866+0000","last_became_peered":"2023-10-19T12:41:23.327866+0000","last_unstale":"2023-10-19T12:42:27.124886+0000","last_undegraded":"2023-10-19T12:42:27.124886+0000","last_fullsized":"2023-10-19T12:42:27.124886+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T21:53:23.600196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"88'5","reported_seq":127,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:43:26.454850+0000","last_change":"2023-10-19T12:41:18.286635+0000","last_active":"2023-10-19T12:43:26.454850+0000","last_peered":"2023-10-19T12:43:26.454850+0000","last_clean":"2023-10-19T12:43:26.454850+0000","last_became_active":"2023-10-19T12:41:18.286310+0000","last_became_peered":"2023-10-19T12:41:18.286310+0000","last_unstale":"2023-10-19T12:43:26.454850+0000","last_undegraded":"2023-10-19T12:43:26.454850+0000","last_fullsized":"2023-10-19T12:43:26.454850+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:30:38.266038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":102,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"90'7","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:56.676372+0000","last_change":"2023-10-19T12:41:19.297989+0000","last_active":"2023-10-19T12:42:56.676372+0000","last_peered":"2023-10-19T12:42:56.676372+0000","last_clean":"2023-10-19T12:42:56.676372+0000","last_became_active":"2023-10-19T12:41:19.297680+0000","last_became_peered":"2023-10-19T12:41:19.297680+0000","last_unstale":"2023-10-19T12:42:56.676372+0000","last_undegraded":"2023-10-19T12:42:56.676372+0000","last_fullsized":"2023-10-19T12:42:56.676372+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:40:22.883804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.126049+0000","last_change":"2023-10-19T12:41:23.478723+0000","last_active":"2023-10-19T12:42:27.126049+0000","last_peered":"2023-10-19T12:42:27.126049+0000","last_clean":"2023-10-19T12:42:27.126049+0000","last_became_active":"2023-10-19T12:41:23.478063+0000","last_became_peered":"2023-10-19T12:41:23.478063+0000","last_unstale":"2023-10-19T12:42:27.126049+0000","last_undegraded":"2023-10-19T12:42:27.126049+0000","last_fullsized":"2023-10-19T12:42:27.126049+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:41:00.885308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"90'8","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:56.675092+0000","last_change":"2023-10-19T12:41:19.285478+0000","last_active":"2023-10-19T12:42:56.675092+0000","last_peered":"2023-10-19T12:42:56.675092+0000","last_clean":"2023-10-19T12:42:56.675092+0000","last_became_active":"2023-10-19T12:41:19.285175+0000","last_became_peered":"2023-10-19T12:41:19.285175+0000","last_unstale":"2023-10-19T12:42:56.675092+0000","last_undegraded":"2023-10-19T12:42:56.675092+0000","last_fullsized":"2023-10-19T12:42:56.675092+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:18:03.423712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"88'5","reported_seq":124,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:43:25.455905+0000","last_change":"2023-10-19T12:41:18.297207+0000","last_active":"2023-10-19T12:43:25.455905+0000","last_peered":"2023-10-19T12:43:25.455905+0000","last_clean":"2023-10-19T12:43:25.455905+0000","last_became_active":"2023-10-19T12:41:18.296490+0000","last_became_peered":"2023-10-19T12:41:18.296490+0000","last_unstale":"2023-10-19T12:43:25.455905+0000","last_undegraded":"2023-10-19T12:43:25.455905+0000","last_fullsized":"2023-10-19T12:43:25.455905+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:42:33.769810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"88'1","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:28.120989+0000","last_change":"2023-10-19T12:41:23.338803+0000","last_active":"2023-10-19T12:42:28.120989+0000","last_peered":"2023-10-19T12:42:28.120989+0000","last_clean":"2023-10-19T12:42:28.120989+0000","last_became_active":"2023-10-19T12:41:23.338383+0000","last_became_peered":"2023-10-19T12:41:23.338383+0000","last_unstale":"2023-10-19T12:42:28.120989+0000","last_undegraded":"2023-10-19T12:42:28.120989+0000","last_fullsized":"2023-10-19T12:42:28.120989+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:39:24.412323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"90'8","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:43:23.559610+0000","last_change":"2023-10-19T12:41:19.290536+0000","last_active":"2023-10-19T12:43:23.559610+0000","last_peered":"2023-10-19T12:43:23.559610+0000","last_clean":"2023-10-19T12:43:23.559610+0000","last_became_active":"2023-10-19T12:41:19.290141+0000","last_became_peered":"2023-10-19T12:41:19.290141+0000","last_unstale":"2023-10-19T12:43:23.559610+0000","last_undegraded":"2023-10-19T12:43:23.559610+0000","last_fullsized":"2023-10-19T12:43:23.559610+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:49:59.601767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"88'6","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.762131+0000","last_change":"2023-10-19T12:41:18.276568+0000","last_active":"2023-10-19T12:43:27.762131+0000","last_peered":"2023-10-19T12:43:27.762131+0000","last_clean":"2023-10-19T12:43:27.762131+0000","last_became_active":"2023-10-19T12:41:18.276216+0000","last_became_peered":"2023-10-19T12:41:18.276216+0000","last_unstale":"2023-10-19T12:43:27.762131+0000","last_undegraded":"2023-10-19T12:43:27.762131+0000","last_fullsized":"2023-10-19T12:43:27.762131+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T23:24:32.159972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":314,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:28.120341+0000","last_change":"2023-10-19T12:40:14.674594+0000","last_active":"2023-10-19T12:42:28.120341+0000","last_peered":"2023-10-19T12:42:28.120341+0000","last_clean":"2023-10-19T12:42:28.120341+0000","last_became_active":"2023-10-19T12:40:14.674234+0000","last_became_peered":"2023-10-19T12:40:14.674234+0000","last_unstale":"2023-10-19T12:42:28.120341+0000","last_undegraded":"2023-10-19T12:42:28.120341+0000","last_fullsized":"2023-10-19T12:42:28.120341+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:37:07.222565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:37:07.222565+0000","last_clean_scrub_stamp":"2023-10-19T12:37:07.222565+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-21T00:22:40.530907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-19T12:43:28.780476+0000","last_change":"2023-10-19T12:43:28.777654+0000","last_active":"2023-10-19T12:43:28.780476+0000","last_peered":"2023-10-19T12:43:28.780476+0000","last_clean":"2023-10-19T12:43:28.780476+0000","last_became_active":"2023-10-19T12:43:28.777183+0000","last_became_peered":"2023-10-19T12:43:28.777183+0000","last_unstale":"2023-10-19T12:43:28.780476+0000","last_undegraded":"2023-10-19T12:43:28.780476+0000","last_fullsized":"2023-10-19T12:43:28.780476+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T23:22:06.993915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6,10],"acting":[8,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1","version":"90'5","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:56.679900+0000","last_change":"2023-10-19T12:41:19.294132+0000","last_active":"2023-10-19T12:42:56.679900+0000","last_peered":"2023-10-19T12:42:56.679900+0000","last_clean":"2023-10-19T12:42:56.679900+0000","last_became_active":"2023-10-19T12:41:19.293800+0000","last_became_peered":"2023-10-19T12:41:19.293800+0000","last_unstale":"2023-10-19T12:42:56.679900+0000","last_undegraded":"2023-10-19T12:42:56.679900+0000","last_fullsized":"2023-10-19T12:42:56.679900+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:30:56.734581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"88'4","reported_seq":15,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:28.136072+0000","last_change":"2023-10-19T12:42:28.135694+0000","last_active":"2023-10-19T12:42:28.136072+0000","last_peered":"2023-10-19T12:42:28.136072+0000","last_clean":"2023-10-19T12:42:28.136072+0000","last_became_active":"2023-10-19T12:42:28.127322+0000","last_became_peered":"2023-10-19T12:42:28.127322+0000","last_unstale":"2023-10-19T12:42:28.136072+0000","last_undegraded":"2023-10-19T12:42:28.136072+0000","last_fullsized":"2023-10-19T12:42:28.136072+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T23:26:54.615667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.122348+0000","last_change":"2023-10-19T12:41:23.328605+0000","last_active":"2023-10-19T12:42:27.122348+0000","last_peered":"2023-10-19T12:42:27.122348+0000","last_clean":"2023-10-19T12:42:27.122348+0000","last_became_active":"2023-10-19T12:41:23.327992+0000","last_became_peered":"2023-10-19T12:41:23.327992+0000","last_unstale":"2023-10-19T12:42:27.122348+0000","last_undegraded":"2023-10-19T12:42:27.122348+0000","last_fullsized":"2023-10-19T12:42:27.122348+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:00:04.415235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"88'4","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.763134+0000","last_change":"2023-10-19T12:41:18.290347+0000","last_active":"2023-10-19T12:43:27.763134+0000","last_peered":"2023-10-19T12:43:27.763134+0000","last_clean":"2023-10-19T12:43:27.763134+0000","last_became_active":"2023-10-19T12:41:18.290050+0000","last_became_peered":"2023-10-19T12:41:18.290050+0000","last_unstale":"2023-10-19T12:43:27.763134+0000","last_undegraded":"2023-10-19T12:43:27.763134+0000","last_fullsized":"2023-10-19T12:43:27.763134+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:19:05.618338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"90'9","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:56.678606+0000","last_change":"2023-10-19T12:41:19.303753+0000","last_active":"2023-10-19T12:42:56.678606+0000","last_peered":"2023-10-19T12:42:56.678606+0000","last_clean":"2023-10-19T12:42:56.678606+0000","last_became_active":"2023-10-19T12:41:19.299710+0000","last_became_peered":"2023-10-19T12:41:19.299710+0000","last_unstale":"2023-10-19T12:42:56.678606+0000","last_undegraded":"2023-10-19T12:42:56.678606+0000","last_fullsized":"2023-10-19T12:42:56.678606+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:40:27.929956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:43:23.559527+0000","last_change":"2023-10-19T12:41:23.478159+0000","last_active":"2023-10-19T12:43:23.559527+0000","last_peered":"2023-10-19T12:43:23.559527+0000","last_clean":"2023-10-19T12:43:23.559527+0000","last_became_active":"2023-10-19T12:41:23.477647+0000","last_became_peered":"2023-10-19T12:41:23.477647+0000","last_unstale":"2023-10-19T12:43:23.559527+0000","last_undegraded":"2023-10-19T12:43:23.559527+0000","last_fullsized":"2023-10-19T12:43:23.559527+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:48:31.904477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"90'12","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-19T12:43:28.772974+0000","last_change":"2023-10-19T12:41:18.295746+0000","last_active":"2023-10-19T12:43:28.772974+0000","last_peered":"2023-10-19T12:43:28.772974+0000","last_clean":"2023-10-19T12:43:28.772974+0000","last_became_active":"2023-10-19T12:41:18.294855+0000","last_became_peered":"2023-10-19T12:41:18.294855+0000","last_unstale":"2023-10-19T12:43:28.772974+0000","last_undegraded":"2023-10-19T12:43:28.772974+0000","last_fullsized":"2023-10-19T12:43:28.772974+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:52:24.628136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"90'5","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.768609+0000","last_change":"2023-10-19T12:41:19.283960+0000","last_active":"2023-10-19T12:43:27.768609+0000","last_peered":"2023-10-19T12:43:27.768609+0000","last_clean":"2023-10-19T12:43:27.768609+0000","last_became_active":"2023-10-19T12:41:19.282544+0000","last_became_peered":"2023-10-19T12:41:19.282544+0000","last_unstale":"2023-10-19T12:43:27.768609+0000","last_undegraded":"2023-10-19T12:43:27.768609+0000","last_fullsized":"2023-10-19T12:43:27.768609+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T23:58:08.794192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.116192+0000","last_change":"2023-10-19T12:41:23.323593+0000","last_active":"2023-10-19T12:42:27.116192+0000","last_peered":"2023-10-19T12:42:27.116192+0000","last_clean":"2023-10-19T12:42:27.116192+0000","last_became_active":"2023-10-19T12:41:23.323204+0000","last_became_peered":"2023-10-19T12:41:23.323204+0000","last_unstale":"2023-10-19T12:42:27.116192+0000","last_undegraded":"2023-10-19T12:42:27.116192+0000","last_fullsized":"2023-10-19T12:42:27.116192+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:15:15.379085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"88'7","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-19T12:43:28.775180+0000","last_change":"2023-10-19T12:41:18.286231+0000","last_active":"2023-10-19T12:43:28.775180+0000","last_peered":"2023-10-19T12:43:28.775180+0000","last_clean":"2023-10-19T12:43:28.775180+0000","last_became_active":"2023-10-19T12:41:18.285932+0000","last_became_peered":"2023-10-19T12:41:18.285932+0000","last_unstale":"2023-10-19T12:43:28.775180+0000","last_undegraded":"2023-10-19T12:43:28.775180+0000","last_fullsized":"2023-10-19T12:43:28.775180+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:13:02.066468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"90'7","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-19T12:43:28.774328+0000","last_change":"2023-10-19T12:42:28.126438+0000","last_active":"2023-10-19T12:43:28.774328+0000","last_peered":"2023-10-19T12:43:28.774328+0000","last_clean":"2023-10-19T12:43:28.774328+0000","last_became_active":"2023-10-19T12:42:28.126115+0000","last_became_peered":"2023-10-19T12:42:28.126115+0000","last_unstale":"2023-10-19T12:43:28.774328+0000","last_undegraded":"2023-10-19T12:43:28.774328+0000","last_fullsized":"2023-10-19T12:43:28.774328+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:48:12.878420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.763594+0000","last_change":"2023-10-19T12:41:23.479129+0000","last_active":"2023-10-19T12:43:27.763594+0000","last_peered":"2023-10-19T12:43:27.763594+0000","last_clean":"2023-10-19T12:43:27.763594+0000","last_became_active":"2023-10-19T12:41:23.478518+0000","last_became_peered":"2023-10-19T12:41:23.478518+0000","last_unstale":"2023-10-19T12:43:27.763594+0000","last_undegraded":"2023-10-19T12:43:27.763594+0000","last_fullsized":"2023-10-19T12:43:27.763594+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:55:38.767504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"88'2","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.124117+0000","last_change":"2023-10-19T12:41:18.283269+0000","last_active":"2023-10-19T12:42:27.124117+0000","last_peered":"2023-10-19T12:42:27.124117+0000","last_clean":"2023-10-19T12:42:27.124117+0000","last_became_active":"2023-10-19T12:41:18.282913+0000","last_became_peered":"2023-10-19T12:41:18.282913+0000","last_unstale":"2023-10-19T12:42:27.124117+0000","last_undegraded":"2023-10-19T12:42:27.124117+0000","last_fullsized":"2023-10-19T12:42:27.124117+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:44:01.042312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"90'2","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-19T12:43:28.770381+0000","last_change":"2023-10-19T12:41:19.284222+0000","last_active":"2023-10-19T12:43:28.770381+0000","last_peered":"2023-10-19T12:43:28.770381+0000","last_clean":"2023-10-19T12:43:28.770381+0000","last_became_active":"2023-10-19T12:41:19.283914+0000","last_became_peered":"2023-10-19T12:41:19.283914+0000","last_unstale":"2023-10-19T12:43:28.770381+0000","last_undegraded":"2023-10-19T12:43:28.770381+0000","last_fullsized":"2023-10-19T12:43:28.770381+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:15:34.801502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.759445+0000","last_change":"2023-10-19T12:41:23.338071+0000","last_active":"2023-10-19T12:43:27.759445+0000","last_peered":"2023-10-19T12:43:27.759445+0000","last_clean":"2023-10-19T12:43:27.759445+0000","last_became_active":"2023-10-19T12:41:23.336265+0000","last_became_peered":"2023-10-19T12:41:23.336265+0000","last_unstale":"2023-10-19T12:43:27.759445+0000","last_undegraded":"2023-10-19T12:43:27.759445+0000","last_fullsized":"2023-10-19T12:43:27.759445+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:02:53.139468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"88'7","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.765619+0000","last_change":"2023-10-19T12:41:18.293027+0000","last_active":"2023-10-19T12:43:27.765619+0000","last_peered":"2023-10-19T12:43:27.765619+0000","last_clean":"2023-10-19T12:43:27.765619+0000","last_became_active":"2023-10-19T12:41:18.289478+0000","last_became_peered":"2023-10-19T12:41:18.289478+0000","last_unstale":"2023-10-19T12:43:27.765619+0000","last_undegraded":"2023-10-19T12:43:27.765619+0000","last_fullsized":"2023-10-19T12:43:27.765619+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:26:32.986754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"90'9","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:56.692932+0000","last_change":"2023-10-19T12:41:19.293206+0000","last_active":"2023-10-19T12:42:56.692932+0000","last_peered":"2023-10-19T12:42:56.692932+0000","last_clean":"2023-10-19T12:42:56.692932+0000","last_became_active":"2023-10-19T12:41:19.292898+0000","last_became_peered":"2023-10-19T12:41:19.292898+0000","last_unstale":"2023-10-19T12:42:56.692932+0000","last_undegraded":"2023-10-19T12:42:56.692932+0000","last_fullsized":"2023-10-19T12:42:56.692932+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T23:36:17.548859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"88'1","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.763493+0000","last_change":"2023-10-19T12:41:23.343048+0000","last_active":"2023-10-19T12:43:27.763493+0000","last_peered":"2023-10-19T12:43:27.763493+0000","last_clean":"2023-10-19T12:43:27.763493+0000","last_became_active":"2023-10-19T12:41:23.342696+0000","last_became_peered":"2023-10-19T12:41:23.342696+0000","last_unstale":"2023-10-19T12:43:27.763493+0000","last_undegraded":"2023-10-19T12:43:27.763493+0000","last_fullsized":"2023-10-19T12:43:27.763493+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:30:38.858947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"88'3","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:28.121335+0000","last_change":"2023-10-19T12:41:18.293079+0000","last_active":"2023-10-19T12:42:28.121335+0000","last_peered":"2023-10-19T12:42:28.121335+0000","last_clean":"2023-10-19T12:42:28.121335+0000","last_became_active":"2023-10-19T12:41:18.292803+0000","last_became_peered":"2023-10-19T12:41:18.292803+0000","last_unstale":"2023-10-19T12:42:28.121335+0000","last_undegraded":"2023-10-19T12:42:28.121335+0000","last_fullsized":"2023-10-19T12:42:28.121335+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T22:37:14.550800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"90'8","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:56.692004+0000","last_change":"2023-10-19T12:41:19.292921+0000","last_active":"2023-10-19T12:42:56.692004+0000","last_peered":"2023-10-19T12:42:56.692004+0000","last_clean":"2023-10-19T12:42:56.692004+0000","last_became_active":"2023-10-19T12:41:19.292498+0000","last_became_peered":"2023-10-19T12:41:19.292498+0000","last_unstale":"2023-10-19T12:42:56.692004+0000","last_undegraded":"2023-10-19T12:42:56.692004+0000","last_fullsized":"2023-10-19T12:42:56.692004+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T22:02:55.878154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.763662+0000","last_change":"2023-10-19T12:41:23.477894+0000","last_active":"2023-10-19T12:43:27.763662+0000","last_peered":"2023-10-19T12:43:27.763662+0000","last_clean":"2023-10-19T12:43:27.763662+0000","last_became_active":"2023-10-19T12:41:23.477478+0000","last_became_peered":"2023-10-19T12:41:23.477478+0000","last_unstale":"2023-10-19T12:43:27.763662+0000","last_undegraded":"2023-10-19T12:43:27.763662+0000","last_fullsized":"2023-10-19T12:43:27.763662+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:44:21.730215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"88'4","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.762798+0000","last_change":"2023-10-19T12:41:18.282474+0000","last_active":"2023-10-19T12:43:27.762798+0000","last_peered":"2023-10-19T12:43:27.762798+0000","last_clean":"2023-10-19T12:43:27.762798+0000","last_became_active":"2023-10-19T12:41:18.282124+0000","last_became_peered":"2023-10-19T12:41:18.282124+0000","last_unstale":"2023-10-19T12:43:27.762798+0000","last_undegraded":"2023-10-19T12:43:27.762798+0000","last_fullsized":"2023-10-19T12:43:27.762798+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T21:27:37.530324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"90'5","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:56.681539+0000","last_change":"2023-10-19T12:41:19.302928+0000","last_active":"2023-10-19T12:42:56.681539+0000","last_peered":"2023-10-19T12:42:56.681539+0000","last_clean":"2023-10-19T12:42:56.681539+0000","last_became_active":"2023-10-19T12:41:19.302641+0000","last_became_peered":"2023-10-19T12:41:19.302641+0000","last_unstale":"2023-10-19T12:42:56.681539+0000","last_undegraded":"2023-10-19T12:42:56.681539+0000","last_fullsized":"2023-10-19T12:42:56.681539+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:07:46.333875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.124012+0000","last_change":"2023-10-19T12:41:23.329079+0000","last_active":"2023-10-19T12:42:27.124012+0000","last_peered":"2023-10-19T12:42:27.124012+0000","last_clean":"2023-10-19T12:42:27.124012+0000","last_became_active":"2023-10-19T12:41:23.328407+0000","last_became_peered":"2023-10-19T12:41:23.328407+0000","last_unstale":"2023-10-19T12:42:27.124012+0000","last_undegraded":"2023-10-19T12:42:27.124012+0000","last_fullsized":"2023-10-19T12:42:27.124012+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:46:19.404922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"90'7","reported_seq":128,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:43:25.457972+0000","last_change":"2023-10-19T12:41:18.286336+0000","last_active":"2023-10-19T12:43:25.457972+0000","last_peered":"2023-10-19T12:43:25.457972+0000","last_clean":"2023-10-19T12:43:25.457972+0000","last_became_active":"2023-10-19T12:41:18.285921+0000","last_became_peered":"2023-10-19T12:41:18.285921+0000","last_unstale":"2023-10-19T12:43:25.457972+0000","last_undegraded":"2023-10-19T12:43:25.457972+0000","last_fullsized":"2023-10-19T12:43:25.457972+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T23:16:34.842143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1701,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":103,"num_read_kb":3,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"90'7","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:56.684915+0000","last_change":"2023-10-19T12:41:19.289466+0000","last_active":"2023-10-19T12:42:56.684915+0000","last_peered":"2023-10-19T12:42:56.684915+0000","last_clean":"2023-10-19T12:42:56.684915+0000","last_became_active":"2023-10-19T12:41:19.288669+0000","last_became_peered":"2023-10-19T12:41:19.288669+0000","last_unstale":"2023-10-19T12:42:56.684915+0000","last_undegraded":"2023-10-19T12:42:56.684915+0000","last_fullsized":"2023-10-19T12:42:56.684915+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T23:31:52.163958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.768166+0000","last_change":"2023-10-19T12:41:23.343521+0000","last_active":"2023-10-19T12:43:27.768166+0000","last_peered":"2023-10-19T12:43:27.768166+0000","last_clean":"2023-10-19T12:43:27.768166+0000","last_became_active":"2023-10-19T12:41:23.342288+0000","last_became_peered":"2023-10-19T12:41:23.342288+0000","last_unstale":"2023-10-19T12:43:27.768166+0000","last_undegraded":"2023-10-19T12:43:27.768166+0000","last_fullsized":"2023-10-19T12:43:27.768166+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:58:06.810552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"88'3","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.122056+0000","last_change":"2023-10-19T12:41:18.294999+0000","last_active":"2023-10-19T12:42:27.122056+0000","last_peered":"2023-10-19T12:42:27.122056+0000","last_clean":"2023-10-19T12:42:27.122056+0000","last_became_active":"2023-10-19T12:41:18.294776+0000","last_became_peered":"2023-10-19T12:41:18.294776+0000","last_unstale":"2023-10-19T12:42:27.122056+0000","last_undegraded":"2023-10-19T12:42:27.122056+0000","last_fullsized":"2023-10-19T12:42:27.122056+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:17:53.704739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"90'6","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:56.690764+0000","last_change":"2023-10-19T12:41:19.291753+0000","last_active":"2023-10-19T12:42:56.690764+0000","last_peered":"2023-10-19T12:42:56.690764+0000","last_clean":"2023-10-19T12:42:56.690764+0000","last_became_active":"2023-10-19T12:41:19.291475+0000","last_became_peered":"2023-10-19T12:41:19.291475+0000","last_unstale":"2023-10-19T12:42:56.690764+0000","last_undegraded":"2023-10-19T12:42:56.690764+0000","last_fullsized":"2023-10-19T12:42:56.690764+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:26:38.494864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.118754+0000","last_change":"2023-10-19T12:41:23.327966+0000","last_active":"2023-10-19T12:42:27.118754+0000","last_peered":"2023-10-19T12:42:27.118754+0000","last_clean":"2023-10-19T12:42:27.118754+0000","last_became_active":"2023-10-19T12:41:23.327555+0000","last_became_peered":"2023-10-19T12:41:23.327555+0000","last_unstale":"2023-10-19T12:42:27.118754+0000","last_undegraded":"2023-10-19T12:42:27.118754+0000","last_fullsized":"2023-10-19T12:42:27.118754+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:01:34.044012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"88'5","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.125824+0000","last_change":"2023-10-19T12:41:18.297472+0000","last_active":"2023-10-19T12:42:27.125824+0000","last_peered":"2023-10-19T12:42:27.125824+0000","last_clean":"2023-10-19T12:42:27.125824+0000","last_became_active":"2023-10-19T12:41:18.296410+0000","last_became_peered":"2023-10-19T12:41:18.296410+0000","last_unstale":"2023-10-19T12:42:27.125824+0000","last_undegraded":"2023-10-19T12:42:27.125824+0000","last_fullsized":"2023-10-19T12:42:27.125824+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:20:15.039332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"90'9","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:56.681206+0000","last_change":"2023-10-19T12:41:19.295136+0000","last_active":"2023-10-19T12:42:56.681206+0000","last_peered":"2023-10-19T12:42:56.681206+0000","last_clean":"2023-10-19T12:42:56.681206+0000","last_became_active":"2023-10-19T12:41:19.294836+0000","last_became_peered":"2023-10-19T12:41:19.294836+0000","last_unstale":"2023-10-19T12:42:56.681206+0000","last_undegraded":"2023-10-19T12:42:56.681206+0000","last_fullsized":"2023-10-19T12:42:56.681206+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:08:25.830396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"90'9","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:56.678683+0000","last_change":"2023-10-19T12:41:19.290047+0000","last_active":"2023-10-19T12:42:56.678683+0000","last_peered":"2023-10-19T12:42:56.678683+0000","last_clean":"2023-10-19T12:42:56.678683+0000","last_became_active":"2023-10-19T12:41:19.289792+0000","last_became_peered":"2023-10-19T12:41:19.289792+0000","last_unstale":"2023-10-19T12:42:56.678683+0000","last_undegraded":"2023-10-19T12:42:56.678683+0000","last_fullsized":"2023-10-19T12:42:56.678683+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:10:58.981643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"90'12","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:56.676584+0000","last_change":"2023-10-19T12:41:19.287973+0000","last_active":"2023-10-19T12:42:56.676584+0000","last_peered":"2023-10-19T12:42:56.676584+0000","last_clean":"2023-10-19T12:42:56.676584+0000","last_became_active":"2023-10-19T12:41:19.287508+0000","last_became_peered":"2023-10-19T12:41:19.287508+0000","last_unstale":"2023-10-19T12:42:56.676584+0000","last_undegraded":"2023-10-19T12:42:56.676584+0000","last_fullsized":"2023-10-19T12:42:56.676584+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:25:57.815032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"90'8","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:56.679807+0000","last_change":"2023-10-19T12:41:19.294154+0000","last_active":"2023-10-19T12:42:56.679807+0000","last_peered":"2023-10-19T12:42:56.679807+0000","last_clean":"2023-10-19T12:42:56.679807+0000","last_became_active":"2023-10-19T12:41:19.293873+0000","last_became_peered":"2023-10-19T12:41:19.293873+0000","last_unstale":"2023-10-19T12:42:56.679807+0000","last_undegraded":"2023-10-19T12:42:56.679807+0000","last_fullsized":"2023-10-19T12:42:56.679807+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:29:58.428571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"90'7","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.768327+0000","last_change":"2023-10-19T12:41:19.309512+0000","last_active":"2023-10-19T12:43:27.768327+0000","last_peered":"2023-10-19T12:43:27.768327+0000","last_clean":"2023-10-19T12:43:27.768327+0000","last_became_active":"2023-10-19T12:41:19.309149+0000","last_became_peered":"2023-10-19T12:41:19.309149+0000","last_unstale":"2023-10-19T12:43:27.768327+0000","last_undegraded":"2023-10-19T12:43:27.768327+0000","last_fullsized":"2023-10-19T12:43:27.768327+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:19:34.971413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"90'4","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:56.678488+0000","last_change":"2023-10-19T12:41:19.301496+0000","last_active":"2023-10-19T12:42:56.678488+0000","last_peered":"2023-10-19T12:42:56.678488+0000","last_clean":"2023-10-19T12:42:56.678488+0000","last_became_active":"2023-10-19T12:41:19.299697+0000","last_became_peered":"2023-10-19T12:41:19.299697+0000","last_unstale":"2023-10-19T12:42:56.678488+0000","last_undegraded":"2023-10-19T12:42:56.678488+0000","last_fullsized":"2023-10-19T12:42:56.678488+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T23:51:52.448215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"90'6","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:56.671023+0000","last_change":"2023-10-19T12:41:19.289995+0000","last_active":"2023-10-19T12:42:56.671023+0000","last_peered":"2023-10-19T12:42:56.671023+0000","last_clean":"2023-10-19T12:42:56.671023+0000","last_became_active":"2023-10-19T12:41:19.289471+0000","last_became_peered":"2023-10-19T12:41:19.289471+0000","last_unstale":"2023-10-19T12:42:56.671023+0000","last_undegraded":"2023-10-19T12:42:56.671023+0000","last_fullsized":"2023-10-19T12:42:56.671023+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:28:25.801772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"90'15","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:56.676368+0000","last_change":"2023-10-19T12:41:19.287620+0000","last_active":"2023-10-19T12:42:56.676368+0000","last_peered":"2023-10-19T12:42:56.676368+0000","last_clean":"2023-10-19T12:42:56.676368+0000","last_became_active":"2023-10-19T12:41:19.287298+0000","last_became_peered":"2023-10-19T12:41:19.287298+0000","last_unstale":"2023-10-19T12:42:56.676368+0000","last_undegraded":"2023-10-19T12:42:56.676368+0000","last_fullsized":"2023-10-19T12:42:56.676368+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:01:46.919580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"90'2","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.768730+0000","last_change":"2023-10-19T12:41:19.278455+0000","last_active":"2023-10-19T12:43:27.768730+0000","last_peered":"2023-10-19T12:43:27.768730+0000","last_clean":"2023-10-19T12:43:27.768730+0000","last_became_active":"2023-10-19T12:41:19.278093+0000","last_became_peered":"2023-10-19T12:41:19.278093+0000","last_unstale":"2023-10-19T12:43:27.768730+0000","last_undegraded":"2023-10-19T12:43:27.768730+0000","last_fullsized":"2023-10-19T12:43:27.768730+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T22:52:00.939409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"90'6","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:56.690255+0000","last_change":"2023-10-19T12:41:19.294478+0000","last_active":"2023-10-19T12:42:56.690255+0000","last_peered":"2023-10-19T12:42:56.690255+0000","last_clean":"2023-10-19T12:42:56.690255+0000","last_became_active":"2023-10-19T12:41:19.294136+0000","last_became_peered":"2023-10-19T12:41:19.294136+0000","last_unstale":"2023-10-19T12:42:56.690255+0000","last_undegraded":"2023-10-19T12:42:56.690255+0000","last_fullsized":"2023-10-19T12:42:56.690255+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:18:20.066346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"90'8","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:56.693840+0000","last_change":"2023-10-19T12:41:19.283014+0000","last_active":"2023-10-19T12:42:56.693840+0000","last_peered":"2023-10-19T12:42:56.693840+0000","last_clean":"2023-10-19T12:42:56.693840+0000","last_became_active":"2023-10-19T12:41:19.279958+0000","last_became_peered":"2023-10-19T12:41:19.279958+0000","last_unstale":"2023-10-19T12:42:56.693840+0000","last_undegraded":"2023-10-19T12:42:56.693840+0000","last_fullsized":"2023-10-19T12:42:56.693840+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-21T00:26:13.329031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"90'10","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:56.693671+0000","last_change":"2023-10-19T12:41:19.296507+0000","last_active":"2023-10-19T12:42:56.693671+0000","last_peered":"2023-10-19T12:42:56.693671+0000","last_clean":"2023-10-19T12:42:56.693671+0000","last_became_active":"2023-10-19T12:41:19.295960+0000","last_became_peered":"2023-10-19T12:41:19.295960+0000","last_unstale":"2023-10-19T12:42:56.693671+0000","last_undegraded":"2023-10-19T12:42:56.693671+0000","last_fullsized":"2023-10-19T12:42:56.693671+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T22:49:06.224425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"90'11","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:56.689554+0000","last_change":"2023-10-19T12:41:19.300262+0000","last_active":"2023-10-19T12:42:56.689554+0000","last_peered":"2023-10-19T12:42:56.689554+0000","last_clean":"2023-10-19T12:42:56.689554+0000","last_became_active":"2023-10-19T12:41:19.299702+0000","last_became_peered":"2023-10-19T12:41:19.299702+0000","last_unstale":"2023-10-19T12:42:56.689554+0000","last_undegraded":"2023-10-19T12:42:56.689554+0000","last_fullsized":"2023-10-19T12:42:56.689554+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:30:22.690228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"90'8","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:56.675950+0000","last_change":"2023-10-19T12:41:19.289863+0000","last_active":"2023-10-19T12:42:56.675950+0000","last_peered":"2023-10-19T12:42:56.675950+0000","last_clean":"2023-10-19T12:42:56.675950+0000","last_became_active":"2023-10-19T12:41:19.289556+0000","last_became_peered":"2023-10-19T12:41:19.289556+0000","last_unstale":"2023-10-19T12:42:56.675950+0000","last_undegraded":"2023-10-19T12:42:56.675950+0000","last_fullsized":"2023-10-19T12:42:56.675950+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:17:18.560081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":67959,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1031,"num_read_kb":590,"num_write":248,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":1204,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":204193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":216,"ondisk_log_size":216,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":79,"seq":339302416423,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1019904,"data_stored":495261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 19 12:42:35 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.86699999999999999,"15min":0.91500000000000004},"min":{"1min":0.39600000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.84399999999999997,"5min":8.5449999999999999,"15min":8.5449999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.84499999999999997,"15min":0.88500000000000001},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.90700000000000003,"5min":7.641,"15min":7.641},"last":0.52500000000000002}]},{"osd":1,"last update":"Thu Oct 19 12:42:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.70499999999999996,"15min":0.71299999999999997},"min":{"1min":0.49299999999999999,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.85099999999999998,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.70799999999999996,"15min":0.71199999999999997},"min":{"1min":0.47299999999999998,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.83699999999999997,"5min":1.883,"15min":1.883},"last":0.69199999999999995}]},{"osd":2,"last update":"Thu Oct 19 12:42:35 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.54800000000000004,"15min":0.55700000000000005},"min":{"1min":0.39600000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.64700000000000002,"5min":1.496,"15min":1.496},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.55300000000000005,"15min":0.55100000000000005},"min":{"1min":0.35499999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.92700000000000005,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.83499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":4,"last update":"Thu Oct 19 12:42:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.83499999999999996,"15min":0.85499999999999998},"min":{"1min":0.57099999999999995,"5min":0.495,"15min":0.495},"max":{"1min":0.95499999999999996,"5min":3.5190000000000001,"15min":3.5190000000000001},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.75700000000000001,"15min":0.76900000000000002},"min":{"1min":0.55700000000000005,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.90200000000000002,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.76300000000000001}]},{"osd":5,"last update":"Thu Oct 19 12:42:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63900000000000001,"15min":0.64000000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.02,"5min":1.675,"15min":1.675},"last":0.623},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.69599999999999995,"15min":0.69799999999999995},"min":{"1min":0.45800000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0920000000000001,"5min":2.089,"15min":2.089},"last":0.86699999999999999}]},{"osd":6,"last update":"Thu Oct 19 12:42:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.75700000000000001,"15min":0.76400000000000001},"min":{"1min":0.48899999999999999,"5min":0.438,"15min":0.438},"max":{"1min":1.0609999999999999,"5min":2.004,"15min":2.004},"last":0.877},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.75900000000000001,"15min":0.76700000000000002},"min":{"1min":0.51100000000000001,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.641,"5min":1.704,"15min":1.704},"last":0.74299999999999999}]},{"osd":7,"last update":"Thu Oct 19 12:42:35 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":1.0029999999999999,"15min":1.0449999999999999},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.98199999999999998,"5min":6.5590000000000002,"15min":6.5590000000000002},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.78500000000000003,"5min":1.0620000000000001,"15min":1.1080000000000001},"min":{"1min":0.60099999999999998,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.99199999999999999,"5min":7.3070000000000004,"15min":7.3070000000000004},"last":0.89800000000000002}]},{"osd":8,"last update":"Thu Oct 19 12:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.753,"15min":0.75700000000000001},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.94699999999999995,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.70899999999999996,"15min":0.70699999999999996},"min":{"1min":0.53500000000000003,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.66900000000000004}]},{"osd":9,"last update":"Thu Oct 19 12:42:35 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":1.0529999999999999,"15min":1.095},"min":{"1min":0.60899999999999999,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.96999999999999997,"5min":7.8440000000000003,"15min":7.8440000000000003},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.96799999999999997,"15min":0.99199999999999999},"min":{"1min":0.621,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.0269999999999999,"5min":5.0860000000000003,"15min":5.0860000000000003},"last":0.91000000000000003}]},{"osd":10,"last update":"Thu Oct 19 12:42:35 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":1.0920000000000001,"15min":1.1299999999999999},"min":{"1min":0.72899999999999998,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.0269999999999999,"5min":7.2619999999999996,"15min":7.2619999999999996},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.81299999999999994,"5min":1.085,"15min":1.1299999999999999},"min":{"1min":0.65600000000000003,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.008,"5min":7.7619999999999996,"15min":7.7619999999999996},"last":0.77900000000000003}]}]},{"osd":10,"up_from":72,"seq":309237645354,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28680,"kb_used_data":1664,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716472,"statfs":{"total":95995035648,"available":95965667328,"internally_reserved":0,"allocated":1703936,"data_stored":1141323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 19 12:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.61199999999999999,"15min":0.57199999999999995},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":5.8819999999999997,"5min":5.8819999999999997,"15min":5.8819999999999997},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.55600000000000005,"15min":0.55000000000000004},"min":{"1min":0.39900000000000002,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.78100000000000003}]},{"osd":1,"last update":"Thu Oct 19 12:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.44900000000000001,"15min":0.45600000000000002},"min":{"1min":0.29699999999999999,"5min":0.254,"15min":0.254},"max":{"1min":0.57199999999999995,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.32200000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.61299999999999999,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.59699999999999998}]},{"osd":2,"last update":"Thu Oct 19 12:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.68200000000000005,"15min":0.69699999999999995},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.78800000000000003,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.68600000000000005,"15min":0.70999999999999996},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.77300000000000002,"5min":2.2050000000000001,"15min":2.2050000000000001},"last":0.88}]},{"osd":3,"last update":"Thu Oct 19 12:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.63600000000000001,"15min":0.65500000000000003},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.83999999999999997,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.70799999999999996,"15min":0.68100000000000005},"min":{"1min":0.47399999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":5.9109999999999996,"5min":5.9109999999999996,"15min":5.9109999999999996},"last":0.85499999999999998}]},{"osd":4,"last update":"Thu Oct 19 12:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.56999999999999995,"15min":0.57499999999999996},"min":{"1min":0.41099999999999998,"5min":0.37,"15min":0.37},"max":{"1min":0.68700000000000006,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.56299999999999994,"15min":0.56999999999999995},"min":{"1min":0.33700000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.75700000000000001,"5min":0.999,"15min":0.999},"last":0.57199999999999995}]},{"osd":5,"last update":"Thu Oct 19 12:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.79700000000000004,"15min":0.83499999999999996},"min":{"1min":0.45700000000000002,"5min":0.434,"15min":0.434},"max":{"1min":0.92500000000000004,"5min":2.3940000000000001,"15min":2.3940000000000001},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.755,"15min":0.77600000000000002},"min":{"1min":0.54200000000000004,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.88500000000000001,"5min":2.2530000000000001,"15min":2.2530000000000001},"last":0.98499999999999999}]},{"osd":6,"last update":"Thu Oct 19 12:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.74299999999999999,"15min":0.76100000000000001},"min":{"1min":0.46200000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.92200000000000004,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.95799999999999996},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.75900000000000001,"15min":0.76400000000000001},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.93300000000000005,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.92700000000000005}]},{"osd":7,"last update":"Thu Oct 19 12:41:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":1.046}]},{"osd":8,"last update":"Thu Oct 19 12:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.81399999999999995,"15min":0.84499999999999997},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.82199999999999995,"5min":2.012,"15min":2.012},"last":1.0069999999999999},{"interface":"front","average":{"1min":0.754,"5min":0.86699999999999999,"15min":0.90700000000000003},"min":{"1min":0.53100000000000003,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.95999999999999996,"5min":2.2290000000000001,"15min":2.2290000000000001},"last":0.94399999999999995}]},{"osd":9,"last update":"Thu Oct 19 12:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.80700000000000005,"15min":0.81399999999999995},"min":{"1min":0.61099999999999999,"5min":0.5,"15min":0.5},"max":{"1min":0.97199999999999998,"5min":1.262,"15min":1.262},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":2.032,"5min":2.032,"15min":2.032},"last":0.89800000000000002}]},{"osd":11,"last update":"Thu Oct 19 12:42:35 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76200000000000001,"15min":0.76100000000000001},"min":{"1min":0.56599999999999995,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":1.024},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.76200000000000001,"15min":0.754},"min":{"1min":0.59699999999999998,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":1.0469999999999999}]}]},{"osd":9,"up_from":67,"seq":287762808879,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28056,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717096,"statfs":{"total":95995035648,"available":95966306304,"internally_reserved":0,"allocated":1060864,"data_stored":508048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 19 12:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.55200000000000005,"15min":0.57899999999999996},"min":{"1min":0.39200000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.502,"5min":0.55000000000000004,"15min":0.57199999999999995},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.63600000000000001,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.60599999999999998}]},{"osd":1,"last update":"Thu Oct 19 12:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.76600000000000001,"15min":0.79400000000000004},"min":{"1min":0.58199999999999996,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.79100000000000004,"15min":0.78300000000000003},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":6.9279999999999999,"5min":6.9279999999999999,"15min":6.9279999999999999},"last":0.58099999999999996}]},{"osd":2,"last update":"Thu Oct 19 12:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.80800000000000005,"15min":0.79400000000000004},"min":{"1min":0.57399999999999995,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":6.9420000000000002,"5min":6.9420000000000002,"15min":6.9420000000000002},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.76000000000000001,"15min":0.77400000000000002},"min":{"1min":0.49099999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.24,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.70499999999999996}]},{"osd":3,"last update":"Thu Oct 19 12:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.71899999999999997,"15min":0.75900000000000001},"min":{"1min":0.46700000000000003,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.0529999999999999,"5min":1.196,"15min":1.196},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.80300000000000005,"15min":0.84699999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.1950000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.72299999999999998}]},{"osd":4,"last update":"Thu Oct 19 12:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.80100000000000005,"15min":0.84499999999999997},"min":{"1min":0.53900000000000003,"5min":0.495,"15min":0.495},"max":{"1min":0.94299999999999995,"5min":1.125,"15min":1.125},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.80400000000000005,"15min":0.83799999999999997},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.95299999999999996,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.53800000000000003}]},{"osd":5,"last update":"Thu Oct 19 12:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.84799999999999998,"15min":0.88900000000000001},"min":{"1min":0.58999999999999997,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0429999999999999,"5min":1.141,"15min":1.141},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.83199999999999996,"15min":0.85799999999999998},"min":{"1min":0.55200000000000005,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":0.86099999999999999}]},{"osd":6,"last update":"Thu Oct 19 12:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.48299999999999998}]},{"osd":7,"last update":"Thu Oct 19 12:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.89200000000000002,"15min":0.93000000000000005},"min":{"1min":0.53200000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.097,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.628},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.95399999999999996,"15min":1.0089999999999999},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.4370000000000001,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":0.78700000000000003}]},{"osd":8,"last update":"Thu Oct 19 12:42:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.0089999999999999,"15min":1.0349999999999999},"min":{"1min":0.61799999999999999,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":6.992,"5min":6.992,"15min":6.992},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.871,"5min":0.93500000000000005,"15min":0.97199999999999998},"min":{"1min":0.61299999999999999,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":0.90700000000000003}]},{"osd":10,"last update":"Thu Oct 19 12:43:13 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.93100000000000005,"15min":0.98299999999999998},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.0680000000000001,"5min":1.248,"15min":1.248},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.94099999999999995,"15min":0.96799999999999997},"min":{"1min":0.65500000000000003,"5min":0.624,"15min":0.624},"max":{"1min":1.1359999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.76900000000000002}]},{"osd":11,"last update":"Thu Oct 19 12:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.95099999999999996,"15min":0.96099999999999997},"min":{"1min":0.72599999999999998,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.097,"5min":1.526,"15min":1.526},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.89100000000000001,"15min":0.90100000000000002},"min":{"1min":0.63,"5min":0.629,"15min":0.629},"max":{"1min":1.2050000000000001,"5min":1.393,"15min":1.393},"last":0.83099999999999996}]}]},{"osd":8,"up_from":59,"seq":253403070515,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28064,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717088,"statfs":{"total":95995035648,"available":95966298112,"internally_reserved":0,"allocated":1064960,"data_stored":513670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 19 12:43:29 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.59699999999999998,"15min":0.60399999999999998},"min":{"1min":0.434,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.752,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.75},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.60699999999999998,"15min":0.59699999999999998},"min":{"1min":0.48399999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.80500000000000005,"5min":0.872,"15min":0.872},"last":0.60799999999999998}]},{"osd":1,"last update":"Thu Oct 19 12:42:28 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.621,"15min":0.60399999999999998},"min":{"1min":0.504,"5min":0.378,"15min":0.378},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.61299999999999999,"15min":0.58999999999999997},"min":{"1min":0.51500000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.91000000000000003}]},{"osd":2,"last update":"Thu Oct 19 12:43:29 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.504,"15min":0.47799999999999998},"min":{"1min":0.38700000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.498},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.505,"15min":0.47599999999999998},"min":{"1min":0.42099999999999999,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.70499999999999996,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.52800000000000002}]},{"osd":3,"last update":"Thu Oct 19 12:43:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.65300000000000002,"15min":0.63800000000000001},"min":{"1min":0.56299999999999994,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.876,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.64200000000000002,"15min":0.65200000000000002},"min":{"1min":0.45000000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.622}]},{"osd":4,"last update":"Thu Oct 19 12:43:29 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.70899999999999996,"15min":0.69999999999999996},"min":{"1min":0.56299999999999994,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.95299999999999996,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.70699999999999996,"15min":0.66800000000000004},"min":{"1min":0.64700000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.68799999999999994}]},{"osd":5,"last update":"Thu Oct 19 12:43:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.59299999999999997,"15min":0.56699999999999995},"min":{"1min":0.47899999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.63300000000000001,"15min":0.621},"min":{"1min":0.35899999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.92100000000000004,"5min":1.01,"15min":1.01},"last":0.66200000000000003}]},{"osd":6,"last update":"Thu Oct 19 12:43:29 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.76200000000000001,"15min":0.73699999999999999},"min":{"1min":0.70099999999999996,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.1399999999999999,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.748,"15min":0.72599999999999998},"min":{"1min":0.67100000000000004,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.79400000000000004}]},{"osd":7,"last update":"Thu Oct 19 12:43:29 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.79100000000000004,"15min":0.753},"min":{"1min":0.58299999999999996,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.107,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.88,"5min":0.79300000000000004,"15min":0.77900000000000003},"min":{"1min":0.64200000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.98799999999999999,"5min":1.113,"15min":1.113},"last":0.93300000000000005}]},{"osd":9,"last update":"Thu Oct 19 12:42:56 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.80200000000000005,"15min":0.77000000000000002},"min":{"1min":0.67500000000000004,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":2.4129999999999998,"5min":2.4129999999999998,"15min":2.4129999999999998},"last":0.872},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.83499999999999996,"15min":0.80000000000000004},"min":{"1min":0.76900000000000002,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":2.4300000000000002,"5min":2.4300000000000002,"15min":2.4300000000000002},"last":0.90600000000000003}]},{"osd":10,"last update":"Thu Oct 19 12:43:18 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.76200000000000001,"15min":0.71499999999999997},"min":{"1min":0.56200000000000006,"5min":0.434,"15min":0.434},"max":{"1min":1.0189999999999999,"5min":1.145,"15min":1.145},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.81200000000000006,"15min":0.77400000000000002},"min":{"1min":0.59699999999999998,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.96399999999999997}]},{"osd":11,"last update":"Thu Oct 19 12:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.88,"15min":0.871},"min":{"1min":0.74099999999999999,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.84399999999999997,"15min":0.84199999999999997},"min":{"1min":0.68500000000000005,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.88800000000000001}]}]},{"osd":7,"up_from":51,"seq":219043332152,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28612,"kb_used_data":1596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716540,"statfs":{"total":95995035648,"available":95965736960,"internally_reserved":0,"allocated":1634304,"data_stored":1090878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 19 12:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.61899999999999999,"15min":0.60899999999999999},"min":{"1min":0.434,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.56699999999999995,"15min":0.56299999999999994},"min":{"1min":0.46400000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.76600000000000001,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.45400000000000001}]},{"osd":1,"last update":"Thu Oct 19 12:43:07 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.41999999999999998,"15min":0.40799999999999997},"min":{"1min":0.29999999999999999,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.52300000000000002,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.44500000000000001,"15min":0.42999999999999999},"min":{"1min":0.27800000000000002,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.48999999999999999}]},{"osd":2,"last update":"Thu Oct 19 12:43:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.60799999999999998,"15min":0.59999999999999998},"min":{"1min":0.378,"5min":0.314,"15min":0.314},"max":{"1min":0.79300000000000004,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60199999999999998,"15min":0.61399999999999999},"min":{"1min":0.42599999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.76300000000000001,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.57599999999999996}]},{"osd":3,"last update":"Thu Oct 19 12:43:07 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.63900000000000001,"15min":0.63100000000000001},"min":{"1min":0.47199999999999998,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.81899999999999995,"5min":0.877,"15min":0.877},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.59699999999999998,"15min":0.60799999999999998},"min":{"1min":0.46200000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.83299999999999996,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.46600000000000003}]},{"osd":4,"last update":"Thu Oct 19 12:43:07 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.51000000000000001,"15min":0.504},"min":{"1min":0.34799999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.63900000000000001,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.5,"15min":0.48599999999999999},"min":{"1min":0.33100000000000002,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.745,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.40999999999999998}]},{"osd":5,"last update":"Thu Oct 19 12:43:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.68600000000000005,"15min":0.67800000000000005},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.86099999999999999,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.65000000000000002,"15min":0.64000000000000001},"min":{"1min":0.49199999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.626}]},{"osd":6,"last update":"Thu Oct 19 12:43:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.71899999999999997,"15min":0.72499999999999998},"min":{"1min":0.57199999999999995,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.81499999999999995,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.66500000000000004,"15min":0.66600000000000004},"min":{"1min":0.52600000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.91600000000000004,"5min":1.006,"15min":1.006},"last":0.56399999999999995}]},{"osd":8,"last update":"Thu Oct 19 12:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.72799999999999998,"15min":0.72399999999999998},"min":{"1min":0.61399999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.88200000000000001,"5min":1.002,"15min":1.002},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.69999999999999996,"15min":0.68799999999999994},"min":{"1min":0.56000000000000005,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.74099999999999999}]},{"osd":9,"last update":"Thu Oct 19 12:42:56 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.79900000000000004,"15min":0.78600000000000003},"min":{"1min":0.63,"5min":0.504,"15min":0.504},"max":{"1min":0.90000000000000002,"5min":2.9780000000000002,"15min":2.9780000000000002},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.74099999999999999,"15min":0.751},"min":{"1min":0.58699999999999997,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.94499999999999995,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.77100000000000002}]},{"osd":10,"last update":"Thu Oct 19 12:43:15 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.68100000000000005,"15min":0.68300000000000005},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.91300000000000003,"5min":1.044,"15min":1.044},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.751,"15min":0.753},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.93100000000000005,"5min":1.024,"15min":1.024},"last":0.75600000000000001}]},{"osd":11,"last update":"Thu Oct 19 12:43:19 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82599999999999996,"15min":0.82699999999999996},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":0.94099999999999995,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.71399999999999997,"15min":0.71499999999999997},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.69999999999999996}]}]},{"osd":6,"up_from":46,"seq":197568495676,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1015808,"data_stored":489582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 19 12:42:51 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.52900000000000003,"15min":0.497},"min":{"1min":0.41399999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":0.44},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.55000000000000004,"15min":0.55200000000000005},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.47399999999999998}]},{"osd":1,"last update":"Thu Oct 19 12:42:51 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.68000000000000005,"15min":0.63400000000000001},"min":{"1min":0.47499999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":3.4430000000000001,"5min":3.4430000000000001,"15min":3.4430000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.73599999999999999,"15min":0.68799999999999994},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.841,"5min":1.841,"15min":1.841},"last":0.76800000000000002}]},{"osd":2,"last update":"Thu Oct 19 12:42:51 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.72599999999999998,"15min":0.69199999999999995},"min":{"1min":0.54000000000000004,"5min":0.437,"15min":0.437},"max":{"1min":3.5110000000000001,"5min":3.5110000000000001,"15min":3.5110000000000001},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.67900000000000005,"15min":0.66200000000000003},"min":{"1min":0.39200000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.63400000000000001}]},{"osd":3,"last update":"Thu Oct 19 12:42:51 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.61899999999999999,"15min":0.627},"min":{"1min":0.40799999999999997,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.92700000000000005,"5min":1.131,"15min":1.131},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.71299999999999997,"15min":0.70699999999999996},"min":{"1min":0.53800000000000003,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.631,"5min":1.631,"15min":1.631},"last":0.66600000000000004}]},{"osd":4,"last update":"Thu Oct 19 12:42:51 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.78400000000000003,"15min":0.77600000000000002},"min":{"1min":0.58299999999999996,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.768,"5min":1.768,"15min":1.768},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.80100000000000005,"15min":0.79100000000000004},"min":{"1min":0.56299999999999994,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":3.4900000000000002,"5min":3.4900000000000002,"15min":3.4900000000000002},"last":0.85499999999999998}]},{"osd":5,"last update":"Thu Oct 19 12:42:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":0.87,"15min":0.82799999999999996},"min":{"1min":0.57999999999999996,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":3.4710000000000001,"5min":3.4710000000000001,"15min":3.4710000000000001},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.82899999999999996,"15min":0.82799999999999996},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.655,"5min":1.655,"15min":1.655},"last":0.84399999999999997}]},{"osd":7,"last update":"Thu Oct 19 12:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.85499999999999998,"15min":0.81899999999999995},"min":{"1min":0.61199999999999999,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.3919999999999999,"5min":1.879,"15min":1.879},"last":0.87},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.86099999999999999,"15min":0.85199999999999998},"min":{"1min":0.55300000000000005,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.097,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":0.82499999999999996}]},{"osd":8,"last update":"Thu Oct 19 12:42:31 2023","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":0.90400000000000003,"15min":0.89400000000000002},"min":{"1min":0.61199999999999999,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.7210000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.133,"5min":0.94199999999999995,"15min":0.92200000000000004},"min":{"1min":0.79200000000000004,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":3.5600000000000001,"5min":3.5600000000000001,"15min":3.5600000000000001},"last":0.86399999999999999}]},{"osd":9,"last update":"Thu Oct 19 12:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.84599999999999997,"15min":0.85899999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.107,"5min":1.216,"15min":1.216},"last":0.89300000000000002},{"interface":"front","average":{"1min":1.006,"5min":0.98399999999999999,"15min":1},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.9239999999999999,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":1}]},{"osd":10,"last update":"Thu Oct 19 12:43:19 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":1.01,"15min":1.018},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.47,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":1.042},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.96799999999999997,"15min":0.97199999999999998},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.3200000000000001,"5min":1.8640000000000001,"15min":1.8640000000000001},"last":0.94199999999999995}]},{"osd":11,"last update":"Thu Oct 19 12:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":1.0109999999999999,"15min":1.0189999999999999},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.198,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.89200000000000002,"15min":0.89800000000000002},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.109,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.91700000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574931,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28080,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717072,"statfs":{"total":95995035648,"available":95966281728,"internally_reserved":0,"allocated":1089536,"data_stored":552240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 19 12:42:59 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.64600000000000002,"15min":0.59299999999999997},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.77300000000000002,"5min":8.4559999999999995,"15min":8.4559999999999995},"last":0.437},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.60899999999999999,"15min":0.57399999999999995},"min":{"1min":0.42199999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.52700000000000002}]},{"osd":2,"last update":"Thu Oct 19 12:43:15 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.56999999999999995,"15min":0.60199999999999998},"min":{"1min":0.47499999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.872,"5min":0.872,"15min":4.1710000000000003},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.60599999999999998,"15min":0.53100000000000003},"min":{"1min":0.52500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.87,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.41299999999999998}]},{"osd":3,"last update":"Thu Oct 19 12:42:38 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.61399999999999999,"15min":0.59199999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.86299999999999999,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.56999999999999995,"15min":0.56000000000000005},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.48199999999999998}]},{"osd":4,"last update":"Thu Oct 19 12:43:08 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.44900000000000001,"15min":0.40999999999999998},"min":{"1min":0.26900000000000002,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.73699999999999999,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.371},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.45700000000000002,"15min":0.41299999999999998},"min":{"1min":0.30499999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.77300000000000002,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.60599999999999998}]},{"osd":5,"last update":"Thu Oct 19 12:43:24 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.55800000000000005,"15min":0.54100000000000004},"min":{"1min":0.42199999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.621},{"interface":"front","average":{"1min":0.752,"5min":0.65000000000000002,"15min":0.58799999999999997},"min":{"1min":0.51400000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.91000000000000003,"5min":1.03,"15min":1.03},"last":0.78800000000000003}]},{"osd":6,"last update":"Thu Oct 19 12:42:52 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.71599999999999997,"15min":0.69599999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.97799999999999998,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.622,"5min":0.78100000000000003,"15min":0.92700000000000005},"min":{"1min":0.432,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.86199999999999999,"5min":8.4039999999999999,"15min":8.4039999999999999},"last":0.56299999999999994}]},{"osd":7,"last update":"Thu Oct 19 12:43:09 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.63900000000000001,"15min":0.61899999999999999},"min":{"1min":0.42799999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.94499999999999995,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.79800000000000004,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.65100000000000002}]},{"osd":8,"last update":"Thu Oct 19 12:42:28 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.64400000000000002,"15min":0.628},"min":{"1min":0.51100000000000001,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.93799999999999994,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.752,"15min":0.73799999999999999},"min":{"1min":0.57999999999999996,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0409999999999999,"5min":1.117,"15min":1.117},"last":0.67600000000000005}]},{"osd":9,"last update":"Thu Oct 19 12:42:59 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.71099999999999997,"15min":0.70899999999999996},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.90900000000000003,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.748,"15min":0.74199999999999999},"min":{"1min":0.54800000000000004,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.66300000000000003}]},{"osd":10,"last update":"Thu Oct 19 12:43:15 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68899999999999995,"15min":0.67500000000000004},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.85999999999999999,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.77800000000000002,"15min":0.75800000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0129999999999999,"5min":1.099,"15min":1.099},"last":0.81000000000000005}]},{"osd":11,"last update":"Thu Oct 19 12:43:24 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.81399999999999995,"15min":0.81699999999999995},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.95799999999999996,"5min":1.022,"15min":1.022},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.89500000000000002,"15min":0.89700000000000002},"min":{"1min":0.66600000000000004,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.048,"5min":1.125,"15min":1.125},"last":0.83499999999999996}]}]},{"osd":0,"up_from":8,"seq":34359738457,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28072,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717080,"statfs":{"total":95995035648,"available":95966289920,"internally_reserved":0,"allocated":1073152,"data_stored":511365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Oct 19 12:42:51 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.63700000000000001,"15min":0.57699999999999996},"min":{"1min":0.42499999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.88900000000000001,"5min":1.405,"15min":1.405},"last":4.6349999999999998},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.70199999999999996,"15min":0.59599999999999997},"min":{"1min":0.45200000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":5.4880000000000004,"5min":5.4880000000000004,"15min":5.4880000000000004},"last":1.4850000000000001}]},{"osd":2,"last update":"Thu Oct 19 12:43:19 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.71799999999999997,"15min":0.64000000000000001},"min":{"1min":0.439,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":5.54,"5min":5.54,"15min":5.54},"last":2.1139999999999999},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.67600000000000005,"15min":0.58999999999999997},"min":{"1min":0.45400000000000001,"5min":0.379,"15min":0.379},"max":{"1min":1.075,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":5.1500000000000004}]},{"osd":3,"last update":"Thu Oct 19 12:43:22 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.502,"15min":0.5},"min":{"1min":0.40100000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.69499999999999995,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":4.7430000000000003},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.64100000000000001,"15min":0.63900000000000001},"min":{"1min":0.52900000000000003,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.85799999999999998,"5min":1.145,"15min":1.145},"last":5.0279999999999996}]},{"osd":4,"last update":"Thu Oct 19 12:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.70599999999999996,"15min":0.64900000000000002},"min":{"1min":0.50600000000000001,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":2.7269999999999999,"5min":2.7269999999999999,"15min":2.7269999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.68500000000000005,"15min":0.64300000000000002},"min":{"1min":0.46800000000000003,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":2.2069999999999999,"5min":2.2069999999999999,"15min":2.2069999999999999},"last":4.7629999999999999}]},{"osd":5,"last update":"Thu Oct 19 12:43:22 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.73399999999999999,"15min":0.68200000000000005},"min":{"1min":0.46999999999999997,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.091,"5min":2.8300000000000001,"15min":2.8300000000000001},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.73099999999999998,"15min":0.70099999999999996},"min":{"1min":0.52300000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.97899999999999998,"5min":2.145,"15min":2.145},"last":2.0680000000000001}]},{"osd":6,"last update":"Thu Oct 19 12:42:47 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.71099999999999997,"15min":0.67400000000000004},"min":{"1min":0.434,"5min":0.375,"15min":0.375},"max":{"1min":2.2930000000000001,"5min":2.2930000000000001,"15min":2.2930000000000001},"last":4.9340000000000002},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.70699999999999996,"15min":0.66600000000000004},"min":{"1min":0.51000000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.081,"5min":1.6160000000000001,"15min":1.6160000000000001},"last":4.7830000000000004}]},{"osd":7,"last update":"Thu Oct 19 12:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.83699999999999997,"15min":0.81299999999999994},"min":{"1min":0.57299999999999995,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":4.6929999999999996,"5min":4.6929999999999996,"15min":4.6929999999999996},"last":4.6929999999999996},{"interface":"front","average":{"1min":0.80000000000000004,"5min":1.075,"15min":1.121},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.2729999999999999,"5min":5.524,"15min":5.524},"last":0.52600000000000002}]},{"osd":8,"last update":"Thu Oct 19 12:42:29 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.89900000000000002,"15min":0.83099999999999996},"min":{"1min":0.61299999999999999,"5min":0.503,"15min":0.503},"max":{"1min":2.7949999999999999,"5min":6.8730000000000002,"15min":6.8730000000000002},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.84599999999999997,"15min":0.83499999999999996},"min":{"1min":0.60099999999999998,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":2.1760000000000002,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":4.835}]},{"osd":9,"last update":"Thu Oct 19 12:42:56 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.80500000000000005,"15min":0.76900000000000002},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":2.6309999999999998,"5min":2.6309999999999998,"15min":2.6309999999999998},"last":4.9109999999999996},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.876,"15min":0.85799999999999998},"min":{"1min":0.46899999999999997,"5min":0.442,"15min":0.442},"max":{"1min":2.9359999999999999,"5min":2.9359999999999999,"15min":2.9359999999999999},"last":4.6680000000000001}]},{"osd":10,"last update":"Thu Oct 19 12:43:19 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.024,"15min":0.99199999999999999},"min":{"1min":0.70099999999999996,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":5.5540000000000003,"5min":5.5540000000000003,"15min":5.5540000000000003},"last":1.5429999999999999},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.95199999999999996,"15min":0.96599999999999997},"min":{"1min":0.69699999999999995,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.292,"5min":2.2639999999999998,"15min":2.2639999999999998},"last":4.8879999999999999}]},{"osd":11,"last update":"Thu Oct 19 12:42:36 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.84599999999999997,"15min":0.84299999999999997},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.1160000000000001,"5min":1.22,"15min":1.22},"last":4.9889999999999999},{"interface":"front","average":{"1min":1.036,"5min":0.95199999999999996,"15min":0.93799999999999994},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":2.907,"5min":2.907,"15min":2.907},"last":0.59399999999999997}]}]},{"osd":2,"up_from":18,"seq":77309411408,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28084,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717068,"statfs":{"total":95995035648,"available":95966277632,"internally_reserved":0,"allocated":1093632,"data_stored":551747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 19 12:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.57099999999999995,"15min":0.56799999999999995},"min":{"1min":0.439,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.68999999999999995,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.624,"15min":0.57999999999999996},"min":{"1min":0.36799999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.3520000000000001,"5min":6.726,"15min":6.726},"last":0.58399999999999996}]},{"osd":1,"last update":"Thu Oct 19 12:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.60899999999999999,"15min":0.56499999999999995},"min":{"1min":0.32400000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.85599999999999998,"5min":1.081,"15min":1.081},"last":1.042},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.61899999999999999,"15min":0.57299999999999995},"min":{"1min":0.38400000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.99199999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.88}]},{"osd":3,"last update":"Thu Oct 19 12:42:39 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.60799999999999998,"15min":0.58999999999999997},"min":{"1min":0.48799999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.90300000000000002,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.58199999999999996,"15min":0.59899999999999998},"min":{"1min":0.39600000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.76000000000000001,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.54400000000000004}]},{"osd":4,"last update":"Thu Oct 19 12:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.71599999999999997,"15min":0.72199999999999998},"min":{"1min":0.51200000000000001,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.70399999999999996,"15min":0.71899999999999997},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.76300000000000001,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.68100000000000005}]},{"osd":5,"last update":"Thu Oct 19 12:42:27 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.47999999999999998,"15min":0.44900000000000001},"min":{"1min":0.29999999999999999,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.72699999999999998,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.50800000000000001,"15min":0.47299999999999998},"min":{"1min":0.35499999999999998,"5min":0.25,"15min":0.25},"max":{"1min":0.92900000000000005,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.89700000000000002}]},{"osd":6,"last update":"Thu Oct 19 12:42:47 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.67600000000000005,"15min":0.64600000000000002},"min":{"1min":0.55600000000000005,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.91000000000000003,"5min":1.042,"15min":1.042},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67200000000000004,"15min":0.66200000000000003},"min":{"1min":0.44600000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.88100000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.755}]},{"osd":7,"last update":"Thu Oct 19 12:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.79900000000000004,"15min":0.80700000000000005},"min":{"1min":0.59399999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":0.97399999999999998,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.97399999999999998},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.81299999999999994,"15min":0.81899999999999995},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":0.996,"5min":1.016,"15min":1.016},"last":0.996}]},{"osd":8,"last update":"Thu Oct 19 12:42:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.65600000000000003,"15min":0.66000000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.94699999999999995,"5min":1.429,"15min":1.429},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.67900000000000005,"15min":0.67000000000000004},"min":{"1min":0.45000000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.002,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.73099999999999998}]},{"osd":9,"last update":"Thu Oct 19 12:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.77700000000000002,"15min":0.747},"min":{"1min":0.54600000000000004,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.077,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.748,"15min":0.72299999999999998},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.81499999999999995}]},{"osd":10,"last update":"Thu Oct 19 12:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.73599999999999999,"15min":0.71299999999999997},"min":{"1min":0.498,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.88900000000000001,"5min":0.997,"15min":0.997},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.78600000000000003,"15min":0.74399999999999999},"min":{"1min":0.63600000000000001,"5min":0.504,"15min":0.504},"max":{"1min":1.0509999999999999,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":1.0149999999999999}]},{"osd":11,"last update":"Thu Oct 19 12:43:19 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.84499999999999997,"15min":0.85299999999999998},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.02,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.89200000000000002,"15min":0.90000000000000002},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.018,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.93500000000000005}]}]},{"osd":3,"up_from":25,"seq":107374182475,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28040,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717112,"statfs":{"total":95995035648,"available":95966322688,"internally_reserved":0,"allocated":1044480,"data_stored":499164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 19 12:42:39 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.46400000000000002,"15min":0.438},"min":{"1min":0.36099999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.86899999999999999,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.47699999999999998,"15min":0.42099999999999999},"min":{"1min":0.318,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.0029999999999999,"5min":1.044,"15min":1.044},"last":0.39700000000000002}]},{"osd":1,"last update":"Thu Oct 19 12:42:39 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.68799999999999994,"15min":0.621},"min":{"1min":0.50700000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.032,"5min":1.077,"15min":1.077},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.622,"5min":0.627,"15min":0.57299999999999995},"min":{"1min":0.47199999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.81799999999999995,"5min":1.228,"15min":1.228},"last":0.79800000000000004}]},{"osd":2,"last update":"Thu Oct 19 12:42:39 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.66300000000000003,"15min":0.61499999999999999},"min":{"1min":0.58299999999999996,"5min":0.377,"15min":0.377},"max":{"1min":0.85199999999999998,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.71199999999999997,"15min":0.622},"min":{"1min":0.59099999999999997,"5min":0.374,"15min":0.374},"max":{"1min":1.0329999999999999,"5min":1.056,"15min":1.056},"last":0.505}]},{"osd":4,"last update":"Thu Oct 19 12:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72599999999999998,"15min":0.66000000000000003},"min":{"1min":0.46500000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.99199999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.75600000000000001,"15min":0.66600000000000004},"min":{"1min":0.55900000000000005,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0609999999999999,"5min":1.228,"15min":1.228},"last":0.85599999999999998}]},{"osd":5,"last update":"Thu Oct 19 12:42:27 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.79800000000000004,"15min":0.746},"min":{"1min":0.63,"5min":0.501,"15min":0.501},"max":{"1min":1.0680000000000001,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.752,"5min":0.72599999999999998,"15min":0.69499999999999995},"min":{"1min":0.59999999999999998,"5min":0.443,"15min":0.443},"max":{"1min":0.96999999999999997,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.59999999999999998}]},{"osd":6,"last update":"Thu Oct 19 12:42:46 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.66100000000000003,"15min":0.629},"min":{"1min":0.44500000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.76500000000000001,"15min":0.71299999999999997},"min":{"1min":0.53700000000000003,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.1759999999999999,"5min":1.45,"15min":1.45},"last":0.58099999999999996}]},{"osd":7,"last update":"Thu Oct 19 12:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71499999999999997,"15min":0.69899999999999995},"min":{"1min":0.47299999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.85499999999999998,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.77900000000000003,"15min":0.74099999999999999},"min":{"1min":0.59799999999999998,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.77800000000000002}]},{"osd":8,"last update":"Thu Oct 19 12:40:26 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.97599999999999998},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.998}]},{"osd":9,"last update":"Thu Oct 19 12:42:56 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.91100000000000003,"15min":0.90900000000000003},"min":{"1min":0.47199999999999998,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.0900000000000001,"5min":1.478,"15min":1.478},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.78100000000000003,"15min":0.79700000000000004},"min":{"1min":0.497,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":0.69799999999999995}]},{"osd":10,"last update":"Thu Oct 19 12:43:20 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.85699999999999998,"15min":0.89500000000000002},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.93600000000000005,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.88900000000000001,"15min":0.92500000000000004},"min":{"1min":0.64300000000000002,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.0620000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.67900000000000005}]},{"osd":11,"last update":"Thu Oct 19 12:43:20 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.91200000000000003,"15min":0.91400000000000003},"min":{"1min":0.76300000000000001,"5min":0.752,"15min":0.752},"max":{"1min":1.1160000000000001,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.81000000000000005,"15min":0.81399999999999995},"min":{"1min":0.60799999999999998,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.97599999999999998,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.755}]}]},{"osd":4,"up_from":33,"seq":141733920838,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28052,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717100,"statfs":{"total":95995035648,"available":95966310400,"internally_reserved":0,"allocated":1056768,"data_stored":513768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 19 12:40:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.51900000000000002,"15min":0.50700000000000001},"min":{"1min":0.38500000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.44},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.54900000000000004,"15min":0.52900000000000003},"min":{"1min":0.47999999999999998,"5min":0.37,"15min":0.37},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":2.1539999999999999}]},{"osd":1,"last update":"Thu Oct 19 12:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.42799999999999999,"15min":0.39400000000000002},"min":{"1min":0.35299999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.51600000000000001,"5min":2.3559999999999999,"15min":2.3559999999999999},"last":0.437},{"interface":"front","average":{"1min":0.441,"5min":0.44600000000000001,"15min":0.40799999999999997},"min":{"1min":0.34799999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.61399999999999999,"5min":3.129,"15min":3.129},"last":0.47999999999999998}]},{"osd":2,"last update":"Thu Oct 19 12:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.64200000000000002,"15min":0.56799999999999995},"min":{"1min":0.34200000000000003,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.747,"5min":7.6470000000000002,"15min":7.6470000000000002},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.622,"15min":0.57199999999999995},"min":{"1min":0.45000000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.82899999999999996,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.79100000000000004}]},{"osd":3,"last update":"Thu Oct 19 12:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.63400000000000001,"15min":0.58499999999999996},"min":{"1min":0.50600000000000001,"5min":0.376,"15min":0.376},"max":{"1min":1.2669999999999999,"5min":3.1019999999999999,"15min":3.1019999999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.66400000000000003,"15min":0.61299999999999999},"min":{"1min":0.42199999999999999,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.0109999999999999,"5min":7.444,"15min":7.444},"last":0.64900000000000002}]},{"osd":5,"last update":"Thu Oct 19 12:43:22 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.66800000000000004,"15min":0.628},"min":{"1min":0.41999999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.85399999999999998,"5min":1.732,"15min":1.732},"last":0.746},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.70999999999999996,"15min":0.628},"min":{"1min":0.51000000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.79600000000000004,"5min":6.8390000000000004,"15min":6.8390000000000004},"last":0.80600000000000005}]},{"osd":6,"last update":"Thu Oct 19 12:42:48 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.73299999999999998,"15min":0.66100000000000003},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":3.8050000000000002,"5min":6.5309999999999997,"15min":6.5309999999999997},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.71599999999999997,"15min":0.67200000000000004},"min":{"1min":0.56299999999999994,"5min":0.443,"15min":0.443},"max":{"1min":1.3560000000000001,"5min":2.2250000000000001,"15min":2.2250000000000001},"last":0.60399999999999998}]},{"osd":7,"last update":"Thu Oct 19 12:43:10 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.60999999999999999,"15min":0.58099999999999996},"min":{"1min":0.47999999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.82399999999999995,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.625,"5min":0.60199999999999998,"15min":0.56100000000000005},"min":{"1min":0.434,"5min":0.376,"15min":0.376},"max":{"1min":0.97099999999999997,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.69999999999999996}]},{"osd":8,"last update":"Thu Oct 19 12:43:29 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.76000000000000001,"15min":0.70699999999999996},"min":{"1min":0.56100000000000005,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.0069999999999999,"5min":2.2719999999999998,"15min":2.2719999999999998},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.74299999999999999,"15min":0.69399999999999995},"min":{"1min":0.622,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.84799999999999998,"5min":2.504,"15min":2.504},"last":0.76900000000000002}]},{"osd":9,"last update":"Thu Oct 19 12:42:59 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.77900000000000003,"15min":0.747},"min":{"1min":0.53800000000000003,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.28,"5min":4.5800000000000001,"15min":4.5800000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.871,"15min":0.82699999999999996},"min":{"1min":0.65500000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.319,"5min":3.8300000000000001,"15min":3.8300000000000001},"last":0.86599999999999999}]},{"osd":10,"last update":"Thu Oct 19 12:43:15 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80100000000000005},"min":{"1min":0.61799999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.91200000000000003,"5min":1.538,"15min":1.538},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.749,"5min":0.81399999999999995,"15min":0.77500000000000002},"min":{"1min":0.58299999999999996,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0309999999999999,"5min":6.8780000000000001,"15min":6.8780000000000001},"last":0.84899999999999998}]},{"osd":11,"last update":"Thu Oct 19 12:43:21 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.91400000000000003,"15min":0.93300000000000005},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":0.93100000000000005,"5min":3.0350000000000001,"15min":3.0350000000000001},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.73399999999999999,"5min":1.0149999999999999,"15min":1.0620000000000001},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.05,"5min":7.3010000000000002,"15min":7.3010000000000002},"last":0.82199999999999995}]}]},{"osd":5,"up_from":38,"seq":163208757313,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28620,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716532,"statfs":{"total":95995035648,"available":95965728768,"internally_reserved":0,"allocated":1642496,"data_stored":1086144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 19 12:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.53900000000000003,"15min":0.52700000000000002},"min":{"1min":0.34799999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.54500000000000004,"15min":0.53700000000000003},"min":{"1min":0.35499999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.79000000000000004,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.55700000000000005}]},{"osd":1,"last update":"Thu Oct 19 12:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.57499999999999996,"15min":0.53700000000000003},"min":{"1min":0.379,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.74299999999999999,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.58299999999999996,"15min":0.55200000000000005},"min":{"1min":0.34799999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.81399999999999995,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.59699999999999998}]},{"osd":2,"last update":"Thu Oct 19 12:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.436,"15min":0.39700000000000002},"min":{"1min":0.27400000000000002,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.46600000000000003,"15min":0.438},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.73599999999999999,"5min":1.095,"15min":1.095},"last":0.51900000000000002}]},{"osd":3,"last update":"Thu Oct 19 12:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.59399999999999997,"15min":0.57999999999999996},"min":{"1min":0.41199999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.872,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.63200000000000001,"15min":0.61799999999999999},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.90000000000000002,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.70899999999999996}]},{"osd":4,"last update":"Thu Oct 19 12:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.63200000000000001,"15min":0.58599999999999997},"min":{"1min":0.51800000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.874,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.61199999999999999,"15min":0.57799999999999996},"min":{"1min":0.39500000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.82999999999999996,"5min":0.997,"15min":0.997},"last":0.79800000000000004}]},{"osd":6,"last update":"Thu Oct 19 12:42:48 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.67500000000000004,"15min":0.67700000000000005},"min":{"1min":0.47699999999999998,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.94299999999999995,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.72899999999999998}]},{"osd":7,"last update":"Thu Oct 19 12:43:13 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.67500000000000004,"15min":0.66900000000000004},"min":{"1min":0.47399999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.89000000000000001,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.749},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.69299999999999995,"15min":0.67000000000000004},"min":{"1min":0.46600000000000003,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.90300000000000002,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.83199999999999996}]},{"osd":8,"last update":"Thu Oct 19 12:42:28 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.63400000000000001,"15min":0.626},"min":{"1min":0.44900000000000001,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.89400000000000002,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.68700000000000006,"15min":0.68100000000000005},"min":{"1min":0.436,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.0129999999999999,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.81599999999999995}]},{"osd":9,"last update":"Thu Oct 19 12:42:53 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.79600000000000004,"15min":0.77300000000000002},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":3.9049999999999998,"5min":3.9049999999999998,"15min":3.9049999999999998},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.755,"5min":0.75700000000000001,"15min":0.76200000000000001},"min":{"1min":0.54700000000000004,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.93899999999999995,"5min":1.115,"15min":1.115},"last":0.84799999999999998}]},{"osd":10,"last update":"Thu Oct 19 12:43:18 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.77100000000000002,"15min":0.747},"min":{"1min":0.63500000000000001,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.96899999999999997,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.747,"15min":0.72499999999999998},"min":{"1min":0.53700000000000003,"5min":0.438,"15min":0.438},"max":{"1min":0.97599999999999998,"5min":1.145,"15min":1.145},"last":0.91300000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":63380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":62887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":62426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-19T12:43:32.050 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-19T12:43:32.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:31 smithi157 ceph-mon[134109]: pgmap v354: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 255 B/s wr, 7 op/s 2023-10-19T12:43:32.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:31 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/655324033' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-19T12:43:32.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:31 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/2516366941' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-19T12:43:32.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:31 smithi195 ceph-mon[134493]: pgmap v354: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 255 B/s wr, 7 op/s 2023-10-19T12:43:32.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:31 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/655324033' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-19T12:43:32.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:31 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/2516366941' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-19T12:43:32.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.283+0000 7f75c03ff700 1 -- 172.21.15.46:0/1633588689 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f75b8073250 msgr2=0x7f75b80736d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:32.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.283+0000 7f75c03ff700 1 --2- 172.21.15.46:0/1633588689 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f75b8073250 0x7f75b80736d0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f75a8009990 tx=0x7f75a8009ca0 comp rx=0 tx=0).stop 2023-10-19T12:43:32.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.283+0000 7f75c03ff700 1 -- 172.21.15.46:0/1633588689 shutdown_connections 2023-10-19T12:43:32.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.283+0000 7f75c03ff700 1 --2- 172.21.15.46:0/1633588689 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f75b8108600 0x7f75b810aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:32.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.283+0000 7f75c03ff700 1 --2- 172.21.15.46:0/1633588689 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f75b8074830 0x7f75b8072c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:32.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.283+0000 7f75c03ff700 1 --2- 172.21.15.46:0/1633588689 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f75b8073250 0x7f75b80736d0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:32.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.283+0000 7f75c03ff700 1 -- 172.21.15.46:0/1633588689 >> 172.21.15.46:0/1633588689 conn(0x7f75b80fbc90 msgr2=0x7f75b80fe0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:32.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.283+0000 7f75c03ff700 1 -- 172.21.15.46:0/1633588689 shutdown_connections 2023-10-19T12:43:32.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.283+0000 7f75c03ff700 1 -- 172.21.15.46:0/1633588689 wait complete. 2023-10-19T12:43:32.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.284+0000 7f75c03ff700 1 Processor -- start 2023-10-19T12:43:32.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.284+0000 7f75c03ff700 1 -- start start 2023-10-19T12:43:32.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.285+0000 7f75c03ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f75b8073250 0x7f75b8198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:32.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.285+0000 7f75c03ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f75b8074830 0x7f75b8198ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:32.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.285+0000 7f75c03ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f75b8108600 0x7f75b819fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:32.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.285+0000 7f75c03ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75b81a0460 con 0x7f75b8074830 2023-10-19T12:43:32.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.285+0000 7f75c03ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75b81a05a0 con 0x7f75b8108600 2023-10-19T12:43:32.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.285+0000 7f75c03ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75b81a0730 con 0x7f75b8073250 2023-10-19T12:43:32.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.285+0000 7f75bd99a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f75b8074830 0x7f75b8198ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:32.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.285+0000 7f75bd99a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f75b8074830 0x7f75b8198ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60824/0 (socket says 172.21.15.46:60824) 2023-10-19T12:43:32.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.285+0000 7f75bd99a700 1 -- 172.21.15.46:0/3047689401 learned_addr learned my addr 172.21.15.46:0/3047689401 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:43:32.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.285+0000 7f75be19b700 1 --2- 172.21.15.46:0/3047689401 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f75b8073250 0x7f75b8198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:32.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.285+0000 7f75be99c700 1 --2- 172.21.15.46:0/3047689401 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f75b8108600 0x7f75b819fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:32.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.285+0000 7f75bd99a700 1 -- 172.21.15.46:0/3047689401 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f75b8073250 msgr2=0x7f75b8198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:32.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.285+0000 7f75bd99a700 1 --2- 172.21.15.46:0/3047689401 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f75b8073250 0x7f75b8198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:32.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.285+0000 7f75bd99a700 1 -- 172.21.15.46:0/3047689401 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f75b8108600 msgr2=0x7f75b819fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:32.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.285+0000 7f75bd99a700 1 --2- 172.21.15.46:0/3047689401 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f75b8108600 0x7f75b819fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:32.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.285+0000 7f75bd99a700 1 -- 172.21.15.46:0/3047689401 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a80095f0 con 0x7f75b8074830 2023-10-19T12:43:32.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.285+0000 7f75be99c700 1 --2- 172.21.15.46:0/3047689401 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f75b8108600 0x7f75b819fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T12:43:32.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.286+0000 7f75bd99a700 1 --2- 172.21.15.46:0/3047689401 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f75b8074830 0x7f75b8198ec0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f75a800b680 tx=0x7f75a8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:32.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.286+0000 7f75af7fe700 1 -- 172.21.15.46:0/3047689401 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a801d070 con 0x7f75b8074830 2023-10-19T12:43:32.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.286+0000 7f75af7fe700 1 -- 172.21.15.46:0/3047689401 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f75a8021410 con 0x7f75b8074830 2023-10-19T12:43:32.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.286+0000 7f75c03ff700 1 -- 172.21.15.46:0/3047689401 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75b81a09b0 con 0x7f75b8074830 2023-10-19T12:43:32.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.286+0000 7f75af7fe700 1 -- 172.21.15.46:0/3047689401 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a8017650 con 0x7f75b8074830 2023-10-19T12:43:32.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.286+0000 7f75c03ff700 1 -- 172.21.15.46:0/3047689401 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75b81a0e30 con 0x7f75b8074830 2023-10-19T12:43:32.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.287+0000 7f75c03ff700 1 -- 172.21.15.46:0/3047689401 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75b81073c0 con 0x7f75b8074830 2023-10-19T12:43:32.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.289+0000 7f75af7fe700 1 -- 172.21.15.46:0/3047689401 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f75a8021580 con 0x7f75b8074830 2023-10-19T12:43:32.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.290+0000 7f75af7fe700 1 --2- 172.21.15.46:0/3047689401 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f75a40a1500 0x7f75a40a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:32.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.291+0000 7f75af7fe700 1 -- 172.21.15.46:0/3047689401 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f75a80ce4d0 con 0x7f75b8074830 2023-10-19T12:43:32.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.291+0000 7f75be19b700 1 --2- 172.21.15.46:0/3047689401 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f75a40a1500 0x7f75a40a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:32.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.291+0000 7f75be19b700 1 --2- 172.21.15.46:0/3047689401 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f75a40a1500 0x7f75a40a39c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f75b4009c60 tx=0x7f75b4009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:32.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.294+0000 7f75af7fe700 1 -- 172.21.15.46:0/3047689401 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f75a8097790 con 0x7f75b8074830 2023-10-19T12:43:32.506 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.503+0000 7f75c03ff700 1 -- 172.21.15.46:0/3047689401 --> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f75b8060c30 con 0x7f75a40a1500 2023-10-19T12:43:32.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.516+0000 7f75af7fe700 1 -- 172.21.15.46:0/3047689401 <== mgr.14150 v2:172.21.15.46:6800/3168073651 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+426729 (secure 0 0 0) 0x7f75b8060c30 con 0x7f75a40a1500 2023-10-19T12:43:32.525 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:43:32.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.522+0000 7f75c03ff700 1 -- 172.21.15.46:0/3047689401 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f75a40a1500 msgr2=0x7f75a40a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:32.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.522+0000 7f75c03ff700 1 --2- 172.21.15.46:0/3047689401 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f75a40a1500 0x7f75a40a39c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f75b4009c60 tx=0x7f75b4009260 comp rx=0 tx=0).stop 2023-10-19T12:43:32.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.522+0000 7f75c03ff700 1 -- 172.21.15.46:0/3047689401 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f75b8074830 msgr2=0x7f75b8198ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:32.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.522+0000 7f75c03ff700 1 --2- 172.21.15.46:0/3047689401 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f75b8074830 0x7f75b8198ec0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f75a800b680 tx=0x7f75a8004730 comp rx=0 tx=0).stop 2023-10-19T12:43:32.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.522+0000 7f75c03ff700 1 -- 172.21.15.46:0/3047689401 shutdown_connections 2023-10-19T12:43:32.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.522+0000 7f75c03ff700 1 --2- 172.21.15.46:0/3047689401 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f75b8108600 0x7f75b819fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:32.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.522+0000 7f75c03ff700 1 --2- 172.21.15.46:0/3047689401 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f75a40a1500 0x7f75a40a39c0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:32.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.522+0000 7f75c03ff700 1 --2- 172.21.15.46:0/3047689401 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f75b8073250 0x7f75b8198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:32.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.522+0000 7f75c03ff700 1 --2- 172.21.15.46:0/3047689401 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f75b8074830 0x7f75b8198ec0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:32.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.522+0000 7f75c03ff700 1 -- 172.21.15.46:0/3047689401 >> 172.21.15.46:0/3047689401 conn(0x7f75b80fbc90 msgr2=0x7f75b8104500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:32.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.522+0000 7f75c03ff700 1 -- 172.21.15.46:0/3047689401 shutdown_connections 2023-10-19T12:43:32.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.523+0000 7f75c03ff700 1 -- 172.21.15.46:0/3047689401 wait complete. 2023-10-19T12:43:32.531 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-10-19T12:43:32.545 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":354,"stamp":"2023-10-19T12:43:30.672366+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658573,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1157,"num_read_kb":699,"num_write":431,"num_write_kb":3084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":1181940,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":855,"ondisk_log_size":855,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":422,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":338380,"kb_used_data":14160,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124603444,"statfs":{"total":1151940427776,"available":1151593926656,"internally_reserved":0,"allocated":14499840,"data_stored":7953190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19130,"internal_metadata":331855174},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":316,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":31,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001986"},"pg_stats":[{"pgid":"3.3f","version":"90'8","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:56.693361+0000","last_change":"2023-10-19T12:41:19.300761+0000","last_active":"2023-10-19T12:42:56.693361+0000","last_peered":"2023-10-19T12:42:56.693361+0000","last_clean":"2023-10-19T12:42:56.693361+0000","last_became_active":"2023-10-19T12:41:19.300431+0000","last_became_peered":"2023-10-19T12:41:19.300431+0000","last_unstale":"2023-10-19T12:42:56.693361+0000","last_undegraded":"2023-10-19T12:42:56.693361+0000","last_fullsized":"2023-10-19T12:42:56.693361+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-21T00:36:29.735726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"90'4","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.769387+0000","last_change":"2023-10-19T12:41:19.300748+0000","last_active":"2023-10-19T12:43:27.769387+0000","last_peered":"2023-10-19T12:43:27.769387+0000","last_clean":"2023-10-19T12:43:27.769387+0000","last_became_active":"2023-10-19T12:41:19.294769+0000","last_became_peered":"2023-10-19T12:41:19.294769+0000","last_unstale":"2023-10-19T12:43:27.769387+0000","last_undegraded":"2023-10-19T12:43:27.769387+0000","last_fullsized":"2023-10-19T12:43:27.769387+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T23:04:58.055573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"90'7","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.769281+0000","last_change":"2023-10-19T12:41:19.294264+0000","last_active":"2023-10-19T12:43:27.769281+0000","last_peered":"2023-10-19T12:43:27.769281+0000","last_clean":"2023-10-19T12:43:27.769281+0000","last_became_active":"2023-10-19T12:41:19.293878+0000","last_became_peered":"2023-10-19T12:41:19.293878+0000","last_unstale":"2023-10-19T12:43:27.769281+0000","last_undegraded":"2023-10-19T12:43:27.769281+0000","last_fullsized":"2023-10-19T12:43:27.769281+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:11:01.049036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"90'8","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.758729+0000","last_change":"2023-10-19T12:42:28.129235+0000","last_active":"2023-10-19T12:43:27.758729+0000","last_peered":"2023-10-19T12:43:27.758729+0000","last_clean":"2023-10-19T12:43:27.758729+0000","last_became_active":"2023-10-19T12:42:28.128818+0000","last_became_peered":"2023-10-19T12:42:28.128818+0000","last_unstale":"2023-10-19T12:43:27.758729+0000","last_undegraded":"2023-10-19T12:43:27.758729+0000","last_fullsized":"2023-10-19T12:43:27.758729+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:16:26.558697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"90'4","reported_seq":23,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.762818+0000","last_change":"2023-10-19T12:41:19.301164+0000","last_active":"2023-10-19T12:43:27.762818+0000","last_peered":"2023-10-19T12:43:27.762818+0000","last_clean":"2023-10-19T12:43:27.762818+0000","last_became_active":"2023-10-19T12:41:19.300920+0000","last_became_peered":"2023-10-19T12:41:19.300920+0000","last_unstale":"2023-10-19T12:43:27.762818+0000","last_undegraded":"2023-10-19T12:43:27.762818+0000","last_fullsized":"2023-10-19T12:43:27.762818+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:15:40.211319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"90'6","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:56.663084+0000","last_change":"2023-10-19T12:41:19.292866+0000","last_active":"2023-10-19T12:42:56.663084+0000","last_peered":"2023-10-19T12:42:56.663084+0000","last_clean":"2023-10-19T12:42:56.663084+0000","last_became_active":"2023-10-19T12:41:19.292392+0000","last_became_peered":"2023-10-19T12:41:19.292392+0000","last_unstale":"2023-10-19T12:42:56.663084+0000","last_undegraded":"2023-10-19T12:42:56.663084+0000","last_fullsized":"2023-10-19T12:42:56.663084+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:37:34.373704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"90'5","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:56.681290+0000","last_change":"2023-10-19T12:42:28.127944+0000","last_active":"2023-10-19T12:42:56.681290+0000","last_peered":"2023-10-19T12:42:56.681290+0000","last_clean":"2023-10-19T12:42:56.681290+0000","last_became_active":"2023-10-19T12:42:28.127619+0000","last_became_peered":"2023-10-19T12:42:28.127619+0000","last_unstale":"2023-10-19T12:42:56.681290+0000","last_undegraded":"2023-10-19T12:42:56.681290+0000","last_fullsized":"2023-10-19T12:42:56.681290+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:01:27.131472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,8],"acting":[7,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"90'9","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:56.694775+0000","last_change":"2023-10-19T12:41:19.290501+0000","last_active":"2023-10-19T12:42:56.694775+0000","last_peered":"2023-10-19T12:42:56.694775+0000","last_clean":"2023-10-19T12:42:56.694775+0000","last_became_active":"2023-10-19T12:41:19.290080+0000","last_became_peered":"2023-10-19T12:41:19.290080+0000","last_unstale":"2023-10-19T12:42:56.694775+0000","last_undegraded":"2023-10-19T12:42:56.694775+0000","last_fullsized":"2023-10-19T12:42:56.694775+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:40:19.827896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"90'11","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:56.679528+0000","last_change":"2023-10-19T12:41:19.304631+0000","last_active":"2023-10-19T12:42:56.679528+0000","last_peered":"2023-10-19T12:42:56.679528+0000","last_clean":"2023-10-19T12:42:56.679528+0000","last_became_active":"2023-10-19T12:41:19.301990+0000","last_became_peered":"2023-10-19T12:41:19.301990+0000","last_unstale":"2023-10-19T12:42:56.679528+0000","last_undegraded":"2023-10-19T12:42:56.679528+0000","last_fullsized":"2023-10-19T12:42:56.679528+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:50:46.128888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"90'16","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:56.672240+0000","last_change":"2023-10-19T12:41:19.294366+0000","last_active":"2023-10-19T12:42:56.672240+0000","last_peered":"2023-10-19T12:42:56.672240+0000","last_clean":"2023-10-19T12:42:56.672240+0000","last_became_active":"2023-10-19T12:41:19.292644+0000","last_became_peered":"2023-10-19T12:41:19.292644+0000","last_unstale":"2023-10-19T12:42:56.672240+0000","last_undegraded":"2023-10-19T12:42:56.672240+0000","last_fullsized":"2023-10-19T12:42:56.672240+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:59:30.111950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"90'6","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:56.684890+0000","last_change":"2023-10-19T12:41:19.290054+0000","last_active":"2023-10-19T12:42:56.684890+0000","last_peered":"2023-10-19T12:42:56.684890+0000","last_clean":"2023-10-19T12:42:56.684890+0000","last_became_active":"2023-10-19T12:41:19.289739+0000","last_became_peered":"2023-10-19T12:41:19.289739+0000","last_unstale":"2023-10-19T12:42:56.684890+0000","last_undegraded":"2023-10-19T12:42:56.684890+0000","last_fullsized":"2023-10-19T12:42:56.684890+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:30:36.398762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"90'7","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.763700+0000","last_change":"2023-10-19T12:41:19.295309+0000","last_active":"2023-10-19T12:43:27.763700+0000","last_peered":"2023-10-19T12:43:27.763700+0000","last_clean":"2023-10-19T12:43:27.763700+0000","last_became_active":"2023-10-19T12:41:19.295009+0000","last_became_peered":"2023-10-19T12:41:19.295009+0000","last_unstale":"2023-10-19T12:43:27.763700+0000","last_undegraded":"2023-10-19T12:43:27.763700+0000","last_fullsized":"2023-10-19T12:43:27.763700+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:27:33.798071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"90'10","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:56.677115+0000","last_change":"2023-10-19T12:41:19.302920+0000","last_active":"2023-10-19T12:42:56.677115+0000","last_peered":"2023-10-19T12:42:56.677115+0000","last_clean":"2023-10-19T12:42:56.677115+0000","last_became_active":"2023-10-19T12:41:19.300250+0000","last_became_peered":"2023-10-19T12:41:19.300250+0000","last_unstale":"2023-10-19T12:42:56.677115+0000","last_undegraded":"2023-10-19T12:42:56.677115+0000","last_fullsized":"2023-10-19T12:42:56.677115+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:51:47.487907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"90'7","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.765252+0000","last_change":"2023-10-19T12:41:19.300654+0000","last_active":"2023-10-19T12:43:27.765252+0000","last_peered":"2023-10-19T12:43:27.765252+0000","last_clean":"2023-10-19T12:43:27.765252+0000","last_became_active":"2023-10-19T12:41:19.295408+0000","last_became_peered":"2023-10-19T12:41:19.295408+0000","last_unstale":"2023-10-19T12:43:27.765252+0000","last_undegraded":"2023-10-19T12:43:27.765252+0000","last_fullsized":"2023-10-19T12:43:27.765252+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:53:47.039077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"90'7","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.765000+0000","last_change":"2023-10-19T12:41:19.293141+0000","last_active":"2023-10-19T12:43:27.765000+0000","last_peered":"2023-10-19T12:43:27.765000+0000","last_clean":"2023-10-19T12:43:27.765000+0000","last_became_active":"2023-10-19T12:41:19.290790+0000","last_became_peered":"2023-10-19T12:41:19.290790+0000","last_unstale":"2023-10-19T12:43:27.765000+0000","last_undegraded":"2023-10-19T12:43:27.765000+0000","last_fullsized":"2023-10-19T12:43:27.765000+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:23:44.757080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"90'9","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:56.682686+0000","last_change":"2023-10-19T12:41:19.299670+0000","last_active":"2023-10-19T12:42:56.682686+0000","last_peered":"2023-10-19T12:42:56.682686+0000","last_clean":"2023-10-19T12:42:56.682686+0000","last_became_active":"2023-10-19T12:41:19.299375+0000","last_became_peered":"2023-10-19T12:41:19.299375+0000","last_unstale":"2023-10-19T12:42:56.682686+0000","last_undegraded":"2023-10-19T12:42:56.682686+0000","last_fullsized":"2023-10-19T12:42:56.682686+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:30:23.234790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"90'8","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:56.693273+0000","last_change":"2023-10-19T12:41:19.300359+0000","last_active":"2023-10-19T12:42:56.693273+0000","last_peered":"2023-10-19T12:42:56.693273+0000","last_clean":"2023-10-19T12:42:56.693273+0000","last_became_active":"2023-10-19T12:41:19.300032+0000","last_became_peered":"2023-10-19T12:41:19.300032+0000","last_unstale":"2023-10-19T12:42:56.693273+0000","last_undegraded":"2023-10-19T12:42:56.693273+0000","last_fullsized":"2023-10-19T12:42:56.693273+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-21T00:33:24.621723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"90'10","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.759359+0000","last_change":"2023-10-19T12:41:19.288276+0000","last_active":"2023-10-19T12:43:27.759359+0000","last_peered":"2023-10-19T12:43:27.759359+0000","last_clean":"2023-10-19T12:43:27.759359+0000","last_became_active":"2023-10-19T12:41:19.287905+0000","last_became_peered":"2023-10-19T12:41:19.287905+0000","last_unstale":"2023-10-19T12:43:27.759359+0000","last_undegraded":"2023-10-19T12:43:27.759359+0000","last_fullsized":"2023-10-19T12:43:27.759359+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:46:15.640987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"90'7","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:56.677232+0000","last_change":"2023-10-19T12:41:19.300682+0000","last_active":"2023-10-19T12:42:56.677232+0000","last_peered":"2023-10-19T12:42:56.677232+0000","last_clean":"2023-10-19T12:42:56.677232+0000","last_became_active":"2023-10-19T12:41:19.300347+0000","last_became_peered":"2023-10-19T12:41:19.300347+0000","last_unstale":"2023-10-19T12:42:56.677232+0000","last_undegraded":"2023-10-19T12:42:56.677232+0000","last_fullsized":"2023-10-19T12:42:56.677232+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T21:21:31.772556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.116324+0000","last_change":"2023-10-19T12:41:23.337419+0000","last_active":"2023-10-19T12:42:27.116324+0000","last_peered":"2023-10-19T12:42:27.116324+0000","last_clean":"2023-10-19T12:42:27.116324+0000","last_became_active":"2023-10-19T12:41:23.337046+0000","last_became_peered":"2023-10-19T12:41:23.337046+0000","last_unstale":"2023-10-19T12:42:27.116324+0000","last_undegraded":"2023-10-19T12:42:27.116324+0000","last_fullsized":"2023-10-19T12:42:27.116324+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-21T00:20:22.732851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"88'13","reported_seq":137,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:28.456753+0000","last_change":"2023-10-19T12:41:18.282453+0000","last_active":"2023-10-19T12:43:28.456753+0000","last_peered":"2023-10-19T12:43:28.456753+0000","last_clean":"2023-10-19T12:43:28.456753+0000","last_became_active":"2023-10-19T12:41:18.281705+0000","last_became_peered":"2023-10-19T12:41:18.281705+0000","last_unstale":"2023-10-19T12:43:28.456753+0000","last_undegraded":"2023-10-19T12:43:28.456753+0000","last_fullsized":"2023-10-19T12:43:28.456753+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T21:12:33.877631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":103,"num_read_kb":103,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"90'5","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:43:18.559101+0000","last_change":"2023-10-19T12:41:19.292175+0000","last_active":"2023-10-19T12:43:18.559101+0000","last_peered":"2023-10-19T12:43:18.559101+0000","last_clean":"2023-10-19T12:43:18.559101+0000","last_became_active":"2023-10-19T12:41:19.291867+0000","last_became_peered":"2023-10-19T12:41:19.291867+0000","last_unstale":"2023-10-19T12:43:18.559101+0000","last_undegraded":"2023-10-19T12:43:18.559101+0000","last_fullsized":"2023-10-19T12:43:18.559101+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:22:12.255839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.760975+0000","last_change":"2023-10-19T12:41:23.340447+0000","last_active":"2023-10-19T12:43:27.760975+0000","last_peered":"2023-10-19T12:43:27.760975+0000","last_clean":"2023-10-19T12:43:27.760975+0000","last_became_active":"2023-10-19T12:41:23.340074+0000","last_became_peered":"2023-10-19T12:41:23.340074+0000","last_unstale":"2023-10-19T12:43:27.760975+0000","last_undegraded":"2023-10-19T12:43:27.760975+0000","last_fullsized":"2023-10-19T12:43:27.760975+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:12:11.828854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"88'2","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:43:18.559114+0000","last_change":"2023-10-19T12:41:18.297822+0000","last_active":"2023-10-19T12:43:18.559114+0000","last_peered":"2023-10-19T12:43:18.559114+0000","last_clean":"2023-10-19T12:43:18.559114+0000","last_became_active":"2023-10-19T12:41:18.297526+0000","last_became_peered":"2023-10-19T12:41:18.297526+0000","last_unstale":"2023-10-19T12:43:18.559114+0000","last_undegraded":"2023-10-19T12:43:18.559114+0000","last_fullsized":"2023-10-19T12:43:18.559114+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:59:28.110110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"90'6","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.769273+0000","last_change":"2023-10-19T12:41:19.309918+0000","last_active":"2023-10-19T12:43:27.769273+0000","last_peered":"2023-10-19T12:43:27.769273+0000","last_clean":"2023-10-19T12:43:27.769273+0000","last_became_active":"2023-10-19T12:41:19.309391+0000","last_became_peered":"2023-10-19T12:41:19.309391+0000","last_unstale":"2023-10-19T12:43:27.769273+0000","last_undegraded":"2023-10-19T12:43:27.769273+0000","last_fullsized":"2023-10-19T12:43:27.769273+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:52:49.320469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.762033+0000","last_change":"2023-10-19T12:41:23.337296+0000","last_active":"2023-10-19T12:43:27.762033+0000","last_peered":"2023-10-19T12:43:27.762033+0000","last_clean":"2023-10-19T12:43:27.762033+0000","last_became_active":"2023-10-19T12:41:23.336836+0000","last_became_peered":"2023-10-19T12:41:23.336836+0000","last_unstale":"2023-10-19T12:43:27.762033+0000","last_undegraded":"2023-10-19T12:43:27.762033+0000","last_fullsized":"2023-10-19T12:43:27.762033+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:15:25.400517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"88'12","reported_seq":57,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.763007+0000","last_change":"2023-10-19T12:42:28.174505+0000","last_active":"2023-10-19T12:43:27.763007+0000","last_peered":"2023-10-19T12:43:27.763007+0000","last_clean":"2023-10-19T12:43:27.763007+0000","last_became_active":"2023-10-19T12:42:28.165270+0000","last_became_peered":"2023-10-19T12:42:28.165270+0000","last_unstale":"2023-10-19T12:43:27.763007+0000","last_undegraded":"2023-10-19T12:43:27.763007+0000","last_fullsized":"2023-10-19T12:43:27.763007+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:54:50.199916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"90'9","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:56.680250+0000","last_change":"2023-10-19T12:41:19.301628+0000","last_active":"2023-10-19T12:42:56.680250+0000","last_peered":"2023-10-19T12:42:56.680250+0000","last_clean":"2023-10-19T12:42:56.680250+0000","last_became_active":"2023-10-19T12:41:19.301343+0000","last_became_peered":"2023-10-19T12:41:19.301343+0000","last_unstale":"2023-10-19T12:42:56.680250+0000","last_undegraded":"2023-10-19T12:42:56.680250+0000","last_fullsized":"2023-10-19T12:42:56.680250+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:02:31.273024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.761159+0000","last_change":"2023-10-19T12:41:23.330222+0000","last_active":"2023-10-19T12:43:27.761159+0000","last_peered":"2023-10-19T12:43:27.761159+0000","last_clean":"2023-10-19T12:43:27.761159+0000","last_became_active":"2023-10-19T12:41:23.329838+0000","last_became_peered":"2023-10-19T12:41:23.329838+0000","last_unstale":"2023-10-19T12:43:27.761159+0000","last_undegraded":"2023-10-19T12:43:27.761159+0000","last_fullsized":"2023-10-19T12:43:27.761159+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T21:40:52.899198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"88'5","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:28.133876+0000","last_change":"2023-10-19T12:42:28.133484+0000","last_active":"2023-10-19T12:42:28.133876+0000","last_peered":"2023-10-19T12:42:28.133876+0000","last_clean":"2023-10-19T12:42:28.133876+0000","last_became_active":"2023-10-19T12:42:28.126495+0000","last_became_peered":"2023-10-19T12:42:28.126495+0000","last_unstale":"2023-10-19T12:42:28.133876+0000","last_undegraded":"2023-10-19T12:42:28.133876+0000","last_fullsized":"2023-10-19T12:42:28.133876+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T21:28:29.956191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"90'15","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:56.677905+0000","last_change":"2023-10-19T12:42:28.129032+0000","last_active":"2023-10-19T12:42:56.677905+0000","last_peered":"2023-10-19T12:42:56.677905+0000","last_clean":"2023-10-19T12:42:56.677905+0000","last_became_active":"2023-10-19T12:42:28.128562+0000","last_became_peered":"2023-10-19T12:42:28.128562+0000","last_unstale":"2023-10-19T12:42:56.677905+0000","last_undegraded":"2023-10-19T12:42:56.677905+0000","last_fullsized":"2023-10-19T12:42:56.677905+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:52:14.264191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.116859+0000","last_change":"2023-10-19T12:41:23.330626+0000","last_active":"2023-10-19T12:42:27.116859+0000","last_peered":"2023-10-19T12:42:27.116859+0000","last_clean":"2023-10-19T12:42:27.116859+0000","last_became_active":"2023-10-19T12:41:23.330250+0000","last_became_peered":"2023-10-19T12:41:23.330250+0000","last_unstale":"2023-10-19T12:42:27.116859+0000","last_undegraded":"2023-10-19T12:42:27.116859+0000","last_fullsized":"2023-10-19T12:42:27.116859+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:09:48.428636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"88'5","reported_seq":138,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:43:24.208746+0000","last_change":"2023-10-19T12:42:28.136196+0000","last_active":"2023-10-19T12:43:24.208746+0000","last_peered":"2023-10-19T12:43:24.208746+0000","last_clean":"2023-10-19T12:43:24.208746+0000","last_became_active":"2023-10-19T12:42:28.126762+0000","last_became_peered":"2023-10-19T12:42:28.126762+0000","last_unstale":"2023-10-19T12:43:24.208746+0000","last_undegraded":"2023-10-19T12:43:24.208746+0000","last_fullsized":"2023-10-19T12:43:24.208746+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:04:58.098356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":95,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":622,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"90'7","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.762744+0000","last_change":"2023-10-19T12:41:19.285423+0000","last_active":"2023-10-19T12:43:27.762744+0000","last_peered":"2023-10-19T12:43:27.762744+0000","last_clean":"2023-10-19T12:43:27.762744+0000","last_became_active":"2023-10-19T12:41:19.285110+0000","last_became_peered":"2023-10-19T12:41:19.285110+0000","last_unstale":"2023-10-19T12:43:27.762744+0000","last_undegraded":"2023-10-19T12:43:27.762744+0000","last_fullsized":"2023-10-19T12:43:27.762744+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:27:51.707594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.116601+0000","last_change":"2023-10-19T12:41:23.343240+0000","last_active":"2023-10-19T12:42:27.116601+0000","last_peered":"2023-10-19T12:42:27.116601+0000","last_clean":"2023-10-19T12:42:27.116601+0000","last_became_active":"2023-10-19T12:41:23.342778+0000","last_became_peered":"2023-10-19T12:41:23.342778+0000","last_unstale":"2023-10-19T12:42:27.116601+0000","last_undegraded":"2023-10-19T12:42:27.116601+0000","last_fullsized":"2023-10-19T12:42:27.116601+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:47:15.690193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"88'7","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:28.179078+0000","last_change":"2023-10-19T12:42:28.179078+0000","last_active":"2023-10-19T12:42:28.179078+0000","last_peered":"2023-10-19T12:42:28.179078+0000","last_clean":"2023-10-19T12:42:28.179078+0000","last_became_active":"2023-10-19T12:42:28.165372+0000","last_became_peered":"2023-10-19T12:42:28.165372+0000","last_unstale":"2023-10-19T12:42:28.179078+0000","last_undegraded":"2023-10-19T12:42:28.179078+0000","last_fullsized":"2023-10-19T12:42:28.179078+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T21:12:40.451182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,6],"acting":[10,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"90'8","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-19T12:43:28.779471+0000","last_change":"2023-10-19T12:43:28.777892+0000","last_active":"2023-10-19T12:43:28.779471+0000","last_peered":"2023-10-19T12:43:28.779471+0000","last_clean":"2023-10-19T12:43:28.779471+0000","last_became_active":"2023-10-19T12:43:28.777514+0000","last_became_peered":"2023-10-19T12:43:28.777514+0000","last_unstale":"2023-10-19T12:43:28.779471+0000","last_undegraded":"2023-10-19T12:43:28.779471+0000","last_fullsized":"2023-10-19T12:43:28.779471+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T22:10:03.226531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,6],"acting":[9,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.123624+0000","last_change":"2023-10-19T12:41:23.338871+0000","last_active":"2023-10-19T12:42:27.123624+0000","last_peered":"2023-10-19T12:42:27.123624+0000","last_clean":"2023-10-19T12:42:27.123624+0000","last_became_active":"2023-10-19T12:41:23.338493+0000","last_became_peered":"2023-10-19T12:41:23.338493+0000","last_unstale":"2023-10-19T12:42:27.123624+0000","last_undegraded":"2023-10-19T12:42:27.123624+0000","last_fullsized":"2023-10-19T12:42:27.123624+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T22:49:12.948436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"88'3","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.125512+0000","last_change":"2023-10-19T12:41:18.291110+0000","last_active":"2023-10-19T12:42:27.125512+0000","last_peered":"2023-10-19T12:42:27.125512+0000","last_clean":"2023-10-19T12:42:27.125512+0000","last_became_active":"2023-10-19T12:41:18.290675+0000","last_became_peered":"2023-10-19T12:41:18.290675+0000","last_unstale":"2023-10-19T12:42:27.125512+0000","last_undegraded":"2023-10-19T12:42:27.125512+0000","last_fullsized":"2023-10-19T12:42:27.125512+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:57:44.713046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"90'8","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:56.694839+0000","last_change":"2023-10-19T12:41:19.299727+0000","last_active":"2023-10-19T12:42:56.694839+0000","last_peered":"2023-10-19T12:42:56.694839+0000","last_clean":"2023-10-19T12:42:56.694839+0000","last_became_active":"2023-10-19T12:41:19.299387+0000","last_became_peered":"2023-10-19T12:41:19.299387+0000","last_unstale":"2023-10-19T12:42:56.694839+0000","last_undegraded":"2023-10-19T12:42:56.694839+0000","last_fullsized":"2023-10-19T12:42:56.694839+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:34:03.783326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.769294+0000","last_change":"2023-10-19T12:41:23.331954+0000","last_active":"2023-10-19T12:43:27.769294+0000","last_peered":"2023-10-19T12:43:27.769294+0000","last_clean":"2023-10-19T12:43:27.769294+0000","last_became_active":"2023-10-19T12:41:23.328835+0000","last_became_peered":"2023-10-19T12:41:23.328835+0000","last_unstale":"2023-10-19T12:43:27.769294+0000","last_undegraded":"2023-10-19T12:43:27.769294+0000","last_fullsized":"2023-10-19T12:43:27.769294+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T21:49:10.473768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"88'3","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.120595+0000","last_change":"2023-10-19T12:41:18.280694+0000","last_active":"2023-10-19T12:42:27.120595+0000","last_peered":"2023-10-19T12:42:27.120595+0000","last_clean":"2023-10-19T12:42:27.120595+0000","last_became_active":"2023-10-19T12:41:18.280333+0000","last_became_peered":"2023-10-19T12:41:18.280333+0000","last_unstale":"2023-10-19T12:42:27.120595+0000","last_undegraded":"2023-10-19T12:42:27.120595+0000","last_fullsized":"2023-10-19T12:42:27.120595+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:06:02.944400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"90'11","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.758598+0000","last_change":"2023-10-19T12:41:19.288659+0000","last_active":"2023-10-19T12:43:27.758598+0000","last_peered":"2023-10-19T12:43:27.758598+0000","last_clean":"2023-10-19T12:43:27.758598+0000","last_became_active":"2023-10-19T12:41:19.288310+0000","last_became_peered":"2023-10-19T12:41:19.288310+0000","last_unstale":"2023-10-19T12:43:27.758598+0000","last_undegraded":"2023-10-19T12:43:27.758598+0000","last_fullsized":"2023-10-19T12:43:27.758598+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T23:15:05.772393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:28.118079+0000","last_change":"2023-10-19T12:41:23.333370+0000","last_active":"2023-10-19T12:42:28.118079+0000","last_peered":"2023-10-19T12:42:28.118079+0000","last_clean":"2023-10-19T12:42:28.118079+0000","last_became_active":"2023-10-19T12:41:23.332691+0000","last_became_peered":"2023-10-19T12:41:23.332691+0000","last_unstale":"2023-10-19T12:42:28.118079+0000","last_undegraded":"2023-10-19T12:42:28.118079+0000","last_fullsized":"2023-10-19T12:42:28.118079+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T21:28:45.414610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"90'5","reported_seq":220,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:43:25.209373+0000","last_change":"2023-10-19T12:41:18.287081+0000","last_active":"2023-10-19T12:43:25.209373+0000","last_peered":"2023-10-19T12:43:25.209373+0000","last_clean":"2023-10-19T12:43:25.209373+0000","last_became_active":"2023-10-19T12:41:18.286784+0000","last_became_peered":"2023-10-19T12:41:18.286784+0000","last_unstale":"2023-10-19T12:43:25.209373+0000","last_undegraded":"2023-10-19T12:43:25.209373+0000","last_fullsized":"2023-10-19T12:43:25.209373+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:49:10.167022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":197,"num_read_kb":197,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"90'10","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:56.683027+0000","last_change":"2023-10-19T12:41:19.300361+0000","last_active":"2023-10-19T12:42:56.683027+0000","last_peered":"2023-10-19T12:42:56.683027+0000","last_clean":"2023-10-19T12:42:56.683027+0000","last_became_active":"2023-10-19T12:41:19.299871+0000","last_became_peered":"2023-10-19T12:41:19.299871+0000","last_unstale":"2023-10-19T12:42:56.683027+0000","last_undegraded":"2023-10-19T12:42:56.683027+0000","last_fullsized":"2023-10-19T12:42:56.683027+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:46:31.437532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.758403+0000","last_change":"2023-10-19T12:41:23.338341+0000","last_active":"2023-10-19T12:43:27.758403+0000","last_peered":"2023-10-19T12:43:27.758403+0000","last_clean":"2023-10-19T12:43:27.758403+0000","last_became_active":"2023-10-19T12:41:23.336081+0000","last_became_peered":"2023-10-19T12:41:23.336081+0000","last_unstale":"2023-10-19T12:43:27.758403+0000","last_undegraded":"2023-10-19T12:43:27.758403+0000","last_fullsized":"2023-10-19T12:43:27.758403+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:02:35.474513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"88'4","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.118927+0000","last_change":"2023-10-19T12:41:18.280086+0000","last_active":"2023-10-19T12:42:27.118927+0000","last_peered":"2023-10-19T12:42:27.118927+0000","last_clean":"2023-10-19T12:42:27.118927+0000","last_became_active":"2023-10-19T12:41:18.279819+0000","last_became_peered":"2023-10-19T12:41:18.279819+0000","last_unstale":"2023-10-19T12:42:27.118927+0000","last_undegraded":"2023-10-19T12:42:27.118927+0000","last_fullsized":"2023-10-19T12:42:27.118927+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T23:02:28.723477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"90'9","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-19T12:43:28.781603+0000","last_change":"2023-10-19T12:43:28.781603+0000","last_active":"2023-10-19T12:43:28.781603+0000","last_peered":"2023-10-19T12:43:28.781603+0000","last_clean":"2023-10-19T12:43:28.781603+0000","last_became_active":"2023-10-19T12:43:28.781189+0000","last_became_peered":"2023-10-19T12:43:28.781189+0000","last_unstale":"2023-10-19T12:43:28.781603+0000","last_undegraded":"2023-10-19T12:43:28.781603+0000","last_fullsized":"2023-10-19T12:43:28.781603+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:53:26.785127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,5],"acting":[0,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-19T12:43:28.784130+0000","last_change":"2023-10-19T12:43:28.784130+0000","last_active":"2023-10-19T12:43:28.784130+0000","last_peered":"2023-10-19T12:43:28.784130+0000","last_clean":"2023-10-19T12:43:28.784130+0000","last_became_active":"2023-10-19T12:43:28.783623+0000","last_became_peered":"2023-10-19T12:43:28.783623+0000","last_unstale":"2023-10-19T12:43:28.784130+0000","last_undegraded":"2023-10-19T12:43:28.784130+0000","last_fullsized":"2023-10-19T12:43:28.784130+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:02:21.375104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,8],"acting":[4,1,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"88'5","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.121398+0000","last_change":"2023-10-19T12:41:18.285452+0000","last_active":"2023-10-19T12:42:27.121398+0000","last_peered":"2023-10-19T12:42:27.121398+0000","last_clean":"2023-10-19T12:42:27.121398+0000","last_became_active":"2023-10-19T12:41:18.285155+0000","last_became_peered":"2023-10-19T12:41:18.285155+0000","last_unstale":"2023-10-19T12:42:27.121398+0000","last_undegraded":"2023-10-19T12:42:27.121398+0000","last_fullsized":"2023-10-19T12:42:27.121398+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:30:41.041925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"90'11","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:56.680490+0000","last_change":"2023-10-19T12:41:19.284839+0000","last_active":"2023-10-19T12:42:56.680490+0000","last_peered":"2023-10-19T12:42:56.680490+0000","last_clean":"2023-10-19T12:42:56.680490+0000","last_became_active":"2023-10-19T12:41:19.284538+0000","last_became_peered":"2023-10-19T12:41:19.284538+0000","last_unstale":"2023-10-19T12:42:56.680490+0000","last_undegraded":"2023-10-19T12:42:56.680490+0000","last_fullsized":"2023-10-19T12:42:56.680490+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:29:12.288958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.115869+0000","last_change":"2023-10-19T12:41:23.339611+0000","last_active":"2023-10-19T12:42:27.115869+0000","last_peered":"2023-10-19T12:42:27.115869+0000","last_clean":"2023-10-19T12:42:27.115869+0000","last_became_active":"2023-10-19T12:41:23.337786+0000","last_became_peered":"2023-10-19T12:41:23.337786+0000","last_unstale":"2023-10-19T12:42:27.115869+0000","last_undegraded":"2023-10-19T12:42:27.115869+0000","last_fullsized":"2023-10-19T12:42:27.115869+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:56:01.219811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"90'38","reported_seq":260,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:43:25.209266+0000","last_change":"2023-10-19T12:41:18.279330+0000","last_active":"2023-10-19T12:43:25.209266+0000","last_peered":"2023-10-19T12:43:25.209266+0000","last_clean":"2023-10-19T12:43:25.209266+0000","last_became_active":"2023-10-19T12:41:18.278942+0000","last_became_peered":"2023-10-19T12:41:18.278942+0000","last_unstale":"2023-10-19T12:43:25.209266+0000","last_undegraded":"2023-10-19T12:43:25.209266+0000","last_fullsized":"2023-10-19T12:43:25.209266+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:40:23.340009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60690,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":204,"num_read_kb":161,"num_write":40,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"90'6","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.763252+0000","last_change":"2023-10-19T12:41:19.296103+0000","last_active":"2023-10-19T12:43:27.763252+0000","last_peered":"2023-10-19T12:43:27.763252+0000","last_clean":"2023-10-19T12:43:27.763252+0000","last_became_active":"2023-10-19T12:41:19.293432+0000","last_became_peered":"2023-10-19T12:41:19.293432+0000","last_unstale":"2023-10-19T12:43:27.763252+0000","last_undegraded":"2023-10-19T12:43:27.763252+0000","last_fullsized":"2023-10-19T12:43:27.763252+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:21:46.039560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.122205+0000","last_change":"2023-10-19T12:41:23.330711+0000","last_active":"2023-10-19T12:42:27.122205+0000","last_peered":"2023-10-19T12:42:27.122205+0000","last_clean":"2023-10-19T12:42:27.122205+0000","last_became_active":"2023-10-19T12:41:23.330115+0000","last_became_peered":"2023-10-19T12:41:23.330115+0000","last_unstale":"2023-10-19T12:42:27.122205+0000","last_undegraded":"2023-10-19T12:42:27.122205+0000","last_fullsized":"2023-10-19T12:42:27.122205+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:48:50.296265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"88'9","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.116428+0000","last_change":"2023-10-19T12:41:18.289434+0000","last_active":"2023-10-19T12:42:27.116428+0000","last_peered":"2023-10-19T12:42:27.116428+0000","last_clean":"2023-10-19T12:42:27.116428+0000","last_became_active":"2023-10-19T12:41:18.289226+0000","last_became_peered":"2023-10-19T12:41:18.289226+0000","last_unstale":"2023-10-19T12:42:27.116428+0000","last_undegraded":"2023-10-19T12:42:27.116428+0000","last_fullsized":"2023-10-19T12:42:27.116428+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T21:18:19.007202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"90'9","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:56.692393+0000","last_change":"2023-10-19T12:41:19.300555+0000","last_active":"2023-10-19T12:42:56.692393+0000","last_peered":"2023-10-19T12:42:56.692393+0000","last_clean":"2023-10-19T12:42:56.692393+0000","last_became_active":"2023-10-19T12:41:19.300162+0000","last_became_peered":"2023-10-19T12:41:19.300162+0000","last_unstale":"2023-10-19T12:42:56.692393+0000","last_undegraded":"2023-10-19T12:42:56.692393+0000","last_fullsized":"2023-10-19T12:42:56.692393+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:26:33.779562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.122864+0000","last_change":"2023-10-19T12:41:23.338750+0000","last_active":"2023-10-19T12:42:27.122864+0000","last_peered":"2023-10-19T12:42:27.122864+0000","last_clean":"2023-10-19T12:42:27.122864+0000","last_became_active":"2023-10-19T12:41:23.338318+0000","last_became_peered":"2023-10-19T12:41:23.338318+0000","last_unstale":"2023-10-19T12:42:27.122864+0000","last_undegraded":"2023-10-19T12:42:27.122864+0000","last_fullsized":"2023-10-19T12:42:27.122864+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:11:20.182270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"88'5","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.120277+0000","last_change":"2023-10-19T12:41:18.293923+0000","last_active":"2023-10-19T12:42:27.120277+0000","last_peered":"2023-10-19T12:42:27.120277+0000","last_clean":"2023-10-19T12:42:27.120277+0000","last_became_active":"2023-10-19T12:41:18.293688+0000","last_became_peered":"2023-10-19T12:41:18.293688+0000","last_unstale":"2023-10-19T12:42:27.120277+0000","last_undegraded":"2023-10-19T12:42:27.120277+0000","last_fullsized":"2023-10-19T12:42:27.120277+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:34:15.162178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"90'15","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:56.694051+0000","last_change":"2023-10-19T12:41:19.302733+0000","last_active":"2023-10-19T12:42:56.694051+0000","last_peered":"2023-10-19T12:42:56.694051+0000","last_clean":"2023-10-19T12:42:56.694051+0000","last_became_active":"2023-10-19T12:41:19.302401+0000","last_became_peered":"2023-10-19T12:41:19.302401+0000","last_unstale":"2023-10-19T12:42:56.694051+0000","last_undegraded":"2023-10-19T12:42:56.694051+0000","last_fullsized":"2023-10-19T12:42:56.694051+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:55:05.864499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-19T12:43:28.780788+0000","last_change":"2023-10-19T12:43:28.780007+0000","last_active":"2023-10-19T12:43:28.780788+0000","last_peered":"2023-10-19T12:43:28.780788+0000","last_clean":"2023-10-19T12:43:28.780788+0000","last_became_active":"2023-10-19T12:43:28.779620+0000","last_became_peered":"2023-10-19T12:43:28.779620+0000","last_unstale":"2023-10-19T12:43:28.780788+0000","last_undegraded":"2023-10-19T12:43:28.780788+0000","last_fullsized":"2023-10-19T12:43:28.780788+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:01:36.931162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7,0,3],"acting":[8,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.11","version":"90'6","reported_seq":134,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-19T12:43:29.463894+0000","last_change":"2023-10-19T12:41:18.277563+0000","last_active":"2023-10-19T12:43:29.463894+0000","last_peered":"2023-10-19T12:43:29.463894+0000","last_clean":"2023-10-19T12:43:29.463894+0000","last_became_active":"2023-10-19T12:41:18.277255+0000","last_became_peered":"2023-10-19T12:41:18.277255+0000","last_unstale":"2023-10-19T12:43:29.463894+0000","last_undegraded":"2023-10-19T12:43:29.463894+0000","last_fullsized":"2023-10-19T12:43:29.463894+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:28:31.468355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":108,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"90'6","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:56.675483+0000","last_change":"2023-10-19T12:41:19.288939+0000","last_active":"2023-10-19T12:42:56.675483+0000","last_peered":"2023-10-19T12:42:56.675483+0000","last_clean":"2023-10-19T12:42:56.675483+0000","last_became_active":"2023-10-19T12:41:19.288612+0000","last_became_peered":"2023-10-19T12:41:19.288612+0000","last_unstale":"2023-10-19T12:42:56.675483+0000","last_undegraded":"2023-10-19T12:42:56.675483+0000","last_fullsized":"2023-10-19T12:42:56.675483+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:45:36.050331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.125921+0000","last_change":"2023-10-19T12:41:23.333823+0000","last_active":"2023-10-19T12:42:27.125921+0000","last_peered":"2023-10-19T12:42:27.125921+0000","last_clean":"2023-10-19T12:42:27.125921+0000","last_became_active":"2023-10-19T12:41:23.332698+0000","last_became_peered":"2023-10-19T12:41:23.332698+0000","last_unstale":"2023-10-19T12:42:27.125921+0000","last_undegraded":"2023-10-19T12:42:27.125921+0000","last_fullsized":"2023-10-19T12:42:27.125921+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:54:43.952531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"88'17","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.762439+0000","last_change":"2023-10-19T12:41:18.290426+0000","last_active":"2023-10-19T12:43:27.762439+0000","last_peered":"2023-10-19T12:43:27.762439+0000","last_clean":"2023-10-19T12:43:27.762439+0000","last_became_active":"2023-10-19T12:41:18.290096+0000","last_became_peered":"2023-10-19T12:41:18.290096+0000","last_unstale":"2023-10-19T12:43:27.762439+0000","last_undegraded":"2023-10-19T12:43:27.762439+0000","last_fullsized":"2023-10-19T12:43:27.762439+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:14:34.731869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"90'6","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:56.672893+0000","last_change":"2023-10-19T12:41:19.300423+0000","last_active":"2023-10-19T12:42:56.672893+0000","last_peered":"2023-10-19T12:42:56.672893+0000","last_clean":"2023-10-19T12:42:56.672893+0000","last_became_active":"2023-10-19T12:41:19.299999+0000","last_became_peered":"2023-10-19T12:41:19.299999+0000","last_unstale":"2023-10-19T12:42:56.672893+0000","last_undegraded":"2023-10-19T12:42:56.672893+0000","last_fullsized":"2023-10-19T12:42:56.672893+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:35:32.703396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.119720+0000","last_change":"2023-10-19T12:41:23.330091+0000","last_active":"2023-10-19T12:42:27.119720+0000","last_peered":"2023-10-19T12:42:27.119720+0000","last_clean":"2023-10-19T12:42:27.119720+0000","last_became_active":"2023-10-19T12:41:23.329695+0000","last_became_peered":"2023-10-19T12:41:23.329695+0000","last_unstale":"2023-10-19T12:42:27.119720+0000","last_undegraded":"2023-10-19T12:42:27.119720+0000","last_fullsized":"2023-10-19T12:42:27.119720+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:37:09.840232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"88'2","reported_seq":23,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.765619+0000","last_change":"2023-10-19T12:41:18.279761+0000","last_active":"2023-10-19T12:43:27.765619+0000","last_peered":"2023-10-19T12:43:27.765619+0000","last_clean":"2023-10-19T12:43:27.765619+0000","last_became_active":"2023-10-19T12:41:18.279430+0000","last_became_peered":"2023-10-19T12:41:18.279430+0000","last_unstale":"2023-10-19T12:43:27.765619+0000","last_undegraded":"2023-10-19T12:43:27.765619+0000","last_fullsized":"2023-10-19T12:43:27.765619+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:43:32.447842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"90'5","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:56.675356+0000","last_change":"2023-10-19T12:41:19.290406+0000","last_active":"2023-10-19T12:42:56.675356+0000","last_peered":"2023-10-19T12:42:56.675356+0000","last_clean":"2023-10-19T12:42:56.675356+0000","last_became_active":"2023-10-19T12:41:19.290032+0000","last_became_peered":"2023-10-19T12:41:19.290032+0000","last_unstale":"2023-10-19T12:42:56.675356+0000","last_undegraded":"2023-10-19T12:42:56.675356+0000","last_fullsized":"2023-10-19T12:42:56.675356+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:30:30.875800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-19T12:43:28.770421+0000","last_change":"2023-10-19T12:41:23.478036+0000","last_active":"2023-10-19T12:43:28.770421+0000","last_peered":"2023-10-19T12:43:28.770421+0000","last_clean":"2023-10-19T12:43:28.770421+0000","last_became_active":"2023-10-19T12:41:23.477542+0000","last_became_peered":"2023-10-19T12:41:23.477542+0000","last_unstale":"2023-10-19T12:43:28.770421+0000","last_undegraded":"2023-10-19T12:43:28.770421+0000","last_fullsized":"2023-10-19T12:43:28.770421+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:32:24.599591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"88'1","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.758692+0000","last_change":"2023-10-19T12:41:18.289254+0000","last_active":"2023-10-19T12:43:27.758692+0000","last_peered":"2023-10-19T12:43:27.758692+0000","last_clean":"2023-10-19T12:43:27.758692+0000","last_became_active":"2023-10-19T12:41:18.287036+0000","last_became_peered":"2023-10-19T12:41:18.287036+0000","last_unstale":"2023-10-19T12:43:27.758692+0000","last_undegraded":"2023-10-19T12:43:27.758692+0000","last_fullsized":"2023-10-19T12:43:27.758692+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T21:33:41.720725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"90'4","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:56.693437+0000","last_change":"2023-10-19T12:41:19.299711+0000","last_active":"2023-10-19T12:42:56.693437+0000","last_peered":"2023-10-19T12:42:56.693437+0000","last_clean":"2023-10-19T12:42:56.693437+0000","last_became_active":"2023-10-19T12:41:19.299367+0000","last_became_peered":"2023-10-19T12:41:19.299367+0000","last_unstale":"2023-10-19T12:42:56.693437+0000","last_undegraded":"2023-10-19T12:42:56.693437+0000","last_fullsized":"2023-10-19T12:42:56.693437+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:32:36.783990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.124886+0000","last_change":"2023-10-19T12:41:23.328301+0000","last_active":"2023-10-19T12:42:27.124886+0000","last_peered":"2023-10-19T12:42:27.124886+0000","last_clean":"2023-10-19T12:42:27.124886+0000","last_became_active":"2023-10-19T12:41:23.327866+0000","last_became_peered":"2023-10-19T12:41:23.327866+0000","last_unstale":"2023-10-19T12:42:27.124886+0000","last_undegraded":"2023-10-19T12:42:27.124886+0000","last_fullsized":"2023-10-19T12:42:27.124886+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T21:53:23.600196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"88'5","reported_seq":127,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:43:26.454850+0000","last_change":"2023-10-19T12:41:18.286635+0000","last_active":"2023-10-19T12:43:26.454850+0000","last_peered":"2023-10-19T12:43:26.454850+0000","last_clean":"2023-10-19T12:43:26.454850+0000","last_became_active":"2023-10-19T12:41:18.286310+0000","last_became_peered":"2023-10-19T12:41:18.286310+0000","last_unstale":"2023-10-19T12:43:26.454850+0000","last_undegraded":"2023-10-19T12:43:26.454850+0000","last_fullsized":"2023-10-19T12:43:26.454850+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:30:38.266038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":102,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"90'7","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:56.676372+0000","last_change":"2023-10-19T12:41:19.297989+0000","last_active":"2023-10-19T12:42:56.676372+0000","last_peered":"2023-10-19T12:42:56.676372+0000","last_clean":"2023-10-19T12:42:56.676372+0000","last_became_active":"2023-10-19T12:41:19.297680+0000","last_became_peered":"2023-10-19T12:41:19.297680+0000","last_unstale":"2023-10-19T12:42:56.676372+0000","last_undegraded":"2023-10-19T12:42:56.676372+0000","last_fullsized":"2023-10-19T12:42:56.676372+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:40:22.883804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.126049+0000","last_change":"2023-10-19T12:41:23.478723+0000","last_active":"2023-10-19T12:42:27.126049+0000","last_peered":"2023-10-19T12:42:27.126049+0000","last_clean":"2023-10-19T12:42:27.126049+0000","last_became_active":"2023-10-19T12:41:23.478063+0000","last_became_peered":"2023-10-19T12:41:23.478063+0000","last_unstale":"2023-10-19T12:42:27.126049+0000","last_undegraded":"2023-10-19T12:42:27.126049+0000","last_fullsized":"2023-10-19T12:42:27.126049+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:41:00.885308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"90'8","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:56.675092+0000","last_change":"2023-10-19T12:41:19.285478+0000","last_active":"2023-10-19T12:42:56.675092+0000","last_peered":"2023-10-19T12:42:56.675092+0000","last_clean":"2023-10-19T12:42:56.675092+0000","last_became_active":"2023-10-19T12:41:19.285175+0000","last_became_peered":"2023-10-19T12:41:19.285175+0000","last_unstale":"2023-10-19T12:42:56.675092+0000","last_undegraded":"2023-10-19T12:42:56.675092+0000","last_fullsized":"2023-10-19T12:42:56.675092+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:18:03.423712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"88'5","reported_seq":124,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:43:25.455905+0000","last_change":"2023-10-19T12:41:18.297207+0000","last_active":"2023-10-19T12:43:25.455905+0000","last_peered":"2023-10-19T12:43:25.455905+0000","last_clean":"2023-10-19T12:43:25.455905+0000","last_became_active":"2023-10-19T12:41:18.296490+0000","last_became_peered":"2023-10-19T12:41:18.296490+0000","last_unstale":"2023-10-19T12:43:25.455905+0000","last_undegraded":"2023-10-19T12:43:25.455905+0000","last_fullsized":"2023-10-19T12:43:25.455905+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:42:33.769810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"88'1","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:28.120989+0000","last_change":"2023-10-19T12:41:23.338803+0000","last_active":"2023-10-19T12:42:28.120989+0000","last_peered":"2023-10-19T12:42:28.120989+0000","last_clean":"2023-10-19T12:42:28.120989+0000","last_became_active":"2023-10-19T12:41:23.338383+0000","last_became_peered":"2023-10-19T12:41:23.338383+0000","last_unstale":"2023-10-19T12:42:28.120989+0000","last_undegraded":"2023-10-19T12:42:28.120989+0000","last_fullsized":"2023-10-19T12:42:28.120989+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:39:24.412323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"90'8","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:43:23.559610+0000","last_change":"2023-10-19T12:41:19.290536+0000","last_active":"2023-10-19T12:43:23.559610+0000","last_peered":"2023-10-19T12:43:23.559610+0000","last_clean":"2023-10-19T12:43:23.559610+0000","last_became_active":"2023-10-19T12:41:19.290141+0000","last_became_peered":"2023-10-19T12:41:19.290141+0000","last_unstale":"2023-10-19T12:43:23.559610+0000","last_undegraded":"2023-10-19T12:43:23.559610+0000","last_fullsized":"2023-10-19T12:43:23.559610+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:49:59.601767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"88'6","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.762131+0000","last_change":"2023-10-19T12:41:18.276568+0000","last_active":"2023-10-19T12:43:27.762131+0000","last_peered":"2023-10-19T12:43:27.762131+0000","last_clean":"2023-10-19T12:43:27.762131+0000","last_became_active":"2023-10-19T12:41:18.276216+0000","last_became_peered":"2023-10-19T12:41:18.276216+0000","last_unstale":"2023-10-19T12:43:27.762131+0000","last_undegraded":"2023-10-19T12:43:27.762131+0000","last_fullsized":"2023-10-19T12:43:27.762131+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T23:24:32.159972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":314,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:28.120341+0000","last_change":"2023-10-19T12:40:14.674594+0000","last_active":"2023-10-19T12:42:28.120341+0000","last_peered":"2023-10-19T12:42:28.120341+0000","last_clean":"2023-10-19T12:42:28.120341+0000","last_became_active":"2023-10-19T12:40:14.674234+0000","last_became_peered":"2023-10-19T12:40:14.674234+0000","last_unstale":"2023-10-19T12:42:28.120341+0000","last_undegraded":"2023-10-19T12:42:28.120341+0000","last_fullsized":"2023-10-19T12:42:28.120341+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:37:07.222565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:37:07.222565+0000","last_clean_scrub_stamp":"2023-10-19T12:37:07.222565+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-21T00:22:40.530907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-19T12:43:28.780476+0000","last_change":"2023-10-19T12:43:28.777654+0000","last_active":"2023-10-19T12:43:28.780476+0000","last_peered":"2023-10-19T12:43:28.780476+0000","last_clean":"2023-10-19T12:43:28.780476+0000","last_became_active":"2023-10-19T12:43:28.777183+0000","last_became_peered":"2023-10-19T12:43:28.777183+0000","last_unstale":"2023-10-19T12:43:28.780476+0000","last_undegraded":"2023-10-19T12:43:28.780476+0000","last_fullsized":"2023-10-19T12:43:28.780476+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T23:22:06.993915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6,10],"acting":[8,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1","version":"90'5","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:56.679900+0000","last_change":"2023-10-19T12:41:19.294132+0000","last_active":"2023-10-19T12:42:56.679900+0000","last_peered":"2023-10-19T12:42:56.679900+0000","last_clean":"2023-10-19T12:42:56.679900+0000","last_became_active":"2023-10-19T12:41:19.293800+0000","last_became_peered":"2023-10-19T12:41:19.293800+0000","last_unstale":"2023-10-19T12:42:56.679900+0000","last_undegraded":"2023-10-19T12:42:56.679900+0000","last_fullsized":"2023-10-19T12:42:56.679900+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:30:56.734581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"88'4","reported_seq":15,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:28.136072+0000","last_change":"2023-10-19T12:42:28.135694+0000","last_active":"2023-10-19T12:42:28.136072+0000","last_peered":"2023-10-19T12:42:28.136072+0000","last_clean":"2023-10-19T12:42:28.136072+0000","last_became_active":"2023-10-19T12:42:28.127322+0000","last_became_peered":"2023-10-19T12:42:28.127322+0000","last_unstale":"2023-10-19T12:42:28.136072+0000","last_undegraded":"2023-10-19T12:42:28.136072+0000","last_fullsized":"2023-10-19T12:42:28.136072+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T23:26:54.615667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.122348+0000","last_change":"2023-10-19T12:41:23.328605+0000","last_active":"2023-10-19T12:42:27.122348+0000","last_peered":"2023-10-19T12:42:27.122348+0000","last_clean":"2023-10-19T12:42:27.122348+0000","last_became_active":"2023-10-19T12:41:23.327992+0000","last_became_peered":"2023-10-19T12:41:23.327992+0000","last_unstale":"2023-10-19T12:42:27.122348+0000","last_undegraded":"2023-10-19T12:42:27.122348+0000","last_fullsized":"2023-10-19T12:42:27.122348+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:00:04.415235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"88'4","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.763134+0000","last_change":"2023-10-19T12:41:18.290347+0000","last_active":"2023-10-19T12:43:27.763134+0000","last_peered":"2023-10-19T12:43:27.763134+0000","last_clean":"2023-10-19T12:43:27.763134+0000","last_became_active":"2023-10-19T12:41:18.290050+0000","last_became_peered":"2023-10-19T12:41:18.290050+0000","last_unstale":"2023-10-19T12:43:27.763134+0000","last_undegraded":"2023-10-19T12:43:27.763134+0000","last_fullsized":"2023-10-19T12:43:27.763134+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:19:05.618338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"90'9","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:56.678606+0000","last_change":"2023-10-19T12:41:19.303753+0000","last_active":"2023-10-19T12:42:56.678606+0000","last_peered":"2023-10-19T12:42:56.678606+0000","last_clean":"2023-10-19T12:42:56.678606+0000","last_became_active":"2023-10-19T12:41:19.299710+0000","last_became_peered":"2023-10-19T12:41:19.299710+0000","last_unstale":"2023-10-19T12:42:56.678606+0000","last_undegraded":"2023-10-19T12:42:56.678606+0000","last_fullsized":"2023-10-19T12:42:56.678606+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:40:27.929956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:43:23.559527+0000","last_change":"2023-10-19T12:41:23.478159+0000","last_active":"2023-10-19T12:43:23.559527+0000","last_peered":"2023-10-19T12:43:23.559527+0000","last_clean":"2023-10-19T12:43:23.559527+0000","last_became_active":"2023-10-19T12:41:23.477647+0000","last_became_peered":"2023-10-19T12:41:23.477647+0000","last_unstale":"2023-10-19T12:43:23.559527+0000","last_undegraded":"2023-10-19T12:43:23.559527+0000","last_fullsized":"2023-10-19T12:43:23.559527+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:48:31.904477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"90'12","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-19T12:43:28.772974+0000","last_change":"2023-10-19T12:41:18.295746+0000","last_active":"2023-10-19T12:43:28.772974+0000","last_peered":"2023-10-19T12:43:28.772974+0000","last_clean":"2023-10-19T12:43:28.772974+0000","last_became_active":"2023-10-19T12:41:18.294855+0000","last_became_peered":"2023-10-19T12:41:18.294855+0000","last_unstale":"2023-10-19T12:43:28.772974+0000","last_undegraded":"2023-10-19T12:43:28.772974+0000","last_fullsized":"2023-10-19T12:43:28.772974+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:52:24.628136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"90'5","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.768609+0000","last_change":"2023-10-19T12:41:19.283960+0000","last_active":"2023-10-19T12:43:27.768609+0000","last_peered":"2023-10-19T12:43:27.768609+0000","last_clean":"2023-10-19T12:43:27.768609+0000","last_became_active":"2023-10-19T12:41:19.282544+0000","last_became_peered":"2023-10-19T12:41:19.282544+0000","last_unstale":"2023-10-19T12:43:27.768609+0000","last_undegraded":"2023-10-19T12:43:27.768609+0000","last_fullsized":"2023-10-19T12:43:27.768609+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T23:58:08.794192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.116192+0000","last_change":"2023-10-19T12:41:23.323593+0000","last_active":"2023-10-19T12:42:27.116192+0000","last_peered":"2023-10-19T12:42:27.116192+0000","last_clean":"2023-10-19T12:42:27.116192+0000","last_became_active":"2023-10-19T12:41:23.323204+0000","last_became_peered":"2023-10-19T12:41:23.323204+0000","last_unstale":"2023-10-19T12:42:27.116192+0000","last_undegraded":"2023-10-19T12:42:27.116192+0000","last_fullsized":"2023-10-19T12:42:27.116192+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:15:15.379085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"88'7","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-19T12:43:28.775180+0000","last_change":"2023-10-19T12:41:18.286231+0000","last_active":"2023-10-19T12:43:28.775180+0000","last_peered":"2023-10-19T12:43:28.775180+0000","last_clean":"2023-10-19T12:43:28.775180+0000","last_became_active":"2023-10-19T12:41:18.285932+0000","last_became_peered":"2023-10-19T12:41:18.285932+0000","last_unstale":"2023-10-19T12:43:28.775180+0000","last_undegraded":"2023-10-19T12:43:28.775180+0000","last_fullsized":"2023-10-19T12:43:28.775180+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:13:02.066468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"90'7","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-19T12:43:28.774328+0000","last_change":"2023-10-19T12:42:28.126438+0000","last_active":"2023-10-19T12:43:28.774328+0000","last_peered":"2023-10-19T12:43:28.774328+0000","last_clean":"2023-10-19T12:43:28.774328+0000","last_became_active":"2023-10-19T12:42:28.126115+0000","last_became_peered":"2023-10-19T12:42:28.126115+0000","last_unstale":"2023-10-19T12:43:28.774328+0000","last_undegraded":"2023-10-19T12:43:28.774328+0000","last_fullsized":"2023-10-19T12:43:28.774328+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:48:12.878420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.763594+0000","last_change":"2023-10-19T12:41:23.479129+0000","last_active":"2023-10-19T12:43:27.763594+0000","last_peered":"2023-10-19T12:43:27.763594+0000","last_clean":"2023-10-19T12:43:27.763594+0000","last_became_active":"2023-10-19T12:41:23.478518+0000","last_became_peered":"2023-10-19T12:41:23.478518+0000","last_unstale":"2023-10-19T12:43:27.763594+0000","last_undegraded":"2023-10-19T12:43:27.763594+0000","last_fullsized":"2023-10-19T12:43:27.763594+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:55:38.767504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"88'2","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.124117+0000","last_change":"2023-10-19T12:41:18.283269+0000","last_active":"2023-10-19T12:42:27.124117+0000","last_peered":"2023-10-19T12:42:27.124117+0000","last_clean":"2023-10-19T12:42:27.124117+0000","last_became_active":"2023-10-19T12:41:18.282913+0000","last_became_peered":"2023-10-19T12:41:18.282913+0000","last_unstale":"2023-10-19T12:42:27.124117+0000","last_undegraded":"2023-10-19T12:42:27.124117+0000","last_fullsized":"2023-10-19T12:42:27.124117+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:44:01.042312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"90'2","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-19T12:43:28.770381+0000","last_change":"2023-10-19T12:41:19.284222+0000","last_active":"2023-10-19T12:43:28.770381+0000","last_peered":"2023-10-19T12:43:28.770381+0000","last_clean":"2023-10-19T12:43:28.770381+0000","last_became_active":"2023-10-19T12:41:19.283914+0000","last_became_peered":"2023-10-19T12:41:19.283914+0000","last_unstale":"2023-10-19T12:43:28.770381+0000","last_undegraded":"2023-10-19T12:43:28.770381+0000","last_fullsized":"2023-10-19T12:43:28.770381+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:15:34.801502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.759445+0000","last_change":"2023-10-19T12:41:23.338071+0000","last_active":"2023-10-19T12:43:27.759445+0000","last_peered":"2023-10-19T12:43:27.759445+0000","last_clean":"2023-10-19T12:43:27.759445+0000","last_became_active":"2023-10-19T12:41:23.336265+0000","last_became_peered":"2023-10-19T12:41:23.336265+0000","last_unstale":"2023-10-19T12:43:27.759445+0000","last_undegraded":"2023-10-19T12:43:27.759445+0000","last_fullsized":"2023-10-19T12:43:27.759445+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:02:53.139468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"88'7","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.765619+0000","last_change":"2023-10-19T12:41:18.293027+0000","last_active":"2023-10-19T12:43:27.765619+0000","last_peered":"2023-10-19T12:43:27.765619+0000","last_clean":"2023-10-19T12:43:27.765619+0000","last_became_active":"2023-10-19T12:41:18.289478+0000","last_became_peered":"2023-10-19T12:41:18.289478+0000","last_unstale":"2023-10-19T12:43:27.765619+0000","last_undegraded":"2023-10-19T12:43:27.765619+0000","last_fullsized":"2023-10-19T12:43:27.765619+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:26:32.986754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"90'9","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:56.692932+0000","last_change":"2023-10-19T12:41:19.293206+0000","last_active":"2023-10-19T12:42:56.692932+0000","last_peered":"2023-10-19T12:42:56.692932+0000","last_clean":"2023-10-19T12:42:56.692932+0000","last_became_active":"2023-10-19T12:41:19.292898+0000","last_became_peered":"2023-10-19T12:41:19.292898+0000","last_unstale":"2023-10-19T12:42:56.692932+0000","last_undegraded":"2023-10-19T12:42:56.692932+0000","last_fullsized":"2023-10-19T12:42:56.692932+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T23:36:17.548859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"88'1","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.763493+0000","last_change":"2023-10-19T12:41:23.343048+0000","last_active":"2023-10-19T12:43:27.763493+0000","last_peered":"2023-10-19T12:43:27.763493+0000","last_clean":"2023-10-19T12:43:27.763493+0000","last_became_active":"2023-10-19T12:41:23.342696+0000","last_became_peered":"2023-10-19T12:41:23.342696+0000","last_unstale":"2023-10-19T12:43:27.763493+0000","last_undegraded":"2023-10-19T12:43:27.763493+0000","last_fullsized":"2023-10-19T12:43:27.763493+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:30:38.858947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"88'3","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:28.121335+0000","last_change":"2023-10-19T12:41:18.293079+0000","last_active":"2023-10-19T12:42:28.121335+0000","last_peered":"2023-10-19T12:42:28.121335+0000","last_clean":"2023-10-19T12:42:28.121335+0000","last_became_active":"2023-10-19T12:41:18.292803+0000","last_became_peered":"2023-10-19T12:41:18.292803+0000","last_unstale":"2023-10-19T12:42:28.121335+0000","last_undegraded":"2023-10-19T12:42:28.121335+0000","last_fullsized":"2023-10-19T12:42:28.121335+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T22:37:14.550800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"90'8","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:56.692004+0000","last_change":"2023-10-19T12:41:19.292921+0000","last_active":"2023-10-19T12:42:56.692004+0000","last_peered":"2023-10-19T12:42:56.692004+0000","last_clean":"2023-10-19T12:42:56.692004+0000","last_became_active":"2023-10-19T12:41:19.292498+0000","last_became_peered":"2023-10-19T12:41:19.292498+0000","last_unstale":"2023-10-19T12:42:56.692004+0000","last_undegraded":"2023-10-19T12:42:56.692004+0000","last_fullsized":"2023-10-19T12:42:56.692004+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T22:02:55.878154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.763662+0000","last_change":"2023-10-19T12:41:23.477894+0000","last_active":"2023-10-19T12:43:27.763662+0000","last_peered":"2023-10-19T12:43:27.763662+0000","last_clean":"2023-10-19T12:43:27.763662+0000","last_became_active":"2023-10-19T12:41:23.477478+0000","last_became_peered":"2023-10-19T12:41:23.477478+0000","last_unstale":"2023-10-19T12:43:27.763662+0000","last_undegraded":"2023-10-19T12:43:27.763662+0000","last_fullsized":"2023-10-19T12:43:27.763662+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:44:21.730215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"88'4","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.762798+0000","last_change":"2023-10-19T12:41:18.282474+0000","last_active":"2023-10-19T12:43:27.762798+0000","last_peered":"2023-10-19T12:43:27.762798+0000","last_clean":"2023-10-19T12:43:27.762798+0000","last_became_active":"2023-10-19T12:41:18.282124+0000","last_became_peered":"2023-10-19T12:41:18.282124+0000","last_unstale":"2023-10-19T12:43:27.762798+0000","last_undegraded":"2023-10-19T12:43:27.762798+0000","last_fullsized":"2023-10-19T12:43:27.762798+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T21:27:37.530324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"90'5","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:56.681539+0000","last_change":"2023-10-19T12:41:19.302928+0000","last_active":"2023-10-19T12:42:56.681539+0000","last_peered":"2023-10-19T12:42:56.681539+0000","last_clean":"2023-10-19T12:42:56.681539+0000","last_became_active":"2023-10-19T12:41:19.302641+0000","last_became_peered":"2023-10-19T12:41:19.302641+0000","last_unstale":"2023-10-19T12:42:56.681539+0000","last_undegraded":"2023-10-19T12:42:56.681539+0000","last_fullsized":"2023-10-19T12:42:56.681539+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:07:46.333875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.124012+0000","last_change":"2023-10-19T12:41:23.329079+0000","last_active":"2023-10-19T12:42:27.124012+0000","last_peered":"2023-10-19T12:42:27.124012+0000","last_clean":"2023-10-19T12:42:27.124012+0000","last_became_active":"2023-10-19T12:41:23.328407+0000","last_became_peered":"2023-10-19T12:41:23.328407+0000","last_unstale":"2023-10-19T12:42:27.124012+0000","last_undegraded":"2023-10-19T12:42:27.124012+0000","last_fullsized":"2023-10-19T12:42:27.124012+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:46:19.404922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"90'7","reported_seq":128,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:43:25.457972+0000","last_change":"2023-10-19T12:41:18.286336+0000","last_active":"2023-10-19T12:43:25.457972+0000","last_peered":"2023-10-19T12:43:25.457972+0000","last_clean":"2023-10-19T12:43:25.457972+0000","last_became_active":"2023-10-19T12:41:18.285921+0000","last_became_peered":"2023-10-19T12:41:18.285921+0000","last_unstale":"2023-10-19T12:43:25.457972+0000","last_undegraded":"2023-10-19T12:43:25.457972+0000","last_fullsized":"2023-10-19T12:43:25.457972+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T23:16:34.842143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1701,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":103,"num_read_kb":3,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"90'7","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:56.684915+0000","last_change":"2023-10-19T12:41:19.289466+0000","last_active":"2023-10-19T12:42:56.684915+0000","last_peered":"2023-10-19T12:42:56.684915+0000","last_clean":"2023-10-19T12:42:56.684915+0000","last_became_active":"2023-10-19T12:41:19.288669+0000","last_became_peered":"2023-10-19T12:41:19.288669+0000","last_unstale":"2023-10-19T12:42:56.684915+0000","last_undegraded":"2023-10-19T12:42:56.684915+0000","last_fullsized":"2023-10-19T12:42:56.684915+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T23:31:52.163958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.768166+0000","last_change":"2023-10-19T12:41:23.343521+0000","last_active":"2023-10-19T12:43:27.768166+0000","last_peered":"2023-10-19T12:43:27.768166+0000","last_clean":"2023-10-19T12:43:27.768166+0000","last_became_active":"2023-10-19T12:41:23.342288+0000","last_became_peered":"2023-10-19T12:41:23.342288+0000","last_unstale":"2023-10-19T12:43:27.768166+0000","last_undegraded":"2023-10-19T12:43:27.768166+0000","last_fullsized":"2023-10-19T12:43:27.768166+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:58:06.810552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"88'3","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.122056+0000","last_change":"2023-10-19T12:41:18.294999+0000","last_active":"2023-10-19T12:42:27.122056+0000","last_peered":"2023-10-19T12:42:27.122056+0000","last_clean":"2023-10-19T12:42:27.122056+0000","last_became_active":"2023-10-19T12:41:18.294776+0000","last_became_peered":"2023-10-19T12:41:18.294776+0000","last_unstale":"2023-10-19T12:42:27.122056+0000","last_undegraded":"2023-10-19T12:42:27.122056+0000","last_fullsized":"2023-10-19T12:42:27.122056+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:17:53.704739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"90'6","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:56.690764+0000","last_change":"2023-10-19T12:41:19.291753+0000","last_active":"2023-10-19T12:42:56.690764+0000","last_peered":"2023-10-19T12:42:56.690764+0000","last_clean":"2023-10-19T12:42:56.690764+0000","last_became_active":"2023-10-19T12:41:19.291475+0000","last_became_peered":"2023-10-19T12:41:19.291475+0000","last_unstale":"2023-10-19T12:42:56.690764+0000","last_undegraded":"2023-10-19T12:42:56.690764+0000","last_fullsized":"2023-10-19T12:42:56.690764+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:26:38.494864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.118754+0000","last_change":"2023-10-19T12:41:23.327966+0000","last_active":"2023-10-19T12:42:27.118754+0000","last_peered":"2023-10-19T12:42:27.118754+0000","last_clean":"2023-10-19T12:42:27.118754+0000","last_became_active":"2023-10-19T12:41:23.327555+0000","last_became_peered":"2023-10-19T12:41:23.327555+0000","last_unstale":"2023-10-19T12:42:27.118754+0000","last_undegraded":"2023-10-19T12:42:27.118754+0000","last_fullsized":"2023-10-19T12:42:27.118754+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:01:34.044012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"88'5","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-19T12:42:27.125824+0000","last_change":"2023-10-19T12:41:18.297472+0000","last_active":"2023-10-19T12:42:27.125824+0000","last_peered":"2023-10-19T12:42:27.125824+0000","last_clean":"2023-10-19T12:42:27.125824+0000","last_became_active":"2023-10-19T12:41:18.296410+0000","last_became_peered":"2023-10-19T12:41:18.296410+0000","last_unstale":"2023-10-19T12:42:27.125824+0000","last_undegraded":"2023-10-19T12:42:27.125824+0000","last_fullsized":"2023-10-19T12:42:27.125824+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:20:15.039332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"90'9","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:56.681206+0000","last_change":"2023-10-19T12:41:19.295136+0000","last_active":"2023-10-19T12:42:56.681206+0000","last_peered":"2023-10-19T12:42:56.681206+0000","last_clean":"2023-10-19T12:42:56.681206+0000","last_became_active":"2023-10-19T12:41:19.294836+0000","last_became_peered":"2023-10-19T12:41:19.294836+0000","last_unstale":"2023-10-19T12:42:56.681206+0000","last_undegraded":"2023-10-19T12:42:56.681206+0000","last_fullsized":"2023-10-19T12:42:56.681206+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:08:25.830396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"90'9","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:56.678683+0000","last_change":"2023-10-19T12:41:19.290047+0000","last_active":"2023-10-19T12:42:56.678683+0000","last_peered":"2023-10-19T12:42:56.678683+0000","last_clean":"2023-10-19T12:42:56.678683+0000","last_became_active":"2023-10-19T12:41:19.289792+0000","last_became_peered":"2023-10-19T12:41:19.289792+0000","last_unstale":"2023-10-19T12:42:56.678683+0000","last_undegraded":"2023-10-19T12:42:56.678683+0000","last_fullsized":"2023-10-19T12:42:56.678683+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:10:58.981643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"90'12","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:56.676584+0000","last_change":"2023-10-19T12:41:19.287973+0000","last_active":"2023-10-19T12:42:56.676584+0000","last_peered":"2023-10-19T12:42:56.676584+0000","last_clean":"2023-10-19T12:42:56.676584+0000","last_became_active":"2023-10-19T12:41:19.287508+0000","last_became_peered":"2023-10-19T12:41:19.287508+0000","last_unstale":"2023-10-19T12:42:56.676584+0000","last_undegraded":"2023-10-19T12:42:56.676584+0000","last_fullsized":"2023-10-19T12:42:56.676584+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:25:57.815032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"90'8","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:56.679807+0000","last_change":"2023-10-19T12:41:19.294154+0000","last_active":"2023-10-19T12:42:56.679807+0000","last_peered":"2023-10-19T12:42:56.679807+0000","last_clean":"2023-10-19T12:42:56.679807+0000","last_became_active":"2023-10-19T12:41:19.293873+0000","last_became_peered":"2023-10-19T12:41:19.293873+0000","last_unstale":"2023-10-19T12:42:56.679807+0000","last_undegraded":"2023-10-19T12:42:56.679807+0000","last_fullsized":"2023-10-19T12:42:56.679807+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:29:58.428571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"90'7","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.768327+0000","last_change":"2023-10-19T12:41:19.309512+0000","last_active":"2023-10-19T12:43:27.768327+0000","last_peered":"2023-10-19T12:43:27.768327+0000","last_clean":"2023-10-19T12:43:27.768327+0000","last_became_active":"2023-10-19T12:41:19.309149+0000","last_became_peered":"2023-10-19T12:41:19.309149+0000","last_unstale":"2023-10-19T12:43:27.768327+0000","last_undegraded":"2023-10-19T12:43:27.768327+0000","last_fullsized":"2023-10-19T12:43:27.768327+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:19:34.971413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"90'4","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:56.678488+0000","last_change":"2023-10-19T12:41:19.301496+0000","last_active":"2023-10-19T12:42:56.678488+0000","last_peered":"2023-10-19T12:42:56.678488+0000","last_clean":"2023-10-19T12:42:56.678488+0000","last_became_active":"2023-10-19T12:41:19.299697+0000","last_became_peered":"2023-10-19T12:41:19.299697+0000","last_unstale":"2023-10-19T12:42:56.678488+0000","last_undegraded":"2023-10-19T12:42:56.678488+0000","last_fullsized":"2023-10-19T12:42:56.678488+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T23:51:52.448215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"90'6","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:56.671023+0000","last_change":"2023-10-19T12:41:19.289995+0000","last_active":"2023-10-19T12:42:56.671023+0000","last_peered":"2023-10-19T12:42:56.671023+0000","last_clean":"2023-10-19T12:42:56.671023+0000","last_became_active":"2023-10-19T12:41:19.289471+0000","last_became_peered":"2023-10-19T12:41:19.289471+0000","last_unstale":"2023-10-19T12:42:56.671023+0000","last_undegraded":"2023-10-19T12:42:56.671023+0000","last_fullsized":"2023-10-19T12:42:56.671023+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:28:25.801772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"90'15","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:56.676368+0000","last_change":"2023-10-19T12:41:19.287620+0000","last_active":"2023-10-19T12:42:56.676368+0000","last_peered":"2023-10-19T12:42:56.676368+0000","last_clean":"2023-10-19T12:42:56.676368+0000","last_became_active":"2023-10-19T12:41:19.287298+0000","last_became_peered":"2023-10-19T12:41:19.287298+0000","last_unstale":"2023-10-19T12:42:56.676368+0000","last_undegraded":"2023-10-19T12:42:56.676368+0000","last_fullsized":"2023-10-19T12:42:56.676368+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:01:46.919580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"90'2","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.768730+0000","last_change":"2023-10-19T12:41:19.278455+0000","last_active":"2023-10-19T12:43:27.768730+0000","last_peered":"2023-10-19T12:43:27.768730+0000","last_clean":"2023-10-19T12:43:27.768730+0000","last_became_active":"2023-10-19T12:41:19.278093+0000","last_became_peered":"2023-10-19T12:41:19.278093+0000","last_unstale":"2023-10-19T12:43:27.768730+0000","last_undegraded":"2023-10-19T12:43:27.768730+0000","last_fullsized":"2023-10-19T12:43:27.768730+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T22:52:00.939409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"90'6","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:56.690255+0000","last_change":"2023-10-19T12:41:19.294478+0000","last_active":"2023-10-19T12:42:56.690255+0000","last_peered":"2023-10-19T12:42:56.690255+0000","last_clean":"2023-10-19T12:42:56.690255+0000","last_became_active":"2023-10-19T12:41:19.294136+0000","last_became_peered":"2023-10-19T12:41:19.294136+0000","last_unstale":"2023-10-19T12:42:56.690255+0000","last_undegraded":"2023-10-19T12:42:56.690255+0000","last_fullsized":"2023-10-19T12:42:56.690255+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:18:20.066346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"90'8","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:56.693840+0000","last_change":"2023-10-19T12:41:19.283014+0000","last_active":"2023-10-19T12:42:56.693840+0000","last_peered":"2023-10-19T12:42:56.693840+0000","last_clean":"2023-10-19T12:42:56.693840+0000","last_became_active":"2023-10-19T12:41:19.279958+0000","last_became_peered":"2023-10-19T12:41:19.279958+0000","last_unstale":"2023-10-19T12:42:56.693840+0000","last_undegraded":"2023-10-19T12:42:56.693840+0000","last_fullsized":"2023-10-19T12:42:56.693840+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-21T00:26:13.329031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"90'10","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:56.693671+0000","last_change":"2023-10-19T12:41:19.296507+0000","last_active":"2023-10-19T12:42:56.693671+0000","last_peered":"2023-10-19T12:42:56.693671+0000","last_clean":"2023-10-19T12:42:56.693671+0000","last_became_active":"2023-10-19T12:41:19.295960+0000","last_became_peered":"2023-10-19T12:41:19.295960+0000","last_unstale":"2023-10-19T12:42:56.693671+0000","last_undegraded":"2023-10-19T12:42:56.693671+0000","last_fullsized":"2023-10-19T12:42:56.693671+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T22:49:06.224425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"90'11","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:56.689554+0000","last_change":"2023-10-19T12:41:19.300262+0000","last_active":"2023-10-19T12:42:56.689554+0000","last_peered":"2023-10-19T12:42:56.689554+0000","last_clean":"2023-10-19T12:42:56.689554+0000","last_became_active":"2023-10-19T12:41:19.299702+0000","last_became_peered":"2023-10-19T12:41:19.299702+0000","last_unstale":"2023-10-19T12:42:56.689554+0000","last_undegraded":"2023-10-19T12:42:56.689554+0000","last_fullsized":"2023-10-19T12:42:56.689554+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:30:22.690228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"90'8","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:56.675950+0000","last_change":"2023-10-19T12:41:19.289863+0000","last_active":"2023-10-19T12:42:56.675950+0000","last_peered":"2023-10-19T12:42:56.675950+0000","last_clean":"2023-10-19T12:42:56.675950+0000","last_became_active":"2023-10-19T12:41:19.289556+0000","last_became_peered":"2023-10-19T12:41:19.289556+0000","last_unstale":"2023-10-19T12:42:56.675950+0000","last_undegraded":"2023-10-19T12:42:56.675950+0000","last_fullsized":"2023-10-19T12:42:56.675950+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:17:18.560081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":67959,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1031,"num_read_kb":590,"num_write":248,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":1204,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":204193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":216,"ondisk_log_size":216,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":79,"seq":339302416423,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1019904,"data_stored":495261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 19 12:42:35 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.86699999999999999,"15min":0.91500000000000004},"min":{"1min":0.39600000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.84399999999999997,"5min":8.5449999999999999,"15min":8.5449999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.84499999999999997,"15min":0.88500000000000001},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.90700000000000003,"5min":7.641,"15min":7.641},"last":0.52500000000000002}]},{"osd":1,"last update":"Thu Oct 19 12:42:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.70499999999999996,"15min":0.71299999999999997},"min":{"1min":0.49299999999999999,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.85099999999999998,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.70799999999999996,"15min":0.71199999999999997},"min":{"1min":0.47299999999999998,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.83699999999999997,"5min":1.883,"15min":1.883},"last":0.69199999999999995}]},{"osd":2,"last update":"Thu Oct 19 12:42:35 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.54800000000000004,"15min":0.55700000000000005},"min":{"1min":0.39600000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.64700000000000002,"5min":1.496,"15min":1.496},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.55300000000000005,"15min":0.55100000000000005},"min":{"1min":0.35499999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.92700000000000005,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.83499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":4,"last update":"Thu Oct 19 12:42:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.83499999999999996,"15min":0.85499999999999998},"min":{"1min":0.57099999999999995,"5min":0.495,"15min":0.495},"max":{"1min":0.95499999999999996,"5min":3.5190000000000001,"15min":3.5190000000000001},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.75700000000000001,"15min":0.76900000000000002},"min":{"1min":0.55700000000000005,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.90200000000000002,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.76300000000000001}]},{"osd":5,"last update":"Thu Oct 19 12:42:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63900000000000001,"15min":0.64000000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.02,"5min":1.675,"15min":1.675},"last":0.623},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.69599999999999995,"15min":0.69799999999999995},"min":{"1min":0.45800000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0920000000000001,"5min":2.089,"15min":2.089},"last":0.86699999999999999}]},{"osd":6,"last update":"Thu Oct 19 12:42:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.75700000000000001,"15min":0.76400000000000001},"min":{"1min":0.48899999999999999,"5min":0.438,"15min":0.438},"max":{"1min":1.0609999999999999,"5min":2.004,"15min":2.004},"last":0.877},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.75900000000000001,"15min":0.76700000000000002},"min":{"1min":0.51100000000000001,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.641,"5min":1.704,"15min":1.704},"last":0.74299999999999999}]},{"osd":7,"last update":"Thu Oct 19 12:42:35 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":1.0029999999999999,"15min":1.0449999999999999},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.98199999999999998,"5min":6.5590000000000002,"15min":6.5590000000000002},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.78500000000000003,"5min":1.0620000000000001,"15min":1.1080000000000001},"min":{"1min":0.60099999999999998,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.99199999999999999,"5min":7.3070000000000004,"15min":7.3070000000000004},"last":0.89800000000000002}]},{"osd":8,"last update":"Thu Oct 19 12:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.753,"15min":0.75700000000000001},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.94699999999999995,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.70899999999999996,"15min":0.70699999999999996},"min":{"1min":0.53500000000000003,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.66900000000000004}]},{"osd":9,"last update":"Thu Oct 19 12:42:35 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":1.0529999999999999,"15min":1.095},"min":{"1min":0.60899999999999999,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.96999999999999997,"5min":7.8440000000000003,"15min":7.8440000000000003},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.96799999999999997,"15min":0.99199999999999999},"min":{"1min":0.621,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.0269999999999999,"5min":5.0860000000000003,"15min":5.0860000000000003},"last":0.91000000000000003}]},{"osd":10,"last update":"Thu Oct 19 12:42:35 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":1.0920000000000001,"15min":1.1299999999999999},"min":{"1min":0.72899999999999998,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.0269999999999999,"5min":7.2619999999999996,"15min":7.2619999999999996},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.81299999999999994,"5min":1.085,"15min":1.1299999999999999},"min":{"1min":0.65600000000000003,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.008,"5min":7.7619999999999996,"15min":7.7619999999999996},"last":0.77900000000000003}]}]},{"osd":10,"up_from":72,"seq":309237645354,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28680,"kb_used_data":1664,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716472,"statfs":{"total":95995035648,"available":95965667328,"internally_reserved":0,"allocated":1703936,"data_stored":1141323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 19 12:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.61199999999999999,"15min":0.57199999999999995},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":5.8819999999999997,"5min":5.8819999999999997,"15min":5.8819999999999997},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.55600000000000005,"15min":0.55000000000000004},"min":{"1min":0.39900000000000002,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.78100000000000003}]},{"osd":1,"last update":"Thu Oct 19 12:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.44900000000000001,"15min":0.45600000000000002},"min":{"1min":0.29699999999999999,"5min":0.254,"15min":0.254},"max":{"1min":0.57199999999999995,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.32200000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.61299999999999999,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.59699999999999998}]},{"osd":2,"last update":"Thu Oct 19 12:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.68200000000000005,"15min":0.69699999999999995},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.78800000000000003,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.68600000000000005,"15min":0.70999999999999996},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.77300000000000002,"5min":2.2050000000000001,"15min":2.2050000000000001},"last":0.88}]},{"osd":3,"last update":"Thu Oct 19 12:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.63600000000000001,"15min":0.65500000000000003},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.83999999999999997,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.70799999999999996,"15min":0.68100000000000005},"min":{"1min":0.47399999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":5.9109999999999996,"5min":5.9109999999999996,"15min":5.9109999999999996},"last":0.85499999999999998}]},{"osd":4,"last update":"Thu Oct 19 12:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.56999999999999995,"15min":0.57499999999999996},"min":{"1min":0.41099999999999998,"5min":0.37,"15min":0.37},"max":{"1min":0.68700000000000006,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.56299999999999994,"15min":0.56999999999999995},"min":{"1min":0.33700000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.75700000000000001,"5min":0.999,"15min":0.999},"last":0.57199999999999995}]},{"osd":5,"last update":"Thu Oct 19 12:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.79700000000000004,"15min":0.83499999999999996},"min":{"1min":0.45700000000000002,"5min":0.434,"15min":0.434},"max":{"1min":0.92500000000000004,"5min":2.3940000000000001,"15min":2.3940000000000001},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.755,"15min":0.77600000000000002},"min":{"1min":0.54200000000000004,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.88500000000000001,"5min":2.2530000000000001,"15min":2.2530000000000001},"last":0.98499999999999999}]},{"osd":6,"last update":"Thu Oct 19 12:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.74299999999999999,"15min":0.76100000000000001},"min":{"1min":0.46200000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.92200000000000004,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.95799999999999996},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.75900000000000001,"15min":0.76400000000000001},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.93300000000000005,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.92700000000000005}]},{"osd":7,"last update":"Thu Oct 19 12:41:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":1.046}]},{"osd":8,"last update":"Thu Oct 19 12:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.81399999999999995,"15min":0.84499999999999997},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.82199999999999995,"5min":2.012,"15min":2.012},"last":1.0069999999999999},{"interface":"front","average":{"1min":0.754,"5min":0.86699999999999999,"15min":0.90700000000000003},"min":{"1min":0.53100000000000003,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.95999999999999996,"5min":2.2290000000000001,"15min":2.2290000000000001},"last":0.94399999999999995}]},{"osd":9,"last update":"Thu Oct 19 12:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.80700000000000005,"15min":0.81399999999999995},"min":{"1min":0.61099999999999999,"5min":0.5,"15min":0.5},"max":{"1min":0.97199999999999998,"5min":1.262,"15min":1.262},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":2.032,"5min":2.032,"15min":2.032},"last":0.89800000000000002}]},{"osd":11,"last update":"Thu Oct 19 12:42:35 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76200000000000001,"15min":0.76100000000000001},"min":{"1min":0.56599999999999995,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":1.024},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.76200000000000001,"15min":0.754},"min":{"1min":0.59699999999999998,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":1.0469999999999999}]}]},{"osd":9,"up_from":67,"seq":287762808879,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28056,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717096,"statfs":{"total":95995035648,"available":95966306304,"internally_reserved":0,"allocated":1060864,"data_stored":508048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 19 12:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.55200000000000005,"15min":0.57899999999999996},"min":{"1min":0.39200000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.502,"5min":0.55000000000000004,"15min":0.57199999999999995},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.63600000000000001,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.60599999999999998}]},{"osd":1,"last update":"Thu Oct 19 12:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.76600000000000001,"15min":0.79400000000000004},"min":{"1min":0.58199999999999996,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.79100000000000004,"15min":0.78300000000000003},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":6.9279999999999999,"5min":6.9279999999999999,"15min":6.9279999999999999},"last":0.58099999999999996}]},{"osd":2,"last update":"Thu Oct 19 12:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.80800000000000005,"15min":0.79400000000000004},"min":{"1min":0.57399999999999995,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":6.9420000000000002,"5min":6.9420000000000002,"15min":6.9420000000000002},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.76000000000000001,"15min":0.77400000000000002},"min":{"1min":0.49099999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.24,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.70499999999999996}]},{"osd":3,"last update":"Thu Oct 19 12:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.71899999999999997,"15min":0.75900000000000001},"min":{"1min":0.46700000000000003,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.0529999999999999,"5min":1.196,"15min":1.196},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.80300000000000005,"15min":0.84699999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.1950000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.72299999999999998}]},{"osd":4,"last update":"Thu Oct 19 12:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.80100000000000005,"15min":0.84499999999999997},"min":{"1min":0.53900000000000003,"5min":0.495,"15min":0.495},"max":{"1min":0.94299999999999995,"5min":1.125,"15min":1.125},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.80400000000000005,"15min":0.83799999999999997},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.95299999999999996,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.53800000000000003}]},{"osd":5,"last update":"Thu Oct 19 12:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.84799999999999998,"15min":0.88900000000000001},"min":{"1min":0.58999999999999997,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0429999999999999,"5min":1.141,"15min":1.141},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.83199999999999996,"15min":0.85799999999999998},"min":{"1min":0.55200000000000005,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":0.86099999999999999}]},{"osd":6,"last update":"Thu Oct 19 12:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.48299999999999998}]},{"osd":7,"last update":"Thu Oct 19 12:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.89200000000000002,"15min":0.93000000000000005},"min":{"1min":0.53200000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.097,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.628},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.95399999999999996,"15min":1.0089999999999999},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.4370000000000001,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":0.78700000000000003}]},{"osd":8,"last update":"Thu Oct 19 12:42:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.0089999999999999,"15min":1.0349999999999999},"min":{"1min":0.61799999999999999,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":6.992,"5min":6.992,"15min":6.992},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.871,"5min":0.93500000000000005,"15min":0.97199999999999998},"min":{"1min":0.61299999999999999,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":0.90700000000000003}]},{"osd":10,"last update":"Thu Oct 19 12:43:13 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.93100000000000005,"15min":0.98299999999999998},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.0680000000000001,"5min":1.248,"15min":1.248},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.94099999999999995,"15min":0.96799999999999997},"min":{"1min":0.65500000000000003,"5min":0.624,"15min":0.624},"max":{"1min":1.1359999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.76900000000000002}]},{"osd":11,"last update":"Thu Oct 19 12:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.95099999999999996,"15min":0.96099999999999997},"min":{"1min":0.72599999999999998,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.097,"5min":1.526,"15min":1.526},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.89100000000000001,"15min":0.90100000000000002},"min":{"1min":0.63,"5min":0.629,"15min":0.629},"max":{"1min":1.2050000000000001,"5min":1.393,"15min":1.393},"last":0.83099999999999996}]}]},{"osd":8,"up_from":59,"seq":253403070515,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28064,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717088,"statfs":{"total":95995035648,"available":95966298112,"internally_reserved":0,"allocated":1064960,"data_stored":513670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 19 12:43:29 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.59699999999999998,"15min":0.60399999999999998},"min":{"1min":0.434,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.752,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.75},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.60699999999999998,"15min":0.59699999999999998},"min":{"1min":0.48399999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.80500000000000005,"5min":0.872,"15min":0.872},"last":0.60799999999999998}]},{"osd":1,"last update":"Thu Oct 19 12:42:28 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.621,"15min":0.60399999999999998},"min":{"1min":0.504,"5min":0.378,"15min":0.378},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.61299999999999999,"15min":0.58999999999999997},"min":{"1min":0.51500000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.91000000000000003}]},{"osd":2,"last update":"Thu Oct 19 12:43:29 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.504,"15min":0.47799999999999998},"min":{"1min":0.38700000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.498},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.505,"15min":0.47599999999999998},"min":{"1min":0.42099999999999999,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.70499999999999996,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.52800000000000002}]},{"osd":3,"last update":"Thu Oct 19 12:43:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.65300000000000002,"15min":0.63800000000000001},"min":{"1min":0.56299999999999994,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.876,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.64200000000000002,"15min":0.65200000000000002},"min":{"1min":0.45000000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.622}]},{"osd":4,"last update":"Thu Oct 19 12:43:29 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.70899999999999996,"15min":0.69999999999999996},"min":{"1min":0.56299999999999994,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.95299999999999996,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.70699999999999996,"15min":0.66800000000000004},"min":{"1min":0.64700000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.68799999999999994}]},{"osd":5,"last update":"Thu Oct 19 12:43:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.59299999999999997,"15min":0.56699999999999995},"min":{"1min":0.47899999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.63300000000000001,"15min":0.621},"min":{"1min":0.35899999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.92100000000000004,"5min":1.01,"15min":1.01},"last":0.66200000000000003}]},{"osd":6,"last update":"Thu Oct 19 12:43:29 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.76200000000000001,"15min":0.73699999999999999},"min":{"1min":0.70099999999999996,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.1399999999999999,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.748,"15min":0.72599999999999998},"min":{"1min":0.67100000000000004,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.79400000000000004}]},{"osd":7,"last update":"Thu Oct 19 12:43:29 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.79100000000000004,"15min":0.753},"min":{"1min":0.58299999999999996,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.107,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.88,"5min":0.79300000000000004,"15min":0.77900000000000003},"min":{"1min":0.64200000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.98799999999999999,"5min":1.113,"15min":1.113},"last":0.93300000000000005}]},{"osd":9,"last update":"Thu Oct 19 12:42:56 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.80200000000000005,"15min":0.77000000000000002},"min":{"1min":0.67500000000000004,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":2.4129999999999998,"5min":2.4129999999999998,"15min":2.4129999999999998},"last":0.872},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.83499999999999996,"15min":0.80000000000000004},"min":{"1min":0.76900000000000002,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":2.4300000000000002,"5min":2.4300000000000002,"15min":2.4300000000000002},"last":0.90600000000000003}]},{"osd":10,"last update":"Thu Oct 19 12:43:18 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.76200000000000001,"15min":0.71499999999999997},"min":{"1min":0.56200000000000006,"5min":0.434,"15min":0.434},"max":{"1min":1.0189999999999999,"5min":1.145,"15min":1.145},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.81200000000000006,"15min":0.77400000000000002},"min":{"1min":0.59699999999999998,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.96399999999999997}]},{"osd":11,"last update":"Thu Oct 19 12:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.88,"15min":0.871},"min":{"1min":0.74099999999999999,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.84399999999999997,"15min":0.84199999999999997},"min":{"1min":0.68500000000000005,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.88800000000000001}]}]},{"osd":7,"up_from":51,"seq":219043332152,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28612,"kb_used_data":1596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716540,"statfs":{"total":95995035648,"available":95965736960,"internally_reserved":0,"allocated":1634304,"data_stored":1090878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 19 12:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.61899999999999999,"15min":0.60899999999999999},"min":{"1min":0.434,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.56699999999999995,"15min":0.56299999999999994},"min":{"1min":0.46400000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.76600000000000001,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.45400000000000001}]},{"osd":1,"last update":"Thu Oct 19 12:43:07 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.41999999999999998,"15min":0.40799999999999997},"min":{"1min":0.29999999999999999,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.52300000000000002,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.44500000000000001,"15min":0.42999999999999999},"min":{"1min":0.27800000000000002,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.48999999999999999}]},{"osd":2,"last update":"Thu Oct 19 12:43:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.60799999999999998,"15min":0.59999999999999998},"min":{"1min":0.378,"5min":0.314,"15min":0.314},"max":{"1min":0.79300000000000004,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60199999999999998,"15min":0.61399999999999999},"min":{"1min":0.42599999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.76300000000000001,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.57599999999999996}]},{"osd":3,"last update":"Thu Oct 19 12:43:07 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.63900000000000001,"15min":0.63100000000000001},"min":{"1min":0.47199999999999998,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.81899999999999995,"5min":0.877,"15min":0.877},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.59699999999999998,"15min":0.60799999999999998},"min":{"1min":0.46200000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.83299999999999996,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.46600000000000003}]},{"osd":4,"last update":"Thu Oct 19 12:43:07 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.51000000000000001,"15min":0.504},"min":{"1min":0.34799999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.63900000000000001,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.5,"15min":0.48599999999999999},"min":{"1min":0.33100000000000002,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.745,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.40999999999999998}]},{"osd":5,"last update":"Thu Oct 19 12:43:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.68600000000000005,"15min":0.67800000000000005},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.86099999999999999,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.65000000000000002,"15min":0.64000000000000001},"min":{"1min":0.49199999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.626}]},{"osd":6,"last update":"Thu Oct 19 12:43:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.71899999999999997,"15min":0.72499999999999998},"min":{"1min":0.57199999999999995,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.81499999999999995,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.66500000000000004,"15min":0.66600000000000004},"min":{"1min":0.52600000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.91600000000000004,"5min":1.006,"15min":1.006},"last":0.56399999999999995}]},{"osd":8,"last update":"Thu Oct 19 12:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.72799999999999998,"15min":0.72399999999999998},"min":{"1min":0.61399999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.88200000000000001,"5min":1.002,"15min":1.002},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.69999999999999996,"15min":0.68799999999999994},"min":{"1min":0.56000000000000005,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.74099999999999999}]},{"osd":9,"last update":"Thu Oct 19 12:42:56 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.79900000000000004,"15min":0.78600000000000003},"min":{"1min":0.63,"5min":0.504,"15min":0.504},"max":{"1min":0.90000000000000002,"5min":2.9780000000000002,"15min":2.9780000000000002},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.74099999999999999,"15min":0.751},"min":{"1min":0.58699999999999997,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.94499999999999995,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.77100000000000002}]},{"osd":10,"last update":"Thu Oct 19 12:43:15 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.68100000000000005,"15min":0.68300000000000005},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.91300000000000003,"5min":1.044,"15min":1.044},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.751,"15min":0.753},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.93100000000000005,"5min":1.024,"15min":1.024},"last":0.75600000000000001}]},{"osd":11,"last update":"Thu Oct 19 12:43:19 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82599999999999996,"15min":0.82699999999999996},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":0.94099999999999995,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.71399999999999997,"15min":0.71499999999999997},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.69999999999999996}]}]},{"osd":6,"up_from":46,"seq":197568495676,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1015808,"data_stored":489582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 19 12:42:51 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.52900000000000003,"15min":0.497},"min":{"1min":0.41399999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":0.44},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.55000000000000004,"15min":0.55200000000000005},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.47399999999999998}]},{"osd":1,"last update":"Thu Oct 19 12:42:51 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.68000000000000005,"15min":0.63400000000000001},"min":{"1min":0.47499999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":3.4430000000000001,"5min":3.4430000000000001,"15min":3.4430000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.73599999999999999,"15min":0.68799999999999994},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.841,"5min":1.841,"15min":1.841},"last":0.76800000000000002}]},{"osd":2,"last update":"Thu Oct 19 12:42:51 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.72599999999999998,"15min":0.69199999999999995},"min":{"1min":0.54000000000000004,"5min":0.437,"15min":0.437},"max":{"1min":3.5110000000000001,"5min":3.5110000000000001,"15min":3.5110000000000001},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.67900000000000005,"15min":0.66200000000000003},"min":{"1min":0.39200000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.63400000000000001}]},{"osd":3,"last update":"Thu Oct 19 12:42:51 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.61899999999999999,"15min":0.627},"min":{"1min":0.40799999999999997,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.92700000000000005,"5min":1.131,"15min":1.131},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.71299999999999997,"15min":0.70699999999999996},"min":{"1min":0.53800000000000003,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.631,"5min":1.631,"15min":1.631},"last":0.66600000000000004}]},{"osd":4,"last update":"Thu Oct 19 12:42:51 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.78400000000000003,"15min":0.77600000000000002},"min":{"1min":0.58299999999999996,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.768,"5min":1.768,"15min":1.768},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.80100000000000005,"15min":0.79100000000000004},"min":{"1min":0.56299999999999994,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":3.4900000000000002,"5min":3.4900000000000002,"15min":3.4900000000000002},"last":0.85499999999999998}]},{"osd":5,"last update":"Thu Oct 19 12:42:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":0.87,"15min":0.82799999999999996},"min":{"1min":0.57999999999999996,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":3.4710000000000001,"5min":3.4710000000000001,"15min":3.4710000000000001},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.82899999999999996,"15min":0.82799999999999996},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.655,"5min":1.655,"15min":1.655},"last":0.84399999999999997}]},{"osd":7,"last update":"Thu Oct 19 12:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.85499999999999998,"15min":0.81899999999999995},"min":{"1min":0.61199999999999999,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.3919999999999999,"5min":1.879,"15min":1.879},"last":0.87},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.86099999999999999,"15min":0.85199999999999998},"min":{"1min":0.55300000000000005,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.097,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":0.82499999999999996}]},{"osd":8,"last update":"Thu Oct 19 12:42:31 2023","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":0.90400000000000003,"15min":0.89400000000000002},"min":{"1min":0.61199999999999999,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.7210000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.133,"5min":0.94199999999999995,"15min":0.92200000000000004},"min":{"1min":0.79200000000000004,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":3.5600000000000001,"5min":3.5600000000000001,"15min":3.5600000000000001},"last":0.86399999999999999}]},{"osd":9,"last update":"Thu Oct 19 12:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.84599999999999997,"15min":0.85899999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.107,"5min":1.216,"15min":1.216},"last":0.89300000000000002},{"interface":"front","average":{"1min":1.006,"5min":0.98399999999999999,"15min":1},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.9239999999999999,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":1}]},{"osd":10,"last update":"Thu Oct 19 12:43:19 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":1.01,"15min":1.018},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.47,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":1.042},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.96799999999999997,"15min":0.97199999999999998},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.3200000000000001,"5min":1.8640000000000001,"15min":1.8640000000000001},"last":0.94199999999999995}]},{"osd":11,"last update":"Thu Oct 19 12:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":1.0109999999999999,"15min":1.0189999999999999},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.198,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.89200000000000002,"15min":0.89800000000000002},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.109,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.91700000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574931,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28080,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717072,"statfs":{"total":95995035648,"available":95966281728,"internally_reserved":0,"allocated":1089536,"data_stored":552240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 19 12:42:59 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.64600000000000002,"15min":0.59299999999999997},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.77300000000000002,"5min":8.4559999999999995,"15min":8.4559999999999995},"last":0.437},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.60899999999999999,"15min":0.57399999999999995},"min":{"1min":0.42199999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.52700000000000002}]},{"osd":2,"last update":"Thu Oct 19 12:43:15 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.56999999999999995,"15min":0.60199999999999998},"min":{"1min":0.47499999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.872,"5min":0.872,"15min":4.1710000000000003},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.60599999999999998,"15min":0.53100000000000003},"min":{"1min":0.52500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.87,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.41299999999999998}]},{"osd":3,"last update":"Thu Oct 19 12:42:38 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.61399999999999999,"15min":0.59199999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.86299999999999999,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.56999999999999995,"15min":0.56000000000000005},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.48199999999999998}]},{"osd":4,"last update":"Thu Oct 19 12:43:08 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.44900000000000001,"15min":0.40999999999999998},"min":{"1min":0.26900000000000002,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.73699999999999999,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.371},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.45700000000000002,"15min":0.41299999999999998},"min":{"1min":0.30499999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.77300000000000002,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.60599999999999998}]},{"osd":5,"last update":"Thu Oct 19 12:43:24 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.55800000000000005,"15min":0.54100000000000004},"min":{"1min":0.42199999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.621},{"interface":"front","average":{"1min":0.752,"5min":0.65000000000000002,"15min":0.58799999999999997},"min":{"1min":0.51400000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.91000000000000003,"5min":1.03,"15min":1.03},"last":0.78800000000000003}]},{"osd":6,"last update":"Thu Oct 19 12:42:52 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.71599999999999997,"15min":0.69599999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.97799999999999998,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.622,"5min":0.78100000000000003,"15min":0.92700000000000005},"min":{"1min":0.432,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.86199999999999999,"5min":8.4039999999999999,"15min":8.4039999999999999},"last":0.56299999999999994}]},{"osd":7,"last update":"Thu Oct 19 12:43:09 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.63900000000000001,"15min":0.61899999999999999},"min":{"1min":0.42799999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.94499999999999995,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.79800000000000004,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.65100000000000002}]},{"osd":8,"last update":"Thu Oct 19 12:42:28 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.64400000000000002,"15min":0.628},"min":{"1min":0.51100000000000001,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.93799999999999994,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.752,"15min":0.73799999999999999},"min":{"1min":0.57999999999999996,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0409999999999999,"5min":1.117,"15min":1.117},"last":0.67600000000000005}]},{"osd":9,"last update":"Thu Oct 19 12:42:59 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.71099999999999997,"15min":0.70899999999999996},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.90900000000000003,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.748,"15min":0.74199999999999999},"min":{"1min":0.54800000000000004,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.66300000000000003}]},{"osd":10,"last update":"Thu Oct 19 12:43:15 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68899999999999995,"15min":0.67500000000000004},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.85999999999999999,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.77800000000000002,"15min":0.75800000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0129999999999999,"5min":1.099,"15min":1.099},"last":0.81000000000000005}]},{"osd":11,"last update":"Thu Oct 19 12:43:24 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.81399999999999995,"15min":0.81699999999999995},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.95799999999999996,"5min":1.022,"15min":1.022},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.89500000000000002,"15min":0.89700000000000002},"min":{"1min":0.66600000000000004,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.048,"5min":1.125,"15min":1.125},"last":0.83499999999999996}]}]},{"osd":0,"up_from":8,"seq":34359738457,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28072,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717080,"statfs":{"total":95995035648,"available":95966289920,"internally_reserved":0,"allocated":1073152,"data_stored":511365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Oct 19 12:42:51 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.63700000000000001,"15min":0.57699999999999996},"min":{"1min":0.42499999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.88900000000000001,"5min":1.405,"15min":1.405},"last":4.6349999999999998},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.70199999999999996,"15min":0.59599999999999997},"min":{"1min":0.45200000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":5.4880000000000004,"5min":5.4880000000000004,"15min":5.4880000000000004},"last":1.4850000000000001}]},{"osd":2,"last update":"Thu Oct 19 12:43:19 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.71799999999999997,"15min":0.64000000000000001},"min":{"1min":0.439,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":5.54,"5min":5.54,"15min":5.54},"last":2.1139999999999999},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.67600000000000005,"15min":0.58999999999999997},"min":{"1min":0.45400000000000001,"5min":0.379,"15min":0.379},"max":{"1min":1.075,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":5.1500000000000004}]},{"osd":3,"last update":"Thu Oct 19 12:43:22 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.502,"15min":0.5},"min":{"1min":0.40100000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.69499999999999995,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":4.7430000000000003},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.64100000000000001,"15min":0.63900000000000001},"min":{"1min":0.52900000000000003,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.85799999999999998,"5min":1.145,"15min":1.145},"last":5.0279999999999996}]},{"osd":4,"last update":"Thu Oct 19 12:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.70599999999999996,"15min":0.64900000000000002},"min":{"1min":0.50600000000000001,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":2.7269999999999999,"5min":2.7269999999999999,"15min":2.7269999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.68500000000000005,"15min":0.64300000000000002},"min":{"1min":0.46800000000000003,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":2.2069999999999999,"5min":2.2069999999999999,"15min":2.2069999999999999},"last":4.7629999999999999}]},{"osd":5,"last update":"Thu Oct 19 12:43:22 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.73399999999999999,"15min":0.68200000000000005},"min":{"1min":0.46999999999999997,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.091,"5min":2.8300000000000001,"15min":2.8300000000000001},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.73099999999999998,"15min":0.70099999999999996},"min":{"1min":0.52300000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.97899999999999998,"5min":2.145,"15min":2.145},"last":2.0680000000000001}]},{"osd":6,"last update":"Thu Oct 19 12:42:47 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.71099999999999997,"15min":0.67400000000000004},"min":{"1min":0.434,"5min":0.375,"15min":0.375},"max":{"1min":2.2930000000000001,"5min":2.2930000000000001,"15min":2.2930000000000001},"last":4.9340000000000002},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.70699999999999996,"15min":0.66600000000000004},"min":{"1min":0.51000000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.081,"5min":1.6160000000000001,"15min":1.6160000000000001},"last":4.7830000000000004}]},{"osd":7,"last update":"Thu Oct 19 12:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.83699999999999997,"15min":0.81299999999999994},"min":{"1min":0.57299999999999995,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":4.6929999999999996,"5min":4.6929999999999996,"15min":4.6929999999999996},"last":4.6929999999999996},{"interface":"front","average":{"1min":0.80000000000000004,"5min":1.075,"15min":1.121},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.2729999999999999,"5min":5.524,"15min":5.524},"last":0.52600000000000002}]},{"osd":8,"last update":"Thu Oct 19 12:42:29 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.89900000000000002,"15min":0.83099999999999996},"min":{"1min":0.61299999999999999,"5min":0.503,"15min":0.503},"max":{"1min":2.7949999999999999,"5min":6.8730000000000002,"15min":6.8730000000000002},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.84599999999999997,"15min":0.83499999999999996},"min":{"1min":0.60099999999999998,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":2.1760000000000002,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":4.835}]},{"osd":9,"last update":"Thu Oct 19 12:42:56 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.80500000000000005,"15min":0.76900000000000002},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":2.6309999999999998,"5min":2.6309999999999998,"15min":2.6309999999999998},"last":4.9109999999999996},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.876,"15min":0.85799999999999998},"min":{"1min":0.46899999999999997,"5min":0.442,"15min":0.442},"max":{"1min":2.9359999999999999,"5min":2.9359999999999999,"15min":2.9359999999999999},"last":4.6680000000000001}]},{"osd":10,"last update":"Thu Oct 19 12:43:19 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.024,"15min":0.99199999999999999},"min":{"1min":0.70099999999999996,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":5.5540000000000003,"5min":5.5540000000000003,"15min":5.5540000000000003},"last":1.5429999999999999},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.95199999999999996,"15min":0.96599999999999997},"min":{"1min":0.69699999999999995,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.292,"5min":2.2639999999999998,"15min":2.2639999999999998},"last":4.8879999999999999}]},{"osd":11,"last update":"Thu Oct 19 12:42:36 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.84599999999999997,"15min":0.84299999999999997},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.1160000000000001,"5min":1.22,"15min":1.22},"last":4.9889999999999999},{"interface":"front","average":{"1min":1.036,"5min":0.95199999999999996,"15min":0.93799999999999994},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":2.907,"5min":2.907,"15min":2.907},"last":0.59399999999999997}]}]},{"osd":2,"up_from":18,"seq":77309411408,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28084,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717068,"statfs":{"total":95995035648,"available":95966277632,"internally_reserved":0,"allocated":1093632,"data_stored":551747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 19 12:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.57099999999999995,"15min":0.56799999999999995},"min":{"1min":0.439,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.68999999999999995,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.624,"15min":0.57999999999999996},"min":{"1min":0.36799999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.3520000000000001,"5min":6.726,"15min":6.726},"last":0.58399999999999996}]},{"osd":1,"last update":"Thu Oct 19 12:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.60899999999999999,"15min":0.56499999999999995},"min":{"1min":0.32400000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.85599999999999998,"5min":1.081,"15min":1.081},"last":1.042},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.61899999999999999,"15min":0.57299999999999995},"min":{"1min":0.38400000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.99199999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.88}]},{"osd":3,"last update":"Thu Oct 19 12:42:39 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.60799999999999998,"15min":0.58999999999999997},"min":{"1min":0.48799999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.90300000000000002,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.58199999999999996,"15min":0.59899999999999998},"min":{"1min":0.39600000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.76000000000000001,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.54400000000000004}]},{"osd":4,"last update":"Thu Oct 19 12:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.71599999999999997,"15min":0.72199999999999998},"min":{"1min":0.51200000000000001,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.70399999999999996,"15min":0.71899999999999997},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.76300000000000001,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.68100000000000005}]},{"osd":5,"last update":"Thu Oct 19 12:42:27 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.47999999999999998,"15min":0.44900000000000001},"min":{"1min":0.29999999999999999,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.72699999999999998,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.50800000000000001,"15min":0.47299999999999998},"min":{"1min":0.35499999999999998,"5min":0.25,"15min":0.25},"max":{"1min":0.92900000000000005,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.89700000000000002}]},{"osd":6,"last update":"Thu Oct 19 12:42:47 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.67600000000000005,"15min":0.64600000000000002},"min":{"1min":0.55600000000000005,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.91000000000000003,"5min":1.042,"15min":1.042},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67200000000000004,"15min":0.66200000000000003},"min":{"1min":0.44600000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.88100000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.755}]},{"osd":7,"last update":"Thu Oct 19 12:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.79900000000000004,"15min":0.80700000000000005},"min":{"1min":0.59399999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":0.97399999999999998,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.97399999999999998},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.81299999999999994,"15min":0.81899999999999995},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":0.996,"5min":1.016,"15min":1.016},"last":0.996}]},{"osd":8,"last update":"Thu Oct 19 12:42:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.65600000000000003,"15min":0.66000000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.94699999999999995,"5min":1.429,"15min":1.429},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.67900000000000005,"15min":0.67000000000000004},"min":{"1min":0.45000000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.002,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.73099999999999998}]},{"osd":9,"last update":"Thu Oct 19 12:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.77700000000000002,"15min":0.747},"min":{"1min":0.54600000000000004,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.077,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.748,"15min":0.72299999999999998},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.81499999999999995}]},{"osd":10,"last update":"Thu Oct 19 12:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.73599999999999999,"15min":0.71299999999999997},"min":{"1min":0.498,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.88900000000000001,"5min":0.997,"15min":0.997},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.78600000000000003,"15min":0.74399999999999999},"min":{"1min":0.63600000000000001,"5min":0.504,"15min":0.504},"max":{"1min":1.0509999999999999,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":1.0149999999999999}]},{"osd":11,"last update":"Thu Oct 19 12:43:19 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.84499999999999997,"15min":0.85299999999999998},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.02,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.89200000000000002,"15min":0.90000000000000002},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.018,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.93500000000000005}]}]},{"osd":3,"up_from":25,"seq":107374182475,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28040,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717112,"statfs":{"total":95995035648,"available":95966322688,"internally_reserved":0,"allocated":1044480,"data_stored":499164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 19 12:42:39 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.46400000000000002,"15min":0.438},"min":{"1min":0.36099999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.86899999999999999,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.47699999999999998,"15min":0.42099999999999999},"min":{"1min":0.318,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.0029999999999999,"5min":1.044,"15min":1.044},"last":0.39700000000000002}]},{"osd":1,"last update":"Thu Oct 19 12:42:39 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.68799999999999994,"15min":0.621},"min":{"1min":0.50700000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.032,"5min":1.077,"15min":1.077},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.622,"5min":0.627,"15min":0.57299999999999995},"min":{"1min":0.47199999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.81799999999999995,"5min":1.228,"15min":1.228},"last":0.79800000000000004}]},{"osd":2,"last update":"Thu Oct 19 12:42:39 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.66300000000000003,"15min":0.61499999999999999},"min":{"1min":0.58299999999999996,"5min":0.377,"15min":0.377},"max":{"1min":0.85199999999999998,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.71199999999999997,"15min":0.622},"min":{"1min":0.59099999999999997,"5min":0.374,"15min":0.374},"max":{"1min":1.0329999999999999,"5min":1.056,"15min":1.056},"last":0.505}]},{"osd":4,"last update":"Thu Oct 19 12:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72599999999999998,"15min":0.66000000000000003},"min":{"1min":0.46500000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.99199999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.75600000000000001,"15min":0.66600000000000004},"min":{"1min":0.55900000000000005,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0609999999999999,"5min":1.228,"15min":1.228},"last":0.85599999999999998}]},{"osd":5,"last update":"Thu Oct 19 12:42:27 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.79800000000000004,"15min":0.746},"min":{"1min":0.63,"5min":0.501,"15min":0.501},"max":{"1min":1.0680000000000001,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.752,"5min":0.72599999999999998,"15min":0.69499999999999995},"min":{"1min":0.59999999999999998,"5min":0.443,"15min":0.443},"max":{"1min":0.96999999999999997,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.59999999999999998}]},{"osd":6,"last update":"Thu Oct 19 12:42:46 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.66100000000000003,"15min":0.629},"min":{"1min":0.44500000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.76500000000000001,"15min":0.71299999999999997},"min":{"1min":0.53700000000000003,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.1759999999999999,"5min":1.45,"15min":1.45},"last":0.58099999999999996}]},{"osd":7,"last update":"Thu Oct 19 12:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71499999999999997,"15min":0.69899999999999995},"min":{"1min":0.47299999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.85499999999999998,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.77900000000000003,"15min":0.74099999999999999},"min":{"1min":0.59799999999999998,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.77800000000000002}]},{"osd":8,"last update":"Thu Oct 19 12:40:26 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.97599999999999998},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.998}]},{"osd":9,"last update":"Thu Oct 19 12:42:56 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.91100000000000003,"15min":0.90900000000000003},"min":{"1min":0.47199999999999998,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.0900000000000001,"5min":1.478,"15min":1.478},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.78100000000000003,"15min":0.79700000000000004},"min":{"1min":0.497,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":0.69799999999999995}]},{"osd":10,"last update":"Thu Oct 19 12:43:20 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.85699999999999998,"15min":0.89500000000000002},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.93600000000000005,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.88900000000000001,"15min":0.92500000000000004},"min":{"1min":0.64300000000000002,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.0620000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.67900000000000005}]},{"osd":11,"last update":"Thu Oct 19 12:43:20 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.91200000000000003,"15min":0.91400000000000003},"min":{"1min":0.76300000000000001,"5min":0.752,"15min":0.752},"max":{"1min":1.1160000000000001,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.81000000000000005,"15min":0.81399999999999995},"min":{"1min":0.60799999999999998,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.97599999999999998,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.755}]}]},{"osd":4,"up_from":33,"seq":141733920838,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28052,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717100,"statfs":{"total":95995035648,"available":95966310400,"internally_reserved":0,"allocated":1056768,"data_stored":513768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 19 12:40:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.51900000000000002,"15min":0.50700000000000001},"min":{"1min":0.38500000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.44},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.54900000000000004,"15min":0.52900000000000003},"min":{"1min":0.47999999999999998,"5min":0.37,"15min":0.37},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":2.1539999999999999}]},{"osd":1,"last update":"Thu Oct 19 12:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.42799999999999999,"15min":0.39400000000000002},"min":{"1min":0.35299999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.51600000000000001,"5min":2.3559999999999999,"15min":2.3559999999999999},"last":0.437},{"interface":"front","average":{"1min":0.441,"5min":0.44600000000000001,"15min":0.40799999999999997},"min":{"1min":0.34799999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.61399999999999999,"5min":3.129,"15min":3.129},"last":0.47999999999999998}]},{"osd":2,"last update":"Thu Oct 19 12:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.64200000000000002,"15min":0.56799999999999995},"min":{"1min":0.34200000000000003,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.747,"5min":7.6470000000000002,"15min":7.6470000000000002},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.622,"15min":0.57199999999999995},"min":{"1min":0.45000000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.82899999999999996,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.79100000000000004}]},{"osd":3,"last update":"Thu Oct 19 12:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.63400000000000001,"15min":0.58499999999999996},"min":{"1min":0.50600000000000001,"5min":0.376,"15min":0.376},"max":{"1min":1.2669999999999999,"5min":3.1019999999999999,"15min":3.1019999999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.66400000000000003,"15min":0.61299999999999999},"min":{"1min":0.42199999999999999,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.0109999999999999,"5min":7.444,"15min":7.444},"last":0.64900000000000002}]},{"osd":5,"last update":"Thu Oct 19 12:43:22 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.66800000000000004,"15min":0.628},"min":{"1min":0.41999999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.85399999999999998,"5min":1.732,"15min":1.732},"last":0.746},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.70999999999999996,"15min":0.628},"min":{"1min":0.51000000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.79600000000000004,"5min":6.8390000000000004,"15min":6.8390000000000004},"last":0.80600000000000005}]},{"osd":6,"last update":"Thu Oct 19 12:42:48 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.73299999999999998,"15min":0.66100000000000003},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":3.8050000000000002,"5min":6.5309999999999997,"15min":6.5309999999999997},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.71599999999999997,"15min":0.67200000000000004},"min":{"1min":0.56299999999999994,"5min":0.443,"15min":0.443},"max":{"1min":1.3560000000000001,"5min":2.2250000000000001,"15min":2.2250000000000001},"last":0.60399999999999998}]},{"osd":7,"last update":"Thu Oct 19 12:43:10 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.60999999999999999,"15min":0.58099999999999996},"min":{"1min":0.47999999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.82399999999999995,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.625,"5min":0.60199999999999998,"15min":0.56100000000000005},"min":{"1min":0.434,"5min":0.376,"15min":0.376},"max":{"1min":0.97099999999999997,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.69999999999999996}]},{"osd":8,"last update":"Thu Oct 19 12:43:29 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.76000000000000001,"15min":0.70699999999999996},"min":{"1min":0.56100000000000005,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.0069999999999999,"5min":2.2719999999999998,"15min":2.2719999999999998},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.74299999999999999,"15min":0.69399999999999995},"min":{"1min":0.622,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.84799999999999998,"5min":2.504,"15min":2.504},"last":0.76900000000000002}]},{"osd":9,"last update":"Thu Oct 19 12:42:59 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.77900000000000003,"15min":0.747},"min":{"1min":0.53800000000000003,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.28,"5min":4.5800000000000001,"15min":4.5800000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.871,"15min":0.82699999999999996},"min":{"1min":0.65500000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.319,"5min":3.8300000000000001,"15min":3.8300000000000001},"last":0.86599999999999999}]},{"osd":10,"last update":"Thu Oct 19 12:43:15 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80100000000000005},"min":{"1min":0.61799999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.91200000000000003,"5min":1.538,"15min":1.538},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.749,"5min":0.81399999999999995,"15min":0.77500000000000002},"min":{"1min":0.58299999999999996,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0309999999999999,"5min":6.8780000000000001,"15min":6.8780000000000001},"last":0.84899999999999998}]},{"osd":11,"last update":"Thu Oct 19 12:43:21 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.91400000000000003,"15min":0.93300000000000005},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":0.93100000000000005,"5min":3.0350000000000001,"15min":3.0350000000000001},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.73399999999999999,"5min":1.0149999999999999,"15min":1.0620000000000001},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.05,"5min":7.3010000000000002,"15min":7.3010000000000002},"last":0.82199999999999995}]}]},{"osd":5,"up_from":38,"seq":163208757313,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28620,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716532,"statfs":{"total":95995035648,"available":95965728768,"internally_reserved":0,"allocated":1642496,"data_stored":1086144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 19 12:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.53900000000000003,"15min":0.52700000000000002},"min":{"1min":0.34799999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.54500000000000004,"15min":0.53700000000000003},"min":{"1min":0.35499999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.79000000000000004,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.55700000000000005}]},{"osd":1,"last update":"Thu Oct 19 12:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.57499999999999996,"15min":0.53700000000000003},"min":{"1min":0.379,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.74299999999999999,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.58299999999999996,"15min":0.55200000000000005},"min":{"1min":0.34799999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.81399999999999995,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.59699999999999998}]},{"osd":2,"last update":"Thu Oct 19 12:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.436,"15min":0.39700000000000002},"min":{"1min":0.27400000000000002,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.46600000000000003,"15min":0.438},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.73599999999999999,"5min":1.095,"15min":1.095},"last":0.51900000000000002}]},{"osd":3,"last update":"Thu Oct 19 12:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.59399999999999997,"15min":0.57999999999999996},"min":{"1min":0.41199999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.872,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.63200000000000001,"15min":0.61799999999999999},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.90000000000000002,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.70899999999999996}]},{"osd":4,"last update":"Thu Oct 19 12:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.63200000000000001,"15min":0.58599999999999997},"min":{"1min":0.51800000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.874,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.61199999999999999,"15min":0.57799999999999996},"min":{"1min":0.39500000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.82999999999999996,"5min":0.997,"15min":0.997},"last":0.79800000000000004}]},{"osd":6,"last update":"Thu Oct 19 12:42:48 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.67500000000000004,"15min":0.67700000000000005},"min":{"1min":0.47699999999999998,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.94299999999999995,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.72899999999999998}]},{"osd":7,"last update":"Thu Oct 19 12:43:13 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.67500000000000004,"15min":0.66900000000000004},"min":{"1min":0.47399999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.89000000000000001,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.749},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.69299999999999995,"15min":0.67000000000000004},"min":{"1min":0.46600000000000003,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.90300000000000002,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.83199999999999996}]},{"osd":8,"last update":"Thu Oct 19 12:42:28 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.63400000000000001,"15min":0.626},"min":{"1min":0.44900000000000001,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.89400000000000002,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.68700000000000006,"15min":0.68100000000000005},"min":{"1min":0.436,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.0129999999999999,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.81599999999999995}]},{"osd":9,"last update":"Thu Oct 19 12:42:53 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.79600000000000004,"15min":0.77300000000000002},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":3.9049999999999998,"5min":3.9049999999999998,"15min":3.9049999999999998},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.755,"5min":0.75700000000000001,"15min":0.76200000000000001},"min":{"1min":0.54700000000000004,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.93899999999999995,"5min":1.115,"15min":1.115},"last":0.84799999999999998}]},{"osd":10,"last update":"Thu Oct 19 12:43:18 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.77100000000000002,"15min":0.747},"min":{"1min":0.63500000000000001,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.96899999999999997,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.747,"15min":0.72499999999999998},"min":{"1min":0.53700000000000003,"5min":0.438,"15min":0.438},"max":{"1min":0.97599999999999998,"5min":1.145,"15min":1.145},"last":0.91300000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":63380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":62887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":62426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-19T12:43:32.554 INFO:tasks.fwd_scrub.ceph_manager:clean! 2023-10-19T12:43:32.554 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-19T12:43:32.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.786+0000 7f3fa61ff700 1 -- 172.21.15.46:0/3808419203 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3fa00731f0 msgr2=0x7f3fa0073670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:32.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.786+0000 7f3fa61ff700 1 --2- 172.21.15.46:0/3808419203 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3fa00731f0 0x7f3fa0073670 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f3f94009990 tx=0x7f3f94009ca0 comp rx=0 tx=0).stop 2023-10-19T12:43:32.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.786+0000 7f3fa61ff700 1 -- 172.21.15.46:0/3808419203 shutdown_connections 2023-10-19T12:43:32.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.786+0000 7f3fa61ff700 1 --2- 172.21.15.46:0/3808419203 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3fa0108610 0x7f3fa010aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:32.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.786+0000 7f3fa61ff700 1 --2- 172.21.15.46:0/3808419203 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3fa00747d0 0x7f3fa0072c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:32.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.786+0000 7f3fa61ff700 1 --2- 172.21.15.46:0/3808419203 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3fa00731f0 0x7f3fa0073670 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:32.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.786+0000 7f3fa61ff700 1 -- 172.21.15.46:0/3808419203 >> 172.21.15.46:0/3808419203 conn(0x7f3fa00fbc90 msgr2=0x7f3fa00fe0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:32.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.787+0000 7f3fa61ff700 1 -- 172.21.15.46:0/3808419203 shutdown_connections 2023-10-19T12:43:32.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.787+0000 7f3fa61ff700 1 -- 172.21.15.46:0/3808419203 wait complete. 2023-10-19T12:43:32.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.787+0000 7f3fa61ff700 1 Processor -- start 2023-10-19T12:43:32.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.788+0000 7f3fa61ff700 1 -- start start 2023-10-19T12:43:32.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.788+0000 7f3fa61ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3fa00731f0 0x7f3fa0198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:32.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.788+0000 7f3fa61ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3fa00747d0 0x7f3fa0198ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:32.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.788+0000 7f3fa61ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3fa0108610 0x7f3fa019fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:32.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.788+0000 7f3fa61ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa01a0440 con 0x7f3fa0108610 2023-10-19T12:43:32.796 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.788+0000 7f3fa61ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa01a0580 con 0x7f3fa00747d0 2023-10-19T12:43:32.796 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.788+0000 7f3fa61ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa01a0710 con 0x7f3fa00731f0 2023-10-19T12:43:32.796 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.788+0000 7f3f9effd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3fa00747d0 0x7f3fa0198ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:32.796 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.788+0000 7f3f9effd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3fa00747d0 0x7f3fa0198ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:34820/0 (socket says 172.21.15.46:34820) 2023-10-19T12:43:32.796 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.788+0000 7f3f9effd700 1 -- 172.21.15.46:0/4209915403 learned_addr learned my addr 172.21.15.46:0/4209915403 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:43:32.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.788+0000 7f3f9ffff700 1 --2- 172.21.15.46:0/4209915403 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3fa0108610 0x7f3fa019fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:32.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.788+0000 7f3f9f7fe700 1 --2- 172.21.15.46:0/4209915403 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3fa00731f0 0x7f3fa0198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:32.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.789+0000 7f3f9effd700 1 -- 172.21.15.46:0/4209915403 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3fa00731f0 msgr2=0x7f3fa0198960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:32.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.789+0000 7f3f9effd700 1 --2- 172.21.15.46:0/4209915403 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3fa00731f0 0x7f3fa0198960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:32.798 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.789+0000 7f3f9effd700 1 -- 172.21.15.46:0/4209915403 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3fa0108610 msgr2=0x7f3fa019fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:32.798 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.789+0000 7f3f9effd700 1 --2- 172.21.15.46:0/4209915403 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3fa0108610 0x7f3fa019fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:32.798 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.789+0000 7f3f9effd700 1 -- 172.21.15.46:0/4209915403 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f940095f0 con 0x7f3fa00747d0 2023-10-19T12:43:32.798 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.789+0000 7f3f9effd700 1 --2- 172.21.15.46:0/4209915403 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3fa00747d0 0x7f3fa0198ea0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3f94000c00 tx=0x7f3f94005740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:32.798 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.789+0000 7f3f9cff9700 1 -- 172.21.15.46:0/4209915403 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9401d070 con 0x7f3fa00747d0 2023-10-19T12:43:32.799 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.789+0000 7f3f9cff9700 1 -- 172.21.15.46:0/4209915403 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3f94021410 con 0x7f3fa00747d0 2023-10-19T12:43:32.799 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.789+0000 7f3fa61ff700 1 -- 172.21.15.46:0/4209915403 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fa01a0990 con 0x7f3fa00747d0 2023-10-19T12:43:32.799 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.789+0000 7f3f9cff9700 1 -- 172.21.15.46:0/4209915403 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f94017650 con 0x7f3fa00747d0 2023-10-19T12:43:32.799 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.789+0000 7f3fa61ff700 1 -- 172.21.15.46:0/4209915403 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fa01a0db0 con 0x7f3fa00747d0 2023-10-19T12:43:32.800 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.790+0000 7f3fa61ff700 1 -- 172.21.15.46:0/4209915403 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fa0107420 con 0x7f3fa00747d0 2023-10-19T12:43:32.800 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.792+0000 7f3f9cff9700 1 -- 172.21.15.46:0/4209915403 <== mon.2 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f3f940217f0 con 0x7f3fa00747d0 2023-10-19T12:43:32.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.794+0000 7f3f9cff9700 1 --2- 172.21.15.46:0/4209915403 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f3f880a1480 0x7f3f880a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:32.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.794+0000 7f3f9cff9700 1 -- 172.21.15.46:0/4209915403 <== mon.2 v2:172.21.15.157:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f3f940ce5c0 con 0x7f3fa00747d0 2023-10-19T12:43:32.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.794+0000 7f3f9f7fe700 1 --2- 172.21.15.46:0/4209915403 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f3f880a1480 0x7f3f880a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:32.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.794+0000 7f3f9f7fe700 1 --2- 172.21.15.46:0/4209915403 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f3f880a1480 0x7f3f880a3940 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f3f90005950 tx=0x7f3f9000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:32.802 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:32.798+0000 7f3f9cff9700 1 -- 172.21.15.46:0/4209915403 <== mon.2 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3f94097880 con 0x7f3fa00747d0 2023-10-19T12:43:33.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.007+0000 7f3fa61ff700 1 -- 172.21.15.46:0/4209915403 --> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3fa002cfd0 con 0x7f3f880a1480 2023-10-19T12:43:33.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.020+0000 7f3f9cff9700 1 -- 172.21.15.46:0/4209915403 <== mgr.14150 v2:172.21.15.46:6800/3168073651 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+426669 (secure 0 0 0) 0x7f3fa002cfd0 con 0x7f3f880a1480 2023-10-19T12:43:33.028 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:43:33.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.025+0000 7f3fa61ff700 1 -- 172.21.15.46:0/4209915403 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f3f880a1480 msgr2=0x7f3f880a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:33.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.025+0000 7f3fa61ff700 1 --2- 172.21.15.46:0/4209915403 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f3f880a1480 0x7f3f880a3940 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f3f90005950 tx=0x7f3f9000b410 comp rx=0 tx=0).stop 2023-10-19T12:43:33.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.025+0000 7f3fa61ff700 1 -- 172.21.15.46:0/4209915403 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3fa00747d0 msgr2=0x7f3fa0198ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:33.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.025+0000 7f3fa61ff700 1 --2- 172.21.15.46:0/4209915403 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3fa00747d0 0x7f3fa0198ea0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3f94000c00 tx=0x7f3f94005740 comp rx=0 tx=0).stop 2023-10-19T12:43:33.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.025+0000 7f3fa61ff700 1 -- 172.21.15.46:0/4209915403 shutdown_connections 2023-10-19T12:43:33.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.025+0000 7f3fa61ff700 1 --2- 172.21.15.46:0/4209915403 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3fa0108610 0x7f3fa019fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:33.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.025+0000 7f3fa61ff700 1 --2- 172.21.15.46:0/4209915403 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f3f880a1480 0x7f3f880a3940 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:33.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.025+0000 7f3fa61ff700 1 --2- 172.21.15.46:0/4209915403 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3fa00731f0 0x7f3fa0198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:33.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.025+0000 7f3fa61ff700 1 --2- 172.21.15.46:0/4209915403 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3fa00747d0 0x7f3fa0198ea0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:33.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.025+0000 7f3fa61ff700 1 -- 172.21.15.46:0/4209915403 >> 172.21.15.46:0/4209915403 conn(0x7f3fa00fbc90 msgr2=0x7f3fa0104560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:33.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.025+0000 7f3fa61ff700 1 -- 172.21.15.46:0/4209915403 shutdown_connections 2023-10-19T12:43:33.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.025+0000 7f3fa61ff700 1 -- 172.21.15.46:0/4209915403 wait complete. 2023-10-19T12:43:33.034 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2023-10-19T12:43:33.048 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":355,"stamp":"2023-10-19T12:43:32.672824+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":664268,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1199,"num_read_kb":726,"num_write":435,"num_write_kb":3093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":1181940,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":859,"ondisk_log_size":859,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":421,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":338672,"kb_used_data":14408,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124603152,"statfs":{"total":1151940427776,"available":1151593627648,"internally_reserved":0,"allocated":14753792,"data_stored":8108531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19130,"internal_metadata":331855174},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":6011,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":98,"num_read_kb":53,"num_write":7,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001940"},"pg_stats":[{"pgid":"3.3f","version":"90'8","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.767615+0000","last_change":"2023-10-19T12:41:19.300761+0000","last_active":"2023-10-19T12:43:27.767615+0000","last_peered":"2023-10-19T12:43:27.767615+0000","last_clean":"2023-10-19T12:43:27.767615+0000","last_became_active":"2023-10-19T12:41:19.300431+0000","last_became_peered":"2023-10-19T12:41:19.300431+0000","last_unstale":"2023-10-19T12:43:27.767615+0000","last_undegraded":"2023-10-19T12:43:27.767615+0000","last_fullsized":"2023-10-19T12:43:27.767615+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-21T00:36:29.735726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"90'4","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.769387+0000","last_change":"2023-10-19T12:41:19.300748+0000","last_active":"2023-10-19T12:43:27.769387+0000","last_peered":"2023-10-19T12:43:27.769387+0000","last_clean":"2023-10-19T12:43:27.769387+0000","last_became_active":"2023-10-19T12:41:19.294769+0000","last_became_peered":"2023-10-19T12:41:19.294769+0000","last_unstale":"2023-10-19T12:43:27.769387+0000","last_undegraded":"2023-10-19T12:43:27.769387+0000","last_fullsized":"2023-10-19T12:43:27.769387+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T23:04:58.055573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"90'7","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.769281+0000","last_change":"2023-10-19T12:41:19.294264+0000","last_active":"2023-10-19T12:43:27.769281+0000","last_peered":"2023-10-19T12:43:27.769281+0000","last_clean":"2023-10-19T12:43:27.769281+0000","last_became_active":"2023-10-19T12:41:19.293878+0000","last_became_peered":"2023-10-19T12:41:19.293878+0000","last_unstale":"2023-10-19T12:43:27.769281+0000","last_undegraded":"2023-10-19T12:43:27.769281+0000","last_fullsized":"2023-10-19T12:43:27.769281+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:11:01.049036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"90'8","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.758729+0000","last_change":"2023-10-19T12:42:28.129235+0000","last_active":"2023-10-19T12:43:27.758729+0000","last_peered":"2023-10-19T12:43:27.758729+0000","last_clean":"2023-10-19T12:43:27.758729+0000","last_became_active":"2023-10-19T12:42:28.128818+0000","last_became_peered":"2023-10-19T12:42:28.128818+0000","last_unstale":"2023-10-19T12:43:27.758729+0000","last_undegraded":"2023-10-19T12:43:27.758729+0000","last_fullsized":"2023-10-19T12:43:27.758729+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:16:26.558697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"90'4","reported_seq":23,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.762818+0000","last_change":"2023-10-19T12:41:19.301164+0000","last_active":"2023-10-19T12:43:27.762818+0000","last_peered":"2023-10-19T12:43:27.762818+0000","last_clean":"2023-10-19T12:43:27.762818+0000","last_became_active":"2023-10-19T12:41:19.300920+0000","last_became_peered":"2023-10-19T12:41:19.300920+0000","last_unstale":"2023-10-19T12:43:27.762818+0000","last_undegraded":"2023-10-19T12:43:27.762818+0000","last_fullsized":"2023-10-19T12:43:27.762818+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:15:40.211319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"90'6","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.763118+0000","last_change":"2023-10-19T12:41:19.292866+0000","last_active":"2023-10-19T12:43:27.763118+0000","last_peered":"2023-10-19T12:43:27.763118+0000","last_clean":"2023-10-19T12:43:27.763118+0000","last_became_active":"2023-10-19T12:41:19.292392+0000","last_became_peered":"2023-10-19T12:41:19.292392+0000","last_unstale":"2023-10-19T12:43:27.763118+0000","last_undegraded":"2023-10-19T12:43:27.763118+0000","last_fullsized":"2023-10-19T12:43:27.763118+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:37:34.373704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"90'5","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.768318+0000","last_change":"2023-10-19T12:42:28.127944+0000","last_active":"2023-10-19T12:43:27.768318+0000","last_peered":"2023-10-19T12:43:27.768318+0000","last_clean":"2023-10-19T12:43:27.768318+0000","last_became_active":"2023-10-19T12:42:28.127619+0000","last_became_peered":"2023-10-19T12:42:28.127619+0000","last_unstale":"2023-10-19T12:43:27.768318+0000","last_undegraded":"2023-10-19T12:43:27.768318+0000","last_fullsized":"2023-10-19T12:43:27.768318+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:01:27.131472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,8],"acting":[7,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"90'9","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:56.694775+0000","last_change":"2023-10-19T12:41:19.290501+0000","last_active":"2023-10-19T12:42:56.694775+0000","last_peered":"2023-10-19T12:42:56.694775+0000","last_clean":"2023-10-19T12:42:56.694775+0000","last_became_active":"2023-10-19T12:41:19.290080+0000","last_became_peered":"2023-10-19T12:41:19.290080+0000","last_unstale":"2023-10-19T12:42:56.694775+0000","last_undegraded":"2023-10-19T12:42:56.694775+0000","last_fullsized":"2023-10-19T12:42:56.694775+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:40:19.827896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"90'11","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.766760+0000","last_change":"2023-10-19T12:41:19.304631+0000","last_active":"2023-10-19T12:43:27.766760+0000","last_peered":"2023-10-19T12:43:27.766760+0000","last_clean":"2023-10-19T12:43:27.766760+0000","last_became_active":"2023-10-19T12:41:19.301990+0000","last_became_peered":"2023-10-19T12:41:19.301990+0000","last_unstale":"2023-10-19T12:43:27.766760+0000","last_undegraded":"2023-10-19T12:43:27.766760+0000","last_fullsized":"2023-10-19T12:43:27.766760+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:50:46.128888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"90'16","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.762483+0000","last_change":"2023-10-19T12:41:19.294366+0000","last_active":"2023-10-19T12:43:27.762483+0000","last_peered":"2023-10-19T12:43:27.762483+0000","last_clean":"2023-10-19T12:43:27.762483+0000","last_became_active":"2023-10-19T12:41:19.292644+0000","last_became_peered":"2023-10-19T12:41:19.292644+0000","last_unstale":"2023-10-19T12:43:27.762483+0000","last_undegraded":"2023-10-19T12:43:27.762483+0000","last_fullsized":"2023-10-19T12:43:27.762483+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:59:30.111950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"90'6","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.767759+0000","last_change":"2023-10-19T12:41:19.290054+0000","last_active":"2023-10-19T12:43:27.767759+0000","last_peered":"2023-10-19T12:43:27.767759+0000","last_clean":"2023-10-19T12:43:27.767759+0000","last_became_active":"2023-10-19T12:41:19.289739+0000","last_became_peered":"2023-10-19T12:41:19.289739+0000","last_unstale":"2023-10-19T12:43:27.767759+0000","last_undegraded":"2023-10-19T12:43:27.767759+0000","last_fullsized":"2023-10-19T12:43:27.767759+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:30:36.398762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"90'7","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.763700+0000","last_change":"2023-10-19T12:41:19.295309+0000","last_active":"2023-10-19T12:43:27.763700+0000","last_peered":"2023-10-19T12:43:27.763700+0000","last_clean":"2023-10-19T12:43:27.763700+0000","last_became_active":"2023-10-19T12:41:19.295009+0000","last_became_peered":"2023-10-19T12:41:19.295009+0000","last_unstale":"2023-10-19T12:43:27.763700+0000","last_undegraded":"2023-10-19T12:43:27.763700+0000","last_fullsized":"2023-10-19T12:43:27.763700+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:27:33.798071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"90'10","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.767248+0000","last_change":"2023-10-19T12:41:19.302920+0000","last_active":"2023-10-19T12:43:27.767248+0000","last_peered":"2023-10-19T12:43:27.767248+0000","last_clean":"2023-10-19T12:43:27.767248+0000","last_became_active":"2023-10-19T12:41:19.300250+0000","last_became_peered":"2023-10-19T12:41:19.300250+0000","last_unstale":"2023-10-19T12:43:27.767248+0000","last_undegraded":"2023-10-19T12:43:27.767248+0000","last_fullsized":"2023-10-19T12:43:27.767248+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:51:47.487907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"90'7","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.765252+0000","last_change":"2023-10-19T12:41:19.300654+0000","last_active":"2023-10-19T12:43:27.765252+0000","last_peered":"2023-10-19T12:43:27.765252+0000","last_clean":"2023-10-19T12:43:27.765252+0000","last_became_active":"2023-10-19T12:41:19.295408+0000","last_became_peered":"2023-10-19T12:41:19.295408+0000","last_unstale":"2023-10-19T12:43:27.765252+0000","last_undegraded":"2023-10-19T12:43:27.765252+0000","last_fullsized":"2023-10-19T12:43:27.765252+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:53:47.039077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"90'7","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.765000+0000","last_change":"2023-10-19T12:41:19.293141+0000","last_active":"2023-10-19T12:43:27.765000+0000","last_peered":"2023-10-19T12:43:27.765000+0000","last_clean":"2023-10-19T12:43:27.765000+0000","last_became_active":"2023-10-19T12:41:19.290790+0000","last_became_peered":"2023-10-19T12:41:19.290790+0000","last_unstale":"2023-10-19T12:43:27.765000+0000","last_undegraded":"2023-10-19T12:43:27.765000+0000","last_fullsized":"2023-10-19T12:43:27.765000+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:23:44.757080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"90'9","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.765392+0000","last_change":"2023-10-19T12:41:19.299670+0000","last_active":"2023-10-19T12:43:27.765392+0000","last_peered":"2023-10-19T12:43:27.765392+0000","last_clean":"2023-10-19T12:43:27.765392+0000","last_became_active":"2023-10-19T12:41:19.299375+0000","last_became_peered":"2023-10-19T12:41:19.299375+0000","last_unstale":"2023-10-19T12:43:27.765392+0000","last_undegraded":"2023-10-19T12:43:27.765392+0000","last_fullsized":"2023-10-19T12:43:27.765392+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:30:23.234790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"90'8","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.767731+0000","last_change":"2023-10-19T12:41:19.300359+0000","last_active":"2023-10-19T12:43:27.767731+0000","last_peered":"2023-10-19T12:43:27.767731+0000","last_clean":"2023-10-19T12:43:27.767731+0000","last_became_active":"2023-10-19T12:41:19.300032+0000","last_became_peered":"2023-10-19T12:41:19.300032+0000","last_unstale":"2023-10-19T12:43:27.767731+0000","last_undegraded":"2023-10-19T12:43:27.767731+0000","last_fullsized":"2023-10-19T12:43:27.767731+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-21T00:33:24.621723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"90'10","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.759359+0000","last_change":"2023-10-19T12:41:19.288276+0000","last_active":"2023-10-19T12:43:27.759359+0000","last_peered":"2023-10-19T12:43:27.759359+0000","last_clean":"2023-10-19T12:43:27.759359+0000","last_became_active":"2023-10-19T12:41:19.287905+0000","last_became_peered":"2023-10-19T12:41:19.287905+0000","last_unstale":"2023-10-19T12:43:27.759359+0000","last_undegraded":"2023-10-19T12:43:27.759359+0000","last_fullsized":"2023-10-19T12:43:27.759359+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:46:15.640987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"90'7","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.759072+0000","last_change":"2023-10-19T12:41:19.300682+0000","last_active":"2023-10-19T12:43:27.759072+0000","last_peered":"2023-10-19T12:43:27.759072+0000","last_clean":"2023-10-19T12:43:27.759072+0000","last_became_active":"2023-10-19T12:41:19.300347+0000","last_became_peered":"2023-10-19T12:41:19.300347+0000","last_unstale":"2023-10-19T12:43:27.759072+0000","last_undegraded":"2023-10-19T12:43:27.759072+0000","last_fullsized":"2023-10-19T12:43:27.759072+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T21:21:31.772556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.758531+0000","last_change":"2023-10-19T12:41:23.337419+0000","last_active":"2023-10-19T12:43:27.758531+0000","last_peered":"2023-10-19T12:43:27.758531+0000","last_clean":"2023-10-19T12:43:27.758531+0000","last_became_active":"2023-10-19T12:41:23.337046+0000","last_became_peered":"2023-10-19T12:41:23.337046+0000","last_unstale":"2023-10-19T12:43:27.758531+0000","last_undegraded":"2023-10-19T12:43:27.758531+0000","last_fullsized":"2023-10-19T12:43:27.758531+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-21T00:20:22.732851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"88'13","reported_seq":137,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:28.456753+0000","last_change":"2023-10-19T12:41:18.282453+0000","last_active":"2023-10-19T12:43:28.456753+0000","last_peered":"2023-10-19T12:43:28.456753+0000","last_clean":"2023-10-19T12:43:28.456753+0000","last_became_active":"2023-10-19T12:41:18.281705+0000","last_became_peered":"2023-10-19T12:41:18.281705+0000","last_unstale":"2023-10-19T12:43:28.456753+0000","last_undegraded":"2023-10-19T12:43:28.456753+0000","last_fullsized":"2023-10-19T12:43:28.456753+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T21:12:33.877631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":103,"num_read_kb":103,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"90'5","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:43:18.559101+0000","last_change":"2023-10-19T12:41:19.292175+0000","last_active":"2023-10-19T12:43:18.559101+0000","last_peered":"2023-10-19T12:43:18.559101+0000","last_clean":"2023-10-19T12:43:18.559101+0000","last_became_active":"2023-10-19T12:41:19.291867+0000","last_became_peered":"2023-10-19T12:41:19.291867+0000","last_unstale":"2023-10-19T12:43:18.559101+0000","last_undegraded":"2023-10-19T12:43:18.559101+0000","last_fullsized":"2023-10-19T12:43:18.559101+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:22:12.255839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.760975+0000","last_change":"2023-10-19T12:41:23.340447+0000","last_active":"2023-10-19T12:43:27.760975+0000","last_peered":"2023-10-19T12:43:27.760975+0000","last_clean":"2023-10-19T12:43:27.760975+0000","last_became_active":"2023-10-19T12:41:23.340074+0000","last_became_peered":"2023-10-19T12:41:23.340074+0000","last_unstale":"2023-10-19T12:43:27.760975+0000","last_undegraded":"2023-10-19T12:43:27.760975+0000","last_fullsized":"2023-10-19T12:43:27.760975+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:12:11.828854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"88'2","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:43:18.559114+0000","last_change":"2023-10-19T12:41:18.297822+0000","last_active":"2023-10-19T12:43:18.559114+0000","last_peered":"2023-10-19T12:43:18.559114+0000","last_clean":"2023-10-19T12:43:18.559114+0000","last_became_active":"2023-10-19T12:41:18.297526+0000","last_became_peered":"2023-10-19T12:41:18.297526+0000","last_unstale":"2023-10-19T12:43:18.559114+0000","last_undegraded":"2023-10-19T12:43:18.559114+0000","last_fullsized":"2023-10-19T12:43:18.559114+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:59:28.110110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"90'6","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.769273+0000","last_change":"2023-10-19T12:41:19.309918+0000","last_active":"2023-10-19T12:43:27.769273+0000","last_peered":"2023-10-19T12:43:27.769273+0000","last_clean":"2023-10-19T12:43:27.769273+0000","last_became_active":"2023-10-19T12:41:19.309391+0000","last_became_peered":"2023-10-19T12:41:19.309391+0000","last_unstale":"2023-10-19T12:43:27.769273+0000","last_undegraded":"2023-10-19T12:43:27.769273+0000","last_fullsized":"2023-10-19T12:43:27.769273+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:52:49.320469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.762033+0000","last_change":"2023-10-19T12:41:23.337296+0000","last_active":"2023-10-19T12:43:27.762033+0000","last_peered":"2023-10-19T12:43:27.762033+0000","last_clean":"2023-10-19T12:43:27.762033+0000","last_became_active":"2023-10-19T12:41:23.336836+0000","last_became_peered":"2023-10-19T12:41:23.336836+0000","last_unstale":"2023-10-19T12:43:27.762033+0000","last_undegraded":"2023-10-19T12:43:27.762033+0000","last_fullsized":"2023-10-19T12:43:27.762033+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:15:25.400517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"88'12","reported_seq":57,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.763007+0000","last_change":"2023-10-19T12:42:28.174505+0000","last_active":"2023-10-19T12:43:27.763007+0000","last_peered":"2023-10-19T12:43:27.763007+0000","last_clean":"2023-10-19T12:43:27.763007+0000","last_became_active":"2023-10-19T12:42:28.165270+0000","last_became_peered":"2023-10-19T12:42:28.165270+0000","last_unstale":"2023-10-19T12:43:27.763007+0000","last_undegraded":"2023-10-19T12:43:27.763007+0000","last_fullsized":"2023-10-19T12:43:27.763007+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:54:50.199916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"90'9","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.767183+0000","last_change":"2023-10-19T12:41:19.301628+0000","last_active":"2023-10-19T12:43:27.767183+0000","last_peered":"2023-10-19T12:43:27.767183+0000","last_clean":"2023-10-19T12:43:27.767183+0000","last_became_active":"2023-10-19T12:41:19.301343+0000","last_became_peered":"2023-10-19T12:41:19.301343+0000","last_unstale":"2023-10-19T12:43:27.767183+0000","last_undegraded":"2023-10-19T12:43:27.767183+0000","last_fullsized":"2023-10-19T12:43:27.767183+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:02:31.273024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.761159+0000","last_change":"2023-10-19T12:41:23.330222+0000","last_active":"2023-10-19T12:43:27.761159+0000","last_peered":"2023-10-19T12:43:27.761159+0000","last_clean":"2023-10-19T12:43:27.761159+0000","last_became_active":"2023-10-19T12:41:23.329838+0000","last_became_peered":"2023-10-19T12:41:23.329838+0000","last_unstale":"2023-10-19T12:43:27.761159+0000","last_undegraded":"2023-10-19T12:43:27.761159+0000","last_fullsized":"2023-10-19T12:43:27.761159+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T21:40:52.899198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"88'5","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.766810+0000","last_change":"2023-10-19T12:42:28.133484+0000","last_active":"2023-10-19T12:43:27.766810+0000","last_peered":"2023-10-19T12:43:27.766810+0000","last_clean":"2023-10-19T12:43:27.766810+0000","last_became_active":"2023-10-19T12:42:28.126495+0000","last_became_peered":"2023-10-19T12:42:28.126495+0000","last_unstale":"2023-10-19T12:43:27.766810+0000","last_undegraded":"2023-10-19T12:43:27.766810+0000","last_fullsized":"2023-10-19T12:43:27.766810+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T21:28:29.956191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"90'15","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.764896+0000","last_change":"2023-10-19T12:42:28.129032+0000","last_active":"2023-10-19T12:43:27.764896+0000","last_peered":"2023-10-19T12:43:27.764896+0000","last_clean":"2023-10-19T12:43:27.764896+0000","last_became_active":"2023-10-19T12:42:28.128562+0000","last_became_peered":"2023-10-19T12:42:28.128562+0000","last_unstale":"2023-10-19T12:43:27.764896+0000","last_undegraded":"2023-10-19T12:43:27.764896+0000","last_fullsized":"2023-10-19T12:43:27.764896+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:52:14.264191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.758936+0000","last_change":"2023-10-19T12:41:23.330626+0000","last_active":"2023-10-19T12:43:27.758936+0000","last_peered":"2023-10-19T12:43:27.758936+0000","last_clean":"2023-10-19T12:43:27.758936+0000","last_became_active":"2023-10-19T12:41:23.330250+0000","last_became_peered":"2023-10-19T12:41:23.330250+0000","last_unstale":"2023-10-19T12:43:27.758936+0000","last_undegraded":"2023-10-19T12:43:27.758936+0000","last_fullsized":"2023-10-19T12:43:27.758936+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:09:48.428636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"88'5","reported_seq":145,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-19T12:43:29.216182+0000","last_change":"2023-10-19T12:42:28.136196+0000","last_active":"2023-10-19T12:43:29.216182+0000","last_peered":"2023-10-19T12:43:29.216182+0000","last_clean":"2023-10-19T12:43:29.216182+0000","last_became_active":"2023-10-19T12:42:28.126762+0000","last_became_peered":"2023-10-19T12:42:28.126762+0000","last_unstale":"2023-10-19T12:43:29.216182+0000","last_undegraded":"2023-10-19T12:43:29.216182+0000","last_fullsized":"2023-10-19T12:43:29.216182+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:04:58.098356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":100,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":622,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"90'7","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.762744+0000","last_change":"2023-10-19T12:41:19.285423+0000","last_active":"2023-10-19T12:43:27.762744+0000","last_peered":"2023-10-19T12:43:27.762744+0000","last_clean":"2023-10-19T12:43:27.762744+0000","last_became_active":"2023-10-19T12:41:19.285110+0000","last_became_peered":"2023-10-19T12:41:19.285110+0000","last_unstale":"2023-10-19T12:43:27.762744+0000","last_undegraded":"2023-10-19T12:43:27.762744+0000","last_fullsized":"2023-10-19T12:43:27.762744+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:27:51.707594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.758865+0000","last_change":"2023-10-19T12:41:23.343240+0000","last_active":"2023-10-19T12:43:27.758865+0000","last_peered":"2023-10-19T12:43:27.758865+0000","last_clean":"2023-10-19T12:43:27.758865+0000","last_became_active":"2023-10-19T12:41:23.342778+0000","last_became_peered":"2023-10-19T12:41:23.342778+0000","last_unstale":"2023-10-19T12:43:27.758865+0000","last_undegraded":"2023-10-19T12:43:27.758865+0000","last_fullsized":"2023-10-19T12:43:27.758865+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:47:15.690193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"88'7","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.763011+0000","last_change":"2023-10-19T12:42:28.179078+0000","last_active":"2023-10-19T12:43:27.763011+0000","last_peered":"2023-10-19T12:43:27.763011+0000","last_clean":"2023-10-19T12:43:27.763011+0000","last_became_active":"2023-10-19T12:42:28.165372+0000","last_became_peered":"2023-10-19T12:42:28.165372+0000","last_unstale":"2023-10-19T12:43:27.763011+0000","last_undegraded":"2023-10-19T12:43:27.763011+0000","last_fullsized":"2023-10-19T12:43:27.763011+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T21:12:40.451182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,6],"acting":[10,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"90'8","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-19T12:43:28.779471+0000","last_change":"2023-10-19T12:43:28.777892+0000","last_active":"2023-10-19T12:43:28.779471+0000","last_peered":"2023-10-19T12:43:28.779471+0000","last_clean":"2023-10-19T12:43:28.779471+0000","last_became_active":"2023-10-19T12:43:28.777514+0000","last_became_peered":"2023-10-19T12:43:28.777514+0000","last_unstale":"2023-10-19T12:43:28.779471+0000","last_undegraded":"2023-10-19T12:43:28.779471+0000","last_fullsized":"2023-10-19T12:43:28.779471+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T22:10:03.226531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,6],"acting":[9,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-19T12:43:28.778762+0000","last_change":"2023-10-19T12:41:23.338871+0000","last_active":"2023-10-19T12:43:28.778762+0000","last_peered":"2023-10-19T12:43:28.778762+0000","last_clean":"2023-10-19T12:43:28.778762+0000","last_became_active":"2023-10-19T12:41:23.338493+0000","last_became_peered":"2023-10-19T12:41:23.338493+0000","last_unstale":"2023-10-19T12:43:28.778762+0000","last_undegraded":"2023-10-19T12:43:28.778762+0000","last_fullsized":"2023-10-19T12:43:28.778762+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T22:49:12.948436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"88'3","reported_seq":23,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.764658+0000","last_change":"2023-10-19T12:41:18.291110+0000","last_active":"2023-10-19T12:43:27.764658+0000","last_peered":"2023-10-19T12:43:27.764658+0000","last_clean":"2023-10-19T12:43:27.764658+0000","last_became_active":"2023-10-19T12:41:18.290675+0000","last_became_peered":"2023-10-19T12:41:18.290675+0000","last_unstale":"2023-10-19T12:43:27.764658+0000","last_undegraded":"2023-10-19T12:43:27.764658+0000","last_fullsized":"2023-10-19T12:43:27.764658+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:57:44.713046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"90'8","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:56.694839+0000","last_change":"2023-10-19T12:41:19.299727+0000","last_active":"2023-10-19T12:42:56.694839+0000","last_peered":"2023-10-19T12:42:56.694839+0000","last_clean":"2023-10-19T12:42:56.694839+0000","last_became_active":"2023-10-19T12:41:19.299387+0000","last_became_peered":"2023-10-19T12:41:19.299387+0000","last_unstale":"2023-10-19T12:42:56.694839+0000","last_undegraded":"2023-10-19T12:42:56.694839+0000","last_fullsized":"2023-10-19T12:42:56.694839+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:34:03.783326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.769294+0000","last_change":"2023-10-19T12:41:23.331954+0000","last_active":"2023-10-19T12:43:27.769294+0000","last_peered":"2023-10-19T12:43:27.769294+0000","last_clean":"2023-10-19T12:43:27.769294+0000","last_became_active":"2023-10-19T12:41:23.328835+0000","last_became_peered":"2023-10-19T12:41:23.328835+0000","last_unstale":"2023-10-19T12:43:27.769294+0000","last_undegraded":"2023-10-19T12:43:27.769294+0000","last_fullsized":"2023-10-19T12:43:27.769294+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T21:49:10.473768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"88'3","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.764125+0000","last_change":"2023-10-19T12:41:18.280694+0000","last_active":"2023-10-19T12:43:27.764125+0000","last_peered":"2023-10-19T12:43:27.764125+0000","last_clean":"2023-10-19T12:43:27.764125+0000","last_became_active":"2023-10-19T12:41:18.280333+0000","last_became_peered":"2023-10-19T12:41:18.280333+0000","last_unstale":"2023-10-19T12:43:27.764125+0000","last_undegraded":"2023-10-19T12:43:27.764125+0000","last_fullsized":"2023-10-19T12:43:27.764125+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:06:02.944400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"90'11","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.758598+0000","last_change":"2023-10-19T12:41:19.288659+0000","last_active":"2023-10-19T12:43:27.758598+0000","last_peered":"2023-10-19T12:43:27.758598+0000","last_clean":"2023-10-19T12:43:27.758598+0000","last_became_active":"2023-10-19T12:41:19.288310+0000","last_became_peered":"2023-10-19T12:41:19.288310+0000","last_unstale":"2023-10-19T12:43:27.758598+0000","last_undegraded":"2023-10-19T12:43:27.758598+0000","last_fullsized":"2023-10-19T12:43:27.758598+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T23:15:05.772393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:28.118079+0000","last_change":"2023-10-19T12:41:23.333370+0000","last_active":"2023-10-19T12:42:28.118079+0000","last_peered":"2023-10-19T12:42:28.118079+0000","last_clean":"2023-10-19T12:42:28.118079+0000","last_became_active":"2023-10-19T12:41:23.332691+0000","last_became_peered":"2023-10-19T12:41:23.332691+0000","last_unstale":"2023-10-19T12:42:28.118079+0000","last_undegraded":"2023-10-19T12:42:28.118079+0000","last_fullsized":"2023-10-19T12:42:28.118079+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T21:28:45.414610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"90'5","reported_seq":232,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-19T12:43:30.217030+0000","last_change":"2023-10-19T12:41:18.287081+0000","last_active":"2023-10-19T12:43:30.217030+0000","last_peered":"2023-10-19T12:43:30.217030+0000","last_clean":"2023-10-19T12:43:30.217030+0000","last_became_active":"2023-10-19T12:41:18.286784+0000","last_became_peered":"2023-10-19T12:41:18.286784+0000","last_unstale":"2023-10-19T12:43:30.217030+0000","last_undegraded":"2023-10-19T12:43:30.217030+0000","last_fullsized":"2023-10-19T12:43:30.217030+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:49:10.167022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":207,"num_read_kb":207,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"90'10","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.766844+0000","last_change":"2023-10-19T12:41:19.300361+0000","last_active":"2023-10-19T12:43:27.766844+0000","last_peered":"2023-10-19T12:43:27.766844+0000","last_clean":"2023-10-19T12:43:27.766844+0000","last_became_active":"2023-10-19T12:41:19.299871+0000","last_became_peered":"2023-10-19T12:41:19.299871+0000","last_unstale":"2023-10-19T12:43:27.766844+0000","last_undegraded":"2023-10-19T12:43:27.766844+0000","last_fullsized":"2023-10-19T12:43:27.766844+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:46:31.437532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.758403+0000","last_change":"2023-10-19T12:41:23.338341+0000","last_active":"2023-10-19T12:43:27.758403+0000","last_peered":"2023-10-19T12:43:27.758403+0000","last_clean":"2023-10-19T12:43:27.758403+0000","last_became_active":"2023-10-19T12:41:23.336081+0000","last_became_peered":"2023-10-19T12:41:23.336081+0000","last_unstale":"2023-10-19T12:43:27.758403+0000","last_undegraded":"2023-10-19T12:43:27.758403+0000","last_fullsized":"2023-10-19T12:43:27.758403+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:02:35.474513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"88'4","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.767806+0000","last_change":"2023-10-19T12:41:18.280086+0000","last_active":"2023-10-19T12:43:27.767806+0000","last_peered":"2023-10-19T12:43:27.767806+0000","last_clean":"2023-10-19T12:43:27.767806+0000","last_became_active":"2023-10-19T12:41:18.279819+0000","last_became_peered":"2023-10-19T12:41:18.279819+0000","last_unstale":"2023-10-19T12:43:27.767806+0000","last_undegraded":"2023-10-19T12:43:27.767806+0000","last_fullsized":"2023-10-19T12:43:27.767806+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T23:02:28.723477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"90'9","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-19T12:43:28.781603+0000","last_change":"2023-10-19T12:43:28.781603+0000","last_active":"2023-10-19T12:43:28.781603+0000","last_peered":"2023-10-19T12:43:28.781603+0000","last_clean":"2023-10-19T12:43:28.781603+0000","last_became_active":"2023-10-19T12:43:28.781189+0000","last_became_peered":"2023-10-19T12:43:28.781189+0000","last_unstale":"2023-10-19T12:43:28.781603+0000","last_undegraded":"2023-10-19T12:43:28.781603+0000","last_fullsized":"2023-10-19T12:43:28.781603+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:53:26.785127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,5],"acting":[0,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-19T12:43:28.784130+0000","last_change":"2023-10-19T12:43:28.784130+0000","last_active":"2023-10-19T12:43:28.784130+0000","last_peered":"2023-10-19T12:43:28.784130+0000","last_clean":"2023-10-19T12:43:28.784130+0000","last_became_active":"2023-10-19T12:43:28.783623+0000","last_became_peered":"2023-10-19T12:43:28.783623+0000","last_unstale":"2023-10-19T12:43:28.784130+0000","last_undegraded":"2023-10-19T12:43:28.784130+0000","last_fullsized":"2023-10-19T12:43:28.784130+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:02:21.375104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,8],"acting":[4,1,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"88'5","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.764782+0000","last_change":"2023-10-19T12:41:18.285452+0000","last_active":"2023-10-19T12:43:27.764782+0000","last_peered":"2023-10-19T12:43:27.764782+0000","last_clean":"2023-10-19T12:43:27.764782+0000","last_became_active":"2023-10-19T12:41:18.285155+0000","last_became_peered":"2023-10-19T12:41:18.285155+0000","last_unstale":"2023-10-19T12:43:27.764782+0000","last_undegraded":"2023-10-19T12:43:27.764782+0000","last_fullsized":"2023-10-19T12:43:27.764782+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:30:41.041925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"90'11","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.767316+0000","last_change":"2023-10-19T12:41:19.284839+0000","last_active":"2023-10-19T12:43:27.767316+0000","last_peered":"2023-10-19T12:43:27.767316+0000","last_clean":"2023-10-19T12:43:27.767316+0000","last_became_active":"2023-10-19T12:41:19.284538+0000","last_became_peered":"2023-10-19T12:41:19.284538+0000","last_unstale":"2023-10-19T12:43:27.767316+0000","last_undegraded":"2023-10-19T12:43:27.767316+0000","last_fullsized":"2023-10-19T12:43:27.767316+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:29:12.288958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-19T12:43:28.781717+0000","last_change":"2023-10-19T12:43:28.781152+0000","last_active":"2023-10-19T12:43:28.781717+0000","last_peered":"2023-10-19T12:43:28.781717+0000","last_clean":"2023-10-19T12:43:28.781717+0000","last_became_active":"2023-10-19T12:43:28.780620+0000","last_became_peered":"2023-10-19T12:43:28.780620+0000","last_unstale":"2023-10-19T12:43:28.781717+0000","last_undegraded":"2023-10-19T12:43:28.781717+0000","last_fullsized":"2023-10-19T12:43:28.781717+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:20:05.692023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,11,5],"acting":[10,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.14","version":"90'41","reported_seq":277,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-19T12:43:30.217085+0000","last_change":"2023-10-19T12:41:18.279330+0000","last_active":"2023-10-19T12:43:30.217085+0000","last_peered":"2023-10-19T12:43:30.217085+0000","last_clean":"2023-10-19T12:43:30.217085+0000","last_became_active":"2023-10-19T12:41:18.278942+0000","last_became_peered":"2023-10-19T12:41:18.278942+0000","last_unstale":"2023-10-19T12:43:30.217085+0000","last_undegraded":"2023-10-19T12:43:30.217085+0000","last_fullsized":"2023-10-19T12:43:30.217085+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:40:23.340009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66385,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":216,"num_read_kb":173,"num_write":43,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"90'6","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.763252+0000","last_change":"2023-10-19T12:41:19.296103+0000","last_active":"2023-10-19T12:43:27.763252+0000","last_peered":"2023-10-19T12:43:27.763252+0000","last_clean":"2023-10-19T12:43:27.763252+0000","last_became_active":"2023-10-19T12:41:19.293432+0000","last_became_peered":"2023-10-19T12:41:19.293432+0000","last_unstale":"2023-10-19T12:43:27.763252+0000","last_undegraded":"2023-10-19T12:43:27.763252+0000","last_fullsized":"2023-10-19T12:43:27.763252+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:21:46.039560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.765267+0000","last_change":"2023-10-19T12:41:23.330711+0000","last_active":"2023-10-19T12:43:27.765267+0000","last_peered":"2023-10-19T12:43:27.765267+0000","last_clean":"2023-10-19T12:43:27.765267+0000","last_became_active":"2023-10-19T12:41:23.330115+0000","last_became_peered":"2023-10-19T12:41:23.330115+0000","last_unstale":"2023-10-19T12:43:27.765267+0000","last_undegraded":"2023-10-19T12:43:27.765267+0000","last_fullsized":"2023-10-19T12:43:27.765267+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:48:50.296265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"88'9","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.758733+0000","last_change":"2023-10-19T12:41:18.289434+0000","last_active":"2023-10-19T12:43:27.758733+0000","last_peered":"2023-10-19T12:43:27.758733+0000","last_clean":"2023-10-19T12:43:27.758733+0000","last_became_active":"2023-10-19T12:41:18.289226+0000","last_became_peered":"2023-10-19T12:41:18.289226+0000","last_unstale":"2023-10-19T12:43:27.758733+0000","last_undegraded":"2023-10-19T12:43:27.758733+0000","last_fullsized":"2023-10-19T12:43:27.758733+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T21:18:19.007202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"90'9","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.765720+0000","last_change":"2023-10-19T12:41:19.300555+0000","last_active":"2023-10-19T12:43:27.765720+0000","last_peered":"2023-10-19T12:43:27.765720+0000","last_clean":"2023-10-19T12:43:27.765720+0000","last_became_active":"2023-10-19T12:41:19.300162+0000","last_became_peered":"2023-10-19T12:41:19.300162+0000","last_unstale":"2023-10-19T12:43:27.765720+0000","last_undegraded":"2023-10-19T12:43:27.765720+0000","last_fullsized":"2023-10-19T12:43:27.765720+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:26:33.779562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.766867+0000","last_change":"2023-10-19T12:41:23.338750+0000","last_active":"2023-10-19T12:43:27.766867+0000","last_peered":"2023-10-19T12:43:27.766867+0000","last_clean":"2023-10-19T12:43:27.766867+0000","last_became_active":"2023-10-19T12:41:23.338318+0000","last_became_peered":"2023-10-19T12:41:23.338318+0000","last_unstale":"2023-10-19T12:43:27.766867+0000","last_undegraded":"2023-10-19T12:43:27.766867+0000","last_fullsized":"2023-10-19T12:43:27.766867+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:11:20.182270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"88'5","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.765240+0000","last_change":"2023-10-19T12:41:18.293923+0000","last_active":"2023-10-19T12:43:27.765240+0000","last_peered":"2023-10-19T12:43:27.765240+0000","last_clean":"2023-10-19T12:43:27.765240+0000","last_became_active":"2023-10-19T12:41:18.293688+0000","last_became_peered":"2023-10-19T12:41:18.293688+0000","last_unstale":"2023-10-19T12:43:27.765240+0000","last_undegraded":"2023-10-19T12:43:27.765240+0000","last_fullsized":"2023-10-19T12:43:27.765240+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:34:15.162178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"90'15","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.767658+0000","last_change":"2023-10-19T12:41:19.302733+0000","last_active":"2023-10-19T12:43:27.767658+0000","last_peered":"2023-10-19T12:43:27.767658+0000","last_clean":"2023-10-19T12:43:27.767658+0000","last_became_active":"2023-10-19T12:41:19.302401+0000","last_became_peered":"2023-10-19T12:41:19.302401+0000","last_unstale":"2023-10-19T12:43:27.767658+0000","last_undegraded":"2023-10-19T12:43:27.767658+0000","last_fullsized":"2023-10-19T12:43:27.767658+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:55:05.864499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-19T12:43:28.780788+0000","last_change":"2023-10-19T12:43:28.780007+0000","last_active":"2023-10-19T12:43:28.780788+0000","last_peered":"2023-10-19T12:43:28.780788+0000","last_clean":"2023-10-19T12:43:28.780788+0000","last_became_active":"2023-10-19T12:43:28.779620+0000","last_became_peered":"2023-10-19T12:43:28.779620+0000","last_unstale":"2023-10-19T12:43:28.780788+0000","last_undegraded":"2023-10-19T12:43:28.780788+0000","last_fullsized":"2023-10-19T12:43:28.780788+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:01:36.931162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7,0,3],"acting":[8,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.11","version":"90'6","reported_seq":134,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-19T12:43:29.463894+0000","last_change":"2023-10-19T12:41:18.277563+0000","last_active":"2023-10-19T12:43:29.463894+0000","last_peered":"2023-10-19T12:43:29.463894+0000","last_clean":"2023-10-19T12:43:29.463894+0000","last_became_active":"2023-10-19T12:41:18.277255+0000","last_became_peered":"2023-10-19T12:41:18.277255+0000","last_unstale":"2023-10-19T12:43:29.463894+0000","last_undegraded":"2023-10-19T12:43:29.463894+0000","last_fullsized":"2023-10-19T12:43:29.463894+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:28:31.468355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":108,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"90'6","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.767310+0000","last_change":"2023-10-19T12:41:19.288939+0000","last_active":"2023-10-19T12:43:27.767310+0000","last_peered":"2023-10-19T12:43:27.767310+0000","last_clean":"2023-10-19T12:43:27.767310+0000","last_became_active":"2023-10-19T12:41:19.288612+0000","last_became_peered":"2023-10-19T12:41:19.288612+0000","last_unstale":"2023-10-19T12:43:27.767310+0000","last_undegraded":"2023-10-19T12:43:27.767310+0000","last_fullsized":"2023-10-19T12:43:27.767310+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:45:36.050331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.765457+0000","last_change":"2023-10-19T12:41:23.333823+0000","last_active":"2023-10-19T12:43:27.765457+0000","last_peered":"2023-10-19T12:43:27.765457+0000","last_clean":"2023-10-19T12:43:27.765457+0000","last_became_active":"2023-10-19T12:41:23.332698+0000","last_became_peered":"2023-10-19T12:41:23.332698+0000","last_unstale":"2023-10-19T12:43:27.765457+0000","last_undegraded":"2023-10-19T12:43:27.765457+0000","last_fullsized":"2023-10-19T12:43:27.765457+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:54:43.952531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"88'17","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.762439+0000","last_change":"2023-10-19T12:41:18.290426+0000","last_active":"2023-10-19T12:43:27.762439+0000","last_peered":"2023-10-19T12:43:27.762439+0000","last_clean":"2023-10-19T12:43:27.762439+0000","last_became_active":"2023-10-19T12:41:18.290096+0000","last_became_peered":"2023-10-19T12:41:18.290096+0000","last_unstale":"2023-10-19T12:43:27.762439+0000","last_undegraded":"2023-10-19T12:43:27.762439+0000","last_fullsized":"2023-10-19T12:43:27.762439+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:14:34.731869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"90'6","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.764233+0000","last_change":"2023-10-19T12:41:19.300423+0000","last_active":"2023-10-19T12:43:27.764233+0000","last_peered":"2023-10-19T12:43:27.764233+0000","last_clean":"2023-10-19T12:43:27.764233+0000","last_became_active":"2023-10-19T12:41:19.299999+0000","last_became_peered":"2023-10-19T12:41:19.299999+0000","last_unstale":"2023-10-19T12:43:27.764233+0000","last_undegraded":"2023-10-19T12:43:27.764233+0000","last_fullsized":"2023-10-19T12:43:27.764233+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:35:32.703396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.764709+0000","last_change":"2023-10-19T12:41:23.330091+0000","last_active":"2023-10-19T12:43:27.764709+0000","last_peered":"2023-10-19T12:43:27.764709+0000","last_clean":"2023-10-19T12:43:27.764709+0000","last_became_active":"2023-10-19T12:41:23.329695+0000","last_became_peered":"2023-10-19T12:41:23.329695+0000","last_unstale":"2023-10-19T12:43:27.764709+0000","last_undegraded":"2023-10-19T12:43:27.764709+0000","last_fullsized":"2023-10-19T12:43:27.764709+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:37:09.840232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"88'2","reported_seq":23,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.765619+0000","last_change":"2023-10-19T12:41:18.279761+0000","last_active":"2023-10-19T12:43:27.765619+0000","last_peered":"2023-10-19T12:43:27.765619+0000","last_clean":"2023-10-19T12:43:27.765619+0000","last_became_active":"2023-10-19T12:41:18.279430+0000","last_became_peered":"2023-10-19T12:41:18.279430+0000","last_unstale":"2023-10-19T12:43:27.765619+0000","last_undegraded":"2023-10-19T12:43:27.765619+0000","last_fullsized":"2023-10-19T12:43:27.765619+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:43:32.447842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"90'5","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.767331+0000","last_change":"2023-10-19T12:41:19.290406+0000","last_active":"2023-10-19T12:43:27.767331+0000","last_peered":"2023-10-19T12:43:27.767331+0000","last_clean":"2023-10-19T12:43:27.767331+0000","last_became_active":"2023-10-19T12:41:19.290032+0000","last_became_peered":"2023-10-19T12:41:19.290032+0000","last_unstale":"2023-10-19T12:43:27.767331+0000","last_undegraded":"2023-10-19T12:43:27.767331+0000","last_fullsized":"2023-10-19T12:43:27.767331+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:30:30.875800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-19T12:43:28.770421+0000","last_change":"2023-10-19T12:41:23.478036+0000","last_active":"2023-10-19T12:43:28.770421+0000","last_peered":"2023-10-19T12:43:28.770421+0000","last_clean":"2023-10-19T12:43:28.770421+0000","last_became_active":"2023-10-19T12:41:23.477542+0000","last_became_peered":"2023-10-19T12:41:23.477542+0000","last_unstale":"2023-10-19T12:43:28.770421+0000","last_undegraded":"2023-10-19T12:43:28.770421+0000","last_fullsized":"2023-10-19T12:43:28.770421+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:32:24.599591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"88'1","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.758692+0000","last_change":"2023-10-19T12:41:18.289254+0000","last_active":"2023-10-19T12:43:27.758692+0000","last_peered":"2023-10-19T12:43:27.758692+0000","last_clean":"2023-10-19T12:43:27.758692+0000","last_became_active":"2023-10-19T12:41:18.287036+0000","last_became_peered":"2023-10-19T12:41:18.287036+0000","last_unstale":"2023-10-19T12:43:27.758692+0000","last_undegraded":"2023-10-19T12:43:27.758692+0000","last_fullsized":"2023-10-19T12:43:27.758692+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T21:33:41.720725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"90'4","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.761725+0000","last_change":"2023-10-19T12:41:19.299711+0000","last_active":"2023-10-19T12:43:27.761725+0000","last_peered":"2023-10-19T12:43:27.761725+0000","last_clean":"2023-10-19T12:43:27.761725+0000","last_became_active":"2023-10-19T12:41:19.299367+0000","last_became_peered":"2023-10-19T12:41:19.299367+0000","last_unstale":"2023-10-19T12:43:27.761725+0000","last_undegraded":"2023-10-19T12:43:27.761725+0000","last_fullsized":"2023-10-19T12:43:27.761725+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:32:36.783990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-19T12:43:28.776913+0000","last_change":"2023-10-19T12:41:23.328301+0000","last_active":"2023-10-19T12:43:28.776913+0000","last_peered":"2023-10-19T12:43:28.776913+0000","last_clean":"2023-10-19T12:43:28.776913+0000","last_became_active":"2023-10-19T12:41:23.327866+0000","last_became_peered":"2023-10-19T12:41:23.327866+0000","last_unstale":"2023-10-19T12:43:28.776913+0000","last_undegraded":"2023-10-19T12:43:28.776913+0000","last_fullsized":"2023-10-19T12:43:28.776913+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T21:53:23.600196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"88'5","reported_seq":134,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-19T12:43:31.461747+0000","last_change":"2023-10-19T12:41:18.286635+0000","last_active":"2023-10-19T12:43:31.461747+0000","last_peered":"2023-10-19T12:43:31.461747+0000","last_clean":"2023-10-19T12:43:31.461747+0000","last_became_active":"2023-10-19T12:41:18.286310+0000","last_became_peered":"2023-10-19T12:41:18.286310+0000","last_unstale":"2023-10-19T12:43:31.461747+0000","last_undegraded":"2023-10-19T12:43:31.461747+0000","last_fullsized":"2023-10-19T12:43:31.461747+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:30:38.266038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":107,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"90'7","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.761580+0000","last_change":"2023-10-19T12:41:19.297989+0000","last_active":"2023-10-19T12:43:27.761580+0000","last_peered":"2023-10-19T12:43:27.761580+0000","last_clean":"2023-10-19T12:43:27.761580+0000","last_became_active":"2023-10-19T12:41:19.297680+0000","last_became_peered":"2023-10-19T12:41:19.297680+0000","last_unstale":"2023-10-19T12:43:27.761580+0000","last_undegraded":"2023-10-19T12:43:27.761580+0000","last_fullsized":"2023-10-19T12:43:27.761580+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:40:22.883804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.766483+0000","last_change":"2023-10-19T12:41:23.478723+0000","last_active":"2023-10-19T12:43:27.766483+0000","last_peered":"2023-10-19T12:43:27.766483+0000","last_clean":"2023-10-19T12:43:27.766483+0000","last_became_active":"2023-10-19T12:41:23.478063+0000","last_became_peered":"2023-10-19T12:41:23.478063+0000","last_unstale":"2023-10-19T12:43:27.766483+0000","last_undegraded":"2023-10-19T12:43:27.766483+0000","last_fullsized":"2023-10-19T12:43:27.766483+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:41:00.885308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"90'8","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.764280+0000","last_change":"2023-10-19T12:41:19.285478+0000","last_active":"2023-10-19T12:43:27.764280+0000","last_peered":"2023-10-19T12:43:27.764280+0000","last_clean":"2023-10-19T12:43:27.764280+0000","last_became_active":"2023-10-19T12:41:19.285175+0000","last_became_peered":"2023-10-19T12:41:19.285175+0000","last_unstale":"2023-10-19T12:43:27.764280+0000","last_undegraded":"2023-10-19T12:43:27.764280+0000","last_fullsized":"2023-10-19T12:43:27.764280+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:18:03.423712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"90'6","reported_seq":132,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-19T12:43:29.463336+0000","last_change":"2023-10-19T12:41:18.297207+0000","last_active":"2023-10-19T12:43:29.463336+0000","last_peered":"2023-10-19T12:43:29.463336+0000","last_clean":"2023-10-19T12:43:29.463336+0000","last_became_active":"2023-10-19T12:41:18.296490+0000","last_became_peered":"2023-10-19T12:41:18.296490+0000","last_unstale":"2023-10-19T12:43:29.463336+0000","last_undegraded":"2023-10-19T12:43:29.463336+0000","last_fullsized":"2023-10-19T12:43:29.463336+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:42:33.769810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":105,"num_read_kb":105,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"88'1","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.767409+0000","last_change":"2023-10-19T12:41:23.338803+0000","last_active":"2023-10-19T12:43:27.767409+0000","last_peered":"2023-10-19T12:43:27.767409+0000","last_clean":"2023-10-19T12:43:27.767409+0000","last_became_active":"2023-10-19T12:41:23.338383+0000","last_became_peered":"2023-10-19T12:41:23.338383+0000","last_unstale":"2023-10-19T12:43:27.767409+0000","last_undegraded":"2023-10-19T12:43:27.767409+0000","last_fullsized":"2023-10-19T12:43:27.767409+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:39:24.412323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"90'8","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:43:23.559610+0000","last_change":"2023-10-19T12:41:19.290536+0000","last_active":"2023-10-19T12:43:23.559610+0000","last_peered":"2023-10-19T12:43:23.559610+0000","last_clean":"2023-10-19T12:43:23.559610+0000","last_became_active":"2023-10-19T12:41:19.290141+0000","last_became_peered":"2023-10-19T12:41:19.290141+0000","last_unstale":"2023-10-19T12:43:23.559610+0000","last_undegraded":"2023-10-19T12:43:23.559610+0000","last_fullsized":"2023-10-19T12:43:23.559610+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:49:59.601767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"88'6","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.762131+0000","last_change":"2023-10-19T12:41:18.276568+0000","last_active":"2023-10-19T12:43:27.762131+0000","last_peered":"2023-10-19T12:43:27.762131+0000","last_clean":"2023-10-19T12:43:27.762131+0000","last_became_active":"2023-10-19T12:41:18.276216+0000","last_became_peered":"2023-10-19T12:41:18.276216+0000","last_unstale":"2023-10-19T12:43:27.762131+0000","last_undegraded":"2023-10-19T12:43:27.762131+0000","last_fullsized":"2023-10-19T12:43:27.762131+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T23:24:32.159972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":316,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.767213+0000","last_change":"2023-10-19T12:40:14.674594+0000","last_active":"2023-10-19T12:43:27.767213+0000","last_peered":"2023-10-19T12:43:27.767213+0000","last_clean":"2023-10-19T12:43:27.767213+0000","last_became_active":"2023-10-19T12:40:14.674234+0000","last_became_peered":"2023-10-19T12:40:14.674234+0000","last_unstale":"2023-10-19T12:43:27.767213+0000","last_undegraded":"2023-10-19T12:43:27.767213+0000","last_fullsized":"2023-10-19T12:43:27.767213+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:37:07.222565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:37:07.222565+0000","last_clean_scrub_stamp":"2023-10-19T12:37:07.222565+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-21T00:22:40.530907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-19T12:43:28.780476+0000","last_change":"2023-10-19T12:43:28.777654+0000","last_active":"2023-10-19T12:43:28.780476+0000","last_peered":"2023-10-19T12:43:28.780476+0000","last_clean":"2023-10-19T12:43:28.780476+0000","last_became_active":"2023-10-19T12:43:28.777183+0000","last_became_peered":"2023-10-19T12:43:28.777183+0000","last_unstale":"2023-10-19T12:43:28.780476+0000","last_undegraded":"2023-10-19T12:43:28.780476+0000","last_fullsized":"2023-10-19T12:43:28.780476+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T23:22:06.993915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6,10],"acting":[8,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1","version":"90'5","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.764465+0000","last_change":"2023-10-19T12:41:19.294132+0000","last_active":"2023-10-19T12:43:27.764465+0000","last_peered":"2023-10-19T12:43:27.764465+0000","last_clean":"2023-10-19T12:43:27.764465+0000","last_became_active":"2023-10-19T12:41:19.293800+0000","last_became_peered":"2023-10-19T12:41:19.293800+0000","last_unstale":"2023-10-19T12:43:27.764465+0000","last_undegraded":"2023-10-19T12:43:27.764465+0000","last_fullsized":"2023-10-19T12:43:27.764465+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:30:56.734581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"88'4","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.766648+0000","last_change":"2023-10-19T12:42:28.135694+0000","last_active":"2023-10-19T12:43:27.766648+0000","last_peered":"2023-10-19T12:43:27.766648+0000","last_clean":"2023-10-19T12:43:27.766648+0000","last_became_active":"2023-10-19T12:42:28.127322+0000","last_became_peered":"2023-10-19T12:42:28.127322+0000","last_unstale":"2023-10-19T12:43:27.766648+0000","last_undegraded":"2023-10-19T12:43:27.766648+0000","last_fullsized":"2023-10-19T12:43:27.766648+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T23:26:54.615667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-19T12:43:28.778758+0000","last_change":"2023-10-19T12:41:23.328605+0000","last_active":"2023-10-19T12:43:28.778758+0000","last_peered":"2023-10-19T12:43:28.778758+0000","last_clean":"2023-10-19T12:43:28.778758+0000","last_became_active":"2023-10-19T12:41:23.327992+0000","last_became_peered":"2023-10-19T12:41:23.327992+0000","last_unstale":"2023-10-19T12:43:28.778758+0000","last_undegraded":"2023-10-19T12:43:28.778758+0000","last_fullsized":"2023-10-19T12:43:28.778758+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:00:04.415235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"88'4","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.763134+0000","last_change":"2023-10-19T12:41:18.290347+0000","last_active":"2023-10-19T12:43:27.763134+0000","last_peered":"2023-10-19T12:43:27.763134+0000","last_clean":"2023-10-19T12:43:27.763134+0000","last_became_active":"2023-10-19T12:41:18.290050+0000","last_became_peered":"2023-10-19T12:41:18.290050+0000","last_unstale":"2023-10-19T12:43:27.763134+0000","last_undegraded":"2023-10-19T12:43:27.763134+0000","last_fullsized":"2023-10-19T12:43:27.763134+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:19:05.618338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"90'9","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.765063+0000","last_change":"2023-10-19T12:41:19.303753+0000","last_active":"2023-10-19T12:43:27.765063+0000","last_peered":"2023-10-19T12:43:27.765063+0000","last_clean":"2023-10-19T12:43:27.765063+0000","last_became_active":"2023-10-19T12:41:19.299710+0000","last_became_peered":"2023-10-19T12:41:19.299710+0000","last_unstale":"2023-10-19T12:43:27.765063+0000","last_undegraded":"2023-10-19T12:43:27.765063+0000","last_fullsized":"2023-10-19T12:43:27.765063+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:40:27.929956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:43:23.559527+0000","last_change":"2023-10-19T12:41:23.478159+0000","last_active":"2023-10-19T12:43:23.559527+0000","last_peered":"2023-10-19T12:43:23.559527+0000","last_clean":"2023-10-19T12:43:23.559527+0000","last_became_active":"2023-10-19T12:41:23.477647+0000","last_became_peered":"2023-10-19T12:41:23.477647+0000","last_unstale":"2023-10-19T12:43:23.559527+0000","last_undegraded":"2023-10-19T12:43:23.559527+0000","last_fullsized":"2023-10-19T12:43:23.559527+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:48:31.904477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"90'12","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-19T12:43:28.772974+0000","last_change":"2023-10-19T12:41:18.295746+0000","last_active":"2023-10-19T12:43:28.772974+0000","last_peered":"2023-10-19T12:43:28.772974+0000","last_clean":"2023-10-19T12:43:28.772974+0000","last_became_active":"2023-10-19T12:41:18.294855+0000","last_became_peered":"2023-10-19T12:41:18.294855+0000","last_unstale":"2023-10-19T12:43:28.772974+0000","last_undegraded":"2023-10-19T12:43:28.772974+0000","last_fullsized":"2023-10-19T12:43:28.772974+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:52:24.628136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"90'5","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.768609+0000","last_change":"2023-10-19T12:41:19.283960+0000","last_active":"2023-10-19T12:43:27.768609+0000","last_peered":"2023-10-19T12:43:27.768609+0000","last_clean":"2023-10-19T12:43:27.768609+0000","last_became_active":"2023-10-19T12:41:19.282544+0000","last_became_peered":"2023-10-19T12:41:19.282544+0000","last_unstale":"2023-10-19T12:43:27.768609+0000","last_undegraded":"2023-10-19T12:43:27.768609+0000","last_fullsized":"2023-10-19T12:43:27.768609+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T23:58:08.794192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-19T12:43:28.782498+0000","last_change":"2023-10-19T12:41:23.323593+0000","last_active":"2023-10-19T12:43:28.782498+0000","last_peered":"2023-10-19T12:43:28.782498+0000","last_clean":"2023-10-19T12:43:28.782498+0000","last_became_active":"2023-10-19T12:41:23.323204+0000","last_became_peered":"2023-10-19T12:41:23.323204+0000","last_unstale":"2023-10-19T12:43:28.782498+0000","last_undegraded":"2023-10-19T12:43:28.782498+0000","last_fullsized":"2023-10-19T12:43:28.782498+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:15:15.379085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"88'7","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-19T12:43:28.775180+0000","last_change":"2023-10-19T12:41:18.286231+0000","last_active":"2023-10-19T12:43:28.775180+0000","last_peered":"2023-10-19T12:43:28.775180+0000","last_clean":"2023-10-19T12:43:28.775180+0000","last_became_active":"2023-10-19T12:41:18.285932+0000","last_became_peered":"2023-10-19T12:41:18.285932+0000","last_unstale":"2023-10-19T12:43:28.775180+0000","last_undegraded":"2023-10-19T12:43:28.775180+0000","last_fullsized":"2023-10-19T12:43:28.775180+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:13:02.066468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"90'7","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-19T12:43:28.774328+0000","last_change":"2023-10-19T12:42:28.126438+0000","last_active":"2023-10-19T12:43:28.774328+0000","last_peered":"2023-10-19T12:43:28.774328+0000","last_clean":"2023-10-19T12:43:28.774328+0000","last_became_active":"2023-10-19T12:42:28.126115+0000","last_became_peered":"2023-10-19T12:42:28.126115+0000","last_unstale":"2023-10-19T12:43:28.774328+0000","last_undegraded":"2023-10-19T12:43:28.774328+0000","last_fullsized":"2023-10-19T12:43:28.774328+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:48:12.878420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.763594+0000","last_change":"2023-10-19T12:41:23.479129+0000","last_active":"2023-10-19T12:43:27.763594+0000","last_peered":"2023-10-19T12:43:27.763594+0000","last_clean":"2023-10-19T12:43:27.763594+0000","last_became_active":"2023-10-19T12:41:23.478518+0000","last_became_peered":"2023-10-19T12:41:23.478518+0000","last_unstale":"2023-10-19T12:43:27.763594+0000","last_undegraded":"2023-10-19T12:43:27.763594+0000","last_fullsized":"2023-10-19T12:43:27.763594+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:55:38.767504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"88'2","reported_seq":23,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-19T12:43:28.779203+0000","last_change":"2023-10-19T12:41:18.283269+0000","last_active":"2023-10-19T12:43:28.779203+0000","last_peered":"2023-10-19T12:43:28.779203+0000","last_clean":"2023-10-19T12:43:28.779203+0000","last_became_active":"2023-10-19T12:41:18.282913+0000","last_became_peered":"2023-10-19T12:41:18.282913+0000","last_unstale":"2023-10-19T12:43:28.779203+0000","last_undegraded":"2023-10-19T12:43:28.779203+0000","last_fullsized":"2023-10-19T12:43:28.779203+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:44:01.042312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"90'2","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-19T12:43:28.770381+0000","last_change":"2023-10-19T12:41:19.284222+0000","last_active":"2023-10-19T12:43:28.770381+0000","last_peered":"2023-10-19T12:43:28.770381+0000","last_clean":"2023-10-19T12:43:28.770381+0000","last_became_active":"2023-10-19T12:41:19.283914+0000","last_became_peered":"2023-10-19T12:41:19.283914+0000","last_unstale":"2023-10-19T12:43:28.770381+0000","last_undegraded":"2023-10-19T12:43:28.770381+0000","last_fullsized":"2023-10-19T12:43:28.770381+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:15:34.801502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.759445+0000","last_change":"2023-10-19T12:41:23.338071+0000","last_active":"2023-10-19T12:43:27.759445+0000","last_peered":"2023-10-19T12:43:27.759445+0000","last_clean":"2023-10-19T12:43:27.759445+0000","last_became_active":"2023-10-19T12:41:23.336265+0000","last_became_peered":"2023-10-19T12:41:23.336265+0000","last_unstale":"2023-10-19T12:43:27.759445+0000","last_undegraded":"2023-10-19T12:43:27.759445+0000","last_fullsized":"2023-10-19T12:43:27.759445+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:02:53.139468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"88'7","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.765619+0000","last_change":"2023-10-19T12:41:18.293027+0000","last_active":"2023-10-19T12:43:27.765619+0000","last_peered":"2023-10-19T12:43:27.765619+0000","last_clean":"2023-10-19T12:43:27.765619+0000","last_became_active":"2023-10-19T12:41:18.289478+0000","last_became_peered":"2023-10-19T12:41:18.289478+0000","last_unstale":"2023-10-19T12:43:27.765619+0000","last_undegraded":"2023-10-19T12:43:27.765619+0000","last_fullsized":"2023-10-19T12:43:27.765619+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:26:32.986754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"90'9","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-19T12:43:28.778693+0000","last_change":"2023-10-19T12:41:19.293206+0000","last_active":"2023-10-19T12:43:28.778693+0000","last_peered":"2023-10-19T12:43:28.778693+0000","last_clean":"2023-10-19T12:43:28.778693+0000","last_became_active":"2023-10-19T12:41:19.292898+0000","last_became_peered":"2023-10-19T12:41:19.292898+0000","last_unstale":"2023-10-19T12:43:28.778693+0000","last_undegraded":"2023-10-19T12:43:28.778693+0000","last_fullsized":"2023-10-19T12:43:28.778693+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T23:36:17.548859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"88'1","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.763493+0000","last_change":"2023-10-19T12:41:23.343048+0000","last_active":"2023-10-19T12:43:27.763493+0000","last_peered":"2023-10-19T12:43:27.763493+0000","last_clean":"2023-10-19T12:43:27.763493+0000","last_became_active":"2023-10-19T12:41:23.342696+0000","last_became_peered":"2023-10-19T12:41:23.342696+0000","last_unstale":"2023-10-19T12:43:27.763493+0000","last_undegraded":"2023-10-19T12:43:27.763493+0000","last_fullsized":"2023-10-19T12:43:27.763493+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:30:38.858947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"88'3","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.758712+0000","last_change":"2023-10-19T12:41:18.293079+0000","last_active":"2023-10-19T12:43:27.758712+0000","last_peered":"2023-10-19T12:43:27.758712+0000","last_clean":"2023-10-19T12:43:27.758712+0000","last_became_active":"2023-10-19T12:41:18.292803+0000","last_became_peered":"2023-10-19T12:41:18.292803+0000","last_unstale":"2023-10-19T12:43:27.758712+0000","last_undegraded":"2023-10-19T12:43:27.758712+0000","last_fullsized":"2023-10-19T12:43:27.758712+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T22:37:14.550800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"90'8","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:56.692004+0000","last_change":"2023-10-19T12:41:19.292921+0000","last_active":"2023-10-19T12:42:56.692004+0000","last_peered":"2023-10-19T12:42:56.692004+0000","last_clean":"2023-10-19T12:42:56.692004+0000","last_became_active":"2023-10-19T12:41:19.292498+0000","last_became_peered":"2023-10-19T12:41:19.292498+0000","last_unstale":"2023-10-19T12:42:56.692004+0000","last_undegraded":"2023-10-19T12:42:56.692004+0000","last_fullsized":"2023-10-19T12:42:56.692004+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T22:02:55.878154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.763662+0000","last_change":"2023-10-19T12:41:23.477894+0000","last_active":"2023-10-19T12:43:27.763662+0000","last_peered":"2023-10-19T12:43:27.763662+0000","last_clean":"2023-10-19T12:43:27.763662+0000","last_became_active":"2023-10-19T12:41:23.477478+0000","last_became_peered":"2023-10-19T12:41:23.477478+0000","last_unstale":"2023-10-19T12:43:27.763662+0000","last_undegraded":"2023-10-19T12:43:27.763662+0000","last_fullsized":"2023-10-19T12:43:27.763662+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:44:21.730215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"88'4","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.762798+0000","last_change":"2023-10-19T12:41:18.282474+0000","last_active":"2023-10-19T12:43:27.762798+0000","last_peered":"2023-10-19T12:43:27.762798+0000","last_clean":"2023-10-19T12:43:27.762798+0000","last_became_active":"2023-10-19T12:41:18.282124+0000","last_became_peered":"2023-10-19T12:41:18.282124+0000","last_unstale":"2023-10-19T12:43:27.762798+0000","last_undegraded":"2023-10-19T12:43:27.762798+0000","last_fullsized":"2023-10-19T12:43:27.762798+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T21:27:37.530324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"90'5","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-19T12:43:28.775219+0000","last_change":"2023-10-19T12:41:19.302928+0000","last_active":"2023-10-19T12:43:28.775219+0000","last_peered":"2023-10-19T12:43:28.775219+0000","last_clean":"2023-10-19T12:43:28.775219+0000","last_became_active":"2023-10-19T12:41:19.302641+0000","last_became_peered":"2023-10-19T12:41:19.302641+0000","last_unstale":"2023-10-19T12:43:28.775219+0000","last_undegraded":"2023-10-19T12:43:28.775219+0000","last_fullsized":"2023-10-19T12:43:28.775219+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:07:46.333875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.765761+0000","last_change":"2023-10-19T12:41:23.329079+0000","last_active":"2023-10-19T12:43:27.765761+0000","last_peered":"2023-10-19T12:43:27.765761+0000","last_clean":"2023-10-19T12:43:27.765761+0000","last_became_active":"2023-10-19T12:41:23.328407+0000","last_became_peered":"2023-10-19T12:41:23.328407+0000","last_unstale":"2023-10-19T12:43:27.765761+0000","last_undegraded":"2023-10-19T12:43:27.765761+0000","last_fullsized":"2023-10-19T12:43:27.765761+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:46:19.404922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"90'7","reported_seq":136,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-19T12:43:31.466810+0000","last_change":"2023-10-19T12:41:18.286336+0000","last_active":"2023-10-19T12:43:31.466810+0000","last_peered":"2023-10-19T12:43:31.466810+0000","last_clean":"2023-10-19T12:43:31.466810+0000","last_became_active":"2023-10-19T12:41:18.285921+0000","last_became_peered":"2023-10-19T12:41:18.285921+0000","last_unstale":"2023-10-19T12:43:31.466810+0000","last_undegraded":"2023-10-19T12:43:31.466810+0000","last_fullsized":"2023-10-19T12:43:31.466810+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T23:16:34.842143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1701,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":108,"num_read_kb":3,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"90'7","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.767705+0000","last_change":"2023-10-19T12:41:19.289466+0000","last_active":"2023-10-19T12:43:27.767705+0000","last_peered":"2023-10-19T12:43:27.767705+0000","last_clean":"2023-10-19T12:43:27.767705+0000","last_became_active":"2023-10-19T12:41:19.288669+0000","last_became_peered":"2023-10-19T12:41:19.288669+0000","last_unstale":"2023-10-19T12:43:27.767705+0000","last_undegraded":"2023-10-19T12:43:27.767705+0000","last_fullsized":"2023-10-19T12:43:27.767705+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T23:31:52.163958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.768166+0000","last_change":"2023-10-19T12:41:23.343521+0000","last_active":"2023-10-19T12:43:27.768166+0000","last_peered":"2023-10-19T12:43:27.768166+0000","last_clean":"2023-10-19T12:43:27.768166+0000","last_became_active":"2023-10-19T12:41:23.342288+0000","last_became_peered":"2023-10-19T12:41:23.342288+0000","last_unstale":"2023-10-19T12:43:27.768166+0000","last_undegraded":"2023-10-19T12:43:27.768166+0000","last_fullsized":"2023-10-19T12:43:27.768166+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:58:06.810552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"88'3","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.765007+0000","last_change":"2023-10-19T12:41:18.294999+0000","last_active":"2023-10-19T12:43:27.765007+0000","last_peered":"2023-10-19T12:43:27.765007+0000","last_clean":"2023-10-19T12:43:27.765007+0000","last_became_active":"2023-10-19T12:41:18.294776+0000","last_became_peered":"2023-10-19T12:41:18.294776+0000","last_unstale":"2023-10-19T12:43:27.765007+0000","last_undegraded":"2023-10-19T12:43:27.765007+0000","last_fullsized":"2023-10-19T12:43:27.765007+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:17:53.704739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"90'6","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-19T12:43:28.780578+0000","last_change":"2023-10-19T12:43:28.780578+0000","last_active":"2023-10-19T12:43:28.780578+0000","last_peered":"2023-10-19T12:43:28.780578+0000","last_clean":"2023-10-19T12:43:28.780578+0000","last_became_active":"2023-10-19T12:43:28.780132+0000","last_became_peered":"2023-10-19T12:43:28.780132+0000","last_unstale":"2023-10-19T12:43:28.780578+0000","last_undegraded":"2023-10-19T12:43:28.780578+0000","last_fullsized":"2023-10-19T12:43:28.780578+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T22:39:19.398720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.764003+0000","last_change":"2023-10-19T12:41:23.327966+0000","last_active":"2023-10-19T12:43:27.764003+0000","last_peered":"2023-10-19T12:43:27.764003+0000","last_clean":"2023-10-19T12:43:27.764003+0000","last_became_active":"2023-10-19T12:41:23.327555+0000","last_became_peered":"2023-10-19T12:41:23.327555+0000","last_unstale":"2023-10-19T12:43:27.764003+0000","last_undegraded":"2023-10-19T12:43:27.764003+0000","last_fullsized":"2023-10-19T12:43:27.764003+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:22.303771+0000","last_clean_scrub_stamp":"2023-10-19T12:41:22.303771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:01:34.044012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"88'5","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.765357+0000","last_change":"2023-10-19T12:41:18.297472+0000","last_active":"2023-10-19T12:43:27.765357+0000","last_peered":"2023-10-19T12:43:27.765357+0000","last_clean":"2023-10-19T12:43:27.765357+0000","last_became_active":"2023-10-19T12:41:18.296410+0000","last_became_peered":"2023-10-19T12:41:18.296410+0000","last_unstale":"2023-10-19T12:43:27.765357+0000","last_undegraded":"2023-10-19T12:43:27.765357+0000","last_fullsized":"2023-10-19T12:43:27.765357+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:17.208744+0000","last_clean_scrub_stamp":"2023-10-19T12:41:17.208744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:20:15.039332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"90'9","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.768153+0000","last_change":"2023-10-19T12:41:19.295136+0000","last_active":"2023-10-19T12:43:27.768153+0000","last_peered":"2023-10-19T12:43:27.768153+0000","last_clean":"2023-10-19T12:43:27.768153+0000","last_became_active":"2023-10-19T12:41:19.294836+0000","last_became_peered":"2023-10-19T12:41:19.294836+0000","last_unstale":"2023-10-19T12:43:27.768153+0000","last_undegraded":"2023-10-19T12:43:27.768153+0000","last_fullsized":"2023-10-19T12:43:27.768153+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:08:25.830396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"90'9","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.767185+0000","last_change":"2023-10-19T12:41:19.290047+0000","last_active":"2023-10-19T12:43:27.767185+0000","last_peered":"2023-10-19T12:43:27.767185+0000","last_clean":"2023-10-19T12:43:27.767185+0000","last_became_active":"2023-10-19T12:41:19.289792+0000","last_became_peered":"2023-10-19T12:41:19.289792+0000","last_unstale":"2023-10-19T12:43:27.767185+0000","last_undegraded":"2023-10-19T12:43:27.767185+0000","last_fullsized":"2023-10-19T12:43:27.767185+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:10:58.981643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"90'12","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.758663+0000","last_change":"2023-10-19T12:41:19.287973+0000","last_active":"2023-10-19T12:43:27.758663+0000","last_peered":"2023-10-19T12:43:27.758663+0000","last_clean":"2023-10-19T12:43:27.758663+0000","last_became_active":"2023-10-19T12:41:19.287508+0000","last_became_peered":"2023-10-19T12:41:19.287508+0000","last_unstale":"2023-10-19T12:43:27.758663+0000","last_undegraded":"2023-10-19T12:43:27.758663+0000","last_fullsized":"2023-10-19T12:43:27.758663+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:25:57.815032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"90'8","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.758528+0000","last_change":"2023-10-19T12:41:19.294154+0000","last_active":"2023-10-19T12:43:27.758528+0000","last_peered":"2023-10-19T12:43:27.758528+0000","last_clean":"2023-10-19T12:43:27.758528+0000","last_became_active":"2023-10-19T12:41:19.293873+0000","last_became_peered":"2023-10-19T12:41:19.293873+0000","last_unstale":"2023-10-19T12:43:27.758528+0000","last_undegraded":"2023-10-19T12:43:27.758528+0000","last_fullsized":"2023-10-19T12:43:27.758528+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:29:58.428571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"90'7","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.768327+0000","last_change":"2023-10-19T12:41:19.309512+0000","last_active":"2023-10-19T12:43:27.768327+0000","last_peered":"2023-10-19T12:43:27.768327+0000","last_clean":"2023-10-19T12:43:27.768327+0000","last_became_active":"2023-10-19T12:41:19.309149+0000","last_became_peered":"2023-10-19T12:41:19.309149+0000","last_unstale":"2023-10-19T12:43:27.768327+0000","last_undegraded":"2023-10-19T12:43:27.768327+0000","last_fullsized":"2023-10-19T12:43:27.768327+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:19:34.971413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"90'4","reported_seq":24,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-19T12:43:28.777149+0000","last_change":"2023-10-19T12:41:19.301496+0000","last_active":"2023-10-19T12:43:28.777149+0000","last_peered":"2023-10-19T12:43:28.777149+0000","last_clean":"2023-10-19T12:43:28.777149+0000","last_became_active":"2023-10-19T12:41:19.299697+0000","last_became_peered":"2023-10-19T12:41:19.299697+0000","last_unstale":"2023-10-19T12:43:28.777149+0000","last_undegraded":"2023-10-19T12:43:28.777149+0000","last_fullsized":"2023-10-19T12:43:28.777149+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T23:51:52.448215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"90'6","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-19T12:43:28.779035+0000","last_change":"2023-10-19T12:41:19.289995+0000","last_active":"2023-10-19T12:43:28.779035+0000","last_peered":"2023-10-19T12:43:28.779035+0000","last_clean":"2023-10-19T12:43:28.779035+0000","last_became_active":"2023-10-19T12:41:19.289471+0000","last_became_peered":"2023-10-19T12:41:19.289471+0000","last_unstale":"2023-10-19T12:43:28.779035+0000","last_undegraded":"2023-10-19T12:43:28.779035+0000","last_fullsized":"2023-10-19T12:43:28.779035+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:28:25.801772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"90'15","reported_seq":35,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-19T12:43:28.783069+0000","last_change":"2023-10-19T12:41:19.287620+0000","last_active":"2023-10-19T12:43:28.783069+0000","last_peered":"2023-10-19T12:43:28.783069+0000","last_clean":"2023-10-19T12:43:28.783069+0000","last_became_active":"2023-10-19T12:41:19.287298+0000","last_became_peered":"2023-10-19T12:41:19.287298+0000","last_unstale":"2023-10-19T12:43:28.783069+0000","last_undegraded":"2023-10-19T12:43:28.783069+0000","last_fullsized":"2023-10-19T12:43:28.783069+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:01:46.919580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"90'2","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.768730+0000","last_change":"2023-10-19T12:41:19.278455+0000","last_active":"2023-10-19T12:43:27.768730+0000","last_peered":"2023-10-19T12:43:27.768730+0000","last_clean":"2023-10-19T12:43:27.768730+0000","last_became_active":"2023-10-19T12:41:19.278093+0000","last_became_peered":"2023-10-19T12:41:19.278093+0000","last_unstale":"2023-10-19T12:43:27.768730+0000","last_undegraded":"2023-10-19T12:43:27.768730+0000","last_fullsized":"2023-10-19T12:43:27.768730+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T22:52:00.939409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"90'6","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-19T12:43:28.777440+0000","last_change":"2023-10-19T12:41:19.294478+0000","last_active":"2023-10-19T12:43:28.777440+0000","last_peered":"2023-10-19T12:43:28.777440+0000","last_clean":"2023-10-19T12:43:28.777440+0000","last_became_active":"2023-10-19T12:41:19.294136+0000","last_became_peered":"2023-10-19T12:41:19.294136+0000","last_unstale":"2023-10-19T12:43:28.777440+0000","last_undegraded":"2023-10-19T12:43:28.777440+0000","last_fullsized":"2023-10-19T12:43:28.777440+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:18:20.066346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"90'8","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-19T12:42:56.693840+0000","last_change":"2023-10-19T12:41:19.283014+0000","last_active":"2023-10-19T12:42:56.693840+0000","last_peered":"2023-10-19T12:42:56.693840+0000","last_clean":"2023-10-19T12:42:56.693840+0000","last_became_active":"2023-10-19T12:41:19.279958+0000","last_became_peered":"2023-10-19T12:41:19.279958+0000","last_unstale":"2023-10-19T12:42:56.693840+0000","last_undegraded":"2023-10-19T12:42:56.693840+0000","last_fullsized":"2023-10-19T12:42:56.693840+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-21T00:26:13.329031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"90'10","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.766272+0000","last_change":"2023-10-19T12:41:19.296507+0000","last_active":"2023-10-19T12:43:27.766272+0000","last_peered":"2023-10-19T12:43:27.766272+0000","last_clean":"2023-10-19T12:43:27.766272+0000","last_became_active":"2023-10-19T12:41:19.295960+0000","last_became_peered":"2023-10-19T12:41:19.295960+0000","last_unstale":"2023-10-19T12:43:27.766272+0000","last_undegraded":"2023-10-19T12:43:27.766272+0000","last_fullsized":"2023-10-19T12:43:27.766272+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T22:49:06.224425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"90'11","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.767382+0000","last_change":"2023-10-19T12:41:19.300262+0000","last_active":"2023-10-19T12:43:27.767382+0000","last_peered":"2023-10-19T12:43:27.767382+0000","last_clean":"2023-10-19T12:43:27.767382+0000","last_became_active":"2023-10-19T12:41:19.299702+0000","last_became_peered":"2023-10-19T12:41:19.299702+0000","last_unstale":"2023-10-19T12:43:27.767382+0000","last_undegraded":"2023-10-19T12:43:27.767382+0000","last_fullsized":"2023-10-19T12:43:27.767382+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:30:22.690228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"90'8","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-19T12:43:27.767075+0000","last_change":"2023-10-19T12:41:19.289863+0000","last_active":"2023-10-19T12:43:27.767075+0000","last_peered":"2023-10-19T12:43:27.767075+0000","last_clean":"2023-10-19T12:43:27.767075+0000","last_became_active":"2023-10-19T12:41:19.289556+0000","last_became_peered":"2023-10-19T12:41:19.289556+0000","last_unstale":"2023-10-19T12:43:27.767075+0000","last_undegraded":"2023-10-19T12:43:27.767075+0000","last_fullsized":"2023-10-19T12:43:27.767075+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T12:41:18.258120+0000","last_clean_scrub_stamp":"2023-10-19T12:41:18.258120+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:17:18.560081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":73654,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1073,"num_read_kb":617,"num_write":252,"num_write_kb":153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":1204,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":589824,"data_stored":220962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":220,"ondisk_log_size":220,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":79,"seq":339302416424,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1052672,"data_stored":515057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 19 12:42:35 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.86699999999999999,"15min":0.91500000000000004},"min":{"1min":0.39600000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.84399999999999997,"5min":8.5449999999999999,"15min":8.5449999999999999},"last":0.498},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.84499999999999997,"15min":0.88500000000000001},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.90700000000000003,"5min":7.641,"15min":7.641},"last":0.46300000000000002}]},{"osd":1,"last update":"Thu Oct 19 12:42:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.70499999999999996,"15min":0.71299999999999997},"min":{"1min":0.49299999999999999,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.85099999999999998,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.70799999999999996,"15min":0.71199999999999997},"min":{"1min":0.47299999999999998,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.83699999999999997,"5min":1.883,"15min":1.883},"last":0.63400000000000001}]},{"osd":2,"last update":"Thu Oct 19 12:42:35 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.54800000000000004,"15min":0.55700000000000005},"min":{"1min":0.39600000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.64700000000000002,"5min":1.496,"15min":1.496},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.55300000000000005,"15min":0.55100000000000005},"min":{"1min":0.35499999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.92700000000000005,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.64500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":4,"last update":"Thu Oct 19 12:42:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.83499999999999996,"15min":0.85499999999999998},"min":{"1min":0.57099999999999995,"5min":0.495,"15min":0.495},"max":{"1min":0.95499999999999996,"5min":3.5190000000000001,"15min":3.5190000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.75700000000000001,"15min":0.76900000000000002},"min":{"1min":0.55700000000000005,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.90200000000000002,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.70099999999999996}]},{"osd":5,"last update":"Thu Oct 19 12:42:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63900000000000001,"15min":0.64000000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.02,"5min":1.675,"15min":1.675},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.69599999999999995,"15min":0.69799999999999995},"min":{"1min":0.45800000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0920000000000001,"5min":2.089,"15min":2.089},"last":0.71299999999999997}]},{"osd":6,"last update":"Thu Oct 19 12:42:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.75700000000000001,"15min":0.76400000000000001},"min":{"1min":0.48899999999999999,"5min":0.438,"15min":0.438},"max":{"1min":1.0609999999999999,"5min":2.004,"15min":2.004},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.75900000000000001,"15min":0.76700000000000002},"min":{"1min":0.51100000000000001,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.641,"5min":1.704,"15min":1.704},"last":0.66500000000000004}]},{"osd":7,"last update":"Thu Oct 19 12:42:35 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":1.0029999999999999,"15min":1.0449999999999999},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.98199999999999998,"5min":6.5590000000000002,"15min":6.5590000000000002},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.78500000000000003,"5min":1.0620000000000001,"15min":1.1080000000000001},"min":{"1min":0.60099999999999998,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.99199999999999999,"5min":7.3070000000000004,"15min":7.3070000000000004},"last":0.82099999999999995}]},{"osd":8,"last update":"Thu Oct 19 12:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.753,"15min":0.75700000000000001},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.94699999999999995,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.75},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.70899999999999996,"15min":0.70699999999999996},"min":{"1min":0.53500000000000003,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.72499999999999998}]},{"osd":9,"last update":"Thu Oct 19 12:42:35 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":1.0529999999999999,"15min":1.095},"min":{"1min":0.60899999999999999,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.96999999999999997,"5min":7.8440000000000003,"15min":7.8440000000000003},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.96799999999999997,"15min":0.99199999999999999},"min":{"1min":0.621,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.0269999999999999,"5min":5.0860000000000003,"15min":5.0860000000000003},"last":0.84199999999999997}]},{"osd":10,"last update":"Thu Oct 19 12:42:35 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":1.0920000000000001,"15min":1.1299999999999999},"min":{"1min":0.72899999999999998,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.0269999999999999,"5min":7.2619999999999996,"15min":7.2619999999999996},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.81299999999999994,"5min":1.085,"15min":1.1299999999999999},"min":{"1min":0.65600000000000003,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.008,"5min":7.7619999999999996,"15min":7.7619999999999996},"last":0.80900000000000005}]}]},{"osd":10,"up_from":72,"seq":309237645355,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28728,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716424,"statfs":{"total":95995035648,"available":95965618176,"internally_reserved":0,"allocated":1744896,"data_stored":1167130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 19 12:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.61199999999999999,"15min":0.57199999999999995},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":5.8819999999999997,"5min":5.8819999999999997,"15min":5.8819999999999997},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.55600000000000005,"15min":0.55000000000000004},"min":{"1min":0.39900000000000002,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.58999999999999997}]},{"osd":1,"last update":"Thu Oct 19 12:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.44900000000000001,"15min":0.45600000000000002},"min":{"1min":0.29699999999999999,"5min":0.254,"15min":0.254},"max":{"1min":0.57199999999999995,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.32200000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.61299999999999999,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.51800000000000002}]},{"osd":2,"last update":"Thu Oct 19 12:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.68200000000000005,"15min":0.69699999999999995},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.78800000000000003,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.68600000000000005,"15min":0.70999999999999996},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.77300000000000002,"5min":2.2050000000000001,"15min":2.2050000000000001},"last":0.751}]},{"osd":3,"last update":"Thu Oct 19 12:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.63600000000000001,"15min":0.65500000000000003},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.83999999999999997,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.70799999999999996,"15min":0.68100000000000005},"min":{"1min":0.47399999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":5.9109999999999996,"5min":5.9109999999999996,"15min":5.9109999999999996},"last":0.67300000000000004}]},{"osd":4,"last update":"Thu Oct 19 12:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.56999999999999995,"15min":0.57499999999999996},"min":{"1min":0.41099999999999998,"5min":0.37,"15min":0.37},"max":{"1min":0.68700000000000006,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.623},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.56299999999999994,"15min":0.56999999999999995},"min":{"1min":0.33700000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.75700000000000001,"5min":0.999,"15min":0.999},"last":0.73399999999999999}]},{"osd":5,"last update":"Thu Oct 19 12:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.79700000000000004,"15min":0.83499999999999996},"min":{"1min":0.45700000000000002,"5min":0.434,"15min":0.434},"max":{"1min":0.92500000000000004,"5min":2.3940000000000001,"15min":2.3940000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.755,"15min":0.77600000000000002},"min":{"1min":0.54200000000000004,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.88500000000000001,"5min":2.2530000000000001,"15min":2.2530000000000001},"last":0.90200000000000002}]},{"osd":6,"last update":"Thu Oct 19 12:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.74299999999999999,"15min":0.76100000000000001},"min":{"1min":0.46200000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.92200000000000004,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.75900000000000001,"15min":0.76400000000000001},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.93300000000000005,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.77500000000000002}]},{"osd":7,"last update":"Thu Oct 19 12:41:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":1.046}]},{"osd":8,"last update":"Thu Oct 19 12:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.81399999999999995,"15min":0.84499999999999997},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.82199999999999995,"5min":2.012,"15min":2.012},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.754,"5min":0.86699999999999999,"15min":0.90700000000000003},"min":{"1min":0.53100000000000003,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.95999999999999996,"5min":2.2290000000000001,"15min":2.2290000000000001},"last":0.96499999999999997}]},{"osd":9,"last update":"Thu Oct 19 12:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.80700000000000005,"15min":0.81399999999999995},"min":{"1min":0.61099999999999999,"5min":0.5,"15min":0.5},"max":{"1min":0.97199999999999998,"5min":1.262,"15min":1.262},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":2.032,"5min":2.032,"15min":2.032},"last":0.88900000000000001}]},{"osd":11,"last update":"Thu Oct 19 12:42:35 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76200000000000001,"15min":0.76100000000000001},"min":{"1min":0.56599999999999995,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.76200000000000001,"15min":0.754},"min":{"1min":0.59699999999999998,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.98599999999999999}]}]},{"osd":9,"up_from":67,"seq":287762808879,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28056,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717096,"statfs":{"total":95995035648,"available":95966306304,"internally_reserved":0,"allocated":1060864,"data_stored":508048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 19 12:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.55200000000000005,"15min":0.57899999999999996},"min":{"1min":0.39200000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.502,"5min":0.55000000000000004,"15min":0.57199999999999995},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.63600000000000001,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.60599999999999998}]},{"osd":1,"last update":"Thu Oct 19 12:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.76600000000000001,"15min":0.79400000000000004},"min":{"1min":0.58199999999999996,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.79100000000000004,"15min":0.78300000000000003},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":6.9279999999999999,"5min":6.9279999999999999,"15min":6.9279999999999999},"last":0.58099999999999996}]},{"osd":2,"last update":"Thu Oct 19 12:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.80800000000000005,"15min":0.79400000000000004},"min":{"1min":0.57399999999999995,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":6.9420000000000002,"5min":6.9420000000000002,"15min":6.9420000000000002},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.76000000000000001,"15min":0.77400000000000002},"min":{"1min":0.49099999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.24,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.70499999999999996}]},{"osd":3,"last update":"Thu Oct 19 12:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.71899999999999997,"15min":0.75900000000000001},"min":{"1min":0.46700000000000003,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.0529999999999999,"5min":1.196,"15min":1.196},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.80300000000000005,"15min":0.84699999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.1950000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.72299999999999998}]},{"osd":4,"last update":"Thu Oct 19 12:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.80100000000000005,"15min":0.84499999999999997},"min":{"1min":0.53900000000000003,"5min":0.495,"15min":0.495},"max":{"1min":0.94299999999999995,"5min":1.125,"15min":1.125},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.80400000000000005,"15min":0.83799999999999997},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.95299999999999996,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.53800000000000003}]},{"osd":5,"last update":"Thu Oct 19 12:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.84799999999999998,"15min":0.88900000000000001},"min":{"1min":0.58999999999999997,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0429999999999999,"5min":1.141,"15min":1.141},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.83199999999999996,"15min":0.85799999999999998},"min":{"1min":0.55200000000000005,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":0.86099999999999999}]},{"osd":6,"last update":"Thu Oct 19 12:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.48299999999999998}]},{"osd":7,"last update":"Thu Oct 19 12:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.89200000000000002,"15min":0.93000000000000005},"min":{"1min":0.53200000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.097,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.628},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.95399999999999996,"15min":1.0089999999999999},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.4370000000000001,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":0.78700000000000003}]},{"osd":8,"last update":"Thu Oct 19 12:42:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.0089999999999999,"15min":1.0349999999999999},"min":{"1min":0.61799999999999999,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":6.992,"5min":6.992,"15min":6.992},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.871,"5min":0.93500000000000005,"15min":0.97199999999999998},"min":{"1min":0.61299999999999999,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":0.90700000000000003}]},{"osd":10,"last update":"Thu Oct 19 12:43:13 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.93100000000000005,"15min":0.98299999999999998},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.0680000000000001,"5min":1.248,"15min":1.248},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.94099999999999995,"15min":0.96799999999999997},"min":{"1min":0.65500000000000003,"5min":0.624,"15min":0.624},"max":{"1min":1.1359999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.76900000000000002}]},{"osd":11,"last update":"Thu Oct 19 12:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.95099999999999996,"15min":0.96099999999999997},"min":{"1min":0.72599999999999998,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.097,"5min":1.526,"15min":1.526},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.89100000000000001,"15min":0.90100000000000002},"min":{"1min":0.63,"5min":0.629,"15min":0.629},"max":{"1min":1.2050000000000001,"5min":1.393,"15min":1.393},"last":0.83099999999999996}]}]},{"osd":8,"up_from":59,"seq":253403070515,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28064,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717088,"statfs":{"total":95995035648,"available":95966298112,"internally_reserved":0,"allocated":1064960,"data_stored":513670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 19 12:43:29 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.59699999999999998,"15min":0.60399999999999998},"min":{"1min":0.434,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.752,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.75},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.60699999999999998,"15min":0.59699999999999998},"min":{"1min":0.48399999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.80500000000000005,"5min":0.872,"15min":0.872},"last":0.60799999999999998}]},{"osd":1,"last update":"Thu Oct 19 12:42:28 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.621,"15min":0.60399999999999998},"min":{"1min":0.504,"5min":0.378,"15min":0.378},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.61299999999999999,"15min":0.58999999999999997},"min":{"1min":0.51500000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.91000000000000003}]},{"osd":2,"last update":"Thu Oct 19 12:43:29 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.504,"15min":0.47799999999999998},"min":{"1min":0.38700000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.498},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.505,"15min":0.47599999999999998},"min":{"1min":0.42099999999999999,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.70499999999999996,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.52800000000000002}]},{"osd":3,"last update":"Thu Oct 19 12:43:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.65300000000000002,"15min":0.63800000000000001},"min":{"1min":0.56299999999999994,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.876,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.64200000000000002,"15min":0.65200000000000002},"min":{"1min":0.45000000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.622}]},{"osd":4,"last update":"Thu Oct 19 12:43:29 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.70899999999999996,"15min":0.69999999999999996},"min":{"1min":0.56299999999999994,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.95299999999999996,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.70699999999999996,"15min":0.66800000000000004},"min":{"1min":0.64700000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.68799999999999994}]},{"osd":5,"last update":"Thu Oct 19 12:43:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.59299999999999997,"15min":0.56699999999999995},"min":{"1min":0.47899999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.63300000000000001,"15min":0.621},"min":{"1min":0.35899999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.92100000000000004,"5min":1.01,"15min":1.01},"last":0.66200000000000003}]},{"osd":6,"last update":"Thu Oct 19 12:43:29 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.76200000000000001,"15min":0.73699999999999999},"min":{"1min":0.70099999999999996,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.1399999999999999,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.748,"15min":0.72599999999999998},"min":{"1min":0.67100000000000004,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.79400000000000004}]},{"osd":7,"last update":"Thu Oct 19 12:43:29 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.79100000000000004,"15min":0.753},"min":{"1min":0.58299999999999996,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.107,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.88,"5min":0.79300000000000004,"15min":0.77900000000000003},"min":{"1min":0.64200000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.98799999999999999,"5min":1.113,"15min":1.113},"last":0.93300000000000005}]},{"osd":9,"last update":"Thu Oct 19 12:42:56 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.80200000000000005,"15min":0.77000000000000002},"min":{"1min":0.67500000000000004,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":2.4129999999999998,"5min":2.4129999999999998,"15min":2.4129999999999998},"last":0.872},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.83499999999999996,"15min":0.80000000000000004},"min":{"1min":0.76900000000000002,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":2.4300000000000002,"5min":2.4300000000000002,"15min":2.4300000000000002},"last":0.90600000000000003}]},{"osd":10,"last update":"Thu Oct 19 12:43:18 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.76200000000000001,"15min":0.71499999999999997},"min":{"1min":0.56200000000000006,"5min":0.434,"15min":0.434},"max":{"1min":1.0189999999999999,"5min":1.145,"15min":1.145},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.81200000000000006,"15min":0.77400000000000002},"min":{"1min":0.59699999999999998,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.96399999999999997}]},{"osd":11,"last update":"Thu Oct 19 12:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.88,"15min":0.871},"min":{"1min":0.74099999999999999,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.84399999999999997,"15min":0.84199999999999997},"min":{"1min":0.68500000000000005,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.88800000000000001}]}]},{"osd":7,"up_from":51,"seq":219043332153,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28648,"kb_used_data":1628,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716504,"statfs":{"total":95995035648,"available":95965700096,"internally_reserved":0,"allocated":1667072,"data_stored":1110674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 19 12:41:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.61899999999999999,"15min":0.60899999999999999},"min":{"1min":0.434,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.56699999999999995,"15min":0.56299999999999994},"min":{"1min":0.46400000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.76600000000000001,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.45400000000000001}]},{"osd":1,"last update":"Thu Oct 19 12:43:07 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.41999999999999998,"15min":0.40799999999999997},"min":{"1min":0.29999999999999999,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.52300000000000002,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.309},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.44500000000000001,"15min":0.42999999999999999},"min":{"1min":0.27800000000000002,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.56699999999999995}]},{"osd":2,"last update":"Thu Oct 19 12:43:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.60799999999999998,"15min":0.59999999999999998},"min":{"1min":0.378,"5min":0.314,"15min":0.314},"max":{"1min":0.79300000000000004,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60199999999999998,"15min":0.61399999999999999},"min":{"1min":0.42599999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.76300000000000001,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.46999999999999997}]},{"osd":3,"last update":"Thu Oct 19 12:43:07 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.63900000000000001,"15min":0.63100000000000001},"min":{"1min":0.47199999999999998,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.81899999999999995,"5min":0.877,"15min":0.877},"last":0.436},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.59699999999999998,"15min":0.60799999999999998},"min":{"1min":0.46200000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.83299999999999996,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.54300000000000004}]},{"osd":4,"last update":"Thu Oct 19 12:43:07 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.51000000000000001,"15min":0.504},"min":{"1min":0.34799999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.63900000000000001,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.5,"15min":0.48599999999999999},"min":{"1min":0.33100000000000002,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.745,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.374}]},{"osd":5,"last update":"Thu Oct 19 12:43:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.68600000000000005,"15min":0.67800000000000005},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.86099999999999999,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.65000000000000002,"15min":0.64000000000000001},"min":{"1min":0.49199999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.496}]},{"osd":6,"last update":"Thu Oct 19 12:43:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.71899999999999997,"15min":0.72499999999999998},"min":{"1min":0.57199999999999995,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.81499999999999995,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.66500000000000004,"15min":0.66600000000000004},"min":{"1min":0.52600000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.91600000000000004,"5min":1.006,"15min":1.006},"last":0.68799999999999994}]},{"osd":8,"last update":"Thu Oct 19 12:43:26 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.72799999999999998,"15min":0.72399999999999998},"min":{"1min":0.61399999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.88200000000000001,"5min":1.002,"15min":1.002},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.69999999999999996,"15min":0.68799999999999994},"min":{"1min":0.56000000000000005,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.72399999999999998}]},{"osd":9,"last update":"Thu Oct 19 12:42:56 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.79900000000000004,"15min":0.78600000000000003},"min":{"1min":0.63,"5min":0.504,"15min":0.504},"max":{"1min":0.90000000000000002,"5min":2.9780000000000002,"15min":2.9780000000000002},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.74099999999999999,"15min":0.751},"min":{"1min":0.58699999999999997,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.94499999999999995,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.628}]},{"osd":10,"last update":"Thu Oct 19 12:43:15 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.68100000000000005,"15min":0.68300000000000005},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.91300000000000003,"5min":1.044,"15min":1.044},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.751,"15min":0.753},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.93100000000000005,"5min":1.024,"15min":1.024},"last":0.67300000000000004}]},{"osd":11,"last update":"Thu Oct 19 12:43:19 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82599999999999996,"15min":0.82699999999999996},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":0.94099999999999995,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.71399999999999997,"15min":0.71499999999999997},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.59399999999999997}]}]},{"osd":6,"up_from":46,"seq":197568495677,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1048576,"data_stored":509378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 19 12:42:51 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.52900000000000003,"15min":0.497},"min":{"1min":0.41399999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.55000000000000004,"15min":0.55200000000000005},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.69499999999999995}]},{"osd":1,"last update":"Thu Oct 19 12:42:51 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.68000000000000005,"15min":0.63400000000000001},"min":{"1min":0.47499999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":3.4430000000000001,"5min":3.4430000000000001,"15min":3.4430000000000001},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.73599999999999999,"15min":0.68799999999999994},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.841,"5min":1.841,"15min":1.841},"last":0.89800000000000002}]},{"osd":2,"last update":"Thu Oct 19 12:42:51 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.72599999999999998,"15min":0.69199999999999995},"min":{"1min":0.54000000000000004,"5min":0.437,"15min":0.437},"max":{"1min":3.5110000000000001,"5min":3.5110000000000001,"15min":3.5110000000000001},"last":0.877},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.67900000000000005,"15min":0.66200000000000003},"min":{"1min":0.39200000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.91500000000000004}]},{"osd":3,"last update":"Thu Oct 19 12:42:51 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.61899999999999999,"15min":0.627},"min":{"1min":0.40799999999999997,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.92700000000000005,"5min":1.131,"15min":1.131},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.71299999999999997,"15min":0.70699999999999996},"min":{"1min":0.53800000000000003,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.631,"5min":1.631,"15min":1.631},"last":0.85499999999999998}]},{"osd":4,"last update":"Thu Oct 19 12:42:51 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.78400000000000003,"15min":0.77600000000000002},"min":{"1min":0.58299999999999996,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.768,"5min":1.768,"15min":1.768},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.80100000000000005,"15min":0.79100000000000004},"min":{"1min":0.56299999999999994,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":3.4900000000000002,"5min":3.4900000000000002,"15min":3.4900000000000002},"last":1.0309999999999999}]},{"osd":5,"last update":"Thu Oct 19 12:42:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":0.87,"15min":0.82799999999999996},"min":{"1min":0.57999999999999996,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":3.4710000000000001,"5min":3.4710000000000001,"15min":3.4710000000000001},"last":1.181},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.82899999999999996,"15min":0.82799999999999996},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.655,"5min":1.655,"15min":1.655},"last":1.135}]},{"osd":7,"last update":"Thu Oct 19 12:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.85499999999999998,"15min":0.81899999999999995},"min":{"1min":0.61199999999999999,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.3919999999999999,"5min":1.879,"15min":1.879},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.86099999999999999,"15min":0.85199999999999998},"min":{"1min":0.55300000000000005,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.097,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":0.98799999999999999}]},{"osd":8,"last update":"Thu Oct 19 12:42:31 2023","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":0.90400000000000003,"15min":0.89400000000000002},"min":{"1min":0.61199999999999999,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.7210000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":1.153},{"interface":"front","average":{"1min":1.133,"5min":0.94199999999999995,"15min":0.92200000000000004},"min":{"1min":0.79200000000000004,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":3.5600000000000001,"5min":3.5600000000000001,"15min":3.5600000000000001},"last":1.1950000000000001}]},{"osd":9,"last update":"Thu Oct 19 12:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.84599999999999997,"15min":0.85899999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.107,"5min":1.216,"15min":1.216},"last":1.113},{"interface":"front","average":{"1min":1.006,"5min":0.98399999999999999,"15min":1},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.9239999999999999,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":1.0549999999999999}]},{"osd":10,"last update":"Thu Oct 19 12:43:19 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":1.01,"15min":1.018},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.47,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":1.0169999999999999},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.96799999999999997,"15min":0.97199999999999998},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.3200000000000001,"5min":1.8640000000000001,"15min":1.8640000000000001},"last":1.069}]},{"osd":11,"last update":"Thu Oct 19 12:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":1.0109999999999999,"15min":1.0189999999999999},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.198,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":1.2609999999999999},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.89200000000000002,"15min":0.89800000000000002},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.109,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":1.163}]}]},{"osd":1,"up_from":13,"seq":55834574932,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28128,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717024,"statfs":{"total":95995035648,"available":95966232576,"internally_reserved":0,"allocated":1130496,"data_stored":577415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 19 12:42:59 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.64600000000000002,"15min":0.59299999999999997},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.77300000000000002,"5min":8.4559999999999995,"15min":8.4559999999999995},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.60899999999999999,"15min":0.57399999999999995},"min":{"1min":0.42199999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.45600000000000002}]},{"osd":2,"last update":"Thu Oct 19 12:43:15 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.56999999999999995,"15min":0.60199999999999998},"min":{"1min":0.47499999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.872,"5min":0.872,"15min":4.1710000000000003},"last":0.62},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.60599999999999998,"15min":0.53100000000000003},"min":{"1min":0.52500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.87,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.60699999999999998}]},{"osd":3,"last update":"Thu Oct 19 12:42:38 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.61399999999999999,"15min":0.59199999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.86299999999999999,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.56999999999999995,"15min":0.56000000000000005},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.67700000000000005}]},{"osd":4,"last update":"Thu Oct 19 12:43:08 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.44900000000000001,"15min":0.40999999999999998},"min":{"1min":0.26900000000000002,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.73699999999999999,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.45700000000000002,"15min":0.41299999999999998},"min":{"1min":0.30499999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.77300000000000002,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.57299999999999995}]},{"osd":5,"last update":"Thu Oct 19 12:43:24 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.55800000000000005,"15min":0.54100000000000004},"min":{"1min":0.42199999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.752,"5min":0.65000000000000002,"15min":0.58799999999999997},"min":{"1min":0.51400000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.91000000000000003,"5min":1.03,"15min":1.03},"last":0.79000000000000004}]},{"osd":6,"last update":"Thu Oct 19 12:42:52 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.71599999999999997,"15min":0.69599999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.97799999999999998,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.622,"5min":0.78100000000000003,"15min":0.92700000000000005},"min":{"1min":0.432,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.86199999999999999,"5min":8.4039999999999999,"15min":8.4039999999999999},"last":0.63400000000000001}]},{"osd":7,"last update":"Thu Oct 19 12:43:09 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.63900000000000001,"15min":0.61899999999999999},"min":{"1min":0.42799999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.94499999999999995,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.79800000000000004,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.51200000000000001}]},{"osd":8,"last update":"Thu Oct 19 12:42:28 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.64400000000000002,"15min":0.628},"min":{"1min":0.51100000000000001,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.93799999999999994,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.752,"15min":0.73799999999999999},"min":{"1min":0.57999999999999996,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0409999999999999,"5min":1.117,"15min":1.117},"last":0.71799999999999997}]},{"osd":9,"last update":"Thu Oct 19 12:42:59 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.71099999999999997,"15min":0.70899999999999996},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.90900000000000003,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.746},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.748,"15min":0.74199999999999999},"min":{"1min":0.54800000000000004,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.73299999999999998}]},{"osd":10,"last update":"Thu Oct 19 12:43:15 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68899999999999995,"15min":0.67500000000000004},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.85999999999999999,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.77800000000000002,"15min":0.75800000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0129999999999999,"5min":1.099,"15min":1.099},"last":0.83599999999999997}]},{"osd":11,"last update":"Thu Oct 19 12:43:24 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.81399999999999995,"15min":0.81699999999999995},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.95799999999999996,"5min":1.022,"15min":1.022},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.89500000000000002,"15min":0.89700000000000002},"min":{"1min":0.66600000000000004,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.048,"5min":1.125,"15min":1.125},"last":0.85699999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738457,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28072,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717080,"statfs":{"total":95995035648,"available":95966289920,"internally_reserved":0,"allocated":1073152,"data_stored":511365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Oct 19 12:42:51 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.63700000000000001,"15min":0.57699999999999996},"min":{"1min":0.42499999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.88900000000000001,"5min":1.405,"15min":1.405},"last":4.6349999999999998},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.70199999999999996,"15min":0.59599999999999997},"min":{"1min":0.45200000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":5.4880000000000004,"5min":5.4880000000000004,"15min":5.4880000000000004},"last":1.4850000000000001}]},{"osd":2,"last update":"Thu Oct 19 12:43:19 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.71799999999999997,"15min":0.64000000000000001},"min":{"1min":0.439,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":5.54,"5min":5.54,"15min":5.54},"last":2.1139999999999999},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.67600000000000005,"15min":0.58999999999999997},"min":{"1min":0.45400000000000001,"5min":0.379,"15min":0.379},"max":{"1min":1.075,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":5.1500000000000004}]},{"osd":3,"last update":"Thu Oct 19 12:43:22 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.502,"15min":0.5},"min":{"1min":0.40100000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.69499999999999995,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":4.7430000000000003},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.64100000000000001,"15min":0.63900000000000001},"min":{"1min":0.52900000000000003,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.85799999999999998,"5min":1.145,"15min":1.145},"last":5.0279999999999996}]},{"osd":4,"last update":"Thu Oct 19 12:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.70599999999999996,"15min":0.64900000000000002},"min":{"1min":0.50600000000000001,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":2.7269999999999999,"5min":2.7269999999999999,"15min":2.7269999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.68500000000000005,"15min":0.64300000000000002},"min":{"1min":0.46800000000000003,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":2.2069999999999999,"5min":2.2069999999999999,"15min":2.2069999999999999},"last":4.7629999999999999}]},{"osd":5,"last update":"Thu Oct 19 12:43:22 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.73399999999999999,"15min":0.68200000000000005},"min":{"1min":0.46999999999999997,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.091,"5min":2.8300000000000001,"15min":2.8300000000000001},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.73099999999999998,"15min":0.70099999999999996},"min":{"1min":0.52300000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.97899999999999998,"5min":2.145,"15min":2.145},"last":2.0680000000000001}]},{"osd":6,"last update":"Thu Oct 19 12:42:47 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.71099999999999997,"15min":0.67400000000000004},"min":{"1min":0.434,"5min":0.375,"15min":0.375},"max":{"1min":2.2930000000000001,"5min":2.2930000000000001,"15min":2.2930000000000001},"last":4.9340000000000002},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.70699999999999996,"15min":0.66600000000000004},"min":{"1min":0.51000000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.081,"5min":1.6160000000000001,"15min":1.6160000000000001},"last":4.7830000000000004}]},{"osd":7,"last update":"Thu Oct 19 12:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.83699999999999997,"15min":0.81299999999999994},"min":{"1min":0.57299999999999995,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":4.6929999999999996,"5min":4.6929999999999996,"15min":4.6929999999999996},"last":4.6929999999999996},{"interface":"front","average":{"1min":0.80000000000000004,"5min":1.075,"15min":1.121},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.2729999999999999,"5min":5.524,"15min":5.524},"last":0.52600000000000002}]},{"osd":8,"last update":"Thu Oct 19 12:42:29 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.89900000000000002,"15min":0.83099999999999996},"min":{"1min":0.61299999999999999,"5min":0.503,"15min":0.503},"max":{"1min":2.7949999999999999,"5min":6.8730000000000002,"15min":6.8730000000000002},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.84599999999999997,"15min":0.83499999999999996},"min":{"1min":0.60099999999999998,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":2.1760000000000002,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":4.835}]},{"osd":9,"last update":"Thu Oct 19 12:42:56 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.80500000000000005,"15min":0.76900000000000002},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":2.6309999999999998,"5min":2.6309999999999998,"15min":2.6309999999999998},"last":4.9109999999999996},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.876,"15min":0.85799999999999998},"min":{"1min":0.46899999999999997,"5min":0.442,"15min":0.442},"max":{"1min":2.9359999999999999,"5min":2.9359999999999999,"15min":2.9359999999999999},"last":4.6680000000000001}]},{"osd":10,"last update":"Thu Oct 19 12:43:19 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.024,"15min":0.99199999999999999},"min":{"1min":0.70099999999999996,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":5.5540000000000003,"5min":5.5540000000000003,"15min":5.5540000000000003},"last":1.5429999999999999},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.95199999999999996,"15min":0.96599999999999997},"min":{"1min":0.69699999999999995,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.292,"5min":2.2639999999999998,"15min":2.2639999999999998},"last":4.8879999999999999}]},{"osd":11,"last update":"Thu Oct 19 12:42:36 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.84599999999999997,"15min":0.84299999999999997},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.1160000000000001,"5min":1.22,"15min":1.22},"last":4.9889999999999999},{"interface":"front","average":{"1min":1.036,"5min":0.95199999999999996,"15min":0.93799999999999994},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":2.907,"5min":2.907,"15min":2.907},"last":0.59399999999999997}]}]},{"osd":2,"up_from":18,"seq":77309411409,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28132,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717020,"statfs":{"total":95995035648,"available":95966228480,"internally_reserved":0,"allocated":1134592,"data_stored":576922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 19 12:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.57099999999999995,"15min":0.56799999999999995},"min":{"1min":0.439,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.68999999999999995,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.624,"15min":0.57999999999999996},"min":{"1min":0.36799999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.3520000000000001,"5min":6.726,"15min":6.726},"last":0.51200000000000001}]},{"osd":1,"last update":"Thu Oct 19 12:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.60899999999999999,"15min":0.56499999999999995},"min":{"1min":0.32400000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.85599999999999998,"5min":1.081,"15min":1.081},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.61899999999999999,"15min":0.57299999999999995},"min":{"1min":0.38400000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.99199999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.83799999999999997}]},{"osd":3,"last update":"Thu Oct 19 12:42:39 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.60799999999999998,"15min":0.58999999999999997},"min":{"1min":0.48799999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.90300000000000002,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.58199999999999996,"15min":0.59899999999999998},"min":{"1min":0.39600000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.76000000000000001,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.63500000000000001}]},{"osd":4,"last update":"Thu Oct 19 12:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.71599999999999997,"15min":0.72199999999999998},"min":{"1min":0.51200000000000001,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.745},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.70399999999999996,"15min":0.71899999999999997},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.76300000000000001,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.59799999999999998}]},{"osd":5,"last update":"Thu Oct 19 12:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.504,"15min":0.45700000000000002},"min":{"1min":0.38300000000000001,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.77500000000000002,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.53400000000000003,"15min":0.48199999999999998},"min":{"1min":0.378,"5min":0.25,"15min":0.25},"max":{"1min":0.89700000000000002,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.40400000000000003}]},{"osd":6,"last update":"Thu Oct 19 12:42:47 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.67600000000000005,"15min":0.64600000000000002},"min":{"1min":0.55600000000000005,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.91000000000000003,"5min":1.042,"15min":1.042},"last":0.503},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67200000000000004,"15min":0.66200000000000003},"min":{"1min":0.44600000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.88100000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.70899999999999996}]},{"osd":7,"last update":"Thu Oct 19 12:43:25 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.79900000000000004,"15min":0.80700000000000005},"min":{"1min":0.59399999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":0.97399999999999998,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.81299999999999994,"15min":0.81899999999999995},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":0.996,"5min":1.016,"15min":1.016},"last":0.78900000000000003}]},{"osd":8,"last update":"Thu Oct 19 12:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.67000000000000004,"15min":0.66400000000000003},"min":{"1min":0.40500000000000003,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.91300000000000003,"5min":1.429,"15min":1.429},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.69299999999999995,"15min":0.67500000000000004},"min":{"1min":0.497,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.89800000000000002,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.61699999999999999}]},{"osd":9,"last update":"Thu Oct 19 12:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.77700000000000002,"15min":0.747},"min":{"1min":0.54600000000000004,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.077,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.748,"15min":0.72299999999999998},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.80400000000000005}]},{"osd":10,"last update":"Thu Oct 19 12:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.73599999999999999,"15min":0.71299999999999997},"min":{"1min":0.498,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.88900000000000001,"5min":0.997,"15min":0.997},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.78600000000000003,"15min":0.74399999999999999},"min":{"1min":0.63600000000000001,"5min":0.504,"15min":0.504},"max":{"1min":1.0509999999999999,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.82099999999999995}]},{"osd":11,"last update":"Thu Oct 19 12:43:19 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.84499999999999997,"15min":0.85299999999999998},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.02,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.876},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.89200000000000002,"15min":0.90000000000000002},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.018,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.77700000000000002}]}]},{"osd":3,"up_from":25,"seq":107374182475,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28040,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717112,"statfs":{"total":95995035648,"available":95966322688,"internally_reserved":0,"allocated":1044480,"data_stored":499164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 19 12:42:39 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.46400000000000002,"15min":0.438},"min":{"1min":0.36099999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.86899999999999999,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.47699999999999998,"15min":0.42099999999999999},"min":{"1min":0.318,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.0029999999999999,"5min":1.044,"15min":1.044},"last":0.39700000000000002}]},{"osd":1,"last update":"Thu Oct 19 12:42:39 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.68799999999999994,"15min":0.621},"min":{"1min":0.50700000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.032,"5min":1.077,"15min":1.077},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.622,"5min":0.627,"15min":0.57299999999999995},"min":{"1min":0.47199999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.81799999999999995,"5min":1.228,"15min":1.228},"last":0.79800000000000004}]},{"osd":2,"last update":"Thu Oct 19 12:42:39 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.66300000000000003,"15min":0.61499999999999999},"min":{"1min":0.58299999999999996,"5min":0.377,"15min":0.377},"max":{"1min":0.85199999999999998,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.71199999999999997,"15min":0.622},"min":{"1min":0.59099999999999997,"5min":0.374,"15min":0.374},"max":{"1min":1.0329999999999999,"5min":1.056,"15min":1.056},"last":0.505}]},{"osd":4,"last update":"Thu Oct 19 12:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72599999999999998,"15min":0.66000000000000003},"min":{"1min":0.46500000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.99199999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.75600000000000001,"15min":0.66600000000000004},"min":{"1min":0.55900000000000005,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0609999999999999,"5min":1.228,"15min":1.228},"last":0.85599999999999998}]},{"osd":5,"last update":"Thu Oct 19 12:42:27 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.79800000000000004,"15min":0.746},"min":{"1min":0.63,"5min":0.501,"15min":0.501},"max":{"1min":1.0680000000000001,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.752,"5min":0.72599999999999998,"15min":0.69499999999999995},"min":{"1min":0.59999999999999998,"5min":0.443,"15min":0.443},"max":{"1min":0.96999999999999997,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.59999999999999998}]},{"osd":6,"last update":"Thu Oct 19 12:42:46 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.66100000000000003,"15min":0.629},"min":{"1min":0.44500000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.76500000000000001,"15min":0.71299999999999997},"min":{"1min":0.53700000000000003,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.1759999999999999,"5min":1.45,"15min":1.45},"last":0.58099999999999996}]},{"osd":7,"last update":"Thu Oct 19 12:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71499999999999997,"15min":0.69899999999999995},"min":{"1min":0.47299999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.85499999999999998,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.77900000000000003,"15min":0.74099999999999999},"min":{"1min":0.59799999999999998,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.77800000000000002}]},{"osd":8,"last update":"Thu Oct 19 12:40:26 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.97599999999999998},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.998}]},{"osd":9,"last update":"Thu Oct 19 12:42:56 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.91100000000000003,"15min":0.90900000000000003},"min":{"1min":0.47199999999999998,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.0900000000000001,"5min":1.478,"15min":1.478},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.78100000000000003,"15min":0.79700000000000004},"min":{"1min":0.497,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":0.69799999999999995}]},{"osd":10,"last update":"Thu Oct 19 12:43:20 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.85699999999999998,"15min":0.89500000000000002},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.93600000000000005,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.88900000000000001,"15min":0.92500000000000004},"min":{"1min":0.64300000000000002,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.0620000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.67900000000000005}]},{"osd":11,"last update":"Thu Oct 19 12:43:20 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.91200000000000003,"15min":0.91400000000000003},"min":{"1min":0.76300000000000001,"5min":0.752,"15min":0.752},"max":{"1min":1.1160000000000001,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.81000000000000005,"15min":0.81399999999999995},"min":{"1min":0.60799999999999998,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.97599999999999998,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.755}]}]},{"osd":4,"up_from":33,"seq":141733920838,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28052,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717100,"statfs":{"total":95995035648,"available":95966310400,"internally_reserved":0,"allocated":1056768,"data_stored":513768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 19 12:40:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.51900000000000002,"15min":0.50700000000000001},"min":{"1min":0.38500000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.44},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.54900000000000004,"15min":0.52900000000000003},"min":{"1min":0.47999999999999998,"5min":0.37,"15min":0.37},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":2.1539999999999999}]},{"osd":1,"last update":"Thu Oct 19 12:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.42799999999999999,"15min":0.39400000000000002},"min":{"1min":0.35299999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.51600000000000001,"5min":2.3559999999999999,"15min":2.3559999999999999},"last":0.437},{"interface":"front","average":{"1min":0.441,"5min":0.44600000000000001,"15min":0.40799999999999997},"min":{"1min":0.34799999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.61399999999999999,"5min":3.129,"15min":3.129},"last":0.47999999999999998}]},{"osd":2,"last update":"Thu Oct 19 12:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.64200000000000002,"15min":0.56799999999999995},"min":{"1min":0.34200000000000003,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.747,"5min":7.6470000000000002,"15min":7.6470000000000002},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.622,"15min":0.57199999999999995},"min":{"1min":0.45000000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.82899999999999996,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.79100000000000004}]},{"osd":3,"last update":"Thu Oct 19 12:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.63400000000000001,"15min":0.58499999999999996},"min":{"1min":0.50600000000000001,"5min":0.376,"15min":0.376},"max":{"1min":1.2669999999999999,"5min":3.1019999999999999,"15min":3.1019999999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.66400000000000003,"15min":0.61299999999999999},"min":{"1min":0.42199999999999999,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.0109999999999999,"5min":7.444,"15min":7.444},"last":0.64900000000000002}]},{"osd":5,"last update":"Thu Oct 19 12:43:22 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.66800000000000004,"15min":0.628},"min":{"1min":0.41999999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.85399999999999998,"5min":1.732,"15min":1.732},"last":0.746},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.70999999999999996,"15min":0.628},"min":{"1min":0.51000000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.79600000000000004,"5min":6.8390000000000004,"15min":6.8390000000000004},"last":0.80600000000000005}]},{"osd":6,"last update":"Thu Oct 19 12:42:48 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.73299999999999998,"15min":0.66100000000000003},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":3.8050000000000002,"5min":6.5309999999999997,"15min":6.5309999999999997},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.71599999999999997,"15min":0.67200000000000004},"min":{"1min":0.56299999999999994,"5min":0.443,"15min":0.443},"max":{"1min":1.3560000000000001,"5min":2.2250000000000001,"15min":2.2250000000000001},"last":0.60399999999999998}]},{"osd":7,"last update":"Thu Oct 19 12:43:10 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.60999999999999999,"15min":0.58099999999999996},"min":{"1min":0.47999999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.82399999999999995,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.625,"5min":0.60199999999999998,"15min":0.56100000000000005},"min":{"1min":0.434,"5min":0.376,"15min":0.376},"max":{"1min":0.97099999999999997,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.69999999999999996}]},{"osd":8,"last update":"Thu Oct 19 12:43:29 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.76000000000000001,"15min":0.70699999999999996},"min":{"1min":0.56100000000000005,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.0069999999999999,"5min":2.2719999999999998,"15min":2.2719999999999998},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.74299999999999999,"15min":0.69399999999999995},"min":{"1min":0.622,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.84799999999999998,"5min":2.504,"15min":2.504},"last":0.76900000000000002}]},{"osd":9,"last update":"Thu Oct 19 12:42:59 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.77900000000000003,"15min":0.747},"min":{"1min":0.53800000000000003,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.28,"5min":4.5800000000000001,"15min":4.5800000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.871,"15min":0.82699999999999996},"min":{"1min":0.65500000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.319,"5min":3.8300000000000001,"15min":3.8300000000000001},"last":0.86599999999999999}]},{"osd":10,"last update":"Thu Oct 19 12:43:15 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80100000000000005},"min":{"1min":0.61799999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.91200000000000003,"5min":1.538,"15min":1.538},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.749,"5min":0.81399999999999995,"15min":0.77500000000000002},"min":{"1min":0.58299999999999996,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0309999999999999,"5min":6.8780000000000001,"15min":6.8780000000000001},"last":0.84899999999999998}]},{"osd":11,"last update":"Thu Oct 19 12:43:21 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.91400000000000003,"15min":0.93300000000000005},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":0.93100000000000005,"5min":3.0350000000000001,"15min":3.0350000000000001},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.73399999999999999,"5min":1.0149999999999999,"15min":1.0620000000000001},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.05,"5min":7.3010000000000002,"15min":7.3010000000000002},"last":0.82199999999999995}]}]},{"osd":5,"up_from":38,"seq":163208757314,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28656,"kb_used_data":1636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716496,"statfs":{"total":95995035648,"available":95965691904,"internally_reserved":0,"allocated":1675264,"data_stored":1105940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 19 12:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.53900000000000003,"15min":0.52700000000000002},"min":{"1min":0.34799999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.54500000000000004,"15min":0.53700000000000003},"min":{"1min":0.35499999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.79000000000000004,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.47999999999999998}]},{"osd":1,"last update":"Thu Oct 19 12:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.57499999999999996,"15min":0.53700000000000003},"min":{"1min":0.379,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.74299999999999999,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.58299999999999996,"15min":0.55200000000000005},"min":{"1min":0.34799999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.81399999999999995,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.52700000000000002}]},{"osd":2,"last update":"Thu Oct 19 12:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.436,"15min":0.39700000000000002},"min":{"1min":0.27400000000000002,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.46600000000000003,"15min":0.438},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.73599999999999999,"5min":1.095,"15min":1.095},"last":0.38500000000000001}]},{"osd":3,"last update":"Thu Oct 19 12:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.59399999999999997,"15min":0.57999999999999996},"min":{"1min":0.41199999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.872,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.62},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.63200000000000001,"15min":0.61799999999999999},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.90000000000000002,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.63500000000000001}]},{"osd":4,"last update":"Thu Oct 19 12:43:23 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.63200000000000001,"15min":0.58599999999999997},"min":{"1min":0.51800000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.874,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.61199999999999999,"15min":0.57799999999999996},"min":{"1min":0.39500000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.82999999999999996,"5min":0.997,"15min":0.997},"last":0.58499999999999996}]},{"osd":6,"last update":"Thu Oct 19 12:42:48 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.67500000000000004,"15min":0.67700000000000005},"min":{"1min":0.47699999999999998,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.94299999999999995,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.65600000000000003}]},{"osd":7,"last update":"Thu Oct 19 12:43:13 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.67500000000000004,"15min":0.66900000000000004},"min":{"1min":0.47399999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.89000000000000001,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.69299999999999995,"15min":0.67000000000000004},"min":{"1min":0.46600000000000003,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.90300000000000002,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.71799999999999997}]},{"osd":8,"last update":"Thu Oct 19 12:43:30 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.64800000000000002,"15min":0.63100000000000001},"min":{"1min":0.437,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.95299999999999996,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.751},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.69899999999999995,"15min":0.68500000000000005},"min":{"1min":0.45600000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.94499999999999995,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.73499999999999999}]},{"osd":9,"last update":"Thu Oct 19 12:42:53 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.79600000000000004,"15min":0.77300000000000002},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":3.9049999999999998,"5min":3.9049999999999998,"15min":3.9049999999999998},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.755,"5min":0.75700000000000001,"15min":0.76200000000000001},"min":{"1min":0.54700000000000004,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.93899999999999995,"5min":1.115,"15min":1.115},"last":0.81599999999999995}]},{"osd":10,"last update":"Thu Oct 19 12:43:18 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.77100000000000002,"15min":0.747},"min":{"1min":0.63500000000000001,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.96899999999999997,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.747,"15min":0.72499999999999998},"min":{"1min":0.53700000000000003,"5min":0.438,"15min":0.438},"max":{"1min":0.97599999999999998,"5min":1.145,"15min":1.145},"last":0.80100000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":68759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":68266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":68437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-19T12:43:33.056 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-19T12:43:33.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.289+0000 7fbed11ff700 1 -- 172.21.15.46:0/2605430358 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbecc103ac0 msgr2=0x7fbecc105eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:33.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.289+0000 7fbed11ff700 1 --2- 172.21.15.46:0/2605430358 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbecc103ac0 0x7fbecc105eb0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fbeb4009990 tx=0x7fbeb4009ca0 comp rx=0 tx=0).stop 2023-10-19T12:43:33.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.289+0000 7fbed11ff700 1 -- 172.21.15.46:0/2605430358 shutdown_connections 2023-10-19T12:43:33.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.289+0000 7fbed11ff700 1 --2- 172.21.15.46:0/2605430358 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbecc1063f0 0x7fbecc108860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:33.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.289+0000 7fbed11ff700 1 --2- 172.21.15.46:0/2605430358 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbecc101190 0x7fbecc103580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:33.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.289+0000 7fbed11ff700 1 --2- 172.21.15.46:0/2605430358 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbecc103ac0 0x7fbecc105eb0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:33.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.289+0000 7fbed11ff700 1 -- 172.21.15.46:0/2605430358 >> 172.21.15.46:0/2605430358 conn(0x7fbecc0faba0 msgr2=0x7fbecc0fcfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:33.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.289+0000 7fbed11ff700 1 -- 172.21.15.46:0/2605430358 shutdown_connections 2023-10-19T12:43:33.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.289+0000 7fbed11ff700 1 -- 172.21.15.46:0/2605430358 wait complete. 2023-10-19T12:43:33.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.290+0000 7fbed11ff700 1 Processor -- start 2023-10-19T12:43:33.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.290+0000 7fbed11ff700 1 -- start start 2023-10-19T12:43:33.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.291+0000 7fbed11ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbecc101190 0x7fbecc1988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:33.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.291+0000 7fbed11ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbecc103ac0 0x7fbecc198e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:33.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.291+0000 7fbed11ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbecc1063f0 0x7fbecc19fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:33.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.291+0000 7fbed11ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbecc1a0400 con 0x7fbecc103ac0 2023-10-19T12:43:33.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.291+0000 7fbed11ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbecc1a0540 con 0x7fbecc101190 2023-10-19T12:43:33.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.291+0000 7fbed11ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbecc1a06d0 con 0x7fbecc1063f0 2023-10-19T12:43:33.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.291+0000 7fbec3fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbecc103ac0 0x7fbecc198e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:33.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.291+0000 7fbecad9d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbecc101190 0x7fbecc1988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:33.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.291+0000 7fbec3fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbecc103ac0 0x7fbecc198e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36714/0 (socket says 172.21.15.46:36714) 2023-10-19T12:43:33.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.291+0000 7fbec3fff700 1 -- 172.21.15.46:0/1202616505 learned_addr learned my addr 172.21.15.46:0/1202616505 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:43:33.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.291+0000 7fbecb59e700 1 --2- 172.21.15.46:0/1202616505 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbecc1063f0 0x7fbecc19fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:33.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.291+0000 7fbec3fff700 1 -- 172.21.15.46:0/1202616505 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbecc1063f0 msgr2=0x7fbecc19fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:33.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.291+0000 7fbec3fff700 1 --2- 172.21.15.46:0/1202616505 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbecc1063f0 0x7fbecc19fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:33.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.291+0000 7fbec3fff700 1 -- 172.21.15.46:0/1202616505 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbecc101190 msgr2=0x7fbecc1988d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:33.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.291+0000 7fbec3fff700 1 --2- 172.21.15.46:0/1202616505 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbecc101190 0x7fbecc1988d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:33.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.291+0000 7fbec3fff700 1 -- 172.21.15.46:0/1202616505 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeb40095f0 con 0x7fbecc103ac0 2023-10-19T12:43:33.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.291+0000 7fbecad9d700 1 --2- 172.21.15.46:0/1202616505 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbecc101190 0x7fbecc1988d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:43:33.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.292+0000 7fbec3fff700 1 --2- 172.21.15.46:0/1202616505 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbecc103ac0 0x7fbecc198e10 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fbeb4005910 tx=0x7fbeb4009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:33.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.292+0000 7fbec8d99700 1 -- 172.21.15.46:0/1202616505 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeb401d070 con 0x7fbecc103ac0 2023-10-19T12:43:33.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.292+0000 7fbec8d99700 1 -- 172.21.15.46:0/1202616505 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbeb4021410 con 0x7fbecc103ac0 2023-10-19T12:43:33.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.292+0000 7fbed11ff700 1 -- 172.21.15.46:0/1202616505 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbecc1a0950 con 0x7fbecc103ac0 2023-10-19T12:43:33.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.292+0000 7fbec8d99700 1 -- 172.21.15.46:0/1202616505 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeb4005720 con 0x7fbecc103ac0 2023-10-19T12:43:33.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.292+0000 7fbed11ff700 1 -- 172.21.15.46:0/1202616505 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbecc1a0dd0 con 0x7fbecc103ac0 2023-10-19T12:43:33.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.293+0000 7fbed11ff700 1 -- 172.21.15.46:0/1202616505 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbecc107ff0 con 0x7fbecc103ac0 2023-10-19T12:43:33.303 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.296+0000 7fbec8d99700 1 -- 172.21.15.46:0/1202616505 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fbeb4021580 con 0x7fbecc103ac0 2023-10-19T12:43:33.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.297+0000 7fbec8d99700 1 --2- 172.21.15.46:0/1202616505 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fbeb80a1500 0x7fbeb80a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:33.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.297+0000 7fbec8d99700 1 -- 172.21.15.46:0/1202616505 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7fbeb40ce3e0 con 0x7fbecc103ac0 2023-10-19T12:43:33.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.297+0000 7fbecad9d700 1 --2- 172.21.15.46:0/1202616505 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fbeb80a1500 0x7fbeb80a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:33.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.298+0000 7fbecad9d700 1 --2- 172.21.15.46:0/1202616505 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fbeb80a1500 0x7fbeb80a39c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fbebc011490 tx=0x7fbebc009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:33.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.302+0000 7fbec8d99700 1 -- 172.21.15.46:0/1202616505 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fbeb40976a0 con 0x7fbecc103ac0 2023-10-19T12:43:33.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.516+0000 7fbed11ff700 1 -- 172.21.15.46:0/1202616505 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbecc067530 con 0x7fbecc103ac0 2023-10-19T12:43:33.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.518+0000 7fbec8d99700 1 -- 172.21.15.46:0/1202616505 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) v1 ==== 74+0+24780 (secure 0 0 0) 0x7fbeb409acc0 con 0x7fbecc103ac0 2023-10-19T12:43:33.522 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:43:33.522 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":92,"fsid":"96a8be3c-6e7b-11ee-8db6-212e2dc638e7","created":"2023-10-19T12:33:26.148713+0000","modified":"2023-10-19T12:43:28.761367+0000","last_up_change":"2023-10-19T12:40:30.761679+0000","last_in_change":"2023-10-19T12:40:13.663559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-19T12:37:07.175795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-19T12:41:16.895203+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-19T12:41:18.255601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-19T12:41:21.830455+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"346ce86b-a10a-4869-9fdb-c3c1d4161455","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6803","nonce":500237995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6805","nonce":500237995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6809","nonce":500237995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6807","nonce":500237995}]},"public_addr":"172.21.15.46:6803/500237995","cluster_addr":"172.21.15.46:6805/500237995","heartbeat_back_addr":"172.21.15.46:6809/500237995","heartbeat_front_addr":"172.21.15.46:6807/500237995","state":["exists","up"]},{"osd":1,"uuid":"02aae687-76c5-4124-bae4-9787ed571c28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6801","nonce":2496862790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6803","nonce":2496862790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6807","nonce":2496862790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6805","nonce":2496862790}]},"public_addr":"172.21.15.157:6801/2496862790","cluster_addr":"172.21.15.157:6803/2496862790","heartbeat_back_addr":"172.21.15.157:6807/2496862790","heartbeat_front_addr":"172.21.15.157:6805/2496862790","state":["exists","up"]},{"osd":2,"uuid":"d5360828-1f58-4380-b2ad-0c21ff850981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6801","nonce":4211767276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6803","nonce":4211767276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6807","nonce":4211767276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6805","nonce":4211767276}]},"public_addr":"172.21.15.195:6801/4211767276","cluster_addr":"172.21.15.195:6803/4211767276","heartbeat_back_addr":"172.21.15.195:6807/4211767276","heartbeat_front_addr":"172.21.15.195:6805/4211767276","state":["exists","up"]},{"osd":3,"uuid":"accb780f-49d0-43f8-b166-ee12c558ef00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6811","nonce":1964113352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6813","nonce":1964113352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6817","nonce":1964113352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6815","nonce":1964113352}]},"public_addr":"172.21.15.46:6811/1964113352","cluster_addr":"172.21.15.46:6813/1964113352","heartbeat_back_addr":"172.21.15.46:6817/1964113352","heartbeat_front_addr":"172.21.15.46:6815/1964113352","state":["exists","up"]},{"osd":4,"uuid":"e662886d-e989-4d02-8c1f-3c4671352b0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6809","nonce":3636910144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6811","nonce":3636910144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6815","nonce":3636910144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6813","nonce":3636910144}]},"public_addr":"172.21.15.157:6809/3636910144","cluster_addr":"172.21.15.157:6811/3636910144","heartbeat_back_addr":"172.21.15.157:6815/3636910144","heartbeat_front_addr":"172.21.15.157:6813/3636910144","state":["exists","up"]},{"osd":5,"uuid":"9597e0ce-14ea-407d-90fe-f74bccee38b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6809","nonce":4071287969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6811","nonce":4071287969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6815","nonce":4071287969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6813","nonce":4071287969}]},"public_addr":"172.21.15.195:6809/4071287969","cluster_addr":"172.21.15.195:6811/4071287969","heartbeat_back_addr":"172.21.15.195:6815/4071287969","heartbeat_front_addr":"172.21.15.195:6813/4071287969","state":["exists","up"]},{"osd":6,"uuid":"6b78ba38-f60e-4cb6-b01c-cecc1820e8e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6819","nonce":1842285555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6821","nonce":1842285555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6825","nonce":1842285555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6823","nonce":1842285555}]},"public_addr":"172.21.15.46:6819/1842285555","cluster_addr":"172.21.15.46:6821/1842285555","heartbeat_back_addr":"172.21.15.46:6825/1842285555","heartbeat_front_addr":"172.21.15.46:6823/1842285555","state":["exists","up"]},{"osd":7,"uuid":"59a0899f-3bcd-4db2-b544-24df3a536749","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6817","nonce":3498672588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6819","nonce":3498672588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6823","nonce":3498672588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6821","nonce":3498672588}]},"public_addr":"172.21.15.157:6817/3498672588","cluster_addr":"172.21.15.157:6819/3498672588","heartbeat_back_addr":"172.21.15.157:6823/3498672588","heartbeat_front_addr":"172.21.15.157:6821/3498672588","state":["exists","up"]},{"osd":8,"uuid":"9c3c9835-043a-4fb5-a9ee-edf8caf6b605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6817","nonce":74230104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6819","nonce":74230104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6823","nonce":74230104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6821","nonce":74230104}]},"public_addr":"172.21.15.195:6817/74230104","cluster_addr":"172.21.15.195:6819/74230104","heartbeat_back_addr":"172.21.15.195:6823/74230104","heartbeat_front_addr":"172.21.15.195:6821/74230104","state":["exists","up"]},{"osd":9,"uuid":"3f18f506-a577-4b7c-ae0d-9351c07e81f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6827","nonce":3472581046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6829","nonce":3472581046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6833","nonce":3472581046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6831","nonce":3472581046}]},"public_addr":"172.21.15.46:6827/3472581046","cluster_addr":"172.21.15.46:6829/3472581046","heartbeat_back_addr":"172.21.15.46:6833/3472581046","heartbeat_front_addr":"172.21.15.46:6831/3472581046","state":["exists","up"]},{"osd":10,"uuid":"1ed01854-443a-4acf-9293-7ca0d451a93d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6825","nonce":2378416559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6827","nonce":2378416559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6831","nonce":2378416559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6829","nonce":2378416559}]},"public_addr":"172.21.15.157:6825/2378416559","cluster_addr":"172.21.15.157:6827/2378416559","heartbeat_back_addr":"172.21.15.157:6831/2378416559","heartbeat_front_addr":"172.21.15.157:6829/2378416559","state":["exists","up"]},{"osd":11,"uuid":"021398c0-9184-4647-8220-e40f6705ca90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6825","nonce":3075632222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6827","nonce":3075632222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6831","nonce":3075632222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6829","nonce":3075632222}]},"public_addr":"172.21.15.195:6825/3075632222","cluster_addr":"172.21.15.195:6827/3075632222","heartbeat_back_addr":"172.21.15.195:6831/3075632222","heartbeat_front_addr":"172.21.15.195:6829/3075632222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:36:22.002614+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:36:44.098031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:37:04.518341+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:37:30.796462+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:37:52.756555+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:38:13.403168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:38:39.058472+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:39:01.106893+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:39:21.908334+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:39:46.843884+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:40:08.792020+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:40:29.282974+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":7}]},{"pgid":"3.1b","mappings":[{"from":3,"to":6},{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.39","mappings":[{"from":5,"to":8}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]},{"pgid":"4.6","mappings":[{"from":5,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.46:0/3248595150":"2023-10-20T12:34:26.552115+0000","172.21.15.46:0/3624849341":"2023-10-20T12:34:26.552115+0000","172.21.15.46:0/1844094590":"2023-10-20T12:34:26.552115+0000","172.21.15.46:6801/20022894":"2023-10-20T12:34:26.552115+0000","172.21.15.46:0/3969790632":"2023-10-20T12:34:00.135248+0000","172.21.15.46:0/2331135821":"2023-10-20T12:34:00.135248+0000","172.21.15.46:6800/51664346":"2023-10-20T12:34:00.135248+0000","172.21.15.46:6801/51664346":"2023-10-20T12:34:00.135248+0000","172.21.15.46:0/585851467":"2023-10-20T12:34:00.135248+0000","172.21.15.46:6800/20022894":"2023-10-20T12:34:26.552115+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-19T12:43:33.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.520+0000 7fbed11ff700 1 -- 172.21.15.46:0/1202616505 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fbeb80a1500 msgr2=0x7fbeb80a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:33.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.520+0000 7fbed11ff700 1 --2- 172.21.15.46:0/1202616505 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fbeb80a1500 0x7fbeb80a39c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fbebc011490 tx=0x7fbebc009260 comp rx=0 tx=0).stop 2023-10-19T12:43:33.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.520+0000 7fbed11ff700 1 -- 172.21.15.46:0/1202616505 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbecc103ac0 msgr2=0x7fbecc198e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:33.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.520+0000 7fbed11ff700 1 --2- 172.21.15.46:0/1202616505 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbecc103ac0 0x7fbecc198e10 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fbeb4005910 tx=0x7fbeb4009580 comp rx=0 tx=0).stop 2023-10-19T12:43:33.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.520+0000 7fbed11ff700 1 -- 172.21.15.46:0/1202616505 shutdown_connections 2023-10-19T12:43:33.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.520+0000 7fbed11ff700 1 --2- 172.21.15.46:0/1202616505 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fbeb80a1500 0x7fbeb80a39c0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:33.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.520+0000 7fbed11ff700 1 --2- 172.21.15.46:0/1202616505 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbecc1063f0 0x7fbecc19fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:33.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.520+0000 7fbed11ff700 1 --2- 172.21.15.46:0/1202616505 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbecc101190 0x7fbecc1988d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:33.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.520+0000 7fbed11ff700 1 --2- 172.21.15.46:0/1202616505 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbecc103ac0 0x7fbecc198e10 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:33.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.520+0000 7fbed11ff700 1 -- 172.21.15.46:0/1202616505 >> 172.21.15.46:0/1202616505 conn(0x7fbecc0faba0 msgr2=0x7fbecc100a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:33.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.521+0000 7fbed11ff700 1 -- 172.21.15.46:0/1202616505 shutdown_connections 2023-10-19T12:43:33.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.521+0000 7fbed11ff700 1 -- 172.21.15.46:0/1202616505 wait complete. 2023-10-19T12:43:33.543 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-19T12:37:07.175795+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-19T12:41:16.895203+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-19T12:41:18.255601+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-19T12:41:21.830455+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-19T12:43:33.544 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-19T12:43:33.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.749+0000 7f4377dff700 1 -- 172.21.15.46:0/2153063302 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f43701007a0 msgr2=0x7f4370100bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:33.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.749+0000 7f4377dff700 1 --2- 172.21.15.46:0/2153063302 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f43701007a0 0x7f4370100bc0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f436c0099c0 tx=0x7f436c009cd0 comp rx=0 tx=0).stop 2023-10-19T12:43:33.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.749+0000 7f4377dff700 1 -- 172.21.15.46:0/2153063302 shutdown_connections 2023-10-19T12:43:33.754 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.749+0000 7f4377dff700 1 --2- 172.21.15.46:0/2153063302 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4370102330 0x7f4370108be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:33.754 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.749+0000 7f4377dff700 1 --2- 172.21.15.46:0/2153063302 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f43701007a0 0x7f4370100bc0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:33.754 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.749+0000 7f4377dff700 1 --2- 172.21.15.46:0/2153063302 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4370101990 0x7f4370101df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:33.754 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.749+0000 7f4377dff700 1 -- 172.21.15.46:0/2153063302 >> 172.21.15.46:0/2153063302 conn(0x7f43700fbcf0 msgr2=0x7f43700fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:33.754 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.750+0000 7f4377dff700 1 -- 172.21.15.46:0/2153063302 shutdown_connections 2023-10-19T12:43:33.755 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.750+0000 7f4377dff700 1 -- 172.21.15.46:0/2153063302 wait complete. 2023-10-19T12:43:33.756 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.750+0000 7f4377dff700 1 Processor -- start 2023-10-19T12:43:33.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.751+0000 7f4377dff700 1 -- start start 2023-10-19T12:43:33.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.751+0000 7f4377dff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43701007a0 0x7f4370196750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:33.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.751+0000 7f4377dff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4370101990 0x7f4370196c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:33.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.751+0000 7f4377dff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4370102330 0x7f437019dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:33.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.751+0000 7f4377dff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f437019e280 con 0x7f4370102330 2023-10-19T12:43:33.758 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.751+0000 7f4377dff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f437019e3c0 con 0x7f4370101990 2023-10-19T12:43:33.758 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.751+0000 7f4377dff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f437019e550 con 0x7f43701007a0 2023-10-19T12:43:33.758 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.751+0000 7f437639c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4370102330 0x7f437019dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:33.758 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.751+0000 7f437539a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4370101990 0x7f4370196c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:33.759 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.751+0000 7f4375b9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43701007a0 0x7f4370196750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:33.759 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.751+0000 7f437639c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4370102330 0x7f437019dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36722/0 (socket says 172.21.15.46:36722) 2023-10-19T12:43:33.759 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.751+0000 7f437639c700 1 -- 172.21.15.46:0/1079757973 learned_addr learned my addr 172.21.15.46:0/1079757973 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:43:33.759 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.752+0000 7f437639c700 1 -- 172.21.15.46:0/1079757973 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43701007a0 msgr2=0x7f4370196750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:33.759 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.752+0000 7f437639c700 1 --2- 172.21.15.46:0/1079757973 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43701007a0 0x7f4370196750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:33.760 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.752+0000 7f437639c700 1 -- 172.21.15.46:0/1079757973 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4370101990 msgr2=0x7f4370196c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:33.760 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.752+0000 7f437639c700 1 --2- 172.21.15.46:0/1079757973 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4370101990 0x7f4370196c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:33.760 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.752+0000 7f437639c700 1 -- 172.21.15.46:0/1079757973 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f436c0095f0 con 0x7f4370102330 2023-10-19T12:43:33.760 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.752+0000 7f437639c700 1 --2- 172.21.15.46:0/1079757973 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4370102330 0x7f437019dcb0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f436800ef30 tx=0x7f436800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:33.760 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.752+0000 7f4366ffd700 1 -- 172.21.15.46:0/1079757973 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4368018070 con 0x7f4370102330 2023-10-19T12:43:33.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.752+0000 7f4366ffd700 1 -- 172.21.15.46:0/1079757973 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f436800f040 con 0x7f4370102330 2023-10-19T12:43:33.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.752+0000 7f4366ffd700 1 -- 172.21.15.46:0/1079757973 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436800cd00 con 0x7f4370102330 2023-10-19T12:43:33.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.752+0000 7f4377dff700 1 -- 172.21.15.46:0/1079757973 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f437019e7d0 con 0x7f4370102330 2023-10-19T12:43:33.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.752+0000 7f4377dff700 1 -- 172.21.15.46:0/1079757973 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f437019ec90 con 0x7f4370102330 2023-10-19T12:43:33.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.753+0000 7f4377dff700 1 -- 172.21.15.46:0/1079757973 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4370107bc0 con 0x7f4370102330 2023-10-19T12:43:33.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.755+0000 7f4366ffd700 1 -- 172.21.15.46:0/1079757973 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f4368003a00 con 0x7f4370102330 2023-10-19T12:43:33.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.757+0000 7f4366ffd700 1 --2- 172.21.15.46:0/1079757973 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f435c0a1480 0x7f435c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:33.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.758+0000 7f4366ffd700 1 -- 172.21.15.46:0/1079757973 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f43680ccca0 con 0x7f4370102330 2023-10-19T12:43:33.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.758+0000 7f4375b9b700 1 --2- 172.21.15.46:0/1079757973 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f435c0a1480 0x7f435c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:33.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.758+0000 7f4375b9b700 1 --2- 172.21.15.46:0/1079757973 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f435c0a1480 0x7f435c0a3940 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f436c003730 tx=0x7f436c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:33.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.762+0000 7f4366ffd700 1 -- 172.21.15.46:0/1079757973 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f4368095f60 con 0x7f4370102330 2023-10-19T12:43:33.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:33 smithi046 ceph-mon[98509]: from='client.25610 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-19T12:43:33.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:33 smithi046 ceph-mon[98509]: from='client.15603 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-19T12:43:33.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:33 smithi046 ceph-mon[98509]: pgmap v355: 129 pgs: 129 active+clean; 649 KiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1.4 KiB/s wr, 13 op/s 2023-10-19T12:43:33.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:33 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/1202616505' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-19T12:43:33.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.976+0000 7f4377dff700 1 -- 172.21.15.46:0/1079757973 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f43701075a0 con 0x7f4370102330 2023-10-19T12:43:33.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.977+0000 7f4366ffd700 1 -- 172.21.15.46:0/1079757973 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v92) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4368099580 con 0x7f4370102330 2023-10-19T12:43:33.981 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2023-10-19T12:43:33.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.979+0000 7f4377dff700 1 -- 172.21.15.46:0/1079757973 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f435c0a1480 msgr2=0x7f435c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:33.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.979+0000 7f4377dff700 1 --2- 172.21.15.46:0/1079757973 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f435c0a1480 0x7f435c0a3940 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f436c003730 tx=0x7f436c000bc0 comp rx=0 tx=0).stop 2023-10-19T12:43:33.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.979+0000 7f4377dff700 1 -- 172.21.15.46:0/1079757973 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4370102330 msgr2=0x7f437019dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:33.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.979+0000 7f4377dff700 1 --2- 172.21.15.46:0/1079757973 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4370102330 0x7f437019dcb0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f436800ef30 tx=0x7f436800c3a0 comp rx=0 tx=0).stop 2023-10-19T12:43:33.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.979+0000 7f4377dff700 1 -- 172.21.15.46:0/1079757973 shutdown_connections 2023-10-19T12:43:33.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.979+0000 7f4377dff700 1 --2- 172.21.15.46:0/1079757973 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4370102330 0x7f437019dcb0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:33.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.979+0000 7f4377dff700 1 --2- 172.21.15.46:0/1079757973 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f435c0a1480 0x7f435c0a3940 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:33.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.979+0000 7f4377dff700 1 --2- 172.21.15.46:0/1079757973 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43701007a0 0x7f4370196750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:33.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.979+0000 7f4377dff700 1 --2- 172.21.15.46:0/1079757973 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4370101990 0x7f4370196c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:33.985 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.979+0000 7f4377dff700 1 -- 172.21.15.46:0/1079757973 >> 172.21.15.46:0/1079757973 conn(0x7f43700fbcf0 msgr2=0x7f4370104d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:33.985 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.980+0000 7f4377dff700 1 -- 172.21.15.46:0/1079757973 shutdown_connections 2023-10-19T12:43:33.985 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:33.980+0000 7f4377dff700 1 -- 172.21.15.46:0/1079757973 wait complete. 2023-10-19T12:43:34.002 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-19T12:43:34.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:33 smithi157 ceph-mon[134109]: from='client.25610 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-19T12:43:34.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:33 smithi157 ceph-mon[134109]: from='client.15603 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-19T12:43:34.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:33 smithi157 ceph-mon[134109]: pgmap v355: 129 pgs: 129 active+clean; 649 KiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1.4 KiB/s wr, 13 op/s 2023-10-19T12:43:34.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:33 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/1202616505' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-19T12:43:34.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:33 smithi195 ceph-mon[134493]: from='client.25610 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-19T12:43:34.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:33 smithi195 ceph-mon[134493]: from='client.15603 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-19T12:43:34.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:33 smithi195 ceph-mon[134493]: pgmap v355: 129 pgs: 129 active+clean; 649 KiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1.4 KiB/s wr, 13 op/s 2023-10-19T12:43:34.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:33 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/1202616505' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-19T12:43:34.218 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.211+0000 7f04891ff700 1 -- 172.21.15.46:0/2359478684 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0484102330 msgr2=0x7f0484108be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:34.218 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.211+0000 7f04891ff700 1 --2- 172.21.15.46:0/2359478684 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0484102330 0x7f0484108be0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f047c009f90 tx=0x7f047c00b330 comp rx=0 tx=0).stop 2023-10-19T12:43:34.218 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.211+0000 7f04891ff700 1 -- 172.21.15.46:0/2359478684 shutdown_connections 2023-10-19T12:43:34.218 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.211+0000 7f04891ff700 1 --2- 172.21.15.46:0/2359478684 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0484102330 0x7f0484108be0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:34.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.211+0000 7f04891ff700 1 --2- 172.21.15.46:0/2359478684 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f04841007a0 0x7f0484100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:34.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.211+0000 7f04891ff700 1 --2- 172.21.15.46:0/2359478684 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0484101990 0x7f0484101df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:34.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.211+0000 7f04891ff700 1 -- 172.21.15.46:0/2359478684 >> 172.21.15.46:0/2359478684 conn(0x7f04840fbcf0 msgr2=0x7f04840fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:34.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.211+0000 7f04891ff700 1 -- 172.21.15.46:0/2359478684 shutdown_connections 2023-10-19T12:43:34.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.211+0000 7f04891ff700 1 -- 172.21.15.46:0/2359478684 wait complete. 2023-10-19T12:43:34.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.212+0000 7f04891ff700 1 Processor -- start 2023-10-19T12:43:34.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.212+0000 7f04891ff700 1 -- start start 2023-10-19T12:43:34.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.212+0000 7f04891ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f04841007a0 0x7f0484198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:34.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.212+0000 7f04891ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0484101990 0x7f0484198f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:34.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.212+0000 7f04891ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0484102330 0x7f048419ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:34.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.213+0000 7f04891ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04841a0540 con 0x7f04841007a0 2023-10-19T12:43:34.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.213+0000 7f04891ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04841a0680 con 0x7f0484102330 2023-10-19T12:43:34.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.213+0000 7f04891ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04841a0810 con 0x7f0484101990 2023-10-19T12:43:34.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.213+0000 7f0482d9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f04841007a0 0x7f0484198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:34.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.213+0000 7f0482d9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f04841007a0 0x7f0484198a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36730/0 (socket says 172.21.15.46:36730) 2023-10-19T12:43:34.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.213+0000 7f047bfff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0484101990 0x7f0484198f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:34.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.213+0000 7f0482d9d700 1 -- 172.21.15.46:0/1985293762 learned_addr learned my addr 172.21.15.46:0/1985293762 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:43:34.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.213+0000 7f048359e700 1 --2- 172.21.15.46:0/1985293762 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0484102330 0x7f048419ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:34.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.213+0000 7f047bfff700 1 -- 172.21.15.46:0/1985293762 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0484102330 msgr2=0x7f048419ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:34.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.213+0000 7f047bfff700 1 --2- 172.21.15.46:0/1985293762 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0484102330 0x7f048419ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:34.223 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.213+0000 7f047bfff700 1 -- 172.21.15.46:0/1985293762 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f04841007a0 msgr2=0x7f0484198a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:34.223 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.213+0000 7f047bfff700 1 --2- 172.21.15.46:0/1985293762 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f04841007a0 0x7f0484198a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:34.223 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.213+0000 7f047bfff700 1 -- 172.21.15.46:0/1985293762 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f046c0095f0 con 0x7f0484101990 2023-10-19T12:43:34.223 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.213+0000 7f0482d9d700 1 --2- 172.21.15.46:0/1985293762 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f04841007a0 0x7f0484198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:43:34.223 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.213+0000 7f047bfff700 1 --2- 172.21.15.46:0/1985293762 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0484101990 0x7f0484198f50 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f046c00eb90 tx=0x7f046c00eea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:34.224 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.214+0000 7f0480d99700 1 -- 172.21.15.46:0/1985293762 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f046c009970 con 0x7f0484101990 2023-10-19T12:43:34.224 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.214+0000 7f04891ff700 1 -- 172.21.15.46:0/1985293762 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f047c009c40 con 0x7f0484101990 2023-10-19T12:43:34.224 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.214+0000 7f0480d99700 1 -- 172.21.15.46:0/1985293762 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f046c0044e0 con 0x7f0484101990 2023-10-19T12:43:34.224 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.214+0000 7f0480d99700 1 -- 172.21.15.46:0/1985293762 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f046c003e50 con 0x7f0484101990 2023-10-19T12:43:34.224 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.214+0000 7f04891ff700 1 -- 172.21.15.46:0/1985293762 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04841a0ec0 con 0x7f0484101990 2023-10-19T12:43:34.225 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.215+0000 7f04891ff700 1 -- 172.21.15.46:0/1985293762 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04840675a0 con 0x7f0484101990 2023-10-19T12:43:34.226 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.217+0000 7f0480d99700 1 -- 172.21.15.46:0/1985293762 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f046c004000 con 0x7f0484101990 2023-10-19T12:43:34.226 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.218+0000 7f0480d99700 1 --2- 172.21.15.46:0/1985293762 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f04700a1480 0x7f04700a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:34.226 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.219+0000 7f0480d99700 1 -- 172.21.15.46:0/1985293762 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f046c014070 con 0x7f0484101990 2023-10-19T12:43:34.226 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.219+0000 7f0482d9d700 1 --2- 172.21.15.46:0/1985293762 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f04700a1480 0x7f04700a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:34.226 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.219+0000 7f0482d9d700 1 --2- 172.21.15.46:0/1985293762 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f04700a1480 0x7f04700a3940 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f0474005950 tx=0x7f0474009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:34.227 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.221+0000 7f0480d99700 1 -- 172.21.15.46:0/1985293762 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f046c0968d0 con 0x7f0484101990 2023-10-19T12:43:34.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.437+0000 7f04891ff700 1 -- 172.21.15.46:0/1985293762 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f048410c010 con 0x7f0484101990 2023-10-19T12:43:34.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.438+0000 7f0480d99700 1 -- 172.21.15.46:0/1985293762 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v92) v1 ==== 104+0+11 (secure 0 0 0) 0x7f046c099ef0 con 0x7f0484101990 2023-10-19T12:43:34.441 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2023-10-19T12:43:34.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.440+0000 7f04891ff700 1 -- 172.21.15.46:0/1985293762 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f04700a1480 msgr2=0x7f04700a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:34.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.440+0000 7f04891ff700 1 --2- 172.21.15.46:0/1985293762 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f04700a1480 0x7f04700a3940 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f0474005950 tx=0x7f0474009260 comp rx=0 tx=0).stop 2023-10-19T12:43:34.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.440+0000 7f04891ff700 1 -- 172.21.15.46:0/1985293762 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0484101990 msgr2=0x7f0484198f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:34.444 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.440+0000 7f04891ff700 1 --2- 172.21.15.46:0/1985293762 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0484101990 0x7f0484198f50 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f046c00eb90 tx=0x7f046c00eea0 comp rx=0 tx=0).stop 2023-10-19T12:43:34.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.440+0000 7f04891ff700 1 -- 172.21.15.46:0/1985293762 shutdown_connections 2023-10-19T12:43:34.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.440+0000 7f04891ff700 1 --2- 172.21.15.46:0/1985293762 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0484102330 0x7f048419ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:34.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.440+0000 7f04891ff700 1 --2- 172.21.15.46:0/1985293762 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f04841007a0 0x7f0484198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:34.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.440+0000 7f04891ff700 1 --2- 172.21.15.46:0/1985293762 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f04700a1480 0x7f04700a3940 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:34.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.440+0000 7f04891ff700 1 --2- 172.21.15.46:0/1985293762 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0484101990 0x7f0484198f50 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:34.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.440+0000 7f04891ff700 1 -- 172.21.15.46:0/1985293762 >> 172.21.15.46:0/1985293762 conn(0x7f04840fbcf0 msgr2=0x7f0484072a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:34.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.441+0000 7f04891ff700 1 -- 172.21.15.46:0/1985293762 shutdown_connections 2023-10-19T12:43:34.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.441+0000 7f04891ff700 1 -- 172.21.15.46:0/1985293762 wait complete. 2023-10-19T12:43:34.463 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-19T12:43:34.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.668+0000 7fc8411ff700 1 -- 172.21.15.46:0/2117780154 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc83c101990 msgr2=0x7fc83c101df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:34.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.668+0000 7fc8411ff700 1 --2- 172.21.15.46:0/2117780154 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc83c101990 0x7fc83c101df0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fc8240099c0 tx=0x7fc824009cd0 comp rx=0 tx=0).stop 2023-10-19T12:43:34.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.668+0000 7fc8411ff700 1 -- 172.21.15.46:0/2117780154 shutdown_connections 2023-10-19T12:43:34.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.668+0000 7fc8411ff700 1 --2- 172.21.15.46:0/2117780154 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc83c102330 0x7fc83c108be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:34.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.668+0000 7fc8411ff700 1 --2- 172.21.15.46:0/2117780154 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc83c1007a0 0x7fc83c100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:34.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.668+0000 7fc8411ff700 1 --2- 172.21.15.46:0/2117780154 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc83c101990 0x7fc83c101df0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:34.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.668+0000 7fc8411ff700 1 -- 172.21.15.46:0/2117780154 >> 172.21.15.46:0/2117780154 conn(0x7fc83c0fbcf0 msgr2=0x7fc83c0fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:34.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.668+0000 7fc8411ff700 1 -- 172.21.15.46:0/2117780154 shutdown_connections 2023-10-19T12:43:34.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.668+0000 7fc8411ff700 1 -- 172.21.15.46:0/2117780154 wait complete. 2023-10-19T12:43:34.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.669+0000 7fc8411ff700 1 Processor -- start 2023-10-19T12:43:34.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.669+0000 7fc8411ff700 1 -- start start 2023-10-19T12:43:34.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.670+0000 7fc8411ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc83c1007a0 0x7fc83c1988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:34.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.670+0000 7fc8411ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc83c101990 0x7fc83c198e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:34.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.670+0000 7fc8411ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc83c102330 0x7fc83c19fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:34.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.670+0000 7fc8411ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc83c1a0420 con 0x7fc83c102330 2023-10-19T12:43:34.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.670+0000 7fc8411ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc83c1a0560 con 0x7fc83c101990 2023-10-19T12:43:34.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.670+0000 7fc8411ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc83c1a06f0 con 0x7fc83c1007a0 2023-10-19T12:43:34.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.670+0000 7fc83b59e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc83c102330 0x7fc83c19fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:34.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.670+0000 7fc83b59e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc83c102330 0x7fc83c19fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36756/0 (socket says 172.21.15.46:36756) 2023-10-19T12:43:34.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.670+0000 7fc83b59e700 1 -- 172.21.15.46:0/780669657 learned_addr learned my addr 172.21.15.46:0/780669657 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:43:34.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.670+0000 7fc83ad9d700 1 --2- 172.21.15.46:0/780669657 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc83c1007a0 0x7fc83c1988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:34.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.670+0000 7fc833fff700 1 --2- 172.21.15.46:0/780669657 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc83c101990 0x7fc83c198e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:34.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.670+0000 7fc83ad9d700 1 -- 172.21.15.46:0/780669657 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc83c101990 msgr2=0x7fc83c198e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:34.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.670+0000 7fc83ad9d700 1 --2- 172.21.15.46:0/780669657 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc83c101990 0x7fc83c198e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:34.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.670+0000 7fc83ad9d700 1 -- 172.21.15.46:0/780669657 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc83c102330 msgr2=0x7fc83c19fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:34.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.670+0000 7fc83ad9d700 1 --2- 172.21.15.46:0/780669657 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc83c102330 0x7fc83c19fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:34.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.670+0000 7fc83ad9d700 1 -- 172.21.15.46:0/780669657 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8240095f0 con 0x7fc83c1007a0 2023-10-19T12:43:34.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.670+0000 7fc83b59e700 1 --2- 172.21.15.46:0/780669657 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc83c102330 0x7fc83c19fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:43:34.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.671+0000 7fc83ad9d700 1 --2- 172.21.15.46:0/780669657 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc83c1007a0 0x7fc83c1988f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc82c00e9c0 tx=0x7fc82c00ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:34.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.671+0000 7fc838d99700 1 -- 172.21.15.46:0/780669657 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82c004220 con 0x7fc83c1007a0 2023-10-19T12:43:34.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.671+0000 7fc838d99700 1 -- 172.21.15.46:0/780669657 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc82c004380 con 0x7fc83c1007a0 2023-10-19T12:43:34.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.671+0000 7fc8411ff700 1 -- 172.21.15.46:0/780669657 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc83c1a09d0 con 0x7fc83c1007a0 2023-10-19T12:43:34.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.671+0000 7fc838d99700 1 -- 172.21.15.46:0/780669657 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82c003be0 con 0x7fc83c1007a0 2023-10-19T12:43:34.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.671+0000 7fc8411ff700 1 -- 172.21.15.46:0/780669657 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc83c1a0ee0 con 0x7fc83c1007a0 2023-10-19T12:43:34.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.672+0000 7fc8411ff700 1 -- 172.21.15.46:0/780669657 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc83c0675a0 con 0x7fc83c1007a0 2023-10-19T12:43:34.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.674+0000 7fc838d99700 1 -- 172.21.15.46:0/780669657 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fc82c003d40 con 0x7fc83c1007a0 2023-10-19T12:43:34.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.676+0000 7fc838d99700 1 --2- 172.21.15.46:0/780669657 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fc8280a1480 0x7fc8280a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:34.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.676+0000 7fc838d99700 1 -- 172.21.15.46:0/780669657 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7fc82c014070 con 0x7fc83c1007a0 2023-10-19T12:43:34.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.676+0000 7fc833fff700 1 --2- 172.21.15.46:0/780669657 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fc8280a1480 0x7fc8280a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:34.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.676+0000 7fc833fff700 1 --2- 172.21.15.46:0/780669657 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fc8280a1480 0x7fc8280a3940 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc824003730 tx=0x7fc82400b540 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:34.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.678+0000 7fc838d99700 1 -- 172.21.15.46:0/780669657 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc82c096780 con 0x7fc83c1007a0 2023-10-19T12:43:34.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.892+0000 7fc8411ff700 1 -- 172.21.15.46:0/780669657 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc83c10c190 con 0x7fc83c1007a0 2023-10-19T12:43:34.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.893+0000 7fc838d99700 1 -- 172.21.15.46:0/780669657 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v92) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc82c099da0 con 0x7fc83c1007a0 2023-10-19T12:43:34.897 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2023-10-19T12:43:34.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.896+0000 7fc8411ff700 1 -- 172.21.15.46:0/780669657 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fc8280a1480 msgr2=0x7fc8280a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:34.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.896+0000 7fc8411ff700 1 --2- 172.21.15.46:0/780669657 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fc8280a1480 0x7fc8280a3940 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc824003730 tx=0x7fc82400b540 comp rx=0 tx=0).stop 2023-10-19T12:43:34.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.896+0000 7fc8411ff700 1 -- 172.21.15.46:0/780669657 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc83c1007a0 msgr2=0x7fc83c1988f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:34.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.896+0000 7fc8411ff700 1 --2- 172.21.15.46:0/780669657 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc83c1007a0 0x7fc83c1988f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc82c00e9c0 tx=0x7fc82c00ecd0 comp rx=0 tx=0).stop 2023-10-19T12:43:34.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.896+0000 7fc8411ff700 1 -- 172.21.15.46:0/780669657 shutdown_connections 2023-10-19T12:43:34.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.896+0000 7fc8411ff700 1 --2- 172.21.15.46:0/780669657 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc83c102330 0x7fc83c19fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:34.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.896+0000 7fc8411ff700 1 --2- 172.21.15.46:0/780669657 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fc8280a1480 0x7fc8280a3940 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:34.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.896+0000 7fc8411ff700 1 --2- 172.21.15.46:0/780669657 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc83c1007a0 0x7fc83c1988f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:34.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.896+0000 7fc8411ff700 1 --2- 172.21.15.46:0/780669657 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc83c101990 0x7fc83c198e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:34.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.896+0000 7fc8411ff700 1 -- 172.21.15.46:0/780669657 >> 172.21.15.46:0/780669657 conn(0x7fc83c0fbcf0 msgr2=0x7fc83c1071b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:34.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.896+0000 7fc8411ff700 1 -- 172.21.15.46:0/780669657 shutdown_connections 2023-10-19T12:43:34.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:34.896+0000 7fc8411ff700 1 -- 172.21.15.46:0/780669657 wait complete. 2023-10-19T12:43:34.918 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-19T12:43:35.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:34 smithi157 ceph-mon[134109]: from='client.25622 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-19T12:43:35.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:34 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/1079757973' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-19T12:43:35.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:34 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/1985293762' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-19T12:43:35.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.122+0000 7f745d9ff700 1 -- 172.21.15.46:0/1222959629 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7458101990 msgr2=0x7f7458101df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:35.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.122+0000 7f745d9ff700 1 --2- 172.21.15.46:0/1222959629 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7458101990 0x7f7458101df0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f744c0099c0 tx=0x7f744c009cd0 comp rx=0 tx=0).stop 2023-10-19T12:43:35.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.123+0000 7f745d9ff700 1 -- 172.21.15.46:0/1222959629 shutdown_connections 2023-10-19T12:43:35.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.123+0000 7f745d9ff700 1 --2- 172.21.15.46:0/1222959629 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7458102330 0x7f7458108be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:35.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.123+0000 7f745d9ff700 1 --2- 172.21.15.46:0/1222959629 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f74581007a0 0x7f7458100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:35.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.123+0000 7f745d9ff700 1 --2- 172.21.15.46:0/1222959629 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7458101990 0x7f7458101df0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:35.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.123+0000 7f745d9ff700 1 -- 172.21.15.46:0/1222959629 >> 172.21.15.46:0/1222959629 conn(0x7f74580fbcf0 msgr2=0x7f74580fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:35.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.123+0000 7f745d9ff700 1 -- 172.21.15.46:0/1222959629 shutdown_connections 2023-10-19T12:43:35.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.123+0000 7f745d9ff700 1 -- 172.21.15.46:0/1222959629 wait complete. 2023-10-19T12:43:35.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.124+0000 7f745d9ff700 1 Processor -- start 2023-10-19T12:43:35.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.124+0000 7f745d9ff700 1 -- start start 2023-10-19T12:43:35.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.124+0000 7f745d9ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74581007a0 0x7f74581988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:35.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.124+0000 7f745d9ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7458101990 0x7f7458198e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:35.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.124+0000 7f745d9ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7458102330 0x7f745819fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:35.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.124+0000 7f745d9ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74581a0420 con 0x7f74581007a0 2023-10-19T12:43:35.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.124+0000 7f745d9ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74581a0560 con 0x7f7458101990 2023-10-19T12:43:35.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.124+0000 7f745d9ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74581a06f0 con 0x7f7458102330 2023-10-19T12:43:35.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.124+0000 7f7456ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74581007a0 0x7f74581988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:35.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.124+0000 7f7456ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74581007a0 0x7f74581988f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36774/0 (socket says 172.21.15.46:36774) 2023-10-19T12:43:35.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.124+0000 7f7456ffd700 1 -- 172.21.15.46:0/3702340614 learned_addr learned my addr 172.21.15.46:0/3702340614 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:43:35.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.124+0000 7f74567fc700 1 --2- 172.21.15.46:0/3702340614 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7458101990 0x7f7458198e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:35.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.125+0000 7f74577fe700 1 --2- 172.21.15.46:0/3702340614 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7458102330 0x7f745819fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:35.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.125+0000 7f7456ffd700 1 -- 172.21.15.46:0/3702340614 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7458102330 msgr2=0x7f745819fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:35.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.125+0000 7f7456ffd700 1 --2- 172.21.15.46:0/3702340614 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7458102330 0x7f745819fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:35.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.125+0000 7f7456ffd700 1 -- 172.21.15.46:0/3702340614 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7458101990 msgr2=0x7f7458198e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:35.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.125+0000 7f7456ffd700 1 --2- 172.21.15.46:0/3702340614 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7458101990 0x7f7458198e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:35.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.125+0000 7f7456ffd700 1 -- 172.21.15.46:0/3702340614 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f744c0095f0 con 0x7f74581007a0 2023-10-19T12:43:35.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.125+0000 7f74567fc700 1 --2- 172.21.15.46:0/3702340614 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7458101990 0x7f7458198e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:43:35.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.125+0000 7f7456ffd700 1 --2- 172.21.15.46:0/3702340614 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74581007a0 0x7f74581988f0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f744800e970 tx=0x7f744800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:35.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.125+0000 7f745c9fd700 1 -- 172.21.15.46:0/3702340614 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7448009790 con 0x7f74581007a0 2023-10-19T12:43:35.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.125+0000 7f745c9fd700 1 -- 172.21.15.46:0/3702340614 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f744800c7e0 con 0x7f74581007a0 2023-10-19T12:43:35.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.125+0000 7f745d9ff700 1 -- 172.21.15.46:0/3702340614 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74581a09d0 con 0x7f74581007a0 2023-10-19T12:43:35.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.125+0000 7f745c9fd700 1 -- 172.21.15.46:0/3702340614 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7448003c70 con 0x7f74581007a0 2023-10-19T12:43:35.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.126+0000 7f745d9ff700 1 -- 172.21.15.46:0/3702340614 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74581a0ee0 con 0x7f74581007a0 2023-10-19T12:43:35.135 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.127+0000 7f745d9ff700 1 -- 172.21.15.46:0/3702340614 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74580675a0 con 0x7f74581007a0 2023-10-19T12:43:35.135 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:34 smithi195 ceph-mon[134493]: from='client.25622 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-19T12:43:35.135 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:34 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/1079757973' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-19T12:43:35.136 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:34 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/1985293762' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-19T12:43:35.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.129+0000 7f745c9fd700 1 -- 172.21.15.46:0/3702340614 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f744800cc50 con 0x7f74581007a0 2023-10-19T12:43:35.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.130+0000 7f745c9fd700 1 --2- 172.21.15.46:0/3702340614 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f74400a1480 0x7f74400a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:35.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.130+0000 7f745c9fd700 1 -- 172.21.15.46:0/3702340614 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f7448014070 con 0x7f74581007a0 2023-10-19T12:43:35.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.130+0000 7f74567fc700 1 --2- 172.21.15.46:0/3702340614 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f74400a1480 0x7f74400a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:35.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.131+0000 7f74567fc700 1 --2- 172.21.15.46:0/3702340614 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f74400a1480 0x7f74400a3940 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f744c003730 tx=0x7f744c01a040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:35.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.134+0000 7f745c9fd700 1 -- 172.21.15.46:0/3702340614 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7448096530 con 0x7f74581007a0 2023-10-19T12:43:35.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:34 smithi046 ceph-mon[98509]: from='client.25622 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-19T12:43:35.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:34 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/1079757973' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-19T12:43:35.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:34 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/1985293762' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-19T12:43:35.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.351+0000 7f745d9ff700 1 -- 172.21.15.46:0/3702340614 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f745810c220 con 0x7f74581007a0 2023-10-19T12:43:35.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.351+0000 7f745c9fd700 1 -- 172.21.15.46:0/3702340614 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v92) v1 ==== 103+0+11 (secure 0 0 0) 0x7f7448003dd0 con 0x7f74581007a0 2023-10-19T12:43:35.355 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2023-10-19T12:43:35.357 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.354+0000 7f745d9ff700 1 -- 172.21.15.46:0/3702340614 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f74400a1480 msgr2=0x7f74400a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:35.358 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.354+0000 7f745d9ff700 1 --2- 172.21.15.46:0/3702340614 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f74400a1480 0x7f74400a3940 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f744c003730 tx=0x7f744c01a040 comp rx=0 tx=0).stop 2023-10-19T12:43:35.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.354+0000 7f745d9ff700 1 -- 172.21.15.46:0/3702340614 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74581007a0 msgr2=0x7f74581988f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:35.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.354+0000 7f745d9ff700 1 --2- 172.21.15.46:0/3702340614 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74581007a0 0x7f74581988f0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f744800e970 tx=0x7f744800ec80 comp rx=0 tx=0).stop 2023-10-19T12:43:35.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.354+0000 7f745d9ff700 1 -- 172.21.15.46:0/3702340614 shutdown_connections 2023-10-19T12:43:35.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.354+0000 7f745d9ff700 1 --2- 172.21.15.46:0/3702340614 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f74400a1480 0x7f74400a3940 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:35.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.354+0000 7f745d9ff700 1 --2- 172.21.15.46:0/3702340614 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7458102330 0x7f745819fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:35.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.354+0000 7f745d9ff700 1 --2- 172.21.15.46:0/3702340614 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74581007a0 0x7f74581988f0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:35.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.354+0000 7f745d9ff700 1 --2- 172.21.15.46:0/3702340614 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7458101990 0x7f7458198e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:35.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.354+0000 7f745d9ff700 1 -- 172.21.15.46:0/3702340614 >> 172.21.15.46:0/3702340614 conn(0x7f74580fbcf0 msgr2=0x7f7458072a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:35.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.354+0000 7f745d9ff700 1 -- 172.21.15.46:0/3702340614 shutdown_connections 2023-10-19T12:43:35.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.354+0000 7f745d9ff700 1 -- 172.21.15.46:0/3702340614 wait complete. 2023-10-19T12:43:35.376 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-19T12:43:35.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.578+0000 7fbef71ff700 1 -- 172.21.15.46:0/1416988269 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbef0074830 msgr2=0x7fbef0072c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:35.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.578+0000 7fbef71ff700 1 --2- 172.21.15.46:0/1416988269 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbef0074830 0x7fbef0072c80 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fbeec009990 tx=0x7fbeec009ca0 comp rx=0 tx=0).stop 2023-10-19T12:43:35.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.578+0000 7fbef71ff700 1 -- 172.21.15.46:0/1416988269 shutdown_connections 2023-10-19T12:43:35.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.578+0000 7fbef71ff700 1 --2- 172.21.15.46:0/1416988269 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbef010cd10 0x7fbef010f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:35.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.578+0000 7fbef71ff700 1 --2- 172.21.15.46:0/1416988269 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbef0074830 0x7fbef0072c80 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:35.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.578+0000 7fbef71ff700 1 --2- 172.21.15.46:0/1416988269 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbef0073250 0x7fbef00736d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:35.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.578+0000 7fbef71ff700 1 -- 172.21.15.46:0/1416988269 >> 172.21.15.46:0/1416988269 conn(0x7fbef00fbc90 msgr2=0x7fbef00fe0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:35.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.578+0000 7fbef71ff700 1 -- 172.21.15.46:0/1416988269 shutdown_connections 2023-10-19T12:43:35.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.578+0000 7fbef71ff700 1 -- 172.21.15.46:0/1416988269 wait complete. 2023-10-19T12:43:35.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.579+0000 7fbef71ff700 1 Processor -- start 2023-10-19T12:43:35.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.579+0000 7fbef71ff700 1 -- start start 2023-10-19T12:43:35.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.580+0000 7fbef71ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbef0073250 0x7fbef019ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:35.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.580+0000 7fbef71ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbef0074830 0x7fbef019d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:35.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.580+0000 7fbef71ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbef010cd10 0x7fbef01a4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:35.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.580+0000 7fbef71ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbef01a47e0 con 0x7fbef010cd10 2023-10-19T12:43:35.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.580+0000 7fbef71ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbef01a4950 con 0x7fbef0074830 2023-10-19T12:43:35.587 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.580+0000 7fbef71ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbef01a4b10 con 0x7fbef0073250 2023-10-19T12:43:35.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.580+0000 7fbef579c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbef010cd10 0x7fbef01a4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:35.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.580+0000 7fbef4f9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbef0073250 0x7fbef019ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:35.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.580+0000 7fbef579c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbef010cd10 0x7fbef01a4210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36786/0 (socket says 172.21.15.46:36786) 2023-10-19T12:43:35.588 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.580+0000 7fbef579c700 1 -- 172.21.15.46:0/595951295 learned_addr learned my addr 172.21.15.46:0/595951295 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:43:35.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.580+0000 7fbef4f9b700 1 --2- 172.21.15.46:0/595951295 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbef0073250 0x7fbef019ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:56966/0 (socket says 172.21.15.46:56966) 2023-10-19T12:43:35.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.580+0000 7fbee7fff700 1 --2- 172.21.15.46:0/595951295 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbef0074830 0x7fbef019d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:35.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.580+0000 7fbef579c700 1 -- 172.21.15.46:0/595951295 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbef0073250 msgr2=0x7fbef019ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:35.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.580+0000 7fbef579c700 1 --2- 172.21.15.46:0/595951295 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbef0073250 0x7fbef019ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:35.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.580+0000 7fbef579c700 1 -- 172.21.15.46:0/595951295 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbef0074830 msgr2=0x7fbef019d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:35.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.580+0000 7fbef579c700 1 --2- 172.21.15.46:0/595951295 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbef0074830 0x7fbef019d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:35.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.580+0000 7fbef579c700 1 -- 172.21.15.46:0/595951295 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeec0095f0 con 0x7fbef010cd10 2023-10-19T12:43:35.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.581+0000 7fbee7fff700 1 --2- 172.21.15.46:0/595951295 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbef0074830 0x7fbef019d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:43:35.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.581+0000 7fbef579c700 1 --2- 172.21.15.46:0/595951295 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbef010cd10 0x7fbef01a4210 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fbee800ef30 tx=0x7fbee800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:35.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.581+0000 7fbee5ffb700 1 -- 172.21.15.46:0/595951295 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee8018070 con 0x7fbef010cd10 2023-10-19T12:43:35.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.581+0000 7fbef71ff700 1 -- 172.21.15.46:0/595951295 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbef01a4d90 con 0x7fbef010cd10 2023-10-19T12:43:35.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.581+0000 7fbee5ffb700 1 -- 172.21.15.46:0/595951295 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbee800f040 con 0x7fbef010cd10 2023-10-19T12:43:35.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.581+0000 7fbee5ffb700 1 -- 172.21.15.46:0/595951295 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee800cd00 con 0x7fbef010cd10 2023-10-19T12:43:35.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.581+0000 7fbef71ff700 1 -- 172.21.15.46:0/595951295 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbef01a5240 con 0x7fbef010cd10 2023-10-19T12:43:35.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.582+0000 7fbef71ff700 1 -- 172.21.15.46:0/595951295 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbef0102f70 con 0x7fbef010cd10 2023-10-19T12:43:35.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.584+0000 7fbee5ffb700 1 -- 172.21.15.46:0/595951295 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fbee8003a00 con 0x7fbef010cd10 2023-10-19T12:43:35.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.586+0000 7fbee5ffb700 1 --2- 172.21.15.46:0/595951295 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fbed80a1480 0x7fbed80a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:35.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.587+0000 7fbee5ffb700 1 -- 172.21.15.46:0/595951295 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7fbee80ccc70 con 0x7fbef010cd10 2023-10-19T12:43:35.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.587+0000 7fbef4f9b700 1 --2- 172.21.15.46:0/595951295 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fbed80a1480 0x7fbed80a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:35.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.587+0000 7fbef4f9b700 1 --2- 172.21.15.46:0/595951295 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fbed80a1480 0x7fbed80a3940 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fbeec000c00 tx=0x7fbeec005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:35.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.591+0000 7fbee5ffb700 1 -- 172.21.15.46:0/595951295 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fbee8095f30 con 0x7fbef010cd10 2023-10-19T12:43:35.858 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.855+0000 7fbef71ff700 1 -- 172.21.15.46:0/595951295 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbef0067530 con 0x7fbef010cd10 2023-10-19T12:43:35.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.856+0000 7fbee5ffb700 1 -- 172.21.15.46:0/595951295 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+11372 (secure 0 0 0) 0x7fbee8099550 con 0x7fbef010cd10 2023-10-19T12:43:35.860 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:43:35.860 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14580,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/2235286008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":2235286008},{"type":"v1","addr":"172.21.15.46:6835","nonce":2235286008}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14592,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/339398444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":339398444},{"type":"v1","addr":"172.21.15.46:6837","nonce":339398444}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-19T12:41:18.815780+0000","modified":"2023-10-19T12:41:47.301944+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24680,"mds_1":24655,"mds_2":24643,"mds_3":24631,"mds_4":24629},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14640":{"gid":14640,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.46:6839/1655843965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":1655843965},{"type":"v1","addr":"172.21.15.46:6839","nonce":1655843965}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14652":{"gid":14652,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.46:6841/4204925553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6840","nonce":4204925553},{"type":"v1","addr":"172.21.15.46:6841","nonce":4204925553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24560":{"gid":24560,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.157:6833/1687745569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":1687745569},{"type":"v1","addr":"172.21.15.157:6833","nonce":1687745569}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24574":{"gid":24574,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.195:6833/3629933235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3629933235},{"type":"v1","addr":"172.21.15.195:6833","nonce":3629933235}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24602":{"gid":24602,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.157:6835/108432552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":108432552},{"type":"v1","addr":"172.21.15.157:6835","nonce":108432552}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24629":{"gid":24629,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":13,"addr":"172.21.15.157:6837/2629536514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6836","nonce":2629536514},{"type":"v1","addr":"172.21.15.157:6837","nonce":2629536514}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24631":{"gid":24631,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.195:6835/1406909915","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":1406909915},{"type":"v1","addr":"172.21.15.195:6835","nonce":1406909915}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24643":{"gid":24643,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":13,"addr":"172.21.15.195:6837/293916188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":293916188},{"type":"v1","addr":"172.21.15.195:6837","nonce":293916188}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24655":{"gid":24655,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":11,"addr":"172.21.15.195:6839/4094901934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6838","nonce":4094901934},{"type":"v1","addr":"172.21.15.195:6839","nonce":4094901934}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24680":{"gid":24680,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.157:6839/552718978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6838","nonce":552718978},{"type":"v1","addr":"172.21.15.157:6839","nonce":552718978}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-19T12:43:35.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.859+0000 7fbef71ff700 1 -- 172.21.15.46:0/595951295 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fbed80a1480 msgr2=0x7fbed80a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:35.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.859+0000 7fbef71ff700 1 --2- 172.21.15.46:0/595951295 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fbed80a1480 0x7fbed80a3940 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fbeec000c00 tx=0x7fbeec005fb0 comp rx=0 tx=0).stop 2023-10-19T12:43:35.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.859+0000 7fbef71ff700 1 -- 172.21.15.46:0/595951295 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbef010cd10 msgr2=0x7fbef01a4210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:35.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.859+0000 7fbef71ff700 1 --2- 172.21.15.46:0/595951295 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbef010cd10 0x7fbef01a4210 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fbee800ef30 tx=0x7fbee800c3a0 comp rx=0 tx=0).stop 2023-10-19T12:43:35.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.859+0000 7fbef71ff700 1 -- 172.21.15.46:0/595951295 shutdown_connections 2023-10-19T12:43:35.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.859+0000 7fbef71ff700 1 --2- 172.21.15.46:0/595951295 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbef010cd10 0x7fbef01a4210 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:35.864 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.859+0000 7fbef71ff700 1 --2- 172.21.15.46:0/595951295 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fbed80a1480 0x7fbed80a3940 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:35.864 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.859+0000 7fbef71ff700 1 --2- 172.21.15.46:0/595951295 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbef0073250 0x7fbef019ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:35.864 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.859+0000 7fbef71ff700 1 --2- 172.21.15.46:0/595951295 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbef0074830 0x7fbef019d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:35.864 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.859+0000 7fbef71ff700 1 -- 172.21.15.46:0/595951295 >> 172.21.15.46:0/595951295 conn(0x7fbef00fbc90 msgr2=0x7fbef01000b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:35.865 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.859+0000 7fbef71ff700 1 -- 172.21.15.46:0/595951295 shutdown_connections 2023-10-19T12:43:35.865 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:35.859+0000 7fbef71ff700 1 -- 172.21.15.46:0/595951295 wait complete. 2023-10-19T12:43:35.865 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 27 2023-10-19T12:43:35.882 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-19T12:43:36.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.082+0000 7f34a979d700 1 -- 172.21.15.46:0/590863090 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f34a4074830 msgr2=0x7f34a4072c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:36.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.082+0000 7f34a979d700 1 --2- 172.21.15.46:0/590863090 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f34a4074830 0x7f34a4072c80 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f3494009990 tx=0x7f3494009ca0 comp rx=0 tx=0).stop 2023-10-19T12:43:36.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.083+0000 7f34a979d700 1 -- 172.21.15.46:0/590863090 shutdown_connections 2023-10-19T12:43:36.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.083+0000 7f34a979d700 1 --2- 172.21.15.46:0/590863090 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34a410caf0 0x7f34a410eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:36.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.083+0000 7f34a979d700 1 --2- 172.21.15.46:0/590863090 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f34a4074830 0x7f34a4072c80 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:36.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.083+0000 7f34a979d700 1 --2- 172.21.15.46:0/590863090 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f34a4073250 0x7f34a40736d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:36.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.083+0000 7f34a979d700 1 -- 172.21.15.46:0/590863090 >> 172.21.15.46:0/590863090 conn(0x7f34a40fba70 msgr2=0x7f34a40fded0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:36.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.083+0000 7f34a979d700 1 -- 172.21.15.46:0/590863090 shutdown_connections 2023-10-19T12:43:36.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.083+0000 7f34a979d700 1 -- 172.21.15.46:0/590863090 wait complete. 2023-10-19T12:43:36.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:35 smithi157 ceph-mon[134109]: pgmap v356: 129 pgs: 129 active+clean; 649 KiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.4 KiB/s wr, 9 op/s 2023-10-19T12:43:36.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:35 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/780669657' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-19T12:43:36.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:35 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/3702340614' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-19T12:43:36.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.084+0000 7f34a979d700 1 Processor -- start 2023-10-19T12:43:36.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.084+0000 7f34a979d700 1 -- start start 2023-10-19T12:43:36.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.084+0000 7f34a979d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f34a4073250 0x7f34a419ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:36.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.084+0000 7f34a979d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34a4074830 0x7f34a419cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:36.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.084+0000 7f34a979d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f34a410caf0 0x7f34a41a3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:36.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.084+0000 7f34a979d700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a41a4590 con 0x7f34a4073250 2023-10-19T12:43:36.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.084+0000 7f34a979d700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a41a46d0 con 0x7f34a410caf0 2023-10-19T12:43:36.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.084+0000 7f34a979d700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a41a4860 con 0x7f34a4074830 2023-10-19T12:43:36.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.084+0000 7f34a3fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f34a4073250 0x7f34a419ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:36.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.084+0000 7f34a8f9c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f34a410caf0 0x7f34a41a3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:36.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.084+0000 7f34a8f9c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f34a410caf0 0x7f34a41a3fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:33672/0 (socket says 172.21.15.46:33672) 2023-10-19T12:43:36.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.084+0000 7f34a37fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34a4074830 0x7f34a419cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:36.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.084+0000 7f34a3fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f34a4073250 0x7f34a419ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36798/0 (socket says 172.21.15.46:36798) 2023-10-19T12:43:36.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.084+0000 7f34a3fff700 1 -- 172.21.15.46:0/1582690290 learned_addr learned my addr 172.21.15.46:0/1582690290 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:43:36.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.085+0000 7f34a8f9c700 1 -- 172.21.15.46:0/1582690290 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34a4074830 msgr2=0x7f34a419cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:36.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.085+0000 7f34a8f9c700 1 --2- 172.21.15.46:0/1582690290 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34a4074830 0x7f34a419cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:36.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.085+0000 7f34a8f9c700 1 -- 172.21.15.46:0/1582690290 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f34a4073250 msgr2=0x7f34a419ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:36.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.085+0000 7f34a8f9c700 1 --2- 172.21.15.46:0/1582690290 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f34a4073250 0x7f34a419ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:36.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.085+0000 7f34a8f9c700 1 -- 172.21.15.46:0/1582690290 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34940095f0 con 0x7f34a410caf0 2023-10-19T12:43:36.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.085+0000 7f34a3fff700 1 --2- 172.21.15.46:0/1582690290 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f34a4073250 0x7f34a419ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:43:36.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.085+0000 7f34a37fe700 1 --2- 172.21.15.46:0/1582690290 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34a4074830 0x7f34a419cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:43:36.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.085+0000 7f34a8f9c700 1 --2- 172.21.15.46:0/1582690290 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f34a410caf0 0x7f34a41a3fc0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f349c00efc0 tx=0x7f349c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:36.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.085+0000 7f34a17fa700 1 -- 172.21.15.46:0/1582690290 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349c018070 con 0x7f34a410caf0 2023-10-19T12:43:36.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.085+0000 7f34a979d700 1 -- 172.21.15.46:0/1582690290 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34a41a4ae0 con 0x7f34a410caf0 2023-10-19T12:43:36.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.085+0000 7f34a17fa700 1 -- 172.21.15.46:0/1582690290 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f349c00f040 con 0x7f34a410caf0 2023-10-19T12:43:36.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.085+0000 7f34a17fa700 1 -- 172.21.15.46:0/1582690290 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349c00cd40 con 0x7f34a410caf0 2023-10-19T12:43:36.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.086+0000 7f34a979d700 1 -- 172.21.15.46:0/1582690290 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34a41a4ff0 con 0x7f34a410caf0 2023-10-19T12:43:36.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.086+0000 7f34a979d700 1 -- 172.21.15.46:0/1582690290 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34a4102d50 con 0x7f34a410caf0 2023-10-19T12:43:36.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.089+0000 7f34a17fa700 1 -- 172.21.15.46:0/1582690290 <== mon.2 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f349c003a00 con 0x7f34a410caf0 2023-10-19T12:43:36.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.090+0000 7f34a17fa700 1 --2- 172.21.15.46:0/1582690290 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f348c0a1480 0x7f348c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:36.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.090+0000 7f34a17fa700 1 -- 172.21.15.46:0/1582690290 <== mon.2 v2:172.21.15.157:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f349c0cd690 con 0x7f34a410caf0 2023-10-19T12:43:36.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.090+0000 7f34a3fff700 1 --2- 172.21.15.46:0/1582690290 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f348c0a1480 0x7f348c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:36.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.091+0000 7f34a3fff700 1 --2- 172.21.15.46:0/1582690290 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f348c0a1480 0x7f348c0a3940 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f349400b2e0 tx=0x7f349400b750 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:36.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.092+0000 7f34a17fa700 1 -- 172.21.15.46:0/1582690290 <== mon.2 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f349c096950 con 0x7f34a410caf0 2023-10-19T12:43:36.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:35 smithi195 ceph-mon[134493]: pgmap v356: 129 pgs: 129 active+clean; 649 KiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.4 KiB/s wr, 9 op/s 2023-10-19T12:43:36.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:35 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/780669657' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-19T12:43:36.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:35 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/3702340614' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-19T12:43:36.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:35 smithi046 ceph-mon[98509]: pgmap v356: 129 pgs: 129 active+clean; 649 KiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.4 KiB/s wr, 9 op/s 2023-10-19T12:43:36.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:35 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/780669657' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-19T12:43:36.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:35 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/3702340614' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-19T12:43:36.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.309+0000 7f34a979d700 1 -- 172.21.15.46:0/1582690290 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f34a40673e0 con 0x7f34a410caf0 2023-10-19T12:43:36.314 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.311+0000 7f34a17fa700 1 -- 172.21.15.46:0/1582690290 <== mon.2 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) v1 ==== 74+0+24780 (secure 0 0 0) 0x7f349c099f70 con 0x7f34a410caf0 2023-10-19T12:43:36.315 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:43:36.315 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":92,"fsid":"96a8be3c-6e7b-11ee-8db6-212e2dc638e7","created":"2023-10-19T12:33:26.148713+0000","modified":"2023-10-19T12:43:28.761367+0000","last_up_change":"2023-10-19T12:40:30.761679+0000","last_in_change":"2023-10-19T12:40:13.663559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-19T12:37:07.175795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-19T12:41:16.895203+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-19T12:41:18.255601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-19T12:41:21.830455+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"346ce86b-a10a-4869-9fdb-c3c1d4161455","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6803","nonce":500237995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6805","nonce":500237995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6809","nonce":500237995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6807","nonce":500237995}]},"public_addr":"172.21.15.46:6803/500237995","cluster_addr":"172.21.15.46:6805/500237995","heartbeat_back_addr":"172.21.15.46:6809/500237995","heartbeat_front_addr":"172.21.15.46:6807/500237995","state":["exists","up"]},{"osd":1,"uuid":"02aae687-76c5-4124-bae4-9787ed571c28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6801","nonce":2496862790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6803","nonce":2496862790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6807","nonce":2496862790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6805","nonce":2496862790}]},"public_addr":"172.21.15.157:6801/2496862790","cluster_addr":"172.21.15.157:6803/2496862790","heartbeat_back_addr":"172.21.15.157:6807/2496862790","heartbeat_front_addr":"172.21.15.157:6805/2496862790","state":["exists","up"]},{"osd":2,"uuid":"d5360828-1f58-4380-b2ad-0c21ff850981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6801","nonce":4211767276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6803","nonce":4211767276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6807","nonce":4211767276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6805","nonce":4211767276}]},"public_addr":"172.21.15.195:6801/4211767276","cluster_addr":"172.21.15.195:6803/4211767276","heartbeat_back_addr":"172.21.15.195:6807/4211767276","heartbeat_front_addr":"172.21.15.195:6805/4211767276","state":["exists","up"]},{"osd":3,"uuid":"accb780f-49d0-43f8-b166-ee12c558ef00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6811","nonce":1964113352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6813","nonce":1964113352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6817","nonce":1964113352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6815","nonce":1964113352}]},"public_addr":"172.21.15.46:6811/1964113352","cluster_addr":"172.21.15.46:6813/1964113352","heartbeat_back_addr":"172.21.15.46:6817/1964113352","heartbeat_front_addr":"172.21.15.46:6815/1964113352","state":["exists","up"]},{"osd":4,"uuid":"e662886d-e989-4d02-8c1f-3c4671352b0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6809","nonce":3636910144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6811","nonce":3636910144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6815","nonce":3636910144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6813","nonce":3636910144}]},"public_addr":"172.21.15.157:6809/3636910144","cluster_addr":"172.21.15.157:6811/3636910144","heartbeat_back_addr":"172.21.15.157:6815/3636910144","heartbeat_front_addr":"172.21.15.157:6813/3636910144","state":["exists","up"]},{"osd":5,"uuid":"9597e0ce-14ea-407d-90fe-f74bccee38b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6809","nonce":4071287969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6811","nonce":4071287969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6815","nonce":4071287969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6813","nonce":4071287969}]},"public_addr":"172.21.15.195:6809/4071287969","cluster_addr":"172.21.15.195:6811/4071287969","heartbeat_back_addr":"172.21.15.195:6815/4071287969","heartbeat_front_addr":"172.21.15.195:6813/4071287969","state":["exists","up"]},{"osd":6,"uuid":"6b78ba38-f60e-4cb6-b01c-cecc1820e8e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6819","nonce":1842285555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6821","nonce":1842285555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6825","nonce":1842285555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6823","nonce":1842285555}]},"public_addr":"172.21.15.46:6819/1842285555","cluster_addr":"172.21.15.46:6821/1842285555","heartbeat_back_addr":"172.21.15.46:6825/1842285555","heartbeat_front_addr":"172.21.15.46:6823/1842285555","state":["exists","up"]},{"osd":7,"uuid":"59a0899f-3bcd-4db2-b544-24df3a536749","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6817","nonce":3498672588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6819","nonce":3498672588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6823","nonce":3498672588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6821","nonce":3498672588}]},"public_addr":"172.21.15.157:6817/3498672588","cluster_addr":"172.21.15.157:6819/3498672588","heartbeat_back_addr":"172.21.15.157:6823/3498672588","heartbeat_front_addr":"172.21.15.157:6821/3498672588","state":["exists","up"]},{"osd":8,"uuid":"9c3c9835-043a-4fb5-a9ee-edf8caf6b605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6817","nonce":74230104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6819","nonce":74230104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6823","nonce":74230104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6821","nonce":74230104}]},"public_addr":"172.21.15.195:6817/74230104","cluster_addr":"172.21.15.195:6819/74230104","heartbeat_back_addr":"172.21.15.195:6823/74230104","heartbeat_front_addr":"172.21.15.195:6821/74230104","state":["exists","up"]},{"osd":9,"uuid":"3f18f506-a577-4b7c-ae0d-9351c07e81f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6827","nonce":3472581046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6829","nonce":3472581046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6833","nonce":3472581046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6831","nonce":3472581046}]},"public_addr":"172.21.15.46:6827/3472581046","cluster_addr":"172.21.15.46:6829/3472581046","heartbeat_back_addr":"172.21.15.46:6833/3472581046","heartbeat_front_addr":"172.21.15.46:6831/3472581046","state":["exists","up"]},{"osd":10,"uuid":"1ed01854-443a-4acf-9293-7ca0d451a93d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6825","nonce":2378416559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6827","nonce":2378416559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6831","nonce":2378416559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6829","nonce":2378416559}]},"public_addr":"172.21.15.157:6825/2378416559","cluster_addr":"172.21.15.157:6827/2378416559","heartbeat_back_addr":"172.21.15.157:6831/2378416559","heartbeat_front_addr":"172.21.15.157:6829/2378416559","state":["exists","up"]},{"osd":11,"uuid":"021398c0-9184-4647-8220-e40f6705ca90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6825","nonce":3075632222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6827","nonce":3075632222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6831","nonce":3075632222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6829","nonce":3075632222}]},"public_addr":"172.21.15.195:6825/3075632222","cluster_addr":"172.21.15.195:6827/3075632222","heartbeat_back_addr":"172.21.15.195:6831/3075632222","heartbeat_front_addr":"172.21.15.195:6829/3075632222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:36:22.002614+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:36:44.098031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:37:04.518341+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:37:30.796462+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:37:52.756555+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:38:13.403168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:38:39.058472+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:39:01.106893+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:39:21.908334+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:39:46.843884+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:40:08.792020+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:40:29.282974+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":7}]},{"pgid":"3.1b","mappings":[{"from":3,"to":6},{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.39","mappings":[{"from":5,"to":8}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]},{"pgid":"4.6","mappings":[{"from":5,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.46:0/3248595150":"2023-10-20T12:34:26.552115+0000","172.21.15.46:0/3624849341":"2023-10-20T12:34:26.552115+0000","172.21.15.46:0/1844094590":"2023-10-20T12:34:26.552115+0000","172.21.15.46:6801/20022894":"2023-10-20T12:34:26.552115+0000","172.21.15.46:0/3969790632":"2023-10-20T12:34:00.135248+0000","172.21.15.46:0/2331135821":"2023-10-20T12:34:00.135248+0000","172.21.15.46:6800/51664346":"2023-10-20T12:34:00.135248+0000","172.21.15.46:6801/51664346":"2023-10-20T12:34:00.135248+0000","172.21.15.46:0/585851467":"2023-10-20T12:34:00.135248+0000","172.21.15.46:6800/20022894":"2023-10-20T12:34:26.552115+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-19T12:43:36.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.314+0000 7f34a979d700 1 -- 172.21.15.46:0/1582690290 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f348c0a1480 msgr2=0x7f348c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:36.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.314+0000 7f34a979d700 1 --2- 172.21.15.46:0/1582690290 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f348c0a1480 0x7f348c0a3940 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f349400b2e0 tx=0x7f349400b750 comp rx=0 tx=0).stop 2023-10-19T12:43:36.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.314+0000 7f34a979d700 1 -- 172.21.15.46:0/1582690290 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f34a410caf0 msgr2=0x7f34a41a3fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:36.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.314+0000 7f34a979d700 1 --2- 172.21.15.46:0/1582690290 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f34a410caf0 0x7f34a41a3fc0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f349c00efc0 tx=0x7f349c00c3a0 comp rx=0 tx=0).stop 2023-10-19T12:43:36.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.314+0000 7f34a979d700 1 -- 172.21.15.46:0/1582690290 shutdown_connections 2023-10-19T12:43:36.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.314+0000 7f34a979d700 1 --2- 172.21.15.46:0/1582690290 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f34a410caf0 0x7f34a41a3fc0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:36.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.314+0000 7f34a979d700 1 --2- 172.21.15.46:0/1582690290 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f34a4073250 0x7f34a419ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:36.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.314+0000 7f34a979d700 1 --2- 172.21.15.46:0/1582690290 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f348c0a1480 0x7f348c0a3940 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:36.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.314+0000 7f34a979d700 1 --2- 172.21.15.46:0/1582690290 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34a4074830 0x7f34a419cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:36.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.314+0000 7f34a979d700 1 -- 172.21.15.46:0/1582690290 >> 172.21.15.46:0/1582690290 conn(0x7f34a40fba70 msgr2=0x7f34a40ffe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:36.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.314+0000 7f34a979d700 1 -- 172.21.15.46:0/1582690290 shutdown_connections 2023-10-19T12:43:36.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.314+0000 7f34a979d700 1 -- 172.21.15.46:0/1582690290 wait complete. 2023-10-19T12:43:36.337 DEBUG:tasks.fwd_scrub:Yielding 2023-10-19T12:43:36.338 INFO:teuthology.run_tasks:Running task exec... 2023-10-19T12:43:36.349 INFO:teuthology.task.exec:Executing custom commands... 2023-10-19T12:43:36.350 INFO:teuthology.task.exec:Running commands on role client.0 host ubuntu@smithi046.front.sepia.ceph.com 2023-10-19T12:43:36.350 DEBUG:teuthology.orchestra.run.smithi046:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -l /tmp/cephfs/ && sudo df -h /tmp/cephfs/' 2023-10-19T12:43:36.351 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2023-10-19T12:43:36.351 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-19T12:43:36.351 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-19T12:43:36.450 INFO:teuthology.orchestra.run.smithi046.stdout:total 0 2023-10-19T12:43:36.494 INFO:teuthology.orchestra.run.smithi046.stdout:Filesystem Size Used Avail Use% Mounted on 2023-10-19T12:43:36.494 INFO:teuthology.orchestra.run.smithi046.stdout:0@96a8be3c-6e7b-11ee-8db6-212e2dc638e7.cephfs=/volumes/_nogroup/sv_1/6e0973be-51e9-4268-9cb0-a3e0d00ea81e 1.1T 332M 1.1T 1% /tmp/cephfs 2023-10-19T12:43:36.499 DEBUG:teuthology.orchestra.run.smithi046:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo mkdir -m 755 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres && sudo chown postgres:postgres /tmp/cephfs/postgres' 2023-10-19T12:43:36.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.575+0000 7f5b4a5ff700 1 -- 172.21.15.46:0/1024341540 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5b441007a0 msgr2=0x7f5b44100bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:36.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.575+0000 7f5b4a5ff700 1 --2- 172.21.15.46:0/1024341540 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5b441007a0 0x7f5b44100bc0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5b34009920 tx=0x7f5b34009c30 comp rx=0 tx=0).stop 2023-10-19T12:43:36.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.575+0000 7f5b4a5ff700 1 -- 172.21.15.46:0/1024341540 shutdown_connections 2023-10-19T12:43:36.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.575+0000 7f5b4a5ff700 1 --2- 172.21.15.46:0/1024341540 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5b44102330 0x7f5b44108be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:36.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.575+0000 7f5b4a5ff700 1 --2- 172.21.15.46:0/1024341540 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5b441007a0 0x7f5b44100bc0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:36.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.575+0000 7f5b4a5ff700 1 --2- 172.21.15.46:0/1024341540 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5b44101990 0x7f5b44101df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:36.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.575+0000 7f5b4a5ff700 1 -- 172.21.15.46:0/1024341540 >> 172.21.15.46:0/1024341540 conn(0x7f5b440fbcf0 msgr2=0x7f5b440fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:36.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.575+0000 7f5b4a5ff700 1 -- 172.21.15.46:0/1024341540 shutdown_connections 2023-10-19T12:43:36.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.575+0000 7f5b4a5ff700 1 -- 172.21.15.46:0/1024341540 wait complete. 2023-10-19T12:43:36.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.576+0000 7f5b4a5ff700 1 Processor -- start 2023-10-19T12:43:36.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.577+0000 7f5b4a5ff700 1 -- start start 2023-10-19T12:43:36.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.577+0000 7f5b4a5ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5b441007a0 0x7f5b44196860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:36.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.577+0000 7f5b4a5ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5b44101990 0x7f5b44196da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:36.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.577+0000 7f5b4a5ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5b44102330 0x7f5b4419dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:36.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.577+0000 7f5b4a5ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b4419e340 con 0x7f5b441007a0 2023-10-19T12:43:36.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.577+0000 7f5b4a5ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b4419e480 con 0x7f5b44101990 2023-10-19T12:43:36.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.577+0000 7f5b4a5ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b4419e610 con 0x7f5b44102330 2023-10-19T12:43:36.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.577+0000 7f5b43fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5b441007a0 0x7f5b44196860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:36.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.577+0000 7f5b43fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5b441007a0 0x7f5b44196860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36810/0 (socket says 172.21.15.46:36810) 2023-10-19T12:43:36.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.577+0000 7f5b43fff700 1 -- 172.21.15.46:0/3846104573 learned_addr learned my addr 172.21.15.46:0/3846104573 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:43:36.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.577+0000 7f5b437fe700 1 --2- 172.21.15.46:0/3846104573 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5b44101990 0x7f5b44196da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:36.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.577+0000 7f5b48b9c700 1 --2- 172.21.15.46:0/3846104573 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5b44102330 0x7f5b4419dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:36.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.578+0000 7f5b43fff700 1 -- 172.21.15.46:0/3846104573 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5b44102330 msgr2=0x7f5b4419dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:36.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.578+0000 7f5b43fff700 1 --2- 172.21.15.46:0/3846104573 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5b44102330 0x7f5b4419dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:36.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.578+0000 7f5b43fff700 1 -- 172.21.15.46:0/3846104573 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5b44101990 msgr2=0x7f5b44196da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:36.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.578+0000 7f5b43fff700 1 --2- 172.21.15.46:0/3846104573 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5b44101990 0x7f5b44196da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:36.585 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.578+0000 7f5b43fff700 1 -- 172.21.15.46:0/3846104573 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b3c009d00 con 0x7f5b441007a0 2023-10-19T12:43:36.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.578+0000 7f5b437fe700 1 --2- 172.21.15.46:0/3846104573 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5b44101990 0x7f5b44196da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:43:36.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.578+0000 7f5b43fff700 1 --2- 172.21.15.46:0/3846104573 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5b441007a0 0x7f5b44196860 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f5b34009230 tx=0x7f5b3400bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:36.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.578+0000 7f5b417fa700 1 -- 172.21.15.46:0/3846104573 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b3401c070 con 0x7f5b441007a0 2023-10-19T12:43:36.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.578+0000 7f5b417fa700 1 -- 172.21.15.46:0/3846104573 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5b3400bb20 con 0x7f5b441007a0 2023-10-19T12:43:36.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.578+0000 7f5b4a5ff700 1 -- 172.21.15.46:0/3846104573 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b34009520 con 0x7f5b441007a0 2023-10-19T12:43:36.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.579+0000 7f5b417fa700 1 -- 172.21.15.46:0/3846104573 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b340049c0 con 0x7f5b441007a0 2023-10-19T12:43:36.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.579+0000 7f5b4a5ff700 1 -- 172.21.15.46:0/3846104573 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b4419eb20 con 0x7f5b441007a0 2023-10-19T12:43:36.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.583+0000 7f5b5df4bb80 1 Processor -- start 2023-10-19T12:43:36.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.583+0000 7f5b417fa700 1 -- 172.21.15.46:0/3846104573 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f5b34020070 con 0x7f5b441007a0 2023-10-19T12:43:36.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.583+0000 7f5b5df4bb80 1 -- start start 2023-10-19T12:43:36.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.583+0000 7f5b5df4bb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55be62b00760 0x55be62b00b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:36.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.583+0000 7f5b5df4bb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55be62b010c0 0x55be62aff520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:36.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.583+0000 7f5b5df4bb80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55be62affa60 0x55be62affee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:36.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.583+0000 7f5b5df4bb80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be62a6e760 con 0x55be62affa60 2023-10-19T12:43:36.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.583+0000 7f5b5df4bb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be62a54ce0 con 0x55be62b00760 2023-10-19T12:43:36.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.583+0000 7f5b5df4bb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be62a52600 con 0x55be62b010c0 2023-10-19T12:43:36.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.584+0000 7f5b437fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55be62affa60 0x55be62affee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:36.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.584+0000 7f5b48b9c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55be62b00760 0x55be62b00b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:36.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.584+0000 7f5b437fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55be62affa60 0x55be62affee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36824/0 (socket says 172.21.15.46:36824) 2023-10-19T12:43:36.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.584+0000 7f5b48b9c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55be62b00760 0x55be62b00b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:33698/0 (socket says 172.21.15.46:33698) 2023-10-19T12:43:36.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.584+0000 7f5b437fe700 1 -- 172.21.15.46:0/2087715822 learned_addr learned my addr 172.21.15.46:0/2087715822 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:43:36.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.584+0000 7f5b43fff700 1 --2- 172.21.15.46:0/2087715822 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55be62b010c0 0x55be62aff520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:36.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.584+0000 7f5b437fe700 1 -- 172.21.15.46:0/2087715822 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55be62b010c0 msgr2=0x55be62aff520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:43:36.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.584+0000 7f5b437fe700 1 --2- 172.21.15.46:0/2087715822 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55be62b010c0 0x55be62aff520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:36.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.584+0000 7f5b437fe700 1 -- 172.21.15.46:0/2087715822 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55be62b00760 msgr2=0x55be62b00b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:43:36.598 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.584+0000 7f5b437fe700 1 --2- 172.21.15.46:0/2087715822 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55be62b00760 0x55be62b00b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:36.598 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.584+0000 7f5b437fe700 1 -- 172.21.15.46:0/2087715822 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55be62a0b470 con 0x55be62affa60 2023-10-19T12:43:36.598 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.584+0000 7f5b48b9c700 1 --2- 172.21.15.46:0/2087715822 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55be62b00760 0x55be62b00b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:43:36.598 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.585+0000 7f5b437fe700 1 --2- 172.21.15.46:0/2087715822 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55be62affa60 0x55be62affee0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f5b380115f0 tx=0x7f5b38011900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a6d7911889b4d18 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:36.598 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.585+0000 7f5b417fa700 1 --2- 172.21.15.46:0/3846104573 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f5b2c0a1500 0x7f5b2c0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:36.599 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.585+0000 7f5b417fa700 1 -- 172.21.15.46:0/3846104573 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f5b340cdd80 con 0x7f5b441007a0 2023-10-19T12:43:36.599 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.585+0000 7f5b48b9c700 1 --2- 172.21.15.46:0/3846104573 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f5b2c0a1500 0x7f5b2c0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:36.599 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.585+0000 7f5b2a7fc700 1 -- 172.21.15.46:0/2087715822 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b38019630 con 0x55be62affa60 2023-10-19T12:43:36.599 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.585+0000 7f5b2a7fc700 1 -- 172.21.15.46:0/2087715822 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5b38019c50 con 0x55be62affa60 2023-10-19T12:43:36.599 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.585+0000 7f5b2a7fc700 1 -- 172.21.15.46:0/2087715822 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b3800ec20 con 0x55be62affa60 2023-10-19T12:43:36.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.586+0000 7f5b48b9c700 1 --2- 172.21.15.46:0/3846104573 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f5b2c0a1500 0x7f5b2c0a39c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c009610 tx=0x7f5b3c00b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:36.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.586+0000 7f5b5df4bb80 1 -- 172.21.15.46:0/2087715822 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55be62affa60 msgr2=0x55be62affee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:36.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.586+0000 7f5b5df4bb80 1 --2- 172.21.15.46:0/2087715822 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55be62affa60 0x55be62affee0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f5b380115f0 tx=0x7f5b38011900 comp rx=0 tx=0).stop 2023-10-19T12:43:36.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.586+0000 7f5b5df4bb80 1 -- 172.21.15.46:0/2087715822 shutdown_connections 2023-10-19T12:43:36.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.586+0000 7f5b5df4bb80 1 --2- 172.21.15.46:0/2087715822 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55be62affa60 0x55be62affee0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:36.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.586+0000 7f5b5df4bb80 1 --2- 172.21.15.46:0/2087715822 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55be62b00760 0x55be62b00b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:36.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.586+0000 7f5b5df4bb80 1 --2- 172.21.15.46:0/2087715822 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55be62b010c0 0x55be62aff520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:36.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.586+0000 7f5b5df4bb80 1 -- 172.21.15.46:0/2087715822 >> 172.21.15.46:0/2087715822 conn(0x55be62a6f7a0 msgr2=0x55be62af5bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:36.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.586+0000 7f5b5df4bb80 1 -- 172.21.15.46:0/2087715822 shutdown_connections 2023-10-19T12:43:36.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.586+0000 7f5b5df4bb80 1 -- 172.21.15.46:0/2087715822 wait complete. 2023-10-19T12:43:36.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.587+0000 7f5b5df4bb80 1 -- start start 2023-10-19T12:43:36.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.587+0000 7f5b5df4bb80 1 Processor -- start 2023-10-19T12:43:36.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.588+0000 7f5b5df4bb80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55be62affa60 0x55be62b09030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:36.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.588+0000 7f5b5df4bb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55be62b00760 0x55be62b09570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:36.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.588+0000 7f5b5df4bb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55be62b010c0 0x55be62b10560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:36.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.588+0000 7f5b5df4bb80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be62a4def0 con 0x55be62affa60 2023-10-19T12:43:36.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.588+0000 7f5b5df4bb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be629ea790 con 0x55be62b00760 2023-10-19T12:43:36.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.588+0000 7f5b5df4bb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be629ea430 con 0x55be62b010c0 2023-10-19T12:43:36.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.588+0000 7f5b5df4bb80 10 client.0 _ll_register_callbacks cb 0x55be62934b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:43:36.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.588+0000 7f5b43fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55be62affa60 0x55be62b09030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:36.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.588+0000 7f5b48b9c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55be62b010c0 0x55be62b10560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:36.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.588+0000 7f5b43fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55be62affa60 0x55be62b09030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36832/0 (socket says 172.21.15.46:36832) 2023-10-19T12:43:36.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.588+0000 7f5b43fff700 1 -- 172.21.15.46:0/1622432765 learned_addr learned my addr 172.21.15.46:0/1622432765 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:43:36.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.588+0000 7f5b437fe700 1 --2- 172.21.15.46:0/1622432765 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55be62b00760 0x55be62b09570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:36.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.588+0000 7f5b48b9c700 1 -- 172.21.15.46:0/1622432765 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55be62b00760 msgr2=0x55be62b09570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:43:36.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.588+0000 7f5b48b9c700 1 --2- 172.21.15.46:0/1622432765 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55be62b00760 0x55be62b09570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:36.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.589+0000 7f5b48b9c700 1 -- 172.21.15.46:0/1622432765 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55be62affa60 msgr2=0x55be62b09030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:43:36.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.589+0000 7f5b48b9c700 1 --2- 172.21.15.46:0/1622432765 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55be62affa60 0x55be62b09030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:36.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.589+0000 7f5b48b9c700 1 -- 172.21.15.46:0/1622432765 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b3c009160 con 0x55be62b010c0 2023-10-19T12:43:36.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.589+0000 7f5b48b9c700 1 --2- 172.21.15.46:0/1622432765 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55be62b010c0 0x55be62b10560 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c009cd0 tx=0x7f5b3c004b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c914778d191b1481 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:36.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.589+0000 7f5b237fe700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-10-19T12:43:36.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.589+0000 7f5b237fe700 1 -- 172.21.15.46:0/1622432765 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b3c0092f0 con 0x55be62b010c0 2023-10-19T12:43:36.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.589+0000 7f5b5df4bb80 1 -- 172.21.15.46:0/1622432765 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55be62a52f70 con 0x55be62b010c0 2023-10-19T12:43:36.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.589+0000 7f5b237fe700 1 -- 172.21.15.46:0/1622432765 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f5b3c016a90 con 0x55be62b010c0 2023-10-19T12:43:36.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.590+0000 7f5b237fe700 1 -- 172.21.15.46:0/1622432765 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5b3c016c50 con 0x55be62b010c0 2023-10-19T12:43:36.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.590+0000 7f5b5df4bb80 10 client.25687 fetch_fsmap learned FSMap version 27 2023-10-19T12:43:36.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.590+0000 7f5b5df4bb80 1 -- 172.21.15.46:0/1622432765 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7f5b38009dd0 con 0x55be62b010c0 2023-10-19T12:43:36.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.590+0000 7f5b237fe700 1 -- 172.21.15.46:0/1622432765 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55be62a52f70 con 0x55be62b010c0 2023-10-19T12:43:36.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.591+0000 7f5b237fe700 1 -- 172.21.15.46:0/1622432765 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f5b3c02b3b0 con 0x55be62b010c0 2023-10-19T12:43:36.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.591+0000 7f5b5df4bb80 10 client.25687 fetch_fsmap finished waiting for FSMap version 27 2023-10-19T12:43:36.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.591+0000 7f5b5df4bb80 10 client.25687 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-19T12:43:36.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.591+0000 7f5b5df4bb80 20 client.25687 populate_metadata read hostname 'smithi046' 2023-10-19T12:43:36.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.591+0000 7f5b5df4bb80 1 --2- 172.21.15.46:0/1622432765 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x55be62b14e40 0x55be62b17260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:36.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.591+0000 7f5b5df4bb80 4 client.25687 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-19T12:43:36.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.591+0000 7f5b5df4bb80 1 -- 172.21.15.46:0/1622432765 --> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55be62aca930 con 0x55be62b14e40 2023-10-19T12:43:36.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.591+0000 7f5b43fff700 1 --2- 172.21.15.46:0/1622432765 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x55be62b14e40 0x55be62b17260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:36.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.592+0000 7f5b43fff700 1 --2- 172.21.15.46:0/1622432765 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x55be62b14e40 0x55be62b17260 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=977683d26db93941 server_cookie=34d1ef5f322dc996 in_seq=0 out_seq=0 2023-10-19T12:43:36.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.592+0000 7f5b237fe700 10 client.25687 ms_handle_connect on v2:172.21.15.157:6838/552718978 2023-10-19T12:43:36.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.592+0000 7f5b237fe700 1 -- 172.21.15.46:0/1622432765 <== mds.0 v2:172.21.15.157:6838/552718978 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55be62aca930 con 0x55be62b14e40 2023-10-19T12:43:36.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.592+0000 7f5b237fe700 10 client.25687 handle_command_reply: tid=0 2023-10-19T12:43:36.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.592+0000 7f5b5df4bb80 1 client.25687 shutdown 2023-10-19T12:43:36.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.593+0000 7f5b5df4bb80 1 -- 172.21.15.46:0/1622432765 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55be62b010c0 msgr2=0x55be62b10560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:36.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.593+0000 7f5b5df4bb80 1 --2- 172.21.15.46:0/1622432765 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55be62b010c0 0x55be62b10560 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c009cd0 tx=0x7f5b3c004b40 comp rx=0 tx=0).stop 2023-10-19T12:43:36.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.593+0000 7f5b5df4bb80 1 -- 172.21.15.46:0/1622432765 shutdown_connections 2023-10-19T12:43:36.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.593+0000 7f5b5df4bb80 1 --2- 172.21.15.46:0/1622432765 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55be62b010c0 0x55be62b10560 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:36.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.593+0000 7f5b5df4bb80 1 --2- 172.21.15.46:0/1622432765 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x55be62b14e40 0x55be62b17260 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:36.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.593+0000 7f5b5df4bb80 1 --2- 172.21.15.46:0/1622432765 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55be62affa60 0x55be62b09030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:36.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.593+0000 7f5b237fe700 0 client.25687 ms_handle_reset on v2:172.21.15.157:6838/552718978 2023-10-19T12:43:36.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.593+0000 7f5b5df4bb80 1 --2- 172.21.15.46:0/1622432765 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55be62b00760 0x55be62b09570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:36.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.593+0000 7f5b5df4bb80 1 -- 172.21.15.46:0/1622432765 >> 172.21.15.46:0/1622432765 conn(0x55be62a6f7a0 msgr2=0x55be62af5ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:36.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.593+0000 7f5b5df4bb80 1 -- 172.21.15.46:0/1622432765 shutdown_connections 2023-10-19T12:43:36.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.593+0000 7f5b5df4bb80 1 -- 172.21.15.46:0/1622432765 wait complete. 2023-10-19T12:43:36.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.593+0000 7f5b5df4bb80 20 client.25687 trim_cache size 0 max 16384 2023-10-19T12:43:36.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.616+0000 7f5b5df4bb80 1 Processor -- start 2023-10-19T12:43:36.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.616+0000 7f5b5df4bb80 1 -- start start 2023-10-19T12:43:36.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.616+0000 7f5b5df4bb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55be62affa60 0x55be62b06fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:36.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.616+0000 7f5b5df4bb80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55be62b00760 0x55be62b10520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:36.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.616+0000 7f5b5df4bb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55be62b010c0 0x55be62b08de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:36.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.616+0000 7f5b5df4bb80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be628ce9a0 con 0x55be62b00760 2023-10-19T12:43:36.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.616+0000 7f5b5df4bb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be62af7620 con 0x55be62affa60 2023-10-19T12:43:36.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.616+0000 7f5b5df4bb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be62af2220 con 0x55be62b010c0 2023-10-19T12:43:36.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.617+0000 7f5b437fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55be62b00760 0x55be62b10520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:36.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.617+0000 7f5b437fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55be62b00760 0x55be62b10520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36844/0 (socket says 172.21.15.46:36844) 2023-10-19T12:43:36.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.617+0000 7f5b437fe700 1 -- 172.21.15.46:0/1297019348 learned_addr learned my addr 172.21.15.46:0/1297019348 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:43:36.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.617+0000 7f5b43fff700 1 --2- 172.21.15.46:0/1297019348 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55be62affa60 0x55be62b06fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:36.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.617+0000 7f5b48b9c700 1 --2- 172.21.15.46:0/1297019348 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55be62b010c0 0x55be62b08de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:36.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.617+0000 7f5b437fe700 1 -- 172.21.15.46:0/1297019348 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55be62b010c0 msgr2=0x55be62b08de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:43:36.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.617+0000 7f5b437fe700 1 --2- 172.21.15.46:0/1297019348 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55be62b010c0 0x55be62b08de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:36.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.617+0000 7f5b437fe700 1 -- 172.21.15.46:0/1297019348 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55be62affa60 msgr2=0x55be62b06fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:43:36.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.617+0000 7f5b437fe700 1 --2- 172.21.15.46:0/1297019348 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55be62affa60 0x55be62b06fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:36.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.617+0000 7f5b437fe700 1 -- 172.21.15.46:0/1297019348 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55be62b1beb0 con 0x55be62b00760 2023-10-19T12:43:36.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.617+0000 7f5b43fff700 1 --2- 172.21.15.46:0/1297019348 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55be62affa60 0x55be62b06fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:43:36.626 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.618+0000 7f5b437fe700 1 --2- 172.21.15.46:0/1297019348 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55be62b00760 0x55be62b10520 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f5b38011c50 tx=0x7f5b380114f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28da99432b9e4392 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:36.626 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.618+0000 7f5b2affd700 1 -- 172.21.15.46:0/1297019348 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b38005270 con 0x55be62b00760 2023-10-19T12:43:36.626 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.618+0000 7f5b2affd700 1 -- 172.21.15.46:0/1297019348 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5b380198f0 con 0x55be62b00760 2023-10-19T12:43:36.626 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.618+0000 7f5b2affd700 1 -- 172.21.15.46:0/1297019348 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b38003c20 con 0x55be62b00760 2023-10-19T12:43:36.627 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.619+0000 7f5b5df4bb80 1 -- 172.21.15.46:0/1297019348 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55be62b00760 msgr2=0x55be62b10520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:36.627 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.619+0000 7f5b5df4bb80 1 --2- 172.21.15.46:0/1297019348 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55be62b00760 0x55be62b10520 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f5b38011c50 tx=0x7f5b380114f0 comp rx=0 tx=0).stop 2023-10-19T12:43:36.627 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.619+0000 7f5b5df4bb80 1 -- 172.21.15.46:0/1297019348 shutdown_connections 2023-10-19T12:43:36.627 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.619+0000 7f5b5df4bb80 1 --2- 172.21.15.46:0/1297019348 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55be62b010c0 0x55be62b08de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:36.627 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.619+0000 7f5b5df4bb80 1 --2- 172.21.15.46:0/1297019348 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55be62affa60 0x55be62b06fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:36.628 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.619+0000 7f5b5df4bb80 1 --2- 172.21.15.46:0/1297019348 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55be62b00760 0x55be62b10520 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:36.628 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.619+0000 7f5b5df4bb80 1 -- 172.21.15.46:0/1297019348 >> 172.21.15.46:0/1297019348 conn(0x55be62a6f7a0 msgr2=0x55be62af5ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:36.628 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.619+0000 7f5b5df4bb80 1 -- 172.21.15.46:0/1297019348 shutdown_connections 2023-10-19T12:43:36.628 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.619+0000 7f5b5df4bb80 1 -- 172.21.15.46:0/1297019348 wait complete. 2023-10-19T12:43:36.628 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.620+0000 7f5b5df4bb80 1 -- start start 2023-10-19T12:43:36.629 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.620+0000 7f5b5df4bb80 1 Processor -- start 2023-10-19T12:43:36.629 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.621+0000 7f5b5df4bb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55be62affa60 0x55be62b0d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:36.629 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.621+0000 7f5b5df4bb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55be62b00760 0x55be62b0da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:36.629 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.621+0000 7f5b5df4bb80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55be62b010c0 0x55be62b68c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:36.629 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.621+0000 7f5b5df4bb80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be62b691c0 con 0x55be62b010c0 2023-10-19T12:43:36.629 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.621+0000 7f5b5df4bb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be62b69300 con 0x55be62b00760 2023-10-19T12:43:36.630 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.621+0000 7f5b5df4bb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be62b69440 con 0x55be62affa60 2023-10-19T12:43:36.630 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.621+0000 7f5b5df4bb80 10 client.0 _ll_register_callbacks cb 0x55be62934b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:43:36.630 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.621+0000 7f5b48b9c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55be62b010c0 0x55be62b68c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:36.630 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.621+0000 7f5b48b9c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55be62b010c0 0x55be62b68c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36858/0 (socket says 172.21.15.46:36858) 2023-10-19T12:43:36.630 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.621+0000 7f5b48b9c700 1 -- 172.21.15.46:0/1680789730 learned_addr learned my addr 172.21.15.46:0/1680789730 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:43:36.631 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.621+0000 7f5b437fe700 1 --2- 172.21.15.46:0/1680789730 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55be62b00760 0x55be62b0da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:36.631 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.621+0000 7f5b43fff700 1 --2- 172.21.15.46:0/1680789730 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55be62affa60 0x55be62b0d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:36.631 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.621+0000 7f5b48b9c700 1 -- 172.21.15.46:0/1680789730 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55be62affa60 msgr2=0x55be62b0d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:43:36.631 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.621+0000 7f5b48b9c700 1 --2- 172.21.15.46:0/1680789730 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55be62affa60 0x55be62b0d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:36.631 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.621+0000 7f5b48b9c700 1 -- 172.21.15.46:0/1680789730 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55be62b00760 msgr2=0x55be62b0da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:43:36.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.621+0000 7f5b48b9c700 1 --2- 172.21.15.46:0/1680789730 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55be62b00760 0x55be62b0da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:36.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.621+0000 7f5b48b9c700 1 -- 172.21.15.46:0/1680789730 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b4419eb20 con 0x55be62b010c0 2023-10-19T12:43:36.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.622+0000 7f5b48b9c700 1 --2- 172.21.15.46:0/1680789730 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55be62b010c0 0x55be62b68c80 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c02bf50 tx=0x7f5b3c02bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=367ce0a5270e5b88 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:36.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.622+0000 7f5b237fe700 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2023-10-19T12:43:36.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.622+0000 7f5b237fe700 1 -- 172.21.15.46:0/1680789730 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b3c00e020 con 0x55be62b010c0 2023-10-19T12:43:36.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.622+0000 7f5b5df4bb80 1 -- 172.21.15.46:0/1680789730 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5b38019c50 con 0x55be62b010c0 2023-10-19T12:43:36.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.622+0000 7f5b237fe700 1 -- 172.21.15.46:0/1680789730 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f5b3c02bb30 con 0x55be62b010c0 2023-10-19T12:43:36.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.622+0000 7f5b237fe700 1 -- 172.21.15.46:0/1680789730 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5b3c0166e0 con 0x55be62b010c0 2023-10-19T12:43:36.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.622+0000 7f5b5df4bb80 10 client.15669 fetch_fsmap learned FSMap version 27 2023-10-19T12:43:36.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.622+0000 7f5b5df4bb80 1 -- 172.21.15.46:0/1680789730 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55be62a0b470 con 0x55be62b010c0 2023-10-19T12:43:36.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.622+0000 7f5b237fe700 1 -- 172.21.15.46:0/1680789730 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5b38019c50 con 0x55be62b010c0 2023-10-19T12:43:36.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.623+0000 7f5b237fe700 1 -- 172.21.15.46:0/1680789730 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f5b3c023810 con 0x55be62b010c0 2023-10-19T12:43:36.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.623+0000 7f5b5df4bb80 10 client.15669 fetch_fsmap finished waiting for FSMap version 27 2023-10-19T12:43:36.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.623+0000 7f5b5df4bb80 10 client.15669 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-19T12:43:36.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.623+0000 7f5b5df4bb80 20 client.15669 populate_metadata read hostname 'smithi046' 2023-10-19T12:43:36.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.623+0000 7f5b5df4bb80 1 --2- 172.21.15.46:0/1680789730 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x55be62b6ae90 0x55be62b6d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:36.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.623+0000 7f5b5df4bb80 4 client.15669 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-19T12:43:36.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.623+0000 7f5b5df4bb80 1 -- 172.21.15.46:0/1680789730 --> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55be62a46ed0 con 0x55be62b6ae90 2023-10-19T12:43:36.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.623+0000 7f5b43fff700 1 --2- 172.21.15.46:0/1680789730 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x55be62b6ae90 0x55be62b6d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:36.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.624+0000 7f5b43fff700 1 --2- 172.21.15.46:0/1680789730 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x55be62b6ae90 0x55be62b6d2b0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d53e2e7af5c5cbc7 server_cookie=61d41df952a8c191 in_seq=0 out_seq=0 2023-10-19T12:43:36.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.624+0000 7f5b237fe700 10 client.15669 ms_handle_connect on v2:172.21.15.157:6838/552718978 2023-10-19T12:43:36.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.625+0000 7f5b237fe700 1 -- 172.21.15.46:0/1680789730 <== mds.0 v2:172.21.15.157:6838/552718978 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55be62a46ed0 con 0x55be62b6ae90 2023-10-19T12:43:36.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.625+0000 7f5b237fe700 10 client.15669 handle_command_reply: tid=0 2023-10-19T12:43:36.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.625+0000 7f5b5df4bb80 1 client.15669 shutdown 2023-10-19T12:43:36.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.625+0000 7f5b5df4bb80 1 -- 172.21.15.46:0/1680789730 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55be62b010c0 msgr2=0x55be62b68c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:36.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.625+0000 7f5b5df4bb80 1 --2- 172.21.15.46:0/1680789730 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55be62b010c0 0x55be62b68c80 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c02bf50 tx=0x7f5b3c02bf80 comp rx=0 tx=0).stop 2023-10-19T12:43:36.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.625+0000 7f5b5df4bb80 1 -- 172.21.15.46:0/1680789730 shutdown_connections 2023-10-19T12:43:36.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.625+0000 7f5b5df4bb80 1 --2- 172.21.15.46:0/1680789730 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x55be62b6ae90 0x55be62b6d2b0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:36.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.625+0000 7f5b5df4bb80 1 --2- 172.21.15.46:0/1680789730 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55be62b010c0 0x55be62b68c80 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:36.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.625+0000 7f5b5df4bb80 1 --2- 172.21.15.46:0/1680789730 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55be62affa60 0x55be62b0d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:36.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.625+0000 7f5b5df4bb80 1 --2- 172.21.15.46:0/1680789730 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55be62b00760 0x55be62b0da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:36.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.625+0000 7f5b5df4bb80 1 -- 172.21.15.46:0/1680789730 >> 172.21.15.46:0/1680789730 conn(0x55be62a6f7a0 msgr2=0x55be62b06f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:36.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.625+0000 7f5b237fe700 0 client.15669 ms_handle_reset on v2:172.21.15.157:6838/552718978 2023-10-19T12:43:36.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.625+0000 7f5b5df4bb80 1 -- 172.21.15.46:0/1680789730 shutdown_connections 2023-10-19T12:43:36.640 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.625+0000 7f5b5df4bb80 1 -- 172.21.15.46:0/1680789730 wait complete. 2023-10-19T12:43:36.640 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.626+0000 7f5b5df4bb80 20 client.15669 trim_cache size 0 max 16384 2023-10-19T12:43:36.640 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-10-19T12:43:36.640 INFO:teuthology.orchestra.run.smithi046.stdout: "return_code": 0, 2023-10-19T12:43:36.641 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_tag": "95aa1a7a-7908-4a60-87e1-d942b34d3027", 2023-10-19T12:43:36.641 INFO:teuthology.orchestra.run.smithi046.stdout: "mode": "asynchronous" 2023-10-19T12:43:36.641 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-10-19T12:43:36.642 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.626+0000 7f5b4a5ff700 1 -- 172.21.15.46:0/3846104573 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f5b2c0a1500 msgr2=0x7f5b2c0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:36.642 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.626+0000 7f5b4a5ff700 1 --2- 172.21.15.46:0/3846104573 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f5b2c0a1500 0x7f5b2c0a39c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c009610 tx=0x7f5b3c00b040 comp rx=0 tx=0).stop 2023-10-19T12:43:36.642 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.626+0000 7f5b4a5ff700 1 -- 172.21.15.46:0/3846104573 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5b441007a0 msgr2=0x7f5b44196860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:36.642 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.626+0000 7f5b4a5ff700 1 --2- 172.21.15.46:0/3846104573 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5b441007a0 0x7f5b44196860 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f5b34009230 tx=0x7f5b3400bef0 comp rx=0 tx=0).stop 2023-10-19T12:43:36.643 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.626+0000 7f5b4a5ff700 1 -- 172.21.15.46:0/3846104573 shutdown_connections 2023-10-19T12:43:36.643 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.626+0000 7f5b4a5ff700 1 --2- 172.21.15.46:0/3846104573 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f5b2c0a1500 0x7f5b2c0a39c0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:36.643 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.626+0000 7f5b4a5ff700 1 --2- 172.21.15.46:0/3846104573 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5b44102330 0x7f5b4419dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:36.643 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.626+0000 7f5b4a5ff700 1 --2- 172.21.15.46:0/3846104573 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5b441007a0 0x7f5b44196860 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:36.643 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.626+0000 7f5b4a5ff700 1 --2- 172.21.15.46:0/3846104573 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5b44101990 0x7f5b44196da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:36.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.626+0000 7f5b4a5ff700 1 -- 172.21.15.46:0/3846104573 >> 172.21.15.46:0/3846104573 conn(0x7f5b440fbcf0 msgr2=0x7f5b44104e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:36.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.627+0000 7f5b4a5ff700 1 -- 172.21.15.46:0/3846104573 shutdown_connections 2023-10-19T12:43:36.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.627+0000 7f5b4a5ff700 1 -- 172.21.15.46:0/3846104573 wait complete. 2023-10-19T12:43:36.649 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-19T12:43:36.657 DEBUG:teuthology.orchestra.run.smithi046:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- mkdir -m 700 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres/data' 2023-10-19T12:43:36.812 DEBUG:teuthology.orchestra.run.smithi046:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo semanage fcontext -a -t postgresql_db_t "/tmp/cephfs/postgres(/.*)?"' 2023-10-19T12:43:36.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.866+0000 7f8aab5ff700 1 -- 172.21.15.46:0/1321190493 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8aa4106470 msgr2=0x7f8aa41088e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:36.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.866+0000 7f8aab5ff700 1 --2- 172.21.15.46:0/1321190493 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8aa4106470 0x7f8aa41088e0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c009f90 tx=0x7f8a9c00b330 comp rx=0 tx=0).stop 2023-10-19T12:43:36.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.867+0000 7f8aab5ff700 1 -- 172.21.15.46:0/1321190493 shutdown_connections 2023-10-19T12:43:36.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.867+0000 7f8aab5ff700 1 --2- 172.21.15.46:0/1321190493 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8aa4106470 0x7f8aa41088e0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:36.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.867+0000 7f8aab5ff700 1 --2- 172.21.15.46:0/1321190493 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8aa4101210 0x7f8aa4103600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:36.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.867+0000 7f8aab5ff700 1 --2- 172.21.15.46:0/1321190493 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8aa4103b40 0x7f8aa4105f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:36.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.867+0000 7f8aab5ff700 1 -- 172.21.15.46:0/1321190493 >> 172.21.15.46:0/1321190493 conn(0x7f8aa40fac00 msgr2=0x7f8aa40fd040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:36.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.867+0000 7f8aab5ff700 1 -- 172.21.15.46:0/1321190493 shutdown_connections 2023-10-19T12:43:36.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.867+0000 7f8aab5ff700 1 -- 172.21.15.46:0/1321190493 wait complete. 2023-10-19T12:43:36.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.868+0000 7f8aab5ff700 1 Processor -- start 2023-10-19T12:43:36.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.868+0000 7f8aab5ff700 1 -- start start 2023-10-19T12:43:36.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.868+0000 7f8aab5ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8aa4101210 0x7f8aa4198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:36.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.868+0000 7f8aab5ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8aa4103b40 0x7f8aa4198f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:36.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.868+0000 7f8aab5ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8aa4106470 0x7f8aa419ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:36.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.868+0000 7f8aab5ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa41a0560 con 0x7f8aa4103b40 2023-10-19T12:43:36.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.868+0000 7f8aab5ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa41a06a0 con 0x7f8aa4101210 2023-10-19T12:43:36.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.868+0000 7f8aab5ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa41a0830 con 0x7f8aa4106470 2023-10-19T12:43:36.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.868+0000 7f8aa8b9a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8aa4103b40 0x7f8aa4198f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:36.876 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.869+0000 7f8aa8b9a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8aa4103b40 0x7f8aa4198f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36878/0 (socket says 172.21.15.46:36878) 2023-10-19T12:43:36.876 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.869+0000 7f8aa8b9a700 1 -- 172.21.15.46:0/1263206950 learned_addr learned my addr 172.21.15.46:0/1263206950 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:43:36.876 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.869+0000 7f8aa939b700 1 --2- 172.21.15.46:0/1263206950 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8aa4101210 0x7f8aa4198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:36.876 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.869+0000 7f8aa9b9c700 1 --2- 172.21.15.46:0/1263206950 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8aa4106470 0x7f8aa419ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:36.876 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.869+0000 7f8aa939b700 1 -- 172.21.15.46:0/1263206950 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8aa4106470 msgr2=0x7f8aa419ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:36.876 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.869+0000 7f8aa939b700 1 --2- 172.21.15.46:0/1263206950 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8aa4106470 0x7f8aa419ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:36.877 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.869+0000 7f8aa939b700 1 -- 172.21.15.46:0/1263206950 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8aa4103b40 msgr2=0x7f8aa4198f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:36.877 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.869+0000 7f8aa939b700 1 --2- 172.21.15.46:0/1263206950 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8aa4103b40 0x7f8aa4198f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:36.877 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.869+0000 7f8aa939b700 1 -- 172.21.15.46:0/1263206950 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a9c009c40 con 0x7f8aa4101210 2023-10-19T12:43:36.877 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.869+0000 7f8aa8b9a700 1 --2- 172.21.15.46:0/1263206950 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8aa4103b40 0x7f8aa4198f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:43:36.877 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.869+0000 7f8aa939b700 1 --2- 172.21.15.46:0/1263206950 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8aa4101210 0x7f8aa4198a30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8aa000e9c0 tx=0x7f8aa000ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:36.878 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.870+0000 7f8a9a7fc700 1 -- 172.21.15.46:0/1263206950 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa000c9c0 con 0x7f8aa4101210 2023-10-19T12:43:36.878 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.870+0000 7f8aab5ff700 1 -- 172.21.15.46:0/1263206950 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8aa41a0b10 con 0x7f8aa4101210 2023-10-19T12:43:36.878 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.870+0000 7f8a9a7fc700 1 -- 172.21.15.46:0/1263206950 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8aa0010430 con 0x7f8aa4101210 2023-10-19T12:43:36.878 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.870+0000 7f8a9a7fc700 1 -- 172.21.15.46:0/1263206950 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa0018680 con 0x7f8aa4101210 2023-10-19T12:43:36.878 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.870+0000 7f8aab5ff700 1 -- 172.21.15.46:0/1263206950 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8aa41a1070 con 0x7f8aa4101210 2023-10-19T12:43:36.879 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:36 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/595951295' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-19T12:43:36.879 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:36 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/1582690290' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-19T12:43:36.881 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.874+0000 7f8a9a7fc700 1 -- 172.21.15.46:0/1263206950 <== mon.2 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f8aa0010810 con 0x7f8aa4101210 2023-10-19T12:43:36.881 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.875+0000 7f8abeecab80 1 Processor -- start 2023-10-19T12:43:36.882 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.876+0000 7f8abeecab80 1 -- start start 2023-10-19T12:43:36.882 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.876+0000 7f8a9a7fc700 1 --2- 172.21.15.46:0/1263206950 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f8a900a1500 0x7f8a900a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:36.882 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.876+0000 7f8a9a7fc700 1 -- 172.21.15.46:0/1263206950 <== mon.2 v2:172.21.15.157:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f8aa0014070 con 0x7f8aa4101210 2023-10-19T12:43:36.882 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.876+0000 7f8abeecab80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560c873bcae0 0x560c873bcf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:36.882 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.876+0000 7f8abeecab80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560c873bd440 0x560c873bb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:36.883 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.876+0000 7f8abeecab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560c873bbde0 0x560c873bc260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:36.883 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.876+0000 7f8abeecab80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c873266e0 con 0x560c873bd440 2023-10-19T12:43:36.883 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.876+0000 7f8abeecab80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c8730cc60 con 0x560c873bcae0 2023-10-19T12:43:36.883 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.876+0000 7f8abeecab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c8730a580 con 0x560c873bbde0 2023-10-19T12:43:36.884 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.876+0000 7f8aa9b9c700 1 --2- 172.21.15.46:0/1263206950 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f8a900a1500 0x7f8a900a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:36.884 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.877+0000 7f8aa9b9c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560c873bbde0 0x560c873bc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:36.884 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.877+0000 7f8aa8b9a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560c873bd440 0x560c873bb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:36.884 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.877+0000 7f8aa9b9c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560c873bbde0 0x560c873bc260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:57062/0 (socket says 172.21.15.46:57062) 2023-10-19T12:43:36.884 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.877+0000 7f8aa9b9c700 1 -- 172.21.15.46:0/701766618 learned_addr learned my addr 172.21.15.46:0/701766618 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:43:36.884 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.877+0000 7f8aa939b700 1 --2- 172.21.15.46:0/701766618 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560c873bcae0 0x560c873bcf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:36.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.877+0000 7f8aa8b9a700 1 -- 172.21.15.46:0/701766618 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560c873bbde0 msgr2=0x560c873bc260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:43:36.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.877+0000 7f8aa8b9a700 1 --2- 172.21.15.46:0/701766618 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560c873bbde0 0x560c873bc260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:36.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.877+0000 7f8aa8b9a700 1 -- 172.21.15.46:0/701766618 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560c873bcae0 msgr2=0x560c873bcf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:43:36.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.877+0000 7f8aa8b9a700 1 --2- 172.21.15.46:0/701766618 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560c873bcae0 0x560c873bcf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:36.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.877+0000 7f8aa8b9a700 1 -- 172.21.15.46:0/701766618 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560c872c33f0 con 0x560c873bd440 2023-10-19T12:43:36.886 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.877+0000 7f8aa9b9c700 1 --2- 172.21.15.46:0/701766618 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560c873bbde0 0x560c873bc260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:43:36.886 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.877+0000 7f8aa939b700 1 --2- 172.21.15.46:0/701766618 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560c873bcae0 0x560c873bcf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:43:36.886 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.877+0000 7f8aa9b9c700 1 --2- 172.21.15.46:0/1263206950 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f8a900a1500 0x7f8a900a39c0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c009f90 tx=0x7f8a9c007420 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:36.886 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.877+0000 7f8aa8b9a700 1 --2- 172.21.15.46:0/701766618 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560c873bd440 0x560c873bb8a0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f8a94011570 tx=0x7f8a94011880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95cbdbb51e5d8684 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:36.886 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.878+0000 7f8a8f7fe700 1 -- 172.21.15.46:0/701766618 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a94004230 con 0x560c873bd440 2023-10-19T12:43:36.887 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.878+0000 7f8a8f7fe700 1 -- 172.21.15.46:0/701766618 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8a94004390 con 0x560c873bd440 2023-10-19T12:43:36.887 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.878+0000 7f8a8f7fe700 1 -- 172.21.15.46:0/701766618 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a94019820 con 0x560c873bd440 2023-10-19T12:43:36.887 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.878+0000 7f8abeecab80 1 -- 172.21.15.46:0/701766618 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560c873bd440 msgr2=0x560c873bb8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:36.887 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.878+0000 7f8abeecab80 1 --2- 172.21.15.46:0/701766618 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560c873bd440 0x560c873bb8a0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f8a94011570 tx=0x7f8a94011880 comp rx=0 tx=0).stop 2023-10-19T12:43:36.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.879+0000 7f8abeecab80 1 -- 172.21.15.46:0/701766618 shutdown_connections 2023-10-19T12:43:36.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.879+0000 7f8abeecab80 1 --2- 172.21.15.46:0/701766618 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560c873bbde0 0x560c873bc260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:36.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.879+0000 7f8abeecab80 1 --2- 172.21.15.46:0/701766618 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560c873bcae0 0x560c873bcf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:36.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.879+0000 7f8abeecab80 1 --2- 172.21.15.46:0/701766618 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560c873bd440 0x560c873bb8a0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:36.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.879+0000 7f8abeecab80 1 -- 172.21.15.46:0/701766618 >> 172.21.15.46:0/701766618 conn(0x560c87327720 msgr2=0x560c873adb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:36.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.879+0000 7f8abeecab80 1 -- 172.21.15.46:0/701766618 shutdown_connections 2023-10-19T12:43:36.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.879+0000 7f8abeecab80 1 -- 172.21.15.46:0/701766618 wait complete. 2023-10-19T12:43:36.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.879+0000 7f8abeecab80 1 -- start start 2023-10-19T12:43:36.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.880+0000 7f8abeecab80 1 Processor -- start 2023-10-19T12:43:36.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.880+0000 7f8abeecab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560c873bbde0 0x560c873c52c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:36.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.880+0000 7f8abeecab80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560c873bcae0 0x560c873c5800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:36.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.880+0000 7f8abeecab80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560c873bd440 0x560c873cc840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:36.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.880+0000 7f8abeecab80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c87305e70 con 0x560c873bd440 2023-10-19T12:43:36.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.880+0000 7f8abeecab80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c872a2710 con 0x560c873bcae0 2023-10-19T12:43:36.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.880+0000 7f8abeecab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c872a23b0 con 0x560c873bbde0 2023-10-19T12:43:36.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.881+0000 7f8abeecab80 10 client.0 _ll_register_callbacks cb 0x560c871eca80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:43:36.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.881+0000 7f8aa9b9c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560c873bd440 0x560c873cc840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:36.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.881+0000 7f8aa9b9c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560c873bd440 0x560c873cc840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36900/0 (socket says 172.21.15.46:36900) 2023-10-19T12:43:36.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.881+0000 7f8aa9b9c700 1 -- 172.21.15.46:0/1978120842 learned_addr learned my addr 172.21.15.46:0/1978120842 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:43:36.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.881+0000 7f8aa8b9a700 1 --2- 172.21.15.46:0/1978120842 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560c873bcae0 0x560c873c5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:36.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.881+0000 7f8aa939b700 1 --2- 172.21.15.46:0/1978120842 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560c873bbde0 0x560c873c52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:36.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.881+0000 7f8aa9b9c700 1 -- 172.21.15.46:0/1978120842 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560c873bbde0 msgr2=0x560c873c52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:43:36.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.881+0000 7f8aa9b9c700 1 --2- 172.21.15.46:0/1978120842 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560c873bbde0 0x560c873c52c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:36.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.881+0000 7f8aa9b9c700 1 -- 172.21.15.46:0/1978120842 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560c873bcae0 msgr2=0x560c873c5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:43:36.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.881+0000 7f8aa9b9c700 1 --2- 172.21.15.46:0/1978120842 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560c873bcae0 0x560c873c5800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:36.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.881+0000 7f8aa9b9c700 1 -- 172.21.15.46:0/1978120842 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8aa41a1070 con 0x560c873bd440 2023-10-19T12:43:36.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.882+0000 7f8aa9b9c700 1 --2- 172.21.15.46:0/1978120842 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560c873bd440 0x560c873cc840 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c00bc70 tx=0x7f8a9c026000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac2f7c0212319c63 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:36.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.882+0000 7f8a8cff9700 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2023-10-19T12:43:36.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.882+0000 7f8a8cff9700 1 -- 172.21.15.46:0/1978120842 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c026070 con 0x560c873bd440 2023-10-19T12:43:36.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.882+0000 7f8abeecab80 1 -- 172.21.15.46:0/1978120842 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560c8730aef0 con 0x560c873bd440 2023-10-19T12:43:36.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.882+0000 7f8a8cff9700 1 -- 172.21.15.46:0/1978120842 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f8a9c008e70 con 0x560c873bd440 2023-10-19T12:43:36.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.882+0000 7f8a8cff9700 1 -- 172.21.15.46:0/1978120842 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8a9c00e040 con 0x560c873bd440 2023-10-19T12:43:36.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.882+0000 7f8abeecab80 10 client.15681 fetch_fsmap learned FSMap version 27 2023-10-19T12:43:36.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.882+0000 7f8abeecab80 1 -- 172.21.15.46:0/1978120842 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7f8a94009d60 con 0x560c873bd440 2023-10-19T12:43:36.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.882+0000 7f8a8cff9700 1 -- 172.21.15.46:0/1978120842 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x560c8730aef0 con 0x560c873bd440 2023-10-19T12:43:36.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.882+0000 7f8a8cff9700 1 -- 172.21.15.46:0/1978120842 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f8a9c01e7f0 con 0x560c873bd440 2023-10-19T12:43:36.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.883+0000 7f8abeecab80 10 client.15681 fetch_fsmap finished waiting for FSMap version 27 2023-10-19T12:43:36.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.883+0000 7f8abeecab80 10 client.15681 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-19T12:43:36.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.883+0000 7f8abeecab80 20 client.15681 populate_metadata read hostname 'smithi046' 2023-10-19T12:43:36.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.883+0000 7f8abeecab80 1 --2- 172.21.15.46:0/1978120842 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x560c873d10b0 0x560c873d34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:36.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.883+0000 7f8abeecab80 4 client.15681 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-19T12:43:36.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.883+0000 7f8abeecab80 1 -- 172.21.15.46:0/1978120842 --> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560c873828b0 con 0x560c873d10b0 2023-10-19T12:43:36.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.883+0000 7f8aa939b700 1 --2- 172.21.15.46:0/1978120842 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x560c873d10b0 0x560c873d34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:36.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.884+0000 7f8aa939b700 1 --2- 172.21.15.46:0/1978120842 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x560c873d10b0 0x560c873d34d0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9860c6ef91c87793 server_cookie=4e6831967b7fb007 in_seq=0 out_seq=0 2023-10-19T12:43:36.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.884+0000 7f8a8cff9700 10 client.15681 ms_handle_connect on v2:172.21.15.157:6838/552718978 2023-10-19T12:43:36.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.884+0000 7f8a8cff9700 1 -- 172.21.15.46:0/1978120842 <== mds.0 v2:172.21.15.157:6838/552718978 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x560c873828b0 con 0x560c873d10b0 2023-10-19T12:43:36.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.884+0000 7f8a8cff9700 10 client.15681 handle_command_reply: tid=0 2023-10-19T12:43:36.899 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.884+0000 7f8abeecab80 1 client.15681 shutdown 2023-10-19T12:43:36.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.884+0000 7f8abeecab80 1 -- 172.21.15.46:0/1978120842 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560c873bd440 msgr2=0x560c873cc840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:36.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.884+0000 7f8abeecab80 1 --2- 172.21.15.46:0/1978120842 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560c873bd440 0x560c873cc840 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c00bc70 tx=0x7f8a9c026000 comp rx=0 tx=0).stop 2023-10-19T12:43:36.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.885+0000 7f8abeecab80 1 -- 172.21.15.46:0/1978120842 shutdown_connections 2023-10-19T12:43:36.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.885+0000 7f8abeecab80 1 --2- 172.21.15.46:0/1978120842 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x560c873d10b0 0x560c873d34d0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:36.900 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.885+0000 7f8abeecab80 1 --2- 172.21.15.46:0/1978120842 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560c873bd440 0x560c873cc840 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:36.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.885+0000 7f8abeecab80 1 --2- 172.21.15.46:0/1978120842 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560c873bbde0 0x560c873c52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:36.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.885+0000 7f8abeecab80 1 --2- 172.21.15.46:0/1978120842 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560c873bcae0 0x560c873c5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:36.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.885+0000 7f8abeecab80 1 -- 172.21.15.46:0/1978120842 >> 172.21.15.46:0/1978120842 conn(0x560c87327720 msgr2=0x560c873adb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:36.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.885+0000 7f8a8cff9700 0 client.15681 ms_handle_reset on v2:172.21.15.157:6838/552718978 2023-10-19T12:43:36.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.885+0000 7f8abeecab80 1 -- 172.21.15.46:0/1978120842 shutdown_connections 2023-10-19T12:43:36.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.885+0000 7f8abeecab80 1 -- 172.21.15.46:0/1978120842 wait complete. 2023-10-19T12:43:36.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.885+0000 7f8abeecab80 20 client.15681 trim_cache size 0 max 16384 2023-10-19T12:43:36.906 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.903+0000 7f8abeecab80 1 Processor -- start 2023-10-19T12:43:36.906 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.903+0000 7f8abeecab80 1 -- start start 2023-10-19T12:43:36.906 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.903+0000 7f8abeecab80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560c873bbde0 0x560c873c47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:36.907 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.903+0000 7f8abeecab80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560c873bcae0 0x560c873cc800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:36.907 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.903+0000 7f8abeecab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560c873bd440 0x560c873a85d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:36.907 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.903+0000 7f8abeecab80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c873c4320 con 0x560c873bbde0 2023-10-19T12:43:36.907 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.903+0000 7f8abeecab80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c87186920 con 0x560c873bcae0 2023-10-19T12:43:36.907 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.903+0000 7f8abeecab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c873828b0 con 0x560c873bd440 2023-10-19T12:43:36.911 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.903+0000 7f8aa939b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560c873bbde0 0x560c873c47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:36.911 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.903+0000 7f8aa939b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560c873bbde0 0x560c873c47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36912/0 (socket says 172.21.15.46:36912) 2023-10-19T12:43:36.912 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.904+0000 7f8aa8b9a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560c873bcae0 0x560c873cc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:36.912 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.904+0000 7f8aa939b700 1 -- 172.21.15.46:0/1297224431 learned_addr learned my addr 172.21.15.46:0/1297224431 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:43:36.912 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.904+0000 7f8aa9b9c700 1 --2- 172.21.15.46:0/1297224431 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560c873bd440 0x560c873a85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:36.912 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.904+0000 7f8aa939b700 1 -- 172.21.15.46:0/1297224431 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560c873bd440 msgr2=0x560c873a85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:43:36.912 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.904+0000 7f8aa939b700 1 --2- 172.21.15.46:0/1297224431 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560c873bd440 0x560c873a85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:36.913 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.904+0000 7f8aa939b700 1 -- 172.21.15.46:0/1297224431 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560c873bcae0 msgr2=0x560c873cc800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:43:36.913 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.904+0000 7f8aa939b700 1 --2- 172.21.15.46:0/1297224431 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560c873bcae0 0x560c873cc800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:36.913 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.904+0000 7f8aa939b700 1 -- 172.21.15.46:0/1297224431 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560c87130de0 con 0x560c873bbde0 2023-10-19T12:43:36.913 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.904+0000 7f8aa8b9a700 1 --2- 172.21.15.46:0/1297224431 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560c873bcae0 0x560c873cc800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:43:36.913 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.904+0000 7f8aa939b700 1 --2- 172.21.15.46:0/1297224431 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560c873bbde0 0x560c873c47d0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f8aa00ca840 tx=0x7f8aa00ca6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97d49eca30b9ed52 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:36.914 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.905+0000 7f8a8ffff700 1 -- 172.21.15.46:0/1297224431 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa00b82c0 con 0x560c873bbde0 2023-10-19T12:43:36.914 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.905+0000 7f8a8ffff700 1 -- 172.21.15.46:0/1297224431 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8aa00b1070 con 0x560c873bbde0 2023-10-19T12:43:36.914 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.905+0000 7f8a8ffff700 1 -- 172.21.15.46:0/1297224431 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa0010670 con 0x560c873bbde0 2023-10-19T12:43:36.914 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.905+0000 7f8abeecab80 1 -- 172.21.15.46:0/1297224431 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560c873bbde0 msgr2=0x560c873c47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:36.915 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.905+0000 7f8abeecab80 1 --2- 172.21.15.46:0/1297224431 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560c873bbde0 0x560c873c47d0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f8aa00ca840 tx=0x7f8aa00ca6c0 comp rx=0 tx=0).stop 2023-10-19T12:43:36.915 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.905+0000 7f8abeecab80 1 -- 172.21.15.46:0/1297224431 shutdown_connections 2023-10-19T12:43:36.915 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.905+0000 7f8abeecab80 1 --2- 172.21.15.46:0/1297224431 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560c873bd440 0x560c873a85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:36.915 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.905+0000 7f8abeecab80 1 --2- 172.21.15.46:0/1297224431 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560c873bbde0 0x560c873c47d0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:36.915 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.905+0000 7f8abeecab80 1 --2- 172.21.15.46:0/1297224431 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560c873bcae0 0x560c873cc800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:36.916 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.905+0000 7f8abeecab80 1 -- 172.21.15.46:0/1297224431 >> 172.21.15.46:0/1297224431 conn(0x560c87327720 msgr2=0x560c873bc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:36.916 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.906+0000 7f8abeecab80 1 -- 172.21.15.46:0/1297224431 shutdown_connections 2023-10-19T12:43:36.916 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.906+0000 7f8abeecab80 1 -- 172.21.15.46:0/1297224431 wait complete. 2023-10-19T12:43:36.916 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.906+0000 7f8abeecab80 1 -- start start 2023-10-19T12:43:36.916 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.906+0000 7f8abeecab80 1 Processor -- start 2023-10-19T12:43:36.916 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.907+0000 7f8abeecab80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560c873bbde0 0x560c873cc650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:36.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.907+0000 7f8abeecab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560c873bcae0 0x560c873c91e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:36.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.907+0000 7f8abeecab80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560c873bd440 0x560c873c9720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:36.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.907+0000 7f8abeecab80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c873c9cf0 con 0x560c873bbde0 2023-10-19T12:43:36.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.907+0000 7f8abeecab80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c873c9e30 con 0x560c873bd440 2023-10-19T12:43:36.917 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.907+0000 7f8abeecab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c87424f40 con 0x560c873bcae0 2023-10-19T12:43:36.918 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.907+0000 7f8abeecab80 10 client.0 _ll_register_callbacks cb 0x560c871eca80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:43:36.918 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.907+0000 7f8aa939b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560c873bbde0 0x560c873cc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:36.918 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.907+0000 7f8aa939b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560c873bbde0 0x560c873cc650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36926/0 (socket says 172.21.15.46:36926) 2023-10-19T12:43:36.918 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.907+0000 7f8aa939b700 1 -- 172.21.15.46:0/1789637949 learned_addr learned my addr 172.21.15.46:0/1789637949 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:43:36.918 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.907+0000 7f8aa8b9a700 1 --2- 172.21.15.46:0/1789637949 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560c873bcae0 0x560c873c91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:36.919 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.907+0000 7f8aa9b9c700 1 --2- 172.21.15.46:0/1789637949 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560c873bd440 0x560c873c9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:36.919 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.907+0000 7f8aa939b700 1 -- 172.21.15.46:0/1789637949 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560c873bcae0 msgr2=0x560c873c91e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:43:36.919 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.907+0000 7f8aa939b700 1 --2- 172.21.15.46:0/1789637949 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560c873bcae0 0x560c873c91e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:36.919 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.907+0000 7f8aa939b700 1 -- 172.21.15.46:0/1789637949 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560c873bd440 msgr2=0x560c873c9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:43:36.919 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.907+0000 7f8aa939b700 1 --2- 172.21.15.46:0/1789637949 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560c873bd440 0x560c873c9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:36.920 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.907+0000 7f8aa939b700 1 -- 172.21.15.46:0/1789637949 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560c872c33f0 con 0x560c873bbde0 2023-10-19T12:43:36.920 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.907+0000 7f8aa8b9a700 1 --2- 172.21.15.46:0/1789637949 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560c873bcae0 0x560c873c91e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T12:43:36.920 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.908+0000 7f8aa939b700 1 --2- 172.21.15.46:0/1789637949 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560c873bbde0 0x560c873cc650 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f8aa00cab60 tx=0x7f8aa00ca780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6a212743a51d62 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:43:36.920 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.908+0000 7f8a8cff9700 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2023-10-19T12:43:36.920 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.908+0000 7f8a8cff9700 1 -- 172.21.15.46:0/1789637949 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa0010610 con 0x560c873bbde0 2023-10-19T12:43:36.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.908+0000 7f8a8cff9700 1 -- 172.21.15.46:0/1789637949 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f8aa009e160 con 0x560c873bbde0 2023-10-19T12:43:36.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.908+0000 7f8abeecab80 1 -- 172.21.15.46:0/1789637949 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8a94004390 con 0x560c873bbde0 2023-10-19T12:43:36.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.908+0000 7f8a8cff9700 1 -- 172.21.15.46:0/1789637949 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8aa0099500 con 0x560c873bbde0 2023-10-19T12:43:36.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.908+0000 7f8abeecab80 10 client.15687 fetch_fsmap learned FSMap version 27 2023-10-19T12:43:36.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.908+0000 7f8abeecab80 1 -- 172.21.15.46:0/1789637949 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7f8aa41a0b10 con 0x560c873bbde0 2023-10-19T12:43:36.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.908+0000 7f8a8cff9700 1 -- 172.21.15.46:0/1789637949 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8a94004390 con 0x560c873bbde0 2023-10-19T12:43:36.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.908+0000 7f8a8cff9700 1 -- 172.21.15.46:0/1789637949 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f8aa007f070 con 0x560c873bbde0 2023-10-19T12:43:36.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.908+0000 7f8abeecab80 10 client.15687 fetch_fsmap finished waiting for FSMap version 27 2023-10-19T12:43:36.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.908+0000 7f8abeecab80 10 client.15687 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-19T12:43:36.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.908+0000 7f8abeecab80 20 client.15687 populate_metadata read hostname 'smithi046' 2023-10-19T12:43:36.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.908+0000 7f8abeecab80 1 --2- 172.21.15.46:0/1789637949 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x560c87426510 0x560c87428930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:43:36.923 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.908+0000 7f8abeecab80 4 client.15687 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-19T12:43:36.923 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.908+0000 7f8abeecab80 1 -- 172.21.15.46:0/1789637949 --> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x560c872fee50 con 0x560c87426510 2023-10-19T12:43:36.924 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.909+0000 7f8aa8b9a700 1 --2- 172.21.15.46:0/1789637949 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x560c87426510 0x560c87428930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:43:36.924 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.909+0000 7f8aa8b9a700 1 --2- 172.21.15.46:0/1789637949 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x560c87426510 0x560c87428930 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=674d7d4383817238 server_cookie=d6e6a84826cd2b62 in_seq=0 out_seq=0 2023-10-19T12:43:36.924 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.909+0000 7f8a8cff9700 10 client.15687 ms_handle_connect on v2:172.21.15.157:6838/552718978 2023-10-19T12:43:36.925 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.909+0000 7f8a8cff9700 1 -- 172.21.15.46:0/1789637949 <== mds.0 v2:172.21.15.157:6838/552718978 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x560c872fee50 con 0x560c87426510 2023-10-19T12:43:36.925 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.909+0000 7f8a8cff9700 10 client.15687 handle_command_reply: tid=0 2023-10-19T12:43:36.925 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.910+0000 7f8abeecab80 1 client.15687 shutdown 2023-10-19T12:43:36.925 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.910+0000 7f8abeecab80 1 -- 172.21.15.46:0/1789637949 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560c873bbde0 msgr2=0x560c873cc650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:36.925 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.910+0000 7f8abeecab80 1 --2- 172.21.15.46:0/1789637949 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560c873bbde0 0x560c873cc650 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f8aa00cab60 tx=0x7f8aa00ca780 comp rx=0 tx=0).stop 2023-10-19T12:43:36.926 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.910+0000 7f8abeecab80 1 -- 172.21.15.46:0/1789637949 shutdown_connections 2023-10-19T12:43:36.926 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.910+0000 7f8abeecab80 1 --2- 172.21.15.46:0/1789637949 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560c873bd440 0x560c873c9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:36.926 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.910+0000 7f8abeecab80 1 --2- 172.21.15.46:0/1789637949 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x560c87426510 0x560c87428930 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:36.926 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.910+0000 7f8abeecab80 1 --2- 172.21.15.46:0/1789637949 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560c873bbde0 0x560c873cc650 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:36.926 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.910+0000 7f8abeecab80 1 --2- 172.21.15.46:0/1789637949 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560c873bcae0 0x560c873c91e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:36.927 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.910+0000 7f8a8cff9700 0 client.15687 ms_handle_reset on v2:172.21.15.157:6838/552718978 2023-10-19T12:43:36.927 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.910+0000 7f8abeecab80 1 -- 172.21.15.46:0/1789637949 >> 172.21.15.46:0/1789637949 conn(0x560c87327720 msgr2=0x560c873adac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:36.927 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.910+0000 7f8abeecab80 1 -- 172.21.15.46:0/1789637949 shutdown_connections 2023-10-19T12:43:36.927 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.910+0000 7f8abeecab80 1 -- 172.21.15.46:0/1789637949 wait complete. 2023-10-19T12:43:36.927 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.910+0000 7f8abeecab80 20 client.15687 trim_cache size 0 max 16384 2023-10-19T12:43:36.928 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-10-19T12:43:36.928 INFO:teuthology.orchestra.run.smithi046.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-19T12:43:36.928 INFO:teuthology.orchestra.run.smithi046.stdout: "scrubs": { 2023-10-19T12:43:36.928 INFO:teuthology.orchestra.run.smithi046.stdout: "95aa1a7a-7908-4a60-87e1-d942b34d3027": { 2023-10-19T12:43:36.928 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2023-10-19T12:43:36.929 INFO:teuthology.orchestra.run.smithi046.stdout: "tag": "95aa1a7a-7908-4a60-87e1-d942b34d3027", 2023-10-19T12:43:36.929 INFO:teuthology.orchestra.run.smithi046.stdout: "options": "recursive,force" 2023-10-19T12:43:36.929 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:43:36.929 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:43:36.929 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-10-19T12:43:36.930 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.911+0000 7f8aab5ff700 1 -- 172.21.15.46:0/1263206950 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f8a900a1500 msgr2=0x7f8a900a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:36.930 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.911+0000 7f8aab5ff700 1 --2- 172.21.15.46:0/1263206950 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f8a900a1500 0x7f8a900a39c0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c009f90 tx=0x7f8a9c007420 comp rx=0 tx=0).stop 2023-10-19T12:43:36.930 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.911+0000 7f8aab5ff700 1 -- 172.21.15.46:0/1263206950 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8aa4101210 msgr2=0x7f8aa4198a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:43:36.931 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.911+0000 7f8aab5ff700 1 --2- 172.21.15.46:0/1263206950 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8aa4101210 0x7f8aa4198a30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8aa000e9c0 tx=0x7f8aa000ecd0 comp rx=0 tx=0).stop 2023-10-19T12:43:36.931 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.911+0000 7f8aab5ff700 1 -- 172.21.15.46:0/1263206950 shutdown_connections 2023-10-19T12:43:36.931 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.911+0000 7f8aab5ff700 1 --2- 172.21.15.46:0/1263206950 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f8a900a1500 0x7f8a900a39c0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:36.931 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.911+0000 7f8aab5ff700 1 --2- 172.21.15.46:0/1263206950 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8aa4106470 0x7f8aa419ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:36.931 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.911+0000 7f8aab5ff700 1 --2- 172.21.15.46:0/1263206950 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8aa4101210 0x7f8aa4198a30 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:36.932 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.911+0000 7f8aab5ff700 1 --2- 172.21.15.46:0/1263206950 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8aa4103b40 0x7f8aa4198f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:43:36.932 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.911+0000 7f8aab5ff700 1 -- 172.21.15.46:0/1263206950 >> 172.21.15.46:0/1263206950 conn(0x7f8aa40fac00 msgr2=0x7f8aa4100990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:43:36.932 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.911+0000 7f8aab5ff700 1 -- 172.21.15.46:0/1263206950 shutdown_connections 2023-10-19T12:43:36.932 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:43:36.911+0000 7f8aab5ff700 1 -- 172.21.15.46:0/1263206950 wait complete. 2023-10-19T12:43:36.933 INFO:tasks.cephfs.filesystem:scrub status for tag:95aa1a7a-7908-4a60-87e1-d942b34d3027 - {'path': '/', 'tag': '95aa1a7a-7908-4a60-87e1-d942b34d3027', 'options': 'recursive,force'} 2023-10-19T12:43:37.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:36 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/595951295' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-19T12:43:37.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:36 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/1582690290' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-19T12:43:37.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:36 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/595951295' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-19T12:43:37.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:36 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/1582690290' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-19T12:43:38.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:37 smithi157 ceph-mon[134109]: scrub queued for path: / 2023-10-19T12:43:38.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:37 smithi157 ceph-mon[134109]: scrub summary: idle+waiting paths [/] 2023-10-19T12:43:38.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:37 smithi157 ceph-mon[134109]: scrub summary: active paths [/] 2023-10-19T12:43:38.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:37 smithi157 ceph-mon[134109]: scrub summary: idle+waiting paths [/] 2023-10-19T12:43:38.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:37 smithi157 ceph-mon[134109]: pgmap v357: 129 pgs: 129 active+clean; 649 KiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2023-10-19T12:43:38.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:37 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:43:38.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:37 smithi195 ceph-mon[134493]: scrub queued for path: / 2023-10-19T12:43:38.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:37 smithi195 ceph-mon[134493]: scrub summary: idle+waiting paths [/] 2023-10-19T12:43:38.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:37 smithi195 ceph-mon[134493]: scrub summary: active paths [/] 2023-10-19T12:43:38.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:37 smithi195 ceph-mon[134493]: scrub summary: idle+waiting paths [/] 2023-10-19T12:43:38.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:37 smithi195 ceph-mon[134493]: pgmap v357: 129 pgs: 129 active+clean; 649 KiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2023-10-19T12:43:38.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:37 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:43:38.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:37 smithi046 ceph-mon[98509]: scrub queued for path: / 2023-10-19T12:43:38.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:37 smithi046 ceph-mon[98509]: scrub summary: idle+waiting paths [/] 2023-10-19T12:43:38.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:37 smithi046 ceph-mon[98509]: scrub summary: active paths [/] 2023-10-19T12:43:38.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:37 smithi046 ceph-mon[98509]: scrub summary: idle+waiting paths [/] 2023-10-19T12:43:38.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:37 smithi046 ceph-mon[98509]: pgmap v357: 129 pgs: 129 active+clean; 649 KiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2023-10-19T12:43:38.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:37 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:43:39.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:39 smithi157 ceph-mon[134109]: pgmap v358: 129 pgs: 129 active+clean; 649 KiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2023-10-19T12:43:39.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:39 smithi195 ceph-mon[134493]: pgmap v358: 129 pgs: 129 active+clean; 649 KiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2023-10-19T12:43:39.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:39 smithi046 ceph-mon[98509]: pgmap v358: 129 pgs: 129 active+clean; 649 KiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2023-10-19T12:43:40.338 DEBUG:teuthology.orchestra.run.smithi046:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo grep -i postgresql /etc/selinux/targeted/contexts/files/file_contexts.local' 2023-10-19T12:43:40.447 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/cephfs/postgres(/.*)? system_u:object_r:postgresql_db_t:s0 2023-10-19T12:43:40.452 DEBUG:teuthology.orchestra.run.smithi046:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo restorecon -R -v /tmp/cephfs/postgres' 2023-10-19T12:43:40.564 DEBUG:teuthology.orchestra.run.smithi046:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2023-10-19T12:43:40.666 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/cephfs/postgres/: 2023-10-19T12:43:40.666 INFO:teuthology.orchestra.run.smithi046.stdout:total 0 2023-10-19T12:43:40.667 INFO:teuthology.orchestra.run.smithi046.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Oct 19 12:43 . 2023-10-19T12:43:40.667 INFO:teuthology.orchestra.run.smithi046.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 1 Oct 19 12:43 .. 2023-10-19T12:43:40.667 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 data 2023-10-19T12:43:40.667 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:43:40.667 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/cephfs/postgres/data: 2023-10-19T12:43:40.668 INFO:teuthology.orchestra.run.smithi046.stdout:total 0 2023-10-19T12:43:40.668 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 . 2023-10-19T12:43:40.668 INFO:teuthology.orchestra.run.smithi046.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Oct 19 12:43 .. 2023-10-19T12:43:40.671 DEBUG:teuthology.orchestra.run.smithi046:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo mkdir -p /etc/systemd/system/postgresql.service.d/ && printf '"'"'[Service]\nEnvironment=PGDATA=/tmp/cephfs/postgres/data\nEnvironment=PGLOG=/tmp/cephfs/postgres/pgstartup.log\n'"'"' | sudo tee /etc/systemd/system/postgresql.service.d/env.conf' 2023-10-19T12:43:40.801 INFO:teuthology.orchestra.run.smithi046.stdout:[Service] 2023-10-19T12:43:40.802 INFO:teuthology.orchestra.run.smithi046.stdout:Environment=PGDATA=/tmp/cephfs/postgres/data 2023-10-19T12:43:40.802 INFO:teuthology.orchestra.run.smithi046.stdout:Environment=PGLOG=/tmp/cephfs/postgres/pgstartup.log 2023-10-19T12:43:40.808 DEBUG:teuthology.orchestra.run.smithi046:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- postgresql-setup --initdb' 2023-10-19T12:43:41.007 INFO:teuthology.orchestra.run.smithi046.stderr: * Initializing database in '/tmp/cephfs/postgres/data' 2023-10-19T12:43:41.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:41 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:43:41.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:41 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:43:41.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:41 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:43:41.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:41 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:43:41.730 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:41 smithi046 ceph-mon[98509]: pgmap v359: 129 pgs: 129 active+clean; 649 KiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2023-10-19T12:43:41.837 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:41 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:43:41.838 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:41 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:43:41.838 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:41 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:43:41.838 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:41 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:43:41.838 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:41 smithi157 ceph-mon[134109]: pgmap v359: 129 pgs: 129 active+clean; 649 KiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2023-10-19T12:43:41.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:41 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:43:41.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:41 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:43:41.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:41 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:43:41.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:41 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:43:41.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:41 smithi195 ceph-mon[134493]: pgmap v359: 129 pgs: 129 active+clean; 649 KiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2023-10-19T12:43:42.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:42 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:43:42.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:42 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:43:42.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:42 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:43:42.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:42 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:43:42.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:42 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:43:43.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:42 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:43:43.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:42 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:43:43.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:42 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:43:43.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:42 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:43:43.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:42 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:43:43.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:42 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:43:43.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:42 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:43:43.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:42 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:43:43.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:42 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:43:43.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:42 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:43:43.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:43 smithi046 ceph-mon[98509]: pgmap v360: 129 pgs: 129 active+clean; 8.7 MiB data, 334 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 697 KiB/s wr, 15 op/s 2023-10-19T12:43:44.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:43 smithi157 ceph-mon[134109]: pgmap v360: 129 pgs: 129 active+clean; 8.7 MiB data, 334 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 697 KiB/s wr, 15 op/s 2023-10-19T12:43:44.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:43 smithi195 ceph-mon[134493]: pgmap v360: 129 pgs: 129 active+clean; 8.7 MiB data, 334 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 697 KiB/s wr, 15 op/s 2023-10-19T12:43:46.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:45 smithi157 ceph-mon[134109]: pgmap v361: 129 pgs: 129 active+clean; 9.0 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 721 KiB/s wr, 13 op/s 2023-10-19T12:43:46.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:45 smithi195 ceph-mon[134493]: pgmap v361: 129 pgs: 129 active+clean; 9.0 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 721 KiB/s wr, 13 op/s 2023-10-19T12:43:46.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:45 smithi046 ceph-mon[98509]: pgmap v361: 129 pgs: 129 active+clean; 9.0 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 721 KiB/s wr, 13 op/s 2023-10-19T12:43:48.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:47 smithi157 ceph-mon[134109]: pgmap v362: 129 pgs: 129 active+clean; 19 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 1.6 MiB/s wr, 22 op/s 2023-10-19T12:43:48.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:47 smithi157 ceph-mon[134109]: scrub summary: idle 2023-10-19T12:43:48.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:47 smithi195 ceph-mon[134493]: pgmap v362: 129 pgs: 129 active+clean; 19 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 1.6 MiB/s wr, 22 op/s 2023-10-19T12:43:48.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:47 smithi195 ceph-mon[134493]: scrub summary: idle 2023-10-19T12:43:48.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:47 smithi046 ceph-mon[98509]: pgmap v362: 129 pgs: 129 active+clean; 19 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 1.6 MiB/s wr, 22 op/s 2023-10-19T12:43:48.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:47 smithi046 ceph-mon[98509]: scrub summary: idle 2023-10-19T12:43:48.871 INFO:teuthology.orchestra.run.smithi046.stderr: * Initialized, logs are in /var/lib/pgsql/initdb_postgresql.log 2023-10-19T12:43:48.877 DEBUG:teuthology.orchestra.run.smithi046:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2023-10-19T12:43:48.992 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/cephfs/postgres/: 2023-10-19T12:43:48.992 INFO:teuthology.orchestra.run.smithi046.stdout:total 0 2023-10-19T12:43:48.993 INFO:teuthology.orchestra.run.smithi046.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Oct 19 12:43 . 2023-10-19T12:43:48.993 INFO:teuthology.orchestra.run.smithi046.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 1 Oct 19 12:43 .. 2023-10-19T12:43:48.993 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Oct 19 12:43 data 2023-10-19T12:43:48.993 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:43:48.994 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/cephfs/postgres/data: 2023-10-19T12:43:48.994 INFO:teuthology.orchestra.run.smithi046.stdout:total 30 2023-10-19T12:43:48.994 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Oct 19 12:43 . 2023-10-19T12:43:48.994 INFO:teuthology.orchestra.run.smithi046.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Oct 19 12:43 .. 2023-10-19T12:43:48.995 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 19 12:43 base 2023-10-19T12:43:48.995 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 58 Oct 19 12:43 global 2023-10-19T12:43:48.995 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 log 2023-10-19T12:43:48.995 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 pg_commit_ts 2023-10-19T12:43:48.995 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 pg_dynshmem 2023-10-19T12:43:48.996 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 4269 Oct 19 12:43 pg_hba.conf 2023-10-19T12:43:48.996 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1636 Oct 19 12:43 pg_ident.conf 2023-10-19T12:43:48.996 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 19 12:43 pg_logical 2023-10-19T12:43:48.996 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Oct 19 12:43 pg_multixact 2023-10-19T12:43:48.996 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Oct 19 12:43 pg_notify 2023-10-19T12:43:48.996 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 pg_replslot 2023-10-19T12:43:48.997 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 pg_serial 2023-10-19T12:43:48.997 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 pg_snapshots 2023-10-19T12:43:48.997 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 pg_stat 2023-10-19T12:43:48.997 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 pg_stat_tmp 2023-10-19T12:43:48.997 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Oct 19 12:43 pg_subtrans 2023-10-19T12:43:48.998 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 pg_tblspc 2023-10-19T12:43:48.998 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 pg_twophase 2023-10-19T12:43:48.998 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 19 12:43 PG_VERSION 2023-10-19T12:43:48.998 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Oct 19 12:43 pg_wal 2023-10-19T12:43:48.998 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Oct 19 12:43 pg_xact 2023-10-19T12:43:48.998 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 88 Oct 19 12:43 postgresql.auto.conf 2023-10-19T12:43:48.999 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 22989 Oct 19 12:43 postgresql.conf 2023-10-19T12:43:48.999 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:43:48.999 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/cephfs/postgres/data/base: 2023-10-19T12:43:48.999 INFO:teuthology.orchestra.run.smithi046.stdout:total 0 2023-10-19T12:43:48.999 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 19 12:43 . 2023-10-19T12:43:48.999 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Oct 19 12:43 .. 2023-10-19T12:43:49.000 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 293 Oct 19 12:43 1 2023-10-19T12:43:49.000 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 293 Oct 19 12:43 12346 2023-10-19T12:43:49.000 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 293 Oct 19 12:43 12347 2023-10-19T12:43:49.000 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:43:49.000 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/cephfs/postgres/data/base/1: 2023-10-19T12:43:49.000 INFO:teuthology.orchestra.run.smithi046.stdout:total 7193 2023-10-19T12:43:49.001 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 293 Oct 19 12:43 . 2023-10-19T12:43:49.001 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 19 12:43 .. 2023-10-19T12:43:49.001 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 112 2023-10-19T12:43:49.001 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 113 2023-10-19T12:43:49.001 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Oct 19 12:43 12182 2023-10-19T12:43:49.001 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 12182_fsm 2023-10-19T12:43:49.002 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12182_vm 2023-10-19T12:43:49.002 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 12184 2023-10-19T12:43:49.002 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12186 2023-10-19T12:43:49.002 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12187 2023-10-19T12:43:49.002 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 12187_fsm 2023-10-19T12:43:49.003 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12187_vm 2023-10-19T12:43:49.003 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 12189 2023-10-19T12:43:49.003 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12191 2023-10-19T12:43:49.003 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12192 2023-10-19T12:43:49.003 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 12192_fsm 2023-10-19T12:43:49.004 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12192_vm 2023-10-19T12:43:49.004 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 12194 2023-10-19T12:43:49.004 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12196 2023-10-19T12:43:49.004 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12197 2023-10-19T12:43:49.004 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 12197_fsm 2023-10-19T12:43:49.004 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12197_vm 2023-10-19T12:43:49.005 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 12199 2023-10-19T12:43:49.005 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12201 2023-10-19T12:43:49.005 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12202 2023-10-19T12:43:49.005 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 12202_fsm 2023-10-19T12:43:49.005 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12202_vm 2023-10-19T12:43:49.005 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 12204 2023-10-19T12:43:49.006 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12206 2023-10-19T12:43:49.006 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12207 2023-10-19T12:43:49.006 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 12207_fsm 2023-10-19T12:43:49.006 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12207_vm 2023-10-19T12:43:49.006 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 12209 2023-10-19T12:43:49.007 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12211 2023-10-19T12:43:49.007 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 12212 2023-10-19T12:43:49.007 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 12214 2023-10-19T12:43:49.007 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12216 2023-10-19T12:43:49.007 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 73728 Oct 19 12:43 1247 2023-10-19T12:43:49.008 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 1247_fsm 2023-10-19T12:43:49.008 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 1247_vm 2023-10-19T12:43:49.008 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 393216 Oct 19 12:43 1249 2023-10-19T12:43:49.008 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 1249_fsm 2023-10-19T12:43:49.008 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 1249_vm 2023-10-19T12:43:49.009 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 606208 Oct 19 12:43 1255 2023-10-19T12:43:49.009 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 1255_fsm 2023-10-19T12:43:49.009 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 1255_vm 2023-10-19T12:43:49.009 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Oct 19 12:43 1259 2023-10-19T12:43:49.009 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 1259_fsm 2023-10-19T12:43:49.009 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 1259_vm 2023-10-19T12:43:49.010 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 1417 2023-10-19T12:43:49.010 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 1417_vm 2023-10-19T12:43:49.010 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 1418 2023-10-19T12:43:49.010 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 1418_vm 2023-10-19T12:43:49.011 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 174 2023-10-19T12:43:49.011 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 175 2023-10-19T12:43:49.011 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2187 2023-10-19T12:43:49.011 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2224 2023-10-19T12:43:49.011 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2224_vm 2023-10-19T12:43:49.011 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2328 2023-10-19T12:43:49.012 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2328_vm 2023-10-19T12:43:49.012 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2336 2023-10-19T12:43:49.012 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2336_vm 2023-10-19T12:43:49.012 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2337 2023-10-19T12:43:49.013 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2600 2023-10-19T12:43:49.013 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2600_fsm 2023-10-19T12:43:49.013 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2600_vm 2023-10-19T12:43:49.013 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2601 2023-10-19T12:43:49.013 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2601_fsm 2023-10-19T12:43:49.014 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2601_vm 2023-10-19T12:43:49.014 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 19 12:43 2602 2023-10-19T12:43:49.014 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2602_fsm 2023-10-19T12:43:49.014 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2602_vm 2023-10-19T12:43:49.015 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 19 12:43 2603 2023-10-19T12:43:49.015 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2603_fsm 2023-10-19T12:43:49.015 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2603_vm 2023-10-19T12:43:49.015 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2604 2023-10-19T12:43:49.015 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2604_vm 2023-10-19T12:43:49.015 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2605 2023-10-19T12:43:49.016 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2605_fsm 2023-10-19T12:43:49.016 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2605_vm 2023-10-19T12:43:49.016 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2606 2023-10-19T12:43:49.016 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2606_fsm 2023-10-19T12:43:49.016 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2606_vm 2023-10-19T12:43:49.016 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2607 2023-10-19T12:43:49.017 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2607_fsm 2023-10-19T12:43:49.017 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2607_vm 2023-10-19T12:43:49.017 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 442368 Oct 19 12:43 2608 2023-10-19T12:43:49.017 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2608_fsm 2023-10-19T12:43:49.017 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2608_vm 2023-10-19T12:43:49.018 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 286720 Oct 19 12:43 2609 2023-10-19T12:43:49.018 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2609_fsm 2023-10-19T12:43:49.018 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2609_vm 2023-10-19T12:43:49.018 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2610 2023-10-19T12:43:49.018 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2610_fsm 2023-10-19T12:43:49.019 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2610_vm 2023-10-19T12:43:49.019 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2611 2023-10-19T12:43:49.019 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2611_vm 2023-10-19T12:43:49.019 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2612 2023-10-19T12:43:49.020 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2612_fsm 2023-10-19T12:43:49.020 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2612_vm 2023-10-19T12:43:49.020 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2613 2023-10-19T12:43:49.020 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2613_vm 2023-10-19T12:43:49.020 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2615 2023-10-19T12:43:49.020 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2615_fsm 2023-10-19T12:43:49.021 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2615_vm 2023-10-19T12:43:49.021 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2616 2023-10-19T12:43:49.021 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2616_fsm 2023-10-19T12:43:49.021 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2616_vm 2023-10-19T12:43:49.021 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Oct 19 12:43 2617 2023-10-19T12:43:49.022 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2617_fsm 2023-10-19T12:43:49.022 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2617_vm 2023-10-19T12:43:49.022 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Oct 19 12:43 2618 2023-10-19T12:43:49.022 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2618_fsm 2023-10-19T12:43:49.022 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2618_vm 2023-10-19T12:43:49.023 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Oct 19 12:43 2619 2023-10-19T12:43:49.023 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2619_fsm 2023-10-19T12:43:49.023 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2619_vm 2023-10-19T12:43:49.023 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2620 2023-10-19T12:43:49.024 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2620_vm 2023-10-19T12:43:49.024 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2650 2023-10-19T12:43:49.024 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2651 2023-10-19T12:43:49.025 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2652 2023-10-19T12:43:49.025 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 19 12:43 2653 2023-10-19T12:43:49.025 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 19 12:43 2654 2023-10-19T12:43:49.026 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 19 12:43 2655 2023-10-19T12:43:49.026 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2656 2023-10-19T12:43:49.026 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2657 2023-10-19T12:43:49.026 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Oct 19 12:43 2658 2023-10-19T12:43:49.027 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Oct 19 12:43 2659 2023-10-19T12:43:49.027 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2660 2023-10-19T12:43:49.027 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2661 2023-10-19T12:43:49.028 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 19 12:43 2662 2023-10-19T12:43:49.028 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 19 12:43 2663 2023-10-19T12:43:49.028 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2664 2023-10-19T12:43:49.029 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2665 2023-10-19T12:43:49.029 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2666 2023-10-19T12:43:49.029 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2667 2023-10-19T12:43:49.029 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2668 2023-10-19T12:43:49.029 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2669 2023-10-19T12:43:49.030 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2670 2023-10-19T12:43:49.030 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 319488 Oct 19 12:43 2673 2023-10-19T12:43:49.030 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 376832 Oct 19 12:43 2674 2023-10-19T12:43:49.030 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 180224 Oct 19 12:43 2675 2023-10-19T12:43:49.030 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2678 2023-10-19T12:43:49.031 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2679 2023-10-19T12:43:49.031 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2680 2023-10-19T12:43:49.031 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2681 2023-10-19T12:43:49.031 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2682 2023-10-19T12:43:49.031 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2683 2023-10-19T12:43:49.031 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2684 2023-10-19T12:43:49.031 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2685 2023-10-19T12:43:49.032 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2686 2023-10-19T12:43:49.032 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2687 2023-10-19T12:43:49.032 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 19 12:43 2688 2023-10-19T12:43:49.032 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 19 12:43 2689 2023-10-19T12:43:49.032 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Oct 19 12:43 2690 2023-10-19T12:43:49.033 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 270336 Oct 19 12:43 2691 2023-10-19T12:43:49.033 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2692 2023-10-19T12:43:49.033 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2693 2023-10-19T12:43:49.033 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2696 2023-10-19T12:43:49.033 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2699 2023-10-19T12:43:49.034 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2701 2023-10-19T12:43:49.034 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2702 2023-10-19T12:43:49.034 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2703 2023-10-19T12:43:49.034 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 19 12:43 2704 2023-10-19T12:43:49.034 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2753 2023-10-19T12:43:49.035 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2753_fsm 2023-10-19T12:43:49.035 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2753_vm 2023-10-19T12:43:49.035 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2754 2023-10-19T12:43:49.035 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2755 2023-10-19T12:43:49.035 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 19 12:43 2756 2023-10-19T12:43:49.035 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 19 12:43 2757 2023-10-19T12:43:49.036 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2830 2023-10-19T12:43:49.036 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2830_vm 2023-10-19T12:43:49.036 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2831 2023-10-19T12:43:49.036 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2832 2023-10-19T12:43:49.036 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2832_vm 2023-10-19T12:43:49.036 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2833 2023-10-19T12:43:49.037 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2834 2023-10-19T12:43:49.037 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2834_vm 2023-10-19T12:43:49.037 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2835 2023-10-19T12:43:49.037 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2836 2023-10-19T12:43:49.037 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2836_vm 2023-10-19T12:43:49.037 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2837 2023-10-19T12:43:49.038 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 417792 Oct 19 12:43 2838 2023-10-19T12:43:49.038 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2838_fsm 2023-10-19T12:43:49.038 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2838_vm 2023-10-19T12:43:49.038 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2839 2023-10-19T12:43:49.038 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2840 2023-10-19T12:43:49.038 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2840_fsm 2023-10-19T12:43:49.039 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2840_vm 2023-10-19T12:43:49.039 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2841 2023-10-19T12:43:49.039 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2995 2023-10-19T12:43:49.039 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2995_vm 2023-10-19T12:43:49.039 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2996 2023-10-19T12:43:49.040 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3079 2023-10-19T12:43:49.040 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 3079_fsm 2023-10-19T12:43:49.040 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3079_vm 2023-10-19T12:43:49.040 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3080 2023-10-19T12:43:49.040 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3081 2023-10-19T12:43:49.040 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3085 2023-10-19T12:43:49.040 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3118 2023-10-19T12:43:49.041 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3118_vm 2023-10-19T12:43:49.041 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3119 2023-10-19T12:43:49.041 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3164 2023-10-19T12:43:49.041 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3256 2023-10-19T12:43:49.041 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3256_vm 2023-10-19T12:43:49.041 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3257 2023-10-19T12:43:49.042 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3258 2023-10-19T12:43:49.042 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3350 2023-10-19T12:43:49.042 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3350_vm 2023-10-19T12:43:49.042 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3351 2023-10-19T12:43:49.042 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3379 2023-10-19T12:43:49.043 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3380 2023-10-19T12:43:49.043 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3381 2023-10-19T12:43:49.043 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3381_vm 2023-10-19T12:43:49.043 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3394 2023-10-19T12:43:49.043 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 3394_fsm 2023-10-19T12:43:49.043 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3394_vm 2023-10-19T12:43:49.044 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3395 2023-10-19T12:43:49.044 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3439 2023-10-19T12:43:49.044 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3439_vm 2023-10-19T12:43:49.044 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3440 2023-10-19T12:43:49.044 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 19 12:43 3455 2023-10-19T12:43:49.045 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3456 2023-10-19T12:43:49.045 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 3456_fsm 2023-10-19T12:43:49.045 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3456_vm 2023-10-19T12:43:49.045 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3466 2023-10-19T12:43:49.045 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3466_vm 2023-10-19T12:43:49.046 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3467 2023-10-19T12:43:49.046 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3468 2023-10-19T12:43:49.046 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3501 2023-10-19T12:43:49.046 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3501_vm 2023-10-19T12:43:49.046 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3502 2023-10-19T12:43:49.047 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3503 2023-10-19T12:43:49.047 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3534 2023-10-19T12:43:49.047 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3541 2023-10-19T12:43:49.047 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 3541_fsm 2023-10-19T12:43:49.047 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3541_vm 2023-10-19T12:43:49.047 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3542 2023-10-19T12:43:49.048 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3574 2023-10-19T12:43:49.048 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3575 2023-10-19T12:43:49.048 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3576 2023-10-19T12:43:49.048 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3576_vm 2023-10-19T12:43:49.048 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3596 2023-10-19T12:43:49.048 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3596_vm 2023-10-19T12:43:49.049 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3597 2023-10-19T12:43:49.049 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3598 2023-10-19T12:43:49.049 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3598_vm 2023-10-19T12:43:49.049 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3599 2023-10-19T12:43:49.049 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3600 2023-10-19T12:43:49.049 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 3600_fsm 2023-10-19T12:43:49.050 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3600_vm 2023-10-19T12:43:49.050 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3601 2023-10-19T12:43:49.050 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 3601_fsm 2023-10-19T12:43:49.050 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3601_vm 2023-10-19T12:43:49.050 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3602 2023-10-19T12:43:49.050 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 3602_fsm 2023-10-19T12:43:49.051 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3602_vm 2023-10-19T12:43:49.051 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3603 2023-10-19T12:43:49.051 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 3603_fsm 2023-10-19T12:43:49.051 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3603_vm 2023-10-19T12:43:49.051 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3604 2023-10-19T12:43:49.052 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3605 2023-10-19T12:43:49.052 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3606 2023-10-19T12:43:49.054 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3607 2023-10-19T12:43:49.055 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3608 2023-10-19T12:43:49.055 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 19 12:43 3609 2023-10-19T12:43:49.055 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3712 2023-10-19T12:43:49.056 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3764 2023-10-19T12:43:49.056 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 3764_fsm 2023-10-19T12:43:49.056 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3764_vm 2023-10-19T12:43:49.057 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3766 2023-10-19T12:43:49.057 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3767 2023-10-19T12:43:49.057 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3997 2023-10-19T12:43:49.058 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 5002 2023-10-19T12:43:49.058 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 548 2023-10-19T12:43:49.058 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 549 2023-10-19T12:43:49.059 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 6102 2023-10-19T12:43:49.059 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 6102_vm 2023-10-19T12:43:49.059 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 6104 2023-10-19T12:43:49.060 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 6104_vm 2023-10-19T12:43:49.060 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 6106 2023-10-19T12:43:49.060 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 6106_vm 2023-10-19T12:43:49.061 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 6110 2023-10-19T12:43:49.061 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 6111 2023-10-19T12:43:49.061 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 6112 2023-10-19T12:43:49.062 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 6113 2023-10-19T12:43:49.062 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 6117 2023-10-19T12:43:49.062 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 826 2023-10-19T12:43:49.063 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 826_vm 2023-10-19T12:43:49.063 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 827 2023-10-19T12:43:49.063 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 828 2023-10-19T12:43:49.063 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Oct 19 12:43 pg_filenode.map 2023-10-19T12:43:49.064 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 19 12:43 PG_VERSION 2023-10-19T12:43:49.064 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:43:49.064 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/cephfs/postgres/data/base/12346: 2023-10-19T12:43:49.064 INFO:teuthology.orchestra.run.smithi046.stdout:total 7193 2023-10-19T12:43:49.065 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 293 Oct 19 12:43 . 2023-10-19T12:43:49.065 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 19 12:43 .. 2023-10-19T12:43:49.065 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 112 2023-10-19T12:43:49.065 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 113 2023-10-19T12:43:49.065 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Oct 19 12:43 12182 2023-10-19T12:43:49.066 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 12182_fsm 2023-10-19T12:43:49.066 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12182_vm 2023-10-19T12:43:49.066 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 12184 2023-10-19T12:43:49.066 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12186 2023-10-19T12:43:49.066 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12187 2023-10-19T12:43:49.067 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 12187_fsm 2023-10-19T12:43:49.067 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12187_vm 2023-10-19T12:43:49.067 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 12189 2023-10-19T12:43:49.067 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12191 2023-10-19T12:43:49.067 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12192 2023-10-19T12:43:49.067 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 12192_fsm 2023-10-19T12:43:49.068 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12192_vm 2023-10-19T12:43:49.068 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 12194 2023-10-19T12:43:49.068 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12196 2023-10-19T12:43:49.068 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12197 2023-10-19T12:43:49.068 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 12197_fsm 2023-10-19T12:43:49.068 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12197_vm 2023-10-19T12:43:49.069 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 12199 2023-10-19T12:43:49.069 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12201 2023-10-19T12:43:49.069 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12202 2023-10-19T12:43:49.069 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 12202_fsm 2023-10-19T12:43:49.069 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12202_vm 2023-10-19T12:43:49.070 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 12204 2023-10-19T12:43:49.070 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12206 2023-10-19T12:43:49.070 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12207 2023-10-19T12:43:49.070 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 12207_fsm 2023-10-19T12:43:49.070 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12207_vm 2023-10-19T12:43:49.071 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 12209 2023-10-19T12:43:49.071 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12211 2023-10-19T12:43:49.071 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 12212 2023-10-19T12:43:49.071 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 12214 2023-10-19T12:43:49.071 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12216 2023-10-19T12:43:49.072 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 73728 Oct 19 12:43 1247 2023-10-19T12:43:49.072 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 1247_fsm 2023-10-19T12:43:49.072 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 1247_vm 2023-10-19T12:43:49.072 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 393216 Oct 19 12:43 1249 2023-10-19T12:43:49.072 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 1249_fsm 2023-10-19T12:43:49.072 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 1249_vm 2023-10-19T12:43:49.073 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 606208 Oct 19 12:43 1255 2023-10-19T12:43:49.073 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 1255_fsm 2023-10-19T12:43:49.073 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 1255_vm 2023-10-19T12:43:49.073 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Oct 19 12:43 1259 2023-10-19T12:43:49.073 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 1259_fsm 2023-10-19T12:43:49.073 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 1259_vm 2023-10-19T12:43:49.074 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 1417 2023-10-19T12:43:49.074 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 1417_vm 2023-10-19T12:43:49.074 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 1418 2023-10-19T12:43:49.074 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 1418_vm 2023-10-19T12:43:49.074 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 174 2023-10-19T12:43:49.075 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 175 2023-10-19T12:43:49.075 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2187 2023-10-19T12:43:49.075 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2224 2023-10-19T12:43:49.075 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2224_vm 2023-10-19T12:43:49.075 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2328 2023-10-19T12:43:49.076 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2328_vm 2023-10-19T12:43:49.076 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2336 2023-10-19T12:43:49.076 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2336_vm 2023-10-19T12:43:49.076 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2337 2023-10-19T12:43:49.077 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2600 2023-10-19T12:43:49.077 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2600_fsm 2023-10-19T12:43:49.077 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2600_vm 2023-10-19T12:43:49.077 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2601 2023-10-19T12:43:49.077 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2601_fsm 2023-10-19T12:43:49.078 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2601_vm 2023-10-19T12:43:49.078 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 19 12:43 2602 2023-10-19T12:43:49.078 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2602_fsm 2023-10-19T12:43:49.078 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2602_vm 2023-10-19T12:43:49.078 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 19 12:43 2603 2023-10-19T12:43:49.079 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2603_fsm 2023-10-19T12:43:49.079 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2603_vm 2023-10-19T12:43:49.079 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2604 2023-10-19T12:43:49.079 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2604_vm 2023-10-19T12:43:49.079 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2605 2023-10-19T12:43:49.079 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2605_fsm 2023-10-19T12:43:49.080 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2605_vm 2023-10-19T12:43:49.080 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2606 2023-10-19T12:43:49.080 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2606_fsm 2023-10-19T12:43:49.080 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2606_vm 2023-10-19T12:43:49.080 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2607 2023-10-19T12:43:49.080 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2607_fsm 2023-10-19T12:43:49.081 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2607_vm 2023-10-19T12:43:49.081 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 442368 Oct 19 12:43 2608 2023-10-19T12:43:49.081 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2608_fsm 2023-10-19T12:43:49.081 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2608_vm 2023-10-19T12:43:49.081 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 286720 Oct 19 12:43 2609 2023-10-19T12:43:49.082 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2609_fsm 2023-10-19T12:43:49.082 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2609_vm 2023-10-19T12:43:49.082 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2610 2023-10-19T12:43:49.082 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2610_fsm 2023-10-19T12:43:49.082 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2610_vm 2023-10-19T12:43:49.083 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2611 2023-10-19T12:43:49.083 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2611_vm 2023-10-19T12:43:49.083 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2612 2023-10-19T12:43:49.083 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2612_fsm 2023-10-19T12:43:49.083 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2612_vm 2023-10-19T12:43:49.083 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2613 2023-10-19T12:43:49.084 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2613_vm 2023-10-19T12:43:49.084 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2615 2023-10-19T12:43:49.084 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2615_fsm 2023-10-19T12:43:49.084 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2615_vm 2023-10-19T12:43:49.084 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2616 2023-10-19T12:43:49.084 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2616_fsm 2023-10-19T12:43:49.085 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2616_vm 2023-10-19T12:43:49.085 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Oct 19 12:43 2617 2023-10-19T12:43:49.085 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2617_fsm 2023-10-19T12:43:49.085 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2617_vm 2023-10-19T12:43:49.085 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Oct 19 12:43 2618 2023-10-19T12:43:49.086 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2618_fsm 2023-10-19T12:43:49.086 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2618_vm 2023-10-19T12:43:49.086 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Oct 19 12:43 2619 2023-10-19T12:43:49.086 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2619_fsm 2023-10-19T12:43:49.086 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2619_vm 2023-10-19T12:43:49.087 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2620 2023-10-19T12:43:49.087 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2620_vm 2023-10-19T12:43:49.087 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2650 2023-10-19T12:43:49.087 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2651 2023-10-19T12:43:49.087 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2652 2023-10-19T12:43:49.088 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 19 12:43 2653 2023-10-19T12:43:49.088 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 19 12:43 2654 2023-10-19T12:43:49.088 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 19 12:43 2655 2023-10-19T12:43:49.088 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2656 2023-10-19T12:43:49.088 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2657 2023-10-19T12:43:49.089 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Oct 19 12:43 2658 2023-10-19T12:43:49.089 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Oct 19 12:43 2659 2023-10-19T12:43:49.089 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2660 2023-10-19T12:43:49.089 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2661 2023-10-19T12:43:49.089 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 19 12:43 2662 2023-10-19T12:43:49.090 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 19 12:43 2663 2023-10-19T12:43:49.090 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2664 2023-10-19T12:43:49.090 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2665 2023-10-19T12:43:49.090 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2666 2023-10-19T12:43:49.090 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2667 2023-10-19T12:43:49.090 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2668 2023-10-19T12:43:49.091 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2669 2023-10-19T12:43:49.091 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2670 2023-10-19T12:43:49.091 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 319488 Oct 19 12:43 2673 2023-10-19T12:43:49.091 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 376832 Oct 19 12:43 2674 2023-10-19T12:43:49.091 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 180224 Oct 19 12:43 2675 2023-10-19T12:43:49.092 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2678 2023-10-19T12:43:49.092 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2679 2023-10-19T12:43:49.092 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2680 2023-10-19T12:43:49.092 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2681 2023-10-19T12:43:49.092 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2682 2023-10-19T12:43:49.092 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2683 2023-10-19T12:43:49.093 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2684 2023-10-19T12:43:49.093 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2685 2023-10-19T12:43:49.093 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2686 2023-10-19T12:43:49.093 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2687 2023-10-19T12:43:49.094 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 19 12:43 2688 2023-10-19T12:43:49.094 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 19 12:43 2689 2023-10-19T12:43:49.094 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Oct 19 12:43 2690 2023-10-19T12:43:49.094 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 270336 Oct 19 12:43 2691 2023-10-19T12:43:49.094 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2692 2023-10-19T12:43:49.095 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2693 2023-10-19T12:43:49.095 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2696 2023-10-19T12:43:49.095 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2699 2023-10-19T12:43:49.095 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2701 2023-10-19T12:43:49.095 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2702 2023-10-19T12:43:49.096 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2703 2023-10-19T12:43:49.096 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 19 12:43 2704 2023-10-19T12:43:49.096 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2753 2023-10-19T12:43:49.096 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2753_fsm 2023-10-19T12:43:49.096 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2753_vm 2023-10-19T12:43:49.097 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2754 2023-10-19T12:43:49.097 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2755 2023-10-19T12:43:49.097 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 19 12:43 2756 2023-10-19T12:43:49.097 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 19 12:43 2757 2023-10-19T12:43:49.097 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2830 2023-10-19T12:43:49.098 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2830_vm 2023-10-19T12:43:49.098 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2831 2023-10-19T12:43:49.098 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2832 2023-10-19T12:43:49.098 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2832_vm 2023-10-19T12:43:49.098 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2833 2023-10-19T12:43:49.099 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2834 2023-10-19T12:43:49.099 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2834_vm 2023-10-19T12:43:49.099 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2835 2023-10-19T12:43:49.099 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2836 2023-10-19T12:43:49.099 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2836_vm 2023-10-19T12:43:49.099 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2837 2023-10-19T12:43:49.100 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 417792 Oct 19 12:43 2838 2023-10-19T12:43:49.100 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2838_fsm 2023-10-19T12:43:49.100 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2838_vm 2023-10-19T12:43:49.100 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2839 2023-10-19T12:43:49.100 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2840 2023-10-19T12:43:49.101 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2840_fsm 2023-10-19T12:43:49.101 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2840_vm 2023-10-19T12:43:49.101 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2841 2023-10-19T12:43:49.101 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2995 2023-10-19T12:43:49.101 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2995_vm 2023-10-19T12:43:49.101 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2996 2023-10-19T12:43:49.102 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3079 2023-10-19T12:43:49.102 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 3079_fsm 2023-10-19T12:43:49.102 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3079_vm 2023-10-19T12:43:49.102 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3080 2023-10-19T12:43:49.102 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3081 2023-10-19T12:43:49.103 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3085 2023-10-19T12:43:49.103 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3118 2023-10-19T12:43:49.103 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3118_vm 2023-10-19T12:43:49.103 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3119 2023-10-19T12:43:49.103 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3164 2023-10-19T12:43:49.104 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3256 2023-10-19T12:43:49.104 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3256_vm 2023-10-19T12:43:49.104 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3257 2023-10-19T12:43:49.105 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3258 2023-10-19T12:43:49.105 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3350 2023-10-19T12:43:49.105 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3350_vm 2023-10-19T12:43:49.105 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3351 2023-10-19T12:43:49.105 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3379 2023-10-19T12:43:49.106 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3380 2023-10-19T12:43:49.106 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3381 2023-10-19T12:43:49.106 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3381_vm 2023-10-19T12:43:49.106 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3394 2023-10-19T12:43:49.106 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 3394_fsm 2023-10-19T12:43:49.107 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3394_vm 2023-10-19T12:43:49.107 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3395 2023-10-19T12:43:49.107 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3439 2023-10-19T12:43:49.107 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3439_vm 2023-10-19T12:43:49.107 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3440 2023-10-19T12:43:49.108 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 19 12:43 3455 2023-10-19T12:43:49.108 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3456 2023-10-19T12:43:49.108 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 3456_fsm 2023-10-19T12:43:49.108 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3456_vm 2023-10-19T12:43:49.108 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3466 2023-10-19T12:43:49.108 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3466_vm 2023-10-19T12:43:49.109 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3467 2023-10-19T12:43:49.109 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3468 2023-10-19T12:43:49.109 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3501 2023-10-19T12:43:49.109 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3501_vm 2023-10-19T12:43:49.109 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3502 2023-10-19T12:43:49.110 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3503 2023-10-19T12:43:49.110 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3534 2023-10-19T12:43:49.110 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3541 2023-10-19T12:43:49.110 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 3541_fsm 2023-10-19T12:43:49.110 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3541_vm 2023-10-19T12:43:49.111 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3542 2023-10-19T12:43:49.111 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3574 2023-10-19T12:43:49.111 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3575 2023-10-19T12:43:49.111 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3576 2023-10-19T12:43:49.111 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3576_vm 2023-10-19T12:43:49.111 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3596 2023-10-19T12:43:49.112 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3596_vm 2023-10-19T12:43:49.112 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3597 2023-10-19T12:43:49.112 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3598 2023-10-19T12:43:49.112 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3598_vm 2023-10-19T12:43:49.112 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3599 2023-10-19T12:43:49.112 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3600 2023-10-19T12:43:49.113 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 3600_fsm 2023-10-19T12:43:49.113 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3600_vm 2023-10-19T12:43:49.113 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3601 2023-10-19T12:43:49.113 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 3601_fsm 2023-10-19T12:43:49.113 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3601_vm 2023-10-19T12:43:49.114 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3602 2023-10-19T12:43:49.114 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 3602_fsm 2023-10-19T12:43:49.114 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3602_vm 2023-10-19T12:43:49.114 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3603 2023-10-19T12:43:49.114 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 3603_fsm 2023-10-19T12:43:49.115 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3603_vm 2023-10-19T12:43:49.115 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3604 2023-10-19T12:43:49.115 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3605 2023-10-19T12:43:49.115 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3606 2023-10-19T12:43:49.115 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3607 2023-10-19T12:43:49.116 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3608 2023-10-19T12:43:49.116 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 19 12:43 3609 2023-10-19T12:43:49.116 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3712 2023-10-19T12:43:49.116 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3764 2023-10-19T12:43:49.116 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 3764_fsm 2023-10-19T12:43:49.117 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3764_vm 2023-10-19T12:43:49.117 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3766 2023-10-19T12:43:49.117 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3767 2023-10-19T12:43:49.117 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3997 2023-10-19T12:43:49.117 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 5002 2023-10-19T12:43:49.117 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 548 2023-10-19T12:43:49.118 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 549 2023-10-19T12:43:49.118 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 6102 2023-10-19T12:43:49.118 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 6102_vm 2023-10-19T12:43:49.118 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 6104 2023-10-19T12:43:49.119 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 6104_vm 2023-10-19T12:43:49.119 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 6106 2023-10-19T12:43:49.119 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 6106_vm 2023-10-19T12:43:49.120 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 6110 2023-10-19T12:43:49.120 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 6111 2023-10-19T12:43:49.120 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 6112 2023-10-19T12:43:49.120 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 6113 2023-10-19T12:43:49.120 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 6117 2023-10-19T12:43:49.121 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 826 2023-10-19T12:43:49.121 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 826_vm 2023-10-19T12:43:49.121 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 827 2023-10-19T12:43:49.121 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 828 2023-10-19T12:43:49.121 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Oct 19 12:43 pg_filenode.map 2023-10-19T12:43:49.122 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 19 12:43 PG_VERSION 2023-10-19T12:43:49.122 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:43:49.122 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/cephfs/postgres/data/base/12347: 2023-10-19T12:43:49.122 INFO:teuthology.orchestra.run.smithi046.stdout:total 7193 2023-10-19T12:43:49.122 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 293 Oct 19 12:43 . 2023-10-19T12:43:49.123 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 19 12:43 .. 2023-10-19T12:43:49.123 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 112 2023-10-19T12:43:49.123 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 113 2023-10-19T12:43:49.123 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Oct 19 12:43 12182 2023-10-19T12:43:49.123 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 12182_fsm 2023-10-19T12:43:49.123 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12182_vm 2023-10-19T12:43:49.124 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 12184 2023-10-19T12:43:49.124 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12186 2023-10-19T12:43:49.124 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12187 2023-10-19T12:43:49.124 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 12187_fsm 2023-10-19T12:43:49.124 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12187_vm 2023-10-19T12:43:49.125 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 12189 2023-10-19T12:43:49.125 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12191 2023-10-19T12:43:49.125 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12192 2023-10-19T12:43:49.125 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 12192_fsm 2023-10-19T12:43:49.125 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12192_vm 2023-10-19T12:43:49.125 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 12194 2023-10-19T12:43:49.126 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12196 2023-10-19T12:43:49.126 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12197 2023-10-19T12:43:49.126 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 12197_fsm 2023-10-19T12:43:49.126 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12197_vm 2023-10-19T12:43:49.126 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 12199 2023-10-19T12:43:49.127 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12201 2023-10-19T12:43:49.127 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12202 2023-10-19T12:43:49.127 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 12202_fsm 2023-10-19T12:43:49.127 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12202_vm 2023-10-19T12:43:49.127 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 12204 2023-10-19T12:43:49.127 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12206 2023-10-19T12:43:49.128 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12207 2023-10-19T12:43:49.128 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 12207_fsm 2023-10-19T12:43:49.128 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12207_vm 2023-10-19T12:43:49.128 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 12209 2023-10-19T12:43:49.128 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12211 2023-10-19T12:43:49.129 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 12212 2023-10-19T12:43:49.129 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 12214 2023-10-19T12:43:49.129 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12216 2023-10-19T12:43:49.129 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 73728 Oct 19 12:43 1247 2023-10-19T12:43:49.129 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 1247_fsm 2023-10-19T12:43:49.129 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 1247_vm 2023-10-19T12:43:49.130 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 393216 Oct 19 12:43 1249 2023-10-19T12:43:49.130 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 1249_fsm 2023-10-19T12:43:49.130 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 1249_vm 2023-10-19T12:43:49.130 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 606208 Oct 19 12:43 1255 2023-10-19T12:43:49.130 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 1255_fsm 2023-10-19T12:43:49.131 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 1255_vm 2023-10-19T12:43:49.131 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Oct 19 12:43 1259 2023-10-19T12:43:49.131 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 1259_fsm 2023-10-19T12:43:49.131 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 1259_vm 2023-10-19T12:43:49.131 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 1417 2023-10-19T12:43:49.132 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 1417_vm 2023-10-19T12:43:49.132 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 1418 2023-10-19T12:43:49.132 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 1418_vm 2023-10-19T12:43:49.132 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 174 2023-10-19T12:43:49.132 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 175 2023-10-19T12:43:49.133 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2187 2023-10-19T12:43:49.133 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2224 2023-10-19T12:43:49.133 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2224_vm 2023-10-19T12:43:49.133 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2328 2023-10-19T12:43:49.133 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2328_vm 2023-10-19T12:43:49.133 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2336 2023-10-19T12:43:49.134 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2336_vm 2023-10-19T12:43:49.134 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2337 2023-10-19T12:43:49.134 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2600 2023-10-19T12:43:49.134 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2600_fsm 2023-10-19T12:43:49.134 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2600_vm 2023-10-19T12:43:49.135 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2601 2023-10-19T12:43:49.135 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2601_fsm 2023-10-19T12:43:49.135 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2601_vm 2023-10-19T12:43:49.135 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 19 12:43 2602 2023-10-19T12:43:49.135 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2602_fsm 2023-10-19T12:43:49.135 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2602_vm 2023-10-19T12:43:49.136 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 19 12:43 2603 2023-10-19T12:43:49.136 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2603_fsm 2023-10-19T12:43:49.136 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2603_vm 2023-10-19T12:43:49.136 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2604 2023-10-19T12:43:49.136 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2604_vm 2023-10-19T12:43:49.137 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2605 2023-10-19T12:43:49.137 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2605_fsm 2023-10-19T12:43:49.137 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2605_vm 2023-10-19T12:43:49.137 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2606 2023-10-19T12:43:49.137 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2606_fsm 2023-10-19T12:43:49.137 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2606_vm 2023-10-19T12:43:49.138 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2607 2023-10-19T12:43:49.138 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2607_fsm 2023-10-19T12:43:49.138 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2607_vm 2023-10-19T12:43:49.138 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 442368 Oct 19 12:43 2608 2023-10-19T12:43:49.138 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2608_fsm 2023-10-19T12:43:49.139 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2608_vm 2023-10-19T12:43:49.139 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 286720 Oct 19 12:43 2609 2023-10-19T12:43:49.139 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2609_fsm 2023-10-19T12:43:49.139 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2609_vm 2023-10-19T12:43:49.139 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2610 2023-10-19T12:43:49.140 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2610_fsm 2023-10-19T12:43:49.140 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2610_vm 2023-10-19T12:43:49.140 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2611 2023-10-19T12:43:49.140 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2611_vm 2023-10-19T12:43:49.140 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2612 2023-10-19T12:43:49.140 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2612_fsm 2023-10-19T12:43:49.141 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2612_vm 2023-10-19T12:43:49.141 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2613 2023-10-19T12:43:49.141 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2613_vm 2023-10-19T12:43:49.141 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2615 2023-10-19T12:43:49.141 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2615_fsm 2023-10-19T12:43:49.142 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2615_vm 2023-10-19T12:43:49.142 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2616 2023-10-19T12:43:49.142 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2616_fsm 2023-10-19T12:43:49.142 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2616_vm 2023-10-19T12:43:49.142 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Oct 19 12:43 2617 2023-10-19T12:43:49.142 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2617_fsm 2023-10-19T12:43:49.143 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2617_vm 2023-10-19T12:43:49.143 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Oct 19 12:43 2618 2023-10-19T12:43:49.143 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2618_fsm 2023-10-19T12:43:49.143 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2618_vm 2023-10-19T12:43:49.143 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Oct 19 12:43 2619 2023-10-19T12:43:49.144 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2619_fsm 2023-10-19T12:43:49.144 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2619_vm 2023-10-19T12:43:49.144 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2620 2023-10-19T12:43:49.144 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2620_vm 2023-10-19T12:43:49.144 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2650 2023-10-19T12:43:49.145 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2651 2023-10-19T12:43:49.145 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2652 2023-10-19T12:43:49.145 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 19 12:43 2653 2023-10-19T12:43:49.145 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 19 12:43 2654 2023-10-19T12:43:49.145 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 19 12:43 2655 2023-10-19T12:43:49.145 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2656 2023-10-19T12:43:49.146 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2657 2023-10-19T12:43:49.146 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Oct 19 12:43 2658 2023-10-19T12:43:49.146 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Oct 19 12:43 2659 2023-10-19T12:43:49.146 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2660 2023-10-19T12:43:49.146 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2661 2023-10-19T12:43:49.146 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 19 12:43 2662 2023-10-19T12:43:49.147 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 19 12:43 2663 2023-10-19T12:43:49.147 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2664 2023-10-19T12:43:49.147 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2665 2023-10-19T12:43:49.147 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2666 2023-10-19T12:43:49.147 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2667 2023-10-19T12:43:49.147 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2668 2023-10-19T12:43:49.148 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2669 2023-10-19T12:43:49.148 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2670 2023-10-19T12:43:49.148 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 319488 Oct 19 12:43 2673 2023-10-19T12:43:49.148 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 376832 Oct 19 12:43 2674 2023-10-19T12:43:49.148 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 180224 Oct 19 12:43 2675 2023-10-19T12:43:49.148 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2678 2023-10-19T12:43:49.149 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2679 2023-10-19T12:43:49.149 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2680 2023-10-19T12:43:49.149 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2681 2023-10-19T12:43:49.149 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2682 2023-10-19T12:43:49.149 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2683 2023-10-19T12:43:49.149 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2684 2023-10-19T12:43:49.150 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2685 2023-10-19T12:43:49.150 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2686 2023-10-19T12:43:49.150 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2687 2023-10-19T12:43:49.150 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 19 12:43 2688 2023-10-19T12:43:49.150 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 19 12:43 2689 2023-10-19T12:43:49.151 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Oct 19 12:43 2690 2023-10-19T12:43:49.151 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 270336 Oct 19 12:43 2691 2023-10-19T12:43:49.151 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2692 2023-10-19T12:43:49.151 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2693 2023-10-19T12:43:49.151 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2696 2023-10-19T12:43:49.151 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2699 2023-10-19T12:43:49.152 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2701 2023-10-19T12:43:49.152 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2702 2023-10-19T12:43:49.152 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2703 2023-10-19T12:43:49.152 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 19 12:43 2704 2023-10-19T12:43:49.152 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2753 2023-10-19T12:43:49.152 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2753_fsm 2023-10-19T12:43:49.153 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2753_vm 2023-10-19T12:43:49.153 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2754 2023-10-19T12:43:49.153 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2755 2023-10-19T12:43:49.153 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 19 12:43 2756 2023-10-19T12:43:49.153 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 19 12:43 2757 2023-10-19T12:43:49.154 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2830 2023-10-19T12:43:49.154 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2830_vm 2023-10-19T12:43:49.154 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2831 2023-10-19T12:43:49.154 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2832 2023-10-19T12:43:49.154 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2832_vm 2023-10-19T12:43:49.154 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2833 2023-10-19T12:43:49.155 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2834 2023-10-19T12:43:49.155 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2834_vm 2023-10-19T12:43:49.155 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2835 2023-10-19T12:43:49.155 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2836 2023-10-19T12:43:49.155 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2836_vm 2023-10-19T12:43:49.155 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2837 2023-10-19T12:43:49.156 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 417792 Oct 19 12:43 2838 2023-10-19T12:43:49.156 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2838_fsm 2023-10-19T12:43:49.156 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2838_vm 2023-10-19T12:43:49.156 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2839 2023-10-19T12:43:49.156 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2840 2023-10-19T12:43:49.156 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2840_fsm 2023-10-19T12:43:49.157 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2840_vm 2023-10-19T12:43:49.157 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2841 2023-10-19T12:43:49.157 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2995 2023-10-19T12:43:49.157 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2995_vm 2023-10-19T12:43:49.157 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2996 2023-10-19T12:43:49.158 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3079 2023-10-19T12:43:49.158 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 3079_fsm 2023-10-19T12:43:49.158 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3079_vm 2023-10-19T12:43:49.158 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3080 2023-10-19T12:43:49.158 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3081 2023-10-19T12:43:49.159 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3085 2023-10-19T12:43:49.159 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3118 2023-10-19T12:43:49.159 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3118_vm 2023-10-19T12:43:49.159 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3119 2023-10-19T12:43:49.159 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3164 2023-10-19T12:43:49.160 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3256 2023-10-19T12:43:49.160 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3256_vm 2023-10-19T12:43:49.160 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3257 2023-10-19T12:43:49.160 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3258 2023-10-19T12:43:49.160 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3350 2023-10-19T12:43:49.161 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3350_vm 2023-10-19T12:43:49.161 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3351 2023-10-19T12:43:49.161 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3379 2023-10-19T12:43:49.161 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3380 2023-10-19T12:43:49.161 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3381 2023-10-19T12:43:49.161 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3381_vm 2023-10-19T12:43:49.162 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3394 2023-10-19T12:43:49.162 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 3394_fsm 2023-10-19T12:43:49.162 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3394_vm 2023-10-19T12:43:49.163 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3395 2023-10-19T12:43:49.163 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3439 2023-10-19T12:43:49.163 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3439_vm 2023-10-19T12:43:49.163 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3440 2023-10-19T12:43:49.164 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 19 12:43 3455 2023-10-19T12:43:49.164 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3456 2023-10-19T12:43:49.164 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 3456_fsm 2023-10-19T12:43:49.164 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3456_vm 2023-10-19T12:43:49.164 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3466 2023-10-19T12:43:49.164 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3466_vm 2023-10-19T12:43:49.165 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3467 2023-10-19T12:43:49.165 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3468 2023-10-19T12:43:49.165 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3501 2023-10-19T12:43:49.165 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3501_vm 2023-10-19T12:43:49.165 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3502 2023-10-19T12:43:49.166 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3503 2023-10-19T12:43:49.166 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3534 2023-10-19T12:43:49.166 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3541 2023-10-19T12:43:49.166 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 3541_fsm 2023-10-19T12:43:49.166 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3541_vm 2023-10-19T12:43:49.167 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3542 2023-10-19T12:43:49.167 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3574 2023-10-19T12:43:49.167 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3575 2023-10-19T12:43:49.167 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3576 2023-10-19T12:43:49.167 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3576_vm 2023-10-19T12:43:49.168 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3596 2023-10-19T12:43:49.168 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3596_vm 2023-10-19T12:43:49.168 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3597 2023-10-19T12:43:49.168 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3598 2023-10-19T12:43:49.168 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3598_vm 2023-10-19T12:43:49.168 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3599 2023-10-19T12:43:49.169 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3600 2023-10-19T12:43:49.169 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 3600_fsm 2023-10-19T12:43:49.169 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3600_vm 2023-10-19T12:43:49.169 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3601 2023-10-19T12:43:49.169 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 3601_fsm 2023-10-19T12:43:49.170 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3601_vm 2023-10-19T12:43:49.170 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3602 2023-10-19T12:43:49.170 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 3602_fsm 2023-10-19T12:43:49.170 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3602_vm 2023-10-19T12:43:49.170 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3603 2023-10-19T12:43:49.171 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 3603_fsm 2023-10-19T12:43:49.171 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3603_vm 2023-10-19T12:43:49.171 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3604 2023-10-19T12:43:49.171 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3605 2023-10-19T12:43:49.171 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3606 2023-10-19T12:43:49.172 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3607 2023-10-19T12:43:49.172 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3608 2023-10-19T12:43:49.172 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 19 12:43 3609 2023-10-19T12:43:49.172 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3712 2023-10-19T12:43:49.172 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3764 2023-10-19T12:43:49.173 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 3764_fsm 2023-10-19T12:43:49.173 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3764_vm 2023-10-19T12:43:49.173 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3766 2023-10-19T12:43:49.173 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3767 2023-10-19T12:43:49.173 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3997 2023-10-19T12:43:49.173 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 5002 2023-10-19T12:43:49.174 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 548 2023-10-19T12:43:49.174 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 549 2023-10-19T12:43:49.174 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 6102 2023-10-19T12:43:49.174 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 6102_vm 2023-10-19T12:43:49.174 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 6104 2023-10-19T12:43:49.174 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 6104_vm 2023-10-19T12:43:49.175 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 6106 2023-10-19T12:43:49.175 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 6106_vm 2023-10-19T12:43:49.175 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 6110 2023-10-19T12:43:49.175 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 6111 2023-10-19T12:43:49.175 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 6112 2023-10-19T12:43:49.176 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 6113 2023-10-19T12:43:49.176 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 6117 2023-10-19T12:43:49.176 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 826 2023-10-19T12:43:49.176 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 826_vm 2023-10-19T12:43:49.176 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 827 2023-10-19T12:43:49.177 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 828 2023-10-19T12:43:49.177 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Oct 19 12:43 pg_filenode.map 2023-10-19T12:43:49.177 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 19 12:43 PG_VERSION 2023-10-19T12:43:49.177 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:43:49.177 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/cephfs/postgres/data/global: 2023-10-19T12:43:49.178 INFO:teuthology.orchestra.run.smithi046.stdout:total 553 2023-10-19T12:43:49.178 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 58 Oct 19 12:43 . 2023-10-19T12:43:49.178 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Oct 19 12:43 .. 2023-10-19T12:43:49.178 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 1136 2023-10-19T12:43:49.179 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 1136_fsm 2023-10-19T12:43:49.179 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 1136_vm 2023-10-19T12:43:49.179 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 1137 2023-10-19T12:43:49.179 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 1213 2023-10-19T12:43:49.179 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 1213_fsm 2023-10-19T12:43:49.180 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 1213_vm 2023-10-19T12:43:49.180 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 1214 2023-10-19T12:43:49.180 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 1214_fsm 2023-10-19T12:43:49.180 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 1214_vm 2023-10-19T12:43:49.180 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 1232 2023-10-19T12:43:49.180 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 1233 2023-10-19T12:43:49.181 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 1260 2023-10-19T12:43:49.181 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 1260_fsm 2023-10-19T12:43:49.181 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 1260_vm 2023-10-19T12:43:49.181 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 1261 2023-10-19T12:43:49.181 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 1261_fsm 2023-10-19T12:43:49.182 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 1261_vm 2023-10-19T12:43:49.182 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 1262 2023-10-19T12:43:49.182 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 1262_fsm 2023-10-19T12:43:49.182 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 1262_vm 2023-10-19T12:43:49.182 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2396 2023-10-19T12:43:49.183 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2396_fsm 2023-10-19T12:43:49.183 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2396_vm 2023-10-19T12:43:49.183 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2397 2023-10-19T12:43:49.183 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2671 2023-10-19T12:43:49.183 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2672 2023-10-19T12:43:49.183 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2676 2023-10-19T12:43:49.184 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2677 2023-10-19T12:43:49.184 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2694 2023-10-19T12:43:49.184 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2695 2023-10-19T12:43:49.184 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2697 2023-10-19T12:43:49.184 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2698 2023-10-19T12:43:49.184 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2846 2023-10-19T12:43:49.185 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2846_vm 2023-10-19T12:43:49.185 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2847 2023-10-19T12:43:49.185 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2964 2023-10-19T12:43:49.185 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2964_vm 2023-10-19T12:43:49.185 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2965 2023-10-19T12:43:49.186 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2966 2023-10-19T12:43:49.186 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2966_vm 2023-10-19T12:43:49.186 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2967 2023-10-19T12:43:49.186 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3592 2023-10-19T12:43:49.186 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3592_vm 2023-10-19T12:43:49.187 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3593 2023-10-19T12:43:49.187 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 4060 2023-10-19T12:43:49.187 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 4060_vm 2023-10-19T12:43:49.187 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 4061 2023-10-19T12:43:49.187 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 6000 2023-10-19T12:43:49.188 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 6000_vm 2023-10-19T12:43:49.188 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 6001 2023-10-19T12:43:49.188 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 6002 2023-10-19T12:43:49.188 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 6100 2023-10-19T12:43:49.189 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 6100_vm 2023-10-19T12:43:49.189 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 6114 2023-10-19T12:43:49.189 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 6115 2023-10-19T12:43:49.189 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 pg_control 2023-10-19T12:43:49.189 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Oct 19 12:43 pg_filenode.map 2023-10-19T12:43:49.189 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:43:49.190 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/cephfs/postgres/data/log: 2023-10-19T12:43:49.190 INFO:teuthology.orchestra.run.smithi046.stdout:total 0 2023-10-19T12:43:49.190 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 . 2023-10-19T12:43:49.190 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Oct 19 12:43 .. 2023-10-19T12:43:49.191 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:43:49.191 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/cephfs/postgres/data/pg_commit_ts: 2023-10-19T12:43:49.191 INFO:teuthology.orchestra.run.smithi046.stdout:total 0 2023-10-19T12:43:49.191 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 . 2023-10-19T12:43:49.191 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Oct 19 12:43 .. 2023-10-19T12:43:49.191 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:43:49.192 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/cephfs/postgres/data/pg_dynshmem: 2023-10-19T12:43:49.192 INFO:teuthology.orchestra.run.smithi046.stdout:total 0 2023-10-19T12:43:49.192 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 . 2023-10-19T12:43:49.192 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Oct 19 12:43 .. 2023-10-19T12:43:49.192 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:43:49.193 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/cephfs/postgres/data/pg_logical: 2023-10-19T12:43:49.193 INFO:teuthology.orchestra.run.smithi046.stdout:total 1 2023-10-19T12:43:49.193 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 19 12:43 . 2023-10-19T12:43:49.193 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Oct 19 12:43 .. 2023-10-19T12:43:49.193 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 mappings 2023-10-19T12:43:49.194 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Oct 19 12:43 replorigin_checkpoint 2023-10-19T12:43:49.194 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 snapshots 2023-10-19T12:43:49.194 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:43:49.194 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/cephfs/postgres/data/pg_logical/mappings: 2023-10-19T12:43:49.194 INFO:teuthology.orchestra.run.smithi046.stdout:total 0 2023-10-19T12:43:49.195 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 . 2023-10-19T12:43:49.195 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 19 12:43 .. 2023-10-19T12:43:49.195 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:43:49.195 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/cephfs/postgres/data/pg_logical/snapshots: 2023-10-19T12:43:49.195 INFO:teuthology.orchestra.run.smithi046.stdout:total 0 2023-10-19T12:43:49.195 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 . 2023-10-19T12:43:49.196 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 19 12:43 .. 2023-10-19T12:43:49.196 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:43:49.196 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/cephfs/postgres/data/pg_multixact: 2023-10-19T12:43:49.196 INFO:teuthology.orchestra.run.smithi046.stdout:total 0 2023-10-19T12:43:49.197 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Oct 19 12:43 . 2023-10-19T12:43:49.197 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Oct 19 12:43 .. 2023-10-19T12:43:49.197 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Oct 19 12:43 members 2023-10-19T12:43:49.197 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Oct 19 12:43 offsets 2023-10-19T12:43:49.198 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:43:49.198 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/cephfs/postgres/data/pg_multixact/members: 2023-10-19T12:43:49.198 INFO:teuthology.orchestra.run.smithi046.stdout:total 8 2023-10-19T12:43:49.198 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Oct 19 12:43 . 2023-10-19T12:43:49.199 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Oct 19 12:43 .. 2023-10-19T12:43:49.199 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 0000 2023-10-19T12:43:49.199 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:43:49.199 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/cephfs/postgres/data/pg_multixact/offsets: 2023-10-19T12:43:49.199 INFO:teuthology.orchestra.run.smithi046.stdout:total 8 2023-10-19T12:43:49.199 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Oct 19 12:43 . 2023-10-19T12:43:49.200 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Oct 19 12:43 .. 2023-10-19T12:43:49.200 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 0000 2023-10-19T12:43:49.200 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:43:49.200 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/cephfs/postgres/data/pg_notify: 2023-10-19T12:43:49.200 INFO:teuthology.orchestra.run.smithi046.stdout:total 8 2023-10-19T12:43:49.201 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Oct 19 12:43 . 2023-10-19T12:43:49.201 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Oct 19 12:43 .. 2023-10-19T12:43:49.201 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 0000 2023-10-19T12:43:49.201 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:43:49.201 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/cephfs/postgres/data/pg_replslot: 2023-10-19T12:43:49.202 INFO:teuthology.orchestra.run.smithi046.stdout:total 0 2023-10-19T12:43:49.202 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 . 2023-10-19T12:43:49.202 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Oct 19 12:43 .. 2023-10-19T12:43:49.202 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:43:49.202 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/cephfs/postgres/data/pg_serial: 2023-10-19T12:43:49.203 INFO:teuthology.orchestra.run.smithi046.stdout:total 0 2023-10-19T12:43:49.203 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 . 2023-10-19T12:43:49.203 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Oct 19 12:43 .. 2023-10-19T12:43:49.203 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:43:49.203 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/cephfs/postgres/data/pg_snapshots: 2023-10-19T12:43:49.203 INFO:teuthology.orchestra.run.smithi046.stdout:total 0 2023-10-19T12:43:49.204 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 . 2023-10-19T12:43:49.204 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Oct 19 12:43 .. 2023-10-19T12:43:49.204 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:43:49.204 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/cephfs/postgres/data/pg_stat: 2023-10-19T12:43:49.204 INFO:teuthology.orchestra.run.smithi046.stdout:total 0 2023-10-19T12:43:49.205 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 . 2023-10-19T12:43:49.205 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Oct 19 12:43 .. 2023-10-19T12:43:49.205 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:43:49.205 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/cephfs/postgres/data/pg_stat_tmp: 2023-10-19T12:43:49.205 INFO:teuthology.orchestra.run.smithi046.stdout:total 0 2023-10-19T12:43:49.206 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 . 2023-10-19T12:43:49.206 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Oct 19 12:43 .. 2023-10-19T12:43:49.206 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:43:49.206 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/cephfs/postgres/data/pg_subtrans: 2023-10-19T12:43:49.207 INFO:teuthology.orchestra.run.smithi046.stdout:total 8 2023-10-19T12:43:49.207 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Oct 19 12:43 . 2023-10-19T12:43:49.207 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Oct 19 12:43 .. 2023-10-19T12:43:49.207 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 0000 2023-10-19T12:43:49.207 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:43:49.207 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/cephfs/postgres/data/pg_tblspc: 2023-10-19T12:43:49.208 INFO:teuthology.orchestra.run.smithi046.stdout:total 0 2023-10-19T12:43:49.208 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 . 2023-10-19T12:43:49.208 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Oct 19 12:43 .. 2023-10-19T12:43:49.208 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:43:49.208 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/cephfs/postgres/data/pg_twophase: 2023-10-19T12:43:49.209 INFO:teuthology.orchestra.run.smithi046.stdout:total 0 2023-10-19T12:43:49.209 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 . 2023-10-19T12:43:49.209 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Oct 19 12:43 .. 2023-10-19T12:43:49.209 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:43:49.209 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/cephfs/postgres/data/pg_wal: 2023-10-19T12:43:49.210 INFO:teuthology.orchestra.run.smithi046.stdout:total 16384 2023-10-19T12:43:49.210 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Oct 19 12:43 . 2023-10-19T12:43:49.210 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Oct 19 12:43 .. 2023-10-19T12:43:49.210 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 19 12:43 000000010000000000000001 2023-10-19T12:43:49.210 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 archive_status 2023-10-19T12:43:49.210 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:43:49.211 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/cephfs/postgres/data/pg_wal/archive_status: 2023-10-19T12:43:49.211 INFO:teuthology.orchestra.run.smithi046.stdout:total 0 2023-10-19T12:43:49.211 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 . 2023-10-19T12:43:49.211 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Oct 19 12:43 .. 2023-10-19T12:43:49.211 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:43:49.211 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/cephfs/postgres/data/pg_xact: 2023-10-19T12:43:49.212 INFO:teuthology.orchestra.run.smithi046.stdout:total 8 2023-10-19T12:43:49.212 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Oct 19 12:43 . 2023-10-19T12:43:49.212 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Oct 19 12:43 .. 2023-10-19T12:43:49.212 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 0000 2023-10-19T12:43:49.213 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:48 smithi046 ceph-mon[98509]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-19T12:43:49.214 DEBUG:teuthology.orchestra.run.smithi046:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo systemctl start postgresql' 2023-10-19T12:43:49.215 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:48 smithi195 ceph-mon[134493]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-19T12:43:49.215 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:48 smithi157 ceph-mon[134109]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-19T12:43:49.450 DEBUG:teuthology.orchestra.run.smithi046:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- pgbench -s 32 -i' 2023-10-19T12:43:49.568 INFO:teuthology.orchestra.run.smithi046.stderr:NOTICE: table "pgbench_history" does not exist, skipping 2023-10-19T12:43:49.575 INFO:teuthology.orchestra.run.smithi046.stderr:NOTICE: table "pgbench_tellers" does not exist, skipping 2023-10-19T12:43:49.580 INFO:teuthology.orchestra.run.smithi046.stderr:NOTICE: table "pgbench_accounts" does not exist, skipping 2023-10-19T12:43:49.584 INFO:teuthology.orchestra.run.smithi046.stderr:NOTICE: table "pgbench_branches" does not exist, skipping 2023-10-19T12:43:49.614 INFO:teuthology.orchestra.run.smithi046.stderr:creating tables... 2023-10-19T12:43:49.724 INFO:teuthology.orchestra.run.smithi046.stderr:100000 of 3200000 tuples (3%) done (elapsed 0.11 s, remaining 3.37 s) 2023-10-19T12:43:49.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:49 smithi046 ceph-mon[98509]: pgmap v363: 129 pgs: 129 active+clean; 21 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 1.7 MiB/s wr, 27 op/s 2023-10-19T12:43:50.068 INFO:teuthology.orchestra.run.smithi046.stderr:200000 of 3200000 tuples (6%) done (elapsed 0.45 s, remaining 6.79 s) 2023-10-19T12:43:50.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:49 smithi157 ceph-mon[134109]: pgmap v363: 129 pgs: 129 active+clean; 21 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 1.7 MiB/s wr, 27 op/s 2023-10-19T12:43:50.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:49 smithi195 ceph-mon[134493]: pgmap v363: 129 pgs: 129 active+clean; 21 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 1.7 MiB/s wr, 27 op/s 2023-10-19T12:43:50.413 INFO:teuthology.orchestra.run.smithi046.stderr:300000 of 3200000 tuples (9%) done (elapsed 0.80 s, remaining 7.71 s) 2023-10-19T12:43:50.584 INFO:teuthology.orchestra.run.smithi046.stderr:400000 of 3200000 tuples (12%) done (elapsed 0.97 s, remaining 6.78 s) 2023-10-19T12:43:50.841 INFO:teuthology.orchestra.run.smithi046.stderr:500000 of 3200000 tuples (15%) done (elapsed 1.23 s, remaining 6.62 s) 2023-10-19T12:43:51.170 INFO:teuthology.orchestra.run.smithi046.stderr:600000 of 3200000 tuples (18%) done (elapsed 1.55 s, remaining 6.74 s) 2023-10-19T12:43:51.287 INFO:teuthology.orchestra.run.smithi046.stderr:700000 of 3200000 tuples (21%) done (elapsed 1.67 s, remaining 5.97 s) 2023-10-19T12:43:51.664 INFO:teuthology.orchestra.run.smithi046.stderr:800000 of 3200000 tuples (25%) done (elapsed 2.05 s, remaining 6.15 s) 2023-10-19T12:43:52.010 INFO:teuthology.orchestra.run.smithi046.stderr:900000 of 3200000 tuples (28%) done (elapsed 2.39 s, remaining 6.12 s) 2023-10-19T12:43:52.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:51 smithi157 ceph-mon[134109]: pgmap v364: 129 pgs: 129 active+clean; 34 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 3.2 MiB/s wr, 56 op/s 2023-10-19T12:43:52.121 INFO:teuthology.orchestra.run.smithi046.stderr:1000000 of 3200000 tuples (31%) done (elapsed 2.51 s, remaining 5.51 s) 2023-10-19T12:43:52.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:51 smithi195 ceph-mon[134493]: pgmap v364: 129 pgs: 129 active+clean; 34 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 3.2 MiB/s wr, 56 op/s 2023-10-19T12:43:52.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:51 smithi046 ceph-mon[98509]: pgmap v364: 129 pgs: 129 active+clean; 34 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 3.2 MiB/s wr, 56 op/s 2023-10-19T12:43:52.491 INFO:teuthology.orchestra.run.smithi046.stderr:1100000 of 3200000 tuples (34%) done (elapsed 2.88 s, remaining 5.49 s) 2023-10-19T12:43:52.610 INFO:teuthology.orchestra.run.smithi046.stderr:1200000 of 3200000 tuples (37%) done (elapsed 2.99 s, remaining 4.99 s) 2023-10-19T12:43:52.946 INFO:teuthology.orchestra.run.smithi046.stderr:1300000 of 3200000 tuples (40%) done (elapsed 3.33 s, remaining 4.87 s) 2023-10-19T12:43:53.334 INFO:teuthology.orchestra.run.smithi046.stderr:1400000 of 3200000 tuples (43%) done (elapsed 3.72 s, remaining 4.78 s) 2023-10-19T12:43:53.441 INFO:teuthology.orchestra.run.smithi046.stderr:1500000 of 3200000 tuples (46%) done (elapsed 3.83 s, remaining 4.34 s) 2023-10-19T12:43:53.760 INFO:teuthology.orchestra.run.smithi046.stderr:1600000 of 3200000 tuples (50%) done (elapsed 4.14 s, remaining 4.14 s) 2023-10-19T12:43:53.955 INFO:teuthology.orchestra.run.smithi046.stderr:1700000 of 3200000 tuples (53%) done (elapsed 4.34 s, remaining 3.83 s) 2023-10-19T12:43:54.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:53 smithi157 ceph-mon[134109]: pgmap v365: 129 pgs: 129 active+clean; 74 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 10 MiB/s wr, 146 op/s 2023-10-19T12:43:54.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:53 smithi157 ceph-mon[134109]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-19T12:43:54.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:53 smithi195 ceph-mon[134493]: pgmap v365: 129 pgs: 129 active+clean; 74 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 10 MiB/s wr, 146 op/s 2023-10-19T12:43:54.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:53 smithi195 ceph-mon[134493]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-19T12:43:54.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:53 smithi046 ceph-mon[98509]: pgmap v365: 129 pgs: 129 active+clean; 74 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 10 MiB/s wr, 146 op/s 2023-10-19T12:43:54.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:53 smithi046 ceph-mon[98509]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-19T12:43:54.249 INFO:teuthology.orchestra.run.smithi046.stderr:1800000 of 3200000 tuples (56%) done (elapsed 4.63 s, remaining 3.60 s) 2023-10-19T12:43:54.559 INFO:teuthology.orchestra.run.smithi046.stderr:1900000 of 3200000 tuples (59%) done (elapsed 4.94 s, remaining 3.38 s) 2023-10-19T12:43:54.739 INFO:teuthology.orchestra.run.smithi046.stderr:2000000 of 3200000 tuples (62%) done (elapsed 5.12 s, remaining 3.07 s) 2023-10-19T12:43:55.034 INFO:teuthology.orchestra.run.smithi046.stderr:2100000 of 3200000 tuples (65%) done (elapsed 5.42 s, remaining 2.84 s) 2023-10-19T12:43:55.329 INFO:teuthology.orchestra.run.smithi046.stderr:2200000 of 3200000 tuples (68%) done (elapsed 5.71 s, remaining 2.60 s) 2023-10-19T12:43:55.529 INFO:teuthology.orchestra.run.smithi046.stderr:2300000 of 3200000 tuples (71%) done (elapsed 5.91 s, remaining 2.31 s) 2023-10-19T12:43:55.821 INFO:teuthology.orchestra.run.smithi046.stderr:2400000 of 3200000 tuples (75%) done (elapsed 6.21 s, remaining 2.07 s) 2023-10-19T12:43:56.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:55 smithi157 ceph-mon[134109]: pgmap v366: 129 pgs: 129 active+clean; 106 MiB data, 590 MiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 15 MiB/s wr, 143 op/s 2023-10-19T12:43:56.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:55 smithi195 ceph-mon[134493]: pgmap v366: 129 pgs: 129 active+clean; 106 MiB data, 590 MiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 15 MiB/s wr, 143 op/s 2023-10-19T12:43:56.169 INFO:teuthology.orchestra.run.smithi046.stderr:2500000 of 3200000 tuples (78%) done (elapsed 6.55 s, remaining 1.83 s) 2023-10-19T12:43:56.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:55 smithi046 ceph-mon[98509]: pgmap v366: 129 pgs: 129 active+clean; 106 MiB data, 590 MiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 15 MiB/s wr, 143 op/s 2023-10-19T12:43:56.372 INFO:teuthology.orchestra.run.smithi046.stderr:2600000 of 3200000 tuples (81%) done (elapsed 6.76 s, remaining 1.56 s) 2023-10-19T12:43:56.702 INFO:teuthology.orchestra.run.smithi046.stderr:2700000 of 3200000 tuples (84%) done (elapsed 7.09 s, remaining 1.31 s) 2023-10-19T12:43:57.019 INFO:teuthology.orchestra.run.smithi046.stderr:2800000 of 3200000 tuples (87%) done (elapsed 7.40 s, remaining 1.06 s) 2023-10-19T12:43:57.241 INFO:teuthology.orchestra.run.smithi046.stderr:2900000 of 3200000 tuples (90%) done (elapsed 7.63 s, remaining 0.79 s) 2023-10-19T12:43:57.549 INFO:teuthology.orchestra.run.smithi046.stderr:3000000 of 3200000 tuples (93%) done (elapsed 7.93 s, remaining 0.53 s) 2023-10-19T12:43:57.902 INFO:teuthology.orchestra.run.smithi046.stderr:3100000 of 3200000 tuples (96%) done (elapsed 8.29 s, remaining 0.27 s) 2023-10-19T12:43:58.034 INFO:teuthology.orchestra.run.smithi046.stderr:3200000 of 3200000 tuples (100%) done (elapsed 8.42 s, remaining 0.00 s) 2023-10-19T12:43:58.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:57 smithi157 ceph-mon[134109]: pgmap v367: 129 pgs: 129 active+clean; 207 MiB data, 751 MiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 32 MiB/s wr, 161 op/s 2023-10-19T12:43:58.108 INFO:teuthology.orchestra.run.smithi046.stderr:vacuum... 2023-10-19T12:43:58.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:57 smithi195 ceph-mon[134493]: pgmap v367: 129 pgs: 129 active+clean; 207 MiB data, 751 MiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 32 MiB/s wr, 161 op/s 2023-10-19T12:43:58.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:57 smithi046 ceph-mon[98509]: pgmap v367: 129 pgs: 129 active+clean; 207 MiB data, 751 MiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 32 MiB/s wr, 161 op/s 2023-10-19T12:43:59.129 INFO:teuthology.orchestra.run.smithi046.stderr:set primary keys... 2023-10-19T12:43:59.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:43:59 smithi157 ceph-mon[134109]: pgmap v368: 129 pgs: 129 active+clean; 279 MiB data, 905 MiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 43 MiB/s wr, 157 op/s 2023-10-19T12:43:59.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:43:59 smithi195 ceph-mon[134493]: pgmap v368: 129 pgs: 129 active+clean; 279 MiB data, 905 MiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 43 MiB/s wr, 157 op/s 2023-10-19T12:43:59.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:43:59 smithi046 ceph-mon[98509]: pgmap v368: 129 pgs: 129 active+clean; 279 MiB data, 905 MiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 43 MiB/s wr, 157 op/s 2023-10-19T12:44:01.547 INFO:teuthology.orchestra.run.smithi046.stderr:done. 2023-10-19T12:44:01.555 DEBUG:teuthology.orchestra.run.smithi046:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- pgbench -c 100 -j 4 --progress=5 --time=900' 2023-10-19T12:44:01.700 INFO:teuthology.orchestra.run.smithi046.stderr:starting vacuum...end. 2023-10-19T12:44:01.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:44:01 smithi046 ceph-mon[98509]: pgmap v369: 129 pgs: 129 active+clean; 331 MiB data, 1011 MiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 51 MiB/s wr, 154 op/s 2023-10-19T12:44:02.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:44:01 smithi157 ceph-mon[134109]: pgmap v369: 129 pgs: 129 active+clean; 331 MiB data, 1011 MiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 51 MiB/s wr, 154 op/s 2023-10-19T12:44:02.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:44:01 smithi195 ceph-mon[134493]: pgmap v369: 129 pgs: 129 active+clean; 331 MiB data, 1011 MiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 51 MiB/s wr, 154 op/s 2023-10-19T12:44:04.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:44:03 smithi157 ceph-mon[134109]: pgmap v370: 129 pgs: 129 active+clean; 407 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 60 MiB/s wr, 140 op/s 2023-10-19T12:44:04.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:44:03 smithi195 ceph-mon[134493]: pgmap v370: 129 pgs: 129 active+clean; 407 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 60 MiB/s wr, 140 op/s 2023-10-19T12:44:04.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:44:03 smithi046 ceph-mon[98509]: pgmap v370: 129 pgs: 129 active+clean; 407 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 60 MiB/s wr, 140 op/s 2023-10-19T12:44:06.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:44:05 smithi157 ceph-mon[134109]: pgmap v371: 129 pgs: 129 active+clean; 477 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 57 MiB/s wr, 64 op/s 2023-10-19T12:44:06.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:44:05 smithi195 ceph-mon[134493]: pgmap v371: 129 pgs: 129 active+clean; 477 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 57 MiB/s wr, 64 op/s 2023-10-19T12:44:06.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:44:05 smithi046 ceph-mon[98509]: pgmap v371: 129 pgs: 129 active+clean; 477 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 57 MiB/s wr, 64 op/s 2023-10-19T12:44:06.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 5.0 s, 1706.8 tps, lat 55.695 ms stddev 68.667 2023-10-19T12:44:06.934 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-19T12:44:07.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.289+0000 7f8b99fff700 1 -- 172.21.15.46:0/4095062739 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b94104560 msgr2=0x7f8b9410ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:44:07.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.289+0000 7f8b99fff700 1 --2- 172.21.15.46:0/4095062739 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b94104560 0x7f8b9410ae10 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f8b84013f90 tx=0x7f8b840096e0 comp rx=0 tx=0).stop 2023-10-19T12:44:07.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.290+0000 7f8b99fff700 1 -- 172.21.15.46:0/4095062739 shutdown_connections 2023-10-19T12:44:07.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.290+0000 7f8b99fff700 1 --2- 172.21.15.46:0/4095062739 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b94104560 0x7f8b9410ae10 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:07.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.290+0000 7f8b99fff700 1 --2- 172.21.15.46:0/4095062739 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8b941029d0 0x7f8b94102df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:07.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.290+0000 7f8b99fff700 1 --2- 172.21.15.46:0/4095062739 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8b94103bc0 0x7f8b94104020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:07.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.290+0000 7f8b99fff700 1 -- 172.21.15.46:0/4095062739 >> 172.21.15.46:0/4095062739 conn(0x7f8b940fdf40 msgr2=0x7f8b94100380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:44:07.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.290+0000 7f8b99fff700 1 -- 172.21.15.46:0/4095062739 shutdown_connections 2023-10-19T12:44:07.295 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.290+0000 7f8b99fff700 1 -- 172.21.15.46:0/4095062739 wait complete. 2023-10-19T12:44:07.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.291+0000 7f8b99fff700 1 Processor -- start 2023-10-19T12:44:07.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.292+0000 7f8b99fff700 1 -- start start 2023-10-19T12:44:07.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.293+0000 7f8b99fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8b941029d0 0x7f8b94194570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:07.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.293+0000 7f8b99fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b94103bc0 0x7f8b94194ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:07.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.293+0000 7f8b99fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8b94104560 0x7f8b9419bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:07.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.293+0000 7f8b99fff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9419c0a0 con 0x7f8b94103bc0 2023-10-19T12:44:07.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.293+0000 7f8b99fff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9419c1e0 con 0x7f8b94104560 2023-10-19T12:44:07.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.293+0000 7f8b99fff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9419c370 con 0x7f8b941029d0 2023-10-19T12:44:07.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.293+0000 7f8b937fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8b941029d0 0x7f8b94194570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:07.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.294+0000 7f8b92ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b94103bc0 0x7f8b94194ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:07.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.294+0000 7f8b937fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8b941029d0 0x7f8b94194570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:49876/0 (socket says 172.21.15.46:49876) 2023-10-19T12:44:07.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.294+0000 7f8b937fe700 1 -- 172.21.15.46:0/571504846 learned_addr learned my addr 172.21.15.46:0/571504846 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:44:07.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.294+0000 7f8b93fff700 1 --2- 172.21.15.46:0/571504846 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8b94104560 0x7f8b9419bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:07.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.294+0000 7f8b93fff700 1 -- 172.21.15.46:0/571504846 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8b941029d0 msgr2=0x7f8b94194570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:44:07.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.294+0000 7f8b93fff700 1 --2- 172.21.15.46:0/571504846 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8b941029d0 0x7f8b94194570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:07.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.294+0000 7f8b93fff700 1 -- 172.21.15.46:0/571504846 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b94103bc0 msgr2=0x7f8b94194ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:44:07.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.294+0000 7f8b93fff700 1 --2- 172.21.15.46:0/571504846 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b94103bc0 0x7f8b94194ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:07.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.294+0000 7f8b93fff700 1 -- 172.21.15.46:0/571504846 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b84013b90 con 0x7f8b94104560 2023-10-19T12:44:07.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.295+0000 7f8b93fff700 1 --2- 172.21.15.46:0/571504846 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8b94104560 0x7f8b9419bad0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8b84014fd0 tx=0x7f8b8401ad20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:44:07.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.295+0000 7f8b90ff9700 1 -- 172.21.15.46:0/571504846 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b84009e90 con 0x7f8b94104560 2023-10-19T12:44:07.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.296+0000 7f8b90ff9700 1 -- 172.21.15.46:0/571504846 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8b84005570 con 0x7f8b94104560 2023-10-19T12:44:07.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.296+0000 7f8b90ff9700 1 -- 172.21.15.46:0/571504846 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b84003bf0 con 0x7f8b94104560 2023-10-19T12:44:07.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.296+0000 7f8b99fff700 1 -- 172.21.15.46:0/571504846 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b9419c5f0 con 0x7f8b94104560 2023-10-19T12:44:07.302 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.296+0000 7f8b99fff700 1 -- 172.21.15.46:0/571504846 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b9419c960 con 0x7f8b94104560 2023-10-19T12:44:07.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.305+0000 7f8b90ff9700 1 -- 172.21.15.46:0/571504846 <== mon.2 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f8b84003d50 con 0x7f8b94104560 2023-10-19T12:44:07.314 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.311+0000 7f8bad92ab80 1 Processor -- start 2023-10-19T12:44:07.315 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.311+0000 7f8bad92ab80 1 -- start start 2023-10-19T12:44:07.315 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.312+0000 7f8b90ff9700 1 --2- 172.21.15.46:0/571504846 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f8b800b2610 0x7f8b800b4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:07.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.312+0000 7f8bad92ab80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556b7e80b2d0 0x556b7e80b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:07.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.312+0000 7f8bad92ab80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556b7e80bc30 0x556b7e80a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:07.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.312+0000 7f8bad92ab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556b7e80a5d0 0x556b7e80aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:07.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.312+0000 7f8bad92ab80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b7e77d6e0 con 0x556b7e80b2d0 2023-10-19T12:44:07.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.312+0000 7f8bad92ab80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b7e763c60 con 0x556b7e80bc30 2023-10-19T12:44:07.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.312+0000 7f8bad92ab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b7e761580 con 0x556b7e80a5d0 2023-10-19T12:44:07.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.313+0000 7f8b93fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556b7e80a5d0 0x556b7e80aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:07.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.313+0000 7f8b93fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556b7e80a5d0 0x556b7e80aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:49882/0 (socket says 172.21.15.46:49882) 2023-10-19T12:44:07.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.313+0000 7f8b93fff700 1 -- 172.21.15.46:0/258648227 learned_addr learned my addr 172.21.15.46:0/258648227 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:44:07.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.313+0000 7f8b90ff9700 1 -- 172.21.15.46:0/571504846 <== mon.2 v2:172.21.15.157:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f8b840cce00 con 0x7f8b94104560 2023-10-19T12:44:07.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.313+0000 7f8b92ffd700 1 --2- 172.21.15.46:0/571504846 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f8b800b2610 0x7f8b800b4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:07.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.313+0000 7f8b93fff700 1 -- 172.21.15.46:0/258648227 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556b7e80bc30 msgr2=0x556b7e80a090 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-19T12:44:07.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.313+0000 7f8b93fff700 1 --2- 172.21.15.46:0/258648227 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556b7e80bc30 0x556b7e80a090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:07.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.313+0000 7f8b93fff700 1 -- 172.21.15.46:0/258648227 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556b7e80b2d0 msgr2=0x556b7e80b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:44:07.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.313+0000 7f8b93fff700 1 --2- 172.21.15.46:0/258648227 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556b7e80b2d0 0x556b7e80b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:07.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.313+0000 7f8b93fff700 1 -- 172.21.15.46:0/258648227 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556b7e71a3f0 con 0x556b7e80a5d0 2023-10-19T12:44:07.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.314+0000 7f8b93fff700 1 --2- 172.21.15.46:0/258648227 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556b7e80a5d0 0x556b7e80aa50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8b84005bf0 tx=0x7f8b840970d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=32d7a4740b7d9cfb server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:44:07.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.314+0000 7f8b89ffb700 1 -- 172.21.15.46:0/258648227 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b8409b360 con 0x556b7e80a5d0 2023-10-19T12:44:07.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.314+0000 7f8b89ffb700 1 -- 172.21.15.46:0/258648227 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8b8400b940 con 0x556b7e80a5d0 2023-10-19T12:44:07.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.314+0000 7f8b89ffb700 1 -- 172.21.15.46:0/258648227 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b84099000 con 0x556b7e80a5d0 2023-10-19T12:44:07.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.316+0000 7f8b92ffd700 1 --2- 172.21.15.46:0/571504846 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f8b800b2610 0x7f8b800b4ad0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c005fd0 tx=0x7f8b7c009310 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:44:07.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.316+0000 7f8bad92ab80 1 -- 172.21.15.46:0/258648227 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556b7e80a5d0 msgr2=0x556b7e80aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:44:07.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.316+0000 7f8bad92ab80 1 --2- 172.21.15.46:0/258648227 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556b7e80a5d0 0x556b7e80aa50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8b84005bf0 tx=0x7f8b840970d0 comp rx=0 tx=0).stop 2023-10-19T12:44:07.323 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.317+0000 7f8bad92ab80 1 -- 172.21.15.46:0/258648227 shutdown_connections 2023-10-19T12:44:07.323 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.317+0000 7f8bad92ab80 1 --2- 172.21.15.46:0/258648227 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556b7e80a5d0 0x556b7e80aa50 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:07.323 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.317+0000 7f8bad92ab80 1 --2- 172.21.15.46:0/258648227 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556b7e80b2d0 0x556b7e80b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:07.323 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.317+0000 7f8bad92ab80 1 --2- 172.21.15.46:0/258648227 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556b7e80bc30 0x556b7e80a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:07.323 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.317+0000 7f8bad92ab80 1 -- 172.21.15.46:0/258648227 >> 172.21.15.46:0/258648227 conn(0x556b7e77e720 msgr2=0x556b7e804b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:44:07.324 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.317+0000 7f8bad92ab80 1 -- 172.21.15.46:0/258648227 shutdown_connections 2023-10-19T12:44:07.324 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.317+0000 7f8bad92ab80 1 -- 172.21.15.46:0/258648227 wait complete. 2023-10-19T12:44:07.324 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.318+0000 7f8bad92ab80 1 -- start start 2023-10-19T12:44:07.324 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.318+0000 7f8bad92ab80 1 Processor -- start 2023-10-19T12:44:07.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.319+0000 7f8bad92ab80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556b7e80a5d0 0x556b7e8138a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:07.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.319+0000 7f8bad92ab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556b7e80b2d0 0x556b7e813de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:07.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.319+0000 7f8bad92ab80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556b7e80bc30 0x556b7e81ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:07.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.319+0000 7f8bad92ab80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b7e75ce70 con 0x556b7e80a5d0 2023-10-19T12:44:07.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.319+0000 7f8bad92ab80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b7e6f9710 con 0x556b7e80bc30 2023-10-19T12:44:07.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.319+0000 7f8bad92ab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b7e6f93b0 con 0x556b7e80b2d0 2023-10-19T12:44:07.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.319+0000 7f8bad92ab80 10 client.0 _ll_register_callbacks cb 0x556b7e643a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:44:07.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.320+0000 7f8b92ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556b7e80b2d0 0x556b7e813de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:07.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.320+0000 7f8b92ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556b7e80b2d0 0x556b7e813de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:49886/0 (socket says 172.21.15.46:49886) 2023-10-19T12:44:07.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.320+0000 7f8b92ffd700 1 -- 172.21.15.46:0/2780585812 learned_addr learned my addr 172.21.15.46:0/2780585812 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:44:07.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.320+0000 7f8b93fff700 1 --2- 172.21.15.46:0/2780585812 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556b7e80bc30 0x556b7e81ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:07.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.320+0000 7f8b92ffd700 1 -- 172.21.15.46:0/2780585812 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556b7e80bc30 msgr2=0x556b7e81ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:44:07.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.320+0000 7f8b92ffd700 1 --2- 172.21.15.46:0/2780585812 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556b7e80bc30 0x556b7e81ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:07.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.320+0000 7f8b92ffd700 1 -- 172.21.15.46:0/2780585812 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556b7e80a5d0 msgr2=0x556b7e8138a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:44:07.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.320+0000 7f8b92ffd700 1 --2- 172.21.15.46:0/2780585812 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556b7e80a5d0 0x556b7e8138a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:07.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.320+0000 7f8b92ffd700 1 -- 172.21.15.46:0/2780585812 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b9419c960 con 0x556b7e80b2d0 2023-10-19T12:44:07.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.321+0000 7f8b93fff700 1 --2- 172.21.15.46:0/2780585812 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556b7e80bc30 0x556b7e81ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:44:07.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.322+0000 7f8b92ffd700 1 --2- 172.21.15.46:0/2780585812 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556b7e80b2d0 0x556b7e813de0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c0126d0 tx=0x7f8b7c0047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ce52b409f612315 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:44:07.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.322+0000 7f8b72ffd700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-10-19T12:44:07.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.323+0000 7f8b72ffd700 1 -- 172.21.15.46:0/2780585812 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b7c01f830 con 0x556b7e80b2d0 2023-10-19T12:44:07.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.323+0000 7f8b72ffd700 1 -- 172.21.15.46:0/2780585812 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f8b7c018070 con 0x556b7e80b2d0 2023-10-19T12:44:07.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.323+0000 7f8bad92ab80 1 -- 172.21.15.46:0/2780585812 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556b7e761ef0 con 0x556b7e80b2d0 2023-10-19T12:44:07.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.324+0000 7f8b72ffd700 1 -- 172.21.15.46:0/2780585812 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8b7c01f990 con 0x556b7e80b2d0 2023-10-19T12:44:07.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.324+0000 7f8bad92ab80 10 client.25723 fetch_fsmap learned FSMap version 29 2023-10-19T12:44:07.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.324+0000 7f8bad92ab80 1 -- 172.21.15.46:0/2780585812 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x556b7e587de0 con 0x556b7e80b2d0 2023-10-19T12:44:07.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.325+0000 7f8b72ffd700 1 -- 172.21.15.46:0/2780585812 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x556b7e761ef0 con 0x556b7e80b2d0 2023-10-19T12:44:07.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.325+0000 7f8b72ffd700 1 -- 172.21.15.46:0/2780585812 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 29) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f8b7c031ce0 con 0x556b7e80b2d0 2023-10-19T12:44:07.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.325+0000 7f8bad92ab80 10 client.25723 fetch_fsmap finished waiting for FSMap version 29 2023-10-19T12:44:07.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.325+0000 7f8bad92ab80 10 client.25723 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-19T12:44:07.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.325+0000 7f8bad92ab80 20 client.25723 populate_metadata read hostname 'smithi046' 2023-10-19T12:44:07.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.325+0000 7f8bad92ab80 1 --2- 172.21.15.46:0/2780585812 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x556b7e81f7b0 0x556b7e821bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:07.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.325+0000 7f8bad92ab80 4 client.25723 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-19T12:44:07.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.325+0000 7f8bad92ab80 1 -- 172.21.15.46:0/2780585812 --> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556b7e7d98b0 con 0x556b7e81f7b0 2023-10-19T12:44:07.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.326+0000 7f8b937fe700 1 --2- 172.21.15.46:0/2780585812 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x556b7e81f7b0 0x556b7e821bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:07.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.326+0000 7f8b937fe700 1 --2- 172.21.15.46:0/2780585812 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x556b7e81f7b0 0x556b7e821bd0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e20518f6f14314ba server_cookie=2c45fa949b76657 in_seq=0 out_seq=0 2023-10-19T12:44:07.336 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.326+0000 7f8b72ffd700 10 client.25723 ms_handle_connect on v2:172.21.15.157:6838/552718978 2023-10-19T12:44:07.336 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.327+0000 7f8b72ffd700 1 -- 172.21.15.46:0/2780585812 <== mds.0 v2:172.21.15.157:6838/552718978 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x556b7e7d98b0 con 0x556b7e81f7b0 2023-10-19T12:44:07.336 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.327+0000 7f8b72ffd700 10 client.25723 handle_command_reply: tid=0 2023-10-19T12:44:07.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.328+0000 7f8bad92ab80 1 client.25723 shutdown 2023-10-19T12:44:07.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.328+0000 7f8bad92ab80 1 -- 172.21.15.46:0/2780585812 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556b7e80b2d0 msgr2=0x556b7e813de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:44:07.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.328+0000 7f8bad92ab80 1 --2- 172.21.15.46:0/2780585812 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556b7e80b2d0 0x556b7e813de0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c0126d0 tx=0x7f8b7c0047c0 comp rx=0 tx=0).stop 2023-10-19T12:44:07.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.328+0000 7f8bad92ab80 1 -- 172.21.15.46:0/2780585812 shutdown_connections 2023-10-19T12:44:07.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.328+0000 7f8bad92ab80 1 --2- 172.21.15.46:0/2780585812 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556b7e80bc30 0x556b7e81ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:07.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.328+0000 7f8bad92ab80 1 --2- 172.21.15.46:0/2780585812 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x556b7e81f7b0 0x556b7e821bd0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:07.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.328+0000 7f8bad92ab80 1 --2- 172.21.15.46:0/2780585812 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556b7e80a5d0 0x556b7e8138a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:07.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.328+0000 7f8bad92ab80 1 --2- 172.21.15.46:0/2780585812 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556b7e80b2d0 0x556b7e813de0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:07.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.328+0000 7f8bad92ab80 1 -- 172.21.15.46:0/2780585812 >> 172.21.15.46:0/2780585812 conn(0x556b7e77e720 msgr2=0x556b7e809080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:44:07.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.328+0000 7f8b72ffd700 0 client.25723 ms_handle_reset on v2:172.21.15.157:6838/552718978 2023-10-19T12:44:07.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.329+0000 7f8bad92ab80 1 -- 172.21.15.46:0/2780585812 shutdown_connections 2023-10-19T12:44:07.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.329+0000 7f8bad92ab80 1 -- 172.21.15.46:0/2780585812 wait complete. 2023-10-19T12:44:07.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.330+0000 7f8bad92ab80 20 client.25723 trim_cache size 0 max 16384 2023-10-19T12:44:07.358 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.355+0000 7f8bad92ab80 1 Processor -- start 2023-10-19T12:44:07.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.356+0000 7f8bad92ab80 1 -- start start 2023-10-19T12:44:07.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.356+0000 7f8bad92ab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556b7e80a5d0 0x556b7e813880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:07.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.356+0000 7f8bad92ab80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556b7e80b2d0 0x556b7e81ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:07.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.356+0000 7f8bad92ab80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556b7e80bc30 0x556b7e813dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:07.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.356+0000 7f8bad92ab80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b7e5dd920 con 0x556b7e80b2d0 2023-10-19T12:44:07.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.356+0000 7f8bad92ab80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b7e806b80 con 0x556b7e80bc30 2023-10-19T12:44:07.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.356+0000 7f8bad92ab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b7e812880 con 0x556b7e80a5d0 2023-10-19T12:44:07.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.356+0000 7f8b92ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556b7e80b2d0 0x556b7e81ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:07.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.356+0000 7f8b937fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556b7e80a5d0 0x556b7e813880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:07.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.356+0000 7f8b92ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556b7e80b2d0 0x556b7e81ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55488/0 (socket says 172.21.15.46:55488) 2023-10-19T12:44:07.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.356+0000 7f8b92ffd700 1 -- 172.21.15.46:0/71120917 learned_addr learned my addr 172.21.15.46:0/71120917 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:44:07.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.357+0000 7f8b93fff700 1 --2- 172.21.15.46:0/71120917 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556b7e80bc30 0x556b7e813dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:07.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.357+0000 7f8b92ffd700 1 -- 172.21.15.46:0/71120917 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556b7e80a5d0 msgr2=0x556b7e813880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:44:07.363 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.357+0000 7f8b92ffd700 1 --2- 172.21.15.46:0/71120917 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556b7e80a5d0 0x556b7e813880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:07.363 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.357+0000 7f8b92ffd700 1 -- 172.21.15.46:0/71120917 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556b7e80bc30 msgr2=0x556b7e813dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:44:07.363 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.357+0000 7f8b92ffd700 1 --2- 172.21.15.46:0/71120917 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556b7e80bc30 0x556b7e813dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:07.363 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.357+0000 7f8b92ffd700 1 -- 172.21.15.46:0/71120917 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556b7e570c60 con 0x556b7e80b2d0 2023-10-19T12:44:07.364 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.357+0000 7f8b92ffd700 1 --2- 172.21.15.46:0/71120917 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556b7e80b2d0 0x556b7e81ade0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c027510 tx=0x7f8b7c012d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=801b65c98d03d7b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:44:07.364 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.358+0000 7f8b8a7fc700 1 -- 172.21.15.46:0/71120917 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b7c027900 con 0x556b7e80b2d0 2023-10-19T12:44:07.364 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.358+0000 7f8b8a7fc700 1 -- 172.21.15.46:0/71120917 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8b7c016070 con 0x556b7e80b2d0 2023-10-19T12:44:07.364 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.358+0000 7f8b8a7fc700 1 -- 172.21.15.46:0/71120917 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b7c01fdd0 con 0x556b7e80b2d0 2023-10-19T12:44:07.364 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.359+0000 7f8bad92ab80 1 -- 172.21.15.46:0/71120917 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556b7e80b2d0 msgr2=0x556b7e81ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:44:07.365 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.359+0000 7f8bad92ab80 1 --2- 172.21.15.46:0/71120917 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556b7e80b2d0 0x556b7e81ade0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c027510 tx=0x7f8b7c012d70 comp rx=0 tx=0).stop 2023-10-19T12:44:07.365 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.359+0000 7f8bad92ab80 1 -- 172.21.15.46:0/71120917 shutdown_connections 2023-10-19T12:44:07.365 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.359+0000 7f8bad92ab80 1 --2- 172.21.15.46:0/71120917 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556b7e80bc30 0x556b7e813dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:07.365 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.359+0000 7f8bad92ab80 1 --2- 172.21.15.46:0/71120917 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556b7e80a5d0 0x556b7e813880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:07.365 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.359+0000 7f8bad92ab80 1 --2- 172.21.15.46:0/71120917 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556b7e80b2d0 0x556b7e81ade0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:07.366 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.359+0000 7f8bad92ab80 1 -- 172.21.15.46:0/71120917 >> 172.21.15.46:0/71120917 conn(0x556b7e77e720 msgr2=0x556b7e812db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:44:07.366 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.360+0000 7f8bad92ab80 1 -- 172.21.15.46:0/71120917 shutdown_connections 2023-10-19T12:44:07.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.360+0000 7f8bad92ab80 1 -- 172.21.15.46:0/71120917 wait complete. 2023-10-19T12:44:07.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.360+0000 7f8bad92ab80 1 -- start start 2023-10-19T12:44:07.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.361+0000 7f8bad92ab80 1 Processor -- start 2023-10-19T12:44:07.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.362+0000 7f8bad92ab80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556b7e80a5d0 0x556b7e81a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:07.367 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.362+0000 7f8bad92ab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556b7e80b2d0 0x556b7e81ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:07.368 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.362+0000 7f8bad92ab80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556b7e80bc30 0x556b7e818fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:07.368 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.362+0000 7f8bad92ab80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b7e8196f0 con 0x556b7e80a5d0 2023-10-19T12:44:07.368 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.362+0000 7f8bad92ab80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b7e819860 con 0x556b7e80bc30 2023-10-19T12:44:07.368 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.362+0000 7f8bad92ab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b7e819a20 con 0x556b7e80b2d0 2023-10-19T12:44:07.368 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.362+0000 7f8bad92ab80 10 client.0 _ll_register_callbacks cb 0x556b7e643a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:44:07.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.363+0000 7f8b93fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556b7e80bc30 0x556b7e818fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:07.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.363+0000 7f8b93fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556b7e80bc30 0x556b7e818fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:40396/0 (socket says 172.21.15.46:40396) 2023-10-19T12:44:07.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.363+0000 7f8b93fff700 1 -- 172.21.15.46:0/1345537253 learned_addr learned my addr 172.21.15.46:0/1345537253 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:44:07.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.363+0000 7f8b937fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556b7e80a5d0 0x556b7e81a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:07.369 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.363+0000 7f8b92ffd700 1 --2- 172.21.15.46:0/1345537253 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556b7e80b2d0 0x556b7e81ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:07.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.364+0000 7f8b93fff700 1 -- 172.21.15.46:0/1345537253 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556b7e80b2d0 msgr2=0x556b7e81ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:44:07.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.364+0000 7f8b93fff700 1 --2- 172.21.15.46:0/1345537253 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556b7e80b2d0 0x556b7e81ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:07.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.364+0000 7f8b93fff700 1 -- 172.21.15.46:0/1345537253 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556b7e80a5d0 msgr2=0x556b7e81a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:44:07.372 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.364+0000 7f8b93fff700 1 --2- 172.21.15.46:0/1345537253 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556b7e80a5d0 0x556b7e81a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:07.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.364+0000 7f8b93fff700 1 -- 172.21.15.46:0/1345537253 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556b7e587de0 con 0x556b7e80bc30 2023-10-19T12:44:07.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.364+0000 7f8b93fff700 1 --2- 172.21.15.46:0/1345537253 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556b7e80bc30 0x556b7e818fe0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8b84097160 tx=0x7f8b84003680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59399080bf972a69 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:44:07.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.364+0000 7f8b72ffd700 10 client.0 ms_handle_connect on v2:172.21.15.157:3300/0 2023-10-19T12:44:07.373 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.365+0000 7f8b72ffd700 1 -- 172.21.15.46:0/1345537253 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b8409b360 con 0x556b7e80bc30 2023-10-19T12:44:07.374 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.365+0000 7f8b72ffd700 1 -- 172.21.15.46:0/1345537253 <== mon.2 v2:172.21.15.157:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f8b8409ac60 con 0x556b7e80bc30 2023-10-19T12:44:07.375 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.365+0000 7f8bad92ab80 1 -- 172.21.15.46:0/1345537253 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8b8400b940 con 0x556b7e80bc30 2023-10-19T12:44:07.375 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.365+0000 7f8b72ffd700 1 -- 172.21.15.46:0/1345537253 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8b8409edb0 con 0x556b7e80bc30 2023-10-19T12:44:07.376 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.365+0000 7f8bad92ab80 10 client.25712 fetch_fsmap learned FSMap version 29 2023-10-19T12:44:07.376 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.365+0000 7f8bad92ab80 1 -- 172.21.15.46:0/1345537253 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x556b7e5ae250 con 0x556b7e80bc30 2023-10-19T12:44:07.376 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.366+0000 7f8b72ffd700 1 -- 172.21.15.46:0/1345537253 <== mon.2 v2:172.21.15.157:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8b8400b940 con 0x556b7e80bc30 2023-10-19T12:44:07.376 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.366+0000 7f8b72ffd700 1 -- 172.21.15.46:0/1345537253 <== mon.2 v2:172.21.15.157:3300/0 5 ==== fsmap(e 29) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f8b8409aec0 con 0x556b7e80bc30 2023-10-19T12:44:07.377 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.366+0000 7f8bad92ab80 10 client.25712 fetch_fsmap finished waiting for FSMap version 29 2023-10-19T12:44:07.377 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.366+0000 7f8bad92ab80 10 client.25712 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-19T12:44:07.377 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.366+0000 7f8bad92ab80 20 client.25712 populate_metadata read hostname 'smithi046' 2023-10-19T12:44:07.377 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.366+0000 7f8bad92ab80 1 --2- 172.21.15.46:0/1345537253 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x556b7e8747e0 0x556b7e876c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:07.377 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.366+0000 7f8bad92ab80 4 client.25712 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-19T12:44:07.378 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.366+0000 7f8bad92ab80 1 -- 172.21.15.46:0/1345537253 --> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x556b7e755e50 con 0x556b7e8747e0 2023-10-19T12:44:07.378 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.367+0000 7f8b937fe700 1 --2- 172.21.15.46:0/1345537253 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x556b7e8747e0 0x556b7e876c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:07.378 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.367+0000 7f8b937fe700 1 --2- 172.21.15.46:0/1345537253 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x556b7e8747e0 0x556b7e876c00 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa8a3df529b0ed2 server_cookie=fcfcb8e273ad2e9c in_seq=0 out_seq=0 2023-10-19T12:44:07.378 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.367+0000 7f8b72ffd700 10 client.25712 ms_handle_connect on v2:172.21.15.157:6838/552718978 2023-10-19T12:44:07.378 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.368+0000 7f8b72ffd700 1 -- 172.21.15.46:0/1345537253 <== mds.0 v2:172.21.15.157:6838/552718978 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x556b7e755e50 con 0x556b7e8747e0 2023-10-19T12:44:07.379 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.368+0000 7f8b72ffd700 10 client.25712 handle_command_reply: tid=0 2023-10-19T12:44:07.379 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.368+0000 7f8bad92ab80 1 client.25712 shutdown 2023-10-19T12:44:07.379 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.368+0000 7f8bad92ab80 1 -- 172.21.15.46:0/1345537253 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556b7e80bc30 msgr2=0x556b7e818fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:44:07.379 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.368+0000 7f8bad92ab80 1 --2- 172.21.15.46:0/1345537253 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556b7e80bc30 0x556b7e818fe0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8b84097160 tx=0x7f8b84003680 comp rx=0 tx=0).stop 2023-10-19T12:44:07.379 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.368+0000 7f8bad92ab80 1 -- 172.21.15.46:0/1345537253 shutdown_connections 2023-10-19T12:44:07.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.368+0000 7f8bad92ab80 1 --2- 172.21.15.46:0/1345537253 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x556b7e80bc30 0x556b7e818fe0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:07.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.368+0000 7f8bad92ab80 1 --2- 172.21.15.46:0/1345537253 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x556b7e8747e0 0x556b7e876c00 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:07.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.368+0000 7f8bad92ab80 1 --2- 172.21.15.46:0/1345537253 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556b7e80a5d0 0x556b7e81a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:07.380 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.368+0000 7f8bad92ab80 1 --2- 172.21.15.46:0/1345537253 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556b7e80b2d0 0x556b7e81ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:07.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.368+0000 7f8bad92ab80 1 -- 172.21.15.46:0/1345537253 >> 172.21.15.46:0/1345537253 conn(0x556b7e77e720 msgr2=0x556b7e813840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:44:07.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.369+0000 7f8b72ffd700 0 client.25712 ms_handle_reset on v2:172.21.15.157:6838/552718978 2023-10-19T12:44:07.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.369+0000 7f8bad92ab80 1 -- 172.21.15.46:0/1345537253 shutdown_connections 2023-10-19T12:44:07.381 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.369+0000 7f8bad92ab80 1 -- 172.21.15.46:0/1345537253 wait complete. 2023-10-19T12:44:07.382 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.369+0000 7f8bad92ab80 20 client.25712 trim_cache size 0 max 16384 2023-10-19T12:44:07.382 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-10-19T12:44:07.383 INFO:teuthology.orchestra.run.smithi046.stdout: "status": "no active scrubs running", 2023-10-19T12:44:07.383 INFO:teuthology.orchestra.run.smithi046.stdout: "scrubs": {} 2023-10-19T12:44:07.383 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-10-19T12:44:07.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.370+0000 7f8b99fff700 1 -- 172.21.15.46:0/571504846 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f8b800b2610 msgr2=0x7f8b800b4ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:44:07.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.370+0000 7f8b99fff700 1 --2- 172.21.15.46:0/571504846 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f8b800b2610 0x7f8b800b4ad0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c005fd0 tx=0x7f8b7c009310 comp rx=0 tx=0).stop 2023-10-19T12:44:07.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.370+0000 7f8b99fff700 1 -- 172.21.15.46:0/571504846 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8b94104560 msgr2=0x7f8b9419bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:44:07.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.370+0000 7f8b99fff700 1 --2- 172.21.15.46:0/571504846 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8b94104560 0x7f8b9419bad0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8b84014fd0 tx=0x7f8b8401ad20 comp rx=0 tx=0).stop 2023-10-19T12:44:07.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.371+0000 7f8b99fff700 1 -- 172.21.15.46:0/571504846 shutdown_connections 2023-10-19T12:44:07.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.371+0000 7f8b99fff700 1 --2- 172.21.15.46:0/571504846 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8b94104560 0x7f8b9419bad0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:07.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.371+0000 7f8b99fff700 1 --2- 172.21.15.46:0/571504846 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f8b800b2610 0x7f8b800b4ad0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:07.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.371+0000 7f8b99fff700 1 --2- 172.21.15.46:0/571504846 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8b941029d0 0x7f8b94194570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:07.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.371+0000 7f8b99fff700 1 --2- 172.21.15.46:0/571504846 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b94103bc0 0x7f8b94194ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:07.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.371+0000 7f8b99fff700 1 -- 172.21.15.46:0/571504846 >> 172.21.15.46:0/571504846 conn(0x7f8b940fdf40 msgr2=0x7f8b940fe6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:44:07.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.371+0000 7f8b99fff700 1 -- 172.21.15.46:0/571504846 shutdown_connections 2023-10-19T12:44:07.386 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.371+0000 7f8b99fff700 1 -- 172.21.15.46:0/571504846 wait complete. 2023-10-19T12:44:07.404 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-19T12:44:07.405 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-19T12:44:07.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.721+0000 7fd45d5ff700 1 -- 172.21.15.46:0/815867380 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4581063f0 msgr2=0x7fd458108860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:44:07.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.721+0000 7fd45d5ff700 1 --2- 172.21.15.46:0/815867380 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4581063f0 0x7fd458108860 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fd450009990 tx=0x7fd450009ca0 comp rx=0 tx=0).stop 2023-10-19T12:44:07.726 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.722+0000 7fd45d5ff700 1 -- 172.21.15.46:0/815867380 shutdown_connections 2023-10-19T12:44:07.726 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.722+0000 7fd45d5ff700 1 --2- 172.21.15.46:0/815867380 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4581063f0 0x7fd458108860 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:07.726 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.722+0000 7fd45d5ff700 1 --2- 172.21.15.46:0/815867380 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd458101190 0x7fd458103580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:07.726 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.722+0000 7fd45d5ff700 1 --2- 172.21.15.46:0/815867380 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd458103ac0 0x7fd458105eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:07.726 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.722+0000 7fd45d5ff700 1 -- 172.21.15.46:0/815867380 >> 172.21.15.46:0/815867380 conn(0x7fd4580faba0 msgr2=0x7fd4580fcfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:44:07.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.722+0000 7fd45d5ff700 1 -- 172.21.15.46:0/815867380 shutdown_connections 2023-10-19T12:44:07.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.722+0000 7fd45d5ff700 1 -- 172.21.15.46:0/815867380 wait complete. 2023-10-19T12:44:07.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.724+0000 7fd45d5ff700 1 Processor -- start 2023-10-19T12:44:07.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.724+0000 7fd45d5ff700 1 -- start start 2023-10-19T12:44:07.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.724+0000 7fd45d5ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd458101190 0x7fd458196580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:07.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.724+0000 7fd45d5ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd458103ac0 0x7fd458196ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:07.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.725+0000 7fd45d5ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4581063f0 0x7fd45819dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:07.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.725+0000 7fd45d5ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd45819e0b0 con 0x7fd4581063f0 2023-10-19T12:44:07.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.725+0000 7fd45d5ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd45819e1f0 con 0x7fd458103ac0 2023-10-19T12:44:07.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.725+0000 7fd45d5ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd45819e380 con 0x7fd458101190 2023-10-19T12:44:07.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.725+0000 7fd44e7fc700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd458103ac0 0x7fd458196ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:07.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.725+0000 7fd456ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd458101190 0x7fd458196580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:07.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.725+0000 7fd44e7fc700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd458103ac0 0x7fd458196ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:40426/0 (socket says 172.21.15.46:40426) 2023-10-19T12:44:07.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.725+0000 7fd44e7fc700 1 -- 172.21.15.46:0/2098659298 learned_addr learned my addr 172.21.15.46:0/2098659298 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:44:07.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.725+0000 7fd4577fe700 1 --2- 172.21.15.46:0/2098659298 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4581063f0 0x7fd45819dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:07.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.725+0000 7fd456ffd700 1 -- 172.21.15.46:0/2098659298 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd458103ac0 msgr2=0x7fd458196ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:44:07.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.725+0000 7fd456ffd700 1 --2- 172.21.15.46:0/2098659298 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd458103ac0 0x7fd458196ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:07.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.725+0000 7fd456ffd700 1 -- 172.21.15.46:0/2098659298 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4581063f0 msgr2=0x7fd45819dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:44:07.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.725+0000 7fd456ffd700 1 --2- 172.21.15.46:0/2098659298 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4581063f0 0x7fd45819dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:07.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.725+0000 7fd456ffd700 1 -- 172.21.15.46:0/2098659298 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4500095f0 con 0x7fd458101190 2023-10-19T12:44:07.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.726+0000 7fd4577fe700 1 --2- 172.21.15.46:0/2098659298 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4581063f0 0x7fd45819dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T12:44:07.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.726+0000 7fd456ffd700 1 --2- 172.21.15.46:0/2098659298 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd458101190 0x7fd458196580 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd44800c970 tx=0x7fd44800cc80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:44:07.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.726+0000 7fd454ff9700 1 -- 172.21.15.46:0/2098659298 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd448004440 con 0x7fd458101190 2023-10-19T12:44:07.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.726+0000 7fd454ff9700 1 -- 172.21.15.46:0/2098659298 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd44800ce60 con 0x7fd458101190 2023-10-19T12:44:07.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.726+0000 7fd454ff9700 1 -- 172.21.15.46:0/2098659298 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd448003c70 con 0x7fd458101190 2023-10-19T12:44:07.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.727+0000 7fd45d5ff700 1 -- 172.21.15.46:0/2098659298 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4580fefe0 con 0x7fd458101190 2023-10-19T12:44:07.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.727+0000 7fd45d5ff700 1 -- 172.21.15.46:0/2098659298 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4580ff4a0 con 0x7fd458101190 2023-10-19T12:44:07.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.729+0000 7fd45d5ff700 1 -- 172.21.15.46:0/2098659298 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4580fc720 con 0x7fd458101190 2023-10-19T12:44:07.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.731+0000 7fd454ff9700 1 -- 172.21.15.46:0/2098659298 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fd448007cb0 con 0x7fd458101190 2023-10-19T12:44:07.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.732+0000 7fd454ff9700 1 --2- 172.21.15.46:0/2098659298 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fd4440a5910 0x7fd4440a7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:07.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.733+0000 7fd454ff9700 1 -- 172.21.15.46:0/2098659298 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7fd4480ccce0 con 0x7fd458101190 2023-10-19T12:44:07.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.733+0000 7fd44e7fc700 1 --2- 172.21.15.46:0/2098659298 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fd4440a5910 0x7fd4440a7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:07.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.733+0000 7fd44e7fc700 1 --2- 172.21.15.46:0/2098659298 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fd4440a5910 0x7fd4440a7dd0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd4400094f0 tx=0x7fd440009040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:44:07.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:07.736+0000 7fd454ff9700 1 -- 172.21.15.46:0/2098659298 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd448095f10 con 0x7fd458101190 2023-10-19T12:44:08.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:44:07 smithi157 ceph-mon[134109]: pgmap v372: 129 pgs: 129 active+clean; 779 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 68 MiB/s wr, 148 op/s 2023-10-19T12:44:08.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:44:07 smithi195 ceph-mon[134493]: pgmap v372: 129 pgs: 129 active+clean; 779 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 68 MiB/s wr, 148 op/s 2023-10-19T12:44:08.225 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.222+0000 7fd45d5ff700 1 -- 172.21.15.46:0/2098659298 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd458067500 con 0x7fd458101190 2023-10-19T12:44:08.225 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.223+0000 7fd454ff9700 1 -- 172.21.15.46:0/2098659298 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+11379 (secure 0 0 0) 0x7fd448099530 con 0x7fd458101190 2023-10-19T12:44:08.226 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:44:08.226 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14580,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/2235286008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":2235286008},{"type":"v1","addr":"172.21.15.46:6835","nonce":2235286008}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14592,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/339398444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":339398444},{"type":"v1","addr":"172.21.15.46:6837","nonce":339398444}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-19T12:41:18.815780+0000","modified":"2023-10-19T12:43:52.248360+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24680,"mds_1":24655,"mds_2":24643,"mds_3":24631,"mds_4":24629},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14640":{"gid":14640,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.46:6839/1655843965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":1655843965},{"type":"v1","addr":"172.21.15.46:6839","nonce":1655843965}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14652":{"gid":14652,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.46:6841/4204925553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6840","nonce":4204925553},{"type":"v1","addr":"172.21.15.46:6841","nonce":4204925553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24560":{"gid":24560,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.157:6833/1687745569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":1687745569},{"type":"v1","addr":"172.21.15.157:6833","nonce":1687745569}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24574":{"gid":24574,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.195:6833/3629933235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3629933235},{"type":"v1","addr":"172.21.15.195:6833","nonce":3629933235}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24602":{"gid":24602,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.157:6835/108432552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":108432552},{"type":"v1","addr":"172.21.15.157:6835","nonce":108432552}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24629":{"gid":24629,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":13,"addr":"172.21.15.157:6837/2629536514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6836","nonce":2629536514},{"type":"v1","addr":"172.21.15.157:6837","nonce":2629536514}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24631":{"gid":24631,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.195:6835/1406909915","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":1406909915},{"type":"v1","addr":"172.21.15.195:6835","nonce":1406909915}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24643":{"gid":24643,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":13,"addr":"172.21.15.195:6837/293916188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":293916188},{"type":"v1","addr":"172.21.15.195:6837","nonce":293916188}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24655":{"gid":24655,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":11,"addr":"172.21.15.195:6839/4094901934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6838","nonce":4094901934},{"type":"v1","addr":"172.21.15.195:6839","nonce":4094901934}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24680":{"gid":24680,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.157:6839/552718978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6838","nonce":552718978},{"type":"v1","addr":"172.21.15.157:6839","nonce":552718978}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-19T12:44:08.230 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.226+0000 7fd45d5ff700 1 -- 172.21.15.46:0/2098659298 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fd4440a5910 msgr2=0x7fd4440a7dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:44:08.230 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.226+0000 7fd45d5ff700 1 --2- 172.21.15.46:0/2098659298 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fd4440a5910 0x7fd4440a7dd0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd4400094f0 tx=0x7fd440009040 comp rx=0 tx=0).stop 2023-10-19T12:44:08.230 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.226+0000 7fd45d5ff700 1 -- 172.21.15.46:0/2098659298 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd458101190 msgr2=0x7fd458196580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:44:08.230 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.226+0000 7fd45d5ff700 1 --2- 172.21.15.46:0/2098659298 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd458101190 0x7fd458196580 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd44800c970 tx=0x7fd44800cc80 comp rx=0 tx=0).stop 2023-10-19T12:44:08.231 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.227+0000 7fd45d5ff700 1 -- 172.21.15.46:0/2098659298 shutdown_connections 2023-10-19T12:44:08.231 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.227+0000 7fd45d5ff700 1 --2- 172.21.15.46:0/2098659298 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4581063f0 0x7fd45819dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:08.231 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.227+0000 7fd45d5ff700 1 --2- 172.21.15.46:0/2098659298 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fd4440a5910 0x7fd4440a7dd0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:08.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.227+0000 7fd45d5ff700 1 --2- 172.21.15.46:0/2098659298 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd458101190 0x7fd458196580 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:08.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.227+0000 7fd45d5ff700 1 --2- 172.21.15.46:0/2098659298 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd458103ac0 0x7fd458196ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:08.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.227+0000 7fd45d5ff700 1 -- 172.21.15.46:0/2098659298 >> 172.21.15.46:0/2098659298 conn(0x7fd4580faba0 msgr2=0x7fd458101ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:44:08.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.227+0000 7fd45d5ff700 1 -- 172.21.15.46:0/2098659298 shutdown_connections 2023-10-19T12:44:08.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.227+0000 7fd45d5ff700 1 -- 172.21.15.46:0/2098659298 wait complete. 2023-10-19T12:44:08.233 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:44:07 smithi046 ceph-mon[98509]: pgmap v372: 129 pgs: 129 active+clean; 779 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 68 MiB/s wr, 148 op/s 2023-10-19T12:44:08.233 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 29 2023-10-19T12:44:08.261 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-10-19T12:44:08.626 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.623+0000 7f11d05ff700 1 -- 172.21.15.46:0/2705395909 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11c8104560 msgr2=0x7f11c810ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:44:08.627 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.623+0000 7f11d05ff700 1 --2- 172.21.15.46:0/2705395909 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11c8104560 0x7f11c810ae10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f11c00098f0 tx=0x7f11c0009c00 comp rx=0 tx=0).stop 2023-10-19T12:44:08.627 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.623+0000 7f11d05ff700 1 -- 172.21.15.46:0/2705395909 shutdown_connections 2023-10-19T12:44:08.627 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.623+0000 7f11d05ff700 1 --2- 172.21.15.46:0/2705395909 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11c8104560 0x7f11c810ae10 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:08.627 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.623+0000 7f11d05ff700 1 --2- 172.21.15.46:0/2705395909 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f11c81029d0 0x7f11c8102df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:08.628 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.623+0000 7f11d05ff700 1 --2- 172.21.15.46:0/2705395909 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f11c8103bc0 0x7f11c8104020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:08.628 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.623+0000 7f11d05ff700 1 -- 172.21.15.46:0/2705395909 >> 172.21.15.46:0/2705395909 conn(0x7f11c80fdf40 msgr2=0x7f11c8100380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:44:08.628 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.623+0000 7f11d05ff700 1 -- 172.21.15.46:0/2705395909 shutdown_connections 2023-10-19T12:44:08.628 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.623+0000 7f11d05ff700 1 -- 172.21.15.46:0/2705395909 wait complete. 2023-10-19T12:44:08.629 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.625+0000 7f11d05ff700 1 Processor -- start 2023-10-19T12:44:08.629 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.625+0000 7f11d05ff700 1 -- start start 2023-10-19T12:44:08.630 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.626+0000 7f11d05ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f11c81029d0 0x7f11c8198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:08.630 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.626+0000 7f11d05ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f11c8103bc0 0x7f11c8198dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:08.630 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.626+0000 7f11d05ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11c8104560 0x7f11c819fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:08.631 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.626+0000 7f11d05ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11c81a03b0 con 0x7f11c8103bc0 2023-10-19T12:44:08.631 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.626+0000 7f11d05ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11c81a04f0 con 0x7f11c81029d0 2023-10-19T12:44:08.631 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.626+0000 7f11d05ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11c81a0680 con 0x7f11c8104560 2023-10-19T12:44:08.631 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.627+0000 7f11ce39b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f11c81029d0 0x7f11c8198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:08.631 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.627+0000 7f11ce39b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f11c81029d0 0x7f11c8198880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:40438/0 (socket says 172.21.15.46:40438) 2023-10-19T12:44:08.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.627+0000 7f11ce39b700 1 -- 172.21.15.46:0/420547173 learned_addr learned my addr 172.21.15.46:0/420547173 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:44:08.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.627+0000 7f11ceb9c700 1 --2- 172.21.15.46:0/420547173 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11c8104560 0x7f11c819fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:08.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.628+0000 7f11cdb9a700 1 --2- 172.21.15.46:0/420547173 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f11c8103bc0 0x7f11c8198dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:08.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.628+0000 7f11ceb9c700 1 -- 172.21.15.46:0/420547173 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f11c81029d0 msgr2=0x7f11c8198880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:44:08.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.628+0000 7f11ceb9c700 1 --2- 172.21.15.46:0/420547173 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f11c81029d0 0x7f11c8198880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:08.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.628+0000 7f11ceb9c700 1 -- 172.21.15.46:0/420547173 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f11c8103bc0 msgr2=0x7f11c8198dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:44:08.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.628+0000 7f11ceb9c700 1 --2- 172.21.15.46:0/420547173 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f11c8103bc0 0x7f11c8198dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:08.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.628+0000 7f11ceb9c700 1 -- 172.21.15.46:0/420547173 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11c0009520 con 0x7f11c8104560 2023-10-19T12:44:08.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.628+0000 7f11cdb9a700 1 --2- 172.21.15.46:0/420547173 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f11c8103bc0 0x7f11c8198dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T12:44:08.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.628+0000 7f11ceb9c700 1 --2- 172.21.15.46:0/420547173 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11c8104560 0x7f11c819fde0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f11c000fba0 tx=0x7f11c000b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:44:08.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.629+0000 7f11c77fe700 1 -- 172.21.15.46:0/420547173 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c001c070 con 0x7f11c8104560 2023-10-19T12:44:08.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.629+0000 7f11c77fe700 1 -- 172.21.15.46:0/420547173 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f11c000f840 con 0x7f11c8104560 2023-10-19T12:44:08.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.629+0000 7f11c77fe700 1 -- 172.21.15.46:0/420547173 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c0003a80 con 0x7f11c8104560 2023-10-19T12:44:08.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.629+0000 7f11d05ff700 1 -- 172.21.15.46:0/420547173 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11c81a0900 con 0x7f11c8104560 2023-10-19T12:44:08.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.629+0000 7f11d05ff700 1 -- 172.21.15.46:0/420547173 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11c81a0cd0 con 0x7f11c8104560 2023-10-19T12:44:08.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.636+0000 7f11c77fe700 1 -- 172.21.15.46:0/420547173 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f11c0020070 con 0x7f11c8104560 2023-10-19T12:44:08.643 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.640+0000 7f11e3fc1b80 1 Processor -- start 2023-10-19T12:44:08.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.640+0000 7f11c77fe700 1 --2- 172.21.15.46:0/420547173 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f11b80a1500 0x7f11b80a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:08.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.641+0000 7f11c77fe700 1 -- 172.21.15.46:0/420547173 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f11c00cdb80 con 0x7f11c8104560 2023-10-19T12:44:08.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.641+0000 7f11e3fc1b80 1 -- start start 2023-10-19T12:44:08.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.642+0000 7f11cdb9a700 1 --2- 172.21.15.46:0/420547173 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f11b80a1500 0x7f11b80a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:08.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.642+0000 7f11e3fc1b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5587561cdae0 0x5587561cdf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:08.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.642+0000 7f11e3fc1b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5587561ce440 0x5587561cc8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:08.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.643+0000 7f11e3fc1b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5587561ccde0 0x5587561cd260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:08.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.643+0000 7f11e3fc1b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587561376e0 con 0x5587561ccde0 2023-10-19T12:44:08.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.643+0000 7f11e3fc1b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55875611dc60 con 0x5587561cdae0 2023-10-19T12:44:08.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.643+0000 7f11e3fc1b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55875611b580 con 0x5587561ce440 2023-10-19T12:44:08.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.643+0000 7f11cdb9a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5587561ce440 0x5587561cc8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:08.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.643+0000 7f11cdb9a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5587561ce440 0x5587561cc8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:49964/0 (socket says 172.21.15.46:49964) 2023-10-19T12:44:08.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.643+0000 7f11cdb9a700 1 -- 172.21.15.46:0/2076021207 learned_addr learned my addr 172.21.15.46:0/2076021207 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:44:08.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.643+0000 7f11cdb9a700 1 --2- 172.21.15.46:0/420547173 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f11b80a1500 0x7f11b80a39c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f11b4005fd0 tx=0x7f11b4009310 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:44:08.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.643+0000 7f11ce39b700 1 --2- 172.21.15.46:0/2076021207 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5587561cdae0 0x5587561cdf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:08.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.643+0000 7f11ceb9c700 1 --2- 172.21.15.46:0/2076021207 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5587561ccde0 0x5587561cd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:08.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.644+0000 7f11ce39b700 1 -- 172.21.15.46:0/2076021207 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5587561ce440 msgr2=0x5587561cc8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:44:08.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.644+0000 7f11ce39b700 1 --2- 172.21.15.46:0/2076021207 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5587561ce440 0x5587561cc8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:08.650 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.644+0000 7f11ce39b700 1 -- 172.21.15.46:0/2076021207 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5587561ccde0 msgr2=0x5587561cd260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:44:08.650 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.644+0000 7f11ce39b700 1 --2- 172.21.15.46:0/2076021207 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5587561ccde0 0x5587561cd260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:08.650 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.644+0000 7f11ce39b700 1 -- 172.21.15.46:0/2076021207 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5587560d43f0 con 0x5587561cdae0 2023-10-19T12:44:08.650 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.644+0000 7f11ce39b700 1 --2- 172.21.15.46:0/2076021207 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5587561cdae0 0x5587561cdf00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f11bc00f5a0 tx=0x7f11bc00f8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d752f199afb6264 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:44:08.651 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.645+0000 7f11c4bfe700 1 -- 172.21.15.46:0/2076021207 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11bc00fed0 con 0x5587561cdae0 2023-10-19T12:44:08.651 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.645+0000 7f11c4bfe700 1 -- 172.21.15.46:0/2076021207 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f11bc004bb0 con 0x5587561cdae0 2023-10-19T12:44:08.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.645+0000 7f11c4bfe700 1 -- 172.21.15.46:0/2076021207 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11bc0051e0 con 0x5587561cdae0 2023-10-19T12:44:08.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.646+0000 7f11e3fc1b80 1 -- 172.21.15.46:0/2076021207 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5587561cdae0 msgr2=0x5587561cdf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:44:08.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.646+0000 7f11e3fc1b80 1 --2- 172.21.15.46:0/2076021207 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5587561cdae0 0x5587561cdf00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f11bc00f5a0 tx=0x7f11bc00f8b0 comp rx=0 tx=0).stop 2023-10-19T12:44:08.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.646+0000 7f11e3fc1b80 1 -- 172.21.15.46:0/2076021207 shutdown_connections 2023-10-19T12:44:08.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.646+0000 7f11e3fc1b80 1 --2- 172.21.15.46:0/2076021207 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5587561ccde0 0x5587561cd260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:08.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.646+0000 7f11e3fc1b80 1 --2- 172.21.15.46:0/2076021207 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5587561cdae0 0x5587561cdf00 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:08.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.646+0000 7f11e3fc1b80 1 --2- 172.21.15.46:0/2076021207 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5587561ce440 0x5587561cc8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:08.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.646+0000 7f11e3fc1b80 1 -- 172.21.15.46:0/2076021207 >> 172.21.15.46:0/2076021207 conn(0x558756138720 msgr2=0x5587561beb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:44:08.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.647+0000 7f11e3fc1b80 1 -- 172.21.15.46:0/2076021207 shutdown_connections 2023-10-19T12:44:08.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.647+0000 7f11e3fc1b80 1 -- 172.21.15.46:0/2076021207 wait complete. 2023-10-19T12:44:08.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.647+0000 7f11e3fc1b80 1 -- start start 2023-10-19T12:44:08.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.648+0000 7f11e3fc1b80 1 Processor -- start 2023-10-19T12:44:08.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.649+0000 7f11e3fc1b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5587561ccde0 0x5587561d6300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:08.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.649+0000 7f11e3fc1b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5587561cdae0 0x5587561d6840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:08.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.649+0000 7f11e3fc1b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5587561ce440 0x5587561dd830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:08.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.649+0000 7f11e3fc1b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x558756116e70 con 0x5587561ce440 2023-10-19T12:44:08.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.649+0000 7f11e3fc1b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587560b3710 con 0x5587561cdae0 2023-10-19T12:44:08.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.649+0000 7f11e3fc1b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587560b33b0 con 0x5587561ccde0 2023-10-19T12:44:08.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.650+0000 7f11e3fc1b80 10 client.0 _ll_register_callbacks cb 0x558755ffda80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:44:08.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.650+0000 7f11cdb9a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5587561cdae0 0x5587561d6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:08.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.651+0000 7f11cdb9a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5587561cdae0 0x5587561d6840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:40454/0 (socket says 172.21.15.46:40454) 2023-10-19T12:44:08.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.651+0000 7f11cdb9a700 1 -- 172.21.15.46:0/902978789 learned_addr learned my addr 172.21.15.46:0/902978789 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:44:08.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.651+0000 7f11ceb9c700 1 --2- 172.21.15.46:0/902978789 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5587561ce440 0x5587561dd830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:08.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.650+0000 7f11ce39b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5587561ccde0 0x5587561d6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:08.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.652+0000 7f11cdb9a700 1 -- 172.21.15.46:0/902978789 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5587561ccde0 msgr2=0x5587561d6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:44:08.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.652+0000 7f11cdb9a700 1 --2- 172.21.15.46:0/902978789 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5587561ccde0 0x5587561d6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:08.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.652+0000 7f11cdb9a700 1 -- 172.21.15.46:0/902978789 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5587561ce440 msgr2=0x5587561dd830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:44:08.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.652+0000 7f11cdb9a700 1 --2- 172.21.15.46:0/902978789 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5587561ce440 0x5587561dd830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:08.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.652+0000 7f11cdb9a700 1 -- 172.21.15.46:0/902978789 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11bc00f1d0 con 0x5587561cdae0 2023-10-19T12:44:08.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.652+0000 7f11ceb9c700 1 --2- 172.21.15.46:0/902978789 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5587561ce440 0x5587561dd830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T12:44:08.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.653+0000 7f11cdb9a700 1 --2- 172.21.15.46:0/902978789 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5587561cdae0 0x5587561d6840 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f11b40124a0 tx=0x7f11b4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=499c08501f5fbd1 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:44:08.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.653+0000 7f11b1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.157:3300/0 2023-10-19T12:44:08.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.653+0000 7f11b1ffb700 1 -- 172.21.15.46:0/902978789 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b4029670 con 0x5587561cdae0 2023-10-19T12:44:08.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.654+0000 7f11b1ffb700 1 -- 172.21.15.46:0/902978789 <== mon.2 v2:172.21.15.157:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f11b40297d0 con 0x5587561cdae0 2023-10-19T12:44:08.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.654+0000 7f11e3fc1b80 1 -- 172.21.15.46:0/902978789 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55875611bef0 con 0x5587561cdae0 2023-10-19T12:44:08.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.655+0000 7f11b1ffb700 1 -- 172.21.15.46:0/902978789 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f11b4029990 con 0x5587561cdae0 2023-10-19T12:44:08.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.655+0000 7f11e3fc1b80 10 client.25730 fetch_fsmap learned FSMap version 29 2023-10-19T12:44:08.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.655+0000 7f11e3fc1b80 1 -- 172.21.15.46:0/902978789 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x558755f41de0 con 0x5587561cdae0 2023-10-19T12:44:08.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.656+0000 7f11b1ffb700 1 -- 172.21.15.46:0/902978789 <== mon.2 v2:172.21.15.157:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55875611bef0 con 0x5587561cdae0 2023-10-19T12:44:08.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.656+0000 7f11b1ffb700 1 -- 172.21.15.46:0/902978789 <== mon.2 v2:172.21.15.157:3300/0 5 ==== fsmap(e 29) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f11b4033700 con 0x5587561cdae0 2023-10-19T12:44:08.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.656+0000 7f11e3fc1b80 10 client.25730 fetch_fsmap finished waiting for FSMap version 29 2023-10-19T12:44:08.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.656+0000 7f11e3fc1b80 10 client.25730 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2023-10-19T12:44:08.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.656+0000 7f11e3fc1b80 20 client.25730 populate_metadata read hostname 'smithi046' 2023-10-19T12:44:08.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.656+0000 7f11e3fc1b80 1 --2- 172.21.15.46:0/902978789 >> [v2:172.21.15.157:6836/2629536514,v1:172.21.15.157:6837/2629536514] conn(0x5587561c54c0 0x5587561c78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:08.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.656+0000 7f11e3fc1b80 4 client.25730 mds_command: new command op to 24629 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-19T12:44:08.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.656+0000 7f11e3fc1b80 1 -- 172.21.15.46:0/902978789 --> [v2:172.21.15.157:6836/2629536514,v1:172.21.15.157:6837/2629536514] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5587561938b0 con 0x5587561c54c0 2023-10-19T12:44:08.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.656+0000 7f11ce39b700 1 --2- 172.21.15.46:0/902978789 >> [v2:172.21.15.157:6836/2629536514,v1:172.21.15.157:6837/2629536514] conn(0x5587561c54c0 0x5587561c78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:08.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.657+0000 7f11ce39b700 1 --2- 172.21.15.46:0/902978789 >> [v2:172.21.15.157:6836/2629536514,v1:172.21.15.157:6837/2629536514] conn(0x5587561c54c0 0x5587561c78e0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=3b4b3698a0b1e73 server_cookie=bb81a9350d13d5d8 in_seq=0 out_seq=0 2023-10-19T12:44:08.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.657+0000 7f11b1ffb700 10 client.25730 ms_handle_connect on v2:172.21.15.157:6836/2629536514 2023-10-19T12:44:08.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.658+0000 7f11b1ffb700 1 -- 172.21.15.46:0/902978789 <== mds.4 v2:172.21.15.157:6836/2629536514 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5587561938b0 con 0x5587561c54c0 2023-10-19T12:44:08.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.658+0000 7f11b1ffb700 10 client.25730 handle_command_reply: tid=0 2023-10-19T12:44:08.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.658+0000 7f11e3fc1b80 1 client.25730 shutdown 2023-10-19T12:44:08.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.659+0000 7f11e3fc1b80 1 -- 172.21.15.46:0/902978789 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5587561cdae0 msgr2=0x5587561d6840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:44:08.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.659+0000 7f11e3fc1b80 1 --2- 172.21.15.46:0/902978789 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5587561cdae0 0x5587561d6840 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f11b40124a0 tx=0x7f11b4004750 comp rx=0 tx=0).stop 2023-10-19T12:44:08.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.659+0000 7f11e3fc1b80 1 -- 172.21.15.46:0/902978789 shutdown_connections 2023-10-19T12:44:08.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.660+0000 7f11e3fc1b80 1 --2- 172.21.15.46:0/902978789 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5587561ce440 0x5587561dd830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:08.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.660+0000 7f11e3fc1b80 1 --2- 172.21.15.46:0/902978789 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5587561ccde0 0x5587561d6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:08.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.660+0000 7f11e3fc1b80 1 --2- 172.21.15.46:0/902978789 >> [v2:172.21.15.157:6836/2629536514,v1:172.21.15.157:6837/2629536514] conn(0x5587561c54c0 0x5587561c78e0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:08.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.660+0000 7f11e3fc1b80 1 --2- 172.21.15.46:0/902978789 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5587561cdae0 0x5587561d6840 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:08.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.660+0000 7f11e3fc1b80 1 -- 172.21.15.46:0/902978789 >> 172.21.15.46:0/902978789 conn(0x558756138720 msgr2=0x5587561cb890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:44:08.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.660+0000 7f11b1ffb700 0 client.25730 ms_handle_reset on v2:172.21.15.157:6836/2629536514 2023-10-19T12:44:08.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.660+0000 7f11e3fc1b80 1 -- 172.21.15.46:0/902978789 shutdown_connections 2023-10-19T12:44:08.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.660+0000 7f11e3fc1b80 1 -- 172.21.15.46:0/902978789 wait complete. 2023-10-19T12:44:08.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.661+0000 7f11e3fc1b80 20 client.25730 trim_cache size 0 max 16384 2023-10-19T12:44:08.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.683+0000 7f11e3fc1b80 1 Processor -- start 2023-10-19T12:44:08.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.683+0000 7f11e3fc1b80 1 -- start start 2023-10-19T12:44:08.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.683+0000 7f11e3fc1b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5587561ccde0 0x5587561d5810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:08.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.683+0000 7f11e3fc1b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5587561cdae0 0x5587561cc200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:08.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.683+0000 7f11e3fc1b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5587561ce440 0x5587561d6300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:08.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.685+0000 7f11ce39b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5587561ccde0 0x5587561d5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:08.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.685+0000 7f11ce39b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5587561ccde0 0x5587561d5810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55554/0 (socket says 172.21.15.46:55554) 2023-10-19T12:44:08.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.685+0000 7f11ce39b700 1 -- 172.21.15.46:0/470624092 learned_addr learned my addr 172.21.15.46:0/470624092 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:44:08.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.685+0000 7f11ceb9c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5587561ce440 0x5587561d6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:08.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.685+0000 7f11cdb9a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5587561cdae0 0x5587561cc200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:08.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.685+0000 7f11e3fc1b80 1 -- 172.21.15.46:0/470624092 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x558755f97920 con 0x5587561ccde0 2023-10-19T12:44:08.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.686+0000 7f11e3fc1b80 1 -- 172.21.15.46:0/470624092 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55875611bf20 con 0x5587561ce440 2023-10-19T12:44:08.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.686+0000 7f11e3fc1b80 1 -- 172.21.15.46:0/470624092 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587561c2890 con 0x5587561cdae0 2023-10-19T12:44:08.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.686+0000 7f11ce39b700 1 -- 172.21.15.46:0/470624092 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5587561cdae0 msgr2=0x5587561cc200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:44:08.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.686+0000 7f11ce39b700 1 --2- 172.21.15.46:0/470624092 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5587561cdae0 0x5587561cc200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:08.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.686+0000 7f11ce39b700 1 -- 172.21.15.46:0/470624092 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5587561ce440 msgr2=0x5587561d6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:44:08.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.686+0000 7f11ce39b700 1 --2- 172.21.15.46:0/470624092 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5587561ce440 0x5587561d6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:08.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.686+0000 7f11ce39b700 1 -- 172.21.15.46:0/470624092 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558755f2ac60 con 0x5587561ccde0 2023-10-19T12:44:08.692 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.687+0000 7f11ce39b700 1 --2- 172.21.15.46:0/470624092 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5587561ccde0 0x5587561d5810 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f11bc00f4c0 tx=0x7f11bc01f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=534028da6574faa7 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:44:08.692 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.688+0000 7f11c53ff700 1 -- 172.21.15.46:0/470624092 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11bc022040 con 0x5587561ccde0 2023-10-19T12:44:08.693 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.688+0000 7f11c53ff700 1 -- 172.21.15.46:0/470624092 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f11bc00b030 con 0x5587561ccde0 2023-10-19T12:44:08.693 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.688+0000 7f11c53ff700 1 -- 172.21.15.46:0/470624092 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11bc022040 con 0x5587561ccde0 2023-10-19T12:44:08.693 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.689+0000 7f11e3fc1b80 1 -- 172.21.15.46:0/470624092 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5587561ccde0 msgr2=0x5587561d5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:44:08.693 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.689+0000 7f11e3fc1b80 1 --2- 172.21.15.46:0/470624092 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5587561ccde0 0x5587561d5810 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f11bc00f4c0 tx=0x7f11bc01f040 comp rx=0 tx=0).stop 2023-10-19T12:44:08.694 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.690+0000 7f11e3fc1b80 1 -- 172.21.15.46:0/470624092 shutdown_connections 2023-10-19T12:44:08.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.690+0000 7f11e3fc1b80 1 --2- 172.21.15.46:0/470624092 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5587561ce440 0x5587561d6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:08.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.690+0000 7f11e3fc1b80 1 --2- 172.21.15.46:0/470624092 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5587561ccde0 0x5587561d5810 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:08.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.690+0000 7f11e3fc1b80 1 --2- 172.21.15.46:0/470624092 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5587561cdae0 0x5587561cc200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:08.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.690+0000 7f11e3fc1b80 1 -- 172.21.15.46:0/470624092 >> 172.21.15.46:0/470624092 conn(0x558756138720 msgr2=0x5587561beb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:44:08.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.691+0000 7f11e3fc1b80 1 -- 172.21.15.46:0/470624092 shutdown_connections 2023-10-19T12:44:08.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.691+0000 7f11e3fc1b80 1 -- 172.21.15.46:0/470624092 wait complete. 2023-10-19T12:44:08.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.691+0000 7f11e3fc1b80 1 -- start start 2023-10-19T12:44:08.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.691+0000 7f11e3fc1b80 1 Processor -- start 2023-10-19T12:44:08.697 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.692+0000 7f11e3fc1b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5587561ccde0 0x558756236760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:08.697 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.692+0000 7f11e3fc1b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5587561cdae0 0x558756236ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:08.697 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.692+0000 7f11e3fc1b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5587561ce440 0x55875623dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:08.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.692+0000 7f11e3fc1b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55875623e220 con 0x5587561ce440 2023-10-19T12:44:08.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.692+0000 7f11e3fc1b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55875623e360 con 0x5587561cdae0 2023-10-19T12:44:08.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.692+0000 7f11e3fc1b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55875623e4f0 con 0x5587561ccde0 2023-10-19T12:44:08.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.692+0000 7f11e3fc1b80 10 client.0 _ll_register_callbacks cb 0x558755ffda80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:44:08.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.693+0000 7f11cdb9a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5587561cdae0 0x558756236ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:08.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.693+0000 7f11ce39b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5587561ccde0 0x558756236760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:08.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.693+0000 7f11ce39b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5587561ccde0 0x558756236760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:49998/0 (socket says 172.21.15.46:49998) 2023-10-19T12:44:08.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.693+0000 7f11ce39b700 1 -- 172.21.15.46:0/3067629889 learned_addr learned my addr 172.21.15.46:0/3067629889 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:44:08.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.693+0000 7f11cdb9a700 1 --2- 172.21.15.46:0/3067629889 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5587561cdae0 0x558756236ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:40478/0 (socket says 172.21.15.46:40478) 2023-10-19T12:44:08.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.693+0000 7f11ceb9c700 1 --2- 172.21.15.46:0/3067629889 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5587561ce440 0x55875623dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:08.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.694+0000 7f11ce39b700 1 -- 172.21.15.46:0/3067629889 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5587561cdae0 msgr2=0x558756236ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:44:08.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.694+0000 7f11ce39b700 1 --2- 172.21.15.46:0/3067629889 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5587561cdae0 0x558756236ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:08.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.694+0000 7f11ce39b700 1 -- 172.21.15.46:0/3067629889 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5587561ce440 msgr2=0x55875623dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:44:08.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.694+0000 7f11ce39b700 1 --2- 172.21.15.46:0/3067629889 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5587561ce440 0x55875623dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:08.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.694+0000 7f11ce39b700 1 -- 172.21.15.46:0/3067629889 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5587560d43f0 con 0x5587561ccde0 2023-10-19T12:44:08.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.695+0000 7f11cdb9a700 1 --2- 172.21.15.46:0/3067629889 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5587561cdae0 0x558756236ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T12:44:08.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.695+0000 7f11b1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-10-19T12:44:08.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.695+0000 7f11ce39b700 1 --2- 172.21.15.46:0/3067629889 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5587561ccde0 0x558756236760 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f11bc0263b0 tx=0x7f11bc026490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73dade00fce06e5f server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:44:08.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.695+0000 7f11b1ffb700 1 -- 172.21.15.46:0/3067629889 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11bc026cc0 con 0x5587561ccde0 2023-10-19T12:44:08.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.695+0000 7f11b1ffb700 1 -- 172.21.15.46:0/3067629889 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f11bc026e20 con 0x5587561ccde0 2023-10-19T12:44:08.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.696+0000 7f11e3fc1b80 1 -- 172.21.15.46:0/3067629889 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f11bc004bb0 con 0x5587561ccde0 2023-10-19T12:44:08.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.696+0000 7f11b1ffb700 1 -- 172.21.15.46:0/3067629889 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f11bc003b00 con 0x5587561ccde0 2023-10-19T12:44:08.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.696+0000 7f11e3fc1b80 10 client.25750 fetch_fsmap learned FSMap version 29 2023-10-19T12:44:08.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.696+0000 7f11e3fc1b80 1 -- 172.21.15.46:0/3067629889 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x558755f68250 con 0x5587561ccde0 2023-10-19T12:44:08.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.697+0000 7f11b1ffb700 1 -- 172.21.15.46:0/3067629889 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f11bc004bb0 con 0x5587561ccde0 2023-10-19T12:44:08.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.697+0000 7f11b1ffb700 1 -- 172.21.15.46:0/3067629889 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 29) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f11bc025070 con 0x5587561ccde0 2023-10-19T12:44:08.704 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.697+0000 7f11e3fc1b80 10 client.25750 fetch_fsmap finished waiting for FSMap version 29 2023-10-19T12:44:08.704 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.697+0000 7f11e3fc1b80 10 client.25750 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2023-10-19T12:44:08.704 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.697+0000 7f11e3fc1b80 20 client.25750 populate_metadata read hostname 'smithi046' 2023-10-19T12:44:08.704 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.697+0000 7f11e3fc1b80 1 --2- 172.21.15.46:0/3067629889 >> [v2:172.21.15.157:6836/2629536514,v1:172.21.15.157:6837/2629536514] conn(0x55875623fc20 0x558756242040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:08.704 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.697+0000 7f11e3fc1b80 4 client.25750 mds_command: new command op to 24629 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-19T12:44:08.705 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.697+0000 7f11e3fc1b80 1 -- 172.21.15.46:0/3067629889 --> [v2:172.21.15.157:6836/2629536514,v1:172.21.15.157:6837/2629536514] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55875610fe50 con 0x55875623fc20 2023-10-19T12:44:08.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.698+0000 7f11cdb9a700 1 --2- 172.21.15.46:0/3067629889 >> [v2:172.21.15.157:6836/2629536514,v1:172.21.15.157:6837/2629536514] conn(0x55875623fc20 0x558756242040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:08.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.699+0000 7f11cdb9a700 1 --2- 172.21.15.46:0/3067629889 >> [v2:172.21.15.157:6836/2629536514,v1:172.21.15.157:6837/2629536514] conn(0x55875623fc20 0x558756242040 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=e6964d8e1125d3b5 server_cookie=34080ccfa8e29b26 in_seq=0 out_seq=0 2023-10-19T12:44:08.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.699+0000 7f11b1ffb700 10 client.25750 ms_handle_connect on v2:172.21.15.157:6836/2629536514 2023-10-19T12:44:08.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.699+0000 7f11b1ffb700 1 -- 172.21.15.46:0/3067629889 <== mds.4 v2:172.21.15.157:6836/2629536514 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55875610fe50 con 0x55875623fc20 2023-10-19T12:44:08.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.699+0000 7f11b1ffb700 10 client.25750 handle_command_reply: tid=0 2023-10-19T12:44:08.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.699+0000 7f11e3fc1b80 1 client.25750 shutdown 2023-10-19T12:44:08.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.700+0000 7f11e3fc1b80 1 -- 172.21.15.46:0/3067629889 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5587561ccde0 msgr2=0x558756236760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:44:08.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.700+0000 7f11e3fc1b80 1 --2- 172.21.15.46:0/3067629889 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5587561ccde0 0x558756236760 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f11bc0263b0 tx=0x7f11bc026490 comp rx=0 tx=0).stop 2023-10-19T12:44:08.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.701+0000 7f11e3fc1b80 1 -- 172.21.15.46:0/3067629889 shutdown_connections 2023-10-19T12:44:08.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.701+0000 7f11e3fc1b80 1 --2- 172.21.15.46:0/3067629889 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5587561ce440 0x55875623dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:08.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.701+0000 7f11e3fc1b80 1 --2- 172.21.15.46:0/3067629889 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5587561ccde0 0x558756236760 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:08.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.701+0000 7f11e3fc1b80 1 --2- 172.21.15.46:0/3067629889 >> [v2:172.21.15.157:6836/2629536514,v1:172.21.15.157:6837/2629536514] conn(0x55875623fc20 0x558756242040 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:08.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.701+0000 7f11e3fc1b80 1 --2- 172.21.15.46:0/3067629889 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5587561cdae0 0x558756236ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:08.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.701+0000 7f11b1ffb700 0 client.25750 ms_handle_reset on v2:172.21.15.157:6836/2629536514 2023-10-19T12:44:08.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.701+0000 7f11e3fc1b80 1 -- 172.21.15.46:0/3067629889 >> 172.21.15.46:0/3067629889 conn(0x558756138720 msgr2=0x5587561d57e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:44:08.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.701+0000 7f11e3fc1b80 1 -- 172.21.15.46:0/3067629889 shutdown_connections 2023-10-19T12:44:08.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.701+0000 7f11e3fc1b80 1 -- 172.21.15.46:0/3067629889 wait complete. 2023-10-19T12:44:08.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.702+0000 7f11e3fc1b80 20 client.25750 trim_cache size 0 max 16384 2023-10-19T12:44:08.710 INFO:teuthology.orchestra.run.smithi046.stdout:[] 2023-10-19T12:44:08.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.702+0000 7f11d05ff700 1 -- 172.21.15.46:0/420547173 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f11b80a1500 msgr2=0x7f11b80a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:44:08.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.702+0000 7f11d05ff700 1 --2- 172.21.15.46:0/420547173 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f11b80a1500 0x7f11b80a39c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f11b4005fd0 tx=0x7f11b4009310 comp rx=0 tx=0).stop 2023-10-19T12:44:08.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.703+0000 7f11d05ff700 1 -- 172.21.15.46:0/420547173 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11c8104560 msgr2=0x7f11c819fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:44:08.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.703+0000 7f11d05ff700 1 --2- 172.21.15.46:0/420547173 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11c8104560 0x7f11c819fde0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f11c000fba0 tx=0x7f11c000b790 comp rx=0 tx=0).stop 2023-10-19T12:44:08.712 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.703+0000 7f11d05ff700 1 -- 172.21.15.46:0/420547173 shutdown_connections 2023-10-19T12:44:08.712 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.703+0000 7f11d05ff700 1 --2- 172.21.15.46:0/420547173 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f11b80a1500 0x7f11b80a39c0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:08.712 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.703+0000 7f11d05ff700 1 --2- 172.21.15.46:0/420547173 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11c8104560 0x7f11c819fde0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:08.712 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.703+0000 7f11d05ff700 1 --2- 172.21.15.46:0/420547173 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f11c81029d0 0x7f11c8198880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:08.712 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.703+0000 7f11d05ff700 1 --2- 172.21.15.46:0/420547173 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f11c8103bc0 0x7f11c8198dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:08.712 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.703+0000 7f11d05ff700 1 -- 172.21.15.46:0/420547173 >> 172.21.15.46:0/420547173 conn(0x7f11c80fdf40 msgr2=0x7f11c8106ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:44:08.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.704+0000 7f11d05ff700 1 -- 172.21.15.46:0/420547173 shutdown_connections 2023-10-19T12:44:08.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:08.704+0000 7f11d05ff700 1 -- 172.21.15.46:0/420547173 wait complete. 2023-10-19T12:44:08.739 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-10-19T12:44:09.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.049+0000 7fe842dff700 1 -- 172.21.15.46:0/604144831 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe83c101220 msgr2=0x7fe83c067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:44:09.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.049+0000 7fe842dff700 1 --2- 172.21.15.46:0/604144831 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe83c101220 0x7fe83c067830 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe830009990 tx=0x7fe830009ca0 comp rx=0 tx=0).stop 2023-10-19T12:44:09.056 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.053+0000 7fe842dff700 1 -- 172.21.15.46:0/604144831 shutdown_connections 2023-10-19T12:44:09.056 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.053+0000 7fe842dff700 1 --2- 172.21.15.46:0/604144831 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe83c101220 0x7fe83c067830 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:09.056 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.053+0000 7fe842dff700 1 --2- 172.21.15.46:0/604144831 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe83c0ff690 0x7fe83c0ffab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:09.057 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.053+0000 7fe842dff700 1 --2- 172.21.15.46:0/604144831 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe83c100880 0x7fe83c100ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:09.057 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.053+0000 7fe842dff700 1 -- 172.21.15.46:0/604144831 >> 172.21.15.46:0/604144831 conn(0x7fe83c0fac00 msgr2=0x7fe83c0fd040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:44:09.057 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.053+0000 7fe842dff700 1 -- 172.21.15.46:0/604144831 shutdown_connections 2023-10-19T12:44:09.057 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.053+0000 7fe842dff700 1 -- 172.21.15.46:0/604144831 wait complete. 2023-10-19T12:44:09.058 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.055+0000 7fe842dff700 1 Processor -- start 2023-10-19T12:44:09.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.056+0000 7fe842dff700 1 -- start start 2023-10-19T12:44:09.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.057+0000 7fe842dff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe83c0ff690 0x7fe83c10d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:09.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.057+0000 7fe842dff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe83c100880 0x7fe83c10db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:09.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.057+0000 7fe840b9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe83c0ff690 0x7fe83c10d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:09.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.057+0000 7fe840b9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe83c0ff690 0x7fe83c10d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:40492/0 (socket says 172.21.15.46:40492) 2023-10-19T12:44:09.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.058+0000 7fe842dff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe83c101220 0x7fe83c10a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:09.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.058+0000 7fe842dff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe83c10a930 con 0x7fe83c101220 2023-10-19T12:44:09.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.058+0000 7fe842dff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe83c10aaa0 con 0x7fe83c0ff690 2023-10-19T12:44:09.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.058+0000 7fe842dff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe83c10ac60 con 0x7fe83c100880 2023-10-19T12:44:09.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.058+0000 7fe840b9b700 1 -- 172.21.15.46:0/266643768 learned_addr learned my addr 172.21.15.46:0/266643768 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:44:09.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.059+0000 7fe840b9b700 1 -- 172.21.15.46:0/266643768 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe83c100880 msgr2=0x7fe83c10db40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-19T12:44:09.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.059+0000 7fe840b9b700 1 --2- 172.21.15.46:0/266643768 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe83c100880 0x7fe83c10db40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:09.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.059+0000 7fe840b9b700 1 -- 172.21.15.46:0/266643768 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe83c101220 msgr2=0x7fe83c10a190 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-19T12:44:09.064 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.059+0000 7fe840b9b700 1 --2- 172.21.15.46:0/266643768 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe83c101220 0x7fe83c10a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:09.064 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.059+0000 7fe840b9b700 1 -- 172.21.15.46:0/266643768 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8300095f0 con 0x7fe83c0ff690 2023-10-19T12:44:09.064 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.059+0000 7fe840b9b700 1 --2- 172.21.15.46:0/266643768 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe83c0ff690 0x7fe83c10d600 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe83400efc0 tx=0x7fe83400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:44:09.064 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.060+0000 7fe839ffb700 1 -- 172.21.15.46:0/266643768 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe834018070 con 0x7fe83c0ff690 2023-10-19T12:44:09.064 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.060+0000 7fe842dff700 1 -- 172.21.15.46:0/266643768 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe83c1a4df0 con 0x7fe83c0ff690 2023-10-19T12:44:09.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.060+0000 7fe839ffb700 1 -- 172.21.15.46:0/266643768 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe83400f040 con 0x7fe83c0ff690 2023-10-19T12:44:09.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.060+0000 7fe839ffb700 1 -- 172.21.15.46:0/266643768 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe834004280 con 0x7fe83c0ff690 2023-10-19T12:44:09.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.061+0000 7fe842dff700 1 -- 172.21.15.46:0/266643768 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe83c1a5270 con 0x7fe83c0ff690 2023-10-19T12:44:09.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.066+0000 7fe839ffb700 1 -- 172.21.15.46:0/266643768 <== mon.2 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fe83400cad0 con 0x7fe83c0ff690 2023-10-19T12:44:09.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.068+0000 7fe839ffb700 1 --2- 172.21.15.46:0/266643768 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fe8240a1550 0x7fe8240a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:09.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.068+0000 7fe856681b80 1 Processor -- start 2023-10-19T12:44:09.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.068+0000 7fe839ffb700 1 -- 172.21.15.46:0/266643768 <== mon.2 v2:172.21.15.157:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7fe8340cd0c0 con 0x7fe83c0ff690 2023-10-19T12:44:09.073 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.069+0000 7fe856681b80 1 -- start start 2023-10-19T12:44:09.073 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.070+0000 7fe856681b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f83ae772d0 0x55f83ae776f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:09.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.070+0000 7fe856681b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f83ae77c30 0x55f83ae76090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:09.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.070+0000 7fe856681b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f83ae765d0 0x55f83ae76a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:09.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.070+0000 7fe856681b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f83ade96e0 con 0x55f83ae765d0 2023-10-19T12:44:09.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.070+0000 7fe856681b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f83adcfc60 con 0x55f83ae772d0 2023-10-19T12:44:09.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.070+0000 7fe856681b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f83adcd580 con 0x55f83ae77c30 2023-10-19T12:44:09.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.070+0000 7fe83bfff700 1 --2- 172.21.15.46:0/266643768 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fe8240a1550 0x7fe8240a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:09.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.070+0000 7fe840b9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f83ae772d0 0x55f83ae776f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:09.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.070+0000 7fe840b9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f83ae772d0 0x55f83ae776f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:40494/0 (socket says 172.21.15.46:40494) 2023-10-19T12:44:09.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.070+0000 7fe840b9b700 1 -- 172.21.15.46:0/3205483613 learned_addr learned my addr 172.21.15.46:0/3205483613 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:44:09.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.071+0000 7fe84139c700 1 --2- 172.21.15.46:0/3205483613 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f83ae765d0 0x55f83ae76a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:09.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.072+0000 7fe83bfff700 1 --2- 172.21.15.46:0/3205483613 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f83ae77c30 0x55f83ae76090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:09.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.072+0000 7fe83bfff700 1 --2- 172.21.15.46:0/266643768 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fe8240a1550 0x7fe8240a3a10 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe82c009730 tx=0x7fe82c006cb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:44:09.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.072+0000 7fe840b9b700 1 -- 172.21.15.46:0/3205483613 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f83ae77c30 msgr2=0x55f83ae76090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:44:09.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.072+0000 7fe840b9b700 1 --2- 172.21.15.46:0/3205483613 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f83ae77c30 0x55f83ae76090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:09.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.072+0000 7fe840b9b700 1 -- 172.21.15.46:0/3205483613 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f83ae765d0 msgr2=0x55f83ae76a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:44:09.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.072+0000 7fe840b9b700 1 --2- 172.21.15.46:0/3205483613 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f83ae765d0 0x55f83ae76a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:09.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.072+0000 7fe840b9b700 1 -- 172.21.15.46:0/3205483613 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f83ad863f0 con 0x55f83ae772d0 2023-10-19T12:44:09.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.073+0000 7fe840b9b700 1 --2- 172.21.15.46:0/3205483613 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f83ae772d0 0x55f83ae776f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe834096540 tx=0x7fe834095d80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ace59ad378b49b server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:44:09.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.073+0000 7fe84139c700 1 --2- 172.21.15.46:0/3205483613 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f83ae765d0 0x55f83ae76a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:44:09.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.073+0000 7fe822ffd700 1 -- 172.21.15.46:0/3205483613 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8340999a0 con 0x55f83ae772d0 2023-10-19T12:44:09.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.073+0000 7fe822ffd700 1 -- 172.21.15.46:0/3205483613 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe83409a740 con 0x55f83ae772d0 2023-10-19T12:44:09.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.073+0000 7fe822ffd700 1 -- 172.21.15.46:0/3205483613 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe834098470 con 0x55f83ae772d0 2023-10-19T12:44:09.080 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.074+0000 7fe856681b80 1 -- 172.21.15.46:0/3205483613 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f83ae772d0 msgr2=0x55f83ae776f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:44:09.080 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.074+0000 7fe856681b80 1 --2- 172.21.15.46:0/3205483613 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f83ae772d0 0x55f83ae776f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe834096540 tx=0x7fe834095d80 comp rx=0 tx=0).stop 2023-10-19T12:44:09.080 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.075+0000 7fe856681b80 1 -- 172.21.15.46:0/3205483613 shutdown_connections 2023-10-19T12:44:09.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.075+0000 7fe856681b80 1 --2- 172.21.15.46:0/3205483613 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f83ae765d0 0x55f83ae76a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:09.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.075+0000 7fe856681b80 1 --2- 172.21.15.46:0/3205483613 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f83ae772d0 0x55f83ae776f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:09.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.075+0000 7fe856681b80 1 --2- 172.21.15.46:0/3205483613 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f83ae77c30 0x55f83ae76090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:09.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.075+0000 7fe856681b80 1 -- 172.21.15.46:0/3205483613 >> 172.21.15.46:0/3205483613 conn(0x55f83adea720 msgr2=0x55f83ae70b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:44:09.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.077+0000 7fe856681b80 1 -- 172.21.15.46:0/3205483613 shutdown_connections 2023-10-19T12:44:09.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.077+0000 7fe856681b80 1 -- 172.21.15.46:0/3205483613 wait complete. 2023-10-19T12:44:09.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.078+0000 7fe856681b80 1 -- start start 2023-10-19T12:44:09.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.079+0000 7fe856681b80 1 Processor -- start 2023-10-19T12:44:09.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.079+0000 7fe856681b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f83ae765d0 0x55f83ae90b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:09.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.079+0000 7fe856681b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f83ae772d0 0x55f83ae910d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:09.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.079+0000 7fe856681b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f83ae77c30 0x55f83ae98110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:09.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.079+0000 7fe856681b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f83adc8e70 con 0x55f83ae772d0 2023-10-19T12:44:09.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.079+0000 7fe856681b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f83ad65710 con 0x55f83ae77c30 2023-10-19T12:44:09.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.080+0000 7fe856681b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f83ad653b0 con 0x55f83ae765d0 2023-10-19T12:44:09.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.080+0000 7fe856681b80 10 client.0 _ll_register_callbacks cb 0x55f83acafa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:44:09.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.080+0000 7fe84139c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f83ae77c30 0x55f83ae98110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:09.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.080+0000 7fe84139c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f83ae77c30 0x55f83ae98110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:40510/0 (socket says 172.21.15.46:40510) 2023-10-19T12:44:09.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.080+0000 7fe84139c700 1 -- 172.21.15.46:0/1365178938 learned_addr learned my addr 172.21.15.46:0/1365178938 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:44:09.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.080+0000 7fe83bfff700 1 --2- 172.21.15.46:0/1365178938 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f83ae772d0 0x55f83ae910d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:09.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.080+0000 7fe84139c700 1 -- 172.21.15.46:0/1365178938 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f83ae765d0 msgr2=0x55f83ae90b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:44:09.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.080+0000 7fe84139c700 1 --2- 172.21.15.46:0/1365178938 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f83ae765d0 0x55f83ae90b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:09.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.081+0000 7fe84139c700 1 -- 172.21.15.46:0/1365178938 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f83ae772d0 msgr2=0x55f83ae910d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:44:09.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.081+0000 7fe84139c700 1 --2- 172.21.15.46:0/1365178938 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f83ae772d0 0x55f83ae910d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:09.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.081+0000 7fe84139c700 1 -- 172.21.15.46:0/1365178938 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe83c068260 con 0x55f83ae77c30 2023-10-19T12:44:09.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.081+0000 7fe84139c700 1 --2- 172.21.15.46:0/1365178938 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f83ae77c30 0x55f83ae98110 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe8300098e0 tx=0x7fe8300038b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=749ebdee7115b24f server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:44:09.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.082+0000 7fe81bfff700 10 client.0 ms_handle_connect on v2:172.21.15.157:3300/0 2023-10-19T12:44:09.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.082+0000 7fe81bfff700 1 -- 172.21.15.46:0/1365178938 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe83001f040 con 0x55f83ae77c30 2023-10-19T12:44:09.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.082+0000 7fe81bfff700 1 -- 172.21.15.46:0/1365178938 <== mon.2 v2:172.21.15.157:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7fe83000bbf0 con 0x55f83ae77c30 2023-10-19T12:44:09.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.083+0000 7fe856681b80 1 -- 172.21.15.46:0/1365178938 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f83adcdef0 con 0x55f83ae77c30 2023-10-19T12:44:09.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.083+0000 7fe81bfff700 1 -- 172.21.15.46:0/1365178938 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe830004210 con 0x55f83ae77c30 2023-10-19T12:44:09.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:44:08 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/2098659298' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-19T12:44:09.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.084+0000 7fe856681b80 10 client.25748 fetch_fsmap learned FSMap version 29 2023-10-19T12:44:09.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.084+0000 7fe856681b80 1 -- 172.21.15.46:0/1365178938 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x7fe83c1a5270 con 0x55f83ae77c30 2023-10-19T12:44:09.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.084+0000 7fe81bfff700 1 -- 172.21.15.46:0/1365178938 <== mon.2 v2:172.21.15.157:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55f83adcdef0 con 0x55f83ae77c30 2023-10-19T12:44:09.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.085+0000 7fe81bfff700 1 -- 172.21.15.46:0/1365178938 <== mon.2 v2:172.21.15.157:3300/0 5 ==== fsmap(e 29) v1 ==== 7906+0+0 (secure 0 0 0) 0x7fe83000f460 con 0x55f83ae77c30 2023-10-19T12:44:09.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.085+0000 7fe856681b80 10 client.25748 fetch_fsmap finished waiting for FSMap version 29 2023-10-19T12:44:09.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.085+0000 7fe856681b80 10 client.25748 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2023-10-19T12:44:09.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.085+0000 7fe856681b80 20 client.25748 populate_metadata read hostname 'smithi046' 2023-10-19T12:44:09.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.085+0000 7fe856681b80 1 --2- 172.21.15.46:0/1365178938 >> [v2:172.21.15.195:6834/1406909915,v1:172.21.15.195:6835/1406909915] conn(0x55f83aeada40 0x55f83aeafe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:09.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.085+0000 7fe856681b80 4 client.25748 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-19T12:44:09.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.085+0000 7fe856681b80 1 -- 172.21.15.46:0/1365178938 --> [v2:172.21.15.195:6834/1406909915,v1:172.21.15.195:6835/1406909915] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f83ae458b0 con 0x55f83aeada40 2023-10-19T12:44:09.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.086+0000 7fe840b9b700 1 --2- 172.21.15.46:0/1365178938 >> [v2:172.21.15.195:6834/1406909915,v1:172.21.15.195:6835/1406909915] conn(0x55f83aeada40 0x55f83aeafe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:09.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.087+0000 7fe840b9b700 1 --2- 172.21.15.46:0/1365178938 >> [v2:172.21.15.195:6834/1406909915,v1:172.21.15.195:6835/1406909915] conn(0x55f83aeada40 0x55f83aeafe60 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=e62826109319307d server_cookie=f5436e786709660c in_seq=0 out_seq=0 2023-10-19T12:44:09.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.087+0000 7fe81bfff700 10 client.25748 ms_handle_connect on v2:172.21.15.195:6834/1406909915 2023-10-19T12:44:09.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.088+0000 7fe81bfff700 1 -- 172.21.15.46:0/1365178938 <== mds.3 v2:172.21.15.195:6834/1406909915 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55f83ae458b0 con 0x55f83aeada40 2023-10-19T12:44:09.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.088+0000 7fe81bfff700 10 client.25748 handle_command_reply: tid=0 2023-10-19T12:44:09.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.088+0000 7fe856681b80 1 client.25748 shutdown 2023-10-19T12:44:09.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.088+0000 7fe856681b80 1 -- 172.21.15.46:0/1365178938 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f83ae77c30 msgr2=0x55f83ae98110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:44:09.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.088+0000 7fe856681b80 1 --2- 172.21.15.46:0/1365178938 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f83ae77c30 0x55f83ae98110 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe8300098e0 tx=0x7fe8300038b0 comp rx=0 tx=0).stop 2023-10-19T12:44:09.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.088+0000 7fe856681b80 1 -- 172.21.15.46:0/1365178938 shutdown_connections 2023-10-19T12:44:09.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.088+0000 7fe856681b80 1 --2- 172.21.15.46:0/1365178938 >> [v2:172.21.15.195:6834/1406909915,v1:172.21.15.195:6835/1406909915] conn(0x55f83aeada40 0x55f83aeafe60 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:09.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.088+0000 7fe856681b80 1 --2- 172.21.15.46:0/1365178938 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f83ae77c30 0x55f83ae98110 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:09.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.088+0000 7fe856681b80 1 --2- 172.21.15.46:0/1365178938 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f83ae765d0 0x55f83ae90b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:09.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.088+0000 7fe856681b80 1 --2- 172.21.15.46:0/1365178938 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f83ae772d0 0x55f83ae910d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:09.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.088+0000 7fe856681b80 1 -- 172.21.15.46:0/1365178938 >> 172.21.15.46:0/1365178938 conn(0x55f83adea720 msgr2=0x55f83ae75080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:44:09.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.089+0000 7fe81bfff700 0 client.25748 ms_handle_reset on v2:172.21.15.195:6834/1406909915 2023-10-19T12:44:09.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.090+0000 7fe856681b80 1 -- 172.21.15.46:0/1365178938 shutdown_connections 2023-10-19T12:44:09.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.090+0000 7fe856681b80 1 -- 172.21.15.46:0/1365178938 wait complete. 2023-10-19T12:44:09.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.090+0000 7fe856681b80 20 client.25748 trim_cache size 0 max 16384 2023-10-19T12:44:09.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.116+0000 7fe856681b80 1 Processor -- start 2023-10-19T12:44:09.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.116+0000 7fe856681b80 1 -- start start 2023-10-19T12:44:09.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.117+0000 7fe856681b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f83ae765d0 0x55f83ae76090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:09.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.117+0000 7fe856681b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f83ae772d0 0x55f83ae980d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:09.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.117+0000 7fe856681b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f83ae77c30 0x55f83ae6b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:09.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.117+0000 7fe856681b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f83ac49920 con 0x55f83ae765d0 2023-10-19T12:44:09.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.118+0000 7fe856681b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f83ae72b80 con 0x55f83ae772d0 2023-10-19T12:44:09.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.118+0000 7fe856681b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f83ae722e0 con 0x55f83ae77c30 2023-10-19T12:44:09.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.118+0000 7fe83bfff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f83ae772d0 0x55f83ae980d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:09.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.118+0000 7fe840b9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f83ae765d0 0x55f83ae76090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:09.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.118+0000 7fe84139c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f83ae77c30 0x55f83ae6b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:09.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.119+0000 7fe84139c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f83ae77c30 0x55f83ae6b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:50030/0 (socket says 172.21.15.46:50030) 2023-10-19T12:44:09.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.119+0000 7fe84139c700 1 -- 172.21.15.46:0/1075707612 learned_addr learned my addr 172.21.15.46:0/1075707612 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:44:09.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.119+0000 7fe83bfff700 1 -- 172.21.15.46:0/1075707612 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f83ae77c30 msgr2=0x55f83ae6b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:44:09.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.119+0000 7fe83bfff700 1 --2- 172.21.15.46:0/1075707612 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f83ae77c30 0x55f83ae6b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:09.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.119+0000 7fe83bfff700 1 -- 172.21.15.46:0/1075707612 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f83ae765d0 msgr2=0x55f83ae76090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:44:09.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.119+0000 7fe83bfff700 1 --2- 172.21.15.46:0/1075707612 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f83ae765d0 0x55f83ae76090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:09.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.119+0000 7fe83bfff700 1 -- 172.21.15.46:0/1075707612 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f83abf3de0 con 0x55f83ae772d0 2023-10-19T12:44:09.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.120+0000 7fe83bfff700 1 --2- 172.21.15.46:0/1075707612 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f83ae772d0 0x55f83ae980d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe82c009e80 tx=0x7fe82c00e000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1289ff4df9890b37 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:44:09.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.120+0000 7fe8237fe700 1 -- 172.21.15.46:0/1075707612 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe82c012980 con 0x55f83ae772d0 2023-10-19T12:44:09.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.120+0000 7fe8237fe700 1 -- 172.21.15.46:0/1075707612 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe82c01b050 con 0x55f83ae772d0 2023-10-19T12:44:09.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.120+0000 7fe8237fe700 1 -- 172.21.15.46:0/1075707612 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe82c020ea0 con 0x55f83ae772d0 2023-10-19T12:44:09.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.121+0000 7fe856681b80 1 -- 172.21.15.46:0/1075707612 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f83ae772d0 msgr2=0x55f83ae980d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:44:09.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.121+0000 7fe856681b80 1 --2- 172.21.15.46:0/1075707612 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f83ae772d0 0x55f83ae980d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe82c009e80 tx=0x7fe82c00e000 comp rx=0 tx=0).stop 2023-10-19T12:44:09.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.121+0000 7fe856681b80 1 -- 172.21.15.46:0/1075707612 shutdown_connections 2023-10-19T12:44:09.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.121+0000 7fe856681b80 1 --2- 172.21.15.46:0/1075707612 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f83ae77c30 0x55f83ae6b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:09.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.121+0000 7fe856681b80 1 --2- 172.21.15.46:0/1075707612 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f83ae765d0 0x55f83ae76090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:09.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.121+0000 7fe856681b80 1 --2- 172.21.15.46:0/1075707612 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f83ae772d0 0x55f83ae980d0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:09.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.121+0000 7fe856681b80 1 -- 172.21.15.46:0/1075707612 >> 172.21.15.46:0/1075707612 conn(0x55f83adea720 msgr2=0x55f83aeb47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:44:09.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.122+0000 7fe856681b80 1 -- 172.21.15.46:0/1075707612 shutdown_connections 2023-10-19T12:44:09.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.122+0000 7fe856681b80 1 -- 172.21.15.46:0/1075707612 wait complete. 2023-10-19T12:44:09.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.122+0000 7fe856681b80 1 -- start start 2023-10-19T12:44:09.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.122+0000 7fe856681b80 1 Processor -- start 2023-10-19T12:44:09.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.123+0000 7fe856681b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f83ae765d0 0x55f83ae97a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:09.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.123+0000 7fe856681b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f83ae772d0 0x55f83ae97fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:09.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.123+0000 7fe856681b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f83ae77c30 0x55f83ae96070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:09.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.123+0000 7fe856681b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f83ae96780 con 0x55f83ae77c30 2023-10-19T12:44:09.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.123+0000 7fe856681b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f83ae968f0 con 0x55f83ae772d0 2023-10-19T12:44:09.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.123+0000 7fe856681b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f83ae96ab0 con 0x55f83ae765d0 2023-10-19T12:44:09.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.123+0000 7fe856681b80 10 client.0 _ll_register_callbacks cb 0x55f83acafa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:44:09.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.124+0000 7fe83bfff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f83ae772d0 0x55f83ae97fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:09.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.124+0000 7fe83bfff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f83ae772d0 0x55f83ae97fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:40534/0 (socket says 172.21.15.46:40534) 2023-10-19T12:44:09.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.124+0000 7fe83bfff700 1 -- 172.21.15.46:0/3191362197 learned_addr learned my addr 172.21.15.46:0/3191362197 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:44:09.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.124+0000 7fe83bfff700 1 -- 172.21.15.46:0/3191362197 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f83ae765d0 msgr2=0x55f83ae97a60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-19T12:44:09.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.124+0000 7fe83bfff700 1 --2- 172.21.15.46:0/3191362197 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f83ae765d0 0x55f83ae97a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:09.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.124+0000 7fe83bfff700 1 -- 172.21.15.46:0/3191362197 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f83ae77c30 msgr2=0x55f83ae96070 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-19T12:44:09.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.125+0000 7fe84139c700 1 --2- 172.21.15.46:0/3191362197 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f83ae77c30 0x55f83ae96070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:09.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.125+0000 7fe83bfff700 1 --2- 172.21.15.46:0/3191362197 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f83ae77c30 0x55f83ae96070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:09.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.125+0000 7fe83bfff700 1 -- 172.21.15.46:0/3191362197 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe82c013740 con 0x55f83ae772d0 2023-10-19T12:44:09.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.125+0000 7fe83bfff700 1 --2- 172.21.15.46:0/3191362197 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f83ae772d0 0x55f83ae97fa0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe82c004790 tx=0x7fe82c012a60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=551e7c52346f8542 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:44:09.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.125+0000 7fe81bfff700 10 client.0 ms_handle_connect on v2:172.21.15.157:3300/0 2023-10-19T12:44:09.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.125+0000 7fe81bfff700 1 -- 172.21.15.46:0/3191362197 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe82c0295f0 con 0x55f83ae772d0 2023-10-19T12:44:09.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.125+0000 7fe81bfff700 1 -- 172.21.15.46:0/3191362197 <== mon.2 v2:172.21.15.157:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7fe82c029750 con 0x55f83ae772d0 2023-10-19T12:44:09.135 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.125+0000 7fe856681b80 1 -- 172.21.15.46:0/3191362197 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe83409a740 con 0x55f83ae772d0 2023-10-19T12:44:09.135 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.126+0000 7fe81bfff700 1 -- 172.21.15.46:0/3191362197 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe82c012ec0 con 0x55f83ae772d0 2023-10-19T12:44:09.135 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.126+0000 7fe856681b80 10 client.25754 fetch_fsmap learned FSMap version 29 2023-10-19T12:44:09.135 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.126+0000 7fe856681b80 1 -- 172.21.15.46:0/3191362197 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55f83abdcc60 con 0x55f83ae772d0 2023-10-19T12:44:09.135 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.126+0000 7fe81bfff700 1 -- 172.21.15.46:0/3191362197 <== mon.2 v2:172.21.15.157:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe83409a740 con 0x55f83ae772d0 2023-10-19T12:44:09.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.126+0000 7fe81bfff700 1 -- 172.21.15.46:0/3191362197 <== mon.2 v2:172.21.15.157:3300/0 5 ==== fsmap(e 29) v1 ==== 7906+0+0 (secure 0 0 0) 0x7fe82c0329f0 con 0x55f83ae772d0 2023-10-19T12:44:09.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.126+0000 7fe856681b80 10 client.25754 fetch_fsmap finished waiting for FSMap version 29 2023-10-19T12:44:09.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.126+0000 7fe856681b80 10 client.25754 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2023-10-19T12:44:09.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.126+0000 7fe856681b80 20 client.25754 populate_metadata read hostname 'smithi046' 2023-10-19T12:44:09.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.126+0000 7fe856681b80 1 --2- 172.21.15.46:0/3191362197 >> [v2:172.21.15.195:6834/1406909915,v1:172.21.15.195:6835/1406909915] conn(0x55f83af02c00 0x55f83af05020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:09.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.126+0000 7fe856681b80 4 client.25754 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-19T12:44:09.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.126+0000 7fe856681b80 1 -- 172.21.15.46:0/3191362197 --> [v2:172.21.15.195:6834/1406909915,v1:172.21.15.195:6835/1406909915] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55f83adc1e50 con 0x55f83af02c00 2023-10-19T12:44:09.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.127+0000 7fe840b9b700 1 --2- 172.21.15.46:0/3191362197 >> [v2:172.21.15.195:6834/1406909915,v1:172.21.15.195:6835/1406909915] conn(0x55f83af02c00 0x55f83af05020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:09.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.127+0000 7fe840b9b700 1 --2- 172.21.15.46:0/3191362197 >> [v2:172.21.15.195:6834/1406909915,v1:172.21.15.195:6835/1406909915] conn(0x55f83af02c00 0x55f83af05020 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=feb598c30dae0a6b server_cookie=29c9d546dc7ba9b0 in_seq=0 out_seq=0 2023-10-19T12:44:09.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.127+0000 7fe81bfff700 10 client.25754 ms_handle_connect on v2:172.21.15.195:6834/1406909915 2023-10-19T12:44:09.138 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:44:08 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/2098659298' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-19T12:44:09.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.127+0000 7fe81bfff700 1 -- 172.21.15.46:0/3191362197 <== mds.3 v2:172.21.15.195:6834/1406909915 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55f83adc1e50 con 0x55f83af02c00 2023-10-19T12:44:09.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.127+0000 7fe81bfff700 10 client.25754 handle_command_reply: tid=0 2023-10-19T12:44:09.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.128+0000 7fe856681b80 1 client.25754 shutdown 2023-10-19T12:44:09.140 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.128+0000 7fe856681b80 1 -- 172.21.15.46:0/3191362197 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f83ae772d0 msgr2=0x55f83ae97fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:44:09.140 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.128+0000 7fe856681b80 1 --2- 172.21.15.46:0/3191362197 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f83ae772d0 0x55f83ae97fa0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe82c004790 tx=0x7fe82c012a60 comp rx=0 tx=0).stop 2023-10-19T12:44:09.140 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.128+0000 7fe856681b80 1 -- 172.21.15.46:0/3191362197 shutdown_connections 2023-10-19T12:44:09.140 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.128+0000 7fe856681b80 1 --2- 172.21.15.46:0/3191362197 >> [v2:172.21.15.195:6834/1406909915,v1:172.21.15.195:6835/1406909915] conn(0x55f83af02c00 0x55f83af05020 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:09.140 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.128+0000 7fe856681b80 1 --2- 172.21.15.46:0/3191362197 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f83ae77c30 0x55f83ae96070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:09.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.128+0000 7fe856681b80 1 --2- 172.21.15.46:0/3191362197 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f83ae765d0 0x55f83ae97a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:09.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.128+0000 7fe856681b80 1 --2- 172.21.15.46:0/3191362197 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f83ae772d0 0x55f83ae97fa0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:09.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.128+0000 7fe856681b80 1 -- 172.21.15.46:0/3191362197 >> 172.21.15.46:0/3191362197 conn(0x55f83adea720 msgr2=0x55f83ae90070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:44:09.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.128+0000 7fe81bfff700 0 client.25754 ms_handle_reset on v2:172.21.15.195:6834/1406909915 2023-10-19T12:44:09.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.128+0000 7fe856681b80 1 -- 172.21.15.46:0/3191362197 shutdown_connections 2023-10-19T12:44:09.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.128+0000 7fe856681b80 1 -- 172.21.15.46:0/3191362197 wait complete. 2023-10-19T12:44:09.142 INFO:teuthology.orchestra.run.smithi046.stdout:[] 2023-10-19T12:44:09.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.128+0000 7fe856681b80 20 client.25754 trim_cache size 0 max 16384 2023-10-19T12:44:09.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.129+0000 7fe842dff700 1 -- 172.21.15.46:0/266643768 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fe8240a1550 msgr2=0x7fe8240a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:44:09.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.129+0000 7fe842dff700 1 --2- 172.21.15.46:0/266643768 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fe8240a1550 0x7fe8240a3a10 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe82c009730 tx=0x7fe82c006cb0 comp rx=0 tx=0).stop 2023-10-19T12:44:09.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.129+0000 7fe842dff700 1 -- 172.21.15.46:0/266643768 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe83c0ff690 msgr2=0x7fe83c10d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:44:09.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.129+0000 7fe842dff700 1 --2- 172.21.15.46:0/266643768 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe83c0ff690 0x7fe83c10d600 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe83400efc0 tx=0x7fe83400c3a0 comp rx=0 tx=0).stop 2023-10-19T12:44:09.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.129+0000 7fe842dff700 1 -- 172.21.15.46:0/266643768 shutdown_connections 2023-10-19T12:44:09.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.129+0000 7fe842dff700 1 --2- 172.21.15.46:0/266643768 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe83c101220 0x7fe83c10a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:09.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.129+0000 7fe842dff700 1 --2- 172.21.15.46:0/266643768 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe83c0ff690 0x7fe83c10d600 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:09.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.129+0000 7fe842dff700 1 --2- 172.21.15.46:0/266643768 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fe8240a1550 0x7fe8240a3a10 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:09.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.129+0000 7fe842dff700 1 --2- 172.21.15.46:0/266643768 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe83c100880 0x7fe83c10db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:09.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.129+0000 7fe842dff700 1 -- 172.21.15.46:0/266643768 >> 172.21.15.46:0/266643768 conn(0x7fe83c0fac00 msgr2=0x7fe83c101aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:44:09.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.130+0000 7fe842dff700 1 -- 172.21.15.46:0/266643768 shutdown_connections 2023-10-19T12:44:09.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.130+0000 7fe842dff700 1 -- 172.21.15.46:0/266643768 wait complete. 2023-10-19T12:44:09.160 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:44:08 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/2098659298' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-19T12:44:09.163 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-10-19T12:44:09.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.541+0000 7eff03bff700 1 -- 172.21.15.46:0/658137269 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efefc106dd0 msgr2=0x7efefc1071f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:44:09.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.541+0000 7eff03bff700 1 --2- 172.21.15.46:0/658137269 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efefc106dd0 0x7efefc1071f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7efef8009990 tx=0x7efef8009ca0 comp rx=0 tx=0).stop 2023-10-19T12:44:09.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.541+0000 7eff03bff700 1 -- 172.21.15.46:0/658137269 shutdown_connections 2023-10-19T12:44:09.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.541+0000 7eff03bff700 1 --2- 172.21.15.46:0/658137269 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efefc108960 0x7efefc10f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:09.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.541+0000 7eff03bff700 1 --2- 172.21.15.46:0/658137269 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efefc106dd0 0x7efefc1071f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:09.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.541+0000 7eff03bff700 1 --2- 172.21.15.46:0/658137269 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efefc107fc0 0x7efefc108420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:09.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.541+0000 7eff03bff700 1 -- 172.21.15.46:0/658137269 >> 172.21.15.46:0/658137269 conn(0x7efefc075d70 msgr2=0x7efefc0781b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:44:09.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.541+0000 7eff03bff700 1 -- 172.21.15.46:0/658137269 shutdown_connections 2023-10-19T12:44:09.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.541+0000 7eff03bff700 1 -- 172.21.15.46:0/658137269 wait complete. 2023-10-19T12:44:09.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.543+0000 7eff03bff700 1 Processor -- start 2023-10-19T12:44:09.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.545+0000 7eff03bff700 1 -- start start 2023-10-19T12:44:09.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.545+0000 7eff03bff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efefc106dd0 0x7efefc19cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:09.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.545+0000 7eff03bff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efefc107fc0 0x7efefc19d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:09.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.545+0000 7eff03bff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efefc108960 0x7efefc1a42b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:09.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.545+0000 7eff03bff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efefc1a4880 con 0x7efefc106dd0 2023-10-19T12:44:09.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.545+0000 7eff03bff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efefc1a49f0 con 0x7efefc108960 2023-10-19T12:44:09.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.545+0000 7eff03bff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efefc1a4bb0 con 0x7efefc107fc0 2023-10-19T12:44:09.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.545+0000 7eff0119a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efefc107fc0 0x7efefc19d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:09.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.545+0000 7eff0119a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efefc107fc0 0x7efefc19d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:50050/0 (socket says 172.21.15.46:50050) 2023-10-19T12:44:09.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.545+0000 7eff0119a700 1 -- 172.21.15.46:0/1821526864 learned_addr learned my addr 172.21.15.46:0/1821526864 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:44:09.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.545+0000 7eff0219c700 1 --2- 172.21.15.46:0/1821526864 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efefc108960 0x7efefc1a42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:09.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.546+0000 7eff0199b700 1 --2- 172.21.15.46:0/1821526864 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efefc106dd0 0x7efefc19cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:09.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.546+0000 7eff0219c700 1 -- 172.21.15.46:0/1821526864 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efefc107fc0 msgr2=0x7efefc19d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:44:09.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.546+0000 7eff0219c700 1 --2- 172.21.15.46:0/1821526864 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efefc107fc0 0x7efefc19d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:09.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.546+0000 7eff0219c700 1 -- 172.21.15.46:0/1821526864 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efefc106dd0 msgr2=0x7efefc19cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:44:09.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.546+0000 7eff0219c700 1 --2- 172.21.15.46:0/1821526864 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efefc106dd0 0x7efefc19cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:09.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.546+0000 7eff0219c700 1 -- 172.21.15.46:0/1821526864 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efef80095f0 con 0x7efefc108960 2023-10-19T12:44:09.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.546+0000 7eff0119a700 1 --2- 172.21.15.46:0/1821526864 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efefc107fc0 0x7efefc19d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:44:09.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.547+0000 7eff0219c700 1 --2- 172.21.15.46:0/1821526864 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efefc108960 0x7efefc1a42b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7efef400ab40 tx=0x7efef400ae50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:44:09.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.547+0000 7efef2ffd700 1 -- 172.21.15.46:0/1821526864 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef400f070 con 0x7efefc108960 2023-10-19T12:44:09.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.547+0000 7efef2ffd700 1 -- 172.21.15.46:0/1821526864 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efef4007a70 con 0x7efefc108960 2023-10-19T12:44:09.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.547+0000 7eff03bff700 1 -- 172.21.15.46:0/1821526864 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efefc1a4e90 con 0x7efefc108960 2023-10-19T12:44:09.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.547+0000 7efef2ffd700 1 -- 172.21.15.46:0/1821526864 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef4005280 con 0x7efefc108960 2023-10-19T12:44:09.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.547+0000 7eff03bff700 1 -- 172.21.15.46:0/1821526864 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efefc1a5310 con 0x7efefc108960 2023-10-19T12:44:09.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.554+0000 7efef2ffd700 1 -- 172.21.15.46:0/1821526864 <== mon.2 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7efef4004ad0 con 0x7efefc108960 2023-10-19T12:44:09.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.557+0000 7eff1752cb80 1 Processor -- start 2023-10-19T12:44:09.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.557+0000 7efef2ffd700 1 --2- 172.21.15.46:0/1821526864 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7efee80a1580 0x7efee80a3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:09.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.557+0000 7eff1752cb80 1 -- start start 2023-10-19T12:44:09.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.558+0000 7eff1752cb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bedaf302d0 0x55bedaf306f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:09.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.558+0000 7efef2ffd700 1 -- 172.21.15.46:0/1821526864 <== mon.2 v2:172.21.15.157:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7efef40cc480 con 0x7efefc108960 2023-10-19T12:44:09.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.558+0000 7eff1752cb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bedaf30c30 0x55bedaf2f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:09.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.558+0000 7eff1752cb80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55bedaf2f5d0 0x55bedaf2fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:09.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.558+0000 7eff1752cb80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bedaea26e0 con 0x55bedaf2f5d0 2023-10-19T12:44:09.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.558+0000 7eff1752cb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bedae88c60 con 0x55bedaf30c30 2023-10-19T12:44:09.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.558+0000 7eff1752cb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bedae86580 con 0x55bedaf302d0 2023-10-19T12:44:09.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.558+0000 7eff0119a700 1 --2- 172.21.15.46:0/1821526864 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7efee80a1580 0x7efee80a3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:09.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.558+0000 7eff0119a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bedaf30c30 0x55bedaf2f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:09.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.558+0000 7eff0119a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bedaf30c30 0x55bedaf2f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:40574/0 (socket says 172.21.15.46:40574) 2023-10-19T12:44:09.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.558+0000 7eff0119a700 1 -- 172.21.15.46:0/3235512484 learned_addr learned my addr 172.21.15.46:0/3235512484 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:44:09.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.558+0000 7eff0219c700 1 --2- 172.21.15.46:0/3235512484 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55bedaf2f5d0 0x55bedaf2fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:09.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.558+0000 7eff0199b700 1 --2- 172.21.15.46:0/3235512484 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bedaf302d0 0x55bedaf306f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:09.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.559+0000 7eff0119a700 1 -- 172.21.15.46:0/3235512484 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bedaf302d0 msgr2=0x55bedaf306f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:44:09.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.559+0000 7eff0119a700 1 --2- 172.21.15.46:0/3235512484 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bedaf302d0 0x55bedaf306f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:09.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.559+0000 7eff0119a700 1 -- 172.21.15.46:0/3235512484 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55bedaf2f5d0 msgr2=0x55bedaf2fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:44:09.566 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.559+0000 7eff0119a700 1 --2- 172.21.15.46:0/3235512484 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55bedaf2f5d0 0x55bedaf2fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:09.566 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.559+0000 7eff0119a700 1 -- 172.21.15.46:0/3235512484 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bedae3f3f0 con 0x55bedaf30c30 2023-10-19T12:44:09.566 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.559+0000 7eff0219c700 1 --2- 172.21.15.46:0/3235512484 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55bedaf2f5d0 0x55bedaf2fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T12:44:09.566 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.560+0000 7eff0119a700 1 --2- 172.21.15.46:0/3235512484 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bedaf30c30 0x55bedaf2f090 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7efeec00f3f0 tx=0x7efeec00f700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7952c6b06dcf53 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:44:09.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.560+0000 7eff0119a700 1 --2- 172.21.15.46:0/1821526864 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7efee80a1580 0x7efee80a3a40 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7efeec00fb00 tx=0x7efeec011000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:44:09.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.561+0000 7efee7fff700 1 -- 172.21.15.46:0/3235512484 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeec00fee0 con 0x55bedaf30c30 2023-10-19T12:44:09.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.561+0000 7efee7fff700 1 -- 172.21.15.46:0/3235512484 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efeec013b10 con 0x55bedaf30c30 2023-10-19T12:44:09.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.561+0000 7efee7fff700 1 -- 172.21.15.46:0/3235512484 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeec01f770 con 0x55bedaf30c30 2023-10-19T12:44:09.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.563+0000 7eff1752cb80 1 -- 172.21.15.46:0/3235512484 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bedaf30c30 msgr2=0x55bedaf2f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:44:09.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.563+0000 7eff1752cb80 1 --2- 172.21.15.46:0/3235512484 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bedaf30c30 0x55bedaf2f090 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7efeec00f3f0 tx=0x7efeec00f700 comp rx=0 tx=0).stop 2023-10-19T12:44:09.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.563+0000 7eff1752cb80 1 -- 172.21.15.46:0/3235512484 shutdown_connections 2023-10-19T12:44:09.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.563+0000 7eff1752cb80 1 --2- 172.21.15.46:0/3235512484 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55bedaf2f5d0 0x55bedaf2fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:09.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.563+0000 7eff1752cb80 1 --2- 172.21.15.46:0/3235512484 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bedaf302d0 0x55bedaf306f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:09.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.563+0000 7eff1752cb80 1 --2- 172.21.15.46:0/3235512484 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bedaf30c30 0x55bedaf2f090 secure :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7efeec00f3f0 tx=0x7efeec00f700 comp rx=0 tx=0).stop 2023-10-19T12:44:09.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.563+0000 7eff1752cb80 1 -- 172.21.15.46:0/3235512484 >> 172.21.15.46:0/3235512484 conn(0x55bedaea3720 msgr2=0x55bedaf29b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:44:09.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.565+0000 7eff1752cb80 1 -- 172.21.15.46:0/3235512484 shutdown_connections 2023-10-19T12:44:09.571 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.565+0000 7eff1752cb80 1 -- 172.21.15.46:0/3235512484 wait complete. 2023-10-19T12:44:09.571 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.565+0000 7eff1752cb80 1 -- start start 2023-10-19T12:44:09.571 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.565+0000 7eff1752cb80 1 Processor -- start 2023-10-19T12:44:09.571 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.566+0000 7eff1752cb80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55bedaf2f5d0 0x55bedaf38d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:09.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.566+0000 7eff1752cb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bedaf302d0 0x55bedaf392a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:09.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.566+0000 7eff1752cb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bedaf3e2d0 0x55bedaf406c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:09.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.566+0000 7eff1752cb80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bedae81e70 con 0x55bedaf2f5d0 2023-10-19T12:44:09.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.566+0000 7eff1752cb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bedae1e710 con 0x55bedaf3e2d0 2023-10-19T12:44:09.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.566+0000 7eff1752cb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bedae1e3b0 con 0x55bedaf302d0 2023-10-19T12:44:09.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.566+0000 7eff1752cb80 10 client.0 _ll_register_callbacks cb 0x55bedad68a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:44:09.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.566+0000 7eff0119a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bedaf302d0 0x55bedaf392a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:09.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.566+0000 7eff0119a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bedaf302d0 0x55bedaf392a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:50062/0 (socket says 172.21.15.46:50062) 2023-10-19T12:44:09.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.566+0000 7eff0119a700 1 -- 172.21.15.46:0/3065880052 learned_addr learned my addr 172.21.15.46:0/3065880052 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:44:09.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.566+0000 7eff0219c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bedaf3e2d0 0x55bedaf406c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:09.574 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.567+0000 7eff0199b700 1 --2- 172.21.15.46:0/3065880052 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55bedaf2f5d0 0x55bedaf38d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:09.574 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.567+0000 7eff0219c700 1 -- 172.21.15.46:0/3065880052 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bedaf302d0 msgr2=0x55bedaf392a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:44:09.574 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.567+0000 7eff0219c700 1 --2- 172.21.15.46:0/3065880052 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bedaf302d0 0x55bedaf392a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:09.574 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.567+0000 7eff0219c700 1 -- 172.21.15.46:0/3065880052 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55bedaf2f5d0 msgr2=0x55bedaf38d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:44:09.574 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.567+0000 7eff0219c700 1 --2- 172.21.15.46:0/3065880052 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55bedaf2f5d0 0x55bedaf38d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:09.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.568+0000 7eff0219c700 1 -- 172.21.15.46:0/3065880052 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efeec01b040 con 0x55bedaf3e2d0 2023-10-19T12:44:09.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.568+0000 7eff0219c700 1 --2- 172.21.15.46:0/3065880052 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bedaf3e2d0 0x55bedaf406c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7efef4004d80 tx=0x7efef4099030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69d45a61c1a3b97b server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:44:09.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.568+0000 7efee57fa700 10 client.0 ms_handle_connect on v2:172.21.15.157:3300/0 2023-10-19T12:44:09.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.569+0000 7efee57fa700 1 -- 172.21.15.46:0/3065880052 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef409d550 con 0x55bedaf3e2d0 2023-10-19T12:44:09.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.569+0000 7efee57fa700 1 -- 172.21.15.46:0/3065880052 <== mon.2 v2:172.21.15.157:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7efef40a1700 con 0x55bedaf3e2d0 2023-10-19T12:44:09.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.569+0000 7eff1752cb80 1 -- 172.21.15.46:0/3065880052 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bedae86ef0 con 0x55bedaf3e2d0 2023-10-19T12:44:09.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.569+0000 7efee57fa700 1 -- 172.21.15.46:0/3065880052 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7efef4004dd0 con 0x55bedaf3e2d0 2023-10-19T12:44:09.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.569+0000 7eff1752cb80 10 client.25766 fetch_fsmap learned FSMap version 29 2023-10-19T12:44:09.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.569+0000 7eff1752cb80 1 -- 172.21.15.46:0/3065880052 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55bedacacde0 con 0x55bedaf3e2d0 2023-10-19T12:44:09.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.570+0000 7efee57fa700 1 -- 172.21.15.46:0/3065880052 <== mon.2 v2:172.21.15.157:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efef409d150 con 0x55bedaf3e2d0 2023-10-19T12:44:09.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.570+0000 7efee57fa700 1 -- 172.21.15.46:0/3065880052 <== mon.2 v2:172.21.15.157:3300/0 5 ==== fsmap(e 29) v1 ==== 7906+0+0 (secure 0 0 0) 0x7efef40988f0 con 0x55bedaf3e2d0 2023-10-19T12:44:09.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.570+0000 7eff1752cb80 10 client.25766 fetch_fsmap finished waiting for FSMap version 29 2023-10-19T12:44:09.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.570+0000 7eff1752cb80 10 client.25766 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-10-19T12:44:09.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.570+0000 7eff1752cb80 20 client.25766 populate_metadata read hostname 'smithi046' 2023-10-19T12:44:09.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.570+0000 7eff1752cb80 1 --2- 172.21.15.46:0/3065880052 >> [v2:172.21.15.195:6836/293916188,v1:172.21.15.195:6837/293916188] conn(0x55bedaf44f90 0x55bedaf47410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:09.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.570+0000 7eff1752cb80 4 client.25766 mds_command: new command op to 24643 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-19T12:44:09.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.570+0000 7eff1752cb80 1 -- 172.21.15.46:0/3065880052 --> [v2:172.21.15.195:6836/293916188,v1:172.21.15.195:6837/293916188] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bedae86ef0 con 0x55bedaf44f90 2023-10-19T12:44:09.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.571+0000 7eff0199b700 1 --2- 172.21.15.46:0/3065880052 >> [v2:172.21.15.195:6836/293916188,v1:172.21.15.195:6837/293916188] conn(0x55bedaf44f90 0x55bedaf47410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:09.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.572+0000 7eff0199b700 1 --2- 172.21.15.46:0/3065880052 >> [v2:172.21.15.195:6836/293916188,v1:172.21.15.195:6837/293916188] conn(0x55bedaf44f90 0x55bedaf47410 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e9c43513f9e455b4 server_cookie=97a17713749dcd37 in_seq=0 out_seq=0 2023-10-19T12:44:09.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.572+0000 7efee57fa700 10 client.25766 ms_handle_connect on v2:172.21.15.195:6836/293916188 2023-10-19T12:44:09.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.572+0000 7efee57fa700 1 -- 172.21.15.46:0/3065880052 <== mds.2 v2:172.21.15.195:6836/293916188 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55bedae86ef0 con 0x55bedaf44f90 2023-10-19T12:44:09.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.572+0000 7efee57fa700 10 client.25766 handle_command_reply: tid=0 2023-10-19T12:44:09.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.573+0000 7eff1752cb80 1 client.25766 shutdown 2023-10-19T12:44:09.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.573+0000 7eff1752cb80 1 -- 172.21.15.46:0/3065880052 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bedaf3e2d0 msgr2=0x55bedaf406c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:44:09.581 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.573+0000 7eff1752cb80 1 --2- 172.21.15.46:0/3065880052 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bedaf3e2d0 0x55bedaf406c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7efef4004d80 tx=0x7efef4099030 comp rx=0 tx=0).stop 2023-10-19T12:44:09.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.574+0000 7eff1752cb80 1 -- 172.21.15.46:0/3065880052 shutdown_connections 2023-10-19T12:44:09.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.574+0000 7eff1752cb80 1 --2- 172.21.15.46:0/3065880052 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bedaf3e2d0 0x55bedaf406c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:09.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.574+0000 7eff1752cb80 1 --2- 172.21.15.46:0/3065880052 >> [v2:172.21.15.195:6836/293916188,v1:172.21.15.195:6837/293916188] conn(0x55bedaf44f90 0x55bedaf47410 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:09.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.574+0000 7eff1752cb80 1 --2- 172.21.15.46:0/3065880052 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55bedaf2f5d0 0x55bedaf38d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:09.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.574+0000 7eff1752cb80 1 --2- 172.21.15.46:0/3065880052 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bedaf302d0 0x55bedaf392a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:09.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.574+0000 7eff1752cb80 1 -- 172.21.15.46:0/3065880052 >> 172.21.15.46:0/3065880052 conn(0x55bedaea3720 msgr2=0x55bedaf2e080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:44:09.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.574+0000 7efee57fa700 0 client.25766 ms_handle_reset on v2:172.21.15.195:6836/293916188 2023-10-19T12:44:09.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.574+0000 7eff1752cb80 1 -- 172.21.15.46:0/3065880052 shutdown_connections 2023-10-19T12:44:09.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.575+0000 7eff1752cb80 1 -- 172.21.15.46:0/3065880052 wait complete. 2023-10-19T12:44:09.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.575+0000 7eff1752cb80 20 client.25766 trim_cache size 0 max 16384 2023-10-19T12:44:09.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.597+0000 7eff1752cb80 1 Processor -- start 2023-10-19T12:44:09.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.597+0000 7eff1752cb80 1 -- start start 2023-10-19T12:44:09.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.597+0000 7eff1752cb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bedaf2f5d0 0x55bedaf2f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:09.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.597+0000 7eff1752cb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bedaf302d0 0x55bedaf38270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:09.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.597+0000 7eff1752cb80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55bedaf3e2d0 0x55bedaf54bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:09.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.597+0000 7eff1752cb80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bedad02920 con 0x55bedaf3e2d0 2023-10-19T12:44:09.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.597+0000 7eff1752cb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bedaf2a0a0 con 0x55bedaf2f5d0 2023-10-19T12:44:09.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.597+0000 7eff1752cb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bedaf261a0 con 0x55bedaf302d0 2023-10-19T12:44:09.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.597+0000 7eff0199b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bedaf2f5d0 0x55bedaf2f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:09.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.597+0000 7eff0199b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bedaf2f5d0 0x55bedaf2f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:40588/0 (socket says 172.21.15.46:40588) 2023-10-19T12:44:09.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.597+0000 7eff0199b700 1 -- 172.21.15.46:0/887125646 learned_addr learned my addr 172.21.15.46:0/887125646 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:44:09.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.597+0000 7eff0119a700 1 --2- 172.21.15.46:0/887125646 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bedaf302d0 0x55bedaf38270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:09.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.598+0000 7eff0219c700 1 --2- 172.21.15.46:0/887125646 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55bedaf3e2d0 0x55bedaf54bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:09.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.598+0000 7eff0199b700 1 -- 172.21.15.46:0/887125646 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bedaf302d0 msgr2=0x55bedaf38270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:44:09.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.598+0000 7eff0199b700 1 --2- 172.21.15.46:0/887125646 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bedaf302d0 0x55bedaf38270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:09.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.598+0000 7eff0199b700 1 -- 172.21.15.46:0/887125646 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55bedaf3e2d0 msgr2=0x55bedaf54bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:44:09.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.598+0000 7eff0199b700 1 --2- 172.21.15.46:0/887125646 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55bedaf3e2d0 0x55bedaf54bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:09.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.598+0000 7eff0199b700 1 -- 172.21.15.46:0/887125646 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bedac95c60 con 0x55bedaf2f5d0 2023-10-19T12:44:09.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.598+0000 7eff0219c700 1 --2- 172.21.15.46:0/887125646 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55bedaf3e2d0 0x55bedaf54bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T12:44:09.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.598+0000 7eff0199b700 1 --2- 172.21.15.46:0/887125646 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bedaf2f5d0 0x55bedaf2f090 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7efef80098e0 tx=0x7efef80092b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b249a34637d909f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:44:09.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.599+0000 7efef0bff700 1 -- 172.21.15.46:0/887125646 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef8025990 con 0x55bedaf2f5d0 2023-10-19T12:44:09.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.599+0000 7efef0bff700 1 -- 172.21.15.46:0/887125646 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efef801e030 con 0x55bedaf2f5d0 2023-10-19T12:44:09.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.599+0000 7efef0bff700 1 -- 172.21.15.46:0/887125646 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef80038e0 con 0x55bedaf2f5d0 2023-10-19T12:44:09.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.600+0000 7eff1752cb80 1 -- 172.21.15.46:0/887125646 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bedaf2f5d0 msgr2=0x55bedaf2f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:44:09.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.600+0000 7eff1752cb80 1 --2- 172.21.15.46:0/887125646 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bedaf2f5d0 0x55bedaf2f090 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7efef80098e0 tx=0x7efef80092b0 comp rx=0 tx=0).stop 2023-10-19T12:44:09.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.600+0000 7eff1752cb80 1 -- 172.21.15.46:0/887125646 shutdown_connections 2023-10-19T12:44:09.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.600+0000 7eff1752cb80 1 --2- 172.21.15.46:0/887125646 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55bedaf3e2d0 0x55bedaf54bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:09.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.600+0000 7eff1752cb80 1 --2- 172.21.15.46:0/887125646 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bedaf2f5d0 0x55bedaf2f090 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:09.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.600+0000 7eff1752cb80 1 --2- 172.21.15.46:0/887125646 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bedaf302d0 0x55bedaf38270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:09.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.600+0000 7eff1752cb80 1 -- 172.21.15.46:0/887125646 >> 172.21.15.46:0/887125646 conn(0x55bedaea3720 msgr2=0x55bedaf37780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:44:09.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.600+0000 7eff1752cb80 1 -- 172.21.15.46:0/887125646 shutdown_connections 2023-10-19T12:44:09.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.600+0000 7eff1752cb80 1 -- 172.21.15.46:0/887125646 wait complete. 2023-10-19T12:44:09.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.601+0000 7eff1752cb80 1 -- start start 2023-10-19T12:44:09.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.601+0000 7eff1752cb80 1 Processor -- start 2023-10-19T12:44:09.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.602+0000 7eff1752cb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bedaf2f5d0 0x55bedaf91760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:09.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.602+0000 7eff1752cb80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55bedaf302d0 0x55bedaf91ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:09.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.602+0000 7eff1752cb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bedaf3e2d0 0x55bedaf98750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:09.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.602+0000 7eff1752cb80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bedaf98c90 con 0x55bedaf302d0 2023-10-19T12:44:09.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.602+0000 7eff1752cb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bedaf98e00 con 0x55bedaf2f5d0 2023-10-19T12:44:09.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.602+0000 7eff1752cb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bedaf98fc0 con 0x55bedaf3e2d0 2023-10-19T12:44:09.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.602+0000 7eff1752cb80 10 client.0 _ll_register_callbacks cb 0x55bedad68a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:44:09.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.602+0000 7eff0199b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bedaf2f5d0 0x55bedaf91760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:09.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.602+0000 7eff0199b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bedaf2f5d0 0x55bedaf91760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:40596/0 (socket says 172.21.15.46:40596) 2023-10-19T12:44:09.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.602+0000 7eff0199b700 1 -- 172.21.15.46:0/2280834547 learned_addr learned my addr 172.21.15.46:0/2280834547 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:44:09.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.602+0000 7eff0219c700 1 --2- 172.21.15.46:0/2280834547 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bedaf3e2d0 0x55bedaf98750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:09.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.603+0000 7eff0119a700 1 --2- 172.21.15.46:0/2280834547 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55bedaf302d0 0x55bedaf91ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:09.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.603+0000 7eff0199b700 1 -- 172.21.15.46:0/2280834547 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bedaf3e2d0 msgr2=0x55bedaf98750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:44:09.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.603+0000 7eff0199b700 1 --2- 172.21.15.46:0/2280834547 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bedaf3e2d0 0x55bedaf98750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:09.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.603+0000 7eff0199b700 1 -- 172.21.15.46:0/2280834547 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55bedaf302d0 msgr2=0x55bedaf91ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:44:09.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.603+0000 7eff0199b700 1 --2- 172.21.15.46:0/2280834547 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55bedaf302d0 0x55bedaf91ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:09.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.603+0000 7eff0199b700 1 -- 172.21.15.46:0/2280834547 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efefc10fb60 con 0x55bedaf2f5d0 2023-10-19T12:44:09.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.604+0000 7eff0199b700 1 --2- 172.21.15.46:0/2280834547 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bedaf2f5d0 0x55bedaf91760 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7efef8004330 tx=0x7efef8005bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f5dab197fa2ea4a server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:44:09.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.604+0000 7efee57fa700 10 client.0 ms_handle_connect on v2:172.21.15.157:3300/0 2023-10-19T12:44:09.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.604+0000 7efee57fa700 1 -- 172.21.15.46:0/2280834547 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef8025b90 con 0x55bedaf2f5d0 2023-10-19T12:44:09.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.604+0000 7efee57fa700 1 -- 172.21.15.46:0/2280834547 <== mon.2 v2:172.21.15.157:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7efef8025cf0 con 0x55bedaf2f5d0 2023-10-19T12:44:09.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.604+0000 7eff1752cb80 1 -- 172.21.15.46:0/2280834547 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efeec013b10 con 0x55bedaf2f5d0 2023-10-19T12:44:09.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.605+0000 7efee57fa700 1 -- 172.21.15.46:0/2280834547 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7efef8005c30 con 0x55bedaf2f5d0 2023-10-19T12:44:09.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.605+0000 7eff1752cb80 10 client.25772 fetch_fsmap learned FSMap version 29 2023-10-19T12:44:09.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.605+0000 7eff1752cb80 1 -- 172.21.15.46:0/2280834547 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55bedacd3250 con 0x55bedaf2f5d0 2023-10-19T12:44:09.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.605+0000 7efee57fa700 1 -- 172.21.15.46:0/2280834547 <== mon.2 v2:172.21.15.157:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efeec013b10 con 0x55bedaf2f5d0 2023-10-19T12:44:09.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.606+0000 7efee57fa700 1 -- 172.21.15.46:0/2280834547 <== mon.2 v2:172.21.15.157:3300/0 5 ==== fsmap(e 29) v1 ==== 7906+0+0 (secure 0 0 0) 0x7efef800bbc0 con 0x55bedaf2f5d0 2023-10-19T12:44:09.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.606+0000 7eff1752cb80 10 client.25772 fetch_fsmap finished waiting for FSMap version 29 2023-10-19T12:44:09.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.606+0000 7eff1752cb80 10 client.25772 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-10-19T12:44:09.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.607+0000 7eff1752cb80 20 client.25772 populate_metadata read hostname 'smithi046' 2023-10-19T12:44:09.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.607+0000 7eff1752cb80 1 --2- 172.21.15.46:0/2280834547 >> [v2:172.21.15.195:6836/293916188,v1:172.21.15.195:6837/293916188] conn(0x55bedaf9a410 0x55bedaf9c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:09.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.607+0000 7eff1752cb80 4 client.25772 mds_command: new command op to 24643 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-19T12:44:09.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.607+0000 7eff1752cb80 1 -- 172.21.15.46:0/2280834547 --> [v2:172.21.15.195:6836/293916188,v1:172.21.15.195:6837/293916188] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55bedaefe8b0 con 0x55bedaf9a410 2023-10-19T12:44:09.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.607+0000 7eff0119a700 1 --2- 172.21.15.46:0/2280834547 >> [v2:172.21.15.195:6836/293916188,v1:172.21.15.195:6837/293916188] conn(0x55bedaf9a410 0x55bedaf9c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:09.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.610+0000 7eff0119a700 1 --2- 172.21.15.46:0/2280834547 >> [v2:172.21.15.195:6836/293916188,v1:172.21.15.195:6837/293916188] conn(0x55bedaf9a410 0x55bedaf9c800 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7f51699d7695eade server_cookie=b7e51565e22e2b4e in_seq=0 out_seq=0 2023-10-19T12:44:09.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.610+0000 7efee57fa700 10 client.25772 ms_handle_connect on v2:172.21.15.195:6836/293916188 2023-10-19T12:44:09.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.610+0000 7efee57fa700 1 -- 172.21.15.46:0/2280834547 <== mds.2 v2:172.21.15.195:6836/293916188 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55bedaefe8b0 con 0x55bedaf9a410 2023-10-19T12:44:09.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.610+0000 7efee57fa700 10 client.25772 handle_command_reply: tid=0 2023-10-19T12:44:09.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.610+0000 7eff1752cb80 1 client.25772 shutdown 2023-10-19T12:44:09.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.610+0000 7eff1752cb80 1 -- 172.21.15.46:0/2280834547 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bedaf2f5d0 msgr2=0x55bedaf91760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:44:09.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.610+0000 7eff1752cb80 1 --2- 172.21.15.46:0/2280834547 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bedaf2f5d0 0x55bedaf91760 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7efef8004330 tx=0x7efef8005bc0 comp rx=0 tx=0).stop 2023-10-19T12:44:09.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.611+0000 7eff1752cb80 1 -- 172.21.15.46:0/2280834547 shutdown_connections 2023-10-19T12:44:09.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.611+0000 7eff1752cb80 1 --2- 172.21.15.46:0/2280834547 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bedaf3e2d0 0x55bedaf98750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:09.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.611+0000 7eff1752cb80 1 --2- 172.21.15.46:0/2280834547 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bedaf2f5d0 0x55bedaf91760 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:09.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.611+0000 7eff1752cb80 1 --2- 172.21.15.46:0/2280834547 >> [v2:172.21.15.195:6836/293916188,v1:172.21.15.195:6837/293916188] conn(0x55bedaf9a410 0x55bedaf9c800 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:09.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.611+0000 7eff1752cb80 1 --2- 172.21.15.46:0/2280834547 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55bedaf302d0 0x55bedaf91ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:09.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.611+0000 7eff1752cb80 1 -- 172.21.15.46:0/2280834547 >> 172.21.15.46:0/2280834547 conn(0x55bedaea3720 msgr2=0x55bedaf38d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:44:09.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.611+0000 7efee57fa700 0 client.25772 ms_handle_reset on v2:172.21.15.195:6836/293916188 2023-10-19T12:44:09.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.611+0000 7eff1752cb80 1 -- 172.21.15.46:0/2280834547 shutdown_connections 2023-10-19T12:44:09.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.611+0000 7eff1752cb80 1 -- 172.21.15.46:0/2280834547 wait complete. 2023-10-19T12:44:09.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.612+0000 7eff1752cb80 20 client.25772 trim_cache size 0 max 16384 2023-10-19T12:44:09.622 INFO:teuthology.orchestra.run.smithi046.stdout:[] 2023-10-19T12:44:09.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.613+0000 7eff03bff700 1 -- 172.21.15.46:0/1821526864 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7efee80a1580 msgr2=0x7efee80a3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:44:09.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.613+0000 7eff03bff700 1 --2- 172.21.15.46:0/1821526864 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7efee80a1580 0x7efee80a3a40 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7efeec00fb00 tx=0x7efeec011000 comp rx=0 tx=0).stop 2023-10-19T12:44:09.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.613+0000 7eff03bff700 1 -- 172.21.15.46:0/1821526864 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efefc108960 msgr2=0x7efefc1a42b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:44:09.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.613+0000 7eff03bff700 1 --2- 172.21.15.46:0/1821526864 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efefc108960 0x7efefc1a42b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7efef400ab40 tx=0x7efef400ae50 comp rx=0 tx=0).stop 2023-10-19T12:44:09.624 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.613+0000 7eff03bff700 1 -- 172.21.15.46:0/1821526864 shutdown_connections 2023-10-19T12:44:09.624 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.613+0000 7eff03bff700 1 --2- 172.21.15.46:0/1821526864 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efefc108960 0x7efefc1a42b0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:09.624 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.613+0000 7eff03bff700 1 --2- 172.21.15.46:0/1821526864 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efefc106dd0 0x7efefc19cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:09.624 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.613+0000 7eff03bff700 1 --2- 172.21.15.46:0/1821526864 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7efee80a1580 0x7efee80a3a40 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:09.624 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.613+0000 7eff03bff700 1 --2- 172.21.15.46:0/1821526864 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efefc107fc0 0x7efefc19d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:09.624 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.613+0000 7eff03bff700 1 -- 172.21.15.46:0/1821526864 >> 172.21.15.46:0/1821526864 conn(0x7efefc075d70 msgr2=0x7efefc10b330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:44:09.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.614+0000 7eff03bff700 1 -- 172.21.15.46:0/1821526864 shutdown_connections 2023-10-19T12:44:09.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:09.614+0000 7eff03bff700 1 -- 172.21.15.46:0/1821526864 wait complete. 2023-10-19T12:44:09.659 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-10-19T12:44:09.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:44:09 smithi046 ceph-mon[98509]: pgmap v373: 129 pgs: 129 active+clean; 921 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 57 MiB/s wr, 176 op/s 2023-10-19T12:44:10.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.005+0000 7f05621ff700 1 -- 172.21.15.46:0/3345003355 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f055c103bc0 msgr2=0x7f055c104020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:44:10.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.005+0000 7f05621ff700 1 --2- 172.21.15.46:0/3345003355 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f055c103bc0 0x7f055c104020 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f05440099c0 tx=0x7f0544009cd0 comp rx=0 tx=0).stop 2023-10-19T12:44:10.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.006+0000 7f05621ff700 1 -- 172.21.15.46:0/3345003355 shutdown_connections 2023-10-19T12:44:10.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.006+0000 7f05621ff700 1 --2- 172.21.15.46:0/3345003355 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f055c104560 0x7f055c10ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:10.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.006+0000 7f05621ff700 1 --2- 172.21.15.46:0/3345003355 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f055c1029d0 0x7f055c102df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:10.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.006+0000 7f05621ff700 1 --2- 172.21.15.46:0/3345003355 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f055c103bc0 0x7f055c104020 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:10.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.006+0000 7f05621ff700 1 -- 172.21.15.46:0/3345003355 >> 172.21.15.46:0/3345003355 conn(0x7f055c0fdf40 msgr2=0x7f055c100380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:44:10.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.006+0000 7f05621ff700 1 -- 172.21.15.46:0/3345003355 shutdown_connections 2023-10-19T12:44:10.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.006+0000 7f05621ff700 1 -- 172.21.15.46:0/3345003355 wait complete. 2023-10-19T12:44:10.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.008+0000 7f05621ff700 1 Processor -- start 2023-10-19T12:44:10.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.008+0000 7f05621ff700 1 -- start start 2023-10-19T12:44:10.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.009+0000 7f05621ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f055c1029d0 0x7f055c19ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:10.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.009+0000 7f05621ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f055c103bc0 0x7f055c19d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:10.013 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.009+0000 7f05621ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f055c104560 0x7f055c1a43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:10.014 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.009+0000 7f05621ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f055c1a49a0 con 0x7f055c103bc0 2023-10-19T12:44:10.014 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.009+0000 7f05621ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f055c1a4ae0 con 0x7f055c104560 2023-10-19T12:44:10.014 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.010+0000 7f05621ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f055c1a4c70 con 0x7f055c1029d0 2023-10-19T12:44:10.014 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.010+0000 7f055bfff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f055c104560 0x7f055c1a43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:10.015 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.010+0000 7f055b7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f055c1029d0 0x7f055c19ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:10.015 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.010+0000 7f055b7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f055c1029d0 0x7f055c19ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:50094/0 (socket says 172.21.15.46:50094) 2023-10-19T12:44:10.015 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.010+0000 7f055b7fe700 1 -- 172.21.15.46:0/2619430973 learned_addr learned my addr 172.21.15.46:0/2619430973 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:44:10.015 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.010+0000 7f0552ffd700 1 --2- 172.21.15.46:0/2619430973 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f055c103bc0 0x7f055c19d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:10.015 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.010+0000 7f055bfff700 1 -- 172.21.15.46:0/2619430973 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f055c1029d0 msgr2=0x7f055c19ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:44:10.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.010+0000 7f055bfff700 1 --2- 172.21.15.46:0/2619430973 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f055c1029d0 0x7f055c19ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:10.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.010+0000 7f055bfff700 1 -- 172.21.15.46:0/2619430973 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f055c103bc0 msgr2=0x7f055c19d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:44:10.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.010+0000 7f055bfff700 1 --2- 172.21.15.46:0/2619430973 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f055c103bc0 0x7f055c19d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:10.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.010+0000 7f055bfff700 1 -- 172.21.15.46:0/2619430973 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05440095f0 con 0x7f055c104560 2023-10-19T12:44:10.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.010+0000 7f0552ffd700 1 --2- 172.21.15.46:0/2619430973 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f055c103bc0 0x7f055c19d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T12:44:10.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.011+0000 7f055bfff700 1 --2- 172.21.15.46:0/2619430973 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f055c104560 0x7f055c1a43d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f055400b3c0 tx=0x7f055400b6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:44:10.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.011+0000 7f05597fa700 1 -- 172.21.15.46:0/2619430973 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0554011830 con 0x7f055c104560 2023-10-19T12:44:10.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.011+0000 7f05597fa700 1 -- 172.21.15.46:0/2619430973 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f055400be80 con 0x7f055c104560 2023-10-19T12:44:10.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.011+0000 7f05597fa700 1 -- 172.21.15.46:0/2619430973 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0554010d70 con 0x7f055c104560 2023-10-19T12:44:10.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.011+0000 7f05621ff700 1 -- 172.21.15.46:0/2619430973 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f055c1a4f50 con 0x7f055c104560 2023-10-19T12:44:10.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.012+0000 7f05621ff700 1 -- 172.21.15.46:0/2619430973 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f055c1a5320 con 0x7f055c104560 2023-10-19T12:44:10.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.019+0000 7f0575b89b80 1 Processor -- start 2023-10-19T12:44:10.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.021+0000 7f05597fa700 1 -- 172.21.15.46:0/2619430973 <== mon.2 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f0554010410 con 0x7f055c104560 2023-10-19T12:44:10.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.021+0000 7f0575b89b80 1 -- start start 2023-10-19T12:44:10.028 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.022+0000 7f0575b89b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560bcf9352d0 0x560bcf9356f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:10.028 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.022+0000 7f0575b89b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560bcf935c30 0x560bcf934090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:10.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.022+0000 7f0575b89b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560bcf9345d0 0x560bcf934a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:10.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.022+0000 7f0575b89b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bcf8a76e0 con 0x560bcf935c30 2023-10-19T12:44:10.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.022+0000 7f0575b89b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bcf88dc60 con 0x560bcf9352d0 2023-10-19T12:44:10.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.022+0000 7f0575b89b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bcf88b580 con 0x560bcf9345d0 2023-10-19T12:44:10.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.022+0000 7f0552ffd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560bcf9352d0 0x560bcf9356f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:10.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.022+0000 7f0552ffd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560bcf9352d0 0x560bcf9356f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:40634/0 (socket says 172.21.15.46:40634) 2023-10-19T12:44:10.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.022+0000 7f0552ffd700 1 -- 172.21.15.46:0/970027766 learned_addr learned my addr 172.21.15.46:0/970027766 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:44:10.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.023+0000 7f0552ffd700 1 --2- 172.21.15.46:0/970027766 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560bcf9345d0 0x560bcf934a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:10.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.023+0000 7f0552ffd700 1 -- 172.21.15.46:0/970027766 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560bcf9345d0 msgr2=0x560bcf934a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:44:10.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.023+0000 7f0552ffd700 1 --2- 172.21.15.46:0/970027766 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560bcf9345d0 0x560bcf934a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:10.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.023+0000 7f0552ffd700 1 -- 172.21.15.46:0/970027766 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560bcf935c30 msgr2=0x560bcf934090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:44:10.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.023+0000 7f0552ffd700 1 --2- 172.21.15.46:0/970027766 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560bcf935c30 0x560bcf934090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:10.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.023+0000 7f0552ffd700 1 -- 172.21.15.46:0/970027766 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560bcf8443f0 con 0x560bcf9352d0 2023-10-19T12:44:10.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.024+0000 7f0552ffd700 1 --2- 172.21.15.46:0/970027766 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560bcf9352d0 0x560bcf9356f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0544003830 tx=0x7f0544005c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ae10b4b2dd6ac9d server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:44:10.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.024+0000 7f05597fa700 1 --2- 172.21.15.46:0/2619430973 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f05480a1580 0x7f05480a3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:10.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.024+0000 7f05597fa700 1 -- 172.21.15.46:0/2619430973 <== mon.2 v2:172.21.15.157:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f05540cca50 con 0x7f055c104560 2023-10-19T12:44:10.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.025+0000 7f0551ffb700 1 -- 172.21.15.46:0/970027766 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054400b790 con 0x560bcf9352d0 2023-10-19T12:44:10.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.025+0000 7f0551ffb700 1 -- 172.21.15.46:0/970027766 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f054400bdb0 con 0x560bcf9352d0 2023-10-19T12:44:10.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.025+0000 7f0551ffb700 1 -- 172.21.15.46:0/970027766 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0544004500 con 0x560bcf9352d0 2023-10-19T12:44:10.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.026+0000 7f0575b89b80 1 -- 172.21.15.46:0/970027766 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560bcf9352d0 msgr2=0x560bcf9356f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:44:10.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.026+0000 7f0575b89b80 1 --2- 172.21.15.46:0/970027766 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560bcf9352d0 0x560bcf9356f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0544003830 tx=0x7f0544005c00 comp rx=0 tx=0).stop 2023-10-19T12:44:10.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.026+0000 7f055b7fe700 1 --2- 172.21.15.46:0/2619430973 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f05480a1580 0x7f05480a3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:10.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.026+0000 7f0575b89b80 1 -- 172.21.15.46:0/970027766 shutdown_connections 2023-10-19T12:44:10.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.026+0000 7f0575b89b80 1 --2- 172.21.15.46:0/970027766 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560bcf9345d0 0x560bcf934a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:10.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.026+0000 7f0575b89b80 1 --2- 172.21.15.46:0/970027766 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560bcf9352d0 0x560bcf9356f0 secure :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0544003830 tx=0x7f0544005c00 comp rx=0 tx=0).stop 2023-10-19T12:44:10.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.026+0000 7f0575b89b80 1 --2- 172.21.15.46:0/970027766 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560bcf935c30 0x560bcf934090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:10.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.026+0000 7f0575b89b80 1 -- 172.21.15.46:0/970027766 >> 172.21.15.46:0/970027766 conn(0x560bcf8a8720 msgr2=0x560bcf92eb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:44:10.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.027+0000 7f0575b89b80 1 -- 172.21.15.46:0/970027766 shutdown_connections 2023-10-19T12:44:10.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.027+0000 7f0575b89b80 1 -- 172.21.15.46:0/970027766 wait complete. 2023-10-19T12:44:10.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.028+0000 7f0575b89b80 1 -- start start 2023-10-19T12:44:10.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.028+0000 7f0575b89b80 1 Processor -- start 2023-10-19T12:44:10.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.029+0000 7f055b7fe700 1 --2- 172.21.15.46:0/2619430973 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f05480a1580 0x7f05480a3a40 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f054c00e250 tx=0x7f054c00b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:44:10.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.029+0000 7f0575b89b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560bcf9345d0 0x560bcf93dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:10.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.029+0000 7f0575b89b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560bcf935c30 0x560bcf93e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:10.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.029+0000 7f0575b89b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560bcf943280 0x560bcf945670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:10.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.029+0000 7f0575b89b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bcf886e70 con 0x560bcf943280 2023-10-19T12:44:10.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.029+0000 7f0575b89b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bcf823710 con 0x560bcf9345d0 2023-10-19T12:44:10.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.029+0000 7f0575b89b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bcf8233b0 con 0x560bcf935c30 2023-10-19T12:44:10.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.029+0000 7f0575b89b80 10 client.0 _ll_register_callbacks cb 0x560bcf76da80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:44:10.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.029+0000 7f055b7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560bcf9345d0 0x560bcf93dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:10.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.030+0000 7f055b7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560bcf9345d0 0x560bcf93dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:40642/0 (socket says 172.21.15.46:40642) 2023-10-19T12:44:10.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.030+0000 7f055b7fe700 1 -- 172.21.15.46:0/2336642149 learned_addr learned my addr 172.21.15.46:0/2336642149 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:44:10.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.030+0000 7f055bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560bcf943280 0x560bcf945670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:10.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.029+0000 7f0552ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560bcf935c30 0x560bcf93e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:10.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.030+0000 7f055b7fe700 1 -- 172.21.15.46:0/2336642149 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560bcf935c30 msgr2=0x560bcf93e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:44:10.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.030+0000 7f055b7fe700 1 --2- 172.21.15.46:0/2336642149 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560bcf935c30 0x560bcf93e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:10.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.030+0000 7f055b7fe700 1 -- 172.21.15.46:0/2336642149 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560bcf943280 msgr2=0x560bcf945670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:44:10.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.030+0000 7f055b7fe700 1 --2- 172.21.15.46:0/2336642149 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560bcf943280 0x560bcf945670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:10.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.030+0000 7f055b7fe700 1 -- 172.21.15.46:0/2336642149 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f055c10b760 con 0x560bcf9345d0 2023-10-19T12:44:10.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.031+0000 7f055b7fe700 1 --2- 172.21.15.46:0/2336642149 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560bcf9345d0 0x560bcf93dd10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f054c0159a0 tx=0x7f054c004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b7de23f9d2bed6b server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:44:10.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.031+0000 7f053affd700 10 client.0 ms_handle_connect on v2:172.21.15.157:3300/0 2023-10-19T12:44:10.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.031+0000 7f053affd700 1 -- 172.21.15.46:0/2336642149 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054c0136c0 con 0x560bcf9345d0 2023-10-19T12:44:10.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.031+0000 7f0575b89b80 1 -- 172.21.15.46:0/2336642149 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560bcf88bef0 con 0x560bcf9345d0 2023-10-19T12:44:10.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.031+0000 7f053affd700 1 -- 172.21.15.46:0/2336642149 <== mon.2 v2:172.21.15.157:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f054c006e40 con 0x560bcf9345d0 2023-10-19T12:44:10.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.032+0000 7f053affd700 1 -- 172.21.15.46:0/2336642149 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f054c013820 con 0x560bcf9345d0 2023-10-19T12:44:10.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.032+0000 7f0575b89b80 10 client.25784 fetch_fsmap learned FSMap version 29 2023-10-19T12:44:10.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.032+0000 7f0575b89b80 1 -- 172.21.15.46:0/2336642149 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x560bcf6b1de0 con 0x560bcf9345d0 2023-10-19T12:44:10.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.032+0000 7f053affd700 1 -- 172.21.15.46:0/2336642149 <== mon.2 v2:172.21.15.157:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x560bcf88bef0 con 0x560bcf9345d0 2023-10-19T12:44:10.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.033+0000 7f053affd700 1 -- 172.21.15.46:0/2336642149 <== mon.2 v2:172.21.15.157:3300/0 5 ==== fsmap(e 29) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f054c01f3f0 con 0x560bcf9345d0 2023-10-19T12:44:10.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.034+0000 7f0575b89b80 10 client.25784 fetch_fsmap finished waiting for FSMap version 29 2023-10-19T12:44:10.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.034+0000 7f0575b89b80 10 client.25784 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-10-19T12:44:10.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.034+0000 7f0575b89b80 20 client.25784 populate_metadata read hostname 'smithi046' 2023-10-19T12:44:10.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.034+0000 7f0575b89b80 1 --2- 172.21.15.46:0/2336642149 >> [v2:172.21.15.195:6838/4094901934,v1:172.21.15.195:6839/4094901934] conn(0x560bcf949fa0 0x560bcf94c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:10.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.034+0000 7f0575b89b80 4 client.25784 mds_command: new command op to 24655 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-19T12:44:10.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.034+0000 7f0575b89b80 1 -- 172.21.15.46:0/2336642149 --> [v2:172.21.15.195:6838/4094901934,v1:172.21.15.195:6839/4094901934] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560bcf9038b0 con 0x560bcf949fa0 2023-10-19T12:44:10.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.034+0000 7f0552ffd700 1 --2- 172.21.15.46:0/2336642149 >> [v2:172.21.15.195:6838/4094901934,v1:172.21.15.195:6839/4094901934] conn(0x560bcf949fa0 0x560bcf94c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:10.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.035+0000 7f0552ffd700 1 --2- 172.21.15.46:0/2336642149 >> [v2:172.21.15.195:6838/4094901934,v1:172.21.15.195:6839/4094901934] conn(0x560bcf949fa0 0x560bcf94c3c0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ca2d0ff6803520a0 server_cookie=e82b2e10351140e8 in_seq=0 out_seq=0 2023-10-19T12:44:10.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.035+0000 7f053affd700 10 client.25784 ms_handle_connect on v2:172.21.15.195:6838/4094901934 2023-10-19T12:44:10.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.036+0000 7f053affd700 1 -- 172.21.15.46:0/2336642149 <== mds.1 v2:172.21.15.195:6838/4094901934 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x560bcf9038b0 con 0x560bcf949fa0 2023-10-19T12:44:10.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.036+0000 7f053affd700 10 client.25784 handle_command_reply: tid=0 2023-10-19T12:44:10.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.036+0000 7f0575b89b80 1 client.25784 shutdown 2023-10-19T12:44:10.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.036+0000 7f0575b89b80 1 -- 172.21.15.46:0/2336642149 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560bcf9345d0 msgr2=0x560bcf93dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:44:10.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.036+0000 7f0575b89b80 1 --2- 172.21.15.46:0/2336642149 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560bcf9345d0 0x560bcf93dd10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f054c0159a0 tx=0x7f054c004ad0 comp rx=0 tx=0).stop 2023-10-19T12:44:10.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.037+0000 7f0575b89b80 1 -- 172.21.15.46:0/2336642149 shutdown_connections 2023-10-19T12:44:10.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.037+0000 7f0575b89b80 1 --2- 172.21.15.46:0/2336642149 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560bcf943280 0x560bcf945670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:10.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.037+0000 7f0575b89b80 1 --2- 172.21.15.46:0/2336642149 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560bcf9345d0 0x560bcf93dd10 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:10.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.037+0000 7f0575b89b80 1 --2- 172.21.15.46:0/2336642149 >> [v2:172.21.15.195:6838/4094901934,v1:172.21.15.195:6839/4094901934] conn(0x560bcf949fa0 0x560bcf94c3c0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:10.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.037+0000 7f0575b89b80 1 --2- 172.21.15.46:0/2336642149 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560bcf935c30 0x560bcf93e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:10.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.037+0000 7f053affd700 0 client.25784 ms_handle_reset on v2:172.21.15.195:6838/4094901934 2023-10-19T12:44:10.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.037+0000 7f0575b89b80 1 -- 172.21.15.46:0/2336642149 >> 172.21.15.46:0/2336642149 conn(0x560bcf8a8720 msgr2=0x560bcf933080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:44:10.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.037+0000 7f0575b89b80 1 -- 172.21.15.46:0/2336642149 shutdown_connections 2023-10-19T12:44:10.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.037+0000 7f0575b89b80 1 -- 172.21.15.46:0/2336642149 wait complete. 2023-10-19T12:44:10.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.038+0000 7f0575b89b80 20 client.25784 trim_cache size 0 max 16384 2023-10-19T12:44:10.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.082+0000 7f0575b89b80 1 Processor -- start 2023-10-19T12:44:10.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.082+0000 7f0575b89b80 1 -- start start 2023-10-19T12:44:10.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.083+0000 7f0575b89b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560bcf9345d0 0x560bcf934090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:10.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.083+0000 7f0575b89b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560bcf935c30 0x560bcf945d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:10.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.083+0000 7f0575b89b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560bcf943280 0x560bcf959be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:10.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.083+0000 7f0575b89b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bcf707920 con 0x560bcf935c30 2023-10-19T12:44:10.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.083+0000 7f0575b89b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bcf92f0a0 con 0x560bcf9345d0 2023-10-19T12:44:10.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.083+0000 7f0575b89b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bcf934c60 con 0x560bcf943280 2023-10-19T12:44:10.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:44:09 smithi157 ceph-mon[134109]: pgmap v373: 129 pgs: 129 active+clean; 921 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 57 MiB/s wr, 176 op/s 2023-10-19T12:44:10.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.083+0000 7f055b7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560bcf9345d0 0x560bcf934090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:10.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.084+0000 7f055bfff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560bcf943280 0x560bcf959be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:10.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.084+0000 7f055b7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560bcf9345d0 0x560bcf934090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:40656/0 (socket says 172.21.15.46:40656) 2023-10-19T12:44:10.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.084+0000 7f055b7fe700 1 -- 172.21.15.46:0/2611108005 learned_addr learned my addr 172.21.15.46:0/2611108005 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:44:10.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.084+0000 7f055b7fe700 1 -- 172.21.15.46:0/2611108005 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560bcf943280 msgr2=0x560bcf959be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:44:10.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.084+0000 7f055b7fe700 1 --2- 172.21.15.46:0/2611108005 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560bcf943280 0x560bcf959be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:10.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.084+0000 7f055b7fe700 1 -- 172.21.15.46:0/2611108005 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560bcf935c30 msgr2=0x560bcf945d50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-19T12:44:10.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.084+0000 7f055b7fe700 1 --2- 172.21.15.46:0/2611108005 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560bcf935c30 0x560bcf945d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:10.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.084+0000 7f055b7fe700 1 -- 172.21.15.46:0/2611108005 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560bcf69ac60 con 0x560bcf9345d0 2023-10-19T12:44:10.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.085+0000 7f055b7fe700 1 --2- 172.21.15.46:0/2611108005 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560bcf9345d0 0x560bcf934090 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f054c0095a0 tx=0x7f054c0097d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db9e8b659d2cef40 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:44:10.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.085+0000 7f05527fc700 1 -- 172.21.15.46:0/2611108005 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054c0133c0 con 0x560bcf9345d0 2023-10-19T12:44:10.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.085+0000 7f05527fc700 1 -- 172.21.15.46:0/2611108005 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f054c00f040 con 0x560bcf9345d0 2023-10-19T12:44:10.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.085+0000 7f05527fc700 1 -- 172.21.15.46:0/2611108005 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054c01fba0 con 0x560bcf9345d0 2023-10-19T12:44:10.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.086+0000 7f0575b89b80 1 -- 172.21.15.46:0/2611108005 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560bcf9345d0 msgr2=0x560bcf934090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:44:10.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.086+0000 7f0575b89b80 1 --2- 172.21.15.46:0/2611108005 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560bcf9345d0 0x560bcf934090 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f054c0095a0 tx=0x7f054c0097d0 comp rx=0 tx=0).stop 2023-10-19T12:44:10.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.087+0000 7f0575b89b80 1 -- 172.21.15.46:0/2611108005 shutdown_connections 2023-10-19T12:44:10.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.087+0000 7f0575b89b80 1 --2- 172.21.15.46:0/2611108005 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560bcf943280 0x560bcf959be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:10.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.087+0000 7f0575b89b80 1 --2- 172.21.15.46:0/2611108005 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560bcf9345d0 0x560bcf934090 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:10.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.089+0000 7f0575b89b80 1 --2- 172.21.15.46:0/2611108005 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560bcf935c30 0x560bcf945d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:10.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.089+0000 7f0575b89b80 1 -- 172.21.15.46:0/2611108005 >> 172.21.15.46:0/2611108005 conn(0x560bcf8a8720 msgr2=0x560bcf950d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:44:10.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.089+0000 7f0575b89b80 1 -- 172.21.15.46:0/2611108005 shutdown_connections 2023-10-19T12:44:10.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.090+0000 7f0575b89b80 1 -- 172.21.15.46:0/2611108005 wait complete. 2023-10-19T12:44:10.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.090+0000 7f0575b89b80 1 -- start start 2023-10-19T12:44:10.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.090+0000 7f0575b89b80 1 Processor -- start 2023-10-19T12:44:10.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.093+0000 7f0575b89b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560bcf9345d0 0x560bcf998510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:10.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.093+0000 7f0575b89b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560bcf935c30 0x560bcf99aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:10.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.093+0000 7f0575b89b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560bcf943280 0x560bcf99d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:10.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.094+0000 7f0552ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560bcf935c30 0x560bcf99aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:10.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.094+0000 7f0552ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560bcf935c30 0x560bcf99aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55702/0 (socket says 172.21.15.46:55702) 2023-10-19T12:44:10.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.094+0000 7f055bfff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560bcf943280 0x560bcf99d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:10.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.094+0000 7f055bfff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560bcf943280 0x560bcf99d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:50118/0 (socket says 172.21.15.46:50118) 2023-10-19T12:44:10.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.094+0000 7f0575b89b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bcf99d720 con 0x560bcf935c30 2023-10-19T12:44:10.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.094+0000 7f0575b89b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bcf99d890 con 0x560bcf9345d0 2023-10-19T12:44:10.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.094+0000 7f0575b89b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bcf99da50 con 0x560bcf943280 2023-10-19T12:44:10.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.094+0000 7f0552ffd700 1 -- 172.21.15.46:0/2394053812 learned_addr learned my addr 172.21.15.46:0/2394053812 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:44:10.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.094+0000 7f0575b89b80 10 client.0 _ll_register_callbacks cb 0x560bcf76da80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:44:10.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.095+0000 7f055b7fe700 1 --2- 172.21.15.46:0/2394053812 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560bcf9345d0 0x560bcf998510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:10.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.096+0000 7f0552ffd700 1 -- 172.21.15.46:0/2394053812 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560bcf943280 msgr2=0x560bcf99d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:44:10.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.096+0000 7f0552ffd700 1 --2- 172.21.15.46:0/2394053812 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560bcf943280 0x560bcf99d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:10.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.096+0000 7f0552ffd700 1 -- 172.21.15.46:0/2394053812 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560bcf9345d0 msgr2=0x560bcf998510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:44:10.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.096+0000 7f0552ffd700 1 --2- 172.21.15.46:0/2394053812 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560bcf9345d0 0x560bcf998510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:10.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.096+0000 7f0552ffd700 1 -- 172.21.15.46:0/2394053812 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560bcf6b1de0 con 0x560bcf935c30 2023-10-19T12:44:10.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.096+0000 7f0575b89b80 1 -- 172.21.15.46:0/2394053812 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f054400bdb0 con 0x560bcf935c30 2023-10-19T12:44:10.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.100+0000 7f0552ffd700 1 --2- 172.21.15.46:0/2394053812 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560bcf935c30 0x560bcf99aa60 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f0544003680 tx=0x7f054400bfb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=407f3e2bc19983d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:44:10.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.100+0000 7f053affd700 10 client.15744 ms_handle_connect on v2:172.21.15.46:3300/0 2023-10-19T12:44:10.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.101+0000 7f053affd700 1 -- 172.21.15.46:0/2394053812 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054403f070 con 0x560bcf935c30 2023-10-19T12:44:10.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.102+0000 7f053affd700 1 -- 172.21.15.46:0/2394053812 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f05440038d0 con 0x560bcf935c30 2023-10-19T12:44:10.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.102+0000 7f053affd700 1 -- 172.21.15.46:0/2394053812 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f05440465d0 con 0x560bcf935c30 2023-10-19T12:44:10.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.102+0000 7f0575b89b80 10 client.15744 fetch_fsmap learned FSMap version 29 2023-10-19T12:44:10.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.102+0000 7f0575b89b80 1 -- 172.21.15.46:0/2394053812 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({fsmap=29}) v3 -- 0x560bcf6d8250 con 0x560bcf935c30 2023-10-19T12:44:10.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.105+0000 7f053affd700 1 -- 172.21.15.46:0/2394053812 <== mon.0 v2:172.21.15.46:3300/0 4 ==== fsmap(e 29) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f0544003a90 con 0x560bcf935c30 2023-10-19T12:44:10.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.105+0000 7f0575b89b80 10 client.15744 fetch_fsmap finished waiting for FSMap version 29 2023-10-19T12:44:10.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.105+0000 7f0575b89b80 10 client.15744 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-10-19T12:44:10.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.105+0000 7f0575b89b80 20 client.15744 populate_metadata read hostname 'smithi046' 2023-10-19T12:44:10.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.105+0000 7f0575b89b80 1 --2- 172.21.15.46:0/2394053812 >> [v2:172.21.15.195:6838/4094901934,v1:172.21.15.195:6839/4094901934] conn(0x560bcf99ecf0 0x560bcf9a10e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:10.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.105+0000 7f0575b89b80 4 client.15744 mds_command: new command op to 24655 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-19T12:44:10.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.105+0000 7f0575b89b80 1 -- 172.21.15.46:0/2394053812 --> [v2:172.21.15.195:6838/4094901934,v1:172.21.15.195:6839/4094901934] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x560bcf87fe50 con 0x560bcf99ecf0 2023-10-19T12:44:10.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.106+0000 7f055b7fe700 1 --2- 172.21.15.46:0/2394053812 >> [v2:172.21.15.195:6838/4094901934,v1:172.21.15.195:6839/4094901934] conn(0x560bcf99ecf0 0x560bcf9a10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:10.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.107+0000 7f055b7fe700 1 --2- 172.21.15.46:0/2394053812 >> [v2:172.21.15.195:6838/4094901934,v1:172.21.15.195:6839/4094901934] conn(0x560bcf99ecf0 0x560bcf9a10e0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1e7f1f805dde3d94 server_cookie=405c8c087669daed in_seq=0 out_seq=0 2023-10-19T12:44:10.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.107+0000 7f053affd700 10 client.15744 ms_handle_connect on v2:172.21.15.195:6838/4094901934 2023-10-19T12:44:10.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.107+0000 7f053affd700 1 -- 172.21.15.46:0/2394053812 <== mds.1 v2:172.21.15.195:6838/4094901934 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x560bcf87fe50 con 0x560bcf99ecf0 2023-10-19T12:44:10.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.107+0000 7f053affd700 10 client.15744 handle_command_reply: tid=0 2023-10-19T12:44:10.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.108+0000 7f0575b89b80 1 client.15744 shutdown 2023-10-19T12:44:10.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.108+0000 7f0575b89b80 1 -- 172.21.15.46:0/2394053812 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560bcf935c30 msgr2=0x560bcf99aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:44:10.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.108+0000 7f0575b89b80 1 --2- 172.21.15.46:0/2394053812 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560bcf935c30 0x560bcf99aa60 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f0544003680 tx=0x7f054400bfb0 comp rx=0 tx=0).stop 2023-10-19T12:44:10.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.109+0000 7f0575b89b80 1 -- 172.21.15.46:0/2394053812 shutdown_connections 2023-10-19T12:44:10.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.109+0000 7f0575b89b80 1 --2- 172.21.15.46:0/2394053812 >> [v2:172.21.15.195:6838/4094901934,v1:172.21.15.195:6839/4094901934] conn(0x560bcf99ecf0 0x560bcf9a10e0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:10.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.109+0000 7f0575b89b80 1 --2- 172.21.15.46:0/2394053812 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560bcf943280 0x560bcf99d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:10.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.109+0000 7f0575b89b80 1 --2- 172.21.15.46:0/2394053812 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560bcf9345d0 0x560bcf998510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:10.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.109+0000 7f053affd700 0 client.15744 ms_handle_reset on v2:172.21.15.195:6838/4094901934 2023-10-19T12:44:10.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.109+0000 7f0575b89b80 1 --2- 172.21.15.46:0/2394053812 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560bcf935c30 0x560bcf99aa60 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:10.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.109+0000 7f0575b89b80 1 -- 172.21.15.46:0/2394053812 >> 172.21.15.46:0/2394053812 conn(0x560bcf8a8720 msgr2=0x560bcf93d220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:44:10.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.110+0000 7f0575b89b80 1 -- 172.21.15.46:0/2394053812 shutdown_connections 2023-10-19T12:44:10.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.110+0000 7f0575b89b80 1 -- 172.21.15.46:0/2394053812 wait complete. 2023-10-19T12:44:10.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.111+0000 7f0575b89b80 20 client.15744 trim_cache size 0 max 16384 2023-10-19T12:44:10.115 INFO:teuthology.orchestra.run.smithi046.stdout:[] 2023-10-19T12:44:10.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.114+0000 7f05621ff700 1 -- 172.21.15.46:0/2619430973 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f05480a1580 msgr2=0x7f05480a3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:44:10.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.114+0000 7f05621ff700 1 --2- 172.21.15.46:0/2619430973 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f05480a1580 0x7f05480a3a40 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f054c00e250 tx=0x7f054c00b040 comp rx=0 tx=0).stop 2023-10-19T12:44:10.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.114+0000 7f05621ff700 1 -- 172.21.15.46:0/2619430973 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f055c104560 msgr2=0x7f055c1a43d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:44:10.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.114+0000 7f05621ff700 1 --2- 172.21.15.46:0/2619430973 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f055c104560 0x7f055c1a43d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f055400b3c0 tx=0x7f055400b6d0 comp rx=0 tx=0).stop 2023-10-19T12:44:10.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.114+0000 7f05621ff700 1 -- 172.21.15.46:0/2619430973 shutdown_connections 2023-10-19T12:44:10.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.114+0000 7f05621ff700 1 --2- 172.21.15.46:0/2619430973 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f055c104560 0x7f055c1a43d0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:10.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.114+0000 7f05621ff700 1 --2- 172.21.15.46:0/2619430973 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f05480a1580 0x7f05480a3a40 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:10.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.114+0000 7f05621ff700 1 --2- 172.21.15.46:0/2619430973 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f055c1029d0 0x7f055c19ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:10.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.114+0000 7f05621ff700 1 --2- 172.21.15.46:0/2619430973 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f055c103bc0 0x7f055c19d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:10.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.114+0000 7f05621ff700 1 -- 172.21.15.46:0/2619430973 >> 172.21.15.46:0/2619430973 conn(0x7f055c0fdf40 msgr2=0x7f055c076c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:44:10.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.114+0000 7f05621ff700 1 -- 172.21.15.46:0/2619430973 shutdown_connections 2023-10-19T12:44:10.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.115+0000 7f05621ff700 1 -- 172.21.15.46:0/2619430973 wait complete. 2023-10-19T12:44:10.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:44:09 smithi195 ceph-mon[134493]: pgmap v373: 129 pgs: 129 active+clean; 921 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 57 MiB/s wr, 176 op/s 2023-10-19T12:44:10.152 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-19T12:44:10.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.442+0000 7f7c661ff700 1 -- 172.21.15.46:0/630211071 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7c600ff080 msgr2=0x7f7c600ff4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:44:10.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.442+0000 7f7c661ff700 1 --2- 172.21.15.46:0/630211071 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7c600ff080 0x7f7c600ff4a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7c500098f0 tx=0x7f7c50009c00 comp rx=0 tx=0).stop 2023-10-19T12:44:10.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.443+0000 7f7c661ff700 1 -- 172.21.15.46:0/630211071 shutdown_connections 2023-10-19T12:44:10.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.443+0000 7f7c661ff700 1 --2- 172.21.15.46:0/630211071 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7c601003a0 0x7f7c60100820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:10.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.443+0000 7f7c661ff700 1 --2- 172.21.15.46:0/630211071 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7c600ff080 0x7f7c600ff4a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:10.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.443+0000 7f7c661ff700 1 --2- 172.21.15.46:0/630211071 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7c600ff9e0 0x7f7c600ffe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:10.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.443+0000 7f7c661ff700 1 -- 172.21.15.46:0/630211071 >> 172.21.15.46:0/630211071 conn(0x7f7c600fac00 msgr2=0x7f7c600fd040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:44:10.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.443+0000 7f7c661ff700 1 -- 172.21.15.46:0/630211071 shutdown_connections 2023-10-19T12:44:10.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.443+0000 7f7c661ff700 1 -- 172.21.15.46:0/630211071 wait complete. 2023-10-19T12:44:10.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.444+0000 7f7c661ff700 1 Processor -- start 2023-10-19T12:44:10.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.445+0000 7f7c661ff700 1 -- start start 2023-10-19T12:44:10.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.445+0000 7f7c661ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7c600ff080 0x7f7c601989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:10.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.445+0000 7f7c661ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7c600ff9e0 0x7f7c60198f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:10.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.446+0000 7f7c661ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7c601003a0 0x7f7c6019ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:10.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.446+0000 7f7c661ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c601a04f0 con 0x7f7c600ff080 2023-10-19T12:44:10.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.446+0000 7f7c661ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c601a0630 con 0x7f7c600ff9e0 2023-10-19T12:44:10.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.446+0000 7f7c661ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c601a07c0 con 0x7f7c601003a0 2023-10-19T12:44:10.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.446+0000 7f7c5effd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7c600ff9e0 0x7f7c60198f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:10.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.446+0000 7f7c5effd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7c600ff9e0 0x7f7c60198f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:40686/0 (socket says 172.21.15.46:40686) 2023-10-19T12:44:10.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.446+0000 7f7c5effd700 1 -- 172.21.15.46:0/1140233886 learned_addr learned my addr 172.21.15.46:0/1140233886 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:44:10.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.446+0000 7f7c5ffff700 1 --2- 172.21.15.46:0/1140233886 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7c601003a0 0x7f7c6019ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:10.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.446+0000 7f7c5f7fe700 1 --2- 172.21.15.46:0/1140233886 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7c600ff080 0x7f7c601989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:10.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.446+0000 7f7c5effd700 1 -- 172.21.15.46:0/1140233886 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7c601003a0 msgr2=0x7f7c6019ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:44:10.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.446+0000 7f7c5effd700 1 --2- 172.21.15.46:0/1140233886 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7c601003a0 0x7f7c6019ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:10.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.446+0000 7f7c5effd700 1 -- 172.21.15.46:0/1140233886 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7c600ff080 msgr2=0x7f7c601989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:44:10.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.447+0000 7f7c5effd700 1 --2- 172.21.15.46:0/1140233886 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7c600ff080 0x7f7c601989c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:10.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.447+0000 7f7c5effd700 1 -- 172.21.15.46:0/1140233886 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c58009d00 con 0x7f7c600ff9e0 2023-10-19T12:44:10.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.447+0000 7f7c5ffff700 1 --2- 172.21.15.46:0/1140233886 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7c601003a0 0x7f7c6019ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:44:10.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.448+0000 7f7c5effd700 1 --2- 172.21.15.46:0/1140233886 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7c600ff9e0 0x7f7c60198f00 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7c5400b530 tx=0x7f7c5400b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:44:10.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.448+0000 7f7c5cff9700 1 -- 172.21.15.46:0/1140233886 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c54011830 con 0x7f7c600ff9e0 2023-10-19T12:44:10.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.448+0000 7f7c661ff700 1 -- 172.21.15.46:0/1140233886 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c50009520 con 0x7f7c600ff9e0 2023-10-19T12:44:10.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.448+0000 7f7c5cff9700 1 -- 172.21.15.46:0/1140233886 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7c54011e50 con 0x7f7c600ff9e0 2023-10-19T12:44:10.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.448+0000 7f7c5cff9700 1 -- 172.21.15.46:0/1140233886 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c5400f2e0 con 0x7f7c600ff9e0 2023-10-19T12:44:10.455 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.448+0000 7f7c661ff700 1 -- 172.21.15.46:0/1140233886 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c601a0e70 con 0x7f7c600ff9e0 2023-10-19T12:44:10.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.456+0000 7f7c5cff9700 1 -- 172.21.15.46:0/1140233886 <== mon.2 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f7c540105a0 con 0x7f7c600ff9e0 2023-10-19T12:44:10.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.460+0000 7f7c5cff9700 1 --2- 172.21.15.46:0/1140233886 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f7c480a1580 0x7f7c480a3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:10.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.460+0000 7f7c79bc6b80 1 Processor -- start 2023-10-19T12:44:10.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.460+0000 7f7c5cff9700 1 -- 172.21.15.46:0/1140233886 <== mon.2 v2:172.21.15.157:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f7c540cca80 con 0x7f7c600ff9e0 2023-10-19T12:44:10.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.460+0000 7f7c79bc6b80 1 -- start start 2023-10-19T12:44:10.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.460+0000 7f7c5f7fe700 1 --2- 172.21.15.46:0/1140233886 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f7c480a1580 0x7f7c480a3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:10.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.461+0000 7f7c79bc6b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560f4927d300 0x560f4927d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:10.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.461+0000 7f7c79bc6b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560f4927dc60 0x560f4927c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:10.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.461+0000 7f7c79bc6b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560f4927c5e0 0x560f4927ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:10.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.461+0000 7f7c79bc6b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f491de6e0 con 0x560f4927d300 2023-10-19T12:44:10.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.461+0000 7f7c79bc6b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f491c4c60 con 0x560f4927c5e0 2023-10-19T12:44:10.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.461+0000 7f7c79bc6b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f491c2580 con 0x560f4927dc60 2023-10-19T12:44:10.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.462+0000 7f7c5effd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560f4927dc60 0x560f4927c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:10.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.462+0000 7f7c5effd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560f4927dc60 0x560f4927c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:50144/0 (socket says 172.21.15.46:50144) 2023-10-19T12:44:10.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.462+0000 7f7c5effd700 1 -- 172.21.15.46:0/2258026891 learned_addr learned my addr 172.21.15.46:0/2258026891 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:44:10.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.462+0000 7f7c5ffff700 1 --2- 172.21.15.46:0/2258026891 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560f4927c5e0 0x560f4927ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:10.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.463+0000 7f7c5effd700 1 -- 172.21.15.46:0/2258026891 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560f4927c5e0 msgr2=0x560f4927ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:44:10.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.463+0000 7f7c5effd700 1 --2- 172.21.15.46:0/2258026891 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560f4927c5e0 0x560f4927ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:10.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.463+0000 7f7c5effd700 1 -- 172.21.15.46:0/2258026891 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560f4927d300 msgr2=0x560f4927d720 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-19T12:44:10.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.463+0000 7f7c5effd700 1 --2- 172.21.15.46:0/2258026891 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560f4927d300 0x560f4927d720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:10.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.463+0000 7f7c5effd700 1 -- 172.21.15.46:0/2258026891 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560f4917b3f0 con 0x560f4927dc60 2023-10-19T12:44:10.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.463+0000 7f7c5ffff700 1 --2- 172.21.15.46:0/2258026891 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560f4927c5e0 0x560f4927ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T12:44:10.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.463+0000 7f7c5effd700 1 --2- 172.21.15.46:0/2258026891 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560f4927dc60 0x560f4927c0a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7c540a17d0 tx=0x7f7c540109a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bfe6be9a0c3efa32 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:44:10.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.464+0000 7f7c45ffb700 1 -- 172.21.15.46:0/2258026891 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c54099970 con 0x560f4927dc60 2023-10-19T12:44:10.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.464+0000 7f7c45ffb700 1 -- 172.21.15.46:0/2258026891 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7c54095cd0 con 0x560f4927dc60 2023-10-19T12:44:10.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.464+0000 7f7c45ffb700 1 -- 172.21.15.46:0/2258026891 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c540990c0 con 0x560f4927dc60 2023-10-19T12:44:10.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.464+0000 7f7c5f7fe700 1 --2- 172.21.15.46:0/1140233886 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f7c480a1580 0x7f7c480a3a40 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f7c5000f9e0 tx=0x7f7c50019040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:44:10.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.464+0000 7f7c79bc6b80 1 -- 172.21.15.46:0/2258026891 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560f4927dc60 msgr2=0x560f4927c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:44:10.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.464+0000 7f7c79bc6b80 1 --2- 172.21.15.46:0/2258026891 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560f4927dc60 0x560f4927c0a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7c540a17d0 tx=0x7f7c540109a0 comp rx=0 tx=0).stop 2023-10-19T12:44:10.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.465+0000 7f7c79bc6b80 1 -- 172.21.15.46:0/2258026891 shutdown_connections 2023-10-19T12:44:10.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.465+0000 7f7c79bc6b80 1 --2- 172.21.15.46:0/2258026891 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560f4927c5e0 0x560f4927ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:10.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.465+0000 7f7c79bc6b80 1 --2- 172.21.15.46:0/2258026891 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560f4927d300 0x560f4927d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:10.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.465+0000 7f7c79bc6b80 1 --2- 172.21.15.46:0/2258026891 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560f4927dc60 0x560f4927c0a0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:10.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.465+0000 7f7c79bc6b80 1 -- 172.21.15.46:0/2258026891 >> 172.21.15.46:0/2258026891 conn(0x560f491df720 msgr2=0x560f49265b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:44:10.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.465+0000 7f7c79bc6b80 1 -- 172.21.15.46:0/2258026891 shutdown_connections 2023-10-19T12:44:10.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.465+0000 7f7c79bc6b80 1 -- 172.21.15.46:0/2258026891 wait complete. 2023-10-19T12:44:10.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.466+0000 7f7c79bc6b80 1 -- start start 2023-10-19T12:44:10.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.466+0000 7f7c79bc6b80 1 Processor -- start 2023-10-19T12:44:10.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.467+0000 7f7c79bc6b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560f4927c5e0 0x560f49285b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:10.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.467+0000 7f7c79bc6b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560f4927d300 0x560f492860d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:10.476 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.467+0000 7f7c79bc6b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560f4927dc60 0x560f4928d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:10.476 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.467+0000 7f7c79bc6b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f491bde70 con 0x560f4927dc60 2023-10-19T12:44:10.476 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.467+0000 7f7c79bc6b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f4915a710 con 0x560f4927d300 2023-10-19T12:44:10.476 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.467+0000 7f7c79bc6b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f4915a3b0 con 0x560f4927c5e0 2023-10-19T12:44:10.477 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.467+0000 7f7c79bc6b80 10 client.0 _ll_register_callbacks cb 0x560f490a4a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:44:10.477 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.467+0000 7f7c5effd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560f4927d300 0x560f492860d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:10.477 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.467+0000 7f7c5f7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560f4927c5e0 0x560f49285b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:10.477 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.467+0000 7f7c5f7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560f4927c5e0 0x560f49285b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:50154/0 (socket says 172.21.15.46:50154) 2023-10-19T12:44:10.477 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.467+0000 7f7c5f7fe700 1 -- 172.21.15.46:0/4124520808 learned_addr learned my addr 172.21.15.46:0/4124520808 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:44:10.478 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.467+0000 7f7c5ffff700 1 --2- 172.21.15.46:0/4124520808 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560f4927dc60 0x560f4928d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:10.478 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.468+0000 7f7c5effd700 1 -- 172.21.15.46:0/4124520808 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560f4927c5e0 msgr2=0x560f49285b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:44:10.478 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.468+0000 7f7c5effd700 1 --2- 172.21.15.46:0/4124520808 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560f4927c5e0 0x560f49285b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:10.478 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.468+0000 7f7c5effd700 1 -- 172.21.15.46:0/4124520808 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560f4927dc60 msgr2=0x560f4928d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:44:10.478 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.468+0000 7f7c5effd700 1 --2- 172.21.15.46:0/4124520808 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560f4927dc60 0x560f4928d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:10.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.468+0000 7f7c5effd700 1 -- 172.21.15.46:0/4124520808 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c601a0e70 con 0x560f4927d300 2023-10-19T12:44:10.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.468+0000 7f7c5ffff700 1 --2- 172.21.15.46:0/4124520808 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560f4927dc60 0x560f4928d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T12:44:10.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.468+0000 7f7c5f7fe700 1 --2- 172.21.15.46:0/4124520808 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560f4927c5e0 0x560f49285b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:44:10.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.469+0000 7f7c5effd700 1 --2- 172.21.15.46:0/4124520808 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560f4927d300 0x560f492860d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7c540963e0 tx=0x7f7c540b92d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a253a553b9ca3855 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:44:10.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.470+0000 7f7c3effd700 10 client.0 ms_handle_connect on v2:172.21.15.157:3300/0 2023-10-19T12:44:10.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.470+0000 7f7c3effd700 1 -- 172.21.15.46:0/4124520808 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c5409dac0 con 0x560f4927d300 2023-10-19T12:44:10.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.470+0000 7f7c3effd700 1 -- 172.21.15.46:0/4124520808 <== mon.2 v2:172.21.15.157:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f7c540a1d00 con 0x560f4927d300 2023-10-19T12:44:10.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.470+0000 7f7c79bc6b80 1 -- 172.21.15.46:0/4124520808 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560f4923a8b0 con 0x560f4927d300 2023-10-19T12:44:10.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.470+0000 7f7c3effd700 1 -- 172.21.15.46:0/4124520808 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7c54099970 con 0x560f4927d300 2023-10-19T12:44:10.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.470+0000 7f7c79bc6b80 10 client.25799 fetch_fsmap learned FSMap version 29 2023-10-19T12:44:10.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.470+0000 7f7c79bc6b80 1 -- 172.21.15.46:0/4124520808 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x560f48fe8de0 con 0x560f4927d300 2023-10-19T12:44:10.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.471+0000 7f7c3effd700 1 -- 172.21.15.46:0/4124520808 <== mon.2 v2:172.21.15.157:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x560f4923a8b0 con 0x560f4927d300 2023-10-19T12:44:10.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.471+0000 7f7c3effd700 1 -- 172.21.15.46:0/4124520808 <== mon.2 v2:172.21.15.157:3300/0 5 ==== fsmap(e 29) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f7c54084270 con 0x560f4927d300 2023-10-19T12:44:10.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.472+0000 7f7c79bc6b80 10 client.25799 fetch_fsmap finished waiting for FSMap version 29 2023-10-19T12:44:10.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.472+0000 7f7c79bc6b80 10 client.25799 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-19T12:44:10.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.472+0000 7f7c79bc6b80 20 client.25799 populate_metadata read hostname 'smithi046' 2023-10-19T12:44:10.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.472+0000 7f7c79bc6b80 1 --2- 172.21.15.46:0/4124520808 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x560f49291530 0x560f49293950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:10.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.472+0000 7f7c79bc6b80 4 client.25799 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-19T12:44:10.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.472+0000 7f7c79bc6b80 1 -- 172.21.15.46:0/4124520808 --> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560f491b6e50 con 0x560f49291530 2023-10-19T12:44:10.483 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.472+0000 7f7c5f7fe700 1 --2- 172.21.15.46:0/4124520808 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x560f49291530 0x560f49293950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:10.484 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.473+0000 7f7c5f7fe700 1 --2- 172.21.15.46:0/4124520808 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x560f49291530 0x560f49293950 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b31169cfac54b1d server_cookie=ab752e43068e656e in_seq=0 out_seq=0 2023-10-19T12:44:10.484 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.473+0000 7f7c3effd700 10 client.25799 ms_handle_connect on v2:172.21.15.157:6838/552718978 2023-10-19T12:44:10.484 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.474+0000 7f7c3effd700 1 -- 172.21.15.46:0/4124520808 <== mds.0 v2:172.21.15.157:6838/552718978 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x560f491b6e50 con 0x560f49291530 2023-10-19T12:44:10.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.475+0000 7f7c3effd700 10 client.25799 handle_command_reply: tid=0 2023-10-19T12:44:10.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.475+0000 7f7c79bc6b80 1 client.25799 shutdown 2023-10-19T12:44:10.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.475+0000 7f7c79bc6b80 1 -- 172.21.15.46:0/4124520808 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560f4927d300 msgr2=0x560f492860d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:44:10.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.475+0000 7f7c79bc6b80 1 --2- 172.21.15.46:0/4124520808 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560f4927d300 0x560f492860d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7c540963e0 tx=0x7f7c540b92d0 comp rx=0 tx=0).stop 2023-10-19T12:44:10.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.475+0000 7f7c79bc6b80 1 -- 172.21.15.46:0/4124520808 shutdown_connections 2023-10-19T12:44:10.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.475+0000 7f7c79bc6b80 1 --2- 172.21.15.46:0/4124520808 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x560f49291530 0x560f49293950 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:10.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.475+0000 7f7c79bc6b80 1 --2- 172.21.15.46:0/4124520808 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560f4927dc60 0x560f4928d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:10.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.475+0000 7f7c79bc6b80 1 --2- 172.21.15.46:0/4124520808 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560f4927c5e0 0x560f49285b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:10.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.475+0000 7f7c79bc6b80 1 --2- 172.21.15.46:0/4124520808 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560f4927d300 0x560f492860d0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:10.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.475+0000 7f7c79bc6b80 1 -- 172.21.15.46:0/4124520808 >> 172.21.15.46:0/4124520808 conn(0x560f491df720 msgr2=0x560f4926a080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:44:10.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.475+0000 7f7c3effd700 0 client.25799 ms_handle_reset on v2:172.21.15.157:6838/552718978 2023-10-19T12:44:10.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.476+0000 7f7c79bc6b80 1 -- 172.21.15.46:0/4124520808 shutdown_connections 2023-10-19T12:44:10.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.476+0000 7f7c79bc6b80 1 -- 172.21.15.46:0/4124520808 wait complete. 2023-10-19T12:44:10.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.476+0000 7f7c79bc6b80 20 client.25799 trim_cache size 0 max 16384 2023-10-19T12:44:10.505 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.502+0000 7f7c79bc6b80 1 Processor -- start 2023-10-19T12:44:10.506 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.502+0000 7f7c79bc6b80 1 -- start start 2023-10-19T12:44:10.507 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.503+0000 7f7c79bc6b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560f4927c5e0 0x560f492605d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:10.507 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.503+0000 7f7c79bc6b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560f4927d300 0x560f4928d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:10.507 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.504+0000 7f7c79bc6b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560f4927dc60 0x560f49285b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:10.507 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.504+0000 7f7c79bc6b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f4903e920 con 0x560f4927c5e0 2023-10-19T12:44:10.507 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.504+0000 7f7c79bc6b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f492666d0 con 0x560f4927d300 2023-10-19T12:44:10.508 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.504+0000 7f7c79bc6b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f4928d570 con 0x560f4927dc60 2023-10-19T12:44:10.509 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.504+0000 7f7c5f7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560f4927c5e0 0x560f492605d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:10.509 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.504+0000 7f7c5ffff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560f4927dc60 0x560f49285b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:10.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.504+0000 7f7c5ffff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560f4927dc60 0x560f49285b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:50156/0 (socket says 172.21.15.46:50156) 2023-10-19T12:44:10.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.504+0000 7f7c5ffff700 1 -- 172.21.15.46:0/3639724838 learned_addr learned my addr 172.21.15.46:0/3639724838 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:44:10.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.504+0000 7f7c5effd700 1 --2- 172.21.15.46:0/3639724838 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560f4927d300 0x560f4928d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:10.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.505+0000 7f7c5ffff700 1 -- 172.21.15.46:0/3639724838 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560f4927d300 msgr2=0x560f4928d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:44:10.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.505+0000 7f7c5ffff700 1 --2- 172.21.15.46:0/3639724838 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560f4927d300 0x560f4928d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:10.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.505+0000 7f7c5ffff700 1 -- 172.21.15.46:0/3639724838 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560f4927c5e0 msgr2=0x560f492605d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:44:10.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.505+0000 7f7c5ffff700 1 --2- 172.21.15.46:0/3639724838 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560f4927c5e0 0x560f492605d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:10.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.505+0000 7f7c5ffff700 1 -- 172.21.15.46:0/3639724838 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560f48fd1c60 con 0x560f4927dc60 2023-10-19T12:44:10.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.505+0000 7f7c5f7fe700 1 --2- 172.21.15.46:0/3639724838 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560f4927c5e0 0x560f492605d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:44:10.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.506+0000 7f7c5ffff700 1 --2- 172.21.15.46:0/3639724838 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560f4927dc60 0x560f49285b70 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7c5800e670 tx=0x7f7c5800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=450df6af1b462904 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:44:10.513 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.506+0000 7f7c467fc700 1 -- 172.21.15.46:0/3639724838 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c5800e040 con 0x560f4927dc60 2023-10-19T12:44:10.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.506+0000 7f7c467fc700 1 -- 172.21.15.46:0/3639724838 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7c5800f040 con 0x560f4927dc60 2023-10-19T12:44:10.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.506+0000 7f7c467fc700 1 -- 172.21.15.46:0/3639724838 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c580178c0 con 0x560f4927dc60 2023-10-19T12:44:10.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.507+0000 7f7c79bc6b80 1 -- 172.21.15.46:0/3639724838 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560f4927dc60 msgr2=0x560f49285b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:44:10.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.507+0000 7f7c79bc6b80 1 --2- 172.21.15.46:0/3639724838 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560f4927dc60 0x560f49285b70 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7c5800e670 tx=0x7f7c5800b040 comp rx=0 tx=0).stop 2023-10-19T12:44:10.514 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.508+0000 7f7c79bc6b80 1 -- 172.21.15.46:0/3639724838 shutdown_connections 2023-10-19T12:44:10.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.508+0000 7f7c79bc6b80 1 --2- 172.21.15.46:0/3639724838 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560f4927dc60 0x560f49285b70 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:10.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.508+0000 7f7c79bc6b80 1 --2- 172.21.15.46:0/3639724838 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560f4927c5e0 0x560f492605d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:10.515 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.508+0000 7f7c79bc6b80 1 --2- 172.21.15.46:0/3639724838 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560f4927d300 0x560f4928d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:10.516 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.508+0000 7f7c79bc6b80 1 -- 172.21.15.46:0/3639724838 >> 172.21.15.46:0/3639724838 conn(0x560f491df720 msgr2=0x560f49265810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:44:10.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.508+0000 7f7c79bc6b80 1 -- 172.21.15.46:0/3639724838 shutdown_connections 2023-10-19T12:44:10.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.509+0000 7f7c79bc6b80 1 -- 172.21.15.46:0/3639724838 wait complete. 2023-10-19T12:44:10.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.510+0000 7f7c79bc6b80 1 -- start start 2023-10-19T12:44:10.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.511+0000 7f7c79bc6b80 1 Processor -- start 2023-10-19T12:44:10.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.512+0000 7f7c79bc6b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560f4927c5e0 0x560f4928aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:10.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.512+0000 7f7c79bc6b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560f4927d300 0x560f4928b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:10.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.512+0000 7f7c79bc6b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560f4927dc60 0x560f4928c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:10.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.512+0000 7f7c79bc6b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f4928c8c0 con 0x560f4927c5e0 2023-10-19T12:44:10.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.512+0000 7f7c79bc6b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f4928ca30 con 0x560f4927dc60 2023-10-19T12:44:10.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.512+0000 7f7c79bc6b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f4928cba0 con 0x560f4927d300 2023-10-19T12:44:10.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.512+0000 7f7c79bc6b80 10 client.0 _ll_register_callbacks cb 0x560f490a4a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:44:10.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.513+0000 7f7c5ffff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560f4927dc60 0x560f4928c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:10.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.514+0000 7f7c5effd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560f4927d300 0x560f4928b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:10.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.514+0000 7f7c5ffff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560f4927dc60 0x560f4928c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:40718/0 (socket says 172.21.15.46:40718) 2023-10-19T12:44:10.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.514+0000 7f7c5f7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560f4927c5e0 0x560f4928aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:10.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.514+0000 7f7c5ffff700 1 -- 172.21.15.46:0/3926824095 learned_addr learned my addr 172.21.15.46:0/3926824095 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:44:10.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.514+0000 7f7c5ffff700 1 -- 172.21.15.46:0/3926824095 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560f4927d300 msgr2=0x560f4928b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:44:10.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.514+0000 7f7c5ffff700 1 --2- 172.21.15.46:0/3926824095 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560f4927d300 0x560f4928b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:10.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.514+0000 7f7c5ffff700 1 -- 172.21.15.46:0/3926824095 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560f4927c5e0 msgr2=0x560f4928aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:44:10.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.514+0000 7f7c5ffff700 1 --2- 172.21.15.46:0/3926824095 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560f4927c5e0 0x560f4928aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:10.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.514+0000 7f7c5ffff700 1 -- 172.21.15.46:0/3926824095 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c6010b700 con 0x560f4927dc60 2023-10-19T12:44:10.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.515+0000 7f7c5effd700 1 --2- 172.21.15.46:0/3926824095 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560f4927d300 0x560f4928b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T12:44:10.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.515+0000 7f7c5ffff700 1 --2- 172.21.15.46:0/3926824095 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560f4927dc60 0x560f4928c380 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7c5800ec60 tx=0x7f7c58007960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cdfd6ec5baf4795f server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:44:10.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.515+0000 7f7c3effd700 10 client.0 ms_handle_connect on v2:172.21.15.157:3300/0 2023-10-19T12:44:10.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.516+0000 7f7c3effd700 1 -- 172.21.15.46:0/3926824095 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c5800e030 con 0x560f4927dc60 2023-10-19T12:44:10.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.519+0000 7f7c3effd700 1 -- 172.21.15.46:0/3926824095 <== mon.2 v2:172.21.15.157:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f7c580177c0 con 0x560f4927dc60 2023-10-19T12:44:10.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.519+0000 7f7c79bc6b80 1 -- 172.21.15.46:0/3926824095 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560f491c2ef0 con 0x560f4927dc60 2023-10-19T12:44:10.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.519+0000 7f7c3effd700 1 -- 172.21.15.46:0/3926824095 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7c58017980 con 0x560f4927dc60 2023-10-19T12:44:10.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.519+0000 7f7c79bc6b80 10 client.25802 fetch_fsmap learned FSMap version 29 2023-10-19T12:44:10.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.519+0000 7f7c79bc6b80 1 -- 172.21.15.46:0/3926824095 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x7f7c58009370 con 0x560f4927dc60 2023-10-19T12:44:10.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.520+0000 7f7c3effd700 1 -- 172.21.15.46:0/3926824095 <== mon.2 v2:172.21.15.157:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x560f491c2ef0 con 0x560f4927dc60 2023-10-19T12:44:10.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.520+0000 7f7c3effd700 1 -- 172.21.15.46:0/3926824095 <== mon.2 v2:172.21.15.157:3300/0 5 ==== fsmap(e 29) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f7c5801d020 con 0x560f4927dc60 2023-10-19T12:44:10.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.520+0000 7f7c79bc6b80 10 client.25802 fetch_fsmap finished waiting for FSMap version 29 2023-10-19T12:44:10.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.520+0000 7f7c79bc6b80 10 client.25802 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-19T12:44:10.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.520+0000 7f7c79bc6b80 20 client.25802 populate_metadata read hostname 'smithi046' 2023-10-19T12:44:10.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.520+0000 7f7c79bc6b80 1 --2- 172.21.15.46:0/3926824095 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x560f492e03c0 0x560f492e27e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:10.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.520+0000 7f7c79bc6b80 4 client.25802 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-19T12:44:10.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.520+0000 7f7c79bc6b80 1 -- 172.21.15.46:0/3926824095 --> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x560f491b6b70 con 0x560f492e03c0 2023-10-19T12:44:10.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.521+0000 7f7c5f7fe700 1 --2- 172.21.15.46:0/3926824095 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x560f492e03c0 0x560f492e27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:10.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.523+0000 7f7c5f7fe700 1 --2- 172.21.15.46:0/3926824095 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x560f492e03c0 0x560f492e27e0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b063eb631e5875bd server_cookie=c7bad9ef598ba972 in_seq=0 out_seq=0 2023-10-19T12:44:10.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.523+0000 7f7c3effd700 10 client.25802 ms_handle_connect on v2:172.21.15.157:6838/552718978 2023-10-19T12:44:10.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.527+0000 7f7c3effd700 1 -- 172.21.15.46:0/3926824095 <== mds.0 v2:172.21.15.157:6838/552718978 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x560f491b6b70 con 0x560f492e03c0 2023-10-19T12:44:10.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.527+0000 7f7c3effd700 10 client.25802 handle_command_reply: tid=0 2023-10-19T12:44:10.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.527+0000 7f7c79bc6b80 1 client.25802 shutdown 2023-10-19T12:44:10.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.527+0000 7f7c79bc6b80 1 -- 172.21.15.46:0/3926824095 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560f4927dc60 msgr2=0x560f4928c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:44:10.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.527+0000 7f7c79bc6b80 1 --2- 172.21.15.46:0/3926824095 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560f4927dc60 0x560f4928c380 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7c5800ec60 tx=0x7f7c58007960 comp rx=0 tx=0).stop 2023-10-19T12:44:10.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.528+0000 7f7c79bc6b80 1 -- 172.21.15.46:0/3926824095 shutdown_connections 2023-10-19T12:44:10.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.528+0000 7f7c79bc6b80 1 --2- 172.21.15.46:0/3926824095 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560f4927dc60 0x560f4928c380 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:10.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.528+0000 7f7c79bc6b80 1 --2- 172.21.15.46:0/3926824095 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x560f492e03c0 0x560f492e27e0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:10.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.528+0000 7f7c79bc6b80 1 --2- 172.21.15.46:0/3926824095 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560f4927c5e0 0x560f4928aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:10.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.528+0000 7f7c79bc6b80 1 --2- 172.21.15.46:0/3926824095 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560f4927d300 0x560f4928b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:10.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.528+0000 7f7c3effd700 0 client.25802 ms_handle_reset on v2:172.21.15.157:6838/552718978 2023-10-19T12:44:10.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.528+0000 7f7c79bc6b80 1 -- 172.21.15.46:0/3926824095 >> 172.21.15.46:0/3926824095 conn(0x560f491df720 msgr2=0x560f49285b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:44:10.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.528+0000 7f7c79bc6b80 1 -- 172.21.15.46:0/3926824095 shutdown_connections 2023-10-19T12:44:10.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.528+0000 7f7c79bc6b80 1 -- 172.21.15.46:0/3926824095 wait complete. 2023-10-19T12:44:10.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.529+0000 7f7c79bc6b80 20 client.25802 trim_cache size 0 max 16384 2023-10-19T12:44:10.534 INFO:teuthology.orchestra.run.smithi046.stdout:[] 2023-10-19T12:44:10.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.530+0000 7f7c661ff700 1 -- 172.21.15.46:0/1140233886 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f7c480a1580 msgr2=0x7f7c480a3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:44:10.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.530+0000 7f7c661ff700 1 --2- 172.21.15.46:0/1140233886 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f7c480a1580 0x7f7c480a3a40 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f7c5000f9e0 tx=0x7f7c50019040 comp rx=0 tx=0).stop 2023-10-19T12:44:10.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.530+0000 7f7c661ff700 1 -- 172.21.15.46:0/1140233886 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7c600ff9e0 msgr2=0x7f7c60198f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:44:10.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.530+0000 7f7c661ff700 1 --2- 172.21.15.46:0/1140233886 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7c600ff9e0 0x7f7c60198f00 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7c5400b530 tx=0x7f7c5400b840 comp rx=0 tx=0).stop 2023-10-19T12:44:10.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.531+0000 7f7c661ff700 1 -- 172.21.15.46:0/1140233886 shutdown_connections 2023-10-19T12:44:10.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.531+0000 7f7c661ff700 1 --2- 172.21.15.46:0/1140233886 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f7c480a1580 0x7f7c480a3a40 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:10.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.531+0000 7f7c661ff700 1 --2- 172.21.15.46:0/1140233886 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7c601003a0 0x7f7c6019ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:10.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.531+0000 7f7c661ff700 1 --2- 172.21.15.46:0/1140233886 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7c600ff080 0x7f7c601989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:10.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.531+0000 7f7c661ff700 1 --2- 172.21.15.46:0/1140233886 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7c600ff9e0 0x7f7c60198f00 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:10.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.531+0000 7f7c661ff700 1 -- 172.21.15.46:0/1140233886 >> 172.21.15.46:0/1140233886 conn(0x7f7c600fac00 msgr2=0x7f7c600fc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:44:10.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.532+0000 7f7c661ff700 1 -- 172.21.15.46:0/1140233886 shutdown_connections 2023-10-19T12:44:10.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:10.532+0000 7f7c661ff700 1 -- 172.21.15.46:0/1140233886 wait complete. 2023-10-19T12:44:11.577 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-19T12:44:11.577 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-19T12:44:11.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 10.0 s, 1547.2 tps, lat 63.159 ms stddev 80.327 2023-10-19T12:44:11.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.971+0000 7f8a90bff700 1 -- 172.21.15.46:0/4176773010 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a8c103ba0 msgr2=0x7f8a8c105f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:44:11.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.971+0000 7f8a90bff700 1 --2- 172.21.15.46:0/4176773010 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a8c103ba0 0x7f8a8c105f90 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8a800098f0 tx=0x7f8a80009c00 comp rx=0 tx=0).stop 2023-10-19T12:44:11.975 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.972+0000 7f8a90bff700 1 -- 172.21.15.46:0/4176773010 shutdown_connections 2023-10-19T12:44:11.976 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.972+0000 7f8a90bff700 1 --2- 172.21.15.46:0/4176773010 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a8c1064d0 0x7f8a8c1088e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:11.976 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.972+0000 7f8a90bff700 1 --2- 172.21.15.46:0/4176773010 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a8c101270 0x7f8a8c103660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:11.976 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.972+0000 7f8a90bff700 1 --2- 172.21.15.46:0/4176773010 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a8c103ba0 0x7f8a8c105f90 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:11.976 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.972+0000 7f8a90bff700 1 -- 172.21.15.46:0/4176773010 >> 172.21.15.46:0/4176773010 conn(0x7f8a8c0fac00 msgr2=0x7f8a8c0fd040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:44:11.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.972+0000 7f8a90bff700 1 -- 172.21.15.46:0/4176773010 shutdown_connections 2023-10-19T12:44:11.977 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.972+0000 7f8a90bff700 1 -- 172.21.15.46:0/4176773010 wait complete. 2023-10-19T12:44:11.978 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.973+0000 7f8a90bff700 1 Processor -- start 2023-10-19T12:44:11.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.973+0000 7f8a90bff700 1 -- start start 2023-10-19T12:44:11.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.973+0000 7f8a90bff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a8c101270 0x7f8a8c1989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:11.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.973+0000 7f8a90bff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a8c103ba0 0x7f8a8c198f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:11.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.974+0000 7f8a8a59c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a8c101270 0x7f8a8c1989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:11.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.974+0000 7f8a90bff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a8c1064d0 0x7f8a8c19ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:11.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.974+0000 7f8a8a59c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a8c101270 0x7f8a8c1989e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:40736/0 (socket says 172.21.15.46:40736) 2023-10-19T12:44:11.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.974+0000 7f8a8a59c700 1 -- 172.21.15.46:0/1861618324 learned_addr learned my addr 172.21.15.46:0/1861618324 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:44:11.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.974+0000 7f8a90bff700 1 -- 172.21.15.46:0/1861618324 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a8c1a0510 con 0x7f8a8c1064d0 2023-10-19T12:44:11.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.974+0000 7f8a90bff700 1 -- 172.21.15.46:0/1861618324 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a8c1a0650 con 0x7f8a8c101270 2023-10-19T12:44:11.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.974+0000 7f8a90bff700 1 -- 172.21.15.46:0/1861618324 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a8c1a07e0 con 0x7f8a8c103ba0 2023-10-19T12:44:11.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.974+0000 7f8a89d9b700 1 --2- 172.21.15.46:0/1861618324 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a8c103ba0 0x7f8a8c198f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:11.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.974+0000 7f8a8ad9d700 1 --2- 172.21.15.46:0/1861618324 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a8c1064d0 0x7f8a8c19ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:11.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.974+0000 7f8a8a59c700 1 -- 172.21.15.46:0/1861618324 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a8c103ba0 msgr2=0x7f8a8c198f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:44:11.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.974+0000 7f8a8a59c700 1 --2- 172.21.15.46:0/1861618324 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a8c103ba0 0x7f8a8c198f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:11.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.974+0000 7f8a8a59c700 1 -- 172.21.15.46:0/1861618324 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a8c1064d0 msgr2=0x7f8a8c19ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:44:11.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.974+0000 7f8a8a59c700 1 --2- 172.21.15.46:0/1861618324 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a8c1064d0 0x7f8a8c19ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:11.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.974+0000 7f8a8a59c700 1 -- 172.21.15.46:0/1861618324 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a80009520 con 0x7f8a8c101270 2023-10-19T12:44:11.982 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.975+0000 7f8a8a59c700 1 --2- 172.21.15.46:0/1861618324 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a8c101270 0x7f8a8c1989e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c00e9c0 tx=0x7f8a7c00ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:44:11.983 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:44:11 smithi046 ceph-mon[98509]: pgmap v374: 129 pgs: 129 active+clean; 1002 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 52 MiB/s wr, 259 op/s 2023-10-19T12:44:11.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.975+0000 7f8a7b7fe700 1 -- 172.21.15.46:0/1861618324 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a7c00cbd0 con 0x7f8a8c101270 2023-10-19T12:44:11.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.975+0000 7f8a7b7fe700 1 -- 172.21.15.46:0/1861618324 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8a7c00eeb0 con 0x7f8a8c101270 2023-10-19T12:44:11.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.975+0000 7f8a7b7fe700 1 -- 172.21.15.46:0/1861618324 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a7c005580 con 0x7f8a8c101270 2023-10-19T12:44:11.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.975+0000 7f8a90bff700 1 -- 172.21.15.46:0/1861618324 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a8c1a0ac0 con 0x7f8a8c101270 2023-10-19T12:44:11.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.976+0000 7f8a90bff700 1 -- 172.21.15.46:0/1861618324 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a8c1a0f80 con 0x7f8a8c101270 2023-10-19T12:44:11.985 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.981+0000 7f8a7b7fe700 1 -- 172.21.15.46:0/1861618324 <== mon.2 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f8a7c004750 con 0x7f8a8c101270 2023-10-19T12:44:11.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.983+0000 7f8a7b7fe700 1 --2- 172.21.15.46:0/1861618324 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f8a740a1650 0x7f8a740a3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:11.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.983+0000 7f8a7b7fe700 1 -- 172.21.15.46:0/1861618324 <== mon.2 v2:172.21.15.157:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f8a7c014070 con 0x7f8a8c101270 2023-10-19T12:44:11.990 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.986+0000 7f8a89d9b700 1 --2- 172.21.15.46:0/1861618324 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f8a740a1650 0x7f8a740a3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:11.990 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.987+0000 7f8aa44bab80 1 Processor -- start 2023-10-19T12:44:11.993 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.988+0000 7f8aa44bab80 1 -- start start 2023-10-19T12:44:11.993 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.989+0000 7f8aa44bab80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5623ebae2b60 0x5623ebae2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:11.993 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.989+0000 7f8aa44bab80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5623ebae34c0 0x5623ebae1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:11.993 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.989+0000 7f8a8a59c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5623ebae2b60 0x5623ebae2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:11.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.989+0000 7f8a8a59c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5623ebae2b60 0x5623ebae2f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:40742/0 (socket says 172.21.15.46:40742) 2023-10-19T12:44:11.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.989+0000 7f8a8a59c700 1 -- 172.21.15.46:0/4245232191 learned_addr learned my addr 172.21.15.46:0/4245232191 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:44:11.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.989+0000 7f8aa44bab80 1 --2- 172.21.15.46:0/4245232191 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5623ebae1e60 0x5623ebae22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:11.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.989+0000 7f8aa44bab80 1 -- 172.21.15.46:0/4245232191 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623eba4c760 con 0x5623ebae34c0 2023-10-19T12:44:11.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.989+0000 7f8aa44bab80 1 -- 172.21.15.46:0/4245232191 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623eba32ce0 con 0x5623ebae2b60 2023-10-19T12:44:11.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.989+0000 7f8aa44bab80 1 -- 172.21.15.46:0/4245232191 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623eba30600 con 0x5623ebae1e60 2023-10-19T12:44:11.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.990+0000 7f8a8ad9d700 1 --2- 172.21.15.46:0/4245232191 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5623ebae1e60 0x5623ebae22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:11.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.990+0000 7f8a89d9b700 1 --2- 172.21.15.46:0/1861618324 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f8a740a1650 0x7f8a740a3b10 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f8a8000fa40 tx=0x7f8a80019040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:44:11.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.990+0000 7f8a8a59c700 1 -- 172.21.15.46:0/4245232191 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5623ebae1e60 msgr2=0x5623ebae22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:44:11.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.990+0000 7f8a8a59c700 1 --2- 172.21.15.46:0/4245232191 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5623ebae1e60 0x5623ebae22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:11.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.990+0000 7f8a8a59c700 1 -- 172.21.15.46:0/4245232191 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5623ebae34c0 msgr2=0x5623ebae1920 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-19T12:44:11.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.990+0000 7f8a8a59c700 1 --2- 172.21.15.46:0/4245232191 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5623ebae34c0 0x5623ebae1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:11.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.990+0000 7f8a8a59c700 1 -- 172.21.15.46:0/4245232191 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5623eb9e9470 con 0x5623ebae2b60 2023-10-19T12:44:11.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.990+0000 7f8a8ad9d700 1 --2- 172.21.15.46:0/4245232191 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5623ebae1e60 0x5623ebae22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T12:44:11.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.990+0000 7f8a8a59c700 1 --2- 172.21.15.46:0/4245232191 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5623ebae2b60 0x5623ebae2f80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c096c90 tx=0x7f8a7c099e90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35514efe04ed8969 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:44:11.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.991+0000 7f8a78ff9700 1 -- 172.21.15.46:0/4245232191 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a7c09e170 con 0x5623ebae2b60 2023-10-19T12:44:11.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.991+0000 7f8a78ff9700 1 -- 172.21.15.46:0/4245232191 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8a7c09a220 con 0x5623ebae2b60 2023-10-19T12:44:11.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.991+0000 7f8a78ff9700 1 -- 172.21.15.46:0/4245232191 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a7c09a480 con 0x5623ebae2b60 2023-10-19T12:44:11.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.992+0000 7f8aa44bab80 1 -- 172.21.15.46:0/4245232191 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5623ebae2b60 msgr2=0x5623ebae2f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:44:11.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.992+0000 7f8aa44bab80 1 --2- 172.21.15.46:0/4245232191 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5623ebae2b60 0x5623ebae2f80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c096c90 tx=0x7f8a7c099e90 comp rx=0 tx=0).stop 2023-10-19T12:44:11.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.992+0000 7f8aa44bab80 1 -- 172.21.15.46:0/4245232191 shutdown_connections 2023-10-19T12:44:11.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.992+0000 7f8aa44bab80 1 --2- 172.21.15.46:0/4245232191 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5623ebae1e60 0x5623ebae22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:11.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.992+0000 7f8aa44bab80 1 --2- 172.21.15.46:0/4245232191 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5623ebae2b60 0x5623ebae2f80 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:12.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.992+0000 7f8aa44bab80 1 --2- 172.21.15.46:0/4245232191 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5623ebae34c0 0x5623ebae1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:12.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.992+0000 7f8aa44bab80 1 -- 172.21.15.46:0/4245232191 >> 172.21.15.46:0/4245232191 conn(0x5623eba4d7a0 msgr2=0x5623ebad3bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:44:12.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.992+0000 7f8aa44bab80 1 -- 172.21.15.46:0/4245232191 shutdown_connections 2023-10-19T12:44:12.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.993+0000 7f8aa44bab80 1 -- 172.21.15.46:0/4245232191 wait complete. 2023-10-19T12:44:12.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.994+0000 7f8aa44bab80 1 -- start start 2023-10-19T12:44:12.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.994+0000 7f8aa44bab80 1 Processor -- start 2023-10-19T12:44:12.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.995+0000 7f8aa44bab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5623ebae1e60 0x5623ebaeb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:12.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.995+0000 7f8aa44bab80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5623ebae2b60 0x5623ebaeba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:12.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.995+0000 7f8aa44bab80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5623ebae34c0 0x5623ebaf2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:12.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.995+0000 7f8aa44bab80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623eba2bef0 con 0x5623ebae2b60 2023-10-19T12:44:12.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.995+0000 7f8aa44bab80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623eb9c8790 con 0x5623ebae34c0 2023-10-19T12:44:12.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.995+0000 7f8aa44bab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623eb9c8430 con 0x5623ebae1e60 2023-10-19T12:44:12.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.995+0000 7f8aa44bab80 10 client.0 _ll_register_callbacks cb 0x5623eb912b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:44:12.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.996+0000 7f8a89d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5623ebae2b60 0x5623ebaeba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:12.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.996+0000 7f8a8ad9d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5623ebae34c0 0x5623ebaf2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:12.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.996+0000 7f8a8ad9d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5623ebae34c0 0x5623ebaf2a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:40748/0 (socket says 172.21.15.46:40748) 2023-10-19T12:44:12.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.996+0000 7f8a8ad9d700 1 -- 172.21.15.46:0/298934028 learned_addr learned my addr 172.21.15.46:0/298934028 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:44:12.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.996+0000 7f8a8a59c700 1 --2- 172.21.15.46:0/298934028 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5623ebae1e60 0x5623ebaeb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:12.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.997+0000 7f8a8ad9d700 1 -- 172.21.15.46:0/298934028 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5623ebae1e60 msgr2=0x5623ebaeb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:44:12.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.997+0000 7f8a8ad9d700 1 --2- 172.21.15.46:0/298934028 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5623ebae1e60 0x5623ebaeb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:12.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.997+0000 7f8a8ad9d700 1 -- 172.21.15.46:0/298934028 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5623ebae2b60 msgr2=0x5623ebaeba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:44:12.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.997+0000 7f8a8ad9d700 1 --2- 172.21.15.46:0/298934028 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5623ebae2b60 0x5623ebaeba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:12.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.997+0000 7f8a8ad9d700 1 -- 172.21.15.46:0/298934028 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a8c1a0f80 con 0x5623ebae34c0 2023-10-19T12:44:12.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.998+0000 7f8a8a59c700 1 --2- 172.21.15.46:0/298934028 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5623ebae1e60 0x5623ebaeb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:44:12.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.998+0000 7f8a8ad9d700 1 --2- 172.21.15.46:0/298934028 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5623ebae34c0 0x5623ebaf2a10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8a8400abe0 tx=0x7f8a8400ac10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a49e483494c69aa server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:44:12.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.998+0000 7f8a71ffb700 10 client.0 ms_handle_connect on v2:172.21.15.157:3300/0 2023-10-19T12:44:12.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.998+0000 7f8a71ffb700 1 -- 172.21.15.46:0/298934028 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a84011040 con 0x5623ebae34c0 2023-10-19T12:44:12.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.998+0000 7f8a71ffb700 1 -- 172.21.15.46:0/298934028 <== mon.2 v2:172.21.15.157:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f8a84006e40 con 0x5623ebae34c0 2023-10-19T12:44:12.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.998+0000 7f8aa44bab80 1 -- 172.21.15.46:0/298934028 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5623eba30f70 con 0x5623ebae34c0 2023-10-19T12:44:12.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.998+0000 7f8a89d9b700 1 --2- 172.21.15.46:0/298934028 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5623ebae2b60 0x5623ebaeba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T12:44:12.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.999+0000 7f8a71ffb700 1 -- 172.21.15.46:0/298934028 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8a8400ae50 con 0x5623ebae34c0 2023-10-19T12:44:12.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.999+0000 7f8aa44bab80 10 client.25814 fetch_fsmap learned FSMap version 29 2023-10-19T12:44:12.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.999+0000 7f8aa44bab80 1 -- 172.21.15.46:0/298934028 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x5623eb856e60 con 0x5623ebae34c0 2023-10-19T12:44:12.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.999+0000 7f8a71ffb700 1 -- 172.21.15.46:0/298934028 <== mon.2 v2:172.21.15.157:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5623eba30f70 con 0x5623ebae34c0 2023-10-19T12:44:12.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:11.999+0000 7f8a71ffb700 1 -- 172.21.15.46:0/298934028 <== mon.2 v2:172.21.15.157:3300/0 5 ==== fsmap(e 29) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f8a84014340 con 0x5623ebae34c0 2023-10-19T12:44:12.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.000+0000 7f8aa44bab80 10 client.25814 fetch_fsmap finished waiting for FSMap version 29 2023-10-19T12:44:12.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.000+0000 7f8aa44bab80 10 client.25814 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-19T12:44:12.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.000+0000 7f8aa44bab80 20 client.25814 populate_metadata read hostname 'smithi046' 2023-10-19T12:44:12.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.000+0000 7f8aa44bab80 1 --2- 172.21.15.46:0/298934028 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x5623ebaf7320 0x5623ebaf9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:12.013 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.000+0000 7f8aa44bab80 4 client.25814 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-19T12:44:12.013 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.000+0000 7f8aa44bab80 1 -- 172.21.15.46:0/298934028 --> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5623ebaa8930 con 0x5623ebaf7320 2023-10-19T12:44:12.013 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.000+0000 7f8a8a59c700 1 --2- 172.21.15.46:0/298934028 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x5623ebaf7320 0x5623ebaf9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:12.013 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.001+0000 7f8a8a59c700 1 --2- 172.21.15.46:0/298934028 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x5623ebaf7320 0x5623ebaf9740 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee71816a020c6d5c server_cookie=fc296e1d97570377 in_seq=0 out_seq=0 2023-10-19T12:44:12.013 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.001+0000 7f8a71ffb700 10 client.25814 ms_handle_connect on v2:172.21.15.157:6838/552718978 2023-10-19T12:44:12.014 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.001+0000 7f8a71ffb700 1 -- 172.21.15.46:0/298934028 <== mds.0 v2:172.21.15.157:6838/552718978 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5623ebaa8930 con 0x5623ebaf7320 2023-10-19T12:44:12.014 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.001+0000 7f8a71ffb700 10 client.25814 handle_command_reply: tid=0 2023-10-19T12:44:12.014 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.001+0000 7f8aa44bab80 1 client.25814 shutdown 2023-10-19T12:44:12.014 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.002+0000 7f8aa44bab80 1 -- 172.21.15.46:0/298934028 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5623ebae34c0 msgr2=0x5623ebaf2a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:44:12.015 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.002+0000 7f8aa44bab80 1 --2- 172.21.15.46:0/298934028 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5623ebae34c0 0x5623ebaf2a10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8a8400abe0 tx=0x7f8a8400ac10 comp rx=0 tx=0).stop 2023-10-19T12:44:12.015 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.002+0000 7f8aa44bab80 1 -- 172.21.15.46:0/298934028 shutdown_connections 2023-10-19T12:44:12.015 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.002+0000 7f8aa44bab80 1 --2- 172.21.15.46:0/298934028 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5623ebae34c0 0x5623ebaf2a10 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:12.015 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.002+0000 7f8aa44bab80 1 --2- 172.21.15.46:0/298934028 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5623ebae1e60 0x5623ebaeb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:12.015 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.002+0000 7f8aa44bab80 1 --2- 172.21.15.46:0/298934028 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x5623ebaf7320 0x5623ebaf9740 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:12.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.002+0000 7f8aa44bab80 1 --2- 172.21.15.46:0/298934028 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5623ebae2b60 0x5623ebaeba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:12.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.002+0000 7f8a71ffb700 0 client.25814 ms_handle_reset on v2:172.21.15.157:6838/552718978 2023-10-19T12:44:12.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.002+0000 7f8aa44bab80 1 -- 172.21.15.46:0/298934028 >> 172.21.15.46:0/298934028 conn(0x5623eba4d7a0 msgr2=0x5623ebae0910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:44:12.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.003+0000 7f8aa44bab80 1 -- 172.21.15.46:0/298934028 shutdown_connections 2023-10-19T12:44:12.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.003+0000 7f8aa44bab80 1 -- 172.21.15.46:0/298934028 wait complete. 2023-10-19T12:44:12.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.003+0000 7f8aa44bab80 20 client.25814 trim_cache size 0 max 16384 2023-10-19T12:44:12.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.035+0000 7f8aa44bab80 1 Processor -- start 2023-10-19T12:44:12.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.035+0000 7f8aa44bab80 1 -- start start 2023-10-19T12:44:12.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.035+0000 7f8aa44bab80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5623ebae1e60 0x5623ebae1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:12.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.036+0000 7f8aa44bab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5623ebae2b60 0x5623ebaf29d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:12.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.036+0000 7f8aa44bab80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5623ebae34c0 0x5623ebacdc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:12.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.036+0000 7f8aa44bab80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623eb8ac9a0 con 0x5623ebae34c0 2023-10-19T12:44:12.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.036+0000 7f8a8a59c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5623ebae1e60 0x5623ebae1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:12.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.037+0000 7f8aa44bab80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623ebad5360 con 0x5623ebae1e60 2023-10-19T12:44:12.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.037+0000 7f8aa44bab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623ebad5c00 con 0x5623ebae2b60 2023-10-19T12:44:12.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.037+0000 7f8a8a59c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5623ebae1e60 0x5623ebae1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:40758/0 (socket says 172.21.15.46:40758) 2023-10-19T12:44:12.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.037+0000 7f8a8a59c700 1 -- 172.21.15.46:0/66117676 learned_addr learned my addr 172.21.15.46:0/66117676 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:44:12.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.037+0000 7f8a89d9b700 1 --2- 172.21.15.46:0/66117676 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5623ebae2b60 0x5623ebaf29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:12.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.037+0000 7f8a8ad9d700 1 --2- 172.21.15.46:0/66117676 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5623ebae34c0 0x5623ebacdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:12.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.037+0000 7f8a8a59c700 1 -- 172.21.15.46:0/66117676 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5623ebae2b60 msgr2=0x5623ebaf29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:44:12.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.037+0000 7f8a8a59c700 1 --2- 172.21.15.46:0/66117676 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5623ebae2b60 0x5623ebaf29d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:12.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.037+0000 7f8a8a59c700 1 -- 172.21.15.46:0/66117676 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5623ebae34c0 msgr2=0x5623ebacdc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:44:12.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.037+0000 7f8a8a59c700 1 --2- 172.21.15.46:0/66117676 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5623ebae34c0 0x5623ebacdc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:12.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.037+0000 7f8a8a59c700 1 -- 172.21.15.46:0/66117676 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5623ebae2510 con 0x5623ebae1e60 2023-10-19T12:44:12.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.038+0000 7f8a8a59c700 1 --2- 172.21.15.46:0/66117676 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5623ebae1e60 0x5623ebae1920 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c098570 tx=0x7f8a7c0985c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71c7c4c49d712b41 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:44:12.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.038+0000 7f8a797fa700 1 -- 172.21.15.46:0/66117676 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a7c09e370 con 0x5623ebae1e60 2023-10-19T12:44:12.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.038+0000 7f8a797fa700 1 -- 172.21.15.46:0/66117676 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8a7c099710 con 0x5623ebae1e60 2023-10-19T12:44:12.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.038+0000 7f8a797fa700 1 -- 172.21.15.46:0/66117676 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a7c09a750 con 0x5623ebae1e60 2023-10-19T12:44:12.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.039+0000 7f8aa44bab80 1 -- 172.21.15.46:0/66117676 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5623ebae1e60 msgr2=0x5623ebae1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:44:12.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.039+0000 7f8aa44bab80 1 --2- 172.21.15.46:0/66117676 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5623ebae1e60 0x5623ebae1920 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c098570 tx=0x7f8a7c0985c0 comp rx=0 tx=0).stop 2023-10-19T12:44:12.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.039+0000 7f8aa44bab80 1 -- 172.21.15.46:0/66117676 shutdown_connections 2023-10-19T12:44:12.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.039+0000 7f8aa44bab80 1 --2- 172.21.15.46:0/66117676 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5623ebae34c0 0x5623ebacdc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:12.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.039+0000 7f8aa44bab80 1 --2- 172.21.15.46:0/66117676 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5623ebae1e60 0x5623ebae1920 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:12.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.039+0000 7f8aa44bab80 1 --2- 172.21.15.46:0/66117676 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5623ebae2b60 0x5623ebaf29d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:12.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.039+0000 7f8aa44bab80 1 -- 172.21.15.46:0/66117676 >> 172.21.15.46:0/66117676 conn(0x5623eba4d7a0 msgr2=0x5623ebacd530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:44:12.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.039+0000 7f8aa44bab80 1 -- 172.21.15.46:0/66117676 shutdown_connections 2023-10-19T12:44:12.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.039+0000 7f8aa44bab80 1 -- 172.21.15.46:0/66117676 wait complete. 2023-10-19T12:44:12.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.040+0000 7f8aa44bab80 1 -- start start 2023-10-19T12:44:12.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.040+0000 7f8aa44bab80 1 Processor -- start 2023-10-19T12:44:12.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.042+0000 7f8aa44bab80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5623ebae1e60 0x5623ebaf13d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:12.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.042+0000 7f8aa44bab80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5623ebae2b60 0x5623ebaf1910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:12.049 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.043+0000 7f8aa44bab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5623ebae34c0 0x5623ebaf1e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:12.049 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.043+0000 7f8a89d9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5623ebae2b60 0x5623ebaf1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:12.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.043+0000 7f8a8ad9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5623ebae34c0 0x5623ebaf1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:12.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.043+0000 7f8a8ad9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5623ebae34c0 0x5623ebaf1e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:50242/0 (socket says 172.21.15.46:50242) 2023-10-19T12:44:12.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.043+0000 7f8a8ad9d700 1 -- 172.21.15.46:0/4129174472 learned_addr learned my addr 172.21.15.46:0/4129174472 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:44:12.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.043+0000 7f8aa44bab80 1 -- 172.21.15.46:0/4129174472 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623ebb4b220 con 0x5623ebae1e60 2023-10-19T12:44:12.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.043+0000 7f8aa44bab80 1 -- 172.21.15.46:0/4129174472 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623ebb4b390 con 0x5623ebae2b60 2023-10-19T12:44:12.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.043+0000 7f8aa44bab80 1 -- 172.21.15.46:0/4129174472 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623ebb4b550 con 0x5623ebae34c0 2023-10-19T12:44:12.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.044+0000 7f8a8a59c700 1 --2- 172.21.15.46:0/4129174472 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5623ebae1e60 0x5623ebaf13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:12.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.044+0000 7f8a8ad9d700 1 -- 172.21.15.46:0/4129174472 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5623ebae2b60 msgr2=0x5623ebaf1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:44:12.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.044+0000 7f8aa44bab80 10 client.0 _ll_register_callbacks cb 0x5623eb912b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:44:12.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.045+0000 7f8a8ad9d700 1 --2- 172.21.15.46:0/4129174472 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5623ebae2b60 0x5623ebaf1910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:12.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.045+0000 7f8a8ad9d700 1 -- 172.21.15.46:0/4129174472 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5623ebae1e60 msgr2=0x5623ebaf13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:44:12.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.045+0000 7f8a8ad9d700 1 --2- 172.21.15.46:0/4129174472 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5623ebae1e60 0x5623ebaf13d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:12.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.045+0000 7f8a8ad9d700 1 -- 172.21.15.46:0/4129174472 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5623eb9e9470 con 0x5623ebae34c0 2023-10-19T12:44:12.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.045+0000 7f8aa44bab80 1 -- 172.21.15.46:0/4129174472 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8a7c09a220 con 0x5623ebae34c0 2023-10-19T12:44:12.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.045+0000 7f8a8a59c700 1 --2- 172.21.15.46:0/4129174472 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5623ebae1e60 0x5623ebaf13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:44:12.055 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.045+0000 7f8a89d9b700 1 --2- 172.21.15.46:0/4129174472 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5623ebae2b60 0x5623ebaf1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:44:12.055 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.046+0000 7f8a8ad9d700 1 --2- 172.21.15.46:0/4129174472 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5623ebae34c0 0x5623ebaf1e50 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8a8400abb0 tx=0x7f8a84009a00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2db5ee544f8cd41d server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:44:12.055 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.046+0000 7f8a71ffb700 10 client.25825 ms_handle_connect on v2:172.21.15.195:3300/0 2023-10-19T12:44:12.055 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.046+0000 7f8a71ffb700 1 -- 172.21.15.46:0/4129174472 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a84011040 con 0x5623ebae34c0 2023-10-19T12:44:12.055 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.047+0000 7f8a71ffb700 1 -- 172.21.15.46:0/4129174472 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f8a84014ea0 con 0x5623ebae34c0 2023-10-19T12:44:12.056 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.047+0000 7f8a71ffb700 1 -- 172.21.15.46:0/4129174472 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8a84014550 con 0x5623ebae34c0 2023-10-19T12:44:12.056 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.047+0000 7f8aa44bab80 10 client.25825 fetch_fsmap learned FSMap version 29 2023-10-19T12:44:12.056 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.047+0000 7f8aa44bab80 1 -- 172.21.15.46:0/4129174472 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({fsmap=29}) v3 -- 0x5623eb83fce0 con 0x5623ebae34c0 2023-10-19T12:44:12.056 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.047+0000 7f8a71ffb700 1 -- 172.21.15.46:0/4129174472 <== mon.1 v2:172.21.15.195:3300/0 4 ==== fsmap(e 29) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f8a84008040 con 0x5623ebae34c0 2023-10-19T12:44:12.056 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.047+0000 7f8aa44bab80 10 client.25825 fetch_fsmap finished waiting for FSMap version 29 2023-10-19T12:44:12.057 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.047+0000 7f8aa44bab80 10 client.25825 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-19T12:44:12.057 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.047+0000 7f8aa44bab80 20 client.25825 populate_metadata read hostname 'smithi046' 2023-10-19T12:44:12.057 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.047+0000 7f8aa44bab80 1 --2- 172.21.15.46:0/4129174472 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x5623ebb4cdc0 0x5623ebb4f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:12.057 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.047+0000 7f8aa44bab80 4 client.25825 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-19T12:44:12.058 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.047+0000 7f8aa44bab80 1 -- 172.21.15.46:0/4129174472 --> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x5623eba24ed0 con 0x5623ebb4cdc0 2023-10-19T12:44:12.058 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.048+0000 7f8a8a59c700 1 --2- 172.21.15.46:0/4129174472 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x5623ebb4cdc0 0x5623ebb4f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:12.058 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.048+0000 7f8a71ffb700 10 client.25825 ms_handle_connect on v2:172.21.15.157:6838/552718978 2023-10-19T12:44:12.058 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.048+0000 7f8a8a59c700 1 --2- 172.21.15.46:0/4129174472 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x5623ebb4cdc0 0x5623ebb4f1e0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b36fc5741077e6d server_cookie=df07a06b5f4ed6d6 in_seq=0 out_seq=0 2023-10-19T12:44:12.059 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.050+0000 7f8a71ffb700 1 -- 172.21.15.46:0/4129174472 <== mds.0 v2:172.21.15.157:6838/552718978 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5623eba24ed0 con 0x5623ebb4cdc0 2023-10-19T12:44:12.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.050+0000 7f8a71ffb700 10 client.25825 handle_command_reply: tid=0 2023-10-19T12:44:12.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.050+0000 7f8aa44bab80 1 client.25825 shutdown 2023-10-19T12:44:12.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.051+0000 7f8aa44bab80 1 -- 172.21.15.46:0/4129174472 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5623ebae34c0 msgr2=0x5623ebaf1e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:44:12.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.051+0000 7f8aa44bab80 1 --2- 172.21.15.46:0/4129174472 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5623ebae34c0 0x5623ebaf1e50 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8a8400abb0 tx=0x7f8a84009a00 comp rx=0 tx=0).stop 2023-10-19T12:44:12.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.052+0000 7f8aa44bab80 1 -- 172.21.15.46:0/4129174472 shutdown_connections 2023-10-19T12:44:12.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.052+0000 7f8aa44bab80 1 --2- 172.21.15.46:0/4129174472 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5623ebae34c0 0x5623ebaf1e50 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:12.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.052+0000 7f8aa44bab80 1 --2- 172.21.15.46:0/4129174472 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x5623ebb4cdc0 0x5623ebb4f1e0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:12.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.052+0000 7f8aa44bab80 1 --2- 172.21.15.46:0/4129174472 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5623ebae1e60 0x5623ebaf13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:12.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.052+0000 7f8aa44bab80 1 --2- 172.21.15.46:0/4129174472 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5623ebae2b60 0x5623ebaf1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:12.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.052+0000 7f8aa44bab80 1 -- 172.21.15.46:0/4129174472 >> 172.21.15.46:0/4129174472 conn(0x5623eba4d7a0 msgr2=0x5623ebacd530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:44:12.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.052+0000 7f8a71ffb700 0 client.25825 ms_handle_reset on v2:172.21.15.157:6838/552718978 2023-10-19T12:44:12.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.053+0000 7f8aa44bab80 1 -- 172.21.15.46:0/4129174472 shutdown_connections 2023-10-19T12:44:12.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.053+0000 7f8aa44bab80 1 -- 172.21.15.46:0/4129174472 wait complete. 2023-10-19T12:44:12.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.053+0000 7f8aa44bab80 20 client.25825 trim_cache size 0 max 16384 2023-10-19T12:44:12.063 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-10-19T12:44:12.063 INFO:teuthology.orchestra.run.smithi046.stdout: "return_code": 0, 2023-10-19T12:44:12.064 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_tag": "21e73f70-af16-4ae7-bc34-e6c54ba8e1ec", 2023-10-19T12:44:12.064 INFO:teuthology.orchestra.run.smithi046.stdout: "mode": "asynchronous" 2023-10-19T12:44:12.064 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-10-19T12:44:12.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.054+0000 7f8a90bff700 1 -- 172.21.15.46:0/1861618324 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f8a740a1650 msgr2=0x7f8a740a3b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:44:12.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.054+0000 7f8a90bff700 1 --2- 172.21.15.46:0/1861618324 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f8a740a1650 0x7f8a740a3b10 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f8a8000fa40 tx=0x7f8a80019040 comp rx=0 tx=0).stop 2023-10-19T12:44:12.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.054+0000 7f8a90bff700 1 -- 172.21.15.46:0/1861618324 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a8c101270 msgr2=0x7f8a8c1989e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:44:12.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.054+0000 7f8a90bff700 1 --2- 172.21.15.46:0/1861618324 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a8c101270 0x7f8a8c1989e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c00e9c0 tx=0x7f8a7c00ecd0 comp rx=0 tx=0).stop 2023-10-19T12:44:12.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.054+0000 7f8a90bff700 1 -- 172.21.15.46:0/1861618324 shutdown_connections 2023-10-19T12:44:12.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.054+0000 7f8a90bff700 1 --2- 172.21.15.46:0/1861618324 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a8c1064d0 0x7f8a8c19ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:12.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.054+0000 7f8a90bff700 1 --2- 172.21.15.46:0/1861618324 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a8c101270 0x7f8a8c1989e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:12.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.054+0000 7f8a90bff700 1 --2- 172.21.15.46:0/1861618324 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f8a740a1650 0x7f8a740a3b10 secure :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f8a8000fa40 tx=0x7f8a80019040 comp rx=0 tx=0).stop 2023-10-19T12:44:12.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.054+0000 7f8a90bff700 1 --2- 172.21.15.46:0/1861618324 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a8c103ba0 0x7f8a8c198f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:12.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.054+0000 7f8a90bff700 1 -- 172.21.15.46:0/1861618324 >> 172.21.15.46:0/1861618324 conn(0x7f8a8c0fac00 msgr2=0x7f8a8c100a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:44:12.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.055+0000 7f8a90bff700 1 -- 172.21.15.46:0/1861618324 shutdown_connections 2023-10-19T12:44:12.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.055+0000 7f8a90bff700 1 -- 172.21.15.46:0/1861618324 wait complete. 2023-10-19T12:44:12.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:44:11 smithi157 ceph-mon[134109]: pgmap v374: 129 pgs: 129 active+clean; 1002 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 52 MiB/s wr, 259 op/s 2023-10-19T12:44:12.091 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-19T12:44:12.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:44:11 smithi195 ceph-mon[134493]: pgmap v374: 129 pgs: 129 active+clean; 1002 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 52 MiB/s wr, 259 op/s 2023-10-19T12:44:12.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.456+0000 7fcdf339d700 1 -- 172.21.15.46:0/2426101265 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcdec100650 msgr2=0x7fcdec100a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:44:12.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.456+0000 7fcdf339d700 1 --2- 172.21.15.46:0/2426101265 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcdec100650 0x7fcdec100a70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fcddc0099c0 tx=0x7fcddc009cd0 comp rx=0 tx=0).stop 2023-10-19T12:44:12.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.456+0000 7fcdf339d700 1 -- 172.21.15.46:0/2426101265 shutdown_connections 2023-10-19T12:44:12.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.456+0000 7fcdf339d700 1 --2- 172.21.15.46:0/2426101265 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcdec1021e0 0x7fcdec108a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:12.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.456+0000 7fcdf339d700 1 --2- 172.21.15.46:0/2426101265 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcdec100650 0x7fcdec100a70 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:12.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.456+0000 7fcdf339d700 1 --2- 172.21.15.46:0/2426101265 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcdec101840 0x7fcdec101ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:12.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.456+0000 7fcdf339d700 1 -- 172.21.15.46:0/2426101265 >> 172.21.15.46:0/2426101265 conn(0x7fcdec0fbbc0 msgr2=0x7fcdec0fe000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:44:12.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.456+0000 7fcdf339d700 1 -- 172.21.15.46:0/2426101265 shutdown_connections 2023-10-19T12:44:12.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.457+0000 7fcdf339d700 1 -- 172.21.15.46:0/2426101265 wait complete. 2023-10-19T12:44:12.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.458+0000 7fcdf339d700 1 Processor -- start 2023-10-19T12:44:12.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.459+0000 7fcdf339d700 1 -- start start 2023-10-19T12:44:12.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.460+0000 7fcdf339d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcdec100650 0x7fcdec198810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:12.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.460+0000 7fcdf339d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcdec101840 0x7fcdec198d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:12.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.460+0000 7fcdf339d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcdec1021e0 0x7fcdec19fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:12.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.460+0000 7fcdf339d700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdec1a0340 con 0x7fcdec100650 2023-10-19T12:44:12.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.460+0000 7fcdf339d700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdec1a0480 con 0x7fcdec101840 2023-10-19T12:44:12.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.460+0000 7fcdf339d700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdec1a0610 con 0x7fcdec1021e0 2023-10-19T12:44:12.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.460+0000 7fcdf2b9c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcdec1021e0 0x7fcdec19fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:12.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.460+0000 7fcdf2b9c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcdec1021e0 0x7fcdec19fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:50258/0 (socket says 172.21.15.46:50258) 2023-10-19T12:44:12.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.460+0000 7fcdf2b9c700 1 -- 172.21.15.46:0/1750875793 learned_addr learned my addr 172.21.15.46:0/1750875793 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:44:12.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.460+0000 7fcdf239b700 1 --2- 172.21.15.46:0/1750875793 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcdec100650 0x7fcdec198810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:12.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.461+0000 7fcdf1b9a700 1 --2- 172.21.15.46:0/1750875793 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcdec101840 0x7fcdec198d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:12.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.461+0000 7fcdf2b9c700 1 -- 172.21.15.46:0/1750875793 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcdec101840 msgr2=0x7fcdec198d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:44:12.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.461+0000 7fcdf2b9c700 1 --2- 172.21.15.46:0/1750875793 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcdec101840 0x7fcdec198d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:12.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.461+0000 7fcdf2b9c700 1 -- 172.21.15.46:0/1750875793 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcdec100650 msgr2=0x7fcdec198810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:44:12.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.461+0000 7fcdf2b9c700 1 --2- 172.21.15.46:0/1750875793 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcdec100650 0x7fcdec198810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:12.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.461+0000 7fcdf2b9c700 1 -- 172.21.15.46:0/1750875793 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcddc0095f0 con 0x7fcdec1021e0 2023-10-19T12:44:12.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.461+0000 7fcdf2b9c700 1 --2- 172.21.15.46:0/1750875793 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcdec1021e0 0x7fcdec19fd70 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fcde400ef30 tx=0x7fcde400c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:44:12.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.462+0000 7fcde37fe700 1 -- 172.21.15.46:0/1750875793 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde4018070 con 0x7fcdec1021e0 2023-10-19T12:44:12.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.462+0000 7fcdf339d700 1 -- 172.21.15.46:0/1750875793 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdec1a0890 con 0x7fcdec1021e0 2023-10-19T12:44:12.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.462+0000 7fcde37fe700 1 -- 172.21.15.46:0/1750875793 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcde400f040 con 0x7fcdec1021e0 2023-10-19T12:44:12.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.462+0000 7fcde37fe700 1 -- 172.21.15.46:0/1750875793 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde4003dc0 con 0x7fcdec1021e0 2023-10-19T12:44:12.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.462+0000 7fcdf339d700 1 -- 172.21.15.46:0/1750875793 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdec1a0da0 con 0x7fcdec1021e0 2023-10-19T12:44:12.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.467+0000 7fce07f46b80 1 Processor -- start 2023-10-19T12:44:12.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.468+0000 7fcde37fe700 1 -- 172.21.15.46:0/1750875793 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fcde4007500 con 0x7fcdec1021e0 2023-10-19T12:44:12.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.470+0000 7fce07f46b80 1 -- start start 2023-10-19T12:44:12.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.470+0000 7fce07f46b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bbbeed1ce0 0x55bbbeed2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:12.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.470+0000 7fce07f46b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bbbeed2640 0x55bbbeed2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:12.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.470+0000 7fce07f46b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55bbbeed3000 0x55bbbeed3460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:12.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.470+0000 7fce07f46b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbbee3c6e0 con 0x55bbbeed3000 2023-10-19T12:44:12.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.470+0000 7fce07f46b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbbee22c60 con 0x55bbbeed2640 2023-10-19T12:44:12.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.470+0000 7fce07f46b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbbee20580 con 0x55bbbeed1ce0 2023-10-19T12:44:12.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.471+0000 7fcdf1b9a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bbbeed1ce0 0x55bbbeed2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:12.476 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.471+0000 7fcdf1b9a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bbbeed1ce0 0x55bbbeed2100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:50262/0 (socket says 172.21.15.46:50262) 2023-10-19T12:44:12.476 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.471+0000 7fcdf1b9a700 1 -- 172.21.15.46:0/2889853358 learned_addr learned my addr 172.21.15.46:0/2889853358 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:44:12.477 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.471+0000 7fcdf239b700 1 --2- 172.21.15.46:0/2889853358 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bbbeed2640 0x55bbbeed2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:12.478 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.471+0000 7fcdf1b9a700 1 --2- 172.21.15.46:0/2889853358 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55bbbeed3000 0x55bbbeed3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:12.478 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.471+0000 7fcde37fe700 1 --2- 172.21.15.46:0/1750875793 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fcdd80a14e0 0x7fcdd80a39a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:12.478 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.471+0000 7fcdf1b9a700 1 -- 172.21.15.46:0/2889853358 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bbbeed2640 msgr2=0x55bbbeed2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:44:12.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.471+0000 7fcdf1b9a700 1 --2- 172.21.15.46:0/2889853358 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bbbeed2640 0x55bbbeed2ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:12.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.471+0000 7fcdf1b9a700 1 -- 172.21.15.46:0/2889853358 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55bbbeed3000 msgr2=0x55bbbeed3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:44:12.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.471+0000 7fcdf1b9a700 1 --2- 172.21.15.46:0/2889853358 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55bbbeed3000 0x55bbbeed3460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:12.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.471+0000 7fcdf1b9a700 1 -- 172.21.15.46:0/2889853358 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bbbedd93f0 con 0x55bbbeed1ce0 2023-10-19T12:44:12.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.472+0000 7fcdf2b9c700 1 --2- 172.21.15.46:0/1750875793 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fcdd80a14e0 0x7fcdd80a39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:12.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.472+0000 7fcdf1b9a700 1 --2- 172.21.15.46:0/2889853358 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bbbeed1ce0 0x55bbbeed2100 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fcde8013650 tx=0x7fcde800c6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ab51e1a66c3a6cd server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:44:12.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.472+0000 7fcde37fe700 1 -- 172.21.15.46:0/1750875793 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7fcde40ccd90 con 0x7fcdec1021e0 2023-10-19T12:44:12.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.472+0000 7fcde0bfe700 1 -- 172.21.15.46:0/2889853358 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde801e410 con 0x55bbbeed1ce0 2023-10-19T12:44:12.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.472+0000 7fcde0bfe700 1 -- 172.21.15.46:0/2889853358 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcde8011910 con 0x55bbbeed1ce0 2023-10-19T12:44:12.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.472+0000 7fcde0bfe700 1 -- 172.21.15.46:0/2889853358 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde800f730 con 0x55bbbeed1ce0 2023-10-19T12:44:12.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.473+0000 7fce07f46b80 1 -- 172.21.15.46:0/2889853358 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bbbeed1ce0 msgr2=0x55bbbeed2100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:44:12.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.473+0000 7fce07f46b80 1 --2- 172.21.15.46:0/2889853358 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bbbeed1ce0 0x55bbbeed2100 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fcde8013650 tx=0x7fcde800c6f0 comp rx=0 tx=0).stop 2023-10-19T12:44:12.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.474+0000 7fce07f46b80 1 -- 172.21.15.46:0/2889853358 shutdown_connections 2023-10-19T12:44:12.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.474+0000 7fce07f46b80 1 --2- 172.21.15.46:0/2889853358 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55bbbeed3000 0x55bbbeed3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:12.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.474+0000 7fce07f46b80 1 --2- 172.21.15.46:0/2889853358 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bbbeed1ce0 0x55bbbeed2100 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:12.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.474+0000 7fce07f46b80 1 --2- 172.21.15.46:0/2889853358 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bbbeed2640 0x55bbbeed2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:12.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.474+0000 7fce07f46b80 1 -- 172.21.15.46:0/2889853358 >> 172.21.15.46:0/2889853358 conn(0x55bbbee3d720 msgr2=0x55bbbeec3d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:44:12.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.474+0000 7fcdf2b9c700 1 --2- 172.21.15.46:0/1750875793 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fcdd80a14e0 0x7fcdd80a39a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fcde4099a70 tx=0x7fcde4004e30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:44:12.483 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.474+0000 7fce07f46b80 1 -- 172.21.15.46:0/2889853358 shutdown_connections 2023-10-19T12:44:12.483 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.474+0000 7fce07f46b80 1 -- 172.21.15.46:0/2889853358 wait complete. 2023-10-19T12:44:12.483 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.474+0000 7fce07f46b80 1 -- start start 2023-10-19T12:44:12.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.475+0000 7fce07f46b80 1 Processor -- start 2023-10-19T12:44:12.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.476+0000 7fce07f46b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55bbbeed1ce0 0x55bbbeedb2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:12.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.476+0000 7fce07f46b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bbbeed2640 0x55bbbeedb810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:12.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.476+0000 7fce07f46b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bbbeed3000 0x55bbbeee2850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:12.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.476+0000 7fce07f46b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbbee1be70 con 0x55bbbeed1ce0 2023-10-19T12:44:12.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.476+0000 7fce07f46b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbbedb8710 con 0x55bbbeed3000 2023-10-19T12:44:12.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.476+0000 7fce07f46b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbbedb83b0 con 0x55bbbeed2640 2023-10-19T12:44:12.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.476+0000 7fce07f46b80 10 client.0 _ll_register_callbacks cb 0x55bbbed02a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:44:12.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.477+0000 7fcdf239b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bbbeed2640 0x55bbbeedb810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:12.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.477+0000 7fcdf239b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bbbeed2640 0x55bbbeedb810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:50270/0 (socket says 172.21.15.46:50270) 2023-10-19T12:44:12.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.477+0000 7fcdf239b700 1 -- 172.21.15.46:0/2387863264 learned_addr learned my addr 172.21.15.46:0/2387863264 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:44:12.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.477+0000 7fcdf1b9a700 1 --2- 172.21.15.46:0/2387863264 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bbbeed3000 0x55bbbeee2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:12.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.478+0000 7fcdf1b9a700 1 --2- 172.21.15.46:0/2387863264 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55bbbeed1ce0 0x55bbbeedb2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:12.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.479+0000 7fcdf239b700 1 -- 172.21.15.46:0/2387863264 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bbbeed3000 msgr2=0x55bbbeee2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:44:12.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.479+0000 7fcdf239b700 1 --2- 172.21.15.46:0/2387863264 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bbbeed3000 0x55bbbeee2850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:12.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.479+0000 7fcdf239b700 1 -- 172.21.15.46:0/2387863264 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55bbbeed1ce0 msgr2=0x55bbbeedb2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:44:12.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.479+0000 7fcdf239b700 1 --2- 172.21.15.46:0/2387863264 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55bbbeed1ce0 0x55bbbeedb2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:12.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.479+0000 7fcdf239b700 1 -- 172.21.15.46:0/2387863264 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcde800cde0 con 0x55bbbeed2640 2023-10-19T12:44:12.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.480+0000 7fcdf239b700 1 --2- 172.21.15.46:0/2387863264 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bbbeed2640 0x55bbbeedb810 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fcddc0099c0 tx=0x7fcddc00bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=51969b58270849b9 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:44:12.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.480+0000 7fcdd5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-10-19T12:44:12.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.481+0000 7fcdd5ffb700 1 -- 172.21.15.46:0/2387863264 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcddc01d070 con 0x55bbbeed2640 2023-10-19T12:44:12.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.481+0000 7fcdd5ffb700 1 -- 172.21.15.46:0/2387863264 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7fcddc005590 con 0x55bbbeed2640 2023-10-19T12:44:12.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.481+0000 7fce07f46b80 1 -- 172.21.15.46:0/2387863264 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bbbee20ef0 con 0x55bbbeed2640 2023-10-19T12:44:12.490 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.481+0000 7fcdd5ffb700 1 -- 172.21.15.46:0/2387863264 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcddc0037d0 con 0x55bbbeed2640 2023-10-19T12:44:12.490 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.481+0000 7fce07f46b80 10 client.25837 fetch_fsmap learned FSMap version 29 2023-10-19T12:44:12.490 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.481+0000 7fce07f46b80 1 -- 172.21.15.46:0/2387863264 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55bbbec46de0 con 0x55bbbeed2640 2023-10-19T12:44:12.490 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.482+0000 7fcdd5ffb700 1 -- 172.21.15.46:0/2387863264 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55bbbee20ef0 con 0x55bbbeed2640 2023-10-19T12:44:12.490 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.482+0000 7fcdd5ffb700 1 -- 172.21.15.46:0/2387863264 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 29) v1 ==== 7906+0+0 (secure 0 0 0) 0x7fcddc00f980 con 0x55bbbeed2640 2023-10-19T12:44:12.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.482+0000 7fce07f46b80 10 client.25837 fetch_fsmap finished waiting for FSMap version 29 2023-10-19T12:44:12.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.482+0000 7fce07f46b80 10 client.25837 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-19T12:44:12.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.482+0000 7fce07f46b80 20 client.25837 populate_metadata read hostname 'smithi046' 2023-10-19T12:44:12.493 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.483+0000 7fce07f46b80 1 --2- 172.21.15.46:0/2387863264 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x55bbbeee7180 0x55bbbeee95a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:12.493 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.483+0000 7fce07f46b80 4 client.25837 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-19T12:44:12.493 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.483+0000 7fce07f46b80 1 -- 172.21.15.46:0/2387863264 --> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bbbee988b0 con 0x55bbbeee7180 2023-10-19T12:44:12.493 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.483+0000 7fcdf1b9a700 1 --2- 172.21.15.46:0/2387863264 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x55bbbeee7180 0x55bbbeee95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:12.493 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.483+0000 7fcdd5ffb700 10 client.25837 ms_handle_connect on v2:172.21.15.157:6838/552718978 2023-10-19T12:44:12.494 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.483+0000 7fcdf1b9a700 1 --2- 172.21.15.46:0/2387863264 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x55bbbeee7180 0x55bbbeee95a0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a399a2816893b14a server_cookie=3eb12886c6f38fb in_seq=0 out_seq=0 2023-10-19T12:44:12.494 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.484+0000 7fcdd5ffb700 1 -- 172.21.15.46:0/2387863264 <== mds.0 v2:172.21.15.157:6838/552718978 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55bbbee988b0 con 0x55bbbeee7180 2023-10-19T12:44:12.494 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.484+0000 7fcdd5ffb700 10 client.25837 handle_command_reply: tid=0 2023-10-19T12:44:12.494 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.485+0000 7fce07f46b80 1 client.25837 shutdown 2023-10-19T12:44:12.494 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.485+0000 7fce07f46b80 1 -- 172.21.15.46:0/2387863264 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bbbeed2640 msgr2=0x55bbbeedb810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:44:12.495 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.485+0000 7fce07f46b80 1 --2- 172.21.15.46:0/2387863264 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bbbeed2640 0x55bbbeedb810 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fcddc0099c0 tx=0x7fcddc00bea0 comp rx=0 tx=0).stop 2023-10-19T12:44:12.495 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.485+0000 7fce07f46b80 1 -- 172.21.15.46:0/2387863264 shutdown_connections 2023-10-19T12:44:12.495 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.485+0000 7fce07f46b80 1 --2- 172.21.15.46:0/2387863264 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bbbeed3000 0x55bbbeee2850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:12.495 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.485+0000 7fce07f46b80 1 --2- 172.21.15.46:0/2387863264 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x55bbbeee7180 0x55bbbeee95a0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:12.495 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.485+0000 7fce07f46b80 1 --2- 172.21.15.46:0/2387863264 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55bbbeed1ce0 0x55bbbeedb2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:12.496 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.485+0000 7fce07f46b80 1 --2- 172.21.15.46:0/2387863264 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bbbeed2640 0x55bbbeedb810 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:12.496 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.485+0000 7fce07f46b80 1 -- 172.21.15.46:0/2387863264 >> 172.21.15.46:0/2387863264 conn(0x55bbbee3d720 msgr2=0x55bbbeec82d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:44:12.496 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.485+0000 7fcdd5ffb700 0 client.25837 ms_handle_reset on v2:172.21.15.157:6838/552718978 2023-10-19T12:44:12.496 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.485+0000 7fce07f46b80 1 -- 172.21.15.46:0/2387863264 shutdown_connections 2023-10-19T12:44:12.496 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.485+0000 7fce07f46b80 1 -- 172.21.15.46:0/2387863264 wait complete. 2023-10-19T12:44:12.497 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.486+0000 7fce07f46b80 20 client.25837 trim_cache size 0 max 16384 2023-10-19T12:44:12.518 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.515+0000 7fce07f46b80 1 Processor -- start 2023-10-19T12:44:12.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.516+0000 7fce07f46b80 1 -- start start 2023-10-19T12:44:12.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.517+0000 7fce07f46b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bbbeed1ce0 0x55bbbeebe820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:12.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.517+0000 7fce07f46b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bbbeed2640 0x55bbbeee2810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:12.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.518+0000 7fce07f46b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55bbbeed3000 0x55bbbeec3a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:12.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.518+0000 7fce07f46b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbbec9c920 con 0x55bbbeed3000 2023-10-19T12:44:12.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.518+0000 7fce07f46b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbbeee4560 con 0x55bbbeed2640 2023-10-19T12:44:12.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.518+0000 7fce07f46b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbbeedc2c0 con 0x55bbbeed1ce0 2023-10-19T12:44:12.523 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.519+0000 7fcdf1b9a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bbbeed1ce0 0x55bbbeebe820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:12.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.519+0000 7fcdf239b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bbbeed2640 0x55bbbeee2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:12.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.519+0000 7fcdf239b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bbbeed2640 0x55bbbeee2810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:40820/0 (socket says 172.21.15.46:40820) 2023-10-19T12:44:12.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.519+0000 7fcdf239b700 1 -- 172.21.15.46:0/1472288428 learned_addr learned my addr 172.21.15.46:0/1472288428 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:44:12.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.520+0000 7fcdf1b9a700 1 --2- 172.21.15.46:0/1472288428 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55bbbeed3000 0x55bbbeec3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:12.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.521+0000 7fcdf1b9a700 1 -- 172.21.15.46:0/1472288428 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bbbeed1ce0 msgr2=0x55bbbeebe820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:44:12.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.521+0000 7fcdf1b9a700 1 --2- 172.21.15.46:0/1472288428 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bbbeed1ce0 0x55bbbeebe820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:12.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.521+0000 7fcdf1b9a700 1 -- 172.21.15.46:0/1472288428 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bbbeed2640 msgr2=0x55bbbeee2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:44:12.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.521+0000 7fcdf1b9a700 1 --2- 172.21.15.46:0/1472288428 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bbbeed2640 0x55bbbeee2810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:12.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.521+0000 7fcdf1b9a700 1 -- 172.21.15.46:0/1472288428 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bbbec2fc60 con 0x55bbbeed3000 2023-10-19T12:44:12.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.521+0000 7fcdf1b9a700 1 --2- 172.21.15.46:0/1472288428 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55bbbeed3000 0x55bbbeec3a60 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fcde8005d90 tx=0x7fcde800c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e35c98431ab207b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:44:12.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.522+0000 7fcde13ff700 1 -- 172.21.15.46:0/1472288428 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde802d450 con 0x55bbbeed3000 2023-10-19T12:44:12.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.522+0000 7fcde13ff700 1 -- 172.21.15.46:0/1472288428 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcde802d5b0 con 0x55bbbeed3000 2023-10-19T12:44:12.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.522+0000 7fcde13ff700 1 -- 172.21.15.46:0/1472288428 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde802de10 con 0x55bbbeed3000 2023-10-19T12:44:12.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.524+0000 7fce07f46b80 1 -- 172.21.15.46:0/1472288428 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55bbbeed3000 msgr2=0x55bbbeec3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:44:12.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.524+0000 7fce07f46b80 1 --2- 172.21.15.46:0/1472288428 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55bbbeed3000 0x55bbbeec3a60 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fcde8005d90 tx=0x7fcde800c470 comp rx=0 tx=0).stop 2023-10-19T12:44:12.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.524+0000 7fce07f46b80 1 -- 172.21.15.46:0/1472288428 shutdown_connections 2023-10-19T12:44:12.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.524+0000 7fce07f46b80 1 --2- 172.21.15.46:0/1472288428 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55bbbeed3000 0x55bbbeec3a60 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:12.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.524+0000 7fce07f46b80 1 --2- 172.21.15.46:0/1472288428 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bbbeed1ce0 0x55bbbeebe820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:12.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.524+0000 7fce07f46b80 1 --2- 172.21.15.46:0/1472288428 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bbbeed2640 0x55bbbeee2810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:12.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.524+0000 7fce07f46b80 1 -- 172.21.15.46:0/1472288428 >> 172.21.15.46:0/1472288428 conn(0x55bbbee3d720 msgr2=0x55bbbeed33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:44:12.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.524+0000 7fce07f46b80 1 -- 172.21.15.46:0/1472288428 shutdown_connections 2023-10-19T12:44:12.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.524+0000 7fce07f46b80 1 -- 172.21.15.46:0/1472288428 wait complete. 2023-10-19T12:44:12.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.525+0000 7fce07f46b80 1 -- start start 2023-10-19T12:44:12.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.526+0000 7fce07f46b80 1 Processor -- start 2023-10-19T12:44:12.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.526+0000 7fce07f46b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bbbeed1ce0 0x55bbbeee2290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:12.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.526+0000 7fce07f46b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bbbeed2640 0x55bbbeee27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:12.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.526+0000 7fce07f46b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55bbbeed3000 0x55bbbeee0c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:12.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.526+0000 7fce07f46b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbbeee1350 con 0x55bbbeed3000 2023-10-19T12:44:12.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.526+0000 7fce07f46b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbbeee14c0 con 0x55bbbeed2640 2023-10-19T12:44:12.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.526+0000 7fce07f46b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbbeee1680 con 0x55bbbeed1ce0 2023-10-19T12:44:12.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.526+0000 7fce07f46b80 10 client.0 _ll_register_callbacks cb 0x55bbbed02a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:44:12.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.528+0000 7fcdf239b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bbbeed2640 0x55bbbeee27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:12.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.528+0000 7fcdf239b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bbbeed2640 0x55bbbeee27d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:40834/0 (socket says 172.21.15.46:40834) 2023-10-19T12:44:12.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.528+0000 7fcdf239b700 1 -- 172.21.15.46:0/3632040034 learned_addr learned my addr 172.21.15.46:0/3632040034 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:44:12.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.528+0000 7fcdf1b9a700 1 --2- 172.21.15.46:0/3632040034 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55bbbeed3000 0x55bbbeee0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:12.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.528+0000 7fcdf1b9a700 1 --2- 172.21.15.46:0/3632040034 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bbbeed1ce0 0x55bbbeee2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:12.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.528+0000 7fcdf239b700 1 -- 172.21.15.46:0/3632040034 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bbbeed1ce0 msgr2=0x55bbbeee2290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:44:12.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.528+0000 7fcdf239b700 1 --2- 172.21.15.46:0/3632040034 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bbbeed1ce0 0x55bbbeee2290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:12.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.528+0000 7fcdf239b700 1 -- 172.21.15.46:0/3632040034 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55bbbeed3000 msgr2=0x55bbbeee0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:44:12.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.528+0000 7fcdf239b700 1 --2- 172.21.15.46:0/3632040034 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55bbbeed3000 0x55bbbeee0c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:12.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.528+0000 7fcdf239b700 1 -- 172.21.15.46:0/3632040034 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcde8026040 con 0x55bbbeed2640 2023-10-19T12:44:12.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.529+0000 7fcdf1b9a700 1 --2- 172.21.15.46:0/3632040034 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bbbeed1ce0 0x55bbbeee2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T12:44:12.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.529+0000 7fcdd5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.157:3300/0 2023-10-19T12:44:12.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.529+0000 7fcdf239b700 1 --2- 172.21.15.46:0/3632040034 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bbbeed2640 0x55bbbeee27d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fcddc003a80 tx=0x7fcddc009cd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10afbc0e40081a76 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:44:12.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.531+0000 7fcdd5ffb700 1 -- 172.21.15.46:0/3632040034 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcddc01d040 con 0x55bbbeed2640 2023-10-19T12:44:12.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.531+0000 7fcdd5ffb700 1 -- 172.21.15.46:0/3632040034 <== mon.2 v2:172.21.15.157:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7fcddc022450 con 0x55bbbeed2640 2023-10-19T12:44:12.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.531+0000 7fce07f46b80 1 -- 172.21.15.46:0/3632040034 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bbbee14e50 con 0x55bbbeed2640 2023-10-19T12:44:12.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.532+0000 7fcdd5ffb700 1 -- 172.21.15.46:0/3632040034 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcddc005a00 con 0x55bbbeed2640 2023-10-19T12:44:12.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.532+0000 7fce07f46b80 10 client.25838 fetch_fsmap learned FSMap version 29 2023-10-19T12:44:12.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.532+0000 7fce07f46b80 1 -- 172.21.15.46:0/3632040034 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55bbbec6d250 con 0x55bbbeed2640 2023-10-19T12:44:12.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.533+0000 7fcdd5ffb700 1 -- 172.21.15.46:0/3632040034 <== mon.2 v2:172.21.15.157:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55bbbee14e50 con 0x55bbbeed2640 2023-10-19T12:44:12.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.533+0000 7fcdd5ffb700 1 -- 172.21.15.46:0/3632040034 <== mon.2 v2:172.21.15.157:3300/0 5 ==== fsmap(e 29) v1 ==== 7906+0+0 (secure 0 0 0) 0x7fcddc03f070 con 0x55bbbeed2640 2023-10-19T12:44:12.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.533+0000 7fce07f46b80 10 client.25838 fetch_fsmap finished waiting for FSMap version 29 2023-10-19T12:44:12.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.533+0000 7fce07f46b80 10 client.25838 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-19T12:44:12.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.533+0000 7fce07f46b80 20 client.25838 populate_metadata read hostname 'smithi046' 2023-10-19T12:44:12.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.533+0000 7fce07f46b80 1 --2- 172.21.15.46:0/3632040034 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x55bbbef3c130 0x55bbbef3e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:12.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.533+0000 7fce07f46b80 4 client.25838 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-19T12:44:12.539 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.533+0000 7fce07f46b80 1 -- 172.21.15.46:0/3632040034 --> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55bbbee14b70 con 0x55bbbef3c130 2023-10-19T12:44:12.539 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.535+0000 7fcdf1b9a700 1 --2- 172.21.15.46:0/3632040034 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x55bbbef3c130 0x55bbbef3e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:12.540 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.537+0000 7fcdf1b9a700 1 --2- 172.21.15.46:0/3632040034 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x55bbbef3c130 0x55bbbef3e550 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86e3289bbb73a55a server_cookie=d7d5e43dd7a321ce in_seq=0 out_seq=0 2023-10-19T12:44:12.540 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.537+0000 7fcdd5ffb700 10 client.25838 ms_handle_connect on v2:172.21.15.157:6838/552718978 2023-10-19T12:44:12.540 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.537+0000 7fcdd5ffb700 1 -- 172.21.15.46:0/3632040034 <== mds.0 v2:172.21.15.157:6838/552718978 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55bbbee14b70 con 0x55bbbef3c130 2023-10-19T12:44:12.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.537+0000 7fcdd5ffb700 10 client.25838 handle_command_reply: tid=0 2023-10-19T12:44:12.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.537+0000 7fce07f46b80 1 client.25838 shutdown 2023-10-19T12:44:12.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.540+0000 7fce07f46b80 1 -- 172.21.15.46:0/3632040034 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bbbeed2640 msgr2=0x55bbbeee27d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:44:12.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.540+0000 7fce07f46b80 1 --2- 172.21.15.46:0/3632040034 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bbbeed2640 0x55bbbeee27d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fcddc003a80 tx=0x7fcddc009cd0 comp rx=0 tx=0).stop 2023-10-19T12:44:12.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.540+0000 7fce07f46b80 1 -- 172.21.15.46:0/3632040034 shutdown_connections 2023-10-19T12:44:12.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.540+0000 7fce07f46b80 1 --2- 172.21.15.46:0/3632040034 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x55bbbef3c130 0x55bbbef3e550 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:12.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.540+0000 7fce07f46b80 1 --2- 172.21.15.46:0/3632040034 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55bbbeed3000 0x55bbbeee0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:12.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.540+0000 7fce07f46b80 1 --2- 172.21.15.46:0/3632040034 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bbbeed1ce0 0x55bbbeee2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:12.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.540+0000 7fce07f46b80 1 --2- 172.21.15.46:0/3632040034 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55bbbeed2640 0x55bbbeee27d0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:12.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.540+0000 7fcdd5ffb700 0 client.25838 ms_handle_reset on v2:172.21.15.157:6838/552718978 2023-10-19T12:44:12.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.540+0000 7fce07f46b80 1 -- 172.21.15.46:0/3632040034 >> 172.21.15.46:0/3632040034 conn(0x55bbbee3d720 msgr2=0x55bbbeec3a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:44:12.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.541+0000 7fce07f46b80 1 -- 172.21.15.46:0/3632040034 shutdown_connections 2023-10-19T12:44:12.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.541+0000 7fce07f46b80 1 -- 172.21.15.46:0/3632040034 wait complete. 2023-10-19T12:44:12.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.541+0000 7fce07f46b80 20 client.25838 trim_cache size 0 max 16384 2023-10-19T12:44:12.546 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-10-19T12:44:12.547 INFO:teuthology.orchestra.run.smithi046.stdout: "status": "scrub active (2 inodes in the stack)", 2023-10-19T12:44:12.547 INFO:teuthology.orchestra.run.smithi046.stdout: "scrubs": { 2023-10-19T12:44:12.547 INFO:teuthology.orchestra.run.smithi046.stdout: "21e73f70-af16-4ae7-bc34-e6c54ba8e1ec": { 2023-10-19T12:44:12.547 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2023-10-19T12:44:12.548 INFO:teuthology.orchestra.run.smithi046.stdout: "tag": "21e73f70-af16-4ae7-bc34-e6c54ba8e1ec", 2023-10-19T12:44:12.548 INFO:teuthology.orchestra.run.smithi046.stdout: "options": "recursive,force" 2023-10-19T12:44:12.548 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:44:12.548 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:44:12.549 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-10-19T12:44:12.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.542+0000 7fcdf339d700 1 -- 172.21.15.46:0/1750875793 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fcdd80a14e0 msgr2=0x7fcdd80a39a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:44:12.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.542+0000 7fcdf339d700 1 --2- 172.21.15.46:0/1750875793 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fcdd80a14e0 0x7fcdd80a39a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fcde4099a70 tx=0x7fcde4004e30 comp rx=0 tx=0).stop 2023-10-19T12:44:12.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.542+0000 7fcdf339d700 1 -- 172.21.15.46:0/1750875793 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcdec1021e0 msgr2=0x7fcdec19fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:44:12.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.542+0000 7fcdf339d700 1 --2- 172.21.15.46:0/1750875793 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcdec1021e0 0x7fcdec19fd70 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fcde400ef30 tx=0x7fcde400c450 comp rx=0 tx=0).stop 2023-10-19T12:44:12.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.543+0000 7fcdf339d700 1 -- 172.21.15.46:0/1750875793 shutdown_connections 2023-10-19T12:44:12.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.543+0000 7fcdf339d700 1 --2- 172.21.15.46:0/1750875793 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fcdd80a14e0 0x7fcdd80a39a0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:12.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.543+0000 7fcdf339d700 1 --2- 172.21.15.46:0/1750875793 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcdec1021e0 0x7fcdec19fd70 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:12.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.543+0000 7fcdf339d700 1 --2- 172.21.15.46:0/1750875793 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcdec100650 0x7fcdec198810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:12.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.543+0000 7fcdf339d700 1 --2- 172.21.15.46:0/1750875793 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcdec101840 0x7fcdec198d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:12.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.543+0000 7fcdf339d700 1 -- 172.21.15.46:0/1750875793 >> 172.21.15.46:0/1750875793 conn(0x7fcdec0fbbc0 msgr2=0x7fcdec072a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:44:12.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.543+0000 7fcdf339d700 1 -- 172.21.15.46:0/1750875793 shutdown_connections 2023-10-19T12:44:12.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:12.543+0000 7fcdf339d700 1 -- 172.21.15.46:0/1750875793 wait complete. 2023-10-19T12:44:12.578 INFO:tasks.cephfs.filesystem:scrub status for tag:21e73f70-af16-4ae7-bc34-e6c54ba8e1ec - {'path': '/', 'tag': '21e73f70-af16-4ae7-bc34-e6c54ba8e1ec', 'options': 'recursive,force'} 2023-10-19T12:44:12.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:44:12 smithi046 ceph-mon[98509]: scrub queued for path: / 2023-10-19T12:44:12.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:44:12 smithi046 ceph-mon[98509]: scrub summary: idle+waiting paths [/] 2023-10-19T12:44:12.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:44:12 smithi046 ceph-mon[98509]: scrub summary: active paths [/] 2023-10-19T12:44:12.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:44:12 smithi046 ceph-mon[98509]: scrub summary: active paths [/] 2023-10-19T12:44:12.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:44:12 smithi046 ceph-mon[98509]: scrub summary: active paths [/] 2023-10-19T12:44:12.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:44:12 smithi046 ceph-mon[98509]: scrub summary: idle+waiting paths [/] 2023-10-19T12:44:12.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:44:12 smithi046 ceph-mon[98509]: scrub summary: idle+waiting paths [/] 2023-10-19T12:44:12.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:44:12 smithi046 ceph-mon[98509]: scrub summary: active paths [/] 2023-10-19T12:44:12.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:44:12 smithi046 ceph-mon[98509]: scrub summary: active paths [/] 2023-10-19T12:44:12.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:44:12 smithi046 ceph-mon[98509]: scrub summary: idle+waiting paths [/] 2023-10-19T12:44:12.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:44:12 smithi046 ceph-mon[98509]: scrub summary: idle+waiting paths [/] 2023-10-19T12:44:13.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:44:12 smithi157 ceph-mon[134109]: scrub queued for path: / 2023-10-19T12:44:13.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:44:12 smithi157 ceph-mon[134109]: scrub summary: idle+waiting paths [/] 2023-10-19T12:44:13.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:44:12 smithi157 ceph-mon[134109]: scrub summary: active paths [/] 2023-10-19T12:44:13.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:44:12 smithi157 ceph-mon[134109]: scrub summary: active paths [/] 2023-10-19T12:44:13.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:44:12 smithi157 ceph-mon[134109]: scrub summary: active paths [/] 2023-10-19T12:44:13.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:44:12 smithi157 ceph-mon[134109]: scrub summary: idle+waiting paths [/] 2023-10-19T12:44:13.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:44:12 smithi157 ceph-mon[134109]: scrub summary: idle+waiting paths [/] 2023-10-19T12:44:13.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:44:12 smithi157 ceph-mon[134109]: scrub summary: active paths [/] 2023-10-19T12:44:13.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:44:12 smithi157 ceph-mon[134109]: scrub summary: active paths [/] 2023-10-19T12:44:13.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:44:12 smithi157 ceph-mon[134109]: scrub summary: idle+waiting paths [/] 2023-10-19T12:44:13.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:44:12 smithi157 ceph-mon[134109]: scrub summary: idle+waiting paths [/] 2023-10-19T12:44:13.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:44:12 smithi195 ceph-mon[134493]: scrub queued for path: / 2023-10-19T12:44:13.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:44:12 smithi195 ceph-mon[134493]: scrub summary: idle+waiting paths [/] 2023-10-19T12:44:13.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:44:12 smithi195 ceph-mon[134493]: scrub summary: active paths [/] 2023-10-19T12:44:13.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:44:12 smithi195 ceph-mon[134493]: scrub summary: active paths [/] 2023-10-19T12:44:13.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:44:12 smithi195 ceph-mon[134493]: scrub summary: active paths [/] 2023-10-19T12:44:13.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:44:12 smithi195 ceph-mon[134493]: scrub summary: idle+waiting paths [/] 2023-10-19T12:44:13.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:44:12 smithi195 ceph-mon[134493]: scrub summary: idle+waiting paths [/] 2023-10-19T12:44:13.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:44:12 smithi195 ceph-mon[134493]: scrub summary: active paths [/] 2023-10-19T12:44:13.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:44:12 smithi195 ceph-mon[134493]: scrub summary: active paths [/] 2023-10-19T12:44:13.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:44:12 smithi195 ceph-mon[134493]: scrub summary: idle+waiting paths [/] 2023-10-19T12:44:13.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:44:12 smithi195 ceph-mon[134493]: scrub summary: idle+waiting paths [/] 2023-10-19T12:44:14.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:44:13 smithi157 ceph-mon[134109]: scrub summary: active paths [/] 2023-10-19T12:44:14.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:44:13 smithi157 ceph-mon[134109]: scrub summary: active paths [/] 2023-10-19T12:44:14.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:44:13 smithi157 ceph-mon[134109]: scrub summary: idle+waiting paths [/] 2023-10-19T12:44:14.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:44:13 smithi157 ceph-mon[134109]: scrub summary: idle+waiting paths [/] 2023-10-19T12:44:14.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:44:13 smithi157 ceph-mon[134109]: pgmap v375: 129 pgs: 129 active+clean; 1.0 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 52 MiB/s wr, 365 op/s 2023-10-19T12:44:14.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:44:13 smithi195 ceph-mon[134493]: scrub summary: active paths [/] 2023-10-19T12:44:14.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:44:13 smithi195 ceph-mon[134493]: scrub summary: active paths [/] 2023-10-19T12:44:14.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:44:13 smithi195 ceph-mon[134493]: scrub summary: idle+waiting paths [/] 2023-10-19T12:44:14.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:44:13 smithi195 ceph-mon[134493]: scrub summary: idle+waiting paths [/] 2023-10-19T12:44:14.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:44:13 smithi195 ceph-mon[134493]: pgmap v375: 129 pgs: 129 active+clean; 1.0 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 52 MiB/s wr, 365 op/s 2023-10-19T12:44:14.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:44:13 smithi046 ceph-mon[98509]: scrub summary: active paths [/] 2023-10-19T12:44:14.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:44:13 smithi046 ceph-mon[98509]: scrub summary: active paths [/] 2023-10-19T12:44:14.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:44:13 smithi046 ceph-mon[98509]: scrub summary: idle+waiting paths [/] 2023-10-19T12:44:14.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:44:13 smithi046 ceph-mon[98509]: scrub summary: idle+waiting paths [/] 2023-10-19T12:44:14.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:44:13 smithi046 ceph-mon[98509]: pgmap v375: 129 pgs: 129 active+clean; 1.0 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 52 MiB/s wr, 365 op/s 2023-10-19T12:44:16.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:44:15 smithi157 ceph-mon[134109]: pgmap v376: 129 pgs: 129 active+clean; 1.0 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 43 MiB/s wr, 398 op/s 2023-10-19T12:44:16.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:44:15 smithi195 ceph-mon[134493]: pgmap v376: 129 pgs: 129 active+clean; 1.0 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 43 MiB/s wr, 398 op/s 2023-10-19T12:44:16.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:44:15 smithi046 ceph-mon[98509]: pgmap v376: 129 pgs: 129 active+clean; 1.0 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 43 MiB/s wr, 398 op/s 2023-10-19T12:44:16.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 15.0 s, 1242.2 tps, lat 81.322 ms stddev 157.581 2023-10-19T12:44:18.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:44:17 smithi157 ceph-mon[134109]: pgmap v377: 129 pgs: 129 active+clean; 1.1 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 52 MiB/s wr, 649 op/s 2023-10-19T12:44:18.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:44:17 smithi195 ceph-mon[134493]: pgmap v377: 129 pgs: 129 active+clean; 1.1 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 52 MiB/s wr, 649 op/s 2023-10-19T12:44:18.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:44:17 smithi046 ceph-mon[98509]: pgmap v377: 129 pgs: 129 active+clean; 1.1 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 52 MiB/s wr, 649 op/s 2023-10-19T12:44:19.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:44:19 smithi157 ceph-mon[134109]: pgmap v378: 129 pgs: 129 active+clean; 1.1 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 48 MiB/s wr, 774 op/s 2023-10-19T12:44:19.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:44:19 smithi195 ceph-mon[134493]: pgmap v378: 129 pgs: 129 active+clean; 1.1 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 48 MiB/s wr, 774 op/s 2023-10-19T12:44:19.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:44:19 smithi046 ceph-mon[98509]: pgmap v378: 129 pgs: 129 active+clean; 1.1 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 48 MiB/s wr, 774 op/s 2023-10-19T12:44:21.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 20.0 s, 1795.4 tps, lat 55.173 ms stddev 77.766 2023-10-19T12:44:22.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:44:21 smithi157 ceph-mon[134109]: pgmap v379: 129 pgs: 129 active+clean; 1.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 59 MiB/s wr, 964 op/s 2023-10-19T12:44:22.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:44:21 smithi195 ceph-mon[134493]: pgmap v379: 129 pgs: 129 active+clean; 1.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 59 MiB/s wr, 964 op/s 2023-10-19T12:44:22.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:44:21 smithi046 ceph-mon[98509]: pgmap v379: 129 pgs: 129 active+clean; 1.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 59 MiB/s wr, 964 op/s 2023-10-19T12:44:24.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:44:23 smithi157 ceph-mon[134109]: pgmap v380: 129 pgs: 129 active+clean; 1.1 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 60 MiB/s wr, 1.01k op/s 2023-10-19T12:44:24.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:44:23 smithi195 ceph-mon[134493]: pgmap v380: 129 pgs: 129 active+clean; 1.1 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 60 MiB/s wr, 1.01k op/s 2023-10-19T12:44:24.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:44:23 smithi046 ceph-mon[98509]: pgmap v380: 129 pgs: 129 active+clean; 1.1 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 60 MiB/s wr, 1.01k op/s 2023-10-19T12:44:25.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:44:25 smithi157 ceph-mon[134109]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-19T12:44:25.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:44:25 smithi157 ceph-mon[134109]: pgmap v381: 129 pgs: 129 active+clean; 1.2 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 55 MiB/s wr, 997 op/s 2023-10-19T12:44:25.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:44:25 smithi195 ceph-mon[134493]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-19T12:44:25.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:44:25 smithi195 ceph-mon[134493]: pgmap v381: 129 pgs: 129 active+clean; 1.2 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 55 MiB/s wr, 997 op/s 2023-10-19T12:44:25.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:44:25 smithi046 ceph-mon[98509]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-19T12:44:25.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:44:25 smithi046 ceph-mon[98509]: pgmap v381: 129 pgs: 129 active+clean; 1.2 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 55 MiB/s wr, 997 op/s 2023-10-19T12:44:26.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 25.0 s, 1914.0 tps, lat 52.853 ms stddev 70.739 2023-10-19T12:44:28.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:44:27 smithi157 ceph-mon[134109]: pgmap v382: 129 pgs: 129 active+clean; 1.2 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 59 MiB/s wr, 1.20k op/s 2023-10-19T12:44:28.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:44:27 smithi195 ceph-mon[134493]: pgmap v382: 129 pgs: 129 active+clean; 1.2 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 59 MiB/s wr, 1.20k op/s 2023-10-19T12:44:28.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:44:27 smithi046 ceph-mon[98509]: pgmap v382: 129 pgs: 129 active+clean; 1.2 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 59 MiB/s wr, 1.20k op/s 2023-10-19T12:44:29.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:44:29 smithi195 ceph-mon[134493]: pgmap v383: 129 pgs: 129 active+clean; 1.2 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 49 MiB/s wr, 1.07k op/s 2023-10-19T12:44:29.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:44:29 smithi046 ceph-mon[98509]: pgmap v383: 129 pgs: 129 active+clean; 1.2 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 49 MiB/s wr, 1.07k op/s 2023-10-19T12:44:29.837 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:44:29 smithi157 ceph-mon[134109]: pgmap v383: 129 pgs: 129 active+clean; 1.2 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 49 MiB/s wr, 1.07k op/s 2023-10-19T12:44:30.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:44:30 smithi195 ceph-mon[134493]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-19T12:44:30.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:44:30 smithi046 ceph-mon[98509]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-19T12:44:30.838 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:44:30 smithi157 ceph-mon[134109]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-19T12:44:31.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:44:31 smithi195 ceph-mon[134493]: pgmap v384: 129 pgs: 129 active+clean; 1.2 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 40 MiB/s wr, 990 op/s 2023-10-19T12:44:31.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 30.0 s, 1864.6 tps, lat 52.947 ms stddev 68.211 2023-10-19T12:44:31.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:44:31 smithi046 ceph-mon[98509]: pgmap v384: 129 pgs: 129 active+clean; 1.2 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 40 MiB/s wr, 990 op/s 2023-10-19T12:44:31.837 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:44:31 smithi157 ceph-mon[134109]: pgmap v384: 129 pgs: 129 active+clean; 1.2 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 40 MiB/s wr, 990 op/s 2023-10-19T12:44:34.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:44:33 smithi157 ceph-mon[134109]: pgmap v385: 129 pgs: 129 active+clean; 1.2 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 27 MiB/s wr, 882 op/s 2023-10-19T12:44:34.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:44:33 smithi195 ceph-mon[134493]: pgmap v385: 129 pgs: 129 active+clean; 1.2 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 27 MiB/s wr, 882 op/s 2023-10-19T12:44:34.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:44:33 smithi046 ceph-mon[98509]: pgmap v385: 129 pgs: 129 active+clean; 1.2 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 27 MiB/s wr, 882 op/s 2023-10-19T12:44:36.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:44:35 smithi157 ceph-mon[134109]: pgmap v386: 129 pgs: 129 active+clean; 1.2 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 23 MiB/s wr, 801 op/s 2023-10-19T12:44:36.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:44:35 smithi195 ceph-mon[134493]: pgmap v386: 129 pgs: 129 active+clean; 1.2 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 23 MiB/s wr, 801 op/s 2023-10-19T12:44:36.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:44:35 smithi046 ceph-mon[98509]: pgmap v386: 129 pgs: 129 active+clean; 1.2 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 23 MiB/s wr, 801 op/s 2023-10-19T12:44:36.702 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 35.0 s, 1995.4 tps, lat 50.776 ms stddev 73.392 2023-10-19T12:44:38.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:44:37 smithi157 ceph-mon[134109]: pgmap v387: 129 pgs: 129 active+clean; 1.3 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 26 MiB/s wr, 879 op/s 2023-10-19T12:44:38.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:44:37 smithi195 ceph-mon[134493]: pgmap v387: 129 pgs: 129 active+clean; 1.3 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 26 MiB/s wr, 879 op/s 2023-10-19T12:44:38.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:44:37 smithi046 ceph-mon[98509]: pgmap v387: 129 pgs: 129 active+clean; 1.3 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 26 MiB/s wr, 879 op/s 2023-10-19T12:44:39.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:44:39 smithi195 ceph-mon[134493]: pgmap v388: 129 pgs: 129 active+clean; 1.3 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 MiB/s wr, 771 op/s 2023-10-19T12:44:39.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:44:39 smithi046 ceph-mon[98509]: pgmap v388: 129 pgs: 129 active+clean; 1.3 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 MiB/s wr, 771 op/s 2023-10-19T12:44:39.837 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:44:39 smithi157 ceph-mon[134109]: pgmap v388: 129 pgs: 129 active+clean; 1.3 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 MiB/s wr, 771 op/s 2023-10-19T12:44:41.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 40.0 s, 2220.8 tps, lat 45.354 ms stddev 58.494 2023-10-19T12:44:42.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:44:41 smithi157 ceph-mon[134109]: pgmap v389: 129 pgs: 129 active+clean; 1.3 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 MiB/s wr, 747 op/s 2023-10-19T12:44:42.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:44:41 smithi195 ceph-mon[134493]: pgmap v389: 129 pgs: 129 active+clean; 1.3 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 MiB/s wr, 747 op/s 2023-10-19T12:44:42.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:44:41 smithi046 ceph-mon[98509]: pgmap v389: 129 pgs: 129 active+clean; 1.3 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 MiB/s wr, 747 op/s 2023-10-19T12:44:42.579 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-19T12:44:42.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:42.977+0000 7f37a6dff700 1 -- 172.21.15.46:0/3902189699 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f37a01029d0 msgr2=0x7f37a0102df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:44:42.985 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:42.977+0000 7f37a6dff700 1 --2- 172.21.15.46:0/3902189699 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f37a01029d0 0x7f37a0102df0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f37940099c0 tx=0x7f3794009cd0 comp rx=0 tx=0).stop 2023-10-19T12:44:42.985 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:42.978+0000 7f37a6dff700 1 -- 172.21.15.46:0/3902189699 shutdown_connections 2023-10-19T12:44:42.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:42.978+0000 7f37a6dff700 1 --2- 172.21.15.46:0/3902189699 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37a0104560 0x7f37a010ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:42.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:42.978+0000 7f37a6dff700 1 --2- 172.21.15.46:0/3902189699 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f37a01029d0 0x7f37a0102df0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:42.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:42.978+0000 7f37a6dff700 1 --2- 172.21.15.46:0/3902189699 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37a0103bc0 0x7f37a0104020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:42.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:42.978+0000 7f37a6dff700 1 -- 172.21.15.46:0/3902189699 >> 172.21.15.46:0/3902189699 conn(0x7f37a00fdf40 msgr2=0x7f37a0100380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:44:42.987 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:42.979+0000 7f37a6dff700 1 -- 172.21.15.46:0/3902189699 shutdown_connections 2023-10-19T12:44:42.988 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:42.979+0000 7f37a6dff700 1 -- 172.21.15.46:0/3902189699 wait complete. 2023-10-19T12:44:42.988 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:42.980+0000 7f37a6dff700 1 Processor -- start 2023-10-19T12:44:42.988 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:42.980+0000 7f37a6dff700 1 -- start start 2023-10-19T12:44:42.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:42.981+0000 7f37a6dff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37a01029d0 0x7f37a01989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:42.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:42.981+0000 7f37a6dff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f37a0103bc0 0x7f37a0198f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:42.990 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:42.981+0000 7f37a6dff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37a0104560 0x7f37a019ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:42.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:42.981+0000 7f37a6dff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37a01a0500 con 0x7f37a01029d0 2023-10-19T12:44:42.992 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:42.981+0000 7f37a6dff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37a01a0640 con 0x7f37a0103bc0 2023-10-19T12:44:42.992 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:42.981+0000 7f37a6dff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37a01a07d0 con 0x7f37a0104560 2023-10-19T12:44:42.992 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:42.981+0000 7f379ffff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f37a0103bc0 0x7f37a0198f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:42.993 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:42.981+0000 7f379ffff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f37a0103bc0 0x7f37a0198f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:50774/0 (socket says 172.21.15.46:50774) 2023-10-19T12:44:42.993 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:42.981+0000 7f379ffff700 1 -- 172.21.15.46:0/3675999939 learned_addr learned my addr 172.21.15.46:0/3675999939 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:44:42.993 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:42.982+0000 7f37a539c700 1 --2- 172.21.15.46:0/3675999939 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37a0104560 0x7f37a019ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:42.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:42.982+0000 7f37a539c700 1 -- 172.21.15.46:0/3675999939 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f37a0103bc0 msgr2=0x7f37a0198f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:44:42.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:42.982+0000 7f37a539c700 1 --2- 172.21.15.46:0/3675999939 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f37a0103bc0 0x7f37a0198f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:42.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:42.982+0000 7f37a539c700 1 -- 172.21.15.46:0/3675999939 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37a01029d0 msgr2=0x7f37a01989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:44:42.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:42.982+0000 7f37a539c700 1 --2- 172.21.15.46:0/3675999939 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37a01029d0 0x7f37a01989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:42.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:42.982+0000 7f37a539c700 1 -- 172.21.15.46:0/3675999939 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3798009c40 con 0x7f37a0104560 2023-10-19T12:44:42.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:42.983+0000 7f37a539c700 1 --2- 172.21.15.46:0/3675999939 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37a0104560 0x7f37a019ff30 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f379800efb0 tx=0x7f379800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:44:42.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:42.983+0000 7f379dffb700 1 -- 172.21.15.46:0/3675999939 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f379800ca50 con 0x7f37a0104560 2023-10-19T12:44:42.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:42.983+0000 7f379dffb700 1 -- 172.21.15.46:0/3675999939 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f379800f040 con 0x7f37a0104560 2023-10-19T12:44:42.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:42.983+0000 7f379dffb700 1 -- 172.21.15.46:0/3675999939 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3798004620 con 0x7f37a0104560 2023-10-19T12:44:42.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:42.983+0000 7f37a6dff700 1 -- 172.21.15.46:0/3675999939 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37940095f0 con 0x7f37a0104560 2023-10-19T12:44:42.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:42.984+0000 7f37a6dff700 1 -- 172.21.15.46:0/3675999939 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37a01a0de0 con 0x7f37a0104560 2023-10-19T12:44:43.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:42.997+0000 7f379dffb700 1 -- 172.21.15.46:0/3675999939 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f37980047a0 con 0x7f37a0104560 2023-10-19T12:44:43.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:42.998+0000 7f37ba7a7b80 1 Processor -- start 2023-10-19T12:44:43.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:42.999+0000 7f37ba7a7b80 1 -- start start 2023-10-19T12:44:43.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:42.999+0000 7f37ba7a7b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a42c063ae0 0x55a42c063f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:43.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:42.999+0000 7f37ba7a7b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a42c064440 0x55a42c0628a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:43.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:42.999+0000 7f37ba7a7b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a42c062de0 0x55a42c063260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:43.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:42.999+0000 7f37ba7a7b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a42bfcd6e0 con 0x55a42c062de0 2023-10-19T12:44:43.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:42.999+0000 7f37ba7a7b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a42bfb3c60 con 0x55a42c063ae0 2023-10-19T12:44:43.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:42.999+0000 7f37ba7a7b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a42bfb1580 con 0x55a42c064440 2023-10-19T12:44:43.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.000+0000 7f379ffff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a42c063ae0 0x55a42c063f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:43.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.000+0000 7f37a4b9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a42c064440 0x55a42c0628a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:43.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.000+0000 7f379ffff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a42c063ae0 0x55a42c063f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:50790/0 (socket says 172.21.15.46:50790) 2023-10-19T12:44:43.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.000+0000 7f379ffff700 1 -- 172.21.15.46:0/371833830 learned_addr learned my addr 172.21.15.46:0/371833830 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:44:43.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.000+0000 7f379ffff700 1 --2- 172.21.15.46:0/371833830 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a42c062de0 0x55a42c063260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:43.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.000+0000 7f379ffff700 1 -- 172.21.15.46:0/371833830 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a42c064440 msgr2=0x55a42c0628a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:44:43.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.000+0000 7f379ffff700 1 --2- 172.21.15.46:0/371833830 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a42c064440 0x55a42c0628a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:43.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.000+0000 7f379ffff700 1 -- 172.21.15.46:0/371833830 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a42c062de0 msgr2=0x55a42c063260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:44:43.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.000+0000 7f379ffff700 1 --2- 172.21.15.46:0/371833830 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a42c062de0 0x55a42c063260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:43.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.001+0000 7f379ffff700 1 -- 172.21.15.46:0/371833830 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a42bf6a3f0 con 0x55a42c063ae0 2023-10-19T12:44:43.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.001+0000 7f379ffff700 1 --2- 172.21.15.46:0/371833830 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a42c063ae0 0x55a42c063f00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f378c015840 tx=0x7f378c009670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed350d81b742f162 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:44:43.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.001+0000 7f379dffb700 1 --2- 172.21.15.46:0/3675999939 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f37900a1650 0x7f37900a3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:43.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.002+0000 7f379dffb700 1 -- 172.21.15.46:0/3675999939 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f37980ccd40 con 0x7f37a0104560 2023-10-19T12:44:43.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.002+0000 7f37a4b9b700 1 --2- 172.21.15.46:0/3675999939 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f37900a1650 0x7f37900a3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:43.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.003+0000 7f378affd700 1 -- 172.21.15.46:0/371833830 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f378c015e60 con 0x55a42c063ae0 2023-10-19T12:44:43.013 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.004+0000 7f378affd700 1 -- 172.21.15.46:0/371833830 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f378c017b10 con 0x55a42c063ae0 2023-10-19T12:44:43.013 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.004+0000 7f378affd700 1 -- 172.21.15.46:0/371833830 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f378c0189d0 con 0x55a42c063ae0 2023-10-19T12:44:43.013 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.006+0000 7f37ba7a7b80 1 -- 172.21.15.46:0/371833830 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a42c063ae0 msgr2=0x55a42c063f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:44:43.014 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.006+0000 7f37a4b9b700 1 --2- 172.21.15.46:0/3675999939 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f37900a1650 0x7f37900a3b10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f3794009fd0 tx=0x7f37940058e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:44:43.014 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.006+0000 7f37ba7a7b80 1 --2- 172.21.15.46:0/371833830 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a42c063ae0 0x55a42c063f00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f378c015840 tx=0x7f378c009670 comp rx=0 tx=0).stop 2023-10-19T12:44:43.015 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.010+0000 7f37ba7a7b80 1 -- 172.21.15.46:0/371833830 shutdown_connections 2023-10-19T12:44:43.015 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.010+0000 7f37ba7a7b80 1 --2- 172.21.15.46:0/371833830 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a42c062de0 0x55a42c063260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:43.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.010+0000 7f37ba7a7b80 1 --2- 172.21.15.46:0/371833830 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a42c063ae0 0x55a42c063f00 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:43.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.010+0000 7f37ba7a7b80 1 --2- 172.21.15.46:0/371833830 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a42c064440 0x55a42c0628a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:43.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.010+0000 7f37ba7a7b80 1 -- 172.21.15.46:0/371833830 >> 172.21.15.46:0/371833830 conn(0x55a42bfce720 msgr2=0x55a42c054b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:44:43.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.011+0000 7f37ba7a7b80 1 -- 172.21.15.46:0/371833830 shutdown_connections 2023-10-19T12:44:43.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.012+0000 7f37ba7a7b80 1 -- 172.21.15.46:0/371833830 wait complete. 2023-10-19T12:44:43.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.012+0000 7f37ba7a7b80 1 -- start start 2023-10-19T12:44:43.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.013+0000 7f37ba7a7b80 1 Processor -- start 2023-10-19T12:44:43.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.014+0000 7f37ba7a7b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a42c062de0 0x55a42c06c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:43.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.014+0000 7f37ba7a7b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a42c063ae0 0x55a42c06c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:43.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.014+0000 7f37ba7a7b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a42c064440 0x55a42c0736f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:43.022 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.015+0000 7f37a4b9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a42c062de0 0x55a42c06c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:43.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.015+0000 7f37ba7a7b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a42bface70 con 0x55a42c063ae0 2023-10-19T12:44:43.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.015+0000 7f37ba7a7b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a42bf49710 con 0x55a42c064440 2023-10-19T12:44:43.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.015+0000 7f37a4b9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a42c062de0 0x55a42c06c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:34868/0 (socket says 172.21.15.46:34868) 2023-10-19T12:44:43.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.015+0000 7f37a4b9b700 1 -- 172.21.15.46:0/2929403911 learned_addr learned my addr 172.21.15.46:0/2929403911 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:44:43.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.015+0000 7f37ba7a7b80 1 -- 172.21.15.46:0/2929403911 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a42bf493b0 con 0x55a42c062de0 2023-10-19T12:44:43.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.015+0000 7f379ffff700 1 --2- 172.21.15.46:0/2929403911 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a42c063ae0 0x55a42c06c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:43.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.015+0000 7f37ba7a7b80 10 client.0 _ll_register_callbacks cb 0x55a42be93a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:44:43.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.016+0000 7f37a539c700 1 --2- 172.21.15.46:0/2929403911 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a42c064440 0x55a42c0736f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:43.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.017+0000 7f379ffff700 1 -- 172.21.15.46:0/2929403911 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a42c062de0 msgr2=0x55a42c06c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:44:43.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.017+0000 7f379ffff700 1 --2- 172.21.15.46:0/2929403911 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a42c062de0 0x55a42c06c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:43.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.017+0000 7f379ffff700 1 -- 172.21.15.46:0/2929403911 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a42c064440 msgr2=0x55a42c0736f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:44:43.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.017+0000 7f379ffff700 1 --2- 172.21.15.46:0/2929403911 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a42c064440 0x55a42c0736f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:43.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.017+0000 7f379ffff700 1 -- 172.21.15.46:0/2929403911 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f378c0154f0 con 0x55a42c063ae0 2023-10-19T12:44:43.028 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.017+0000 7f37a539c700 1 --2- 172.21.15.46:0/2929403911 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a42c064440 0x55a42c0736f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T12:44:43.028 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.018+0000 7f377ffff700 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2023-10-19T12:44:43.028 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.018+0000 7f379ffff700 1 --2- 172.21.15.46:0/2929403911 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a42c063ae0 0x55a42c06c6b0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f378c015810 tx=0x7f378c017880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4811d658f5d8d140 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:44:43.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.018+0000 7f377ffff700 1 -- 172.21.15.46:0/2929403911 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f378c015e60 con 0x55a42c063ae0 2023-10-19T12:44:43.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.018+0000 7f37ba7a7b80 1 -- 172.21.15.46:0/2929403911 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a42bfb1ef0 con 0x55a42c063ae0 2023-10-19T12:44:43.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.019+0000 7f377ffff700 1 -- 172.21.15.46:0/2929403911 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f378c018b60 con 0x55a42c063ae0 2023-10-19T12:44:43.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.019+0000 7f377ffff700 1 -- 172.21.15.46:0/2929403911 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f378c015e60 con 0x55a42c063ae0 2023-10-19T12:44:43.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.019+0000 7f37ba7a7b80 10 client.15792 fetch_fsmap learned FSMap version 31 2023-10-19T12:44:43.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.019+0000 7f37ba7a7b80 1 -- 172.21.15.46:0/2929403911 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55a42bdd7de0 con 0x55a42c063ae0 2023-10-19T12:44:43.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.019+0000 7f377ffff700 1 -- 172.21.15.46:0/2929403911 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f378c030070 con 0x55a42c063ae0 2023-10-19T12:44:43.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.019+0000 7f377ffff700 1 -- 172.21.15.46:0/2929403911 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 31) v1 ==== 7922+0+0 (secure 0 0 0) 0x7f378c021bd0 con 0x55a42c063ae0 2023-10-19T12:44:43.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.019+0000 7f37ba7a7b80 10 client.15792 fetch_fsmap finished waiting for FSMap version 31 2023-10-19T12:44:43.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.019+0000 7f37ba7a7b80 10 client.15792 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-19T12:44:43.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.019+0000 7f37ba7a7b80 20 client.15792 populate_metadata read hostname 'smithi046' 2023-10-19T12:44:43.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.020+0000 7f37ba7a7b80 1 --2- 172.21.15.46:0/2929403911 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x55a42c077ef0 0x55a42c07a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:43.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.020+0000 7f37ba7a7b80 4 client.15792 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-19T12:44:43.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.020+0000 7f37ba7a7b80 1 -- 172.21.15.46:0/2929403911 --> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a42c0298b0 con 0x55a42c077ef0 2023-10-19T12:44:43.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.021+0000 7f37a4b9b700 1 --2- 172.21.15.46:0/2929403911 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x55a42c077ef0 0x55a42c07a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:43.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.022+0000 7f377ffff700 10 client.15792 ms_handle_connect on v2:172.21.15.157:6838/552718978 2023-10-19T12:44:43.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.022+0000 7f37a4b9b700 1 --2- 172.21.15.46:0/2929403911 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x55a42c077ef0 0x55a42c07a310 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f976c9b7e5a4fb0 server_cookie=18a6a33f65b509cb in_seq=0 out_seq=0 2023-10-19T12:44:43.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.023+0000 7f377ffff700 1 -- 172.21.15.46:0/2929403911 <== mds.0 v2:172.21.15.157:6838/552718978 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a42c0298b0 con 0x55a42c077ef0 2023-10-19T12:44:43.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.023+0000 7f377ffff700 10 client.15792 handle_command_reply: tid=0 2023-10-19T12:44:43.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.023+0000 7f37ba7a7b80 1 client.15792 shutdown 2023-10-19T12:44:43.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.024+0000 7f37ba7a7b80 1 -- 172.21.15.46:0/2929403911 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a42c063ae0 msgr2=0x55a42c06c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:44:43.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.024+0000 7f37ba7a7b80 1 --2- 172.21.15.46:0/2929403911 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a42c063ae0 0x55a42c06c6b0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f378c015810 tx=0x7f378c017880 comp rx=0 tx=0).stop 2023-10-19T12:44:43.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.024+0000 7f37ba7a7b80 1 -- 172.21.15.46:0/2929403911 shutdown_connections 2023-10-19T12:44:43.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.024+0000 7f37ba7a7b80 1 --2- 172.21.15.46:0/2929403911 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a42c064440 0x55a42c0736f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:43.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.024+0000 7f37ba7a7b80 1 --2- 172.21.15.46:0/2929403911 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a42c062de0 0x55a42c06c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:43.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.024+0000 7f37ba7a7b80 1 --2- 172.21.15.46:0/2929403911 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x55a42c077ef0 0x55a42c07a310 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:43.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.024+0000 7f37ba7a7b80 1 --2- 172.21.15.46:0/2929403911 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a42c063ae0 0x55a42c06c6b0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:43.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.024+0000 7f37ba7a7b80 1 -- 172.21.15.46:0/2929403911 >> 172.21.15.46:0/2929403911 conn(0x55a42bfce720 msgr2=0x55a42c054b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:44:43.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.024+0000 7f377ffff700 0 client.15792 ms_handle_reset on v2:172.21.15.157:6838/552718978 2023-10-19T12:44:43.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.025+0000 7f37ba7a7b80 1 -- 172.21.15.46:0/2929403911 shutdown_connections 2023-10-19T12:44:43.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.025+0000 7f37ba7a7b80 1 -- 172.21.15.46:0/2929403911 wait complete. 2023-10-19T12:44:43.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.026+0000 7f37ba7a7b80 20 client.15792 trim_cache size 0 max 16384 2023-10-19T12:44:43.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.064+0000 7f37ba7a7b80 1 Processor -- start 2023-10-19T12:44:43.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.065+0000 7f37ba7a7b80 1 -- start start 2023-10-19T12:44:43.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.066+0000 7f37ba7a7b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a42c062de0 0x55a42c0628a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:43.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.066+0000 7f37ba7a7b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a42c064440 0x55a42c0736b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:43.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.066+0000 7f37ba7a7b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a42c055bf0 0x55a42c06c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:43.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.066+0000 7f37ba7a7b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a42be2d920 con 0x55a42c055bf0 2023-10-19T12:44:43.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.066+0000 7f37ba7a7b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a42c055670 con 0x55a42c064440 2023-10-19T12:44:43.070 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.066+0000 7f37ba7a7b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a42c0550a0 con 0x55a42c062de0 2023-10-19T12:44:43.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.067+0000 7f37a4b9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a42c062de0 0x55a42c0628a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:43.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.067+0000 7f379ffff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a42c064440 0x55a42c0736b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:43.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.067+0000 7f379ffff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a42c064440 0x55a42c0736b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:50812/0 (socket says 172.21.15.46:50812) 2023-10-19T12:44:43.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.067+0000 7f379ffff700 1 -- 172.21.15.46:0/2010829543 learned_addr learned my addr 172.21.15.46:0/2010829543 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:44:43.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.067+0000 7f37a4b9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a42c062de0 0x55a42c0628a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:34874/0 (socket says 172.21.15.46:34874) 2023-10-19T12:44:43.072 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.068+0000 7f37a4b9b700 1 -- 172.21.15.46:0/2010829543 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a42c064440 msgr2=0x55a42c0736b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:44:43.073 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.068+0000 7f37a4b9b700 1 --2- 172.21.15.46:0/2010829543 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a42c064440 0x55a42c0736b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:43.073 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.068+0000 7f37a4b9b700 1 -- 172.21.15.46:0/2010829543 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a42c055bf0 msgr2=0x55a42c06c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:44:43.073 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.068+0000 7f37a4b9b700 1 --2- 172.21.15.46:0/2010829543 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a42c055bf0 0x55a42c06c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:43.073 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.068+0000 7f37a4b9b700 1 -- 172.21.15.46:0/2010829543 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a42bdc0c60 con 0x55a42c062de0 2023-10-19T12:44:43.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.068+0000 7f379ffff700 1 --2- 172.21.15.46:0/2010829543 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a42c064440 0x55a42c0736b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:44:43.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.068+0000 7f37a4b9b700 1 --2- 172.21.15.46:0/2010829543 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a42c062de0 0x55a42c0628a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x55a42c07abb0 tx=0x7f3794020000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a408e504f7c677e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:44:43.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.069+0000 7f378b7fe700 1 -- 172.21.15.46:0/2010829543 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3794032a10 con 0x55a42c062de0 2023-10-19T12:44:43.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.069+0000 7f378b7fe700 1 -- 172.21.15.46:0/2010829543 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f379401e040 con 0x55a42c062de0 2023-10-19T12:44:43.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.069+0000 7f378b7fe700 1 -- 172.21.15.46:0/2010829543 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3794003b10 con 0x55a42c062de0 2023-10-19T12:44:43.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.071+0000 7f37ba7a7b80 1 -- 172.21.15.46:0/2010829543 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a42c062de0 msgr2=0x55a42c0628a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:44:43.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.071+0000 7f37ba7a7b80 1 --2- 172.21.15.46:0/2010829543 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a42c062de0 0x55a42c0628a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x55a42c07abb0 tx=0x7f3794020000 comp rx=0 tx=0).stop 2023-10-19T12:44:43.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.073+0000 7f37ba7a7b80 1 -- 172.21.15.46:0/2010829543 shutdown_connections 2023-10-19T12:44:43.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.073+0000 7f37ba7a7b80 1 --2- 172.21.15.46:0/2010829543 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a42c055bf0 0x55a42c06c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:43.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.073+0000 7f37ba7a7b80 1 --2- 172.21.15.46:0/2010829543 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a42c062de0 0x55a42c0628a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:43.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.073+0000 7f37ba7a7b80 1 --2- 172.21.15.46:0/2010829543 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a42c064440 0x55a42c0736b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:43.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.073+0000 7f37ba7a7b80 1 -- 172.21.15.46:0/2010829543 >> 172.21.15.46:0/2010829543 conn(0x55a42bfce720 msgr2=0x55a42c06a180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:44:43.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.074+0000 7f37ba7a7b80 1 -- 172.21.15.46:0/2010829543 shutdown_connections 2023-10-19T12:44:43.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.075+0000 7f37ba7a7b80 1 -- 172.21.15.46:0/2010829543 wait complete. 2023-10-19T12:44:43.080 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.077+0000 7f37ba7a7b80 1 -- start start 2023-10-19T12:44:43.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.078+0000 7f37ba7a7b80 1 Processor -- start 2023-10-19T12:44:43.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.079+0000 7f37ba7a7b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a42c055bf0 0x55a42c073680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:43.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.079+0000 7f37ba7a7b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a42c062de0 0x55a42c070120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:43.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.080+0000 7f37ba7a7b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a42c064440 0x55a42c070660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:43.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.080+0000 7f37ba7a7b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a42c070d50 con 0x55a42c064440 2023-10-19T12:44:43.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.080+0000 7f37ba7a7b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a42c0cbcd0 con 0x55a42c062de0 2023-10-19T12:44:43.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.080+0000 7f37ba7a7b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a42c0cbe90 con 0x55a42c055bf0 2023-10-19T12:44:43.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.080+0000 7f37ba7a7b80 10 client.0 _ll_register_callbacks cb 0x55a42be93a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:44:43.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.080+0000 7f37a4b9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a42c055bf0 0x55a42c073680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:43.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.081+0000 7f37a4b9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a42c055bf0 0x55a42c073680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:34882/0 (socket says 172.21.15.46:34882) 2023-10-19T12:44:43.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.081+0000 7f37a4b9b700 1 -- 172.21.15.46:0/3115978275 learned_addr learned my addr 172.21.15.46:0/3115978275 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:44:43.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.081+0000 7f379ffff700 1 --2- 172.21.15.46:0/3115978275 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a42c062de0 0x55a42c070120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:43.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.082+0000 7f37a4b9b700 1 -- 172.21.15.46:0/3115978275 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a42c062de0 msgr2=0x55a42c070120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:44:43.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.082+0000 7f37a4b9b700 1 --2- 172.21.15.46:0/3115978275 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a42c062de0 0x55a42c070120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:43.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.082+0000 7f37a4b9b700 1 -- 172.21.15.46:0/3115978275 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a42c064440 msgr2=0x55a42c070660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:44:43.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.082+0000 7f37a4b9b700 1 --2- 172.21.15.46:0/3115978275 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a42c064440 0x55a42c070660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:43.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.082+0000 7f37a4b9b700 1 -- 172.21.15.46:0/3115978275 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a42bdd7de0 con 0x55a42c055bf0 2023-10-19T12:44:43.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.083+0000 7f377ffff700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-10-19T12:44:43.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.083+0000 7f37a4b9b700 1 --2- 172.21.15.46:0/3115978275 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a42c055bf0 0x55a42c073680 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3794035000 tx=0x7f3794005ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67490e85bd8e3547 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:44:43.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.084+0000 7f377ffff700 1 -- 172.21.15.46:0/3115978275 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3794027070 con 0x55a42c055bf0 2023-10-19T12:44:43.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.084+0000 7f377ffff700 1 -- 172.21.15.46:0/3115978275 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f37940324c0 con 0x55a42c055bf0 2023-10-19T12:44:43.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.084+0000 7f37ba7a7b80 1 -- 172.21.15.46:0/3115978275 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f378c017b10 con 0x55a42c055bf0 2023-10-19T12:44:43.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.085+0000 7f377ffff700 1 -- 172.21.15.46:0/3115978275 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3794003890 con 0x55a42c055bf0 2023-10-19T12:44:43.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.085+0000 7f37ba7a7b80 10 client.25858 fetch_fsmap learned FSMap version 31 2023-10-19T12:44:43.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.085+0000 7f37ba7a7b80 1 -- 172.21.15.46:0/3115978275 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x7f37a010b760 con 0x55a42c055bf0 2023-10-19T12:44:43.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.085+0000 7f377ffff700 1 -- 172.21.15.46:0/3115978275 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f378c017b10 con 0x55a42c055bf0 2023-10-19T12:44:43.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.086+0000 7f377ffff700 1 -- 172.21.15.46:0/3115978275 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 31) v1 ==== 7922+0+0 (secure 0 0 0) 0x7f3794043070 con 0x55a42c055bf0 2023-10-19T12:44:43.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.086+0000 7f37ba7a7b80 10 client.25858 fetch_fsmap finished waiting for FSMap version 31 2023-10-19T12:44:43.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.086+0000 7f37ba7a7b80 10 client.25858 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-19T12:44:43.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.086+0000 7f37ba7a7b80 20 client.25858 populate_metadata read hostname 'smithi046' 2023-10-19T12:44:43.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.087+0000 7f37ba7a7b80 1 --2- 172.21.15.46:0/3115978275 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x55a42c0cd440 0x55a42c0cf830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:44:43.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.087+0000 7f37ba7a7b80 4 client.25858 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-19T12:44:43.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.087+0000 7f37ba7a7b80 1 -- 172.21.15.46:0/3115978275 --> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55a42bfa5e50 con 0x55a42c0cd440 2023-10-19T12:44:43.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.087+0000 7f379ffff700 1 --2- 172.21.15.46:0/3115978275 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x55a42c0cd440 0x55a42c0cf830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:44:43.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.091+0000 7f379ffff700 1 --2- 172.21.15.46:0/3115978275 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x55a42c0cd440 0x55a42c0cf830 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e5bb74ab550caa9 server_cookie=e04fbb3023d96419 in_seq=0 out_seq=0 2023-10-19T12:44:43.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.091+0000 7f377ffff700 10 client.25858 ms_handle_connect on v2:172.21.15.157:6838/552718978 2023-10-19T12:44:43.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.091+0000 7f377ffff700 1 -- 172.21.15.46:0/3115978275 <== mds.0 v2:172.21.15.157:6838/552718978 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55a42bfa5e50 con 0x55a42c0cd440 2023-10-19T12:44:43.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.091+0000 7f377ffff700 10 client.25858 handle_command_reply: tid=0 2023-10-19T12:44:43.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.092+0000 7f37ba7a7b80 1 client.25858 shutdown 2023-10-19T12:44:43.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.093+0000 7f37ba7a7b80 1 -- 172.21.15.46:0/3115978275 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a42c055bf0 msgr2=0x55a42c073680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:44:43.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.093+0000 7f37ba7a7b80 1 --2- 172.21.15.46:0/3115978275 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a42c055bf0 0x55a42c073680 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3794035000 tx=0x7f3794005ca0 comp rx=0 tx=0).stop 2023-10-19T12:44:43.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.094+0000 7f37ba7a7b80 1 -- 172.21.15.46:0/3115978275 shutdown_connections 2023-10-19T12:44:43.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.094+0000 7f37ba7a7b80 1 --2- 172.21.15.46:0/3115978275 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x55a42c0cd440 0x55a42c0cf830 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:43.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.094+0000 7f37ba7a7b80 1 --2- 172.21.15.46:0/3115978275 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a42c064440 0x55a42c070660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:43.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.094+0000 7f37ba7a7b80 1 --2- 172.21.15.46:0/3115978275 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a42c055bf0 0x55a42c073680 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:43.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.094+0000 7f37ba7a7b80 1 --2- 172.21.15.46:0/3115978275 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55a42c062de0 0x55a42c070120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:43.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.094+0000 7f377ffff700 0 client.25858 ms_handle_reset on v2:172.21.15.157:6838/552718978 2023-10-19T12:44:43.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.094+0000 7f37ba7a7b80 1 -- 172.21.15.46:0/3115978275 >> 172.21.15.46:0/3115978275 conn(0x55a42bfce720 msgr2=0x55a42c06c110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:44:43.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.096+0000 7f37ba7a7b80 1 -- 172.21.15.46:0/3115978275 shutdown_connections 2023-10-19T12:44:43.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.096+0000 7f37ba7a7b80 1 -- 172.21.15.46:0/3115978275 wait complete. 2023-10-19T12:44:43.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.096+0000 7f37ba7a7b80 20 client.25858 trim_cache size 0 max 16384 2023-10-19T12:44:43.100 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-10-19T12:44:43.101 INFO:teuthology.orchestra.run.smithi046.stdout: "status": "scrub active (2 inodes in the stack)", 2023-10-19T12:44:43.101 INFO:teuthology.orchestra.run.smithi046.stdout: "scrubs": { 2023-10-19T12:44:43.101 INFO:teuthology.orchestra.run.smithi046.stdout: "21e73f70-af16-4ae7-bc34-e6c54ba8e1ec": { 2023-10-19T12:44:43.101 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2023-10-19T12:44:43.101 INFO:teuthology.orchestra.run.smithi046.stdout: "tag": "21e73f70-af16-4ae7-bc34-e6c54ba8e1ec", 2023-10-19T12:44:43.102 INFO:teuthology.orchestra.run.smithi046.stdout: "options": "recursive,force" 2023-10-19T12:44:43.102 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:44:43.102 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:44:43.102 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-10-19T12:44:43.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.097+0000 7f37a6dff700 1 -- 172.21.15.46:0/3675999939 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f37900a1650 msgr2=0x7f37900a3b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:44:43.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.097+0000 7f37a6dff700 1 --2- 172.21.15.46:0/3675999939 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f37900a1650 0x7f37900a3b10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f3794009fd0 tx=0x7f37940058e0 comp rx=0 tx=0).stop 2023-10-19T12:44:43.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.097+0000 7f37a6dff700 1 -- 172.21.15.46:0/3675999939 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37a0104560 msgr2=0x7f37a019ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:44:43.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.097+0000 7f37a6dff700 1 --2- 172.21.15.46:0/3675999939 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37a0104560 0x7f37a019ff30 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f379800efb0 tx=0x7f379800c3a0 comp rx=0 tx=0).stop 2023-10-19T12:44:43.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.097+0000 7f37a6dff700 1 -- 172.21.15.46:0/3675999939 shutdown_connections 2023-10-19T12:44:43.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.097+0000 7f37a6dff700 1 --2- 172.21.15.46:0/3675999939 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f37900a1650 0x7f37900a3b10 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:43.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.097+0000 7f37a6dff700 1 --2- 172.21.15.46:0/3675999939 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37a0104560 0x7f37a019ff30 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:43.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.097+0000 7f37a6dff700 1 --2- 172.21.15.46:0/3675999939 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37a01029d0 0x7f37a01989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:43.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.097+0000 7f37a6dff700 1 --2- 172.21.15.46:0/3675999939 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f37a0103bc0 0x7f37a0198f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:44:43.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.097+0000 7f37a6dff700 1 -- 172.21.15.46:0/3675999939 >> 172.21.15.46:0/3675999939 conn(0x7f37a00fdf40 msgr2=0x7f37a0106f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:44:43.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.097+0000 7f37a6dff700 1 -- 172.21.15.46:0/3675999939 shutdown_connections 2023-10-19T12:44:43.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:44:43.098+0000 7f37a6dff700 1 -- 172.21.15.46:0/3675999939 wait complete. 2023-10-19T12:44:43.146 INFO:tasks.cephfs.filesystem:scrub status for tag:21e73f70-af16-4ae7-bc34-e6c54ba8e1ec - {'path': '/', 'tag': '21e73f70-af16-4ae7-bc34-e6c54ba8e1ec', 'options': 'recursive,force'} 2023-10-19T12:44:44.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:44:43 smithi157 ceph-mon[134109]: pgmap v390: 129 pgs: 129 active+clean; 1.3 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 26 MiB/s wr, 754 op/s 2023-10-19T12:44:44.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:44:43 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:44:44.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:44:43 smithi195 ceph-mon[134493]: pgmap v390: 129 pgs: 129 active+clean; 1.3 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 26 MiB/s wr, 754 op/s 2023-10-19T12:44:44.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:44:43 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:44:44.233 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:44:43 smithi046 ceph-mon[98509]: pgmap v390: 129 pgs: 129 active+clean; 1.3 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 26 MiB/s wr, 754 op/s 2023-10-19T12:44:44.233 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:44:43 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:44:45.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:44:44 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:44:45.232 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:44:44 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:44:45.232 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:44:44 smithi046 ceph-mon[98509]: pgmap v391: 129 pgs: 129 active+clean; 1.3 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 22 MiB/s wr, 667 op/s 2023-10-19T12:44:45.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:44:44 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:44:45.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:44:44 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:44:45.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:44:44 smithi157 ceph-mon[134109]: pgmap v391: 129 pgs: 129 active+clean; 1.3 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 22 MiB/s wr, 667 op/s 2023-10-19T12:44:45.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:44:44 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:44:45.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:44:44 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:44:45.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:44:44 smithi195 ceph-mon[134493]: pgmap v391: 129 pgs: 129 active+clean; 1.3 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 22 MiB/s wr, 667 op/s 2023-10-19T12:44:46.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:44:45 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:44:46.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:44:45 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:44:46.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:44:45 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:44:46.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:44:45 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:44:46.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:44:45 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:44:46.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:44:45 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:44:46.478 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:44:45 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:44:46.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:44:45 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:44:46.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:44:45 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:44:46.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 45.0 s, 881.8 tps, lat 112.831 ms stddev 147.219 2023-10-19T12:44:47.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:44:46 smithi157 ceph-mon[134109]: pgmap v392: 129 pgs: 129 active+clean; 1.3 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 23 MiB/s wr, 795 op/s 2023-10-19T12:44:47.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:44:46 smithi195 ceph-mon[134493]: pgmap v392: 129 pgs: 129 active+clean; 1.3 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 23 MiB/s wr, 795 op/s 2023-10-19T12:44:47.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:44:46 smithi046 ceph-mon[98509]: pgmap v392: 129 pgs: 129 active+clean; 1.3 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 23 MiB/s wr, 795 op/s 2023-10-19T12:44:49.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:44:49 smithi195 ceph-mon[134493]: pgmap v393: 129 pgs: 129 active+clean; 1.3 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 MiB/s wr, 750 op/s 2023-10-19T12:44:49.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:44:49 smithi046 ceph-mon[98509]: pgmap v393: 129 pgs: 129 active+clean; 1.3 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 MiB/s wr, 750 op/s 2023-10-19T12:44:49.837 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:44:49 smithi157 ceph-mon[134109]: pgmap v393: 129 pgs: 129 active+clean; 1.3 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 MiB/s wr, 750 op/s 2023-10-19T12:44:51.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 50.0 s, 1047.2 tps, lat 95.200 ms stddev 128.722 2023-10-19T12:44:52.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:44:51 smithi157 ceph-mon[134109]: pgmap v394: 129 pgs: 129 active+clean; 1.3 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 19 MiB/s wr, 777 op/s 2023-10-19T12:44:52.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:44:51 smithi195 ceph-mon[134493]: pgmap v394: 129 pgs: 129 active+clean; 1.3 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 19 MiB/s wr, 777 op/s 2023-10-19T12:44:52.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:44:51 smithi046 ceph-mon[98509]: pgmap v394: 129 pgs: 129 active+clean; 1.3 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 19 MiB/s wr, 777 op/s 2023-10-19T12:44:54.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:44:53 smithi157 ceph-mon[134109]: pgmap v395: 129 pgs: 129 active+clean; 1.4 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 22 MiB/s wr, 851 op/s 2023-10-19T12:44:54.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:44:53 smithi195 ceph-mon[134493]: pgmap v395: 129 pgs: 129 active+clean; 1.4 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 22 MiB/s wr, 851 op/s 2023-10-19T12:44:54.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:44:53 smithi046 ceph-mon[98509]: pgmap v395: 129 pgs: 129 active+clean; 1.4 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 22 MiB/s wr, 851 op/s 2023-10-19T12:44:56.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:44:55 smithi157 ceph-mon[134109]: pgmap v396: 129 pgs: 129 active+clean; 1.4 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 21 MiB/s wr, 754 op/s 2023-10-19T12:44:56.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:44:55 smithi195 ceph-mon[134493]: pgmap v396: 129 pgs: 129 active+clean; 1.4 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 21 MiB/s wr, 754 op/s 2023-10-19T12:44:56.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:44:55 smithi046 ceph-mon[98509]: pgmap v396: 129 pgs: 129 active+clean; 1.4 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 21 MiB/s wr, 754 op/s 2023-10-19T12:44:56.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 55.0 s, 1261.4 tps, lat 79.174 ms stddev 90.766 2023-10-19T12:44:58.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:44:57 smithi157 ceph-mon[134109]: pgmap v397: 129 pgs: 129 active+clean; 1.4 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 27 MiB/s wr, 940 op/s 2023-10-19T12:44:58.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:44:57 smithi195 ceph-mon[134493]: pgmap v397: 129 pgs: 129 active+clean; 1.4 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 27 MiB/s wr, 940 op/s 2023-10-19T12:44:58.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:44:57 smithi046 ceph-mon[98509]: pgmap v397: 129 pgs: 129 active+clean; 1.4 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 27 MiB/s wr, 940 op/s 2023-10-19T12:44:59.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:44:59 smithi195 ceph-mon[134493]: pgmap v398: 129 pgs: 129 active+clean; 1.4 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 25 MiB/s wr, 854 op/s 2023-10-19T12:44:59.733 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:44:59 smithi046 ceph-mon[98509]: pgmap v398: 129 pgs: 129 active+clean; 1.4 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 25 MiB/s wr, 854 op/s 2023-10-19T12:44:59.837 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:44:59 smithi157 ceph-mon[134109]: pgmap v398: 129 pgs: 129 active+clean; 1.4 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 25 MiB/s wr, 854 op/s 2023-10-19T12:45:01.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 60.0 s, 1267.8 tps, lat 77.956 ms stddev 85.257 2023-10-19T12:45:02.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:45:01 smithi157 ceph-mon[134109]: pgmap v399: 129 pgs: 129 active+clean; 1.4 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 27 MiB/s wr, 886 op/s 2023-10-19T12:45:02.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:45:01 smithi195 ceph-mon[134493]: pgmap v399: 129 pgs: 129 active+clean; 1.4 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 27 MiB/s wr, 886 op/s 2023-10-19T12:45:02.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:45:01 smithi046 ceph-mon[98509]: pgmap v399: 129 pgs: 129 active+clean; 1.4 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 27 MiB/s wr, 886 op/s 2023-10-19T12:45:04.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:45:03 smithi157 ceph-mon[134109]: pgmap v400: 129 pgs: 129 active+clean; 1.5 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 255 KiB/s rd, 28 MiB/s wr, 891 op/s 2023-10-19T12:45:04.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:45:03 smithi195 ceph-mon[134493]: pgmap v400: 129 pgs: 129 active+clean; 1.5 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 255 KiB/s rd, 28 MiB/s wr, 891 op/s 2023-10-19T12:45:04.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:45:03 smithi046 ceph-mon[98509]: pgmap v400: 129 pgs: 129 active+clean; 1.5 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 255 KiB/s rd, 28 MiB/s wr, 891 op/s 2023-10-19T12:45:06.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:45:05 smithi157 ceph-mon[134109]: pgmap v401: 129 pgs: 129 active+clean; 1.5 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 23 MiB/s wr, 734 op/s 2023-10-19T12:45:06.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:45:05 smithi195 ceph-mon[134493]: pgmap v401: 129 pgs: 129 active+clean; 1.5 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 23 MiB/s wr, 734 op/s 2023-10-19T12:45:06.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:45:05 smithi046 ceph-mon[98509]: pgmap v401: 129 pgs: 129 active+clean; 1.5 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 23 MiB/s wr, 734 op/s 2023-10-19T12:45:06.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 65.0 s, 957.2 tps, lat 89.138 ms stddev 183.677 2023-10-19T12:45:08.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:45:07 smithi157 ceph-mon[134109]: pgmap v402: 129 pgs: 129 active+clean; 1.5 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 31 MiB/s wr, 1.28k op/s 2023-10-19T12:45:08.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:45:07 smithi157 ceph-mon[134109]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-19T12:45:08.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:45:07 smithi195 ceph-mon[134493]: pgmap v402: 129 pgs: 129 active+clean; 1.5 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 31 MiB/s wr, 1.28k op/s 2023-10-19T12:45:08.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:45:07 smithi195 ceph-mon[134493]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-19T12:45:08.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:45:07 smithi046 ceph-mon[98509]: pgmap v402: 129 pgs: 129 active+clean; 1.5 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 31 MiB/s wr, 1.28k op/s 2023-10-19T12:45:08.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:45:07 smithi046 ceph-mon[98509]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-19T12:45:09.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:45:09 smithi195 ceph-mon[134493]: pgmap v403: 129 pgs: 129 active+clean; 1.5 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 33 MiB/s wr, 1.55k op/s 2023-10-19T12:45:09.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:45:09 smithi046 ceph-mon[98509]: pgmap v403: 129 pgs: 129 active+clean; 1.5 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 33 MiB/s wr, 1.55k op/s 2023-10-19T12:45:09.837 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:45:09 smithi157 ceph-mon[134109]: pgmap v403: 129 pgs: 129 active+clean; 1.5 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 33 MiB/s wr, 1.55k op/s 2023-10-19T12:45:11.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 70.0 s, 1454.2 tps, lat 79.901 ms stddev 172.155 2023-10-19T12:45:12.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:45:11 smithi157 ceph-mon[134109]: pgmap v404: 129 pgs: 129 active+clean; 1.5 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 35 MiB/s wr, 1.71k op/s 2023-10-19T12:45:12.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:45:11 smithi195 ceph-mon[134493]: pgmap v404: 129 pgs: 129 active+clean; 1.5 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 35 MiB/s wr, 1.71k op/s 2023-10-19T12:45:12.228 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:45:11 smithi046 ceph-mon[98509]: pgmap v404: 129 pgs: 129 active+clean; 1.5 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 35 MiB/s wr, 1.71k op/s 2023-10-19T12:45:13.147 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-19T12:45:13.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.528+0000 7f6d8fdff700 1 -- 172.21.15.46:0/1716294700 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6d88100880 msgr2=0x7f6d88100ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:45:13.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.528+0000 7f6d8fdff700 1 --2- 172.21.15.46:0/1716294700 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6d88100880 0x7f6d88100ce0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6d78009990 tx=0x7f6d78009ca0 comp rx=0 tx=0).stop 2023-10-19T12:45:13.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.528+0000 7f6d8fdff700 1 -- 172.21.15.46:0/1716294700 shutdown_connections 2023-10-19T12:45:13.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.528+0000 7f6d8fdff700 1 --2- 172.21.15.46:0/1716294700 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6d88101220 0x7f6d88107ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:45:13.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.528+0000 7f6d8fdff700 1 --2- 172.21.15.46:0/1716294700 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d880ff690 0x7f6d880ffab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:45:13.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.529+0000 7f6d8fdff700 1 --2- 172.21.15.46:0/1716294700 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6d88100880 0x7f6d88100ce0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:45:13.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.529+0000 7f6d8fdff700 1 -- 172.21.15.46:0/1716294700 >> 172.21.15.46:0/1716294700 conn(0x7f6d880fac00 msgr2=0x7f6d880fd040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:45:13.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.529+0000 7f6d8fdff700 1 -- 172.21.15.46:0/1716294700 shutdown_connections 2023-10-19T12:45:13.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.529+0000 7f6d8fdff700 1 -- 172.21.15.46:0/1716294700 wait complete. 2023-10-19T12:45:13.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.532+0000 7f6d8fdff700 1 Processor -- start 2023-10-19T12:45:13.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.533+0000 7f6d8fdff700 1 -- start start 2023-10-19T12:45:13.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.533+0000 7f6d8fdff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6d880ff690 0x7f6d88109dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:45:13.539 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.533+0000 7f6d8fdff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d88100880 0x7f6d88108450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:45:13.539 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.533+0000 7f6d8fdff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6d88101220 0x7f6d88108990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:45:13.539 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.533+0000 7f6d8fdff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d8819a520 con 0x7f6d88100880 2023-10-19T12:45:13.539 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.534+0000 7f6d8fdff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d8819a690 con 0x7f6d88101220 2023-10-19T12:45:13.539 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.534+0000 7f6d8fdff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d8819a850 con 0x7f6d880ff690 2023-10-19T12:45:13.539 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.534+0000 7f6d8e39c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6d88101220 0x7f6d88108990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:45:13.540 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.534+0000 7f6d8e39c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6d88101220 0x7f6d88108990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:54596/0 (socket says 172.21.15.46:54596) 2023-10-19T12:45:13.540 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.534+0000 7f6d8e39c700 1 -- 172.21.15.46:0/947143509 learned_addr learned my addr 172.21.15.46:0/947143509 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:45:13.540 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.534+0000 7f6d8e39c700 1 -- 172.21.15.46:0/947143509 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6d880ff690 msgr2=0x7f6d88109dc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-19T12:45:13.540 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.534+0000 7f6d8e39c700 1 --2- 172.21.15.46:0/947143509 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6d880ff690 0x7f6d88109dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:45:13.540 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.534+0000 7f6d8e39c700 1 -- 172.21.15.46:0/947143509 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d88100880 msgr2=0x7f6d88108450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:45:13.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.534+0000 7f6d8e39c700 1 --2- 172.21.15.46:0/947143509 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d88100880 0x7f6d88108450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:45:13.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.534+0000 7f6d8e39c700 1 -- 172.21.15.46:0/947143509 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d780095f0 con 0x7f6d88101220 2023-10-19T12:45:13.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.535+0000 7f6d8e39c700 1 --2- 172.21.15.46:0/947143509 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6d88101220 0x7f6d88108990 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6d8000ef30 tx=0x7f6d8000c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:45:13.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.535+0000 7f6d7effd700 1 -- 172.21.15.46:0/947143509 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d80018070 con 0x7f6d88101220 2023-10-19T12:45:13.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.535+0000 7f6d7effd700 1 -- 172.21.15.46:0/947143509 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6d8000f040 con 0x7f6d88101220 2023-10-19T12:45:13.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.535+0000 7f6d7effd700 1 -- 172.21.15.46:0/947143509 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d80004020 con 0x7f6d88101220 2023-10-19T12:45:13.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.535+0000 7f6d8fdff700 1 -- 172.21.15.46:0/947143509 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d8819aa70 con 0x7f6d88101220 2023-10-19T12:45:13.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.536+0000 7f6d8fdff700 1 -- 172.21.15.46:0/947143509 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d8819af30 con 0x7f6d88101220 2023-10-19T12:45:13.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.540+0000 7f6d7effd700 1 -- 172.21.15.46:0/947143509 <== mon.2 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f6d80004ad0 con 0x7f6d88101220 2023-10-19T12:45:13.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.542+0000 7f6da3651b80 1 Processor -- start 2023-10-19T12:45:13.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.543+0000 7f6da3651b80 1 -- start start 2023-10-19T12:45:13.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.543+0000 7f6d7effd700 1 --2- 172.21.15.46:0/947143509 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f6d740a15d0 0x7f6d740a3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:45:13.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.543+0000 7f6da3651b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563adb4bf2d0 0x563adb4bf6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:45:13.547 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.543+0000 7f6da3651b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563adb4bfc30 0x563adb4be090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:45:13.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.543+0000 7f6da3651b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563adb4be5d0 0x563adb4bea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:45:13.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.543+0000 7f6da3651b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x563adb4316e0 con 0x563adb4bf2d0 2023-10-19T12:45:13.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.543+0000 7f6da3651b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x563adb417c60 con 0x563adb4bfc30 2023-10-19T12:45:13.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.543+0000 7f6da3651b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x563adb415580 con 0x563adb4be5d0 2023-10-19T12:45:13.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.544+0000 7f6d7effd700 1 -- 172.21.15.46:0/947143509 <== mon.2 v2:172.21.15.157:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f6d800cca30 con 0x7f6d88101220 2023-10-19T12:45:13.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.544+0000 7f6d8d39a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563adb4bfc30 0x563adb4be090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:45:13.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.544+0000 7f6d8d39a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563adb4bfc30 0x563adb4be090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:54602/0 (socket says 172.21.15.46:54602) 2023-10-19T12:45:13.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.544+0000 7f6d8d39a700 1 -- 172.21.15.46:0/1568849205 learned_addr learned my addr 172.21.15.46:0/1568849205 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:45:13.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.544+0000 7f6d8d39a700 1 --2- 172.21.15.46:0/947143509 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f6d740a15d0 0x7f6d740a3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:45:13.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.545+0000 7f6d8db9b700 1 --2- 172.21.15.46:0/1568849205 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563adb4bf2d0 0x563adb4bf6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:45:13.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.545+0000 7f6d8e39c700 1 --2- 172.21.15.46:0/1568849205 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563adb4be5d0 0x563adb4bea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:45:13.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.545+0000 7f6d8d39a700 1 -- 172.21.15.46:0/1568849205 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563adb4be5d0 msgr2=0x563adb4bea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:45:13.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.545+0000 7f6d8d39a700 1 --2- 172.21.15.46:0/1568849205 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563adb4be5d0 0x563adb4bea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:45:13.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.545+0000 7f6d8d39a700 1 -- 172.21.15.46:0/1568849205 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563adb4bf2d0 msgr2=0x563adb4bf6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:45:13.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.545+0000 7f6d8d39a700 1 --2- 172.21.15.46:0/1568849205 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563adb4bf2d0 0x563adb4bf6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:45:13.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.545+0000 7f6d8d39a700 1 -- 172.21.15.46:0/1568849205 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563adb3ce3f0 con 0x563adb4bfc30 2023-10-19T12:45:13.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.545+0000 7f6d8e39c700 1 --2- 172.21.15.46:0/1568849205 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563adb4be5d0 0x563adb4bea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T12:45:13.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.546+0000 7f6d8d39a700 1 --2- 172.21.15.46:0/1568849205 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563adb4bfc30 0x563adb4be090 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6d7800b8d0 tx=0x7f6d7800b900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cefc69777ef207d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:45:13.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.546+0000 7f6d8db9b700 1 --2- 172.21.15.46:0/1568849205 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563adb4bf2d0 0x563adb4bf6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T12:45:13.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.546+0000 7f6d73fff700 1 -- 172.21.15.46:0/1568849205 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d780059c0 con 0x563adb4bfc30 2023-10-19T12:45:13.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.546+0000 7f6d73fff700 1 -- 172.21.15.46:0/1568849205 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6d7800fc50 con 0x563adb4bfc30 2023-10-19T12:45:13.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.546+0000 7f6d73fff700 1 -- 172.21.15.46:0/1568849205 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d78026e40 con 0x563adb4bfc30 2023-10-19T12:45:13.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.547+0000 7f6da3651b80 1 -- 172.21.15.46:0/1568849205 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563adb4bfc30 msgr2=0x563adb4be090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:45:13.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.547+0000 7f6d8d39a700 1 --2- 172.21.15.46:0/947143509 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f6d740a15d0 0x7f6d740a3a90 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f6d7802c000 tx=0x7f6d78029000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:45:13.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.547+0000 7f6da3651b80 1 --2- 172.21.15.46:0/1568849205 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563adb4bfc30 0x563adb4be090 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6d7800b8d0 tx=0x7f6d7800b900 comp rx=0 tx=0).stop 2023-10-19T12:45:13.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.548+0000 7f6da3651b80 1 -- 172.21.15.46:0/1568849205 shutdown_connections 2023-10-19T12:45:13.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.548+0000 7f6da3651b80 1 --2- 172.21.15.46:0/1568849205 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563adb4be5d0 0x563adb4bea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:45:13.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.548+0000 7f6da3651b80 1 --2- 172.21.15.46:0/1568849205 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563adb4bf2d0 0x563adb4bf6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:45:13.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.548+0000 7f6da3651b80 1 --2- 172.21.15.46:0/1568849205 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563adb4bfc30 0x563adb4be090 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:45:13.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.548+0000 7f6da3651b80 1 -- 172.21.15.46:0/1568849205 >> 172.21.15.46:0/1568849205 conn(0x563adb432720 msgr2=0x563adb4b8b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:45:13.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.549+0000 7f6da3651b80 1 -- 172.21.15.46:0/1568849205 shutdown_connections 2023-10-19T12:45:13.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.549+0000 7f6da3651b80 1 -- 172.21.15.46:0/1568849205 wait complete. 2023-10-19T12:45:13.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.550+0000 7f6da3651b80 1 -- start start 2023-10-19T12:45:13.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.550+0000 7f6da3651b80 1 Processor -- start 2023-10-19T12:45:13.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.551+0000 7f6da3651b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563adb4be5d0 0x563adb4d8b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:45:13.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.551+0000 7f6da3651b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563adb4bf2d0 0x563adb4d9050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:45:13.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.551+0000 7f6da3651b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563adb4bfc30 0x563adb4e0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:45:13.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.551+0000 7f6da3651b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x563adb410e70 con 0x563adb4be5d0 2023-10-19T12:45:13.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.551+0000 7f6da3651b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x563adb3ad710 con 0x563adb4bfc30 2023-10-19T12:45:13.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.551+0000 7f6da3651b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x563adb3ad3b0 con 0x563adb4bf2d0 2023-10-19T12:45:13.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.551+0000 7f6da3651b80 10 client.0 _ll_register_callbacks cb 0x563adb2f7a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:45:13.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.552+0000 7f6d8d39a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563adb4bf2d0 0x563adb4d9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:45:13.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.552+0000 7f6d8d39a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563adb4bf2d0 0x563adb4d9050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:47500/0 (socket says 172.21.15.46:47500) 2023-10-19T12:45:13.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.552+0000 7f6d8d39a700 1 -- 172.21.15.46:0/1043279354 learned_addr learned my addr 172.21.15.46:0/1043279354 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:45:13.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.552+0000 7f6d8e39c700 1 --2- 172.21.15.46:0/1043279354 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563adb4bfc30 0x563adb4e0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:45:13.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.552+0000 7f6d8d39a700 1 -- 172.21.15.46:0/1043279354 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563adb4bfc30 msgr2=0x563adb4e0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:45:13.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.552+0000 7f6d8d39a700 1 --2- 172.21.15.46:0/1043279354 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563adb4bfc30 0x563adb4e0090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:45:13.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.552+0000 7f6d8d39a700 1 -- 172.21.15.46:0/1043279354 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563adb4be5d0 msgr2=0x563adb4d8b10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-19T12:45:13.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.552+0000 7f6d8d39a700 1 --2- 172.21.15.46:0/1043279354 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563adb4be5d0 0x563adb4d8b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:45:13.559 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.552+0000 7f6d8d39a700 1 -- 172.21.15.46:0/1043279354 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d78020040 con 0x563adb4bf2d0 2023-10-19T12:45:13.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.553+0000 7f6d8d39a700 1 --2- 172.21.15.46:0/1043279354 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563adb4bf2d0 0x563adb4d9050 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6d78009350 tx=0x7f6d78005fb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa08809d204998a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:45:13.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.553+0000 7f6d717fa700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-10-19T12:45:13.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.553+0000 7f6d717fa700 1 -- 172.21.15.46:0/1043279354 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d78030520 con 0x563adb4bf2d0 2023-10-19T12:45:13.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.553+0000 7f6d717fa700 1 -- 172.21.15.46:0/1043279354 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f6d78026e40 con 0x563adb4bf2d0 2023-10-19T12:45:13.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.553+0000 7f6da3651b80 1 -- 172.21.15.46:0/1043279354 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563adb415ef0 con 0x563adb4bf2d0 2023-10-19T12:45:13.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.554+0000 7f6d717fa700 1 -- 172.21.15.46:0/1043279354 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6d78030680 con 0x563adb4bf2d0 2023-10-19T12:45:13.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.554+0000 7f6da3651b80 10 client.25867 fetch_fsmap learned FSMap version 32 2023-10-19T12:45:13.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.554+0000 7f6da3651b80 1 -- 172.21.15.46:0/1043279354 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x563adb23bde0 con 0x563adb4bf2d0 2023-10-19T12:45:13.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.554+0000 7f6d717fa700 1 -- 172.21.15.46:0/1043279354 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x563adb415ef0 con 0x563adb4bf2d0 2023-10-19T12:45:13.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.554+0000 7f6d717fa700 1 -- 172.21.15.46:0/1043279354 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 32) v1 ==== 7926+0+0 (secure 0 0 0) 0x7f6d78062070 con 0x563adb4bf2d0 2023-10-19T12:45:13.562 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.555+0000 7f6da3651b80 10 client.25867 fetch_fsmap finished waiting for FSMap version 32 2023-10-19T12:45:13.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.555+0000 7f6da3651b80 10 client.25867 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-19T12:45:13.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.555+0000 7f6da3651b80 20 client.25867 populate_metadata read hostname 'smithi046' 2023-10-19T12:45:13.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.555+0000 7f6da3651b80 1 --2- 172.21.15.46:0/1043279354 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x563adb4e4400 0x563adb4e6820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:45:13.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.555+0000 7f6da3651b80 4 client.25867 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-19T12:45:13.563 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.555+0000 7f6da3651b80 1 -- 172.21.15.46:0/1043279354 --> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563adb48d8b0 con 0x563adb4e4400 2023-10-19T12:45:13.564 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.557+0000 7f6d8db9b700 1 --2- 172.21.15.46:0/1043279354 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x563adb4e4400 0x563adb4e6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:45:13.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.558+0000 7f6d8db9b700 1 --2- 172.21.15.46:0/1043279354 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x563adb4e4400 0x563adb4e6820 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=57648dad37921ce5 server_cookie=c219cfa1d0b900c5 in_seq=0 out_seq=0 2023-10-19T12:45:13.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.558+0000 7f6d717fa700 10 client.25867 ms_handle_connect on v2:172.21.15.157:6838/552718978 2023-10-19T12:45:13.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.559+0000 7f6d717fa700 1 -- 172.21.15.46:0/1043279354 <== mds.0 v2:172.21.15.157:6838/552718978 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x563adb48d8b0 con 0x563adb4e4400 2023-10-19T12:45:13.565 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.559+0000 7f6d717fa700 10 client.25867 handle_command_reply: tid=0 2023-10-19T12:45:13.566 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.559+0000 7f6da3651b80 1 client.25867 shutdown 2023-10-19T12:45:13.566 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.559+0000 7f6da3651b80 1 -- 172.21.15.46:0/1043279354 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563adb4bf2d0 msgr2=0x563adb4d9050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:45:13.566 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.559+0000 7f6da3651b80 1 --2- 172.21.15.46:0/1043279354 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563adb4bf2d0 0x563adb4d9050 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6d78009350 tx=0x7f6d78005fb0 comp rx=0 tx=0).stop 2023-10-19T12:45:13.566 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.559+0000 7f6da3651b80 1 -- 172.21.15.46:0/1043279354 shutdown_connections 2023-10-19T12:45:13.566 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.559+0000 7f6da3651b80 1 --2- 172.21.15.46:0/1043279354 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563adb4bfc30 0x563adb4e0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:45:13.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.559+0000 7f6da3651b80 1 --2- 172.21.15.46:0/1043279354 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x563adb4e4400 0x563adb4e6820 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:45:13.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.559+0000 7f6da3651b80 1 --2- 172.21.15.46:0/1043279354 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563adb4be5d0 0x563adb4d8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:45:13.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.559+0000 7f6da3651b80 1 --2- 172.21.15.46:0/1043279354 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563adb4bf2d0 0x563adb4d9050 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:45:13.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.559+0000 7f6da3651b80 1 -- 172.21.15.46:0/1043279354 >> 172.21.15.46:0/1043279354 conn(0x563adb432720 msgr2=0x563adb4bd080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:45:13.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.559+0000 7f6d717fa700 0 client.25867 ms_handle_reset on v2:172.21.15.157:6838/552718978 2023-10-19T12:45:13.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.560+0000 7f6da3651b80 1 -- 172.21.15.46:0/1043279354 shutdown_connections 2023-10-19T12:45:13.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.560+0000 7f6da3651b80 1 -- 172.21.15.46:0/1043279354 wait complete. 2023-10-19T12:45:13.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.560+0000 7f6da3651b80 20 client.25867 trim_cache size 0 max 16384 2023-10-19T12:45:13.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.593+0000 7f6da3651b80 1 Processor -- start 2023-10-19T12:45:13.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.593+0000 7f6da3651b80 1 -- start start 2023-10-19T12:45:13.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.593+0000 7f6da3651b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563adb4be5d0 0x563adb4c5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:45:13.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.593+0000 7f6da3651b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563adb4bf2d0 0x563adb4e0050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:45:13.598 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.593+0000 7f6da3651b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563adb4bfc30 0x563adb4c22d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:45:13.598 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.593+0000 7f6da3651b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x563adb291920 con 0x563adb4be5d0 2023-10-19T12:45:13.598 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.593+0000 7f6da3651b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x563adb4e1210 con 0x563adb4bf2d0 2023-10-19T12:45:13.598 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.593+0000 7f6da3651b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x563adb4b0fd0 con 0x563adb4bfc30 2023-10-19T12:45:13.598 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.594+0000 7f6d8d39a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563adb4bf2d0 0x563adb4e0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:45:13.599 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.595+0000 7f6d8d39a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563adb4bf2d0 0x563adb4e0050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:54620/0 (socket says 172.21.15.46:54620) 2023-10-19T12:45:13.599 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.595+0000 7f6d8d39a700 1 -- 172.21.15.46:0/181497370 learned_addr learned my addr 172.21.15.46:0/181497370 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:45:13.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.595+0000 7f6d8db9b700 1 --2- 172.21.15.46:0/181497370 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563adb4be5d0 0x563adb4c5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:45:13.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.596+0000 7f6d8d39a700 1 -- 172.21.15.46:0/181497370 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563adb4bfc30 msgr2=0x563adb4c22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:45:13.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.596+0000 7f6d8e39c700 1 --2- 172.21.15.46:0/181497370 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563adb4bfc30 0x563adb4c22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:45:13.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.597+0000 7f6d8d39a700 1 --2- 172.21.15.46:0/181497370 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563adb4bfc30 0x563adb4c22d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:45:13.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.597+0000 7f6d8d39a700 1 -- 172.21.15.46:0/181497370 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563adb4be5d0 msgr2=0x563adb4c5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:45:13.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.597+0000 7f6d8d39a700 1 --2- 172.21.15.46:0/181497370 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563adb4be5d0 0x563adb4c5ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:45:13.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.597+0000 7f6d8d39a700 1 -- 172.21.15.46:0/181497370 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563adb224c60 con 0x563adb4bf2d0 2023-10-19T12:45:13.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.597+0000 7f6d8db9b700 1 --2- 172.21.15.46:0/181497370 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563adb4be5d0 0x563adb4c5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T12:45:13.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.597+0000 7f6d8e39c700 1 --2- 172.21.15.46:0/181497370 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563adb4bfc30 0x563adb4c22d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T12:45:13.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.597+0000 7f6d8d39a700 1 --2- 172.21.15.46:0/181497370 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563adb4bf2d0 0x563adb4e0050 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6d7800b680 tx=0x7f6d780058e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e8179e092ccc594 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:45:13.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.598+0000 7f6d7cbff700 1 -- 172.21.15.46:0/181497370 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d78017ca0 con 0x563adb4bf2d0 2023-10-19T12:45:13.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.598+0000 7f6d7cbff700 1 -- 172.21.15.46:0/181497370 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6d78026720 con 0x563adb4bf2d0 2023-10-19T12:45:13.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.598+0000 7f6d7cbff700 1 -- 172.21.15.46:0/181497370 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d78030e30 con 0x563adb4bf2d0 2023-10-19T12:45:13.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.599+0000 7f6da3651b80 1 -- 172.21.15.46:0/181497370 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563adb4bf2d0 msgr2=0x563adb4e0050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:45:13.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.599+0000 7f6da3651b80 1 --2- 172.21.15.46:0/181497370 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563adb4bf2d0 0x563adb4e0050 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6d7800b680 tx=0x7f6d780058e0 comp rx=0 tx=0).stop 2023-10-19T12:45:13.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.601+0000 7f6da3651b80 1 -- 172.21.15.46:0/181497370 shutdown_connections 2023-10-19T12:45:13.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.601+0000 7f6da3651b80 1 --2- 172.21.15.46:0/181497370 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563adb4bfc30 0x563adb4c22d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:45:13.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.601+0000 7f6da3651b80 1 --2- 172.21.15.46:0/181497370 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563adb4be5d0 0x563adb4c5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:45:13.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.601+0000 7f6da3651b80 1 --2- 172.21.15.46:0/181497370 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563adb4bf2d0 0x563adb4e0050 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:45:13.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.601+0000 7f6da3651b80 1 -- 172.21.15.46:0/181497370 >> 172.21.15.46:0/181497370 conn(0x563adb432720 msgr2=0x563adb4d8020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:45:13.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.601+0000 7f6da3651b80 1 -- 172.21.15.46:0/181497370 shutdown_connections 2023-10-19T12:45:13.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.601+0000 7f6da3651b80 1 -- 172.21.15.46:0/181497370 wait complete. 2023-10-19T12:45:13.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.602+0000 7f6da3651b80 1 -- start start 2023-10-19T12:45:13.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.602+0000 7f6da3651b80 1 Processor -- start 2023-10-19T12:45:13.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.604+0000 7f6da3651b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563adb4be5d0 0x563adb4df8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:45:13.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.604+0000 7f6da3651b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563adb4bf2d0 0x563adb4dfde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:45:13.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.604+0000 7f6da3651b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563adb4bfc30 0x563adb4ddf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:45:13.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.604+0000 7f6da3651b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x563adb4de520 con 0x563adb4bfc30 2023-10-19T12:45:13.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.604+0000 7f6da3651b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x563adb4de690 con 0x563adb4be5d0 2023-10-19T12:45:13.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.604+0000 7f6da3651b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x563adb4de850 con 0x563adb4bf2d0 2023-10-19T12:45:13.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.604+0000 7f6da3651b80 10 client.0 _ll_register_callbacks cb 0x563adb2f7a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:45:13.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.605+0000 7f6d8db9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563adb4be5d0 0x563adb4df8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:45:13.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.605+0000 7f6d8db9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563adb4be5d0 0x563adb4df8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:54628/0 (socket says 172.21.15.46:54628) 2023-10-19T12:45:13.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.605+0000 7f6d8db9b700 1 -- 172.21.15.46:0/2329594453 learned_addr learned my addr 172.21.15.46:0/2329594453 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:45:13.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.605+0000 7f6d8d39a700 1 --2- 172.21.15.46:0/2329594453 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563adb4bf2d0 0x563adb4dfde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:45:13.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.606+0000 7f6d8db9b700 1 -- 172.21.15.46:0/2329594453 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563adb4bf2d0 msgr2=0x563adb4dfde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:45:13.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.606+0000 7f6d8db9b700 1 --2- 172.21.15.46:0/2329594453 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563adb4bf2d0 0x563adb4dfde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:45:13.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.606+0000 7f6d8db9b700 1 -- 172.21.15.46:0/2329594453 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563adb4bfc30 msgr2=0x563adb4ddf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:45:13.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.606+0000 7f6d8db9b700 1 --2- 172.21.15.46:0/2329594453 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563adb4bfc30 0x563adb4ddf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:45:13.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.606+0000 7f6d8db9b700 1 -- 172.21.15.46:0/2329594453 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563adb23bde0 con 0x563adb4be5d0 2023-10-19T12:45:13.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.606+0000 7f6d8db9b700 1 --2- 172.21.15.46:0/2329594453 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563adb4be5d0 0x563adb4df8a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6d84000c00 tx=0x7f6d8400be00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe75d129581a89a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:45:13.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.606+0000 7f6d717fa700 10 client.0 ms_handle_connect on v2:172.21.15.157:3300/0 2023-10-19T12:45:13.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.607+0000 7f6d717fa700 1 -- 172.21.15.46:0/2329594453 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d84015330 con 0x563adb4be5d0 2023-10-19T12:45:13.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.607+0000 7f6d717fa700 1 -- 172.21.15.46:0/2329594453 <== mon.2 v2:172.21.15.157:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f6d84015490 con 0x563adb4be5d0 2023-10-19T12:45:13.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.608+0000 7f6da3651b80 1 -- 172.21.15.46:0/2329594453 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6d7800fc50 con 0x563adb4be5d0 2023-10-19T12:45:13.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.608+0000 7f6d717fa700 1 -- 172.21.15.46:0/2329594453 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6d8401e420 con 0x563adb4be5d0 2023-10-19T12:45:13.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.609+0000 7f6da3651b80 10 client.25874 fetch_fsmap learned FSMap version 32 2023-10-19T12:45:13.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.609+0000 7f6da3651b80 1 -- 172.21.15.46:0/2329594453 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x563adb262250 con 0x563adb4be5d0 2023-10-19T12:45:13.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.609+0000 7f6d717fa700 1 -- 172.21.15.46:0/2329594453 <== mon.2 v2:172.21.15.157:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6d7800fc50 con 0x563adb4be5d0 2023-10-19T12:45:13.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.609+0000 7f6d717fa700 1 -- 172.21.15.46:0/2329594453 <== mon.2 v2:172.21.15.157:3300/0 5 ==== fsmap(e 32) v1 ==== 7926+0+0 (secure 0 0 0) 0x7f6d84028420 con 0x563adb4be5d0 2023-10-19T12:45:13.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.609+0000 7f6da3651b80 10 client.25874 fetch_fsmap finished waiting for FSMap version 32 2023-10-19T12:45:13.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.609+0000 7f6da3651b80 10 client.25874 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-19T12:45:13.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.609+0000 7f6da3651b80 20 client.25874 populate_metadata read hostname 'smithi046' 2023-10-19T12:45:13.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.609+0000 7f6da3651b80 1 --2- 172.21.15.46:0/2329594453 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x563adb5396a0 0x563adb53bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:45:13.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.609+0000 7f6da3651b80 4 client.25874 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-19T12:45:13.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.610+0000 7f6da3651b80 1 -- 172.21.15.46:0/2329594453 --> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x563adb409e50 con 0x563adb5396a0 2023-10-19T12:45:13.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.610+0000 7f6d8d39a700 1 --2- 172.21.15.46:0/2329594453 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x563adb5396a0 0x563adb53bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:45:13.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.611+0000 7f6d717fa700 10 client.25874 ms_handle_connect on v2:172.21.15.157:6838/552718978 2023-10-19T12:45:13.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.611+0000 7f6d8d39a700 1 --2- 172.21.15.46:0/2329594453 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x563adb5396a0 0x563adb53bac0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9af5e996a1a03525 server_cookie=d21444dc991c2537 in_seq=0 out_seq=0 2023-10-19T12:45:13.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.612+0000 7f6d717fa700 1 -- 172.21.15.46:0/2329594453 <== mds.0 v2:172.21.15.157:6838/552718978 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x563adb409e50 con 0x563adb5396a0 2023-10-19T12:45:13.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.612+0000 7f6d717fa700 10 client.25874 handle_command_reply: tid=0 2023-10-19T12:45:13.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.612+0000 7f6da3651b80 1 client.25874 shutdown 2023-10-19T12:45:13.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.613+0000 7f6da3651b80 1 -- 172.21.15.46:0/2329594453 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563adb4be5d0 msgr2=0x563adb4df8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:45:13.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.613+0000 7f6da3651b80 1 --2- 172.21.15.46:0/2329594453 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563adb4be5d0 0x563adb4df8a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6d84000c00 tx=0x7f6d8400be00 comp rx=0 tx=0).stop 2023-10-19T12:45:13.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.614+0000 7f6da3651b80 1 -- 172.21.15.46:0/2329594453 shutdown_connections 2023-10-19T12:45:13.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.614+0000 7f6da3651b80 1 --2- 172.21.15.46:0/2329594453 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x563adb5396a0 0x563adb53bac0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:45:13.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.614+0000 7f6da3651b80 1 --2- 172.21.15.46:0/2329594453 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563adb4bfc30 0x563adb4ddf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:45:13.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.614+0000 7f6da3651b80 1 --2- 172.21.15.46:0/2329594453 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563adb4be5d0 0x563adb4df8a0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:45:13.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.614+0000 7f6da3651b80 1 --2- 172.21.15.46:0/2329594453 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563adb4bf2d0 0x563adb4dfde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:45:13.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.614+0000 7f6da3651b80 1 -- 172.21.15.46:0/2329594453 >> 172.21.15.46:0/2329594453 conn(0x563adb432720 msgr2=0x563adb4d8ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:45:13.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.614+0000 7f6d717fa700 0 client.25874 ms_handle_reset on v2:172.21.15.157:6838/552718978 2023-10-19T12:45:13.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.614+0000 7f6da3651b80 1 -- 172.21.15.46:0/2329594453 shutdown_connections 2023-10-19T12:45:13.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.614+0000 7f6da3651b80 1 -- 172.21.15.46:0/2329594453 wait complete. 2023-10-19T12:45:13.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.615+0000 7f6da3651b80 20 client.25874 trim_cache size 0 max 16384 2023-10-19T12:45:13.620 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-10-19T12:45:13.621 INFO:teuthology.orchestra.run.smithi046.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-19T12:45:13.621 INFO:teuthology.orchestra.run.smithi046.stdout: "scrubs": { 2023-10-19T12:45:13.621 INFO:teuthology.orchestra.run.smithi046.stdout: "21e73f70-af16-4ae7-bc34-e6c54ba8e1ec": { 2023-10-19T12:45:13.621 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2023-10-19T12:45:13.621 INFO:teuthology.orchestra.run.smithi046.stdout: "tag": "21e73f70-af16-4ae7-bc34-e6c54ba8e1ec", 2023-10-19T12:45:13.622 INFO:teuthology.orchestra.run.smithi046.stdout: "options": "recursive,force" 2023-10-19T12:45:13.622 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:45:13.622 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:45:13.622 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-10-19T12:45:13.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.616+0000 7f6d8fdff700 1 -- 172.21.15.46:0/947143509 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f6d740a15d0 msgr2=0x7f6d740a3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:45:13.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.616+0000 7f6d8fdff700 1 --2- 172.21.15.46:0/947143509 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f6d740a15d0 0x7f6d740a3a90 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f6d7802c000 tx=0x7f6d78029000 comp rx=0 tx=0).stop 2023-10-19T12:45:13.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.616+0000 7f6d8fdff700 1 -- 172.21.15.46:0/947143509 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6d88101220 msgr2=0x7f6d88108990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:45:13.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.616+0000 7f6d8fdff700 1 --2- 172.21.15.46:0/947143509 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6d88101220 0x7f6d88108990 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6d8000ef30 tx=0x7f6d8000c450 comp rx=0 tx=0).stop 2023-10-19T12:45:13.624 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.616+0000 7f6d8fdff700 1 -- 172.21.15.46:0/947143509 shutdown_connections 2023-10-19T12:45:13.624 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.616+0000 7f6d8fdff700 1 --2- 172.21.15.46:0/947143509 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6d88101220 0x7f6d88108990 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:45:13.624 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.616+0000 7f6d8fdff700 1 --2- 172.21.15.46:0/947143509 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f6d740a15d0 0x7f6d740a3a90 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:45:13.624 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.616+0000 7f6d8fdff700 1 --2- 172.21.15.46:0/947143509 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6d880ff690 0x7f6d88109dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:45:13.624 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.616+0000 7f6d8fdff700 1 --2- 172.21.15.46:0/947143509 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d88100880 0x7f6d88108450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:45:13.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.616+0000 7f6d8fdff700 1 -- 172.21.15.46:0/947143509 >> 172.21.15.46:0/947143509 conn(0x7f6d880fac00 msgr2=0x7f6d88103b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:45:13.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.616+0000 7f6d8fdff700 1 -- 172.21.15.46:0/947143509 shutdown_connections 2023-10-19T12:45:13.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:13.617+0000 7f6d8fdff700 1 -- 172.21.15.46:0/947143509 wait complete. 2023-10-19T12:45:13.653 INFO:tasks.cephfs.filesystem:scrub status for tag:21e73f70-af16-4ae7-bc34-e6c54ba8e1ec - {'path': '/', 'tag': '21e73f70-af16-4ae7-bc34-e6c54ba8e1ec', 'options': 'recursive,force'} 2023-10-19T12:45:13.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:45:13 smithi046 ceph-mon[98509]: pgmap v405: 129 pgs: 129 active+clean; 1.5 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 34 MiB/s wr, 1.85k op/s 2023-10-19T12:45:14.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:45:13 smithi157 ceph-mon[134109]: pgmap v405: 129 pgs: 129 active+clean; 1.5 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 34 MiB/s wr, 1.85k op/s 2023-10-19T12:45:14.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:45:13 smithi195 ceph-mon[134493]: pgmap v405: 129 pgs: 129 active+clean; 1.5 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 34 MiB/s wr, 1.85k op/s 2023-10-19T12:45:16.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:45:15 smithi157 ceph-mon[134109]: pgmap v406: 129 pgs: 129 active+clean; 1.5 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 30 MiB/s wr, 1.71k op/s 2023-10-19T12:45:16.135 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:45:15 smithi195 ceph-mon[134493]: pgmap v406: 129 pgs: 129 active+clean; 1.5 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 30 MiB/s wr, 1.71k op/s 2023-10-19T12:45:16.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:45:15 smithi046 ceph-mon[98509]: pgmap v406: 129 pgs: 129 active+clean; 1.5 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 30 MiB/s wr, 1.71k op/s 2023-10-19T12:45:16.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 75.0 s, 1377.6 tps, lat 72.565 ms stddev 98.106 2023-10-19T12:45:18.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:45:17 smithi157 ceph-mon[134109]: pgmap v407: 129 pgs: 129 active+clean; 1.5 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 32 MiB/s wr, 1.83k op/s 2023-10-19T12:45:18.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:45:17 smithi195 ceph-mon[134493]: pgmap v407: 129 pgs: 129 active+clean; 1.5 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 32 MiB/s wr, 1.83k op/s 2023-10-19T12:45:18.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:45:17 smithi046 ceph-mon[98509]: pgmap v407: 129 pgs: 129 active+clean; 1.5 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 32 MiB/s wr, 1.83k op/s 2023-10-19T12:45:19.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:45:19 smithi195 ceph-mon[134493]: pgmap v408: 129 pgs: 129 active+clean; 1.5 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 23 MiB/s wr, 1.33k op/s 2023-10-19T12:45:19.730 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:45:19 smithi046 ceph-mon[98509]: pgmap v408: 129 pgs: 129 active+clean; 1.5 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 23 MiB/s wr, 1.33k op/s 2023-10-19T12:45:19.837 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:45:19 smithi157 ceph-mon[134109]: pgmap v408: 129 pgs: 129 active+clean; 1.5 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 23 MiB/s wr, 1.33k op/s 2023-10-19T12:45:21.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 80.0 s, 1780.8 tps, lat 56.724 ms stddev 69.691 2023-10-19T12:45:22.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:45:21 smithi157 ceph-mon[134109]: pgmap v409: 129 pgs: 129 active+clean; 1.5 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 15 MiB/s wr, 878 op/s 2023-10-19T12:45:22.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:45:21 smithi195 ceph-mon[134493]: pgmap v409: 129 pgs: 129 active+clean; 1.5 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 15 MiB/s wr, 878 op/s 2023-10-19T12:45:22.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:45:21 smithi046 ceph-mon[98509]: pgmap v409: 129 pgs: 129 active+clean; 1.5 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 15 MiB/s wr, 878 op/s 2023-10-19T12:45:24.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:45:23 smithi157 ceph-mon[134109]: pgmap v410: 129 pgs: 129 active+clean; 1.5 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 16 MiB/s wr, 831 op/s 2023-10-19T12:45:24.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:45:23 smithi195 ceph-mon[134493]: pgmap v410: 129 pgs: 129 active+clean; 1.5 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 16 MiB/s wr, 831 op/s 2023-10-19T12:45:24.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:45:23 smithi046 ceph-mon[98509]: pgmap v410: 129 pgs: 129 active+clean; 1.5 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 16 MiB/s wr, 831 op/s 2023-10-19T12:45:26.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:45:25 smithi157 ceph-mon[134109]: pgmap v411: 129 pgs: 129 active+clean; 1.5 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 11 MiB/s wr, 554 op/s 2023-10-19T12:45:26.134 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:45:25 smithi195 ceph-mon[134493]: pgmap v411: 129 pgs: 129 active+clean; 1.5 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 11 MiB/s wr, 554 op/s 2023-10-19T12:45:26.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:45:25 smithi046 ceph-mon[98509]: pgmap v411: 129 pgs: 129 active+clean; 1.5 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 11 MiB/s wr, 554 op/s 2023-10-19T12:45:26.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 85.0 s, 1677.6 tps, lat 59.245 ms stddev 80.655 2023-10-19T12:45:28.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:45:27 smithi157 ceph-mon[134109]: pgmap v412: 129 pgs: 129 active+clean; 1.5 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 MiB/s wr, 683 op/s 2023-10-19T12:45:28.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:45:27 smithi195 ceph-mon[134493]: pgmap v412: 129 pgs: 129 active+clean; 1.5 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 MiB/s wr, 683 op/s 2023-10-19T12:45:28.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:45:27 smithi046 ceph-mon[98509]: pgmap v412: 129 pgs: 129 active+clean; 1.5 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 MiB/s wr, 683 op/s 2023-10-19T12:45:29.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:45:29 smithi046 ceph-mon[98509]: pgmap v413: 129 pgs: 129 active+clean; 1.5 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 12 MiB/s wr, 620 op/s 2023-10-19T12:45:29.837 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:45:29 smithi157 ceph-mon[134109]: pgmap v413: 129 pgs: 129 active+clean; 1.5 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 12 MiB/s wr, 620 op/s 2023-10-19T12:45:29.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:45:29 smithi195 ceph-mon[134493]: pgmap v413: 129 pgs: 129 active+clean; 1.5 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 12 MiB/s wr, 620 op/s 2023-10-19T12:45:31.700 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 90.0 s, 1806.0 tps, lat 55.436 ms stddev 69.761 2023-10-19T12:45:32.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:45:31 smithi157 ceph-mon[134109]: pgmap v414: 129 pgs: 129 active+clean; 1.5 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 11 MiB/s wr, 626 op/s 2023-10-19T12:45:32.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:45:31 smithi195 ceph-mon[134493]: pgmap v414: 129 pgs: 129 active+clean; 1.5 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 11 MiB/s wr, 626 op/s 2023-10-19T12:45:32.228 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:45:31 smithi046 ceph-mon[98509]: pgmap v414: 129 pgs: 129 active+clean; 1.5 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 11 MiB/s wr, 626 op/s 2023-10-19T12:45:34.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:45:33 smithi157 ceph-mon[134109]: pgmap v415: 129 pgs: 129 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 MiB/s wr, 786 op/s 2023-10-19T12:45:34.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:45:33 smithi195 ceph-mon[134493]: pgmap v415: 129 pgs: 129 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 MiB/s wr, 786 op/s 2023-10-19T12:45:34.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:45:33 smithi046 ceph-mon[98509]: pgmap v415: 129 pgs: 129 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 MiB/s wr, 786 op/s 2023-10-19T12:45:36.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:45:35 smithi157 ceph-mon[134109]: pgmap v416: 129 pgs: 129 active+clean; 1.5 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 10 MiB/s wr, 617 op/s 2023-10-19T12:45:36.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:45:35 smithi195 ceph-mon[134493]: pgmap v416: 129 pgs: 129 active+clean; 1.5 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 10 MiB/s wr, 617 op/s 2023-10-19T12:45:36.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:45:35 smithi046 ceph-mon[98509]: pgmap v416: 129 pgs: 129 active+clean; 1.5 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 10 MiB/s wr, 617 op/s 2023-10-19T12:45:36.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 95.0 s, 1540.4 tps, lat 64.704 ms stddev 76.459 2023-10-19T12:45:38.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:45:37 smithi157 ceph-mon[134109]: pgmap v417: 129 pgs: 129 active+clean; 1.5 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 MiB/s wr, 742 op/s 2023-10-19T12:45:38.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:45:37 smithi195 ceph-mon[134493]: pgmap v417: 129 pgs: 129 active+clean; 1.5 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 MiB/s wr, 742 op/s 2023-10-19T12:45:38.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:45:37 smithi046 ceph-mon[98509]: pgmap v417: 129 pgs: 129 active+clean; 1.5 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 MiB/s wr, 742 op/s 2023-10-19T12:45:39.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:45:39 smithi046 ceph-mon[98509]: pgmap v418: 129 pgs: 129 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 10 MiB/s wr, 670 op/s 2023-10-19T12:45:39.837 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:45:39 smithi157 ceph-mon[134109]: pgmap v418: 129 pgs: 129 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 10 MiB/s wr, 670 op/s 2023-10-19T12:45:39.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:45:39 smithi195 ceph-mon[134493]: pgmap v418: 129 pgs: 129 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 10 MiB/s wr, 670 op/s 2023-10-19T12:45:41.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 100.0 s, 1176.6 tps, lat 85.529 ms stddev 97.931 2023-10-19T12:45:42.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:45:41 smithi157 ceph-mon[134109]: pgmap v419: 129 pgs: 129 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 10 MiB/s wr, 679 op/s 2023-10-19T12:45:42.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:45:41 smithi195 ceph-mon[134493]: pgmap v419: 129 pgs: 129 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 10 MiB/s wr, 679 op/s 2023-10-19T12:45:42.228 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:45:41 smithi046 ceph-mon[98509]: pgmap v419: 129 pgs: 129 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 10 MiB/s wr, 679 op/s 2023-10-19T12:45:43.654 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-19T12:45:44.057 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.053+0000 7f37bb3ff700 1 -- 172.21.15.46:0/1092935887 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f37b41019c0 msgr2=0x7f37b4101e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:45:44.057 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.054+0000 7f37bb3ff700 1 --2- 172.21.15.46:0/1092935887 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f37b41019c0 0x7f37b4101e20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f37a4009990 tx=0x7f37a4009ca0 comp rx=0 tx=0).stop 2023-10-19T12:45:44.058 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.055+0000 7f37bb3ff700 1 -- 172.21.15.46:0/1092935887 shutdown_connections 2023-10-19T12:45:44.059 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.055+0000 7f37bb3ff700 1 --2- 172.21.15.46:0/1092935887 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37b4102360 0x7f37b4108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:45:44.059 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.055+0000 7f37bb3ff700 1 --2- 172.21.15.46:0/1092935887 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37b41007d0 0x7f37b4100bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:45:44.059 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.055+0000 7f37bb3ff700 1 --2- 172.21.15.46:0/1092935887 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f37b41019c0 0x7f37b4101e20 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:45:44.059 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.056+0000 7f37bb3ff700 1 -- 172.21.15.46:0/1092935887 >> 172.21.15.46:0/1092935887 conn(0x7f37b40fbd40 msgr2=0x7f37b40fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:45:44.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.056+0000 7f37bb3ff700 1 -- 172.21.15.46:0/1092935887 shutdown_connections 2023-10-19T12:45:44.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.056+0000 7f37bb3ff700 1 -- 172.21.15.46:0/1092935887 wait complete. 2023-10-19T12:45:44.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.057+0000 7f37bb3ff700 1 Processor -- start 2023-10-19T12:45:44.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.058+0000 7f37bb3ff700 1 -- start start 2023-10-19T12:45:44.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.058+0000 7f37bb3ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37b41007d0 0x7f37b4198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:45:44.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.058+0000 7f37bb3ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37b41019c0 0x7f37b4198e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:45:44.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.058+0000 7f37bb3ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f37b4102360 0x7f37b419fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:45:44.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.058+0000 7f37bb3ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37b41a0460 con 0x7f37b41007d0 2023-10-19T12:45:44.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.058+0000 7f37bb3ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37b41a05a0 con 0x7f37b4102360 2023-10-19T12:45:44.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.058+0000 7f37bb3ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37b41a0730 con 0x7f37b41019c0 2023-10-19T12:45:44.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.058+0000 7f37b919b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37b41007d0 0x7f37b4198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:45:44.064 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.058+0000 7f37b999c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f37b4102360 0x7f37b419fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:45:44.064 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.058+0000 7f37b919b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37b41007d0 0x7f37b4198930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44966/0 (socket says 172.21.15.46:44966) 2023-10-19T12:45:44.064 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.058+0000 7f37b919b700 1 -- 172.21.15.46:0/3224484280 learned_addr learned my addr 172.21.15.46:0/3224484280 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:45:44.064 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.059+0000 7f37b899a700 1 --2- 172.21.15.46:0/3224484280 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37b41019c0 0x7f37b4198e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:45:44.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.059+0000 7f37b999c700 1 -- 172.21.15.46:0/3224484280 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37b41019c0 msgr2=0x7f37b4198e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:45:44.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.059+0000 7f37b999c700 1 --2- 172.21.15.46:0/3224484280 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37b41019c0 0x7f37b4198e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:45:44.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.059+0000 7f37b999c700 1 -- 172.21.15.46:0/3224484280 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37b41007d0 msgr2=0x7f37b4198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:45:44.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.059+0000 7f37b999c700 1 --2- 172.21.15.46:0/3224484280 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37b41007d0 0x7f37b4198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:45:44.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.059+0000 7f37b999c700 1 -- 172.21.15.46:0/3224484280 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37a40095f0 con 0x7f37b4102360 2023-10-19T12:45:44.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.060+0000 7f37b999c700 1 --2- 172.21.15.46:0/3224484280 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f37b4102360 0x7f37b419fe90 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f37ac00efc0 tx=0x7f37ac00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:45:44.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.060+0000 7f37aa7fc700 1 -- 172.21.15.46:0/3224484280 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37ac018070 con 0x7f37b4102360 2023-10-19T12:45:44.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.060+0000 7f37bb3ff700 1 -- 172.21.15.46:0/3224484280 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37b4109290 con 0x7f37b4102360 2023-10-19T12:45:44.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.060+0000 7f37bb3ff700 1 -- 172.21.15.46:0/3224484280 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37b41097a0 con 0x7f37b4102360 2023-10-19T12:45:44.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.061+0000 7f37aa7fc700 1 -- 172.21.15.46:0/3224484280 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f37ac00f040 con 0x7f37b4102360 2023-10-19T12:45:44.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.061+0000 7f37aa7fc700 1 -- 172.21.15.46:0/3224484280 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37ac018070 con 0x7f37b4102360 2023-10-19T12:45:44.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.065+0000 7f37aa7fc700 1 -- 172.21.15.46:0/3224484280 <== mon.2 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f37ac00cb60 con 0x7f37b4102360 2023-10-19T12:45:44.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.067+0000 7f37cec87b80 1 Processor -- start 2023-10-19T12:45:44.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.068+0000 7f37aa7fc700 1 --2- 172.21.15.46:0/3224484280 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f37a00a15e0 0x7f37a00a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:45:44.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.068+0000 7f37aa7fc700 1 -- 172.21.15.46:0/3224484280 <== mon.2 v2:172.21.15.157:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f37ac0cc900 con 0x7f37b4102360 2023-10-19T12:45:44.071 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.068+0000 7f37b899a700 1 --2- 172.21.15.46:0/3224484280 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f37a00a15e0 0x7f37a00a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:45:44.073 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.068+0000 7f37cec87b80 1 -- start start 2023-10-19T12:45:44.073 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.069+0000 7f37cec87b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c707a402d0 0x55c707a406f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:45:44.073 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.069+0000 7f37cec87b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c707a40c30 0x55c707a3f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:45:44.073 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.069+0000 7f37cec87b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c707a3f5d0 0x55c707a3fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:45:44.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.069+0000 7f37cec87b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7079b26e0 con 0x55c707a40c30 2023-10-19T12:45:44.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.069+0000 7f37cec87b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c707998c60 con 0x55c707a3f5d0 2023-10-19T12:45:44.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.069+0000 7f37cec87b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c707996580 con 0x55c707a402d0 2023-10-19T12:45:44.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.069+0000 7f37b919b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c707a402d0 0x55c707a406f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:45:44.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.069+0000 7f37b919b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c707a402d0 0x55c707a406f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:55452/0 (socket says 172.21.15.46:55452) 2023-10-19T12:45:44.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.069+0000 7f37b919b700 1 -- 172.21.15.46:0/2714922795 learned_addr learned my addr 172.21.15.46:0/2714922795 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:45:44.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.069+0000 7f37b999c700 1 --2- 172.21.15.46:0/2714922795 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c707a3f5d0 0x55c707a3fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:45:44.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.069+0000 7f37b919b700 1 -- 172.21.15.46:0/2714922795 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c707a3f5d0 msgr2=0x55c707a3fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:45:44.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.069+0000 7f37b919b700 1 --2- 172.21.15.46:0/2714922795 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c707a3f5d0 0x55c707a3fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:45:44.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.069+0000 7f37b919b700 1 -- 172.21.15.46:0/2714922795 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c707a40c30 msgr2=0x55c707a3f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:45:44.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.069+0000 7f37b919b700 1 --2- 172.21.15.46:0/2714922795 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c707a40c30 0x55c707a3f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:45:44.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.069+0000 7f37b919b700 1 -- 172.21.15.46:0/2714922795 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c70794f3f0 con 0x55c707a402d0 2023-10-19T12:45:44.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.070+0000 7f37b919b700 1 --2- 172.21.15.46:0/2714922795 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c707a402d0 0x55c707a406f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f37b000bea0 tx=0x7f37b00106b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d9a6ea415428912 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:45:44.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.070+0000 7f379f7fe700 1 -- 172.21.15.46:0/2714922795 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b0010ed0 con 0x55c707a402d0 2023-10-19T12:45:44.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.070+0000 7f379f7fe700 1 -- 172.21.15.46:0/2714922795 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f37b0015070 con 0x55c707a402d0 2023-10-19T12:45:44.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.070+0000 7f379f7fe700 1 -- 172.21.15.46:0/2714922795 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b001a4a0 con 0x55c707a402d0 2023-10-19T12:45:44.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.071+0000 7f37cec87b80 1 -- 172.21.15.46:0/2714922795 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c707a402d0 msgr2=0x55c707a406f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:45:44.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.071+0000 7f37cec87b80 1 --2- 172.21.15.46:0/2714922795 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c707a402d0 0x55c707a406f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f37b000bea0 tx=0x7f37b00106b0 comp rx=0 tx=0).stop 2023-10-19T12:45:44.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.071+0000 7f37b899a700 1 --2- 172.21.15.46:0/3224484280 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f37a00a15e0 0x7f37a00a3aa0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f37a4005950 tx=0x7f37a40058e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:45:44.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.071+0000 7f37cec87b80 1 -- 172.21.15.46:0/2714922795 shutdown_connections 2023-10-19T12:45:44.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.071+0000 7f37cec87b80 1 --2- 172.21.15.46:0/2714922795 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c707a3f5d0 0x55c707a3fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:45:44.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.071+0000 7f37cec87b80 1 --2- 172.21.15.46:0/2714922795 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c707a402d0 0x55c707a406f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:45:44.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.071+0000 7f37cec87b80 1 --2- 172.21.15.46:0/2714922795 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c707a40c30 0x55c707a3f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:45:44.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.071+0000 7f37cec87b80 1 -- 172.21.15.46:0/2714922795 >> 172.21.15.46:0/2714922795 conn(0x55c7079b3720 msgr2=0x55c707a39b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:45:44.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.071+0000 7f37cec87b80 1 -- 172.21.15.46:0/2714922795 shutdown_connections 2023-10-19T12:45:44.080 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.072+0000 7f37cec87b80 1 -- 172.21.15.46:0/2714922795 wait complete. 2023-10-19T12:45:44.080 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.073+0000 7f37cec87b80 1 -- start start 2023-10-19T12:45:44.080 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.073+0000 7f37cec87b80 1 Processor -- start 2023-10-19T12:45:44.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.075+0000 7f37cec87b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c707a3f5d0 0x55c707a48c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:45:44.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.075+0000 7f37cec87b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c707a402d0 0x55c707a49170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:45:44.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.075+0000 7f37cec87b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c707a4e1a0 0x55c707a50590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:45:44.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.075+0000 7f37cec87b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c707991e70 con 0x55c707a3f5d0 2023-10-19T12:45:44.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.075+0000 7f37cec87b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c70792e710 con 0x55c707a402d0 2023-10-19T12:45:44.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.075+0000 7f37cec87b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c70792e3b0 con 0x55c707a4e1a0 2023-10-19T12:45:44.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.075+0000 7f37cec87b80 10 client.0 _ll_register_callbacks cb 0x55c707878a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:45:44.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.076+0000 7f37b899a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c707a402d0 0x55c707a49170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:45:44.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.077+0000 7f37b899a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c707a402d0 0x55c707a49170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:35306/0 (socket says 172.21.15.46:35306) 2023-10-19T12:45:44.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.077+0000 7f37b899a700 1 -- 172.21.15.46:0/4163877593 learned_addr learned my addr 172.21.15.46:0/4163877593 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:45:44.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.077+0000 7f37b999c700 1 --2- 172.21.15.46:0/4163877593 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c707a4e1a0 0x55c707a50590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:45:44.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.077+0000 7f37b919b700 1 --2- 172.21.15.46:0/4163877593 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c707a3f5d0 0x55c707a48c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:45:44.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.077+0000 7f37b999c700 1 -- 172.21.15.46:0/4163877593 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c707a402d0 msgr2=0x55c707a49170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:45:44.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.077+0000 7f37b999c700 1 --2- 172.21.15.46:0/4163877593 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c707a402d0 0x55c707a49170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:45:44.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.077+0000 7f37b999c700 1 -- 172.21.15.46:0/4163877593 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c707a3f5d0 msgr2=0x55c707a48c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:45:44.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.077+0000 7f37b999c700 1 --2- 172.21.15.46:0/4163877593 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c707a3f5d0 0x55c707a48c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:45:44.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.077+0000 7f37b999c700 1 -- 172.21.15.46:0/4163877593 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37b000bad0 con 0x55c707a4e1a0 2023-10-19T12:45:44.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.078+0000 7f37b919b700 1 --2- 172.21.15.46:0/4163877593 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c707a3f5d0 0x55c707a48c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T12:45:44.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.078+0000 7f37b999c700 1 --2- 172.21.15.46:0/4163877593 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c707a4e1a0 0x55c707a50590 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f37ac00ef90 tx=0x7f37ac09ad50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=13bac817c86274d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:45:44.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.078+0000 7f379cff9700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-10-19T12:45:44.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.079+0000 7f379cff9700 1 -- 172.21.15.46:0/4163877593 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37ac0b1070 con 0x55c707a4e1a0 2023-10-19T12:45:44.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.079+0000 7f379cff9700 1 -- 172.21.15.46:0/4163877593 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f37ac09e7a0 con 0x55c707a4e1a0 2023-10-19T12:45:44.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.079+0000 7f37cec87b80 1 -- 172.21.15.46:0/4163877593 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c707996ef0 con 0x55c707a4e1a0 2023-10-19T12:45:44.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.079+0000 7f379cff9700 1 -- 172.21.15.46:0/4163877593 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f37ac00ce10 con 0x55c707a4e1a0 2023-10-19T12:45:44.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.079+0000 7f37cec87b80 10 client.25882 fetch_fsmap learned FSMap version 32 2023-10-19T12:45:44.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.079+0000 7f37cec87b80 1 -- 172.21.15.46:0/4163877593 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55c7077bcde0 con 0x55c707a4e1a0 2023-10-19T12:45:44.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.080+0000 7f379cff9700 1 -- 172.21.15.46:0/4163877593 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55c707996ef0 con 0x55c707a4e1a0 2023-10-19T12:45:44.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.081+0000 7f379cff9700 1 -- 172.21.15.46:0/4163877593 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 32) v1 ==== 7926+0+0 (secure 0 0 0) 0x7f37ac0995b0 con 0x55c707a4e1a0 2023-10-19T12:45:44.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.081+0000 7f37cec87b80 10 client.25882 fetch_fsmap finished waiting for FSMap version 32 2023-10-19T12:45:44.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.081+0000 7f37cec87b80 10 client.25882 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-19T12:45:44.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.081+0000 7f37cec87b80 20 client.25882 populate_metadata read hostname 'smithi046' 2023-10-19T12:45:44.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.081+0000 7f37cec87b80 1 --2- 172.21.15.46:0/4163877593 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x55c707a54ec0 0x55c707a572e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:45:44.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.081+0000 7f37cec87b80 4 client.25882 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-19T12:45:44.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.081+0000 7f37cec87b80 1 -- 172.21.15.46:0/4163877593 --> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c707a0e8b0 con 0x55c707a54ec0 2023-10-19T12:45:44.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.081+0000 7f37b919b700 1 --2- 172.21.15.46:0/4163877593 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x55c707a54ec0 0x55c707a572e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:45:44.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.082+0000 7f37b919b700 1 --2- 172.21.15.46:0/4163877593 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x55c707a54ec0 0x55c707a572e0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e88ff3956345aa67 server_cookie=9d650d74b51b2fd0 in_seq=0 out_seq=0 2023-10-19T12:45:44.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.082+0000 7f379cff9700 10 client.25882 ms_handle_connect on v2:172.21.15.157:6838/552718978 2023-10-19T12:45:44.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.083+0000 7f379cff9700 1 -- 172.21.15.46:0/4163877593 <== mds.0 v2:172.21.15.157:6838/552718978 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c707a0e8b0 con 0x55c707a54ec0 2023-10-19T12:45:44.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.083+0000 7f379cff9700 10 client.25882 handle_command_reply: tid=0 2023-10-19T12:45:44.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.083+0000 7f37cec87b80 1 client.25882 shutdown 2023-10-19T12:45:44.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.084+0000 7f37cec87b80 1 -- 172.21.15.46:0/4163877593 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c707a4e1a0 msgr2=0x55c707a50590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:45:44.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.084+0000 7f37cec87b80 1 --2- 172.21.15.46:0/4163877593 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c707a4e1a0 0x55c707a50590 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f37ac00ef90 tx=0x7f37ac09ad50 comp rx=0 tx=0).stop 2023-10-19T12:45:44.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.084+0000 7f37cec87b80 1 -- 172.21.15.46:0/4163877593 shutdown_connections 2023-10-19T12:45:44.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.084+0000 7f37cec87b80 1 --2- 172.21.15.46:0/4163877593 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c707a4e1a0 0x55c707a50590 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:45:44.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.084+0000 7f37cec87b80 1 --2- 172.21.15.46:0/4163877593 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x55c707a54ec0 0x55c707a572e0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:45:44.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.084+0000 7f37cec87b80 1 --2- 172.21.15.46:0/4163877593 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c707a3f5d0 0x55c707a48c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:45:44.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.084+0000 7f379cff9700 0 client.25882 ms_handle_reset on v2:172.21.15.157:6838/552718978 2023-10-19T12:45:44.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.084+0000 7f37cec87b80 1 --2- 172.21.15.46:0/4163877593 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c707a402d0 0x55c707a49170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:45:44.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.084+0000 7f37cec87b80 1 -- 172.21.15.46:0/4163877593 >> 172.21.15.46:0/4163877593 conn(0x55c7079b3720 msgr2=0x55c707a3e080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:45:44.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.085+0000 7f37cec87b80 1 -- 172.21.15.46:0/4163877593 shutdown_connections 2023-10-19T12:45:44.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.085+0000 7f37cec87b80 1 -- 172.21.15.46:0/4163877593 wait complete. 2023-10-19T12:45:44.094 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:45:43 smithi157 ceph-mon[134109]: pgmap v420: 129 pgs: 129 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 MiB/s wr, 795 op/s 2023-10-19T12:45:44.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.085+0000 7f37cec87b80 20 client.25882 trim_cache size 0 max 16384 2023-10-19T12:45:44.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.121+0000 7f37cec87b80 1 Processor -- start 2023-10-19T12:45:44.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.121+0000 7f37cec87b80 1 -- start start 2023-10-19T12:45:44.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.122+0000 7f37cec87b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c707a3f5d0 0x55c707a48140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:45:44.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.122+0000 7f37cec87b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c707a402d0 0x55c707a345d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:45:44.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.122+0000 7f37cec87b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c707a4e1a0 0x55c707a64ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:45:44.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.123+0000 7f37cec87b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c707812920 con 0x55c707a3f5d0 2023-10-19T12:45:44.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.123+0000 7f37cec87b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c707a3f090 con 0x55c707a402d0 2023-10-19T12:45:44.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.123+0000 7f37cec87b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c707a3ff50 con 0x55c707a4e1a0 2023-10-19T12:45:44.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.123+0000 7f37b919b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c707a3f5d0 0x55c707a48140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:45:44.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.123+0000 7f37b919b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c707a3f5d0 0x55c707a48140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44988/0 (socket says 172.21.15.46:44988) 2023-10-19T12:45:44.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.123+0000 7f37b919b700 1 -- 172.21.15.46:0/170742668 learned_addr learned my addr 172.21.15.46:0/170742668 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:45:44.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.123+0000 7f37b999c700 1 --2- 172.21.15.46:0/170742668 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c707a4e1a0 0x55c707a64ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:45:44.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.124+0000 7f37b899a700 1 --2- 172.21.15.46:0/170742668 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c707a402d0 0x55c707a345d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:45:44.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.124+0000 7f37b919b700 1 -- 172.21.15.46:0/170742668 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c707a4e1a0 msgr2=0x55c707a64ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:45:44.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.124+0000 7f37b919b700 1 --2- 172.21.15.46:0/170742668 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c707a4e1a0 0x55c707a64ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:45:44.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.124+0000 7f37b919b700 1 -- 172.21.15.46:0/170742668 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c707a402d0 msgr2=0x55c707a345d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:45:44.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.124+0000 7f37b919b700 1 --2- 172.21.15.46:0/170742668 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c707a402d0 0x55c707a345d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:45:44.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.124+0000 7f37b919b700 1 -- 172.21.15.46:0/170742668 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c7077a5c60 con 0x55c707a3f5d0 2023-10-19T12:45:44.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.124+0000 7f37b899a700 1 --2- 172.21.15.46:0/170742668 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c707a402d0 0x55c707a345d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T12:45:44.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.124+0000 7f37b919b700 1 --2- 172.21.15.46:0/170742668 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c707a3f5d0 0x55c707a48140 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f37b0019000 tx=0x7f37b0003890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27ec0227cf53822a server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:45:44.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:45:43 smithi195 ceph-mon[134493]: pgmap v420: 129 pgs: 129 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 MiB/s wr, 795 op/s 2023-10-19T12:45:44.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.126+0000 7f379ffff700 1 -- 172.21.15.46:0/170742668 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b001e070 con 0x55c707a3f5d0 2023-10-19T12:45:44.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.126+0000 7f379ffff700 1 -- 172.21.15.46:0/170742668 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f37b002a070 con 0x55c707a3f5d0 2023-10-19T12:45:44.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.126+0000 7f379ffff700 1 -- 172.21.15.46:0/170742668 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b0005040 con 0x55c707a3f5d0 2023-10-19T12:45:44.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.129+0000 7f37cec87b80 1 -- 172.21.15.46:0/170742668 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c707a3f5d0 msgr2=0x55c707a48140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:45:44.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.129+0000 7f37cec87b80 1 --2- 172.21.15.46:0/170742668 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c707a3f5d0 0x55c707a48140 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f37b0019000 tx=0x7f37b0003890 comp rx=0 tx=0).stop 2023-10-19T12:45:44.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.130+0000 7f37cec87b80 1 -- 172.21.15.46:0/170742668 shutdown_connections 2023-10-19T12:45:44.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.130+0000 7f37cec87b80 1 --2- 172.21.15.46:0/170742668 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c707a4e1a0 0x55c707a64ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:45:44.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.130+0000 7f37cec87b80 1 --2- 172.21.15.46:0/170742668 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c707a3f5d0 0x55c707a48140 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:45:44.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.130+0000 7f37cec87b80 1 --2- 172.21.15.46:0/170742668 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c707a402d0 0x55c707a345d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:45:44.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.130+0000 7f37cec87b80 1 -- 172.21.15.46:0/170742668 >> 172.21.15.46:0/170742668 conn(0x55c7079b3720 msgr2=0x55c707a46b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:45:44.135 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.130+0000 7f37cec87b80 1 -- 172.21.15.46:0/170742668 shutdown_connections 2023-10-19T12:45:44.135 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.130+0000 7f37cec87b80 1 -- 172.21.15.46:0/170742668 wait complete. 2023-10-19T12:45:44.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.130+0000 7f37cec87b80 1 -- start start 2023-10-19T12:45:44.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.131+0000 7f37cec87b80 1 Processor -- start 2023-10-19T12:45:44.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.132+0000 7f37cec87b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c707a3f5d0 0x55c707aa1650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:45:44.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.132+0000 7f37cec87b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c707a402d0 0x55c707aa1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:45:44.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.132+0000 7f37cec87b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c707a4e1a0 0x55c707aa85c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:45:44.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.132+0000 7f37cec87b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c707aa8b00 con 0x55c707a402d0 2023-10-19T12:45:44.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.132+0000 7f37cec87b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c707aa8c40 con 0x55c707a3f5d0 2023-10-19T12:45:44.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.132+0000 7f37cec87b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c707aa8dd0 con 0x55c707a4e1a0 2023-10-19T12:45:44.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.132+0000 7f37cec87b80 10 client.0 _ll_register_callbacks cb 0x55c707878a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:45:44.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.133+0000 7f37b999c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c707a4e1a0 0x55c707aa85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:45:44.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.133+0000 7f37b999c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c707a4e1a0 0x55c707aa85c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:55484/0 (socket says 172.21.15.46:55484) 2023-10-19T12:45:44.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.133+0000 7f37b999c700 1 -- 172.21.15.46:0/1908153001 learned_addr learned my addr 172.21.15.46:0/1908153001 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:45:44.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.133+0000 7f37b919b700 1 --2- 172.21.15.46:0/1908153001 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c707a3f5d0 0x55c707aa1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:45:44.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.134+0000 7f37b899a700 1 --2- 172.21.15.46:0/1908153001 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c707a402d0 0x55c707aa1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:45:44.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.136+0000 7f37b999c700 1 -- 172.21.15.46:0/1908153001 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c707a3f5d0 msgr2=0x55c707aa1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:45:44.140 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.136+0000 7f37b999c700 1 --2- 172.21.15.46:0/1908153001 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c707a3f5d0 0x55c707aa1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:45:44.140 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.136+0000 7f37b999c700 1 -- 172.21.15.46:0/1908153001 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c707a402d0 msgr2=0x55c707aa1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:45:44.140 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.136+0000 7f37b999c700 1 --2- 172.21.15.46:0/1908153001 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c707a402d0 0x55c707aa1b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:45:44.140 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.136+0000 7f37b999c700 1 -- 172.21.15.46:0/1908153001 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c70794f3f0 con 0x55c707a4e1a0 2023-10-19T12:45:44.140 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.136+0000 7f37b919b700 1 --2- 172.21.15.46:0/1908153001 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c707a3f5d0 0x55c707aa1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:45:44.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.136+0000 7f37b999c700 1 --2- 172.21.15.46:0/1908153001 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c707a4e1a0 0x55c707aa85c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f37ac099ad0 tx=0x7f37ac0b2290 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9282aca6b821bf1a server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:45:44.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.139+0000 7f379cff9700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-10-19T12:45:44.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.140+0000 7f379cff9700 1 -- 172.21.15.46:0/1908153001 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37ac0b1070 con 0x55c707a4e1a0 2023-10-19T12:45:44.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.140+0000 7f379cff9700 1 -- 172.21.15.46:0/1908153001 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f37ac00ce10 con 0x55c707a4e1a0 2023-10-19T12:45:44.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.141+0000 7f37cec87b80 1 -- 172.21.15.46:0/1908153001 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f37b0015070 con 0x55c707a4e1a0 2023-10-19T12:45:44.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.142+0000 7f379cff9700 1 -- 172.21.15.46:0/1908153001 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f37ac003a00 con 0x55c707a4e1a0 2023-10-19T12:45:44.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.142+0000 7f37cec87b80 10 client.25888 fetch_fsmap learned FSMap version 32 2023-10-19T12:45:44.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.142+0000 7f37cec87b80 1 -- 172.21.15.46:0/1908153001 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55c7077e3250 con 0x55c707a4e1a0 2023-10-19T12:45:44.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.142+0000 7f379cff9700 1 -- 172.21.15.46:0/1908153001 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f37b0015070 con 0x55c707a4e1a0 2023-10-19T12:45:44.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.143+0000 7f379cff9700 1 -- 172.21.15.46:0/1908153001 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 32) v1 ==== 7926+0+0 (secure 0 0 0) 0x7f37ac080070 con 0x55c707a4e1a0 2023-10-19T12:45:44.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.143+0000 7f37cec87b80 10 client.25888 fetch_fsmap finished waiting for FSMap version 32 2023-10-19T12:45:44.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.143+0000 7f37cec87b80 10 client.25888 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-19T12:45:44.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.143+0000 7f37cec87b80 20 client.25888 populate_metadata read hostname 'smithi046' 2023-10-19T12:45:44.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.143+0000 7f37cec87b80 1 --2- 172.21.15.46:0/1908153001 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x55c707aaa550 0x55c707aac970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:45:44.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.143+0000 7f37cec87b80 4 client.25888 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-19T12:45:44.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.143+0000 7f37cec87b80 1 -- 172.21.15.46:0/1908153001 --> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55c70798ae50 con 0x55c707aaa550 2023-10-19T12:45:44.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.146+0000 7f37b919b700 1 --2- 172.21.15.46:0/1908153001 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x55c707aaa550 0x55c707aac970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:45:44.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.148+0000 7f37b919b700 1 --2- 172.21.15.46:0/1908153001 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x55c707aaa550 0x55c707aac970 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c921179612b8ec3 server_cookie=d7c6863cf6177274 in_seq=0 out_seq=0 2023-10-19T12:45:44.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.148+0000 7f379cff9700 10 client.25888 ms_handle_connect on v2:172.21.15.157:6838/552718978 2023-10-19T12:45:44.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.152+0000 7f379cff9700 1 -- 172.21.15.46:0/1908153001 <== mds.0 v2:172.21.15.157:6838/552718978 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55c70798ae50 con 0x55c707aaa550 2023-10-19T12:45:44.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.152+0000 7f379cff9700 10 client.25888 handle_command_reply: tid=0 2023-10-19T12:45:44.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.152+0000 7f37cec87b80 1 client.25888 shutdown 2023-10-19T12:45:44.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.153+0000 7f37cec87b80 1 -- 172.21.15.46:0/1908153001 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c707a4e1a0 msgr2=0x55c707aa85c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:45:44.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.153+0000 7f37cec87b80 1 --2- 172.21.15.46:0/1908153001 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c707a4e1a0 0x55c707aa85c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f37ac099ad0 tx=0x7f37ac0b2290 comp rx=0 tx=0).stop 2023-10-19T12:45:44.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.153+0000 7f37cec87b80 1 -- 172.21.15.46:0/1908153001 shutdown_connections 2023-10-19T12:45:44.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.153+0000 7f37cec87b80 1 --2- 172.21.15.46:0/1908153001 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c707a4e1a0 0x55c707aa85c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:45:44.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.153+0000 7f37cec87b80 1 --2- 172.21.15.46:0/1908153001 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c707a3f5d0 0x55c707aa1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:45:44.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.153+0000 7f37cec87b80 1 --2- 172.21.15.46:0/1908153001 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x55c707aaa550 0x55c707aac970 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:45:44.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.153+0000 7f379cff9700 0 client.25888 ms_handle_reset on v2:172.21.15.157:6838/552718978 2023-10-19T12:45:44.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.153+0000 7f37cec87b80 1 --2- 172.21.15.46:0/1908153001 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c707a402d0 0x55c707aa1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:45:44.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.153+0000 7f37cec87b80 1 -- 172.21.15.46:0/1908153001 >> 172.21.15.46:0/1908153001 conn(0x55c7079b3720 msgr2=0x55c707a432d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:45:44.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.154+0000 7f37cec87b80 1 -- 172.21.15.46:0/1908153001 shutdown_connections 2023-10-19T12:45:44.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.155+0000 7f37cec87b80 1 -- 172.21.15.46:0/1908153001 wait complete. 2023-10-19T12:45:44.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.155+0000 7f37cec87b80 20 client.25888 trim_cache size 0 max 16384 2023-10-19T12:45:44.160 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-10-19T12:45:44.160 INFO:teuthology.orchestra.run.smithi046.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-19T12:45:44.161 INFO:teuthology.orchestra.run.smithi046.stdout: "scrubs": { 2023-10-19T12:45:44.161 INFO:teuthology.orchestra.run.smithi046.stdout: "21e73f70-af16-4ae7-bc34-e6c54ba8e1ec": { 2023-10-19T12:45:44.161 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2023-10-19T12:45:44.161 INFO:teuthology.orchestra.run.smithi046.stdout: "tag": "21e73f70-af16-4ae7-bc34-e6c54ba8e1ec", 2023-10-19T12:45:44.161 INFO:teuthology.orchestra.run.smithi046.stdout: "options": "recursive,force" 2023-10-19T12:45:44.162 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:45:44.162 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:45:44.162 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-10-19T12:45:44.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.156+0000 7f37bb3ff700 1 -- 172.21.15.46:0/3224484280 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f37a00a15e0 msgr2=0x7f37a00a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:45:44.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.156+0000 7f37bb3ff700 1 --2- 172.21.15.46:0/3224484280 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f37a00a15e0 0x7f37a00a3aa0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f37a4005950 tx=0x7f37a40058e0 comp rx=0 tx=0).stop 2023-10-19T12:45:44.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.156+0000 7f37bb3ff700 1 -- 172.21.15.46:0/3224484280 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f37b4102360 msgr2=0x7f37b419fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:45:44.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.156+0000 7f37bb3ff700 1 --2- 172.21.15.46:0/3224484280 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f37b4102360 0x7f37b419fe90 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f37ac00efc0 tx=0x7f37ac00c3a0 comp rx=0 tx=0).stop 2023-10-19T12:45:44.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.157+0000 7f37bb3ff700 1 -- 172.21.15.46:0/3224484280 shutdown_connections 2023-10-19T12:45:44.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.157+0000 7f37bb3ff700 1 --2- 172.21.15.46:0/3224484280 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f37b4102360 0x7f37b419fe90 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:45:44.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.157+0000 7f37bb3ff700 1 --2- 172.21.15.46:0/3224484280 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37b41007d0 0x7f37b4198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:45:44.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.157+0000 7f37bb3ff700 1 --2- 172.21.15.46:0/3224484280 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f37a00a15e0 0x7f37a00a3aa0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:45:44.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.157+0000 7f37bb3ff700 1 --2- 172.21.15.46:0/3224484280 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37b41019c0 0x7f37b4198e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:45:44.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.157+0000 7f37bb3ff700 1 -- 172.21.15.46:0/3224484280 >> 172.21.15.46:0/3224484280 conn(0x7f37b40fbd40 msgr2=0x7f37b4104ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:45:44.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.157+0000 7f37bb3ff700 1 -- 172.21.15.46:0/3224484280 shutdown_connections 2023-10-19T12:45:44.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:45:44.157+0000 7f37bb3ff700 1 -- 172.21.15.46:0/3224484280 wait complete. 2023-10-19T12:45:44.195 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:45:43 smithi046 ceph-mon[98509]: pgmap v420: 129 pgs: 129 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 MiB/s wr, 795 op/s 2023-10-19T12:45:44.199 INFO:tasks.cephfs.filesystem:scrub status for tag:21e73f70-af16-4ae7-bc34-e6c54ba8e1ec - {'path': '/', 'tag': '21e73f70-af16-4ae7-bc34-e6c54ba8e1ec', 'options': 'recursive,force'} 2023-10-19T12:45:46.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:45:45 smithi157 ceph-mon[134109]: pgmap v421: 129 pgs: 129 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 9.7 MiB/s wr, 645 op/s 2023-10-19T12:45:46.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:45:45 smithi195 ceph-mon[134493]: pgmap v421: 129 pgs: 129 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 9.7 MiB/s wr, 645 op/s 2023-10-19T12:45:46.233 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:45:45 smithi046 ceph-mon[98509]: pgmap v421: 129 pgs: 129 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 9.7 MiB/s wr, 645 op/s 2023-10-19T12:45:46.702 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 105.0 s, 1059.2 tps, lat 93.491 ms stddev 112.281 2023-10-19T12:45:47.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:45:46 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:45:47.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:45:46 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:45:47.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:45:46 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:45:47.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:45:46 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:45:47.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:45:46 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:45:47.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:45:46 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:45:47.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:45:46 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:45:47.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:45:46 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:45:47.133 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:45:46 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:45:47.133 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:45:46 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:45:47.232 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:45:46 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:45:47.232 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:45:46 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:45:47.232 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:45:46 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:45:47.233 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:45:46 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:45:47.233 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:45:46 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:45:48.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:45:47 smithi157 ceph-mon[134109]: pgmap v422: 129 pgs: 129 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 13 MiB/s wr, 829 op/s 2023-10-19T12:45:48.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:45:47 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:45:48.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:45:47 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:45:48.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:45:47 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:45:48.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:45:47 smithi195 ceph-mon[134493]: pgmap v422: 129 pgs: 129 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 13 MiB/s wr, 829 op/s 2023-10-19T12:45:48.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:45:47 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:45:48.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:45:47 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:45:48.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:45:47 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:45:48.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:45:47 smithi046 ceph-mon[98509]: pgmap v422: 129 pgs: 129 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 13 MiB/s wr, 829 op/s 2023-10-19T12:45:48.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:45:47 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:45:48.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:45:47 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:45:48.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:45:47 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:45:49.732 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:45:49 smithi046 ceph-mon[98509]: pgmap v423: 129 pgs: 129 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 13 MiB/s wr, 767 op/s 2023-10-19T12:45:49.837 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:45:49 smithi157 ceph-mon[134109]: pgmap v423: 129 pgs: 129 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 13 MiB/s wr, 767 op/s 2023-10-19T12:45:49.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:45:49 smithi195 ceph-mon[134493]: pgmap v423: 129 pgs: 129 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 13 MiB/s wr, 767 op/s 2023-10-19T12:45:51.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 110.0 s, 1095.2 tps, lat 91.246 ms stddev 109.698 2023-10-19T12:45:52.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:45:51 smithi157 ceph-mon[134109]: pgmap v424: 129 pgs: 129 active+clean; 1.5 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 14 MiB/s wr, 754 op/s 2023-10-19T12:45:52.133 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:45:51 smithi195 ceph-mon[134493]: pgmap v424: 129 pgs: 129 active+clean; 1.5 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 14 MiB/s wr, 754 op/s 2023-10-19T12:45:52.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:45:51 smithi046 ceph-mon[98509]: pgmap v424: 129 pgs: 129 active+clean; 1.5 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 14 MiB/s wr, 754 op/s 2023-10-19T12:45:54.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:45:53 smithi157 ceph-mon[134109]: pgmap v425: 129 pgs: 129 active+clean; 1.5 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 15 MiB/s wr, 834 op/s 2023-10-19T12:45:54.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:45:53 smithi195 ceph-mon[134493]: pgmap v425: 129 pgs: 129 active+clean; 1.5 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 15 MiB/s wr, 834 op/s 2023-10-19T12:45:54.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:45:53 smithi046 ceph-mon[98509]: pgmap v425: 129 pgs: 129 active+clean; 1.5 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 15 MiB/s wr, 834 op/s 2023-10-19T12:45:56.091 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:45:55 smithi157 ceph-mon[134109]: pgmap v426: 129 pgs: 129 active+clean; 1.5 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 13 MiB/s wr, 660 op/s 2023-10-19T12:45:56.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:45:55 smithi195 ceph-mon[134493]: pgmap v426: 129 pgs: 129 active+clean; 1.5 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 13 MiB/s wr, 660 op/s 2023-10-19T12:45:56.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:45:55 smithi046 ceph-mon[98509]: pgmap v426: 129 pgs: 129 active+clean; 1.5 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 13 MiB/s wr, 660 op/s 2023-10-19T12:45:56.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 115.0 s, 1252.5 tps, lat 78.940 ms stddev 99.341 2023-10-19T12:45:58.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:45:57 smithi157 ceph-mon[134109]: pgmap v427: 129 pgs: 129 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 15 MiB/s wr, 792 op/s 2023-10-19T12:45:58.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:45:57 smithi195 ceph-mon[134493]: pgmap v427: 129 pgs: 129 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 15 MiB/s wr, 792 op/s 2023-10-19T12:45:58.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:45:57 smithi046 ceph-mon[98509]: pgmap v427: 129 pgs: 129 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 15 MiB/s wr, 792 op/s 2023-10-19T12:45:59.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:45:59 smithi046 ceph-mon[98509]: pgmap v428: 129 pgs: 129 active+clean; 1.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 13 MiB/s wr, 639 op/s 2023-10-19T12:45:59.838 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:45:59 smithi157 ceph-mon[134109]: pgmap v428: 129 pgs: 129 active+clean; 1.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 13 MiB/s wr, 639 op/s 2023-10-19T12:45:59.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:45:59 smithi195 ceph-mon[134493]: pgmap v428: 129 pgs: 129 active+clean; 1.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 13 MiB/s wr, 639 op/s 2023-10-19T12:46:00.730 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:46:00 smithi046 ceph-mon[98509]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-19T12:46:00.837 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:46:00 smithi157 ceph-mon[134109]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-19T12:46:00.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:46:00 smithi195 ceph-mon[134493]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-19T12:46:01.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 120.0 s, 1068.0 tps, lat 94.465 ms stddev 112.793 2023-10-19T12:46:01.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:46:01 smithi046 ceph-mon[98509]: pgmap v429: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 13 MiB/s wr, 623 op/s 2023-10-19T12:46:01.837 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:46:01 smithi157 ceph-mon[134109]: pgmap v429: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 13 MiB/s wr, 623 op/s 2023-10-19T12:46:01.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:46:01 smithi195 ceph-mon[134493]: pgmap v429: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 13 MiB/s wr, 623 op/s 2023-10-19T12:46:04.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:46:03 smithi157 ceph-mon[134109]: pgmap v430: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 15 MiB/s wr, 791 op/s 2023-10-19T12:46:04.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:46:03 smithi195 ceph-mon[134493]: pgmap v430: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 15 MiB/s wr, 791 op/s 2023-10-19T12:46:04.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:46:03 smithi046 ceph-mon[98509]: pgmap v430: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 15 MiB/s wr, 791 op/s 2023-10-19T12:46:06.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:46:05 smithi157 ceph-mon[134109]: pgmap v431: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 MiB/s wr, 631 op/s 2023-10-19T12:46:06.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:46:05 smithi157 ceph-mon[134109]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-19T12:46:06.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:46:05 smithi195 ceph-mon[134493]: pgmap v431: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 MiB/s wr, 631 op/s 2023-10-19T12:46:06.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:46:05 smithi195 ceph-mon[134493]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-19T12:46:06.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:46:05 smithi046 ceph-mon[98509]: pgmap v431: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 MiB/s wr, 631 op/s 2023-10-19T12:46:06.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:46:05 smithi046 ceph-mon[98509]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-19T12:46:06.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 125.0 s, 816.2 tps, lat 88.792 ms stddev 201.361 2023-10-19T12:46:08.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:46:07 smithi195 ceph-mon[134493]: pgmap v432: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 22 MiB/s wr, 1.33k op/s 2023-10-19T12:46:08.232 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:46:07 smithi046 ceph-mon[98509]: pgmap v432: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 22 MiB/s wr, 1.33k op/s 2023-10-19T12:46:08.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:46:07 smithi157 ceph-mon[134109]: pgmap v432: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 22 MiB/s wr, 1.33k op/s 2023-10-19T12:46:09.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:46:09 smithi046 ceph-mon[98509]: pgmap v433: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 MiB/s wr, 1.54k op/s 2023-10-19T12:46:09.837 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:46:09 smithi157 ceph-mon[134109]: pgmap v433: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 MiB/s wr, 1.54k op/s 2023-10-19T12:46:09.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:46:09 smithi195 ceph-mon[134493]: pgmap v433: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 MiB/s wr, 1.54k op/s 2023-10-19T12:46:11.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 130.0 s, 1186.2 tps, lat 108.543 ms stddev 262.616 2023-10-19T12:46:12.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:46:11 smithi157 ceph-mon[134109]: pgmap v434: 129 pgs: 129 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 MiB/s wr, 1.65k op/s 2023-10-19T12:46:12.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:46:11 smithi195 ceph-mon[134493]: pgmap v434: 129 pgs: 129 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 MiB/s wr, 1.65k op/s 2023-10-19T12:46:12.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:46:11 smithi046 ceph-mon[98509]: pgmap v434: 129 pgs: 129 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 MiB/s wr, 1.65k op/s 2023-10-19T12:46:14.092 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:46:13 smithi157 ceph-mon[134109]: pgmap v435: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 29 MiB/s wr, 1.84k op/s 2023-10-19T12:46:14.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:46:13 smithi195 ceph-mon[134493]: pgmap v435: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 29 MiB/s wr, 1.84k op/s 2023-10-19T12:46:14.200 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-19T12:46:14.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:46:13 smithi046 ceph-mon[98509]: pgmap v435: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 29 MiB/s wr, 1.84k op/s 2023-10-19T12:46:14.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.577+0000 7fdc8ffff700 1 -- 172.21.15.46:0/617663879 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdc880ff000 msgr2=0x7fdc88101430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:46:14.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.577+0000 7fdc8ffff700 1 --2- 172.21.15.46:0/617663879 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdc880ff000 0x7fdc88101430 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fdc84009990 tx=0x7fdc84009ca0 comp rx=0 tx=0).stop 2023-10-19T12:46:14.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.578+0000 7fdc8ffff700 1 -- 172.21.15.46:0/617663879 shutdown_connections 2023-10-19T12:46:14.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.578+0000 7fdc8ffff700 1 --2- 172.21.15.46:0/617663879 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdc88104340 0x7fdc881047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:46:14.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.578+0000 7fdc8ffff700 1 --2- 172.21.15.46:0/617663879 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdc880ff000 0x7fdc88101430 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:46:14.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.579+0000 7fdc8ffff700 1 --2- 172.21.15.46:0/617663879 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc88101970 0x7fdc88103e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:46:14.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.579+0000 7fdc8ffff700 1 -- 172.21.15.46:0/617663879 >> 172.21.15.46:0/617663879 conn(0x7fdc880fac00 msgr2=0x7fdc880fd040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:46:14.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.579+0000 7fdc8ffff700 1 -- 172.21.15.46:0/617663879 shutdown_connections 2023-10-19T12:46:14.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.579+0000 7fdc8ffff700 1 -- 172.21.15.46:0/617663879 wait complete. 2023-10-19T12:46:14.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.583+0000 7fdc8ffff700 1 Processor -- start 2023-10-19T12:46:14.586 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.584+0000 7fdc8ffff700 1 -- start start 2023-10-19T12:46:14.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.584+0000 7fdc8ffff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdc880ff000 0x7fdc8806f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:46:14.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.584+0000 7fdc8ffff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdc88101970 0x7fdc8806f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:46:14.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.584+0000 7fdc8ffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc88104340 0x7fdc881acea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:46:14.589 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.585+0000 7fdc8ffff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc88072670 con 0x7fdc88104340 2023-10-19T12:46:14.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.585+0000 7fdc8ffff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc880727e0 con 0x7fdc88101970 2023-10-19T12:46:14.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.585+0000 7fdc8ffff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc881ad3e0 con 0x7fdc880ff000 2023-10-19T12:46:14.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.585+0000 7fdc8dd9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdc880ff000 0x7fdc8806f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:46:14.590 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.585+0000 7fdc8dd9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdc880ff000 0x7fdc8806f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:55524/0 (socket says 172.21.15.46:55524) 2023-10-19T12:46:14.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.585+0000 7fdc8dd9b700 1 -- 172.21.15.46:0/3841458207 learned_addr learned my addr 172.21.15.46:0/3841458207 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:46:14.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.586+0000 7fdc8dd9b700 1 -- 172.21.15.46:0/3841458207 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdc88101970 msgr2=0x7fdc8806f5e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-19T12:46:14.591 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.586+0000 7fdc8dd9b700 1 --2- 172.21.15.46:0/3841458207 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdc88101970 0x7fdc8806f5e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:46:14.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.586+0000 7fdc8dd9b700 1 -- 172.21.15.46:0/3841458207 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc88104340 msgr2=0x7fdc881acea0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-19T12:46:14.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.586+0000 7fdc8dd9b700 1 --2- 172.21.15.46:0/3841458207 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc88104340 0x7fdc881acea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:46:14.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.586+0000 7fdc8dd9b700 1 -- 172.21.15.46:0/3841458207 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc840095f0 con 0x7fdc880ff000 2023-10-19T12:46:14.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.586+0000 7fdc8dd9b700 1 --2- 172.21.15.46:0/3841458207 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdc880ff000 0x7fdc8806f0a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fdc8400b5c0 tx=0x7fdc84003cb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:46:14.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.586+0000 7fdc7effd700 1 -- 172.21.15.46:0/3841458207 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc8401d070 con 0x7fdc880ff000 2023-10-19T12:46:14.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.587+0000 7fdc8ffff700 1 -- 172.21.15.46:0/3841458207 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc881ad5e0 con 0x7fdc880ff000 2023-10-19T12:46:14.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.587+0000 7fdc7effd700 1 -- 172.21.15.46:0/3841458207 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdc8400f460 con 0x7fdc880ff000 2023-10-19T12:46:14.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.587+0000 7fdc7effd700 1 -- 172.21.15.46:0/3841458207 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc84017650 con 0x7fdc880ff000 2023-10-19T12:46:14.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.588+0000 7fdc8ffff700 1 -- 172.21.15.46:0/3841458207 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc881ad950 con 0x7fdc880ff000 2023-10-19T12:46:14.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.600+0000 7fdc7effd700 1 -- 172.21.15.46:0/3841458207 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fdc840052d0 con 0x7fdc880ff000 2023-10-19T12:46:14.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.603+0000 7fdca3823b80 1 Processor -- start 2023-10-19T12:46:14.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.603+0000 7fdca3823b80 1 -- start start 2023-10-19T12:46:14.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.604+0000 7fdca3823b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563566f232d0 0x563566f236f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:46:14.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.604+0000 7fdca3823b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563566f23c30 0x563566f22090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:46:14.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.604+0000 7fdca3823b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563566f225d0 0x563566f22a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:46:14.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.604+0000 7fdca3823b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x563566e956e0 con 0x563566f23c30 2023-10-19T12:46:14.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.604+0000 7fdca3823b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x563566e7bc60 con 0x563566f232d0 2023-10-19T12:46:14.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.604+0000 7fdca3823b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x563566e79580 con 0x563566f225d0 2023-10-19T12:46:14.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.604+0000 7fdc8e59c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563566f232d0 0x563566f236f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:46:14.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.605+0000 7fdc8d59a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563566f225d0 0x563566f22a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:46:14.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.605+0000 7fdc8e59c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563566f232d0 0x563566f236f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:35040/0 (socket says 172.21.15.46:35040) 2023-10-19T12:46:14.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.605+0000 7fdc8d59a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563566f225d0 0x563566f22a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:55540/0 (socket says 172.21.15.46:55540) 2023-10-19T12:46:14.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.605+0000 7fdc8e59c700 1 -- 172.21.15.46:0/579908442 learned_addr learned my addr 172.21.15.46:0/579908442 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:46:14.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.606+0000 7fdc7effd700 1 --2- 172.21.15.46:0/3841458207 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fdc740a1550 0x7fdc740a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:46:14.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.606+0000 7fdc7effd700 1 -- 172.21.15.46:0/3841458207 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7fdc840d1170 con 0x7fdc880ff000 2023-10-19T12:46:14.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.607+0000 7fdc8dd9b700 1 --2- 172.21.15.46:0/579908442 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563566f23c30 0x563566f22090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:46:14.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.607+0000 7fdc8dd9b700 1 -- 172.21.15.46:0/579908442 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563566f225d0 msgr2=0x563566f22a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:46:14.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.607+0000 7fdc8dd9b700 1 --2- 172.21.15.46:0/579908442 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563566f225d0 0x563566f22a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:46:14.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.607+0000 7fdc8dd9b700 1 -- 172.21.15.46:0/579908442 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563566f232d0 msgr2=0x563566f236f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:46:14.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.607+0000 7fdc8dd9b700 1 --2- 172.21.15.46:0/579908442 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563566f232d0 0x563566f236f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:46:14.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.607+0000 7fdc8dd9b700 1 -- 172.21.15.46:0/579908442 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563566e323f0 con 0x563566f23c30 2023-10-19T12:46:14.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.607+0000 7fdc8e59c700 1 --2- 172.21.15.46:0/3841458207 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fdc740a1550 0x7fdc740a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:46:14.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.608+0000 7fdc8d59a700 1 --2- 172.21.15.46:0/579908442 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563566f225d0 0x563566f22a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:46:14.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.608+0000 7fdc8dd9b700 1 --2- 172.21.15.46:0/579908442 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563566f23c30 0x563566f22090 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fdc880729a0 tx=0x7fdc8400fc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=891dd5e1e71619d server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:46:14.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.609+0000 7fdc73fff700 1 -- 172.21.15.46:0/579908442 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc8409a5a0 con 0x563566f23c30 2023-10-19T12:46:14.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.609+0000 7fdc73fff700 1 -- 172.21.15.46:0/579908442 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdc8409a3c0 con 0x563566f23c30 2023-10-19T12:46:14.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.609+0000 7fdc73fff700 1 -- 172.21.15.46:0/579908442 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc84005580 con 0x563566f23c30 2023-10-19T12:46:14.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.609+0000 7fdc8e59c700 1 --2- 172.21.15.46:0/3841458207 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fdc740a1550 0x7fdc740a3a10 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fdc80007ae0 tx=0x7fdc80004ad0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:46:14.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.610+0000 7fdca3823b80 1 -- 172.21.15.46:0/579908442 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563566f23c30 msgr2=0x563566f22090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:46:14.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.610+0000 7fdca3823b80 1 --2- 172.21.15.46:0/579908442 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563566f23c30 0x563566f22090 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fdc880729a0 tx=0x7fdc8400fc50 comp rx=0 tx=0).stop 2023-10-19T12:46:14.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.610+0000 7fdca3823b80 1 -- 172.21.15.46:0/579908442 shutdown_connections 2023-10-19T12:46:14.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.610+0000 7fdca3823b80 1 --2- 172.21.15.46:0/579908442 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563566f225d0 0x563566f22a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:46:14.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.610+0000 7fdca3823b80 1 --2- 172.21.15.46:0/579908442 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563566f232d0 0x563566f236f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:46:14.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.610+0000 7fdca3823b80 1 --2- 172.21.15.46:0/579908442 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563566f23c30 0x563566f22090 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:46:14.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.610+0000 7fdca3823b80 1 -- 172.21.15.46:0/579908442 >> 172.21.15.46:0/579908442 conn(0x563566e96720 msgr2=0x563566f1cb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:46:14.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.611+0000 7fdca3823b80 1 -- 172.21.15.46:0/579908442 shutdown_connections 2023-10-19T12:46:14.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.611+0000 7fdca3823b80 1 -- 172.21.15.46:0/579908442 wait complete. 2023-10-19T12:46:14.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.612+0000 7fdca3823b80 1 -- start start 2023-10-19T12:46:14.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.612+0000 7fdca3823b80 1 Processor -- start 2023-10-19T12:46:14.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.613+0000 7fdca3823b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563566f225d0 0x563566f2b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:46:14.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.613+0000 7fdca3823b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563566f232d0 0x563566f2bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:46:14.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.613+0000 7fdca3823b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563566f30f30 0x563566f33320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:46:14.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.613+0000 7fdca3823b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x563566e74e70 con 0x563566f30f30 2023-10-19T12:46:14.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.613+0000 7fdca3823b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x563566e11710 con 0x563566f225d0 2023-10-19T12:46:14.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.613+0000 7fdca3823b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x563566e113b0 con 0x563566f232d0 2023-10-19T12:46:14.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.613+0000 7fdca3823b80 10 client.0 _ll_register_callbacks cb 0x563566d5ba80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:46:14.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.613+0000 7fdc8dd9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563566f225d0 0x563566f2b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:46:14.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.614+0000 7fdc8d59a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563566f232d0 0x563566f2bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:46:14.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.614+0000 7fdc8d59a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563566f232d0 0x563566f2bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:55548/0 (socket says 172.21.15.46:55548) 2023-10-19T12:46:14.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.614+0000 7fdc8d59a700 1 -- 172.21.15.46:0/2873677906 learned_addr learned my addr 172.21.15.46:0/2873677906 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:46:14.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.614+0000 7fdc8d59a700 1 -- 172.21.15.46:0/2873677906 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563566f225d0 msgr2=0x563566f2b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:46:14.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.615+0000 7fdc8d59a700 1 --2- 172.21.15.46:0/2873677906 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563566f225d0 0x563566f2b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:46:14.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.615+0000 7fdc8d59a700 1 -- 172.21.15.46:0/2873677906 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563566f30f30 msgr2=0x563566f33320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:46:14.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.615+0000 7fdc8d59a700 1 --2- 172.21.15.46:0/2873677906 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563566f30f30 0x563566f33320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:46:14.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.615+0000 7fdc8d59a700 1 -- 172.21.15.46:0/2873677906 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc7800b690 con 0x563566f232d0 2023-10-19T12:46:14.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.615+0000 7fdc8dd9b700 1 --2- 172.21.15.46:0/2873677906 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563566f225d0 0x563566f2b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T12:46:14.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.616+0000 7fdc717fa700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-10-19T12:46:14.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.616+0000 7fdc8d59a700 1 --2- 172.21.15.46:0/2873677906 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563566f232d0 0x563566f2bf00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fdc7800bad0 tx=0x7fdc7800be90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7577159fe47ee0fc server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:46:14.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.617+0000 7fdc717fa700 1 -- 172.21.15.46:0/2873677906 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc7801a670 con 0x563566f232d0 2023-10-19T12:46:14.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.617+0000 7fdc717fa700 1 -- 172.21.15.46:0/2873677906 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7fdc78003e40 con 0x563566f232d0 2023-10-19T12:46:14.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.618+0000 7fdca3823b80 1 -- 172.21.15.46:0/2873677906 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563566e79ef0 con 0x563566f232d0 2023-10-19T12:46:14.624 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.618+0000 7fdc717fa700 1 -- 172.21.15.46:0/2873677906 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdc7801a7d0 con 0x563566f232d0 2023-10-19T12:46:14.624 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.618+0000 7fdca3823b80 10 client.25900 fetch_fsmap learned FSMap version 34 2023-10-19T12:46:14.624 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.618+0000 7fdca3823b80 1 -- 172.21.15.46:0/2873677906 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x7fdc881ad950 con 0x563566f232d0 2023-10-19T12:46:14.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.619+0000 7fdc717fa700 1 -- 172.21.15.46:0/2873677906 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x563566e79ef0 con 0x563566f232d0 2023-10-19T12:46:14.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.620+0000 7fdc717fa700 1 -- 172.21.15.46:0/2873677906 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 34) v1 ==== 7934+0+0 (secure 0 0 0) 0x7fdc7801a930 con 0x563566f232d0 2023-10-19T12:46:14.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.620+0000 7fdca3823b80 10 client.25900 fetch_fsmap finished waiting for FSMap version 34 2023-10-19T12:46:14.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.620+0000 7fdca3823b80 10 client.25900 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-19T12:46:14.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.621+0000 7fdca3823b80 20 client.25900 populate_metadata read hostname 'smithi046' 2023-10-19T12:46:14.626 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.621+0000 7fdca3823b80 1 --2- 172.21.15.46:0/2873677906 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x563566f48c00 0x563566f4b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:46:14.626 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.621+0000 7fdca3823b80 4 client.25900 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-19T12:46:14.626 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.621+0000 7fdca3823b80 1 -- 172.21.15.46:0/2873677906 --> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563566ef18b0 con 0x563566f48c00 2023-10-19T12:46:14.626 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.621+0000 7fdc8dd9b700 1 --2- 172.21.15.46:0/2873677906 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x563566f48c00 0x563566f4b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:46:14.627 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.622+0000 7fdc717fa700 10 client.25900 ms_handle_connect on v2:172.21.15.157:6838/552718978 2023-10-19T12:46:14.627 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.622+0000 7fdc8dd9b700 1 --2- 172.21.15.46:0/2873677906 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x563566f48c00 0x563566f4b020 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7967553af87d98d4 server_cookie=65b4abd65a29de6d in_seq=0 out_seq=0 2023-10-19T12:46:14.628 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.623+0000 7fdc717fa700 1 -- 172.21.15.46:0/2873677906 <== mds.0 v2:172.21.15.157:6838/552718978 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x563566ef18b0 con 0x563566f48c00 2023-10-19T12:46:14.628 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.623+0000 7fdc717fa700 10 client.25900 handle_command_reply: tid=0 2023-10-19T12:46:14.628 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.623+0000 7fdca3823b80 1 client.25900 shutdown 2023-10-19T12:46:14.628 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.624+0000 7fdca3823b80 1 -- 172.21.15.46:0/2873677906 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563566f232d0 msgr2=0x563566f2bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:46:14.628 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.624+0000 7fdca3823b80 1 --2- 172.21.15.46:0/2873677906 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563566f232d0 0x563566f2bf00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fdc7800bad0 tx=0x7fdc7800be90 comp rx=0 tx=0).stop 2023-10-19T12:46:14.629 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.624+0000 7fdca3823b80 1 -- 172.21.15.46:0/2873677906 shutdown_connections 2023-10-19T12:46:14.629 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.624+0000 7fdca3823b80 1 --2- 172.21.15.46:0/2873677906 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x563566f48c00 0x563566f4b020 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:46:14.629 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.624+0000 7fdca3823b80 1 --2- 172.21.15.46:0/2873677906 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563566f30f30 0x563566f33320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:46:14.629 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.624+0000 7fdca3823b80 1 --2- 172.21.15.46:0/2873677906 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563566f225d0 0x563566f2b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:46:14.629 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.624+0000 7fdca3823b80 1 --2- 172.21.15.46:0/2873677906 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563566f232d0 0x563566f2bf00 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:46:14.630 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.624+0000 7fdca3823b80 1 -- 172.21.15.46:0/2873677906 >> 172.21.15.46:0/2873677906 conn(0x563566e96720 msgr2=0x563566f21080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:46:14.630 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.624+0000 7fdc717fa700 0 client.25900 ms_handle_reset on v2:172.21.15.157:6838/552718978 2023-10-19T12:46:14.630 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.624+0000 7fdca3823b80 1 -- 172.21.15.46:0/2873677906 shutdown_connections 2023-10-19T12:46:14.630 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.624+0000 7fdca3823b80 1 -- 172.21.15.46:0/2873677906 wait complete. 2023-10-19T12:46:14.631 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.624+0000 7fdca3823b80 20 client.25900 trim_cache size 0 max 16384 2023-10-19T12:46:14.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.656+0000 7fdca3823b80 1 Processor -- start 2023-10-19T12:46:14.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.656+0000 7fdca3823b80 1 -- start start 2023-10-19T12:46:14.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.657+0000 7fdca3823b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563566f225d0 0x563566f22090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:46:14.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.657+0000 7fdca3823b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563566f232d0 0x563566f44a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:46:14.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.657+0000 7fdca3823b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563566f30f30 0x563566f2a510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:46:14.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.657+0000 7fdca3823b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x563566cf5920 con 0x563566f30f30 2023-10-19T12:46:14.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.657+0000 7fdca3823b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x563566f2b530 con 0x563566f232d0 2023-10-19T12:46:14.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.657+0000 7fdca3823b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x563566f2c8c0 con 0x563566f225d0 2023-10-19T12:46:14.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.657+0000 7fdc8d59a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563566f232d0 0x563566f44a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:46:14.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.657+0000 7fdc8d59a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563566f232d0 0x563566f44a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:35056/0 (socket says 172.21.15.46:35056) 2023-10-19T12:46:14.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.657+0000 7fdc8d59a700 1 -- 172.21.15.46:0/3776653118 learned_addr learned my addr 172.21.15.46:0/3776653118 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:46:14.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.658+0000 7fdc8dd9b700 1 --2- 172.21.15.46:0/3776653118 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563566f225d0 0x563566f22090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:46:14.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.658+0000 7fdc8d59a700 1 -- 172.21.15.46:0/3776653118 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563566f225d0 msgr2=0x563566f22090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:46:14.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.658+0000 7fdc8d59a700 1 --2- 172.21.15.46:0/3776653118 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563566f225d0 0x563566f22090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:46:14.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.658+0000 7fdc8d59a700 1 -- 172.21.15.46:0/3776653118 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563566f30f30 msgr2=0x563566f2a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:46:14.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.658+0000 7fdc8d59a700 1 --2- 172.21.15.46:0/3776653118 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563566f30f30 0x563566f2a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:46:14.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.658+0000 7fdc8d59a700 1 -- 172.21.15.46:0/3776653118 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563566f1e5b0 con 0x563566f232d0 2023-10-19T12:46:14.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.659+0000 7fdc8d59a700 1 --2- 172.21.15.46:0/3776653118 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563566f232d0 0x563566f44a10 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fdc78011820 tx=0x7fdc780117b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4efc9f089a68a993 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:46:14.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.661+0000 7fdc7cff9700 1 -- 172.21.15.46:0/3776653118 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc7801a7d0 con 0x563566f232d0 2023-10-19T12:46:14.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.661+0000 7fdc7cff9700 1 -- 172.21.15.46:0/3776653118 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x563566e79ef0 con 0x563566f232d0 2023-10-19T12:46:14.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.661+0000 7fdc7cff9700 1 -- 172.21.15.46:0/3776653118 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc78019bc0 con 0x563566f232d0 2023-10-19T12:46:14.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.662+0000 7fdca3823b80 1 -- 172.21.15.46:0/3776653118 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563566f232d0 msgr2=0x563566f44a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:46:14.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.662+0000 7fdca3823b80 1 --2- 172.21.15.46:0/3776653118 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563566f232d0 0x563566f44a10 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fdc78011820 tx=0x7fdc780117b0 comp rx=0 tx=0).stop 2023-10-19T12:46:14.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.662+0000 7fdca3823b80 1 -- 172.21.15.46:0/3776653118 shutdown_connections 2023-10-19T12:46:14.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.662+0000 7fdca3823b80 1 --2- 172.21.15.46:0/3776653118 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563566f30f30 0x563566f2a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:46:14.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.662+0000 7fdca3823b80 1 --2- 172.21.15.46:0/3776653118 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563566f225d0 0x563566f22090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:46:14.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.662+0000 7fdca3823b80 1 --2- 172.21.15.46:0/3776653118 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563566f232d0 0x563566f44a10 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:46:14.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.662+0000 7fdca3823b80 1 -- 172.21.15.46:0/3776653118 >> 172.21.15.46:0/3776653118 conn(0x563566e96720 msgr2=0x563566f1c830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:46:14.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.662+0000 7fdca3823b80 1 -- 172.21.15.46:0/3776653118 shutdown_connections 2023-10-19T12:46:14.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.662+0000 7fdca3823b80 1 -- 172.21.15.46:0/3776653118 wait complete. 2023-10-19T12:46:14.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.663+0000 7fdca3823b80 1 -- start start 2023-10-19T12:46:14.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.663+0000 7fdca3823b80 1 Processor -- start 2023-10-19T12:46:14.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.664+0000 7fdca3823b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563566f225d0 0x563566f97130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:46:14.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.664+0000 7fdca3823b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563566f232d0 0x563566f99680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:46:14.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.664+0000 7fdca3823b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563566f30f30 0x563566f9bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:46:14.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.664+0000 7fdca3823b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x563566f58db0 con 0x563566f30f30 2023-10-19T12:46:14.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.664+0000 7fdca3823b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x563566f9c110 con 0x563566f232d0 2023-10-19T12:46:14.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.664+0000 7fdca3823b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x563566f9c2d0 con 0x563566f225d0 2023-10-19T12:46:14.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.664+0000 7fdca3823b80 10 client.0 _ll_register_callbacks cb 0x563566d5ba80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:46:14.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.665+0000 7fdc8d59a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563566f232d0 0x563566f99680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:46:14.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.665+0000 7fdc8d59a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563566f232d0 0x563566f99680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:35064/0 (socket says 172.21.15.46:35064) 2023-10-19T12:46:14.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.665+0000 7fdc8d59a700 1 -- 172.21.15.46:0/3294360603 learned_addr learned my addr 172.21.15.46:0/3294360603 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:46:14.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.665+0000 7fdc8e59c700 1 --2- 172.21.15.46:0/3294360603 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563566f30f30 0x563566f9bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:46:14.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.665+0000 7fdc8dd9b700 1 --2- 172.21.15.46:0/3294360603 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563566f225d0 0x563566f97130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:46:14.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.665+0000 7fdc8d59a700 1 -- 172.21.15.46:0/3294360603 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563566f225d0 msgr2=0x563566f97130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:46:14.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.665+0000 7fdc8d59a700 1 --2- 172.21.15.46:0/3294360603 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563566f225d0 0x563566f97130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:46:14.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.666+0000 7fdc8d59a700 1 -- 172.21.15.46:0/3294360603 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563566f30f30 msgr2=0x563566f9bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:46:14.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.666+0000 7fdc8d59a700 1 --2- 172.21.15.46:0/3294360603 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563566f30f30 0x563566f9bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:46:14.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.666+0000 7fdc8d59a700 1 -- 172.21.15.46:0/3294360603 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc881ad950 con 0x563566f232d0 2023-10-19T12:46:14.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.666+0000 7fdc8e59c700 1 --2- 172.21.15.46:0/3294360603 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563566f30f30 0x563566f9bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T12:46:14.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.666+0000 7fdc8d59a700 1 --2- 172.21.15.46:0/3294360603 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563566f232d0 0x563566f99680 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fdc78001eb0 tx=0x7fdc7800b310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8140bbe0fcdcc22a server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:46:14.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.666+0000 7fdc717fa700 10 client.0 ms_handle_connect on v2:172.21.15.157:3300/0 2023-10-19T12:46:14.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.667+0000 7fdc717fa700 1 -- 172.21.15.46:0/3294360603 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc78005c20 con 0x563566f232d0 2023-10-19T12:46:14.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.667+0000 7fdc717fa700 1 -- 172.21.15.46:0/3294360603 <== mon.2 v2:172.21.15.157:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7fdc78000e40 con 0x563566f232d0 2023-10-19T12:46:14.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.667+0000 7fdca3823b80 1 -- 172.21.15.46:0/3294360603 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdc8409a3c0 con 0x563566f232d0 2023-10-19T12:46:14.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.667+0000 7fdc717fa700 1 -- 172.21.15.46:0/3294360603 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdc7801a680 con 0x563566f232d0 2023-10-19T12:46:14.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.667+0000 7fdca3823b80 10 client.25901 fetch_fsmap learned FSMap version 34 2023-10-19T12:46:14.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.667+0000 7fdca3823b80 1 -- 172.21.15.46:0/3294360603 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x563566c9fde0 con 0x563566f232d0 2023-10-19T12:46:14.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.668+0000 7fdc717fa700 1 -- 172.21.15.46:0/3294360603 <== mon.2 v2:172.21.15.157:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdc8409a3c0 con 0x563566f232d0 2023-10-19T12:46:14.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.668+0000 7fdc717fa700 1 -- 172.21.15.46:0/3294360603 <== mon.2 v2:172.21.15.157:3300/0 5 ==== fsmap(e 34) v1 ==== 7934+0+0 (secure 0 0 0) 0x7fdc7802b030 con 0x563566f232d0 2023-10-19T12:46:14.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.668+0000 7fdca3823b80 10 client.25901 fetch_fsmap finished waiting for FSMap version 34 2023-10-19T12:46:14.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.668+0000 7fdca3823b80 10 client.25901 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-19T12:46:14.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.668+0000 7fdca3823b80 20 client.25901 populate_metadata read hostname 'smithi046' 2023-10-19T12:46:14.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.668+0000 7fdca3823b80 1 --2- 172.21.15.46:0/3294360603 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x563566f9d9a0 0x563566f9fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:46:14.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.668+0000 7fdca3823b80 4 client.25901 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-19T12:46:14.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.668+0000 7fdca3823b80 1 -- 172.21.15.46:0/3294360603 --> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x563566e6de50 con 0x563566f9d9a0 2023-10-19T12:46:14.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.669+0000 7fdc8dd9b700 1 --2- 172.21.15.46:0/3294360603 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x563566f9d9a0 0x563566f9fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:46:14.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.669+0000 7fdc717fa700 10 client.25901 ms_handle_connect on v2:172.21.15.157:6838/552718978 2023-10-19T12:46:14.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.670+0000 7fdc8dd9b700 1 --2- 172.21.15.46:0/3294360603 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x563566f9d9a0 0x563566f9fdc0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b08ec8b799feadd6 server_cookie=ee3813050df4d4ef in_seq=0 out_seq=0 2023-10-19T12:46:14.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.670+0000 7fdc717fa700 1 -- 172.21.15.46:0/3294360603 <== mds.0 v2:172.21.15.157:6838/552718978 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x563566e6de50 con 0x563566f9d9a0 2023-10-19T12:46:14.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.670+0000 7fdc717fa700 10 client.25901 handle_command_reply: tid=0 2023-10-19T12:46:14.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.670+0000 7fdca3823b80 1 client.25901 shutdown 2023-10-19T12:46:14.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.671+0000 7fdca3823b80 1 -- 172.21.15.46:0/3294360603 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563566f232d0 msgr2=0x563566f99680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:46:14.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.671+0000 7fdca3823b80 1 --2- 172.21.15.46:0/3294360603 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563566f232d0 0x563566f99680 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fdc78001eb0 tx=0x7fdc7800b310 comp rx=0 tx=0).stop 2023-10-19T12:46:14.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.671+0000 7fdca3823b80 1 -- 172.21.15.46:0/3294360603 shutdown_connections 2023-10-19T12:46:14.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.671+0000 7fdca3823b80 1 --2- 172.21.15.46:0/3294360603 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x563566f9d9a0 0x563566f9fdc0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:46:14.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.671+0000 7fdca3823b80 1 --2- 172.21.15.46:0/3294360603 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563566f30f30 0x563566f9bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:46:14.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.671+0000 7fdc717fa700 0 client.25901 ms_handle_reset on v2:172.21.15.157:6838/552718978 2023-10-19T12:46:14.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.671+0000 7fdca3823b80 1 --2- 172.21.15.46:0/3294360603 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563566f225d0 0x563566f97130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:46:14.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.671+0000 7fdca3823b80 1 --2- 172.21.15.46:0/3294360603 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563566f232d0 0x563566f99680 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:46:14.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.671+0000 7fdca3823b80 1 -- 172.21.15.46:0/3294360603 >> 172.21.15.46:0/3294360603 conn(0x563566e96720 msgr2=0x563566f1c810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:46:14.681 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.672+0000 7fdca3823b80 1 -- 172.21.15.46:0/3294360603 shutdown_connections 2023-10-19T12:46:14.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.672+0000 7fdca3823b80 1 -- 172.21.15.46:0/3294360603 wait complete. 2023-10-19T12:46:14.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.673+0000 7fdca3823b80 20 client.25901 trim_cache size 0 max 16384 2023-10-19T12:46:14.682 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-10-19T12:46:14.683 INFO:teuthology.orchestra.run.smithi046.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-19T12:46:14.683 INFO:teuthology.orchestra.run.smithi046.stdout: "scrubs": { 2023-10-19T12:46:14.683 INFO:teuthology.orchestra.run.smithi046.stdout: "21e73f70-af16-4ae7-bc34-e6c54ba8e1ec": { 2023-10-19T12:46:14.683 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2023-10-19T12:46:14.683 INFO:teuthology.orchestra.run.smithi046.stdout: "tag": "21e73f70-af16-4ae7-bc34-e6c54ba8e1ec", 2023-10-19T12:46:14.684 INFO:teuthology.orchestra.run.smithi046.stdout: "options": "recursive,force" 2023-10-19T12:46:14.684 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:46:14.684 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:46:14.684 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-10-19T12:46:14.685 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.674+0000 7fdc8ffff700 1 -- 172.21.15.46:0/3841458207 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fdc740a1550 msgr2=0x7fdc740a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:46:14.685 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.674+0000 7fdc8ffff700 1 --2- 172.21.15.46:0/3841458207 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fdc740a1550 0x7fdc740a3a10 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fdc80007ae0 tx=0x7fdc80004ad0 comp rx=0 tx=0).stop 2023-10-19T12:46:14.685 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.674+0000 7fdc8ffff700 1 -- 172.21.15.46:0/3841458207 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdc880ff000 msgr2=0x7fdc8806f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:46:14.685 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.674+0000 7fdc8ffff700 1 --2- 172.21.15.46:0/3841458207 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdc880ff000 0x7fdc8806f0a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fdc8400b5c0 tx=0x7fdc84003cb0 comp rx=0 tx=0).stop 2023-10-19T12:46:14.685 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.674+0000 7fdc8ffff700 1 -- 172.21.15.46:0/3841458207 shutdown_connections 2023-10-19T12:46:14.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.674+0000 7fdc8ffff700 1 --2- 172.21.15.46:0/3841458207 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc88104340 0x7fdc881acea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:46:14.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.674+0000 7fdc8ffff700 1 --2- 172.21.15.46:0/3841458207 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fdc740a1550 0x7fdc740a3a10 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:46:14.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.674+0000 7fdc8ffff700 1 --2- 172.21.15.46:0/3841458207 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdc880ff000 0x7fdc8806f0a0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:46:14.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.674+0000 7fdc8ffff700 1 --2- 172.21.15.46:0/3841458207 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdc88101970 0x7fdc8806f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:46:14.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.674+0000 7fdc8ffff700 1 -- 172.21.15.46:0/3841458207 >> 172.21.15.46:0/3841458207 conn(0x7fdc880fac00 msgr2=0x7fdc88102350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:46:14.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.674+0000 7fdc8ffff700 1 -- 172.21.15.46:0/3841458207 shutdown_connections 2023-10-19T12:46:14.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:14.675+0000 7fdc8ffff700 1 -- 172.21.15.46:0/3841458207 wait complete. 2023-10-19T12:46:14.708 INFO:tasks.cephfs.filesystem:scrub status for tag:21e73f70-af16-4ae7-bc34-e6c54ba8e1ec - {'path': '/', 'tag': '21e73f70-af16-4ae7-bc34-e6c54ba8e1ec', 'options': 'recursive,force'} 2023-10-19T12:46:16.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:46:15 smithi157 ceph-mon[134109]: pgmap v436: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 24 MiB/s wr, 1.60k op/s 2023-10-19T12:46:16.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:46:15 smithi195 ceph-mon[134493]: pgmap v436: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 24 MiB/s wr, 1.60k op/s 2023-10-19T12:46:16.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:46:15 smithi046 ceph-mon[98509]: pgmap v436: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 24 MiB/s wr, 1.60k op/s 2023-10-19T12:46:16.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 135.0 s, 1299.0 tps, lat 72.224 ms stddev 88.196 2023-10-19T12:46:18.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:46:17 smithi157 ceph-mon[134109]: pgmap v437: 129 pgs: 129 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 27 MiB/s wr, 1.74k op/s 2023-10-19T12:46:18.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:46:17 smithi195 ceph-mon[134493]: pgmap v437: 129 pgs: 129 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 27 MiB/s wr, 1.74k op/s 2023-10-19T12:46:18.233 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:46:17 smithi046 ceph-mon[98509]: pgmap v437: 129 pgs: 129 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 27 MiB/s wr, 1.74k op/s 2023-10-19T12:46:19.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:46:19 smithi046 ceph-mon[98509]: pgmap v438: 129 pgs: 129 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 17 MiB/s wr, 1.08k op/s 2023-10-19T12:46:19.837 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:46:19 smithi157 ceph-mon[134109]: pgmap v438: 129 pgs: 129 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 17 MiB/s wr, 1.08k op/s 2023-10-19T12:46:19.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:46:19 smithi195 ceph-mon[134493]: pgmap v438: 129 pgs: 129 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 17 MiB/s wr, 1.08k op/s 2023-10-19T12:46:20.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:46:20 smithi046 ceph-mon[98509]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-19T12:46:20.837 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:46:20 smithi157 ceph-mon[134109]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-19T12:46:20.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:46:20 smithi195 ceph-mon[134493]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-19T12:46:21.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 140.0 s, 1336.2 tps, lat 79.731 ms stddev 105.293 2023-10-19T12:46:21.728 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:46:21 smithi046 ceph-mon[98509]: pgmap v439: 129 pgs: 129 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 12 MiB/s wr, 725 op/s 2023-10-19T12:46:21.837 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:46:21 smithi157 ceph-mon[134109]: pgmap v439: 129 pgs: 129 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 12 MiB/s wr, 725 op/s 2023-10-19T12:46:21.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:46:21 smithi195 ceph-mon[134493]: pgmap v439: 129 pgs: 129 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 12 MiB/s wr, 725 op/s 2023-10-19T12:46:24.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:46:23 smithi157 ceph-mon[134109]: pgmap v440: 129 pgs: 129 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 13 MiB/s wr, 752 op/s 2023-10-19T12:46:24.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:46:23 smithi195 ceph-mon[134493]: pgmap v440: 129 pgs: 129 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 13 MiB/s wr, 752 op/s 2023-10-19T12:46:24.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:46:23 smithi046 ceph-mon[98509]: pgmap v440: 129 pgs: 129 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 13 MiB/s wr, 752 op/s 2023-10-19T12:46:26.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:46:25 smithi157 ceph-mon[134109]: pgmap v441: 129 pgs: 129 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 8.1 MiB/s wr, 493 op/s 2023-10-19T12:46:26.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:46:25 smithi195 ceph-mon[134493]: pgmap v441: 129 pgs: 129 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 8.1 MiB/s wr, 493 op/s 2023-10-19T12:46:26.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:46:25 smithi046 ceph-mon[98509]: pgmap v441: 129 pgs: 129 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 8.1 MiB/s wr, 493 op/s 2023-10-19T12:46:26.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 145.0 s, 1470.4 tps, lat 67.405 ms stddev 86.163 2023-10-19T12:46:28.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:46:27 smithi195 ceph-mon[134493]: pgmap v442: 129 pgs: 129 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 10 MiB/s wr, 628 op/s 2023-10-19T12:46:28.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:46:27 smithi046 ceph-mon[98509]: pgmap v442: 129 pgs: 129 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 10 MiB/s wr, 628 op/s 2023-10-19T12:46:28.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:46:27 smithi157 ceph-mon[134109]: pgmap v442: 129 pgs: 129 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 10 MiB/s wr, 628 op/s 2023-10-19T12:46:29.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:46:29 smithi046 ceph-mon[98509]: pgmap v443: 129 pgs: 129 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.2 MiB/s wr, 597 op/s 2023-10-19T12:46:29.837 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:46:29 smithi157 ceph-mon[134109]: pgmap v443: 129 pgs: 129 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.2 MiB/s wr, 597 op/s 2023-10-19T12:46:29.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:46:29 smithi195 ceph-mon[134493]: pgmap v443: 129 pgs: 129 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.2 MiB/s wr, 597 op/s 2023-10-19T12:46:31.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 150.0 s, 1259.4 tps, lat 78.680 ms stddev 93.324 2023-10-19T12:46:32.091 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:46:31 smithi157 ceph-mon[134109]: pgmap v444: 129 pgs: 129 active+clean; 1.5 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.1 MiB/s wr, 582 op/s 2023-10-19T12:46:32.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:46:31 smithi195 ceph-mon[134493]: pgmap v444: 129 pgs: 129 active+clean; 1.5 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.1 MiB/s wr, 582 op/s 2023-10-19T12:46:32.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:46:31 smithi046 ceph-mon[98509]: pgmap v444: 129 pgs: 129 active+clean; 1.5 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.1 MiB/s wr, 582 op/s 2023-10-19T12:46:34.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:46:33 smithi157 ceph-mon[134109]: pgmap v445: 129 pgs: 129 active+clean; 1.5 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 MiB/s wr, 756 op/s 2023-10-19T12:46:34.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:46:33 smithi195 ceph-mon[134493]: pgmap v445: 129 pgs: 129 active+clean; 1.5 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 MiB/s wr, 756 op/s 2023-10-19T12:46:34.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:46:33 smithi046 ceph-mon[98509]: pgmap v445: 129 pgs: 129 active+clean; 1.5 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 MiB/s wr, 756 op/s 2023-10-19T12:46:36.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:46:35 smithi157 ceph-mon[134109]: pgmap v446: 129 pgs: 129 active+clean; 1.5 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 8.2 MiB/s wr, 569 op/s 2023-10-19T12:46:36.133 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:46:35 smithi195 ceph-mon[134493]: pgmap v446: 129 pgs: 129 active+clean; 1.5 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 8.2 MiB/s wr, 569 op/s 2023-10-19T12:46:36.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:46:35 smithi046 ceph-mon[98509]: pgmap v446: 129 pgs: 129 active+clean; 1.5 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 8.2 MiB/s wr, 569 op/s 2023-10-19T12:46:36.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 155.0 s, 1366.6 tps, lat 73.749 ms stddev 86.509 2023-10-19T12:46:38.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:46:37 smithi195 ceph-mon[134493]: pgmap v447: 129 pgs: 129 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 10 MiB/s wr, 696 op/s 2023-10-19T12:46:38.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:46:37 smithi046 ceph-mon[98509]: pgmap v447: 129 pgs: 129 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 10 MiB/s wr, 696 op/s 2023-10-19T12:46:38.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:46:37 smithi157 ceph-mon[134109]: pgmap v447: 129 pgs: 129 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 10 MiB/s wr, 696 op/s 2023-10-19T12:46:39.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:46:39 smithi046 ceph-mon[98509]: pgmap v448: 129 pgs: 129 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 9.6 MiB/s wr, 660 op/s 2023-10-19T12:46:39.837 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:46:39 smithi157 ceph-mon[134109]: pgmap v448: 129 pgs: 129 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 9.6 MiB/s wr, 660 op/s 2023-10-19T12:46:39.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:46:39 smithi195 ceph-mon[134493]: pgmap v448: 129 pgs: 129 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 9.6 MiB/s wr, 660 op/s 2023-10-19T12:46:41.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 160.0 s, 1391.0 tps, lat 70.613 ms stddev 86.400 2023-10-19T12:46:42.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:46:41 smithi157 ceph-mon[134109]: pgmap v449: 129 pgs: 129 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 8.2 MiB/s wr, 587 op/s 2023-10-19T12:46:42.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:46:41 smithi195 ceph-mon[134493]: pgmap v449: 129 pgs: 129 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 8.2 MiB/s wr, 587 op/s 2023-10-19T12:46:42.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:46:41 smithi046 ceph-mon[98509]: pgmap v449: 129 pgs: 129 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 8.2 MiB/s wr, 587 op/s 2023-10-19T12:46:44.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:46:43 smithi157 ceph-mon[134109]: pgmap v450: 129 pgs: 129 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 10 MiB/s wr, 738 op/s 2023-10-19T12:46:44.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:46:43 smithi195 ceph-mon[134493]: pgmap v450: 129 pgs: 129 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 10 MiB/s wr, 738 op/s 2023-10-19T12:46:44.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:46:43 smithi046 ceph-mon[98509]: pgmap v450: 129 pgs: 129 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 10 MiB/s wr, 738 op/s 2023-10-19T12:46:44.710 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-19T12:46:45.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.102+0000 7f79723ff700 1 -- 172.21.15.46:0/2684369741 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f796c101970 msgr2=0x7f796c103e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:46:45.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.102+0000 7f79723ff700 1 --2- 172.21.15.46:0/2684369741 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f796c101970 0x7f796c103e00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7960009990 tx=0x7f7960009ca0 comp rx=0 tx=0).stop 2023-10-19T12:46:45.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.103+0000 7f79723ff700 1 -- 172.21.15.46:0/2684369741 shutdown_connections 2023-10-19T12:46:45.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.103+0000 7f79723ff700 1 --2- 172.21.15.46:0/2684369741 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f796c104340 0x7f796c1047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:46:45.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.103+0000 7f79723ff700 1 --2- 172.21.15.46:0/2684369741 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f796c0ff000 0x7f796c101430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:46:45.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.103+0000 7f79723ff700 1 --2- 172.21.15.46:0/2684369741 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f796c101970 0x7f796c103e00 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:46:45.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.103+0000 7f79723ff700 1 -- 172.21.15.46:0/2684369741 >> 172.21.15.46:0/2684369741 conn(0x7f796c0fac00 msgr2=0x7f796c0fd040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:46:45.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.103+0000 7f79723ff700 1 -- 172.21.15.46:0/2684369741 shutdown_connections 2023-10-19T12:46:45.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.103+0000 7f79723ff700 1 -- 172.21.15.46:0/2684369741 wait complete. 2023-10-19T12:46:45.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.105+0000 7f79723ff700 1 Processor -- start 2023-10-19T12:46:45.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.105+0000 7f79723ff700 1 -- start start 2023-10-19T12:46:45.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.105+0000 7f79723ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f796c0ff000 0x7f796c19ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:46:45.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.106+0000 7f79723ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f796c101970 0x7f796c19d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:46:45.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.106+0000 7f79723ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f796c104340 0x7f796c1a4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:46:45.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.106+0000 7f79723ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f796c1a47e0 con 0x7f796c104340 2023-10-19T12:46:45.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.106+0000 7f79723ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f796c1a4950 con 0x7f796c101970 2023-10-19T12:46:45.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.106+0000 7f79723ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f796c1a4b10 con 0x7f796c0ff000 2023-10-19T12:46:45.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.106+0000 7f796bfff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f796c0ff000 0x7f796c19ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:46:45.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.107+0000 7f796bfff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f796c0ff000 0x7f796c19ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:47460/0 (socket says 172.21.15.46:47460) 2023-10-19T12:46:45.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.107+0000 7f796bfff700 1 -- 172.21.15.46:0/3136246090 learned_addr learned my addr 172.21.15.46:0/3136246090 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:46:45.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.107+0000 7f797099c700 1 --2- 172.21.15.46:0/3136246090 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f796c104340 0x7f796c1a4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:46:45.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.107+0000 7f796b7fe700 1 --2- 172.21.15.46:0/3136246090 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f796c101970 0x7f796c19d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:46:45.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.107+0000 7f796bfff700 1 -- 172.21.15.46:0/3136246090 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f796c101970 msgr2=0x7f796c19d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:46:45.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.107+0000 7f796bfff700 1 --2- 172.21.15.46:0/3136246090 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f796c101970 0x7f796c19d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:46:45.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.107+0000 7f796bfff700 1 -- 172.21.15.46:0/3136246090 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f796c104340 msgr2=0x7f796c1a4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:46:45.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.107+0000 7f796bfff700 1 --2- 172.21.15.46:0/3136246090 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f796c104340 0x7f796c1a4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:46:45.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.107+0000 7f796bfff700 1 -- 172.21.15.46:0/3136246090 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79600095f0 con 0x7f796c0ff000 2023-10-19T12:46:45.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.108+0000 7f796bfff700 1 --2- 172.21.15.46:0/3136246090 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f796c0ff000 0x7f796c19ccc0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f795c00c9b0 tx=0x7f795c00ccc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:46:45.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.109+0000 7f79697fa700 1 -- 172.21.15.46:0/3136246090 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f795c007b00 con 0x7f796c0ff000 2023-10-19T12:46:45.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.109+0000 7f79697fa700 1 -- 172.21.15.46:0/3136246090 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f795c007c60 con 0x7f796c0ff000 2023-10-19T12:46:45.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.109+0000 7f79697fa700 1 -- 172.21.15.46:0/3136246090 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f795c018660 con 0x7f796c0ff000 2023-10-19T12:46:45.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.109+0000 7f79723ff700 1 -- 172.21.15.46:0/3136246090 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f796c1a4df0 con 0x7f796c0ff000 2023-10-19T12:46:45.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.109+0000 7f79723ff700 1 -- 172.21.15.46:0/3136246090 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f796c1a51c0 con 0x7f796c0ff000 2023-10-19T12:46:45.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.118+0000 7f7985d3ab80 1 Processor -- start 2023-10-19T12:46:45.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.118+0000 7f7985d3ab80 1 -- start start 2023-10-19T12:46:45.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.119+0000 7f79697fa700 1 -- 172.21.15.46:0/3136246090 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f795c00f450 con 0x7f796c0ff000 2023-10-19T12:46:45.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.119+0000 7f7985d3ab80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5632d35ad2d0 0x5632d35ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:46:45.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.119+0000 7f7985d3ab80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5632d35adc30 0x5632d35ac090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:46:45.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.119+0000 7f7985d3ab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5632d35ac5d0 0x5632d35aca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:46:45.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.120+0000 7f7985d3ab80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x5632d351f6e0 con 0x5632d35ad2d0 2023-10-19T12:46:45.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.120+0000 7f7985d3ab80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5632d3505c60 con 0x5632d35adc30 2023-10-19T12:46:45.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.120+0000 7f7985d3ab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5632d3503580 con 0x5632d35ac5d0 2023-10-19T12:46:45.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.120+0000 7f797099c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5632d35ad2d0 0x5632d35ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:46:45.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.120+0000 7f796bfff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5632d35adc30 0x5632d35ac090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:46:45.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.120+0000 7f796bfff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5632d35adc30 0x5632d35ac090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:39316/0 (socket says 172.21.15.46:39316) 2023-10-19T12:46:45.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.120+0000 7f796bfff700 1 -- 172.21.15.46:0/3114496504 learned_addr learned my addr 172.21.15.46:0/3114496504 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:46:45.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.120+0000 7f796b7fe700 1 --2- 172.21.15.46:0/3114496504 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5632d35ac5d0 0x5632d35aca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:46:45.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.121+0000 7f796bfff700 1 -- 172.21.15.46:0/3114496504 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5632d35ac5d0 msgr2=0x5632d35aca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:46:45.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.121+0000 7f796bfff700 1 --2- 172.21.15.46:0/3114496504 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5632d35ac5d0 0x5632d35aca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:46:45.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.121+0000 7f796bfff700 1 -- 172.21.15.46:0/3114496504 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5632d35ad2d0 msgr2=0x5632d35ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:46:45.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.121+0000 7f796bfff700 1 --2- 172.21.15.46:0/3114496504 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5632d35ad2d0 0x5632d35ad6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:46:45.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.121+0000 7f796bfff700 1 -- 172.21.15.46:0/3114496504 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5632d34bc3f0 con 0x5632d35adc30 2023-10-19T12:46:45.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.121+0000 7f79697fa700 1 --2- 172.21.15.46:0/3136246090 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f79540a1550 0x7f79540a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:46:45.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.121+0000 7f797099c700 1 --2- 172.21.15.46:0/3114496504 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5632d35ad2d0 0x5632d35ad6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T12:46:45.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.121+0000 7f79697fa700 1 -- 172.21.15.46:0/3136246090 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f795c0ccff0 con 0x7f796c0ff000 2023-10-19T12:46:45.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.122+0000 7f797099c700 1 --2- 172.21.15.46:0/3136246090 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f79540a1550 0x7f79540a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:46:45.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.122+0000 7f796bfff700 1 --2- 172.21.15.46:0/3114496504 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5632d35adc30 0x5632d35ac090 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f795c0d0f30 tx=0x7f795c0d0f60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e98ba87bf9a46d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:46:45.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.122+0000 7f79527fc700 1 -- 172.21.15.46:0/3114496504 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f795c096280 con 0x5632d35adc30 2023-10-19T12:46:45.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.122+0000 7f79527fc700 1 -- 172.21.15.46:0/3114496504 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f795c099d10 con 0x5632d35adc30 2023-10-19T12:46:45.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.122+0000 7f79527fc700 1 -- 172.21.15.46:0/3114496504 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f795c09a640 con 0x5632d35adc30 2023-10-19T12:46:45.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.123+0000 7f7985d3ab80 1 -- 172.21.15.46:0/3114496504 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5632d35adc30 msgr2=0x5632d35ac090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:46:45.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.123+0000 7f7985d3ab80 1 --2- 172.21.15.46:0/3114496504 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5632d35adc30 0x5632d35ac090 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f795c0d0f30 tx=0x7f795c0d0f60 comp rx=0 tx=0).stop 2023-10-19T12:46:45.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.123+0000 7f797099c700 1 --2- 172.21.15.46:0/3136246090 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f79540a1550 0x7f79540a3a10 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f7964009fd0 tx=0x7f796400e040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:46:45.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.123+0000 7f7985d3ab80 1 -- 172.21.15.46:0/3114496504 shutdown_connections 2023-10-19T12:46:45.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.123+0000 7f7985d3ab80 1 --2- 172.21.15.46:0/3114496504 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5632d35ac5d0 0x5632d35aca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:46:45.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.123+0000 7f7985d3ab80 1 --2- 172.21.15.46:0/3114496504 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5632d35ad2d0 0x5632d35ad6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:46:45.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.123+0000 7f7985d3ab80 1 --2- 172.21.15.46:0/3114496504 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5632d35adc30 0x5632d35ac090 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:46:45.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.123+0000 7f7985d3ab80 1 -- 172.21.15.46:0/3114496504 >> 172.21.15.46:0/3114496504 conn(0x5632d3520720 msgr2=0x5632d35a6b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:46:45.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.123+0000 7f7985d3ab80 1 -- 172.21.15.46:0/3114496504 shutdown_connections 2023-10-19T12:46:45.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.123+0000 7f7985d3ab80 1 -- 172.21.15.46:0/3114496504 wait complete. 2023-10-19T12:46:45.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.124+0000 7f7985d3ab80 1 -- start start 2023-10-19T12:46:45.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.125+0000 7f7985d3ab80 1 Processor -- start 2023-10-19T12:46:45.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.125+0000 7f7985d3ab80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5632d35ac5d0 0x5632d35b5b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:46:45.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.125+0000 7f7985d3ab80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5632d35ad2d0 0x5632d35b6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:46:45.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.125+0000 7f7985d3ab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5632d35adc30 0x5632d35bd080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:46:45.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.125+0000 7f7985d3ab80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x5632d34fee70 con 0x5632d35ad2d0 2023-10-19T12:46:45.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.125+0000 7f7985d3ab80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5632d349b710 con 0x5632d35ac5d0 2023-10-19T12:46:45.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.125+0000 7f7985d3ab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5632d349b3b0 con 0x5632d35adc30 2023-10-19T12:46:45.135 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.125+0000 7f7985d3ab80 10 client.0 _ll_register_callbacks cb 0x5632d33e5a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:46:45.135 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.126+0000 7f796bfff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5632d35ac5d0 0x5632d35b5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:46:45.135 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.126+0000 7f796bfff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5632d35ac5d0 0x5632d35b5b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:39330/0 (socket says 172.21.15.46:39330) 2023-10-19T12:46:45.135 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.126+0000 7f796bfff700 1 -- 172.21.15.46:0/243543172 learned_addr learned my addr 172.21.15.46:0/243543172 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:46:45.135 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.127+0000 7f796bfff700 1 -- 172.21.15.46:0/243543172 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5632d35adc30 msgr2=0x5632d35bd080 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-19T12:46:45.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.127+0000 7f796bfff700 1 --2- 172.21.15.46:0/243543172 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5632d35adc30 0x5632d35bd080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:46:45.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.127+0000 7f796bfff700 1 -- 172.21.15.46:0/243543172 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5632d35ad2d0 msgr2=0x5632d35b6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:46:45.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.127+0000 7f796bfff700 1 --2- 172.21.15.46:0/243543172 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5632d35ad2d0 0x5632d35b6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:46:45.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.127+0000 7f796bfff700 1 -- 172.21.15.46:0/243543172 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f796c1a51c0 con 0x5632d35ac5d0 2023-10-19T12:46:45.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.128+0000 7f796bfff700 1 --2- 172.21.15.46:0/243543172 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5632d35ac5d0 0x5632d35b5b00 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f795c000c00 tx=0x7f795c0cd320 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df1527f5cf93e46d server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:46:45.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.128+0000 7f794b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.157:3300/0 2023-10-19T12:46:45.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.128+0000 7f794b7fe700 1 -- 172.21.15.46:0/243543172 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f795c0cf310 con 0x5632d35ac5d0 2023-10-19T12:46:45.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.128+0000 7f794b7fe700 1 -- 172.21.15.46:0/243543172 <== mon.2 v2:172.21.15.157:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f795c007dd0 con 0x5632d35ac5d0 2023-10-19T12:46:45.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.128+0000 7f7985d3ab80 1 -- 172.21.15.46:0/243543172 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5632d3503ef0 con 0x5632d35ac5d0 2023-10-19T12:46:45.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.129+0000 7f794b7fe700 1 -- 172.21.15.46:0/243543172 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f795c096280 con 0x5632d35ac5d0 2023-10-19T12:46:45.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.129+0000 7f7985d3ab80 10 client.25910 fetch_fsmap learned FSMap version 35 2023-10-19T12:46:45.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.129+0000 7f7985d3ab80 1 -- 172.21.15.46:0/243543172 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x5632d3329de0 con 0x5632d35ac5d0 2023-10-19T12:46:45.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.130+0000 7f794b7fe700 1 -- 172.21.15.46:0/243543172 <== mon.2 v2:172.21.15.157:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5632d3503ef0 con 0x5632d35ac5d0 2023-10-19T12:46:45.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.130+0000 7f794b7fe700 1 -- 172.21.15.46:0/243543172 <== mon.2 v2:172.21.15.157:3300/0 5 ==== fsmap(e 35) v1 ==== 7922+0+0 (secure 0 0 0) 0x7f795c0add20 con 0x5632d35ac5d0 2023-10-19T12:46:45.140 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.131+0000 7f7985d3ab80 10 client.25910 fetch_fsmap finished waiting for FSMap version 35 2023-10-19T12:46:45.140 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.131+0000 7f7985d3ab80 10 client.25910 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-19T12:46:45.140 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.131+0000 7f7985d3ab80 20 client.25910 populate_metadata read hostname 'smithi046' 2023-10-19T12:46:45.140 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.131+0000 7f7985d3ab80 1 --2- 172.21.15.46:0/243543172 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x5632d35d24a0 0x5632d35d48c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:46:45.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.131+0000 7f7985d3ab80 4 client.25910 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-19T12:46:45.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.131+0000 7f7985d3ab80 1 -- 172.21.15.46:0/243543172 --> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5632d357b8b0 con 0x5632d35d24a0 2023-10-19T12:46:45.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.131+0000 7f796b7fe700 1 --2- 172.21.15.46:0/243543172 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x5632d35d24a0 0x5632d35d48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:46:45.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.132+0000 7f796b7fe700 1 --2- 172.21.15.46:0/243543172 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x5632d35d24a0 0x5632d35d48c0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=507175df501eca38 server_cookie=dad496038a3a9877 in_seq=0 out_seq=0 2023-10-19T12:46:45.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.132+0000 7f794b7fe700 10 client.25910 ms_handle_connect on v2:172.21.15.157:6838/552718978 2023-10-19T12:46:45.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.133+0000 7f794b7fe700 1 -- 172.21.15.46:0/243543172 <== mds.0 v2:172.21.15.157:6838/552718978 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5632d357b8b0 con 0x5632d35d24a0 2023-10-19T12:46:45.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.133+0000 7f794b7fe700 10 client.25910 handle_command_reply: tid=0 2023-10-19T12:46:45.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.133+0000 7f7985d3ab80 1 client.25910 shutdown 2023-10-19T12:46:45.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.135+0000 7f7985d3ab80 1 -- 172.21.15.46:0/243543172 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5632d35ac5d0 msgr2=0x5632d35b5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:46:45.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.135+0000 7f7985d3ab80 1 --2- 172.21.15.46:0/243543172 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5632d35ac5d0 0x5632d35b5b00 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f795c000c00 tx=0x7f795c0cd320 comp rx=0 tx=0).stop 2023-10-19T12:46:45.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.136+0000 7f7985d3ab80 1 -- 172.21.15.46:0/243543172 shutdown_connections 2023-10-19T12:46:45.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.136+0000 7f7985d3ab80 1 --2- 172.21.15.46:0/243543172 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5632d35adc30 0x5632d35bd080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:46:45.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.136+0000 7f7985d3ab80 1 --2- 172.21.15.46:0/243543172 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5632d35ac5d0 0x5632d35b5b00 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:46:45.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.136+0000 7f7985d3ab80 1 --2- 172.21.15.46:0/243543172 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x5632d35d24a0 0x5632d35d48c0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:46:45.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.136+0000 7f7985d3ab80 1 --2- 172.21.15.46:0/243543172 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5632d35ad2d0 0x5632d35b6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:46:45.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.136+0000 7f7985d3ab80 1 -- 172.21.15.46:0/243543172 >> 172.21.15.46:0/243543172 conn(0x5632d3520720 msgr2=0x5632d35a6b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:46:45.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.136+0000 7f794b7fe700 0 client.25910 ms_handle_reset on v2:172.21.15.157:6838/552718978 2023-10-19T12:46:45.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.136+0000 7f7985d3ab80 1 -- 172.21.15.46:0/243543172 shutdown_connections 2023-10-19T12:46:45.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.137+0000 7f7985d3ab80 1 -- 172.21.15.46:0/243543172 wait complete. 2023-10-19T12:46:45.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.137+0000 7f7985d3ab80 20 client.25910 trim_cache size 0 max 16384 2023-10-19T12:46:45.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.168+0000 7f7985d3ab80 1 Processor -- start 2023-10-19T12:46:45.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.169+0000 7f7985d3ab80 1 -- start start 2023-10-19T12:46:45.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.169+0000 7f7985d3ab80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5632d35ac5d0 0x5632d35ac090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:46:45.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.169+0000 7f7985d3ab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5632d35ad2d0 0x5632d35bd040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:46:45.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.169+0000 7f7985d3ab80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5632d35adc30 0x5632d35a6810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:46:45.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.169+0000 7f7985d3ab80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x5632d337f920 con 0x5632d35ac5d0 2023-10-19T12:46:45.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.169+0000 7f7985d3ab80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5632d35b5670 con 0x5632d35adc30 2023-10-19T12:46:45.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.169+0000 7f7985d3ab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5632d35a7a10 con 0x5632d35ad2d0 2023-10-19T12:46:45.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.170+0000 7f796b7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5632d35ad2d0 0x5632d35bd040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:46:45.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.170+0000 7f796b7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5632d35ad2d0 0x5632d35bd040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:47488/0 (socket says 172.21.15.46:47488) 2023-10-19T12:46:45.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.170+0000 7f796b7fe700 1 -- 172.21.15.46:0/1461672780 learned_addr learned my addr 172.21.15.46:0/1461672780 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:46:45.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.170+0000 7f797099c700 1 --2- 172.21.15.46:0/1461672780 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5632d35adc30 0x5632d35a6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:46:45.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.170+0000 7f796bfff700 1 --2- 172.21.15.46:0/1461672780 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5632d35ac5d0 0x5632d35ac090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:46:45.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.171+0000 7f797099c700 1 -- 172.21.15.46:0/1461672780 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5632d35ad2d0 msgr2=0x5632d35bd040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:46:45.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.171+0000 7f797099c700 1 --2- 172.21.15.46:0/1461672780 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5632d35ad2d0 0x5632d35bd040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:46:45.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.171+0000 7f797099c700 1 -- 172.21.15.46:0/1461672780 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5632d35ac5d0 msgr2=0x5632d35ac090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:46:45.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.171+0000 7f797099c700 1 --2- 172.21.15.46:0/1461672780 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5632d35ac5d0 0x5632d35ac090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:46:45.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.171+0000 7f797099c700 1 -- 172.21.15.46:0/1461672780 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5632d3312c60 con 0x5632d35adc30 2023-10-19T12:46:45.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.171+0000 7f796b7fe700 1 --2- 172.21.15.46:0/1461672780 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5632d35ad2d0 0x5632d35bd040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:46:45.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.171+0000 7f796bfff700 1 --2- 172.21.15.46:0/1461672780 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5632d35ac5d0 0x5632d35ac090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:46:45.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.173+0000 7f797099c700 1 --2- 172.21.15.46:0/1461672780 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5632d35adc30 0x5632d35a6810 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f796400a950 tx=0x7f796400c050 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5383dae51d21d175 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:46:45.179 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.174+0000 7f7952ffd700 1 -- 172.21.15.46:0/1461672780 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7964011040 con 0x5632d35adc30 2023-10-19T12:46:45.179 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.174+0000 7f7952ffd700 1 -- 172.21.15.46:0/1461672780 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7964022400 con 0x5632d35adc30 2023-10-19T12:46:45.179 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.174+0000 7f7952ffd700 1 -- 172.21.15.46:0/1461672780 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7964017650 con 0x5632d35adc30 2023-10-19T12:46:45.179 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.175+0000 7f7985d3ab80 1 -- 172.21.15.46:0/1461672780 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5632d35adc30 msgr2=0x5632d35a6810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:46:45.179 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.175+0000 7f7985d3ab80 1 --2- 172.21.15.46:0/1461672780 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5632d35adc30 0x5632d35a6810 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f796400a950 tx=0x7f796400c050 comp rx=0 tx=0).stop 2023-10-19T12:46:45.180 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.175+0000 7f7985d3ab80 1 -- 172.21.15.46:0/1461672780 shutdown_connections 2023-10-19T12:46:45.180 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.175+0000 7f7985d3ab80 1 --2- 172.21.15.46:0/1461672780 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5632d35adc30 0x5632d35a6810 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:46:45.180 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.176+0000 7f7985d3ab80 1 --2- 172.21.15.46:0/1461672780 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5632d35ac5d0 0x5632d35ac090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:46:45.180 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.176+0000 7f7985d3ab80 1 --2- 172.21.15.46:0/1461672780 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5632d35ad2d0 0x5632d35bd040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:46:45.181 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.176+0000 7f7985d3ab80 1 -- 172.21.15.46:0/1461672780 >> 172.21.15.46:0/1461672780 conn(0x5632d3520720 msgr2=0x5632d35b4840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:46:45.182 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.176+0000 7f7985d3ab80 1 -- 172.21.15.46:0/1461672780 shutdown_connections 2023-10-19T12:46:45.182 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.176+0000 7f7985d3ab80 1 -- 172.21.15.46:0/1461672780 wait complete. 2023-10-19T12:46:45.182 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.177+0000 7f7985d3ab80 1 -- start start 2023-10-19T12:46:45.182 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.177+0000 7f7985d3ab80 1 Processor -- start 2023-10-19T12:46:45.182 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.178+0000 7f7985d3ab80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5632d35ac5d0 0x5632d35b9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:46:45.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.179+0000 7f7985d3ab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5632d35ad2d0 0x5632d35b95d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:46:45.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.179+0000 7f7985d3ab80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5632d35adc30 0x5632d35bc5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:46:45.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.179+0000 7f797099c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5632d35adc30 0x5632d35bc5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:46:45.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.179+0000 7f797099c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5632d35adc30 0x5632d35bc5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:39338/0 (socket says 172.21.15.46:39338) 2023-10-19T12:46:45.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.179+0000 7f797099c700 1 -- 172.21.15.46:0/2405191560 learned_addr learned my addr 172.21.15.46:0/2405191560 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:46:45.185 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.179+0000 7f7985d3ab80 1 -- 172.21.15.46:0/2405191560 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x5632d35bcb30 con 0x5632d35ac5d0 2023-10-19T12:46:45.185 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.179+0000 7f796b7fe700 1 --2- 172.21.15.46:0/2405191560 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5632d35ad2d0 0x5632d35b95d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:46:45.185 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.179+0000 7f7985d3ab80 1 -- 172.21.15.46:0/2405191560 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5632d35bcca0 con 0x5632d35adc30 2023-10-19T12:46:45.185 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.179+0000 7f7985d3ab80 1 -- 172.21.15.46:0/2405191560 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5632d35bce60 con 0x5632d35ad2d0 2023-10-19T12:46:45.185 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.180+0000 7f7985d3ab80 10 client.0 _ll_register_callbacks cb 0x5632d33e5a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:46:45.186 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.180+0000 7f796bfff700 1 --2- 172.21.15.46:0/2405191560 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5632d35ac5d0 0x5632d35b9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:46:45.186 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.180+0000 7f797099c700 1 -- 172.21.15.46:0/2405191560 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5632d35ad2d0 msgr2=0x5632d35b95d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:46:45.186 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.180+0000 7f797099c700 1 --2- 172.21.15.46:0/2405191560 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5632d35ad2d0 0x5632d35b95d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:46:45.186 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.180+0000 7f797099c700 1 -- 172.21.15.46:0/2405191560 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5632d35ac5d0 msgr2=0x5632d35b9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:46:45.186 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.180+0000 7f797099c700 1 --2- 172.21.15.46:0/2405191560 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5632d35ac5d0 0x5632d35b9090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:46:45.187 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.180+0000 7f797099c700 1 -- 172.21.15.46:0/2405191560 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5632d3329de0 con 0x5632d35adc30 2023-10-19T12:46:45.187 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.180+0000 7f796bfff700 1 --2- 172.21.15.46:0/2405191560 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5632d35ac5d0 0x5632d35b9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T12:46:45.187 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.181+0000 7f797099c700 1 --2- 172.21.15.46:0/2405191560 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5632d35adc30 0x5632d35bc5f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7964003cd0 tx=0x7f7964003db0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62da57ad4dfc8ca6 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:46:45.187 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.181+0000 7f794b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.157:3300/0 2023-10-19T12:46:45.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.181+0000 7f794b7fe700 1 -- 172.21.15.46:0/2405191560 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7964011030 con 0x5632d35adc30 2023-10-19T12:46:45.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.181+0000 7f794b7fe700 1 -- 172.21.15.46:0/2405191560 <== mon.2 v2:172.21.15.157:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f7964022780 con 0x5632d35adc30 2023-10-19T12:46:45.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.182+0000 7f7985d3ab80 1 -- 172.21.15.46:0/2405191560 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f795c099d10 con 0x5632d35adc30 2023-10-19T12:46:45.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.182+0000 7f794b7fe700 1 -- 172.21.15.46:0/2405191560 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7964022b40 con 0x5632d35adc30 2023-10-19T12:46:45.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.182+0000 7f7985d3ab80 10 client.25916 fetch_fsmap learned FSMap version 35 2023-10-19T12:46:45.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.182+0000 7f7985d3ab80 1 -- 172.21.15.46:0/2405191560 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x7f796c1052f0 con 0x5632d35adc30 2023-10-19T12:46:45.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.182+0000 7f794b7fe700 1 -- 172.21.15.46:0/2405191560 <== mon.2 v2:172.21.15.157:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f795c099d10 con 0x5632d35adc30 2023-10-19T12:46:45.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.183+0000 7f794b7fe700 1 -- 172.21.15.46:0/2405191560 <== mon.2 v2:172.21.15.157:3300/0 5 ==== fsmap(e 35) v1 ==== 7922+0+0 (secure 0 0 0) 0x7f79640173f0 con 0x5632d35adc30 2023-10-19T12:46:45.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.183+0000 7f7985d3ab80 10 client.25916 fetch_fsmap finished waiting for FSMap version 35 2023-10-19T12:46:45.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.183+0000 7f7985d3ab80 10 client.25916 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-19T12:46:45.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.183+0000 7f7985d3ab80 20 client.25916 populate_metadata read hostname 'smithi046' 2023-10-19T12:46:45.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.183+0000 7f7985d3ab80 1 --2- 172.21.15.46:0/2405191560 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x5632d3627600 0x5632d3629a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:46:45.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.183+0000 7f7985d3ab80 4 client.25916 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-19T12:46:45.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.183+0000 7f7985d3ab80 1 -- 172.21.15.46:0/2405191560 --> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5632d34f7e50 con 0x5632d3627600 2023-10-19T12:46:45.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.183+0000 7f796bfff700 1 --2- 172.21.15.46:0/2405191560 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x5632d3627600 0x5632d3629a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:46:45.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.184+0000 7f796bfff700 1 --2- 172.21.15.46:0/2405191560 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x5632d3627600 0x5632d3629a20 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e14d8d1acfa31266 server_cookie=56ab2a1aa408e64 in_seq=0 out_seq=0 2023-10-19T12:46:45.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.184+0000 7f794b7fe700 10 client.25916 ms_handle_connect on v2:172.21.15.157:6838/552718978 2023-10-19T12:46:45.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.184+0000 7f794b7fe700 1 -- 172.21.15.46:0/2405191560 <== mds.0 v2:172.21.15.157:6838/552718978 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x5632d34f7e50 con 0x5632d3627600 2023-10-19T12:46:45.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.184+0000 7f794b7fe700 10 client.25916 handle_command_reply: tid=0 2023-10-19T12:46:45.193 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.184+0000 7f7985d3ab80 1 client.25916 shutdown 2023-10-19T12:46:45.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.185+0000 7f7985d3ab80 1 -- 172.21.15.46:0/2405191560 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5632d35adc30 msgr2=0x5632d35bc5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:46:45.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.185+0000 7f7985d3ab80 1 --2- 172.21.15.46:0/2405191560 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5632d35adc30 0x5632d35bc5f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7964003cd0 tx=0x7f7964003db0 comp rx=0 tx=0).stop 2023-10-19T12:46:45.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.185+0000 7f7985d3ab80 1 -- 172.21.15.46:0/2405191560 shutdown_connections 2023-10-19T12:46:45.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.185+0000 7f7985d3ab80 1 --2- 172.21.15.46:0/2405191560 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5632d35adc30 0x5632d35bc5f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:46:45.194 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.185+0000 7f7985d3ab80 1 --2- 172.21.15.46:0/2405191560 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x5632d3627600 0x5632d3629a20 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:46:45.195 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.185+0000 7f7985d3ab80 1 --2- 172.21.15.46:0/2405191560 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5632d35ac5d0 0x5632d35b9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:46:45.195 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.185+0000 7f7985d3ab80 1 --2- 172.21.15.46:0/2405191560 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5632d35ad2d0 0x5632d35b95d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:46:45.195 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.185+0000 7f7985d3ab80 1 -- 172.21.15.46:0/2405191560 >> 172.21.15.46:0/2405191560 conn(0x5632d3520720 msgr2=0x5632d35a6810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:46:45.195 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.185+0000 7f794b7fe700 0 client.25916 ms_handle_reset on v2:172.21.15.157:6838/552718978 2023-10-19T12:46:45.195 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.185+0000 7f7985d3ab80 1 -- 172.21.15.46:0/2405191560 shutdown_connections 2023-10-19T12:46:45.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.185+0000 7f7985d3ab80 1 -- 172.21.15.46:0/2405191560 wait complete. 2023-10-19T12:46:45.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.185+0000 7f7985d3ab80 20 client.25916 trim_cache size 0 max 16384 2023-10-19T12:46:45.196 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-10-19T12:46:45.196 INFO:teuthology.orchestra.run.smithi046.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-19T12:46:45.197 INFO:teuthology.orchestra.run.smithi046.stdout: "scrubs": { 2023-10-19T12:46:45.197 INFO:teuthology.orchestra.run.smithi046.stdout: "21e73f70-af16-4ae7-bc34-e6c54ba8e1ec": { 2023-10-19T12:46:45.197 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2023-10-19T12:46:45.197 INFO:teuthology.orchestra.run.smithi046.stdout: "tag": "21e73f70-af16-4ae7-bc34-e6c54ba8e1ec", 2023-10-19T12:46:45.197 INFO:teuthology.orchestra.run.smithi046.stdout: "options": "recursive,force" 2023-10-19T12:46:45.198 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:46:45.198 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:46:45.198 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-10-19T12:46:45.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.187+0000 7f79723ff700 1 -- 172.21.15.46:0/3136246090 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f79540a1550 msgr2=0x7f79540a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:46:45.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.187+0000 7f79723ff700 1 --2- 172.21.15.46:0/3136246090 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f79540a1550 0x7f79540a3a10 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f7964009fd0 tx=0x7f796400e040 comp rx=0 tx=0).stop 2023-10-19T12:46:45.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.187+0000 7f79723ff700 1 -- 172.21.15.46:0/3136246090 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f796c0ff000 msgr2=0x7f796c19ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:46:45.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.187+0000 7f79723ff700 1 --2- 172.21.15.46:0/3136246090 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f796c0ff000 0x7f796c19ccc0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f795c00c9b0 tx=0x7f795c00ccc0 comp rx=0 tx=0).stop 2023-10-19T12:46:45.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.189+0000 7f79723ff700 1 -- 172.21.15.46:0/3136246090 shutdown_connections 2023-10-19T12:46:45.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.189+0000 7f79723ff700 1 --2- 172.21.15.46:0/3136246090 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f796c104340 0x7f796c1a4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:46:45.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.189+0000 7f79723ff700 1 --2- 172.21.15.46:0/3136246090 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f79540a1550 0x7f79540a3a10 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:46:45.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.189+0000 7f79723ff700 1 --2- 172.21.15.46:0/3136246090 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f796c0ff000 0x7f796c19ccc0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:46:45.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.189+0000 7f79723ff700 1 --2- 172.21.15.46:0/3136246090 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f796c101970 0x7f796c19d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:46:45.201 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.189+0000 7f79723ff700 1 -- 172.21.15.46:0/3136246090 >> 172.21.15.46:0/3136246090 conn(0x7f796c0fac00 msgr2=0x7f796c0ff980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:46:45.201 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.190+0000 7f79723ff700 1 -- 172.21.15.46:0/3136246090 shutdown_connections 2023-10-19T12:46:45.201 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:46:45.190+0000 7f79723ff700 1 -- 172.21.15.46:0/3136246090 wait complete. 2023-10-19T12:46:45.221 INFO:tasks.cephfs.filesystem:scrub status for tag:21e73f70-af16-4ae7-bc34-e6c54ba8e1ec - {'path': '/', 'tag': '21e73f70-af16-4ae7-bc34-e6c54ba8e1ec', 'options': 'recursive,force'} 2023-10-19T12:46:46.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:46:45 smithi195 ceph-mon[134493]: pgmap v451: 129 pgs: 129 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 7.8 MiB/s wr, 545 op/s 2023-10-19T12:46:46.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:46:45 smithi046 ceph-mon[98509]: pgmap v451: 129 pgs: 129 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 7.8 MiB/s wr, 545 op/s 2023-10-19T12:46:46.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:46:45 smithi157 ceph-mon[134109]: pgmap v451: 129 pgs: 129 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 7.8 MiB/s wr, 545 op/s 2023-10-19T12:46:46.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 165.0 s, 1070.0 tps, lat 94.384 ms stddev 113.199 2023-10-19T12:46:48.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:46:47 smithi195 ceph-mon[134493]: pgmap v452: 129 pgs: 129 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 9.7 MiB/s wr, 703 op/s 2023-10-19T12:46:48.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:46:47 smithi046 ceph-mon[98509]: pgmap v452: 129 pgs: 129 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 9.7 MiB/s wr, 703 op/s 2023-10-19T12:46:48.339 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:46:47 smithi157 ceph-mon[134109]: pgmap v452: 129 pgs: 129 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 9.7 MiB/s wr, 703 op/s 2023-10-19T12:46:49.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:46:48 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:46:49.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:46:48 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:46:49.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:46:48 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:46:50.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:46:49 smithi195 ceph-mon[134493]: pgmap v453: 129 pgs: 129 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 8.4 MiB/s wr, 656 op/s 2023-10-19T12:46:50.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:46:49 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:46:50.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:46:49 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:46:50.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:46:49 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:46:50.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:46:49 smithi046 ceph-mon[98509]: pgmap v453: 129 pgs: 129 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 8.4 MiB/s wr, 656 op/s 2023-10-19T12:46:50.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:46:49 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:46:50.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:46:49 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:46:50.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:46:49 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:46:50.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:46:49 smithi157 ceph-mon[134109]: pgmap v453: 129 pgs: 129 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 8.4 MiB/s wr, 656 op/s 2023-10-19T12:46:50.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:46:49 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:46:50.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:46:49 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:46:50.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:46:49 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:46:51.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 170.0 s, 823.0 tps, lat 121.105 ms stddev 187.115 2023-10-19T12:46:52.136 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:46:51 smithi195 ceph-mon[134493]: pgmap v454: 129 pgs: 129 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 7.8 MiB/s wr, 616 op/s 2023-10-19T12:46:52.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:46:51 smithi046 ceph-mon[98509]: pgmap v454: 129 pgs: 129 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 7.8 MiB/s wr, 616 op/s 2023-10-19T12:46:52.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:46:51 smithi157 ceph-mon[134109]: pgmap v454: 129 pgs: 129 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 7.8 MiB/s wr, 616 op/s 2023-10-19T12:46:54.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:46:53 smithi195 ceph-mon[134493]: pgmap v455: 129 pgs: 129 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.9 MiB/s wr, 787 op/s 2023-10-19T12:46:54.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:46:53 smithi046 ceph-mon[98509]: pgmap v455: 129 pgs: 129 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.9 MiB/s wr, 787 op/s 2023-10-19T12:46:54.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:46:53 smithi157 ceph-mon[134109]: pgmap v455: 129 pgs: 129 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.9 MiB/s wr, 787 op/s 2023-10-19T12:46:56.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:46:55 smithi195 ceph-mon[134493]: pgmap v456: 129 pgs: 129 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.3 MiB/s wr, 596 op/s 2023-10-19T12:46:56.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:46:55 smithi046 ceph-mon[98509]: pgmap v456: 129 pgs: 129 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.3 MiB/s wr, 596 op/s 2023-10-19T12:46:56.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:46:55 smithi157 ceph-mon[134109]: pgmap v456: 129 pgs: 129 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.3 MiB/s wr, 596 op/s 2023-10-19T12:46:56.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 175.0 s, 1033.8 tps, lat 94.535 ms stddev 117.136 2023-10-19T12:46:58.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:46:57 smithi195 ceph-mon[134493]: pgmap v457: 129 pgs: 129 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.9 MiB/s wr, 762 op/s 2023-10-19T12:46:58.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:46:57 smithi046 ceph-mon[98509]: pgmap v457: 129 pgs: 129 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.9 MiB/s wr, 762 op/s 2023-10-19T12:46:58.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:46:57 smithi157 ceph-mon[134109]: pgmap v457: 129 pgs: 129 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.9 MiB/s wr, 762 op/s 2023-10-19T12:46:59.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:46:59 smithi046 ceph-mon[98509]: pgmap v458: 129 pgs: 129 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 9.4 MiB/s wr, 747 op/s 2023-10-19T12:46:59.837 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:46:59 smithi157 ceph-mon[134109]: pgmap v458: 129 pgs: 129 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 9.4 MiB/s wr, 747 op/s 2023-10-19T12:46:59.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:46:59 smithi195 ceph-mon[134493]: pgmap v458: 129 pgs: 129 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 9.4 MiB/s wr, 747 op/s 2023-10-19T12:47:01.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 180.0 s, 643.8 tps, lat 156.545 ms stddev 173.771 2023-10-19T12:47:02.090 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:47:01 smithi157 ceph-mon[134109]: pgmap v459: 129 pgs: 129 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 10 MiB/s wr, 738 op/s 2023-10-19T12:47:02.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:47:01 smithi195 ceph-mon[134493]: pgmap v459: 129 pgs: 129 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 10 MiB/s wr, 738 op/s 2023-10-19T12:47:02.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:47:01 smithi046 ceph-mon[98509]: pgmap v459: 129 pgs: 129 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 10 MiB/s wr, 738 op/s 2023-10-19T12:47:04.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:47:03 smithi195 ceph-mon[134493]: pgmap v460: 129 pgs: 129 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 12 MiB/s wr, 928 op/s 2023-10-19T12:47:04.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:47:03 smithi046 ceph-mon[98509]: pgmap v460: 129 pgs: 129 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 12 MiB/s wr, 928 op/s 2023-10-19T12:47:04.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:47:03 smithi157 ceph-mon[134109]: pgmap v460: 129 pgs: 129 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 12 MiB/s wr, 928 op/s 2023-10-19T12:47:06.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:47:05 smithi195 ceph-mon[134493]: pgmap v461: 129 pgs: 129 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 10 MiB/s wr, 731 op/s 2023-10-19T12:47:06.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:47:05 smithi046 ceph-mon[98509]: pgmap v461: 129 pgs: 129 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 10 MiB/s wr, 731 op/s 2023-10-19T12:47:06.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:47:05 smithi157 ceph-mon[134109]: pgmap v461: 129 pgs: 129 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 10 MiB/s wr, 731 op/s 2023-10-19T12:47:06.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 185.0 s, 814.0 tps, lat 123.290 ms stddev 187.497 2023-10-19T12:47:08.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:47:07 smithi195 ceph-mon[134493]: pgmap v462: 129 pgs: 129 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 MiB/s wr, 844 op/s 2023-10-19T12:47:08.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:47:07 smithi046 ceph-mon[98509]: pgmap v462: 129 pgs: 129 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 MiB/s wr, 844 op/s 2023-10-19T12:47:08.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:47:07 smithi157 ceph-mon[134109]: pgmap v462: 129 pgs: 129 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 MiB/s wr, 844 op/s 2023-10-19T12:47:09.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:47:08 smithi195 ceph-mon[134493]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-19T12:47:09.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:47:08 smithi046 ceph-mon[98509]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-19T12:47:09.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:47:08 smithi157 ceph-mon[134109]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-19T12:47:10.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:47:09 smithi046 ceph-mon[98509]: pgmap v463: 129 pgs: 129 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 MiB/s wr, 788 op/s 2023-10-19T12:47:10.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:47:09 smithi157 ceph-mon[134109]: pgmap v463: 129 pgs: 129 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 MiB/s wr, 788 op/s 2023-10-19T12:47:10.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:47:09 smithi195 ceph-mon[134493]: pgmap v463: 129 pgs: 129 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 MiB/s wr, 788 op/s 2023-10-19T12:47:11.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 190.0 s, 963.8 tps, lat 105.843 ms stddev 135.072 2023-10-19T12:47:12.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:47:11 smithi046 ceph-mon[98509]: pgmap v464: 129 pgs: 129 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 686 op/s 2023-10-19T12:47:12.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:47:11 smithi157 ceph-mon[134109]: pgmap v464: 129 pgs: 129 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 686 op/s 2023-10-19T12:47:12.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:47:11 smithi195 ceph-mon[134493]: pgmap v464: 129 pgs: 129 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 686 op/s 2023-10-19T12:47:14.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:47:13 smithi046 ceph-mon[98509]: pgmap v465: 129 pgs: 129 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 MiB/s wr, 802 op/s 2023-10-19T12:47:14.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:47:13 smithi046 ceph-mon[98509]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-19T12:47:14.340 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:47:13 smithi157 ceph-mon[134109]: pgmap v465: 129 pgs: 129 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 MiB/s wr, 802 op/s 2023-10-19T12:47:14.341 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:47:13 smithi157 ceph-mon[134109]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-19T12:47:14.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:47:13 smithi195 ceph-mon[134493]: pgmap v465: 129 pgs: 129 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 MiB/s wr, 802 op/s 2023-10-19T12:47:14.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:47:13 smithi195 ceph-mon[134493]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-19T12:47:15.222 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-19T12:47:15.228 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:47:14 smithi046 ceph-mon[98509]: pgmap v466: 129 pgs: 129 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 10 MiB/s wr, 562 op/s 2023-10-19T12:47:15.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:47:14 smithi157 ceph-mon[134109]: pgmap v466: 129 pgs: 129 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 10 MiB/s wr, 562 op/s 2023-10-19T12:47:15.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:47:14 smithi195 ceph-mon[134493]: pgmap v466: 129 pgs: 129 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 10 MiB/s wr, 562 op/s 2023-10-19T12:47:15.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.489+0000 7fb5635ff700 1 -- 172.21.15.46:0/2914459129 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb55c101220 msgr2=0x7fb55c107ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:47:15.493 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.489+0000 7fb5635ff700 1 --2- 172.21.15.46:0/2914459129 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb55c101220 0x7fb55c107ad0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb55400b0a0 tx=0x7fb55400b3b0 comp rx=0 tx=0).stop 2023-10-19T12:47:15.493 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.489+0000 7fb5635ff700 1 -- 172.21.15.46:0/2914459129 shutdown_connections 2023-10-19T12:47:15.493 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.489+0000 7fb5635ff700 1 --2- 172.21.15.46:0/2914459129 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb55c101220 0x7fb55c107ad0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:47:15.493 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.489+0000 7fb5635ff700 1 --2- 172.21.15.46:0/2914459129 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb55c0ff690 0x7fb55c0ffab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:47:15.494 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.489+0000 7fb5635ff700 1 --2- 172.21.15.46:0/2914459129 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb55c100880 0x7fb55c100ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:47:15.494 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.489+0000 7fb5635ff700 1 -- 172.21.15.46:0/2914459129 >> 172.21.15.46:0/2914459129 conn(0x7fb55c0fac00 msgr2=0x7fb55c0fd040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:47:15.494 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.489+0000 7fb5635ff700 1 -- 172.21.15.46:0/2914459129 shutdown_connections 2023-10-19T12:47:15.495 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.489+0000 7fb5635ff700 1 -- 172.21.15.46:0/2914459129 wait complete. 2023-10-19T12:47:15.495 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.491+0000 7fb5635ff700 1 Processor -- start 2023-10-19T12:47:15.495 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.491+0000 7fb5635ff700 1 -- start start 2023-10-19T12:47:15.495 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.491+0000 7fb5635ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb55c0ff690 0x7fb55c194640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:47:15.496 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.491+0000 7fb5635ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb55c100880 0x7fb55c194b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:47:15.496 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.491+0000 7fb5635ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb55c101220 0x7fb55c19bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:47:15.496 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.491+0000 7fb5635ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb55c19c1e0 con 0x7fb55c101220 2023-10-19T12:47:15.496 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.491+0000 7fb5635ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb55c19c350 con 0x7fb55c100880 2023-10-19T12:47:15.497 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.491+0000 7fb5635ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb55c19c4c0 con 0x7fb55c0ff690 2023-10-19T12:47:15.498 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.492+0000 7fb56139b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb55c0ff690 0x7fb55c194640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:47:15.498 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.492+0000 7fb56139b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb55c0ff690 0x7fb55c194640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:56350/0 (socket says 172.21.15.46:56350) 2023-10-19T12:47:15.498 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.492+0000 7fb56139b700 1 -- 172.21.15.46:0/3610113857 learned_addr learned my addr 172.21.15.46:0/3610113857 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:47:15.498 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.492+0000 7fb560b9a700 1 --2- 172.21.15.46:0/3610113857 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb55c100880 0x7fb55c194b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:47:15.499 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.492+0000 7fb56139b700 1 -- 172.21.15.46:0/3610113857 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb55c100880 msgr2=0x7fb55c194b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:47:15.499 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.492+0000 7fb56139b700 1 --2- 172.21.15.46:0/3610113857 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb55c100880 0x7fb55c194b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:47:15.499 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.492+0000 7fb56139b700 1 -- 172.21.15.46:0/3610113857 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb55c101220 msgr2=0x7fb55c19bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:47:15.499 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.492+0000 7fb56139b700 1 --2- 172.21.15.46:0/3610113857 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb55c101220 0x7fb55c19bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:47:15.500 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.492+0000 7fb56139b700 1 -- 172.21.15.46:0/3610113857 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb554009d00 con 0x7fb55c0ff690 2023-10-19T12:47:15.500 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.493+0000 7fb56139b700 1 --2- 172.21.15.46:0/3610113857 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb55c0ff690 0x7fb55c194640 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb55800e970 tx=0x7fb55800ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:47:15.500 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.493+0000 7fb5527fc700 1 -- 172.21.15.46:0/3610113857 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb558009790 con 0x7fb55c0ff690 2023-10-19T12:47:15.500 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.493+0000 7fb5527fc700 1 -- 172.21.15.46:0/3610113857 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb55800eec0 con 0x7fb55c0ff690 2023-10-19T12:47:15.500 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.493+0000 7fb5527fc700 1 -- 172.21.15.46:0/3610113857 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb558003cf0 con 0x7fb55c0ff690 2023-10-19T12:47:15.501 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.493+0000 7fb5635ff700 1 -- 172.21.15.46:0/3610113857 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb55c19c7a0 con 0x7fb55c0ff690 2023-10-19T12:47:15.501 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.494+0000 7fb5635ff700 1 -- 172.21.15.46:0/3610113857 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb55c19cc60 con 0x7fb55c0ff690 2023-10-19T12:47:15.517 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.514+0000 7fb5527fc700 1 -- 172.21.15.46:0/3610113857 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fb55800ccd0 con 0x7fb55c0ff690 2023-10-19T12:47:15.519 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.516+0000 7fb5527fc700 1 --2- 172.21.15.46:0/3610113857 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fb5480a1500 0x7fb5480a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:47:15.520 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.517+0000 7fb5527fc700 1 -- 172.21.15.46:0/3610113857 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7fb558014070 con 0x7fb55c0ff690 2023-10-19T12:47:15.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.517+0000 7fb560b9a700 1 --2- 172.21.15.46:0/3610113857 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fb5480a1500 0x7fb5480a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:47:15.521 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.518+0000 7fb576f5db80 1 Processor -- start 2023-10-19T12:47:15.522 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.518+0000 7fb560b9a700 1 --2- 172.21.15.46:0/3610113857 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fb5480a1500 0x7fb5480a39c0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fb55c195710 tx=0x7fb54c00a300 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:47:15.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.519+0000 7fb576f5db80 1 -- start start 2023-10-19T12:47:15.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.519+0000 7fb576f5db80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5592821ce2d0 0x5592821ce6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:47:15.524 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.519+0000 7fb576f5db80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5592821cec30 0x5592821cd090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:47:15.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.519+0000 7fb576f5db80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5592821cd5d0 0x5592821cda50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:47:15.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.519+0000 7fb576f5db80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592821406e0 con 0x5592821ce2d0 2023-10-19T12:47:15.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.519+0000 7fb576f5db80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x559282126c60 con 0x5592821cec30 2023-10-19T12:47:15.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.519+0000 7fb576f5db80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x559282124580 con 0x5592821cd5d0 2023-10-19T12:47:15.525 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.519+0000 7fb560b9a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5592821cec30 0x5592821cd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:47:15.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.520+0000 7fb560b9a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5592821cec30 0x5592821cd090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:46924/0 (socket says 172.21.15.46:46924) 2023-10-19T12:47:15.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.520+0000 7fb560b9a700 1 -- 172.21.15.46:0/1400653488 learned_addr learned my addr 172.21.15.46:0/1400653488 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:47:15.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.520+0000 7fb561b9c700 1 --2- 172.21.15.46:0/1400653488 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5592821cd5d0 0x5592821cda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:47:15.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.520+0000 7fb560b9a700 1 -- 172.21.15.46:0/1400653488 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5592821cd5d0 msgr2=0x5592821cda50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:47:15.526 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.520+0000 7fb560b9a700 1 --2- 172.21.15.46:0/1400653488 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5592821cd5d0 0x5592821cda50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:47:15.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.520+0000 7fb560b9a700 1 -- 172.21.15.46:0/1400653488 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5592821ce2d0 msgr2=0x5592821ce6f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-19T12:47:15.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.520+0000 7fb560b9a700 1 --2- 172.21.15.46:0/1400653488 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5592821ce2d0 0x5592821ce6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:47:15.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.520+0000 7fb560b9a700 1 -- 172.21.15.46:0/1400653488 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5592820dd3f0 con 0x5592821cec30 2023-10-19T12:47:15.527 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.520+0000 7fb560b9a700 1 --2- 172.21.15.46:0/1400653488 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5592821cec30 0x5592821cd090 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb54c00fdb0 tx=0x7fb54c012000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c6cff40fe217131 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:47:15.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.521+0000 7fb5477fe700 1 -- 172.21.15.46:0/1400653488 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54c010ac0 con 0x5592821cec30 2023-10-19T12:47:15.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.521+0000 7fb5477fe700 1 -- 172.21.15.46:0/1400653488 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb54c020070 con 0x5592821cec30 2023-10-19T12:47:15.528 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.521+0000 7fb5477fe700 1 -- 172.21.15.46:0/1400653488 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54c01b420 con 0x5592821cec30 2023-10-19T12:47:15.529 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.524+0000 7fb576f5db80 1 -- 172.21.15.46:0/1400653488 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5592821cec30 msgr2=0x5592821cd090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:47:15.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.524+0000 7fb576f5db80 1 --2- 172.21.15.46:0/1400653488 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5592821cec30 0x5592821cd090 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb54c00fdb0 tx=0x7fb54c012000 comp rx=0 tx=0).stop 2023-10-19T12:47:15.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.526+0000 7fb576f5db80 1 -- 172.21.15.46:0/1400653488 shutdown_connections 2023-10-19T12:47:15.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.526+0000 7fb576f5db80 1 --2- 172.21.15.46:0/1400653488 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5592821cd5d0 0x5592821cda50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:47:15.530 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.526+0000 7fb576f5db80 1 --2- 172.21.15.46:0/1400653488 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5592821ce2d0 0x5592821ce6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:47:15.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.526+0000 7fb576f5db80 1 --2- 172.21.15.46:0/1400653488 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5592821cec30 0x5592821cd090 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:47:15.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.526+0000 7fb576f5db80 1 -- 172.21.15.46:0/1400653488 >> 172.21.15.46:0/1400653488 conn(0x559282141720 msgr2=0x5592821c7b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:47:15.531 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.527+0000 7fb576f5db80 1 -- 172.21.15.46:0/1400653488 shutdown_connections 2023-10-19T12:47:15.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.527+0000 7fb576f5db80 1 -- 172.21.15.46:0/1400653488 wait complete. 2023-10-19T12:47:15.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.528+0000 7fb576f5db80 1 -- start start 2023-10-19T12:47:15.532 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.528+0000 7fb576f5db80 1 Processor -- start 2023-10-19T12:47:15.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.530+0000 7fb576f5db80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5592821cd5d0 0x5592821e7c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:47:15.533 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.530+0000 7fb576f5db80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5592821ce2d0 0x5592821e8150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:47:15.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.530+0000 7fb56139b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5592821cd5d0 0x5592821e7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:47:15.534 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.530+0000 7fb56139b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5592821cd5d0 0x5592821e7c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:46940/0 (socket says 172.21.15.46:46940) 2023-10-19T12:47:15.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.531+0000 7fb56139b700 1 -- 172.21.15.46:0/3812164010 learned_addr learned my addr 172.21.15.46:0/3812164010 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:47:15.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.531+0000 7fb560b9a700 1 --2- 172.21.15.46:0/3812164010 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5592821ce2d0 0x5592821e8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:47:15.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.531+0000 7fb576f5db80 1 --2- 172.21.15.46:0/3812164010 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5592821cec30 0x5592821ef190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:47:15.535 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.531+0000 7fb576f5db80 1 -- 172.21.15.46:0/3812164010 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55928211fe70 con 0x5592821cec30 2023-10-19T12:47:15.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.531+0000 7fb576f5db80 1 -- 172.21.15.46:0/3812164010 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592820bc710 con 0x5592821cd5d0 2023-10-19T12:47:15.536 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.531+0000 7fb576f5db80 1 -- 172.21.15.46:0/3812164010 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592820bc3b0 con 0x5592821ce2d0 2023-10-19T12:47:15.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.532+0000 7fb576f5db80 10 client.0 _ll_register_callbacks cb 0x559282006a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:47:15.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.533+0000 7fb56139b700 1 -- 172.21.15.46:0/3812164010 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5592821ce2d0 msgr2=0x5592821e8150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:47:15.537 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.533+0000 7fb56139b700 1 --2- 172.21.15.46:0/3812164010 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5592821ce2d0 0x5592821e8150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:47:15.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.533+0000 7fb56139b700 1 -- 172.21.15.46:0/3812164010 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5592821cec30 msgr2=0x5592821ef190 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-19T12:47:15.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.533+0000 7fb56139b700 1 --2- 172.21.15.46:0/3812164010 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5592821cec30 0x5592821ef190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:47:15.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.533+0000 7fb56139b700 1 -- 172.21.15.46:0/3812164010 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb54c00fa60 con 0x5592821cd5d0 2023-10-19T12:47:15.539 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.534+0000 7fb56139b700 1 --2- 172.21.15.46:0/3812164010 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5592821cd5d0 0x5592821e7c10 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb558099f00 tx=0x7fb558099c90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa10176e84a82414 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:47:15.539 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.534+0000 7fb544ff9700 10 client.0 ms_handle_connect on v2:172.21.15.157:3300/0 2023-10-19T12:47:15.539 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.535+0000 7fb544ff9700 1 -- 172.21.15.46:0/3812164010 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5580caea0 con 0x5592821cd5d0 2023-10-19T12:47:15.540 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.535+0000 7fb544ff9700 1 -- 172.21.15.46:0/3812164010 <== mon.2 v2:172.21.15.157:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7fb55809e350 con 0x5592821cd5d0 2023-10-19T12:47:15.540 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.535+0000 7fb576f5db80 1 -- 172.21.15.46:0/3812164010 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559282124ef0 con 0x5592821cd5d0 2023-10-19T12:47:15.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.537+0000 7fb544ff9700 1 -- 172.21.15.46:0/3812164010 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb5580caea0 con 0x5592821cd5d0 2023-10-19T12:47:15.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.537+0000 7fb576f5db80 10 client.25928 fetch_fsmap learned FSMap version 37 2023-10-19T12:47:15.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.537+0000 7fb576f5db80 1 -- 172.21.15.46:0/3812164010 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x559281f4ade0 con 0x5592821cd5d0 2023-10-19T12:47:15.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.538+0000 7fb544ff9700 1 -- 172.21.15.46:0/3812164010 <== mon.2 v2:172.21.15.157:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb55809e170 con 0x5592821cd5d0 2023-10-19T12:47:15.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.538+0000 7fb544ff9700 1 -- 172.21.15.46:0/3812164010 <== mon.2 v2:172.21.15.157:3300/0 5 ==== fsmap(e 37) v1 ==== 7914+0+0 (secure 0 0 0) 0x7fb5580a2190 con 0x5592821cd5d0 2023-10-19T12:47:15.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.538+0000 7fb576f5db80 10 client.25928 fetch_fsmap finished waiting for FSMap version 37 2023-10-19T12:47:15.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.538+0000 7fb576f5db80 10 client.25928 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-19T12:47:15.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.538+0000 7fb576f5db80 20 client.25928 populate_metadata read hostname 'smithi046' 2023-10-19T12:47:15.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.538+0000 7fb576f5db80 1 --2- 172.21.15.46:0/3812164010 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x5592821f3a00 0x5592821f5e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:47:15.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.538+0000 7fb576f5db80 4 client.25928 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-19T12:47:15.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.538+0000 7fb576f5db80 1 -- 172.21.15.46:0/3812164010 --> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559282124ef0 con 0x5592821f3a00 2023-10-19T12:47:15.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.539+0000 7fb560b9a700 1 --2- 172.21.15.46:0/3812164010 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x5592821f3a00 0x5592821f5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:47:15.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.540+0000 7fb560b9a700 1 --2- 172.21.15.46:0/3812164010 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x5592821f3a00 0x5592821f5e80 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=72a0c3de66b537a4 server_cookie=c1c54dbff9d510c0 in_seq=0 out_seq=0 2023-10-19T12:47:15.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.540+0000 7fb544ff9700 10 client.25928 ms_handle_connect on v2:172.21.15.157:6838/552718978 2023-10-19T12:47:15.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.540+0000 7fb544ff9700 1 -- 172.21.15.46:0/3812164010 <== mds.0 v2:172.21.15.157:6838/552718978 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x559282124ef0 con 0x5592821f3a00 2023-10-19T12:47:15.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.540+0000 7fb544ff9700 10 client.25928 handle_command_reply: tid=0 2023-10-19T12:47:15.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.541+0000 7fb576f5db80 1 client.25928 shutdown 2023-10-19T12:47:15.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.542+0000 7fb576f5db80 1 -- 172.21.15.46:0/3812164010 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5592821cd5d0 msgr2=0x5592821e7c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:47:15.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.542+0000 7fb576f5db80 1 --2- 172.21.15.46:0/3812164010 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5592821cd5d0 0x5592821e7c10 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb558099f00 tx=0x7fb558099c90 comp rx=0 tx=0).stop 2023-10-19T12:47:15.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.552+0000 7fb576f5db80 1 -- 172.21.15.46:0/3812164010 shutdown_connections 2023-10-19T12:47:15.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.552+0000 7fb576f5db80 1 --2- 172.21.15.46:0/3812164010 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x5592821f3a00 0x5592821f5e80 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:47:15.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.552+0000 7fb576f5db80 1 --2- 172.21.15.46:0/3812164010 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5592821cec30 0x5592821ef190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:47:15.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.552+0000 7fb576f5db80 1 --2- 172.21.15.46:0/3812164010 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5592821cd5d0 0x5592821e7c10 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:47:15.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.552+0000 7fb576f5db80 1 --2- 172.21.15.46:0/3812164010 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5592821ce2d0 0x5592821e8150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:47:15.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.552+0000 7fb576f5db80 1 -- 172.21.15.46:0/3812164010 >> 172.21.15.46:0/3812164010 conn(0x559282141720 msgr2=0x5592821cc080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:47:15.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.552+0000 7fb544ff9700 0 client.25928 ms_handle_reset on v2:172.21.15.157:6838/552718978 2023-10-19T12:47:15.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.552+0000 7fb576f5db80 1 -- 172.21.15.46:0/3812164010 shutdown_connections 2023-10-19T12:47:15.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.553+0000 7fb576f5db80 1 -- 172.21.15.46:0/3812164010 wait complete. 2023-10-19T12:47:15.558 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.553+0000 7fb576f5db80 20 client.25928 trim_cache size 0 max 16384 2023-10-19T12:47:15.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.591+0000 7fb576f5db80 1 Processor -- start 2023-10-19T12:47:15.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.591+0000 7fb576f5db80 1 -- start start 2023-10-19T12:47:15.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.591+0000 7fb576f5db80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5592821cd5d0 0x5592821e7120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:47:15.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.591+0000 7fb576f5db80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5592821ce2d0 0x5592821ef150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:47:15.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.591+0000 7fb576f5db80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5592821cec30 0x5592821e79c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:47:15.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.591+0000 7fb576f5db80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x559281fa0920 con 0x5592821cd5d0 2023-10-19T12:47:15.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.591+0000 7fb576f5db80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592821f3490 con 0x5592821cec30 2023-10-19T12:47:15.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.591+0000 7fb576f5db80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592821c4550 con 0x5592821ce2d0 2023-10-19T12:47:15.598 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.594+0000 7fb560b9a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5592821ce2d0 0x5592821ef150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:47:15.598 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.594+0000 7fb561b9c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5592821cec30 0x5592821e79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:47:15.598 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.594+0000 7fb561b9c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5592821cec30 0x5592821e79c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:46946/0 (socket says 172.21.15.46:46946) 2023-10-19T12:47:15.599 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.594+0000 7fb561b9c700 1 -- 172.21.15.46:0/1127749376 learned_addr learned my addr 172.21.15.46:0/1127749376 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:47:15.599 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.594+0000 7fb56139b700 1 --2- 172.21.15.46:0/1127749376 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5592821cd5d0 0x5592821e7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:47:15.599 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.596+0000 7fb560b9a700 1 -- 172.21.15.46:0/1127749376 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5592821cec30 msgr2=0x5592821e79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:47:15.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.596+0000 7fb560b9a700 1 --2- 172.21.15.46:0/1127749376 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5592821cec30 0x5592821e79c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:47:15.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.596+0000 7fb560b9a700 1 -- 172.21.15.46:0/1127749376 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5592821cd5d0 msgr2=0x5592821e7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:47:15.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.596+0000 7fb560b9a700 1 --2- 172.21.15.46:0/1127749376 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5592821cd5d0 0x5592821e7120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:47:15.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.596+0000 7fb560b9a700 1 -- 172.21.15.46:0/1127749376 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559281f33c60 con 0x5592821ce2d0 2023-10-19T12:47:15.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.596+0000 7fb561b9c700 1 --2- 172.21.15.46:0/1127749376 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5592821cec30 0x5592821e79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:47:15.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.598+0000 7fb56139b700 1 --2- 172.21.15.46:0/1127749376 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5592821cd5d0 0x5592821e7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T12:47:15.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.598+0000 7fb560b9a700 1 --2- 172.21.15.46:0/1127749376 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5592821ce2d0 0x5592821ef150 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb54c010710 tx=0x7fb54c01e040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=80c5f01303136e20 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:47:15.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.599+0000 7fb547fff700 1 -- 172.21.15.46:0/1127749376 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54c029070 con 0x5592821ce2d0 2023-10-19T12:47:15.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.599+0000 7fb547fff700 1 -- 172.21.15.46:0/1127749376 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x559282124ef0 con 0x5592821ce2d0 2023-10-19T12:47:15.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.599+0000 7fb547fff700 1 -- 172.21.15.46:0/1127749376 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54c010da0 con 0x5592821ce2d0 2023-10-19T12:47:15.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.600+0000 7fb576f5db80 1 -- 172.21.15.46:0/1127749376 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5592821ce2d0 msgr2=0x5592821ef150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:47:15.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.600+0000 7fb576f5db80 1 --2- 172.21.15.46:0/1127749376 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5592821ce2d0 0x5592821ef150 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb54c010710 tx=0x7fb54c01e040 comp rx=0 tx=0).stop 2023-10-19T12:47:15.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.600+0000 7fb576f5db80 1 -- 172.21.15.46:0/1127749376 shutdown_connections 2023-10-19T12:47:15.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.600+0000 7fb576f5db80 1 --2- 172.21.15.46:0/1127749376 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5592821cec30 0x5592821e79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:47:15.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.600+0000 7fb576f5db80 1 --2- 172.21.15.46:0/1127749376 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5592821cd5d0 0x5592821e7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:47:15.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.600+0000 7fb576f5db80 1 --2- 172.21.15.46:0/1127749376 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5592821ce2d0 0x5592821ef150 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:47:15.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.600+0000 7fb576f5db80 1 -- 172.21.15.46:0/1127749376 >> 172.21.15.46:0/1127749376 conn(0x559282141720 msgr2=0x5592821d4b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:47:15.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.600+0000 7fb576f5db80 1 -- 172.21.15.46:0/1127749376 shutdown_connections 2023-10-19T12:47:15.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.600+0000 7fb576f5db80 1 -- 172.21.15.46:0/1127749376 wait complete. 2023-10-19T12:47:15.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.601+0000 7fb576f5db80 1 -- start start 2023-10-19T12:47:15.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.601+0000 7fb576f5db80 1 Processor -- start 2023-10-19T12:47:15.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.602+0000 7fb576f5db80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5592821cd5d0 0x5592821eef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:47:15.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.602+0000 7fb576f5db80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5592821ce2d0 0x5592821ed640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:47:15.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.602+0000 7fb576f5db80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5592821cec30 0x5592821edb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:47:15.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.602+0000 7fb576f5db80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592821ee1a0 con 0x5592821ce2d0 2023-10-19T12:47:15.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.602+0000 7fb576f5db80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592821ee310 con 0x5592821cd5d0 2023-10-19T12:47:15.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.602+0000 7fb576f5db80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592821ee4d0 con 0x5592821cec30 2023-10-19T12:47:15.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.603+0000 7fb576f5db80 10 client.0 _ll_register_callbacks cb 0x7fb558099fd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:47:15.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.603+0000 7fb561b9c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5592821cec30 0x5592821edb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:47:15.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.603+0000 7fb561b9c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5592821cec30 0x5592821edb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:56388/0 (socket says 172.21.15.46:56388) 2023-10-19T12:47:15.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.603+0000 7fb561b9c700 1 -- 172.21.15.46:0/2032627602 learned_addr learned my addr 172.21.15.46:0/2032627602 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:47:15.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.604+0000 7fb561b9c700 1 -- 172.21.15.46:0/2032627602 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5592821cd5d0 msgr2=0x5592821eef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:47:15.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.604+0000 7fb561b9c700 1 --2- 172.21.15.46:0/2032627602 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5592821cd5d0 0x5592821eef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:47:15.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.604+0000 7fb561b9c700 1 -- 172.21.15.46:0/2032627602 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5592821ce2d0 msgr2=0x5592821ed640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:47:15.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.604+0000 7fb561b9c700 1 --2- 172.21.15.46:0/2032627602 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5592821ce2d0 0x5592821ed640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:47:15.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.604+0000 7fb561b9c700 1 -- 172.21.15.46:0/2032627602 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb55c108420 con 0x5592821cec30 2023-10-19T12:47:15.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.604+0000 7fb561b9c700 1 --2- 172.21.15.46:0/2032627602 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5592821cec30 0x5592821edb80 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb55400b070 tx=0x7fb55400bd90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2da56f34d9f3612 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:47:15.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.604+0000 7fb544ff9700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-10-19T12:47:15.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.605+0000 7fb544ff9700 1 -- 172.21.15.46:0/2032627602 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb55400e040 con 0x5592821cec30 2023-10-19T12:47:15.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.605+0000 7fb544ff9700 1 -- 172.21.15.46:0/2032627602 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7fb554003e10 con 0x5592821cec30 2023-10-19T12:47:15.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.605+0000 7fb576f5db80 1 -- 172.21.15.46:0/2032627602 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb54c020070 con 0x5592821cec30 2023-10-19T12:47:15.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.608+0000 7fb544ff9700 1 -- 172.21.15.46:0/2032627602 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb554005040 con 0x5592821cec30 2023-10-19T12:47:15.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.608+0000 7fb576f5db80 10 client.25939 fetch_fsmap learned FSMap version 37 2023-10-19T12:47:15.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.608+0000 7fb576f5db80 1 -- 172.21.15.46:0/2032627602 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x5592820dd3f0 con 0x5592821cec30 2023-10-19T12:47:15.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.610+0000 7fb544ff9700 1 -- 172.21.15.46:0/2032627602 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb54c020070 con 0x5592821cec30 2023-10-19T12:47:15.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.611+0000 7fb544ff9700 1 -- 172.21.15.46:0/2032627602 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 37) v1 ==== 7914+0+0 (secure 0 0 0) 0x7fb554022020 con 0x5592821cec30 2023-10-19T12:47:15.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.611+0000 7fb576f5db80 10 client.25939 fetch_fsmap finished waiting for FSMap version 37 2023-10-19T12:47:15.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.611+0000 7fb576f5db80 10 client.25939 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-19T12:47:15.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.611+0000 7fb576f5db80 20 client.25939 populate_metadata read hostname 'smithi046' 2023-10-19T12:47:15.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.611+0000 7fb576f5db80 1 --2- 172.21.15.46:0/2032627602 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x559282249250 0x55928224b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:47:15.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.611+0000 7fb576f5db80 4 client.25939 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-19T12:47:15.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.611+0000 7fb576f5db80 1 -- 172.21.15.46:0/2032627602 --> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55928219c8b0 con 0x559282249250 2023-10-19T12:47:15.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.611+0000 7fb56139b700 1 --2- 172.21.15.46:0/2032627602 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x559282249250 0x55928224b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:47:15.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.612+0000 7fb56139b700 1 --2- 172.21.15.46:0/2032627602 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x559282249250 0x55928224b670 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=844b79b0dd1adf0 server_cookie=1abc500f9767b1b4 in_seq=0 out_seq=0 2023-10-19T12:47:15.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.612+0000 7fb544ff9700 10 client.25939 ms_handle_connect on v2:172.21.15.157:6838/552718978 2023-10-19T12:47:15.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.612+0000 7fb544ff9700 1 -- 172.21.15.46:0/2032627602 <== mds.0 v2:172.21.15.157:6838/552718978 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55928219c8b0 con 0x559282249250 2023-10-19T12:47:15.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.612+0000 7fb544ff9700 10 client.25939 handle_command_reply: tid=0 2023-10-19T12:47:15.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.613+0000 7fb576f5db80 1 client.25939 shutdown 2023-10-19T12:47:15.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.614+0000 7fb576f5db80 1 -- 172.21.15.46:0/2032627602 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5592821cec30 msgr2=0x5592821edb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:47:15.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.614+0000 7fb576f5db80 1 --2- 172.21.15.46:0/2032627602 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5592821cec30 0x5592821edb80 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb55400b070 tx=0x7fb55400bd90 comp rx=0 tx=0).stop 2023-10-19T12:47:15.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.614+0000 7fb576f5db80 1 -- 172.21.15.46:0/2032627602 shutdown_connections 2023-10-19T12:47:15.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.614+0000 7fb576f5db80 1 --2- 172.21.15.46:0/2032627602 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5592821cec30 0x5592821edb80 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:47:15.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.614+0000 7fb576f5db80 1 --2- 172.21.15.46:0/2032627602 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5592821cd5d0 0x5592821eef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:47:15.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.615+0000 7fb576f5db80 1 --2- 172.21.15.46:0/2032627602 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x559282249250 0x55928224b670 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:47:15.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.615+0000 7fb576f5db80 1 --2- 172.21.15.46:0/2032627602 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5592821ce2d0 0x5592821ed640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:47:15.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.615+0000 7fb576f5db80 1 -- 172.21.15.46:0/2032627602 >> 172.21.15.46:0/2032627602 conn(0x559282141720 msgr2=0x5592821d12d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:47:15.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.615+0000 7fb544ff9700 0 client.25939 ms_handle_reset on v2:172.21.15.157:6838/552718978 2023-10-19T12:47:15.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.615+0000 7fb576f5db80 1 -- 172.21.15.46:0/2032627602 shutdown_connections 2023-10-19T12:47:15.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.616+0000 7fb576f5db80 1 -- 172.21.15.46:0/2032627602 wait complete. 2023-10-19T12:47:15.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.617+0000 7fb576f5db80 20 client.25939 trim_cache size 0 max 16384 2023-10-19T12:47:15.622 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-10-19T12:47:15.623 INFO:teuthology.orchestra.run.smithi046.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-19T12:47:15.623 INFO:teuthology.orchestra.run.smithi046.stdout: "scrubs": { 2023-10-19T12:47:15.623 INFO:teuthology.orchestra.run.smithi046.stdout: "21e73f70-af16-4ae7-bc34-e6c54ba8e1ec": { 2023-10-19T12:47:15.623 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2023-10-19T12:47:15.623 INFO:teuthology.orchestra.run.smithi046.stdout: "tag": "21e73f70-af16-4ae7-bc34-e6c54ba8e1ec", 2023-10-19T12:47:15.624 INFO:teuthology.orchestra.run.smithi046.stdout: "options": "recursive,force" 2023-10-19T12:47:15.624 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:47:15.624 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:47:15.624 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-10-19T12:47:15.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.620+0000 7fb5635ff700 1 -- 172.21.15.46:0/3610113857 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fb5480a1500 msgr2=0x7fb5480a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:47:15.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.620+0000 7fb5635ff700 1 --2- 172.21.15.46:0/3610113857 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fb5480a1500 0x7fb5480a39c0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fb55c195710 tx=0x7fb54c00a300 comp rx=0 tx=0).stop 2023-10-19T12:47:15.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.620+0000 7fb5635ff700 1 -- 172.21.15.46:0/3610113857 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb55c0ff690 msgr2=0x7fb55c194640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:47:15.626 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.620+0000 7fb5635ff700 1 --2- 172.21.15.46:0/3610113857 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb55c0ff690 0x7fb55c194640 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb55800e970 tx=0x7fb55800ec80 comp rx=0 tx=0).stop 2023-10-19T12:47:15.626 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.621+0000 7fb5635ff700 1 -- 172.21.15.46:0/3610113857 shutdown_connections 2023-10-19T12:47:15.626 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.621+0000 7fb5635ff700 1 --2- 172.21.15.46:0/3610113857 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb55c101220 0x7fb55c19bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:47:15.626 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.621+0000 7fb5635ff700 1 --2- 172.21.15.46:0/3610113857 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fb5480a1500 0x7fb5480a39c0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:47:15.627 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.621+0000 7fb5635ff700 1 --2- 172.21.15.46:0/3610113857 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb55c0ff690 0x7fb55c194640 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:47:15.627 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.621+0000 7fb5635ff700 1 --2- 172.21.15.46:0/3610113857 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb55c100880 0x7fb55c194b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:47:15.627 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.621+0000 7fb5635ff700 1 -- 172.21.15.46:0/3610113857 >> 172.21.15.46:0/3610113857 conn(0x7fb55c0fac00 msgr2=0x7fb55c0fc6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:47:15.627 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.621+0000 7fb5635ff700 1 -- 172.21.15.46:0/3610113857 shutdown_connections 2023-10-19T12:47:15.627 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:15.621+0000 7fb5635ff700 1 -- 172.21.15.46:0/3610113857 wait complete. 2023-10-19T12:47:15.660 INFO:tasks.cephfs.filesystem:scrub status for tag:21e73f70-af16-4ae7-bc34-e6c54ba8e1ec - {'path': '/', 'tag': '21e73f70-af16-4ae7-bc34-e6c54ba8e1ec', 'options': 'recursive,force'} 2023-10-19T12:47:16.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 195.0 s, 843.0 tps, lat 116.464 ms stddev 147.347 2023-10-19T12:47:18.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:47:17 smithi195 ceph-mon[134493]: pgmap v467: 129 pgs: 129 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 12 MiB/s wr, 654 op/s 2023-10-19T12:47:18.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:47:17 smithi046 ceph-mon[98509]: pgmap v467: 129 pgs: 129 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 12 MiB/s wr, 654 op/s 2023-10-19T12:47:18.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:47:17 smithi157 ceph-mon[134109]: pgmap v467: 129 pgs: 129 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 12 MiB/s wr, 654 op/s 2023-10-19T12:47:19.730 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:47:19 smithi046 ceph-mon[98509]: pgmap v468: 129 pgs: 129 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 10 MiB/s wr, 616 op/s 2023-10-19T12:47:19.837 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:47:19 smithi157 ceph-mon[134109]: pgmap v468: 129 pgs: 129 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 10 MiB/s wr, 616 op/s 2023-10-19T12:47:19.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:47:19 smithi195 ceph-mon[134493]: pgmap v468: 129 pgs: 129 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 10 MiB/s wr, 616 op/s 2023-10-19T12:47:21.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 200.0 s, 833.8 tps, lat 120.659 ms stddev 180.522 2023-10-19T12:47:22.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:47:21 smithi195 ceph-mon[134493]: pgmap v469: 129 pgs: 129 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 9.0 MiB/s wr, 528 op/s 2023-10-19T12:47:22.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:47:21 smithi046 ceph-mon[98509]: pgmap v469: 129 pgs: 129 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 9.0 MiB/s wr, 528 op/s 2023-10-19T12:47:22.339 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:47:21 smithi157 ceph-mon[134109]: pgmap v469: 129 pgs: 129 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 9.0 MiB/s wr, 528 op/s 2023-10-19T12:47:24.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:47:23 smithi195 ceph-mon[134493]: pgmap v470: 129 pgs: 129 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 12 MiB/s wr, 660 op/s 2023-10-19T12:47:24.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:47:23 smithi195 ceph-mon[134493]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-19T12:47:24.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:47:23 smithi046 ceph-mon[98509]: pgmap v470: 129 pgs: 129 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 12 MiB/s wr, 660 op/s 2023-10-19T12:47:24.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:47:23 smithi046 ceph-mon[98509]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-19T12:47:24.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:47:23 smithi157 ceph-mon[134109]: pgmap v470: 129 pgs: 129 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 12 MiB/s wr, 660 op/s 2023-10-19T12:47:24.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:47:23 smithi157 ceph-mon[134109]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-19T12:47:26.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:47:25 smithi195 ceph-mon[134493]: pgmap v471: 129 pgs: 129 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8.1 MiB/s wr, 477 op/s 2023-10-19T12:47:26.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:47:25 smithi046 ceph-mon[98509]: pgmap v471: 129 pgs: 129 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8.1 MiB/s wr, 477 op/s 2023-10-19T12:47:26.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:47:25 smithi157 ceph-mon[134109]: pgmap v471: 129 pgs: 129 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8.1 MiB/s wr, 477 op/s 2023-10-19T12:47:26.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 205.0 s, 855.8 tps, lat 117.383 ms stddev 138.056 2023-10-19T12:47:28.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:47:27 smithi046 ceph-mon[98509]: pgmap v472: 129 pgs: 129 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 10 MiB/s wr, 597 op/s 2023-10-19T12:47:28.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:47:27 smithi157 ceph-mon[134109]: pgmap v472: 129 pgs: 129 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 10 MiB/s wr, 597 op/s 2023-10-19T12:47:28.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:47:27 smithi195 ceph-mon[134493]: pgmap v472: 129 pgs: 129 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 10 MiB/s wr, 597 op/s 2023-10-19T12:47:29.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:47:28 smithi046 ceph-mon[98509]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-19T12:47:29.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:47:28 smithi157 ceph-mon[134109]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-19T12:47:29.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:47:28 smithi195 ceph-mon[134493]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-19T12:47:30.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:47:29 smithi046 ceph-mon[98509]: pgmap v473: 129 pgs: 129 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 MiB/s wr, 615 op/s 2023-10-19T12:47:30.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:47:29 smithi157 ceph-mon[134109]: pgmap v473: 129 pgs: 129 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 MiB/s wr, 615 op/s 2023-10-19T12:47:30.383 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:47:29 smithi195 ceph-mon[134493]: pgmap v473: 129 pgs: 129 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 MiB/s wr, 615 op/s 2023-10-19T12:47:31.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 210.0 s, 938.6 tps, lat 105.121 ms stddev 139.446 2023-10-19T12:47:32.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:47:31 smithi046 ceph-mon[98509]: pgmap v474: 129 pgs: 129 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 MiB/s wr, 577 op/s 2023-10-19T12:47:32.339 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:47:31 smithi157 ceph-mon[134109]: pgmap v474: 129 pgs: 129 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 MiB/s wr, 577 op/s 2023-10-19T12:47:32.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:47:31 smithi195 ceph-mon[134493]: pgmap v474: 129 pgs: 129 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 MiB/s wr, 577 op/s 2023-10-19T12:47:33.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:47:32 smithi046 ceph-mon[98509]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-19T12:47:33.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:47:32 smithi046 ceph-mon[98509]: pgmap v475: 129 pgs: 129 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 14 MiB/s wr, 901 op/s 2023-10-19T12:47:33.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:47:32 smithi157 ceph-mon[134109]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-19T12:47:33.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:47:32 smithi157 ceph-mon[134109]: pgmap v475: 129 pgs: 129 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 14 MiB/s wr, 901 op/s 2023-10-19T12:47:33.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:47:32 smithi195 ceph-mon[134493]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-19T12:47:33.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:47:32 smithi195 ceph-mon[134493]: pgmap v475: 129 pgs: 129 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 14 MiB/s wr, 901 op/s 2023-10-19T12:47:36.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:47:35 smithi195 ceph-mon[134493]: pgmap v476: 129 pgs: 129 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 13 MiB/s wr, 895 op/s 2023-10-19T12:47:36.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:47:35 smithi046 ceph-mon[98509]: pgmap v476: 129 pgs: 129 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 13 MiB/s wr, 895 op/s 2023-10-19T12:47:36.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:47:35 smithi157 ceph-mon[134109]: pgmap v476: 129 pgs: 129 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 13 MiB/s wr, 895 op/s 2023-10-19T12:47:36.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 215.0 s, 479.0 tps, lat 209.857 ms stddev 316.374 2023-10-19T12:47:38.134 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:47:37 smithi195 ceph-mon[134493]: pgmap v477: 129 pgs: 129 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 18 MiB/s wr, 1.34k op/s 2023-10-19T12:47:38.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:47:37 smithi046 ceph-mon[98509]: pgmap v477: 129 pgs: 129 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 18 MiB/s wr, 1.34k op/s 2023-10-19T12:47:38.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:47:37 smithi157 ceph-mon[134109]: pgmap v477: 129 pgs: 129 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 18 MiB/s wr, 1.34k op/s 2023-10-19T12:47:39.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:47:39 smithi046 ceph-mon[98509]: pgmap v478: 129 pgs: 129 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 19 MiB/s wr, 1.46k op/s 2023-10-19T12:47:39.837 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:47:39 smithi157 ceph-mon[134109]: pgmap v478: 129 pgs: 129 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 19 MiB/s wr, 1.46k op/s 2023-10-19T12:47:39.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:47:39 smithi195 ceph-mon[134493]: pgmap v478: 129 pgs: 129 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 19 MiB/s wr, 1.46k op/s 2023-10-19T12:47:41.703 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 220.0 s, 924.6 tps, lat 109.197 ms stddev 127.839 2023-10-19T12:47:42.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:47:41 smithi195 ceph-mon[134493]: pgmap v479: 129 pgs: 129 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 17 MiB/s wr, 1.38k op/s 2023-10-19T12:47:42.233 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:47:41 smithi046 ceph-mon[98509]: pgmap v479: 129 pgs: 129 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 17 MiB/s wr, 1.38k op/s 2023-10-19T12:47:42.346 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:47:41 smithi157 ceph-mon[134109]: pgmap v479: 129 pgs: 129 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 17 MiB/s wr, 1.38k op/s 2023-10-19T12:47:44.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:47:43 smithi195 ceph-mon[134493]: pgmap v480: 129 pgs: 129 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 18 MiB/s wr, 1.46k op/s 2023-10-19T12:47:44.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:47:43 smithi046 ceph-mon[98509]: pgmap v480: 129 pgs: 129 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 18 MiB/s wr, 1.46k op/s 2023-10-19T12:47:44.339 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:47:43 smithi157 ceph-mon[134109]: pgmap v480: 129 pgs: 129 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 18 MiB/s wr, 1.46k op/s 2023-10-19T12:47:45.662 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-19T12:47:46.059 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.056+0000 7f8fd03ff700 1 -- 172.21.15.46:0/4139456978 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8fc8100880 msgr2=0x7f8fc8100ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:47:46.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.056+0000 7f8fd03ff700 1 --2- 172.21.15.46:0/4139456978 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8fc8100880 0x7f8fc8100ce0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc0099c0 tx=0x7f8fbc009cd0 comp rx=0 tx=0).stop 2023-10-19T12:47:46.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.056+0000 7f8fd03ff700 1 -- 172.21.15.46:0/4139456978 shutdown_connections 2023-10-19T12:47:46.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.056+0000 7f8fd03ff700 1 --2- 172.21.15.46:0/4139456978 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8fc8101220 0x7f8fc8107ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:47:46.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.056+0000 7f8fd03ff700 1 --2- 172.21.15.46:0/4139456978 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8fc80ff690 0x7f8fc80ffab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:47:46.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.056+0000 7f8fd03ff700 1 --2- 172.21.15.46:0/4139456978 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8fc8100880 0x7f8fc8100ce0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:47:46.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.056+0000 7f8fd03ff700 1 -- 172.21.15.46:0/4139456978 >> 172.21.15.46:0/4139456978 conn(0x7f8fc80fac00 msgr2=0x7f8fc80fd040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:47:46.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.057+0000 7f8fd03ff700 1 -- 172.21.15.46:0/4139456978 shutdown_connections 2023-10-19T12:47:46.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.057+0000 7f8fd03ff700 1 -- 172.21.15.46:0/4139456978 wait complete. 2023-10-19T12:47:46.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.060+0000 7f8fd03ff700 1 Processor -- start 2023-10-19T12:47:46.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.060+0000 7f8fd03ff700 1 -- start start 2023-10-19T12:47:46.064 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.060+0000 7f8fd03ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8fc80ff690 0x7f8fc81036c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:47:46.064 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.060+0000 7f8fd03ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8fc8100880 0x7f8fc8101d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:47:46.064 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.060+0000 7f8fd03ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8fc8101220 0x7f8fc8102290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:47:46.064 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.061+0000 7f8fd03ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc8102a30 con 0x7f8fc8101220 2023-10-19T12:47:46.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.061+0000 7f8fd03ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc8102ba0 con 0x7f8fc8100880 2023-10-19T12:47:46.065 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.061+0000 7f8fd03ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc81a07a0 con 0x7f8fc80ff690 2023-10-19T12:47:46.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.061+0000 7f8fce99c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8fc8101220 0x7f8fc8102290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:47:46.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.061+0000 7f8fce99c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8fc8101220 0x7f8fc8102290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58056/0 (socket says 172.21.15.46:58056) 2023-10-19T12:47:46.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.061+0000 7f8fce99c700 1 -- 172.21.15.46:0/2759368987 learned_addr learned my addr 172.21.15.46:0/2759368987 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:47:46.066 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.061+0000 7f8fce19b700 1 --2- 172.21.15.46:0/2759368987 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8fc80ff690 0x7f8fc81036c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:47:46.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.061+0000 7f8fcd99a700 1 --2- 172.21.15.46:0/2759368987 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8fc8100880 0x7f8fc8101d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:47:46.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.062+0000 7f8fcd99a700 1 -- 172.21.15.46:0/2759368987 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8fc80ff690 msgr2=0x7f8fc81036c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:47:46.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.062+0000 7f8fcd99a700 1 --2- 172.21.15.46:0/2759368987 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8fc80ff690 0x7f8fc81036c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:47:46.067 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.062+0000 7f8fcd99a700 1 -- 172.21.15.46:0/2759368987 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8fc8101220 msgr2=0x7f8fc8102290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:47:46.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.062+0000 7f8fcd99a700 1 --2- 172.21.15.46:0/2759368987 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8fc8101220 0x7f8fc8102290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:47:46.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.062+0000 7f8fcd99a700 1 -- 172.21.15.46:0/2759368987 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fbc0095f0 con 0x7f8fc8100880 2023-10-19T12:47:46.068 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.062+0000 7f8fcd99a700 1 --2- 172.21.15.46:0/2759368987 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8fc8100880 0x7f8fc8101d50 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc009f50 tx=0x7f8fbc005720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:47:46.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.063+0000 7f8fbb7fe700 1 -- 172.21.15.46:0/2759368987 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fbc01d070 con 0x7f8fc8100880 2023-10-19T12:47:46.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.064+0000 7f8fbb7fe700 1 -- 172.21.15.46:0/2759368987 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8fbc004050 con 0x7f8fc8100880 2023-10-19T12:47:46.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.064+0000 7f8fbb7fe700 1 -- 172.21.15.46:0/2759368987 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fbc022d30 con 0x7f8fc8100880 2023-10-19T12:47:46.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.064+0000 7f8fd03ff700 1 -- 172.21.15.46:0/2759368987 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fc81a09d0 con 0x7f8fc8100880 2023-10-19T12:47:46.069 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.064+0000 7f8fd03ff700 1 -- 172.21.15.46:0/2759368987 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fc81a0d40 con 0x7f8fc8100880 2023-10-19T12:47:46.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.069+0000 7f8fbb7fe700 1 -- 172.21.15.46:0/2759368987 <== mon.2 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f8fbc022470 con 0x7f8fc8100880 2023-10-19T12:47:46.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.071+0000 7f8fe3d9ab80 1 Processor -- start 2023-10-19T12:47:46.074 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.071+0000 7f8fe3d9ab80 1 -- start start 2023-10-19T12:47:46.075 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.072+0000 7f8fe3d9ab80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5648e74cf2d0 0x5648e74cf6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:47:46.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.072+0000 7f8fe3d9ab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5648e74cfc30 0x5648e74ce090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:47:46.076 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.073+0000 7f8fce99c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5648e74cf2d0 0x5648e74cf6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:47:46.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.073+0000 7f8fce99c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5648e74cf2d0 0x5648e74cf6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:53100/0 (socket says 172.21.15.46:53100) 2023-10-19T12:47:46.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.073+0000 7f8fe3d9ab80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5648e74ce5d0 0x5648e74cea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:47:46.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.073+0000 7f8fce19b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5648e74cfc30 0x5648e74ce090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:47:46.077 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.073+0000 7f8fce19b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5648e74cfc30 0x5648e74ce090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:41256/0 (socket says 172.21.15.46:41256) 2023-10-19T12:47:46.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.073+0000 7f8fe3d9ab80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648e74416e0 con 0x5648e74ce5d0 2023-10-19T12:47:46.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.073+0000 7f8fe3d9ab80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648e7427c60 con 0x5648e74cf2d0 2023-10-19T12:47:46.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.073+0000 7f8fe3d9ab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648e7425580 con 0x5648e74cfc30 2023-10-19T12:47:46.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.074+0000 7f8fbb7fe700 1 --2- 172.21.15.46:0/2759368987 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f8fb40a1680 0x7f8fb40a3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:47:46.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.074+0000 7f8fbb7fe700 1 -- 172.21.15.46:0/2759368987 <== mon.2 v2:172.21.15.157:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f8fbc0ce540 con 0x7f8fc8100880 2023-10-19T12:47:46.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.075+0000 7f8fce99c700 1 -- 172.21.15.46:0/3764425019 learned_addr learned my addr 172.21.15.46:0/3764425019 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:47:46.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.075+0000 7f8fcd99a700 1 --2- 172.21.15.46:0/3764425019 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5648e74ce5d0 0x5648e74cea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:47:46.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.075+0000 7f8fce99c700 1 --2- 172.21.15.46:0/2759368987 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f8fb40a1680 0x7f8fb40a3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:47:46.080 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.075+0000 7f8fce99c700 1 -- 172.21.15.46:0/3764425019 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5648e74cfc30 msgr2=0x5648e74ce090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:47:46.080 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.075+0000 7f8fce99c700 1 --2- 172.21.15.46:0/3764425019 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5648e74cfc30 0x5648e74ce090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:47:46.080 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.075+0000 7f8fce99c700 1 -- 172.21.15.46:0/3764425019 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5648e74ce5d0 msgr2=0x5648e74cea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:47:46.080 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.075+0000 7f8fce99c700 1 --2- 172.21.15.46:0/3764425019 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5648e74ce5d0 0x5648e74cea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:47:46.080 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.075+0000 7f8fce99c700 1 -- 172.21.15.46:0/3764425019 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5648e73de3f0 con 0x5648e74cf2d0 2023-10-19T12:47:46.081 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.075+0000 7f8fcd99a700 1 --2- 172.21.15.46:0/3764425019 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5648e74ce5d0 0x5648e74cea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T12:47:46.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.076+0000 7f8fce99c700 1 --2- 172.21.15.46:0/3764425019 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5648e74cf2d0 0x5648e74cf6f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8fc0007ac0 tx=0x7f8fc0007dd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11546d2d3645e96f server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:47:46.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.076+0000 7f8fce99c700 1 --2- 172.21.15.46:0/2759368987 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f8fb40a1680 0x7f8fb40a3b40 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f8fc001b000 tx=0x7f8fc001d000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:47:46.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.077+0000 7f8fb8bfe700 1 -- 172.21.15.46:0/3764425019 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc0007500 con 0x5648e74cf2d0 2023-10-19T12:47:46.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.077+0000 7f8fb8bfe700 1 -- 172.21.15.46:0/3764425019 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8fc000f040 con 0x5648e74cf2d0 2023-10-19T12:47:46.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.077+0000 7f8fb8bfe700 1 -- 172.21.15.46:0/3764425019 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc0023740 con 0x5648e74cf2d0 2023-10-19T12:47:46.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.078+0000 7f8fe3d9ab80 1 -- 172.21.15.46:0/3764425019 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5648e74cf2d0 msgr2=0x5648e74cf6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:47:46.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.078+0000 7f8fe3d9ab80 1 --2- 172.21.15.46:0/3764425019 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5648e74cf2d0 0x5648e74cf6f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8fc0007ac0 tx=0x7f8fc0007dd0 comp rx=0 tx=0).stop 2023-10-19T12:47:46.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.079+0000 7f8fe3d9ab80 1 -- 172.21.15.46:0/3764425019 shutdown_connections 2023-10-19T12:47:46.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.079+0000 7f8fe3d9ab80 1 --2- 172.21.15.46:0/3764425019 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5648e74ce5d0 0x5648e74cea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:47:46.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.079+0000 7f8fe3d9ab80 1 --2- 172.21.15.46:0/3764425019 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5648e74cf2d0 0x5648e74cf6f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:47:46.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.079+0000 7f8fe3d9ab80 1 --2- 172.21.15.46:0/3764425019 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5648e74cfc30 0x5648e74ce090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:47:46.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.079+0000 7f8fe3d9ab80 1 -- 172.21.15.46:0/3764425019 >> 172.21.15.46:0/3764425019 conn(0x5648e7442720 msgr2=0x5648e74c8b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:47:46.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.079+0000 7f8fe3d9ab80 1 -- 172.21.15.46:0/3764425019 shutdown_connections 2023-10-19T12:47:46.085 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.079+0000 7f8fe3d9ab80 1 -- 172.21.15.46:0/3764425019 wait complete. 2023-10-19T12:47:46.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.080+0000 7f8fe3d9ab80 1 -- start start 2023-10-19T12:47:46.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.080+0000 7f8fe3d9ab80 1 Processor -- start 2023-10-19T12:47:46.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.081+0000 7f8fe3d9ab80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5648e74ce5d0 0x5648e74d7b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:47:46.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.081+0000 7f8fe3d9ab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5648e74cf2d0 0x5648e74d80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:47:46.086 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.081+0000 7f8fe3d9ab80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5648e74cfc30 0x5648e74df110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:47:46.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.081+0000 7f8fe3d9ab80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648e7420e70 con 0x5648e74ce5d0 2023-10-19T12:47:46.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.081+0000 7f8fe3d9ab80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648e73bd710 con 0x5648e74cfc30 2023-10-19T12:47:46.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.081+0000 7f8fe3d9ab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648e73bd3b0 con 0x5648e74cf2d0 2023-10-19T12:47:46.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.081+0000 7f8fe3d9ab80 10 client.0 _ll_register_callbacks cb 0x5648e7307a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:47:46.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.081+0000 7f8fcd99a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5648e74cf2d0 0x5648e74d80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:47:46.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.081+0000 7f8fcd99a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5648e74cf2d0 0x5648e74d80d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:41268/0 (socket says 172.21.15.46:41268) 2023-10-19T12:47:46.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.081+0000 7f8fcd99a700 1 -- 172.21.15.46:0/1679470875 learned_addr learned my addr 172.21.15.46:0/1679470875 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:47:46.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.082+0000 7f8fce19b700 1 --2- 172.21.15.46:0/1679470875 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5648e74ce5d0 0x5648e74d7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:47:46.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.082+0000 7f8fcd99a700 1 -- 172.21.15.46:0/1679470875 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5648e74cfc30 msgr2=0x5648e74df110 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-19T12:47:46.088 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.082+0000 7f8fcd99a700 1 --2- 172.21.15.46:0/1679470875 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5648e74cfc30 0x5648e74df110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:47:46.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.082+0000 7f8fcd99a700 1 -- 172.21.15.46:0/1679470875 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5648e74ce5d0 msgr2=0x5648e74d7b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:47:46.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.082+0000 7f8fcd99a700 1 --2- 172.21.15.46:0/1679470875 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5648e74ce5d0 0x5648e74d7b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:47:46.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.082+0000 7f8fcd99a700 1 -- 172.21.15.46:0/1679470875 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fc00076a0 con 0x5648e74cf2d0 2023-10-19T12:47:46.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.082+0000 7f8fce19b700 1 --2- 172.21.15.46:0/1679470875 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5648e74ce5d0 0x5648e74d7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T12:47:46.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.084+0000 7f8fcd99a700 1 --2- 172.21.15.46:0/1679470875 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5648e74cf2d0 0x5648e74d80d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc0036f0 tx=0x7f8fbc09bb20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c96a41179811298 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:47:46.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.084+0000 7f8fb1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-10-19T12:47:46.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.084+0000 7f8fb1ffb700 1 -- 172.21.15.46:0/1679470875 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fbc09af40 con 0x5648e74cf2d0 2023-10-19T12:47:46.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.084+0000 7f8fb1ffb700 1 -- 172.21.15.46:0/1679470875 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f8fbc09bce0 con 0x5648e74cf2d0 2023-10-19T12:47:46.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.084+0000 7f8fe3d9ab80 1 -- 172.21.15.46:0/1679470875 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5648e7425ef0 con 0x5648e74cf2d0 2023-10-19T12:47:46.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.085+0000 7f8fb1ffb700 1 -- 172.21.15.46:0/1679470875 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8fbc09b5e0 con 0x5648e74cf2d0 2023-10-19T12:47:46.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.085+0000 7f8fe3d9ab80 10 client.25951 fetch_fsmap learned FSMap version 40 2023-10-19T12:47:46.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.085+0000 7f8fe3d9ab80 1 -- 172.21.15.46:0/1679470875 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) v3 -- 0x5648e724bde0 con 0x5648e74cf2d0 2023-10-19T12:47:46.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.086+0000 7f8fb1ffb700 1 -- 172.21.15.46:0/1679470875 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5648e7425ef0 con 0x5648e74cf2d0 2023-10-19T12:47:46.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.086+0000 7f8fb1ffb700 1 -- 172.21.15.46:0/1679470875 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 40) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f8fbc0973d0 con 0x5648e74cf2d0 2023-10-19T12:47:46.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.087+0000 7f8fe3d9ab80 10 client.25951 fetch_fsmap finished waiting for FSMap version 40 2023-10-19T12:47:46.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.087+0000 7f8fe3d9ab80 10 client.25951 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-19T12:47:46.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.087+0000 7f8fe3d9ab80 20 client.25951 populate_metadata read hostname 'smithi046' 2023-10-19T12:47:46.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.087+0000 7f8fe3d9ab80 1 --2- 172.21.15.46:0/1679470875 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x5648e74f4590 0x5648e74f69b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:47:46.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.087+0000 7f8fe3d9ab80 4 client.25951 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-19T12:47:46.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.087+0000 7f8fe3d9ab80 1 -- 172.21.15.46:0/1679470875 --> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5648e749d8b0 con 0x5648e74f4590 2023-10-19T12:47:46.094 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.088+0000 7f8fce19b700 1 --2- 172.21.15.46:0/1679470875 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x5648e74f4590 0x5648e74f69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:47:46.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.089+0000 7f8fce19b700 1 --2- 172.21.15.46:0/1679470875 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x5648e74f4590 0x5648e74f69b0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=24e3d1ca3e35ab87 server_cookie=6f6a0d5a797ee630 in_seq=0 out_seq=0 2023-10-19T12:47:46.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.089+0000 7f8fb1ffb700 10 client.25951 ms_handle_connect on v2:172.21.15.157:6838/552718978 2023-10-19T12:47:46.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.090+0000 7f8fb1ffb700 1 -- 172.21.15.46:0/1679470875 <== mds.0 v2:172.21.15.157:6838/552718978 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5648e749d8b0 con 0x5648e74f4590 2023-10-19T12:47:46.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.090+0000 7f8fb1ffb700 10 client.25951 handle_command_reply: tid=0 2023-10-19T12:47:46.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.090+0000 7f8fe3d9ab80 1 client.25951 shutdown 2023-10-19T12:47:46.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.095+0000 7f8fe3d9ab80 1 -- 172.21.15.46:0/1679470875 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5648e74cf2d0 msgr2=0x5648e74d80d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:47:46.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.095+0000 7f8fe3d9ab80 1 --2- 172.21.15.46:0/1679470875 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5648e74cf2d0 0x5648e74d80d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc0036f0 tx=0x7f8fbc09bb20 comp rx=0 tx=0).stop 2023-10-19T12:47:46.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.095+0000 7f8fe3d9ab80 1 -- 172.21.15.46:0/1679470875 shutdown_connections 2023-10-19T12:47:46.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.095+0000 7f8fe3d9ab80 1 --2- 172.21.15.46:0/1679470875 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5648e74cfc30 0x5648e74df110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:47:46.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.095+0000 7f8fe3d9ab80 1 --2- 172.21.15.46:0/1679470875 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x5648e74f4590 0x5648e74f69b0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:47:46.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.095+0000 7f8fe3d9ab80 1 --2- 172.21.15.46:0/1679470875 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5648e74ce5d0 0x5648e74d7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:47:46.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.095+0000 7f8fe3d9ab80 1 --2- 172.21.15.46:0/1679470875 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5648e74cf2d0 0x5648e74d80d0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:47:46.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.095+0000 7f8fe3d9ab80 1 -- 172.21.15.46:0/1679470875 >> 172.21.15.46:0/1679470875 conn(0x5648e7442720 msgr2=0x5648e74cd080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:47:46.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.095+0000 7f8fb1ffb700 0 client.25951 ms_handle_reset on v2:172.21.15.157:6838/552718978 2023-10-19T12:47:46.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.096+0000 7f8fe3d9ab80 1 -- 172.21.15.46:0/1679470875 shutdown_connections 2023-10-19T12:47:46.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.096+0000 7f8fe3d9ab80 1 -- 172.21.15.46:0/1679470875 wait complete. 2023-10-19T12:47:46.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.097+0000 7f8fe3d9ab80 20 client.25951 trim_cache size 0 max 16384 2023-10-19T12:47:46.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:47:45 smithi195 ceph-mon[134493]: pgmap v481: 129 pgs: 129 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 15 MiB/s wr, 1.15k op/s 2023-10-19T12:47:46.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.139+0000 7f8fe3d9ab80 1 Processor -- start 2023-10-19T12:47:46.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.140+0000 7f8fe3d9ab80 1 -- start start 2023-10-19T12:47:46.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.140+0000 7f8fe3d9ab80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5648e74ce5d0 0x5648e74d2b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:47:46.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.140+0000 7f8fe3d9ab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5648e74cf2d0 0x5648e74df0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:47:46.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.140+0000 7f8fe3d9ab80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5648e74cfc30 0x5648e74c35d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:47:46.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.141+0000 7f8fcd99a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5648e74cf2d0 0x5648e74df0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:47:46.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.141+0000 7f8fcd99a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5648e74cf2d0 0x5648e74df0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:41282/0 (socket says 172.21.15.46:41282) 2023-10-19T12:47:46.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.141+0000 7f8fce19b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5648e74ce5d0 0x5648e74d2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:47:46.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.141+0000 7f8fe3d9ab80 1 -- 172.21.15.46:0/2558394248 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648e72a1920 con 0x5648e74ce5d0 2023-10-19T12:47:46.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.141+0000 7f8fcd99a700 1 -- 172.21.15.46:0/2558394248 learned_addr learned my addr 172.21.15.46:0/2558394248 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:47:46.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.141+0000 7f8fe3d9ab80 1 -- 172.21.15.46:0/2558394248 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648e7425ef0 con 0x5648e74cfc30 2023-10-19T12:47:46.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.141+0000 7f8fe3d9ab80 1 -- 172.21.15.46:0/2558394248 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648e74c9950 con 0x5648e74cf2d0 2023-10-19T12:47:46.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.141+0000 7f8fce99c700 1 --2- 172.21.15.46:0/2558394248 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5648e74cfc30 0x5648e74c35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:47:46.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.142+0000 7f8fce19b700 1 -- 172.21.15.46:0/2558394248 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5648e74cf2d0 msgr2=0x5648e74df0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:47:46.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.142+0000 7f8fce19b700 1 --2- 172.21.15.46:0/2558394248 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5648e74cf2d0 0x5648e74df0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:47:46.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.142+0000 7f8fce19b700 1 -- 172.21.15.46:0/2558394248 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5648e74cfc30 msgr2=0x5648e74c35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:47:46.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.143+0000 7f8fce19b700 1 --2- 172.21.15.46:0/2558394248 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5648e74cfc30 0x5648e74c35d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:47:46.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.143+0000 7f8fce19b700 1 -- 172.21.15.46:0/2558394248 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5648e7234c60 con 0x5648e74ce5d0 2023-10-19T12:47:46.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.143+0000 7f8fcd99a700 1 --2- 172.21.15.46:0/2558394248 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5648e74cf2d0 0x5648e74df0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T12:47:46.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.143+0000 7f8fce99c700 1 --2- 172.21.15.46:0/2558394248 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5648e74cfc30 0x5648e74c35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:47:46.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.144+0000 7f8fce19b700 1 --2- 172.21.15.46:0/2558394248 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5648e74ce5d0 0x5648e74d2b60 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x5648e74f6f90 tx=0x7f8fc400d520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=920c5dd08b97311f server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:47:46.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.145+0000 7f8fb93ff700 1 -- 172.21.15.46:0/2558394248 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc4018040 con 0x5648e74ce5d0 2023-10-19T12:47:46.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.145+0000 7f8fb93ff700 1 -- 172.21.15.46:0/2558394248 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8fc401a570 con 0x5648e74ce5d0 2023-10-19T12:47:46.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.145+0000 7f8fb93ff700 1 -- 172.21.15.46:0/2558394248 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc4012450 con 0x5648e74ce5d0 2023-10-19T12:47:46.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.147+0000 7f8fe3d9ab80 1 -- 172.21.15.46:0/2558394248 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5648e74ce5d0 msgr2=0x5648e74d2b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:47:46.150 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.147+0000 7f8fe3d9ab80 1 --2- 172.21.15.46:0/2558394248 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5648e74ce5d0 0x5648e74d2b60 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x5648e74f6f90 tx=0x7f8fc400d520 comp rx=0 tx=0).stop 2023-10-19T12:47:46.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.148+0000 7f8fe3d9ab80 1 -- 172.21.15.46:0/2558394248 shutdown_connections 2023-10-19T12:47:46.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.148+0000 7f8fe3d9ab80 1 --2- 172.21.15.46:0/2558394248 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5648e74cfc30 0x5648e74c35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:47:46.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.148+0000 7f8fe3d9ab80 1 --2- 172.21.15.46:0/2558394248 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5648e74ce5d0 0x5648e74d2b60 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:47:46.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.148+0000 7f8fe3d9ab80 1 --2- 172.21.15.46:0/2558394248 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5648e74cf2d0 0x5648e74df0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:47:46.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.148+0000 7f8fe3d9ab80 1 -- 172.21.15.46:0/2558394248 >> 172.21.15.46:0/2558394248 conn(0x5648e7442720 msgr2=0x5648e74ce9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:47:46.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.148+0000 7f8fe3d9ab80 1 -- 172.21.15.46:0/2558394248 shutdown_connections 2023-10-19T12:47:46.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.149+0000 7f8fe3d9ab80 1 -- 172.21.15.46:0/2558394248 wait complete. 2023-10-19T12:47:46.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.150+0000 7f8fe3d9ab80 1 -- start start 2023-10-19T12:47:46.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.150+0000 7f8fe3d9ab80 1 Processor -- start 2023-10-19T12:47:46.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.151+0000 7f8fe3d9ab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5648e74ce5d0 0x5648e74dedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:47:46.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.152+0000 7f8fe3d9ab80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5648e74cf2d0 0x5648e74dd4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:47:46.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.152+0000 7f8fe3d9ab80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5648e74cfc30 0x5648e74dd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:47:46.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.152+0000 7f8fe3d9ab80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648e74ddf30 con 0x5648e74cf2d0 2023-10-19T12:47:46.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.152+0000 7f8fe3d9ab80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648e74de0a0 con 0x5648e74cfc30 2023-10-19T12:47:46.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.152+0000 7f8fe3d9ab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648e74de260 con 0x5648e74ce5d0 2023-10-19T12:47:46.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.152+0000 7f8fe3d9ab80 10 client.0 _ll_register_callbacks cb 0x5648e7307a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:47:46.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.152+0000 7f8fce99c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5648e74cfc30 0x5648e74dd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:47:46.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.152+0000 7f8fce99c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5648e74cfc30 0x5648e74dd9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:53128/0 (socket says 172.21.15.46:53128) 2023-10-19T12:47:46.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.152+0000 7f8fce99c700 1 -- 172.21.15.46:0/1653122144 learned_addr learned my addr 172.21.15.46:0/1653122144 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:47:46.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.152+0000 7f8fce19b700 1 --2- 172.21.15.46:0/1653122144 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5648e74ce5d0 0x5648e74dedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:47:46.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.153+0000 7f8fce99c700 1 -- 172.21.15.46:0/1653122144 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5648e74ce5d0 msgr2=0x5648e74dedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:47:46.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.153+0000 7f8fce99c700 1 --2- 172.21.15.46:0/1653122144 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5648e74ce5d0 0x5648e74dedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:47:46.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.153+0000 7f8fce99c700 1 -- 172.21.15.46:0/1653122144 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5648e74cf2d0 msgr2=0x5648e74dd4b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-19T12:47:46.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.153+0000 7f8fcd99a700 1 --2- 172.21.15.46:0/1653122144 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5648e74cf2d0 0x5648e74dd4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:47:46.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.153+0000 7f8fce99c700 1 --2- 172.21.15.46:0/1653122144 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5648e74cf2d0 0x5648e74dd4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:47:46.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.153+0000 7f8fce99c700 1 -- 172.21.15.46:0/1653122144 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5648e73de3f0 con 0x5648e74cfc30 2023-10-19T12:47:46.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.153+0000 7f8fcd99a700 1 --2- 172.21.15.46:0/1653122144 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5648e74cf2d0 0x5648e74dd4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T12:47:46.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.154+0000 7f8fce99c700 1 --2- 172.21.15.46:0/1653122144 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5648e74cfc30 0x5648e74dd9f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8fc0007ac0 tx=0x7f8fc001ac90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c01a136a5f7c302d server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:47:46.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.154+0000 7f8fb1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.157:3300/0 2023-10-19T12:47:46.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.154+0000 7f8fb1ffb700 1 -- 172.21.15.46:0/1653122144 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc0009660 con 0x5648e74cfc30 2023-10-19T12:47:46.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.154+0000 7f8fb1ffb700 1 -- 172.21.15.46:0/1653122144 <== mon.2 v2:172.21.15.157:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f8fc0003a00 con 0x5648e74cfc30 2023-10-19T12:47:46.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.155+0000 7f8fe3d9ab80 1 -- 172.21.15.46:0/1653122144 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8fc000f040 con 0x5648e74cfc30 2023-10-19T12:47:46.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.155+0000 7f8fb1ffb700 1 -- 172.21.15.46:0/1653122144 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8fc0007500 con 0x5648e74cfc30 2023-10-19T12:47:46.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.155+0000 7f8fe3d9ab80 10 client.25946 fetch_fsmap learned FSMap version 40 2023-10-19T12:47:46.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.155+0000 7f8fe3d9ab80 1 -- 172.21.15.46:0/1653122144 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) v3 -- 0x7f8fc400de70 con 0x5648e74cfc30 2023-10-19T12:47:46.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.157+0000 7f8fb1ffb700 1 -- 172.21.15.46:0/1653122144 <== mon.2 v2:172.21.15.157:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8fc000f040 con 0x5648e74cfc30 2023-10-19T12:47:46.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.157+0000 7f8fb1ffb700 1 -- 172.21.15.46:0/1653122144 <== mon.2 v2:172.21.15.157:3300/0 5 ==== fsmap(e 40) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f8fc0007af0 con 0x5648e74cfc30 2023-10-19T12:47:46.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.157+0000 7f8fe3d9ab80 10 client.25946 fetch_fsmap finished waiting for FSMap version 40 2023-10-19T12:47:46.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.157+0000 7f8fe3d9ab80 10 client.25946 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-19T12:47:46.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.157+0000 7f8fe3d9ab80 20 client.25946 populate_metadata read hostname 'smithi046' 2023-10-19T12:47:46.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.157+0000 7f8fe3d9ab80 1 --2- 172.21.15.46:0/1653122144 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x5648e75523c0 0x5648e75547e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:47:46.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.157+0000 7f8fe3d9ab80 4 client.25946 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-19T12:47:46.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.157+0000 7f8fe3d9ab80 1 -- 172.21.15.46:0/1653122144 --> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5648e7419e50 con 0x5648e75523c0 2023-10-19T12:47:46.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.157+0000 7f8fce19b700 1 --2- 172.21.15.46:0/1653122144 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x5648e75523c0 0x5648e75547e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:47:46.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.158+0000 7f8fce19b700 1 --2- 172.21.15.46:0/1653122144 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x5648e75523c0 0x5648e75547e0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=64825c5942f1ec11 server_cookie=caf3ab8bdb3b9b23 in_seq=0 out_seq=0 2023-10-19T12:47:46.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.158+0000 7f8fb1ffb700 10 client.25946 ms_handle_connect on v2:172.21.15.157:6838/552718978 2023-10-19T12:47:46.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.159+0000 7f8fb1ffb700 1 -- 172.21.15.46:0/1653122144 <== mds.0 v2:172.21.15.157:6838/552718978 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x5648e7419e50 con 0x5648e75523c0 2023-10-19T12:47:46.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.159+0000 7f8fb1ffb700 10 client.25946 handle_command_reply: tid=0 2023-10-19T12:47:46.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.159+0000 7f8fe3d9ab80 1 client.25946 shutdown 2023-10-19T12:47:46.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.160+0000 7f8fe3d9ab80 1 -- 172.21.15.46:0/1653122144 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5648e74cfc30 msgr2=0x5648e74dd9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:47:46.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.160+0000 7f8fe3d9ab80 1 --2- 172.21.15.46:0/1653122144 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5648e74cfc30 0x5648e74dd9f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8fc0007ac0 tx=0x7f8fc001ac90 comp rx=0 tx=0).stop 2023-10-19T12:47:46.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.160+0000 7f8fe3d9ab80 1 -- 172.21.15.46:0/1653122144 shutdown_connections 2023-10-19T12:47:46.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.160+0000 7f8fe3d9ab80 1 --2- 172.21.15.46:0/1653122144 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5648e74cfc30 0x5648e74dd9f0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:47:46.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.160+0000 7f8fe3d9ab80 1 --2- 172.21.15.46:0/1653122144 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5648e74ce5d0 0x5648e74dedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:47:46.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.160+0000 7f8fe3d9ab80 1 --2- 172.21.15.46:0/1653122144 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x5648e75523c0 0x5648e75547e0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:47:46.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.160+0000 7f8fe3d9ab80 1 --2- 172.21.15.46:0/1653122144 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5648e74cf2d0 0x5648e74dd4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:47:46.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.160+0000 7f8fb1ffb700 0 client.25946 ms_handle_reset on v2:172.21.15.157:6838/552718978 2023-10-19T12:47:46.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.160+0000 7f8fe3d9ab80 1 -- 172.21.15.46:0/1653122144 >> 172.21.15.46:0/1653122144 conn(0x5648e7442720 msgr2=0x5648e74d5b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:47:46.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.161+0000 7f8fe3d9ab80 1 -- 172.21.15.46:0/1653122144 shutdown_connections 2023-10-19T12:47:46.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.161+0000 7f8fe3d9ab80 1 -- 172.21.15.46:0/1653122144 wait complete. 2023-10-19T12:47:46.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.162+0000 7f8fe3d9ab80 20 client.25946 trim_cache size 0 max 16384 2023-10-19T12:47:46.169 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-10-19T12:47:46.169 INFO:teuthology.orchestra.run.smithi046.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-19T12:47:46.169 INFO:teuthology.orchestra.run.smithi046.stdout: "scrubs": { 2023-10-19T12:47:46.170 INFO:teuthology.orchestra.run.smithi046.stdout: "21e73f70-af16-4ae7-bc34-e6c54ba8e1ec": { 2023-10-19T12:47:46.170 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2023-10-19T12:47:46.170 INFO:teuthology.orchestra.run.smithi046.stdout: "tag": "21e73f70-af16-4ae7-bc34-e6c54ba8e1ec", 2023-10-19T12:47:46.170 INFO:teuthology.orchestra.run.smithi046.stdout: "options": "recursive,force" 2023-10-19T12:47:46.170 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:47:46.171 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:47:46.171 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-10-19T12:47:46.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.163+0000 7f8fd03ff700 1 -- 172.21.15.46:0/2759368987 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f8fb40a1680 msgr2=0x7f8fb40a3b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:47:46.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.163+0000 7f8fd03ff700 1 --2- 172.21.15.46:0/2759368987 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f8fb40a1680 0x7f8fb40a3b40 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f8fc001b000 tx=0x7f8fc001d000 comp rx=0 tx=0).stop 2023-10-19T12:47:46.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.163+0000 7f8fd03ff700 1 -- 172.21.15.46:0/2759368987 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8fc8100880 msgr2=0x7f8fc8101d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:47:46.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.163+0000 7f8fd03ff700 1 --2- 172.21.15.46:0/2759368987 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8fc8100880 0x7f8fc8101d50 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc009f50 tx=0x7f8fbc005720 comp rx=0 tx=0).stop 2023-10-19T12:47:46.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.164+0000 7f8fd03ff700 1 -- 172.21.15.46:0/2759368987 shutdown_connections 2023-10-19T12:47:46.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.164+0000 7f8fd03ff700 1 --2- 172.21.15.46:0/2759368987 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8fc8101220 0x7f8fc8102290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:47:46.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.164+0000 7f8fd03ff700 1 --2- 172.21.15.46:0/2759368987 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f8fb40a1680 0x7f8fb40a3b40 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:47:46.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.164+0000 7f8fd03ff700 1 --2- 172.21.15.46:0/2759368987 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8fc80ff690 0x7f8fc81036c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:47:46.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.164+0000 7f8fd03ff700 1 --2- 172.21.15.46:0/2759368987 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8fc8100880 0x7f8fc8101d50 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:47:46.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.164+0000 7f8fd03ff700 1 -- 172.21.15.46:0/2759368987 >> 172.21.15.46:0/2759368987 conn(0x7f8fc80fac00 msgr2=0x7f8fc8067830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:47:46.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.164+0000 7f8fd03ff700 1 -- 172.21.15.46:0/2759368987 shutdown_connections 2023-10-19T12:47:46.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:47:46.164+0000 7f8fd03ff700 1 -- 172.21.15.46:0/2759368987 wait complete. 2023-10-19T12:47:46.200 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:47:45 smithi046 ceph-mon[98509]: pgmap v481: 129 pgs: 129 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 15 MiB/s wr, 1.15k op/s 2023-10-19T12:47:46.203 INFO:tasks.cephfs.filesystem:scrub status for tag:21e73f70-af16-4ae7-bc34-e6c54ba8e1ec - {'path': '/', 'tag': '21e73f70-af16-4ae7-bc34-e6c54ba8e1ec', 'options': 'recursive,force'} 2023-10-19T12:47:46.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:47:45 smithi157 ceph-mon[134109]: pgmap v481: 129 pgs: 129 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 15 MiB/s wr, 1.15k op/s 2023-10-19T12:47:46.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 225.0 s, 820.8 tps, lat 121.739 ms stddev 145.649 2023-10-19T12:47:48.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:47:47 smithi195 ceph-mon[134493]: pgmap v482: 129 pgs: 129 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 14 MiB/s wr, 1.08k op/s 2023-10-19T12:47:48.228 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:47:47 smithi046 ceph-mon[98509]: pgmap v482: 129 pgs: 129 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 14 MiB/s wr, 1.08k op/s 2023-10-19T12:47:48.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:47:47 smithi157 ceph-mon[134109]: pgmap v482: 129 pgs: 129 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 14 MiB/s wr, 1.08k op/s 2023-10-19T12:47:49.730 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:47:49 smithi046 ceph-mon[98509]: pgmap v483: 129 pgs: 129 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.6 MiB/s wr, 713 op/s 2023-10-19T12:47:49.837 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:47:49 smithi157 ceph-mon[134109]: pgmap v483: 129 pgs: 129 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.6 MiB/s wr, 713 op/s 2023-10-19T12:47:49.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:47:49 smithi195 ceph-mon[134493]: pgmap v483: 129 pgs: 129 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.6 MiB/s wr, 713 op/s 2023-10-19T12:47:50.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:47:50 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:47:50.837 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:47:50 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:47:50.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:47:50 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:47:51.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 230.0 s, 666.5 tps, lat 148.417 ms stddev 184.057 2023-10-19T12:47:51.837 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:47:51 smithi157 ceph-mon[134109]: pgmap v484: 129 pgs: 129 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.3 MiB/s wr, 495 op/s 2023-10-19T12:47:51.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:47:51 smithi195 ceph-mon[134493]: pgmap v484: 129 pgs: 129 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.3 MiB/s wr, 495 op/s 2023-10-19T12:47:51.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:47:51 smithi046 ceph-mon[98509]: pgmap v484: 129 pgs: 129 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.3 MiB/s wr, 495 op/s 2023-10-19T12:47:52.837 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:47:52 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:47:52.837 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:47:52 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:47:52.838 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:47:52 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:47:52.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:47:52 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:47:52.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:47:52 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:47:52.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:47:52 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:47:52.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:47:52 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:47:52.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:47:52 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:47:52.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:47:52 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:47:53.837 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:47:53 smithi157 ceph-mon[134109]: pgmap v485: 129 pgs: 129 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.5 MiB/s wr, 590 op/s 2023-10-19T12:47:53.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:47:53 smithi195 ceph-mon[134493]: pgmap v485: 129 pgs: 129 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.5 MiB/s wr, 590 op/s 2023-10-19T12:47:53.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:47:53 smithi046 ceph-mon[98509]: pgmap v485: 129 pgs: 129 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.5 MiB/s wr, 590 op/s 2023-10-19T12:47:55.840 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:47:55 smithi157 ceph-mon[134109]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-19T12:47:55.841 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:47:55 smithi157 ceph-mon[134109]: pgmap v486: 129 pgs: 129 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.0 MiB/s wr, 507 op/s 2023-10-19T12:47:55.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:47:55 smithi195 ceph-mon[134493]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-19T12:47:55.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:47:55 smithi195 ceph-mon[134493]: pgmap v486: 129 pgs: 129 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.0 MiB/s wr, 507 op/s 2023-10-19T12:47:55.978 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:47:55 smithi046 ceph-mon[98509]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-19T12:47:55.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:47:55 smithi046 ceph-mon[98509]: pgmap v486: 129 pgs: 129 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.0 MiB/s wr, 507 op/s 2023-10-19T12:47:56.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 235.0 s, 659.1 tps, lat 153.332 ms stddev 177.245 2023-10-19T12:47:58.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:47:57 smithi195 ceph-mon[134493]: pgmap v487: 129 pgs: 129 active+clean; 1.5 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.6 MiB/s wr, 550 op/s 2023-10-19T12:47:58.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:47:57 smithi046 ceph-mon[98509]: pgmap v487: 129 pgs: 129 active+clean; 1.5 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.6 MiB/s wr, 550 op/s 2023-10-19T12:47:58.340 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:47:57 smithi157 ceph-mon[134109]: pgmap v487: 129 pgs: 129 active+clean; 1.5 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.6 MiB/s wr, 550 op/s 2023-10-19T12:47:59.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:47:59 smithi046 ceph-mon[98509]: pgmap v488: 129 pgs: 129 active+clean; 1.5 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.8 MiB/s wr, 554 op/s 2023-10-19T12:47:59.837 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:47:59 smithi157 ceph-mon[134109]: pgmap v488: 129 pgs: 129 active+clean; 1.5 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.8 MiB/s wr, 554 op/s 2023-10-19T12:47:59.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:47:59 smithi195 ceph-mon[134493]: pgmap v488: 129 pgs: 129 active+clean; 1.5 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.8 MiB/s wr, 554 op/s 2023-10-19T12:48:01.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 240.0 s, 836.0 tps, lat 118.540 ms stddev 132.950 2023-10-19T12:48:02.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:48:01 smithi195 ceph-mon[134493]: pgmap v489: 129 pgs: 129 active+clean; 1.5 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.1 MiB/s wr, 502 op/s 2023-10-19T12:48:02.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:48:01 smithi046 ceph-mon[98509]: pgmap v489: 129 pgs: 129 active+clean; 1.5 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.1 MiB/s wr, 502 op/s 2023-10-19T12:48:02.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:48:01 smithi157 ceph-mon[134109]: pgmap v489: 129 pgs: 129 active+clean; 1.5 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.1 MiB/s wr, 502 op/s 2023-10-19T12:48:04.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:48:03 smithi195 ceph-mon[134493]: pgmap v490: 129 pgs: 129 active+clean; 1.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.1 MiB/s wr, 643 op/s 2023-10-19T12:48:04.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:48:03 smithi046 ceph-mon[98509]: pgmap v490: 129 pgs: 129 active+clean; 1.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.1 MiB/s wr, 643 op/s 2023-10-19T12:48:04.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:48:03 smithi157 ceph-mon[134109]: pgmap v490: 129 pgs: 129 active+clean; 1.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.1 MiB/s wr, 643 op/s 2023-10-19T12:48:06.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:48:05 smithi046 ceph-mon[98509]: pgmap v491: 129 pgs: 129 active+clean; 1.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.6 MiB/s wr, 556 op/s 2023-10-19T12:48:06.339 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:48:05 smithi157 ceph-mon[134109]: pgmap v491: 129 pgs: 129 active+clean; 1.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.6 MiB/s wr, 556 op/s 2023-10-19T12:48:06.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:48:05 smithi195 ceph-mon[134493]: pgmap v491: 129 pgs: 129 active+clean; 1.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.6 MiB/s wr, 556 op/s 2023-10-19T12:48:06.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 245.0 s, 864.0 tps, lat 114.882 ms stddev 138.841 2023-10-19T12:48:08.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:48:07 smithi046 ceph-mon[98509]: pgmap v492: 129 pgs: 129 active+clean; 1.5 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.9 MiB/s wr, 621 op/s 2023-10-19T12:48:08.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:48:07 smithi157 ceph-mon[134109]: pgmap v492: 129 pgs: 129 active+clean; 1.5 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.9 MiB/s wr, 621 op/s 2023-10-19T12:48:08.385 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:48:07 smithi195 ceph-mon[134493]: pgmap v492: 129 pgs: 129 active+clean; 1.5 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.9 MiB/s wr, 621 op/s 2023-10-19T12:48:09.838 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:48:09 smithi157 ceph-mon[134109]: pgmap v493: 129 pgs: 129 active+clean; 1.5 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.4 MiB/s wr, 591 op/s 2023-10-19T12:48:09.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:48:09 smithi195 ceph-mon[134493]: pgmap v493: 129 pgs: 129 active+clean; 1.5 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.4 MiB/s wr, 591 op/s 2023-10-19T12:48:09.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:48:09 smithi046 ceph-mon[98509]: pgmap v493: 129 pgs: 129 active+clean; 1.5 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.4 MiB/s wr, 591 op/s 2023-10-19T12:48:11.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 250.0 s, 801.9 tps, lat 126.354 ms stddev 148.628 2023-10-19T12:48:12.134 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:48:11 smithi195 ceph-mon[134493]: pgmap v494: 129 pgs: 129 active+clean; 1.5 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.4 MiB/s wr, 539 op/s 2023-10-19T12:48:12.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:48:11 smithi046 ceph-mon[98509]: pgmap v494: 129 pgs: 129 active+clean; 1.5 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.4 MiB/s wr, 539 op/s 2023-10-19T12:48:12.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:48:11 smithi157 ceph-mon[134109]: pgmap v494: 129 pgs: 129 active+clean; 1.5 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.4 MiB/s wr, 539 op/s 2023-10-19T12:48:14.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:48:13 smithi195 ceph-mon[134493]: pgmap v495: 129 pgs: 129 active+clean; 1.5 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.1 MiB/s wr, 631 op/s 2023-10-19T12:48:14.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:48:13 smithi046 ceph-mon[98509]: pgmap v495: 129 pgs: 129 active+clean; 1.5 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.1 MiB/s wr, 631 op/s 2023-10-19T12:48:14.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:48:13 smithi157 ceph-mon[134109]: pgmap v495: 129 pgs: 129 active+clean; 1.5 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.1 MiB/s wr, 631 op/s 2023-10-19T12:48:16.204 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-19T12:48:16.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:48:15 smithi046 ceph-mon[98509]: pgmap v496: 129 pgs: 129 active+clean; 1.5 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 6.6 MiB/s wr, 526 op/s 2023-10-19T12:48:16.339 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:48:15 smithi157 ceph-mon[134109]: pgmap v496: 129 pgs: 129 active+clean; 1.5 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 6.6 MiB/s wr, 526 op/s 2023-10-19T12:48:16.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:48:15 smithi195 ceph-mon[134493]: pgmap v496: 129 pgs: 129 active+clean; 1.5 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 6.6 MiB/s wr, 526 op/s 2023-10-19T12:48:16.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.608+0000 7f69ec7ff700 1 -- 172.21.15.46:0/2759787999 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f69e410b230 msgr2=0x7f69e410d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:48:16.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.608+0000 7f69ec7ff700 1 --2- 172.21.15.46:0/2759787999 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f69e410b230 0x7f69e410d620 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f69e0009990 tx=0x7f69e0009ca0 comp rx=0 tx=0).stop 2023-10-19T12:48:16.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.608+0000 7f69ec7ff700 1 -- 172.21.15.46:0/2759787999 shutdown_connections 2023-10-19T12:48:16.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.608+0000 7f69ec7ff700 1 --2- 172.21.15.46:0/2759787999 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f69e410db60 0x7f69e410fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:48:16.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.608+0000 7f69ec7ff700 1 --2- 172.21.15.46:0/2759787999 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f69e4108900 0x7f69e410acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:48:16.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.608+0000 7f69ec7ff700 1 --2- 172.21.15.46:0/2759787999 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f69e410b230 0x7f69e410d620 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:48:16.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.608+0000 7f69ec7ff700 1 -- 172.21.15.46:0/2759787999 >> 172.21.15.46:0/2759787999 conn(0x7f69e406d7d0 msgr2=0x7f69e406fc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:48:16.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.609+0000 7f69ec7ff700 1 -- 172.21.15.46:0/2759787999 shutdown_connections 2023-10-19T12:48:16.613 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.609+0000 7f69ec7ff700 1 -- 172.21.15.46:0/2759787999 wait complete. 2023-10-19T12:48:16.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.610+0000 7f69ec7ff700 1 Processor -- start 2023-10-19T12:48:16.614 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.611+0000 7f69ec7ff700 1 -- start start 2023-10-19T12:48:16.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.611+0000 7f69ec7ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f69e4108900 0x7f69e419cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:48:16.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.611+0000 7f69ec7ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f69e410b230 0x7f69e419d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:48:16.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.611+0000 7f69ec7ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f69e410db60 0x7f69e41a4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:48:16.616 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.612+0000 7f69ec7ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e41a48d0 con 0x7f69e4108900 2023-10-19T12:48:16.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.612+0000 7f69ec7ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e41a4a10 con 0x7f69e410db60 2023-10-19T12:48:16.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.612+0000 7f69ec7ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e41a4ba0 con 0x7f69e410b230 2023-10-19T12:48:16.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.612+0000 7f69ead9c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f69e410db60 0x7f69e41a4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:48:16.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.612+0000 7f69ead9c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f69e410db60 0x7f69e41a4300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:34246/0 (socket says 172.21.15.46:34246) 2023-10-19T12:48:16.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.612+0000 7f69ead9c700 1 -- 172.21.15.46:0/3475332527 learned_addr learned my addr 172.21.15.46:0/3475332527 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:48:16.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.612+0000 7f69e9d9a700 1 --2- 172.21.15.46:0/3475332527 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f69e410b230 0x7f69e419d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:48:16.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.612+0000 7f69ead9c700 1 -- 172.21.15.46:0/3475332527 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f69e410b230 msgr2=0x7f69e419d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:48:16.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.612+0000 7f69ead9c700 1 --2- 172.21.15.46:0/3475332527 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f69e410b230 0x7f69e419d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:48:16.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.612+0000 7f69ead9c700 1 -- 172.21.15.46:0/3475332527 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f69e4108900 msgr2=0x7f69e419cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:48:16.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.612+0000 7f69ead9c700 1 --2- 172.21.15.46:0/3475332527 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f69e4108900 0x7f69e419cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:48:16.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.612+0000 7f69ead9c700 1 -- 172.21.15.46:0/3475332527 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69e00095f0 con 0x7f69e410db60 2023-10-19T12:48:16.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.612+0000 7f69e9d9a700 1 --2- 172.21.15.46:0/3475332527 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f69e410b230 0x7f69e419d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:48:16.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.613+0000 7f69ead9c700 1 --2- 172.21.15.46:0/3475332527 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f69e410db60 0x7f69e41a4300 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f69d4009de0 tx=0x7f69d400f3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:48:16.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.613+0000 7f69db7fe700 1 -- 172.21.15.46:0/3475332527 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d400fdd0 con 0x7f69e410db60 2023-10-19T12:48:16.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.613+0000 7f69ec7ff700 1 -- 172.21.15.46:0/3475332527 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69e41a4e80 con 0x7f69e410db60 2023-10-19T12:48:16.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.613+0000 7f69ec7ff700 1 -- 172.21.15.46:0/3475332527 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69e41a5300 con 0x7f69e410db60 2023-10-19T12:48:16.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.617+0000 7f69db7fe700 1 -- 172.21.15.46:0/3475332527 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f69d4011040 con 0x7f69e410db60 2023-10-19T12:48:16.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.617+0000 7f69db7fe700 1 -- 172.21.15.46:0/3475332527 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d4005280 con 0x7f69e410db60 2023-10-19T12:48:16.627 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.624+0000 7f6a000e0b80 1 Processor -- start 2023-10-19T12:48:16.630 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.626+0000 7f69db7fe700 1 -- 172.21.15.46:0/3475332527 <== mon.2 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f69d40053e0 con 0x7f69e410db60 2023-10-19T12:48:16.630 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.626+0000 7f6a000e0b80 1 -- start start 2023-10-19T12:48:16.630 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.627+0000 7f6a000e0b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561be22ceae0 0x561be22cef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:48:16.631 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.627+0000 7f6a000e0b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561be22cf440 0x561be22cd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:48:16.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.627+0000 7f6a000e0b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561be22cdde0 0x561be22ce260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:48:16.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.627+0000 7f6a000e0b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x561be22386e0 con 0x561be22cdde0 2023-10-19T12:48:16.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.627+0000 7f6a000e0b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x561be221ec60 con 0x561be22ceae0 2023-10-19T12:48:16.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.627+0000 7f6a000e0b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x561be221c580 con 0x561be22cf440 2023-10-19T12:48:16.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.627+0000 7f69ea59b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561be22cf440 0x561be22cd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:48:16.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.627+0000 7f69ea59b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561be22cf440 0x561be22cd8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:50196/0 (socket says 172.21.15.46:50196) 2023-10-19T12:48:16.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.627+0000 7f69ea59b700 1 -- 172.21.15.46:0/2755264062 learned_addr learned my addr 172.21.15.46:0/2755264062 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:48:16.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.627+0000 7f69e9d9a700 1 --2- 172.21.15.46:0/2755264062 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561be22ceae0 0x561be22cef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:48:16.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.628+0000 7f69e9d9a700 1 -- 172.21.15.46:0/2755264062 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561be22cf440 msgr2=0x561be22cd8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:48:16.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.628+0000 7f69e9d9a700 1 --2- 172.21.15.46:0/2755264062 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561be22cf440 0x561be22cd8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:48:16.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.628+0000 7f69e9d9a700 1 -- 172.21.15.46:0/2755264062 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561be22cdde0 msgr2=0x561be22ce260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:48:16.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.628+0000 7f69e9d9a700 1 --2- 172.21.15.46:0/2755264062 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561be22cdde0 0x561be22ce260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:48:16.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.628+0000 7f69e9d9a700 1 -- 172.21.15.46:0/2755264062 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561be21d53f0 con 0x561be22ceae0 2023-10-19T12:48:16.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.628+0000 7f69e9d9a700 1 --2- 172.21.15.46:0/2755264062 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561be22ceae0 0x561be22cef00 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f69e000b5c0 tx=0x7f69e000bc20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71f5c7a63637651f server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:48:16.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.629+0000 7f69d8ff9700 1 -- 172.21.15.46:0/2755264062 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e0005a00 con 0x561be22ceae0 2023-10-19T12:48:16.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.629+0000 7f69d8ff9700 1 -- 172.21.15.46:0/2755264062 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f69e000be00 con 0x561be22ceae0 2023-10-19T12:48:16.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.629+0000 7f69d8ff9700 1 -- 172.21.15.46:0/2755264062 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e0017650 con 0x561be22ceae0 2023-10-19T12:48:16.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.630+0000 7f6a000e0b80 1 -- 172.21.15.46:0/2755264062 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561be22ceae0 msgr2=0x561be22cef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:48:16.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.630+0000 7f6a000e0b80 1 --2- 172.21.15.46:0/2755264062 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561be22ceae0 0x561be22cef00 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f69e000b5c0 tx=0x7f69e000bc20 comp rx=0 tx=0).stop 2023-10-19T12:48:16.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.631+0000 7f69db7fe700 1 --2- 172.21.15.46:0/3475332527 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f69d00a1550 0x7f69d00a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:48:16.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.631+0000 7f69db7fe700 1 -- 172.21.15.46:0/3475332527 <== mon.2 v2:172.21.15.157:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f69d40ccae0 con 0x7f69e410db60 2023-10-19T12:48:16.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.631+0000 7f6a000e0b80 1 -- 172.21.15.46:0/2755264062 shutdown_connections 2023-10-19T12:48:16.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.632+0000 7f6a000e0b80 1 --2- 172.21.15.46:0/2755264062 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561be22cdde0 0x561be22ce260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:48:16.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.632+0000 7f6a000e0b80 1 --2- 172.21.15.46:0/2755264062 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561be22ceae0 0x561be22cef00 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:48:16.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.632+0000 7f6a000e0b80 1 --2- 172.21.15.46:0/2755264062 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561be22cf440 0x561be22cd8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:48:16.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.632+0000 7f6a000e0b80 1 -- 172.21.15.46:0/2755264062 >> 172.21.15.46:0/2755264062 conn(0x561be2239720 msgr2=0x561be22bfb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:48:16.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.633+0000 7f69e9d9a700 1 --2- 172.21.15.46:0/3475332527 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f69d00a1550 0x7f69d00a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:48:16.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.633+0000 7f6a000e0b80 1 -- 172.21.15.46:0/2755264062 shutdown_connections 2023-10-19T12:48:16.640 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.633+0000 7f6a000e0b80 1 -- 172.21.15.46:0/2755264062 wait complete. 2023-10-19T12:48:16.640 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.634+0000 7f69e9d9a700 1 --2- 172.21.15.46:0/3475332527 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f69d00a1550 0x7f69d00a3a10 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f69e000a010 tx=0x7f69e0009310 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:48:16.640 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.634+0000 7f6a000e0b80 1 -- start start 2023-10-19T12:48:16.640 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.634+0000 7f6a000e0b80 1 Processor -- start 2023-10-19T12:48:16.640 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.635+0000 7f6a000e0b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561be22cdde0 0x561be22d7260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:48:16.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.635+0000 7f6a000e0b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561be22ceae0 0x561be22d77a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:48:16.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.635+0000 7f6a000e0b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561be22cf440 0x561be22de7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:48:16.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.636+0000 7f69ea59b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561be22cdde0 0x561be22d7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:48:16.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.636+0000 7f69e9d9a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561be22ceae0 0x561be22d77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:48:16.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.636+0000 7f69e9d9a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561be22ceae0 0x561be22d77a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:50198/0 (socket says 172.21.15.46:50198) 2023-10-19T12:48:16.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.636+0000 7f6a000e0b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x561be2217e70 con 0x561be22cf440 2023-10-19T12:48:16.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.636+0000 7f6a000e0b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x561be21b4710 con 0x561be22cdde0 2023-10-19T12:48:16.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.636+0000 7f69ea59b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561be22cdde0 0x561be22d7260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:34264/0 (socket says 172.21.15.46:34264) 2023-10-19T12:48:16.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.636+0000 7f6a000e0b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x561be21b43b0 con 0x561be22ceae0 2023-10-19T12:48:16.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.636+0000 7f69ea59b700 1 -- 172.21.15.46:0/2564160789 learned_addr learned my addr 172.21.15.46:0/2564160789 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:48:16.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.636+0000 7f6a000e0b80 10 client.0 _ll_register_callbacks cb 0x561be20fea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:48:16.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.636+0000 7f69ead9c700 1 --2- 172.21.15.46:0/2564160789 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561be22cf440 0x561be22de7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:48:16.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.636+0000 7f69e9d9a700 1 -- 172.21.15.46:0/2564160789 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561be22cdde0 msgr2=0x561be22d7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:48:16.646 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.636+0000 7f69e9d9a700 1 --2- 172.21.15.46:0/2564160789 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561be22cdde0 0x561be22d7260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:48:16.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.636+0000 7f69e9d9a700 1 -- 172.21.15.46:0/2564160789 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561be22cf440 msgr2=0x561be22de7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:48:16.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.636+0000 7f69e9d9a700 1 --2- 172.21.15.46:0/2564160789 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561be22cf440 0x561be22de7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:48:16.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.636+0000 7f69e9d9a700 1 -- 172.21.15.46:0/2564160789 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69e0020040 con 0x561be22ceae0 2023-10-19T12:48:16.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.637+0000 7f69ea59b700 1 --2- 172.21.15.46:0/2564160789 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561be22cdde0 0x561be22d7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:48:16.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.637+0000 7f69cdffb700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-10-19T12:48:16.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.637+0000 7f69e9d9a700 1 --2- 172.21.15.46:0/2564160789 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561be22ceae0 0x561be22d77a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f69e00098e0 tx=0x7f69e0009ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7f8926be0ca611e server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:48:16.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.638+0000 7f69cdffb700 1 -- 172.21.15.46:0/2564160789 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e0035070 con 0x561be22ceae0 2023-10-19T12:48:16.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.638+0000 7f6a000e0b80 1 -- 172.21.15.46:0/2564160789 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561be221cef0 con 0x561be22ceae0 2023-10-19T12:48:16.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.638+0000 7f69cdffb700 1 -- 172.21.15.46:0/2564160789 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f69e0025a20 con 0x561be22ceae0 2023-10-19T12:48:16.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.641+0000 7f69cdffb700 1 -- 172.21.15.46:0/2564160789 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f69e0035070 con 0x561be22ceae0 2023-10-19T12:48:16.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.641+0000 7f6a000e0b80 10 client.25966 fetch_fsmap learned FSMap version 41 2023-10-19T12:48:16.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.641+0000 7f6a000e0b80 1 -- 172.21.15.46:0/2564160789 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x561be2042de0 con 0x561be22ceae0 2023-10-19T12:48:16.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.642+0000 7f69cdffb700 1 -- 172.21.15.46:0/2564160789 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x561be221cef0 con 0x561be22ceae0 2023-10-19T12:48:16.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.642+0000 7f69cdffb700 1 -- 172.21.15.46:0/2564160789 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 41) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f69e003ac90 con 0x561be22ceae0 2023-10-19T12:48:16.651 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.643+0000 7f6a000e0b80 10 client.25966 fetch_fsmap finished waiting for FSMap version 41 2023-10-19T12:48:16.651 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.643+0000 7f6a000e0b80 10 client.25966 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-19T12:48:16.651 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.643+0000 7f6a000e0b80 20 client.25966 populate_metadata read hostname 'smithi046' 2023-10-19T12:48:16.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.643+0000 7f6a000e0b80 1 --2- 172.21.15.46:0/2564160789 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x561be22e2ab0 0x561be22e4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:48:16.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.643+0000 7f6a000e0b80 4 client.25966 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-19T12:48:16.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.643+0000 7f6a000e0b80 1 -- 172.21.15.46:0/2564160789 --> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561be22948b0 con 0x561be22e2ab0 2023-10-19T12:48:16.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.643+0000 7f69ea59b700 1 --2- 172.21.15.46:0/2564160789 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x561be22e2ab0 0x561be22e4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:48:16.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.644+0000 7f69ea59b700 1 --2- 172.21.15.46:0/2564160789 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x561be22e2ab0 0x561be22e4ec0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=90fe641416c18a0d server_cookie=9dd2d50101f382b8 in_seq=0 out_seq=0 2023-10-19T12:48:16.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.644+0000 7f69cdffb700 10 client.25966 ms_handle_connect on v2:172.21.15.157:6838/552718978 2023-10-19T12:48:16.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.645+0000 7f69cdffb700 1 -- 172.21.15.46:0/2564160789 <== mds.0 v2:172.21.15.157:6838/552718978 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x561be22948b0 con 0x561be22e2ab0 2023-10-19T12:48:16.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.645+0000 7f69cdffb700 10 client.25966 handle_command_reply: tid=0 2023-10-19T12:48:16.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.645+0000 7f6a000e0b80 1 client.25966 shutdown 2023-10-19T12:48:16.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.645+0000 7f6a000e0b80 1 -- 172.21.15.46:0/2564160789 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561be22ceae0 msgr2=0x561be22d77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:48:16.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.645+0000 7f6a000e0b80 1 --2- 172.21.15.46:0/2564160789 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561be22ceae0 0x561be22d77a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f69e00098e0 tx=0x7f69e0009ca0 comp rx=0 tx=0).stop 2023-10-19T12:48:16.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.646+0000 7f6a000e0b80 1 -- 172.21.15.46:0/2564160789 shutdown_connections 2023-10-19T12:48:16.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.646+0000 7f6a000e0b80 1 --2- 172.21.15.46:0/2564160789 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x561be22e2ab0 0x561be22e4ec0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:48:16.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.646+0000 7f6a000e0b80 1 --2- 172.21.15.46:0/2564160789 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561be22cf440 0x561be22de7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:48:16.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.646+0000 7f6a000e0b80 1 --2- 172.21.15.46:0/2564160789 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561be22cdde0 0x561be22d7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:48:16.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.646+0000 7f6a000e0b80 1 --2- 172.21.15.46:0/2564160789 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561be22ceae0 0x561be22d77a0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:48:16.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.646+0000 7f6a000e0b80 1 -- 172.21.15.46:0/2564160789 >> 172.21.15.46:0/2564160789 conn(0x561be2239720 msgr2=0x561be22bfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:48:16.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.646+0000 7f69cdffb700 0 client.25966 ms_handle_reset on v2:172.21.15.157:6838/552718978 2023-10-19T12:48:16.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.646+0000 7f6a000e0b80 1 -- 172.21.15.46:0/2564160789 shutdown_connections 2023-10-19T12:48:16.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.647+0000 7f6a000e0b80 1 -- 172.21.15.46:0/2564160789 wait complete. 2023-10-19T12:48:16.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.648+0000 7f6a000e0b80 20 client.25966 trim_cache size 0 max 16384 2023-10-19T12:48:16.685 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.683+0000 7f6a000e0b80 1 Processor -- start 2023-10-19T12:48:16.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.683+0000 7f6a000e0b80 1 -- start start 2023-10-19T12:48:16.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.683+0000 7f6a000e0b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561be22cdde0 0x561be22d6850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:48:16.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.684+0000 7f6a000e0b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561be22ceae0 0x561be22de7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:48:16.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.684+0000 7f6a000e0b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561be22cf440 0x561be22b9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:48:16.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.684+0000 7f6a000e0b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x561be2098920 con 0x561be22cdde0 2023-10-19T12:48:16.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.684+0000 7f6a000e0b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x561be22948b0 con 0x561be22cf440 2023-10-19T12:48:16.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.684+0000 7f6a000e0b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x561be221cef0 con 0x561be22ceae0 2023-10-19T12:48:16.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.684+0000 7f69ead9c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561be22cf440 0x561be22b9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:48:16.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.684+0000 7f69ead9c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561be22cf440 0x561be22b9bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:34276/0 (socket says 172.21.15.46:34276) 2023-10-19T12:48:16.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.684+0000 7f69ead9c700 1 -- 172.21.15.46:0/4083282593 learned_addr learned my addr 172.21.15.46:0/4083282593 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:48:16.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.684+0000 7f69e9d9a700 1 --2- 172.21.15.46:0/4083282593 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561be22ceae0 0x561be22de7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:48:16.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.684+0000 7f69ea59b700 1 --2- 172.21.15.46:0/4083282593 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561be22cdde0 0x561be22d6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:48:16.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.685+0000 7f69ead9c700 1 -- 172.21.15.46:0/4083282593 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561be22ceae0 msgr2=0x561be22de7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:48:16.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.685+0000 7f69ead9c700 1 --2- 172.21.15.46:0/4083282593 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561be22ceae0 0x561be22de7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:48:16.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.685+0000 7f69ead9c700 1 -- 172.21.15.46:0/4083282593 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561be22cdde0 msgr2=0x561be22d6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:48:16.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.685+0000 7f69ead9c700 1 --2- 172.21.15.46:0/4083282593 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561be22cdde0 0x561be22d6850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:48:16.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.685+0000 7f69ead9c700 1 -- 172.21.15.46:0/4083282593 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561be202bc60 con 0x561be22cf440 2023-10-19T12:48:16.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.685+0000 7f69e9d9a700 1 --2- 172.21.15.46:0/4083282593 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561be22ceae0 0x561be22de7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T12:48:16.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.685+0000 7f69ea59b700 1 --2- 172.21.15.46:0/4083282593 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561be22cdde0 0x561be22d6850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T12:48:16.692 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.685+0000 7f69ead9c700 1 --2- 172.21.15.46:0/4083282593 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561be22cf440 0x561be22b9bc0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f69d4009f50 tx=0x7f69d4099570 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43716c78094c0e77 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:48:16.692 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.686+0000 7f69d97fa700 1 -- 172.21.15.46:0/4083282593 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d40b1070 con 0x561be22cf440 2023-10-19T12:48:16.692 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.686+0000 7f69d97fa700 1 -- 172.21.15.46:0/4083282593 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f69d4099a30 con 0x561be22cf440 2023-10-19T12:48:16.692 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.686+0000 7f69d97fa700 1 -- 172.21.15.46:0/4083282593 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d4097dd0 con 0x561be22cf440 2023-10-19T12:48:16.693 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.687+0000 7f6a000e0b80 1 -- 172.21.15.46:0/4083282593 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561be22cf440 msgr2=0x561be22b9bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:48:16.693 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.687+0000 7f6a000e0b80 1 --2- 172.21.15.46:0/4083282593 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561be22cf440 0x561be22b9bc0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f69d4009f50 tx=0x7f69d4099570 comp rx=0 tx=0).stop 2023-10-19T12:48:16.693 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.688+0000 7f6a000e0b80 1 -- 172.21.15.46:0/4083282593 shutdown_connections 2023-10-19T12:48:16.693 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.688+0000 7f6a000e0b80 1 --2- 172.21.15.46:0/4083282593 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561be22cf440 0x561be22b9bc0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:48:16.694 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.688+0000 7f6a000e0b80 1 --2- 172.21.15.46:0/4083282593 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561be22cdde0 0x561be22d6850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:48:16.694 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.688+0000 7f6a000e0b80 1 --2- 172.21.15.46:0/4083282593 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561be22ceae0 0x561be22de7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:48:16.694 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.688+0000 7f6a000e0b80 1 -- 172.21.15.46:0/4083282593 >> 172.21.15.46:0/4083282593 conn(0x561be2239720 msgr2=0x561be22b94b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:48:16.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.691+0000 7f6a000e0b80 1 -- 172.21.15.46:0/4083282593 shutdown_connections 2023-10-19T12:48:16.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.691+0000 7f6a000e0b80 1 -- 172.21.15.46:0/4083282593 wait complete. 2023-10-19T12:48:16.697 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.692+0000 7f6a000e0b80 1 -- start start 2023-10-19T12:48:16.697 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.692+0000 7f6a000e0b80 1 Processor -- start 2023-10-19T12:48:16.698 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.695+0000 7f6a000e0b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561be22cdde0 0x561be22dbdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:48:16.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.695+0000 7f6a000e0b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561be22ceae0 0x561be22dc310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:48:16.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.695+0000 7f6a000e0b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561be22cf440 0x561be22dd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:48:16.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.695+0000 7f69ea59b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561be22cdde0 0x561be22dbdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:48:16.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.695+0000 7f69ea59b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561be22cdde0 0x561be22dbdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:50214/0 (socket says 172.21.15.46:50214) 2023-10-19T12:48:16.699 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.695+0000 7f69e9d9a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561be22ceae0 0x561be22dc310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:48:16.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.695+0000 7f69e9d9a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561be22ceae0 0x561be22dc310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:34282/0 (socket says 172.21.15.46:34282) 2023-10-19T12:48:16.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.695+0000 7f69e9d9a700 1 -- 172.21.15.46:0/3834051454 learned_addr learned my addr 172.21.15.46:0/3834051454 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:48:16.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.695+0000 7f6a000e0b80 1 -- 172.21.15.46:0/3834051454 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x561be22dd770 con 0x561be22cf440 2023-10-19T12:48:16.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.695+0000 7f6a000e0b80 1 -- 172.21.15.46:0/3834051454 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x561be22dd8e0 con 0x561be22ceae0 2023-10-19T12:48:16.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.695+0000 7f6a000e0b80 1 -- 172.21.15.46:0/3834051454 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x561be22ddaa0 con 0x561be22cdde0 2023-10-19T12:48:16.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.696+0000 7f6a000e0b80 10 client.0 _ll_register_callbacks cb 0x561be20fea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:48:16.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.696+0000 7f69ea59b700 1 -- 172.21.15.46:0/3834051454 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561be22ceae0 msgr2=0x561be22dc310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:48:16.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.696+0000 7f69ea59b700 1 --2- 172.21.15.46:0/3834051454 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561be22ceae0 0x561be22dc310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:48:16.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.696+0000 7f69ea59b700 1 -- 172.21.15.46:0/3834051454 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561be22cf440 msgr2=0x561be22dd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:48:16.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.696+0000 7f69ea59b700 1 --2- 172.21.15.46:0/3834051454 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561be22cf440 0x561be22dd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:48:16.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.696+0000 7f69ea59b700 1 -- 172.21.15.46:0/3834051454 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69e41a5300 con 0x561be22cdde0 2023-10-19T12:48:16.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.696+0000 7f69e9d9a700 1 --2- 172.21.15.46:0/3834051454 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561be22ceae0 0x561be22dc310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:48:16.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.696+0000 7f69ea59b700 1 --2- 172.21.15.46:0/3834051454 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561be22cdde0 0x561be22dbdd0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x561be22e54c0 tx=0x7f69dc019d20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f2469efaabc7ee8f server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:48:16.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.697+0000 7f69cdffb700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-10-19T12:48:16.703 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 255.0 s, 688.2 tps, lat 137.311 ms stddev 160.978 2023-10-19T12:48:16.704 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.697+0000 7f69cdffb700 1 -- 172.21.15.46:0/3834051454 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69dc007dc0 con 0x561be22cdde0 2023-10-19T12:48:16.705 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.697+0000 7f69cdffb700 1 -- 172.21.15.46:0/3834051454 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f69dc0190e0 con 0x561be22cdde0 2023-10-19T12:48:16.705 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.697+0000 7f6a000e0b80 1 -- 172.21.15.46:0/3834051454 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f69e000be00 con 0x561be22cdde0 2023-10-19T12:48:16.705 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.698+0000 7f69cdffb700 1 -- 172.21.15.46:0/3834051454 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f69dc0192a0 con 0x561be22cdde0 2023-10-19T12:48:16.705 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.698+0000 7f6a000e0b80 10 client.25969 fetch_fsmap learned FSMap version 41 2023-10-19T12:48:16.705 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.698+0000 7f6a000e0b80 1 -- 172.21.15.46:0/3834051454 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x561be2069250 con 0x561be22cdde0 2023-10-19T12:48:16.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.698+0000 7f69cdffb700 1 -- 172.21.15.46:0/3834051454 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f69e000be00 con 0x561be22cdde0 2023-10-19T12:48:16.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.699+0000 7f69cdffb700 1 -- 172.21.15.46:0/3834051454 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 41) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f69dc022bc0 con 0x561be22cdde0 2023-10-19T12:48:16.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.699+0000 7f6a000e0b80 10 client.25969 fetch_fsmap finished waiting for FSMap version 41 2023-10-19T12:48:16.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.699+0000 7f6a000e0b80 10 client.25969 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-19T12:48:16.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.699+0000 7f6a000e0b80 20 client.25969 populate_metadata read hostname 'smithi046' 2023-10-19T12:48:16.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.699+0000 7f6a000e0b80 1 --2- 172.21.15.46:0/3834051454 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x561be2339070 0x561be233b490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:48:16.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.699+0000 7f6a000e0b80 4 client.25969 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-19T12:48:16.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.699+0000 7f6a000e0b80 1 -- 172.21.15.46:0/3834051454 --> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x561be2210e50 con 0x561be2339070 2023-10-19T12:48:16.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.699+0000 7f69e9d9a700 1 --2- 172.21.15.46:0/3834051454 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x561be2339070 0x561be233b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:48:16.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.700+0000 7f69e9d9a700 1 --2- 172.21.15.46:0/3834051454 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x561be2339070 0x561be233b490 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3dce01a0c8629e3c server_cookie=1c4daf1f6f121c4a in_seq=0 out_seq=0 2023-10-19T12:48:16.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.700+0000 7f69cdffb700 10 client.25969 ms_handle_connect on v2:172.21.15.157:6838/552718978 2023-10-19T12:48:16.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.700+0000 7f69cdffb700 1 -- 172.21.15.46:0/3834051454 <== mds.0 v2:172.21.15.157:6838/552718978 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x561be2210e50 con 0x561be2339070 2023-10-19T12:48:16.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.700+0000 7f69cdffb700 10 client.25969 handle_command_reply: tid=0 2023-10-19T12:48:16.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.701+0000 7f6a000e0b80 1 client.25969 shutdown 2023-10-19T12:48:16.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.702+0000 7f6a000e0b80 1 -- 172.21.15.46:0/3834051454 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561be22cdde0 msgr2=0x561be22dbdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:48:16.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.702+0000 7f6a000e0b80 1 --2- 172.21.15.46:0/3834051454 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561be22cdde0 0x561be22dbdd0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x561be22e54c0 tx=0x7f69dc019d20 comp rx=0 tx=0).stop 2023-10-19T12:48:16.710 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.703+0000 7f6a000e0b80 1 -- 172.21.15.46:0/3834051454 shutdown_connections 2023-10-19T12:48:16.710 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.703+0000 7f6a000e0b80 1 --2- 172.21.15.46:0/3834051454 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x561be2339070 0x561be233b490 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:48:16.710 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.703+0000 7f6a000e0b80 1 --2- 172.21.15.46:0/3834051454 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561be22cf440 0x561be22dd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:48:16.710 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.703+0000 7f6a000e0b80 1 --2- 172.21.15.46:0/3834051454 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561be22cdde0 0x561be22dbdd0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:48:16.710 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.703+0000 7f6a000e0b80 1 --2- 172.21.15.46:0/3834051454 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561be22ceae0 0x561be22dc310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:48:16.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.703+0000 7f6a000e0b80 1 -- 172.21.15.46:0/3834051454 >> 172.21.15.46:0/3834051454 conn(0x561be2239720 msgr2=0x561be22c4080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:48:16.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.703+0000 7f69cdffb700 0 client.25969 ms_handle_reset on v2:172.21.15.157:6838/552718978 2023-10-19T12:48:16.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.704+0000 7f6a000e0b80 1 -- 172.21.15.46:0/3834051454 shutdown_connections 2023-10-19T12:48:16.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.704+0000 7f6a000e0b80 1 -- 172.21.15.46:0/3834051454 wait complete. 2023-10-19T12:48:16.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.705+0000 7f6a000e0b80 20 client.25969 trim_cache size 0 max 16384 2023-10-19T12:48:16.712 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-10-19T12:48:16.712 INFO:teuthology.orchestra.run.smithi046.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-19T12:48:16.712 INFO:teuthology.orchestra.run.smithi046.stdout: "scrubs": { 2023-10-19T12:48:16.712 INFO:teuthology.orchestra.run.smithi046.stdout: "21e73f70-af16-4ae7-bc34-e6c54ba8e1ec": { 2023-10-19T12:48:16.712 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2023-10-19T12:48:16.713 INFO:teuthology.orchestra.run.smithi046.stdout: "tag": "21e73f70-af16-4ae7-bc34-e6c54ba8e1ec", 2023-10-19T12:48:16.713 INFO:teuthology.orchestra.run.smithi046.stdout: "options": "recursive,force" 2023-10-19T12:48:16.713 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:48:16.713 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:48:16.713 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-10-19T12:48:16.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.707+0000 7f69ec7ff700 1 -- 172.21.15.46:0/3475332527 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f69d00a1550 msgr2=0x7f69d00a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:48:16.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.707+0000 7f69ec7ff700 1 --2- 172.21.15.46:0/3475332527 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f69d00a1550 0x7f69d00a3a10 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f69e000a010 tx=0x7f69e0009310 comp rx=0 tx=0).stop 2023-10-19T12:48:16.715 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.707+0000 7f69ec7ff700 1 -- 172.21.15.46:0/3475332527 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f69e410db60 msgr2=0x7f69e41a4300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:48:16.715 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.707+0000 7f69ec7ff700 1 --2- 172.21.15.46:0/3475332527 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f69e410db60 0x7f69e41a4300 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f69d4009de0 tx=0x7f69d400f3b0 comp rx=0 tx=0).stop 2023-10-19T12:48:16.715 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.708+0000 7f69ec7ff700 1 -- 172.21.15.46:0/3475332527 shutdown_connections 2023-10-19T12:48:16.715 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.708+0000 7f69ec7ff700 1 --2- 172.21.15.46:0/3475332527 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f69e410db60 0x7f69e41a4300 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:48:16.715 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.708+0000 7f69ec7ff700 1 --2- 172.21.15.46:0/3475332527 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f69e4108900 0x7f69e419cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:48:16.715 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.708+0000 7f69ec7ff700 1 --2- 172.21.15.46:0/3475332527 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f69d00a1550 0x7f69d00a3a10 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:48:16.716 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.708+0000 7f69ec7ff700 1 --2- 172.21.15.46:0/3475332527 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f69e410b230 0x7f69e419d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:48:16.716 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.708+0000 7f69ec7ff700 1 -- 172.21.15.46:0/3475332527 >> 172.21.15.46:0/3475332527 conn(0x7f69e406d7d0 msgr2=0x7f69e4108ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:48:16.716 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.709+0000 7f69ec7ff700 1 -- 172.21.15.46:0/3475332527 shutdown_connections 2023-10-19T12:48:16.716 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:16.709+0000 7f69ec7ff700 1 -- 172.21.15.46:0/3475332527 wait complete. 2023-10-19T12:48:16.751 INFO:tasks.cephfs.filesystem:scrub status for tag:21e73f70-af16-4ae7-bc34-e6c54ba8e1ec - {'path': '/', 'tag': '21e73f70-af16-4ae7-bc34-e6c54ba8e1ec', 'options': 'recursive,force'} 2023-10-19T12:48:18.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:48:17 smithi046 ceph-mon[98509]: pgmap v497: 129 pgs: 129 active+clean; 1.5 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.5 MiB/s wr, 577 op/s 2023-10-19T12:48:18.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:48:17 smithi157 ceph-mon[134109]: pgmap v497: 129 pgs: 129 active+clean; 1.5 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.5 MiB/s wr, 577 op/s 2023-10-19T12:48:18.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:48:17 smithi195 ceph-mon[134493]: pgmap v497: 129 pgs: 129 active+clean; 1.5 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.5 MiB/s wr, 577 op/s 2023-10-19T12:48:19.842 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:48:19 smithi157 ceph-mon[134109]: pgmap v498: 129 pgs: 129 active+clean; 1.5 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 6.7 MiB/s wr, 549 op/s 2023-10-19T12:48:19.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:48:19 smithi195 ceph-mon[134493]: pgmap v498: 129 pgs: 129 active+clean; 1.5 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 6.7 MiB/s wr, 549 op/s 2023-10-19T12:48:19.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:48:19 smithi046 ceph-mon[98509]: pgmap v498: 129 pgs: 129 active+clean; 1.5 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 6.7 MiB/s wr, 549 op/s 2023-10-19T12:48:20.837 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:48:20 smithi157 ceph-mon[134109]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-19T12:48:20.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:48:20 smithi195 ceph-mon[134493]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-19T12:48:20.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:48:20 smithi046 ceph-mon[98509]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-19T12:48:21.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 260.0 s, 555.2 tps, lat 191.485 ms stddev 217.697 2023-10-19T12:48:21.837 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:48:21 smithi157 ceph-mon[134109]: pgmap v499: 129 pgs: 129 active+clean; 1.5 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.4 MiB/s wr, 511 op/s 2023-10-19T12:48:21.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:48:21 smithi195 ceph-mon[134493]: pgmap v499: 129 pgs: 129 active+clean; 1.5 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.4 MiB/s wr, 511 op/s 2023-10-19T12:48:21.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:48:21 smithi046 ceph-mon[98509]: pgmap v499: 129 pgs: 129 active+clean; 1.5 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.4 MiB/s wr, 511 op/s 2023-10-19T12:48:24.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:48:23 smithi195 ceph-mon[134493]: pgmap v500: 129 pgs: 129 active+clean; 1.5 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 6.4 MiB/s wr, 580 op/s 2023-10-19T12:48:24.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:48:23 smithi046 ceph-mon[98509]: pgmap v500: 129 pgs: 129 active+clean; 1.5 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 6.4 MiB/s wr, 580 op/s 2023-10-19T12:48:24.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:48:23 smithi157 ceph-mon[134109]: pgmap v500: 129 pgs: 129 active+clean; 1.5 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 6.4 MiB/s wr, 580 op/s 2023-10-19T12:48:26.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:48:25 smithi046 ceph-mon[98509]: pgmap v501: 129 pgs: 129 active+clean; 1.5 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 5.8 MiB/s wr, 504 op/s 2023-10-19T12:48:26.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:48:25 smithi046 ceph-mon[98509]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-19T12:48:26.339 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:48:25 smithi157 ceph-mon[134109]: pgmap v501: 129 pgs: 129 active+clean; 1.5 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 5.8 MiB/s wr, 504 op/s 2023-10-19T12:48:26.339 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:48:25 smithi157 ceph-mon[134109]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-19T12:48:26.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:48:25 smithi195 ceph-mon[134493]: pgmap v501: 129 pgs: 129 active+clean; 1.5 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 5.8 MiB/s wr, 504 op/s 2023-10-19T12:48:26.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:48:25 smithi195 ceph-mon[134493]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-19T12:48:26.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 265.0 s, 688.8 tps, lat 143.998 ms stddev 153.775 2023-10-19T12:48:28.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:48:27 smithi046 ceph-mon[98509]: pgmap v502: 129 pgs: 129 active+clean; 1.5 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.9 MiB/s wr, 547 op/s 2023-10-19T12:48:28.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:48:27 smithi157 ceph-mon[134109]: pgmap v502: 129 pgs: 129 active+clean; 1.5 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.9 MiB/s wr, 547 op/s 2023-10-19T12:48:28.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:48:27 smithi195 ceph-mon[134493]: pgmap v502: 129 pgs: 129 active+clean; 1.5 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.9 MiB/s wr, 547 op/s 2023-10-19T12:48:29.837 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:48:29 smithi157 ceph-mon[134109]: pgmap v503: 129 pgs: 129 active+clean; 1.5 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 5.4 MiB/s wr, 510 op/s 2023-10-19T12:48:29.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:48:29 smithi195 ceph-mon[134493]: pgmap v503: 129 pgs: 129 active+clean; 1.5 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 5.4 MiB/s wr, 510 op/s 2023-10-19T12:48:29.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:48:29 smithi046 ceph-mon[98509]: pgmap v503: 129 pgs: 129 active+clean; 1.5 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 5.4 MiB/s wr, 510 op/s 2023-10-19T12:48:31.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 270.0 s, 673.8 tps, lat 147.397 ms stddev 164.352 2023-10-19T12:48:32.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:48:31 smithi195 ceph-mon[134493]: pgmap v504: 129 pgs: 129 active+clean; 1.5 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.2 MiB/s wr, 513 op/s 2023-10-19T12:48:32.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:48:31 smithi046 ceph-mon[98509]: pgmap v504: 129 pgs: 129 active+clean; 1.5 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.2 MiB/s wr, 513 op/s 2023-10-19T12:48:32.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:48:31 smithi157 ceph-mon[134109]: pgmap v504: 129 pgs: 129 active+clean; 1.5 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.2 MiB/s wr, 513 op/s 2023-10-19T12:48:34.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:48:33 smithi046 ceph-mon[98509]: pgmap v505: 129 pgs: 129 active+clean; 1.5 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 6.8 MiB/s wr, 630 op/s 2023-10-19T12:48:34.341 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:48:33 smithi157 ceph-mon[134109]: pgmap v505: 129 pgs: 129 active+clean; 1.5 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 6.8 MiB/s wr, 630 op/s 2023-10-19T12:48:34.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:48:33 smithi195 ceph-mon[134493]: pgmap v505: 129 pgs: 129 active+clean; 1.5 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 6.8 MiB/s wr, 630 op/s 2023-10-19T12:48:36.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:48:35 smithi046 ceph-mon[98509]: pgmap v506: 129 pgs: 129 active+clean; 1.5 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 6.2 MiB/s wr, 569 op/s 2023-10-19T12:48:36.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:48:35 smithi157 ceph-mon[134109]: pgmap v506: 129 pgs: 129 active+clean; 1.5 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 6.2 MiB/s wr, 569 op/s 2023-10-19T12:48:36.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:48:35 smithi195 ceph-mon[134493]: pgmap v506: 129 pgs: 129 active+clean; 1.5 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 6.2 MiB/s wr, 569 op/s 2023-10-19T12:48:36.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 275.0 s, 615.8 tps, lat 162.439 ms stddev 205.245 2023-10-19T12:48:38.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:48:37 smithi046 ceph-mon[98509]: pgmap v507: 129 pgs: 129 active+clean; 1.5 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.5 MiB/s wr, 609 op/s 2023-10-19T12:48:38.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:48:37 smithi157 ceph-mon[134109]: pgmap v507: 129 pgs: 129 active+clean; 1.5 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.5 MiB/s wr, 609 op/s 2023-10-19T12:48:38.388 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:48:37 smithi195 ceph-mon[134493]: pgmap v507: 129 pgs: 129 active+clean; 1.5 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.5 MiB/s wr, 609 op/s 2023-10-19T12:48:39.837 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:48:39 smithi157 ceph-mon[134109]: pgmap v508: 129 pgs: 129 active+clean; 1.5 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 5.9 MiB/s wr, 554 op/s 2023-10-19T12:48:39.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:48:39 smithi195 ceph-mon[134493]: pgmap v508: 129 pgs: 129 active+clean; 1.5 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 5.9 MiB/s wr, 554 op/s 2023-10-19T12:48:39.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:48:39 smithi046 ceph-mon[98509]: pgmap v508: 129 pgs: 129 active+clean; 1.5 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 5.9 MiB/s wr, 554 op/s 2023-10-19T12:48:41.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 280.0 s, 614.8 tps, lat 163.643 ms stddev 188.315 2023-10-19T12:48:42.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:48:41 smithi195 ceph-mon[134493]: pgmap v509: 129 pgs: 129 active+clean; 1.5 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.5 MiB/s wr, 568 op/s 2023-10-19T12:48:42.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:48:41 smithi046 ceph-mon[98509]: pgmap v509: 129 pgs: 129 active+clean; 1.5 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.5 MiB/s wr, 568 op/s 2023-10-19T12:48:42.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:48:41 smithi157 ceph-mon[134109]: pgmap v509: 129 pgs: 129 active+clean; 1.5 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.5 MiB/s wr, 568 op/s 2023-10-19T12:48:44.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:48:43 smithi046 ceph-mon[98509]: pgmap v510: 129 pgs: 129 active+clean; 1.5 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 6.6 MiB/s wr, 598 op/s 2023-10-19T12:48:44.342 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:48:43 smithi157 ceph-mon[134109]: pgmap v510: 129 pgs: 129 active+clean; 1.5 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 6.6 MiB/s wr, 598 op/s 2023-10-19T12:48:44.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:48:43 smithi195 ceph-mon[134493]: pgmap v510: 129 pgs: 129 active+clean; 1.5 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 6.6 MiB/s wr, 598 op/s 2023-10-19T12:48:46.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:48:45 smithi046 ceph-mon[98509]: pgmap v511: 129 pgs: 129 active+clean; 1.5 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.4 MiB/s wr, 501 op/s 2023-10-19T12:48:46.339 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:48:45 smithi157 ceph-mon[134109]: pgmap v511: 129 pgs: 129 active+clean; 1.5 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.4 MiB/s wr, 501 op/s 2023-10-19T12:48:46.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:48:45 smithi195 ceph-mon[134493]: pgmap v511: 129 pgs: 129 active+clean; 1.5 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.4 MiB/s wr, 501 op/s 2023-10-19T12:48:46.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 285.0 s, 492.2 tps, lat 201.181 ms stddev 236.774 2023-10-19T12:48:46.751 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-19T12:48:47.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.120+0000 7f2a719ff700 1 -- 172.21.15.46:0/3502378772 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2a6c1007a0 msgr2=0x7f2a6c100bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:48:47.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.120+0000 7f2a719ff700 1 --2- 172.21.15.46:0/3502378772 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2a6c1007a0 0x7f2a6c100bc0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2a540099c0 tx=0x7f2a54009cd0 comp rx=0 tx=0).stop 2023-10-19T12:48:47.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.120+0000 7f2a719ff700 1 -- 172.21.15.46:0/3502378772 shutdown_connections 2023-10-19T12:48:47.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.120+0000 7f2a719ff700 1 --2- 172.21.15.46:0/3502378772 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2a6c102330 0x7f2a6c108be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:48:47.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.120+0000 7f2a719ff700 1 --2- 172.21.15.46:0/3502378772 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2a6c1007a0 0x7f2a6c100bc0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:48:47.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.120+0000 7f2a719ff700 1 --2- 172.21.15.46:0/3502378772 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a6c101990 0x7f2a6c101df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:48:47.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.120+0000 7f2a719ff700 1 -- 172.21.15.46:0/3502378772 >> 172.21.15.46:0/3502378772 conn(0x7f2a6c0fbcf0 msgr2=0x7f2a6c0fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:48:47.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.121+0000 7f2a719ff700 1 -- 172.21.15.46:0/3502378772 shutdown_connections 2023-10-19T12:48:47.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.121+0000 7f2a719ff700 1 -- 172.21.15.46:0/3502378772 wait complete. 2023-10-19T12:48:47.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.123+0000 7f2a719ff700 1 Processor -- start 2023-10-19T12:48:47.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.123+0000 7f2a719ff700 1 -- start start 2023-10-19T12:48:47.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.124+0000 7f2a719ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2a6c1007a0 0x7f2a6c19ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:48:47.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.124+0000 7f2a719ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a6c101990 0x7f2a6c19d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:48:47.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.124+0000 7f2a719ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2a6c102330 0x7f2a6c1a43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:48:47.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.124+0000 7f2a719ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a6c1a49a0 con 0x7f2a6c101990 2023-10-19T12:48:47.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.124+0000 7f2a719ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a6c1a4ae0 con 0x7f2a6c1007a0 2023-10-19T12:48:47.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.124+0000 7f2a719ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a6c1a4c70 con 0x7f2a6c102330 2023-10-19T12:48:47.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.124+0000 7f2a6b7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2a6c102330 0x7f2a6c1a43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:48:47.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.124+0000 7f2a6b7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2a6c102330 0x7f2a6c1a43d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:50216/0 (socket says 172.21.15.46:50216) 2023-10-19T12:48:47.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.124+0000 7f2a6b7fe700 1 -- 172.21.15.46:0/904653780 learned_addr learned my addr 172.21.15.46:0/904653780 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:48:47.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.124+0000 7f2a63fff700 1 --2- 172.21.15.46:0/904653780 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a6c101990 0x7f2a6c19d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:48:47.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.124+0000 7f2a6b7fe700 1 -- 172.21.15.46:0/904653780 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2a6c1007a0 msgr2=0x7f2a6c19ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:48:47.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.124+0000 7f2a6b7fe700 1 --2- 172.21.15.46:0/904653780 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2a6c1007a0 0x7f2a6c19ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:48:47.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.124+0000 7f2a6b7fe700 1 -- 172.21.15.46:0/904653780 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a6c101990 msgr2=0x7f2a6c19d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:48:47.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.124+0000 7f2a6b7fe700 1 --2- 172.21.15.46:0/904653780 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a6c101990 0x7f2a6c19d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:48:47.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.125+0000 7f2a6b7fe700 1 -- 172.21.15.46:0/904653780 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a540095f0 con 0x7f2a6c102330 2023-10-19T12:48:47.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.125+0000 7f2a63fff700 1 --2- 172.21.15.46:0/904653780 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a6c101990 0x7f2a6c19d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T12:48:47.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.125+0000 7f2a6b7fe700 1 --2- 172.21.15.46:0/904653780 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2a6c102330 0x7f2a6c1a43d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2a6400b780 tx=0x7f2a6400bb40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:48:47.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.125+0000 7f2a709fd700 1 -- 172.21.15.46:0/904653780 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a6400f840 con 0x7f2a6c102330 2023-10-19T12:48:47.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.125+0000 7f2a709fd700 1 -- 172.21.15.46:0/904653780 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2a6400fe60 con 0x7f2a6c102330 2023-10-19T12:48:47.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.125+0000 7f2a709fd700 1 -- 172.21.15.46:0/904653780 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a6400d3d0 con 0x7f2a6c102330 2023-10-19T12:48:47.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.125+0000 7f2a719ff700 1 -- 172.21.15.46:0/904653780 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a6c1a4f50 con 0x7f2a6c102330 2023-10-19T12:48:47.132 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.126+0000 7f2a719ff700 1 -- 172.21.15.46:0/904653780 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a6c1a52c0 con 0x7f2a6c102330 2023-10-19T12:48:47.135 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.132+0000 7f2a85363b80 1 Processor -- start 2023-10-19T12:48:47.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.134+0000 7f2a709fd700 1 -- 172.21.15.46:0/904653780 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f2a6400f9a0 con 0x7f2a6c102330 2023-10-19T12:48:47.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.134+0000 7f2a85363b80 1 -- start start 2023-10-19T12:48:47.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.137+0000 7f2a709fd700 1 --2- 172.21.15.46:0/904653780 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f2a580a1680 0x7f2a580a3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:48:47.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.137+0000 7f2a709fd700 1 -- 172.21.15.46:0/904653780 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f2a640cce90 con 0x7f2a6c102330 2023-10-19T12:48:47.142 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.137+0000 7f2a85363b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5591d55842d0 0x5591d55846f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:48:47.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.138+0000 7f2a85363b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5591d5584c30 0x5591d5583090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:48:47.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.138+0000 7f2a85363b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5591d55835d0 0x5591d5583a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:48:47.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.138+0000 7f2a85363b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591d54f66e0 con 0x5591d5584c30 2023-10-19T12:48:47.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.138+0000 7f2a85363b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591d54dcc60 con 0x5591d55835d0 2023-10-19T12:48:47.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.138+0000 7f2a85363b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591d54da580 con 0x5591d55842d0 2023-10-19T12:48:47.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.138+0000 7f2a6affd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5591d55842d0 0x5591d55846f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:48:47.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.138+0000 7f2a6affd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5591d55842d0 0x5591d55846f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:50228/0 (socket says 172.21.15.46:50228) 2023-10-19T12:48:47.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.138+0000 7f2a6affd700 1 -- 172.21.15.46:0/1913665529 learned_addr learned my addr 172.21.15.46:0/1913665529 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:48:47.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.138+0000 7f2a63fff700 1 --2- 172.21.15.46:0/904653780 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f2a580a1680 0x7f2a580a3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:48:47.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.139+0000 7f2a6affd700 1 -- 172.21.15.46:0/1913665529 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5591d55835d0 msgr2=0x5591d5583a50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-19T12:48:47.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.139+0000 7f2a6affd700 1 --2- 172.21.15.46:0/1913665529 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5591d55835d0 0x5591d5583a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:48:47.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.139+0000 7f2a6affd700 1 -- 172.21.15.46:0/1913665529 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5591d5584c30 msgr2=0x5591d5583090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:48:47.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.139+0000 7f2a6affd700 1 --2- 172.21.15.46:0/1913665529 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5591d5584c30 0x5591d5583090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:48:47.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.139+0000 7f2a6affd700 1 -- 172.21.15.46:0/1913665529 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5591d54933f0 con 0x5591d55842d0 2023-10-19T12:48:47.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.139+0000 7f2a6affd700 1 --2- 172.21.15.46:0/1913665529 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5591d55842d0 0x5591d55846f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2a54003720 tx=0x7f2a540037f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c72ef9861d470f89 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:48:47.146 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.139+0000 7f2a63fff700 1 --2- 172.21.15.46:0/904653780 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f2a580a1680 0x7f2a580a3b40 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c006fd0 tx=0x7f2a5c006f20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:48:47.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.140+0000 7f2a61ffb700 1 -- 172.21.15.46:0/1913665529 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a5401d070 con 0x5591d55842d0 2023-10-19T12:48:47.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.140+0000 7f2a61ffb700 1 -- 172.21.15.46:0/1913665529 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2a5400b790 con 0x5591d55842d0 2023-10-19T12:48:47.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.140+0000 7f2a61ffb700 1 -- 172.21.15.46:0/1913665529 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a54003b30 con 0x5591d55842d0 2023-10-19T12:48:47.147 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.141+0000 7f2a85363b80 1 -- 172.21.15.46:0/1913665529 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5591d55842d0 msgr2=0x5591d55846f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:48:47.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.141+0000 7f2a85363b80 1 --2- 172.21.15.46:0/1913665529 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5591d55842d0 0x5591d55846f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2a54003720 tx=0x7f2a540037f0 comp rx=0 tx=0).stop 2023-10-19T12:48:47.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.141+0000 7f2a85363b80 1 -- 172.21.15.46:0/1913665529 shutdown_connections 2023-10-19T12:48:47.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.141+0000 7f2a85363b80 1 --2- 172.21.15.46:0/1913665529 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5591d55835d0 0x5591d5583a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:48:47.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.141+0000 7f2a85363b80 1 --2- 172.21.15.46:0/1913665529 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5591d55842d0 0x5591d55846f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:48:47.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.141+0000 7f2a85363b80 1 --2- 172.21.15.46:0/1913665529 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5591d5584c30 0x5591d5583090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:48:47.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.141+0000 7f2a85363b80 1 -- 172.21.15.46:0/1913665529 >> 172.21.15.46:0/1913665529 conn(0x5591d54f7720 msgr2=0x5591d557db50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:48:47.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.141+0000 7f2a85363b80 1 -- 172.21.15.46:0/1913665529 shutdown_connections 2023-10-19T12:48:47.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.141+0000 7f2a85363b80 1 -- 172.21.15.46:0/1913665529 wait complete. 2023-10-19T12:48:47.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.142+0000 7f2a85363b80 1 -- start start 2023-10-19T12:48:47.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.142+0000 7f2a85363b80 1 Processor -- start 2023-10-19T12:48:47.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.144+0000 7f2a85363b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5591d55835d0 0x5591d558cb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:48:47.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.144+0000 7f2a85363b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5591d55842d0 0x5591d558d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:48:47.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.144+0000 7f2a85363b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5591d5584c30 0x5591d55940a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:48:47.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.144+0000 7f2a85363b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591d54d5e70 con 0x5591d5584c30 2023-10-19T12:48:47.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.144+0000 7f2a85363b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591d5472710 con 0x5591d55842d0 2023-10-19T12:48:47.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.144+0000 7f2a85363b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591d54723b0 con 0x5591d55835d0 2023-10-19T12:48:47.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.144+0000 7f2a85363b80 10 client.0 _ll_register_callbacks cb 0x5591d53bca80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:48:47.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.144+0000 7f2a63fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5591d55842d0 0x5591d558d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:48:47.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.144+0000 7f2a63fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5591d55842d0 0x5591d558d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:49902/0 (socket says 172.21.15.46:49902) 2023-10-19T12:48:47.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.144+0000 7f2a63fff700 1 -- 172.21.15.46:0/219823002 learned_addr learned my addr 172.21.15.46:0/219823002 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:48:47.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.144+0000 7f2a6affd700 1 --2- 172.21.15.46:0/219823002 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5591d55835d0 0x5591d558cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:48:47.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.145+0000 7f2a63fff700 1 -- 172.21.15.46:0/219823002 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5591d55835d0 msgr2=0x5591d558cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:48:47.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.145+0000 7f2a63fff700 1 --2- 172.21.15.46:0/219823002 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5591d55835d0 0x5591d558cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:48:47.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.145+0000 7f2a63fff700 1 -- 172.21.15.46:0/219823002 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5591d5584c30 msgr2=0x5591d55940a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:48:47.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.145+0000 7f2a63fff700 1 --2- 172.21.15.46:0/219823002 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5591d5584c30 0x5591d55940a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:48:47.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.145+0000 7f2a63fff700 1 -- 172.21.15.46:0/219823002 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a6c109530 con 0x5591d55842d0 2023-10-19T12:48:47.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.145+0000 7f2a6affd700 1 --2- 172.21.15.46:0/219823002 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5591d55835d0 0x5591d558cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:48:47.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.146+0000 7f2a63fff700 1 --2- 172.21.15.46:0/219823002 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5591d55842d0 0x5591d558d060 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c004790 tx=0x7f2a5c006c90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba3a9741d0594b4b server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:48:47.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.146+0000 7f2a4affd700 10 client.0 ms_handle_connect on v2:172.21.15.157:3300/0 2023-10-19T12:48:47.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.146+0000 7f2a4affd700 1 -- 172.21.15.46:0/219823002 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a5c013d50 con 0x5591d55842d0 2023-10-19T12:48:47.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.146+0000 7f2a4affd700 1 -- 172.21.15.46:0/219823002 <== mon.2 v2:172.21.15.157:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f2a5c01e440 con 0x5591d55842d0 2023-10-19T12:48:47.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.146+0000 7f2a85363b80 1 -- 172.21.15.46:0/219823002 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5591d54daef0 con 0x5591d55842d0 2023-10-19T12:48:47.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.147+0000 7f2a4affd700 1 -- 172.21.15.46:0/219823002 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2a5c01e600 con 0x5591d55842d0 2023-10-19T12:48:47.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.147+0000 7f2a85363b80 10 client.25967 fetch_fsmap learned FSMap version 43 2023-10-19T12:48:47.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.147+0000 7f2a85363b80 1 -- 172.21.15.46:0/219823002 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x5591d5300de0 con 0x5591d55842d0 2023-10-19T12:48:47.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.147+0000 7f2a4affd700 1 -- 172.21.15.46:0/219823002 <== mon.2 v2:172.21.15.157:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5591d54daef0 con 0x5591d55842d0 2023-10-19T12:48:47.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.147+0000 7f2a4affd700 1 -- 172.21.15.46:0/219823002 <== mon.2 v2:172.21.15.157:3300/0 5 ==== fsmap(e 43) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f2a5c01d740 con 0x5591d55842d0 2023-10-19T12:48:47.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.147+0000 7f2a85363b80 10 client.25967 fetch_fsmap finished waiting for FSMap version 43 2023-10-19T12:48:47.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.147+0000 7f2a85363b80 10 client.25967 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-19T12:48:47.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.147+0000 7f2a85363b80 20 client.25967 populate_metadata read hostname 'smithi046' 2023-10-19T12:48:47.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.147+0000 7f2a85363b80 1 --2- 172.21.15.46:0/219823002 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x5591d55a9ae0 0x5591d55abf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:48:47.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.147+0000 7f2a85363b80 4 client.25967 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-19T12:48:47.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.147+0000 7f2a85363b80 1 -- 172.21.15.46:0/219823002 --> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5591d55528b0 con 0x5591d55a9ae0 2023-10-19T12:48:47.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.148+0000 7f2a6affd700 1 --2- 172.21.15.46:0/219823002 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x5591d55a9ae0 0x5591d55abf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:48:47.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.149+0000 7f2a6affd700 1 --2- 172.21.15.46:0/219823002 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x5591d55a9ae0 0x5591d55abf00 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=561243d2b9fdf2e1 server_cookie=f4c5d2b97c07a355 in_seq=0 out_seq=0 2023-10-19T12:48:47.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.149+0000 7f2a4affd700 10 client.25967 ms_handle_connect on v2:172.21.15.157:6838/552718978 2023-10-19T12:48:47.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.150+0000 7f2a4affd700 1 -- 172.21.15.46:0/219823002 <== mds.0 v2:172.21.15.157:6838/552718978 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5591d55528b0 con 0x5591d55a9ae0 2023-10-19T12:48:47.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.150+0000 7f2a4affd700 10 client.25967 handle_command_reply: tid=0 2023-10-19T12:48:47.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.150+0000 7f2a85363b80 1 client.25967 shutdown 2023-10-19T12:48:47.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.151+0000 7f2a85363b80 1 -- 172.21.15.46:0/219823002 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5591d55842d0 msgr2=0x5591d558d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:48:47.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.151+0000 7f2a85363b80 1 --2- 172.21.15.46:0/219823002 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5591d55842d0 0x5591d558d060 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c004790 tx=0x7f2a5c006c90 comp rx=0 tx=0).stop 2023-10-19T12:48:47.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.151+0000 7f2a85363b80 1 -- 172.21.15.46:0/219823002 shutdown_connections 2023-10-19T12:48:47.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.151+0000 7f2a85363b80 1 --2- 172.21.15.46:0/219823002 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x5591d55a9ae0 0x5591d55abf00 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:48:47.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.152+0000 7f2a85363b80 1 --2- 172.21.15.46:0/219823002 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5591d5584c30 0x5591d55940a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:48:47.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.152+0000 7f2a85363b80 1 --2- 172.21.15.46:0/219823002 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5591d55835d0 0x5591d558cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:48:47.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.152+0000 7f2a4affd700 0 client.25967 ms_handle_reset on v2:172.21.15.157:6838/552718978 2023-10-19T12:48:47.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.152+0000 7f2a85363b80 1 --2- 172.21.15.46:0/219823002 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5591d55842d0 0x5591d558d060 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:48:47.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.152+0000 7f2a85363b80 1 -- 172.21.15.46:0/219823002 >> 172.21.15.46:0/219823002 conn(0x5591d54f7720 msgr2=0x5591d5582080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:48:47.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.156+0000 7f2a85363b80 1 -- 172.21.15.46:0/219823002 shutdown_connections 2023-10-19T12:48:47.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.158+0000 7f2a85363b80 1 -- 172.21.15.46:0/219823002 wait complete. 2023-10-19T12:48:47.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.159+0000 7f2a85363b80 20 client.25967 trim_cache size 0 max 16384 2023-10-19T12:48:47.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.193+0000 7f2a85363b80 1 Processor -- start 2023-10-19T12:48:47.196 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.193+0000 7f2a85363b80 1 -- start start 2023-10-19T12:48:47.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.193+0000 7f2a85363b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5591d55835d0 0x5591d558ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:48:47.197 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.193+0000 7f2a85363b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5591d55842d0 0x5591d5593fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:48:47.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.194+0000 7f2a85363b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5591d5584c30 0x5591d558c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:48:47.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.194+0000 7f2a85363b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591d5356920 con 0x5591d55835d0 2023-10-19T12:48:47.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.194+0000 7f2a85363b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591d558da50 con 0x5591d55842d0 2023-10-19T12:48:47.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.194+0000 7f2a85363b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591d557fb80 con 0x5591d5584c30 2023-10-19T12:48:47.198 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.194+0000 7f2a63fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5591d55842d0 0x5591d5593fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:48:47.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.194+0000 7f2a63fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5591d55842d0 0x5591d5593fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:49906/0 (socket says 172.21.15.46:49906) 2023-10-19T12:48:47.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.194+0000 7f2a6affd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5591d55835d0 0x5591d558ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:48:47.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.194+0000 7f2a63fff700 1 -- 172.21.15.46:0/1494726384 learned_addr learned my addr 172.21.15.46:0/1494726384 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:48:47.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.194+0000 7f2a6b7fe700 1 --2- 172.21.15.46:0/1494726384 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5591d5584c30 0x5591d558c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:48:47.199 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.194+0000 7f2a6b7fe700 1 -- 172.21.15.46:0/1494726384 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5591d55842d0 msgr2=0x5591d5593fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:48:47.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.194+0000 7f2a6b7fe700 1 --2- 172.21.15.46:0/1494726384 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5591d55842d0 0x5591d5593fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:48:47.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.194+0000 7f2a6b7fe700 1 -- 172.21.15.46:0/1494726384 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5591d55835d0 msgr2=0x5591d558ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:48:47.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.194+0000 7f2a6b7fe700 1 --2- 172.21.15.46:0/1494726384 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5591d55835d0 0x5591d558ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:48:47.200 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.194+0000 7f2a6b7fe700 1 -- 172.21.15.46:0/1494726384 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5591d52e9c60 con 0x5591d5584c30 2023-10-19T12:48:47.201 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.195+0000 7f2a6b7fe700 1 --2- 172.21.15.46:0/1494726384 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5591d5584c30 0x5591d558c030 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2a6400bf40 tx=0x7f2a640999d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=245f2e11b816ee2a server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:48:47.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.195+0000 7f2a627fc700 1 -- 172.21.15.46:0/1494726384 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a640b1070 con 0x5591d5584c30 2023-10-19T12:48:47.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.195+0000 7f2a627fc700 1 -- 172.21.15.46:0/1494726384 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2a640a2110 con 0x5591d5584c30 2023-10-19T12:48:47.202 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.195+0000 7f2a627fc700 1 -- 172.21.15.46:0/1494726384 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a64017620 con 0x5591d5584c30 2023-10-19T12:48:47.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.196+0000 7f2a85363b80 1 -- 172.21.15.46:0/1494726384 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5591d5584c30 msgr2=0x5591d558c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:48:47.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.196+0000 7f2a85363b80 1 --2- 172.21.15.46:0/1494726384 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5591d5584c30 0x5591d558c030 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2a6400bf40 tx=0x7f2a640999d0 comp rx=0 tx=0).stop 2023-10-19T12:48:47.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.196+0000 7f2a85363b80 1 -- 172.21.15.46:0/1494726384 shutdown_connections 2023-10-19T12:48:47.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.196+0000 7f2a85363b80 1 --2- 172.21.15.46:0/1494726384 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5591d5584c30 0x5591d558c030 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:48:47.203 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.196+0000 7f2a85363b80 1 --2- 172.21.15.46:0/1494726384 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5591d55835d0 0x5591d558ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:48:47.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.196+0000 7f2a85363b80 1 --2- 172.21.15.46:0/1494726384 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5591d55842d0 0x5591d5593fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:48:47.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.196+0000 7f2a85363b80 1 -- 172.21.15.46:0/1494726384 >> 172.21.15.46:0/1494726384 conn(0x5591d54f7720 msgr2=0x5591d557db20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:48:47.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.196+0000 7f2a85363b80 1 -- 172.21.15.46:0/1494726384 shutdown_connections 2023-10-19T12:48:47.204 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.196+0000 7f2a85363b80 1 -- 172.21.15.46:0/1494726384 wait complete. 2023-10-19T12:48:47.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.197+0000 7f2a85363b80 1 -- start start 2023-10-19T12:48:47.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.197+0000 7f2a85363b80 1 Processor -- start 2023-10-19T12:48:47.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.197+0000 7f2a85363b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5591d55835d0 0x5591d5593ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:48:47.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.197+0000 7f2a85363b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5591d55842d0 0x5591d55921c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:48:47.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.197+0000 7f2a85363b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5591d5584c30 0x5591d5592700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:48:47.205 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.197+0000 7f2a85363b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591d55942e0 con 0x5591d5584c30 2023-10-19T12:48:47.206 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.197+0000 7f2a85363b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591d5592c40 con 0x5591d55842d0 2023-10-19T12:48:47.206 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.197+0000 7f2a85363b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591d5592e00 con 0x5591d55835d0 2023-10-19T12:48:47.206 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.197+0000 7f2a85363b80 10 client.0 _ll_register_callbacks cb 0x5591d53bca80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:48:47.206 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.198+0000 7f2a63fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5591d55842d0 0x5591d55921c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:48:47.206 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.198+0000 7f2a63fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5591d55842d0 0x5591d55921c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:49912/0 (socket says 172.21.15.46:49912) 2023-10-19T12:48:47.207 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.198+0000 7f2a6affd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5591d55835d0 0x5591d5593ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:48:47.207 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.198+0000 7f2a63fff700 1 -- 172.21.15.46:0/997562665 learned_addr learned my addr 172.21.15.46:0/997562665 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:48:47.207 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.198+0000 7f2a6b7fe700 1 --2- 172.21.15.46:0/997562665 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5591d5584c30 0x5591d5592700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:48:47.210 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.198+0000 7f2a6affd700 1 -- 172.21.15.46:0/997562665 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5591d55842d0 msgr2=0x5591d55921c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:48:47.210 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.199+0000 7f2a6affd700 1 --2- 172.21.15.46:0/997562665 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5591d55842d0 0x5591d55921c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:48:47.210 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.199+0000 7f2a6affd700 1 -- 172.21.15.46:0/997562665 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5591d5584c30 msgr2=0x5591d5592700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:48:47.210 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.199+0000 7f2a6affd700 1 --2- 172.21.15.46:0/997562665 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5591d5584c30 0x5591d5592700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:48:47.210 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.199+0000 7f2a6affd700 1 -- 172.21.15.46:0/997562665 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a6c1a52c0 con 0x5591d55835d0 2023-10-19T12:48:47.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.199+0000 7f2a6affd700 1 --2- 172.21.15.46:0/997562665 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5591d55835d0 0x5591d5593ac0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2a540098e0 tx=0x7f2a54009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4079134c97e10258 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:48:47.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.199+0000 7f2a4affd700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-10-19T12:48:47.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.200+0000 7f2a4affd700 1 -- 172.21.15.46:0/997562665 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a5401d040 con 0x5591d55835d0 2023-10-19T12:48:47.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.200+0000 7f2a4affd700 1 -- 172.21.15.46:0/997562665 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f2a5400be50 con 0x5591d55835d0 2023-10-19T12:48:47.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.200+0000 7f2a85363b80 1 -- 172.21.15.46:0/997562665 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2a5400b790 con 0x5591d55835d0 2023-10-19T12:48:47.212 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.201+0000 7f2a4affd700 1 -- 172.21.15.46:0/997562665 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2a54005240 con 0x5591d55835d0 2023-10-19T12:48:47.212 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.201+0000 7f2a85363b80 10 client.25984 fetch_fsmap learned FSMap version 43 2023-10-19T12:48:47.212 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.201+0000 7f2a85363b80 1 -- 172.21.15.46:0/997562665 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x5591d5327250 con 0x5591d55835d0 2023-10-19T12:48:47.212 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.203+0000 7f2a4affd700 1 -- 172.21.15.46:0/997562665 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2a5400b790 con 0x5591d55835d0 2023-10-19T12:48:47.212 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.203+0000 7f2a4affd700 1 -- 172.21.15.46:0/997562665 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 43) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f2a54003a70 con 0x5591d55835d0 2023-10-19T12:48:47.212 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.203+0000 7f2a85363b80 10 client.25984 fetch_fsmap finished waiting for FSMap version 43 2023-10-19T12:48:47.213 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.203+0000 7f2a85363b80 10 client.25984 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-19T12:48:47.213 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.203+0000 7f2a85363b80 20 client.25984 populate_metadata read hostname 'smithi046' 2023-10-19T12:48:47.213 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.203+0000 7f2a85363b80 1 --2- 172.21.15.46:0/997562665 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x5591d55fea10 0x5591d5600e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:48:47.213 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.203+0000 7f2a85363b80 4 client.25984 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-19T12:48:47.213 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.203+0000 7f2a85363b80 1 -- 172.21.15.46:0/997562665 --> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5591d54cee50 con 0x5591d55fea10 2023-10-19T12:48:47.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.204+0000 7f2a63fff700 1 --2- 172.21.15.46:0/997562665 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x5591d55fea10 0x5591d5600e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:48:47.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.204+0000 7f2a63fff700 1 --2- 172.21.15.46:0/997562665 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x5591d55fea10 0x5591d5600e00 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d90e9eed3990e84a server_cookie=8b12b89647e0778e in_seq=0 out_seq=0 2023-10-19T12:48:47.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.204+0000 7f2a4affd700 10 client.25984 ms_handle_connect on v2:172.21.15.157:6838/552718978 2023-10-19T12:48:47.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.205+0000 7f2a4affd700 1 -- 172.21.15.46:0/997562665 <== mds.0 v2:172.21.15.157:6838/552718978 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x5591d54cee50 con 0x5591d55fea10 2023-10-19T12:48:47.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.205+0000 7f2a4affd700 10 client.25984 handle_command_reply: tid=0 2023-10-19T12:48:47.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.205+0000 7f2a85363b80 1 client.25984 shutdown 2023-10-19T12:48:47.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.205+0000 7f2a85363b80 1 -- 172.21.15.46:0/997562665 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5591d55835d0 msgr2=0x5591d5593ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:48:47.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.205+0000 7f2a85363b80 1 --2- 172.21.15.46:0/997562665 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5591d55835d0 0x5591d5593ac0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2a540098e0 tx=0x7f2a54009310 comp rx=0 tx=0).stop 2023-10-19T12:48:47.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.205+0000 7f2a85363b80 1 -- 172.21.15.46:0/997562665 shutdown_connections 2023-10-19T12:48:47.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.205+0000 7f2a85363b80 1 --2- 172.21.15.46:0/997562665 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x5591d55fea10 0x5591d5600e00 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:48:47.216 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.205+0000 7f2a85363b80 1 --2- 172.21.15.46:0/997562665 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5591d5584c30 0x5591d5592700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:48:47.216 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.205+0000 7f2a85363b80 1 --2- 172.21.15.46:0/997562665 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5591d55835d0 0x5591d5593ac0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:48:47.216 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.205+0000 7f2a85363b80 1 --2- 172.21.15.46:0/997562665 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5591d55842d0 0x5591d55921c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:48:47.216 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.205+0000 7f2a85363b80 1 -- 172.21.15.46:0/997562665 >> 172.21.15.46:0/997562665 conn(0x5591d54f7720 msgr2=0x5591d558a710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:48:47.216 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.205+0000 7f2a4affd700 0 client.25984 ms_handle_reset on v2:172.21.15.157:6838/552718978 2023-10-19T12:48:47.217 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.205+0000 7f2a85363b80 1 -- 172.21.15.46:0/997562665 shutdown_connections 2023-10-19T12:48:47.217 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.205+0000 7f2a85363b80 1 -- 172.21.15.46:0/997562665 wait complete. 2023-10-19T12:48:47.217 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.206+0000 7f2a85363b80 20 client.25984 trim_cache size 0 max 16384 2023-10-19T12:48:47.217 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-10-19T12:48:47.218 INFO:teuthology.orchestra.run.smithi046.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-19T12:48:47.218 INFO:teuthology.orchestra.run.smithi046.stdout: "scrubs": { 2023-10-19T12:48:47.218 INFO:teuthology.orchestra.run.smithi046.stdout: "21e73f70-af16-4ae7-bc34-e6c54ba8e1ec": { 2023-10-19T12:48:47.218 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2023-10-19T12:48:47.218 INFO:teuthology.orchestra.run.smithi046.stdout: "tag": "21e73f70-af16-4ae7-bc34-e6c54ba8e1ec", 2023-10-19T12:48:47.219 INFO:teuthology.orchestra.run.smithi046.stdout: "options": "recursive,force" 2023-10-19T12:48:47.219 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:48:47.219 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:48:47.219 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-10-19T12:48:47.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.206+0000 7f2a719ff700 1 -- 172.21.15.46:0/904653780 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f2a580a1680 msgr2=0x7f2a580a3b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:48:47.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.206+0000 7f2a719ff700 1 --2- 172.21.15.46:0/904653780 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f2a580a1680 0x7f2a580a3b40 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c006fd0 tx=0x7f2a5c006f20 comp rx=0 tx=0).stop 2023-10-19T12:48:47.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.206+0000 7f2a719ff700 1 -- 172.21.15.46:0/904653780 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2a6c102330 msgr2=0x7f2a6c1a43d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:48:47.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.206+0000 7f2a719ff700 1 --2- 172.21.15.46:0/904653780 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2a6c102330 0x7f2a6c1a43d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2a6400b780 tx=0x7f2a6400bb40 comp rx=0 tx=0).stop 2023-10-19T12:48:47.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.206+0000 7f2a719ff700 1 -- 172.21.15.46:0/904653780 shutdown_connections 2023-10-19T12:48:47.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.206+0000 7f2a719ff700 1 --2- 172.21.15.46:0/904653780 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f2a580a1680 0x7f2a580a3b40 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:48:47.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.206+0000 7f2a719ff700 1 --2- 172.21.15.46:0/904653780 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2a6c102330 0x7f2a6c1a43d0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:48:47.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.206+0000 7f2a719ff700 1 --2- 172.21.15.46:0/904653780 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2a6c1007a0 0x7f2a6c19ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:48:47.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.206+0000 7f2a719ff700 1 --2- 172.21.15.46:0/904653780 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a6c101990 0x7f2a6c19d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:48:47.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.206+0000 7f2a719ff700 1 -- 172.21.15.46:0/904653780 >> 172.21.15.46:0/904653780 conn(0x7f2a6c0fbcf0 msgr2=0x7f2a6c102c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:48:47.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.207+0000 7f2a719ff700 1 -- 172.21.15.46:0/904653780 shutdown_connections 2023-10-19T12:48:47.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:48:47.207+0000 7f2a719ff700 1 -- 172.21.15.46:0/904653780 wait complete. 2023-10-19T12:48:47.236 INFO:tasks.cephfs.filesystem:scrub status for tag:21e73f70-af16-4ae7-bc34-e6c54ba8e1ec - {'path': '/', 'tag': '21e73f70-af16-4ae7-bc34-e6c54ba8e1ec', 'options': 'recursive,force'} 2023-10-19T12:48:48.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:48:47 smithi046 ceph-mon[98509]: pgmap v512: 129 pgs: 129 active+clean; 1.5 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 5.5 MiB/s wr, 522 op/s 2023-10-19T12:48:48.343 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:48:47 smithi157 ceph-mon[134109]: pgmap v512: 129 pgs: 129 active+clean; 1.5 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 5.5 MiB/s wr, 522 op/s 2023-10-19T12:48:48.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:48:47 smithi195 ceph-mon[134493]: pgmap v512: 129 pgs: 129 active+clean; 1.5 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 5.5 MiB/s wr, 522 op/s 2023-10-19T12:48:49.839 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:48:49 smithi157 ceph-mon[134109]: pgmap v513: 129 pgs: 129 active+clean; 1.5 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 5.1 MiB/s wr, 480 op/s 2023-10-19T12:48:49.886 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:48:49 smithi195 ceph-mon[134493]: pgmap v513: 129 pgs: 129 active+clean; 1.5 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 5.1 MiB/s wr, 480 op/s 2023-10-19T12:48:49.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:48:49 smithi046 ceph-mon[98509]: pgmap v513: 129 pgs: 129 active+clean; 1.5 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 5.1 MiB/s wr, 480 op/s 2023-10-19T12:48:51.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 290.0 s, 702.0 tps, lat 146.197 ms stddev 233.960 2023-10-19T12:48:52.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:48:51 smithi046 ceph-mon[98509]: pgmap v514: 129 pgs: 129 active+clean; 1.5 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 5.2 MiB/s wr, 490 op/s 2023-10-19T12:48:52.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:48:51 smithi157 ceph-mon[134109]: pgmap v514: 129 pgs: 129 active+clean; 1.5 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 5.2 MiB/s wr, 490 op/s 2023-10-19T12:48:52.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:48:51 smithi195 ceph-mon[134493]: pgmap v514: 129 pgs: 129 active+clean; 1.5 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 5.2 MiB/s wr, 490 op/s 2023-10-19T12:48:53.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:48:52 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:48:53.343 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:48:52 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:48:53.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:48:52 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:48:54.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:48:53 smithi046 ceph-mon[98509]: pgmap v515: 129 pgs: 129 active+clean; 1.5 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.9 MiB/s wr, 565 op/s 2023-10-19T12:48:54.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:48:53 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:48:54.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:48:53 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:48:54.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:48:53 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:48:54.350 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:48:53 smithi157 ceph-mon[134109]: pgmap v515: 129 pgs: 129 active+clean; 1.5 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.9 MiB/s wr, 565 op/s 2023-10-19T12:48:54.351 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:48:53 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:48:54.351 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:48:53 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:48:54.351 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:48:53 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:48:54.382 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:48:53 smithi195 ceph-mon[134493]: pgmap v515: 129 pgs: 129 active+clean; 1.5 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.9 MiB/s wr, 565 op/s 2023-10-19T12:48:54.382 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:48:53 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:48:54.383 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:48:53 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:48:54.383 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:48:53 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:48:56.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:48:55 smithi046 ceph-mon[98509]: pgmap v516: 129 pgs: 129 active+clean; 1.5 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.2 MiB/s wr, 487 op/s 2023-10-19T12:48:56.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:48:55 smithi157 ceph-mon[134109]: pgmap v516: 129 pgs: 129 active+clean; 1.5 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.2 MiB/s wr, 487 op/s 2023-10-19T12:48:56.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:48:55 smithi195 ceph-mon[134493]: pgmap v516: 129 pgs: 129 active+clean; 1.5 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.2 MiB/s wr, 487 op/s 2023-10-19T12:48:56.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 295.0 s, 850.6 tps, lat 117.425 ms stddev 155.281 2023-10-19T12:48:58.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:48:57 smithi046 ceph-mon[98509]: pgmap v517: 129 pgs: 129 active+clean; 1.5 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 5.3 MiB/s wr, 537 op/s 2023-10-19T12:48:58.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:48:57 smithi157 ceph-mon[134109]: pgmap v517: 129 pgs: 129 active+clean; 1.5 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 5.3 MiB/s wr, 537 op/s 2023-10-19T12:48:58.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:48:57 smithi195 ceph-mon[134493]: pgmap v517: 129 pgs: 129 active+clean; 1.5 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 5.3 MiB/s wr, 537 op/s 2023-10-19T12:48:59.837 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:48:59 smithi157 ceph-mon[134109]: pgmap v518: 129 pgs: 129 active+clean; 1.5 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 5.5 MiB/s wr, 520 op/s 2023-10-19T12:48:59.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:48:59 smithi195 ceph-mon[134493]: pgmap v518: 129 pgs: 129 active+clean; 1.5 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 5.5 MiB/s wr, 520 op/s 2023-10-19T12:48:59.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:48:59 smithi046 ceph-mon[98509]: pgmap v518: 129 pgs: 129 active+clean; 1.5 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 5.5 MiB/s wr, 520 op/s 2023-10-19T12:49:01.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 300.0 s, 918.4 tps, lat 107.243 ms stddev 132.697 2023-10-19T12:49:02.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:49:01 smithi046 ceph-mon[98509]: pgmap v519: 129 pgs: 129 active+clean; 1.5 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.8 MiB/s wr, 542 op/s 2023-10-19T12:49:02.339 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:49:01 smithi157 ceph-mon[134109]: pgmap v519: 129 pgs: 129 active+clean; 1.5 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.8 MiB/s wr, 542 op/s 2023-10-19T12:49:02.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:49:01 smithi195 ceph-mon[134493]: pgmap v519: 129 pgs: 129 active+clean; 1.5 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.8 MiB/s wr, 542 op/s 2023-10-19T12:49:04.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:49:03 smithi046 ceph-mon[98509]: pgmap v520: 129 pgs: 129 active+clean; 1.5 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 7.2 MiB/s wr, 643 op/s 2023-10-19T12:49:04.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:49:03 smithi157 ceph-mon[134109]: pgmap v520: 129 pgs: 129 active+clean; 1.5 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 7.2 MiB/s wr, 643 op/s 2023-10-19T12:49:04.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:49:03 smithi195 ceph-mon[134493]: pgmap v520: 129 pgs: 129 active+clean; 1.5 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 7.2 MiB/s wr, 643 op/s 2023-10-19T12:49:06.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:49:05 smithi046 ceph-mon[98509]: pgmap v521: 129 pgs: 129 active+clean; 1.5 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.5 MiB/s wr, 540 op/s 2023-10-19T12:49:06.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:49:05 smithi157 ceph-mon[134109]: pgmap v521: 129 pgs: 129 active+clean; 1.5 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.5 MiB/s wr, 540 op/s 2023-10-19T12:49:06.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:49:05 smithi195 ceph-mon[134493]: pgmap v521: 129 pgs: 129 active+clean; 1.5 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.5 MiB/s wr, 540 op/s 2023-10-19T12:49:06.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 305.0 s, 436.4 tps, lat 228.015 ms stddev 276.755 2023-10-19T12:49:08.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:49:07 smithi046 ceph-mon[98509]: pgmap v522: 129 pgs: 129 active+clean; 1.5 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.0 MiB/s wr, 621 op/s 2023-10-19T12:49:08.343 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:49:07 smithi157 ceph-mon[134109]: pgmap v522: 129 pgs: 129 active+clean; 1.5 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.0 MiB/s wr, 621 op/s 2023-10-19T12:49:08.383 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:49:07 smithi195 ceph-mon[134493]: pgmap v522: 129 pgs: 129 active+clean; 1.5 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.0 MiB/s wr, 621 op/s 2023-10-19T12:49:09.837 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:49:09 smithi157 ceph-mon[134109]: pgmap v523: 129 pgs: 129 active+clean; 1.5 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.4 MiB/s wr, 577 op/s 2023-10-19T12:49:09.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:49:09 smithi195 ceph-mon[134493]: pgmap v523: 129 pgs: 129 active+clean; 1.5 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.4 MiB/s wr, 577 op/s 2023-10-19T12:49:09.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:49:09 smithi046 ceph-mon[98509]: pgmap v523: 129 pgs: 129 active+clean; 1.5 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.4 MiB/s wr, 577 op/s 2023-10-19T12:49:11.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 310.0 s, 569.4 tps, lat 177.341 ms stddev 205.717 2023-10-19T12:49:12.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:49:11 smithi046 ceph-mon[98509]: pgmap v524: 129 pgs: 129 active+clean; 1.5 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 7.2 MiB/s wr, 592 op/s 2023-10-19T12:49:12.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:49:11 smithi157 ceph-mon[134109]: pgmap v524: 129 pgs: 129 active+clean; 1.5 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 7.2 MiB/s wr, 592 op/s 2023-10-19T12:49:12.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:49:11 smithi195 ceph-mon[134493]: pgmap v524: 129 pgs: 129 active+clean; 1.5 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 7.2 MiB/s wr, 592 op/s 2023-10-19T12:49:14.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:49:13 smithi046 ceph-mon[98509]: pgmap v525: 129 pgs: 129 active+clean; 1.5 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 9.4 MiB/s wr, 670 op/s 2023-10-19T12:49:14.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:49:13 smithi157 ceph-mon[134109]: pgmap v525: 129 pgs: 129 active+clean; 1.5 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 9.4 MiB/s wr, 670 op/s 2023-10-19T12:49:14.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:49:13 smithi195 ceph-mon[134493]: pgmap v525: 129 pgs: 129 active+clean; 1.5 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 9.4 MiB/s wr, 670 op/s 2023-10-19T12:49:16.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:49:15 smithi046 ceph-mon[98509]: pgmap v526: 129 pgs: 129 active+clean; 1.5 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.5 MiB/s wr, 540 op/s 2023-10-19T12:49:16.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:49:15 smithi157 ceph-mon[134109]: pgmap v526: 129 pgs: 129 active+clean; 1.5 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.5 MiB/s wr, 540 op/s 2023-10-19T12:49:16.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:49:15 smithi195 ceph-mon[134493]: pgmap v526: 129 pgs: 129 active+clean; 1.5 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.5 MiB/s wr, 540 op/s 2023-10-19T12:49:16.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 315.0 s, 489.4 tps, lat 205.036 ms stddev 258.939 2023-10-19T12:49:17.237 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-19T12:49:17.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.614+0000 7f81457ff700 1 -- 172.21.15.46:0/4009148898 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8140103be0 msgr2=0x7f8140105fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:49:17.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.614+0000 7f81457ff700 1 --2- 172.21.15.46:0/4009148898 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8140103be0 0x7f8140105fd0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f8128009990 tx=0x7f8128009ca0 comp rx=0 tx=0).stop 2023-10-19T12:49:17.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.614+0000 7f81457ff700 1 -- 172.21.15.46:0/4009148898 shutdown_connections 2023-10-19T12:49:17.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.614+0000 7f81457ff700 1 --2- 172.21.15.46:0/4009148898 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8140106510 0x7f8140108900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:49:17.618 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.614+0000 7f81457ff700 1 --2- 172.21.15.46:0/4009148898 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f81401012b0 0x7f81401036a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:49:17.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.614+0000 7f81457ff700 1 --2- 172.21.15.46:0/4009148898 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8140103be0 0x7f8140105fd0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:49:17.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.614+0000 7f81457ff700 1 -- 172.21.15.46:0/4009148898 >> 172.21.15.46:0/4009148898 conn(0x7f81400fac00 msgr2=0x7f81400fd040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:49:17.619 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.615+0000 7f81457ff700 1 -- 172.21.15.46:0/4009148898 shutdown_connections 2023-10-19T12:49:17.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.615+0000 7f81457ff700 1 -- 172.21.15.46:0/4009148898 wait complete. 2023-10-19T12:49:17.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.617+0000 7f81457ff700 1 Processor -- start 2023-10-19T12:49:17.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.617+0000 7f81457ff700 1 -- start start 2023-10-19T12:49:17.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.618+0000 7f81457ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f81401012b0 0x7f8140194620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:49:17.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.619+0000 7f81457ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8140103be0 0x7f8140194b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:49:17.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.619+0000 7f81457ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8140106510 0x7f814019bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:49:17.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.619+0000 7f81457ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f814019c150 con 0x7f8140103be0 2023-10-19T12:49:17.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.619+0000 7f81457ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f814019c2c0 con 0x7f8140106510 2023-10-19T12:49:17.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.619+0000 7f81457ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f814019c480 con 0x7f81401012b0 2023-10-19T12:49:17.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.619+0000 7f813effd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f81401012b0 0x7f8140194620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:49:17.623 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.619+0000 7f813effd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f81401012b0 0x7f8140194620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:46362/0 (socket says 172.21.15.46:46362) 2023-10-19T12:49:17.624 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.619+0000 7f813e7fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8140103be0 0x7f8140194b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:49:17.624 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.619+0000 7f813effd700 1 -- 172.21.15.46:0/3675347940 learned_addr learned my addr 172.21.15.46:0/3675347940 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:49:17.624 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.620+0000 7f813effd700 1 -- 172.21.15.46:0/3675347940 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8140106510 msgr2=0x7f814019bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:49:17.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.620+0000 7f813effd700 1 --2- 172.21.15.46:0/3675347940 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8140106510 0x7f814019bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:49:17.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.620+0000 7f813effd700 1 -- 172.21.15.46:0/3675347940 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8140103be0 msgr2=0x7f8140194b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:49:17.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.620+0000 7f813effd700 1 --2- 172.21.15.46:0/3675347940 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8140103be0 0x7f8140194b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:49:17.625 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.620+0000 7f813effd700 1 -- 172.21.15.46:0/3675347940 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81280095f0 con 0x7f81401012b0 2023-10-19T12:49:17.626 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.621+0000 7f813effd700 1 --2- 172.21.15.46:0/3675347940 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f81401012b0 0x7f8140194620 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f813800b530 tx=0x7f813800b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:49:17.627 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.621+0000 7f8137fff700 1 -- 172.21.15.46:0/3675347940 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8138011830 con 0x7f81401012b0 2023-10-19T12:49:17.627 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.621+0000 7f8137fff700 1 -- 172.21.15.46:0/3675347940 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8138011e50 con 0x7f81401012b0 2023-10-19T12:49:17.627 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.621+0000 7f8137fff700 1 -- 172.21.15.46:0/3675347940 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f813800f2e0 con 0x7f81401012b0 2023-10-19T12:49:17.627 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.621+0000 7f81457ff700 1 -- 172.21.15.46:0/3675347940 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f814019c700 con 0x7f81401012b0 2023-10-19T12:49:17.627 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.622+0000 7f81457ff700 1 -- 172.21.15.46:0/3675347940 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f814019cbc0 con 0x7f81401012b0 2023-10-19T12:49:17.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.629+0000 7f8137fff700 1 -- 172.21.15.46:0/3675347940 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f8138010380 con 0x7f81401012b0 2023-10-19T12:49:17.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.629+0000 7f8159161b80 1 Processor -- start 2023-10-19T12:49:17.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.629+0000 7f8159161b80 1 -- start start 2023-10-19T12:49:17.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.629+0000 7f8159161b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557326dbe2d0 0x557326dbe6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:49:17.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.629+0000 7f8159161b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557326dbec30 0x557326dbd090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:49:17.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.629+0000 7f8159161b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557326dbd5d0 0x557326dbda50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:49:17.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.629+0000 7f8159161b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x557326d306e0 con 0x557326dbe2d0 2023-10-19T12:49:17.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.629+0000 7f8159161b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x557326d16c60 con 0x557326dbd5d0 2023-10-19T12:49:17.634 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.629+0000 7f8159161b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x557326d14580 con 0x557326dbec30 2023-10-19T12:49:17.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.630+0000 7f813f7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557326dbe2d0 0x557326dbe6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:49:17.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.630+0000 7f813e7fc700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557326dbd5d0 0x557326dbda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:49:17.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.630+0000 7f813e7fc700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557326dbd5d0 0x557326dbda50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:44022/0 (socket says 172.21.15.46:44022) 2023-10-19T12:49:17.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.630+0000 7f813e7fc700 1 -- 172.21.15.46:0/3889258658 learned_addr learned my addr 172.21.15.46:0/3889258658 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:49:17.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.630+0000 7f813effd700 1 --2- 172.21.15.46:0/3889258658 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557326dbec30 0x557326dbd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:49:17.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.631+0000 7f813f7fe700 1 -- 172.21.15.46:0/3889258658 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557326dbec30 msgr2=0x557326dbd090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:49:17.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.631+0000 7f813f7fe700 1 --2- 172.21.15.46:0/3889258658 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557326dbec30 0x557326dbd090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:49:17.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.631+0000 7f813f7fe700 1 -- 172.21.15.46:0/3889258658 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557326dbd5d0 msgr2=0x557326dbda50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:49:17.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.631+0000 7f813f7fe700 1 --2- 172.21.15.46:0/3889258658 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557326dbd5d0 0x557326dbda50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:49:17.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.631+0000 7f813f7fe700 1 -- 172.21.15.46:0/3889258658 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557326ccd3f0 con 0x557326dbe2d0 2023-10-19T12:49:17.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.632+0000 7f8137fff700 1 --2- 172.21.15.46:0/3675347940 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f812c0a1550 0x7f812c0a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:49:17.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.632+0000 7f8137fff700 1 -- 172.21.15.46:0/3675347940 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f81380ccbf0 con 0x7f81401012b0 2023-10-19T12:49:17.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.633+0000 7f813f7fe700 1 --2- 172.21.15.46:0/3889258658 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557326dbe2d0 0x557326dbe6f0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f8130009cc0 tx=0x7f813000b410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f6e8f5a69518406 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:49:17.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.633+0000 7f813effd700 1 --2- 172.21.15.46:0/3675347940 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f812c0a1550 0x7f812c0a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:49:17.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.633+0000 7f81357fa700 1 -- 172.21.15.46:0/3889258658 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f813000bcf0 con 0x557326dbe2d0 2023-10-19T12:49:17.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.633+0000 7f81357fa700 1 -- 172.21.15.46:0/3889258658 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f813000be50 con 0x557326dbe2d0 2023-10-19T12:49:17.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.633+0000 7f81357fa700 1 -- 172.21.15.46:0/3889258658 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81300127e0 con 0x557326dbe2d0 2023-10-19T12:49:17.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.634+0000 7f8159161b80 1 -- 172.21.15.46:0/3889258658 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557326dbe2d0 msgr2=0x557326dbe6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:49:17.640 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.634+0000 7f8159161b80 1 --2- 172.21.15.46:0/3889258658 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557326dbe2d0 0x557326dbe6f0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f8130009cc0 tx=0x7f813000b410 comp rx=0 tx=0).stop 2023-10-19T12:49:17.640 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.634+0000 7f813effd700 1 --2- 172.21.15.46:0/3675347940 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f812c0a1550 0x7f812c0a3a10 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f8138099ad0 tx=0x7f81380b9040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:49:17.640 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.635+0000 7f8159161b80 1 -- 172.21.15.46:0/3889258658 shutdown_connections 2023-10-19T12:49:17.640 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.635+0000 7f8159161b80 1 --2- 172.21.15.46:0/3889258658 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557326dbd5d0 0x557326dbda50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:49:17.640 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.635+0000 7f8159161b80 1 --2- 172.21.15.46:0/3889258658 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557326dbe2d0 0x557326dbe6f0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:49:17.640 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.635+0000 7f8159161b80 1 --2- 172.21.15.46:0/3889258658 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557326dbec30 0x557326dbd090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:49:17.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.635+0000 7f8159161b80 1 -- 172.21.15.46:0/3889258658 >> 172.21.15.46:0/3889258658 conn(0x557326d31720 msgr2=0x557326db7b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:49:17.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.635+0000 7f8159161b80 1 -- 172.21.15.46:0/3889258658 shutdown_connections 2023-10-19T12:49:17.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.635+0000 7f8159161b80 1 -- 172.21.15.46:0/3889258658 wait complete. 2023-10-19T12:49:17.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.636+0000 7f8159161b80 1 -- start start 2023-10-19T12:49:17.642 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.636+0000 7f8159161b80 1 Processor -- start 2023-10-19T12:49:17.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.641+0000 7f8159161b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557326dbd5d0 0x557326dc6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:49:17.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.641+0000 7f8159161b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557326dbe2d0 0x557326dc7040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:49:17.644 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.641+0000 7f8159161b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557326dbec30 0x557326dce080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:49:17.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.641+0000 7f8159161b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x557326d0fe70 con 0x557326dbe2d0 2023-10-19T12:49:17.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.641+0000 7f8159161b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x557326cac710 con 0x557326dbec30 2023-10-19T12:49:17.645 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.641+0000 7f8159161b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x557326cac3b0 con 0x557326dbd5d0 2023-10-19T12:49:17.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.641+0000 7f813f7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557326dbd5d0 0x557326dc6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:49:17.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.641+0000 7f813f7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557326dbd5d0 0x557326dc6b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:46380/0 (socket says 172.21.15.46:46380) 2023-10-19T12:49:17.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.641+0000 7f813f7fe700 1 -- 172.21.15.46:0/763411661 learned_addr learned my addr 172.21.15.46:0/763411661 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:49:17.647 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.641+0000 7f8159161b80 10 client.0 _ll_register_callbacks cb 0x557326bf6a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:49:17.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.641+0000 7f813f7fe700 1 --2- 172.21.15.46:0/763411661 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557326dbec30 0x557326dce080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:49:17.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.641+0000 7f813e7fc700 1 --2- 172.21.15.46:0/763411661 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557326dbe2d0 0x557326dc7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:49:17.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.642+0000 7f813f7fe700 1 -- 172.21.15.46:0/763411661 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557326dbec30 msgr2=0x557326dce080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:49:17.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.642+0000 7f813f7fe700 1 --2- 172.21.15.46:0/763411661 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557326dbec30 0x557326dce080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:49:17.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.642+0000 7f813f7fe700 1 -- 172.21.15.46:0/763411661 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557326dbe2d0 msgr2=0x557326dc7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:49:17.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.642+0000 7f813f7fe700 1 --2- 172.21.15.46:0/763411661 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557326dbe2d0 0x557326dc7040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:49:17.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.642+0000 7f813f7fe700 1 -- 172.21.15.46:0/763411661 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81300098f0 con 0x557326dbd5d0 2023-10-19T12:49:17.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.642+0000 7f813e7fc700 1 --2- 172.21.15.46:0/763411661 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557326dbe2d0 0x557326dc7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T12:49:17.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.642+0000 7f813f7fe700 1 --2- 172.21.15.46:0/763411661 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557326dbd5d0 0x557326dc6b00 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8130013b00 tx=0x7f8130013d30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc73f7ccd1575d59 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:49:17.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.642+0000 7f81267fc700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-10-19T12:49:17.650 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.643+0000 7f81267fc700 1 -- 172.21.15.46:0/763411661 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8130025070 con 0x557326dbd5d0 2023-10-19T12:49:17.650 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.643+0000 7f8159161b80 1 -- 172.21.15.46:0/763411661 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557326d14ef0 con 0x557326dbd5d0 2023-10-19T12:49:17.650 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.643+0000 7f81267fc700 1 -- 172.21.15.46:0/763411661 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f81300129a0 con 0x557326dbd5d0 2023-10-19T12:49:17.650 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.643+0000 7f81267fc700 1 -- 172.21.15.46:0/763411661 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8130012b60 con 0x557326dbd5d0 2023-10-19T12:49:17.650 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.643+0000 7f8159161b80 10 client.25993 fetch_fsmap learned FSMap version 43 2023-10-19T12:49:17.651 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.643+0000 7f8159161b80 1 -- 172.21.15.46:0/763411661 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x557326b3ade0 con 0x557326dbd5d0 2023-10-19T12:49:17.651 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.643+0000 7f81267fc700 1 -- 172.21.15.46:0/763411661 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x557326d14ef0 con 0x557326dbd5d0 2023-10-19T12:49:17.651 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.644+0000 7f81267fc700 1 -- 172.21.15.46:0/763411661 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 43) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f8130028020 con 0x557326dbd5d0 2023-10-19T12:49:17.651 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.644+0000 7f8159161b80 10 client.25993 fetch_fsmap finished waiting for FSMap version 43 2023-10-19T12:49:17.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.644+0000 7f8159161b80 10 client.25993 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-19T12:49:17.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.644+0000 7f8159161b80 20 client.25993 populate_metadata read hostname 'smithi046' 2023-10-19T12:49:17.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.644+0000 7f8159161b80 1 --2- 172.21.15.46:0/763411661 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x557326dd27b0 0x557326dd4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:49:17.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.644+0000 7f8159161b80 4 client.25993 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-19T12:49:17.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.644+0000 7f8159161b80 1 -- 172.21.15.46:0/763411661 --> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557326d8c8b0 con 0x557326dd27b0 2023-10-19T12:49:17.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.644+0000 7f813e7fc700 1 --2- 172.21.15.46:0/763411661 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x557326dd27b0 0x557326dd4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:49:17.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.645+0000 7f813e7fc700 1 --2- 172.21.15.46:0/763411661 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x557326dd27b0 0x557326dd4bd0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e1b2f815d2cc988 server_cookie=a5b5b71d633d7c8c in_seq=0 out_seq=0 2023-10-19T12:49:17.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.645+0000 7f81267fc700 10 client.25993 ms_handle_connect on v2:172.21.15.157:6838/552718978 2023-10-19T12:49:17.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.646+0000 7f81267fc700 1 -- 172.21.15.46:0/763411661 <== mds.0 v2:172.21.15.157:6838/552718978 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x557326d8c8b0 con 0x557326dd27b0 2023-10-19T12:49:17.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.646+0000 7f81267fc700 10 client.25993 handle_command_reply: tid=0 2023-10-19T12:49:17.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.646+0000 7f8159161b80 1 client.25993 shutdown 2023-10-19T12:49:17.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.646+0000 7f8159161b80 1 -- 172.21.15.46:0/763411661 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557326dbd5d0 msgr2=0x557326dc6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:49:17.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.646+0000 7f8159161b80 1 --2- 172.21.15.46:0/763411661 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557326dbd5d0 0x557326dc6b00 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8130013b00 tx=0x7f8130013d30 comp rx=0 tx=0).stop 2023-10-19T12:49:17.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.646+0000 7f8159161b80 1 -- 172.21.15.46:0/763411661 shutdown_connections 2023-10-19T12:49:17.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.646+0000 7f8159161b80 1 --2- 172.21.15.46:0/763411661 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557326dbec30 0x557326dce080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:49:17.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.646+0000 7f8159161b80 1 --2- 172.21.15.46:0/763411661 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557326dbd5d0 0x557326dc6b00 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:49:17.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.646+0000 7f8159161b80 1 --2- 172.21.15.46:0/763411661 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x557326dd27b0 0x557326dd4bd0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:49:17.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.646+0000 7f8159161b80 1 --2- 172.21.15.46:0/763411661 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557326dbe2d0 0x557326dc7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:49:17.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.646+0000 7f8159161b80 1 -- 172.21.15.46:0/763411661 >> 172.21.15.46:0/763411661 conn(0x557326d31720 msgr2=0x557326dbc080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:49:17.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.646+0000 7f81267fc700 0 client.25993 ms_handle_reset on v2:172.21.15.157:6838/552718978 2023-10-19T12:49:17.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.647+0000 7f8159161b80 1 -- 172.21.15.46:0/763411661 shutdown_connections 2023-10-19T12:49:17.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.647+0000 7f8159161b80 1 -- 172.21.15.46:0/763411661 wait complete. 2023-10-19T12:49:17.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.649+0000 7f8159161b80 20 client.25993 trim_cache size 0 max 16384 2023-10-19T12:49:17.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.704+0000 7f8159161b80 1 Processor -- start 2023-10-19T12:49:17.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.704+0000 7f8159161b80 1 -- start start 2023-10-19T12:49:17.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.704+0000 7f8159161b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557326dbd5d0 0x557326dc4a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:49:17.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.704+0000 7f8159161b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557326dbe2d0 0x557326dce040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:49:17.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.704+0000 7f8159161b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557326dbec30 0x557326dc68b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:49:17.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.704+0000 7f8159161b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x557326b90920 con 0x557326dbec30 2023-10-19T12:49:17.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.704+0000 7f8159161b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x557326db8120 con 0x557326dbd5d0 2023-10-19T12:49:17.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.704+0000 7f8159161b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x557326db9c00 con 0x557326dbe2d0 2023-10-19T12:49:17.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.705+0000 7f813e7fc700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557326dbe2d0 0x557326dce040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:49:17.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.705+0000 7f813f7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557326dbd5d0 0x557326dc4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:49:17.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.705+0000 7f813f7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557326dbd5d0 0x557326dc4a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:44040/0 (socket says 172.21.15.46:44040) 2023-10-19T12:49:17.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.705+0000 7f813e7fc700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557326dbe2d0 0x557326dce040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:46388/0 (socket says 172.21.15.46:46388) 2023-10-19T12:49:17.710 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.705+0000 7f813f7fe700 1 -- 172.21.15.46:0/642793133 learned_addr learned my addr 172.21.15.46:0/642793133 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:49:17.710 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.705+0000 7f813f7fe700 1 -- 172.21.15.46:0/642793133 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557326dbe2d0 msgr2=0x557326dce040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:49:17.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.705+0000 7f813f7fe700 1 --2- 172.21.15.46:0/642793133 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557326dbe2d0 0x557326dce040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:49:17.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.705+0000 7f813f7fe700 1 -- 172.21.15.46:0/642793133 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557326dbec30 msgr2=0x557326dc68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:49:17.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.705+0000 7f813f7fe700 1 --2- 172.21.15.46:0/642793133 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557326dbec30 0x557326dc68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:49:17.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.705+0000 7f813f7fe700 1 -- 172.21.15.46:0/642793133 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557326b23c60 con 0x557326dbd5d0 2023-10-19T12:49:17.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.706+0000 7f813e7fc700 1 --2- 172.21.15.46:0/642793133 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557326dbe2d0 0x557326dce040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:49:17.712 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.706+0000 7f813f7fe700 1 --2- 172.21.15.46:0/642793133 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557326dbd5d0 0x557326dc4a80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f813000be20 tx=0x7f8130004be0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0746f05767b5ed0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:49:17.712 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.709+0000 7f8135ffb700 1 -- 172.21.15.46:0/642793133 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8130025030 con 0x557326dbd5d0 2023-10-19T12:49:17.712 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.709+0000 7f8135ffb700 1 -- 172.21.15.46:0/642793133 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8130013550 con 0x557326dbd5d0 2023-10-19T12:49:17.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.709+0000 7f8135ffb700 1 -- 172.21.15.46:0/642793133 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8130021420 con 0x557326dbd5d0 2023-10-19T12:49:17.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.710+0000 7f8159161b80 1 -- 172.21.15.46:0/642793133 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557326dbd5d0 msgr2=0x557326dc4a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:49:17.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.710+0000 7f8159161b80 1 --2- 172.21.15.46:0/642793133 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557326dbd5d0 0x557326dc4a80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f813000be20 tx=0x7f8130004be0 comp rx=0 tx=0).stop 2023-10-19T12:49:17.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.710+0000 7f8159161b80 1 -- 172.21.15.46:0/642793133 shutdown_connections 2023-10-19T12:49:17.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.710+0000 7f8159161b80 1 --2- 172.21.15.46:0/642793133 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557326dbec30 0x557326dc68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:49:17.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.710+0000 7f8159161b80 1 --2- 172.21.15.46:0/642793133 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557326dbd5d0 0x557326dc4a80 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:49:17.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.710+0000 7f8159161b80 1 --2- 172.21.15.46:0/642793133 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557326dbe2d0 0x557326dce040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:49:17.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.710+0000 7f8159161b80 1 -- 172.21.15.46:0/642793133 >> 172.21.15.46:0/642793133 conn(0x557326d31720 msgr2=0x557326dc6010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:49:17.715 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.710+0000 7f8159161b80 1 -- 172.21.15.46:0/642793133 shutdown_connections 2023-10-19T12:49:17.715 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.710+0000 7f8159161b80 1 -- 172.21.15.46:0/642793133 wait complete. 2023-10-19T12:49:17.715 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.711+0000 7f8159161b80 1 -- start start 2023-10-19T12:49:17.716 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.713+0000 7f8159161b80 1 Processor -- start 2023-10-19T12:49:17.717 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.713+0000 7f8159161b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557326dbd5d0 0x557326dcda30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:49:17.717 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.714+0000 7f8159161b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557326dbe2d0 0x557326dcdf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:49:17.717 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.714+0000 7f8159161b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557326dbec30 0x557326dcc130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:49:17.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.714+0000 7f8159161b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x557326dcc840 con 0x557326dbd5d0 2023-10-19T12:49:17.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.714+0000 7f8159161b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x557326dcc9b0 con 0x557326dbe2d0 2023-10-19T12:49:17.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.714+0000 7f8159161b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x557326dccb70 con 0x557326dbec30 2023-10-19T12:49:17.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.714+0000 7f8159161b80 10 client.0 _ll_register_callbacks cb 0x557326bf6a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:49:17.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.714+0000 7f813e7fc700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557326dbe2d0 0x557326dcdf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:49:17.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.714+0000 7f813e7fc700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557326dbe2d0 0x557326dcdf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:44048/0 (socket says 172.21.15.46:44048) 2023-10-19T12:49:17.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.714+0000 7f813e7fc700 1 -- 172.21.15.46:0/3660202287 learned_addr learned my addr 172.21.15.46:0/3660202287 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:49:17.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.715+0000 7f813e7fc700 1 -- 172.21.15.46:0/3660202287 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557326dbec30 msgr2=0x557326dcc130 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-19T12:49:17.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.715+0000 7f813e7fc700 1 --2- 172.21.15.46:0/3660202287 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557326dbec30 0x557326dcc130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:49:17.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.715+0000 7f813e7fc700 1 -- 172.21.15.46:0/3660202287 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557326dbd5d0 msgr2=0x557326dcda30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:49:17.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.715+0000 7f813e7fc700 1 --2- 172.21.15.46:0/3660202287 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557326dbd5d0 0x557326dcda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:49:17.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.715+0000 7f813e7fc700 1 -- 172.21.15.46:0/3660202287 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81401094d0 con 0x557326dbe2d0 2023-10-19T12:49:17.721 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.715+0000 7f813e7fc700 1 --2- 172.21.15.46:0/3660202287 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557326dbe2d0 0x557326dcdf70 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8128009990 tx=0x7f812800ba80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6cc85a51f825952 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:49:17.721 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.715+0000 7f81267fc700 10 client.0 ms_handle_connect on v2:172.21.15.157:3300/0 2023-10-19T12:49:17.721 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.716+0000 7f81267fc700 1 -- 172.21.15.46:0/3660202287 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812801d040 con 0x557326dbe2d0 2023-10-19T12:49:17.721 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.716+0000 7f81267fc700 1 -- 172.21.15.46:0/3660202287 <== mon.2 v2:172.21.15.157:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f8128028e30 con 0x557326dbe2d0 2023-10-19T12:49:17.721 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.716+0000 7f8159161b80 1 -- 172.21.15.46:0/3660202287 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557326d08e50 con 0x557326dbe2d0 2023-10-19T12:49:17.721 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.716+0000 7f81267fc700 1 -- 172.21.15.46:0/3660202287 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f81280282b0 con 0x557326dbe2d0 2023-10-19T12:49:17.722 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.716+0000 7f8159161b80 10 client.25985 fetch_fsmap learned FSMap version 43 2023-10-19T12:49:17.722 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.716+0000 7f8159161b80 1 -- 172.21.15.46:0/3660202287 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x557326b3ade0 con 0x557326dbe2d0 2023-10-19T12:49:17.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.717+0000 7f81267fc700 1 -- 172.21.15.46:0/3660202287 <== mon.2 v2:172.21.15.157:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x557326d08e50 con 0x557326dbe2d0 2023-10-19T12:49:17.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.718+0000 7f81267fc700 1 -- 172.21.15.46:0/3660202287 <== mon.2 v2:172.21.15.157:3300/0 5 ==== fsmap(e 43) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f8128005370 con 0x557326dbe2d0 2023-10-19T12:49:17.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.718+0000 7f8159161b80 10 client.25985 fetch_fsmap finished waiting for FSMap version 43 2023-10-19T12:49:17.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.718+0000 7f8159161b80 10 client.25985 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-19T12:49:17.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.718+0000 7f8159161b80 20 client.25985 populate_metadata read hostname 'smithi046' 2023-10-19T12:49:17.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.718+0000 7f8159161b80 1 --2- 172.21.15.46:0/3660202287 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x557326e38b30 0x557326e3af50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:49:17.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.718+0000 7f8159161b80 4 client.25985 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-19T12:49:17.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.718+0000 7f8159161b80 1 -- 172.21.15.46:0/3660202287 --> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x557326d08b70 con 0x557326e38b30 2023-10-19T12:49:17.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.718+0000 7f813f7fe700 1 --2- 172.21.15.46:0/3660202287 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x557326e38b30 0x557326e3af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:49:17.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.719+0000 7f813f7fe700 1 --2- 172.21.15.46:0/3660202287 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x557326e38b30 0x557326e3af50 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=376816bdc7ba890e server_cookie=d3df79dd19f8bab3 in_seq=0 out_seq=0 2023-10-19T12:49:17.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.719+0000 7f81267fc700 10 client.25985 ms_handle_connect on v2:172.21.15.157:6838/552718978 2023-10-19T12:49:17.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.719+0000 7f81267fc700 1 -- 172.21.15.46:0/3660202287 <== mds.0 v2:172.21.15.157:6838/552718978 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x557326d08b70 con 0x557326e38b30 2023-10-19T12:49:17.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.719+0000 7f81267fc700 10 client.25985 handle_command_reply: tid=0 2023-10-19T12:49:17.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.719+0000 7f8159161b80 1 client.25985 shutdown 2023-10-19T12:49:17.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.719+0000 7f8159161b80 1 -- 172.21.15.46:0/3660202287 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557326dbe2d0 msgr2=0x557326dcdf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:49:17.726 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.719+0000 7f8159161b80 1 --2- 172.21.15.46:0/3660202287 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557326dbe2d0 0x557326dcdf70 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8128009990 tx=0x7f812800ba80 comp rx=0 tx=0).stop 2023-10-19T12:49:17.726 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.720+0000 7f8159161b80 1 -- 172.21.15.46:0/3660202287 shutdown_connections 2023-10-19T12:49:17.726 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.720+0000 7f8159161b80 1 --2- 172.21.15.46:0/3660202287 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557326dbec30 0x557326dcc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:49:17.726 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.720+0000 7f8159161b80 1 --2- 172.21.15.46:0/3660202287 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x557326e38b30 0x557326e3af50 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:49:17.726 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.720+0000 7f8159161b80 1 --2- 172.21.15.46:0/3660202287 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557326dbd5d0 0x557326dcda30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:49:17.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.720+0000 7f8159161b80 1 --2- 172.21.15.46:0/3660202287 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557326dbe2d0 0x557326dcdf70 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:49:17.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.720+0000 7f8159161b80 1 -- 172.21.15.46:0/3660202287 >> 172.21.15.46:0/3660202287 conn(0x557326d31720 msgr2=0x557326dc12d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:49:17.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.720+0000 7f81267fc700 0 client.25985 ms_handle_reset on v2:172.21.15.157:6838/552718978 2023-10-19T12:49:17.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.721+0000 7f8159161b80 1 -- 172.21.15.46:0/3660202287 shutdown_connections 2023-10-19T12:49:17.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.721+0000 7f8159161b80 1 -- 172.21.15.46:0/3660202287 wait complete. 2023-10-19T12:49:17.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.722+0000 7f8159161b80 20 client.25985 trim_cache size 0 max 16384 2023-10-19T12:49:17.728 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-10-19T12:49:17.729 INFO:teuthology.orchestra.run.smithi046.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-19T12:49:17.729 INFO:teuthology.orchestra.run.smithi046.stdout: "scrubs": { 2023-10-19T12:49:17.729 INFO:teuthology.orchestra.run.smithi046.stdout: "21e73f70-af16-4ae7-bc34-e6c54ba8e1ec": { 2023-10-19T12:49:17.729 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2023-10-19T12:49:17.729 INFO:teuthology.orchestra.run.smithi046.stdout: "tag": "21e73f70-af16-4ae7-bc34-e6c54ba8e1ec", 2023-10-19T12:49:17.729 INFO:teuthology.orchestra.run.smithi046.stdout: "options": "recursive,force" 2023-10-19T12:49:17.730 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:49:17.730 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:49:17.730 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-10-19T12:49:17.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.722+0000 7f81457ff700 1 -- 172.21.15.46:0/3675347940 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f812c0a1550 msgr2=0x7f812c0a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:49:17.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.722+0000 7f81457ff700 1 --2- 172.21.15.46:0/3675347940 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f812c0a1550 0x7f812c0a3a10 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f8138099ad0 tx=0x7f81380b9040 comp rx=0 tx=0).stop 2023-10-19T12:49:17.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.722+0000 7f81457ff700 1 -- 172.21.15.46:0/3675347940 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f81401012b0 msgr2=0x7f8140194620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:49:17.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.722+0000 7f81457ff700 1 --2- 172.21.15.46:0/3675347940 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f81401012b0 0x7f8140194620 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f813800b530 tx=0x7f813800b840 comp rx=0 tx=0).stop 2023-10-19T12:49:17.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.723+0000 7f81457ff700 1 -- 172.21.15.46:0/3675347940 shutdown_connections 2023-10-19T12:49:17.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.723+0000 7f81457ff700 1 --2- 172.21.15.46:0/3675347940 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8140106510 0x7f814019bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:49:17.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.723+0000 7f81457ff700 1 --2- 172.21.15.46:0/3675347940 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f812c0a1550 0x7f812c0a3a10 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:49:17.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.723+0000 7f81457ff700 1 --2- 172.21.15.46:0/3675347940 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f81401012b0 0x7f8140194620 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:49:17.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.723+0000 7f81457ff700 1 --2- 172.21.15.46:0/3675347940 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8140103be0 0x7f8140194b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:49:17.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.723+0000 7f81457ff700 1 -- 172.21.15.46:0/3675347940 >> 172.21.15.46:0/3675347940 conn(0x7f81400fac00 msgr2=0x7f8140100a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:49:17.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.723+0000 7f81457ff700 1 -- 172.21.15.46:0/3675347940 shutdown_connections 2023-10-19T12:49:17.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:17.723+0000 7f81457ff700 1 -- 172.21.15.46:0/3675347940 wait complete. 2023-10-19T12:49:17.755 INFO:tasks.cephfs.filesystem:scrub status for tag:21e73f70-af16-4ae7-bc34-e6c54ba8e1ec - {'path': '/', 'tag': '21e73f70-af16-4ae7-bc34-e6c54ba8e1ec', 'options': 'recursive,force'} 2023-10-19T12:49:18.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:49:17 smithi046 ceph-mon[98509]: pgmap v527: 129 pgs: 129 active+clean; 1.5 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.9 MiB/s wr, 599 op/s 2023-10-19T12:49:18.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:49:17 smithi157 ceph-mon[134109]: pgmap v527: 129 pgs: 129 active+clean; 1.5 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.9 MiB/s wr, 599 op/s 2023-10-19T12:49:18.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:49:17 smithi195 ceph-mon[134493]: pgmap v527: 129 pgs: 129 active+clean; 1.5 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.9 MiB/s wr, 599 op/s 2023-10-19T12:49:19.837 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:49:19 smithi157 ceph-mon[134109]: pgmap v528: 129 pgs: 129 active+clean; 1.5 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 8.4 MiB/s wr, 529 op/s 2023-10-19T12:49:19.883 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:49:19 smithi195 ceph-mon[134493]: pgmap v528: 129 pgs: 129 active+clean; 1.5 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 8.4 MiB/s wr, 529 op/s 2023-10-19T12:49:19.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:49:19 smithi046 ceph-mon[98509]: pgmap v528: 129 pgs: 129 active+clean; 1.5 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 8.4 MiB/s wr, 529 op/s 2023-10-19T12:49:21.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 320.0 s, 563.0 tps, lat 173.166 ms stddev 213.115 2023-10-19T12:49:22.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:49:21 smithi046 ceph-mon[98509]: pgmap v529: 129 pgs: 129 active+clean; 1.5 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.7 MiB/s wr, 540 op/s 2023-10-19T12:49:22.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:49:21 smithi157 ceph-mon[134109]: pgmap v529: 129 pgs: 129 active+clean; 1.5 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.7 MiB/s wr, 540 op/s 2023-10-19T12:49:22.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:49:21 smithi195 ceph-mon[134493]: pgmap v529: 129 pgs: 129 active+clean; 1.5 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.7 MiB/s wr, 540 op/s 2023-10-19T12:49:24.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:49:23 smithi046 ceph-mon[98509]: pgmap v530: 129 pgs: 129 active+clean; 1.5 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 9.7 MiB/s wr, 572 op/s 2023-10-19T12:49:24.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:49:23 smithi157 ceph-mon[134109]: pgmap v530: 129 pgs: 129 active+clean; 1.5 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 9.7 MiB/s wr, 572 op/s 2023-10-19T12:49:24.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:49:23 smithi195 ceph-mon[134493]: pgmap v530: 129 pgs: 129 active+clean; 1.5 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 9.7 MiB/s wr, 572 op/s 2023-10-19T12:49:26.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:49:25 smithi046 ceph-mon[98509]: pgmap v531: 129 pgs: 129 active+clean; 1.5 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 7.5 MiB/s wr, 449 op/s 2023-10-19T12:49:26.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:49:25 smithi157 ceph-mon[134109]: pgmap v531: 129 pgs: 129 active+clean; 1.5 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 7.5 MiB/s wr, 449 op/s 2023-10-19T12:49:26.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:49:25 smithi195 ceph-mon[134493]: pgmap v531: 129 pgs: 129 active+clean; 1.5 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 7.5 MiB/s wr, 449 op/s 2023-10-19T12:49:26.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 325.0 s, 525.0 tps, lat 184.818 ms stddev 242.280 2023-10-19T12:49:28.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:49:27 smithi046 ceph-mon[98509]: pgmap v532: 129 pgs: 129 active+clean; 1.5 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.3 MiB/s wr, 544 op/s 2023-10-19T12:49:28.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:49:27 smithi157 ceph-mon[134109]: pgmap v532: 129 pgs: 129 active+clean; 1.5 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.3 MiB/s wr, 544 op/s 2023-10-19T12:49:28.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:49:27 smithi195 ceph-mon[134493]: pgmap v532: 129 pgs: 129 active+clean; 1.5 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.3 MiB/s wr, 544 op/s 2023-10-19T12:49:29.837 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:49:29 smithi157 ceph-mon[134109]: pgmap v533: 129 pgs: 129 active+clean; 1.5 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 8.1 MiB/s wr, 500 op/s 2023-10-19T12:49:29.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:49:29 smithi195 ceph-mon[134493]: pgmap v533: 129 pgs: 129 active+clean; 1.5 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 8.1 MiB/s wr, 500 op/s 2023-10-19T12:49:29.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:49:29 smithi046 ceph-mon[98509]: pgmap v533: 129 pgs: 129 active+clean; 1.5 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 8.1 MiB/s wr, 500 op/s 2023-10-19T12:49:31.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 330.0 s, 521.8 tps, lat 195.831 ms stddev 263.824 2023-10-19T12:49:32.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:49:31 smithi046 ceph-mon[98509]: pgmap v534: 129 pgs: 129 active+clean; 1.5 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.5 MiB/s wr, 513 op/s 2023-10-19T12:49:32.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:49:31 smithi157 ceph-mon[134109]: pgmap v534: 129 pgs: 129 active+clean; 1.5 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.5 MiB/s wr, 513 op/s 2023-10-19T12:49:32.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:49:31 smithi195 ceph-mon[134493]: pgmap v534: 129 pgs: 129 active+clean; 1.5 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.5 MiB/s wr, 513 op/s 2023-10-19T12:49:34.233 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:49:33 smithi046 ceph-mon[98509]: pgmap v535: 129 pgs: 129 active+clean; 1.5 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.2 MiB/s wr, 600 op/s 2023-10-19T12:49:34.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:49:33 smithi157 ceph-mon[134109]: pgmap v535: 129 pgs: 129 active+clean; 1.5 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.2 MiB/s wr, 600 op/s 2023-10-19T12:49:34.387 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:49:33 smithi195 ceph-mon[134493]: pgmap v535: 129 pgs: 129 active+clean; 1.5 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.2 MiB/s wr, 600 op/s 2023-10-19T12:49:36.233 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:49:35 smithi046 ceph-mon[98509]: pgmap v536: 129 pgs: 129 active+clean; 1.5 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.4 MiB/s wr, 521 op/s 2023-10-19T12:49:36.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:49:35 smithi157 ceph-mon[134109]: pgmap v536: 129 pgs: 129 active+clean; 1.5 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.4 MiB/s wr, 521 op/s 2023-10-19T12:49:36.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:49:35 smithi195 ceph-mon[134493]: pgmap v536: 129 pgs: 129 active+clean; 1.5 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.4 MiB/s wr, 521 op/s 2023-10-19T12:49:36.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 335.0 s, 536.8 tps, lat 187.453 ms stddev 210.868 2023-10-19T12:49:38.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:49:37 smithi046 ceph-mon[98509]: pgmap v537: 129 pgs: 129 active+clean; 1.5 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.8 MiB/s wr, 612 op/s 2023-10-19T12:49:38.340 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:49:37 smithi157 ceph-mon[134109]: pgmap v537: 129 pgs: 129 active+clean; 1.5 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.8 MiB/s wr, 612 op/s 2023-10-19T12:49:38.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:49:37 smithi195 ceph-mon[134493]: pgmap v537: 129 pgs: 129 active+clean; 1.5 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.8 MiB/s wr, 612 op/s 2023-10-19T12:49:39.840 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:49:39 smithi157 ceph-mon[134109]: pgmap v538: 129 pgs: 129 active+clean; 1.5 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 8.8 MiB/s wr, 541 op/s 2023-10-19T12:49:39.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:49:39 smithi195 ceph-mon[134493]: pgmap v538: 129 pgs: 129 active+clean; 1.5 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 8.8 MiB/s wr, 541 op/s 2023-10-19T12:49:39.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:49:39 smithi046 ceph-mon[98509]: pgmap v538: 129 pgs: 129 active+clean; 1.5 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 8.8 MiB/s wr, 541 op/s 2023-10-19T12:49:41.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 340.0 s, 509.0 tps, lat 196.504 ms stddev 236.218 2023-10-19T12:49:42.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:49:41 smithi046 ceph-mon[98509]: pgmap v539: 129 pgs: 129 active+clean; 1.5 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.9 MiB/s wr, 527 op/s 2023-10-19T12:49:42.340 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:49:41 smithi157 ceph-mon[134109]: pgmap v539: 129 pgs: 129 active+clean; 1.5 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.9 MiB/s wr, 527 op/s 2023-10-19T12:49:42.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:49:41 smithi195 ceph-mon[134493]: pgmap v539: 129 pgs: 129 active+clean; 1.5 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.9 MiB/s wr, 527 op/s 2023-10-19T12:49:44.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:49:43 smithi046 ceph-mon[98509]: pgmap v540: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.4 MiB/s wr, 591 op/s 2023-10-19T12:49:44.342 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:49:43 smithi157 ceph-mon[134109]: pgmap v540: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.4 MiB/s wr, 591 op/s 2023-10-19T12:49:44.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:49:43 smithi195 ceph-mon[134493]: pgmap v540: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.4 MiB/s wr, 591 op/s 2023-10-19T12:49:46.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:49:45 smithi046 ceph-mon[98509]: pgmap v541: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 7.9 MiB/s wr, 463 op/s 2023-10-19T12:49:46.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:49:45 smithi157 ceph-mon[134109]: pgmap v541: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 7.9 MiB/s wr, 463 op/s 2023-10-19T12:49:46.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:49:45 smithi195 ceph-mon[134493]: pgmap v541: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 7.9 MiB/s wr, 463 op/s 2023-10-19T12:49:46.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 345.0 s, 595.6 tps, lat 173.272 ms stddev 207.439 2023-10-19T12:49:47.756 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-19T12:49:48.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.150+0000 7f16123ff700 1 -- 172.21.15.46:0/778910894 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f160c102320 msgr2=0x7f160c108bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:49:48.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.150+0000 7f16123ff700 1 --2- 172.21.15.46:0/778910894 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f160c102320 0x7f160c108bd0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f1604009990 tx=0x7f1604009ca0 comp rx=0 tx=0).stop 2023-10-19T12:49:48.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.151+0000 7f16123ff700 1 -- 172.21.15.46:0/778910894 shutdown_connections 2023-10-19T12:49:48.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.151+0000 7f16123ff700 1 --2- 172.21.15.46:0/778910894 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f160c102320 0x7f160c108bd0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:49:48.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.151+0000 7f16123ff700 1 --2- 172.21.15.46:0/778910894 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f160c100790 0x7f160c100bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:49:48.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.151+0000 7f16123ff700 1 --2- 172.21.15.46:0/778910894 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f160c101980 0x7f160c101de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:49:48.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.151+0000 7f16123ff700 1 -- 172.21.15.46:0/778910894 >> 172.21.15.46:0/778910894 conn(0x7f160c0fbd00 msgr2=0x7f160c0fe140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:49:48.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.151+0000 7f16123ff700 1 -- 172.21.15.46:0/778910894 shutdown_connections 2023-10-19T12:49:48.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.151+0000 7f16123ff700 1 -- 172.21.15.46:0/778910894 wait complete. 2023-10-19T12:49:48.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.152+0000 7f16123ff700 1 Processor -- start 2023-10-19T12:49:48.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.153+0000 7f16123ff700 1 -- start start 2023-10-19T12:49:48.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.153+0000 7f16123ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f160c100790 0x7f160c19cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:49:48.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.153+0000 7f16123ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f160c101980 0x7f160c19d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:49:48.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.153+0000 7f16123ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f160c102320 0x7f160c1a4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:49:48.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.154+0000 7f16037fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f160c101980 0x7f160c19d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:49:48.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.154+0000 7f16123ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f160c1a48d0 con 0x7f160c100790 2023-10-19T12:49:48.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.154+0000 7f16123ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f160c1a4a10 con 0x7f160c101980 2023-10-19T12:49:48.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.154+0000 7f16123ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f160c1a4ba0 con 0x7f160c102320 2023-10-19T12:49:48.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.154+0000 7f160bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f160c100790 0x7f160c19cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:49:48.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.154+0000 7f161099c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f160c102320 0x7f160c1a4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:49:48.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.154+0000 7f160bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f160c100790 0x7f160c19cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42754/0 (socket says 172.21.15.46:42754) 2023-10-19T12:49:48.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.154+0000 7f160bfff700 1 -- 172.21.15.46:0/3244591670 learned_addr learned my addr 172.21.15.46:0/3244591670 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:49:48.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.155+0000 7f160bfff700 1 -- 172.21.15.46:0/3244591670 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f160c102320 msgr2=0x7f160c1a4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:49:48.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.155+0000 7f160bfff700 1 --2- 172.21.15.46:0/3244591670 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f160c102320 0x7f160c1a4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:49:48.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.155+0000 7f160bfff700 1 -- 172.21.15.46:0/3244591670 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f160c101980 msgr2=0x7f160c19d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:49:48.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.155+0000 7f160bfff700 1 --2- 172.21.15.46:0/3244591670 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f160c101980 0x7f160c19d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:49:48.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.155+0000 7f160bfff700 1 -- 172.21.15.46:0/3244591670 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16040095f0 con 0x7f160c100790 2023-10-19T12:49:48.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.155+0000 7f160bfff700 1 --2- 172.21.15.46:0/3244591670 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f160c100790 0x7f160c19cda0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f15fc00b9c0 tx=0x7f15fc00bcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:49:48.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.155+0000 7f1609ffb700 1 -- 172.21.15.46:0/3244591670 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15fc00d8e0 con 0x7f160c100790 2023-10-19T12:49:48.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.156+0000 7f16123ff700 1 -- 172.21.15.46:0/3244591670 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f160c1a4e80 con 0x7f160c100790 2023-10-19T12:49:48.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.156+0000 7f1609ffb700 1 -- 172.21.15.46:0/3244591670 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f15fc009900 con 0x7f160c100790 2023-10-19T12:49:48.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.156+0000 7f16123ff700 1 -- 172.21.15.46:0/3244591670 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f160c1a52b0 con 0x7f160c100790 2023-10-19T12:49:48.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.156+0000 7f1609ffb700 1 -- 172.21.15.46:0/3244591670 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15fc00c400 con 0x7f160c100790 2023-10-19T12:49:48.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.162+0000 7f1609ffb700 1 -- 172.21.15.46:0/3244591670 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f15fc00c560 con 0x7f160c100790 2023-10-19T12:49:48.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.164+0000 7f1625cb5b80 1 Processor -- start 2023-10-19T12:49:48.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.164+0000 7f1609ffb700 1 --2- 172.21.15.46:0/3244591670 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f15f80a1550 0x7f15f80a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:49:48.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.165+0000 7f1609ffb700 1 -- 172.21.15.46:0/3244591670 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f15fc011070 con 0x7f160c100790 2023-10-19T12:49:48.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.167+0000 7f1625cb5b80 1 -- start start 2023-10-19T12:49:48.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.167+0000 7f161099c700 1 --2- 172.21.15.46:0/3244591670 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f15f80a1550 0x7f15f80a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:49:48.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.167+0000 7f1625cb5b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559149f872d0 0x559149f876f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:49:48.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.167+0000 7f1625cb5b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x559149f87c30 0x559149f86090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:49:48.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.167+0000 7f1625cb5b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559149f865d0 0x559149f86a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:49:48.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.167+0000 7f1625cb5b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x559149ef96e0 con 0x559149f872d0 2023-10-19T12:49:48.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.167+0000 7f1625cb5b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x559149edfc60 con 0x559149f87c30 2023-10-19T12:49:48.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.167+0000 7f1625cb5b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x559149edd580 con 0x559149f865d0 2023-10-19T12:49:48.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.168+0000 7f16037fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x559149f87c30 0x559149f86090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:49:48.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.168+0000 7f16037fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x559149f87c30 0x559149f86090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:37942/0 (socket says 172.21.15.46:37942) 2023-10-19T12:49:48.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.168+0000 7f16037fe700 1 -- 172.21.15.46:0/454857667 learned_addr learned my addr 172.21.15.46:0/454857667 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:49:48.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.168+0000 7f161099c700 1 --2- 172.21.15.46:0/454857667 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559149f865d0 0x559149f86a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:49:48.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.168+0000 7f16037fe700 1 -- 172.21.15.46:0/454857667 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559149f865d0 msgr2=0x559149f86a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:49:48.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.168+0000 7f16037fe700 1 --2- 172.21.15.46:0/454857667 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559149f865d0 0x559149f86a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:49:48.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.168+0000 7f16037fe700 1 -- 172.21.15.46:0/454857667 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559149f872d0 msgr2=0x559149f876f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:49:48.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.168+0000 7f16037fe700 1 --2- 172.21.15.46:0/454857667 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559149f872d0 0x559149f876f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:49:48.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.168+0000 7f16037fe700 1 -- 172.21.15.46:0/454857667 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559149e963f0 con 0x559149f87c30 2023-10-19T12:49:48.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.169+0000 7f16037fe700 1 --2- 172.21.15.46:0/454857667 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x559149f87c30 0x559149f86090 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f15f4007810 tx=0x7f15f4007b20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38bbe09b0a3efb4c server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:49:48.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.169+0000 7f16027fc700 1 -- 172.21.15.46:0/454857667 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f40125f0 con 0x559149f87c30 2023-10-19T12:49:48.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.169+0000 7f161099c700 1 --2- 172.21.15.46:0/3244591670 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f15f80a1550 0x7f15f80a3a10 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f160400a010 tx=0x7f1604009f20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:49:48.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.169+0000 7f16027fc700 1 -- 172.21.15.46:0/454857667 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f15f4012c10 con 0x559149f87c30 2023-10-19T12:49:48.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.169+0000 7f16027fc700 1 -- 172.21.15.46:0/454857667 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f4013dd0 con 0x559149f87c30 2023-10-19T12:49:48.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.170+0000 7f1625cb5b80 1 -- 172.21.15.46:0/454857667 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x559149f87c30 msgr2=0x559149f86090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:49:48.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.170+0000 7f1625cb5b80 1 --2- 172.21.15.46:0/454857667 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x559149f87c30 0x559149f86090 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f15f4007810 tx=0x7f15f4007b20 comp rx=0 tx=0).stop 2023-10-19T12:49:48.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.172+0000 7f1625cb5b80 1 -- 172.21.15.46:0/454857667 shutdown_connections 2023-10-19T12:49:48.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.172+0000 7f1625cb5b80 1 --2- 172.21.15.46:0/454857667 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559149f865d0 0x559149f86a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:49:48.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.172+0000 7f1625cb5b80 1 --2- 172.21.15.46:0/454857667 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559149f872d0 0x559149f876f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:49:48.178 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.172+0000 7f1625cb5b80 1 --2- 172.21.15.46:0/454857667 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x559149f87c30 0x559149f86090 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:49:48.178 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.172+0000 7f1625cb5b80 1 -- 172.21.15.46:0/454857667 >> 172.21.15.46:0/454857667 conn(0x559149efa720 msgr2=0x559149f80b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:49:48.178 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.172+0000 7f1625cb5b80 1 -- 172.21.15.46:0/454857667 shutdown_connections 2023-10-19T12:49:48.178 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.172+0000 7f1625cb5b80 1 -- 172.21.15.46:0/454857667 wait complete. 2023-10-19T12:49:48.178 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.173+0000 7f1625cb5b80 1 -- start start 2023-10-19T12:49:48.179 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.173+0000 7f1625cb5b80 1 Processor -- start 2023-10-19T12:49:48.180 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.174+0000 7f1625cb5b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559149f865d0 0x559149f8fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:49:48.180 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.174+0000 7f1625cb5b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559149f872d0 0x559149f900d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:49:48.180 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.174+0000 7f1625cb5b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x559149f87c30 0x559149f970c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:49:48.181 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.174+0000 7f16037fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559149f872d0 0x559149f900d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:49:48.181 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.174+0000 7f160bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559149f865d0 0x559149f8fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:49:48.181 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.174+0000 7f16037fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559149f872d0 0x559149f900d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:52686/0 (socket says 172.21.15.46:52686) 2023-10-19T12:49:48.181 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.174+0000 7f16037fe700 1 -- 172.21.15.46:0/3431249242 learned_addr learned my addr 172.21.15.46:0/3431249242 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:49:48.182 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.174+0000 7f161099c700 1 --2- 172.21.15.46:0/3431249242 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x559149f87c30 0x559149f970c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:49:48.182 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.174+0000 7f1625cb5b80 1 -- 172.21.15.46:0/3431249242 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x559149ed8e70 con 0x559149f865d0 2023-10-19T12:49:48.182 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.174+0000 7f1625cb5b80 1 -- 172.21.15.46:0/3431249242 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x559149e75710 con 0x559149f87c30 2023-10-19T12:49:48.182 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.174+0000 7f1625cb5b80 1 -- 172.21.15.46:0/3431249242 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x559149e753b0 con 0x559149f872d0 2023-10-19T12:49:48.182 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.175+0000 7f1625cb5b80 10 client.0 _ll_register_callbacks cb 0x559149dbfa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:49:48.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.175+0000 7f161099c700 1 -- 172.21.15.46:0/3431249242 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559149f872d0 msgr2=0x559149f900d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:49:48.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.175+0000 7f161099c700 1 --2- 172.21.15.46:0/3431249242 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559149f872d0 0x559149f900d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:49:48.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.175+0000 7f161099c700 1 -- 172.21.15.46:0/3431249242 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559149f865d0 msgr2=0x559149f8fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:49:48.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.175+0000 7f161099c700 1 --2- 172.21.15.46:0/3431249242 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559149f865d0 0x559149f8fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:49:48.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.175+0000 7f161099c700 1 -- 172.21.15.46:0/3431249242 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15f400e040 con 0x559149f87c30 2023-10-19T12:49:48.183 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.175+0000 7f15eb7fe700 10 client.0 ms_handle_connect on v2:172.21.15.157:3300/0 2023-10-19T12:49:48.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.176+0000 7f161099c700 1 --2- 172.21.15.46:0/3431249242 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x559149f87c30 0x559149f970c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1604003790 tx=0x7f1604009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc7b56de591e6a77 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:49:48.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.176+0000 7f15eb7fe700 1 -- 172.21.15.46:0/3431249242 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f160400f840 con 0x559149f87c30 2023-10-19T12:49:48.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.176+0000 7f1625cb5b80 1 -- 172.21.15.46:0/3431249242 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559149eddef0 con 0x559149f87c30 2023-10-19T12:49:48.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.176+0000 7f15eb7fe700 1 -- 172.21.15.46:0/3431249242 <== mon.2 v2:172.21.15.157:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f160400f9a0 con 0x559149f87c30 2023-10-19T12:49:48.184 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.177+0000 7f15eb7fe700 1 -- 172.21.15.46:0/3431249242 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f160400f840 con 0x559149f87c30 2023-10-19T12:49:48.185 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.180+0000 7f1625cb5b80 10 client.25994 fetch_fsmap learned FSMap version 43 2023-10-19T12:49:48.186 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.180+0000 7f1625cb5b80 1 -- 172.21.15.46:0/3431249242 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x559149d03de0 con 0x559149f87c30 2023-10-19T12:49:48.186 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.180+0000 7f15eb7fe700 1 -- 172.21.15.46:0/3431249242 <== mon.2 v2:172.21.15.157:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1604039030 con 0x559149f87c30 2023-10-19T12:49:48.186 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.181+0000 7f15eb7fe700 1 -- 172.21.15.46:0/3431249242 <== mon.2 v2:172.21.15.157:3300/0 5 ==== fsmap(e 43) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f1604030020 con 0x559149f87c30 2023-10-19T12:49:48.186 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.181+0000 7f1625cb5b80 10 client.25994 fetch_fsmap finished waiting for FSMap version 43 2023-10-19T12:49:48.187 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.181+0000 7f1625cb5b80 10 client.25994 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-19T12:49:48.187 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.181+0000 7f1625cb5b80 20 client.25994 populate_metadata read hostname 'smithi046' 2023-10-19T12:49:48.187 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.181+0000 7f1625cb5b80 1 --2- 172.21.15.46:0/3431249242 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x559149f9b750 0x559149f9db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:49:48.187 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.181+0000 7f1625cb5b80 4 client.25994 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-19T12:49:48.187 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.181+0000 7f1625cb5b80 1 -- 172.21.15.46:0/3431249242 --> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559149f558b0 con 0x559149f9b750 2023-10-19T12:49:48.188 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.181+0000 7f160bfff700 1 --2- 172.21.15.46:0/3431249242 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x559149f9b750 0x559149f9db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:49:48.188 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.182+0000 7f160bfff700 1 --2- 172.21.15.46:0/3431249242 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x559149f9b750 0x559149f9db70 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da9c139d8f2ab4c1 server_cookie=718bdf8f65d6cab2 in_seq=0 out_seq=0 2023-10-19T12:49:48.188 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.182+0000 7f15eb7fe700 10 client.25994 ms_handle_connect on v2:172.21.15.157:6838/552718978 2023-10-19T12:49:48.189 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.183+0000 7f15eb7fe700 1 -- 172.21.15.46:0/3431249242 <== mds.0 v2:172.21.15.157:6838/552718978 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x559149f558b0 con 0x559149f9b750 2023-10-19T12:49:48.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.183+0000 7f15eb7fe700 10 client.25994 handle_command_reply: tid=0 2023-10-19T12:49:48.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.183+0000 7f1625cb5b80 1 client.25994 shutdown 2023-10-19T12:49:48.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.184+0000 7f1625cb5b80 1 -- 172.21.15.46:0/3431249242 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x559149f87c30 msgr2=0x559149f970c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:49:48.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.184+0000 7f1625cb5b80 1 --2- 172.21.15.46:0/3431249242 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x559149f87c30 0x559149f970c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1604003790 tx=0x7f1604009310 comp rx=0 tx=0).stop 2023-10-19T12:49:48.190 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.184+0000 7f1625cb5b80 1 -- 172.21.15.46:0/3431249242 shutdown_connections 2023-10-19T12:49:48.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.184+0000 7f1625cb5b80 1 --2- 172.21.15.46:0/3431249242 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x559149f87c30 0x559149f970c0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:49:48.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.184+0000 7f1625cb5b80 1 --2- 172.21.15.46:0/3431249242 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x559149f9b750 0x559149f9db70 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:49:48.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.184+0000 7f1625cb5b80 1 --2- 172.21.15.46:0/3431249242 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559149f865d0 0x559149f8fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:49:48.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.184+0000 7f1625cb5b80 1 --2- 172.21.15.46:0/3431249242 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559149f872d0 0x559149f900d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:49:48.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.184+0000 7f1625cb5b80 1 -- 172.21.15.46:0/3431249242 >> 172.21.15.46:0/3431249242 conn(0x559149efa720 msgr2=0x559149f85080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:49:48.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.184+0000 7f15eb7fe700 0 client.25994 ms_handle_reset on v2:172.21.15.157:6838/552718978 2023-10-19T12:49:48.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.184+0000 7f1625cb5b80 1 -- 172.21.15.46:0/3431249242 shutdown_connections 2023-10-19T12:49:48.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.186+0000 7f1625cb5b80 1 -- 172.21.15.46:0/3431249242 wait complete. 2023-10-19T12:49:48.192 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.186+0000 7f1625cb5b80 20 client.25994 trim_cache size 0 max 16384 2023-10-19T12:49:48.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:49:47 smithi046 ceph-mon[98509]: pgmap v542: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.4 MiB/s wr, 557 op/s 2023-10-19T12:49:48.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.233+0000 7f1625cb5b80 1 Processor -- start 2023-10-19T12:49:48.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.233+0000 7f1625cb5b80 1 -- start start 2023-10-19T12:49:48.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.234+0000 7f1625cb5b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559149f865d0 0x559149f869b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:49:48.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.234+0000 7f1625cb5b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x559149f872d0 0x559149f96fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:49:48.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.234+0000 7f1625cb5b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559149f87c30 0x559149f8dae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:49:48.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.234+0000 7f1625cb5b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x559149d59920 con 0x559149f87c30 2023-10-19T12:49:48.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.234+0000 7f1625cb5b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x559149f8f700 con 0x559149f872d0 2023-10-19T12:49:48.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.234+0000 7f1625cb5b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x559149f97550 con 0x559149f865d0 2023-10-19T12:49:48.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.235+0000 7f16037fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x559149f872d0 0x559149f96fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:49:48.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.235+0000 7f160bfff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559149f865d0 0x559149f869b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:49:48.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.235+0000 7f16037fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x559149f872d0 0x559149f96fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:37954/0 (socket says 172.21.15.46:37954) 2023-10-19T12:49:48.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.235+0000 7f16037fe700 1 -- 172.21.15.46:0/4221114632 learned_addr learned my addr 172.21.15.46:0/4221114632 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:49:48.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.235+0000 7f160bfff700 1 -- 172.21.15.46:0/4221114632 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x559149f872d0 msgr2=0x559149f96fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:49:48.241 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.235+0000 7f160bfff700 1 --2- 172.21.15.46:0/4221114632 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x559149f872d0 0x559149f96fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:49:48.241 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.235+0000 7f160bfff700 1 -- 172.21.15.46:0/4221114632 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559149f87c30 msgr2=0x559149f8dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:49:48.241 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.235+0000 7f160bfff700 1 --2- 172.21.15.46:0/4221114632 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559149f87c30 0x559149f8dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:49:48.241 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.235+0000 7f160bfff700 1 -- 172.21.15.46:0/4221114632 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559149cecc60 con 0x559149f865d0 2023-10-19T12:49:48.241 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.235+0000 7f160bfff700 1 --2- 172.21.15.46:0/4221114632 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559149f865d0 0x559149f869b0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f15fc014040 tx=0x7f15fc0ba040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f50bb385d24699b server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:49:48.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.236+0000 7f1602ffd700 1 -- 172.21.15.46:0/4221114632 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15fc0a2c70 con 0x559149f865d0 2023-10-19T12:49:48.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.236+0000 7f1602ffd700 1 -- 172.21.15.46:0/4221114632 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f15fc098a20 con 0x559149f865d0 2023-10-19T12:49:48.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.236+0000 7f1602ffd700 1 -- 172.21.15.46:0/4221114632 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15fc099dd0 con 0x559149f865d0 2023-10-19T12:49:48.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.237+0000 7f1625cb5b80 1 -- 172.21.15.46:0/4221114632 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559149f865d0 msgr2=0x559149f869b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:49:48.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.237+0000 7f1625cb5b80 1 --2- 172.21.15.46:0/4221114632 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559149f865d0 0x559149f869b0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f15fc014040 tx=0x7f15fc0ba040 comp rx=0 tx=0).stop 2023-10-19T12:49:48.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.237+0000 7f1625cb5b80 1 -- 172.21.15.46:0/4221114632 shutdown_connections 2023-10-19T12:49:48.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.237+0000 7f1625cb5b80 1 --2- 172.21.15.46:0/4221114632 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559149f87c30 0x559149f8dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:49:48.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.237+0000 7f1625cb5b80 1 --2- 172.21.15.46:0/4221114632 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559149f865d0 0x559149f869b0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:49:48.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.237+0000 7f1625cb5b80 1 --2- 172.21.15.46:0/4221114632 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x559149f872d0 0x559149f96fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:49:48.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.237+0000 7f1625cb5b80 1 -- 172.21.15.46:0/4221114632 >> 172.21.15.46:0/4221114632 conn(0x559149efa720 msgr2=0x559149f80b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:49:48.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.237+0000 7f1625cb5b80 1 -- 172.21.15.46:0/4221114632 shutdown_connections 2023-10-19T12:49:48.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.237+0000 7f1625cb5b80 1 -- 172.21.15.46:0/4221114632 wait complete. 2023-10-19T12:49:48.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.238+0000 7f1625cb5b80 1 -- start start 2023-10-19T12:49:48.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.238+0000 7f1625cb5b80 1 Processor -- start 2023-10-19T12:49:48.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.239+0000 7f1625cb5b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559149f865d0 0x559149f96db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:49:48.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.239+0000 7f1625cb5b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x559149f872d0 0x559149f953c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:49:48.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.239+0000 7f1625cb5b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559149f87c30 0x559149f95900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:49:48.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.239+0000 7f1625cb5b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x559149f95f20 con 0x559149f87c30 2023-10-19T12:49:48.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.239+0000 7f1625cb5b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x559149f96060 con 0x559149f872d0 2023-10-19T12:49:48.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.239+0000 7f1625cb5b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x559149f96220 con 0x559149f865d0 2023-10-19T12:49:48.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.239+0000 7f160bfff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559149f865d0 0x559149f96db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:49:48.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.239+0000 7f1625cb5b80 10 client.0 _ll_register_callbacks cb 0x559149dbfa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:49:48.248 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.239+0000 7f160bfff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559149f865d0 0x559149f96db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:52704/0 (socket says 172.21.15.46:52704) 2023-10-19T12:49:48.248 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.239+0000 7f160bfff700 1 -- 172.21.15.46:0/1051593837 learned_addr learned my addr 172.21.15.46:0/1051593837 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:49:48.248 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.239+0000 7f16037fe700 1 --2- 172.21.15.46:0/1051593837 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x559149f872d0 0x559149f953c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:49:48.248 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.240+0000 7f161099c700 1 --2- 172.21.15.46:0/1051593837 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559149f87c30 0x559149f95900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:49:48.248 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.240+0000 7f16037fe700 1 -- 172.21.15.46:0/1051593837 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559149f865d0 msgr2=0x559149f96db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:49:48.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.240+0000 7f16037fe700 1 --2- 172.21.15.46:0/1051593837 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559149f865d0 0x559149f96db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:49:48.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.240+0000 7f16037fe700 1 -- 172.21.15.46:0/1051593837 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559149f87c30 msgr2=0x559149f95900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:49:48.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.240+0000 7f16037fe700 1 --2- 172.21.15.46:0/1051593837 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559149f87c30 0x559149f95900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:49:48.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.240+0000 7f16037fe700 1 -- 172.21.15.46:0/1051593837 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f160c1a52b0 con 0x559149f872d0 2023-10-19T12:49:48.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.241+0000 7f16037fe700 1 --2- 172.21.15.46:0/1051593837 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x559149f872d0 0x559149f953c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x559149f82630 tx=0x7f15f4012820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=82c7dcb393b7f814 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:49:48.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.241+0000 7f15eb7fe700 10 client.0 ms_handle_connect on v2:172.21.15.157:3300/0 2023-10-19T12:49:48.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.241+0000 7f15eb7fe700 1 -- 172.21.15.46:0/1051593837 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f4022040 con 0x559149f872d0 2023-10-19T12:49:48.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.241+0000 7f1625cb5b80 1 -- 172.21.15.46:0/1051593837 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f15f4012c10 con 0x559149f872d0 2023-10-19T12:49:48.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.241+0000 7f15eb7fe700 1 -- 172.21.15.46:0/1051593837 <== mon.2 v2:172.21.15.157:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f15f4012a50 con 0x559149f872d0 2023-10-19T12:49:48.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.241+0000 7f15eb7fe700 1 -- 172.21.15.46:0/1051593837 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f15f4004250 con 0x559149f872d0 2023-10-19T12:49:48.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.241+0000 7f1625cb5b80 10 client.26000 fetch_fsmap learned FSMap version 43 2023-10-19T12:49:48.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.241+0000 7f1625cb5b80 1 -- 172.21.15.46:0/1051593837 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x559149d2a250 con 0x559149f872d0 2023-10-19T12:49:48.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.242+0000 7f15eb7fe700 1 -- 172.21.15.46:0/1051593837 <== mon.2 v2:172.21.15.157:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f15f4012c10 con 0x559149f872d0 2023-10-19T12:49:48.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.242+0000 7f15eb7fe700 1 -- 172.21.15.46:0/1051593837 <== mon.2 v2:172.21.15.157:3300/0 5 ==== fsmap(e 43) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f15f4013480 con 0x559149f872d0 2023-10-19T12:49:48.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.242+0000 7f1625cb5b80 10 client.26000 fetch_fsmap finished waiting for FSMap version 43 2023-10-19T12:49:48.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.242+0000 7f1625cb5b80 10 client.26000 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-19T12:49:48.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.242+0000 7f1625cb5b80 20 client.26000 populate_metadata read hostname 'smithi046' 2023-10-19T12:49:48.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.242+0000 7f1625cb5b80 1 --2- 172.21.15.46:0/1051593837 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x559149ff0e60 0x559149ff3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:49:48.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.242+0000 7f1625cb5b80 4 client.26000 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-19T12:49:48.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.242+0000 7f1625cb5b80 1 -- 172.21.15.46:0/1051593837 --> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x559149ed1e50 con 0x559149ff0e60 2023-10-19T12:49:48.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.242+0000 7f160bfff700 1 --2- 172.21.15.46:0/1051593837 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x559149ff0e60 0x559149ff3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:49:48.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.243+0000 7f15eb7fe700 10 client.26000 ms_handle_connect on v2:172.21.15.157:6838/552718978 2023-10-19T12:49:48.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.244+0000 7f160bfff700 1 --2- 172.21.15.46:0/1051593837 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x559149ff0e60 0x559149ff3280 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dcb224c4f452e2d0 server_cookie=e0f071b70fb53cc4 in_seq=0 out_seq=0 2023-10-19T12:49:48.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.246+0000 7f15eb7fe700 1 -- 172.21.15.46:0/1051593837 <== mds.0 v2:172.21.15.157:6838/552718978 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x559149ed1e50 con 0x559149ff0e60 2023-10-19T12:49:48.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.246+0000 7f15eb7fe700 10 client.26000 handle_command_reply: tid=0 2023-10-19T12:49:48.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.246+0000 7f1625cb5b80 1 client.26000 shutdown 2023-10-19T12:49:48.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.246+0000 7f1625cb5b80 1 -- 172.21.15.46:0/1051593837 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x559149f872d0 msgr2=0x559149f953c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:49:48.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.246+0000 7f1625cb5b80 1 --2- 172.21.15.46:0/1051593837 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x559149f872d0 0x559149f953c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x559149f82630 tx=0x7f15f4012820 comp rx=0 tx=0).stop 2023-10-19T12:49:48.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.247+0000 7f1625cb5b80 1 -- 172.21.15.46:0/1051593837 shutdown_connections 2023-10-19T12:49:48.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.247+0000 7f1625cb5b80 1 --2- 172.21.15.46:0/1051593837 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x559149ff0e60 0x559149ff3280 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:49:48.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.247+0000 7f1625cb5b80 1 --2- 172.21.15.46:0/1051593837 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559149f87c30 0x559149f95900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:49:48.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.247+0000 7f1625cb5b80 1 --2- 172.21.15.46:0/1051593837 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559149f865d0 0x559149f96db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:49:48.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.247+0000 7f1625cb5b80 1 --2- 172.21.15.46:0/1051593837 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x559149f872d0 0x559149f953c0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:49:48.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.247+0000 7f1625cb5b80 1 -- 172.21.15.46:0/1051593837 >> 172.21.15.46:0/1051593837 conn(0x559149efa720 msgr2=0x559149f8f940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:49:48.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.247+0000 7f15eb7fe700 0 client.26000 ms_handle_reset on v2:172.21.15.157:6838/552718978 2023-10-19T12:49:48.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.247+0000 7f1625cb5b80 1 -- 172.21.15.46:0/1051593837 shutdown_connections 2023-10-19T12:49:48.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.247+0000 7f1625cb5b80 1 -- 172.21.15.46:0/1051593837 wait complete. 2023-10-19T12:49:48.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.247+0000 7f1625cb5b80 20 client.26000 trim_cache size 0 max 16384 2023-10-19T12:49:48.258 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-10-19T12:49:48.258 INFO:teuthology.orchestra.run.smithi046.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-19T12:49:48.258 INFO:teuthology.orchestra.run.smithi046.stdout: "scrubs": { 2023-10-19T12:49:48.258 INFO:teuthology.orchestra.run.smithi046.stdout: "21e73f70-af16-4ae7-bc34-e6c54ba8e1ec": { 2023-10-19T12:49:48.259 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2023-10-19T12:49:48.259 INFO:teuthology.orchestra.run.smithi046.stdout: "tag": "21e73f70-af16-4ae7-bc34-e6c54ba8e1ec", 2023-10-19T12:49:48.259 INFO:teuthology.orchestra.run.smithi046.stdout: "options": "recursive,force" 2023-10-19T12:49:48.259 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:49:48.259 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:49:48.260 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-10-19T12:49:48.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.248+0000 7f16123ff700 1 -- 172.21.15.46:0/3244591670 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f15f80a1550 msgr2=0x7f15f80a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:49:48.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.248+0000 7f16123ff700 1 --2- 172.21.15.46:0/3244591670 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f15f80a1550 0x7f15f80a3a10 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f160400a010 tx=0x7f1604009f20 comp rx=0 tx=0).stop 2023-10-19T12:49:48.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.248+0000 7f16123ff700 1 -- 172.21.15.46:0/3244591670 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f160c100790 msgr2=0x7f160c19cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:49:48.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.248+0000 7f16123ff700 1 --2- 172.21.15.46:0/3244591670 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f160c100790 0x7f160c19cda0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f15fc00b9c0 tx=0x7f15fc00bcd0 comp rx=0 tx=0).stop 2023-10-19T12:49:48.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.248+0000 7f16123ff700 1 -- 172.21.15.46:0/3244591670 shutdown_connections 2023-10-19T12:49:48.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.248+0000 7f16123ff700 1 --2- 172.21.15.46:0/3244591670 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f15f80a1550 0x7f15f80a3a10 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:49:48.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.248+0000 7f16123ff700 1 --2- 172.21.15.46:0/3244591670 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f160c102320 0x7f160c1a4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:49:48.262 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.248+0000 7f16123ff700 1 --2- 172.21.15.46:0/3244591670 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f160c100790 0x7f160c19cda0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:49:48.262 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.248+0000 7f16123ff700 1 --2- 172.21.15.46:0/3244591670 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f160c101980 0x7f160c19d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:49:48.262 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.248+0000 7f16123ff700 1 -- 172.21.15.46:0/3244591670 >> 172.21.15.46:0/3244591670 conn(0x7f160c0fbd00 msgr2=0x7f160c104c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:49:48.262 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.249+0000 7f16123ff700 1 -- 172.21.15.46:0/3244591670 shutdown_connections 2023-10-19T12:49:48.262 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:49:48.250+0000 7f16123ff700 1 -- 172.21.15.46:0/3244591670 wait complete. 2023-10-19T12:49:48.287 INFO:tasks.cephfs.filesystem:scrub status for tag:21e73f70-af16-4ae7-bc34-e6c54ba8e1ec - {'path': '/', 'tag': '21e73f70-af16-4ae7-bc34-e6c54ba8e1ec', 'options': 'recursive,force'} 2023-10-19T12:49:48.344 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:49:47 smithi157 ceph-mon[134109]: pgmap v542: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.4 MiB/s wr, 557 op/s 2023-10-19T12:49:48.382 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:49:47 smithi195 ceph-mon[134493]: pgmap v542: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.4 MiB/s wr, 557 op/s 2023-10-19T12:49:49.837 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:49:49 smithi157 ceph-mon[134109]: pgmap v543: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 7.4 MiB/s wr, 498 op/s 2023-10-19T12:49:49.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:49:49 smithi195 ceph-mon[134493]: pgmap v543: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 7.4 MiB/s wr, 498 op/s 2023-10-19T12:49:49.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:49:49 smithi046 ceph-mon[98509]: pgmap v543: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 7.4 MiB/s wr, 498 op/s 2023-10-19T12:49:51.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 350.0 s, 472.0 tps, lat 189.341 ms stddev 228.007 2023-10-19T12:49:52.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:49:51 smithi046 ceph-mon[98509]: pgmap v544: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.3 MiB/s wr, 504 op/s 2023-10-19T12:49:52.339 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:49:51 smithi157 ceph-mon[134109]: pgmap v544: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.3 MiB/s wr, 504 op/s 2023-10-19T12:49:52.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:49:51 smithi195 ceph-mon[134493]: pgmap v544: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.3 MiB/s wr, 504 op/s 2023-10-19T12:49:54.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:49:53 smithi046 ceph-mon[98509]: pgmap v545: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 MiB/s wr, 765 op/s 2023-10-19T12:49:54.341 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:49:53 smithi157 ceph-mon[134109]: pgmap v545: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 MiB/s wr, 765 op/s 2023-10-19T12:49:54.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:49:53 smithi195 ceph-mon[134493]: pgmap v545: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 MiB/s wr, 765 op/s 2023-10-19T12:49:55.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:49:54 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:49:55.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:49:54 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:49:55.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:49:54 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:49:56.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:49:55 smithi046 ceph-mon[98509]: pgmap v546: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.3 MiB/s wr, 671 op/s 2023-10-19T12:49:56.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:49:55 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:49:56.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:49:55 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:49:56.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:49:55 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:49:56.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:49:55 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:49:56.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:49:55 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:49:56.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:49:55 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:49:56.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:49:55 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:49:56.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:49:55 smithi157 ceph-mon[134109]: pgmap v546: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.3 MiB/s wr, 671 op/s 2023-10-19T12:49:56.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:49:55 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:49:56.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:49:55 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:49:56.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:49:55 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:49:56.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:49:55 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:49:56.339 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:49:55 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:49:56.339 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:49:55 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:49:56.339 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:49:55 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:49:56.388 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:49:55 smithi195 ceph-mon[134493]: pgmap v546: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.3 MiB/s wr, 671 op/s 2023-10-19T12:49:56.388 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:49:55 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:49:56.389 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:49:55 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:49:56.389 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:49:55 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:49:56.389 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:49:55 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:49:56.389 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:49:55 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:49:56.389 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:49:55 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:49:56.390 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:49:55 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:49:56.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 355.0 s, 307.8 tps, lat 349.402 ms stddev 532.642 2023-10-19T12:49:57.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:49:56 smithi157 ceph-mon[134109]: Adjusting osd_memory_target on smithi046 to 223.0M 2023-10-19T12:49:57.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:49:56 smithi157 ceph-mon[134109]: Unable to set osd_memory_target on smithi046 to 233878220: error parsing value: Value '233878220' is below minimum 939524096 2023-10-19T12:49:57.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:49:56 smithi195 ceph-mon[134493]: Adjusting osd_memory_target on smithi046 to 223.0M 2023-10-19T12:49:57.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:49:56 smithi195 ceph-mon[134493]: Unable to set osd_memory_target on smithi046 to 233878220: error parsing value: Value '233878220' is below minimum 939524096 2023-10-19T12:49:57.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:49:56 smithi046 ceph-mon[98509]: Adjusting osd_memory_target on smithi046 to 223.0M 2023-10-19T12:49:57.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:49:56 smithi046 ceph-mon[98509]: Unable to set osd_memory_target on smithi046 to 233878220: error parsing value: Value '233878220' is below minimum 939524096 2023-10-19T12:49:58.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:49:58 smithi157 ceph-mon[134109]: pgmap v547: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 18 MiB/s wr, 1.29k op/s 2023-10-19T12:49:58.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:49:58 smithi195 ceph-mon[134493]: pgmap v547: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 18 MiB/s wr, 1.29k op/s 2023-10-19T12:49:58.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:49:58 smithi046 ceph-mon[98509]: pgmap v547: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 18 MiB/s wr, 1.29k op/s 2023-10-19T12:49:59.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:49:59 smithi195 ceph-mon[134493]: pgmap v548: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 19 MiB/s wr, 1.28k op/s 2023-10-19T12:49:59.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:49:59 smithi046 ceph-mon[98509]: pgmap v548: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 19 MiB/s wr, 1.28k op/s 2023-10-19T12:50:00.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:49:59 smithi157 ceph-mon[134109]: pgmap v548: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 19 MiB/s wr, 1.28k op/s 2023-10-19T12:50:00.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:50:00 smithi195 ceph-mon[134493]: overall HEALTH_OK 2023-10-19T12:50:00.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:50:00 smithi046 ceph-mon[98509]: overall HEALTH_OK 2023-10-19T12:50:01.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:50:00 smithi157 ceph-mon[134109]: overall HEALTH_OK 2023-10-19T12:50:01.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 360.0 s, 520.2 tps, lat 185.767 ms stddev 214.721 2023-10-19T12:50:01.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:50:01 smithi046 ceph-mon[98509]: pgmap v549: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 18 MiB/s wr, 1.29k op/s 2023-10-19T12:50:02.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:50:01 smithi157 ceph-mon[134109]: pgmap v549: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 18 MiB/s wr, 1.29k op/s 2023-10-19T12:50:02.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:50:01 smithi195 ceph-mon[134493]: pgmap v549: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 18 MiB/s wr, 1.29k op/s 2023-10-19T12:50:04.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:50:03 smithi046 ceph-mon[98509]: pgmap v550: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 19 MiB/s wr, 1.38k op/s 2023-10-19T12:50:04.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:50:03 smithi157 ceph-mon[134109]: pgmap v550: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 19 MiB/s wr, 1.38k op/s 2023-10-19T12:50:04.385 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:50:03 smithi195 ceph-mon[134493]: pgmap v550: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 19 MiB/s wr, 1.38k op/s 2023-10-19T12:50:06.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:50:05 smithi157 ceph-mon[134109]: pgmap v551: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 15 MiB/s wr, 1.06k op/s 2023-10-19T12:50:06.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:50:05 smithi195 ceph-mon[134493]: pgmap v551: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 15 MiB/s wr, 1.06k op/s 2023-10-19T12:50:06.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 365.0 s, 581.6 tps, lat 175.325 ms stddev 294.952 2023-10-19T12:50:06.971 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:50:05 smithi046 ceph-mon[98509]: pgmap v551: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 15 MiB/s wr, 1.06k op/s 2023-10-19T12:50:08.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:50:07 smithi157 ceph-mon[134109]: pgmap v552: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 17 MiB/s wr, 1.19k op/s 2023-10-19T12:50:08.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:50:07 smithi195 ceph-mon[134493]: pgmap v552: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 17 MiB/s wr, 1.19k op/s 2023-10-19T12:50:08.768 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:50:07 smithi046 ceph-mon[98509]: pgmap v552: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 17 MiB/s wr, 1.19k op/s 2023-10-19T12:50:09.837 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:50:09 smithi157 ceph-mon[134109]: pgmap v553: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 8.0 MiB/s wr, 604 op/s 2023-10-19T12:50:09.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:50:09 smithi195 ceph-mon[134493]: pgmap v553: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 8.0 MiB/s wr, 604 op/s 2023-10-19T12:50:10.872 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:50:09 smithi046 ceph-mon[98509]: pgmap v553: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 8.0 MiB/s wr, 604 op/s 2023-10-19T12:50:11.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 370.0 s, 397.2 tps, lat 260.938 ms stddev 330.909 2023-10-19T12:50:12.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:50:11 smithi046 ceph-mon[98509]: pgmap v554: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 8.2 MiB/s wr, 590 op/s 2023-10-19T12:50:12.340 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:50:11 smithi157 ceph-mon[134109]: pgmap v554: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 8.2 MiB/s wr, 590 op/s 2023-10-19T12:50:12.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:50:11 smithi195 ceph-mon[134493]: pgmap v554: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 8.2 MiB/s wr, 590 op/s 2023-10-19T12:50:14.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:50:13 smithi046 ceph-mon[98509]: pgmap v555: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 9.5 MiB/s wr, 719 op/s 2023-10-19T12:50:14.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:50:13 smithi157 ceph-mon[134109]: pgmap v555: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 9.5 MiB/s wr, 719 op/s 2023-10-19T12:50:14.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:50:13 smithi195 ceph-mon[134493]: pgmap v555: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 9.5 MiB/s wr, 719 op/s 2023-10-19T12:50:16.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:50:15 smithi046 ceph-mon[98509]: pgmap v556: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 7.9 MiB/s wr, 564 op/s 2023-10-19T12:50:16.345 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:50:15 smithi157 ceph-mon[134109]: pgmap v556: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 7.9 MiB/s wr, 564 op/s 2023-10-19T12:50:16.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:50:15 smithi195 ceph-mon[134493]: pgmap v556: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 7.9 MiB/s wr, 564 op/s 2023-10-19T12:50:16.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 375.0 s, 415.4 tps, lat 238.990 ms stddev 291.358 2023-10-19T12:50:18.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:50:17 smithi046 ceph-mon[98509]: pgmap v557: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 10 MiB/s wr, 750 op/s 2023-10-19T12:50:18.288 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-19T12:50:18.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:50:17 smithi157 ceph-mon[134109]: pgmap v557: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 10 MiB/s wr, 750 op/s 2023-10-19T12:50:18.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:50:17 smithi195 ceph-mon[134493]: pgmap v557: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 10 MiB/s wr, 750 op/s 2023-10-19T12:50:19.837 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:50:19 smithi157 ceph-mon[134109]: pgmap v558: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 8.9 MiB/s wr, 657 op/s 2023-10-19T12:50:19.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:50:19 smithi195 ceph-mon[134493]: pgmap v558: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 8.9 MiB/s wr, 657 op/s 2023-10-19T12:50:19.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:50:19 smithi046 ceph-mon[98509]: pgmap v558: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 8.9 MiB/s wr, 657 op/s 2023-10-19T12:50:20.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.653+0000 7f11e4dff700 1 -- 172.21.15.46:0/3771406332 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11e01007d0 msgr2=0x7f11e0100bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:50:20.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.653+0000 7f11e4dff700 1 --2- 172.21.15.46:0/3771406332 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11e01007d0 0x7f11e0100bf0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f11d800b0a0 tx=0x7f11d800b3b0 comp rx=0 tx=0).stop 2023-10-19T12:50:20.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.653+0000 7f11e4dff700 1 -- 172.21.15.46:0/3771406332 shutdown_connections 2023-10-19T12:50:20.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.653+0000 7f11e4dff700 1 --2- 172.21.15.46:0/3771406332 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f11e0102360 0x7f11e0108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:50:20.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.653+0000 7f11e4dff700 1 --2- 172.21.15.46:0/3771406332 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11e01007d0 0x7f11e0100bf0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:50:20.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.653+0000 7f11e4dff700 1 --2- 172.21.15.46:0/3771406332 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f11e01019c0 0x7f11e0101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:50:20.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.653+0000 7f11e4dff700 1 -- 172.21.15.46:0/3771406332 >> 172.21.15.46:0/3771406332 conn(0x7f11e00fbd40 msgr2=0x7f11e00fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:50:20.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.653+0000 7f11e4dff700 1 -- 172.21.15.46:0/3771406332 shutdown_connections 2023-10-19T12:50:20.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.654+0000 7f11e4dff700 1 -- 172.21.15.46:0/3771406332 wait complete. 2023-10-19T12:50:20.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.655+0000 7f11e4dff700 1 Processor -- start 2023-10-19T12:50:20.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.656+0000 7f11e4dff700 1 -- start start 2023-10-19T12:50:20.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.656+0000 7f11e4dff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f11e01007d0 0x7f11e0194660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:50:20.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.656+0000 7f11e4dff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f11e01019c0 0x7f11e0194ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:50:20.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.656+0000 7f11e4dff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11e0102360 0x7f11e01ad0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:50:20.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.656+0000 7f11e4dff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11e0199c40 con 0x7f11e01007d0 2023-10-19T12:50:20.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.656+0000 7f11e4dff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11e0199db0 con 0x7f11e01019c0 2023-10-19T12:50:20.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.656+0000 7f11e4dff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11e01ad600 con 0x7f11e0102360 2023-10-19T12:50:20.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.656+0000 7f11ddd9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f11e01019c0 0x7f11e0194ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:50:20.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.656+0000 7f11ded9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11e0102360 0x7f11e01ad0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:50:20.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.656+0000 7f11ddd9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f11e01019c0 0x7f11e0194ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:36362/0 (socket says 172.21.15.46:36362) 2023-10-19T12:50:20.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.656+0000 7f11ddd9b700 1 -- 172.21.15.46:0/708693662 learned_addr learned my addr 172.21.15.46:0/708693662 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:50:20.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.657+0000 7f11ded9d700 1 -- 172.21.15.46:0/708693662 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f11e01019c0 msgr2=0x7f11e0194ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:50:20.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.657+0000 7f11ded9d700 1 --2- 172.21.15.46:0/708693662 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f11e01019c0 0x7f11e0194ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:50:20.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.657+0000 7f11ded9d700 1 -- 172.21.15.46:0/708693662 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f11e01007d0 msgr2=0x7f11e0194660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:50:20.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.657+0000 7f11ded9d700 1 --2- 172.21.15.46:0/708693662 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f11e01007d0 0x7f11e0194660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:50:20.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.657+0000 7f11ded9d700 1 -- 172.21.15.46:0/708693662 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11d8009d00 con 0x7f11e0102360 2023-10-19T12:50:20.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.657+0000 7f11ded9d700 1 --2- 172.21.15.46:0/708693662 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11e0102360 0x7f11e01ad0c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f11d400d750 tx=0x7f11d400da60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:50:20.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.658+0000 7f11cf7fe700 1 -- 172.21.15.46:0/708693662 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d4004020 con 0x7f11e0102360 2023-10-19T12:50:20.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.658+0000 7f11cf7fe700 1 -- 172.21.15.46:0/708693662 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f11d4004830 con 0x7f11e0102360 2023-10-19T12:50:20.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.658+0000 7f11e4dff700 1 -- 172.21.15.46:0/708693662 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11e01ad740 con 0x7f11e0102360 2023-10-19T12:50:20.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.658+0000 7f11e4dff700 1 -- 172.21.15.46:0/708693662 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11e01adc20 con 0x7f11e0102360 2023-10-19T12:50:20.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.659+0000 7f11cf7fe700 1 -- 172.21.15.46:0/708693662 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d4005550 con 0x7f11e0102360 2023-10-19T12:50:20.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.665+0000 7f11cf7fe700 1 -- 172.21.15.46:0/708693662 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f11d400f690 con 0x7f11e0102360 2023-10-19T12:50:20.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.667+0000 7f11f87f3b80 1 Processor -- start 2023-10-19T12:50:20.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.667+0000 7f11f87f3b80 1 -- start start 2023-10-19T12:50:20.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.667+0000 7f11cf7fe700 1 --2- 172.21.15.46:0/708693662 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f11c80a15d0 0x7f11c80a3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:50:20.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.668+0000 7f11f87f3b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e4a29fa2d0 0x55e4a29fa6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:50:20.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.668+0000 7f11cf7fe700 1 -- 172.21.15.46:0/708693662 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f11d40cc7f0 con 0x7f11e0102360 2023-10-19T12:50:20.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.668+0000 7f11f87f3b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e4a29fac30 0x55e4a29f9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:50:20.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.668+0000 7f11f87f3b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e4a29f95d0 0x55e4a29f9a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:50:20.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.668+0000 7f11f87f3b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4a296c6e0 con 0x55e4a29fac30 2023-10-19T12:50:20.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.668+0000 7f11f87f3b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4a2952c60 con 0x55e4a29f95d0 2023-10-19T12:50:20.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.668+0000 7f11f87f3b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4a2950580 con 0x55e4a29fa2d0 2023-10-19T12:50:20.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.668+0000 7f11ded9d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e4a29f95d0 0x55e4a29f9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:50:20.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.668+0000 7f11ded9d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e4a29f95d0 0x55e4a29f9a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:36368/0 (socket says 172.21.15.46:36368) 2023-10-19T12:50:20.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.668+0000 7f11ded9d700 1 -- 172.21.15.46:0/1742514528 learned_addr learned my addr 172.21.15.46:0/1742514528 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:50:20.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.668+0000 7f11ddd9b700 1 --2- 172.21.15.46:0/708693662 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f11c80a15d0 0x7f11c80a3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:50:20.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.669+0000 7f11ded9d700 1 -- 172.21.15.46:0/1742514528 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e4a29fa2d0 msgr2=0x55e4a29fa6f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-19T12:50:20.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.669+0000 7f11ded9d700 1 --2- 172.21.15.46:0/1742514528 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e4a29fa2d0 0x55e4a29fa6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:50:20.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.669+0000 7f11ded9d700 1 -- 172.21.15.46:0/1742514528 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e4a29fac30 msgr2=0x55e4a29f9090 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-19T12:50:20.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.669+0000 7f11ded9d700 1 --2- 172.21.15.46:0/1742514528 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e4a29fac30 0x55e4a29f9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:50:20.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.669+0000 7f11ded9d700 1 -- 172.21.15.46:0/1742514528 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e4a29093f0 con 0x55e4a29f95d0 2023-10-19T12:50:20.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.669+0000 7f11ded9d700 1 --2- 172.21.15.46:0/1742514528 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e4a29f95d0 0x55e4a29f9a50 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f11d4096d60 tx=0x7f11d409d9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c1b935bdc6263bb server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:50:20.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.669+0000 7f11ccff9700 1 -- 172.21.15.46:0/1742514528 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d40b90c0 con 0x55e4a29f95d0 2023-10-19T12:50:20.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.669+0000 7f11ccff9700 1 -- 172.21.15.46:0/1742514528 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f11d4083e90 con 0x55e4a29f95d0 2023-10-19T12:50:20.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.669+0000 7f11ccff9700 1 -- 172.21.15.46:0/1742514528 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d40850b0 con 0x55e4a29f95d0 2023-10-19T12:50:20.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.670+0000 7f11f87f3b80 1 -- 172.21.15.46:0/1742514528 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e4a29f95d0 msgr2=0x55e4a29f9a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:50:20.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.670+0000 7f11f87f3b80 1 --2- 172.21.15.46:0/1742514528 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e4a29f95d0 0x55e4a29f9a50 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f11d4096d60 tx=0x7f11d409d9f0 comp rx=0 tx=0).stop 2023-10-19T12:50:20.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.670+0000 7f11ddd9b700 1 --2- 172.21.15.46:0/708693662 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f11c80a15d0 0x7f11c80a3a90 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f11d0005950 tx=0x7f11d0005eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:50:20.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.670+0000 7f11f87f3b80 1 -- 172.21.15.46:0/1742514528 shutdown_connections 2023-10-19T12:50:20.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.670+0000 7f11f87f3b80 1 --2- 172.21.15.46:0/1742514528 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e4a29f95d0 0x55e4a29f9a50 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:50:20.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.670+0000 7f11f87f3b80 1 --2- 172.21.15.46:0/1742514528 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e4a29fa2d0 0x55e4a29fa6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:50:20.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.670+0000 7f11f87f3b80 1 --2- 172.21.15.46:0/1742514528 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e4a29fac30 0x55e4a29f9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:50:20.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.670+0000 7f11f87f3b80 1 -- 172.21.15.46:0/1742514528 >> 172.21.15.46:0/1742514528 conn(0x55e4a296d720 msgr2=0x55e4a29f3b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:50:20.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.671+0000 7f11f87f3b80 1 -- 172.21.15.46:0/1742514528 shutdown_connections 2023-10-19T12:50:20.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.671+0000 7f11f87f3b80 1 -- 172.21.15.46:0/1742514528 wait complete. 2023-10-19T12:50:20.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.671+0000 7f11f87f3b80 1 -- start start 2023-10-19T12:50:20.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.672+0000 7f11f87f3b80 1 Processor -- start 2023-10-19T12:50:20.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.673+0000 7f11f87f3b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e4a29f95d0 0x55e4a2a02a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:50:20.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.673+0000 7f11f87f3b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e4a29fa2d0 0x55e4a2a02fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:50:20.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.673+0000 7f11f87f3b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e4a29fac30 0x55e4a2a0a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:50:20.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.673+0000 7f11f87f3b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4a294be70 con 0x55e4a29f95d0 2023-10-19T12:50:20.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.673+0000 7f11f87f3b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4a28e8710 con 0x55e4a29fa2d0 2023-10-19T12:50:20.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.673+0000 7f11f87f3b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4a28e83b0 con 0x55e4a29fac30 2023-10-19T12:50:20.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.673+0000 7f11f87f3b80 10 client.0 _ll_register_callbacks cb 0x55e4a2832a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:50:20.683 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.673+0000 7f11ddd9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e4a29fa2d0 0x55e4a2a02fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:50:20.683 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.673+0000 7f11ded9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e4a29fac30 0x55e4a2a0a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:50:20.683 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.674+0000 7f11ddd9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e4a29fa2d0 0x55e4a2a02fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:36372/0 (socket says 172.21.15.46:36372) 2023-10-19T12:50:20.683 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.674+0000 7f11ded9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e4a29fac30 0x55e4a2a0a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:45584/0 (socket says 172.21.15.46:45584) 2023-10-19T12:50:20.683 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.674+0000 7f11ddd9b700 1 -- 172.21.15.46:0/1772391946 learned_addr learned my addr 172.21.15.46:0/1772391946 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:50:20.684 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.674+0000 7f11ded9d700 1 -- 172.21.15.46:0/1772391946 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e4a29fa2d0 msgr2=0x55e4a2a02fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:50:20.684 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.674+0000 7f11ded9d700 1 --2- 172.21.15.46:0/1772391946 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e4a29fa2d0 0x55e4a2a02fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:50:20.684 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.674+0000 7f11ded9d700 1 -- 172.21.15.46:0/1772391946 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e4a29f95d0 msgr2=0x55e4a2a02a80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-19T12:50:20.684 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.674+0000 7f11de59c700 1 --2- 172.21.15.46:0/1772391946 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e4a29f95d0 0x55e4a2a02a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:50:20.684 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.675+0000 7f11ded9d700 1 --2- 172.21.15.46:0/1772391946 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e4a29f95d0 0x55e4a2a02a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:50:20.684 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.675+0000 7f11ded9d700 1 -- 172.21.15.46:0/1772391946 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11e01adc20 con 0x55e4a29fac30 2023-10-19T12:50:20.685 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.675+0000 7f11de59c700 1 --2- 172.21.15.46:0/1772391946 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e4a29f95d0 0x55e4a2a02a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T12:50:20.685 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.675+0000 7f11ded9d700 1 --2- 172.21.15.46:0/1772391946 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e4a29fac30 0x55e4a2a0a000 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f11d4004b10 tx=0x7f11d40056b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=92ec6d1ef430ca36 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:50:20.685 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.675+0000 7f11c5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-10-19T12:50:20.685 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.675+0000 7f11c5ffb700 1 -- 172.21.15.46:0/1772391946 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d40852e0 con 0x55e4a29fac30 2023-10-19T12:50:20.685 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.675+0000 7f11c5ffb700 1 -- 172.21.15.46:0/1772391946 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f11d409adf0 con 0x55e4a29fac30 2023-10-19T12:50:20.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.675+0000 7f11f87f3b80 1 -- 172.21.15.46:0/1772391946 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e4a2950ef0 con 0x55e4a29fac30 2023-10-19T12:50:20.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.676+0000 7f11c5ffb700 1 -- 172.21.15.46:0/1772391946 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f11d4096650 con 0x55e4a29fac30 2023-10-19T12:50:20.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.676+0000 7f11f87f3b80 10 client.26020 fetch_fsmap learned FSMap version 43 2023-10-19T12:50:20.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.676+0000 7f11f87f3b80 1 -- 172.21.15.46:0/1772391946 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x55e4a2776de0 con 0x55e4a29fac30 2023-10-19T12:50:20.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.676+0000 7f11c5ffb700 1 -- 172.21.15.46:0/1772391946 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f11d407d030 con 0x55e4a29fac30 2023-10-19T12:50:20.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.676+0000 7f11c5ffb700 1 -- 172.21.15.46:0/1772391946 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 43) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f11d4096310 con 0x55e4a29fac30 2023-10-19T12:50:20.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.677+0000 7f11f87f3b80 10 client.26020 fetch_fsmap finished waiting for FSMap version 43 2023-10-19T12:50:20.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.677+0000 7f11f87f3b80 10 client.26020 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-19T12:50:20.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.677+0000 7f11f87f3b80 20 client.26020 populate_metadata read hostname 'smithi046' 2023-10-19T12:50:20.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.677+0000 7f11f87f3b80 1 --2- 172.21.15.46:0/1772391946 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x55e4a2a0e4f0 0x55e4a2a10910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:50:20.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.677+0000 7f11f87f3b80 4 client.26020 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-19T12:50:20.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.677+0000 7f11f87f3b80 1 -- 172.21.15.46:0/1772391946 --> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e4a29c88b0 con 0x55e4a2a0e4f0 2023-10-19T12:50:20.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.678+0000 7f11de59c700 1 --2- 172.21.15.46:0/1772391946 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x55e4a2a0e4f0 0x55e4a2a10910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:50:20.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.679+0000 7f11de59c700 1 --2- 172.21.15.46:0/1772391946 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x55e4a2a0e4f0 0x55e4a2a10910 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a1ce7f5170f3152 server_cookie=2589c7c65b0ebb09 in_seq=0 out_seq=0 2023-10-19T12:50:20.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.679+0000 7f11c5ffb700 10 client.26020 ms_handle_connect on v2:172.21.15.157:6838/552718978 2023-10-19T12:50:20.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.680+0000 7f11c5ffb700 1 -- 172.21.15.46:0/1772391946 <== mds.0 v2:172.21.15.157:6838/552718978 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e4a29c88b0 con 0x55e4a2a0e4f0 2023-10-19T12:50:20.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.680+0000 7f11c5ffb700 10 client.26020 handle_command_reply: tid=0 2023-10-19T12:50:20.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.680+0000 7f11f87f3b80 1 client.26020 shutdown 2023-10-19T12:50:20.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.680+0000 7f11f87f3b80 1 -- 172.21.15.46:0/1772391946 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e4a29fac30 msgr2=0x55e4a2a0a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:50:20.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.680+0000 7f11f87f3b80 1 --2- 172.21.15.46:0/1772391946 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e4a29fac30 0x55e4a2a0a000 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f11d4004b10 tx=0x7f11d40056b0 comp rx=0 tx=0).stop 2023-10-19T12:50:20.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.680+0000 7f11f87f3b80 1 -- 172.21.15.46:0/1772391946 shutdown_connections 2023-10-19T12:50:20.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.680+0000 7f11f87f3b80 1 --2- 172.21.15.46:0/1772391946 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e4a29fac30 0x55e4a2a0a000 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:50:20.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.680+0000 7f11f87f3b80 1 --2- 172.21.15.46:0/1772391946 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x55e4a2a0e4f0 0x55e4a2a10910 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:50:20.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.680+0000 7f11f87f3b80 1 --2- 172.21.15.46:0/1772391946 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e4a29f95d0 0x55e4a2a02a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:50:20.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.680+0000 7f11f87f3b80 1 --2- 172.21.15.46:0/1772391946 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e4a29fa2d0 0x55e4a2a02fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:50:20.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.680+0000 7f11c5ffb700 0 client.26020 ms_handle_reset on v2:172.21.15.157:6838/552718978 2023-10-19T12:50:20.692 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.680+0000 7f11f87f3b80 1 -- 172.21.15.46:0/1772391946 >> 172.21.15.46:0/1772391946 conn(0x55e4a296d720 msgr2=0x55e4a29f8080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:50:20.692 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.681+0000 7f11f87f3b80 1 -- 172.21.15.46:0/1772391946 shutdown_connections 2023-10-19T12:50:20.692 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.681+0000 7f11f87f3b80 1 -- 172.21.15.46:0/1772391946 wait complete. 2023-10-19T12:50:20.692 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.681+0000 7f11f87f3b80 20 client.26020 trim_cache size 0 max 16384 2023-10-19T12:50:20.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.707+0000 7f11f87f3b80 1 Processor -- start 2023-10-19T12:50:20.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.707+0000 7f11f87f3b80 1 -- start start 2023-10-19T12:50:20.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.707+0000 7f11f87f3b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e4a29f95d0 0x55e4a29ee5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:50:20.712 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.707+0000 7f11f87f3b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e4a29fa2d0 0x55e4a2a09f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:50:20.712 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.708+0000 7f11f87f3b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e4a29fac30 0x55e4a2a02a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:50:20.712 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.708+0000 7f11f87f3b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4a27cc920 con 0x55e4a29fac30 2023-10-19T12:50:20.712 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.708+0000 7f11f87f3b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4a29f5610 con 0x55e4a29fa2d0 2023-10-19T12:50:20.712 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.708+0000 7f11f87f3b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4a2a02640 con 0x55e4a29f95d0 2023-10-19T12:50:20.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.708+0000 7f11de59c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e4a29f95d0 0x55e4a29ee5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:50:20.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.708+0000 7f11de59c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e4a29f95d0 0x55e4a29ee5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:45594/0 (socket says 172.21.15.46:45594) 2023-10-19T12:50:20.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.708+0000 7f11de59c700 1 -- 172.21.15.46:0/1937033026 learned_addr learned my addr 172.21.15.46:0/1937033026 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:50:20.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.708+0000 7f11ddd9b700 1 --2- 172.21.15.46:0/1937033026 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e4a29fa2d0 0x55e4a2a09f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:50:20.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.708+0000 7f11ded9d700 1 --2- 172.21.15.46:0/1937033026 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e4a29fac30 0x55e4a2a02a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:50:20.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.708+0000 7f11de59c700 1 -- 172.21.15.46:0/1937033026 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e4a29fa2d0 msgr2=0x55e4a2a09f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:50:20.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.708+0000 7f11de59c700 1 --2- 172.21.15.46:0/1937033026 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e4a29fa2d0 0x55e4a2a09f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:50:20.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.708+0000 7f11de59c700 1 -- 172.21.15.46:0/1937033026 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e4a29fac30 msgr2=0x55e4a2a02a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:50:20.716 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.709+0000 7f11de59c700 1 --2- 172.21.15.46:0/1937033026 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e4a29fac30 0x55e4a2a02a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:50:20.716 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.709+0000 7f11de59c700 1 -- 172.21.15.46:0/1937033026 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e4a275fc60 con 0x55e4a29f95d0 2023-10-19T12:50:20.716 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.709+0000 7f11de59c700 1 --2- 172.21.15.46:0/1937033026 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e4a29f95d0 0x55e4a29ee5d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f11d800b070 tx=0x7f11d8006040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60a7d92a54a6ef87 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:50:20.716 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.709+0000 7f11cd7fa700 1 -- 172.21.15.46:0/1937033026 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d8027070 con 0x55e4a29f95d0 2023-10-19T12:50:20.717 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.709+0000 7f11cd7fa700 1 -- 172.21.15.46:0/1937033026 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f11d80074a0 con 0x55e4a29f95d0 2023-10-19T12:50:20.717 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.709+0000 7f11cd7fa700 1 -- 172.21.15.46:0/1937033026 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d800e040 con 0x55e4a29f95d0 2023-10-19T12:50:20.717 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.711+0000 7f11f87f3b80 1 -- 172.21.15.46:0/1937033026 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e4a29f95d0 msgr2=0x55e4a29ee5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:50:20.717 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.711+0000 7f11f87f3b80 1 --2- 172.21.15.46:0/1937033026 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e4a29f95d0 0x55e4a29ee5d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f11d800b070 tx=0x7f11d8006040 comp rx=0 tx=0).stop 2023-10-19T12:50:20.717 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.711+0000 7f11f87f3b80 1 -- 172.21.15.46:0/1937033026 shutdown_connections 2023-10-19T12:50:20.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.711+0000 7f11f87f3b80 1 --2- 172.21.15.46:0/1937033026 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e4a29fac30 0x55e4a2a02a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:50:20.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.711+0000 7f11f87f3b80 1 --2- 172.21.15.46:0/1937033026 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e4a29f95d0 0x55e4a29ee5d0 secure :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f11d800b070 tx=0x7f11d8006040 comp rx=0 tx=0).stop 2023-10-19T12:50:20.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.711+0000 7f11f87f3b80 1 --2- 172.21.15.46:0/1937033026 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e4a29fa2d0 0x55e4a2a09f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:50:20.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.711+0000 7f11f87f3b80 1 -- 172.21.15.46:0/1937033026 >> 172.21.15.46:0/1937033026 conn(0x55e4a296d720 msgr2=0x55e4a29f99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:50:20.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.711+0000 7f11f87f3b80 1 -- 172.21.15.46:0/1937033026 shutdown_connections 2023-10-19T12:50:20.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.712+0000 7f11f87f3b80 1 -- 172.21.15.46:0/1937033026 wait complete. 2023-10-19T12:50:20.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.712+0000 7f11f87f3b80 1 -- start start 2023-10-19T12:50:20.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.712+0000 7f11f87f3b80 1 Processor -- start 2023-10-19T12:50:20.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.713+0000 7f11f87f3b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e4a29fa2d0 0x55e4a2a08770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:50:20.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.713+0000 7f11f87f3b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e4a29fac30 0x55e4a2a08cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:50:20.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.713+0000 7f11f87f3b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e4a2a091f0 0x55e4a2a62350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:50:20.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.713+0000 7f11f87f3b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4a2a0a150 con 0x55e4a29fa2d0 2023-10-19T12:50:20.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.713+0000 7f11f87f3b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4a2a0a2c0 con 0x55e4a29fac30 2023-10-19T12:50:20.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.713+0000 7f11f87f3b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4a2a628c0 con 0x55e4a2a091f0 2023-10-19T12:50:20.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.713+0000 7f11f87f3b80 10 client.0 _ll_register_callbacks cb 0x55e4a2832a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:50:20.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.713+0000 7f11de59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e4a29fa2d0 0x55e4a2a08770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:50:20.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.713+0000 7f11ded9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e4a2a091f0 0x55e4a2a62350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:50:20.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.713+0000 7f11de59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e4a29fa2d0 0x55e4a2a08770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43220/0 (socket says 172.21.15.46:43220) 2023-10-19T12:50:20.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.713+0000 7f11de59c700 1 -- 172.21.15.46:0/2669857808 learned_addr learned my addr 172.21.15.46:0/2669857808 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:50:20.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.713+0000 7f11ddd9b700 1 --2- 172.21.15.46:0/2669857808 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e4a29fac30 0x55e4a2a08cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:50:20.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.713+0000 7f11de59c700 1 -- 172.21.15.46:0/2669857808 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e4a2a091f0 msgr2=0x55e4a2a62350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:50:20.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.713+0000 7f11de59c700 1 --2- 172.21.15.46:0/2669857808 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e4a2a091f0 0x55e4a2a62350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:50:20.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.713+0000 7f11de59c700 1 -- 172.21.15.46:0/2669857808 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e4a29fac30 msgr2=0x55e4a2a08cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:50:20.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.714+0000 7f11de59c700 1 --2- 172.21.15.46:0/2669857808 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e4a29fac30 0x55e4a2a08cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:50:20.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.714+0000 7f11de59c700 1 -- 172.21.15.46:0/2669857808 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11e0109560 con 0x55e4a29fa2d0 2023-10-19T12:50:20.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.714+0000 7f11de59c700 1 --2- 172.21.15.46:0/2669857808 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e4a29fa2d0 0x55e4a2a08770 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f11d800b0a0 tx=0x7f11d8007610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc46745179e728f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:50:20.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.714+0000 7f11c5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2023-10-19T12:50:20.726 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.715+0000 7f11c5ffb700 1 -- 172.21.15.46:0/2669857808 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d800e050 con 0x55e4a29fa2d0 2023-10-19T12:50:20.726 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.715+0000 7f11c5ffb700 1 -- 172.21.15.46:0/2669857808 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f11d8007800 con 0x55e4a29fa2d0 2023-10-19T12:50:20.726 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.715+0000 7f11f87f3b80 1 -- 172.21.15.46:0/2669857808 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e4a2a01ab0 con 0x55e4a29fa2d0 2023-10-19T12:50:20.726 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.715+0000 7f11c5ffb700 1 -- 172.21.15.46:0/2669857808 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f11d8027040 con 0x55e4a29fa2d0 2023-10-19T12:50:20.726 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.715+0000 7f11f87f3b80 10 client.15879 fetch_fsmap learned FSMap version 43 2023-10-19T12:50:20.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.715+0000 7f11f87f3b80 1 -- 172.21.15.46:0/2669857808 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x55e4a279d250 con 0x55e4a29fa2d0 2023-10-19T12:50:20.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.716+0000 7f11c5ffb700 1 -- 172.21.15.46:0/2669857808 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f11d8037080 con 0x55e4a29fa2d0 2023-10-19T12:50:20.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.716+0000 7f11c5ffb700 1 -- 172.21.15.46:0/2669857808 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 43) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f11d800b0d0 con 0x55e4a29fa2d0 2023-10-19T12:50:20.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.716+0000 7f11f87f3b80 10 client.15879 fetch_fsmap finished waiting for FSMap version 43 2023-10-19T12:50:20.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.716+0000 7f11f87f3b80 10 client.15879 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-19T12:50:20.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.716+0000 7f11f87f3b80 20 client.15879 populate_metadata read hostname 'smithi046' 2023-10-19T12:50:20.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.716+0000 7f11f87f3b80 1 --2- 172.21.15.46:0/2669857808 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x55e4a2a64210 0x55e4a2a66630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:50:20.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.716+0000 7f11f87f3b80 4 client.15879 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-19T12:50:20.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.716+0000 7f11f87f3b80 1 -- 172.21.15.46:0/2669857808 --> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x7f11d4083e90 con 0x55e4a2a64210 2023-10-19T12:50:20.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.716+0000 7f11ddd9b700 1 --2- 172.21.15.46:0/2669857808 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x55e4a2a64210 0x55e4a2a66630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:50:20.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.717+0000 7f11ddd9b700 1 --2- 172.21.15.46:0/2669857808 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x55e4a2a64210 0x55e4a2a66630 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f44a8672c05b82f6 server_cookie=2fa23f2f4b3c4664 in_seq=0 out_seq=0 2023-10-19T12:50:20.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.717+0000 7f11c5ffb700 10 client.15879 ms_handle_connect on v2:172.21.15.157:6838/552718978 2023-10-19T12:50:20.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.717+0000 7f11c5ffb700 1 -- 172.21.15.46:0/2669857808 <== mds.0 v2:172.21.15.157:6838/552718978 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x7f11d4083e90 con 0x55e4a2a64210 2023-10-19T12:50:20.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.717+0000 7f11c5ffb700 10 client.15879 handle_command_reply: tid=0 2023-10-19T12:50:20.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.717+0000 7f11f87f3b80 1 client.15879 shutdown 2023-10-19T12:50:20.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.717+0000 7f11f87f3b80 1 -- 172.21.15.46:0/2669857808 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e4a29fa2d0 msgr2=0x55e4a2a08770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:50:20.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.717+0000 7f11f87f3b80 1 --2- 172.21.15.46:0/2669857808 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e4a29fa2d0 0x55e4a2a08770 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f11d800b0a0 tx=0x7f11d8007610 comp rx=0 tx=0).stop 2023-10-19T12:50:20.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.717+0000 7f11f87f3b80 1 -- 172.21.15.46:0/2669857808 shutdown_connections 2023-10-19T12:50:20.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.717+0000 7f11f87f3b80 1 --2- 172.21.15.46:0/2669857808 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e4a2a091f0 0x55e4a2a62350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:50:20.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.717+0000 7f11f87f3b80 1 --2- 172.21.15.46:0/2669857808 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x55e4a2a64210 0x55e4a2a66630 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:50:20.730 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.717+0000 7f11f87f3b80 1 --2- 172.21.15.46:0/2669857808 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e4a29fa2d0 0x55e4a2a08770 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:50:20.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.717+0000 7f11f87f3b80 1 --2- 172.21.15.46:0/2669857808 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e4a29fac30 0x55e4a2a08cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:50:20.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.717+0000 7f11f87f3b80 1 -- 172.21.15.46:0/2669857808 >> 172.21.15.46:0/2669857808 conn(0x55e4a296d720 msgr2=0x55e4a2a02a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:50:20.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.717+0000 7f11c5ffb700 0 client.15879 ms_handle_reset on v2:172.21.15.157:6838/552718978 2023-10-19T12:50:20.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.718+0000 7f11f87f3b80 1 -- 172.21.15.46:0/2669857808 shutdown_connections 2023-10-19T12:50:20.731 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.718+0000 7f11f87f3b80 1 -- 172.21.15.46:0/2669857808 wait complete. 2023-10-19T12:50:20.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.718+0000 7f11f87f3b80 20 client.15879 trim_cache size 0 max 16384 2023-10-19T12:50:20.732 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-10-19T12:50:20.732 INFO:teuthology.orchestra.run.smithi046.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-19T12:50:20.732 INFO:teuthology.orchestra.run.smithi046.stdout: "scrubs": { 2023-10-19T12:50:20.733 INFO:teuthology.orchestra.run.smithi046.stdout: "21e73f70-af16-4ae7-bc34-e6c54ba8e1ec": { 2023-10-19T12:50:20.733 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2023-10-19T12:50:20.733 INFO:teuthology.orchestra.run.smithi046.stdout: "tag": "21e73f70-af16-4ae7-bc34-e6c54ba8e1ec", 2023-10-19T12:50:20.733 INFO:teuthology.orchestra.run.smithi046.stdout: "options": "recursive,force" 2023-10-19T12:50:20.733 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:50:20.734 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:50:20.734 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-10-19T12:50:20.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.719+0000 7f11e4dff700 1 -- 172.21.15.46:0/708693662 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f11c80a15d0 msgr2=0x7f11c80a3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:50:20.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.719+0000 7f11e4dff700 1 --2- 172.21.15.46:0/708693662 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f11c80a15d0 0x7f11c80a3a90 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f11d0005950 tx=0x7f11d0005eb0 comp rx=0 tx=0).stop 2023-10-19T12:50:20.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.719+0000 7f11e4dff700 1 -- 172.21.15.46:0/708693662 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11e0102360 msgr2=0x7f11e01ad0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:50:20.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.719+0000 7f11e4dff700 1 --2- 172.21.15.46:0/708693662 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11e0102360 0x7f11e01ad0c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f11d400d750 tx=0x7f11d400da60 comp rx=0 tx=0).stop 2023-10-19T12:50:20.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.719+0000 7f11e4dff700 1 -- 172.21.15.46:0/708693662 shutdown_connections 2023-10-19T12:50:20.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.719+0000 7f11e4dff700 1 --2- 172.21.15.46:0/708693662 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f11c80a15d0 0x7f11c80a3a90 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:50:20.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.719+0000 7f11e4dff700 1 --2- 172.21.15.46:0/708693662 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11e0102360 0x7f11e01ad0c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:50:20.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.719+0000 7f11e4dff700 1 --2- 172.21.15.46:0/708693662 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f11e01007d0 0x7f11e0194660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:50:20.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.719+0000 7f11e4dff700 1 --2- 172.21.15.46:0/708693662 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f11e01019c0 0x7f11e0194ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:50:20.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.719+0000 7f11e4dff700 1 -- 172.21.15.46:0/708693662 >> 172.21.15.46:0/708693662 conn(0x7f11e00fbd40 msgr2=0x7f11e0072a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:50:20.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.720+0000 7f11e4dff700 1 -- 172.21.15.46:0/708693662 shutdown_connections 2023-10-19T12:50:20.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:20.720+0000 7f11e4dff700 1 -- 172.21.15.46:0/708693662 wait complete. 2023-10-19T12:50:20.757 INFO:tasks.cephfs.filesystem:scrub status for tag:21e73f70-af16-4ae7-bc34-e6c54ba8e1ec - {'path': '/', 'tag': '21e73f70-af16-4ae7-bc34-e6c54ba8e1ec', 'options': 'recursive,force'} 2023-10-19T12:50:21.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 380.0 s, 435.4 tps, lat 217.682 ms stddev 277.186 2023-10-19T12:50:22.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:50:21 smithi046 ceph-mon[98509]: pgmap v559: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 8.7 MiB/s wr, 647 op/s 2023-10-19T12:50:22.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:50:21 smithi157 ceph-mon[134109]: pgmap v559: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 8.7 MiB/s wr, 647 op/s 2023-10-19T12:50:22.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:50:21 smithi195 ceph-mon[134493]: pgmap v559: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 8.7 MiB/s wr, 647 op/s 2023-10-19T12:50:24.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:50:23 smithi046 ceph-mon[98509]: pgmap v560: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 9.9 MiB/s wr, 757 op/s 2023-10-19T12:50:24.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:50:23 smithi157 ceph-mon[134109]: pgmap v560: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 9.9 MiB/s wr, 757 op/s 2023-10-19T12:50:24.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:50:23 smithi195 ceph-mon[134493]: pgmap v560: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 9.9 MiB/s wr, 757 op/s 2023-10-19T12:50:26.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:50:25 smithi046 ceph-mon[98509]: pgmap v561: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 7.4 MiB/s wr, 555 op/s 2023-10-19T12:50:26.341 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:50:25 smithi157 ceph-mon[134109]: pgmap v561: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 7.4 MiB/s wr, 555 op/s 2023-10-19T12:50:26.382 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:50:25 smithi195 ceph-mon[134493]: pgmap v561: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 7.4 MiB/s wr, 555 op/s 2023-10-19T12:50:26.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 385.0 s, 619.0 tps, lat 165.479 ms stddev 237.078 2023-10-19T12:50:28.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:50:27 smithi046 ceph-mon[98509]: pgmap v562: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 10 MiB/s wr, 751 op/s 2023-10-19T12:50:28.346 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:50:27 smithi157 ceph-mon[134109]: pgmap v562: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 10 MiB/s wr, 751 op/s 2023-10-19T12:50:28.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:50:27 smithi195 ceph-mon[134493]: pgmap v562: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 10 MiB/s wr, 751 op/s 2023-10-19T12:50:29.839 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:50:29 smithi157 ceph-mon[134109]: pgmap v563: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 9.1 MiB/s wr, 689 op/s 2023-10-19T12:50:29.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:50:29 smithi195 ceph-mon[134493]: pgmap v563: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 9.1 MiB/s wr, 689 op/s 2023-10-19T12:50:29.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:50:29 smithi046 ceph-mon[98509]: pgmap v563: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 9.1 MiB/s wr, 689 op/s 2023-10-19T12:50:31.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 390.0 s, 564.0 tps, lat 183.650 ms stddev 218.228 2023-10-19T12:50:32.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:50:31 smithi046 ceph-mon[98509]: pgmap v564: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 8.9 MiB/s wr, 670 op/s 2023-10-19T12:50:32.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:50:31 smithi157 ceph-mon[134109]: pgmap v564: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 8.9 MiB/s wr, 670 op/s 2023-10-19T12:50:32.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:50:31 smithi195 ceph-mon[134493]: pgmap v564: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 8.9 MiB/s wr, 670 op/s 2023-10-19T12:50:34.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:50:33 smithi046 ceph-mon[98509]: pgmap v565: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 9.9 MiB/s wr, 740 op/s 2023-10-19T12:50:34.339 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:50:33 smithi157 ceph-mon[134109]: pgmap v565: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 9.9 MiB/s wr, 740 op/s 2023-10-19T12:50:34.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:50:33 smithi195 ceph-mon[134493]: pgmap v565: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 9.9 MiB/s wr, 740 op/s 2023-10-19T12:50:36.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:50:35 smithi046 ceph-mon[98509]: pgmap v566: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 6.8 MiB/s wr, 540 op/s 2023-10-19T12:50:36.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:50:35 smithi157 ceph-mon[134109]: pgmap v566: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 6.8 MiB/s wr, 540 op/s 2023-10-19T12:50:36.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:50:35 smithi195 ceph-mon[134493]: pgmap v566: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 6.8 MiB/s wr, 540 op/s 2023-10-19T12:50:36.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 395.0 s, 450.4 tps, lat 214.541 ms stddev 247.005 2023-10-19T12:50:38.347 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:50:37 smithi157 ceph-mon[134109]: pgmap v567: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 7.8 MiB/s wr, 663 op/s 2023-10-19T12:50:38.383 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:50:37 smithi195 ceph-mon[134493]: pgmap v567: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 7.8 MiB/s wr, 663 op/s 2023-10-19T12:50:38.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:50:37 smithi046 ceph-mon[98509]: pgmap v567: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 7.8 MiB/s wr, 663 op/s 2023-10-19T12:50:39.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:50:39 smithi195 ceph-mon[134493]: pgmap v568: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 6.5 MiB/s wr, 556 op/s 2023-10-19T12:50:39.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:50:39 smithi046 ceph-mon[98509]: pgmap v568: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 6.5 MiB/s wr, 556 op/s 2023-10-19T12:50:40.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:50:39 smithi157 ceph-mon[134109]: pgmap v568: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 6.5 MiB/s wr, 556 op/s 2023-10-19T12:50:41.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 400.0 s, 533.8 tps, lat 185.675 ms stddev 241.195 2023-10-19T12:50:42.232 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:50:41 smithi046 ceph-mon[98509]: pgmap v569: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.6 MiB/s wr, 478 op/s 2023-10-19T12:50:42.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:50:41 smithi157 ceph-mon[134109]: pgmap v569: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.6 MiB/s wr, 478 op/s 2023-10-19T12:50:42.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:50:41 smithi195 ceph-mon[134493]: pgmap v569: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.6 MiB/s wr, 478 op/s 2023-10-19T12:50:44.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:50:43 smithi046 ceph-mon[98509]: pgmap v570: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.4 MiB/s wr, 556 op/s 2023-10-19T12:50:44.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:50:43 smithi157 ceph-mon[134109]: pgmap v570: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.4 MiB/s wr, 556 op/s 2023-10-19T12:50:44.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:50:43 smithi195 ceph-mon[134493]: pgmap v570: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.4 MiB/s wr, 556 op/s 2023-10-19T12:50:46.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:50:45 smithi046 ceph-mon[98509]: pgmap v571: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.9 MiB/s wr, 449 op/s 2023-10-19T12:50:46.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:50:45 smithi157 ceph-mon[134109]: pgmap v571: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.9 MiB/s wr, 449 op/s 2023-10-19T12:50:46.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:50:45 smithi195 ceph-mon[134493]: pgmap v571: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.9 MiB/s wr, 449 op/s 2023-10-19T12:50:46.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 405.0 s, 514.8 tps, lat 180.602 ms stddev 265.342 2023-10-19T12:50:48.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:50:47 smithi046 ceph-mon[98509]: pgmap v572: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.5 MiB/s wr, 613 op/s 2023-10-19T12:50:48.340 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:50:47 smithi157 ceph-mon[134109]: pgmap v572: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.5 MiB/s wr, 613 op/s 2023-10-19T12:50:48.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:50:47 smithi195 ceph-mon[134493]: pgmap v572: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.5 MiB/s wr, 613 op/s 2023-10-19T12:50:49.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:50:49 smithi046 ceph-mon[98509]: pgmap v573: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 7.2 MiB/s wr, 634 op/s 2023-10-19T12:50:50.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:50:49 smithi157 ceph-mon[134109]: pgmap v573: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 7.2 MiB/s wr, 634 op/s 2023-10-19T12:50:50.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:50:49 smithi195 ceph-mon[134493]: pgmap v573: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 7.2 MiB/s wr, 634 op/s 2023-10-19T12:50:50.758 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-19T12:50:51.704 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 410.0 s, 474.5 tps, lat 224.559 ms stddev 283.710 2023-10-19T12:50:51.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:50:51 smithi046 ceph-mon[98509]: pgmap v574: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.4 MiB/s wr, 610 op/s 2023-10-19T12:50:52.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.161+0000 7efc4b3ff700 1 -- 172.21.15.46:0/2951150707 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efc44101970 msgr2=0x7efc44103e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:50:52.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.161+0000 7efc4b3ff700 1 --2- 172.21.15.46:0/2951150707 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efc44101970 0x7efc44103e00 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7efc380098f0 tx=0x7efc38009c00 comp rx=0 tx=0).stop 2023-10-19T12:50:52.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.161+0000 7efc4b3ff700 1 -- 172.21.15.46:0/2951150707 shutdown_connections 2023-10-19T12:50:52.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.161+0000 7efc4b3ff700 1 --2- 172.21.15.46:0/2951150707 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc44104340 0x7efc441047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:50:52.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.161+0000 7efc4b3ff700 1 --2- 172.21.15.46:0/2951150707 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efc440ff000 0x7efc44101430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:50:52.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.161+0000 7efc4b3ff700 1 --2- 172.21.15.46:0/2951150707 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efc44101970 0x7efc44103e00 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:50:52.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.161+0000 7efc4b3ff700 1 -- 172.21.15.46:0/2951150707 >> 172.21.15.46:0/2951150707 conn(0x7efc440fac00 msgr2=0x7efc440fd040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:50:52.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.162+0000 7efc4b3ff700 1 -- 172.21.15.46:0/2951150707 shutdown_connections 2023-10-19T12:50:52.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.162+0000 7efc4b3ff700 1 -- 172.21.15.46:0/2951150707 wait complete. 2023-10-19T12:50:52.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.163+0000 7efc4b3ff700 1 Processor -- start 2023-10-19T12:50:52.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.163+0000 7efc4b3ff700 1 -- start start 2023-10-19T12:50:52.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.164+0000 7efc4b3ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc440ff000 0x7efc441945c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:50:52.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.164+0000 7efc4b3ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efc44101970 0x7efc44194b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:50:52.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.164+0000 7efc4b3ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efc44104340 0x7efc4419bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:50:52.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.164+0000 7efc4b3ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc4419c0a0 con 0x7efc440ff000 2023-10-19T12:50:52.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.164+0000 7efc4b3ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc4419c1e0 con 0x7efc44101970 2023-10-19T12:50:52.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.164+0000 7efc4b3ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc4419c370 con 0x7efc44104340 2023-10-19T12:50:52.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.164+0000 7efc4899a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efc44101970 0x7efc44194b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:50:52.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.164+0000 7efc4899a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efc44101970 0x7efc44194b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:33846/0 (socket says 172.21.15.46:33846) 2023-10-19T12:50:52.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.164+0000 7efc4899a700 1 -- 172.21.15.46:0/3739995753 learned_addr learned my addr 172.21.15.46:0/3739995753 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:50:52.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.165+0000 7efc4999c700 1 --2- 172.21.15.46:0/3739995753 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efc44104340 0x7efc4419bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:50:52.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.165+0000 7efc4919b700 1 --2- 172.21.15.46:0/3739995753 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc440ff000 0x7efc441945c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:50:52.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.165+0000 7efc4899a700 1 -- 172.21.15.46:0/3739995753 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efc44104340 msgr2=0x7efc4419bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:50:52.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.165+0000 7efc4899a700 1 --2- 172.21.15.46:0/3739995753 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efc44104340 0x7efc4419bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:50:52.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.165+0000 7efc4899a700 1 -- 172.21.15.46:0/3739995753 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc440ff000 msgr2=0x7efc441945c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:50:52.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.165+0000 7efc4899a700 1 --2- 172.21.15.46:0/3739995753 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc440ff000 0x7efc441945c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:50:52.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.165+0000 7efc4899a700 1 -- 172.21.15.46:0/3739995753 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc38009520 con 0x7efc44101970 2023-10-19T12:50:52.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.165+0000 7efc4919b700 1 --2- 172.21.15.46:0/3739995753 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc440ff000 0x7efc441945c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T12:50:52.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.167+0000 7efc4899a700 1 --2- 172.21.15.46:0/3739995753 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efc44101970 0x7efc44194b00 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7efc38009810 tx=0x7efc3800b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:50:52.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.167+0000 7efc427fc700 1 -- 172.21.15.46:0/3739995753 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc3801c070 con 0x7efc44101970 2023-10-19T12:50:52.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.167+0000 7efc427fc700 1 -- 172.21.15.46:0/3739995753 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efc3800f840 con 0x7efc44101970 2023-10-19T12:50:52.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.167+0000 7efc427fc700 1 -- 172.21.15.46:0/3739995753 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc3801c070 con 0x7efc44101970 2023-10-19T12:50:52.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.167+0000 7efc4b3ff700 1 -- 172.21.15.46:0/3739995753 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc4419c5f0 con 0x7efc44101970 2023-10-19T12:50:52.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.168+0000 7efc4b3ff700 1 -- 172.21.15.46:0/3739995753 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc4419c960 con 0x7efc44101970 2023-10-19T12:50:52.179 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.173+0000 7efc427fc700 1 -- 172.21.15.46:0/3739995753 <== mon.2 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7efc38020030 con 0x7efc44101970 2023-10-19T12:50:52.179 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.175+0000 7efc427fc700 1 --2- 172.21.15.46:0/3739995753 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7efc2c0a1560 0x7efc2c0a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:50:52.180 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.176+0000 7efc427fc700 1 -- 172.21.15.46:0/3739995753 <== mon.2 v2:172.21.15.157:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7efc38021380 con 0x7efc44101970 2023-10-19T12:50:52.180 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.177+0000 7efc4919b700 1 --2- 172.21.15.46:0/3739995753 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7efc2c0a1560 0x7efc2c0a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:50:52.181 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.178+0000 7efc4919b700 1 --2- 172.21.15.46:0/3739995753 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7efc2c0a1560 0x7efc2c0a3a20 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7efc3401a3c0 tx=0x7efc3401c040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:50:52.206 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.203+0000 7efc5ec46b80 1 Processor -- start 2023-10-19T12:50:52.207 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.203+0000 7efc5ec46b80 1 -- start start 2023-10-19T12:50:52.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.204+0000 7efc5ec46b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5623aa6712d0 0x5623aa6716f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:50:52.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.204+0000 7efc5ec46b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5623aa671c30 0x5623aa670090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:50:52.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.204+0000 7efc5ec46b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5623aa6705d0 0x5623aa670a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:50:52.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.204+0000 7efc5ec46b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623aa5e36e0 con 0x5623aa6712d0 2023-10-19T12:50:52.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.204+0000 7efc5ec46b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623aa5c9c60 con 0x5623aa6705d0 2023-10-19T12:50:52.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.204+0000 7efc5ec46b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623aa5c7580 con 0x5623aa671c30 2023-10-19T12:50:52.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.204+0000 7efc4899a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5623aa671c30 0x5623aa670090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:50:52.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.204+0000 7efc4899a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5623aa671c30 0x5623aa670090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:44220/0 (socket says 172.21.15.46:44220) 2023-10-19T12:50:52.209 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.204+0000 7efc4899a700 1 -- 172.21.15.46:0/3220946734 learned_addr learned my addr 172.21.15.46:0/3220946734 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:50:52.210 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.204+0000 7efc4999c700 1 --2- 172.21.15.46:0/3220946734 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5623aa6705d0 0x5623aa670a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:50:52.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.205+0000 7efc4899a700 1 -- 172.21.15.46:0/3220946734 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5623aa6705d0 msgr2=0x5623aa670a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:50:52.212 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.205+0000 7efc4899a700 1 --2- 172.21.15.46:0/3220946734 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5623aa6705d0 0x5623aa670a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:50:52.212 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.205+0000 7efc4899a700 1 -- 172.21.15.46:0/3220946734 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5623aa6712d0 msgr2=0x5623aa6716f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:50:52.212 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.205+0000 7efc4899a700 1 --2- 172.21.15.46:0/3220946734 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5623aa6712d0 0x5623aa6716f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:50:52.212 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.205+0000 7efc4899a700 1 -- 172.21.15.46:0/3220946734 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5623aa5803f0 con 0x5623aa671c30 2023-10-19T12:50:52.213 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.205+0000 7efc4999c700 1 --2- 172.21.15.46:0/3220946734 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5623aa6705d0 0x5623aa670a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T12:50:52.213 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.205+0000 7efc4899a700 1 --2- 172.21.15.46:0/3220946734 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5623aa671c30 0x5623aa670090 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7efc38097de0 tx=0x7efc380a1b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5608b59f53a6f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:50:52.213 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.205+0000 7efc2b7fe700 1 -- 172.21.15.46:0/3220946734 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc380a10d0 con 0x5623aa671c30 2023-10-19T12:50:52.213 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.206+0000 7efc2b7fe700 1 -- 172.21.15.46:0/3220946734 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efc3809a970 con 0x5623aa671c30 2023-10-19T12:50:52.213 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.206+0000 7efc2b7fe700 1 -- 172.21.15.46:0/3220946734 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc380a3130 con 0x5623aa671c30 2023-10-19T12:50:52.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.206+0000 7efc5ec46b80 1 -- 172.21.15.46:0/3220946734 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5623aa671c30 msgr2=0x5623aa670090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:50:52.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.206+0000 7efc5ec46b80 1 --2- 172.21.15.46:0/3220946734 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5623aa671c30 0x5623aa670090 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7efc38097de0 tx=0x7efc380a1b80 comp rx=0 tx=0).stop 2023-10-19T12:50:52.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.207+0000 7efc5ec46b80 1 -- 172.21.15.46:0/3220946734 shutdown_connections 2023-10-19T12:50:52.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.207+0000 7efc5ec46b80 1 --2- 172.21.15.46:0/3220946734 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5623aa6705d0 0x5623aa670a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:50:52.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.207+0000 7efc5ec46b80 1 --2- 172.21.15.46:0/3220946734 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5623aa6712d0 0x5623aa6716f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:50:52.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.207+0000 7efc5ec46b80 1 --2- 172.21.15.46:0/3220946734 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5623aa671c30 0x5623aa670090 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:50:52.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.207+0000 7efc5ec46b80 1 -- 172.21.15.46:0/3220946734 >> 172.21.15.46:0/3220946734 conn(0x5623aa5e4720 msgr2=0x5623aa66ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:50:52.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.207+0000 7efc5ec46b80 1 -- 172.21.15.46:0/3220946734 shutdown_connections 2023-10-19T12:50:52.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.207+0000 7efc5ec46b80 1 -- 172.21.15.46:0/3220946734 wait complete. 2023-10-19T12:50:52.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.208+0000 7efc5ec46b80 1 -- start start 2023-10-19T12:50:52.216 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.208+0000 7efc5ec46b80 1 Processor -- start 2023-10-19T12:50:52.216 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.209+0000 7efc5ec46b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5623aa6705d0 0x5623aa679750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:50:52.216 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.209+0000 7efc5ec46b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5623aa6712d0 0x5623aa679c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:50:52.218 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.209+0000 7efc5ec46b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5623aa671c30 0x5623aa680cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:50:52.218 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.209+0000 7efc5ec46b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623aa5c2e70 con 0x5623aa6705d0 2023-10-19T12:50:52.218 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.209+0000 7efc5ec46b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623aa55f710 con 0x5623aa6712d0 2023-10-19T12:50:52.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.209+0000 7efc5ec46b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623aa55f3b0 con 0x5623aa671c30 2023-10-19T12:50:52.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.209+0000 7efc5ec46b80 10 client.0 _ll_register_callbacks cb 0x5623aa4a9a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:50:52.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.209+0000 7efc4899a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5623aa6712d0 0x5623aa679c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:50:52.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.210+0000 7efc4899a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5623aa6712d0 0x5623aa679c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:33868/0 (socket says 172.21.15.46:33868) 2023-10-19T12:50:52.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.210+0000 7efc4899a700 1 -- 172.21.15.46:0/3018183988 learned_addr learned my addr 172.21.15.46:0/3018183988 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:50:52.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.210+0000 7efc4999c700 1 --2- 172.21.15.46:0/3018183988 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5623aa671c30 0x5623aa680cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:50:52.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.210+0000 7efc4919b700 1 --2- 172.21.15.46:0/3018183988 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5623aa6705d0 0x5623aa679750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:50:52.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.210+0000 7efc4899a700 1 -- 172.21.15.46:0/3018183988 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5623aa671c30 msgr2=0x5623aa680cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:50:52.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.210+0000 7efc4899a700 1 --2- 172.21.15.46:0/3018183988 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5623aa671c30 0x5623aa680cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:50:52.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.210+0000 7efc4899a700 1 -- 172.21.15.46:0/3018183988 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5623aa6705d0 msgr2=0x5623aa679750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:50:52.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.210+0000 7efc4899a700 1 --2- 172.21.15.46:0/3018183988 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5623aa6705d0 0x5623aa679750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:50:52.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.210+0000 7efc4899a700 1 -- 172.21.15.46:0/3018183988 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc4419c960 con 0x5623aa6712d0 2023-10-19T12:50:52.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.210+0000 7efc4899a700 1 --2- 172.21.15.46:0/3018183988 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5623aa6712d0 0x5623aa679c90 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7efc3809aae0 tx=0x7efc3800bb90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20ebe114385cf0d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:50:52.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.210+0000 7efc28ff9700 10 client.0 ms_handle_connect on v2:172.21.15.157:3300/0 2023-10-19T12:50:52.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.211+0000 7efc28ff9700 1 -- 172.21.15.46:0/3018183988 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc380971a0 con 0x5623aa6712d0 2023-10-19T12:50:52.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.211+0000 7efc28ff9700 1 -- 172.21.15.46:0/3018183988 <== mon.2 v2:172.21.15.157:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7efc380a3130 con 0x5623aa6712d0 2023-10-19T12:50:52.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.211+0000 7efc5ec46b80 1 -- 172.21.15.46:0/3018183988 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5623aa5c7ef0 con 0x5623aa6712d0 2023-10-19T12:50:52.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.211+0000 7efc28ff9700 1 -- 172.21.15.46:0/3018183988 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7efc38097540 con 0x5623aa6712d0 2023-10-19T12:50:52.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.211+0000 7efc5ec46b80 10 client.26027 fetch_fsmap learned FSMap version 43 2023-10-19T12:50:52.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.211+0000 7efc5ec46b80 1 -- 172.21.15.46:0/3018183988 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x5623aa3edde0 con 0x5623aa6712d0 2023-10-19T12:50:52.223 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.211+0000 7efc28ff9700 1 -- 172.21.15.46:0/3018183988 <== mon.2 v2:172.21.15.157:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5623aa5c7ef0 con 0x5623aa6712d0 2023-10-19T12:50:52.223 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.212+0000 7efc28ff9700 1 -- 172.21.15.46:0/3018183988 <== mon.2 v2:172.21.15.157:3300/0 5 ==== fsmap(e 43) v1 ==== 7890+0+0 (secure 0 0 0) 0x7efc380aeb80 con 0x5623aa6712d0 2023-10-19T12:50:52.223 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.212+0000 7efc5ec46b80 10 client.26027 fetch_fsmap finished waiting for FSMap version 43 2023-10-19T12:50:52.223 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.212+0000 7efc5ec46b80 10 client.26027 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-19T12:50:52.223 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.212+0000 7efc5ec46b80 20 client.26027 populate_metadata read hostname 'smithi046' 2023-10-19T12:50:52.224 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.212+0000 7efc5ec46b80 1 --2- 172.21.15.46:0/3018183988 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x5623aa684e20 0x5623aa687210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:50:52.224 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.212+0000 7efc5ec46b80 4 client.26027 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-19T12:50:52.224 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.212+0000 7efc5ec46b80 1 -- 172.21.15.46:0/3018183988 --> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5623aa63f8b0 con 0x5623aa684e20 2023-10-19T12:50:52.224 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.212+0000 7efc4919b700 1 --2- 172.21.15.46:0/3018183988 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x5623aa684e20 0x5623aa687210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:50:52.224 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.213+0000 7efc4919b700 1 --2- 172.21.15.46:0/3018183988 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x5623aa684e20 0x5623aa687210 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f5ae239120b4020 server_cookie=ff38f411eb5f9b22 in_seq=0 out_seq=0 2023-10-19T12:50:52.225 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.213+0000 7efc28ff9700 10 client.26027 ms_handle_connect on v2:172.21.15.157:6838/552718978 2023-10-19T12:50:52.225 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.214+0000 7efc28ff9700 1 -- 172.21.15.46:0/3018183988 <== mds.0 v2:172.21.15.157:6838/552718978 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5623aa63f8b0 con 0x5623aa684e20 2023-10-19T12:50:52.225 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.214+0000 7efc28ff9700 10 client.26027 handle_command_reply: tid=0 2023-10-19T12:50:52.225 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.214+0000 7efc5ec46b80 1 client.26027 shutdown 2023-10-19T12:50:52.226 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.215+0000 7efc5ec46b80 1 -- 172.21.15.46:0/3018183988 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5623aa6712d0 msgr2=0x5623aa679c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:50:52.226 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.215+0000 7efc5ec46b80 1 --2- 172.21.15.46:0/3018183988 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5623aa6712d0 0x5623aa679c90 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7efc3809aae0 tx=0x7efc3800bb90 comp rx=0 tx=0).stop 2023-10-19T12:50:52.226 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.216+0000 7efc5ec46b80 1 -- 172.21.15.46:0/3018183988 shutdown_connections 2023-10-19T12:50:52.227 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.216+0000 7efc5ec46b80 1 --2- 172.21.15.46:0/3018183988 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5623aa671c30 0x5623aa680cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:50:52.227 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.216+0000 7efc5ec46b80 1 --2- 172.21.15.46:0/3018183988 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x5623aa684e20 0x5623aa687210 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:50:52.227 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.216+0000 7efc5ec46b80 1 --2- 172.21.15.46:0/3018183988 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5623aa6705d0 0x5623aa679750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:50:52.227 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.216+0000 7efc5ec46b80 1 --2- 172.21.15.46:0/3018183988 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5623aa6712d0 0x5623aa679c90 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:50:52.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.216+0000 7efc5ec46b80 1 -- 172.21.15.46:0/3018183988 >> 172.21.15.46:0/3018183988 conn(0x5623aa5e4720 msgr2=0x5623aa66f080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:50:52.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.216+0000 7efc28ff9700 0 client.26027 ms_handle_reset on v2:172.21.15.157:6838/552718978 2023-10-19T12:50:52.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.216+0000 7efc5ec46b80 1 -- 172.21.15.46:0/3018183988 shutdown_connections 2023-10-19T12:50:52.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.216+0000 7efc5ec46b80 1 -- 172.21.15.46:0/3018183988 wait complete. 2023-10-19T12:50:52.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.217+0000 7efc5ec46b80 20 client.26027 trim_cache size 0 max 16384 2023-10-19T12:50:52.248 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.245+0000 7efc5ec46b80 1 Processor -- start 2023-10-19T12:50:52.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.245+0000 7efc5ec46b80 1 -- start start 2023-10-19T12:50:52.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.246+0000 7efc5ec46b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5623aa6705d0 0x5623aa6655d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:50:52.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.246+0000 7efc5ec46b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5623aa6712d0 0x5623aa680c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:50:52.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.246+0000 7efc5ec46b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5623aa671c30 0x5623aa6742d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:50:52.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.246+0000 7efc5ec46b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623aa443920 con 0x5623aa671c30 2023-10-19T12:50:52.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.246+0000 7efc5ec46b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623aa667550 con 0x5623aa6712d0 2023-10-19T12:50:52.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.246+0000 7efc5ec46b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623aa63f8b0 con 0x5623aa6705d0 2023-10-19T12:50:52.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.246+0000 7efc4899a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5623aa6712d0 0x5623aa680c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:50:52.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.246+0000 7efc4919b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5623aa6705d0 0x5623aa6655d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:50:52.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.246+0000 7efc4999c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5623aa671c30 0x5623aa6742d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:50:52.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.246+0000 7efc4919b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5623aa6705d0 0x5623aa6655d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:44248/0 (socket says 172.21.15.46:44248) 2023-10-19T12:50:52.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.246+0000 7efc4919b700 1 -- 172.21.15.46:0/1447852835 learned_addr learned my addr 172.21.15.46:0/1447852835 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:50:52.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.247+0000 7efc4919b700 1 -- 172.21.15.46:0/1447852835 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5623aa6712d0 msgr2=0x5623aa680c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:50:52.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.247+0000 7efc4919b700 1 --2- 172.21.15.46:0/1447852835 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5623aa6712d0 0x5623aa680c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:50:52.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.247+0000 7efc4919b700 1 -- 172.21.15.46:0/1447852835 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5623aa671c30 msgr2=0x5623aa6742d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:50:52.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.247+0000 7efc4919b700 1 --2- 172.21.15.46:0/1447852835 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5623aa671c30 0x5623aa6742d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:50:52.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.247+0000 7efc4919b700 1 -- 172.21.15.46:0/1447852835 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5623aa3d6c60 con 0x5623aa6705d0 2023-10-19T12:50:52.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.247+0000 7efc4899a700 1 --2- 172.21.15.46:0/1447852835 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5623aa6712d0 0x5623aa680c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:50:52.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.247+0000 7efc4919b700 1 --2- 172.21.15.46:0/1447852835 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5623aa6705d0 0x5623aa6655d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7efc3401ae00 tx=0x7efc34023000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=78e5b077fbb42ef1 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:50:52.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.247+0000 7efc2bfff700 1 -- 172.21.15.46:0/1447852835 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc34037e60 con 0x5623aa6705d0 2023-10-19T12:50:52.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.248+0000 7efc2bfff700 1 -- 172.21.15.46:0/1447852835 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efc34037040 con 0x5623aa6705d0 2023-10-19T12:50:52.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.248+0000 7efc2bfff700 1 -- 172.21.15.46:0/1447852835 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc340044f0 con 0x5623aa6705d0 2023-10-19T12:50:52.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.248+0000 7efc5ec46b80 1 -- 172.21.15.46:0/1447852835 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5623aa6705d0 msgr2=0x5623aa6655d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:50:52.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.248+0000 7efc5ec46b80 1 --2- 172.21.15.46:0/1447852835 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5623aa6705d0 0x5623aa6655d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7efc3401ae00 tx=0x7efc34023000 comp rx=0 tx=0).stop 2023-10-19T12:50:52.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.249+0000 7efc5ec46b80 1 -- 172.21.15.46:0/1447852835 shutdown_connections 2023-10-19T12:50:52.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.249+0000 7efc5ec46b80 1 --2- 172.21.15.46:0/1447852835 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5623aa671c30 0x5623aa6742d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:50:52.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.249+0000 7efc5ec46b80 1 --2- 172.21.15.46:0/1447852835 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5623aa6705d0 0x5623aa6655d0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:50:52.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.249+0000 7efc5ec46b80 1 --2- 172.21.15.46:0/1447852835 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5623aa6712d0 0x5623aa680c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:50:52.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.249+0000 7efc5ec46b80 1 -- 172.21.15.46:0/1447852835 >> 172.21.15.46:0/1447852835 conn(0x5623aa5e4720 msgr2=0x5623aa679730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:50:52.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.249+0000 7efc5ec46b80 1 -- 172.21.15.46:0/1447852835 shutdown_connections 2023-10-19T12:50:52.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.249+0000 7efc5ec46b80 1 -- 172.21.15.46:0/1447852835 wait complete. 2023-10-19T12:50:52.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.250+0000 7efc5ec46b80 1 -- start start 2023-10-19T12:50:52.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.250+0000 7efc5ec46b80 1 Processor -- start 2023-10-19T12:50:52.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.251+0000 7efc5ec46b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5623aa6705d0 0x5623aa680c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:50:52.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.251+0000 7efc5ec46b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5623aa6712d0 0x5623aa67f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:50:52.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.251+0000 7efc5ec46b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5623aa671c30 0x5623aa67f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:50:52.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.252+0000 7efc5ec46b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623aa67fe60 con 0x5623aa6712d0 2023-10-19T12:50:52.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.252+0000 7efc4919b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5623aa6705d0 0x5623aa680c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:50:52.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.252+0000 7efc4919b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5623aa6705d0 0x5623aa680c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:44258/0 (socket says 172.21.15.46:44258) 2023-10-19T12:50:52.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.252+0000 7efc4919b700 1 -- 172.21.15.46:0/698177132 learned_addr learned my addr 172.21.15.46:0/698177132 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:50:52.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.252+0000 7efc4899a700 1 --2- 172.21.15.46:0/698177132 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5623aa6712d0 0x5623aa67f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:50:52.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.256+0000 7efc5ec46b80 1 -- 172.21.15.46:0/698177132 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623aa67ffa0 con 0x5623aa671c30 2023-10-19T12:50:52.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.256+0000 7efc5ec46b80 1 -- 172.21.15.46:0/698177132 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623aa6d8c30 con 0x5623aa6705d0 2023-10-19T12:50:52.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.256+0000 7efc5ec46b80 10 client.0 _ll_register_callbacks cb 0x5623aa4a9a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:50:52.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.257+0000 7efc4999c700 1 --2- 172.21.15.46:0/698177132 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5623aa671c30 0x5623aa67f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:50:52.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.258+0000 7efc4899a700 1 -- 172.21.15.46:0/698177132 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5623aa6705d0 msgr2=0x5623aa680c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:50:52.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.258+0000 7efc4899a700 1 --2- 172.21.15.46:0/698177132 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5623aa6705d0 0x5623aa680c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:50:52.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.258+0000 7efc4899a700 1 -- 172.21.15.46:0/698177132 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5623aa671c30 msgr2=0x5623aa67f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:50:52.262 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.258+0000 7efc4899a700 1 --2- 172.21.15.46:0/698177132 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5623aa671c30 0x5623aa67f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:50:52.262 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.258+0000 7efc4899a700 1 -- 172.21.15.46:0/698177132 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc4419c960 con 0x5623aa6712d0 2023-10-19T12:50:52.262 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.259+0000 7efc4899a700 1 --2- 172.21.15.46:0/698177132 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5623aa6712d0 0x5623aa67f240 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7efc3800fb70 tx=0x7efc3800bcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f75acaa6f5f5d922 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:50:52.263 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.259+0000 7efc28ff9700 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2023-10-19T12:50:52.263 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.260+0000 7efc28ff9700 1 -- 172.21.15.46:0/698177132 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc380054b0 con 0x5623aa6712d0 2023-10-19T12:50:52.264 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.260+0000 7efc28ff9700 1 -- 172.21.15.46:0/698177132 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7efc38097740 con 0x5623aa6712d0 2023-10-19T12:50:52.264 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.260+0000 7efc5ec46b80 1 -- 172.21.15.46:0/698177132 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efc3809a970 con 0x5623aa6712d0 2023-10-19T12:50:52.264 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.260+0000 7efc28ff9700 1 -- 172.21.15.46:0/698177132 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7efc38005040 con 0x5623aa6712d0 2023-10-19T12:50:52.264 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.261+0000 7efc5ec46b80 10 client.15891 fetch_fsmap learned FSMap version 43 2023-10-19T12:50:52.264 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.261+0000 7efc5ec46b80 1 -- 172.21.15.46:0/698177132 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x7efc3402f040 con 0x5623aa6712d0 2023-10-19T12:50:52.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.261+0000 7efc28ff9700 1 -- 172.21.15.46:0/698177132 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efc3809a970 con 0x5623aa6712d0 2023-10-19T12:50:52.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.261+0000 7efc28ff9700 1 -- 172.21.15.46:0/698177132 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 43) v1 ==== 7890+0+0 (secure 0 0 0) 0x7efc380ba310 con 0x5623aa6712d0 2023-10-19T12:50:52.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.262+0000 7efc5ec46b80 10 client.15891 fetch_fsmap finished waiting for FSMap version 43 2023-10-19T12:50:52.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.262+0000 7efc5ec46b80 10 client.15891 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-19T12:50:52.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.262+0000 7efc5ec46b80 20 client.15891 populate_metadata read hostname 'smithi046' 2023-10-19T12:50:52.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.262+0000 7efc5ec46b80 1 --2- 172.21.15.46:0/698177132 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x5623aa6da0d0 0x5623aa6dc4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:50:52.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.263+0000 7efc5ec46b80 4 client.15891 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-19T12:50:52.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.263+0000 7efc5ec46b80 1 -- 172.21.15.46:0/698177132 --> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5623aa5bbe50 con 0x5623aa6da0d0 2023-10-19T12:50:52.285 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.282+0000 7efc4919b700 1 --2- 172.21.15.46:0/698177132 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x5623aa6da0d0 0x5623aa6dc4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:50:52.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.301+0000 7efc28ff9700 10 client.15891 ms_handle_connect on v2:172.21.15.157:6838/552718978 2023-10-19T12:50:52.304 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.301+0000 7efc4919b700 1 --2- 172.21.15.46:0/698177132 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x5623aa6da0d0 0x5623aa6dc4c0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=403025d4b147f55d server_cookie=68ec250dab3a5245 in_seq=0 out_seq=0 2023-10-19T12:50:52.305 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.301+0000 7efc28ff9700 1 -- 172.21.15.46:0/698177132 <== mds.0 v2:172.21.15.157:6838/552718978 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x5623aa5bbe50 con 0x5623aa6da0d0 2023-10-19T12:50:52.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.301+0000 7efc28ff9700 10 client.15891 handle_command_reply: tid=0 2023-10-19T12:50:52.306 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.303+0000 7efc5ec46b80 1 client.15891 shutdown 2023-10-19T12:50:52.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.303+0000 7efc5ec46b80 1 -- 172.21.15.46:0/698177132 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5623aa6712d0 msgr2=0x5623aa67f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:50:52.307 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.303+0000 7efc5ec46b80 1 --2- 172.21.15.46:0/698177132 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5623aa6712d0 0x5623aa67f240 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7efc3800fb70 tx=0x7efc3800bcc0 comp rx=0 tx=0).stop 2023-10-19T12:50:52.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.303+0000 7efc5ec46b80 1 -- 172.21.15.46:0/698177132 shutdown_connections 2023-10-19T12:50:52.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.303+0000 7efc5ec46b80 1 --2- 172.21.15.46:0/698177132 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5623aa671c30 0x5623aa67f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:50:52.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.303+0000 7efc5ec46b80 1 --2- 172.21.15.46:0/698177132 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5623aa6705d0 0x5623aa680c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:50:52.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.303+0000 7efc5ec46b80 1 --2- 172.21.15.46:0/698177132 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x5623aa6da0d0 0x5623aa6dc4c0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:50:52.308 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.303+0000 7efc5ec46b80 1 --2- 172.21.15.46:0/698177132 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5623aa6712d0 0x5623aa67f240 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:50:52.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.303+0000 7efc28ff9700 0 client.15891 ms_handle_reset on v2:172.21.15.157:6838/552718978 2023-10-19T12:50:52.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.303+0000 7efc5ec46b80 1 -- 172.21.15.46:0/698177132 >> 172.21.15.46:0/698177132 conn(0x5623aa5e4720 msgr2=0x5623aa6742d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:50:52.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.304+0000 7efc5ec46b80 1 -- 172.21.15.46:0/698177132 shutdown_connections 2023-10-19T12:50:52.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.304+0000 7efc5ec46b80 1 -- 172.21.15.46:0/698177132 wait complete. 2023-10-19T12:50:52.309 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.304+0000 7efc5ec46b80 20 client.15891 trim_cache size 0 max 16384 2023-10-19T12:50:52.310 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-10-19T12:50:52.310 INFO:teuthology.orchestra.run.smithi046.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-19T12:50:52.310 INFO:teuthology.orchestra.run.smithi046.stdout: "scrubs": { 2023-10-19T12:50:52.310 INFO:teuthology.orchestra.run.smithi046.stdout: "21e73f70-af16-4ae7-bc34-e6c54ba8e1ec": { 2023-10-19T12:50:52.311 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2023-10-19T12:50:52.311 INFO:teuthology.orchestra.run.smithi046.stdout: "tag": "21e73f70-af16-4ae7-bc34-e6c54ba8e1ec", 2023-10-19T12:50:52.311 INFO:teuthology.orchestra.run.smithi046.stdout: "options": "recursive,force" 2023-10-19T12:50:52.311 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:50:52.311 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:50:52.311 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-10-19T12:50:52.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.305+0000 7efc4b3ff700 1 -- 172.21.15.46:0/3739995753 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7efc2c0a1560 msgr2=0x7efc2c0a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:50:52.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.305+0000 7efc4b3ff700 1 --2- 172.21.15.46:0/3739995753 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7efc2c0a1560 0x7efc2c0a3a20 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7efc3401a3c0 tx=0x7efc3401c040 comp rx=0 tx=0).stop 2023-10-19T12:50:52.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.305+0000 7efc4b3ff700 1 -- 172.21.15.46:0/3739995753 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efc44101970 msgr2=0x7efc44194b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:50:52.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.305+0000 7efc4b3ff700 1 --2- 172.21.15.46:0/3739995753 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efc44101970 0x7efc44194b00 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7efc38009810 tx=0x7efc3800b840 comp rx=0 tx=0).stop 2023-10-19T12:50:52.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.307+0000 7efc4b3ff700 1 -- 172.21.15.46:0/3739995753 shutdown_connections 2023-10-19T12:50:52.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.307+0000 7efc4b3ff700 1 --2- 172.21.15.46:0/3739995753 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7efc2c0a1560 0x7efc2c0a3a20 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:50:52.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.307+0000 7efc4b3ff700 1 --2- 172.21.15.46:0/3739995753 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efc44104340 0x7efc4419bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:50:52.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.307+0000 7efc4b3ff700 1 --2- 172.21.15.46:0/3739995753 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc440ff000 0x7efc441945c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:50:52.314 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.307+0000 7efc4b3ff700 1 --2- 172.21.15.46:0/3739995753 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efc44101970 0x7efc44194b00 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:50:52.314 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.307+0000 7efc4b3ff700 1 -- 172.21.15.46:0/3739995753 >> 172.21.15.46:0/3739995753 conn(0x7efc440fac00 msgr2=0x7efc440fafe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:50:52.314 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.307+0000 7efc4b3ff700 1 -- 172.21.15.46:0/3739995753 shutdown_connections 2023-10-19T12:50:52.314 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:50:52.307+0000 7efc4b3ff700 1 -- 172.21.15.46:0/3739995753 wait complete. 2023-10-19T12:50:52.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:50:51 smithi157 ceph-mon[134109]: pgmap v574: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.4 MiB/s wr, 610 op/s 2023-10-19T12:50:52.351 INFO:tasks.cephfs.filesystem:scrub status for tag:21e73f70-af16-4ae7-bc34-e6c54ba8e1ec - {'path': '/', 'tag': '21e73f70-af16-4ae7-bc34-e6c54ba8e1ec', 'options': 'recursive,force'} 2023-10-19T12:50:52.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:50:51 smithi195 ceph-mon[134493]: pgmap v574: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.4 MiB/s wr, 610 op/s 2023-10-19T12:50:54.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:50:53 smithi046 ceph-mon[98509]: pgmap v575: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 7.2 MiB/s wr, 699 op/s 2023-10-19T12:50:54.340 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:50:53 smithi157 ceph-mon[134109]: pgmap v575: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 7.2 MiB/s wr, 699 op/s 2023-10-19T12:50:54.382 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:50:53 smithi195 ceph-mon[134493]: pgmap v575: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 7.2 MiB/s wr, 699 op/s 2023-10-19T12:50:56.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:50:55 smithi157 ceph-mon[134109]: pgmap v576: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 5.9 MiB/s wr, 585 op/s 2023-10-19T12:50:56.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:50:55 smithi157 ceph-mon[134109]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-19T12:50:56.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:50:55 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:50:56.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:50:55 smithi195 ceph-mon[134493]: pgmap v576: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 5.9 MiB/s wr, 585 op/s 2023-10-19T12:50:56.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:50:55 smithi195 ceph-mon[134493]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-19T12:50:56.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:50:55 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:50:56.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:50:55 smithi046 ceph-mon[98509]: pgmap v576: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 5.9 MiB/s wr, 585 op/s 2023-10-19T12:50:56.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:50:55 smithi046 ceph-mon[98509]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-19T12:50:56.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:50:55 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:50:56.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 415.0 s, 520.3 tps, lat 193.326 ms stddev 269.474 2023-10-19T12:50:57.341 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:50:56 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:50:57.341 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:50:56 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:50:57.341 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:50:56 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:50:57.341 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:50:56 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:50:57.341 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:50:56 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:50:57.342 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:50:56 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:50:57.342 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:50:56 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:50:57.342 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:50:56 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:50:57.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:50:56 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:50:57.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:50:56 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:50:57.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:50:56 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:50:57.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:50:56 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:50:57.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:50:56 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:50:57.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:50:56 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:50:57.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:50:56 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:50:57.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:50:56 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:50:57.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:50:56 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:50:57.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:50:56 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:50:57.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:50:56 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:50:57.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:50:56 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:50:57.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:50:56 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:50:57.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:50:56 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:50:57.482 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:50:56 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:50:57.482 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:50:56 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-19T12:50:58.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:50:58 smithi157 ceph-mon[134109]: Adjusting osd_memory_target on smithi195 to 196.2M 2023-10-19T12:50:58.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:50:58 smithi157 ceph-mon[134109]: Unable to set osd_memory_target on smithi195 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-10-19T12:50:58.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:50:58 smithi157 ceph-mon[134109]: Adjusting osd_memory_target on smithi157 to 196.2M 2023-10-19T12:50:58.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:50:58 smithi157 ceph-mon[134109]: Unable to set osd_memory_target on smithi157 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-10-19T12:50:58.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:50:58 smithi157 ceph-mon[134109]: pgmap v577: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 7.2 MiB/s wr, 715 op/s 2023-10-19T12:50:58.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:50:57 smithi195 ceph-mon[134493]: Adjusting osd_memory_target on smithi195 to 196.2M 2023-10-19T12:50:58.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:50:57 smithi195 ceph-mon[134493]: Unable to set osd_memory_target on smithi195 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-10-19T12:50:58.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:50:57 smithi195 ceph-mon[134493]: Adjusting osd_memory_target on smithi157 to 196.2M 2023-10-19T12:50:58.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:50:57 smithi195 ceph-mon[134493]: Unable to set osd_memory_target on smithi157 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-10-19T12:50:58.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:50:57 smithi195 ceph-mon[134493]: pgmap v577: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 7.2 MiB/s wr, 715 op/s 2023-10-19T12:50:58.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:50:57 smithi046 ceph-mon[98509]: Adjusting osd_memory_target on smithi195 to 196.2M 2023-10-19T12:50:58.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:50:57 smithi046 ceph-mon[98509]: Unable to set osd_memory_target on smithi195 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-10-19T12:50:58.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:50:57 smithi046 ceph-mon[98509]: Adjusting osd_memory_target on smithi157 to 196.2M 2023-10-19T12:50:58.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:50:57 smithi046 ceph-mon[98509]: Unable to set osd_memory_target on smithi157 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-10-19T12:50:58.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:50:57 smithi046 ceph-mon[98509]: pgmap v577: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 7.2 MiB/s wr, 715 op/s 2023-10-19T12:50:59.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:50:59 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:50:59.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:50:59 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:50:59.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:50:59 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:50:59.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:50:59 smithi195 ceph-mon[134493]: pgmap v578: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 6.9 MiB/s wr, 631 op/s 2023-10-19T12:50:59.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:50:59 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:50:59.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:50:59 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:50:59.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:50:59 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:50:59.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:50:59 smithi046 ceph-mon[98509]: pgmap v578: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 6.9 MiB/s wr, 631 op/s 2023-10-19T12:51:00.184 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:50:59 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:51:00.184 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:50:59 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:51:00.184 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:50:59 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:51:00.184 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:50:59 smithi157 ceph-mon[134109]: pgmap v578: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 6.9 MiB/s wr, 631 op/s 2023-10-19T12:51:00.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:51:00 smithi046 ceph-mon[98509]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-19T12:51:01.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:51:00 smithi157 ceph-mon[134109]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-19T12:51:01.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:51:00 smithi195 ceph-mon[134493]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-19T12:51:01.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 420.0 s, 804.8 tps, lat 124.892 ms stddev 195.230 2023-10-19T12:51:01.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:51:01 smithi046 ceph-mon[98509]: pgmap v579: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 6.0 MiB/s wr, 545 op/s 2023-10-19T12:51:02.091 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:51:01 smithi157 ceph-mon[134109]: pgmap v579: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 6.0 MiB/s wr, 545 op/s 2023-10-19T12:51:02.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:51:01 smithi195 ceph-mon[134493]: pgmap v579: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 6.0 MiB/s wr, 545 op/s 2023-10-19T12:51:04.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:51:03 smithi046 ceph-mon[98509]: pgmap v580: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 7.1 MiB/s wr, 628 op/s 2023-10-19T12:51:04.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:51:03 smithi157 ceph-mon[134109]: pgmap v580: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 7.1 MiB/s wr, 628 op/s 2023-10-19T12:51:04.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:51:03 smithi195 ceph-mon[134493]: pgmap v580: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 7.1 MiB/s wr, 628 op/s 2023-10-19T12:51:06.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:51:05 smithi046 ceph-mon[98509]: pgmap v581: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 5.9 MiB/s wr, 519 op/s 2023-10-19T12:51:06.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:51:05 smithi157 ceph-mon[134109]: pgmap v581: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 5.9 MiB/s wr, 519 op/s 2023-10-19T12:51:06.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:51:05 smithi195 ceph-mon[134493]: pgmap v581: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 5.9 MiB/s wr, 519 op/s 2023-10-19T12:51:06.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 425.0 s, 435.6 tps, lat 228.270 ms stddev 289.518 2023-10-19T12:51:08.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:51:07 smithi046 ceph-mon[98509]: pgmap v582: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 7.7 MiB/s wr, 692 op/s 2023-10-19T12:51:08.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:51:07 smithi157 ceph-mon[134109]: pgmap v582: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 7.7 MiB/s wr, 692 op/s 2023-10-19T12:51:08.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:51:07 smithi195 ceph-mon[134493]: pgmap v582: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 7.7 MiB/s wr, 692 op/s 2023-10-19T12:51:09.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:51:09 smithi195 ceph-mon[134493]: pgmap v583: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 7.2 MiB/s wr, 644 op/s 2023-10-19T12:51:09.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:51:09 smithi046 ceph-mon[98509]: pgmap v583: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 7.2 MiB/s wr, 644 op/s 2023-10-19T12:51:10.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:51:09 smithi157 ceph-mon[134109]: pgmap v583: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 7.2 MiB/s wr, 644 op/s 2023-10-19T12:51:11.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 430.0 s, 640.4 tps, lat 155.870 ms stddev 208.763 2023-10-19T12:51:12.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:51:11 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-19T12:51:12.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:51:11 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-19T12:51:12.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:51:11 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-19T12:51:12.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:51:11 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:51:12.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:51:11 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:51:12.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:51:11 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:51:12.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:51:11 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:51:12.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:51:11 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-19T12:51:12.339 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:51:11 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-19T12:51:12.339 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:51:11 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-19T12:51:12.339 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:51:11 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:51:12.339 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:51:11 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:51:12.340 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:51:11 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:51:12.340 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:51:11 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:51:12.386 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:51:11 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-19T12:51:12.386 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:51:11 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-19T12:51:12.386 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:51:11 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-19T12:51:12.386 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:51:11 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:51:12.387 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:51:11 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:51:12.387 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:51:11 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:51:12.387 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:51:11 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:51:16.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:51:15 smithi046 ceph-mon[98509]: pgmap v585: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 7.1 MiB/s wr, 670 op/s 2023-10-19T12:51:16.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:51:15 smithi046 ceph-mon[98509]: pgmap v586: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 5.5 MiB/s wr, 545 op/s 2023-10-19T12:51:16.342 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:51:15 smithi157 ceph-mon[134109]: pgmap v585: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 7.1 MiB/s wr, 670 op/s 2023-10-19T12:51:16.343 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:51:15 smithi157 ceph-mon[134109]: pgmap v586: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 5.5 MiB/s wr, 545 op/s 2023-10-19T12:51:16.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:51:15 smithi195 ceph-mon[134493]: pgmap v585: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 7.1 MiB/s wr, 670 op/s 2023-10-19T12:51:16.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:51:15 smithi195 ceph-mon[134493]: pgmap v586: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 5.5 MiB/s wr, 545 op/s 2023-10-19T12:51:16.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 435.0 s, 457.0 tps, lat 222.446 ms stddev 235.517 2023-10-19T12:51:18.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:51:17 smithi157 ceph-mon[134109]: pgmap v587: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 6.5 MiB/s wr, 628 op/s 2023-10-19T12:51:18.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:51:17 smithi195 ceph-mon[134493]: pgmap v587: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 6.5 MiB/s wr, 628 op/s 2023-10-19T12:51:18.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:51:17 smithi046 ceph-mon[98509]: pgmap v587: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 6.5 MiB/s wr, 628 op/s 2023-10-19T12:51:19.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:51:19 smithi046 ceph-mon[98509]: pgmap v588: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 5.4 MiB/s wr, 521 op/s 2023-10-19T12:51:20.090 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:51:19 smithi157 ceph-mon[134109]: pgmap v588: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 5.4 MiB/s wr, 521 op/s 2023-10-19T12:51:20.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:51:19 smithi195 ceph-mon[134493]: pgmap v588: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 5.4 MiB/s wr, 521 op/s 2023-10-19T12:51:21.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 440.0 s, 439.8 tps, lat 223.872 ms stddev 284.443 2023-10-19T12:51:22.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:51:21 smithi046 ceph-mon[98509]: pgmap v589: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 4.7 MiB/s wr, 453 op/s 2023-10-19T12:51:22.342 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:51:21 smithi157 ceph-mon[134109]: pgmap v589: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 4.7 MiB/s wr, 453 op/s 2023-10-19T12:51:22.353 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-19T12:51:22.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:51:21 smithi195 ceph-mon[134493]: pgmap v589: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 4.7 MiB/s wr, 453 op/s 2023-10-19T12:51:22.768 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.763+0000 7f7e669ff700 1 -- 172.21.15.46:0/1624648415 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e60073250 msgr2=0x7f7e600736d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:51:22.768 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.763+0000 7f7e669ff700 1 --2- 172.21.15.46:0/1624648415 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e60073250 0x7f7e600736d0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f7e48009990 tx=0x7f7e48009ca0 comp rx=0 tx=0).stop 2023-10-19T12:51:22.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.763+0000 7f7e669ff700 1 -- 172.21.15.46:0/1624648415 shutdown_connections 2023-10-19T12:51:22.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.763+0000 7f7e669ff700 1 --2- 172.21.15.46:0/1624648415 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7e60108660 0x7f7e6010aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:51:22.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.763+0000 7f7e669ff700 1 --2- 172.21.15.46:0/1624648415 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7e60074830 0x7f7e60072c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:51:22.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.763+0000 7f7e669ff700 1 --2- 172.21.15.46:0/1624648415 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e60073250 0x7f7e600736d0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:51:22.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.763+0000 7f7e669ff700 1 -- 172.21.15.46:0/1624648415 >> 172.21.15.46:0/1624648415 conn(0x7f7e600fbcf0 msgr2=0x7f7e600fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:51:22.771 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.768+0000 7f7e669ff700 1 -- 172.21.15.46:0/1624648415 shutdown_connections 2023-10-19T12:51:22.771 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.768+0000 7f7e669ff700 1 -- 172.21.15.46:0/1624648415 wait complete. 2023-10-19T12:51:22.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.770+0000 7f7e669ff700 1 Processor -- start 2023-10-19T12:51:22.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.770+0000 7f7e669ff700 1 -- start start 2023-10-19T12:51:22.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.770+0000 7f7e669ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7e60073250 0x7f7e6019ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:51:22.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.770+0000 7f7e669ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7e60074830 0x7f7e6019d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:51:22.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.770+0000 7f7e669ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e60108660 0x7f7e601a43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:51:22.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.770+0000 7f7e669ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e601a4970 con 0x7f7e60108660 2023-10-19T12:51:22.775 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.770+0000 7f7e669ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e601a4ab0 con 0x7f7e60074830 2023-10-19T12:51:22.775 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.770+0000 7f7e669ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e601a4c40 con 0x7f7e60073250 2023-10-19T12:51:22.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.771+0000 7f7e5ffff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7e60073250 0x7f7e6019ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:51:22.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.771+0000 7f7e5ffff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7e60073250 0x7f7e6019ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:44228/0 (socket says 172.21.15.46:44228) 2023-10-19T12:51:22.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.771+0000 7f7e5ffff700 1 -- 172.21.15.46:0/3871717785 learned_addr learned my addr 172.21.15.46:0/3871717785 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:51:22.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.771+0000 7f7e64f9c700 1 --2- 172.21.15.46:0/3871717785 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e60108660 0x7f7e601a43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:51:22.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.772+0000 7f7e5ffff700 1 -- 172.21.15.46:0/3871717785 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7e60074830 msgr2=0x7f7e6019d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:51:22.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.772+0000 7f7e5ffff700 1 --2- 172.21.15.46:0/3871717785 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7e60074830 0x7f7e6019d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:51:22.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.772+0000 7f7e5ffff700 1 -- 172.21.15.46:0/3871717785 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e60108660 msgr2=0x7f7e601a43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:51:22.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.772+0000 7f7e5ffff700 1 --2- 172.21.15.46:0/3871717785 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e60108660 0x7f7e601a43a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:51:22.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.772+0000 7f7e5ffff700 1 -- 172.21.15.46:0/3871717785 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e480095f0 con 0x7f7e60073250 2023-10-19T12:51:22.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.782+0000 7f7e5ffff700 1 --2- 172.21.15.46:0/3871717785 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7e60073250 0x7f7e6019ce40 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7e5000b530 tx=0x7f7e5000b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:51:22.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.784+0000 7f7e5dffb700 1 -- 172.21.15.46:0/3871717785 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e50011830 con 0x7f7e60073250 2023-10-19T12:51:22.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.784+0000 7f7e5dffb700 1 -- 172.21.15.46:0/3871717785 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7e50011e50 con 0x7f7e60073250 2023-10-19T12:51:22.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.784+0000 7f7e5dffb700 1 -- 172.21.15.46:0/3871717785 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e5000f2e0 con 0x7f7e60073250 2023-10-19T12:51:22.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.784+0000 7f7e669ff700 1 -- 172.21.15.46:0/3871717785 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e601a4f20 con 0x7f7e60073250 2023-10-19T12:51:22.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.785+0000 7f7e669ff700 1 -- 172.21.15.46:0/3871717785 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e601a52f0 con 0x7f7e60073250 2023-10-19T12:51:22.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.792+0000 7f7e5dffb700 1 -- 172.21.15.46:0/3871717785 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f7e50010580 con 0x7f7e60073250 2023-10-19T12:51:22.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.794+0000 7f7e5dffb700 1 --2- 172.21.15.46:0/3871717785 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f7e4c0a1500 0x7f7e4c0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:51:22.798 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.794+0000 7f7e5dffb700 1 -- 172.21.15.46:0/3871717785 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f7e500ccb80 con 0x7f7e60073250 2023-10-19T12:51:22.798 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.795+0000 7f7e57fff700 1 --2- 172.21.15.46:0/3871717785 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f7e4c0a1500 0x7f7e4c0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:51:22.799 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.796+0000 7f7e57fff700 1 --2- 172.21.15.46:0/3871717785 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f7e4c0a1500 0x7f7e4c0a39c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f7e480098e0 tx=0x7f7e48005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:51:22.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.808+0000 7f7e7a2c3b80 1 Processor -- start 2023-10-19T12:51:22.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.808+0000 7f7e7a2c3b80 1 -- start start 2023-10-19T12:51:22.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.809+0000 7f7e7a2c3b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c8a55222d0 0x55c8a55226f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:51:22.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.809+0000 7f7e7a2c3b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c8a5522c30 0x55c8a5521090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:51:22.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.809+0000 7f7e7a2c3b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c8a55215d0 0x55c8a5521a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:51:22.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.809+0000 7f7e7a2c3b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8a54946e0 con 0x55c8a5522c30 2023-10-19T12:51:22.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.809+0000 7f7e7a2c3b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8a547ac60 con 0x55c8a55222d0 2023-10-19T12:51:22.814 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.809+0000 7f7e7a2c3b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8a5478580 con 0x55c8a55215d0 2023-10-19T12:51:22.814 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.810+0000 7f7e64f9c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c8a55215d0 0x55c8a5521a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:51:22.814 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.810+0000 7f7e64f9c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c8a55215d0 0x55c8a5521a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:44232/0 (socket says 172.21.15.46:44232) 2023-10-19T12:51:22.814 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.810+0000 7f7e64f9c700 1 -- 172.21.15.46:0/3325568976 learned_addr learned my addr 172.21.15.46:0/3325568976 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:51:22.815 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.810+0000 7f7e57fff700 1 --2- 172.21.15.46:0/3325568976 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c8a5522c30 0x55c8a5521090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:51:22.815 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.810+0000 7f7e64f9c700 1 -- 172.21.15.46:0/3325568976 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c8a55222d0 msgr2=0x55c8a55226f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:51:22.815 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.810+0000 7f7e64f9c700 1 --2- 172.21.15.46:0/3325568976 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c8a55222d0 0x55c8a55226f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:51:22.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.810+0000 7f7e64f9c700 1 -- 172.21.15.46:0/3325568976 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c8a5522c30 msgr2=0x55c8a5521090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:51:22.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.810+0000 7f7e64f9c700 1 --2- 172.21.15.46:0/3325568976 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c8a5522c30 0x55c8a5521090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:51:22.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.810+0000 7f7e64f9c700 1 -- 172.21.15.46:0/3325568976 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c8a54313f0 con 0x55c8a55215d0 2023-10-19T12:51:22.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.811+0000 7f7e57fff700 1 --2- 172.21.15.46:0/3325568976 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c8a5522c30 0x55c8a5521090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T12:51:22.816 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.811+0000 7f7e64f9c700 1 --2- 172.21.15.46:0/3325568976 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c8a55215d0 0x55c8a5521a50 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7e58009f20 tx=0x7f7e58009f50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c320dc0bb81cd677 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:51:22.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.811+0000 7f7e567fc700 1 -- 172.21.15.46:0/3325568976 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e58011070 con 0x55c8a55215d0 2023-10-19T12:51:22.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.811+0000 7f7e567fc700 1 -- 172.21.15.46:0/3325568976 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7e58009a50 con 0x55c8a55215d0 2023-10-19T12:51:22.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.811+0000 7f7e567fc700 1 -- 172.21.15.46:0/3325568976 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e5800a400 con 0x55c8a55215d0 2023-10-19T12:51:22.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.812+0000 7f7e7a2c3b80 1 -- 172.21.15.46:0/3325568976 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c8a55215d0 msgr2=0x55c8a5521a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:51:22.818 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.812+0000 7f7e7a2c3b80 1 --2- 172.21.15.46:0/3325568976 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c8a55215d0 0x55c8a5521a50 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7e58009f20 tx=0x7f7e58009f50 comp rx=0 tx=0).stop 2023-10-19T12:51:22.818 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.813+0000 7f7e7a2c3b80 1 -- 172.21.15.46:0/3325568976 shutdown_connections 2023-10-19T12:51:22.818 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.813+0000 7f7e7a2c3b80 1 --2- 172.21.15.46:0/3325568976 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c8a55215d0 0x55c8a5521a50 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:51:22.818 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.813+0000 7f7e7a2c3b80 1 --2- 172.21.15.46:0/3325568976 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c8a55222d0 0x55c8a55226f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:51:22.819 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.813+0000 7f7e7a2c3b80 1 --2- 172.21.15.46:0/3325568976 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c8a5522c30 0x55c8a5521090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:51:22.819 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.813+0000 7f7e7a2c3b80 1 -- 172.21.15.46:0/3325568976 >> 172.21.15.46:0/3325568976 conn(0x55c8a5495720 msgr2=0x55c8a551bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:51:22.819 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.813+0000 7f7e7a2c3b80 1 -- 172.21.15.46:0/3325568976 shutdown_connections 2023-10-19T12:51:22.820 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.813+0000 7f7e7a2c3b80 1 -- 172.21.15.46:0/3325568976 wait complete. 2023-10-19T12:51:22.820 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.814+0000 7f7e7a2c3b80 1 -- start start 2023-10-19T12:51:22.820 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.814+0000 7f7e7a2c3b80 1 Processor -- start 2023-10-19T12:51:22.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.817+0000 7f7e7a2c3b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c8a55215d0 0x55c8a552abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:51:22.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.818+0000 7f7e7a2c3b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c8a55222d0 0x55c8a552b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:51:22.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.818+0000 7f7e7a2c3b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c8a5522c30 0x55c8a5532120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:51:22.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.818+0000 7f7e5ffff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c8a55215d0 0x55c8a552abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:51:22.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.818+0000 7f7e5ffff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c8a55215d0 0x55c8a552abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:59532/0 (socket says 172.21.15.46:59532) 2023-10-19T12:51:22.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.818+0000 7f7e57fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c8a55222d0 0x55c8a552b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:51:22.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.818+0000 7f7e57fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c8a55222d0 0x55c8a552b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:44238/0 (socket says 172.21.15.46:44238) 2023-10-19T12:51:22.823 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.818+0000 7f7e64f9c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c8a5522c30 0x55c8a5532120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:51:22.824 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.819+0000 7f7e64f9c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c8a5522c30 0x55c8a5532120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58868/0 (socket says 172.21.15.46:58868) 2023-10-19T12:51:22.824 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.820+0000 7f7e5ffff700 1 -- 172.21.15.46:0/63539269 learned_addr learned my addr 172.21.15.46:0/63539269 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:51:22.824 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.820+0000 7f7e7a2c3b80 1 -- 172.21.15.46:0/63539269 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8a5473e70 con 0x55c8a5522c30 2023-10-19T12:51:22.824 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.820+0000 7f7e7a2c3b80 1 -- 172.21.15.46:0/63539269 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8a5410710 con 0x55c8a55215d0 2023-10-19T12:51:22.825 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.820+0000 7f7e7a2c3b80 1 -- 172.21.15.46:0/63539269 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8a54103b0 con 0x55c8a55222d0 2023-10-19T12:51:22.825 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.820+0000 7f7e7a2c3b80 10 client.0 _ll_register_callbacks cb 0x55c8a535aa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:51:22.826 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.821+0000 7f7e64f9c700 1 -- 172.21.15.46:0/63539269 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c8a55222d0 msgr2=0x55c8a552b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:51:22.826 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.821+0000 7f7e64f9c700 1 --2- 172.21.15.46:0/63539269 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c8a55222d0 0x55c8a552b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:51:22.826 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.821+0000 7f7e64f9c700 1 -- 172.21.15.46:0/63539269 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c8a55215d0 msgr2=0x55c8a552abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:51:22.826 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.821+0000 7f7e64f9c700 1 --2- 172.21.15.46:0/63539269 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c8a55215d0 0x55c8a552abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:51:22.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.821+0000 7f7e64f9c700 1 -- 172.21.15.46:0/63539269 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e58009bd0 con 0x55c8a5522c30 2023-10-19T12:51:22.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.821+0000 7f7e5ffff700 1 --2- 172.21.15.46:0/63539269 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c8a55215d0 0x55c8a552abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:51:22.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.821+0000 7f7e64f9c700 1 --2- 172.21.15.46:0/63539269 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c8a5522c30 0x55c8a5532120 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f7e58004c20 tx=0x7f7e58015f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50c7083532bcd7c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:51:22.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.821+0000 7f7e3f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2023-10-19T12:51:22.827 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.822+0000 7f7e3f7fe700 1 -- 172.21.15.46:0/63539269 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e58011050 con 0x55c8a5522c30 2023-10-19T12:51:22.828 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.822+0000 7f7e7a2c3b80 1 -- 172.21.15.46:0/63539269 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c8a54f08b0 con 0x55c8a5522c30 2023-10-19T12:51:22.828 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.822+0000 7f7e3f7fe700 1 -- 172.21.15.46:0/63539269 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f7e58006e40 con 0x55c8a5522c30 2023-10-19T12:51:22.828 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.822+0000 7f7e3f7fe700 1 -- 172.21.15.46:0/63539269 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7e58015930 con 0x55c8a5522c30 2023-10-19T12:51:22.828 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.822+0000 7f7e7a2c3b80 10 client.15900 fetch_fsmap learned FSMap version 45 2023-10-19T12:51:22.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.822+0000 7f7e7a2c3b80 1 -- 172.21.15.46:0/63539269 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x55c8a529ede0 con 0x55c8a5522c30 2023-10-19T12:51:22.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.823+0000 7f7e3f7fe700 1 -- 172.21.15.46:0/63539269 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55c8a54f08b0 con 0x55c8a5522c30 2023-10-19T12:51:22.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.823+0000 7f7e3f7fe700 1 -- 172.21.15.46:0/63539269 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 45) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f7e5801e480 con 0x55c8a5522c30 2023-10-19T12:51:22.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.823+0000 7f7e7a2c3b80 10 client.15900 fetch_fsmap finished waiting for FSMap version 45 2023-10-19T12:51:22.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.823+0000 7f7e7a2c3b80 10 client.15900 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-19T12:51:22.830 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.823+0000 7f7e7a2c3b80 20 client.15900 populate_metadata read hostname 'smithi046' 2023-10-19T12:51:22.830 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.823+0000 7f7e7a2c3b80 1 --2- 172.21.15.46:0/63539269 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x55c8a5536890 0x55c8a5538cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:51:22.830 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.823+0000 7f7e7a2c3b80 4 client.15900 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-19T12:51:22.830 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.823+0000 7f7e7a2c3b80 1 -- 172.21.15.46:0/63539269 --> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c8a546ce50 con 0x55c8a5536890 2023-10-19T12:51:22.830 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.824+0000 7f7e5ffff700 1 --2- 172.21.15.46:0/63539269 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x55c8a5536890 0x55c8a5538cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:51:22.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.825+0000 7f7e3f7fe700 10 client.15900 ms_handle_connect on v2:172.21.15.157:6838/552718978 2023-10-19T12:51:22.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.825+0000 7f7e5ffff700 1 --2- 172.21.15.46:0/63539269 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x55c8a5536890 0x55c8a5538cb0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd561e7acc81968d server_cookie=66c9d5a57ead2405 in_seq=0 out_seq=0 2023-10-19T12:51:22.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.827+0000 7f7e3f7fe700 1 -- 172.21.15.46:0/63539269 <== mds.0 v2:172.21.15.157:6838/552718978 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c8a546ce50 con 0x55c8a5536890 2023-10-19T12:51:22.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.827+0000 7f7e3f7fe700 10 client.15900 handle_command_reply: tid=0 2023-10-19T12:51:22.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.827+0000 7f7e7a2c3b80 1 client.15900 shutdown 2023-10-19T12:51:22.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.828+0000 7f7e7a2c3b80 1 -- 172.21.15.46:0/63539269 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c8a5522c30 msgr2=0x55c8a5532120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:51:22.833 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.828+0000 7f7e7a2c3b80 1 --2- 172.21.15.46:0/63539269 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c8a5522c30 0x55c8a5532120 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f7e58004c20 tx=0x7f7e58015f20 comp rx=0 tx=0).stop 2023-10-19T12:51:22.833 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.828+0000 7f7e7a2c3b80 1 -- 172.21.15.46:0/63539269 shutdown_connections 2023-10-19T12:51:22.833 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.828+0000 7f7e7a2c3b80 1 --2- 172.21.15.46:0/63539269 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x55c8a5536890 0x55c8a5538cb0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:51:22.833 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.828+0000 7f7e7a2c3b80 1 --2- 172.21.15.46:0/63539269 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c8a5522c30 0x55c8a5532120 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:51:22.833 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.828+0000 7f7e7a2c3b80 1 --2- 172.21.15.46:0/63539269 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c8a55215d0 0x55c8a552abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:51:22.833 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.828+0000 7f7e7a2c3b80 1 --2- 172.21.15.46:0/63539269 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c8a55222d0 0x55c8a552b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:51:22.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.828+0000 7f7e3f7fe700 0 client.15900 ms_handle_reset on v2:172.21.15.157:6838/552718978 2023-10-19T12:51:22.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.828+0000 7f7e7a2c3b80 1 -- 172.21.15.46:0/63539269 >> 172.21.15.46:0/63539269 conn(0x55c8a5495720 msgr2=0x55c8a551bb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:51:22.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.828+0000 7f7e7a2c3b80 1 -- 172.21.15.46:0/63539269 shutdown_connections 2023-10-19T12:51:22.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.829+0000 7f7e7a2c3b80 1 -- 172.21.15.46:0/63539269 wait complete. 2023-10-19T12:51:22.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.830+0000 7f7e7a2c3b80 20 client.15900 trim_cache size 0 max 16384 2023-10-19T12:51:22.883 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.880+0000 7f7e7a2c3b80 1 Processor -- start 2023-10-19T12:51:22.883 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.880+0000 7f7e7a2c3b80 1 -- start start 2023-10-19T12:51:22.884 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.880+0000 7f7e7a2c3b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c8a55215d0 0x55c8a5521090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:51:22.884 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.880+0000 7f7e7a2c3b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c8a55222d0 0x55c8a55320e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:51:22.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.880+0000 7f7e7a2c3b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c8a5522c30 0x55c8a552a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:51:22.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.880+0000 7f7e7a2c3b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8a52f4920 con 0x55c8a55222d0 2023-10-19T12:51:22.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.880+0000 7f7e7a2c3b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8a551ca10 con 0x55c8a5522c30 2023-10-19T12:51:22.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.880+0000 7f7e7a2c3b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8a551dbb0 con 0x55c8a55215d0 2023-10-19T12:51:22.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.881+0000 7f7e5ffff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c8a55215d0 0x55c8a5521090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:51:22.886 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.881+0000 7f7e5ffff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c8a55215d0 0x55c8a5521090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:44250/0 (socket says 172.21.15.46:44250) 2023-10-19T12:51:22.886 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.881+0000 7f7e5ffff700 1 -- 172.21.15.46:0/2184878970 learned_addr learned my addr 172.21.15.46:0/2184878970 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:51:22.886 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.881+0000 7f7e64f9c700 1 --2- 172.21.15.46:0/2184878970 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c8a5522c30 0x55c8a552a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:51:22.887 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.881+0000 7f7e5ffff700 1 -- 172.21.15.46:0/2184878970 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c8a5522c30 msgr2=0x55c8a552a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:51:22.887 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.881+0000 7f7e5ffff700 1 --2- 172.21.15.46:0/2184878970 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c8a5522c30 0x55c8a552a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:51:22.887 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.881+0000 7f7e5ffff700 1 -- 172.21.15.46:0/2184878970 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c8a55222d0 msgr2=0x55c8a55320e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:51:22.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.881+0000 7f7e5ffff700 1 --2- 172.21.15.46:0/2184878970 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c8a55222d0 0x55c8a55320e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:51:22.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.881+0000 7f7e5ffff700 1 -- 172.21.15.46:0/2184878970 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c8a5287c60 con 0x55c8a55215d0 2023-10-19T12:51:22.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.881+0000 7f7e64f9c700 1 --2- 172.21.15.46:0/2184878970 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c8a5522c30 0x55c8a552a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T12:51:22.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.881+0000 7f7e5ffff700 1 --2- 172.21.15.46:0/2184878970 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c8a55215d0 0x55c8a5521090 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7e500b7fd0 tx=0x7f7e50010980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2727451c69eac00 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:51:22.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.882+0000 7f7e56ffd700 1 -- 172.21.15.46:0/2184878970 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e50099ad0 con 0x55c8a55215d0 2023-10-19T12:51:22.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.882+0000 7f7e56ffd700 1 -- 172.21.15.46:0/2184878970 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7e5009dc20 con 0x55c8a55215d0 2023-10-19T12:51:22.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.882+0000 7f7e56ffd700 1 -- 172.21.15.46:0/2184878970 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e50097f90 con 0x55c8a55215d0 2023-10-19T12:51:22.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.883+0000 7f7e7a2c3b80 1 -- 172.21.15.46:0/2184878970 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c8a55215d0 msgr2=0x55c8a5521090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:51:22.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.883+0000 7f7e7a2c3b80 1 --2- 172.21.15.46:0/2184878970 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c8a55215d0 0x55c8a5521090 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7e500b7fd0 tx=0x7f7e50010980 comp rx=0 tx=0).stop 2023-10-19T12:51:22.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.883+0000 7f7e7a2c3b80 1 -- 172.21.15.46:0/2184878970 shutdown_connections 2023-10-19T12:51:22.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.883+0000 7f7e7a2c3b80 1 --2- 172.21.15.46:0/2184878970 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c8a5522c30 0x55c8a552a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:51:22.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.883+0000 7f7e7a2c3b80 1 --2- 172.21.15.46:0/2184878970 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c8a55215d0 0x55c8a5521090 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:51:22.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.883+0000 7f7e7a2c3b80 1 --2- 172.21.15.46:0/2184878970 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c8a55222d0 0x55c8a55320e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:51:22.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.883+0000 7f7e7a2c3b80 1 -- 172.21.15.46:0/2184878970 >> 172.21.15.46:0/2184878970 conn(0x55c8a5495720 msgr2=0x55c8a5528b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:51:22.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.883+0000 7f7e7a2c3b80 1 -- 172.21.15.46:0/2184878970 shutdown_connections 2023-10-19T12:51:22.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.883+0000 7f7e7a2c3b80 1 -- 172.21.15.46:0/2184878970 wait complete. 2023-10-19T12:51:22.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.884+0000 7f7e7a2c3b80 1 -- start start 2023-10-19T12:51:22.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.884+0000 7f7e7a2c3b80 1 Processor -- start 2023-10-19T12:51:22.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.885+0000 7f7e7a2c3b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c8a55215d0 0x55c8a5531b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:51:22.893 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.885+0000 7f7e7a2c3b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c8a55222d0 0x55c8a5532060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:51:22.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.885+0000 7f7e7a2c3b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c8a5522c30 0x55c8a552e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:51:22.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.885+0000 7f7e7a2c3b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8a552ee20 con 0x55c8a55215d0 2023-10-19T12:51:22.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.885+0000 7f7e7a2c3b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8a552ef90 con 0x55c8a5522c30 2023-10-19T12:51:22.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.885+0000 7f7e7a2c3b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8a552f150 con 0x55c8a55222d0 2023-10-19T12:51:22.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.885+0000 7f7e7a2c3b80 10 client.0 _ll_register_callbacks cb 0x55c8a535aa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:51:22.894 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.885+0000 7f7e57fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c8a55222d0 0x55c8a5532060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:51:22.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.885+0000 7f7e57fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c8a55222d0 0x55c8a5532060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:44256/0 (socket says 172.21.15.46:44256) 2023-10-19T12:51:22.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.885+0000 7f7e57fff700 1 -- 172.21.15.46:0/3757929975 learned_addr learned my addr 172.21.15.46:0/3757929975 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:51:22.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.886+0000 7f7e64f9c700 1 --2- 172.21.15.46:0/3757929975 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c8a5522c30 0x55c8a552e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:51:22.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.886+0000 7f7e57fff700 1 -- 172.21.15.46:0/3757929975 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c8a5522c30 msgr2=0x55c8a552e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:51:22.895 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.886+0000 7f7e57fff700 1 --2- 172.21.15.46:0/3757929975 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c8a5522c30 0x55c8a552e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:51:22.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.886+0000 7f7e57fff700 1 -- 172.21.15.46:0/3757929975 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c8a55215d0 msgr2=0x55c8a5531b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:51:22.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.886+0000 7f7e57fff700 1 --2- 172.21.15.46:0/3757929975 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c8a55215d0 0x55c8a5531b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:51:22.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.886+0000 7f7e57fff700 1 -- 172.21.15.46:0/3757929975 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e601a52f0 con 0x55c8a55222d0 2023-10-19T12:51:22.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.886+0000 7f7e64f9c700 1 --2- 172.21.15.46:0/3757929975 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c8a5522c30 0x55c8a552e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T12:51:22.896 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.886+0000 7f7e57fff700 1 --2- 172.21.15.46:0/3757929975 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c8a55222d0 0x55c8a5532060 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7e48009990 tx=0x7f7e48009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c450d7481daed1 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:51:22.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.886+0000 7f7e3f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-10-19T12:51:22.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.887+0000 7f7e3f7fe700 1 -- 172.21.15.46:0/3757929975 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e4802a030 con 0x55c8a55222d0 2023-10-19T12:51:22.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.887+0000 7f7e7a2c3b80 1 -- 172.21.15.46:0/3757929975 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c8a5478ef0 con 0x55c8a55222d0 2023-10-19T12:51:22.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.887+0000 7f7e3f7fe700 1 -- 172.21.15.46:0/3757929975 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f7e48005070 con 0x55c8a55222d0 2023-10-19T12:51:22.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.887+0000 7f7e3f7fe700 1 -- 172.21.15.46:0/3757929975 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7e4801d070 con 0x55c8a55222d0 2023-10-19T12:51:22.897 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.887+0000 7f7e7a2c3b80 10 client.26059 fetch_fsmap learned FSMap version 45 2023-10-19T12:51:22.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.887+0000 7f7e7a2c3b80 1 -- 172.21.15.46:0/3757929975 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x55c8a52c5250 con 0x55c8a55222d0 2023-10-19T12:51:22.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.887+0000 7f7e3f7fe700 1 -- 172.21.15.46:0/3757929975 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55c8a5478ef0 con 0x55c8a55222d0 2023-10-19T12:51:22.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.888+0000 7f7e3f7fe700 1 -- 172.21.15.46:0/3757929975 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 45) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f7e480304a0 con 0x55c8a55222d0 2023-10-19T12:51:22.898 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.889+0000 7f7e7a2c3b80 10 client.26059 fetch_fsmap finished waiting for FSMap version 45 2023-10-19T12:51:22.901 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.889+0000 7f7e7a2c3b80 10 client.26059 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-19T12:51:22.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.889+0000 7f7e7a2c3b80 20 client.26059 populate_metadata read hostname 'smithi046' 2023-10-19T12:51:22.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.889+0000 7f7e7a2c3b80 1 --2- 172.21.15.46:0/3757929975 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x55c8a558bdf0 0x55c8a558e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:51:22.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.889+0000 7f7e7a2c3b80 4 client.26059 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-19T12:51:22.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.889+0000 7f7e7a2c3b80 1 -- 172.21.15.46:0/3757929975 --> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55c8a546cb70 con 0x55c8a558bdf0 2023-10-19T12:51:22.902 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.889+0000 7f7e5ffff700 1 --2- 172.21.15.46:0/3757929975 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x55c8a558bdf0 0x55c8a558e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:51:22.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.890+0000 7f7e3f7fe700 10 client.26059 ms_handle_connect on v2:172.21.15.157:6838/552718978 2023-10-19T12:51:22.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.890+0000 7f7e5ffff700 1 --2- 172.21.15.46:0/3757929975 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x55c8a558bdf0 0x55c8a558e210 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=688227604fc73531 server_cookie=8565daff2e841f16 in_seq=0 out_seq=0 2023-10-19T12:51:22.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.890+0000 7f7e3f7fe700 1 -- 172.21.15.46:0/3757929975 <== mds.0 v2:172.21.15.157:6838/552718978 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55c8a546cb70 con 0x55c8a558bdf0 2023-10-19T12:51:22.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.890+0000 7f7e3f7fe700 10 client.26059 handle_command_reply: tid=0 2023-10-19T12:51:22.903 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.890+0000 7f7e7a2c3b80 1 client.26059 shutdown 2023-10-19T12:51:22.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.890+0000 7f7e7a2c3b80 1 -- 172.21.15.46:0/3757929975 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c8a55222d0 msgr2=0x55c8a5532060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:51:22.904 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.890+0000 7f7e7a2c3b80 1 --2- 172.21.15.46:0/3757929975 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c8a55222d0 0x55c8a5532060 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7e48009990 tx=0x7f7e48009310 comp rx=0 tx=0).stop 2023-10-19T12:51:22.905 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.890+0000 7f7e7a2c3b80 1 -- 172.21.15.46:0/3757929975 shutdown_connections 2023-10-19T12:51:22.905 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.890+0000 7f7e7a2c3b80 1 --2- 172.21.15.46:0/3757929975 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c8a5522c30 0x55c8a552e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:51:22.905 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.890+0000 7f7e7a2c3b80 1 --2- 172.21.15.46:0/3757929975 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x55c8a558bdf0 0x55c8a558e210 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:51:22.905 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.890+0000 7f7e7a2c3b80 1 --2- 172.21.15.46:0/3757929975 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c8a55215d0 0x55c8a5531b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:51:22.905 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.890+0000 7f7e3f7fe700 0 client.26059 ms_handle_reset on v2:172.21.15.157:6838/552718978 2023-10-19T12:51:22.906 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.890+0000 7f7e7a2c3b80 1 --2- 172.21.15.46:0/3757929975 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c8a55222d0 0x55c8a5532060 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:51:22.906 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.890+0000 7f7e7a2c3b80 1 -- 172.21.15.46:0/3757929975 >> 172.21.15.46:0/3757929975 conn(0x55c8a5495720 msgr2=0x55c8a5525550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:51:22.906 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-10-19T12:51:22.906 INFO:teuthology.orchestra.run.smithi046.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-19T12:51:22.907 INFO:teuthology.orchestra.run.smithi046.stdout: "scrubs": { 2023-10-19T12:51:22.907 INFO:teuthology.orchestra.run.smithi046.stdout: "21e73f70-af16-4ae7-bc34-e6c54ba8e1ec": { 2023-10-19T12:51:22.907 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2023-10-19T12:51:22.907 INFO:teuthology.orchestra.run.smithi046.stdout: "tag": "21e73f70-af16-4ae7-bc34-e6c54ba8e1ec", 2023-10-19T12:51:22.907 INFO:teuthology.orchestra.run.smithi046.stdout: "options": "recursive,force" 2023-10-19T12:51:22.907 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:51:22.908 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:51:22.908 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-10-19T12:51:22.909 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.891+0000 7f7e7a2c3b80 1 -- 172.21.15.46:0/3757929975 shutdown_connections 2023-10-19T12:51:22.909 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.891+0000 7f7e7a2c3b80 1 -- 172.21.15.46:0/3757929975 wait complete. 2023-10-19T12:51:22.909 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.891+0000 7f7e7a2c3b80 20 client.26059 trim_cache size 0 max 16384 2023-10-19T12:51:22.909 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.892+0000 7f7e669ff700 1 -- 172.21.15.46:0/3871717785 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f7e4c0a1500 msgr2=0x7f7e4c0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:51:22.909 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.892+0000 7f7e669ff700 1 --2- 172.21.15.46:0/3871717785 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f7e4c0a1500 0x7f7e4c0a39c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f7e480098e0 tx=0x7f7e48005fb0 comp rx=0 tx=0).stop 2023-10-19T12:51:22.910 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.892+0000 7f7e669ff700 1 -- 172.21.15.46:0/3871717785 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7e60073250 msgr2=0x7f7e6019ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:51:22.910 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.892+0000 7f7e669ff700 1 --2- 172.21.15.46:0/3871717785 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7e60073250 0x7f7e6019ce40 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7e5000b530 tx=0x7f7e5000b8f0 comp rx=0 tx=0).stop 2023-10-19T12:51:22.910 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.892+0000 7f7e669ff700 1 -- 172.21.15.46:0/3871717785 shutdown_connections 2023-10-19T12:51:22.910 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.892+0000 7f7e669ff700 1 --2- 172.21.15.46:0/3871717785 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e60108660 0x7f7e601a43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:51:22.910 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.892+0000 7f7e669ff700 1 --2- 172.21.15.46:0/3871717785 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f7e4c0a1500 0x7f7e4c0a39c0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:51:22.911 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.892+0000 7f7e669ff700 1 --2- 172.21.15.46:0/3871717785 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7e60073250 0x7f7e6019ce40 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:51:22.911 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.892+0000 7f7e669ff700 1 --2- 172.21.15.46:0/3871717785 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7e60074830 0x7f7e6019d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:51:22.911 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.892+0000 7f7e669ff700 1 -- 172.21.15.46:0/3871717785 >> 172.21.15.46:0/3871717785 conn(0x7f7e600fbcf0 msgr2=0x7f7e60100110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:51:22.911 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.893+0000 7f7e669ff700 1 -- 172.21.15.46:0/3871717785 shutdown_connections 2023-10-19T12:51:22.911 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:22.893+0000 7f7e669ff700 1 -- 172.21.15.46:0/3871717785 wait complete. 2023-10-19T12:51:22.936 INFO:tasks.cephfs.filesystem:scrub status for tag:21e73f70-af16-4ae7-bc34-e6c54ba8e1ec - {'path': '/', 'tag': '21e73f70-af16-4ae7-bc34-e6c54ba8e1ec', 'options': 'recursive,force'} 2023-10-19T12:51:24.341 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:51:23 smithi157 ceph-mon[134109]: pgmap v590: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.9 MiB/s wr, 547 op/s 2023-10-19T12:51:24.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:51:23 smithi195 ceph-mon[134493]: pgmap v590: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.9 MiB/s wr, 547 op/s 2023-10-19T12:51:24.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:51:23 smithi046 ceph-mon[98509]: pgmap v590: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.9 MiB/s wr, 547 op/s 2023-10-19T12:51:26.342 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:51:25 smithi157 ceph-mon[134109]: pgmap v591: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.2 MiB/s wr, 414 op/s 2023-10-19T12:51:26.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:51:25 smithi195 ceph-mon[134493]: pgmap v591: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.2 MiB/s wr, 414 op/s 2023-10-19T12:51:26.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:51:25 smithi046 ceph-mon[98509]: pgmap v591: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.2 MiB/s wr, 414 op/s 2023-10-19T12:51:26.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 445.0 s, 492.4 tps, lat 201.075 ms stddev 244.511 2023-10-19T12:51:28.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:51:28 smithi157 ceph-mon[134109]: pgmap v592: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 5.3 MiB/s wr, 512 op/s 2023-10-19T12:51:28.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:51:28 smithi195 ceph-mon[134493]: pgmap v592: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 5.3 MiB/s wr, 512 op/s 2023-10-19T12:51:28.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:51:28 smithi046 ceph-mon[98509]: pgmap v592: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 5.3 MiB/s wr, 512 op/s 2023-10-19T12:51:29.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:51:29 smithi046 ceph-mon[98509]: pgmap v593: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.7 MiB/s wr, 469 op/s 2023-10-19T12:51:30.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:51:29 smithi157 ceph-mon[134109]: pgmap v593: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.7 MiB/s wr, 469 op/s 2023-10-19T12:51:30.134 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:51:29 smithi195 ceph-mon[134493]: pgmap v593: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.7 MiB/s wr, 469 op/s 2023-10-19T12:51:31.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 450.0 s, 447.2 tps, lat 230.612 ms stddev 265.131 2023-10-19T12:51:32.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:51:31 smithi046 ceph-mon[98509]: pgmap v594: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.4 MiB/s wr, 432 op/s 2023-10-19T12:51:32.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:51:31 smithi157 ceph-mon[134109]: pgmap v594: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.4 MiB/s wr, 432 op/s 2023-10-19T12:51:32.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:51:31 smithi195 ceph-mon[134493]: pgmap v594: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.4 MiB/s wr, 432 op/s 2023-10-19T12:51:34.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:51:33 smithi046 ceph-mon[98509]: pgmap v595: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 5.0 MiB/s wr, 500 op/s 2023-10-19T12:51:34.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:51:33 smithi157 ceph-mon[134109]: pgmap v595: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 5.0 MiB/s wr, 500 op/s 2023-10-19T12:51:34.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:51:33 smithi195 ceph-mon[134493]: pgmap v595: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 5.0 MiB/s wr, 500 op/s 2023-10-19T12:51:36.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:51:35 smithi157 ceph-mon[134109]: pgmap v596: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 4.2 MiB/s wr, 408 op/s 2023-10-19T12:51:36.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:51:35 smithi195 ceph-mon[134493]: pgmap v596: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 4.2 MiB/s wr, 408 op/s 2023-10-19T12:51:36.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:51:35 smithi046 ceph-mon[98509]: pgmap v596: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 4.2 MiB/s wr, 408 op/s 2023-10-19T12:51:36.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 455.0 s, 440.4 tps, lat 221.587 ms stddev 261.677 2023-10-19T12:51:38.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:51:37 smithi157 ceph-mon[134109]: pgmap v597: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 5.1 MiB/s wr, 487 op/s 2023-10-19T12:51:38.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:51:37 smithi195 ceph-mon[134493]: pgmap v597: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 5.1 MiB/s wr, 487 op/s 2023-10-19T12:51:38.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:51:37 smithi046 ceph-mon[98509]: pgmap v597: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 5.1 MiB/s wr, 487 op/s 2023-10-19T12:51:39.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:51:39 smithi046 ceph-mon[98509]: pgmap v598: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 4.7 MiB/s wr, 459 op/s 2023-10-19T12:51:40.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:51:39 smithi157 ceph-mon[134109]: pgmap v598: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 4.7 MiB/s wr, 459 op/s 2023-10-19T12:51:40.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:51:39 smithi195 ceph-mon[134493]: pgmap v598: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 4.7 MiB/s wr, 459 op/s 2023-10-19T12:51:41.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 460.0 s, 376.8 tps, lat 260.505 ms stddev 312.954 2023-10-19T12:51:42.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:51:41 smithi046 ceph-mon[98509]: pgmap v599: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 4.8 MiB/s wr, 439 op/s 2023-10-19T12:51:42.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:51:41 smithi157 ceph-mon[134109]: pgmap v599: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 4.8 MiB/s wr, 439 op/s 2023-10-19T12:51:42.382 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:51:41 smithi195 ceph-mon[134493]: pgmap v599: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 4.8 MiB/s wr, 439 op/s 2023-10-19T12:51:44.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:51:43 smithi157 ceph-mon[134109]: pgmap v600: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 6.5 MiB/s wr, 543 op/s 2023-10-19T12:51:44.388 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:51:44 smithi195 ceph-mon[134493]: pgmap v600: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 6.5 MiB/s wr, 543 op/s 2023-10-19T12:51:44.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:51:43 smithi046 ceph-mon[98509]: pgmap v600: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 6.5 MiB/s wr, 543 op/s 2023-10-19T12:51:46.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:51:45 smithi157 ceph-mon[134109]: pgmap v601: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.1 MiB/s wr, 486 op/s 2023-10-19T12:51:46.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:51:45 smithi195 ceph-mon[134493]: pgmap v601: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.1 MiB/s wr, 486 op/s 2023-10-19T12:51:46.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:51:45 smithi046 ceph-mon[98509]: pgmap v601: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.1 MiB/s wr, 486 op/s 2023-10-19T12:51:46.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 465.0 s, 535.4 tps, lat 196.889 ms stddev 233.427 2023-10-19T12:51:48.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:51:48 smithi157 ceph-mon[134109]: pgmap v602: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.5 MiB/s wr, 603 op/s 2023-10-19T12:51:48.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:51:48 smithi195 ceph-mon[134493]: pgmap v602: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.5 MiB/s wr, 603 op/s 2023-10-19T12:51:48.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:51:47 smithi046 ceph-mon[98509]: pgmap v602: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.5 MiB/s wr, 603 op/s 2023-10-19T12:51:49.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:51:49 smithi046 ceph-mon[98509]: pgmap v603: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 8.0 MiB/s wr, 581 op/s 2023-10-19T12:51:50.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:51:49 smithi157 ceph-mon[134109]: pgmap v603: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 8.0 MiB/s wr, 581 op/s 2023-10-19T12:51:50.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:51:49 smithi195 ceph-mon[134493]: pgmap v603: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 8.0 MiB/s wr, 581 op/s 2023-10-19T12:51:51.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 470.0 s, 524.2 tps, lat 190.991 ms stddev 217.835 2023-10-19T12:51:52.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:51:51 smithi046 ceph-mon[98509]: pgmap v604: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 7.6 MiB/s wr, 545 op/s 2023-10-19T12:51:52.340 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:51:51 smithi157 ceph-mon[134109]: pgmap v604: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 7.6 MiB/s wr, 545 op/s 2023-10-19T12:51:52.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:51:51 smithi195 ceph-mon[134493]: pgmap v604: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 7.6 MiB/s wr, 545 op/s 2023-10-19T12:51:52.938 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-19T12:51:53.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.351+0000 7ff65b5ff700 1 -- 172.21.15.46:0/3286218454 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff6541007d0 msgr2=0x7ff654100bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:51:53.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.351+0000 7ff65b5ff700 1 --2- 172.21.15.46:0/3286218454 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff6541007d0 0x7ff654100bf0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff64800b0a0 tx=0x7ff64800b3b0 comp rx=0 tx=0).stop 2023-10-19T12:51:53.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.352+0000 7ff65b5ff700 1 -- 172.21.15.46:0/3286218454 shutdown_connections 2023-10-19T12:51:53.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.352+0000 7ff65b5ff700 1 --2- 172.21.15.46:0/3286218454 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff654102360 0x7ff654108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:51:53.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.352+0000 7ff65b5ff700 1 --2- 172.21.15.46:0/3286218454 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff6541007d0 0x7ff654100bf0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:51:53.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.352+0000 7ff65b5ff700 1 --2- 172.21.15.46:0/3286218454 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff6541019c0 0x7ff654101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:51:53.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.352+0000 7ff65b5ff700 1 -- 172.21.15.46:0/3286218454 >> 172.21.15.46:0/3286218454 conn(0x7ff6540fbd40 msgr2=0x7ff6540fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:51:53.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.352+0000 7ff65b5ff700 1 -- 172.21.15.46:0/3286218454 shutdown_connections 2023-10-19T12:51:53.357 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.352+0000 7ff65b5ff700 1 -- 172.21.15.46:0/3286218454 wait complete. 2023-10-19T12:51:53.357 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.354+0000 7ff65b5ff700 1 Processor -- start 2023-10-19T12:51:53.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.356+0000 7ff65b5ff700 1 -- start start 2023-10-19T12:51:53.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.356+0000 7ff65b5ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff6541007d0 0x7ff654198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:51:53.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.356+0000 7ff65b5ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6541019c0 0x7ff654198f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:51:53.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.356+0000 7ff65b5ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff654102360 0x7ff65419ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:51:53.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.356+0000 7ff65b5ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6541a0580 con 0x7ff6541019c0 2023-10-19T12:51:53.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.356+0000 7ff65b5ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6541a06c0 con 0x7ff6541007d0 2023-10-19T12:51:53.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.356+0000 7ff65b5ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6541a0850 con 0x7ff654102360 2023-10-19T12:51:53.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.357+0000 7ff65939b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff6541007d0 0x7ff654198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:51:53.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.357+0000 7ff65939b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff6541007d0 0x7ff654198a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:47824/0 (socket says 172.21.15.46:47824) 2023-10-19T12:51:53.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.357+0000 7ff65939b700 1 -- 172.21.15.46:0/3159201876 learned_addr learned my addr 172.21.15.46:0/3159201876 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:51:53.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.357+0000 7ff65939b700 1 -- 172.21.15.46:0/3159201876 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff654102360 msgr2=0x7ff65419ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:51:53.363 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.357+0000 7ff65939b700 1 --2- 172.21.15.46:0/3159201876 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff654102360 0x7ff65419ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:51:53.363 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.357+0000 7ff65939b700 1 -- 172.21.15.46:0/3159201876 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6541019c0 msgr2=0x7ff654198f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:51:53.363 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.357+0000 7ff65939b700 1 --2- 172.21.15.46:0/3159201876 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6541019c0 0x7ff654198f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:51:53.363 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.357+0000 7ff65939b700 1 -- 172.21.15.46:0/3159201876 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff64c009520 con 0x7ff6541007d0 2023-10-19T12:51:53.363 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.358+0000 7ff65939b700 1 --2- 172.21.15.46:0/3159201876 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff6541007d0 0x7ff654198a50 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff64800b070 tx=0x7ff648007a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:51:53.364 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.358+0000 7ff6527fc700 1 -- 172.21.15.46:0/3159201876 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff64800e050 con 0x7ff6541007d0 2023-10-19T12:51:53.364 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.358+0000 7ff6527fc700 1 -- 172.21.15.46:0/3159201876 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff648005570 con 0x7ff6541007d0 2023-10-19T12:51:53.364 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.358+0000 7ff6527fc700 1 -- 172.21.15.46:0/3159201876 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff64801ba80 con 0x7ff6541007d0 2023-10-19T12:51:53.364 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.358+0000 7ff65b5ff700 1 -- 172.21.15.46:0/3159201876 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff648009d00 con 0x7ff6541007d0 2023-10-19T12:51:53.364 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.358+0000 7ff65b5ff700 1 -- 172.21.15.46:0/3159201876 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6541a0d70 con 0x7ff6541007d0 2023-10-19T12:51:53.383 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.378+0000 7ff6527fc700 1 -- 172.21.15.46:0/3159201876 <== mon.2 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7ff64801bbe0 con 0x7ff6541007d0 2023-10-19T12:51:53.384 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.381+0000 7ff66ef37b80 1 Processor -- start 2023-10-19T12:51:53.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.381+0000 7ff66ef37b80 1 -- start start 2023-10-19T12:51:53.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.381+0000 7ff66ef37b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5593e8633ae0 0x5593e8633f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:51:53.385 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.382+0000 7ff66ef37b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5593e8634440 0x5593e86328a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:51:53.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.382+0000 7ff66ef37b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5593e8632de0 0x5593e8633260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:51:53.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.383+0000 7ff659b9c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5593e8633ae0 0x5593e8633f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:51:53.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.383+0000 7ff659b9c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5593e8633ae0 0x5593e8633f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:47830/0 (socket says 172.21.15.46:47830) 2023-10-19T12:51:53.387 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.383+0000 7ff659b9c700 1 -- 172.21.15.46:0/1220266772 learned_addr learned my addr 172.21.15.46:0/1220266772 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:51:53.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.383+0000 7ff65939b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5593e8634440 0x5593e86328a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:51:53.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.383+0000 7ff658b9a700 1 --2- 172.21.15.46:0/1220266772 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5593e8632de0 0x5593e8633260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:51:53.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.383+0000 7ff66ef37b80 1 -- 172.21.15.46:0/1220266772 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593e859d6e0 con 0x5593e8632de0 2023-10-19T12:51:53.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.383+0000 7ff66ef37b80 1 -- 172.21.15.46:0/1220266772 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593e8583c60 con 0x5593e8633ae0 2023-10-19T12:51:53.388 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.383+0000 7ff66ef37b80 1 -- 172.21.15.46:0/1220266772 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593e8581580 con 0x5593e8634440 2023-10-19T12:51:53.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.384+0000 7ff6527fc700 1 --2- 172.21.15.46:0/3159201876 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7ff6440a1480 0x7ff6440a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:51:53.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.385+0000 7ff659b9c700 1 -- 172.21.15.46:0/1220266772 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5593e8634440 msgr2=0x5593e86328a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:51:53.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.385+0000 7ff659b9c700 1 --2- 172.21.15.46:0/1220266772 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5593e8634440 0x5593e86328a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:51:53.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.385+0000 7ff659b9c700 1 -- 172.21.15.46:0/1220266772 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5593e8632de0 msgr2=0x5593e8633260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:51:53.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.385+0000 7ff659b9c700 1 --2- 172.21.15.46:0/1220266772 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5593e8632de0 0x5593e8633260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:51:53.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.385+0000 7ff659b9c700 1 -- 172.21.15.46:0/1220266772 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5593e853a3f0 con 0x5593e8633ae0 2023-10-19T12:51:53.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.386+0000 7ff658b9a700 1 --2- 172.21.15.46:0/1220266772 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5593e8632de0 0x5593e8633260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T12:51:53.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.385+0000 7ff6527fc700 1 -- 172.21.15.46:0/3159201876 <== mon.2 v2:172.21.15.157:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7ff6480ce730 con 0x7ff6541007d0 2023-10-19T12:51:53.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.387+0000 7ff659b9c700 1 --2- 172.21.15.46:0/1220266772 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5593e8633ae0 0x5593e8633f00 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff64c009d90 tx=0x7ff64c00e630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b3be534859b82db server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:51:53.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.387+0000 7ff659b9c700 1 --2- 172.21.15.46:0/3159201876 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7ff6440a1480 0x7ff6440a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:51:53.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.387+0000 7ff63f7fe700 1 -- 172.21.15.46:0/1220266772 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff64c01f070 con 0x5593e8633ae0 2023-10-19T12:51:53.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.388+0000 7ff659b9c700 1 --2- 172.21.15.46:0/3159201876 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7ff6440a1480 0x7ff6440a3940 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ff64c01e000 tx=0x7ff64c021000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:51:53.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.388+0000 7ff63f7fe700 1 -- 172.21.15.46:0/1220266772 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff64c00eeb0 con 0x5593e8633ae0 2023-10-19T12:51:53.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.389+0000 7ff63f7fe700 1 -- 172.21.15.46:0/1220266772 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff64c0053d0 con 0x5593e8633ae0 2023-10-19T12:51:53.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.390+0000 7ff66ef37b80 1 -- 172.21.15.46:0/1220266772 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5593e8633ae0 msgr2=0x5593e8633f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:51:53.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.391+0000 7ff66ef37b80 1 --2- 172.21.15.46:0/1220266772 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5593e8633ae0 0x5593e8633f00 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff64c009d90 tx=0x7ff64c00e630 comp rx=0 tx=0).stop 2023-10-19T12:51:53.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.391+0000 7ff66ef37b80 1 -- 172.21.15.46:0/1220266772 shutdown_connections 2023-10-19T12:51:53.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.391+0000 7ff66ef37b80 1 --2- 172.21.15.46:0/1220266772 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5593e8632de0 0x5593e8633260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:51:53.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.391+0000 7ff66ef37b80 1 --2- 172.21.15.46:0/1220266772 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5593e8633ae0 0x5593e8633f00 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:51:53.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.391+0000 7ff66ef37b80 1 --2- 172.21.15.46:0/1220266772 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5593e8634440 0x5593e86328a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:51:53.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.391+0000 7ff66ef37b80 1 -- 172.21.15.46:0/1220266772 >> 172.21.15.46:0/1220266772 conn(0x5593e859e720 msgr2=0x5593e8624b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:51:53.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.391+0000 7ff66ef37b80 1 -- 172.21.15.46:0/1220266772 shutdown_connections 2023-10-19T12:51:53.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.392+0000 7ff66ef37b80 1 -- 172.21.15.46:0/1220266772 wait complete. 2023-10-19T12:51:53.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.393+0000 7ff66ef37b80 1 -- start start 2023-10-19T12:51:53.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.393+0000 7ff66ef37b80 1 Processor -- start 2023-10-19T12:51:53.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.396+0000 7ff66ef37b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5593e8632de0 0x5593e863c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:51:53.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.396+0000 7ff66ef37b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5593e8633ae0 0x5593e863c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:51:53.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.396+0000 7ff66ef37b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5593e8634440 0x5593e8643900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:51:53.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.396+0000 7ff66ef37b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593e857ce70 con 0x5593e8632de0 2023-10-19T12:51:53.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.396+0000 7ff66ef37b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593e8519710 con 0x5593e8633ae0 2023-10-19T12:51:53.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.396+0000 7ff66ef37b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593e85193b0 con 0x5593e8634440 2023-10-19T12:51:53.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.396+0000 7ff66ef37b80 10 client.0 _ll_register_callbacks cb 0x5593e8463a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:51:53.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.397+0000 7ff659b9c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5593e8634440 0x5593e8643900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:51:53.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.397+0000 7ff659b9c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5593e8634440 0x5593e8643900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:42162/0 (socket says 172.21.15.46:42162) 2023-10-19T12:51:53.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.397+0000 7ff659b9c700 1 -- 172.21.15.46:0/1857358454 learned_addr learned my addr 172.21.15.46:0/1857358454 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:51:53.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.397+0000 7ff658b9a700 1 --2- 172.21.15.46:0/1857358454 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5593e8633ae0 0x5593e863c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:51:53.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.398+0000 7ff65939b700 1 --2- 172.21.15.46:0/1857358454 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5593e8632de0 0x5593e863c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:51:53.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.398+0000 7ff659b9c700 1 -- 172.21.15.46:0/1857358454 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5593e8633ae0 msgr2=0x5593e863c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:51:53.403 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.398+0000 7ff659b9c700 1 --2- 172.21.15.46:0/1857358454 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5593e8633ae0 0x5593e863c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:51:53.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.398+0000 7ff659b9c700 1 -- 172.21.15.46:0/1857358454 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5593e8632de0 msgr2=0x5593e863c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:51:53.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.399+0000 7ff659b9c700 1 --2- 172.21.15.46:0/1857358454 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5593e8632de0 0x5593e863c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:51:53.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.399+0000 7ff659b9c700 1 -- 172.21.15.46:0/1857358454 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff64c009a70 con 0x5593e8634440 2023-10-19T12:51:53.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.399+0000 7ff65939b700 1 --2- 172.21.15.46:0/1857358454 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5593e8632de0 0x5593e863c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:51:53.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.400+0000 7ff63cff9700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-10-19T12:51:53.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.400+0000 7ff659b9c700 1 --2- 172.21.15.46:0/1857358454 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5593e8634440 0x5593e8643900 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff64c009df0 tx=0x7ff64c004e20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f13c78702d1fe9f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:51:53.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.401+0000 7ff63cff9700 1 -- 172.21.15.46:0/1857358454 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff64c01f040 con 0x5593e8634440 2023-10-19T12:51:53.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.401+0000 7ff63cff9700 1 -- 172.21.15.46:0/1857358454 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7ff64c014070 con 0x5593e8634440 2023-10-19T12:51:53.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.401+0000 7ff66ef37b80 1 -- 172.21.15.46:0/1857358454 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5593e8581ef0 con 0x5593e8634440 2023-10-19T12:51:53.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.402+0000 7ff63cff9700 1 -- 172.21.15.46:0/1857358454 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff64c01aba0 con 0x5593e8634440 2023-10-19T12:51:53.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.403+0000 7ff66ef37b80 10 client.26068 fetch_fsmap learned FSMap version 45 2023-10-19T12:51:53.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.403+0000 7ff66ef37b80 1 -- 172.21.15.46:0/1857358454 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x5593e83a7de0 con 0x5593e8634440 2023-10-19T12:51:53.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.404+0000 7ff63cff9700 1 -- 172.21.15.46:0/1857358454 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5593e8581ef0 con 0x5593e8634440 2023-10-19T12:51:53.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.404+0000 7ff63cff9700 1 -- 172.21.15.46:0/1857358454 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 45) v1 ==== 7906+0+0 (secure 0 0 0) 0x7ff64c024c30 con 0x5593e8634440 2023-10-19T12:51:53.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.404+0000 7ff66ef37b80 10 client.26068 fetch_fsmap finished waiting for FSMap version 45 2023-10-19T12:51:53.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.404+0000 7ff66ef37b80 10 client.26068 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-19T12:51:53.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.404+0000 7ff66ef37b80 20 client.26068 populate_metadata read hostname 'smithi046' 2023-10-19T12:51:53.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.404+0000 7ff66ef37b80 1 --2- 172.21.15.46:0/1857358454 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x5593e8659120 0x5593e865b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:51:53.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.404+0000 7ff66ef37b80 4 client.26068 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-19T12:51:53.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.405+0000 7ff66ef37b80 1 -- 172.21.15.46:0/1857358454 --> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5593e85f98b0 con 0x5593e8659120 2023-10-19T12:51:53.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.405+0000 7ff65939b700 1 --2- 172.21.15.46:0/1857358454 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x5593e8659120 0x5593e865b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:51:53.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.407+0000 7ff65939b700 1 --2- 172.21.15.46:0/1857358454 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x5593e8659120 0x5593e865b540 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b8a2f96a44c062de server_cookie=69d46d58cb5d99e1 in_seq=0 out_seq=0 2023-10-19T12:51:53.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.407+0000 7ff63cff9700 10 client.26068 ms_handle_connect on v2:172.21.15.157:6838/552718978 2023-10-19T12:51:53.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.408+0000 7ff63cff9700 1 -- 172.21.15.46:0/1857358454 <== mds.0 v2:172.21.15.157:6838/552718978 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x7ff6480b9730 con 0x5593e8659120 2023-10-19T12:51:53.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.408+0000 7ff63cff9700 10 client.26068 handle_command_reply: tid=0 2023-10-19T12:51:53.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.408+0000 7ff66ef37b80 1 client.26068 shutdown 2023-10-19T12:51:53.412 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.409+0000 7ff66ef37b80 1 -- 172.21.15.46:0/1857358454 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5593e8634440 msgr2=0x5593e8643900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:51:53.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.409+0000 7ff66ef37b80 1 --2- 172.21.15.46:0/1857358454 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5593e8634440 0x5593e8643900 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff64c009df0 tx=0x7ff64c004e20 comp rx=0 tx=0).stop 2023-10-19T12:51:53.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.410+0000 7ff66ef37b80 1 -- 172.21.15.46:0/1857358454 shutdown_connections 2023-10-19T12:51:53.413 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.410+0000 7ff66ef37b80 1 --2- 172.21.15.46:0/1857358454 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5593e8634440 0x5593e8643900 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:51:53.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.410+0000 7ff66ef37b80 1 --2- 172.21.15.46:0/1857358454 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x5593e8659120 0x5593e865b540 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:51:53.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.410+0000 7ff66ef37b80 1 --2- 172.21.15.46:0/1857358454 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5593e8632de0 0x5593e863c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:51:53.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.410+0000 7ff66ef37b80 1 --2- 172.21.15.46:0/1857358454 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5593e8633ae0 0x5593e863c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:51:53.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.410+0000 7ff66ef37b80 1 -- 172.21.15.46:0/1857358454 >> 172.21.15.46:0/1857358454 conn(0x5593e859e720 msgr2=0x5593e8631890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:51:53.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.410+0000 7ff63cff9700 0 client.26068 ms_handle_reset on v2:172.21.15.157:6838/552718978 2023-10-19T12:51:53.415 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.411+0000 7ff66ef37b80 1 -- 172.21.15.46:0/1857358454 shutdown_connections 2023-10-19T12:51:53.415 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.411+0000 7ff66ef37b80 1 -- 172.21.15.46:0/1857358454 wait complete. 2023-10-19T12:51:53.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.414+0000 7ff66ef37b80 20 client.26068 trim_cache size 0 max 16384 2023-10-19T12:51:53.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.459+0000 7ff66ef37b80 1 Processor -- start 2023-10-19T12:51:53.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.459+0000 7ff66ef37b80 1 -- start start 2023-10-19T12:51:53.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.459+0000 7ff66ef37b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5593e8632de0 0x5593e8636ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:51:53.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.459+0000 7ff66ef37b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5593e8633ae0 0x5593e8643820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:51:53.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.459+0000 7ff66ef37b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5593e8634440 0x5593e8637020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:51:53.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.459+0000 7ff66ef37b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593e83fd920 con 0x5593e8634440 2023-10-19T12:51:53.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.459+0000 7ff66ef37b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593e8581ef0 con 0x5593e8632de0 2023-10-19T12:51:53.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.459+0000 7ff66ef37b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593e8644ad0 con 0x5593e8633ae0 2023-10-19T12:51:53.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.460+0000 7ff65939b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5593e8632de0 0x5593e8636ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:51:53.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.460+0000 7ff65939b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5593e8632de0 0x5593e8636ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:47842/0 (socket says 172.21.15.46:47842) 2023-10-19T12:51:53.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.460+0000 7ff65939b700 1 -- 172.21.15.46:0/2814778714 learned_addr learned my addr 172.21.15.46:0/2814778714 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:51:53.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.460+0000 7ff65939b700 1 -- 172.21.15.46:0/2814778714 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5593e8633ae0 msgr2=0x5593e8643820 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-19T12:51:53.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.460+0000 7ff65939b700 1 --2- 172.21.15.46:0/2814778714 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5593e8633ae0 0x5593e8643820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:51:53.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.460+0000 7ff65939b700 1 -- 172.21.15.46:0/2814778714 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5593e8634440 msgr2=0x5593e8637020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:51:53.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.460+0000 7ff65939b700 1 --2- 172.21.15.46:0/2814778714 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5593e8634440 0x5593e8637020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:51:53.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.460+0000 7ff65939b700 1 -- 172.21.15.46:0/2814778714 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5593e8390c60 con 0x5593e8632de0 2023-10-19T12:51:53.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.460+0000 7ff65939b700 1 --2- 172.21.15.46:0/2814778714 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5593e8632de0 0x5593e8636ae0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff64800b780 tx=0x7ff648086040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8a8bfaf1ae1b65f server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:51:53.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.461+0000 7ff63ffff700 1 -- 172.21.15.46:0/2814778714 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff64809b070 con 0x5593e8632de0 2023-10-19T12:51:53.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.461+0000 7ff63ffff700 1 -- 172.21.15.46:0/2814778714 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5593e85f98b0 con 0x5593e8632de0 2023-10-19T12:51:53.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.461+0000 7ff63ffff700 1 -- 172.21.15.46:0/2814778714 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6480a3a10 con 0x5593e8632de0 2023-10-19T12:51:53.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.462+0000 7ff66ef37b80 1 -- 172.21.15.46:0/2814778714 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5593e8632de0 msgr2=0x5593e8636ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:51:53.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.462+0000 7ff66ef37b80 1 --2- 172.21.15.46:0/2814778714 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5593e8632de0 0x5593e8636ae0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff64800b780 tx=0x7ff648086040 comp rx=0 tx=0).stop 2023-10-19T12:51:53.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.462+0000 7ff66ef37b80 1 -- 172.21.15.46:0/2814778714 shutdown_connections 2023-10-19T12:51:53.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.462+0000 7ff66ef37b80 1 --2- 172.21.15.46:0/2814778714 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5593e8634440 0x5593e8637020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:51:53.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.462+0000 7ff66ef37b80 1 --2- 172.21.15.46:0/2814778714 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5593e8632de0 0x5593e8636ae0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:51:53.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.462+0000 7ff66ef37b80 1 --2- 172.21.15.46:0/2814778714 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5593e8633ae0 0x5593e8643820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:51:53.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.462+0000 7ff66ef37b80 1 -- 172.21.15.46:0/2814778714 >> 172.21.15.46:0/2814778714 conn(0x5593e859e720 msgr2=0x5593e8624b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:51:53.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.462+0000 7ff66ef37b80 1 -- 172.21.15.46:0/2814778714 shutdown_connections 2023-10-19T12:51:53.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.462+0000 7ff66ef37b80 1 -- 172.21.15.46:0/2814778714 wait complete. 2023-10-19T12:51:53.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.463+0000 7ff66ef37b80 1 -- start start 2023-10-19T12:51:53.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.463+0000 7ff66ef37b80 1 Processor -- start 2023-10-19T12:51:53.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.464+0000 7ff66ef37b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5593e8632de0 0x5593e8643440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:51:53.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.464+0000 7ff66ef37b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5593e8633ae0 0x5593e8643980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:51:53.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.464+0000 7ff66ef37b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5593e8634440 0x5593e8641be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:51:53.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.464+0000 7ff66ef37b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593e86422c0 con 0x5593e8632de0 2023-10-19T12:51:53.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.464+0000 7ff66ef37b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593e8642430 con 0x5593e8633ae0 2023-10-19T12:51:53.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.464+0000 7ff66ef37b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593e86425f0 con 0x5593e8634440 2023-10-19T12:51:53.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.464+0000 7ff66ef37b80 10 client.0 _ll_register_callbacks cb 0x5593e8463a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:51:53.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.465+0000 7ff658b9a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5593e8633ae0 0x5593e8643980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:51:53.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.465+0000 7ff658b9a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5593e8633ae0 0x5593e8643980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:47852/0 (socket says 172.21.15.46:47852) 2023-10-19T12:51:53.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.465+0000 7ff658b9a700 1 -- 172.21.15.46:0/1263752557 learned_addr learned my addr 172.21.15.46:0/1263752557 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:51:53.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.465+0000 7ff658b9a700 1 -- 172.21.15.46:0/1263752557 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5593e8634440 msgr2=0x5593e8641be0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-19T12:51:53.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.465+0000 7ff658b9a700 1 --2- 172.21.15.46:0/1263752557 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5593e8634440 0x5593e8641be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:51:53.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.465+0000 7ff658b9a700 1 -- 172.21.15.46:0/1263752557 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5593e8632de0 msgr2=0x5593e8643440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:51:53.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.465+0000 7ff658b9a700 1 --2- 172.21.15.46:0/1263752557 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5593e8632de0 0x5593e8643440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:51:53.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.465+0000 7ff658b9a700 1 -- 172.21.15.46:0/1263752557 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6541a0d70 con 0x5593e8633ae0 2023-10-19T12:51:53.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.466+0000 7ff658b9a700 1 --2- 172.21.15.46:0/1263752557 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5593e8633ae0 0x5593e8643980 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff6400102f0 tx=0x7ff6400106b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39802b9235594e21 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:51:53.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.466+0000 7ff63cff9700 10 client.0 ms_handle_connect on v2:172.21.15.157:3300/0 2023-10-19T12:51:53.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.466+0000 7ff63cff9700 1 -- 172.21.15.46:0/1263752557 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff640014430 con 0x5593e8633ae0 2023-10-19T12:51:53.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.466+0000 7ff63cff9700 1 -- 172.21.15.46:0/1263752557 <== mon.2 v2:172.21.15.157:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7ff640014590 con 0x5593e8633ae0 2023-10-19T12:51:53.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.466+0000 7ff66ef37b80 1 -- 172.21.15.46:0/1263752557 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff64c00eeb0 con 0x5593e8633ae0 2023-10-19T12:51:53.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.467+0000 7ff63cff9700 1 -- 172.21.15.46:0/1263752557 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff640014790 con 0x5593e8633ae0 2023-10-19T12:51:53.477 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.469+0000 7ff66ef37b80 10 client.26054 fetch_fsmap learned FSMap version 45 2023-10-19T12:51:53.477 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.469+0000 7ff66ef37b80 1 -- 172.21.15.46:0/1263752557 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x5593e83ce250 con 0x5593e8633ae0 2023-10-19T12:51:53.477 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.469+0000 7ff63cff9700 1 -- 172.21.15.46:0/1263752557 <== mon.2 v2:172.21.15.157:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff64c00eeb0 con 0x5593e8633ae0 2023-10-19T12:51:53.478 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.470+0000 7ff63cff9700 1 -- 172.21.15.46:0/1263752557 <== mon.2 v2:172.21.15.157:3300/0 5 ==== fsmap(e 45) v1 ==== 7906+0+0 (secure 0 0 0) 0x7ff64001dad0 con 0x5593e8633ae0 2023-10-19T12:51:53.478 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.470+0000 7ff66ef37b80 10 client.26054 fetch_fsmap finished waiting for FSMap version 45 2023-10-19T12:51:53.478 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.470+0000 7ff66ef37b80 10 client.26054 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-19T12:51:53.478 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.470+0000 7ff66ef37b80 20 client.26054 populate_metadata read hostname 'smithi046' 2023-10-19T12:51:53.478 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.470+0000 7ff66ef37b80 1 --2- 172.21.15.46:0/1263752557 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x5593e86ae5a0 0x5593e86b09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:51:53.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.470+0000 7ff66ef37b80 4 client.26054 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-19T12:51:53.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.470+0000 7ff66ef37b80 1 -- 172.21.15.46:0/1263752557 --> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5593e8575e50 con 0x5593e86ae5a0 2023-10-19T12:51:53.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.471+0000 7ff65939b700 1 --2- 172.21.15.46:0/1263752557 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x5593e86ae5a0 0x5593e86b09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:51:53.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.472+0000 7ff65939b700 1 --2- 172.21.15.46:0/1263752557 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x5593e86ae5a0 0x5593e86b09c0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c1abb13257512599 server_cookie=ca8e04beb97e3ad3 in_seq=0 out_seq=0 2023-10-19T12:51:53.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.472+0000 7ff63cff9700 10 client.26054 ms_handle_connect on v2:172.21.15.157:6838/552718978 2023-10-19T12:51:53.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.472+0000 7ff63cff9700 1 -- 172.21.15.46:0/1263752557 <== mds.0 v2:172.21.15.157:6838/552718978 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x5593e8575e50 con 0x5593e86ae5a0 2023-10-19T12:51:53.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.472+0000 7ff63cff9700 10 client.26054 handle_command_reply: tid=0 2023-10-19T12:51:53.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.472+0000 7ff66ef37b80 1 client.26054 shutdown 2023-10-19T12:51:53.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.473+0000 7ff66ef37b80 1 -- 172.21.15.46:0/1263752557 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5593e8633ae0 msgr2=0x5593e8643980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:51:53.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.473+0000 7ff66ef37b80 1 --2- 172.21.15.46:0/1263752557 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5593e8633ae0 0x5593e8643980 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff6400102f0 tx=0x7ff6400106b0 comp rx=0 tx=0).stop 2023-10-19T12:51:53.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.473+0000 7ff66ef37b80 1 -- 172.21.15.46:0/1263752557 shutdown_connections 2023-10-19T12:51:53.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.473+0000 7ff66ef37b80 1 --2- 172.21.15.46:0/1263752557 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5593e8634440 0x5593e8641be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:51:53.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.473+0000 7ff66ef37b80 1 --2- 172.21.15.46:0/1263752557 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x5593e86ae5a0 0x5593e86b09c0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:51:53.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.473+0000 7ff63cff9700 0 client.26054 ms_handle_reset on v2:172.21.15.157:6838/552718978 2023-10-19T12:51:53.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.473+0000 7ff66ef37b80 1 --2- 172.21.15.46:0/1263752557 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5593e8632de0 0x5593e8643440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:51:53.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.473+0000 7ff66ef37b80 1 --2- 172.21.15.46:0/1263752557 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5593e8633ae0 0x5593e8643980 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:51:53.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.473+0000 7ff66ef37b80 1 -- 172.21.15.46:0/1263752557 >> 172.21.15.46:0/1263752557 conn(0x5593e859e720 msgr2=0x5593e8636ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:51:53.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.473+0000 7ff66ef37b80 1 -- 172.21.15.46:0/1263752557 shutdown_connections 2023-10-19T12:51:53.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.473+0000 7ff66ef37b80 1 -- 172.21.15.46:0/1263752557 wait complete. 2023-10-19T12:51:53.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.474+0000 7ff66ef37b80 20 client.26054 trim_cache size 0 max 16384 2023-10-19T12:51:53.483 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-10-19T12:51:53.483 INFO:teuthology.orchestra.run.smithi046.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-19T12:51:53.483 INFO:teuthology.orchestra.run.smithi046.stdout: "scrubs": { 2023-10-19T12:51:53.483 INFO:teuthology.orchestra.run.smithi046.stdout: "21e73f70-af16-4ae7-bc34-e6c54ba8e1ec": { 2023-10-19T12:51:53.484 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2023-10-19T12:51:53.484 INFO:teuthology.orchestra.run.smithi046.stdout: "tag": "21e73f70-af16-4ae7-bc34-e6c54ba8e1ec", 2023-10-19T12:51:53.484 INFO:teuthology.orchestra.run.smithi046.stdout: "options": "recursive,force" 2023-10-19T12:51:53.484 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:51:53.484 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:51:53.484 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-10-19T12:51:53.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.475+0000 7ff65b5ff700 1 -- 172.21.15.46:0/3159201876 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7ff6440a1480 msgr2=0x7ff6440a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:51:53.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.475+0000 7ff65b5ff700 1 --2- 172.21.15.46:0/3159201876 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7ff6440a1480 0x7ff6440a3940 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ff64c01e000 tx=0x7ff64c021000 comp rx=0 tx=0).stop 2023-10-19T12:51:53.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.475+0000 7ff65b5ff700 1 -- 172.21.15.46:0/3159201876 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff6541007d0 msgr2=0x7ff654198a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:51:53.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.475+0000 7ff65b5ff700 1 --2- 172.21.15.46:0/3159201876 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff6541007d0 0x7ff654198a50 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff64800b070 tx=0x7ff648007a20 comp rx=0 tx=0).stop 2023-10-19T12:51:53.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.475+0000 7ff65b5ff700 1 -- 172.21.15.46:0/3159201876 shutdown_connections 2023-10-19T12:51:53.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.475+0000 7ff65b5ff700 1 --2- 172.21.15.46:0/3159201876 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7ff6440a1480 0x7ff6440a3940 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:51:53.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.475+0000 7ff65b5ff700 1 --2- 172.21.15.46:0/3159201876 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff654102360 0x7ff65419ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:51:53.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.475+0000 7ff65b5ff700 1 --2- 172.21.15.46:0/3159201876 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff6541007d0 0x7ff654198a50 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:51:53.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.475+0000 7ff65b5ff700 1 --2- 172.21.15.46:0/3159201876 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6541019c0 0x7ff654198f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:51:53.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.475+0000 7ff65b5ff700 1 -- 172.21.15.46:0/3159201876 >> 172.21.15.46:0/3159201876 conn(0x7ff6540fbd40 msgr2=0x7ff654072a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:51:53.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.475+0000 7ff65b5ff700 1 -- 172.21.15.46:0/3159201876 shutdown_connections 2023-10-19T12:51:53.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:51:53.475+0000 7ff65b5ff700 1 -- 172.21.15.46:0/3159201876 wait complete. 2023-10-19T12:51:53.524 INFO:tasks.cephfs.filesystem:scrub status for tag:21e73f70-af16-4ae7-bc34-e6c54ba8e1ec - {'path': '/', 'tag': '21e73f70-af16-4ae7-bc34-e6c54ba8e1ec', 'options': 'recursive,force'} 2023-10-19T12:51:54.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:51:53 smithi157 ceph-mon[134109]: pgmap v605: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.2 MiB/s wr, 625 op/s 2023-10-19T12:51:54.382 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:51:53 smithi195 ceph-mon[134493]: pgmap v605: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.2 MiB/s wr, 625 op/s 2023-10-19T12:51:54.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:51:53 smithi046 ceph-mon[98509]: pgmap v605: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.2 MiB/s wr, 625 op/s 2023-10-19T12:51:56.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:51:56 smithi157 ceph-mon[134109]: pgmap v606: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.4 MiB/s wr, 503 op/s 2023-10-19T12:51:56.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:51:56 smithi195 ceph-mon[134493]: pgmap v606: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.4 MiB/s wr, 503 op/s 2023-10-19T12:51:56.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:51:56 smithi046 ceph-mon[98509]: pgmap v606: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.4 MiB/s wr, 503 op/s 2023-10-19T12:51:56.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 475.0 s, 523.2 tps, lat 188.075 ms stddev 248.911 2023-10-19T12:51:58.346 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:51:58 smithi157 ceph-mon[134109]: pgmap v607: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 8.9 MiB/s wr, 566 op/s 2023-10-19T12:51:58.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:51:58 smithi195 ceph-mon[134493]: pgmap v607: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 8.9 MiB/s wr, 566 op/s 2023-10-19T12:51:58.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:51:58 smithi046 ceph-mon[98509]: pgmap v607: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 8.9 MiB/s wr, 566 op/s 2023-10-19T12:51:59.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:51:59 smithi046 ceph-mon[98509]: pgmap v608: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 8.0 MiB/s wr, 474 op/s 2023-10-19T12:52:00.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:51:59 smithi157 ceph-mon[134109]: pgmap v608: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 8.0 MiB/s wr, 474 op/s 2023-10-19T12:52:00.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:51:59 smithi195 ceph-mon[134493]: pgmap v608: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 8.0 MiB/s wr, 474 op/s 2023-10-19T12:52:01.703 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 480.0 s, 435.4 tps, lat 231.385 ms stddev 244.340 2023-10-19T12:52:02.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:52:01 smithi046 ceph-mon[98509]: pgmap v609: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 6.8 MiB/s wr, 432 op/s 2023-10-19T12:52:02.341 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:52:01 smithi157 ceph-mon[134109]: pgmap v609: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 6.8 MiB/s wr, 432 op/s 2023-10-19T12:52:02.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:52:01 smithi195 ceph-mon[134493]: pgmap v609: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 6.8 MiB/s wr, 432 op/s 2023-10-19T12:52:04.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:52:03 smithi046 ceph-mon[98509]: pgmap v610: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 8.0 MiB/s wr, 530 op/s 2023-10-19T12:52:04.347 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:52:03 smithi157 ceph-mon[134109]: pgmap v610: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 8.0 MiB/s wr, 530 op/s 2023-10-19T12:52:04.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:52:03 smithi195 ceph-mon[134493]: pgmap v610: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 8.0 MiB/s wr, 530 op/s 2023-10-19T12:52:06.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:52:06 smithi157 ceph-mon[134109]: pgmap v611: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 6.4 MiB/s wr, 432 op/s 2023-10-19T12:52:06.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:52:05 smithi195 ceph-mon[134493]: pgmap v611: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 6.4 MiB/s wr, 432 op/s 2023-10-19T12:52:06.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:52:05 smithi046 ceph-mon[98509]: pgmap v611: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 6.4 MiB/s wr, 432 op/s 2023-10-19T12:52:06.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 485.0 s, 489.8 tps, lat 196.577 ms stddev 228.604 2023-10-19T12:52:08.340 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:52:08 smithi157 ceph-mon[134109]: pgmap v612: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 7.9 MiB/s wr, 518 op/s 2023-10-19T12:52:08.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:52:08 smithi195 ceph-mon[134493]: pgmap v612: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 7.9 MiB/s wr, 518 op/s 2023-10-19T12:52:08.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:52:08 smithi046 ceph-mon[98509]: pgmap v612: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 7.9 MiB/s wr, 518 op/s 2023-10-19T12:52:09.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:52:09 smithi046 ceph-mon[98509]: pgmap v613: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 6.7 MiB/s wr, 463 op/s 2023-10-19T12:52:10.091 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:52:09 smithi157 ceph-mon[134109]: pgmap v613: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 6.7 MiB/s wr, 463 op/s 2023-10-19T12:52:10.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:52:09 smithi195 ceph-mon[134493]: pgmap v613: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 6.7 MiB/s wr, 463 op/s 2023-10-19T12:52:11.702 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 490.0 s, 487.7 tps, lat 211.657 ms stddev 262.707 2023-10-19T12:52:12.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:52:12 smithi157 ceph-mon[134109]: pgmap v614: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 284 KiB/s rd, 5.9 MiB/s wr, 442 op/s 2023-10-19T12:52:12.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:52:12 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:52:12.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:52:12 smithi195 ceph-mon[134493]: pgmap v614: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 284 KiB/s rd, 5.9 MiB/s wr, 442 op/s 2023-10-19T12:52:12.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:52:12 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:52:12.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:52:12 smithi046 ceph-mon[98509]: pgmap v614: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 284 KiB/s rd, 5.9 MiB/s wr, 442 op/s 2023-10-19T12:52:12.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:52:12 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:52:14.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:52:14 smithi157 ceph-mon[134109]: pgmap v615: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 7.6 MiB/s wr, 538 op/s 2023-10-19T12:52:14.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:52:14 smithi195 ceph-mon[134493]: pgmap v615: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 7.6 MiB/s wr, 538 op/s 2023-10-19T12:52:14.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:52:14 smithi046 ceph-mon[98509]: pgmap v615: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 7.6 MiB/s wr, 538 op/s 2023-10-19T12:52:16.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:52:16 smithi157 ceph-mon[134109]: pgmap v616: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 411 KiB/s rd, 6.4 MiB/s wr, 422 op/s 2023-10-19T12:52:16.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:52:16 smithi195 ceph-mon[134493]: pgmap v616: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 411 KiB/s rd, 6.4 MiB/s wr, 422 op/s 2023-10-19T12:52:16.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:52:16 smithi046 ceph-mon[98509]: pgmap v616: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 411 KiB/s rd, 6.4 MiB/s wr, 422 op/s 2023-10-19T12:52:16.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 495.0 s, 505.1 tps, lat 196.647 ms stddev 250.678 2023-10-19T12:52:17.340 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:52:17 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:52:17.341 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:52:17 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:52:17.341 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:52:17 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:52:17.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:52:17 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:52:17.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:52:17 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:52:17.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:52:17 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:52:17.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:52:17 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:52:17.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:52:17 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:52:17.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:52:17 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:52:18.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:52:18 smithi157 ceph-mon[134109]: pgmap v617: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 7.6 MiB/s wr, 500 op/s 2023-10-19T12:52:18.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:52:18 smithi195 ceph-mon[134493]: pgmap v617: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 7.6 MiB/s wr, 500 op/s 2023-10-19T12:52:18.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:52:18 smithi046 ceph-mon[98509]: pgmap v617: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 7.6 MiB/s wr, 500 op/s 2023-10-19T12:52:19.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:52:19 smithi046 ceph-mon[98509]: pgmap v618: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 410 KiB/s rd, 6.2 MiB/s wr, 436 op/s 2023-10-19T12:52:20.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:52:19 smithi157 ceph-mon[134109]: pgmap v618: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 410 KiB/s rd, 6.2 MiB/s wr, 436 op/s 2023-10-19T12:52:20.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:52:19 smithi195 ceph-mon[134493]: pgmap v618: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 410 KiB/s rd, 6.2 MiB/s wr, 436 op/s 2023-10-19T12:52:21.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 500.0 s, 523.4 tps, lat 191.533 ms stddev 244.706 2023-10-19T12:52:22.345 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:52:21 smithi157 ceph-mon[134109]: pgmap v619: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 410 KiB/s rd, 6.2 MiB/s wr, 421 op/s 2023-10-19T12:52:22.382 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:52:21 smithi195 ceph-mon[134493]: pgmap v619: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 410 KiB/s rd, 6.2 MiB/s wr, 421 op/s 2023-10-19T12:52:22.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:52:21 smithi046 ceph-mon[98509]: pgmap v619: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 410 KiB/s rd, 6.2 MiB/s wr, 421 op/s 2023-10-19T12:52:23.525 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-19T12:52:23.958 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.955+0000 7fa2ba79d700 1 -- 172.21.15.46:0/2701816896 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa2b4107880 msgr2=0x7fa2b4109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:52:23.958 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.955+0000 7fa2ba79d700 1 --2- 172.21.15.46:0/2701816896 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa2b4107880 0x7fa2b4109c70 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fa2a8007510 tx=0x7fa2a8007820 comp rx=0 tx=0).stop 2023-10-19T12:52:23.959 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.955+0000 7fa2ba79d700 1 -- 172.21.15.46:0/2701816896 shutdown_connections 2023-10-19T12:52:23.959 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.955+0000 7fa2ba79d700 1 --2- 172.21.15.46:0/2701816896 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa2b410cd20 0x7fa2b410f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:52:23.959 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.955+0000 7fa2ba79d700 1 --2- 172.21.15.46:0/2701816896 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa2b4107880 0x7fa2b4109c70 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:52:23.959 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.955+0000 7fa2ba79d700 1 --2- 172.21.15.46:0/2701816896 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa2b410a240 0x7fa2b410c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:52:23.960 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.955+0000 7fa2ba79d700 1 -- 172.21.15.46:0/2701816896 >> 172.21.15.46:0/2701816896 conn(0x7fa2b406d660 msgr2=0x7fa2b406faa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:52:23.961 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.955+0000 7fa2ba79d700 1 -- 172.21.15.46:0/2701816896 shutdown_connections 2023-10-19T12:52:23.961 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.955+0000 7fa2ba79d700 1 -- 172.21.15.46:0/2701816896 wait complete. 2023-10-19T12:52:23.961 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.957+0000 7fa2ba79d700 1 Processor -- start 2023-10-19T12:52:23.961 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.957+0000 7fa2ba79d700 1 -- start start 2023-10-19T12:52:23.962 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.958+0000 7fa2ba79d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa2b4107880 0x7fa2b4113680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:52:23.962 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.958+0000 7fa2ba79d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa2b410a240 0x7fa2b4111d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:52:23.963 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.958+0000 7fa2ba79d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa2b410cd20 0x7fa2b4112250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:52:23.963 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.958+0000 7fa2ba79d700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b41129f0 con 0x7fa2b4107880 2023-10-19T12:52:23.963 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.958+0000 7fa2ba79d700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b4112b60 con 0x7fa2b410cd20 2023-10-19T12:52:23.964 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.958+0000 7fa2ba79d700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b41a8d10 con 0x7fa2b410a240 2023-10-19T12:52:23.964 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.959+0000 7fa2b8f9a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa2b410a240 0x7fa2b4111d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:52:23.964 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.959+0000 7fa2b8f9a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa2b410a240 0x7fa2b4111d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:49196/0 (socket says 172.21.15.46:49196) 2023-10-19T12:52:23.964 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.959+0000 7fa2b8f9a700 1 -- 172.21.15.46:0/1364919296 learned_addr learned my addr 172.21.15.46:0/1364919296 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:52:23.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.959+0000 7fa2b9f9c700 1 --2- 172.21.15.46:0/1364919296 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa2b410cd20 0x7fa2b4112250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:52:23.965 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.960+0000 7fa2b979b700 1 --2- 172.21.15.46:0/1364919296 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa2b4107880 0x7fa2b4113680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:52:23.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.960+0000 7fa2b979b700 1 -- 172.21.15.46:0/1364919296 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa2b410a240 msgr2=0x7fa2b4111d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:52:23.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.960+0000 7fa2b979b700 1 --2- 172.21.15.46:0/1364919296 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa2b410a240 0x7fa2b4111d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:52:23.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.960+0000 7fa2b979b700 1 -- 172.21.15.46:0/1364919296 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa2b410cd20 msgr2=0x7fa2b4112250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:52:23.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.960+0000 7fa2b979b700 1 --2- 172.21.15.46:0/1364919296 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa2b410cd20 0x7fa2b4112250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:52:23.966 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.960+0000 7fa2b979b700 1 -- 172.21.15.46:0/1364919296 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2a80071c0 con 0x7fa2b4107880 2023-10-19T12:52:23.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.961+0000 7fa2b979b700 1 --2- 172.21.15.46:0/1364919296 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa2b4107880 0x7fa2b4113680 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fa2a800c3b0 tx=0x7fa2a80053a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:52:23.967 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.964+0000 7fa2a67fc700 1 -- 172.21.15.46:0/1364919296 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a800f040 con 0x7fa2b4107880 2023-10-19T12:52:23.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.964+0000 7fa2a67fc700 1 -- 172.21.15.46:0/1364919296 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa2a8007c00 con 0x7fa2b4107880 2023-10-19T12:52:23.968 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.964+0000 7fa2a67fc700 1 -- 172.21.15.46:0/1364919296 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a8004ad0 con 0x7fa2b4107880 2023-10-19T12:52:23.969 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.964+0000 7fa2ba79d700 1 -- 172.21.15.46:0/1364919296 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2b41a8f40 con 0x7fa2b4107880 2023-10-19T12:52:23.974 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.966+0000 7fa2ba79d700 1 -- 172.21.15.46:0/1364919296 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2b41a92b0 con 0x7fa2b4107880 2023-10-19T12:52:23.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.974+0000 7fa2cf33fb80 1 Processor -- start 2023-10-19T12:52:23.979 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.976+0000 7fa2cf33fb80 1 -- start start 2023-10-19T12:52:23.980 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.977+0000 7fa2cf33fb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55947127fce0 0x559471280100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:52:23.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.977+0000 7fa2cf33fb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x559471280640 0x559471280ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:52:23.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.977+0000 7fa2cf33fb80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559471281000 0x559471281460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:52:23.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.977+0000 7fa2cf33fb80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594711ea6e0 con 0x559471281000 2023-10-19T12:52:23.981 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.977+0000 7fa2cf33fb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594711d0c60 con 0x559471280640 2023-10-19T12:52:23.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.977+0000 7fa2cf33fb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594711ce580 con 0x55947127fce0 2023-10-19T12:52:23.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.978+0000 7fa2a67fc700 1 -- 172.21.15.46:0/1364919296 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fa2a8004c30 con 0x7fa2b4107880 2023-10-19T12:52:23.983 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.978+0000 7fa2b9f9c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55947127fce0 0x559471280100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:52:23.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.978+0000 7fa2b9f9c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55947127fce0 0x559471280100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:49212/0 (socket says 172.21.15.46:49212) 2023-10-19T12:52:23.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.978+0000 7fa2b9f9c700 1 -- 172.21.15.46:0/1391761256 learned_addr learned my addr 172.21.15.46:0/1391761256 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:52:23.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.978+0000 7fa2b8f9a700 1 --2- 172.21.15.46:0/1391761256 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559471281000 0x559471281460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:52:23.984 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.979+0000 7fa2b9f9c700 1 -- 172.21.15.46:0/1391761256 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x559471280640 msgr2=0x559471280ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:52:23.985 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.979+0000 7fa2b9f9c700 1 --2- 172.21.15.46:0/1391761256 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x559471280640 0x559471280ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:52:23.985 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.979+0000 7fa2b9f9c700 1 -- 172.21.15.46:0/1391761256 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559471281000 msgr2=0x559471281460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:52:23.985 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.979+0000 7fa2b9f9c700 1 --2- 172.21.15.46:0/1391761256 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559471281000 0x559471281460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:52:23.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.979+0000 7fa2b9f9c700 1 -- 172.21.15.46:0/1391761256 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5594711873f0 con 0x55947127fce0 2023-10-19T12:52:23.986 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.979+0000 7fa2b9f9c700 1 --2- 172.21.15.46:0/1391761256 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55947127fce0 0x559471280100 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac009d30 tx=0x7fa2ac0078a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe4040fa5fd6ced8 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:52:23.988 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.980+0000 7fa2a67fc700 1 --2- 172.21.15.46:0/1364919296 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fa2a00a1530 0x7fa2a00a39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:52:23.988 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.981+0000 7fa2a67fc700 1 -- 172.21.15.46:0/1364919296 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7fa2a80cd790 con 0x7fa2b4107880 2023-10-19T12:52:23.988 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.981+0000 7fa29f7fe700 1 -- 172.21.15.46:0/1391761256 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2ac014610 con 0x55947127fce0 2023-10-19T12:52:23.988 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.981+0000 7fa29f7fe700 1 -- 172.21.15.46:0/1391761256 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa2ac00f050 con 0x55947127fce0 2023-10-19T12:52:23.988 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.981+0000 7fa29f7fe700 1 -- 172.21.15.46:0/1391761256 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2ac013a80 con 0x55947127fce0 2023-10-19T12:52:23.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.982+0000 7fa2b979b700 1 --2- 172.21.15.46:0/1364919296 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fa2a00a1530 0x7fa2a00a39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:52:23.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.982+0000 7fa2cf33fb80 1 -- 172.21.15.46:0/1391761256 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55947127fce0 msgr2=0x559471280100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:52:23.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.982+0000 7fa2cf33fb80 1 --2- 172.21.15.46:0/1391761256 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55947127fce0 0x559471280100 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac009d30 tx=0x7fa2ac0078a0 comp rx=0 tx=0).stop 2023-10-19T12:52:23.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.983+0000 7fa2cf33fb80 1 -- 172.21.15.46:0/1391761256 shutdown_connections 2023-10-19T12:52:23.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.983+0000 7fa2cf33fb80 1 --2- 172.21.15.46:0/1391761256 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559471281000 0x559471281460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:52:23.990 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.983+0000 7fa2b979b700 1 --2- 172.21.15.46:0/1364919296 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fa2a00a1530 0x7fa2a00a39f0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fa2a809a700 tx=0x7fa2a8005e30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:52:23.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.986+0000 7fa2cf33fb80 1 --2- 172.21.15.46:0/1391761256 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55947127fce0 0x559471280100 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:52:23.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.986+0000 7fa2cf33fb80 1 --2- 172.21.15.46:0/1391761256 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x559471280640 0x559471280ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:52:23.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.986+0000 7fa2cf33fb80 1 -- 172.21.15.46:0/1391761256 >> 172.21.15.46:0/1391761256 conn(0x5594711eb720 msgr2=0x559471271d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:52:23.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.986+0000 7fa2cf33fb80 1 -- 172.21.15.46:0/1391761256 shutdown_connections 2023-10-19T12:52:23.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.986+0000 7fa2cf33fb80 1 -- 172.21.15.46:0/1391761256 wait complete. 2023-10-19T12:52:23.992 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.987+0000 7fa2cf33fb80 1 -- start start 2023-10-19T12:52:23.992 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.987+0000 7fa2cf33fb80 1 Processor -- start 2023-10-19T12:52:23.992 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.989+0000 7fa2cf33fb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55947127fce0 0x559471289520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:52:23.993 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.989+0000 7fa2cf33fb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559471280640 0x559471289a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:52:23.993 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.990+0000 7fa2b9f9c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55947127fce0 0x559471289520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:52:23.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.990+0000 7fa2b9f9c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55947127fce0 0x559471289520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:59228/0 (socket says 172.21.15.46:59228) 2023-10-19T12:52:23.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.992+0000 7fa2b8f9a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559471280640 0x559471289a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:52:23.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.992+0000 7fa2b9f9c700 1 -- 172.21.15.46:0/1604671683 learned_addr learned my addr 172.21.15.46:0/1604671683 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:52:23.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.992+0000 7fa2cf33fb80 1 --2- 172.21.15.46:0/1604671683 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559471281000 0x559471290aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:52:23.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.992+0000 7fa2cf33fb80 1 -- 172.21.15.46:0/1604671683 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594711c9e70 con 0x559471281000 2023-10-19T12:52:23.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.992+0000 7fa2cf33fb80 1 -- 172.21.15.46:0/1604671683 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x559471166710 con 0x55947127fce0 2023-10-19T12:52:23.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.992+0000 7fa2cf33fb80 1 -- 172.21.15.46:0/1604671683 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594711663b0 con 0x559471280640 2023-10-19T12:52:23.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.992+0000 7fa2cf33fb80 10 client.0 _ll_register_callbacks cb 0x5594710b0a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:52:23.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.992+0000 7fa2b9f9c700 1 --2- 172.21.15.46:0/1604671683 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559471281000 0x559471290aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:52:23.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.992+0000 7fa2b8f9a700 1 -- 172.21.15.46:0/1604671683 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55947127fce0 msgr2=0x559471289520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:52:23.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.992+0000 7fa2b8f9a700 1 --2- 172.21.15.46:0/1604671683 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55947127fce0 0x559471289520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:52:23.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.993+0000 7fa2b8f9a700 1 -- 172.21.15.46:0/1604671683 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559471281000 msgr2=0x559471290aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:52:23.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.994+0000 7fa2b8f9a700 1 --2- 172.21.15.46:0/1604671683 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559471281000 0x559471290aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:52:23.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.994+0000 7fa2b8f9a700 1 -- 172.21.15.46:0/1604671683 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2ac009960 con 0x559471280640 2023-10-19T12:52:23.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.994+0000 7fa2b9f9c700 1 --2- 172.21.15.46:0/1604671683 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559471281000 0x559471290aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T12:52:23.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.994+0000 7fa29cff9700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-10-19T12:52:23.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.994+0000 7fa2b8f9a700 1 --2- 172.21.15.46:0/1604671683 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559471280640 0x559471289a60 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa2b00136e0 tx=0x7fa2b0009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=66091a8ca7394305 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:52:23.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.995+0000 7fa29cff9700 1 -- 172.21.15.46:0/1604671683 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2b0011970 con 0x559471280640 2023-10-19T12:52:24.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.995+0000 7fa2cf33fb80 1 -- 172.21.15.46:0/1604671683 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5594711ceef0 con 0x559471280640 2023-10-19T12:52:24.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.997+0000 7fa29cff9700 1 -- 172.21.15.46:0/1604671683 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7fa2b0011ad0 con 0x559471280640 2023-10-19T12:52:24.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.997+0000 7fa29cff9700 1 -- 172.21.15.46:0/1604671683 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa2b0011970 con 0x559471280640 2023-10-19T12:52:24.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.997+0000 7fa2cf33fb80 10 client.26080 fetch_fsmap learned FSMap version 45 2023-10-19T12:52:24.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.997+0000 7fa2cf33fb80 1 -- 172.21.15.46:0/1604671683 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x559470ff4de0 con 0x559471280640 2023-10-19T12:52:24.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.998+0000 7fa29cff9700 1 -- 172.21.15.46:0/1604671683 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5594711ceef0 con 0x559471280640 2023-10-19T12:52:24.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:23.998+0000 7fa29cff9700 1 -- 172.21.15.46:0/1604671683 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 45) v1 ==== 7906+0+0 (secure 0 0 0) 0x7fa2b001d3f0 con 0x559471280640 2023-10-19T12:52:24.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.000+0000 7fa2cf33fb80 10 client.26080 fetch_fsmap finished waiting for FSMap version 45 2023-10-19T12:52:24.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.000+0000 7fa2cf33fb80 10 client.26080 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-19T12:52:24.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.000+0000 7fa2cf33fb80 20 client.26080 populate_metadata read hostname 'smithi046' 2023-10-19T12:52:24.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.000+0000 7fa2cf33fb80 1 --2- 172.21.15.46:0/1604671683 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x559471295320 0x559471297710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:52:24.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.000+0000 7fa2cf33fb80 4 client.26080 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-19T12:52:24.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.000+0000 7fa2cf33fb80 1 -- 172.21.15.46:0/1604671683 --> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5594712468b0 con 0x559471295320 2023-10-19T12:52:24.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.002+0000 7fa2b9f9c700 1 --2- 172.21.15.46:0/1604671683 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x559471295320 0x559471297710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:52:24.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.032+0000 7fa2b9f9c700 1 --2- 172.21.15.46:0/1604671683 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x559471295320 0x559471297710 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a74020eea9664930 server_cookie=ee630fd519c0593b in_seq=0 out_seq=0 2023-10-19T12:52:24.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.032+0000 7fa29cff9700 10 client.26080 ms_handle_connect on v2:172.21.15.157:6838/552718978 2023-10-19T12:52:24.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.041+0000 7fa29cff9700 1 -- 172.21.15.46:0/1604671683 <== mds.0 v2:172.21.15.157:6838/552718978 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5594712468b0 con 0x559471295320 2023-10-19T12:52:24.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.041+0000 7fa29cff9700 10 client.26080 handle_command_reply: tid=0 2023-10-19T12:52:24.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.042+0000 7fa2cf33fb80 1 client.26080 shutdown 2023-10-19T12:52:24.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.042+0000 7fa2cf33fb80 1 -- 172.21.15.46:0/1604671683 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559471280640 msgr2=0x559471289a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:52:24.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.042+0000 7fa2cf33fb80 1 --2- 172.21.15.46:0/1604671683 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559471280640 0x559471289a60 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa2b00136e0 tx=0x7fa2b0009f90 comp rx=0 tx=0).stop 2023-10-19T12:52:24.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.042+0000 7fa2cf33fb80 1 -- 172.21.15.46:0/1604671683 shutdown_connections 2023-10-19T12:52:24.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.042+0000 7fa2cf33fb80 1 --2- 172.21.15.46:0/1604671683 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x559471295320 0x559471297710 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:52:24.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.042+0000 7fa2cf33fb80 1 --2- 172.21.15.46:0/1604671683 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559471281000 0x559471290aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:52:24.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.042+0000 7fa2cf33fb80 1 --2- 172.21.15.46:0/1604671683 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55947127fce0 0x559471289520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:52:24.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.042+0000 7fa2cf33fb80 1 --2- 172.21.15.46:0/1604671683 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559471280640 0x559471289a60 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:52:24.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.042+0000 7fa2cf33fb80 1 -- 172.21.15.46:0/1604671683 >> 172.21.15.46:0/1604671683 conn(0x5594711eb720 msgr2=0x55947127eae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:52:24.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.042+0000 7fa29cff9700 0 client.26080 ms_handle_reset on v2:172.21.15.157:6838/552718978 2023-10-19T12:52:24.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.044+0000 7fa2cf33fb80 1 -- 172.21.15.46:0/1604671683 shutdown_connections 2023-10-19T12:52:24.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.044+0000 7fa2cf33fb80 1 -- 172.21.15.46:0/1604671683 wait complete. 2023-10-19T12:52:24.049 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.044+0000 7fa2cf33fb80 20 client.26080 trim_cache size 0 max 16384 2023-10-19T12:52:24.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.084+0000 7fa2cf33fb80 1 Processor -- start 2023-10-19T12:52:24.087 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.084+0000 7fa2cf33fb80 1 -- start start 2023-10-19T12:52:24.089 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.086+0000 7fa2cf33fb80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55947127fce0 0x559471288a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:52:24.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.086+0000 7fa2cf33fb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x559471280640 0x5594712909c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:52:24.090 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.087+0000 7fa2cf33fb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559471281000 0x559471289520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:52:24.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.087+0000 7fa2b8f9a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x559471280640 0x5594712909c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:52:24.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.087+0000 7fa2b8f9a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x559471280640 0x5594712909c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:59232/0 (socket says 172.21.15.46:59232) 2023-10-19T12:52:24.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.087+0000 7fa2cf33fb80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55947104a920 con 0x55947127fce0 2023-10-19T12:52:24.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.087+0000 7fa2cf33fb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x559471272390 con 0x559471280640 2023-10-19T12:52:24.091 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.087+0000 7fa2cf33fb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x559471273090 con 0x559471281000 2023-10-19T12:52:24.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.088+0000 7fa2b8f9a700 1 -- 172.21.15.46:0/3532624638 learned_addr learned my addr 172.21.15.46:0/3532624638 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:52:24.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.088+0000 7fa2b9f9c700 1 --2- 172.21.15.46:0/3532624638 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559471281000 0x559471289520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:52:24.092 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.088+0000 7fa2b8f9a700 1 -- 172.21.15.46:0/3532624638 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559471281000 msgr2=0x559471289520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:52:24.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.088+0000 7fa2b8f9a700 1 --2- 172.21.15.46:0/3532624638 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559471281000 0x559471289520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:52:24.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.089+0000 7fa2b8f9a700 1 -- 172.21.15.46:0/3532624638 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55947127fce0 msgr2=0x559471288a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:52:24.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.089+0000 7fa2b8f9a700 1 --2- 172.21.15.46:0/3532624638 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55947127fce0 0x559471288a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:52:24.093 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.089+0000 7fa2b8f9a700 1 -- 172.21.15.46:0/3532624638 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559470fddc60 con 0x559471280640 2023-10-19T12:52:24.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.091+0000 7fa2b8f9a700 1 --2- 172.21.15.46:0/3532624638 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x559471280640 0x5594712909c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa2b001d7d0 tx=0x7fa2b00059d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=916bfa56ca5342dc server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:52:24.095 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.092+0000 7fa29ffff700 1 -- 172.21.15.46:0/3532624638 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2b001d3f0 con 0x559471280640 2023-10-19T12:52:24.096 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.092+0000 7fa29ffff700 1 -- 172.21.15.46:0/3532624638 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa2b0005590 con 0x559471280640 2023-10-19T12:52:24.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.092+0000 7fa29ffff700 1 -- 172.21.15.46:0/3532624638 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2b001de20 con 0x559471280640 2023-10-19T12:52:24.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.093+0000 7fa2cf33fb80 1 -- 172.21.15.46:0/3532624638 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x559471280640 msgr2=0x5594712909c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:52:24.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.093+0000 7fa2cf33fb80 1 --2- 172.21.15.46:0/3532624638 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x559471280640 0x5594712909c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa2b001d7d0 tx=0x7fa2b00059d0 comp rx=0 tx=0).stop 2023-10-19T12:52:24.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.093+0000 7fa2cf33fb80 1 -- 172.21.15.46:0/3532624638 shutdown_connections 2023-10-19T12:52:24.097 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.093+0000 7fa2cf33fb80 1 --2- 172.21.15.46:0/3532624638 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559471281000 0x559471289520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:52:24.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.093+0000 7fa2cf33fb80 1 --2- 172.21.15.46:0/3532624638 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55947127fce0 0x559471288a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:52:24.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.093+0000 7fa2cf33fb80 1 --2- 172.21.15.46:0/3532624638 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x559471280640 0x5594712909c0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:52:24.098 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.093+0000 7fa2cf33fb80 1 -- 172.21.15.46:0/3532624638 >> 172.21.15.46:0/3532624638 conn(0x5594711eb720 msgr2=0x5594712875b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:52:24.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.094+0000 7fa2cf33fb80 1 -- 172.21.15.46:0/3532624638 shutdown_connections 2023-10-19T12:52:24.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.094+0000 7fa2cf33fb80 1 -- 172.21.15.46:0/3532624638 wait complete. 2023-10-19T12:52:24.099 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.095+0000 7fa2cf33fb80 1 -- start start 2023-10-19T12:52:24.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.095+0000 7fa2cf33fb80 1 Processor -- start 2023-10-19T12:52:24.100 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.096+0000 7fa2cf33fb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55947127fce0 0x559471290800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:52:24.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.097+0000 7fa2cf33fb80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559471280640 0x55947128f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:52:24.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.097+0000 7fa2cf33fb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x559471281000 0x55947128f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:52:24.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.097+0000 7fa2cf33fb80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55947128fd10 con 0x559471280640 2023-10-19T12:52:24.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.097+0000 7fa2cf33fb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55947128fe80 con 0x559471281000 2023-10-19T12:52:24.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.097+0000 7fa2cf33fb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594712e9130 con 0x55947127fce0 2023-10-19T12:52:24.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.097+0000 7fa2cf33fb80 10 client.0 _ll_register_callbacks cb 0x5594710b0a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:52:24.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.098+0000 7fa2b9f9c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55947127fce0 0x559471290800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:52:24.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.098+0000 7fa2b9f9c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55947127fce0 0x559471290800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:49232/0 (socket says 172.21.15.46:49232) 2023-10-19T12:52:24.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.098+0000 7fa2b9f9c700 1 -- 172.21.15.46:0/2746399610 learned_addr learned my addr 172.21.15.46:0/2746399610 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:52:24.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.098+0000 7fa2b9f9c700 1 --2- 172.21.15.46:0/2746399610 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x559471281000 0x55947128f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:52:24.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.099+0000 7fa2b9f9c700 1 -- 172.21.15.46:0/2746399610 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x559471281000 msgr2=0x55947128f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:52:24.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.099+0000 7fa2b9f9c700 1 --2- 172.21.15.46:0/2746399610 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x559471281000 0x55947128f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:52:24.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.099+0000 7fa2b9f9c700 1 -- 172.21.15.46:0/2746399610 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559471280640 msgr2=0x55947128f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:52:24.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.099+0000 7fa2b9f9c700 1 --2- 172.21.15.46:0/2746399610 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559471280640 0x55947128f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:52:24.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.099+0000 7fa2b9f9c700 1 -- 172.21.15.46:0/2746399610 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559470ff4de0 con 0x55947127fce0 2023-10-19T12:52:24.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.100+0000 7fa29cff9700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-10-19T12:52:24.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.100+0000 7fa2b9f9c700 1 --2- 172.21.15.46:0/2746399610 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55947127fce0 0x559471290800 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac007ca0 tx=0x7fa2ac0078a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a1592c724587e1a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:52:24.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.100+0000 7fa29cff9700 1 -- 172.21.15.46:0/2746399610 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2ac025070 con 0x55947127fce0 2023-10-19T12:52:24.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.101+0000 7fa29cff9700 1 -- 172.21.15.46:0/2746399610 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7fa2ac027a20 con 0x55947127fce0 2023-10-19T12:52:24.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.101+0000 7fa2cf33fb80 1 -- 172.21.15.46:0/2746399610 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa2ac00f050 con 0x55947127fce0 2023-10-19T12:52:24.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.102+0000 7fa29cff9700 1 -- 172.21.15.46:0/2746399610 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa2ac0275c0 con 0x55947127fce0 2023-10-19T12:52:24.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.103+0000 7fa2cf33fb80 10 client.26086 fetch_fsmap learned FSMap version 45 2023-10-19T12:52:24.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.103+0000 7fa2cf33fb80 1 -- 172.21.15.46:0/2746399610 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x55947101b250 con 0x55947127fce0 2023-10-19T12:52:24.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.103+0000 7fa29cff9700 1 -- 172.21.15.46:0/2746399610 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa2ac00f050 con 0x55947127fce0 2023-10-19T12:52:24.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.103+0000 7fa29cff9700 1 -- 172.21.15.46:0/2746399610 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 45) v1 ==== 7906+0+0 (secure 0 0 0) 0x7fa2ac005800 con 0x55947127fce0 2023-10-19T12:52:24.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.103+0000 7fa2cf33fb80 10 client.26086 fetch_fsmap finished waiting for FSMap version 45 2023-10-19T12:52:24.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.103+0000 7fa2cf33fb80 10 client.26086 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-19T12:52:24.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.104+0000 7fa2cf33fb80 20 client.26086 populate_metadata read hostname 'smithi046' 2023-10-19T12:52:24.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.104+0000 7fa2cf33fb80 1 --2- 172.21.15.46:0/2746399610 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x5594712eaa80 0x5594712ecea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:52:24.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.104+0000 7fa2cf33fb80 4 client.26086 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-19T12:52:24.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.104+0000 7fa2cf33fb80 1 -- 172.21.15.46:0/2746399610 --> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5594711c2e50 con 0x5594712eaa80 2023-10-19T12:52:24.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.104+0000 7fa2b8f9a700 1 --2- 172.21.15.46:0/2746399610 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x5594712eaa80 0x5594712ecea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:52:24.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.106+0000 7fa2b8f9a700 1 --2- 172.21.15.46:0/2746399610 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x5594712eaa80 0x5594712ecea0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a54f2d35cd0828b8 server_cookie=99f11da0e1de5cfd in_seq=0 out_seq=0 2023-10-19T12:52:24.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.106+0000 7fa29cff9700 10 client.26086 ms_handle_connect on v2:172.21.15.157:6838/552718978 2023-10-19T12:52:24.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.106+0000 7fa29cff9700 1 -- 172.21.15.46:0/2746399610 <== mds.0 v2:172.21.15.157:6838/552718978 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x5594711c2e50 con 0x5594712eaa80 2023-10-19T12:52:24.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.107+0000 7fa29cff9700 10 client.26086 handle_command_reply: tid=0 2023-10-19T12:52:24.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.107+0000 7fa2cf33fb80 1 client.26086 shutdown 2023-10-19T12:52:24.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.110+0000 7fa2cf33fb80 1 -- 172.21.15.46:0/2746399610 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55947127fce0 msgr2=0x559471290800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:52:24.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.110+0000 7fa2cf33fb80 1 --2- 172.21.15.46:0/2746399610 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55947127fce0 0x559471290800 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac007ca0 tx=0x7fa2ac0078a0 comp rx=0 tx=0).stop 2023-10-19T12:52:24.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.110+0000 7fa2cf33fb80 1 -- 172.21.15.46:0/2746399610 shutdown_connections 2023-10-19T12:52:24.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.110+0000 7fa2cf33fb80 1 --2- 172.21.15.46:0/2746399610 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x559471281000 0x55947128f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:52:24.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.110+0000 7fa2cf33fb80 1 --2- 172.21.15.46:0/2746399610 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55947127fce0 0x559471290800 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:52:24.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.110+0000 7fa2cf33fb80 1 --2- 172.21.15.46:0/2746399610 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x5594712eaa80 0x5594712ecea0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:52:24.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.110+0000 7fa2cf33fb80 1 --2- 172.21.15.46:0/2746399610 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559471280640 0x55947128f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:52:24.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.110+0000 7fa2cf33fb80 1 -- 172.21.15.46:0/2746399610 >> 172.21.15.46:0/2746399610 conn(0x5594711eb720 msgr2=0x5594712894c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:52:24.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.110+0000 7fa29cff9700 0 client.26086 ms_handle_reset on v2:172.21.15.157:6838/552718978 2023-10-19T12:52:24.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.111+0000 7fa2cf33fb80 1 -- 172.21.15.46:0/2746399610 shutdown_connections 2023-10-19T12:52:24.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.111+0000 7fa2cf33fb80 1 -- 172.21.15.46:0/2746399610 wait complete. 2023-10-19T12:52:24.116 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.111+0000 7fa2cf33fb80 20 client.26086 trim_cache size 0 max 16384 2023-10-19T12:52:24.116 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-10-19T12:52:24.117 INFO:teuthology.orchestra.run.smithi046.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-19T12:52:24.117 INFO:teuthology.orchestra.run.smithi046.stdout: "scrubs": { 2023-10-19T12:52:24.117 INFO:teuthology.orchestra.run.smithi046.stdout: "21e73f70-af16-4ae7-bc34-e6c54ba8e1ec": { 2023-10-19T12:52:24.117 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2023-10-19T12:52:24.117 INFO:teuthology.orchestra.run.smithi046.stdout: "tag": "21e73f70-af16-4ae7-bc34-e6c54ba8e1ec", 2023-10-19T12:52:24.118 INFO:teuthology.orchestra.run.smithi046.stdout: "options": "recursive,force" 2023-10-19T12:52:24.118 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:52:24.118 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:52:24.118 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-10-19T12:52:24.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.112+0000 7fa2ba79d700 1 -- 172.21.15.46:0/1364919296 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fa2a00a1530 msgr2=0x7fa2a00a39f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:52:24.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.112+0000 7fa2ba79d700 1 --2- 172.21.15.46:0/1364919296 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fa2a00a1530 0x7fa2a00a39f0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fa2a809a700 tx=0x7fa2a8005e30 comp rx=0 tx=0).stop 2023-10-19T12:52:24.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.112+0000 7fa2ba79d700 1 -- 172.21.15.46:0/1364919296 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa2b4107880 msgr2=0x7fa2b4113680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:52:24.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.112+0000 7fa2ba79d700 1 --2- 172.21.15.46:0/1364919296 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa2b4107880 0x7fa2b4113680 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fa2a800c3b0 tx=0x7fa2a80053a0 comp rx=0 tx=0).stop 2023-10-19T12:52:24.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.112+0000 7fa2ba79d700 1 -- 172.21.15.46:0/1364919296 shutdown_connections 2023-10-19T12:52:24.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.112+0000 7fa2ba79d700 1 --2- 172.21.15.46:0/1364919296 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa2b410cd20 0x7fa2b4112250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:52:24.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.112+0000 7fa2ba79d700 1 --2- 172.21.15.46:0/1364919296 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa2b4107880 0x7fa2b4113680 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:52:24.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.112+0000 7fa2ba79d700 1 --2- 172.21.15.46:0/1364919296 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fa2a00a1530 0x7fa2a00a39f0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:52:24.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.112+0000 7fa2ba79d700 1 --2- 172.21.15.46:0/1364919296 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa2b410a240 0x7fa2b4111d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:52:24.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.112+0000 7fa2ba79d700 1 -- 172.21.15.46:0/1364919296 >> 172.21.15.46:0/1364919296 conn(0x7fa2b406d660 msgr2=0x7fa2b41099d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:52:24.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.113+0000 7fa2ba79d700 1 -- 172.21.15.46:0/1364919296 shutdown_connections 2023-10-19T12:52:24.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:24.113+0000 7fa2ba79d700 1 -- 172.21.15.46:0/1364919296 wait complete. 2023-10-19T12:52:24.149 INFO:tasks.cephfs.filesystem:scrub status for tag:21e73f70-af16-4ae7-bc34-e6c54ba8e1ec - {'path': '/', 'tag': '21e73f70-af16-4ae7-bc34-e6c54ba8e1ec', 'options': 'recursive,force'} 2023-10-19T12:52:24.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:52:24 smithi157 ceph-mon[134109]: pgmap v620: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 7.7 MiB/s wr, 518 op/s 2023-10-19T12:52:24.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:52:24 smithi195 ceph-mon[134493]: pgmap v620: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 7.7 MiB/s wr, 518 op/s 2023-10-19T12:52:24.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:52:24 smithi046 ceph-mon[98509]: pgmap v620: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 7.7 MiB/s wr, 518 op/s 2023-10-19T12:52:26.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:52:26 smithi157 ceph-mon[134109]: pgmap v621: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.9 MiB/s wr, 416 op/s 2023-10-19T12:52:26.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:52:26 smithi195 ceph-mon[134493]: pgmap v621: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.9 MiB/s wr, 416 op/s 2023-10-19T12:52:26.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:52:26 smithi046 ceph-mon[98509]: pgmap v621: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.9 MiB/s wr, 416 op/s 2023-10-19T12:52:26.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 505.0 s, 416.8 tps, lat 225.575 ms stddev 336.039 2023-10-19T12:52:28.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:52:28 smithi157 ceph-mon[134109]: pgmap v622: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.8 MiB/s wr, 530 op/s 2023-10-19T12:52:28.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:52:28 smithi195 ceph-mon[134493]: pgmap v622: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.8 MiB/s wr, 530 op/s 2023-10-19T12:52:28.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:52:28 smithi046 ceph-mon[98509]: pgmap v622: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.8 MiB/s wr, 530 op/s 2023-10-19T12:52:29.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:52:29 smithi046 ceph-mon[98509]: pgmap v623: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 6.1 MiB/s wr, 480 op/s 2023-10-19T12:52:30.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:52:29 smithi157 ceph-mon[134109]: pgmap v623: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 6.1 MiB/s wr, 480 op/s 2023-10-19T12:52:30.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:52:29 smithi195 ceph-mon[134493]: pgmap v623: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 6.1 MiB/s wr, 480 op/s 2023-10-19T12:52:31.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 510.0 s, 438.6 tps, lat 243.587 ms stddev 296.860 2023-10-19T12:52:32.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:52:31 smithi157 ceph-mon[134109]: pgmap v624: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.3 MiB/s wr, 466 op/s 2023-10-19T12:52:32.386 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:52:31 smithi195 ceph-mon[134493]: pgmap v624: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.3 MiB/s wr, 466 op/s 2023-10-19T12:52:32.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:52:31 smithi046 ceph-mon[98509]: pgmap v624: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.3 MiB/s wr, 466 op/s 2023-10-19T12:52:34.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:52:34 smithi157 ceph-mon[134109]: pgmap v625: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.5 MiB/s wr, 576 op/s 2023-10-19T12:52:34.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:52:34 smithi195 ceph-mon[134493]: pgmap v625: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.5 MiB/s wr, 576 op/s 2023-10-19T12:52:34.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:52:34 smithi046 ceph-mon[98509]: pgmap v625: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.5 MiB/s wr, 576 op/s 2023-10-19T12:52:36.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:52:36 smithi157 ceph-mon[134109]: pgmap v626: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.3 MiB/s wr, 463 op/s 2023-10-19T12:52:36.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:52:36 smithi195 ceph-mon[134493]: pgmap v626: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.3 MiB/s wr, 463 op/s 2023-10-19T12:52:36.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:52:36 smithi046 ceph-mon[98509]: pgmap v626: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.3 MiB/s wr, 463 op/s 2023-10-19T12:52:36.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 515.0 s, 469.6 tps, lat 209.543 ms stddev 262.353 2023-10-19T12:52:38.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:52:38 smithi157 ceph-mon[134109]: pgmap v627: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.3 MiB/s wr, 556 op/s 2023-10-19T12:52:38.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:52:38 smithi195 ceph-mon[134493]: pgmap v627: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.3 MiB/s wr, 556 op/s 2023-10-19T12:52:38.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:52:38 smithi046 ceph-mon[98509]: pgmap v627: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.3 MiB/s wr, 556 op/s 2023-10-19T12:52:39.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:52:39 smithi046 ceph-mon[98509]: pgmap v628: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.3 MiB/s wr, 474 op/s 2023-10-19T12:52:40.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:52:39 smithi157 ceph-mon[134109]: pgmap v628: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.3 MiB/s wr, 474 op/s 2023-10-19T12:52:40.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:52:39 smithi195 ceph-mon[134493]: pgmap v628: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.3 MiB/s wr, 474 op/s 2023-10-19T12:52:41.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 520.0 s, 488.8 tps, lat 211.763 ms stddev 269.505 2023-10-19T12:52:42.345 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:52:41 smithi157 ceph-mon[134109]: pgmap v629: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.7 MiB/s wr, 453 op/s 2023-10-19T12:52:42.389 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:52:41 smithi195 ceph-mon[134493]: pgmap v629: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.7 MiB/s wr, 453 op/s 2023-10-19T12:52:42.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:52:41 smithi046 ceph-mon[98509]: pgmap v629: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.7 MiB/s wr, 453 op/s 2023-10-19T12:52:44.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:52:44 smithi157 ceph-mon[134109]: pgmap v630: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.7 MiB/s wr, 554 op/s 2023-10-19T12:52:44.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:52:44 smithi195 ceph-mon[134493]: pgmap v630: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.7 MiB/s wr, 554 op/s 2023-10-19T12:52:44.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:52:44 smithi046 ceph-mon[98509]: pgmap v630: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.7 MiB/s wr, 554 op/s 2023-10-19T12:52:46.340 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:52:46 smithi157 ceph-mon[134109]: pgmap v631: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.1 MiB/s wr, 436 op/s 2023-10-19T12:52:46.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:52:46 smithi195 ceph-mon[134493]: pgmap v631: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.1 MiB/s wr, 436 op/s 2023-10-19T12:52:46.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:52:46 smithi046 ceph-mon[98509]: pgmap v631: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.1 MiB/s wr, 436 op/s 2023-10-19T12:52:46.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 525.0 s, 514.8 tps, lat 185.859 ms stddev 216.034 2023-10-19T12:52:48.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:52:48 smithi157 ceph-mon[134109]: pgmap v632: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 6.3 MiB/s wr, 535 op/s 2023-10-19T12:52:48.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:52:48 smithi195 ceph-mon[134493]: pgmap v632: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 6.3 MiB/s wr, 535 op/s 2023-10-19T12:52:48.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:52:48 smithi046 ceph-mon[98509]: pgmap v632: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 6.3 MiB/s wr, 535 op/s 2023-10-19T12:52:50.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:52:49 smithi157 ceph-mon[134109]: pgmap v633: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 5.6 MiB/s wr, 476 op/s 2023-10-19T12:52:50.139 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:52:49 smithi195 ceph-mon[134493]: pgmap v633: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 5.6 MiB/s wr, 476 op/s 2023-10-19T12:52:50.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:52:49 smithi046 ceph-mon[98509]: pgmap v633: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 5.6 MiB/s wr, 476 op/s 2023-10-19T12:52:51.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:52:50 smithi157 ceph-mon[134109]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-19T12:52:51.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:52:50 smithi195 ceph-mon[134493]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-19T12:52:51.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:52:50 smithi046 ceph-mon[98509]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-19T12:52:51.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 530.0 s, 415.0 tps, lat 242.171 ms stddev 322.751 2023-10-19T12:52:52.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:52:51 smithi157 ceph-mon[134109]: pgmap v634: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 5.8 MiB/s wr, 457 op/s 2023-10-19T12:52:52.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:52:51 smithi195 ceph-mon[134493]: pgmap v634: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 5.8 MiB/s wr, 457 op/s 2023-10-19T12:52:52.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:52:51 smithi046 ceph-mon[98509]: pgmap v634: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 5.8 MiB/s wr, 457 op/s 2023-10-19T12:52:54.150 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-19T12:52:54.303 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:52:54 smithi046 ceph-mon[98509]: pgmap v635: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 6.6 MiB/s wr, 541 op/s 2023-10-19T12:52:54.346 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:52:54 smithi157 ceph-mon[134109]: pgmap v635: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 6.6 MiB/s wr, 541 op/s 2023-10-19T12:52:54.384 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:52:54 smithi195 ceph-mon[134493]: pgmap v635: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 6.6 MiB/s wr, 541 op/s 2023-10-19T12:52:55.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.114+0000 7f2e7a5ff700 1 -- 172.21.15.46:0/1718200351 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2e74106510 msgr2=0x7f2e74108900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:52:55.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.114+0000 7f2e7a5ff700 1 --2- 172.21.15.46:0/1718200351 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2e74106510 0x7f2e74108900 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c009990 tx=0x7f2e6c009ca0 comp rx=0 tx=0).stop 2023-10-19T12:52:55.117 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.114+0000 7f2e7a5ff700 1 -- 172.21.15.46:0/1718200351 shutdown_connections 2023-10-19T12:52:55.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.114+0000 7f2e7a5ff700 1 --2- 172.21.15.46:0/1718200351 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2e74106510 0x7f2e74108900 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:52:55.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.114+0000 7f2e7a5ff700 1 --2- 172.21.15.46:0/1718200351 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2e741012b0 0x7f2e741036a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:52:55.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.114+0000 7f2e7a5ff700 1 --2- 172.21.15.46:0/1718200351 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2e74103be0 0x7f2e74105fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:52:55.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.114+0000 7f2e7a5ff700 1 -- 172.21.15.46:0/1718200351 >> 172.21.15.46:0/1718200351 conn(0x7f2e740fac00 msgr2=0x7f2e740fd040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:52:55.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.115+0000 7f2e7a5ff700 1 -- 172.21.15.46:0/1718200351 shutdown_connections 2023-10-19T12:52:55.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.115+0000 7f2e7a5ff700 1 -- 172.21.15.46:0/1718200351 wait complete. 2023-10-19T12:52:55.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.117+0000 7f2e7a5ff700 1 Processor -- start 2023-10-19T12:52:55.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.119+0000 7f2e7a5ff700 1 -- start start 2023-10-19T12:52:55.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.122+0000 7f2e7a5ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2e741012b0 0x7f2e7406eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:52:55.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.122+0000 7f2e7a5ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2e74103be0 0x7f2e7406f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:52:55.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.123+0000 7f2e7a5ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2e74106510 0x7f2e741a68d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:52:55.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.123+0000 7f2e73fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2e741012b0 0x7f2e7406eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:52:55.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.123+0000 7f2e73fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2e741012b0 0x7f2e7406eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:60204/0 (socket says 172.21.15.46:60204) 2023-10-19T12:52:55.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.123+0000 7f2e73fff700 1 -- 172.21.15.46:0/552665684 learned_addr learned my addr 172.21.15.46:0/552665684 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:52:55.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.123+0000 7f2e7a5ff700 1 -- 172.21.15.46:0/552665684 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e740725c0 con 0x7f2e74103be0 2023-10-19T12:52:55.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.123+0000 7f2e7a5ff700 1 -- 172.21.15.46:0/552665684 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e74072730 con 0x7f2e741012b0 2023-10-19T12:52:55.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.123+0000 7f2e7a5ff700 1 -- 172.21.15.46:0/552665684 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e741a6e10 con 0x7f2e74106510 2023-10-19T12:52:55.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.123+0000 7f2e78b9c700 1 --2- 172.21.15.46:0/552665684 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2e74106510 0x7f2e741a68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:52:55.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.124+0000 7f2e78b9c700 1 -- 172.21.15.46:0/552665684 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2e741012b0 msgr2=0x7f2e7406eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:52:55.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.124+0000 7f2e78b9c700 1 --2- 172.21.15.46:0/552665684 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2e741012b0 0x7f2e7406eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:52:55.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.124+0000 7f2e78b9c700 1 -- 172.21.15.46:0/552665684 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2e74103be0 msgr2=0x7f2e7406f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:52:55.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.124+0000 7f2e78b9c700 1 --2- 172.21.15.46:0/552665684 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2e74103be0 0x7f2e7406f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:52:55.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.124+0000 7f2e78b9c700 1 -- 172.21.15.46:0/552665684 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e6c0095f0 con 0x7f2e74106510 2023-10-19T12:52:55.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.124+0000 7f2e78b9c700 1 --2- 172.21.15.46:0/552665684 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2e74106510 0x7f2e741a68d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c0098e0 tx=0x7f2e6c00f700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:52:55.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.124+0000 7f2e71ffb700 1 -- 172.21.15.46:0/552665684 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e6c01d070 con 0x7f2e74106510 2023-10-19T12:52:55.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.124+0000 7f2e71ffb700 1 -- 172.21.15.46:0/552665684 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2e6c004ca0 con 0x7f2e74106510 2023-10-19T12:52:55.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.124+0000 7f2e71ffb700 1 -- 172.21.15.46:0/552665684 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e6c005590 con 0x7f2e74106510 2023-10-19T12:52:55.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.125+0000 7f2e7a5ff700 1 -- 172.21.15.46:0/552665684 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e741a6f50 con 0x7f2e74106510 2023-10-19T12:52:55.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.126+0000 7f2e7a5ff700 1 -- 172.21.15.46:0/552665684 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e741a72c0 con 0x7f2e74106510 2023-10-19T12:52:55.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.141+0000 7f2e71ffb700 1 -- 172.21.15.46:0/552665684 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f2e6c00fc70 con 0x7f2e74106510 2023-10-19T12:52:55.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.143+0000 7f2e71ffb700 1 --2- 172.21.15.46:0/552665684 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f2e600a1500 0x7f2e600a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:52:55.149 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.143+0000 7f2e71ffb700 1 -- 172.21.15.46:0/552665684 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f2e6c0ce040 con 0x7f2e74106510 2023-10-19T12:52:55.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.149+0000 7f2e73fff700 1 --2- 172.21.15.46:0/552665684 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f2e600a1500 0x7f2e600a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:52:55.151 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.149+0000 7f2e8dfcfb80 1 Processor -- start 2023-10-19T12:52:55.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.149+0000 7f2e8dfcfb80 1 -- start start 2023-10-19T12:52:55.152 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.150+0000 7f2e8dfcfb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563be88c9280 0x563be88c96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:52:55.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.150+0000 7f2e8dfcfb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563be88c9be0 0x563be88ca060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:52:55.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.150+0000 7f2e8dfcfb80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563be88ca5a0 0x563be88caa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:52:55.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.150+0000 7f2e8dfcfb80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x563be883c6e0 con 0x563be88ca5a0 2023-10-19T12:52:55.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.150+0000 7f2e8dfcfb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x563be8822c60 con 0x563be88c9280 2023-10-19T12:52:55.153 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.150+0000 7f2e8dfcfb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x563be8820580 con 0x563be88c9be0 2023-10-19T12:52:55.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.151+0000 7f2e78b9c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563be88ca5a0 0x563be88caa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:52:55.154 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.151+0000 7f2e78b9c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563be88ca5a0 0x563be88caa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52112/0 (socket says 172.21.15.46:52112) 2023-10-19T12:52:55.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.151+0000 7f2e78b9c700 1 -- 172.21.15.46:0/3557343633 learned_addr learned my addr 172.21.15.46:0/3557343633 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:52:55.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.152+0000 7f2e6b7fe700 1 --2- 172.21.15.46:0/3557343633 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563be88c9be0 0x563be88ca060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:52:55.155 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.152+0000 7f2e78b9c700 1 -- 172.21.15.46:0/3557343633 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563be88c9be0 msgr2=0x563be88ca060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:52:55.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.153+0000 7f2e78b9c700 1 --2- 172.21.15.46:0/3557343633 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563be88c9be0 0x563be88ca060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:52:55.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.153+0000 7f2e78b9c700 1 -- 172.21.15.46:0/3557343633 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563be88c9280 msgr2=0x563be88c96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:52:55.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.153+0000 7f2e78b9c700 1 --2- 172.21.15.46:0/3557343633 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563be88c9280 0x563be88c96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:52:55.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.153+0000 7f2e78b9c700 1 -- 172.21.15.46:0/3557343633 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563be87d93f0 con 0x563be88ca5a0 2023-10-19T12:52:55.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.153+0000 7f2e73fff700 1 --2- 172.21.15.46:0/552665684 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f2e600a1500 0x7f2e600a39c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c00ae40 tx=0x7f2e5c00a8a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:52:55.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.154+0000 7f2e78b9c700 1 --2- 172.21.15.46:0/3557343633 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563be88ca5a0 0x563be88caa00 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c09afb0 tx=0x7f2e6c09aa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=874a1f7389878834 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:52:55.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.154+0000 7f2e6a7fc700 1 -- 172.21.15.46:0/3557343633 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e6c09b720 con 0x563be88ca5a0 2023-10-19T12:52:55.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.156+0000 7f2e6a7fc700 1 -- 172.21.15.46:0/3557343633 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2e6c09b020 con 0x563be88ca5a0 2023-10-19T12:52:55.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.156+0000 7f2e6a7fc700 1 -- 172.21.15.46:0/3557343633 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e6c099450 con 0x563be88ca5a0 2023-10-19T12:52:55.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.157+0000 7f2e8dfcfb80 1 -- 172.21.15.46:0/3557343633 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563be88ca5a0 msgr2=0x563be88caa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:52:55.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.157+0000 7f2e8dfcfb80 1 --2- 172.21.15.46:0/3557343633 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563be88ca5a0 0x563be88caa00 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c09afb0 tx=0x7f2e6c09aa00 comp rx=0 tx=0).stop 2023-10-19T12:52:55.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.159+0000 7f2e8dfcfb80 1 -- 172.21.15.46:0/3557343633 shutdown_connections 2023-10-19T12:52:55.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.159+0000 7f2e8dfcfb80 1 --2- 172.21.15.46:0/3557343633 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563be88ca5a0 0x563be88caa00 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:52:55.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.159+0000 7f2e8dfcfb80 1 --2- 172.21.15.46:0/3557343633 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563be88c9280 0x563be88c96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:52:55.161 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.159+0000 7f2e8dfcfb80 1 --2- 172.21.15.46:0/3557343633 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563be88c9be0 0x563be88ca060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:52:55.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.159+0000 7f2e8dfcfb80 1 -- 172.21.15.46:0/3557343633 >> 172.21.15.46:0/3557343633 conn(0x563be883d720 msgr2=0x563be88c3b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:52:55.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.159+0000 7f2e8dfcfb80 1 -- 172.21.15.46:0/3557343633 shutdown_connections 2023-10-19T12:52:55.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.159+0000 7f2e8dfcfb80 1 -- 172.21.15.46:0/3557343633 wait complete. 2023-10-19T12:52:55.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.160+0000 7f2e8dfcfb80 1 -- start start 2023-10-19T12:52:55.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.160+0000 7f2e8dfcfb80 1 Processor -- start 2023-10-19T12:52:55.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.163+0000 7f2e8dfcfb80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563be88c9280 0x563be88d2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:52:55.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.163+0000 7f2e8dfcfb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563be88c9be0 0x563be88d2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:52:55.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.163+0000 7f2e8dfcfb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563be88ca5a0 0x563be88d7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:52:55.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.164+0000 7f2e73fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563be88c9280 0x563be88d2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:52:55.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.164+0000 7f2e8dfcfb80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x563be881be70 con 0x563be88c9280 2023-10-19T12:52:55.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.164+0000 7f2e8dfcfb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x563be87b8710 con 0x563be88ca5a0 2023-10-19T12:52:55.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.164+0000 7f2e8dfcfb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x563be87b83b0 con 0x563be88c9be0 2023-10-19T12:52:55.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.164+0000 7f2e73fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563be88c9280 0x563be88d2780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52114/0 (socket says 172.21.15.46:52114) 2023-10-19T12:52:55.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.164+0000 7f2e73fff700 1 -- 172.21.15.46:0/1464965641 learned_addr learned my addr 172.21.15.46:0/1464965641 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:52:55.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.164+0000 7f2e8dfcfb80 10 client.0 _ll_register_callbacks cb 0x563be8702a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:52:55.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.164+0000 7f2e6b7fe700 1 --2- 172.21.15.46:0/1464965641 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563be88c9be0 0x563be88d2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:52:55.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.166+0000 7f2e73fff700 1 -- 172.21.15.46:0/1464965641 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563be88c9be0 msgr2=0x563be88d2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:52:55.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.166+0000 7f2e73fff700 1 --2- 172.21.15.46:0/1464965641 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563be88c9be0 0x563be88d2cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:52:55.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.166+0000 7f2e73fff700 1 -- 172.21.15.46:0/1464965641 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563be88ca5a0 msgr2=0x563be88d7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:52:55.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.166+0000 7f2e73fff700 1 --2- 172.21.15.46:0/1464965641 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563be88ca5a0 0x563be88d7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:52:55.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.166+0000 7f2e73fff700 1 -- 172.21.15.46:0/1464965641 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e741a72c0 con 0x563be88c9280 2023-10-19T12:52:55.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.168+0000 7f2e73fff700 1 --2- 172.21.15.46:0/1464965641 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563be88c9280 0x563be88d2780 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c005e20 tx=0x7f2e5c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6592788350038f4c server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:52:55.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.168+0000 7f2e537fe700 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2023-10-19T12:52:55.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.169+0000 7f2e537fe700 1 -- 172.21.15.46:0/1464965641 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e5c00ec20 con 0x563be88c9280 2023-10-19T12:52:55.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.169+0000 7f2e8dfcfb80 1 -- 172.21.15.46:0/1464965641 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563be8820ef0 con 0x563be88c9280 2023-10-19T12:52:55.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.171+0000 7f2e537fe700 1 -- 172.21.15.46:0/1464965641 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f2e5c00ed80 con 0x563be88c9280 2023-10-19T12:52:55.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.172+0000 7f2e537fe700 1 -- 172.21.15.46:0/1464965641 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2e5c027460 con 0x563be88c9280 2023-10-19T12:52:55.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.172+0000 7f2e8dfcfb80 10 client.15924 fetch_fsmap learned FSMap version 46 2023-10-19T12:52:55.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.172+0000 7f2e8dfcfb80 1 -- 172.21.15.46:0/1464965641 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) v3 -- 0x563be8646de0 con 0x563be88c9280 2023-10-19T12:52:55.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.173+0000 7f2e537fe700 1 -- 172.21.15.46:0/1464965641 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x563be8820ef0 con 0x563be88c9280 2023-10-19T12:52:55.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.173+0000 7f2e537fe700 1 -- 172.21.15.46:0/1464965641 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 46) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f2e5c01e520 con 0x563be88c9280 2023-10-19T12:52:55.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.175+0000 7f2e8dfcfb80 10 client.15924 fetch_fsmap finished waiting for FSMap version 46 2023-10-19T12:52:55.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.175+0000 7f2e8dfcfb80 10 client.15924 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-19T12:52:55.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.175+0000 7f2e8dfcfb80 20 client.15924 populate_metadata read hostname 'smithi046' 2023-10-19T12:52:55.178 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.175+0000 7f2e8dfcfb80 1 --2- 172.21.15.46:0/1464965641 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x563be88ef6e0 0x563be88f1b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:52:55.178 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.175+0000 7f2e8dfcfb80 4 client.15924 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-19T12:52:55.178 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.175+0000 7f2e8dfcfb80 1 -- 172.21.15.46:0/1464965641 --> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563be88988b0 con 0x563be88ef6e0 2023-10-19T12:52:55.191 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.189+0000 7f2e6b7fe700 1 --2- 172.21.15.46:0/1464965641 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x563be88ef6e0 0x563be88f1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:52:55.206 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.204+0000 7f2e537fe700 10 client.15924 ms_handle_connect on v2:172.21.15.157:6838/552718978 2023-10-19T12:52:55.206 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.204+0000 7f2e6b7fe700 1 --2- 172.21.15.46:0/1464965641 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x563be88ef6e0 0x563be88f1b00 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=20138b8bc60f5d06 server_cookie=d235e33f56e096f8 in_seq=0 out_seq=0 2023-10-19T12:52:55.207 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.205+0000 7f2e537fe700 1 -- 172.21.15.46:0/1464965641 <== mds.0 v2:172.21.15.157:6838/552718978 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x563be88988b0 con 0x563be88ef6e0 2023-10-19T12:52:55.207 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.205+0000 7f2e537fe700 10 client.15924 handle_command_reply: tid=0 2023-10-19T12:52:55.207 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.205+0000 7f2e8dfcfb80 1 client.15924 shutdown 2023-10-19T12:52:55.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.206+0000 7f2e8dfcfb80 1 -- 172.21.15.46:0/1464965641 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563be88c9280 msgr2=0x563be88d2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:52:55.208 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.206+0000 7f2e8dfcfb80 1 --2- 172.21.15.46:0/1464965641 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563be88c9280 0x563be88d2780 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c005e20 tx=0x7f2e5c0047c0 comp rx=0 tx=0).stop 2023-10-19T12:52:55.210 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.208+0000 7f2e8dfcfb80 1 -- 172.21.15.46:0/1464965641 shutdown_connections 2023-10-19T12:52:55.210 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.208+0000 7f2e8dfcfb80 1 --2- 172.21.15.46:0/1464965641 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563be88ca5a0 0x563be88d7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:52:55.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.208+0000 7f2e8dfcfb80 1 --2- 172.21.15.46:0/1464965641 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x563be88ef6e0 0x563be88f1b00 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:52:55.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.208+0000 7f2e8dfcfb80 1 --2- 172.21.15.46:0/1464965641 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563be88c9280 0x563be88d2780 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:52:55.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.208+0000 7f2e8dfcfb80 1 --2- 172.21.15.46:0/1464965641 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563be88c9be0 0x563be88d2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:52:55.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.208+0000 7f2e8dfcfb80 1 -- 172.21.15.46:0/1464965641 >> 172.21.15.46:0/1464965641 conn(0x563be883d720 msgr2=0x563be88c6070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:52:55.211 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.208+0000 7f2e537fe700 0 client.15924 ms_handle_reset on v2:172.21.15.157:6838/552718978 2023-10-19T12:52:55.212 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.210+0000 7f2e8dfcfb80 1 -- 172.21.15.46:0/1464965641 shutdown_connections 2023-10-19T12:52:55.212 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.210+0000 7f2e8dfcfb80 1 -- 172.21.15.46:0/1464965641 wait complete. 2023-10-19T12:52:55.212 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.210+0000 7f2e8dfcfb80 20 client.15924 trim_cache size 0 max 16384 2023-10-19T12:52:55.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.251+0000 7f2e8dfcfb80 1 Processor -- start 2023-10-19T12:52:55.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.251+0000 7f2e8dfcfb80 1 -- start start 2023-10-19T12:52:55.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.251+0000 7f2e8dfcfb80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563be88c9280 0x563be88d1c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:52:55.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.252+0000 7f2e8dfcfb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563be88c9be0 0x563be88d83a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:52:55.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.252+0000 7f2e8dfcfb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563be88ca5a0 0x563be88be5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:52:55.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.252+0000 7f2e8dfcfb80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x563be869c920 con 0x563be88c9280 2023-10-19T12:52:55.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.252+0000 7f2e8dfcfb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x563be88d22f0 con 0x563be88c9be0 2023-10-19T12:52:55.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.252+0000 7f2e8dfcfb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x563be88c5b80 con 0x563be88ca5a0 2023-10-19T12:52:55.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.252+0000 7f2e6b7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563be88c9be0 0x563be88d83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:52:55.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.252+0000 7f2e6b7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563be88c9be0 0x563be88d83a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:60234/0 (socket says 172.21.15.46:60234) 2023-10-19T12:52:55.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.252+0000 7f2e6b7fe700 1 -- 172.21.15.46:0/1800404226 learned_addr learned my addr 172.21.15.46:0/1800404226 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:52:55.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.252+0000 7f2e78b9c700 1 --2- 172.21.15.46:0/1800404226 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563be88ca5a0 0x563be88be5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:52:55.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.253+0000 7f2e6b7fe700 1 -- 172.21.15.46:0/1800404226 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563be88ca5a0 msgr2=0x563be88be5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:52:55.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.253+0000 7f2e6b7fe700 1 --2- 172.21.15.46:0/1800404226 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563be88ca5a0 0x563be88be5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:52:55.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.253+0000 7f2e6b7fe700 1 -- 172.21.15.46:0/1800404226 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563be88c9280 msgr2=0x563be88d1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:52:55.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.253+0000 7f2e6b7fe700 1 --2- 172.21.15.46:0/1800404226 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563be88c9280 0x563be88d1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:52:55.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.253+0000 7f2e6b7fe700 1 -- 172.21.15.46:0/1800404226 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563be862fc60 con 0x563be88c9be0 2023-10-19T12:52:55.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.253+0000 7f2e6b7fe700 1 --2- 172.21.15.46:0/1800404226 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563be88c9be0 0x563be88d83a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2e6401ab20 tx=0x7f2e64009650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e6ba903e29e5533 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:52:55.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.254+0000 7f2e6affd700 1 -- 172.21.15.46:0/1800404226 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e6401a3a0 con 0x563be88c9be0 2023-10-19T12:52:55.262 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.254+0000 7f2e6affd700 1 -- 172.21.15.46:0/1800404226 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2e6401e070 con 0x563be88c9be0 2023-10-19T12:52:55.262 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.254+0000 7f2e6affd700 1 -- 172.21.15.46:0/1800404226 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e640186f0 con 0x563be88c9be0 2023-10-19T12:52:55.262 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.255+0000 7f2e8dfcfb80 1 -- 172.21.15.46:0/1800404226 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563be88c9be0 msgr2=0x563be88d83a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:52:55.262 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.255+0000 7f2e8dfcfb80 1 --2- 172.21.15.46:0/1800404226 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563be88c9be0 0x563be88d83a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2e6401ab20 tx=0x7f2e64009650 comp rx=0 tx=0).stop 2023-10-19T12:52:55.262 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.255+0000 7f2e8dfcfb80 1 -- 172.21.15.46:0/1800404226 shutdown_connections 2023-10-19T12:52:55.263 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.255+0000 7f2e8dfcfb80 1 --2- 172.21.15.46:0/1800404226 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563be88ca5a0 0x563be88be5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:52:55.263 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.255+0000 7f2e8dfcfb80 1 --2- 172.21.15.46:0/1800404226 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563be88c9280 0x563be88d1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:52:55.263 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.255+0000 7f2e8dfcfb80 1 --2- 172.21.15.46:0/1800404226 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563be88c9be0 0x563be88d83a0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:52:55.263 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.255+0000 7f2e8dfcfb80 1 -- 172.21.15.46:0/1800404226 >> 172.21.15.46:0/1800404226 conn(0x563be883d720 msgr2=0x563be88f6480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:52:55.263 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.255+0000 7f2e8dfcfb80 1 -- 172.21.15.46:0/1800404226 shutdown_connections 2023-10-19T12:52:55.264 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.255+0000 7f2e8dfcfb80 1 -- 172.21.15.46:0/1800404226 wait complete. 2023-10-19T12:52:55.264 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.256+0000 7f2e8dfcfb80 1 -- start start 2023-10-19T12:52:55.264 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.256+0000 7f2e8dfcfb80 1 Processor -- start 2023-10-19T12:52:55.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.257+0000 7f2e8dfcfb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563be88c9280 0x563be893dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:52:55.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.258+0000 7f2e8dfcfb80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563be88c9be0 0x563be8940180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:52:55.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.258+0000 7f2e8dfcfb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563be88ca5a0 0x563be8942750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:52:55.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.258+0000 7f2e8dfcfb80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x563be8942e60 con 0x563be88c9be0 2023-10-19T12:52:55.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.258+0000 7f2e8dfcfb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x563be8942fd0 con 0x563be88c9280 2023-10-19T12:52:55.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.258+0000 7f2e8dfcfb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x563be8943190 con 0x563be88ca5a0 2023-10-19T12:52:55.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.258+0000 7f2e8dfcfb80 10 client.0 _ll_register_callbacks cb 0x563be8702a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:52:55.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.258+0000 7f2e78b9c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563be88ca5a0 0x563be8942750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:52:55.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.258+0000 7f2e78b9c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563be88ca5a0 0x563be8942750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:55234/0 (socket says 172.21.15.46:55234) 2023-10-19T12:52:55.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.258+0000 7f2e78b9c700 1 -- 172.21.15.46:0/1004123675 learned_addr learned my addr 172.21.15.46:0/1004123675 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:52:55.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.258+0000 7f2e73fff700 1 --2- 172.21.15.46:0/1004123675 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563be88c9280 0x563be893dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:52:55.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.259+0000 7f2e78b9c700 1 -- 172.21.15.46:0/1004123675 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563be88c9280 msgr2=0x563be893dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:52:55.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.259+0000 7f2e78b9c700 1 --2- 172.21.15.46:0/1004123675 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563be88c9280 0x563be893dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:52:55.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.259+0000 7f2e78b9c700 1 -- 172.21.15.46:0/1004123675 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563be88c9be0 msgr2=0x563be8940180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:52:55.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.259+0000 7f2e78b9c700 1 --2- 172.21.15.46:0/1004123675 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563be88c9be0 0x563be8940180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:52:55.270 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.259+0000 7f2e78b9c700 1 -- 172.21.15.46:0/1004123675 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e64009c90 con 0x563be88ca5a0 2023-10-19T12:52:55.270 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.259+0000 7f2e78b9c700 1 --2- 172.21.15.46:0/1004123675 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563be88ca5a0 0x563be8942750 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c09ad20 tx=0x7f2e6c00b670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45cd98b7e29559bd server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:52:55.270 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.259+0000 7f2e537fe700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-10-19T12:52:55.270 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.260+0000 7f2e537fe700 1 -- 172.21.15.46:0/1004123675 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e6c0b7070 con 0x563be88ca5a0 2023-10-19T12:52:55.270 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.260+0000 7f2e537fe700 1 -- 172.21.15.46:0/1004123675 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f2e6c0a3320 con 0x563be88ca5a0 2023-10-19T12:52:55.271 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.260+0000 7f2e8dfcfb80 1 -- 172.21.15.46:0/1004123675 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2e6c09b020 con 0x563be88ca5a0 2023-10-19T12:52:55.271 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.261+0000 7f2e537fe700 1 -- 172.21.15.46:0/1004123675 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2e6c0b92b0 con 0x563be88ca5a0 2023-10-19T12:52:55.271 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.261+0000 7f2e8dfcfb80 10 client.26101 fetch_fsmap learned FSMap version 46 2023-10-19T12:52:55.271 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.261+0000 7f2e8dfcfb80 1 -- 172.21.15.46:0/1004123675 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) v3 -- 0x563be866d250 con 0x563be88ca5a0 2023-10-19T12:52:55.271 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.261+0000 7f2e537fe700 1 -- 172.21.15.46:0/1004123675 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2e6c09b020 con 0x563be88ca5a0 2023-10-19T12:52:55.271 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.262+0000 7f2e537fe700 1 -- 172.21.15.46:0/1004123675 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 46) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f2e6c0a2e90 con 0x563be88ca5a0 2023-10-19T12:52:55.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.262+0000 7f2e8dfcfb80 10 client.26101 fetch_fsmap finished waiting for FSMap version 46 2023-10-19T12:52:55.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.262+0000 7f2e8dfcfb80 10 client.26101 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-19T12:52:55.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.262+0000 7f2e8dfcfb80 20 client.26101 populate_metadata read hostname 'smithi046' 2023-10-19T12:52:55.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.262+0000 7f2e8dfcfb80 1 --2- 172.21.15.46:0/1004123675 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x563be89446c0 0x563be8946ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:52:55.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.262+0000 7f2e8dfcfb80 4 client.26101 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-19T12:52:55.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.262+0000 7f2e8dfcfb80 1 -- 172.21.15.46:0/1004123675 --> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x563be8814e50 con 0x563be89446c0 2023-10-19T12:52:55.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.262+0000 7f2e73fff700 1 --2- 172.21.15.46:0/1004123675 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x563be89446c0 0x563be8946ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:52:55.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.263+0000 7f2e73fff700 1 --2- 172.21.15.46:0/1004123675 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x563be89446c0 0x563be8946ae0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=186e522283ebc02f server_cookie=66ee27029ecf400c in_seq=0 out_seq=0 2023-10-19T12:52:55.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.263+0000 7f2e537fe700 10 client.26101 ms_handle_connect on v2:172.21.15.157:6838/552718978 2023-10-19T12:52:55.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.263+0000 7f2e537fe700 1 -- 172.21.15.46:0/1004123675 <== mds.0 v2:172.21.15.157:6838/552718978 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x563be8814e50 con 0x563be89446c0 2023-10-19T12:52:55.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.263+0000 7f2e537fe700 10 client.26101 handle_command_reply: tid=0 2023-10-19T12:52:55.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.263+0000 7f2e8dfcfb80 1 client.26101 shutdown 2023-10-19T12:52:55.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.264+0000 7f2e8dfcfb80 1 -- 172.21.15.46:0/1004123675 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563be88ca5a0 msgr2=0x563be8942750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:52:55.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.264+0000 7f2e8dfcfb80 1 --2- 172.21.15.46:0/1004123675 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563be88ca5a0 0x563be8942750 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c09ad20 tx=0x7f2e6c00b670 comp rx=0 tx=0).stop 2023-10-19T12:52:55.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.264+0000 7f2e8dfcfb80 1 -- 172.21.15.46:0/1004123675 shutdown_connections 2023-10-19T12:52:55.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.264+0000 7f2e8dfcfb80 1 --2- 172.21.15.46:0/1004123675 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563be88ca5a0 0x563be8942750 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:52:55.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.264+0000 7f2e8dfcfb80 1 --2- 172.21.15.46:0/1004123675 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x563be88c9280 0x563be893dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:52:55.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.264+0000 7f2e8dfcfb80 1 --2- 172.21.15.46:0/1004123675 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x563be89446c0 0x563be8946ae0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:52:55.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.264+0000 7f2e8dfcfb80 1 --2- 172.21.15.46:0/1004123675 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563be88c9be0 0x563be8940180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:52:55.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.264+0000 7f2e537fe700 0 client.26101 ms_handle_reset on v2:172.21.15.157:6838/552718978 2023-10-19T12:52:55.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.265+0000 7f2e8dfcfb80 1 -- 172.21.15.46:0/1004123675 >> 172.21.15.46:0/1004123675 conn(0x563be883d720 msgr2=0x563be88ca980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:52:55.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.265+0000 7f2e8dfcfb80 1 -- 172.21.15.46:0/1004123675 shutdown_connections 2023-10-19T12:52:55.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.265+0000 7f2e8dfcfb80 1 -- 172.21.15.46:0/1004123675 wait complete. 2023-10-19T12:52:55.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.266+0000 7f2e8dfcfb80 20 client.26101 trim_cache size 0 max 16384 2023-10-19T12:52:55.277 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-10-19T12:52:55.277 INFO:teuthology.orchestra.run.smithi046.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-19T12:52:55.278 INFO:teuthology.orchestra.run.smithi046.stdout: "scrubs": { 2023-10-19T12:52:55.278 INFO:teuthology.orchestra.run.smithi046.stdout: "21e73f70-af16-4ae7-bc34-e6c54ba8e1ec": { 2023-10-19T12:52:55.278 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2023-10-19T12:52:55.278 INFO:teuthology.orchestra.run.smithi046.stdout: "tag": "21e73f70-af16-4ae7-bc34-e6c54ba8e1ec", 2023-10-19T12:52:55.278 INFO:teuthology.orchestra.run.smithi046.stdout: "options": "recursive,force" 2023-10-19T12:52:55.278 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:52:55.279 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:52:55.279 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-10-19T12:52:55.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.267+0000 7f2e7a5ff700 1 -- 172.21.15.46:0/552665684 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f2e600a1500 msgr2=0x7f2e600a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:52:55.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.267+0000 7f2e7a5ff700 1 --2- 172.21.15.46:0/552665684 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f2e600a1500 0x7f2e600a39c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c00ae40 tx=0x7f2e5c00a8a0 comp rx=0 tx=0).stop 2023-10-19T12:52:55.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.267+0000 7f2e7a5ff700 1 -- 172.21.15.46:0/552665684 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2e74106510 msgr2=0x7f2e741a68d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:52:55.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.267+0000 7f2e7a5ff700 1 --2- 172.21.15.46:0/552665684 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2e74106510 0x7f2e741a68d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c0098e0 tx=0x7f2e6c00f700 comp rx=0 tx=0).stop 2023-10-19T12:52:55.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.267+0000 7f2e7a5ff700 1 -- 172.21.15.46:0/552665684 shutdown_connections 2023-10-19T12:52:55.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.267+0000 7f2e7a5ff700 1 --2- 172.21.15.46:0/552665684 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f2e600a1500 0x7f2e600a39c0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:52:55.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.267+0000 7f2e7a5ff700 1 --2- 172.21.15.46:0/552665684 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2e74106510 0x7f2e741a68d0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:52:55.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.267+0000 7f2e7a5ff700 1 --2- 172.21.15.46:0/552665684 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2e741012b0 0x7f2e7406eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:52:55.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.267+0000 7f2e7a5ff700 1 --2- 172.21.15.46:0/552665684 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2e74103be0 0x7f2e7406f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:52:55.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.267+0000 7f2e7a5ff700 1 -- 172.21.15.46:0/552665684 >> 172.21.15.46:0/552665684 conn(0x7f2e740fac00 msgr2=0x7f2e74101b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:52:55.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.267+0000 7f2e7a5ff700 1 -- 172.21.15.46:0/552665684 shutdown_connections 2023-10-19T12:52:55.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:52:55.268+0000 7f2e7a5ff700 1 -- 172.21.15.46:0/552665684 wait complete. 2023-10-19T12:52:55.305 INFO:tasks.cephfs.filesystem:scrub status for tag:21e73f70-af16-4ae7-bc34-e6c54ba8e1ec - {'path': '/', 'tag': '21e73f70-af16-4ae7-bc34-e6c54ba8e1ec', 'options': 'recursive,force'} 2023-10-19T12:52:56.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:52:56 smithi157 ceph-mon[134109]: pgmap v636: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 5.3 MiB/s wr, 439 op/s 2023-10-19T12:52:56.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:52:56 smithi195 ceph-mon[134493]: pgmap v636: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 5.3 MiB/s wr, 439 op/s 2023-10-19T12:52:56.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:52:56 smithi046 ceph-mon[98509]: pgmap v636: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 5.3 MiB/s wr, 439 op/s 2023-10-19T12:52:56.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 535.0 s, 482.2 tps, lat 209.502 ms stddev 236.195 2023-10-19T12:52:58.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:52:58 smithi157 ceph-mon[134109]: pgmap v637: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 6.4 MiB/s wr, 511 op/s 2023-10-19T12:52:58.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:52:58 smithi195 ceph-mon[134493]: pgmap v637: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 6.4 MiB/s wr, 511 op/s 2023-10-19T12:52:58.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:52:58 smithi046 ceph-mon[98509]: pgmap v637: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 6.4 MiB/s wr, 511 op/s 2023-10-19T12:53:00.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:52:59 smithi157 ceph-mon[134109]: pgmap v638: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 5.4 MiB/s wr, 438 op/s 2023-10-19T12:53:00.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:52:59 smithi195 ceph-mon[134493]: pgmap v638: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 5.4 MiB/s wr, 438 op/s 2023-10-19T12:53:00.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:52:59 smithi046 ceph-mon[98509]: pgmap v638: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 5.4 MiB/s wr, 438 op/s 2023-10-19T12:53:01.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:53:00 smithi157 ceph-mon[134109]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-19T12:53:01.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:53:00 smithi195 ceph-mon[134493]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-19T12:53:01.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:53:00 smithi046 ceph-mon[98509]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-19T12:53:01.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 540.0 s, 461.8 tps, lat 215.369 ms stddev 241.113 2023-10-19T12:53:02.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:53:01 smithi157 ceph-mon[134109]: pgmap v639: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 5.8 MiB/s wr, 471 op/s 2023-10-19T12:53:02.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:53:01 smithi195 ceph-mon[134493]: pgmap v639: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 5.8 MiB/s wr, 471 op/s 2023-10-19T12:53:02.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:53:01 smithi046 ceph-mon[98509]: pgmap v639: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 5.8 MiB/s wr, 471 op/s 2023-10-19T12:53:04.339 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:53:04 smithi157 ceph-mon[134109]: pgmap v640: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 5.7 MiB/s wr, 501 op/s 2023-10-19T12:53:04.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:53:04 smithi195 ceph-mon[134493]: pgmap v640: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 5.7 MiB/s wr, 501 op/s 2023-10-19T12:53:04.478 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:53:04 smithi046 ceph-mon[98509]: pgmap v640: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 5.7 MiB/s wr, 501 op/s 2023-10-19T12:53:06.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:53:06 smithi157 ceph-mon[134109]: pgmap v641: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 5.4 MiB/s wr, 415 op/s 2023-10-19T12:53:06.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:53:06 smithi195 ceph-mon[134493]: pgmap v641: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 5.4 MiB/s wr, 415 op/s 2023-10-19T12:53:06.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:53:06 smithi046 ceph-mon[98509]: pgmap v641: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 5.4 MiB/s wr, 415 op/s 2023-10-19T12:53:06.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 545.0 s, 429.4 tps, lat 232.720 ms stddev 250.670 2023-10-19T12:53:08.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:53:08 smithi157 ceph-mon[134109]: pgmap v642: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.8 MiB/s wr, 487 op/s 2023-10-19T12:53:08.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:53:08 smithi195 ceph-mon[134493]: pgmap v642: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.8 MiB/s wr, 487 op/s 2023-10-19T12:53:08.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:53:08 smithi046 ceph-mon[98509]: pgmap v642: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.8 MiB/s wr, 487 op/s 2023-10-19T12:53:09.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:53:09 smithi046 ceph-mon[98509]: pgmap v643: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.0 MiB/s wr, 435 op/s 2023-10-19T12:53:10.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:53:09 smithi157 ceph-mon[134109]: pgmap v643: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.0 MiB/s wr, 435 op/s 2023-10-19T12:53:10.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:53:09 smithi195 ceph-mon[134493]: pgmap v643: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.0 MiB/s wr, 435 op/s 2023-10-19T12:53:11.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 550.0 s, 467.6 tps, lat 209.615 ms stddev 246.618 2023-10-19T12:53:12.340 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:53:12 smithi157 ceph-mon[134109]: pgmap v644: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.7 MiB/s wr, 486 op/s 2023-10-19T12:53:12.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:53:12 smithi195 ceph-mon[134493]: pgmap v644: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.7 MiB/s wr, 486 op/s 2023-10-19T12:53:12.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:53:12 smithi046 ceph-mon[98509]: pgmap v644: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.7 MiB/s wr, 486 op/s 2023-10-19T12:53:14.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:53:14 smithi157 ceph-mon[134109]: pgmap v645: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.5 MiB/s wr, 462 op/s 2023-10-19T12:53:14.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:53:14 smithi195 ceph-mon[134493]: pgmap v645: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.5 MiB/s wr, 462 op/s 2023-10-19T12:53:14.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:53:14 smithi046 ceph-mon[98509]: pgmap v645: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.5 MiB/s wr, 462 op/s 2023-10-19T12:53:16.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:53:16 smithi157 ceph-mon[134109]: pgmap v646: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.9 MiB/s wr, 413 op/s 2023-10-19T12:53:16.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:53:16 smithi195 ceph-mon[134493]: pgmap v646: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.9 MiB/s wr, 413 op/s 2023-10-19T12:53:16.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:53:16 smithi046 ceph-mon[98509]: pgmap v646: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.9 MiB/s wr, 413 op/s 2023-10-19T12:53:16.702 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 555.0 s, 481.4 tps, lat 214.947 ms stddev 263.233 2023-10-19T12:53:17.345 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:53:17 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:53:17.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:53:17 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:53:17.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:53:17 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:53:18.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:53:18 smithi157 ceph-mon[134109]: pgmap v647: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 4.7 MiB/s wr, 451 op/s 2023-10-19T12:53:18.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:53:18 smithi195 ceph-mon[134493]: pgmap v647: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 4.7 MiB/s wr, 451 op/s 2023-10-19T12:53:18.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:53:18 smithi046 ceph-mon[98509]: pgmap v647: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 4.7 MiB/s wr, 451 op/s 2023-10-19T12:53:19.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:53:19 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:53:19.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:53:19 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:53:19.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:53:19 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:53:19.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:53:19 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:53:19.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:53:19 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:53:19.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:53:19 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:53:19.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:53:19 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:53:19.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:53:19 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:53:19.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:53:19 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:53:20.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:53:20 smithi195 ceph-mon[134493]: pgmap v648: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.8 MiB/s wr, 417 op/s 2023-10-19T12:53:20.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:53:20 smithi046 ceph-mon[98509]: pgmap v648: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.8 MiB/s wr, 417 op/s 2023-10-19T12:53:20.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:53:20 smithi157 ceph-mon[134109]: pgmap v648: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.8 MiB/s wr, 417 op/s 2023-10-19T12:53:21.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 560.0 s, 429.2 tps, lat 230.665 ms stddev 268.587 2023-10-19T12:53:22.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:53:22 smithi195 ceph-mon[134493]: pgmap v649: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.4 MiB/s wr, 460 op/s 2023-10-19T12:53:22.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:53:22 smithi046 ceph-mon[98509]: pgmap v649: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.4 MiB/s wr, 460 op/s 2023-10-19T12:53:22.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:53:22 smithi157 ceph-mon[134109]: pgmap v649: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.4 MiB/s wr, 460 op/s 2023-10-19T12:53:24.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:53:24 smithi195 ceph-mon[134493]: pgmap v650: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 4.2 MiB/s wr, 397 op/s 2023-10-19T12:53:24.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:53:24 smithi046 ceph-mon[98509]: pgmap v650: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 4.2 MiB/s wr, 397 op/s 2023-10-19T12:53:24.594 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:53:24 smithi157 ceph-mon[134109]: pgmap v650: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 4.2 MiB/s wr, 397 op/s 2023-10-19T12:53:25.306 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-19T12:53:25.700 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.696+0000 7f2cdf9ff700 1 -- 172.21.15.46:0/2700438172 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2cd8102330 msgr2=0x7f2cd8108be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:53:25.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.696+0000 7f2cdf9ff700 1 --2- 172.21.15.46:0/2700438172 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2cd8102330 0x7f2cd8108be0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2cd00099c0 tx=0x7f2cd0009cd0 comp rx=0 tx=0).stop 2023-10-19T12:53:25.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.697+0000 7f2cdf9ff700 1 -- 172.21.15.46:0/2700438172 shutdown_connections 2023-10-19T12:53:25.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.697+0000 7f2cdf9ff700 1 --2- 172.21.15.46:0/2700438172 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2cd8102330 0x7f2cd8108be0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:53:25.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.697+0000 7f2cdf9ff700 1 --2- 172.21.15.46:0/2700438172 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2cd81007a0 0x7f2cd8100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:53:25.701 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.697+0000 7f2cdf9ff700 1 --2- 172.21.15.46:0/2700438172 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2cd8101990 0x7f2cd8101df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:53:25.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.697+0000 7f2cdf9ff700 1 -- 172.21.15.46:0/2700438172 >> 172.21.15.46:0/2700438172 conn(0x7f2cd80fbcf0 msgr2=0x7f2cd80fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:53:25.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.698+0000 7f2cdf9ff700 1 -- 172.21.15.46:0/2700438172 shutdown_connections 2023-10-19T12:53:25.702 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.698+0000 7f2cdf9ff700 1 -- 172.21.15.46:0/2700438172 wait complete. 2023-10-19T12:53:25.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.699+0000 7f2cdf9ff700 1 Processor -- start 2023-10-19T12:53:25.703 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.699+0000 7f2cdf9ff700 1 -- start start 2023-10-19T12:53:25.704 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.700+0000 7f2cdf9ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2cd81007a0 0x7f2cd8198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:53:25.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.700+0000 7f2cdf9ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2cd8101990 0x7f2cd8198e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:53:25.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.700+0000 7f2cdf9ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2cd8102330 0x7f2cd819fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:53:25.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.700+0000 7f2cdf9ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd81a0470 con 0x7f2cd8102330 2023-10-19T12:53:25.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.700+0000 7f2cdf9ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd81a05b0 con 0x7f2cd81007a0 2023-10-19T12:53:25.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.700+0000 7f2cdf9ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd81a0740 con 0x7f2cd8101990 2023-10-19T12:53:25.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.700+0000 7f2cdcf9a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2cd8101990 0x7f2cd8198e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:53:25.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.700+0000 7f2cdcf9a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2cd8101990 0x7f2cd8198e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:57832/0 (socket says 172.21.15.46:57832) 2023-10-19T12:53:25.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.700+0000 7f2cdcf9a700 1 -- 172.21.15.46:0/3720707200 learned_addr learned my addr 172.21.15.46:0/3720707200 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:53:25.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.702+0000 7f2cdcf9a700 1 -- 172.21.15.46:0/3720707200 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2cd81007a0 msgr2=0x7f2cd8198940 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-19T12:53:25.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.702+0000 7f2cdcf9a700 1 --2- 172.21.15.46:0/3720707200 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2cd81007a0 0x7f2cd8198940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:53:25.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.702+0000 7f2cdcf9a700 1 -- 172.21.15.46:0/3720707200 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2cd8102330 msgr2=0x7f2cd819fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:53:25.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.702+0000 7f2cdcf9a700 1 --2- 172.21.15.46:0/3720707200 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2cd8102330 0x7f2cd819fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:53:25.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.702+0000 7f2cdcf9a700 1 -- 172.21.15.46:0/3720707200 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cd00095f0 con 0x7f2cd8101990 2023-10-19T12:53:25.708 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.702+0000 7f2cdcf9a700 1 --2- 172.21.15.46:0/3720707200 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2cd8101990 0x7f2cd8198e80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2cd400b530 tx=0x7f2cd400b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:53:25.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.702+0000 7f2cce7fc700 1 -- 172.21.15.46:0/3720707200 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd4011830 con 0x7f2cd8101990 2023-10-19T12:53:25.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.703+0000 7f2cce7fc700 1 -- 172.21.15.46:0/3720707200 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2cd4011e50 con 0x7f2cd8101990 2023-10-19T12:53:25.710 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.703+0000 7f2cce7fc700 1 -- 172.21.15.46:0/3720707200 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd400f2e0 con 0x7f2cd8101990 2023-10-19T12:53:25.710 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.704+0000 7f2cdf9ff700 1 -- 172.21.15.46:0/3720707200 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cd81a0a20 con 0x7f2cd8101990 2023-10-19T12:53:25.710 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.704+0000 7f2cdf9ff700 1 -- 172.21.15.46:0/3720707200 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cd81a0eb0 con 0x7f2cd8101990 2023-10-19T12:53:25.717 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.711+0000 7f2cce7fc700 1 -- 172.21.15.46:0/3720707200 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f2cd40105a0 con 0x7f2cd8101990 2023-10-19T12:53:25.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.713+0000 7f2cce7fc700 1 --2- 172.21.15.46:0/3720707200 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f2cc40a15d0 0x7f2cc40a3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:53:25.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.714+0000 7f2cce7fc700 1 -- 172.21.15.46:0/3720707200 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f2cd40ccb60 con 0x7f2cd8101990 2023-10-19T12:53:25.718 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.714+0000 7f2cdd79b700 1 --2- 172.21.15.46:0/3720707200 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f2cc40a15d0 0x7f2cc40a3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:53:25.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.715+0000 7f2cf3263b80 1 Processor -- start 2023-10-19T12:53:25.719 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.715+0000 7f2cf3263b80 1 -- start start 2023-10-19T12:53:25.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.717+0000 7f2cf3263b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564fb94172d0 0x564fb94176f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:53:25.720 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.717+0000 7f2cf3263b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564fb9417c30 0x564fb9416090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:53:25.721 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.717+0000 7f2cf3263b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564fb94165d0 0x564fb9416a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:53:25.721 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.717+0000 7f2cf3263b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x564fb93896e0 con 0x564fb94165d0 2023-10-19T12:53:25.721 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.717+0000 7f2cf3263b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x564fb936fc60 con 0x564fb94172d0 2023-10-19T12:53:25.721 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.717+0000 7f2cf3263b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x564fb936d580 con 0x564fb9417c30 2023-10-19T12:53:25.722 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.717+0000 7f2cdd79b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564fb94172d0 0x564fb94176f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:53:25.722 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.717+0000 7f2cdd79b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564fb94172d0 0x564fb94176f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:54116/0 (socket says 172.21.15.46:54116) 2023-10-19T12:53:25.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.717+0000 7f2cdd79b700 1 -- 172.21.15.46:0/3612513138 learned_addr learned my addr 172.21.15.46:0/3612513138 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:53:25.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.717+0000 7f2cdcf9a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564fb9417c30 0x564fb9416090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:53:25.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.718+0000 7f2cddf9c700 1 --2- 172.21.15.46:0/3612513138 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564fb94165d0 0x564fb9416a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:53:25.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.718+0000 7f2cdd79b700 1 -- 172.21.15.46:0/3612513138 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564fb9417c30 msgr2=0x564fb9416090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:53:25.723 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.718+0000 7f2cdd79b700 1 --2- 172.21.15.46:0/3612513138 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564fb9417c30 0x564fb9416090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:53:25.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.718+0000 7f2cdd79b700 1 -- 172.21.15.46:0/3612513138 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564fb94165d0 msgr2=0x564fb9416a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:53:25.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.718+0000 7f2cdd79b700 1 --2- 172.21.15.46:0/3612513138 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564fb94165d0 0x564fb9416a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:53:25.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.718+0000 7f2cdd79b700 1 -- 172.21.15.46:0/3612513138 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564fb93263f0 con 0x564fb94172d0 2023-10-19T12:53:25.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.718+0000 7f2cdd79b700 1 --2- 172.21.15.46:0/3612513138 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564fb94172d0 0x564fb94176f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2cc80138e0 tx=0x7f2cc8013bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a2b63362450a249 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:53:25.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.719+0000 7f2cc37fe700 1 -- 172.21.15.46:0/3612513138 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc800e050 con 0x564fb94172d0 2023-10-19T12:53:25.724 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.719+0000 7f2cc37fe700 1 -- 172.21.15.46:0/3612513138 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2cc8015c40 con 0x564fb94172d0 2023-10-19T12:53:25.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.719+0000 7f2cc37fe700 1 -- 172.21.15.46:0/3612513138 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc8018ac0 con 0x564fb94172d0 2023-10-19T12:53:25.725 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.720+0000 7f2cf3263b80 1 -- 172.21.15.46:0/3612513138 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564fb94172d0 msgr2=0x564fb94176f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:53:25.726 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.720+0000 7f2cf3263b80 1 --2- 172.21.15.46:0/3612513138 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564fb94172d0 0x564fb94176f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2cc80138e0 tx=0x7f2cc8013bf0 comp rx=0 tx=0).stop 2023-10-19T12:53:25.726 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.720+0000 7f2cf3263b80 1 -- 172.21.15.46:0/3612513138 shutdown_connections 2023-10-19T12:53:25.726 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.720+0000 7f2cf3263b80 1 --2- 172.21.15.46:0/3612513138 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564fb94165d0 0x564fb9416a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:53:25.726 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.720+0000 7f2cf3263b80 1 --2- 172.21.15.46:0/3612513138 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564fb94172d0 0x564fb94176f0 secure :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2cc80138e0 tx=0x7f2cc8013bf0 comp rx=0 tx=0).stop 2023-10-19T12:53:25.726 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.720+0000 7f2cf3263b80 1 --2- 172.21.15.46:0/3612513138 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564fb9417c30 0x564fb9416090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:53:25.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.720+0000 7f2cf3263b80 1 -- 172.21.15.46:0/3612513138 >> 172.21.15.46:0/3612513138 conn(0x564fb938a720 msgr2=0x564fb9410b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:53:25.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.722+0000 7f2cf3263b80 1 -- 172.21.15.46:0/3612513138 shutdown_connections 2023-10-19T12:53:25.727 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.722+0000 7f2cf3263b80 1 -- 172.21.15.46:0/3612513138 wait complete. 2023-10-19T12:53:25.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.723+0000 7f2cf3263b80 1 -- start start 2023-10-19T12:53:25.728 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.723+0000 7f2cf3263b80 1 Processor -- start 2023-10-19T12:53:25.729 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.726+0000 7f2cdd79b700 1 --2- 172.21.15.46:0/3720707200 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f2cc40a15d0 0x7f2cc40a3a90 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f2cc8013fd0 tx=0x7f2cc8018c20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:53:25.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:53:25 smithi046 ceph-mon[98509]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-19T12:53:25.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:53:25 smithi046 ceph-mon[98509]: pgmap v651: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.3 MiB/s wr, 368 op/s 2023-10-19T12:53:25.732 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.728+0000 7f2cf3263b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564fb94165d0 0x564fb941fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:53:25.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.728+0000 7f2cf3263b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564fb9417c30 0x564fb9420150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:53:25.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.728+0000 7f2cf3263b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564fb9425180 0x564fb9427570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:53:25.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.729+0000 7f2cdd79b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564fb94165d0 0x564fb941fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:53:25.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.729+0000 7f2cdd79b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564fb94165d0 0x564fb941fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:54122/0 (socket says 172.21.15.46:54122) 2023-10-19T12:53:25.733 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.729+0000 7f2cddf9c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564fb9425180 0x564fb9427570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:53:25.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.729+0000 7f2cddf9c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564fb9425180 0x564fb9427570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:57846/0 (socket says 172.21.15.46:57846) 2023-10-19T12:53:25.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.729+0000 7f2cddf9c700 1 -- 172.21.15.46:0/511532106 learned_addr learned my addr 172.21.15.46:0/511532106 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:53:25.734 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.729+0000 7f2cdcf9a700 1 --2- 172.21.15.46:0/511532106 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564fb9417c30 0x564fb9420150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:53:25.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.729+0000 7f2cf3263b80 1 -- 172.21.15.46:0/511532106 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x564fb9368e70 con 0x564fb9417c30 2023-10-19T12:53:25.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.729+0000 7f2cf3263b80 1 -- 172.21.15.46:0/511532106 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x564fb9305710 con 0x564fb94165d0 2023-10-19T12:53:25.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.729+0000 7f2cf3263b80 1 -- 172.21.15.46:0/511532106 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x564fb93053b0 con 0x564fb9425180 2023-10-19T12:53:25.735 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.730+0000 7f2cddf9c700 1 -- 172.21.15.46:0/511532106 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564fb94165d0 msgr2=0x564fb941fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:53:25.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.730+0000 7f2cddf9c700 1 --2- 172.21.15.46:0/511532106 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564fb94165d0 0x564fb941fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:53:25.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.730+0000 7f2cddf9c700 1 -- 172.21.15.46:0/511532106 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564fb9417c30 msgr2=0x564fb9420150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:53:25.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.730+0000 7f2cddf9c700 1 --2- 172.21.15.46:0/511532106 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564fb9417c30 0x564fb9420150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:53:25.736 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.730+0000 7f2cddf9c700 1 -- 172.21.15.46:0/511532106 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cc8011040 con 0x564fb9425180 2023-10-19T12:53:25.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.730+0000 7f2cddf9c700 1 --2- 172.21.15.46:0/511532106 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564fb9425180 0x564fb9427570 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2cd00099c0 tx=0x7f2cd000be80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44d7cae153331540 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:53:25.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.730+0000 7f2cc0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-10-19T12:53:25.737 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.731+0000 7f2cc0ff9700 1 -- 172.21.15.46:0/511532106 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd0005500 con 0x564fb9425180 2023-10-19T12:53:25.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.731+0000 7f2cf3263b80 10 client.0 _ll_register_callbacks cb 0x564fb924fa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:53:25.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.731+0000 7f2cc0ff9700 1 -- 172.21.15.46:0/511532106 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f2cd0005660 con 0x564fb9425180 2023-10-19T12:53:25.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.732+0000 7f2cf3263b80 1 -- 172.21.15.46:0/511532106 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564fb936def0 con 0x564fb9425180 2023-10-19T12:53:25.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.732+0000 7f2cc0ff9700 1 -- 172.21.15.46:0/511532106 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2cd0004710 con 0x564fb9425180 2023-10-19T12:53:25.738 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.733+0000 7f2cf3263b80 10 client.26113 fetch_fsmap learned FSMap version 48 2023-10-19T12:53:25.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.733+0000 7f2cf3263b80 1 -- 172.21.15.46:0/511532106 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({fsmap=48}) v3 -- 0x564fb9193de0 con 0x564fb9425180 2023-10-19T12:53:25.739 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.733+0000 7f2cc0ff9700 1 -- 172.21.15.46:0/511532106 <== mon.1 v2:172.21.15.195:3300/0 4 ==== fsmap(e 48) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f2cd003b070 con 0x564fb9425180 2023-10-19T12:53:25.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.734+0000 7f2cf3263b80 10 client.26113 fetch_fsmap finished waiting for FSMap version 48 2023-10-19T12:53:25.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.734+0000 7f2cf3263b80 10 client.26113 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-19T12:53:25.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.734+0000 7f2cf3263b80 20 client.26113 populate_metadata read hostname 'smithi046' 2023-10-19T12:53:25.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.734+0000 7f2cf3263b80 1 --2- 172.21.15.46:0/511532106 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x564fb942bcd0 0x564fb942e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:53:25.740 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.734+0000 7f2cf3263b80 4 client.26113 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-19T12:53:25.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.734+0000 7f2cf3263b80 1 -- 172.21.15.46:0/511532106 --> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564fb93e58b0 con 0x564fb942bcd0 2023-10-19T12:53:25.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.735+0000 7f2cdd79b700 1 --2- 172.21.15.46:0/511532106 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x564fb942bcd0 0x564fb942e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:53:25.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.738+0000 7f2cdd79b700 1 --2- 172.21.15.46:0/511532106 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x564fb942bcd0 0x564fb942e150 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7f0aa3bb2b167bf server_cookie=546fbff9178b462f in_seq=0 out_seq=0 2023-10-19T12:53:25.741 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.738+0000 7f2cc0ff9700 10 client.26113 ms_handle_connect on v2:172.21.15.157:6838/552718978 2023-10-19T12:53:25.742 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.739+0000 7f2cc0ff9700 1 -- 172.21.15.46:0/511532106 <== mds.0 v2:172.21.15.157:6838/552718978 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x564fb93e58b0 con 0x564fb942bcd0 2023-10-19T12:53:25.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.739+0000 7f2cc0ff9700 10 client.26113 handle_command_reply: tid=0 2023-10-19T12:53:25.743 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.739+0000 7f2cf3263b80 1 client.26113 shutdown 2023-10-19T12:53:25.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.740+0000 7f2cf3263b80 1 -- 172.21.15.46:0/511532106 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564fb9425180 msgr2=0x564fb9427570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:53:25.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.740+0000 7f2cf3263b80 1 --2- 172.21.15.46:0/511532106 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564fb9425180 0x564fb9427570 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2cd00099c0 tx=0x7f2cd000be80 comp rx=0 tx=0).stop 2023-10-19T12:53:25.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.740+0000 7f2cf3263b80 1 -- 172.21.15.46:0/511532106 shutdown_connections 2023-10-19T12:53:25.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.740+0000 7f2cf3263b80 1 --2- 172.21.15.46:0/511532106 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564fb9425180 0x564fb9427570 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:53:25.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.740+0000 7f2cf3263b80 1 --2- 172.21.15.46:0/511532106 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564fb94165d0 0x564fb941fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:53:25.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.740+0000 7f2cf3263b80 1 --2- 172.21.15.46:0/511532106 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x564fb942bcd0 0x564fb942e150 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:53:25.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.740+0000 7f2cf3263b80 1 --2- 172.21.15.46:0/511532106 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564fb9417c30 0x564fb9420150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:53:25.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.740+0000 7f2cf3263b80 1 -- 172.21.15.46:0/511532106 >> 172.21.15.46:0/511532106 conn(0x564fb938a720 msgr2=0x564fb9415080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:53:25.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.740+0000 7f2cc0ff9700 0 client.26113 ms_handle_reset on v2:172.21.15.157:6838/552718978 2023-10-19T12:53:25.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.740+0000 7f2cf3263b80 1 -- 172.21.15.46:0/511532106 shutdown_connections 2023-10-19T12:53:25.746 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.741+0000 7f2cf3263b80 1 -- 172.21.15.46:0/511532106 wait complete. 2023-10-19T12:53:25.746 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.743+0000 7f2cf3263b80 20 client.26113 trim_cache size 0 max 16384 2023-10-19T12:53:25.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.782+0000 7f2cf3263b80 1 Processor -- start 2023-10-19T12:53:25.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.782+0000 7f2cf3263b80 1 -- start start 2023-10-19T12:53:25.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.782+0000 7f2cf3263b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564fb94165d0 0x564fb943b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:53:25.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.783+0000 7f2cf3263b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564fb9417c30 0x564fb941a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:53:25.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.783+0000 7f2cf3263b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564fb9425180 0x564fb941a810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:53:25.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.783+0000 7f2cf3263b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x564fb91e9920 con 0x564fb9425180 2023-10-19T12:53:25.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.783+0000 7f2cf3263b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x564fb9420b10 con 0x564fb9417c30 2023-10-19T12:53:25.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.783+0000 7f2cf3263b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x564fb941f780 con 0x564fb94165d0 2023-10-19T12:53:25.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.784+0000 7f2cdd79b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564fb94165d0 0x564fb943b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:53:25.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.784+0000 7f2cddf9c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564fb9425180 0x564fb941a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:53:25.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.784+0000 7f2cdcf9a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564fb9417c30 0x564fb941a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:53:25.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.784+0000 7f2cdd79b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564fb94165d0 0x564fb943b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:57860/0 (socket says 172.21.15.46:57860) 2023-10-19T12:53:25.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.784+0000 7f2cdd79b700 1 -- 172.21.15.46:0/2172455816 learned_addr learned my addr 172.21.15.46:0/2172455816 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:53:25.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.784+0000 7f2cdcf9a700 1 -- 172.21.15.46:0/2172455816 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564fb94165d0 msgr2=0x564fb943b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:53:25.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.784+0000 7f2cdcf9a700 1 --2- 172.21.15.46:0/2172455816 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564fb94165d0 0x564fb943b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:53:25.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.784+0000 7f2cdcf9a700 1 -- 172.21.15.46:0/2172455816 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564fb9425180 msgr2=0x564fb941a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:53:25.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.784+0000 7f2cdcf9a700 1 --2- 172.21.15.46:0/2172455816 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564fb9425180 0x564fb941a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:53:25.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.784+0000 7f2cdcf9a700 1 -- 172.21.15.46:0/2172455816 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564fb917cc60 con 0x564fb9417c30 2023-10-19T12:53:25.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.784+0000 7f2cdd79b700 1 --2- 172.21.15.46:0/2172455816 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564fb94165d0 0x564fb943b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T12:53:25.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.785+0000 7f2cdcf9a700 1 --2- 172.21.15.46:0/2172455816 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564fb9417c30 0x564fb941a2d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2cd40ca2e0 tx=0x7f2cd40b9040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be7c447926f8c834 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:53:25.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.785+0000 7f2cc3fff700 1 -- 172.21.15.46:0/2172455816 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd40a1e40 con 0x564fb9417c30 2023-10-19T12:53:25.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.785+0000 7f2cc3fff700 1 -- 172.21.15.46:0/2172455816 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2cd4097bf0 con 0x564fb9417c30 2023-10-19T12:53:25.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.785+0000 7f2cc3fff700 1 -- 172.21.15.46:0/2172455816 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd40a19b0 con 0x564fb9417c30 2023-10-19T12:53:25.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.786+0000 7f2cf3263b80 1 -- 172.21.15.46:0/2172455816 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564fb9417c30 msgr2=0x564fb941a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:53:25.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.786+0000 7f2cf3263b80 1 --2- 172.21.15.46:0/2172455816 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564fb9417c30 0x564fb941a2d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2cd40ca2e0 tx=0x7f2cd40b9040 comp rx=0 tx=0).stop 2023-10-19T12:53:25.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.786+0000 7f2cf3263b80 1 -- 172.21.15.46:0/2172455816 shutdown_connections 2023-10-19T12:53:25.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.786+0000 7f2cf3263b80 1 --2- 172.21.15.46:0/2172455816 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564fb9425180 0x564fb941a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:53:25.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.786+0000 7f2cf3263b80 1 --2- 172.21.15.46:0/2172455816 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564fb94165d0 0x564fb943b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:53:25.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.786+0000 7f2cf3263b80 1 --2- 172.21.15.46:0/2172455816 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564fb9417c30 0x564fb941a2d0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:53:25.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.786+0000 7f2cf3263b80 1 -- 172.21.15.46:0/2172455816 >> 172.21.15.46:0/2172455816 conn(0x564fb938a720 msgr2=0x564fb941fbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:53:25.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.786+0000 7f2cf3263b80 1 -- 172.21.15.46:0/2172455816 shutdown_connections 2023-10-19T12:53:25.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.787+0000 7f2cf3263b80 1 -- 172.21.15.46:0/2172455816 wait complete. 2023-10-19T12:53:25.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.787+0000 7f2cf3263b80 1 -- start start 2023-10-19T12:53:25.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.787+0000 7f2cf3263b80 1 Processor -- start 2023-10-19T12:53:25.797 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.788+0000 7f2cf3263b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564fb94165d0 0x564fb94784e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:53:25.798 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.788+0000 7f2cf3263b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564fb9417c30 0x564fb9478a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:53:25.798 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.788+0000 7f2cf3263b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564fb9425180 0x564fb947f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:53:25.798 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.788+0000 7f2cf3263b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x564fb947fe40 con 0x564fb9417c30 2023-10-19T12:53:25.798 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.788+0000 7f2cf3263b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x564fb947ffb0 con 0x564fb94165d0 2023-10-19T12:53:25.798 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.788+0000 7f2cf3263b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x564fb9480170 con 0x564fb9425180 2023-10-19T12:53:25.799 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.788+0000 7f2cf3263b80 10 client.0 _ll_register_callbacks cb 0x564fb924fa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:53:25.799 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.788+0000 7f2cdd79b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564fb94165d0 0x564fb94784e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:53:25.799 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.789+0000 7f2cdd79b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564fb94165d0 0x564fb94784e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:54144/0 (socket says 172.21.15.46:54144) 2023-10-19T12:53:25.799 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.789+0000 7f2cdd79b700 1 -- 172.21.15.46:0/3412689780 learned_addr learned my addr 172.21.15.46:0/3412689780 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:53:25.799 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.789+0000 7f2cdcf9a700 1 --2- 172.21.15.46:0/3412689780 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564fb9417c30 0x564fb9478a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:53:25.800 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.789+0000 7f2cddf9c700 1 --2- 172.21.15.46:0/3412689780 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564fb9425180 0x564fb947f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:53:25.800 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.789+0000 7f2cdd79b700 1 -- 172.21.15.46:0/3412689780 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564fb9425180 msgr2=0x564fb947f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:53:25.800 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.789+0000 7f2cdd79b700 1 --2- 172.21.15.46:0/3412689780 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564fb9425180 0x564fb947f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:53:25.800 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.789+0000 7f2cdd79b700 1 -- 172.21.15.46:0/3412689780 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564fb9417c30 msgr2=0x564fb9478a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:53:25.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.789+0000 7f2cdd79b700 1 --2- 172.21.15.46:0/3412689780 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564fb9417c30 0x564fb9478a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:53:25.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.789+0000 7f2cdd79b700 1 -- 172.21.15.46:0/3412689780 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cd81a0eb0 con 0x564fb94165d0 2023-10-19T12:53:25.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.789+0000 7f2cddf9c700 1 --2- 172.21.15.46:0/3412689780 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564fb9425180 0x564fb947f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T12:53:25.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.789+0000 7f2cdcf9a700 1 --2- 172.21.15.46:0/3412689780 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564fb9417c30 0x564fb9478a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:53:25.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.790+0000 7f2cdd79b700 1 --2- 172.21.15.46:0/3412689780 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564fb94165d0 0x564fb94784e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2cc801f040 tx=0x7f2cc8026000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f14f6db7661e6734 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:53:25.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.790+0000 7f2cc0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.157:3300/0 2023-10-19T12:53:25.802 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.790+0000 7f2cc0ff9700 1 -- 172.21.15.46:0/3412689780 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc80183f0 con 0x564fb94165d0 2023-10-19T12:53:25.802 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.790+0000 7f2cf3263b80 1 -- 172.21.15.46:0/3412689780 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2cc8015c40 con 0x564fb94165d0 2023-10-19T12:53:25.802 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.790+0000 7f2cc0ff9700 1 -- 172.21.15.46:0/3412689780 <== mon.2 v2:172.21.15.157:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f2cc8028040 con 0x564fb94165d0 2023-10-19T12:53:25.802 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.791+0000 7f2cc0ff9700 1 -- 172.21.15.46:0/3412689780 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2cc80098a0 con 0x564fb94165d0 2023-10-19T12:53:25.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.791+0000 7f2cf3263b80 10 client.26096 fetch_fsmap learned FSMap version 48 2023-10-19T12:53:25.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.791+0000 7f2cf3263b80 1 -- 172.21.15.46:0/3412689780 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) v3 -- 0x564fb91ba250 con 0x564fb94165d0 2023-10-19T12:53:25.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.791+0000 7f2cc0ff9700 1 -- 172.21.15.46:0/3412689780 <== mon.2 v2:172.21.15.157:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2cc8015c40 con 0x564fb94165d0 2023-10-19T12:53:25.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.792+0000 7f2cc0ff9700 1 -- 172.21.15.46:0/3412689780 <== mon.2 v2:172.21.15.157:3300/0 5 ==== fsmap(e 48) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f2cc8017ab0 con 0x564fb94165d0 2023-10-19T12:53:25.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.792+0000 7f2cf3263b80 10 client.26096 fetch_fsmap finished waiting for FSMap version 48 2023-10-19T12:53:25.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.792+0000 7f2cf3263b80 10 client.26096 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-19T12:53:25.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.792+0000 7f2cf3263b80 20 client.26096 populate_metadata read hostname 'smithi046' 2023-10-19T12:53:25.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.792+0000 7f2cf3263b80 1 --2- 172.21.15.46:0/3412689780 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x564fb948a310 0x564fb948c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:53:25.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.792+0000 7f2cf3263b80 4 client.26096 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-19T12:53:25.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.792+0000 7f2cf3263b80 1 -- 172.21.15.46:0/3412689780 --> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x564fb9361e50 con 0x564fb948a310 2023-10-19T12:53:25.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.793+0000 7f2cdcf9a700 1 --2- 172.21.15.46:0/3412689780 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x564fb948a310 0x564fb948c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:53:25.806 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.796+0000 7f2cc0ff9700 10 client.26096 ms_handle_connect on v2:172.21.15.157:6838/552718978 2023-10-19T12:53:25.806 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.796+0000 7f2cdcf9a700 1 --2- 172.21.15.46:0/3412689780 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x564fb948a310 0x564fb948c700 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e20ec3696646f15d server_cookie=3f05989214b424b in_seq=0 out_seq=0 2023-10-19T12:53:25.806 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.796+0000 7f2cc0ff9700 1 -- 172.21.15.46:0/3412689780 <== mds.0 v2:172.21.15.157:6838/552718978 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x564fb9361e50 con 0x564fb948a310 2023-10-19T12:53:25.806 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.796+0000 7f2cc0ff9700 10 client.26096 handle_command_reply: tid=0 2023-10-19T12:53:25.806 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.796+0000 7f2cf3263b80 1 client.26096 shutdown 2023-10-19T12:53:25.807 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.797+0000 7f2cf3263b80 1 -- 172.21.15.46:0/3412689780 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564fb94165d0 msgr2=0x564fb94784e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:53:25.807 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.797+0000 7f2cf3263b80 1 --2- 172.21.15.46:0/3412689780 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564fb94165d0 0x564fb94784e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2cc801f040 tx=0x7f2cc8026000 comp rx=0 tx=0).stop 2023-10-19T12:53:25.807 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.797+0000 7f2cf3263b80 1 -- 172.21.15.46:0/3412689780 shutdown_connections 2023-10-19T12:53:25.807 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.797+0000 7f2cf3263b80 1 --2- 172.21.15.46:0/3412689780 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564fb9425180 0x564fb947f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:53:25.807 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.797+0000 7f2cf3263b80 1 --2- 172.21.15.46:0/3412689780 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564fb94165d0 0x564fb94784e0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:53:25.808 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.797+0000 7f2cf3263b80 1 --2- 172.21.15.46:0/3412689780 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x564fb948a310 0x564fb948c700 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:53:25.808 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.797+0000 7f2cf3263b80 1 --2- 172.21.15.46:0/3412689780 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564fb9417c30 0x564fb9478a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:53:25.808 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.797+0000 7f2cc0ff9700 0 client.26096 ms_handle_reset on v2:172.21.15.157:6838/552718978 2023-10-19T12:53:25.808 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.797+0000 7f2cf3263b80 1 -- 172.21.15.46:0/3412689780 >> 172.21.15.46:0/3412689780 conn(0x564fb938a720 msgr2=0x564fb941a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:53:25.808 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.797+0000 7f2cf3263b80 1 -- 172.21.15.46:0/3412689780 shutdown_connections 2023-10-19T12:53:25.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.797+0000 7f2cf3263b80 1 -- 172.21.15.46:0/3412689780 wait complete. 2023-10-19T12:53:25.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.798+0000 7f2cf3263b80 20 client.26096 trim_cache size 0 max 16384 2023-10-19T12:53:25.809 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-10-19T12:53:25.809 INFO:teuthology.orchestra.run.smithi046.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-19T12:53:25.810 INFO:teuthology.orchestra.run.smithi046.stdout: "scrubs": { 2023-10-19T12:53:25.810 INFO:teuthology.orchestra.run.smithi046.stdout: "21e73f70-af16-4ae7-bc34-e6c54ba8e1ec": { 2023-10-19T12:53:25.810 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2023-10-19T12:53:25.810 INFO:teuthology.orchestra.run.smithi046.stdout: "tag": "21e73f70-af16-4ae7-bc34-e6c54ba8e1ec", 2023-10-19T12:53:25.811 INFO:teuthology.orchestra.run.smithi046.stdout: "options": "recursive,force" 2023-10-19T12:53:25.811 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:53:25.811 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:53:25.811 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-10-19T12:53:25.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.798+0000 7f2cdf9ff700 1 -- 172.21.15.46:0/3720707200 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f2cc40a15d0 msgr2=0x7f2cc40a3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:53:25.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.798+0000 7f2cdf9ff700 1 --2- 172.21.15.46:0/3720707200 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f2cc40a15d0 0x7f2cc40a3a90 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f2cc8013fd0 tx=0x7f2cc8018c20 comp rx=0 tx=0).stop 2023-10-19T12:53:25.812 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.798+0000 7f2cdf9ff700 1 -- 172.21.15.46:0/3720707200 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2cd8101990 msgr2=0x7f2cd8198e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:53:25.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.798+0000 7f2cdf9ff700 1 --2- 172.21.15.46:0/3720707200 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2cd8101990 0x7f2cd8198e80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2cd400b530 tx=0x7f2cd400b8f0 comp rx=0 tx=0).stop 2023-10-19T12:53:25.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.799+0000 7f2cdf9ff700 1 -- 172.21.15.46:0/3720707200 shutdown_connections 2023-10-19T12:53:25.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.799+0000 7f2cdf9ff700 1 --2- 172.21.15.46:0/3720707200 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2cd8102330 0x7f2cd819fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:53:25.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.799+0000 7f2cdf9ff700 1 --2- 172.21.15.46:0/3720707200 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2cd81007a0 0x7f2cd8198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:53:25.813 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.799+0000 7f2cdf9ff700 1 --2- 172.21.15.46:0/3720707200 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f2cc40a15d0 0x7f2cc40a3a90 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:53:25.814 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.799+0000 7f2cdf9ff700 1 --2- 172.21.15.46:0/3720707200 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2cd8101990 0x7f2cd8198e80 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:53:25.814 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.799+0000 7f2cdf9ff700 1 -- 172.21.15.46:0/3720707200 >> 172.21.15.46:0/3720707200 conn(0x7f2cd80fbcf0 msgr2=0x7f2cd8104c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:53:25.814 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.799+0000 7f2cdf9ff700 1 -- 172.21.15.46:0/3720707200 shutdown_connections 2023-10-19T12:53:25.814 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:25.799+0000 7f2cdf9ff700 1 -- 172.21.15.46:0/3720707200 wait complete. 2023-10-19T12:53:25.834 INFO:tasks.cephfs.filesystem:scrub status for tag:21e73f70-af16-4ae7-bc34-e6c54ba8e1ec - {'path': '/', 'tag': '21e73f70-af16-4ae7-bc34-e6c54ba8e1ec', 'options': 'recursive,force'} 2023-10-19T12:53:26.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:53:25 smithi157 ceph-mon[134109]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-19T12:53:26.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:53:25 smithi157 ceph-mon[134109]: pgmap v651: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.3 MiB/s wr, 368 op/s 2023-10-19T12:53:26.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:53:25 smithi195 ceph-mon[134493]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-19T12:53:26.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:53:25 smithi195 ceph-mon[134493]: pgmap v651: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.3 MiB/s wr, 368 op/s 2023-10-19T12:53:26.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 565.0 s, 602.2 tps, lat 169.737 ms stddev 302.874 2023-10-19T12:53:28.341 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:53:28 smithi157 ceph-mon[134109]: pgmap v652: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.4 MiB/s wr, 442 op/s 2023-10-19T12:53:28.386 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:53:28 smithi195 ceph-mon[134493]: pgmap v652: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.4 MiB/s wr, 442 op/s 2023-10-19T12:53:28.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:53:28 smithi046 ceph-mon[98509]: pgmap v652: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.4 MiB/s wr, 442 op/s 2023-10-19T12:53:29.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:53:29 smithi046 ceph-mon[98509]: pgmap v653: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.6 MiB/s wr, 438 op/s 2023-10-19T12:53:30.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:53:29 smithi157 ceph-mon[134109]: pgmap v653: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.6 MiB/s wr, 438 op/s 2023-10-19T12:53:30.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:53:29 smithi195 ceph-mon[134493]: pgmap v653: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.6 MiB/s wr, 438 op/s 2023-10-19T12:53:31.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 570.0 s, 381.8 tps, lat 259.611 ms stddev 315.463 2023-10-19T12:53:32.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:53:32 smithi157 ceph-mon[134109]: pgmap v654: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.8 MiB/s wr, 483 op/s 2023-10-19T12:53:32.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:53:32 smithi195 ceph-mon[134493]: pgmap v654: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.8 MiB/s wr, 483 op/s 2023-10-19T12:53:32.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:53:32 smithi046 ceph-mon[98509]: pgmap v654: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.8 MiB/s wr, 483 op/s 2023-10-19T12:53:34.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:53:34 smithi157 ceph-mon[134109]: pgmap v655: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.5 MiB/s wr, 452 op/s 2023-10-19T12:53:34.384 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:53:34 smithi195 ceph-mon[134493]: pgmap v655: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.5 MiB/s wr, 452 op/s 2023-10-19T12:53:34.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:53:34 smithi046 ceph-mon[98509]: pgmap v655: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.5 MiB/s wr, 452 op/s 2023-10-19T12:53:36.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:53:36 smithi157 ceph-mon[134109]: pgmap v656: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.5 MiB/s wr, 460 op/s 2023-10-19T12:53:36.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:53:36 smithi195 ceph-mon[134493]: pgmap v656: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.5 MiB/s wr, 460 op/s 2023-10-19T12:53:36.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:53:36 smithi046 ceph-mon[98509]: pgmap v656: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.5 MiB/s wr, 460 op/s 2023-10-19T12:53:36.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 575.0 s, 454.4 tps, lat 214.422 ms stddev 250.825 2023-10-19T12:53:38.341 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:53:38 smithi157 ceph-mon[134109]: pgmap v657: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.8 MiB/s wr, 518 op/s 2023-10-19T12:53:38.383 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:53:38 smithi195 ceph-mon[134493]: pgmap v657: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.8 MiB/s wr, 518 op/s 2023-10-19T12:53:38.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:53:38 smithi046 ceph-mon[98509]: pgmap v657: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.8 MiB/s wr, 518 op/s 2023-10-19T12:53:39.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:53:39 smithi046 ceph-mon[98509]: pgmap v658: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 5.2 MiB/s wr, 490 op/s 2023-10-19T12:53:40.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:53:39 smithi157 ceph-mon[134109]: pgmap v658: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 5.2 MiB/s wr, 490 op/s 2023-10-19T12:53:40.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:53:39 smithi195 ceph-mon[134493]: pgmap v658: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 5.2 MiB/s wr, 490 op/s 2023-10-19T12:53:41.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 580.0 s, 476.8 tps, lat 212.853 ms stddev 263.354 2023-10-19T12:53:42.343 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:53:42 smithi157 ceph-mon[134109]: pgmap v659: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.4 MiB/s wr, 511 op/s 2023-10-19T12:53:42.382 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:53:42 smithi195 ceph-mon[134493]: pgmap v659: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.4 MiB/s wr, 511 op/s 2023-10-19T12:53:42.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:53:42 smithi046 ceph-mon[98509]: pgmap v659: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.4 MiB/s wr, 511 op/s 2023-10-19T12:53:44.339 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:53:44 smithi157 ceph-mon[134109]: pgmap v660: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 4.7 MiB/s wr, 442 op/s 2023-10-19T12:53:44.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:53:44 smithi195 ceph-mon[134493]: pgmap v660: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 4.7 MiB/s wr, 442 op/s 2023-10-19T12:53:44.495 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:53:44 smithi046 ceph-mon[98509]: pgmap v660: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 4.7 MiB/s wr, 442 op/s 2023-10-19T12:53:46.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:53:46 smithi157 ceph-mon[134109]: pgmap v661: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 4.4 MiB/s wr, 426 op/s 2023-10-19T12:53:46.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:53:46 smithi195 ceph-mon[134493]: pgmap v661: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 4.4 MiB/s wr, 426 op/s 2023-10-19T12:53:46.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:53:46 smithi046 ceph-mon[98509]: pgmap v661: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 4.4 MiB/s wr, 426 op/s 2023-10-19T12:53:46.703 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 585.0 s, 538.0 tps, lat 182.266 ms stddev 239.557 2023-10-19T12:53:48.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:53:48 smithi157 ceph-mon[134109]: pgmap v662: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 5.1 MiB/s wr, 484 op/s 2023-10-19T12:53:48.382 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:53:48 smithi195 ceph-mon[134493]: pgmap v662: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 5.1 MiB/s wr, 484 op/s 2023-10-19T12:53:48.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:53:48 smithi046 ceph-mon[98509]: pgmap v662: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 5.1 MiB/s wr, 484 op/s 2023-10-19T12:53:50.094 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:53:49 smithi157 ceph-mon[134109]: pgmap v663: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 5.0 MiB/s wr, 465 op/s 2023-10-19T12:53:50.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:53:49 smithi195 ceph-mon[134493]: pgmap v663: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 5.0 MiB/s wr, 465 op/s 2023-10-19T12:53:50.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:53:49 smithi046 ceph-mon[98509]: pgmap v663: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 5.0 MiB/s wr, 465 op/s 2023-10-19T12:53:51.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 590.0 s, 474.6 tps, lat 216.310 ms stddev 249.311 2023-10-19T12:53:52.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:53:52 smithi157 ceph-mon[134109]: pgmap v664: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 5.7 MiB/s wr, 502 op/s 2023-10-19T12:53:52.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:53:52 smithi195 ceph-mon[134493]: pgmap v664: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 5.7 MiB/s wr, 502 op/s 2023-10-19T12:53:52.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:53:52 smithi046 ceph-mon[98509]: pgmap v664: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 5.7 MiB/s wr, 502 op/s 2023-10-19T12:53:54.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:53:54 smithi157 ceph-mon[134109]: pgmap v665: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 5.0 MiB/s wr, 451 op/s 2023-10-19T12:53:54.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:53:54 smithi195 ceph-mon[134493]: pgmap v665: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 5.0 MiB/s wr, 451 op/s 2023-10-19T12:53:54.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:53:54 smithi046 ceph-mon[98509]: pgmap v665: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 5.0 MiB/s wr, 451 op/s 2023-10-19T12:53:55.835 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-19T12:53:56.346 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:53:56 smithi157 ceph-mon[134109]: pgmap v666: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.6 MiB/s wr, 444 op/s 2023-10-19T12:53:56.382 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:53:56 smithi195 ceph-mon[134493]: pgmap v666: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.6 MiB/s wr, 444 op/s 2023-10-19T12:53:56.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:53:56 smithi046 ceph-mon[98509]: pgmap v666: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.6 MiB/s wr, 444 op/s 2023-10-19T12:53:56.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 595.0 s, 560.4 tps, lat 182.373 ms stddev 254.839 2023-10-19T12:53:58.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.261+0000 7ff9c67ff700 1 -- 172.21.15.46:0/605029842 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff9c00ff690 msgr2=0x7ff9c00ffab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:53:58.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.261+0000 7ff9c67ff700 1 --2- 172.21.15.46:0/605029842 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff9c00ff690 0x7ff9c00ffab0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff9b0009990 tx=0x7ff9b0009ca0 comp rx=0 tx=0).stop 2023-10-19T12:53:58.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.262+0000 7ff9c67ff700 1 -- 172.21.15.46:0/605029842 shutdown_connections 2023-10-19T12:53:58.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.262+0000 7ff9c67ff700 1 --2- 172.21.15.46:0/605029842 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff9c0101220 0x7ff9c0107ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:53:58.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.262+0000 7ff9c67ff700 1 --2- 172.21.15.46:0/605029842 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff9c00ff690 0x7ff9c00ffab0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:53:58.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.262+0000 7ff9c67ff700 1 --2- 172.21.15.46:0/605029842 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9c0100880 0x7ff9c0100ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:53:58.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.262+0000 7ff9c67ff700 1 -- 172.21.15.46:0/605029842 >> 172.21.15.46:0/605029842 conn(0x7ff9c00fac00 msgr2=0x7ff9c00fd040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:53:58.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.262+0000 7ff9c67ff700 1 -- 172.21.15.46:0/605029842 shutdown_connections 2023-10-19T12:53:58.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.262+0000 7ff9c67ff700 1 -- 172.21.15.46:0/605029842 wait complete. 2023-10-19T12:53:58.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.264+0000 7ff9c67ff700 1 Processor -- start 2023-10-19T12:53:58.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.265+0000 7ff9c67ff700 1 -- start start 2023-10-19T12:53:58.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.265+0000 7ff9c67ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff9c00ff690 0x7ff9c0109d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:53:58.270 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.265+0000 7ff9c67ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff9c0100880 0x7ff9c0108450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:53:58.270 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.265+0000 7ff9c67ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9c0101220 0x7ff9c0108990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:53:58.270 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.265+0000 7ff9bffff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff9c00ff690 0x7ff9c0109d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:53:58.270 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.265+0000 7ff9bffff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff9c00ff690 0x7ff9c0109d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:56302/0 (socket says 172.21.15.46:56302) 2023-10-19T12:53:58.270 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.266+0000 7ff9bf7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff9c0100880 0x7ff9c0108450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:53:58.271 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.266+0000 7ff9bf7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff9c0100880 0x7ff9c0108450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:35446/0 (socket says 172.21.15.46:35446) 2023-10-19T12:53:58.271 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.266+0000 7ff9c4d9c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9c0101220 0x7ff9c0108990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:53:58.271 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.266+0000 7ff9c4d9c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9c0101220 0x7ff9c0108990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40012/0 (socket says 172.21.15.46:40012) 2023-10-19T12:53:58.271 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.266+0000 7ff9bffff700 1 -- 172.21.15.46:0/409760082 learned_addr learned my addr 172.21.15.46:0/409760082 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:53:58.271 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.266+0000 7ff9c67ff700 1 -- 172.21.15.46:0/409760082 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c019a680 con 0x7ff9c0101220 2023-10-19T12:53:58.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.266+0000 7ff9c67ff700 1 -- 172.21.15.46:0/409760082 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c0108ed0 con 0x7ff9c00ff690 2023-10-19T12:53:58.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.266+0000 7ff9c67ff700 1 -- 172.21.15.46:0/409760082 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c0109090 con 0x7ff9c0100880 2023-10-19T12:53:58.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.267+0000 7ff9bffff700 1 -- 172.21.15.46:0/409760082 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff9c0100880 msgr2=0x7ff9c0108450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:53:58.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.267+0000 7ff9bffff700 1 --2- 172.21.15.46:0/409760082 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff9c0100880 0x7ff9c0108450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:53:58.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.267+0000 7ff9bffff700 1 -- 172.21.15.46:0/409760082 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9c0101220 msgr2=0x7ff9c0108990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:53:58.273 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.267+0000 7ff9bffff700 1 --2- 172.21.15.46:0/409760082 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9c0101220 0x7ff9c0108990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:53:58.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.267+0000 7ff9bffff700 1 -- 172.21.15.46:0/409760082 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9b00095f0 con 0x7ff9c00ff690 2023-10-19T12:53:58.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.267+0000 7ff9c4d9c700 1 --2- 172.21.15.46:0/409760082 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9c0101220 0x7ff9c0108990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:53:58.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.267+0000 7ff9bffff700 1 --2- 172.21.15.46:0/409760082 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff9c00ff690 0x7ff9c0109d80 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff9b00098e0 tx=0x7ff9b000f670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:53:58.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.267+0000 7ff9bd7fa700 1 -- 172.21.15.46:0/409760082 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b001d070 con 0x7ff9c00ff690 2023-10-19T12:53:58.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.267+0000 7ff9c67ff700 1 -- 172.21.15.46:0/409760082 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9c01a5050 con 0x7ff9c00ff690 2023-10-19T12:53:58.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.267+0000 7ff9bd7fa700 1 -- 172.21.15.46:0/409760082 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff9b0005050 con 0x7ff9c00ff690 2023-10-19T12:53:58.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.267+0000 7ff9bd7fa700 1 -- 172.21.15.46:0/409760082 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b0004b00 con 0x7ff9c00ff690 2023-10-19T12:53:58.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.268+0000 7ff9c67ff700 1 -- 172.21.15.46:0/409760082 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9c01a53c0 con 0x7ff9c00ff690 2023-10-19T12:53:58.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.271+0000 7ff9bd7fa700 1 -- 172.21.15.46:0/409760082 <== mon.2 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7ff9b00051c0 con 0x7ff9c00ff690 2023-10-19T12:53:58.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.274+0000 7ff9da021b80 1 Processor -- start 2023-10-19T12:53:58.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.274+0000 7ff9bd7fa700 1 --2- 172.21.15.46:0/409760082 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7ff9a80a1500 0x7ff9a80a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:53:58.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.275+0000 7ff9bd7fa700 1 -- 172.21.15.46:0/409760082 <== mon.2 v2:172.21.15.157:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7ff9b00cdf30 con 0x7ff9c00ff690 2023-10-19T12:53:58.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.275+0000 7ff9bf7fe700 1 --2- 172.21.15.46:0/409760082 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7ff9a80a1500 0x7ff9a80a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:53:58.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.275+0000 7ff9da021b80 1 -- start start 2023-10-19T12:53:58.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.276+0000 7ff9da021b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55fc1ceac2d0 0x55fc1ceac6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:53:58.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.276+0000 7ff9da021b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fc1ceacc30 0x55fc1ceab090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:53:58.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.276+0000 7ff9da021b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fc1ceab5d0 0x55fc1ceaba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:53:58.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.276+0000 7ff9da021b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc1ce1e6e0 con 0x55fc1ceac2d0 2023-10-19T12:53:58.280 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.276+0000 7ff9da021b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc1ce04c60 con 0x55fc1ceacc30 2023-10-19T12:53:58.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.276+0000 7ff9da021b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc1ce02580 con 0x55fc1ceab5d0 2023-10-19T12:53:58.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.276+0000 7ff9bf7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fc1ceacc30 0x55fc1ceab090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:53:58.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.276+0000 7ff9bf7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fc1ceacc30 0x55fc1ceab090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:56310/0 (socket says 172.21.15.46:56310) 2023-10-19T12:53:58.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.276+0000 7ff9bf7fe700 1 -- 172.21.15.46:0/1174541368 learned_addr learned my addr 172.21.15.46:0/1174541368 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:53:58.281 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.276+0000 7ff9bffff700 1 --2- 172.21.15.46:0/1174541368 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55fc1ceac2d0 0x55fc1ceac6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:53:58.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.276+0000 7ff9c4d9c700 1 --2- 172.21.15.46:0/1174541368 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fc1ceab5d0 0x55fc1ceaba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:53:58.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.276+0000 7ff9bf7fe700 1 --2- 172.21.15.46:0/409760082 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7ff9a80a1500 0x7ff9a80a39c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7ff9c0109700 tx=0x7ff9b4009190 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:53:58.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.277+0000 7ff9bf7fe700 1 -- 172.21.15.46:0/1174541368 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fc1ceab5d0 msgr2=0x55fc1ceaba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:53:58.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.277+0000 7ff9bf7fe700 1 --2- 172.21.15.46:0/1174541368 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fc1ceab5d0 0x55fc1ceaba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:53:58.282 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.277+0000 7ff9bf7fe700 1 -- 172.21.15.46:0/1174541368 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55fc1ceac2d0 msgr2=0x55fc1ceac6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:53:58.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.277+0000 7ff9bf7fe700 1 --2- 172.21.15.46:0/1174541368 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55fc1ceac2d0 0x55fc1ceac6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:53:58.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.277+0000 7ff9bf7fe700 1 -- 172.21.15.46:0/1174541368 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fc1cdbb3f0 con 0x55fc1ceacc30 2023-10-19T12:53:58.283 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.277+0000 7ff9bffff700 1 --2- 172.21.15.46:0/1174541368 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55fc1ceac2d0 0x55fc1ceac6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:53:58.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.277+0000 7ff9bf7fe700 1 --2- 172.21.15.46:0/1174541368 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fc1ceacc30 0x55fc1ceab090 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff9b400ea10 tx=0x7ff9b4011000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9aea643bb90e17cb server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:53:58.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.277+0000 7ff9a67fc700 1 -- 172.21.15.46:0/1174541368 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b400eed0 con 0x55fc1ceacc30 2023-10-19T12:53:58.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.278+0000 7ff9a67fc700 1 -- 172.21.15.46:0/1174541368 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff9b4015940 con 0x55fc1ceacc30 2023-10-19T12:53:58.286 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.278+0000 7ff9a67fc700 1 -- 172.21.15.46:0/1174541368 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b4013a30 con 0x55fc1ceacc30 2023-10-19T12:53:58.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.278+0000 7ff9da021b80 1 -- 172.21.15.46:0/1174541368 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fc1ceacc30 msgr2=0x55fc1ceab090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:53:58.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.278+0000 7ff9da021b80 1 --2- 172.21.15.46:0/1174541368 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fc1ceacc30 0x55fc1ceab090 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff9b400ea10 tx=0x7ff9b4011000 comp rx=0 tx=0).stop 2023-10-19T12:53:58.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.279+0000 7ff9da021b80 1 -- 172.21.15.46:0/1174541368 shutdown_connections 2023-10-19T12:53:58.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.279+0000 7ff9da021b80 1 --2- 172.21.15.46:0/1174541368 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fc1ceab5d0 0x55fc1ceaba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:53:58.287 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.279+0000 7ff9da021b80 1 --2- 172.21.15.46:0/1174541368 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55fc1ceac2d0 0x55fc1ceac6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:53:58.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.279+0000 7ff9da021b80 1 --2- 172.21.15.46:0/1174541368 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fc1ceacc30 0x55fc1ceab090 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:53:58.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.279+0000 7ff9da021b80 1 -- 172.21.15.46:0/1174541368 >> 172.21.15.46:0/1174541368 conn(0x55fc1ce1f720 msgr2=0x55fc1cea5b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:53:58.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.279+0000 7ff9da021b80 1 -- 172.21.15.46:0/1174541368 shutdown_connections 2023-10-19T12:53:58.288 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.279+0000 7ff9da021b80 1 -- 172.21.15.46:0/1174541368 wait complete. 2023-10-19T12:53:58.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.279+0000 7ff9da021b80 1 -- start start 2023-10-19T12:53:58.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.280+0000 7ff9da021b80 1 Processor -- start 2023-10-19T12:53:58.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.280+0000 7ff9da021b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55fc1ceab5d0 0x55fc1ceb4b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:53:58.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.280+0000 7ff9da021b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fc1ceac2d0 0x55fc1ceb5070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:53:58.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.280+0000 7ff9da021b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fc1ceacc30 0x55fc1cebc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:53:58.289 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.280+0000 7ff9da021b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc1cdfde70 con 0x55fc1ceab5d0 2023-10-19T12:53:58.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.280+0000 7ff9da021b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc1cd9a710 con 0x55fc1ceacc30 2023-10-19T12:53:58.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.280+0000 7ff9da021b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc1cd9a3b0 con 0x55fc1ceac2d0 2023-10-19T12:53:58.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.280+0000 7ff9da021b80 10 client.0 _ll_register_callbacks cb 0x55fc1cce4a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:53:58.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.280+0000 7ff9bffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55fc1ceab5d0 0x55fc1ceb4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:53:58.290 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.281+0000 7ff9bf7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fc1ceac2d0 0x55fc1ceb5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:53:58.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.281+0000 7ff9c4d9c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fc1ceacc30 0x55fc1cebc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:53:58.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.281+0000 7ff9bffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55fc1ceab5d0 0x55fc1ceb4b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40038/0 (socket says 172.21.15.46:40038) 2023-10-19T12:53:58.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.281+0000 7ff9bffff700 1 -- 172.21.15.46:0/473650242 learned_addr learned my addr 172.21.15.46:0/473650242 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:53:58.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.281+0000 7ff9c4d9c700 1 -- 172.21.15.46:0/473650242 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fc1ceac2d0 msgr2=0x55fc1ceb5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:53:58.291 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.281+0000 7ff9c4d9c700 1 --2- 172.21.15.46:0/473650242 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fc1ceac2d0 0x55fc1ceb5070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:53:58.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.281+0000 7ff9c4d9c700 1 -- 172.21.15.46:0/473650242 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55fc1ceab5d0 msgr2=0x55fc1ceb4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:53:58.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.281+0000 7ff9c4d9c700 1 --2- 172.21.15.46:0/473650242 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55fc1ceab5d0 0x55fc1ceb4b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:53:58.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.281+0000 7ff9c4d9c700 1 -- 172.21.15.46:0/473650242 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9c01a53c0 con 0x55fc1ceacc30 2023-10-19T12:53:58.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.282+0000 7ff9c4d9c700 1 --2- 172.21.15.46:0/473650242 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fc1ceacc30 0x55fc1cebc0b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff9b8004630 tx=0x7ff9b8004940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4bafd2b459a699e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:53:58.292 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.282+0000 7ff99f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.157:3300/0 2023-10-19T12:53:58.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.282+0000 7ff9bffff700 1 --2- 172.21.15.46:0/473650242 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55fc1ceab5d0 0x55fc1ceb4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:53:58.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.282+0000 7ff99f7fe700 1 -- 172.21.15.46:0/473650242 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b8007e00 con 0x55fc1ceacc30 2023-10-19T12:53:58.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.282+0000 7ff99f7fe700 1 -- 172.21.15.46:0/473650242 <== mon.2 v2:172.21.15.157:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7ff9b8016460 con 0x55fc1ceacc30 2023-10-19T12:53:58.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.282+0000 7ff9da021b80 1 -- 172.21.15.46:0/473650242 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fc1ce02ef0 con 0x55fc1ceacc30 2023-10-19T12:53:58.293 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.282+0000 7ff99f7fe700 1 -- 172.21.15.46:0/473650242 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff9b8016620 con 0x55fc1ceacc30 2023-10-19T12:53:58.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.283+0000 7ff9da021b80 10 client.26108 fetch_fsmap learned FSMap version 48 2023-10-19T12:53:58.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.283+0000 7ff9da021b80 1 -- 172.21.15.46:0/473650242 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) v3 -- 0x7ff9b400e6c0 con 0x55fc1ceacc30 2023-10-19T12:53:58.294 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.283+0000 7ff99f7fe700 1 -- 172.21.15.46:0/473650242 <== mon.2 v2:172.21.15.157:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55fc1ce02ef0 con 0x55fc1ceacc30 2023-10-19T12:53:58.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.283+0000 7ff99f7fe700 1 -- 172.21.15.46:0/473650242 <== mon.2 v2:172.21.15.157:3300/0 5 ==== fsmap(e 48) v1 ==== 7890+0+0 (secure 0 0 0) 0x7ff9b8014040 con 0x55fc1ceacc30 2023-10-19T12:53:58.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.283+0000 7ff9da021b80 10 client.26108 fetch_fsmap finished waiting for FSMap version 48 2023-10-19T12:53:58.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.283+0000 7ff9da021b80 10 client.26108 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-19T12:53:58.296 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.283+0000 7ff9da021b80 20 client.26108 populate_metadata read hostname 'smithi046' 2023-10-19T12:53:58.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.283+0000 7ff9da021b80 1 --2- 172.21.15.46:0/473650242 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x55fc1cec0940 0x55fc1cec2d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:53:58.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.283+0000 7ff9da021b80 4 client.26108 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-19T12:53:58.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.283+0000 7ff9da021b80 1 -- 172.21.15.46:0/473650242 --> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fc1ce7a8b0 con 0x55fc1cec0940 2023-10-19T12:53:58.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.284+0000 7ff9bffff700 1 --2- 172.21.15.46:0/473650242 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x55fc1cec0940 0x55fc1cec2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:53:58.297 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.285+0000 7ff9bffff700 1 --2- 172.21.15.46:0/473650242 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x55fc1cec0940 0x55fc1cec2d60 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ecd7a972d226e8c server_cookie=a728b1a124ab7431 in_seq=0 out_seq=0 2023-10-19T12:53:58.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.285+0000 7ff99f7fe700 10 client.26108 ms_handle_connect on v2:172.21.15.157:6838/552718978 2023-10-19T12:53:58.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.286+0000 7ff99f7fe700 1 -- 172.21.15.46:0/473650242 <== mds.0 v2:172.21.15.157:6838/552718978 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55fc1ce7a8b0 con 0x55fc1cec0940 2023-10-19T12:53:58.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.286+0000 7ff99f7fe700 10 client.26108 handle_command_reply: tid=0 2023-10-19T12:53:58.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.286+0000 7ff9da021b80 1 client.26108 shutdown 2023-10-19T12:53:58.298 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.287+0000 7ff9da021b80 1 -- 172.21.15.46:0/473650242 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fc1ceacc30 msgr2=0x55fc1cebc0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:53:58.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.287+0000 7ff9da021b80 1 --2- 172.21.15.46:0/473650242 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fc1ceacc30 0x55fc1cebc0b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff9b8004630 tx=0x7ff9b8004940 comp rx=0 tx=0).stop 2023-10-19T12:53:58.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.287+0000 7ff9da021b80 1 -- 172.21.15.46:0/473650242 shutdown_connections 2023-10-19T12:53:58.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.287+0000 7ff9da021b80 1 --2- 172.21.15.46:0/473650242 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fc1ceacc30 0x55fc1cebc0b0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:53:58.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.287+0000 7ff9da021b80 1 --2- 172.21.15.46:0/473650242 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x55fc1cec0940 0x55fc1cec2d60 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:53:58.299 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.287+0000 7ff9da021b80 1 --2- 172.21.15.46:0/473650242 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55fc1ceab5d0 0x55fc1ceb4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:53:58.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.287+0000 7ff9da021b80 1 --2- 172.21.15.46:0/473650242 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fc1ceac2d0 0x55fc1ceb5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:53:58.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.287+0000 7ff99f7fe700 0 client.26108 ms_handle_reset on v2:172.21.15.157:6838/552718978 2023-10-19T12:53:58.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.287+0000 7ff9da021b80 1 -- 172.21.15.46:0/473650242 >> 172.21.15.46:0/473650242 conn(0x55fc1ce1f720 msgr2=0x55fc1ceaa080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:53:58.300 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.288+0000 7ff9da021b80 1 -- 172.21.15.46:0/473650242 shutdown_connections 2023-10-19T12:53:58.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.288+0000 7ff9da021b80 1 -- 172.21.15.46:0/473650242 wait complete. 2023-10-19T12:53:58.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.288+0000 7ff9da021b80 20 client.26108 trim_cache size 0 max 16384 2023-10-19T12:53:58.315 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.312+0000 7ff9da021b80 1 Processor -- start 2023-10-19T12:53:58.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.312+0000 7ff9da021b80 1 -- start start 2023-10-19T12:53:58.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.312+0000 7ff9da021b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fc1ceab5d0 0x55fc1cebc760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:53:58.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.312+0000 7ff9da021b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fc1ceac2d0 0x55fc1cebc070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:53:58.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.312+0000 7ff9da021b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55fc1ceacc30 0x55fc1cea05d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:53:58.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.312+0000 7ff9da021b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc1cc7e920 con 0x55fc1ceacc30 2023-10-19T12:53:58.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.312+0000 7ff9da021b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc1ceb46a0 con 0x55fc1ceab5d0 2023-10-19T12:53:58.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.312+0000 7ff9da021b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc1cec30f0 con 0x55fc1ceac2d0 2023-10-19T12:53:58.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.313+0000 7ff9bffff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fc1ceab5d0 0x55fc1cebc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:53:58.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.313+0000 7ff9bffff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fc1ceab5d0 0x55fc1cebc760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:56326/0 (socket says 172.21.15.46:56326) 2023-10-19T12:53:58.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.313+0000 7ff9bffff700 1 -- 172.21.15.46:0/387692797 learned_addr learned my addr 172.21.15.46:0/387692797 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:53:58.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.313+0000 7ff9bf7fe700 1 --2- 172.21.15.46:0/387692797 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fc1ceac2d0 0x55fc1cebc070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:53:58.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.313+0000 7ff9bffff700 1 -- 172.21.15.46:0/387692797 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fc1ceac2d0 msgr2=0x55fc1cebc070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:53:58.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.313+0000 7ff9bffff700 1 --2- 172.21.15.46:0/387692797 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fc1ceac2d0 0x55fc1cebc070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:53:58.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.313+0000 7ff9bffff700 1 -- 172.21.15.46:0/387692797 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55fc1ceacc30 msgr2=0x55fc1cea05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:53:58.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.313+0000 7ff9bffff700 1 --2- 172.21.15.46:0/387692797 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55fc1ceacc30 0x55fc1cea05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:53:58.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.313+0000 7ff9bffff700 1 -- 172.21.15.46:0/387692797 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fc1cc28de0 con 0x55fc1ceab5d0 2023-10-19T12:53:58.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.313+0000 7ff9bffff700 1 --2- 172.21.15.46:0/387692797 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fc1ceab5d0 0x55fc1cebc760 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff9b009b0b0 tx=0x7ff9b00cb510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8cca60be42038ce1 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:53:58.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.313+0000 7ff9a6ffd700 1 -- 172.21.15.46:0/387692797 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b0099030 con 0x55fc1ceab5d0 2023-10-19T12:53:58.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.314+0000 7ff9a6ffd700 1 -- 172.21.15.46:0/387692797 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55fc1ce7a8b0 con 0x55fc1ceab5d0 2023-10-19T12:53:58.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.314+0000 7ff9a6ffd700 1 -- 172.21.15.46:0/387692797 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b009a3e0 con 0x55fc1ceab5d0 2023-10-19T12:53:58.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.314+0000 7ff9bf7fe700 1 --2- 172.21.15.46:0/387692797 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fc1ceac2d0 0x55fc1cebc070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T12:53:58.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.314+0000 7ff9da021b80 1 -- 172.21.15.46:0/387692797 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fc1ceab5d0 msgr2=0x55fc1cebc760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:53:58.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.314+0000 7ff9da021b80 1 --2- 172.21.15.46:0/387692797 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fc1ceab5d0 0x55fc1cebc760 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff9b009b0b0 tx=0x7ff9b00cb510 comp rx=0 tx=0).stop 2023-10-19T12:53:58.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.314+0000 7ff9da021b80 1 -- 172.21.15.46:0/387692797 shutdown_connections 2023-10-19T12:53:58.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.314+0000 7ff9da021b80 1 --2- 172.21.15.46:0/387692797 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55fc1ceacc30 0x55fc1cea05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:53:58.323 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.314+0000 7ff9da021b80 1 --2- 172.21.15.46:0/387692797 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fc1ceab5d0 0x55fc1cebc760 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:53:58.323 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.314+0000 7ff9da021b80 1 --2- 172.21.15.46:0/387692797 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fc1ceac2d0 0x55fc1cebc070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:53:58.323 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.314+0000 7ff9da021b80 1 -- 172.21.15.46:0/387692797 >> 172.21.15.46:0/387692797 conn(0x55fc1ce1f720 msgr2=0x55fc1ceab9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:53:58.323 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.314+0000 7ff9da021b80 1 -- 172.21.15.46:0/387692797 shutdown_connections 2023-10-19T12:53:58.323 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.314+0000 7ff9da021b80 1 -- 172.21.15.46:0/387692797 wait complete. 2023-10-19T12:53:58.324 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.315+0000 7ff9da021b80 1 -- start start 2023-10-19T12:53:58.324 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.315+0000 7ff9da021b80 1 Processor -- start 2023-10-19T12:53:58.324 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.316+0000 7ff9da021b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fc1ceab5d0 0x55fc1ceb9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:53:58.324 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.316+0000 7ff9da021b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55fc1ceac2d0 0x55fc1ceba300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:53:58.324 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.316+0000 7ff9da021b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fc1ceacc30 0x55fc1cebb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:53:58.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.316+0000 7ff9da021b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc1cebb800 con 0x55fc1ceac2d0 2023-10-19T12:53:58.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.316+0000 7ff9da021b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc1cebb970 con 0x55fc1ceacc30 2023-10-19T12:53:58.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.316+0000 7ff9da021b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc1cebbb30 con 0x55fc1ceab5d0 2023-10-19T12:53:58.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.316+0000 7ff9da021b80 10 client.0 _ll_register_callbacks cb 0x55fc1cce4a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:53:58.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.316+0000 7ff9bffff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fc1ceab5d0 0x55fc1ceb9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:53:58.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.316+0000 7ff9bffff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fc1ceab5d0 0x55fc1ceb9dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:35478/0 (socket says 172.21.15.46:35478) 2023-10-19T12:53:58.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.316+0000 7ff9bffff700 1 -- 172.21.15.46:0/766120067 learned_addr learned my addr 172.21.15.46:0/766120067 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:53:58.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.316+0000 7ff9c4d9c700 1 --2- 172.21.15.46:0/766120067 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fc1ceacc30 0x55fc1cebb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:53:58.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.316+0000 7ff9bf7fe700 1 --2- 172.21.15.46:0/766120067 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55fc1ceac2d0 0x55fc1ceba300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:53:58.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.316+0000 7ff9bffff700 1 -- 172.21.15.46:0/766120067 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fc1ceacc30 msgr2=0x55fc1cebb2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:53:58.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.317+0000 7ff9bffff700 1 --2- 172.21.15.46:0/766120067 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fc1ceacc30 0x55fc1cebb2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:53:58.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.317+0000 7ff9bffff700 1 -- 172.21.15.46:0/766120067 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55fc1ceac2d0 msgr2=0x55fc1ceba300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:53:58.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.317+0000 7ff9bffff700 1 --2- 172.21.15.46:0/766120067 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55fc1ceac2d0 0x55fc1ceba300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:53:58.330 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.317+0000 7ff9bffff700 1 -- 172.21.15.46:0/766120067 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9c01a5050 con 0x55fc1ceab5d0 2023-10-19T12:53:58.330 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.317+0000 7ff9c4d9c700 1 --2- 172.21.15.46:0/766120067 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fc1ceacc30 0x55fc1cebb2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:53:58.330 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.317+0000 7ff9bf7fe700 1 --2- 172.21.15.46:0/766120067 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55fc1ceac2d0 0x55fc1ceba300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:53:58.330 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.317+0000 7ff9bffff700 1 --2- 172.21.15.46:0/766120067 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fc1ceab5d0 0x55fc1ceb9dc0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff9b009abf0 tx=0x7ff9b009afa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a1dd2d72f8336dd1 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:53:58.330 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.317+0000 7ff99f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-10-19T12:53:58.331 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.317+0000 7ff99f7fe700 1 -- 172.21.15.46:0/766120067 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b009a3e0 con 0x55fc1ceab5d0 2023-10-19T12:53:58.331 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.317+0000 7ff9da021b80 1 -- 172.21.15.46:0/766120067 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff9b4015940 con 0x55fc1ceab5d0 2023-10-19T12:53:58.331 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.317+0000 7ff99f7fe700 1 -- 172.21.15.46:0/766120067 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7ff9b009a540 con 0x55fc1ceab5d0 2023-10-19T12:53:58.331 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.317+0000 7ff99f7fe700 1 -- 172.21.15.46:0/766120067 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff9b00a2d60 con 0x55fc1ceab5d0 2023-10-19T12:53:58.331 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.318+0000 7ff9da021b80 10 client.26134 fetch_fsmap learned FSMap version 48 2023-10-19T12:53:58.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.318+0000 7ff9da021b80 1 -- 172.21.15.46:0/766120067 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) v3 -- 0x55fc1cc11c60 con 0x55fc1ceab5d0 2023-10-19T12:53:58.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.318+0000 7ff99f7fe700 1 -- 172.21.15.46:0/766120067 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff9b4015940 con 0x55fc1ceab5d0 2023-10-19T12:53:58.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.320+0000 7ff99f7fe700 1 -- 172.21.15.46:0/766120067 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 48) v1 ==== 7890+0+0 (secure 0 0 0) 0x7ff9b007e020 con 0x55fc1ceab5d0 2023-10-19T12:53:58.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.320+0000 7ff9da021b80 10 client.26134 fetch_fsmap finished waiting for FSMap version 48 2023-10-19T12:53:58.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.320+0000 7ff9da021b80 10 client.26134 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-19T12:53:58.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.320+0000 7ff9da021b80 20 client.26134 populate_metadata read hostname 'smithi046' 2023-10-19T12:53:58.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.320+0000 7ff9da021b80 1 --2- 172.21.15.46:0/766120067 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x55fc1cf15270 0x55fc1cf17690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:53:58.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.320+0000 7ff9da021b80 4 client.26134 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-19T12:53:58.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.320+0000 7ff9da021b80 1 -- 172.21.15.46:0/766120067 --> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55fc1cdf6e50 con 0x55fc1cf15270 2023-10-19T12:53:58.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.320+0000 7ff9bf7fe700 1 --2- 172.21.15.46:0/766120067 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x55fc1cf15270 0x55fc1cf17690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:53:58.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.321+0000 7ff99f7fe700 10 client.26134 ms_handle_connect on v2:172.21.15.157:6838/552718978 2023-10-19T12:53:58.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.321+0000 7ff9bf7fe700 1 --2- 172.21.15.46:0/766120067 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x55fc1cf15270 0x55fc1cf17690 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba4232a1b70e5513 server_cookie=a74ab45f15e77940 in_seq=0 out_seq=0 2023-10-19T12:53:58.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.322+0000 7ff99f7fe700 1 -- 172.21.15.46:0/766120067 <== mds.0 v2:172.21.15.157:6838/552718978 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55fc1cdf6e50 con 0x55fc1cf15270 2023-10-19T12:53:58.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.322+0000 7ff99f7fe700 10 client.26134 handle_command_reply: tid=0 2023-10-19T12:53:58.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.322+0000 7ff9da021b80 1 client.26134 shutdown 2023-10-19T12:53:58.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.322+0000 7ff9da021b80 1 -- 172.21.15.46:0/766120067 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fc1ceab5d0 msgr2=0x55fc1ceb9dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:53:58.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.322+0000 7ff9da021b80 1 --2- 172.21.15.46:0/766120067 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fc1ceab5d0 0x55fc1ceb9dc0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff9b009abf0 tx=0x7ff9b009afa0 comp rx=0 tx=0).stop 2023-10-19T12:53:58.337 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.322+0000 7ff9da021b80 1 -- 172.21.15.46:0/766120067 shutdown_connections 2023-10-19T12:53:58.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.322+0000 7ff9da021b80 1 --2- 172.21.15.46:0/766120067 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55fc1ceacc30 0x55fc1cebb2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:53:58.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.322+0000 7ff9da021b80 1 --2- 172.21.15.46:0/766120067 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fc1ceab5d0 0x55fc1ceb9dc0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:53:58.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.322+0000 7ff9da021b80 1 --2- 172.21.15.46:0/766120067 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x55fc1cf15270 0x55fc1cf17690 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:53:58.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.322+0000 7ff9da021b80 1 --2- 172.21.15.46:0/766120067 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55fc1ceac2d0 0x55fc1ceba300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:53:58.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.322+0000 7ff9da021b80 1 -- 172.21.15.46:0/766120067 >> 172.21.15.46:0/766120067 conn(0x55fc1ce1f720 msgr2=0x55fc1cea5a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:53:58.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.322+0000 7ff99f7fe700 0 client.26134 ms_handle_reset on v2:172.21.15.157:6838/552718978 2023-10-19T12:53:58.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.323+0000 7ff9da021b80 1 -- 172.21.15.46:0/766120067 shutdown_connections 2023-10-19T12:53:58.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.323+0000 7ff9da021b80 1 -- 172.21.15.46:0/766120067 wait complete. 2023-10-19T12:53:58.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.323+0000 7ff9da021b80 20 client.26134 trim_cache size 0 max 16384 2023-10-19T12:53:58.340 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-10-19T12:53:58.340 INFO:teuthology.orchestra.run.smithi046.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-19T12:53:58.340 INFO:teuthology.orchestra.run.smithi046.stdout: "scrubs": { 2023-10-19T12:53:58.340 INFO:teuthology.orchestra.run.smithi046.stdout: "21e73f70-af16-4ae7-bc34-e6c54ba8e1ec": { 2023-10-19T12:53:58.340 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2023-10-19T12:53:58.341 INFO:teuthology.orchestra.run.smithi046.stdout: "tag": "21e73f70-af16-4ae7-bc34-e6c54ba8e1ec", 2023-10-19T12:53:58.341 INFO:teuthology.orchestra.run.smithi046.stdout: "options": "recursive,force" 2023-10-19T12:53:58.341 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:53:58.341 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:53:58.341 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-10-19T12:53:58.342 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:53:58 smithi157 ceph-mon[134109]: pgmap v667: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 5.6 MiB/s wr, 517 op/s 2023-10-19T12:53:58.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.324+0000 7ff9c67ff700 1 -- 172.21.15.46:0/409760082 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7ff9a80a1500 msgr2=0x7ff9a80a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:53:58.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.324+0000 7ff9c67ff700 1 --2- 172.21.15.46:0/409760082 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7ff9a80a1500 0x7ff9a80a39c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7ff9c0109700 tx=0x7ff9b4009190 comp rx=0 tx=0).stop 2023-10-19T12:53:58.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.324+0000 7ff9c67ff700 1 -- 172.21.15.46:0/409760082 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff9c00ff690 msgr2=0x7ff9c0109d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:53:58.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.324+0000 7ff9c67ff700 1 --2- 172.21.15.46:0/409760082 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff9c00ff690 0x7ff9c0109d80 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff9b00098e0 tx=0x7ff9b000f670 comp rx=0 tx=0).stop 2023-10-19T12:53:58.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.324+0000 7ff9c67ff700 1 -- 172.21.15.46:0/409760082 shutdown_connections 2023-10-19T12:53:58.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.324+0000 7ff9c67ff700 1 --2- 172.21.15.46:0/409760082 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9c0101220 0x7ff9c0108990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:53:58.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.324+0000 7ff9c67ff700 1 --2- 172.21.15.46:0/409760082 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff9c00ff690 0x7ff9c0109d80 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:53:58.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.324+0000 7ff9c67ff700 1 --2- 172.21.15.46:0/409760082 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7ff9a80a1500 0x7ff9a80a39c0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:53:58.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.324+0000 7ff9c67ff700 1 --2- 172.21.15.46:0/409760082 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff9c0100880 0x7ff9c0108450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:53:58.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.324+0000 7ff9c67ff700 1 -- 172.21.15.46:0/409760082 >> 172.21.15.46:0/409760082 conn(0x7ff9c00fac00 msgr2=0x7ff9c0103c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:53:58.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.324+0000 7ff9c67ff700 1 -- 172.21.15.46:0/409760082 shutdown_connections 2023-10-19T12:53:58.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:53:58.324+0000 7ff9c67ff700 1 -- 172.21.15.46:0/409760082 wait complete. 2023-10-19T12:53:58.352 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:53:58 smithi046 ceph-mon[98509]: pgmap v667: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 5.6 MiB/s wr, 517 op/s 2023-10-19T12:53:58.358 INFO:tasks.cephfs.filesystem:scrub status for tag:21e73f70-af16-4ae7-bc34-e6c54ba8e1ec - {'path': '/', 'tag': '21e73f70-af16-4ae7-bc34-e6c54ba8e1ec', 'options': 'recursive,force'} 2023-10-19T12:53:58.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:53:58 smithi195 ceph-mon[134493]: pgmap v667: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 5.6 MiB/s wr, 517 op/s 2023-10-19T12:54:00.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:53:59 smithi157 ceph-mon[134109]: pgmap v668: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.0 MiB/s wr, 484 op/s 2023-10-19T12:54:00.133 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:53:59 smithi195 ceph-mon[134493]: pgmap v668: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.0 MiB/s wr, 484 op/s 2023-10-19T12:54:00.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:53:59 smithi046 ceph-mon[98509]: pgmap v668: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.0 MiB/s wr, 484 op/s 2023-10-19T12:54:01.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 600.0 s, 412.6 tps, lat 239.976 ms stddev 284.098 2023-10-19T12:54:02.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:54:02 smithi157 ceph-mon[134109]: pgmap v669: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 5.1 MiB/s wr, 491 op/s 2023-10-19T12:54:02.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:54:02 smithi195 ceph-mon[134493]: pgmap v669: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 5.1 MiB/s wr, 491 op/s 2023-10-19T12:54:02.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:54:02 smithi046 ceph-mon[98509]: pgmap v669: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 5.1 MiB/s wr, 491 op/s 2023-10-19T12:54:04.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:54:04 smithi157 ceph-mon[134109]: pgmap v670: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.6 MiB/s wr, 457 op/s 2023-10-19T12:54:04.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:54:04 smithi195 ceph-mon[134493]: pgmap v670: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.6 MiB/s wr, 457 op/s 2023-10-19T12:54:04.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:54:04 smithi046 ceph-mon[98509]: pgmap v670: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.6 MiB/s wr, 457 op/s 2023-10-19T12:54:06.341 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:54:06 smithi157 ceph-mon[134109]: pgmap v671: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.5 MiB/s wr, 447 op/s 2023-10-19T12:54:06.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:54:06 smithi195 ceph-mon[134493]: pgmap v671: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.5 MiB/s wr, 447 op/s 2023-10-19T12:54:06.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:54:06 smithi046 ceph-mon[98509]: pgmap v671: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.5 MiB/s wr, 447 op/s 2023-10-19T12:54:06.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 605.0 s, 425.8 tps, lat 226.138 ms stddev 285.071 2023-10-19T12:54:08.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:54:08 smithi157 ceph-mon[134109]: pgmap v672: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 5.7 MiB/s wr, 531 op/s 2023-10-19T12:54:08.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:54:08 smithi195 ceph-mon[134493]: pgmap v672: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 5.7 MiB/s wr, 531 op/s 2023-10-19T12:54:08.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:54:08 smithi046 ceph-mon[98509]: pgmap v672: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 5.7 MiB/s wr, 531 op/s 2023-10-19T12:54:10.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:54:09 smithi157 ceph-mon[134109]: pgmap v673: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 5.0 MiB/s wr, 488 op/s 2023-10-19T12:54:10.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:54:09 smithi195 ceph-mon[134493]: pgmap v673: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 5.0 MiB/s wr, 488 op/s 2023-10-19T12:54:10.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:54:09 smithi046 ceph-mon[98509]: pgmap v673: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 5.0 MiB/s wr, 488 op/s 2023-10-19T12:54:11.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:54:10 smithi157 ceph-mon[134109]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-19T12:54:11.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:54:10 smithi195 ceph-mon[134493]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-19T12:54:11.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:54:10 smithi046 ceph-mon[98509]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-19T12:54:11.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 610.0 s, 489.2 tps, lat 213.523 ms stddev 297.259 2023-10-19T12:54:12.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:54:11 smithi157 ceph-mon[134109]: pgmap v674: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 5.1 MiB/s wr, 493 op/s 2023-10-19T12:54:12.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:54:11 smithi195 ceph-mon[134493]: pgmap v674: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 5.1 MiB/s wr, 493 op/s 2023-10-19T12:54:12.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:54:11 smithi046 ceph-mon[98509]: pgmap v674: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 5.1 MiB/s wr, 493 op/s 2023-10-19T12:54:14.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:54:14 smithi157 ceph-mon[134109]: pgmap v675: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 5.1 MiB/s wr, 479 op/s 2023-10-19T12:54:14.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:54:14 smithi195 ceph-mon[134493]: pgmap v675: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 5.1 MiB/s wr, 479 op/s 2023-10-19T12:54:14.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:54:14 smithi046 ceph-mon[98509]: pgmap v675: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 5.1 MiB/s wr, 479 op/s 2023-10-19T12:54:16.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:54:16 smithi157 ceph-mon[134109]: pgmap v676: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 5.0 MiB/s wr, 462 op/s 2023-10-19T12:54:16.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:54:16 smithi157 ceph-mon[134109]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-19T12:54:16.384 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:54:16 smithi195 ceph-mon[134493]: pgmap v676: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 5.0 MiB/s wr, 462 op/s 2023-10-19T12:54:16.384 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:54:16 smithi195 ceph-mon[134493]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-19T12:54:16.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:54:16 smithi046 ceph-mon[98509]: pgmap v676: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 5.0 MiB/s wr, 462 op/s 2023-10-19T12:54:16.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:54:16 smithi046 ceph-mon[98509]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-19T12:54:16.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 615.0 s, 557.6 tps, lat 176.782 ms stddev 260.226 2023-10-19T12:54:18.339 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:54:18 smithi157 ceph-mon[134109]: pgmap v677: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 5.7 MiB/s wr, 549 op/s 2023-10-19T12:54:18.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:54:18 smithi195 ceph-mon[134493]: pgmap v677: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 5.7 MiB/s wr, 549 op/s 2023-10-19T12:54:18.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:54:18 smithi046 ceph-mon[98509]: pgmap v677: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 5.7 MiB/s wr, 549 op/s 2023-10-19T12:54:19.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:54:19 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:54:19.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:54:19 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:54:19.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:54:19 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:54:20.342 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:54:20 smithi157 ceph-mon[134109]: pgmap v678: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 5.3 MiB/s wr, 525 op/s 2023-10-19T12:54:20.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:54:20 smithi195 ceph-mon[134493]: pgmap v678: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 5.3 MiB/s wr, 525 op/s 2023-10-19T12:54:20.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:54:20 smithi046 ceph-mon[98509]: pgmap v678: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 5.3 MiB/s wr, 525 op/s 2023-10-19T12:54:21.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 620.0 s, 556.2 tps, lat 175.693 ms stddev 245.040 2023-10-19T12:54:22.340 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:54:22 smithi157 ceph-mon[134109]: pgmap v679: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 5.3 MiB/s wr, 538 op/s 2023-10-19T12:54:22.371 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:54:22 smithi195 ceph-mon[134493]: pgmap v679: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 5.3 MiB/s wr, 538 op/s 2023-10-19T12:54:22.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:54:22 smithi046 ceph-mon[98509]: pgmap v679: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 5.3 MiB/s wr, 538 op/s 2023-10-19T12:54:23.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:54:23 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:54:23.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:54:23 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:54:23.839 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:54:23 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:54:23.839 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:54:23 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:54:23.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:54:23 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:54:23.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:54:23 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:54:24.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:54:24 smithi046 ceph-mon[98509]: pgmap v680: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 5.7 MiB/s wr, 546 op/s 2023-10-19T12:54:24.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:54:24 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:54:24.730 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:54:24 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:54:24.842 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:54:24 smithi157 ceph-mon[134109]: pgmap v680: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 5.7 MiB/s wr, 546 op/s 2023-10-19T12:54:24.843 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:54:24 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:54:24.843 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:54:24 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:54:24.882 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:54:24 smithi195 ceph-mon[134493]: pgmap v680: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 5.7 MiB/s wr, 546 op/s 2023-10-19T12:54:24.882 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:54:24 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:54:24.883 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:54:24 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:54:26.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 625.0 s, 424.2 tps, lat 231.312 ms stddev 269.352 2023-10-19T12:54:26.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:54:26 smithi046 ceph-mon[98509]: pgmap v681: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.5 MiB/s wr, 526 op/s 2023-10-19T12:54:26.730 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:54:26 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:54:26.730 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:54:26 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:54:26.838 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:54:26 smithi157 ceph-mon[134109]: pgmap v681: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.5 MiB/s wr, 526 op/s 2023-10-19T12:54:26.839 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:54:26 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:54:26.839 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:54:26 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:54:26.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:54:26 smithi195 ceph-mon[134493]: pgmap v681: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.5 MiB/s wr, 526 op/s 2023-10-19T12:54:26.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:54:26 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:54:26.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:54:26 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:54:27.837 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:54:27 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:54:27.838 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:54:27 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:54:27.838 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:54:27 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:54:27.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:54:27 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:54:27.882 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:54:27 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:54:27.882 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:54:27 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:54:27.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:54:27 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:54:27.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:54:27 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:54:27.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:54:27 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:54:28.359 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-19T12:54:28.730 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:54:28 smithi046 ceph-mon[98509]: pgmap v682: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 5.6 MiB/s wr, 564 op/s 2023-10-19T12:54:28.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.745+0000 7f06959ff700 1 -- 172.21.15.46:0/2675601020 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f06900747d0 msgr2=0x7f0690072c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:54:28.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.745+0000 7f06959ff700 1 --2- 172.21.15.46:0/2675601020 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f06900747d0 0x7f0690072c20 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0684009990 tx=0x7f0684009ca0 comp rx=0 tx=0).stop 2023-10-19T12:54:28.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.747+0000 7f06959ff700 1 -- 172.21.15.46:0/2675601020 shutdown_connections 2023-10-19T12:54:28.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.747+0000 7f06959ff700 1 --2- 172.21.15.46:0/2675601020 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0690108670 0x7f069010aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:54:28.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.747+0000 7f06959ff700 1 --2- 172.21.15.46:0/2675601020 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f06900747d0 0x7f0690072c20 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:54:28.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.747+0000 7f06959ff700 1 --2- 172.21.15.46:0/2675601020 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f06900731f0 0x7f0690073670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:54:28.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.747+0000 7f06959ff700 1 -- 172.21.15.46:0/2675601020 >> 172.21.15.46:0/2675601020 conn(0x7f06900fbcf0 msgr2=0x7f06900fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:54:28.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.747+0000 7f06959ff700 1 -- 172.21.15.46:0/2675601020 shutdown_connections 2023-10-19T12:54:28.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.747+0000 7f06959ff700 1 -- 172.21.15.46:0/2675601020 wait complete. 2023-10-19T12:54:28.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.749+0000 7f06959ff700 1 Processor -- start 2023-10-19T12:54:28.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.749+0000 7f06959ff700 1 -- start start 2023-10-19T12:54:28.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.749+0000 7f06959ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06900731f0 0x7f0690198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:54:28.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.750+0000 7f06959ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f06900747d0 0x7f0690198ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:54:28.754 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.750+0000 7f06959ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0690108670 0x7f069019fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:54:28.754 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.750+0000 7f06959ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06901a04c0 con 0x7f06900731f0 2023-10-19T12:54:28.754 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.750+0000 7f06959ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06901a0600 con 0x7f0690108670 2023-10-19T12:54:28.754 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.750+0000 7f06959ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06901a0790 con 0x7f06900747d0 2023-10-19T12:54:28.755 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.750+0000 7f068f7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0690108670 0x7f069019fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:54:28.755 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.750+0000 7f068f7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0690108670 0x7f069019fef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:35124/0 (socket says 172.21.15.46:35124) 2023-10-19T12:54:28.755 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.750+0000 7f068f7fe700 1 -- 172.21.15.46:0/3534712355 learned_addr learned my addr 172.21.15.46:0/3534712355 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:54:28.755 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.750+0000 7f068effd700 1 --2- 172.21.15.46:0/3534712355 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06900731f0 0x7f0690198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:54:28.755 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.750+0000 7f068e7fc700 1 --2- 172.21.15.46:0/3534712355 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f06900747d0 0x7f0690198ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:54:28.756 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.751+0000 7f068f7fe700 1 -- 172.21.15.46:0/3534712355 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f06900747d0 msgr2=0x7f0690198ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:54:28.756 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.751+0000 7f068f7fe700 1 --2- 172.21.15.46:0/3534712355 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f06900747d0 0x7f0690198ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:54:28.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.751+0000 7f068f7fe700 1 -- 172.21.15.46:0/3534712355 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06900731f0 msgr2=0x7f0690198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:54:28.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.751+0000 7f068f7fe700 1 --2- 172.21.15.46:0/3534712355 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06900731f0 0x7f0690198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:54:28.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.751+0000 7f068f7fe700 1 -- 172.21.15.46:0/3534712355 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06840095f0 con 0x7f0690108670 2023-10-19T12:54:28.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.751+0000 7f068f7fe700 1 --2- 172.21.15.46:0/3534712355 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0690108670 0x7f069019fef0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0688007ee0 tx=0x7f068800d3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:54:28.758 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.752+0000 7f06949fd700 1 -- 172.21.15.46:0/3534712355 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0688017070 con 0x7f0690108670 2023-10-19T12:54:28.758 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.752+0000 7f06949fd700 1 -- 172.21.15.46:0/3534712355 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f068800f040 con 0x7f0690108670 2023-10-19T12:54:28.758 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.752+0000 7f06959ff700 1 -- 172.21.15.46:0/3534712355 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06901a0a70 con 0x7f0690108670 2023-10-19T12:54:28.759 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.752+0000 7f06949fd700 1 -- 172.21.15.46:0/3534712355 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0688005740 con 0x7f0690108670 2023-10-19T12:54:28.759 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.752+0000 7f06959ff700 1 -- 172.21.15.46:0/3534712355 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06901a0f80 con 0x7f0690108670 2023-10-19T12:54:28.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.760+0000 7f06949fd700 1 -- 172.21.15.46:0/3534712355 <== mon.2 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f06880058a0 con 0x7f0690108670 2023-10-19T12:54:28.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.762+0000 7f06a939db80 1 Processor -- start 2023-10-19T12:54:28.766 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.763+0000 7f06a939db80 1 -- start start 2023-10-19T12:54:28.768 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.763+0000 7f06a939db80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561e0181da90 0x561e0181de90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:54:28.768 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.763+0000 7f06a939db80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561e0181e3d0 0x561e0181e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:54:28.768 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.764+0000 7f068e7fc700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561e0181da90 0x561e0181de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:54:28.768 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.764+0000 7f06a939db80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561e0181ed90 0x561e0181f210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:54:28.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.764+0000 7f06949fd700 1 --2- 172.21.15.46:0/3534712355 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f06780a1500 0x7f06780a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:54:28.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.764+0000 7f068e7fc700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561e0181da90 0x561e0181de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:35130/0 (socket says 172.21.15.46:35130) 2023-10-19T12:54:28.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.764+0000 7f06a939db80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e017886e0 con 0x561e0181ed90 2023-10-19T12:54:28.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.764+0000 7f068e7fc700 1 -- 172.21.15.46:0/2791305839 learned_addr learned my addr 172.21.15.46:0/2791305839 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:54:28.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.764+0000 7f06949fd700 1 -- 172.21.15.46:0/3534712355 <== mon.2 v2:172.21.15.157:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f06880cc7b0 con 0x7f0690108670 2023-10-19T12:54:28.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.764+0000 7f068effd700 1 --2- 172.21.15.46:0/2791305839 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561e0181e3d0 0x561e0181e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:54:28.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.764+0000 7f06a939db80 1 -- 172.21.15.46:0/2791305839 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e0176ec60 con 0x561e0181da90 2023-10-19T12:54:28.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.764+0000 7f06a939db80 1 -- 172.21.15.46:0/2791305839 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e0176c580 con 0x561e0181e3d0 2023-10-19T12:54:28.771 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.765+0000 7f068effd700 1 -- 172.21.15.46:0/2791305839 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561e0181da90 msgr2=0x561e0181de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:54:28.771 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.765+0000 7f068effd700 1 --2- 172.21.15.46:0/2791305839 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561e0181da90 0x561e0181de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:54:28.771 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.765+0000 7f068effd700 1 -- 172.21.15.46:0/2791305839 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561e0181ed90 msgr2=0x561e0181f210 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-19T12:54:28.772 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.765+0000 7f068effd700 1 --2- 172.21.15.46:0/2791305839 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561e0181ed90 0x561e0181f210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:54:28.772 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.765+0000 7f068effd700 1 -- 172.21.15.46:0/2791305839 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561e017253f0 con 0x561e0181e3d0 2023-10-19T12:54:28.772 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.765+0000 7f068e7fc700 1 --2- 172.21.15.46:0/2791305839 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561e0181da90 0x561e0181de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T12:54:28.772 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.765+0000 7f068f7fe700 1 --2- 172.21.15.46:0/3534712355 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f06780a1500 0x7f06780a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:54:28.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.766+0000 7f068effd700 1 --2- 172.21.15.46:0/2791305839 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561e0181e3d0 0x561e0181e850 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0684003790 tx=0x7f0684009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3daec87ec51fb448 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:54:28.775 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.768+0000 7f0675ffb700 1 -- 172.21.15.46:0/2791305839 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f068401d050 con 0x561e0181e3d0 2023-10-19T12:54:28.775 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.768+0000 7f0675ffb700 1 -- 172.21.15.46:0/2791305839 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f068401e040 con 0x561e0181e3d0 2023-10-19T12:54:28.775 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.768+0000 7f0675ffb700 1 -- 172.21.15.46:0/2791305839 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0684005630 con 0x561e0181e3d0 2023-10-19T12:54:28.775 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.769+0000 7f06a939db80 1 -- 172.21.15.46:0/2791305839 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561e0181e3d0 msgr2=0x561e0181e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:54:28.775 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.769+0000 7f06a939db80 1 --2- 172.21.15.46:0/2791305839 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561e0181e3d0 0x561e0181e850 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0684003790 tx=0x7f0684009f90 comp rx=0 tx=0).stop 2023-10-19T12:54:28.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.769+0000 7f068f7fe700 1 --2- 172.21.15.46:0/3534712355 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f06780a1500 0x7f06780a39c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f0688007fd0 tx=0x7f0688009ee0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:54:28.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.770+0000 7f06a939db80 1 -- 172.21.15.46:0/2791305839 shutdown_connections 2023-10-19T12:54:28.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.770+0000 7f06a939db80 1 --2- 172.21.15.46:0/2791305839 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561e0181ed90 0x561e0181f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:54:28.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.770+0000 7f06a939db80 1 --2- 172.21.15.46:0/2791305839 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561e0181da90 0x561e0181de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:54:28.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.770+0000 7f06a939db80 1 --2- 172.21.15.46:0/2791305839 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561e0181e3d0 0x561e0181e850 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:54:28.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.770+0000 7f06a939db80 1 -- 172.21.15.46:0/2791305839 >> 172.21.15.46:0/2791305839 conn(0x561e01789720 msgr2=0x561e0180fb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:54:28.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.770+0000 7f06a939db80 1 -- 172.21.15.46:0/2791305839 shutdown_connections 2023-10-19T12:54:28.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.770+0000 7f06a939db80 1 -- 172.21.15.46:0/2791305839 wait complete. 2023-10-19T12:54:28.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.771+0000 7f06a939db80 1 -- start start 2023-10-19T12:54:28.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.772+0000 7f06a939db80 1 Processor -- start 2023-10-19T12:54:28.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.773+0000 7f06a939db80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561e0181da90 0x561e01827310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:54:28.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.773+0000 7f06a939db80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561e0181e3d0 0x561e01827850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:54:28.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.774+0000 7f06a939db80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561e0181ed90 0x561e0182e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:54:28.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.774+0000 7f06a939db80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e01767e70 con 0x561e0181ed90 2023-10-19T12:54:28.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.774+0000 7f06a939db80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e01704710 con 0x561e0181da90 2023-10-19T12:54:28.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.774+0000 7f06a939db80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e017043b0 con 0x561e0181e3d0 2023-10-19T12:54:28.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.774+0000 7f06a939db80 10 client.0 _ll_register_callbacks cb 0x561e0164ea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:54:28.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.775+0000 7f068e7fc700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561e0181da90 0x561e01827310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:54:28.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.775+0000 7f068e7fc700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561e0181da90 0x561e01827310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:35144/0 (socket says 172.21.15.46:35144) 2023-10-19T12:54:28.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.775+0000 7f068e7fc700 1 -- 172.21.15.46:0/760959321 learned_addr learned my addr 172.21.15.46:0/760959321 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:54:28.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.775+0000 7f068e7fc700 1 --2- 172.21.15.46:0/760959321 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561e0181ed90 0x561e0182e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:54:28.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.776+0000 7f068effd700 1 --2- 172.21.15.46:0/760959321 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561e0181e3d0 0x561e01827850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:54:28.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.777+0000 7f068effd700 1 -- 172.21.15.46:0/760959321 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561e0181da90 msgr2=0x561e01827310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:54:28.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.777+0000 7f068effd700 1 --2- 172.21.15.46:0/760959321 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561e0181da90 0x561e01827310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:54:28.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.777+0000 7f068effd700 1 -- 172.21.15.46:0/760959321 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561e0181ed90 msgr2=0x561e0182e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:54:28.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.777+0000 7f068effd700 1 --2- 172.21.15.46:0/760959321 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561e0181ed90 0x561e0182e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:54:28.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.777+0000 7f068effd700 1 -- 172.21.15.46:0/760959321 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f069010b700 con 0x561e0181e3d0 2023-10-19T12:54:28.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.777+0000 7f066effd700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-10-19T12:54:28.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.777+0000 7f068effd700 1 --2- 172.21.15.46:0/760959321 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561e0181e3d0 0x561e01827850 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0684009350 tx=0x7f068400bc20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7cb2d7b39016033 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:54:28.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.778+0000 7f066effd700 1 -- 172.21.15.46:0/760959321 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0684003d70 con 0x561e0181e3d0 2023-10-19T12:54:28.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.778+0000 7f066effd700 1 -- 172.21.15.46:0/760959321 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f0684023460 con 0x561e0181e3d0 2023-10-19T12:54:28.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.778+0000 7f06a939db80 1 -- 172.21.15.46:0/760959321 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561e0176cef0 con 0x561e0181e3d0 2023-10-19T12:54:28.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.779+0000 7f066effd700 1 -- 172.21.15.46:0/760959321 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7f068401d020 con 0x561e0181e3d0 2023-10-19T12:54:28.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.779+0000 7f06a939db80 10 client.26143 fetch_fsmap learned FSMap version 50 2023-10-19T12:54:28.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.779+0000 7f06a939db80 1 -- 172.21.15.46:0/760959321 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) v3 -- 0x561e01592de0 con 0x561e0181e3d0 2023-10-19T12:54:28.786 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.780+0000 7f066effd700 1 -- 172.21.15.46:0/760959321 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x561e0176cef0 con 0x561e0181e3d0 2023-10-19T12:54:28.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.783+0000 7f066effd700 1 -- 172.21.15.46:0/760959321 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 50) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f0684034070 con 0x561e0181e3d0 2023-10-19T12:54:28.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.784+0000 7f06a939db80 10 client.26143 fetch_fsmap finished waiting for FSMap version 50 2023-10-19T12:54:28.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.784+0000 7f06a939db80 10 client.26143 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-19T12:54:28.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.784+0000 7f06a939db80 20 client.26143 populate_metadata read hostname 'smithi046' 2023-10-19T12:54:28.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.784+0000 7f06a939db80 1 --2- 172.21.15.46:0/760959321 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x561e01832b60 0x561e01834f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:54:28.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.784+0000 7f06a939db80 4 client.26143 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-19T12:54:28.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.784+0000 7f06a939db80 1 -- 172.21.15.46:0/760959321 --> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561e017e48b0 con 0x561e01832b60 2023-10-19T12:54:28.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.785+0000 7f068e7fc700 1 --2- 172.21.15.46:0/760959321 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x561e01832b60 0x561e01834f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:54:28.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.786+0000 7f068e7fc700 1 --2- 172.21.15.46:0/760959321 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x561e01832b60 0x561e01834f80 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8997984a58c23c11 server_cookie=36e4e1977d9a77e6 in_seq=0 out_seq=0 2023-10-19T12:54:28.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.786+0000 7f066effd700 10 client.26143 ms_handle_connect on v2:172.21.15.157:6838/552718978 2023-10-19T12:54:28.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.787+0000 7f066effd700 1 -- 172.21.15.46:0/760959321 <== mds.0 v2:172.21.15.157:6838/552718978 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x561e017e48b0 con 0x561e01832b60 2023-10-19T12:54:28.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.788+0000 7f066effd700 10 client.26143 handle_command_reply: tid=0 2023-10-19T12:54:28.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.788+0000 7f06a939db80 1 client.26143 shutdown 2023-10-19T12:54:28.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.788+0000 7f06a939db80 1 -- 172.21.15.46:0/760959321 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561e0181e3d0 msgr2=0x561e01827850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:54:28.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.788+0000 7f06a939db80 1 --2- 172.21.15.46:0/760959321 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561e0181e3d0 0x561e01827850 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0684009350 tx=0x7f068400bc20 comp rx=0 tx=0).stop 2023-10-19T12:54:28.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.789+0000 7f06a939db80 1 -- 172.21.15.46:0/760959321 shutdown_connections 2023-10-19T12:54:28.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.789+0000 7f06a939db80 1 --2- 172.21.15.46:0/760959321 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x561e01832b60 0x561e01834f80 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:54:28.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.789+0000 7f06a939db80 1 --2- 172.21.15.46:0/760959321 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561e0181ed90 0x561e0182e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:54:28.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.789+0000 7f06a939db80 1 --2- 172.21.15.46:0/760959321 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561e0181da90 0x561e01827310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:54:28.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.789+0000 7f06a939db80 1 --2- 172.21.15.46:0/760959321 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561e0181e3d0 0x561e01827850 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:54:28.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.789+0000 7f06a939db80 1 -- 172.21.15.46:0/760959321 >> 172.21.15.46:0/760959321 conn(0x561e01789720 msgr2=0x561e01814080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:54:28.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.789+0000 7f066effd700 0 client.26143 ms_handle_reset on v2:172.21.15.157:6838/552718978 2023-10-19T12:54:28.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.789+0000 7f06a939db80 1 -- 172.21.15.46:0/760959321 shutdown_connections 2023-10-19T12:54:28.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.789+0000 7f06a939db80 1 -- 172.21.15.46:0/760959321 wait complete. 2023-10-19T12:54:28.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.790+0000 7f06a939db80 20 client.26143 trim_cache size 0 max 16384 2023-10-19T12:54:28.829 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.826+0000 7f06a939db80 1 Processor -- start 2023-10-19T12:54:28.830 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.826+0000 7f06a939db80 1 -- start start 2023-10-19T12:54:28.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.827+0000 7f06a939db80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561e0181da90 0x561e0180a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:54:28.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.827+0000 7f06a939db80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561e0181e3d0 0x561e0182e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:54:28.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.827+0000 7f06a939db80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561e0181ed90 0x561e0180f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:54:28.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.827+0000 7f06a939db80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e015e8920 con 0x561e0181ed90 2023-10-19T12:54:28.831 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.827+0000 7f06a939db80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e01811610 con 0x561e0181da90 2023-10-19T12:54:28.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.827+0000 7f06a939db80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e01826e80 con 0x561e0181e3d0 2023-10-19T12:54:28.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.827+0000 7f068effd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561e0181e3d0 0x561e0182e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:54:28.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.827+0000 7f068effd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561e0181e3d0 0x561e0182e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:50600/0 (socket says 172.21.15.46:50600) 2023-10-19T12:54:28.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.827+0000 7f068effd700 1 -- 172.21.15.46:0/1405963447 learned_addr learned my addr 172.21.15.46:0/1405963447 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:54:28.832 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.828+0000 7f068e7fc700 1 --2- 172.21.15.46:0/1405963447 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561e0181da90 0x561e0180a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:54:28.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.828+0000 7f068effd700 1 -- 172.21.15.46:0/1405963447 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561e0181da90 msgr2=0x561e0180a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:54:28.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.828+0000 7f068effd700 1 --2- 172.21.15.46:0/1405963447 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561e0181da90 0x561e0180a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:54:28.834 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.828+0000 7f068effd700 1 -- 172.21.15.46:0/1405963447 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561e0181ed90 msgr2=0x561e0180f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:54:28.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.828+0000 7f068effd700 1 --2- 172.21.15.46:0/1405963447 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561e0181ed90 0x561e0180f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:54:28.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.828+0000 7f068effd700 1 -- 172.21.15.46:0/1405963447 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561e0157bc60 con 0x561e0181e3d0 2023-10-19T12:54:28.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.828+0000 7f068effd700 1 --2- 172.21.15.46:0/1405963447 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561e0181e3d0 0x561e0182e850 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0684006010 tx=0x7f0684009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=51f46cb04447172f server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:54:28.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.829+0000 7f06767fc700 1 -- 172.21.15.46:0/1405963447 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f068401d040 con 0x561e0181e3d0 2023-10-19T12:54:28.835 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.829+0000 7f06767fc700 1 -- 172.21.15.46:0/1405963447 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f06840058e0 con 0x561e0181e3d0 2023-10-19T12:54:28.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.829+0000 7f06767fc700 1 -- 172.21.15.46:0/1405963447 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0684003b70 con 0x561e0181e3d0 2023-10-19T12:54:28.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.830+0000 7f06a939db80 1 -- 172.21.15.46:0/1405963447 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561e0181e3d0 msgr2=0x561e0182e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:54:28.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.830+0000 7f06a939db80 1 --2- 172.21.15.46:0/1405963447 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561e0181e3d0 0x561e0182e850 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0684006010 tx=0x7f0684009f90 comp rx=0 tx=0).stop 2023-10-19T12:54:28.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.830+0000 7f06a939db80 1 -- 172.21.15.46:0/1405963447 shutdown_connections 2023-10-19T12:54:28.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.830+0000 7f06a939db80 1 --2- 172.21.15.46:0/1405963447 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561e0181ed90 0x561e0180f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:54:28.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.830+0000 7f06a939db80 1 --2- 172.21.15.46:0/1405963447 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561e0181da90 0x561e0180a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:54:28.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.830+0000 7f06a939db80 1 --2- 172.21.15.46:0/1405963447 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561e0181e3d0 0x561e0182e850 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:54:28.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.830+0000 7f06a939db80 1 -- 172.21.15.46:0/1405963447 >> 172.21.15.46:0/1405963447 conn(0x561e01789720 msgr2=0x561e0181f170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:54:28.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.830+0000 7f06a939db80 1 -- 172.21.15.46:0/1405963447 shutdown_connections 2023-10-19T12:54:28.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.830+0000 7f06a939db80 1 -- 172.21.15.46:0/1405963447 wait complete. 2023-10-19T12:54:28.838 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.831+0000 7f06a939db80 1 -- start start 2023-10-19T12:54:28.838 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.831+0000 7f06a939db80 1 Processor -- start 2023-10-19T12:54:28.839 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:54:28 smithi157 ceph-mon[134109]: pgmap v682: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 5.6 MiB/s wr, 564 op/s 2023-10-19T12:54:28.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.832+0000 7f06a939db80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561e0181da90 0x561e0182acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:54:28.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.832+0000 7f06a939db80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561e0181e3d0 0x561e0182b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:54:28.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.832+0000 7f06a939db80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561e0181ed90 0x561e0182de30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:54:28.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.832+0000 7f06a939db80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e0182e370 con 0x561e0181e3d0 2023-10-19T12:54:28.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.832+0000 7f06a939db80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e0182e4b0 con 0x561e0181ed90 2023-10-19T12:54:28.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.832+0000 7f06a939db80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e0182e670 con 0x561e0181da90 2023-10-19T12:54:28.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.832+0000 7f06a939db80 10 client.0 _ll_register_callbacks cb 0x561e0164ea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:54:28.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.832+0000 7f068e7fc700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561e0181da90 0x561e0182acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:54:28.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.832+0000 7f068e7fc700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561e0181da90 0x561e0182acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:50608/0 (socket says 172.21.15.46:50608) 2023-10-19T12:54:28.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.832+0000 7f068e7fc700 1 -- 172.21.15.46:0/2066693357 learned_addr learned my addr 172.21.15.46:0/2066693357 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:54:28.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.832+0000 7f068e7fc700 1 --2- 172.21.15.46:0/2066693357 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561e0181ed90 0x561e0182de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:54:28.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.833+0000 7f068e7fc700 1 -- 172.21.15.46:0/2066693357 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561e0181da90 msgr2=0x561e0182acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:54:28.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.833+0000 7f068e7fc700 1 --2- 172.21.15.46:0/2066693357 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561e0181da90 0x561e0182acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:54:28.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.833+0000 7f068e7fc700 1 -- 172.21.15.46:0/2066693357 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561e0181e3d0 msgr2=0x561e0182b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:54:28.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.833+0000 7f068e7fc700 1 --2- 172.21.15.46:0/2066693357 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561e0181e3d0 0x561e0182b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:54:28.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.833+0000 7f068e7fc700 1 -- 172.21.15.46:0/2066693357 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561e01592de0 con 0x561e0181ed90 2023-10-19T12:54:28.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.834+0000 7f066effd700 10 client.0 ms_handle_connect on v2:172.21.15.157:3300/0 2023-10-19T12:54:28.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.834+0000 7f068e7fc700 1 --2- 172.21.15.46:0/2066693357 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561e0181ed90 0x561e0182de30 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0680009300 tx=0x7f0680008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=955dc463289bd25f server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:54:28.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.834+0000 7f066effd700 1 -- 172.21.15.46:0/2066693357 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06800179c0 con 0x561e0181ed90 2023-10-19T12:54:28.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.834+0000 7f066effd700 1 -- 172.21.15.46:0/2066693357 <== mon.2 v2:172.21.15.157:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f0680011040 con 0x561e0181ed90 2023-10-19T12:54:28.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.834+0000 7f06a939db80 1 -- 172.21.15.46:0/2066693357 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f068401e040 con 0x561e0181ed90 2023-10-19T12:54:28.846 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.834+0000 7f066effd700 1 -- 172.21.15.46:0/2066693357 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7f06800179c0 con 0x561e0181ed90 2023-10-19T12:54:28.846 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.835+0000 7f06a939db80 10 client.26129 fetch_fsmap learned FSMap version 50 2023-10-19T12:54:28.846 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.835+0000 7f06a939db80 1 -- 172.21.15.46:0/2066693357 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) v3 -- 0x561e015b9250 con 0x561e0181ed90 2023-10-19T12:54:28.846 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.835+0000 7f066effd700 1 -- 172.21.15.46:0/2066693357 <== mon.2 v2:172.21.15.157:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0680030030 con 0x561e0181ed90 2023-10-19T12:54:28.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.835+0000 7f066effd700 1 -- 172.21.15.46:0/2066693357 <== mon.2 v2:172.21.15.157:3300/0 5 ==== fsmap(e 50) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f068002a060 con 0x561e0181ed90 2023-10-19T12:54:28.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.835+0000 7f06a939db80 10 client.26129 fetch_fsmap finished waiting for FSMap version 50 2023-10-19T12:54:28.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.835+0000 7f06a939db80 10 client.26129 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-19T12:54:28.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.835+0000 7f06a939db80 20 client.26129 populate_metadata read hostname 'smithi046' 2023-10-19T12:54:28.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.835+0000 7f06a939db80 1 --2- 172.21.15.46:0/2066693357 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x561e0181a400 0x561e0181c820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:54:28.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.836+0000 7f068effd700 1 --2- 172.21.15.46:0/2066693357 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x561e0181a400 0x561e0181c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:54:28.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.835+0000 7f06a939db80 4 client.26129 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-19T12:54:28.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.836+0000 7f06a939db80 1 -- 172.21.15.46:0/2066693357 --> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x7f068401e040 con 0x561e0181a400 2023-10-19T12:54:28.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.836+0000 7f066effd700 10 client.26129 ms_handle_connect on v2:172.21.15.157:6838/552718978 2023-10-19T12:54:28.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.836+0000 7f068effd700 1 --2- 172.21.15.46:0/2066693357 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x561e0181a400 0x561e0181c820 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=52be7cf0e500cc23 server_cookie=ed139ecb11f18cff in_seq=0 out_seq=0 2023-10-19T12:54:28.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.837+0000 7f066effd700 1 -- 172.21.15.46:0/2066693357 <== mds.0 v2:172.21.15.157:6838/552718978 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x7f068401e040 con 0x561e0181a400 2023-10-19T12:54:28.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.837+0000 7f066effd700 10 client.26129 handle_command_reply: tid=0 2023-10-19T12:54:28.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.837+0000 7f06a939db80 1 client.26129 shutdown 2023-10-19T12:54:28.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.837+0000 7f06a939db80 1 -- 172.21.15.46:0/2066693357 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561e0181ed90 msgr2=0x561e0182de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:54:28.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.837+0000 7f06a939db80 1 --2- 172.21.15.46:0/2066693357 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561e0181ed90 0x561e0182de30 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0680009300 tx=0x7f0680008040 comp rx=0 tx=0).stop 2023-10-19T12:54:28.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.837+0000 7f06a939db80 1 -- 172.21.15.46:0/2066693357 shutdown_connections 2023-10-19T12:54:28.850 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.837+0000 7f06a939db80 1 --2- 172.21.15.46:0/2066693357 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561e0181ed90 0x561e0182de30 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:54:28.850 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.837+0000 7f06a939db80 1 --2- 172.21.15.46:0/2066693357 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561e0181da90 0x561e0182acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:54:28.850 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.837+0000 7f06a939db80 1 --2- 172.21.15.46:0/2066693357 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x561e0181a400 0x561e0181c820 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:54:28.850 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.837+0000 7f06a939db80 1 --2- 172.21.15.46:0/2066693357 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561e0181e3d0 0x561e0182b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:54:28.850 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.837+0000 7f066effd700 0 client.26129 ms_handle_reset on v2:172.21.15.157:6838/552718978 2023-10-19T12:54:28.850 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.837+0000 7f06a939db80 1 -- 172.21.15.46:0/2066693357 >> 172.21.15.46:0/2066693357 conn(0x561e01789720 msgr2=0x561e0180f810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:54:28.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.838+0000 7f06a939db80 1 -- 172.21.15.46:0/2066693357 shutdown_connections 2023-10-19T12:54:28.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.838+0000 7f06a939db80 1 -- 172.21.15.46:0/2066693357 wait complete. 2023-10-19T12:54:28.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.838+0000 7f06a939db80 20 client.26129 trim_cache size 0 max 16384 2023-10-19T12:54:28.852 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-10-19T12:54:28.852 INFO:teuthology.orchestra.run.smithi046.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-19T12:54:28.852 INFO:teuthology.orchestra.run.smithi046.stdout: "scrubs": { 2023-10-19T12:54:28.852 INFO:teuthology.orchestra.run.smithi046.stdout: "21e73f70-af16-4ae7-bc34-e6c54ba8e1ec": { 2023-10-19T12:54:28.852 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2023-10-19T12:54:28.853 INFO:teuthology.orchestra.run.smithi046.stdout: "tag": "21e73f70-af16-4ae7-bc34-e6c54ba8e1ec", 2023-10-19T12:54:28.853 INFO:teuthology.orchestra.run.smithi046.stdout: "options": "recursive,force" 2023-10-19T12:54:28.853 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:54:28.853 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:54:28.853 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-10-19T12:54:28.854 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.839+0000 7f06959ff700 1 -- 172.21.15.46:0/3534712355 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f06780a1500 msgr2=0x7f06780a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:54:28.854 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.839+0000 7f06959ff700 1 --2- 172.21.15.46:0/3534712355 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f06780a1500 0x7f06780a39c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f0688007fd0 tx=0x7f0688009ee0 comp rx=0 tx=0).stop 2023-10-19T12:54:28.854 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.841+0000 7f06959ff700 1 -- 172.21.15.46:0/3534712355 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0690108670 msgr2=0x7f069019fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:54:28.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.841+0000 7f06959ff700 1 --2- 172.21.15.46:0/3534712355 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0690108670 0x7f069019fef0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0688007ee0 tx=0x7f068800d3b0 comp rx=0 tx=0).stop 2023-10-19T12:54:28.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.841+0000 7f06959ff700 1 -- 172.21.15.46:0/3534712355 shutdown_connections 2023-10-19T12:54:28.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.841+0000 7f06959ff700 1 --2- 172.21.15.46:0/3534712355 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0690108670 0x7f069019fef0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:54:28.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.841+0000 7f06959ff700 1 --2- 172.21.15.46:0/3534712355 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06900731f0 0x7f0690198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:54:28.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.841+0000 7f06959ff700 1 --2- 172.21.15.46:0/3534712355 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f06780a1500 0x7f06780a39c0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:54:28.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.841+0000 7f06959ff700 1 --2- 172.21.15.46:0/3534712355 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f06900747d0 0x7f0690198ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:54:28.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.841+0000 7f06959ff700 1 -- 172.21.15.46:0/3534712355 >> 172.21.15.46:0/3534712355 conn(0x7f06900fbcf0 msgr2=0x7f06901045c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:54:28.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.841+0000 7f06959ff700 1 -- 172.21.15.46:0/3534712355 shutdown_connections 2023-10-19T12:54:28.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:28.841+0000 7f06959ff700 1 -- 172.21.15.46:0/3534712355 wait complete. 2023-10-19T12:54:28.879 INFO:tasks.cephfs.filesystem:scrub status for tag:21e73f70-af16-4ae7-bc34-e6c54ba8e1ec - {'path': '/', 'tag': '21e73f70-af16-4ae7-bc34-e6c54ba8e1ec', 'options': 'recursive,force'} 2023-10-19T12:54:28.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:54:28 smithi195 ceph-mon[134493]: pgmap v682: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 5.6 MiB/s wr, 564 op/s 2023-10-19T12:54:30.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:54:29 smithi157 ceph-mon[134109]: pgmap v683: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 5.2 MiB/s wr, 506 op/s 2023-10-19T12:54:30.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:54:29 smithi195 ceph-mon[134493]: pgmap v683: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 5.2 MiB/s wr, 506 op/s 2023-10-19T12:54:30.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:54:29 smithi046 ceph-mon[98509]: pgmap v683: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 5.2 MiB/s wr, 506 op/s 2023-10-19T12:54:31.702 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 630.0 s, 513.4 tps, lat 206.384 ms stddev 245.159 2023-10-19T12:54:32.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:54:32 smithi157 ceph-mon[134109]: pgmap v684: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 4.6 MiB/s wr, 478 op/s 2023-10-19T12:54:32.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:54:32 smithi195 ceph-mon[134493]: pgmap v684: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 4.6 MiB/s wr, 478 op/s 2023-10-19T12:54:32.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:54:32 smithi046 ceph-mon[98509]: pgmap v684: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 4.6 MiB/s wr, 478 op/s 2023-10-19T12:54:34.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:54:34 smithi157 ceph-mon[134109]: pgmap v685: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 4.5 MiB/s wr, 457 op/s 2023-10-19T12:54:34.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:54:34 smithi195 ceph-mon[134493]: pgmap v685: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 4.5 MiB/s wr, 457 op/s 2023-10-19T12:54:34.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:54:34 smithi046 ceph-mon[98509]: pgmap v685: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 4.5 MiB/s wr, 457 op/s 2023-10-19T12:54:36.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:54:36 smithi195 ceph-mon[134493]: pgmap v686: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 4.2 MiB/s wr, 423 op/s 2023-10-19T12:54:36.482 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:54:36 smithi046 ceph-mon[98509]: pgmap v686: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 4.2 MiB/s wr, 423 op/s 2023-10-19T12:54:36.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:54:36 smithi157 ceph-mon[134109]: pgmap v686: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 4.2 MiB/s wr, 423 op/s 2023-10-19T12:54:36.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 635.0 s, 575.8 tps, lat 162.913 ms stddev 213.965 2023-10-19T12:54:38.384 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:54:38 smithi195 ceph-mon[134493]: pgmap v687: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 4.7 MiB/s wr, 478 op/s 2023-10-19T12:54:38.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:54:38 smithi046 ceph-mon[98509]: pgmap v687: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 4.7 MiB/s wr, 478 op/s 2023-10-19T12:54:38.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:54:38 smithi157 ceph-mon[134109]: pgmap v687: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 4.7 MiB/s wr, 478 op/s 2023-10-19T12:54:40.095 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:54:39 smithi157 ceph-mon[134109]: pgmap v688: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 4.4 MiB/s wr, 468 op/s 2023-10-19T12:54:40.133 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:54:39 smithi195 ceph-mon[134493]: pgmap v688: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 4.4 MiB/s wr, 468 op/s 2023-10-19T12:54:40.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:54:39 smithi046 ceph-mon[98509]: pgmap v688: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 4.4 MiB/s wr, 468 op/s 2023-10-19T12:54:41.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 640.0 s, 420.2 tps, lat 246.585 ms stddev 280.881 2023-10-19T12:54:42.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:54:42 smithi157 ceph-mon[134109]: pgmap v689: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 4.7 MiB/s wr, 482 op/s 2023-10-19T12:54:42.385 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:54:42 smithi195 ceph-mon[134493]: pgmap v689: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 4.7 MiB/s wr, 482 op/s 2023-10-19T12:54:42.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:54:42 smithi046 ceph-mon[98509]: pgmap v689: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 4.7 MiB/s wr, 482 op/s 2023-10-19T12:54:44.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:54:44 smithi157 ceph-mon[134109]: pgmap v690: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 4.4 MiB/s wr, 445 op/s 2023-10-19T12:54:44.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:54:44 smithi195 ceph-mon[134493]: pgmap v690: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 4.4 MiB/s wr, 445 op/s 2023-10-19T12:54:44.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:54:44 smithi046 ceph-mon[98509]: pgmap v690: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 4.4 MiB/s wr, 445 op/s 2023-10-19T12:54:46.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:54:46 smithi157 ceph-mon[134109]: pgmap v691: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 4.6 MiB/s wr, 440 op/s 2023-10-19T12:54:46.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:54:46 smithi195 ceph-mon[134493]: pgmap v691: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 4.6 MiB/s wr, 440 op/s 2023-10-19T12:54:46.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:54:46 smithi046 ceph-mon[98509]: pgmap v691: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 4.6 MiB/s wr, 440 op/s 2023-10-19T12:54:46.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 645.0 s, 753.6 tps, lat 131.761 ms stddev 165.915 2023-10-19T12:54:48.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:54:48 smithi195 ceph-mon[134493]: pgmap v692: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 4.6 MiB/s wr, 474 op/s 2023-10-19T12:54:48.482 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:54:48 smithi046 ceph-mon[98509]: pgmap v692: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 4.6 MiB/s wr, 474 op/s 2023-10-19T12:54:48.591 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:54:48 smithi157 ceph-mon[134109]: pgmap v692: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 4.6 MiB/s wr, 474 op/s 2023-10-19T12:54:50.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:54:49 smithi157 ceph-mon[134109]: pgmap v693: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 4.5 MiB/s wr, 474 op/s 2023-10-19T12:54:50.139 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:54:49 smithi195 ceph-mon[134493]: pgmap v693: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 4.5 MiB/s wr, 474 op/s 2023-10-19T12:54:50.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:54:49 smithi046 ceph-mon[98509]: pgmap v693: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 4.5 MiB/s wr, 474 op/s 2023-10-19T12:54:51.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 650.0 s, 476.6 tps, lat 210.406 ms stddev 235.453 2023-10-19T12:54:52.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:54:52 smithi157 ceph-mon[134109]: pgmap v694: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 5.1 MiB/s wr, 493 op/s 2023-10-19T12:54:52.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:54:52 smithi195 ceph-mon[134493]: pgmap v694: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 5.1 MiB/s wr, 493 op/s 2023-10-19T12:54:52.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:54:52 smithi046 ceph-mon[98509]: pgmap v694: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 5.1 MiB/s wr, 493 op/s 2023-10-19T12:54:54.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:54:54 smithi195 ceph-mon[134493]: pgmap v695: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 4.4 MiB/s wr, 447 op/s 2023-10-19T12:54:54.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:54:54 smithi046 ceph-mon[98509]: pgmap v695: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 4.4 MiB/s wr, 447 op/s 2023-10-19T12:54:54.595 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:54:54 smithi157 ceph-mon[134109]: pgmap v695: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 4.4 MiB/s wr, 447 op/s 2023-10-19T12:54:56.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:54:56 smithi195 ceph-mon[134493]: pgmap v696: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 4.6 MiB/s wr, 473 op/s 2023-10-19T12:54:56.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:54:56 smithi046 ceph-mon[98509]: pgmap v696: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 4.6 MiB/s wr, 473 op/s 2023-10-19T12:54:56.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:54:56 smithi157 ceph-mon[134109]: pgmap v696: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 4.6 MiB/s wr, 473 op/s 2023-10-19T12:54:56.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 655.0 s, 631.4 tps, lat 163.383 ms stddev 201.782 2023-10-19T12:54:58.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:54:58 smithi195 ceph-mon[134493]: pgmap v697: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 5.1 MiB/s wr, 517 op/s 2023-10-19T12:54:58.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:54:58 smithi046 ceph-mon[98509]: pgmap v697: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 5.1 MiB/s wr, 517 op/s 2023-10-19T12:54:58.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:54:58 smithi157 ceph-mon[134109]: pgmap v697: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 5.1 MiB/s wr, 517 op/s 2023-10-19T12:54:58.880 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-19T12:54:59.314 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.310+0000 7f22be5ff700 1 -- 172.21.15.46:0/2931988874 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f22b81007a0 msgr2=0x7f22b8100bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:54:59.314 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.310+0000 7f22be5ff700 1 --2- 172.21.15.46:0/2931988874 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f22b81007a0 0x7f22b8100bc0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f22a8009920 tx=0x7f22a8009c30 comp rx=0 tx=0).stop 2023-10-19T12:54:59.315 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.312+0000 7f22be5ff700 1 -- 172.21.15.46:0/2931988874 shutdown_connections 2023-10-19T12:54:59.315 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.312+0000 7f22be5ff700 1 --2- 172.21.15.46:0/2931988874 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f22b8102330 0x7f22b8108be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:54:59.315 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.312+0000 7f22be5ff700 1 --2- 172.21.15.46:0/2931988874 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f22b81007a0 0x7f22b8100bc0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:54:59.315 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.312+0000 7f22be5ff700 1 --2- 172.21.15.46:0/2931988874 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f22b8101990 0x7f22b8101df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:54:59.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.312+0000 7f22be5ff700 1 -- 172.21.15.46:0/2931988874 >> 172.21.15.46:0/2931988874 conn(0x7f22b80fbcf0 msgr2=0x7f22b80fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:54:59.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.314+0000 7f22be5ff700 1 -- 172.21.15.46:0/2931988874 shutdown_connections 2023-10-19T12:54:59.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.314+0000 7f22be5ff700 1 -- 172.21.15.46:0/2931988874 wait complete. 2023-10-19T12:54:59.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.317+0000 7f22be5ff700 1 Processor -- start 2023-10-19T12:54:59.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.318+0000 7f22be5ff700 1 -- start start 2023-10-19T12:54:59.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.319+0000 7f22be5ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f22b81007a0 0x7f22b8196870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:54:59.323 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.319+0000 7f22be5ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f22b8101990 0x7f22b8196db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:54:59.323 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.319+0000 7f22be5ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f22b8102330 0x7f22b819dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:54:59.323 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.319+0000 7f22be5ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b819e350 con 0x7f22b8101990 2023-10-19T12:54:59.323 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.319+0000 7f22be5ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b819e490 con 0x7f22b8102330 2023-10-19T12:54:59.323 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.319+0000 7f22be5ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b819e620 con 0x7f22b81007a0 2023-10-19T12:54:59.324 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.320+0000 7f22b77fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f22b8101990 0x7f22b8196db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:54:59.324 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.320+0000 7f22b77fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f22b8101990 0x7f22b8196db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54066/0 (socket says 172.21.15.46:54066) 2023-10-19T12:54:59.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.320+0000 7f22b77fe700 1 -- 172.21.15.46:0/3132453297 learned_addr learned my addr 172.21.15.46:0/3132453297 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:54:59.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.321+0000 7f22b77fe700 1 -- 172.21.15.46:0/3132453297 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f22b81007a0 msgr2=0x7f22b8196870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:54:59.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.321+0000 7f22b77fe700 1 --2- 172.21.15.46:0/3132453297 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f22b81007a0 0x7f22b8196870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:54:59.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.321+0000 7f22b77fe700 1 -- 172.21.15.46:0/3132453297 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f22b8102330 msgr2=0x7f22b819dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:54:59.325 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.321+0000 7f22b77fe700 1 --2- 172.21.15.46:0/3132453297 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f22b8102330 0x7f22b819dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:54:59.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.321+0000 7f22b77fe700 1 -- 172.21.15.46:0/3132453297 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22a8009520 con 0x7f22b8101990 2023-10-19T12:54:59.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.321+0000 7f22b77fe700 1 --2- 172.21.15.46:0/3132453297 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f22b8101990 0x7f22b8196db0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f22ac00b530 tx=0x7f22ac00b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:54:59.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.322+0000 7f22b57fa700 1 -- 172.21.15.46:0/3132453297 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ac011830 con 0x7f22b8101990 2023-10-19T12:54:59.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.322+0000 7f22b57fa700 1 -- 172.21.15.46:0/3132453297 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f22ac011e50 con 0x7f22b8101990 2023-10-19T12:54:59.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.322+0000 7f22be5ff700 1 -- 172.21.15.46:0/3132453297 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22b819e900 con 0x7f22b8101990 2023-10-19T12:54:59.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.322+0000 7f22b57fa700 1 -- 172.21.15.46:0/3132453297 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ac00f2e0 con 0x7f22b8101990 2023-10-19T12:54:59.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.322+0000 7f22be5ff700 1 -- 172.21.15.46:0/3132453297 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22b8072c00 con 0x7f22b8101990 2023-10-19T12:54:59.341 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.338+0000 7f22d2011b80 1 Processor -- start 2023-10-19T12:54:59.341 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.338+0000 7f22d2011b80 1 -- start start 2023-10-19T12:54:59.342 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.339+0000 7f22b57fa700 1 -- 172.21.15.46:0/3132453297 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f22ac010580 con 0x7f22b8101990 2023-10-19T12:54:59.342 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.339+0000 7f22d2011b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560acd67c2d0 0x560acd67c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:54:59.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.339+0000 7f22d2011b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560acd67cc30 0x560acd67b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:54:59.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.339+0000 7f22d2011b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560acd67b5d0 0x560acd67ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:54:59.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.340+0000 7f22bcb9c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560acd67c2d0 0x560acd67c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:54:59.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.340+0000 7f22bcb9c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560acd67c2d0 0x560acd67c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:52818/0 (socket says 172.21.15.46:52818) 2023-10-19T12:54:59.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.340+0000 7f22d2011b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x560acd5ee6e0 con 0x560acd67b5d0 2023-10-19T12:54:59.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.340+0000 7f22d2011b80 1 -- 172.21.15.46:0/380519499 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x560acd5d4c60 con 0x560acd67cc30 2023-10-19T12:54:59.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.340+0000 7f22bcb9c700 1 -- 172.21.15.46:0/380519499 learned_addr learned my addr 172.21.15.46:0/380519499 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:54:59.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.340+0000 7f22d2011b80 1 -- 172.21.15.46:0/380519499 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x560acd5d2580 con 0x560acd67c2d0 2023-10-19T12:54:59.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.340+0000 7f22b7fff700 1 --2- 172.21.15.46:0/380519499 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560acd67cc30 0x560acd67b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:54:59.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.340+0000 7f22b7fff700 1 -- 172.21.15.46:0/380519499 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560acd67c2d0 msgr2=0x560acd67c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:54:59.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.340+0000 7f22b7fff700 1 --2- 172.21.15.46:0/380519499 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560acd67c2d0 0x560acd67c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:54:59.346 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.340+0000 7f22b7fff700 1 -- 172.21.15.46:0/380519499 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560acd67b5d0 msgr2=0x560acd67ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:54:59.347 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.340+0000 7f22b7fff700 1 --2- 172.21.15.46:0/380519499 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560acd67b5d0 0x560acd67ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:54:59.347 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.340+0000 7f22b7fff700 1 -- 172.21.15.46:0/380519499 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560acd58b3f0 con 0x560acd67cc30 2023-10-19T12:54:59.347 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.340+0000 7f22bcb9c700 1 --2- 172.21.15.46:0/380519499 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560acd67c2d0 0x560acd67c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:54:59.347 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.342+0000 7f22b57fa700 1 --2- 172.21.15.46:0/3132453297 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f22a00a5960 0x7f22a00a7e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:54:59.347 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.343+0000 7f22b57fa700 1 -- 172.21.15.46:0/3132453297 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f22ac0ccb80 con 0x7f22b8101990 2023-10-19T12:54:59.348 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.343+0000 7f22bcb9c700 1 --2- 172.21.15.46:0/3132453297 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f22a00a5960 0x7f22a00a7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:54:59.348 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.343+0000 7f22b7fff700 1 --2- 172.21.15.46:0/380519499 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560acd67cc30 0x560acd67b090 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f22a8009920 tx=0x7f22a8009400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed005f11b2c534cc server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:54:59.348 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.343+0000 7f229e7fc700 1 -- 172.21.15.46:0/380519499 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a801c070 con 0x560acd67cc30 2023-10-19T12:54:59.348 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.343+0000 7f229e7fc700 1 -- 172.21.15.46:0/380519499 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f22a800f920 con 0x560acd67cc30 2023-10-19T12:54:59.348 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.343+0000 7f229e7fc700 1 -- 172.21.15.46:0/380519499 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a800bb50 con 0x560acd67cc30 2023-10-19T12:54:59.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.344+0000 7f22d2011b80 1 -- 172.21.15.46:0/380519499 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560acd67cc30 msgr2=0x560acd67b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:54:59.350 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.344+0000 7f22d2011b80 1 --2- 172.21.15.46:0/380519499 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560acd67cc30 0x560acd67b090 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f22a8009920 tx=0x7f22a8009400 comp rx=0 tx=0).stop 2023-10-19T12:54:59.350 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.344+0000 7f22bcb9c700 1 --2- 172.21.15.46:0/3132453297 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f22a00a5960 0x7f22a00a7e20 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f22b00060b0 tx=0x7f22b0009040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:54:59.350 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.345+0000 7f22d2011b80 1 -- 172.21.15.46:0/380519499 shutdown_connections 2023-10-19T12:54:59.350 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.345+0000 7f22d2011b80 1 --2- 172.21.15.46:0/380519499 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560acd67b5d0 0x560acd67ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:54:59.351 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.345+0000 7f22d2011b80 1 --2- 172.21.15.46:0/380519499 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560acd67c2d0 0x560acd67c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:54:59.351 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.345+0000 7f22d2011b80 1 --2- 172.21.15.46:0/380519499 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560acd67cc30 0x560acd67b090 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:54:59.351 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.345+0000 7f22d2011b80 1 -- 172.21.15.46:0/380519499 >> 172.21.15.46:0/380519499 conn(0x560acd5ef720 msgr2=0x560acd675b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:54:59.351 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.345+0000 7f22d2011b80 1 -- 172.21.15.46:0/380519499 shutdown_connections 2023-10-19T12:54:59.351 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.345+0000 7f22d2011b80 1 -- 172.21.15.46:0/380519499 wait complete. 2023-10-19T12:54:59.352 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.346+0000 7f22d2011b80 1 -- start start 2023-10-19T12:54:59.352 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.346+0000 7f22d2011b80 1 Processor -- start 2023-10-19T12:54:59.353 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.347+0000 7f22d2011b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560acd67b5d0 0x560acd684a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:54:59.353 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.347+0000 7f22d2011b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560acd67c2d0 0x560acd684f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:54:59.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.347+0000 7f22d2011b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560acd67cc30 0x560acd68bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:54:59.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.347+0000 7f22d2011b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x560acd5cde70 con 0x560acd67cc30 2023-10-19T12:54:59.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.347+0000 7f22d2011b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x560acd56a710 con 0x560acd67b5d0 2023-10-19T12:54:59.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.347+0000 7f22d2011b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x560acd56a3b0 con 0x560acd67c2d0 2023-10-19T12:54:59.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.347+0000 7f22d2011b80 10 client.0 _ll_register_callbacks cb 0x560acd4b4a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:54:59.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.348+0000 7f22b77fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560acd67c2d0 0x560acd684f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:54:59.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.348+0000 7f22b7fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560acd67b5d0 0x560acd684a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:54:59.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.348+0000 7f22b77fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560acd67c2d0 0x560acd684f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:52834/0 (socket says 172.21.15.46:52834) 2023-10-19T12:54:59.355 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.348+0000 7f22b77fe700 1 -- 172.21.15.46:0/2431331551 learned_addr learned my addr 172.21.15.46:0/2431331551 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:54:59.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.348+0000 7f22b7fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560acd67b5d0 0x560acd684a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:36882/0 (socket says 172.21.15.46:36882) 2023-10-19T12:54:59.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.349+0000 7f22b77fe700 1 -- 172.21.15.46:0/2431331551 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560acd67b5d0 msgr2=0x560acd684a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:54:59.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.349+0000 7f22b77fe700 1 --2- 172.21.15.46:0/2431331551 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560acd67b5d0 0x560acd684a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:54:59.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.349+0000 7f22b77fe700 1 -- 172.21.15.46:0/2431331551 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560acd67cc30 msgr2=0x560acd68bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:54:59.356 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.349+0000 7f22b77fe700 1 --2- 172.21.15.46:0/2431331551 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560acd67cc30 0x560acd68bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:54:59.357 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.349+0000 7f22b77fe700 1 -- 172.21.15.46:0/2431331551 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22b00098a0 con 0x560acd67c2d0 2023-10-19T12:54:59.357 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.349+0000 7f22b77fe700 1 --2- 172.21.15.46:0/2431331551 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560acd67c2d0 0x560acd684f90 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f22ac096540 tx=0x7f22ac0994b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=571047067f0e3b48 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:54:59.357 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.349+0000 7f22977fe700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-10-19T12:54:59.357 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.349+0000 7f22977fe700 1 -- 172.21.15.46:0/2431331551 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ac099ad0 con 0x560acd67c2d0 2023-10-19T12:54:59.357 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.349+0000 7f22977fe700 1 -- 172.21.15.46:0/2431331551 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f22ac09dc20 con 0x560acd67c2d0 2023-10-19T12:54:59.357 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.350+0000 7f22d2011b80 1 -- 172.21.15.46:0/2431331551 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560acd5d2ef0 con 0x560acd67c2d0 2023-10-19T12:54:59.358 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.350+0000 7f22977fe700 1 -- 172.21.15.46:0/2431331551 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7f22ac0a1e60 con 0x560acd67c2d0 2023-10-19T12:54:59.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.351+0000 7f22d2011b80 10 client.26155 fetch_fsmap learned FSMap version 50 2023-10-19T12:54:59.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.351+0000 7f22d2011b80 1 -- 172.21.15.46:0/2431331551 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) v3 -- 0x7f22b8109530 con 0x560acd67c2d0 2023-10-19T12:54:59.359 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.351+0000 7f22977fe700 1 -- 172.21.15.46:0/2431331551 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x560acd5d2ef0 con 0x560acd67c2d0 2023-10-19T12:54:59.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.351+0000 7f22977fe700 1 -- 172.21.15.46:0/2431331551 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 50) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f22ac098fc0 con 0x560acd67c2d0 2023-10-19T12:54:59.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.351+0000 7f22d2011b80 10 client.26155 fetch_fsmap finished waiting for FSMap version 50 2023-10-19T12:54:59.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.351+0000 7f22d2011b80 10 client.26155 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-19T12:54:59.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.352+0000 7f22d2011b80 20 client.26155 populate_metadata read hostname 'smithi046' 2023-10-19T12:54:59.360 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.352+0000 7f22d2011b80 1 --2- 172.21.15.46:0/2431331551 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x560acd699150 0x560acd69b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:54:59.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.352+0000 7f22d2011b80 4 client.26155 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-19T12:54:59.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.352+0000 7f22d2011b80 1 -- 172.21.15.46:0/2431331551 --> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560acd64a8b0 con 0x560acd699150 2023-10-19T12:54:59.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.352+0000 7f22b7fff700 1 --2- 172.21.15.46:0/2431331551 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x560acd699150 0x560acd69b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:54:59.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.354+0000 7f22b7fff700 1 --2- 172.21.15.46:0/2431331551 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x560acd699150 0x560acd69b570 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=942d7cdc9c0d50c6 server_cookie=e841e0acd90a0b9 in_seq=0 out_seq=0 2023-10-19T12:54:59.361 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.354+0000 7f22977fe700 10 client.26155 ms_handle_connect on v2:172.21.15.157:6838/552718978 2023-10-19T12:54:59.362 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.355+0000 7f22977fe700 1 -- 172.21.15.46:0/2431331551 <== mds.0 v2:172.21.15.157:6838/552718978 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x560acd64a8b0 con 0x560acd699150 2023-10-19T12:54:59.363 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.356+0000 7f22977fe700 10 client.26155 handle_command_reply: tid=0 2023-10-19T12:54:59.363 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.357+0000 7f22d2011b80 1 client.26155 shutdown 2023-10-19T12:54:59.363 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.358+0000 7f22d2011b80 1 -- 172.21.15.46:0/2431331551 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560acd67c2d0 msgr2=0x560acd684f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:54:59.363 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.358+0000 7f22d2011b80 1 --2- 172.21.15.46:0/2431331551 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560acd67c2d0 0x560acd684f90 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f22ac096540 tx=0x7f22ac0994b0 comp rx=0 tx=0).stop 2023-10-19T12:54:59.364 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.359+0000 7f22d2011b80 1 -- 172.21.15.46:0/2431331551 shutdown_connections 2023-10-19T12:54:59.364 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.359+0000 7f22d2011b80 1 --2- 172.21.15.46:0/2431331551 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x560acd699150 0x560acd69b570 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:54:59.364 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.359+0000 7f22d2011b80 1 --2- 172.21.15.46:0/2431331551 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560acd67cc30 0x560acd68bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:54:59.364 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.359+0000 7f22d2011b80 1 --2- 172.21.15.46:0/2431331551 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560acd67b5d0 0x560acd684a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:54:59.364 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.359+0000 7f22d2011b80 1 --2- 172.21.15.46:0/2431331551 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560acd67c2d0 0x560acd684f90 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:54:59.365 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.359+0000 7f22d2011b80 1 -- 172.21.15.46:0/2431331551 >> 172.21.15.46:0/2431331551 conn(0x560acd5ef720 msgr2=0x560acd67a080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:54:59.365 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.359+0000 7f22977fe700 0 client.26155 ms_handle_reset on v2:172.21.15.157:6838/552718978 2023-10-19T12:54:59.365 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.360+0000 7f22d2011b80 1 -- 172.21.15.46:0/2431331551 shutdown_connections 2023-10-19T12:54:59.366 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.361+0000 7f22d2011b80 1 -- 172.21.15.46:0/2431331551 wait complete. 2023-10-19T12:54:59.366 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.361+0000 7f22d2011b80 20 client.26155 trim_cache size 0 max 16384 2023-10-19T12:54:59.419 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.415+0000 7f22d2011b80 1 Processor -- start 2023-10-19T12:54:59.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.416+0000 7f22d2011b80 1 -- start start 2023-10-19T12:54:59.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.416+0000 7f22d2011b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560acd67b5d0 0x560acd6705d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:54:59.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.416+0000 7f22d2011b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560acd67c2d0 0x560acd68bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:54:59.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.416+0000 7f22d2011b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560acd67cc30 0x560acd675b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:54:59.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.416+0000 7f22d2011b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x560acd44e920 con 0x560acd67c2d0 2023-10-19T12:54:59.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.416+0000 7f22d2011b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x560acd676a30 con 0x560acd67b5d0 2023-10-19T12:54:59.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.416+0000 7f22d2011b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x560acd683540 con 0x560acd67cc30 2023-10-19T12:54:59.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.417+0000 7f22bcb9c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560acd67cc30 0x560acd675b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:54:59.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.417+0000 7f22b77fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560acd67c2d0 0x560acd68bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:54:59.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.417+0000 7f22bcb9c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560acd67cc30 0x560acd675b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:52850/0 (socket says 172.21.15.46:52850) 2023-10-19T12:54:59.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.417+0000 7f22bcb9c700 1 -- 172.21.15.46:0/3103316208 learned_addr learned my addr 172.21.15.46:0/3103316208 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:54:59.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.417+0000 7f22b77fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560acd67c2d0 0x560acd68bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54084/0 (socket says 172.21.15.46:54084) 2023-10-19T12:54:59.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.417+0000 7f22b7fff700 1 --2- 172.21.15.46:0/3103316208 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560acd67b5d0 0x560acd6705d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:54:59.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.418+0000 7f22b77fe700 1 -- 172.21.15.46:0/3103316208 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560acd67cc30 msgr2=0x560acd675b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:54:59.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.418+0000 7f22b77fe700 1 --2- 172.21.15.46:0/3103316208 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560acd67cc30 0x560acd675b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:54:59.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.418+0000 7f22b77fe700 1 -- 172.21.15.46:0/3103316208 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560acd67b5d0 msgr2=0x560acd6705d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:54:59.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.418+0000 7f22b77fe700 1 --2- 172.21.15.46:0/3103316208 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560acd67b5d0 0x560acd6705d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:54:59.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.418+0000 7f22b77fe700 1 -- 172.21.15.46:0/3103316208 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560acd3f8de0 con 0x560acd67c2d0 2023-10-19T12:54:59.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.419+0000 7f22b77fe700 1 --2- 172.21.15.46:0/3103316208 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560acd67c2d0 0x560acd68bf90 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f22ac0997d0 tx=0x7f22ac098080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c77f4bc7ceb8f9e server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:54:59.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.420+0000 7f229effd700 1 -- 172.21.15.46:0/3103316208 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ac00d040 con 0x560acd67c2d0 2023-10-19T12:54:59.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.420+0000 7f229effd700 1 -- 172.21.15.46:0/3103316208 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f22ac0a1c60 con 0x560acd67c2d0 2023-10-19T12:54:59.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.421+0000 7f22d2011b80 1 -- 172.21.15.46:0/3103316208 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560acd67c2d0 msgr2=0x560acd68bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:54:59.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.421+0000 7f22d2011b80 1 --2- 172.21.15.46:0/3103316208 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560acd67c2d0 0x560acd68bf90 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f22ac0997d0 tx=0x7f22ac098080 comp rx=0 tx=0).stop 2023-10-19T12:54:59.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.422+0000 7f22d2011b80 1 -- 172.21.15.46:0/3103316208 shutdown_connections 2023-10-19T12:54:59.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.422+0000 7f22d2011b80 1 --2- 172.21.15.46:0/3103316208 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560acd67cc30 0x560acd675b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:54:59.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.422+0000 7f22d2011b80 1 --2- 172.21.15.46:0/3103316208 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560acd67b5d0 0x560acd6705d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:54:59.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.422+0000 7f22d2011b80 1 --2- 172.21.15.46:0/3103316208 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560acd67c2d0 0x560acd68bf90 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:54:59.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.423+0000 7f22d2011b80 1 -- 172.21.15.46:0/3103316208 >> 172.21.15.46:0/3103316208 conn(0x560acd5ef720 msgr2=0x560acd69fed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:54:59.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.423+0000 7f22d2011b80 1 -- 172.21.15.46:0/3103316208 shutdown_connections 2023-10-19T12:54:59.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.425+0000 7f22d2011b80 1 -- 172.21.15.46:0/3103316208 wait complete. 2023-10-19T12:54:59.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.426+0000 7f22d2011b80 1 -- start start 2023-10-19T12:54:59.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.427+0000 7f22d2011b80 1 Processor -- start 2023-10-19T12:54:59.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.428+0000 7f22d2011b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560acd67b5d0 0x560acd68b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:54:59.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.428+0000 7f22d2011b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560acd67c2d0 0x560acd68bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:54:59.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.428+0000 7f22d2011b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560acd67cc30 0x560acd688260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:54:59.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.428+0000 7f22d2011b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x560acd6887f0 con 0x560acd67c2d0 2023-10-19T12:54:59.435 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.428+0000 7f22bcb9c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560acd67cc30 0x560acd688260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:54:59.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.429+0000 7f22bcb9c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560acd67cc30 0x560acd688260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:36904/0 (socket says 172.21.15.46:36904) 2023-10-19T12:54:59.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.429+0000 7f22bcb9c700 1 -- 172.21.15.46:0/1423471420 learned_addr learned my addr 172.21.15.46:0/1423471420 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:54:59.436 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.429+0000 7f22b7fff700 1 --2- 172.21.15.46:0/1423471420 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560acd67b5d0 0x560acd68b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:54:59.437 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.429+0000 7f22d2011b80 1 -- 172.21.15.46:0/1423471420 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x560acd688960 con 0x560acd67cc30 2023-10-19T12:54:59.437 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.429+0000 7f22d2011b80 1 -- 172.21.15.46:0/1423471420 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x560acd688b20 con 0x560acd67b5d0 2023-10-19T12:54:59.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.429+0000 7f22b77fe700 1 --2- 172.21.15.46:0/1423471420 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560acd67c2d0 0x560acd68bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:54:59.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.429+0000 7f22d2011b80 10 client.0 _ll_register_callbacks cb 0x560acd4b4a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:54:59.438 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.429+0000 7f22bcb9c700 1 -- 172.21.15.46:0/1423471420 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560acd67b5d0 msgr2=0x560acd68b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:54:59.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.429+0000 7f22bcb9c700 1 --2- 172.21.15.46:0/1423471420 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560acd67b5d0 0x560acd68b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:54:59.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.429+0000 7f22bcb9c700 1 -- 172.21.15.46:0/1423471420 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560acd67c2d0 msgr2=0x560acd68bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:54:59.439 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.429+0000 7f22bcb9c700 1 --2- 172.21.15.46:0/1423471420 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560acd67c2d0 0x560acd68bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:54:59.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.429+0000 7f22bcb9c700 1 -- 172.21.15.46:0/1423471420 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22b8109530 con 0x560acd67cc30 2023-10-19T12:54:59.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.431+0000 7f22bcb9c700 1 --2- 172.21.15.46:0/1423471420 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560acd67cc30 0x560acd688260 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f22b0015e60 tx=0x7f22b0009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c769ec59d8937b68 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:54:59.440 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.431+0000 7f22977fe700 10 client.0 ms_handle_connect on v2:172.21.15.157:3300/0 2023-10-19T12:54:59.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.431+0000 7f22977fe700 1 -- 172.21.15.46:0/1423471420 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b0015e90 con 0x560acd67cc30 2023-10-19T12:54:59.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.431+0000 7f22977fe700 1 -- 172.21.15.46:0/1423471420 <== mon.2 v2:172.21.15.157:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f22b0016da0 con 0x560acd67cc30 2023-10-19T12:54:59.441 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.431+0000 7f22d2011b80 1 -- 172.21.15.46:0/1423471420 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f22a800f920 con 0x560acd67cc30 2023-10-19T12:54:59.442 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.431+0000 7f22977fe700 1 -- 172.21.15.46:0/1423471420 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7f22b0003a00 con 0x560acd67cc30 2023-10-19T12:54:59.442 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.432+0000 7f22d2011b80 10 client.26144 fetch_fsmap learned FSMap version 50 2023-10-19T12:54:59.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.432+0000 7f22d2011b80 1 -- 172.21.15.46:0/1423471420 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) v3 -- 0x560acd3e1c60 con 0x560acd67cc30 2023-10-19T12:54:59.443 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.432+0000 7f22977fe700 1 -- 172.21.15.46:0/1423471420 <== mon.2 v2:172.21.15.157:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f22a800f920 con 0x560acd67cc30 2023-10-19T12:54:59.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.434+0000 7f22977fe700 1 -- 172.21.15.46:0/1423471420 <== mon.2 v2:172.21.15.157:3300/0 5 ==== fsmap(e 50) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f22b0021070 con 0x560acd67cc30 2023-10-19T12:54:59.445 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.434+0000 7f22d2011b80 10 client.26144 fetch_fsmap finished waiting for FSMap version 50 2023-10-19T12:54:59.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.434+0000 7f22d2011b80 10 client.26144 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-19T12:54:59.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.434+0000 7f22d2011b80 20 client.26144 populate_metadata read hostname 'smithi046' 2023-10-19T12:54:59.446 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.434+0000 7f22d2011b80 1 --2- 172.21.15.46:0/1423471420 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x560acd691aa0 0x560acd693ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:54:59.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.434+0000 7f22d2011b80 4 client.26144 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-19T12:54:59.447 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.434+0000 7f22d2011b80 1 -- 172.21.15.46:0/1423471420 --> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x560acd5c6e50 con 0x560acd691aa0 2023-10-19T12:54:59.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.435+0000 7f22b7fff700 1 --2- 172.21.15.46:0/1423471420 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x560acd691aa0 0x560acd693ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:54:59.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.435+0000 7f22b7fff700 1 --2- 172.21.15.46:0/1423471420 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x560acd691aa0 0x560acd693ec0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=71a238b85bec8ba3 server_cookie=e75d9cbe48484861 in_seq=0 out_seq=0 2023-10-19T12:54:59.448 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.435+0000 7f22977fe700 10 client.26144 ms_handle_connect on v2:172.21.15.157:6838/552718978 2023-10-19T12:54:59.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.436+0000 7f22977fe700 1 -- 172.21.15.46:0/1423471420 <== mds.0 v2:172.21.15.157:6838/552718978 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x560acd5c6e50 con 0x560acd691aa0 2023-10-19T12:54:59.449 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.436+0000 7f22977fe700 10 client.26144 handle_command_reply: tid=0 2023-10-19T12:54:59.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.436+0000 7f22d2011b80 1 client.26144 shutdown 2023-10-19T12:54:59.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.436+0000 7f22d2011b80 1 -- 172.21.15.46:0/1423471420 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560acd67cc30 msgr2=0x560acd688260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:54:59.450 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.436+0000 7f22d2011b80 1 --2- 172.21.15.46:0/1423471420 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560acd67cc30 0x560acd688260 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f22b0015e60 tx=0x7f22b0009250 comp rx=0 tx=0).stop 2023-10-19T12:54:59.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.437+0000 7f22d2011b80 1 -- 172.21.15.46:0/1423471420 shutdown_connections 2023-10-19T12:54:59.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.437+0000 7f22d2011b80 1 --2- 172.21.15.46:0/1423471420 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x560acd67cc30 0x560acd688260 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:54:59.451 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.437+0000 7f22d2011b80 1 --2- 172.21.15.46:0/1423471420 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560acd67b5d0 0x560acd68b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:54:59.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.437+0000 7f22d2011b80 1 --2- 172.21.15.46:0/1423471420 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x560acd691aa0 0x560acd693ec0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:54:59.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.437+0000 7f22d2011b80 1 --2- 172.21.15.46:0/1423471420 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560acd67c2d0 0x560acd68bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:54:59.452 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.437+0000 7f22977fe700 0 client.26144 ms_handle_reset on v2:172.21.15.157:6838/552718978 2023-10-19T12:54:59.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.437+0000 7f22d2011b80 1 -- 172.21.15.46:0/1423471420 >> 172.21.15.46:0/1423471420 conn(0x560acd5ef720 msgr2=0x560acd675a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:54:59.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.437+0000 7f22d2011b80 1 -- 172.21.15.46:0/1423471420 shutdown_connections 2023-10-19T12:54:59.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.437+0000 7f22d2011b80 1 -- 172.21.15.46:0/1423471420 wait complete. 2023-10-19T12:54:59.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.437+0000 7f22d2011b80 20 client.26144 trim_cache size 0 max 16384 2023-10-19T12:54:59.454 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-10-19T12:54:59.455 INFO:teuthology.orchestra.run.smithi046.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-19T12:54:59.455 INFO:teuthology.orchestra.run.smithi046.stdout: "scrubs": { 2023-10-19T12:54:59.455 INFO:teuthology.orchestra.run.smithi046.stdout: "21e73f70-af16-4ae7-bc34-e6c54ba8e1ec": { 2023-10-19T12:54:59.456 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2023-10-19T12:54:59.456 INFO:teuthology.orchestra.run.smithi046.stdout: "tag": "21e73f70-af16-4ae7-bc34-e6c54ba8e1ec", 2023-10-19T12:54:59.456 INFO:teuthology.orchestra.run.smithi046.stdout: "options": "recursive,force" 2023-10-19T12:54:59.457 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:54:59.457 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:54:59.457 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-10-19T12:54:59.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.440+0000 7f22be5ff700 1 -- 172.21.15.46:0/3132453297 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f22a00a5960 msgr2=0x7f22a00a7e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:54:59.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.440+0000 7f22be5ff700 1 --2- 172.21.15.46:0/3132453297 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f22a00a5960 0x7f22a00a7e20 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f22b00060b0 tx=0x7f22b0009040 comp rx=0 tx=0).stop 2023-10-19T12:54:59.459 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.440+0000 7f22be5ff700 1 -- 172.21.15.46:0/3132453297 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f22b8101990 msgr2=0x7f22b8196db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:54:59.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.440+0000 7f22be5ff700 1 --2- 172.21.15.46:0/3132453297 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f22b8101990 0x7f22b8196db0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f22ac00b530 tx=0x7f22ac00b8f0 comp rx=0 tx=0).stop 2023-10-19T12:54:59.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.441+0000 7f22be5ff700 1 -- 172.21.15.46:0/3132453297 shutdown_connections 2023-10-19T12:54:59.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.441+0000 7f22be5ff700 1 --2- 172.21.15.46:0/3132453297 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f22b8102330 0x7f22b819dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:54:59.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.441+0000 7f22be5ff700 1 --2- 172.21.15.46:0/3132453297 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f22a00a5960 0x7f22a00a7e20 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:54:59.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.441+0000 7f22be5ff700 1 --2- 172.21.15.46:0/3132453297 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f22b81007a0 0x7f22b8196870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:54:59.461 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.441+0000 7f22be5ff700 1 --2- 172.21.15.46:0/3132453297 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f22b8101990 0x7f22b8196db0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:54:59.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.441+0000 7f22be5ff700 1 -- 172.21.15.46:0/3132453297 >> 172.21.15.46:0/3132453297 conn(0x7f22b80fbcf0 msgr2=0x7f22b8104e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:54:59.462 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.441+0000 7f22be5ff700 1 -- 172.21.15.46:0/3132453297 shutdown_connections 2023-10-19T12:54:59.463 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:54:59.441+0000 7f22be5ff700 1 -- 172.21.15.46:0/3132453297 wait complete. 2023-10-19T12:54:59.491 INFO:tasks.cephfs.filesystem:scrub status for tag:21e73f70-af16-4ae7-bc34-e6c54ba8e1ec - {'path': '/', 'tag': '21e73f70-af16-4ae7-bc34-e6c54ba8e1ec', 'options': 'recursive,force'} 2023-10-19T12:55:00.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:54:59 smithi157 ceph-mon[134109]: pgmap v698: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 5.4 MiB/s wr, 522 op/s 2023-10-19T12:55:00.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:54:59 smithi195 ceph-mon[134493]: pgmap v698: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 5.4 MiB/s wr, 522 op/s 2023-10-19T12:55:00.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:54:59 smithi046 ceph-mon[98509]: pgmap v698: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 5.4 MiB/s wr, 522 op/s 2023-10-19T12:55:01.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 660.0 s, 361.8 tps, lat 233.319 ms stddev 273.999 2023-10-19T12:55:02.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:55:02 smithi157 ceph-mon[134109]: pgmap v699: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 5.3 MiB/s wr, 494 op/s 2023-10-19T12:55:02.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:55:02 smithi195 ceph-mon[134493]: pgmap v699: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 5.3 MiB/s wr, 494 op/s 2023-10-19T12:55:02.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:55:02 smithi046 ceph-mon[98509]: pgmap v699: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 5.3 MiB/s wr, 494 op/s 2023-10-19T12:55:04.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:55:04 smithi157 ceph-mon[134109]: pgmap v700: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.2 MiB/s wr, 477 op/s 2023-10-19T12:55:04.384 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:55:04 smithi195 ceph-mon[134493]: pgmap v700: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.2 MiB/s wr, 477 op/s 2023-10-19T12:55:04.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:55:04 smithi046 ceph-mon[98509]: pgmap v700: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.2 MiB/s wr, 477 op/s 2023-10-19T12:55:06.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:55:06 smithi195 ceph-mon[134493]: pgmap v701: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.4 MiB/s wr, 583 op/s 2023-10-19T12:55:06.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:55:06 smithi046 ceph-mon[98509]: pgmap v701: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.4 MiB/s wr, 583 op/s 2023-10-19T12:55:06.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:55:06 smithi157 ceph-mon[134109]: pgmap v701: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.4 MiB/s wr, 583 op/s 2023-10-19T12:55:06.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 665.0 s, 409.0 tps, lat 272.360 ms stddev 311.476 2023-10-19T12:55:08.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:55:08 smithi046 ceph-mon[98509]: pgmap v702: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 8.3 MiB/s wr, 701 op/s 2023-10-19T12:55:08.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:55:08 smithi157 ceph-mon[134109]: pgmap v702: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 8.3 MiB/s wr, 701 op/s 2023-10-19T12:55:08.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:55:08 smithi195 ceph-mon[134493]: pgmap v702: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 8.3 MiB/s wr, 701 op/s 2023-10-19T12:55:10.089 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:55:09 smithi157 ceph-mon[134109]: pgmap v703: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.0 MiB/s wr, 662 op/s 2023-10-19T12:55:10.136 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:55:09 smithi195 ceph-mon[134493]: pgmap v703: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.0 MiB/s wr, 662 op/s 2023-10-19T12:55:10.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:55:09 smithi046 ceph-mon[98509]: pgmap v703: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.0 MiB/s wr, 662 op/s 2023-10-19T12:55:11.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 670.0 s, 427.8 tps, lat 226.960 ms stddev 251.729 2023-10-19T12:55:12.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:55:12 smithi157 ceph-mon[134109]: pgmap v704: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 8.4 MiB/s wr, 662 op/s 2023-10-19T12:55:12.382 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:55:12 smithi195 ceph-mon[134493]: pgmap v704: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 8.4 MiB/s wr, 662 op/s 2023-10-19T12:55:12.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:55:12 smithi046 ceph-mon[98509]: pgmap v704: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 8.4 MiB/s wr, 662 op/s 2023-10-19T12:55:14.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:55:14 smithi195 ceph-mon[134493]: pgmap v705: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 8.0 MiB/s wr, 629 op/s 2023-10-19T12:55:14.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:55:14 smithi046 ceph-mon[98509]: pgmap v705: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 8.0 MiB/s wr, 629 op/s 2023-10-19T12:55:14.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:55:14 smithi157 ceph-mon[134109]: pgmap v705: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 8.0 MiB/s wr, 629 op/s 2023-10-19T12:55:16.382 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:55:16 smithi195 ceph-mon[134493]: pgmap v706: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 7.4 MiB/s wr, 603 op/s 2023-10-19T12:55:16.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:55:16 smithi046 ceph-mon[98509]: pgmap v706: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 7.4 MiB/s wr, 603 op/s 2023-10-19T12:55:16.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:55:16 smithi157 ceph-mon[134109]: pgmap v706: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 7.4 MiB/s wr, 603 op/s 2023-10-19T12:55:16.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 675.0 s, 552.0 tps, lat 191.212 ms stddev 234.200 2023-10-19T12:55:18.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:55:18 smithi195 ceph-mon[134493]: pgmap v707: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 8.0 MiB/s wr, 566 op/s 2023-10-19T12:55:18.482 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:55:18 smithi046 ceph-mon[98509]: pgmap v707: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 8.0 MiB/s wr, 566 op/s 2023-10-19T12:55:18.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:55:18 smithi157 ceph-mon[134109]: pgmap v707: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 8.0 MiB/s wr, 566 op/s 2023-10-19T12:55:20.100 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:55:19 smithi157 ceph-mon[134109]: pgmap v708: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.0 MiB/s wr, 460 op/s 2023-10-19T12:55:20.136 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:55:19 smithi195 ceph-mon[134493]: pgmap v708: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.0 MiB/s wr, 460 op/s 2023-10-19T12:55:20.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:55:19 smithi046 ceph-mon[98509]: pgmap v708: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.0 MiB/s wr, 460 op/s 2023-10-19T12:55:21.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 680.0 s, 483.4 tps, lat 205.795 ms stddev 220.014 2023-10-19T12:55:22.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:55:22 smithi157 ceph-mon[134109]: pgmap v709: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 7.4 MiB/s wr, 466 op/s 2023-10-19T12:55:22.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:55:22 smithi195 ceph-mon[134493]: pgmap v709: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 7.4 MiB/s wr, 466 op/s 2023-10-19T12:55:22.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:55:22 smithi046 ceph-mon[98509]: pgmap v709: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 7.4 MiB/s wr, 466 op/s 2023-10-19T12:55:24.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:55:24 smithi157 ceph-mon[134109]: pgmap v710: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.6 MiB/s wr, 414 op/s 2023-10-19T12:55:24.388 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:55:24 smithi195 ceph-mon[134493]: pgmap v710: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.6 MiB/s wr, 414 op/s 2023-10-19T12:55:24.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:55:24 smithi046 ceph-mon[98509]: pgmap v710: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.6 MiB/s wr, 414 op/s 2023-10-19T12:55:26.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:55:26 smithi195 ceph-mon[134493]: pgmap v711: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 6.5 MiB/s wr, 430 op/s 2023-10-19T12:55:26.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:55:26 smithi046 ceph-mon[98509]: pgmap v711: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 6.5 MiB/s wr, 430 op/s 2023-10-19T12:55:26.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:55:26 smithi157 ceph-mon[134109]: pgmap v711: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 6.5 MiB/s wr, 430 op/s 2023-10-19T12:55:26.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 685.0 s, 496.8 tps, lat 198.610 ms stddev 281.480 2023-10-19T12:55:28.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:55:28 smithi195 ceph-mon[134493]: pgmap v712: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 7.4 MiB/s wr, 467 op/s 2023-10-19T12:55:28.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:55:28 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:55:28.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:55:28 smithi046 ceph-mon[98509]: pgmap v712: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 7.4 MiB/s wr, 467 op/s 2023-10-19T12:55:28.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:55:28 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:55:28.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:55:28 smithi157 ceph-mon[134109]: pgmap v712: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 7.4 MiB/s wr, 467 op/s 2023-10-19T12:55:28.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:55:28 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:55:29.492 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-19T12:55:29.865 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.862+0000 7f270dfff700 1 -- 172.21.15.46:0/3304099299 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2708100880 msgr2=0x7f2708100ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:55:29.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.862+0000 7f270dfff700 1 --2- 172.21.15.46:0/3304099299 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2708100880 0x7f2708100ce0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f26f0009990 tx=0x7f26f0009ca0 comp rx=0 tx=0).stop 2023-10-19T12:55:29.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.862+0000 7f270dfff700 1 -- 172.21.15.46:0/3304099299 shutdown_connections 2023-10-19T12:55:29.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.862+0000 7f270dfff700 1 --2- 172.21.15.46:0/3304099299 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2708101220 0x7f2708107ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:55:29.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.862+0000 7f270dfff700 1 --2- 172.21.15.46:0/3304099299 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27080ff690 0x7f27080ffab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:55:29.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.862+0000 7f270dfff700 1 --2- 172.21.15.46:0/3304099299 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2708100880 0x7f2708100ce0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:55:29.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.862+0000 7f270dfff700 1 -- 172.21.15.46:0/3304099299 >> 172.21.15.46:0/3304099299 conn(0x7f27080fac00 msgr2=0x7f27080fd040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:55:29.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.862+0000 7f270dfff700 1 -- 172.21.15.46:0/3304099299 shutdown_connections 2023-10-19T12:55:29.867 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.862+0000 7f270dfff700 1 -- 172.21.15.46:0/3304099299 wait complete. 2023-10-19T12:55:29.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.864+0000 7f270dfff700 1 Processor -- start 2023-10-19T12:55:29.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.864+0000 7f270dfff700 1 -- start start 2023-10-19T12:55:29.869 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.864+0000 7f270dfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27080ff690 0x7f2708198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:55:29.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.864+0000 7f270dfff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2708100880 0x7f2708198e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:55:29.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.864+0000 7f270dfff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2708101220 0x7f270819fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:55:29.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.864+0000 7f270dfff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27081a0460 con 0x7f27080ff690 2023-10-19T12:55:29.870 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.864+0000 7f270dfff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27081a05a0 con 0x7f2708101220 2023-10-19T12:55:29.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.864+0000 7f270dfff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27081a0730 con 0x7f2708100880 2023-10-19T12:55:29.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.865+0000 7f26feffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2708100880 0x7f2708198e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:55:29.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.865+0000 7f2707fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2708101220 0x7f270819fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:55:29.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.865+0000 7f26feffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2708100880 0x7f2708198e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:57996/0 (socket says 172.21.15.46:57996) 2023-10-19T12:55:29.871 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.865+0000 7f26feffd700 1 -- 172.21.15.46:0/254396204 learned_addr learned my addr 172.21.15.46:0/254396204 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:55:29.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.865+0000 7f27077fe700 1 --2- 172.21.15.46:0/254396204 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27080ff690 0x7f2708198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:55:29.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.865+0000 7f26feffd700 1 -- 172.21.15.46:0/254396204 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2708101220 msgr2=0x7f270819fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:55:29.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.865+0000 7f26feffd700 1 --2- 172.21.15.46:0/254396204 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2708101220 0x7f270819fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:55:29.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.865+0000 7f26feffd700 1 -- 172.21.15.46:0/254396204 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27080ff690 msgr2=0x7f2708198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:55:29.872 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.866+0000 7f26feffd700 1 --2- 172.21.15.46:0/254396204 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27080ff690 0x7f2708198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:55:29.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.866+0000 7f26feffd700 1 -- 172.21.15.46:0/254396204 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26f00095f0 con 0x7f2708100880 2023-10-19T12:55:29.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.866+0000 7f2707fff700 1 --2- 172.21.15.46:0/254396204 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2708101220 0x7f270819fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:55:29.873 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.866+0000 7f27077fe700 1 --2- 172.21.15.46:0/254396204 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27080ff690 0x7f2708198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:55:29.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.866+0000 7f26feffd700 1 --2- 172.21.15.46:0/254396204 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2708100880 0x7f2708198e70 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f26f000b680 tx=0x7f26f0009580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:55:29.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.866+0000 7f27057fa700 1 -- 172.21.15.46:0/254396204 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f001d070 con 0x7f2708100880 2023-10-19T12:55:29.874 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.867+0000 7f27057fa700 1 -- 172.21.15.46:0/254396204 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f26f0022470 con 0x7f2708100880 2023-10-19T12:55:29.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.867+0000 7f27057fa700 1 -- 172.21.15.46:0/254396204 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f0017650 con 0x7f2708100880 2023-10-19T12:55:29.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.867+0000 7f270dfff700 1 -- 172.21.15.46:0/254396204 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27081a09b0 con 0x7f2708100880 2023-10-19T12:55:29.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.867+0000 7f270dfff700 1 -- 172.21.15.46:0/254396204 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27081a0d80 con 0x7f2708100880 2023-10-19T12:55:29.875 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.872+0000 7f27057fa700 1 -- 172.21.15.46:0/254396204 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f26f00225e0 con 0x7f2708100880 2023-10-19T12:55:29.877 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.874+0000 7f2721a0cb80 1 Processor -- start 2023-10-19T12:55:29.877 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.874+0000 7f2721a0cb80 1 -- start start 2023-10-19T12:55:29.879 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.874+0000 7f2721a0cb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f8aaddeae0 0x55f8aaddef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:55:29.879 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.874+0000 7f2721a0cb80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f8aaddf440 0x55f8aaddd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:55:29.879 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.875+0000 7f2721a0cb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f8aadddde0 0x55f8aadde260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:55:29.879 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.875+0000 7f2721a0cb80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8aad486e0 con 0x55f8aaddf440 2023-10-19T12:55:29.880 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.875+0000 7f2721a0cb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8aad2ec60 con 0x55f8aaddeae0 2023-10-19T12:55:29.880 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.875+0000 7f2721a0cb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8aad2c580 con 0x55f8aadddde0 2023-10-19T12:55:29.880 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.875+0000 7f2707fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f8aaddeae0 0x55f8aaddef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:55:29.880 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.875+0000 7f2707fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f8aaddeae0 0x55f8aaddef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:60074/0 (socket says 172.21.15.46:60074) 2023-10-19T12:55:29.880 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.875+0000 7f2707fff700 1 -- 172.21.15.46:0/1312015112 learned_addr learned my addr 172.21.15.46:0/1312015112 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:55:29.881 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.875+0000 7f27057fa700 1 --2- 172.21.15.46:0/254396204 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f26f40a1500 0x7f26f40a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:55:29.881 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.875+0000 7f26feffd700 1 --2- 172.21.15.46:0/1312015112 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f8aadddde0 0x55f8aadde260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:55:29.881 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.875+0000 7f2707fff700 1 -- 172.21.15.46:0/1312015112 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f8aadddde0 msgr2=0x55f8aadde260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:55:29.881 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.875+0000 7f2707fff700 1 --2- 172.21.15.46:0/1312015112 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f8aadddde0 0x55f8aadde260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:55:29.881 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.875+0000 7f2707fff700 1 -- 172.21.15.46:0/1312015112 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f8aaddf440 msgr2=0x55f8aaddd8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:55:29.882 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.875+0000 7f2707fff700 1 --2- 172.21.15.46:0/1312015112 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f8aaddf440 0x55f8aaddd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:55:29.882 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.875+0000 7f2707fff700 1 -- 172.21.15.46:0/1312015112 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f8aace53f0 con 0x55f8aaddeae0 2023-10-19T12:55:29.882 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.875+0000 7f27057fa700 1 -- 172.21.15.46:0/254396204 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f26f00ce2e0 con 0x7f2708100880 2023-10-19T12:55:29.882 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.876+0000 7f2707fff700 1 --2- 172.21.15.46:0/254396204 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f26f40a1500 0x7f26f40a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:55:29.882 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.876+0000 7f2707fff700 1 --2- 172.21.15.46:0/1312015112 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f8aaddeae0 0x55f8aaddef00 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2700009520 tx=0x7f2700004320 comp rx=0 tx=0).ready entity=mon.2 client_cookie=549139b7c2853488 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:55:29.884 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.876+0000 7f26fdffb700 1 -- 172.21.15.46:0/1312015112 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f270000e6f0 con 0x55f8aaddeae0 2023-10-19T12:55:29.884 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.876+0000 7f26fdffb700 1 -- 172.21.15.46:0/1312015112 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2700027070 con 0x55f8aaddeae0 2023-10-19T12:55:29.884 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.876+0000 7f26fdffb700 1 -- 172.21.15.46:0/1312015112 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27000189f0 con 0x55f8aaddeae0 2023-10-19T12:55:29.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.877+0000 7f2721a0cb80 1 -- 172.21.15.46:0/1312015112 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f8aaddeae0 msgr2=0x55f8aaddef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:55:29.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.877+0000 7f2721a0cb80 1 --2- 172.21.15.46:0/1312015112 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f8aaddeae0 0x55f8aaddef00 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2700009520 tx=0x7f2700004320 comp rx=0 tx=0).stop 2023-10-19T12:55:29.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.877+0000 7f2707fff700 1 --2- 172.21.15.46:0/254396204 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f26f40a1500 0x7f26f40a39c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f2700022000 tx=0x7f270001f000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:55:29.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.877+0000 7f2721a0cb80 1 -- 172.21.15.46:0/1312015112 shutdown_connections 2023-10-19T12:55:29.885 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.877+0000 7f2721a0cb80 1 --2- 172.21.15.46:0/1312015112 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f8aadddde0 0x55f8aadde260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:55:29.886 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.877+0000 7f2721a0cb80 1 --2- 172.21.15.46:0/1312015112 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f8aaddeae0 0x55f8aaddef00 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:55:29.886 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.877+0000 7f2721a0cb80 1 --2- 172.21.15.46:0/1312015112 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f8aaddf440 0x55f8aaddd8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:55:29.886 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.877+0000 7f2721a0cb80 1 -- 172.21.15.46:0/1312015112 >> 172.21.15.46:0/1312015112 conn(0x55f8aad49720 msgr2=0x55f8aadcfb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:55:29.886 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.877+0000 7f2721a0cb80 1 -- 172.21.15.46:0/1312015112 shutdown_connections 2023-10-19T12:55:29.887 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.878+0000 7f2721a0cb80 1 -- 172.21.15.46:0/1312015112 wait complete. 2023-10-19T12:55:29.887 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.878+0000 7f2721a0cb80 1 -- start start 2023-10-19T12:55:29.887 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.878+0000 7f2721a0cb80 1 Processor -- start 2023-10-19T12:55:29.887 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.879+0000 7f2721a0cb80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f8aadddde0 0x55f8aade7310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:55:29.887 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.879+0000 7f2721a0cb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f8aaddeae0 0x55f8aade7850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:55:29.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.879+0000 7f2721a0cb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f8aaddf440 0x55f8aadee890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:55:29.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.879+0000 7f2721a0cb80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8aad27e70 con 0x55f8aadddde0 2023-10-19T12:55:29.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.879+0000 7f2721a0cb80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8aacc4710 con 0x55f8aaddeae0 2023-10-19T12:55:29.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.879+0000 7f2721a0cb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8aacc43b0 con 0x55f8aaddf440 2023-10-19T12:55:29.888 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.879+0000 7f2721a0cb80 10 client.0 _ll_register_callbacks cb 0x55f8aac0ea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:55:29.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.880+0000 7f27077fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f8aadddde0 0x55f8aade7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:55:29.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.880+0000 7f27077fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f8aadddde0 0x55f8aade7310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46878/0 (socket says 172.21.15.46:46878) 2023-10-19T12:55:29.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.880+0000 7f27077fe700 1 -- 172.21.15.46:0/2425321504 learned_addr learned my addr 172.21.15.46:0/2425321504 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:55:29.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.880+0000 7f26feffd700 1 --2- 172.21.15.46:0/2425321504 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f8aaddeae0 0x55f8aade7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:55:29.889 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.880+0000 7f2707fff700 1 --2- 172.21.15.46:0/2425321504 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f8aaddf440 0x55f8aadee890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:55:29.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.880+0000 7f2707fff700 1 -- 172.21.15.46:0/2425321504 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f8aaddeae0 msgr2=0x55f8aade7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:55:29.890 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.880+0000 7f2707fff700 1 --2- 172.21.15.46:0/2425321504 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f8aaddeae0 0x55f8aade7850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:55:29.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.880+0000 7f2707fff700 1 -- 172.21.15.46:0/2425321504 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f8aadddde0 msgr2=0x55f8aade7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:55:29.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.880+0000 7f2707fff700 1 --2- 172.21.15.46:0/2425321504 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f8aadddde0 0x55f8aade7310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:55:29.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.880+0000 7f2707fff700 1 -- 172.21.15.46:0/2425321504 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2700003be0 con 0x55f8aaddf440 2023-10-19T12:55:29.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.882+0000 7f2707fff700 1 --2- 172.21.15.46:0/2425321504 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f8aaddf440 0x55f8aadee890 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2700013000 tx=0x7f2700006000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=817dc946cc5d923f server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:55:29.891 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.882+0000 7f26e6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-10-19T12:55:29.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.882+0000 7f26e6ffd700 1 -- 172.21.15.46:0/2425321504 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2700004cb0 con 0x55f8aaddf440 2023-10-19T12:55:29.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.885+0000 7f26e6ffd700 1 -- 172.21.15.46:0/2425321504 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f2700004e10 con 0x55f8aaddf440 2023-10-19T12:55:29.892 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.885+0000 7f2721a0cb80 1 -- 172.21.15.46:0/2425321504 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f8aad2cef0 con 0x55f8aaddf440 2023-10-19T12:55:29.914 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.911+0000 7f26e6ffd700 1 -- 172.21.15.46:0/2425321504 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7f270000e4f0 con 0x55f8aaddf440 2023-10-19T12:55:29.915 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.911+0000 7f2721a0cb80 10 client.26173 fetch_fsmap learned FSMap version 50 2023-10-19T12:55:29.915 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.911+0000 7f2721a0cb80 1 -- 172.21.15.46:0/2425321504 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) v3 -- 0x55f8aab52de0 con 0x55f8aaddf440 2023-10-19T12:55:29.919 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.916+0000 7f26e6ffd700 1 -- 172.21.15.46:0/2425321504 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55f8aad2cef0 con 0x55f8aaddf440 2023-10-19T12:55:29.920 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.916+0000 7f26e6ffd700 1 -- 172.21.15.46:0/2425321504 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 50) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f27000239b0 con 0x55f8aaddf440 2023-10-19T12:55:29.920 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.917+0000 7f2721a0cb80 10 client.26173 fetch_fsmap finished waiting for FSMap version 50 2023-10-19T12:55:29.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.917+0000 7f2721a0cb80 10 client.26173 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-19T12:55:29.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.917+0000 7f2721a0cb80 20 client.26173 populate_metadata read hostname 'smithi046' 2023-10-19T12:55:29.921 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.917+0000 7f2721a0cb80 1 --2- 172.21.15.46:0/2425321504 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x55f8aadd6400 0x55f8aadd8820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:55:29.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.917+0000 7f2721a0cb80 4 client.26173 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-19T12:55:29.922 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.917+0000 7f2721a0cb80 1 -- 172.21.15.46:0/2425321504 --> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f8aada48b0 con 0x55f8aadd6400 2023-10-19T12:55:29.924 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.921+0000 7f27077fe700 1 --2- 172.21.15.46:0/2425321504 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x55f8aadd6400 0x55f8aadd8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:55:29.929 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.926+0000 7f27077fe700 1 --2- 172.21.15.46:0/2425321504 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x55f8aadd6400 0x55f8aadd8820 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=97306fe1fd4363f4 server_cookie=d23ff188ff1854c1 in_seq=0 out_seq=0 2023-10-19T12:55:29.929 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.926+0000 7f26e6ffd700 10 client.26173 ms_handle_connect on v2:172.21.15.157:6838/552718978 2023-10-19T12:55:29.934 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.931+0000 7f26e6ffd700 1 -- 172.21.15.46:0/2425321504 <== mds.0 v2:172.21.15.157:6838/552718978 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55f8aada48b0 con 0x55f8aadd6400 2023-10-19T12:55:29.935 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.931+0000 7f26e6ffd700 10 client.26173 handle_command_reply: tid=0 2023-10-19T12:55:29.935 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.931+0000 7f2721a0cb80 1 client.26173 shutdown 2023-10-19T12:55:29.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.932+0000 7f2721a0cb80 1 -- 172.21.15.46:0/2425321504 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f8aaddf440 msgr2=0x55f8aadee890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:55:29.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.932+0000 7f2721a0cb80 1 --2- 172.21.15.46:0/2425321504 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f8aaddf440 0x55f8aadee890 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2700013000 tx=0x7f2700006000 comp rx=0 tx=0).stop 2023-10-19T12:55:29.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.932+0000 7f2721a0cb80 1 -- 172.21.15.46:0/2425321504 shutdown_connections 2023-10-19T12:55:29.936 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.932+0000 7f2721a0cb80 1 --2- 172.21.15.46:0/2425321504 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f8aaddf440 0x55f8aadee890 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:55:29.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.932+0000 7f2721a0cb80 1 --2- 172.21.15.46:0/2425321504 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x55f8aadd6400 0x55f8aadd8820 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:55:29.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.932+0000 7f2721a0cb80 1 --2- 172.21.15.46:0/2425321504 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f8aadddde0 0x55f8aade7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:55:29.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.932+0000 7f2721a0cb80 1 --2- 172.21.15.46:0/2425321504 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f8aaddeae0 0x55f8aade7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:55:29.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.932+0000 7f2721a0cb80 1 -- 172.21.15.46:0/2425321504 >> 172.21.15.46:0/2425321504 conn(0x55f8aad49720 msgr2=0x55f8aaddc890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:55:29.937 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.933+0000 7f26e6ffd700 0 client.26173 ms_handle_reset on v2:172.21.15.157:6838/552718978 2023-10-19T12:55:29.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.933+0000 7f2721a0cb80 1 -- 172.21.15.46:0/2425321504 shutdown_connections 2023-10-19T12:55:29.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.933+0000 7f2721a0cb80 1 -- 172.21.15.46:0/2425321504 wait complete. 2023-10-19T12:55:29.939 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.933+0000 7f2721a0cb80 20 client.26173 trim_cache size 0 max 16384 2023-10-19T12:55:29.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:55:29 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:55:29.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:55:29 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:55:29.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:55:29 smithi046 ceph-mon[98509]: pgmap v713: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 6.8 MiB/s wr, 447 op/s 2023-10-19T12:55:29.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.986+0000 7f2721a0cb80 1 Processor -- start 2023-10-19T12:55:29.989 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.986+0000 7f2721a0cb80 1 -- start start 2023-10-19T12:55:29.990 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.987+0000 7f2721a0cb80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f8aadddde0 0x55f8aade6020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:55:29.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.987+0000 7f2721a0cb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f8aaddeae0 0x55f8aaddd140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:55:29.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.987+0000 7f27077fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f8aadddde0 0x55f8aade6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:55:29.991 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.987+0000 7f27077fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f8aadddde0 0x55f8aade6020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46894/0 (socket says 172.21.15.46:46894) 2023-10-19T12:55:29.992 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.988+0000 7f27077fe700 1 -- 172.21.15.46:0/4177396703 learned_addr learned my addr 172.21.15.46:0/4177396703 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:55:29.992 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.988+0000 7f2721a0cb80 1 --2- 172.21.15.46:0/4177396703 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f8aaddf440 0x55f8aade1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:55:29.992 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.988+0000 7f26feffd700 1 --2- 172.21.15.46:0/4177396703 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f8aaddeae0 0x55f8aaddd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:55:29.993 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.988+0000 7f2721a0cb80 1 -- 172.21.15.46:0/4177396703 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8aaba8920 con 0x55f8aadddde0 2023-10-19T12:55:29.993 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.988+0000 7f2721a0cb80 1 -- 172.21.15.46:0/4177396703 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8aade83c0 con 0x55f8aaddf440 2023-10-19T12:55:29.993 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.988+0000 7f2721a0cb80 1 -- 172.21.15.46:0/4177396703 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8aade6e80 con 0x55f8aaddeae0 2023-10-19T12:55:29.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.988+0000 7f2707fff700 1 --2- 172.21.15.46:0/4177396703 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f8aaddf440 0x55f8aade1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:55:29.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.989+0000 7f27077fe700 1 -- 172.21.15.46:0/4177396703 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f8aaddeae0 msgr2=0x55f8aaddd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:55:29.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.989+0000 7f27077fe700 1 --2- 172.21.15.46:0/4177396703 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f8aaddeae0 0x55f8aaddd140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:55:29.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.989+0000 7f27077fe700 1 -- 172.21.15.46:0/4177396703 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f8aaddf440 msgr2=0x55f8aade1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:55:29.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.989+0000 7f27077fe700 1 --2- 172.21.15.46:0/4177396703 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f8aaddf440 0x55f8aade1ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:55:29.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.989+0000 7f27077fe700 1 -- 172.21.15.46:0/4177396703 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f8aab3bc60 con 0x55f8aadddde0 2023-10-19T12:55:29.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.989+0000 7f2707fff700 1 --2- 172.21.15.46:0/4177396703 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f8aaddf440 0x55f8aade1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T12:55:29.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.989+0000 7f27077fe700 1 --2- 172.21.15.46:0/4177396703 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f8aadddde0 0x55f8aade6020 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f26f8005c50 tx=0x7f26f80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=779c8b72ae9deb2e server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:55:29.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.993+0000 7f26fe7fc700 1 -- 172.21.15.46:0/4177396703 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f801d070 con 0x55f8aadddde0 2023-10-19T12:55:29.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.993+0000 7f26fe7fc700 1 -- 172.21.15.46:0/4177396703 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55f8aada48b0 con 0x55f8aadddde0 2023-10-19T12:55:29.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.993+0000 7f26fe7fc700 1 -- 172.21.15.46:0/4177396703 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f8010040 con 0x55f8aadddde0 2023-10-19T12:55:29.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.994+0000 7f2721a0cb80 1 -- 172.21.15.46:0/4177396703 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f8aadddde0 msgr2=0x55f8aade6020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:55:29.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.994+0000 7f2721a0cb80 1 --2- 172.21.15.46:0/4177396703 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f8aadddde0 0x55f8aade6020 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f26f8005c50 tx=0x7f26f80047c0 comp rx=0 tx=0).stop 2023-10-19T12:55:29.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.994+0000 7f2721a0cb80 1 -- 172.21.15.46:0/4177396703 shutdown_connections 2023-10-19T12:55:29.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.995+0000 7f2721a0cb80 1 --2- 172.21.15.46:0/4177396703 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f8aaddf440 0x55f8aade1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:55:29.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.995+0000 7f2721a0cb80 1 --2- 172.21.15.46:0/4177396703 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f8aadddde0 0x55f8aade6020 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:55:30.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.995+0000 7f2721a0cb80 1 --2- 172.21.15.46:0/4177396703 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f8aaddeae0 0x55f8aaddd140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:55:30.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.995+0000 7f2721a0cb80 1 -- 172.21.15.46:0/4177396703 >> 172.21.15.46:0/4177396703 conn(0x55f8aad49720 msgr2=0x55f8aade5380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:55:30.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.995+0000 7f2721a0cb80 1 -- 172.21.15.46:0/4177396703 shutdown_connections 2023-10-19T12:55:30.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.995+0000 7f2721a0cb80 1 -- 172.21.15.46:0/4177396703 wait complete. 2023-10-19T12:55:30.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.996+0000 7f2721a0cb80 1 -- start start 2023-10-19T12:55:30.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.996+0000 7f2721a0cb80 1 Processor -- start 2023-10-19T12:55:30.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.997+0000 7f2721a0cb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f8aadddde0 0x55f8aae478c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:55:30.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.998+0000 7f2721a0cb80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f8aaddeae0 0x55f8aae47e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:55:30.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.998+0000 7f2721a0cb80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f8aaddf440 0x55f8aae4ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:55:30.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.998+0000 7f27077fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f8aadddde0 0x55f8aae478c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:55:30.003 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.998+0000 7f27077fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f8aadddde0 0x55f8aae478c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:58014/0 (socket says 172.21.15.46:58014) 2023-10-19T12:55:30.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.998+0000 7f26feffd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f8aaddeae0 0x55f8aae47e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:55:30.004 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.998+0000 7f2721a0cb80 1 -- 172.21.15.46:0/1421509515 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8aae4f260 con 0x55f8aaddf440 2023-10-19T12:55:30.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.998+0000 7f2721a0cb80 1 -- 172.21.15.46:0/1421509515 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8aae4f3a0 con 0x55f8aaddeae0 2023-10-19T12:55:30.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.998+0000 7f2721a0cb80 1 -- 172.21.15.46:0/1421509515 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8aae4f530 con 0x55f8aadddde0 2023-10-19T12:55:30.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.998+0000 7f2721a0cb80 10 client.0 _ll_register_callbacks cb 0x55f8aac0ea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:55:30.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.998+0000 7f2707fff700 1 --2- 172.21.15.46:0/1421509515 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f8aaddf440 0x55f8aae4ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:55:30.005 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.998+0000 7f27077fe700 1 -- 172.21.15.46:0/1421509515 learned_addr learned my addr 172.21.15.46:0/1421509515 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:55:30.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.999+0000 7f26feffd700 1 -- 172.21.15.46:0/1421509515 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f8aadddde0 msgr2=0x55f8aae478c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:55:30.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.999+0000 7f26feffd700 1 --2- 172.21.15.46:0/1421509515 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f8aadddde0 0x55f8aae478c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:55:30.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.999+0000 7f26feffd700 1 -- 172.21.15.46:0/1421509515 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f8aaddf440 msgr2=0x55f8aae4ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:55:30.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.999+0000 7f26feffd700 1 --2- 172.21.15.46:0/1421509515 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f8aaddf440 0x55f8aae4ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:55:30.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.999+0000 7f26feffd700 1 -- 172.21.15.46:0/1421509515 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26f80043c0 con 0x55f8aaddeae0 2023-10-19T12:55:30.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.999+0000 7f26feffd700 1 --2- 172.21.15.46:0/1421509515 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f8aaddeae0 0x55f8aae47e00 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f26f009afc0 tx=0x7f26f00092d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80262ea394e974c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:55:30.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:29.999+0000 7f26e6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.157:3300/0 2023-10-19T12:55:30.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:30.000+0000 7f26e6ffd700 1 -- 172.21.15.46:0/1421509515 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f009ae00 con 0x55f8aaddeae0 2023-10-19T12:55:30.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:30.000+0000 7f26e6ffd700 1 -- 172.21.15.46:0/1421509515 <== mon.2 v2:172.21.15.157:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f26f009b9c0 con 0x55f8aaddeae0 2023-10-19T12:55:30.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:30.001+0000 7f2721a0cb80 1 -- 172.21.15.46:0/1421509515 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2700027070 con 0x55f8aaddeae0 2023-10-19T12:55:30.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:30.001+0000 7f26e6ffd700 1 -- 172.21.15.46:0/1421509515 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7f26f009ac20 con 0x55f8aaddeae0 2023-10-19T12:55:30.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:30.001+0000 7f2721a0cb80 10 client.26162 fetch_fsmap learned FSMap version 50 2023-10-19T12:55:30.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:30.001+0000 7f2721a0cb80 1 -- 172.21.15.46:0/1421509515 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) v3 -- 0x55f8aab79250 con 0x55f8aaddeae0 2023-10-19T12:55:30.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:30.001+0000 7f26e6ffd700 1 -- 172.21.15.46:0/1421509515 <== mon.2 v2:172.21.15.157:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2700027070 con 0x55f8aaddeae0 2023-10-19T12:55:30.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:30.001+0000 7f26e6ffd700 1 -- 172.21.15.46:0/1421509515 <== mon.2 v2:172.21.15.157:3300/0 5 ==== fsmap(e 50) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f26f00b9320 con 0x55f8aaddeae0 2023-10-19T12:55:30.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:30.002+0000 7f2721a0cb80 10 client.26162 fetch_fsmap finished waiting for FSMap version 50 2023-10-19T12:55:30.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:30.002+0000 7f2721a0cb80 10 client.26162 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-19T12:55:30.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:30.002+0000 7f2721a0cb80 20 client.26162 populate_metadata read hostname 'smithi046' 2023-10-19T12:55:30.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:30.002+0000 7f2721a0cb80 1 --2- 172.21.15.46:0/1421509515 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x55f8aae50cc0 0x55f8aae530e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:55:30.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:30.002+0000 7f2721a0cb80 4 client.26162 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-19T12:55:30.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:30.002+0000 7f2721a0cb80 1 -- 172.21.15.46:0/1421509515 --> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55f8aad20e50 con 0x55f8aae50cc0 2023-10-19T12:55:30.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:30.002+0000 7f27077fe700 1 --2- 172.21.15.46:0/1421509515 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x55f8aae50cc0 0x55f8aae530e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:55:30.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:30.003+0000 7f27077fe700 1 --2- 172.21.15.46:0/1421509515 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x55f8aae50cc0 0x55f8aae530e0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a00a9141ab71c39 server_cookie=79ded1dbbfce02d9 in_seq=0 out_seq=0 2023-10-19T12:55:30.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:30.003+0000 7f26e6ffd700 10 client.26162 ms_handle_connect on v2:172.21.15.157:6838/552718978 2023-10-19T12:55:30.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:30.003+0000 7f26e6ffd700 1 -- 172.21.15.46:0/1421509515 <== mds.0 v2:172.21.15.157:6838/552718978 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55f8aad20e50 con 0x55f8aae50cc0 2023-10-19T12:55:30.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:30.003+0000 7f26e6ffd700 10 client.26162 handle_command_reply: tid=0 2023-10-19T12:55:30.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:30.003+0000 7f2721a0cb80 1 client.26162 shutdown 2023-10-19T12:55:30.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:30.004+0000 7f2721a0cb80 1 -- 172.21.15.46:0/1421509515 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f8aaddeae0 msgr2=0x55f8aae47e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:55:30.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:30.004+0000 7f2721a0cb80 1 --2- 172.21.15.46:0/1421509515 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f8aaddeae0 0x55f8aae47e00 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f26f009afc0 tx=0x7f26f00092d0 comp rx=0 tx=0).stop 2023-10-19T12:55:30.013 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:30.004+0000 7f2721a0cb80 1 -- 172.21.15.46:0/1421509515 shutdown_connections 2023-10-19T12:55:30.013 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:30.004+0000 7f2721a0cb80 1 --2- 172.21.15.46:0/1421509515 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x55f8aae50cc0 0x55f8aae530e0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:55:30.013 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:30.004+0000 7f26e6ffd700 0 client.26162 ms_handle_reset on v2:172.21.15.157:6838/552718978 2023-10-19T12:55:30.013 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:30.004+0000 7f2721a0cb80 1 --2- 172.21.15.46:0/1421509515 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f8aaddf440 0x55f8aae4ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:55:30.013 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:30.004+0000 7f2721a0cb80 1 --2- 172.21.15.46:0/1421509515 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f8aadddde0 0x55f8aae478c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:55:30.014 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:30.004+0000 7f2721a0cb80 1 --2- 172.21.15.46:0/1421509515 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55f8aaddeae0 0x55f8aae47e00 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:55:30.014 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:30.004+0000 7f2721a0cb80 1 -- 172.21.15.46:0/1421509515 >> 172.21.15.46:0/1421509515 conn(0x55f8aad49720 msgr2=0x55f8aade6020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:55:30.014 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:30.005+0000 7f2721a0cb80 1 -- 172.21.15.46:0/1421509515 shutdown_connections 2023-10-19T12:55:30.014 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:30.006+0000 7f2721a0cb80 1 -- 172.21.15.46:0/1421509515 wait complete. 2023-10-19T12:55:30.014 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:30.007+0000 7f2721a0cb80 20 client.26162 trim_cache size 0 max 16384 2023-10-19T12:55:30.015 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-10-19T12:55:30.015 INFO:teuthology.orchestra.run.smithi046.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-19T12:55:30.015 INFO:teuthology.orchestra.run.smithi046.stdout: "scrubs": { 2023-10-19T12:55:30.016 INFO:teuthology.orchestra.run.smithi046.stdout: "21e73f70-af16-4ae7-bc34-e6c54ba8e1ec": { 2023-10-19T12:55:30.016 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2023-10-19T12:55:30.016 INFO:teuthology.orchestra.run.smithi046.stdout: "tag": "21e73f70-af16-4ae7-bc34-e6c54ba8e1ec", 2023-10-19T12:55:30.016 INFO:teuthology.orchestra.run.smithi046.stdout: "options": "recursive,force" 2023-10-19T12:55:30.016 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:55:30.016 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:55:30.017 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-10-19T12:55:30.017 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:30.010+0000 7f270dfff700 1 -- 172.21.15.46:0/254396204 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f26f40a1500 msgr2=0x7f26f40a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:55:30.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:30.010+0000 7f270dfff700 1 --2- 172.21.15.46:0/254396204 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f26f40a1500 0x7f26f40a39c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f2700022000 tx=0x7f270001f000 comp rx=0 tx=0).stop 2023-10-19T12:55:30.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:30.010+0000 7f270dfff700 1 -- 172.21.15.46:0/254396204 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2708100880 msgr2=0x7f2708198e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:55:30.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:30.010+0000 7f270dfff700 1 --2- 172.21.15.46:0/254396204 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2708100880 0x7f2708198e70 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f26f000b680 tx=0x7f26f0009580 comp rx=0 tx=0).stop 2023-10-19T12:55:30.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:30.010+0000 7f270dfff700 1 -- 172.21.15.46:0/254396204 shutdown_connections 2023-10-19T12:55:30.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:30.010+0000 7f270dfff700 1 --2- 172.21.15.46:0/254396204 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2708101220 0x7f270819fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:55:30.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:30.010+0000 7f270dfff700 1 --2- 172.21.15.46:0/254396204 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27080ff690 0x7f2708198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:55:30.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:30.010+0000 7f270dfff700 1 --2- 172.21.15.46:0/254396204 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f26f40a1500 0x7f26f40a39c0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:55:30.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:30.010+0000 7f270dfff700 1 --2- 172.21.15.46:0/254396204 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2708100880 0x7f2708198e70 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:55:30.019 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:30.010+0000 7f270dfff700 1 -- 172.21.15.46:0/254396204 >> 172.21.15.46:0/254396204 conn(0x7f27080fac00 msgr2=0x7f2708103c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:55:30.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:30.011+0000 7f270dfff700 1 -- 172.21.15.46:0/254396204 shutdown_connections 2023-10-19T12:55:30.020 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:55:30.012+0000 7f270dfff700 1 -- 172.21.15.46:0/254396204 wait complete. 2023-10-19T12:55:30.062 INFO:tasks.cephfs.filesystem:scrub status for tag:21e73f70-af16-4ae7-bc34-e6c54ba8e1ec - {'path': '/', 'tag': '21e73f70-af16-4ae7-bc34-e6c54ba8e1ec', 'options': 'recursive,force'} 2023-10-19T12:55:30.135 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:55:29 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:55:30.136 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:55:29 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:55:30.136 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:55:29 smithi195 ceph-mon[134493]: pgmap v713: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 6.8 MiB/s wr, 447 op/s 2023-10-19T12:55:30.340 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:55:29 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:55:30.341 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:55:29 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:55:30.341 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:55:29 smithi157 ceph-mon[134109]: pgmap v713: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 6.8 MiB/s wr, 447 op/s 2023-10-19T12:55:31.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:55:30 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:55:31.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:55:30 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:55:31.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:55:30 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:55:31.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:55:30 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:55:31.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:55:30 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:55:31.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:55:30 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:55:31.384 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:55:30 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:55:31.384 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:55:30 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:55:31.384 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:55:30 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:55:31.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 690.0 s, 414.8 tps, lat 242.256 ms stddev 271.057 2023-10-19T12:55:32.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:55:31 smithi046 ceph-mon[98509]: pgmap v714: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 6.8 MiB/s wr, 449 op/s 2023-10-19T12:55:32.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:55:31 smithi157 ceph-mon[134109]: pgmap v714: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 6.8 MiB/s wr, 449 op/s 2023-10-19T12:55:32.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:55:31 smithi195 ceph-mon[134493]: pgmap v714: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 6.8 MiB/s wr, 449 op/s 2023-10-19T12:55:34.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:55:34 smithi195 ceph-mon[134493]: pgmap v715: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 6.0 MiB/s wr, 414 op/s 2023-10-19T12:55:34.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:55:34 smithi046 ceph-mon[98509]: pgmap v715: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 6.0 MiB/s wr, 414 op/s 2023-10-19T12:55:34.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:55:34 smithi157 ceph-mon[134109]: pgmap v715: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 6.0 MiB/s wr, 414 op/s 2023-10-19T12:55:36.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:55:36 smithi195 ceph-mon[134493]: pgmap v716: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 6.1 MiB/s wr, 434 op/s 2023-10-19T12:55:36.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:55:36 smithi046 ceph-mon[98509]: pgmap v716: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 6.1 MiB/s wr, 434 op/s 2023-10-19T12:55:36.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:55:36 smithi157 ceph-mon[134109]: pgmap v716: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 6.1 MiB/s wr, 434 op/s 2023-10-19T12:55:36.704 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 695.0 s, 476.2 tps, lat 208.992 ms stddev 239.077 2023-10-19T12:55:38.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:55:38 smithi046 ceph-mon[98509]: pgmap v717: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 6.6 MiB/s wr, 458 op/s 2023-10-19T12:55:38.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:55:38 smithi157 ceph-mon[134109]: pgmap v717: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 6.6 MiB/s wr, 458 op/s 2023-10-19T12:55:38.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:55:38 smithi195 ceph-mon[134493]: pgmap v717: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 6.6 MiB/s wr, 458 op/s 2023-10-19T12:55:40.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:55:39 smithi157 ceph-mon[134109]: pgmap v718: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.2 MiB/s wr, 433 op/s 2023-10-19T12:55:40.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:55:39 smithi195 ceph-mon[134493]: pgmap v718: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.2 MiB/s wr, 433 op/s 2023-10-19T12:55:40.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:55:39 smithi046 ceph-mon[98509]: pgmap v718: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.2 MiB/s wr, 433 op/s 2023-10-19T12:55:41.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 700.0 s, 464.0 tps, lat 215.785 ms stddev 257.990 2023-10-19T12:55:42.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:55:42 smithi195 ceph-mon[134493]: pgmap v719: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.4 MiB/s wr, 442 op/s 2023-10-19T12:55:42.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:55:42 smithi046 ceph-mon[98509]: pgmap v719: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.4 MiB/s wr, 442 op/s 2023-10-19T12:55:42.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:55:42 smithi157 ceph-mon[134109]: pgmap v719: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.4 MiB/s wr, 442 op/s 2023-10-19T12:55:44.389 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:55:44 smithi195 ceph-mon[134493]: pgmap v720: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 5.5 MiB/s wr, 405 op/s 2023-10-19T12:55:44.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:55:44 smithi046 ceph-mon[98509]: pgmap v720: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 5.5 MiB/s wr, 405 op/s 2023-10-19T12:55:44.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:55:44 smithi157 ceph-mon[134109]: pgmap v720: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 5.5 MiB/s wr, 405 op/s 2023-10-19T12:55:46.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:55:46 smithi195 ceph-mon[134493]: pgmap v721: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.4 MiB/s wr, 435 op/s 2023-10-19T12:55:46.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:55:46 smithi046 ceph-mon[98509]: pgmap v721: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.4 MiB/s wr, 435 op/s 2023-10-19T12:55:46.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:55:46 smithi157 ceph-mon[134109]: pgmap v721: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.4 MiB/s wr, 435 op/s 2023-10-19T12:55:46.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 705.0 s, 465.4 tps, lat 205.670 ms stddev 217.977 2023-10-19T12:55:48.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:55:48 smithi195 ceph-mon[134493]: pgmap v722: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 7.1 MiB/s wr, 471 op/s 2023-10-19T12:55:48.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:55:48 smithi046 ceph-mon[98509]: pgmap v722: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 7.1 MiB/s wr, 471 op/s 2023-10-19T12:55:48.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:55:48 smithi157 ceph-mon[134109]: pgmap v722: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 7.1 MiB/s wr, 471 op/s 2023-10-19T12:55:50.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:55:49 smithi195 ceph-mon[134493]: pgmap v723: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.8 MiB/s wr, 460 op/s 2023-10-19T12:55:50.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:55:49 smithi046 ceph-mon[98509]: pgmap v723: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.8 MiB/s wr, 460 op/s 2023-10-19T12:55:50.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:55:49 smithi157 ceph-mon[134109]: pgmap v723: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.8 MiB/s wr, 460 op/s 2023-10-19T12:55:51.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 710.0 s, 439.6 tps, lat 242.948 ms stddev 308.214 2023-10-19T12:55:52.342 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:55:52 smithi157 ceph-mon[134109]: pgmap v724: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.7 MiB/s wr, 468 op/s 2023-10-19T12:55:52.384 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:55:52 smithi195 ceph-mon[134493]: pgmap v724: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.7 MiB/s wr, 468 op/s 2023-10-19T12:55:52.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:55:52 smithi046 ceph-mon[98509]: pgmap v724: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.7 MiB/s wr, 468 op/s 2023-10-19T12:55:54.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:55:54 smithi157 ceph-mon[134109]: pgmap v725: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 5.5 MiB/s wr, 416 op/s 2023-10-19T12:55:54.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:55:54 smithi195 ceph-mon[134493]: pgmap v725: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 5.5 MiB/s wr, 416 op/s 2023-10-19T12:55:54.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:55:54 smithi046 ceph-mon[98509]: pgmap v725: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 5.5 MiB/s wr, 416 op/s 2023-10-19T12:55:56.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:55:56 smithi195 ceph-mon[134493]: pgmap v726: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.2 MiB/s wr, 431 op/s 2023-10-19T12:55:56.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:55:56 smithi046 ceph-mon[98509]: pgmap v726: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.2 MiB/s wr, 431 op/s 2023-10-19T12:55:56.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:55:56 smithi157 ceph-mon[134109]: pgmap v726: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.2 MiB/s wr, 431 op/s 2023-10-19T12:55:56.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 715.0 s, 381.6 tps, lat 245.390 ms stddev 271.946 2023-10-19T12:55:58.385 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:55:58 smithi195 ceph-mon[134493]: pgmap v727: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 5.4 MiB/s wr, 445 op/s 2023-10-19T12:55:58.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:55:58 smithi046 ceph-mon[98509]: pgmap v727: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 5.4 MiB/s wr, 445 op/s 2023-10-19T12:55:58.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:55:58 smithi157 ceph-mon[134109]: pgmap v727: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 5.4 MiB/s wr, 445 op/s 2023-10-19T12:56:00.063 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-19T12:56:00.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:55:59 smithi195 ceph-mon[134493]: pgmap v728: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.8 MiB/s wr, 422 op/s 2023-10-19T12:56:00.149 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:55:59 smithi046 ceph-mon[98509]: pgmap v728: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.8 MiB/s wr, 422 op/s 2023-10-19T12:56:00.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:55:59 smithi157 ceph-mon[134109]: pgmap v728: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.8 MiB/s wr, 422 op/s 2023-10-19T12:56:00.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.386+0000 7f32dd9ff700 1 -- 172.21.15.46:0/3890760549 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f32d80ff690 msgr2=0x7f32d80ffab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:56:00.389 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.386+0000 7f32dd9ff700 1 --2- 172.21.15.46:0/3890760549 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f32d80ff690 0x7f32d80ffab0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f32c800b0a0 tx=0x7f32c800b3b0 comp rx=0 tx=0).stop 2023-10-19T12:56:00.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.386+0000 7f32dd9ff700 1 -- 172.21.15.46:0/3890760549 shutdown_connections 2023-10-19T12:56:00.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.386+0000 7f32dd9ff700 1 --2- 172.21.15.46:0/3890760549 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32d8101220 0x7f32d8107ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:56:00.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.386+0000 7f32dd9ff700 1 --2- 172.21.15.46:0/3890760549 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f32d80ff690 0x7f32d80ffab0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:56:00.390 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.386+0000 7f32dd9ff700 1 --2- 172.21.15.46:0/3890760549 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f32d8100880 0x7f32d8100ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:56:00.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.386+0000 7f32dd9ff700 1 -- 172.21.15.46:0/3890760549 >> 172.21.15.46:0/3890760549 conn(0x7f32d80fac00 msgr2=0x7f32d80fd040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:56:00.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.386+0000 7f32dd9ff700 1 -- 172.21.15.46:0/3890760549 shutdown_connections 2023-10-19T12:56:00.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.386+0000 7f32dd9ff700 1 -- 172.21.15.46:0/3890760549 wait complete. 2023-10-19T12:56:00.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.388+0000 7f32dd9ff700 1 Processor -- start 2023-10-19T12:56:00.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.389+0000 7f32dd9ff700 1 -- start start 2023-10-19T12:56:00.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.389+0000 7f32dd9ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32d80ff690 0x7f32d819f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:56:00.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.389+0000 7f32dd9ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f32d8100880 0x7f32d81a1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:56:00.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.389+0000 7f32dd9ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f32d8101220 0x7f32d81a41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:56:00.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.389+0000 7f32dd9ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32d81a4980 con 0x7f32d80ff690 2023-10-19T12:56:00.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.389+0000 7f32dd9ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32d81a4af0 con 0x7f32d8100880 2023-10-19T12:56:00.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.389+0000 7f32dd9ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32d81a4cb0 con 0x7f32d8101220 2023-10-19T12:56:00.394 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.389+0000 7f32d77fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f32d8101220 0x7f32d81a41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:56:00.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.390+0000 7f32d77fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f32d8101220 0x7f32d81a41b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:56764/0 (socket says 172.21.15.46:56764) 2023-10-19T12:56:00.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.390+0000 7f32d77fe700 1 -- 172.21.15.46:0/1882891191 learned_addr learned my addr 172.21.15.46:0/1882891191 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:56:00.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.389+0000 7f32ce7fc700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f32d8100880 0x7f32d81a1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:56:00.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.390+0000 7f32d6ffd700 1 --2- 172.21.15.46:0/1882891191 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32d80ff690 0x7f32d819f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:56:00.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.390+0000 7f32d77fe700 1 -- 172.21.15.46:0/1882891191 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f32d8100880 msgr2=0x7f32d81a1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:56:00.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.390+0000 7f32d77fe700 1 --2- 172.21.15.46:0/1882891191 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f32d8100880 0x7f32d81a1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:56:00.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.390+0000 7f32d77fe700 1 -- 172.21.15.46:0/1882891191 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32d80ff690 msgr2=0x7f32d819f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:56:00.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.390+0000 7f32d77fe700 1 --2- 172.21.15.46:0/1882891191 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32d80ff690 0x7f32d819f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:56:00.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.390+0000 7f32d77fe700 1 -- 172.21.15.46:0/1882891191 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32c8009d00 con 0x7f32d8101220 2023-10-19T12:56:00.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.390+0000 7f32d6ffd700 1 --2- 172.21.15.46:0/1882891191 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32d80ff690 0x7f32d819f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T12:56:00.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.390+0000 7f32d77fe700 1 --2- 172.21.15.46:0/1882891191 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f32d8101220 0x7f32d81a41b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f32d000b550 tx=0x7f32d000b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:56:00.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.393+0000 7f32dc9fd700 1 -- 172.21.15.46:0/1882891191 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d0011830 con 0x7f32d8101220 2023-10-19T12:56:00.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.393+0000 7f32dc9fd700 1 -- 172.21.15.46:0/1882891191 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f32d0011e50 con 0x7f32d8101220 2023-10-19T12:56:00.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.393+0000 7f32dc9fd700 1 -- 172.21.15.46:0/1882891191 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d000f2e0 con 0x7f32d8101220 2023-10-19T12:56:00.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.394+0000 7f32dd9ff700 1 -- 172.21.15.46:0/1882891191 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32d81a4f90 con 0x7f32d8101220 2023-10-19T12:56:00.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.394+0000 7f32dd9ff700 1 -- 172.21.15.46:0/1882891191 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32d81a53c0 con 0x7f32d8101220 2023-10-19T12:56:00.404 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.399+0000 7f32dc9fd700 1 -- 172.21.15.46:0/1882891191 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f32d0010580 con 0x7f32d8101220 2023-10-19T12:56:00.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.402+0000 7f32dc9fd700 1 --2- 172.21.15.46:0/1882891191 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f32c40a1550 0x7f32c40a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:56:00.405 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.402+0000 7f32dc9fd700 1 -- 172.21.15.46:0/1882891191 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f32d00cca90 con 0x7f32d8101220 2023-10-19T12:56:00.406 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.403+0000 7f32f1372b80 1 Processor -- start 2023-10-19T12:56:00.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.403+0000 7f32f1372b80 1 -- start start 2023-10-19T12:56:00.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.403+0000 7f32f1372b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5563817f42d0 0x5563817f46f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:56:00.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.404+0000 7f32f1372b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5563817f4c30 0x5563817f3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:56:00.407 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.404+0000 7f32f1372b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5563817f35d0 0x5563817f3a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:56:00.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.404+0000 7f32f1372b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563817666e0 con 0x5563817f42d0 2023-10-19T12:56:00.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.404+0000 7f32f1372b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55638174cc60 con 0x5563817f35d0 2023-10-19T12:56:00.408 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.404+0000 7f32f1372b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55638174a580 con 0x5563817f4c30 2023-10-19T12:56:00.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.404+0000 7f32d77fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5563817f35d0 0x5563817f3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:56:00.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.404+0000 7f32d77fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5563817f35d0 0x5563817f3a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:45942/0 (socket says 172.21.15.46:45942) 2023-10-19T12:56:00.409 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.404+0000 7f32d77fe700 1 -- 172.21.15.46:0/920855173 learned_addr learned my addr 172.21.15.46:0/920855173 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:56:00.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.404+0000 7f32d6ffd700 1 --2- 172.21.15.46:0/920855173 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5563817f42d0 0x5563817f46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:56:00.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.404+0000 7f32d77fe700 1 -- 172.21.15.46:0/920855173 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5563817f4c30 msgr2=0x5563817f3090 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-19T12:56:00.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.404+0000 7f32d77fe700 1 --2- 172.21.15.46:0/920855173 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5563817f4c30 0x5563817f3090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:56:00.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.404+0000 7f32d77fe700 1 -- 172.21.15.46:0/920855173 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5563817f42d0 msgr2=0x5563817f46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:56:00.410 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.404+0000 7f32d77fe700 1 --2- 172.21.15.46:0/920855173 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5563817f42d0 0x5563817f46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:56:00.411 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.404+0000 7f32d77fe700 1 -- 172.21.15.46:0/920855173 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5563817033f0 con 0x5563817f35d0 2023-10-19T12:56:00.414 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.405+0000 7f32d6ffd700 1 --2- 172.21.15.46:0/920855173 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5563817f42d0 0x5563817f46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T12:56:00.415 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.405+0000 7f32d77fe700 1 --2- 172.21.15.46:0/920855173 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5563817f35d0 0x5563817f3a50 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f32d0095ee0 tx=0x7f32d0004860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40287b9342f139e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:56:00.415 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.407+0000 7f32d6ffd700 1 --2- 172.21.15.46:0/1882891191 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f32c40a1550 0x7f32c40a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:56:00.415 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.407+0000 7f32cdffb700 1 -- 172.21.15.46:0/920855173 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d009a0e0 con 0x5563817f35d0 2023-10-19T12:56:00.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.407+0000 7f32cdffb700 1 -- 172.21.15.46:0/920855173 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f32d00999e0 con 0x5563817f35d0 2023-10-19T12:56:00.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.408+0000 7f32cdffb700 1 -- 172.21.15.46:0/920855173 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d0098ed0 con 0x5563817f35d0 2023-10-19T12:56:00.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.409+0000 7f32f1372b80 1 -- 172.21.15.46:0/920855173 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5563817f35d0 msgr2=0x5563817f3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:56:00.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.408+0000 7f32d6ffd700 1 --2- 172.21.15.46:0/1882891191 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f32c40a1550 0x7f32c40a3a10 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f32c800b070 tx=0x7f32c800b3b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:56:00.416 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.409+0000 7f32f1372b80 1 --2- 172.21.15.46:0/920855173 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5563817f35d0 0x5563817f3a50 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f32d0095ee0 tx=0x7f32d0004860 comp rx=0 tx=0).stop 2023-10-19T12:56:00.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.409+0000 7f32f1372b80 1 -- 172.21.15.46:0/920855173 shutdown_connections 2023-10-19T12:56:00.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.409+0000 7f32f1372b80 1 --2- 172.21.15.46:0/920855173 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5563817f35d0 0x5563817f3a50 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:56:00.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.409+0000 7f32f1372b80 1 --2- 172.21.15.46:0/920855173 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5563817f42d0 0x5563817f46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:56:00.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.409+0000 7f32f1372b80 1 --2- 172.21.15.46:0/920855173 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5563817f4c30 0x5563817f3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:56:00.417 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.409+0000 7f32f1372b80 1 -- 172.21.15.46:0/920855173 >> 172.21.15.46:0/920855173 conn(0x556381767720 msgr2=0x5563817edb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:56:00.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.409+0000 7f32f1372b80 1 -- 172.21.15.46:0/920855173 shutdown_connections 2023-10-19T12:56:00.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.409+0000 7f32f1372b80 1 -- 172.21.15.46:0/920855173 wait complete. 2023-10-19T12:56:00.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.410+0000 7f32f1372b80 1 -- start start 2023-10-19T12:56:00.418 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.411+0000 7f32f1372b80 1 Processor -- start 2023-10-19T12:56:00.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.411+0000 7f32f1372b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5563817f35d0 0x5563817fcb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:56:00.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.412+0000 7f32f1372b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5563817f42d0 0x5563817fd080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:56:00.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.412+0000 7f32f1372b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5563817f4c30 0x5563818040c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:56:00.420 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.412+0000 7f32ce7fc700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5563817f42d0 0x5563817fd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:56:00.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.412+0000 7f32ce7fc700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5563817f42d0 0x5563817fd080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:45944/0 (socket says 172.21.15.46:45944) 2023-10-19T12:56:00.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.412+0000 7f32d6ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5563817f35d0 0x5563817fcb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:56:00.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.412+0000 7f32d6ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5563817f35d0 0x5563817fcb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:56788/0 (socket says 172.21.15.46:56788) 2023-10-19T12:56:00.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.415+0000 7f32ce7fc700 1 -- 172.21.15.46:0/286849787 learned_addr learned my addr 172.21.15.46:0/286849787 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:56:00.421 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.415+0000 7f32f1372b80 1 -- 172.21.15.46:0/286849787 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x556381745e70 con 0x5563817f4c30 2023-10-19T12:56:00.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.415+0000 7f32f1372b80 1 -- 172.21.15.46:0/286849787 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563816e2710 con 0x5563817f42d0 2023-10-19T12:56:00.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.415+0000 7f32f1372b80 1 -- 172.21.15.46:0/286849787 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563816e23b0 con 0x5563817f35d0 2023-10-19T12:56:00.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.415+0000 7f32f1372b80 10 client.0 _ll_register_callbacks cb 0x55638162ca80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:56:00.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.416+0000 7f32d77fe700 1 --2- 172.21.15.46:0/286849787 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5563817f4c30 0x5563818040c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:56:00.422 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.416+0000 7f32ce7fc700 1 -- 172.21.15.46:0/286849787 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5563817f35d0 msgr2=0x5563817fcb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:56:00.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.416+0000 7f32ce7fc700 1 --2- 172.21.15.46:0/286849787 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5563817f35d0 0x5563817fcb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:56:00.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.416+0000 7f32ce7fc700 1 -- 172.21.15.46:0/286849787 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5563817f4c30 msgr2=0x5563818040c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:56:00.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.416+0000 7f32ce7fc700 1 --2- 172.21.15.46:0/286849787 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5563817f4c30 0x5563818040c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:56:00.423 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.416+0000 7f32ce7fc700 1 -- 172.21.15.46:0/286849787 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32d81a53c0 con 0x5563817f42d0 2023-10-19T12:56:00.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.416+0000 7f32ce7fc700 1 --2- 172.21.15.46:0/286849787 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5563817f42d0 0x5563817fd080 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f32c000e480 tx=0x7f32c000e790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54e149335195e10d server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:56:00.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.417+0000 7f32b6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.157:3300/0 2023-10-19T12:56:00.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.417+0000 7f32b6ffd700 1 -- 172.21.15.46:0/286849787 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c0013470 con 0x5563817f42d0 2023-10-19T12:56:00.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.417+0000 7f32b6ffd700 1 -- 172.21.15.46:0/286849787 <== mon.2 v2:172.21.15.157:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f32c00135d0 con 0x5563817f42d0 2023-10-19T12:56:00.424 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.417+0000 7f32f1372b80 1 -- 172.21.15.46:0/286849787 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55638174aef0 con 0x5563817f42d0 2023-10-19T12:56:00.425 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.417+0000 7f32b6ffd700 1 -- 172.21.15.46:0/286849787 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7f32c0013790 con 0x5563817f42d0 2023-10-19T12:56:00.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.417+0000 7f32f1372b80 10 client.26171 fetch_fsmap learned FSMap version 50 2023-10-19T12:56:00.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.417+0000 7f32f1372b80 1 -- 172.21.15.46:0/286849787 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) v3 -- 0x556381570de0 con 0x5563817f42d0 2023-10-19T12:56:00.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.418+0000 7f32b6ffd700 1 -- 172.21.15.46:0/286849787 <== mon.2 v2:172.21.15.157:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55638174aef0 con 0x5563817f42d0 2023-10-19T12:56:00.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.419+0000 7f32b6ffd700 1 -- 172.21.15.46:0/286849787 <== mon.2 v2:172.21.15.157:3300/0 5 ==== fsmap(e 50) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f32c0011070 con 0x5563817f42d0 2023-10-19T12:56:00.426 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.419+0000 7f32f1372b80 10 client.26171 fetch_fsmap finished waiting for FSMap version 50 2023-10-19T12:56:00.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.419+0000 7f32f1372b80 10 client.26171 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-19T12:56:00.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.419+0000 7f32f1372b80 20 client.26171 populate_metadata read hostname 'smithi046' 2023-10-19T12:56:00.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.419+0000 7f32f1372b80 1 --2- 172.21.15.46:0/286849787 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x556381808950 0x55638180ad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:56:00.427 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.419+0000 7f32f1372b80 4 client.26171 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-19T12:56:00.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.419+0000 7f32f1372b80 1 -- 172.21.15.46:0/286849787 --> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5563817c28b0 con 0x556381808950 2023-10-19T12:56:00.428 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.419+0000 7f32d6ffd700 1 --2- 172.21.15.46:0/286849787 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x556381808950 0x55638180ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:56:00.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.423+0000 7f32b6ffd700 10 client.26171 ms_handle_connect on v2:172.21.15.157:6838/552718978 2023-10-19T12:56:00.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.423+0000 7f32d6ffd700 1 --2- 172.21.15.46:0/286849787 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x556381808950 0x55638180ad70 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ca5382b5381e4b4 server_cookie=9504e21f9321e001 in_seq=0 out_seq=0 2023-10-19T12:56:00.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.423+0000 7f32b6ffd700 1 -- 172.21.15.46:0/286849787 <== mds.0 v2:172.21.15.157:6838/552718978 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5563817c28b0 con 0x556381808950 2023-10-19T12:56:00.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.423+0000 7f32b6ffd700 10 client.26171 handle_command_reply: tid=0 2023-10-19T12:56:00.429 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.424+0000 7f32f1372b80 1 client.26171 shutdown 2023-10-19T12:56:00.430 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.425+0000 7f32f1372b80 1 -- 172.21.15.46:0/286849787 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5563817f42d0 msgr2=0x5563817fd080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:56:00.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.425+0000 7f32f1372b80 1 --2- 172.21.15.46:0/286849787 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5563817f42d0 0x5563817fd080 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f32c000e480 tx=0x7f32c000e790 comp rx=0 tx=0).stop 2023-10-19T12:56:00.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.427+0000 7f32f1372b80 1 -- 172.21.15.46:0/286849787 shutdown_connections 2023-10-19T12:56:00.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.427+0000 7f32f1372b80 1 --2- 172.21.15.46:0/286849787 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x556381808950 0x55638180ad70 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:56:00.431 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.427+0000 7f32f1372b80 1 --2- 172.21.15.46:0/286849787 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5563817f4c30 0x5563818040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:56:00.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.427+0000 7f32f1372b80 1 --2- 172.21.15.46:0/286849787 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5563817f35d0 0x5563817fcb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:56:00.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.427+0000 7f32f1372b80 1 --2- 172.21.15.46:0/286849787 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5563817f42d0 0x5563817fd080 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:56:00.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.427+0000 7f32b6ffd700 0 client.26171 ms_handle_reset on v2:172.21.15.157:6838/552718978 2023-10-19T12:56:00.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.427+0000 7f32f1372b80 1 -- 172.21.15.46:0/286849787 >> 172.21.15.46:0/286849787 conn(0x556381767720 msgr2=0x5563817f2080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:56:00.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.427+0000 7f32f1372b80 1 -- 172.21.15.46:0/286849787 shutdown_connections 2023-10-19T12:56:00.432 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.427+0000 7f32f1372b80 1 -- 172.21.15.46:0/286849787 wait complete. 2023-10-19T12:56:00.433 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.428+0000 7f32f1372b80 20 client.26171 trim_cache size 0 max 16384 2023-10-19T12:56:00.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.461+0000 7f32f1372b80 1 Processor -- start 2023-10-19T12:56:00.464 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.461+0000 7f32f1372b80 1 -- start start 2023-10-19T12:56:00.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.461+0000 7f32f1372b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5563817f35d0 0x5563817f3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:56:00.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.461+0000 7f32f1372b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5563817f42d0 0x556381804080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:56:00.465 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.462+0000 7f32f1372b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5563817f4c30 0x5563817faba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:56:00.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.462+0000 7f32f1372b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563815c6920 con 0x5563817f4c30 2023-10-19T12:56:00.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.462+0000 7f32f1372b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563817efb80 con 0x5563817f42d0 2023-10-19T12:56:00.466 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.462+0000 7f32f1372b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563817ea1a0 con 0x5563817f35d0 2023-10-19T12:56:00.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.462+0000 7f32d77fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5563817f4c30 0x5563817faba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:56:00.467 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.463+0000 7f32d77fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5563817f4c30 0x5563817faba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35076/0 (socket says 172.21.15.46:35076) 2023-10-19T12:56:00.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.463+0000 7f32d77fe700 1 -- 172.21.15.46:0/464932378 learned_addr learned my addr 172.21.15.46:0/464932378 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:56:00.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.463+0000 7f32d77fe700 1 -- 172.21.15.46:0/464932378 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5563817f35d0 msgr2=0x5563817f3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:56:00.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.463+0000 7f32d77fe700 1 --2- 172.21.15.46:0/464932378 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5563817f35d0 0x5563817f3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:56:00.468 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.463+0000 7f32d77fe700 1 -- 172.21.15.46:0/464932378 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5563817f42d0 msgr2=0x556381804080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:56:00.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.463+0000 7f32d77fe700 1 --2- 172.21.15.46:0/464932378 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5563817f42d0 0x556381804080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:56:00.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.463+0000 7f32d77fe700 1 -- 172.21.15.46:0/464932378 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556381559c60 con 0x5563817f4c30 2023-10-19T12:56:00.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.464+0000 7f32d77fe700 1 --2- 172.21.15.46:0/464932378 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5563817f4c30 0x5563817faba0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f32d0096450 tx=0x7f32d0097f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a59db4c993227f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:56:00.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.464+0000 7f32ceffd700 1 -- 172.21.15.46:0/464932378 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d0010ee0 con 0x5563817f4c30 2023-10-19T12:56:00.469 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.464+0000 7f32ceffd700 1 -- 172.21.15.46:0/464932378 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f32d00a1d70 con 0x5563817f4c30 2023-10-19T12:56:00.470 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.464+0000 7f32ceffd700 1 -- 172.21.15.46:0/464932378 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d0099c40 con 0x5563817f4c30 2023-10-19T12:56:00.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.465+0000 7f32f1372b80 1 -- 172.21.15.46:0/464932378 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5563817f4c30 msgr2=0x5563817faba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:56:00.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.465+0000 7f32f1372b80 1 --2- 172.21.15.46:0/464932378 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5563817f4c30 0x5563817faba0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f32d0096450 tx=0x7f32d0097f40 comp rx=0 tx=0).stop 2023-10-19T12:56:00.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.466+0000 7f32f1372b80 1 -- 172.21.15.46:0/464932378 shutdown_connections 2023-10-19T12:56:00.471 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.466+0000 7f32f1372b80 1 --2- 172.21.15.46:0/464932378 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5563817f4c30 0x5563817faba0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:56:00.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.466+0000 7f32f1372b80 1 --2- 172.21.15.46:0/464932378 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5563817f35d0 0x5563817f3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:56:00.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.466+0000 7f32f1372b80 1 --2- 172.21.15.46:0/464932378 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5563817f42d0 0x556381804080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:56:00.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.466+0000 7f32f1372b80 1 -- 172.21.15.46:0/464932378 >> 172.21.15.46:0/464932378 conn(0x556381767720 msgr2=0x55638180f6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:56:00.472 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.466+0000 7f32f1372b80 1 -- 172.21.15.46:0/464932378 shutdown_connections 2023-10-19T12:56:00.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.466+0000 7f32f1372b80 1 -- 172.21.15.46:0/464932378 wait complete. 2023-10-19T12:56:00.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.467+0000 7f32f1372b80 1 -- start start 2023-10-19T12:56:00.473 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.467+0000 7f32f1372b80 1 Processor -- start 2023-10-19T12:56:00.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.468+0000 7f32f1372b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5563817f35d0 0x556381803be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:56:00.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.469+0000 7f32f1372b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5563817f42d0 0x556381802290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:56:00.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.469+0000 7f32f1372b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5563817f4c30 0x5563818027d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:56:00.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.469+0000 7f32d6ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5563817f35d0 0x556381803be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:56:00.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.469+0000 7f32f1372b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x556381804400 con 0x5563817f35d0 2023-10-19T12:56:00.475 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.469+0000 7f32f1372b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x556381802d10 con 0x5563817f4c30 2023-10-19T12:56:00.476 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.469+0000 7f32f1372b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x556381802e80 con 0x5563817f42d0 2023-10-19T12:56:00.476 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.469+0000 7f32d6ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5563817f35d0 0x556381803be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35086/0 (socket says 172.21.15.46:35086) 2023-10-19T12:56:00.476 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.469+0000 7f32d6ffd700 1 -- 172.21.15.46:0/3268443618 learned_addr learned my addr 172.21.15.46:0/3268443618 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:56:00.476 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.469+0000 7f32d77fe700 1 --2- 172.21.15.46:0/3268443618 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5563817f4c30 0x5563818027d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:56:00.476 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.470+0000 7f32f1372b80 10 client.0 _ll_register_callbacks cb 0x55638162ca80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:56:00.477 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.470+0000 7f32d6ffd700 1 -- 172.21.15.46:0/3268443618 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5563817f42d0 msgr2=0x556381802290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:56:00.477 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.470+0000 7f32d6ffd700 1 --2- 172.21.15.46:0/3268443618 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5563817f42d0 0x556381802290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:56:00.477 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.470+0000 7f32d6ffd700 1 -- 172.21.15.46:0/3268443618 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5563817f4c30 msgr2=0x5563818027d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:56:00.477 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.470+0000 7f32d6ffd700 1 --2- 172.21.15.46:0/3268443618 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5563817f4c30 0x5563818027d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:56:00.477 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.470+0000 7f32d6ffd700 1 -- 172.21.15.46:0/3268443618 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5563817033f0 con 0x5563817f35d0 2023-10-19T12:56:00.478 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.471+0000 7f32d6ffd700 1 --2- 172.21.15.46:0/3268443618 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5563817f35d0 0x556381803be0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f32c800b0a0 tx=0x7f32c8004dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f244bce7b48cdc0f server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:56:00.478 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.471+0000 7f32b6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2023-10-19T12:56:00.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.473+0000 7f32b6ffd700 1 -- 172.21.15.46:0/3268443618 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c802ccc0 con 0x5563817f35d0 2023-10-19T12:56:00.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.473+0000 7f32f1372b80 1 -- 172.21.15.46:0/3268443618 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f32d00999e0 con 0x5563817f35d0 2023-10-19T12:56:00.479 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.473+0000 7f32b6ffd700 1 -- 172.21.15.46:0/3268443618 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f32c8023040 con 0x5563817f35d0 2023-10-19T12:56:00.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.473+0000 7f32b6ffd700 1 -- 172.21.15.46:0/3268443618 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7f32c802ce20 con 0x5563817f35d0 2023-10-19T12:56:00.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.473+0000 7f32f1372b80 10 client.15993 fetch_fsmap learned FSMap version 50 2023-10-19T12:56:00.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.473+0000 7f32f1372b80 1 -- 172.21.15.46:0/3268443618 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) v3 -- 0x556381597250 con 0x5563817f35d0 2023-10-19T12:56:00.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.474+0000 7f32b6ffd700 1 -- 172.21.15.46:0/3268443618 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f32d00999e0 con 0x5563817f35d0 2023-10-19T12:56:00.480 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.474+0000 7f32b6ffd700 1 -- 172.21.15.46:0/3268443618 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 50) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f32c8032020 con 0x5563817f35d0 2023-10-19T12:56:00.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.474+0000 7f32f1372b80 10 client.15993 fetch_fsmap finished waiting for FSMap version 50 2023-10-19T12:56:00.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.474+0000 7f32f1372b80 10 client.15993 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-19T12:56:00.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.474+0000 7f32f1372b80 20 client.15993 populate_metadata read hostname 'smithi046' 2023-10-19T12:56:00.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.474+0000 7f32f1372b80 1 --2- 172.21.15.46:0/3268443618 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x55638185dcd0 0x5563818600f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:56:00.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.474+0000 7f32f1372b80 4 client.15993 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-19T12:56:00.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.474+0000 7f32f1372b80 1 -- 172.21.15.46:0/3268443618 --> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55638173ee50 con 0x55638185dcd0 2023-10-19T12:56:00.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.475+0000 7f32ce7fc700 1 --2- 172.21.15.46:0/3268443618 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x55638185dcd0 0x5563818600f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:56:00.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.476+0000 7f32ce7fc700 1 --2- 172.21.15.46:0/3268443618 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x55638185dcd0 0x5563818600f0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=358843f5b42b4152 server_cookie=d0b1b375c236a8ab in_seq=0 out_seq=0 2023-10-19T12:56:00.483 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.476+0000 7f32b6ffd700 10 client.15993 ms_handle_connect on v2:172.21.15.157:6838/552718978 2023-10-19T12:56:00.483 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.480+0000 7f32b6ffd700 1 -- 172.21.15.46:0/3268443618 <== mds.0 v2:172.21.15.157:6838/552718978 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55638173ee50 con 0x55638185dcd0 2023-10-19T12:56:00.483 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.480+0000 7f32b6ffd700 10 client.15993 handle_command_reply: tid=0 2023-10-19T12:56:00.484 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.480+0000 7f32f1372b80 1 client.15993 shutdown 2023-10-19T12:56:00.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.480+0000 7f32f1372b80 1 -- 172.21.15.46:0/3268443618 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5563817f35d0 msgr2=0x556381803be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:56:00.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.480+0000 7f32f1372b80 1 --2- 172.21.15.46:0/3268443618 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5563817f35d0 0x556381803be0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f32c800b0a0 tx=0x7f32c8004dd0 comp rx=0 tx=0).stop 2023-10-19T12:56:00.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.481+0000 7f32f1372b80 1 -- 172.21.15.46:0/3268443618 shutdown_connections 2023-10-19T12:56:00.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.481+0000 7f32f1372b80 1 --2- 172.21.15.46:0/3268443618 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5563817f4c30 0x5563818027d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:56:00.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.481+0000 7f32f1372b80 1 --2- 172.21.15.46:0/3268443618 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x55638185dcd0 0x5563818600f0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:56:00.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.481+0000 7f32f1372b80 1 --2- 172.21.15.46:0/3268443618 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5563817f35d0 0x556381803be0 secure :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f32c800b0a0 tx=0x7f32c8004dd0 comp rx=0 tx=0).stop 2023-10-19T12:56:00.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.481+0000 7f32f1372b80 1 --2- 172.21.15.46:0/3268443618 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5563817f42d0 0x556381802290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:56:00.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.481+0000 7f32f1372b80 1 -- 172.21.15.46:0/3268443618 >> 172.21.15.46:0/3268443618 conn(0x556381767720 msgr2=0x5563817fab60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:56:00.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.481+0000 7f32b6ffd700 0 client.15993 ms_handle_reset on v2:172.21.15.157:6838/552718978 2023-10-19T12:56:00.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.481+0000 7f32f1372b80 1 -- 172.21.15.46:0/3268443618 shutdown_connections 2023-10-19T12:56:00.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.481+0000 7f32f1372b80 1 -- 172.21.15.46:0/3268443618 wait complete. 2023-10-19T12:56:00.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.482+0000 7f32f1372b80 20 client.15993 trim_cache size 0 max 16384 2023-10-19T12:56:00.487 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-10-19T12:56:00.488 INFO:teuthology.orchestra.run.smithi046.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-19T12:56:00.488 INFO:teuthology.orchestra.run.smithi046.stdout: "scrubs": { 2023-10-19T12:56:00.488 INFO:teuthology.orchestra.run.smithi046.stdout: "21e73f70-af16-4ae7-bc34-e6c54ba8e1ec": { 2023-10-19T12:56:00.488 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2023-10-19T12:56:00.489 INFO:teuthology.orchestra.run.smithi046.stdout: "tag": "21e73f70-af16-4ae7-bc34-e6c54ba8e1ec", 2023-10-19T12:56:00.489 INFO:teuthology.orchestra.run.smithi046.stdout: "options": "recursive,force" 2023-10-19T12:56:00.489 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:56:00.489 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:56:00.490 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-10-19T12:56:00.490 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.483+0000 7f32dd9ff700 1 -- 172.21.15.46:0/1882891191 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f32c40a1550 msgr2=0x7f32c40a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:56:00.491 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.483+0000 7f32dd9ff700 1 --2- 172.21.15.46:0/1882891191 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f32c40a1550 0x7f32c40a3a10 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f32c800b070 tx=0x7f32c800b3b0 comp rx=0 tx=0).stop 2023-10-19T12:56:00.491 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.483+0000 7f32dd9ff700 1 -- 172.21.15.46:0/1882891191 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f32d8101220 msgr2=0x7f32d81a41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:56:00.491 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.483+0000 7f32dd9ff700 1 --2- 172.21.15.46:0/1882891191 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f32d8101220 0x7f32d81a41b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f32d000b550 tx=0x7f32d000b860 comp rx=0 tx=0).stop 2023-10-19T12:56:00.491 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.483+0000 7f32dd9ff700 1 -- 172.21.15.46:0/1882891191 shutdown_connections 2023-10-19T12:56:00.491 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.483+0000 7f32dd9ff700 1 --2- 172.21.15.46:0/1882891191 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f32c40a1550 0x7f32c40a3a10 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:56:00.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.483+0000 7f32dd9ff700 1 --2- 172.21.15.46:0/1882891191 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f32d8101220 0x7f32d81a41b0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:56:00.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.483+0000 7f32dd9ff700 1 --2- 172.21.15.46:0/1882891191 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32d80ff690 0x7f32d819f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:56:00.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.483+0000 7f32dd9ff700 1 --2- 172.21.15.46:0/1882891191 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f32d8100880 0x7f32d81a1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:56:00.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.483+0000 7f32dd9ff700 1 -- 172.21.15.46:0/1882891191 >> 172.21.15.46:0/1882891191 conn(0x7f32d80fac00 msgr2=0x7f32d8067830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:56:00.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.483+0000 7f32dd9ff700 1 -- 172.21.15.46:0/1882891191 shutdown_connections 2023-10-19T12:56:00.493 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:00.483+0000 7f32dd9ff700 1 -- 172.21.15.46:0/1882891191 wait complete. 2023-10-19T12:56:00.520 INFO:tasks.cephfs.filesystem:scrub status for tag:21e73f70-af16-4ae7-bc34-e6c54ba8e1ec - {'path': '/', 'tag': '21e73f70-af16-4ae7-bc34-e6c54ba8e1ec', 'options': 'recursive,force'} 2023-10-19T12:56:01.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 720.0 s, 410.8 tps, lat 255.794 ms stddev 281.092 2023-10-19T12:56:02.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:56:02 smithi157 ceph-mon[134109]: pgmap v729: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.4 MiB/s wr, 437 op/s 2023-10-19T12:56:02.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:56:02 smithi195 ceph-mon[134493]: pgmap v729: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.4 MiB/s wr, 437 op/s 2023-10-19T12:56:02.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:56:02 smithi046 ceph-mon[98509]: pgmap v729: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.4 MiB/s wr, 437 op/s 2023-10-19T12:56:04.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:56:04 smithi195 ceph-mon[134493]: pgmap v730: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.3 MiB/s wr, 403 op/s 2023-10-19T12:56:04.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:56:04 smithi046 ceph-mon[98509]: pgmap v730: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.3 MiB/s wr, 403 op/s 2023-10-19T12:56:04.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:56:04 smithi157 ceph-mon[134109]: pgmap v730: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.3 MiB/s wr, 403 op/s 2023-10-19T12:56:06.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:56:06 smithi195 ceph-mon[134493]: pgmap v731: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.2 MiB/s wr, 422 op/s 2023-10-19T12:56:06.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:56:06 smithi195 ceph-mon[134493]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-19T12:56:06.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:56:06 smithi046 ceph-mon[98509]: pgmap v731: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.2 MiB/s wr, 422 op/s 2023-10-19T12:56:06.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:56:06 smithi046 ceph-mon[98509]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-19T12:56:06.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:56:06 smithi157 ceph-mon[134109]: pgmap v731: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.2 MiB/s wr, 422 op/s 2023-10-19T12:56:06.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:56:06 smithi157 ceph-mon[134109]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-19T12:56:06.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 725.0 s, 406.4 tps, lat 229.212 ms stddev 243.997 2023-10-19T12:56:08.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:56:08 smithi195 ceph-mon[134493]: pgmap v732: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.3 MiB/s wr, 465 op/s 2023-10-19T12:56:08.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:56:08 smithi046 ceph-mon[98509]: pgmap v732: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.3 MiB/s wr, 465 op/s 2023-10-19T12:56:08.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:56:08 smithi157 ceph-mon[134109]: pgmap v732: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.3 MiB/s wr, 465 op/s 2023-10-19T12:56:10.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:56:09 smithi195 ceph-mon[134493]: pgmap v733: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 5.9 MiB/s wr, 465 op/s 2023-10-19T12:56:10.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:56:09 smithi046 ceph-mon[98509]: pgmap v733: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 5.9 MiB/s wr, 465 op/s 2023-10-19T12:56:10.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:56:09 smithi157 ceph-mon[134109]: pgmap v733: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 5.9 MiB/s wr, 465 op/s 2023-10-19T12:56:11.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 730.0 s, 445.6 tps, lat 232.730 ms stddev 268.387 2023-10-19T12:56:12.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:56:12 smithi195 ceph-mon[134493]: pgmap v734: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 6.0 MiB/s wr, 468 op/s 2023-10-19T12:56:12.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:56:12 smithi046 ceph-mon[98509]: pgmap v734: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 6.0 MiB/s wr, 468 op/s 2023-10-19T12:56:12.589 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:56:12 smithi157 ceph-mon[134109]: pgmap v734: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 6.0 MiB/s wr, 468 op/s 2023-10-19T12:56:14.385 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:56:14 smithi195 ceph-mon[134493]: pgmap v735: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 5.2 MiB/s wr, 422 op/s 2023-10-19T12:56:14.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:56:14 smithi046 ceph-mon[98509]: pgmap v735: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 5.2 MiB/s wr, 422 op/s 2023-10-19T12:56:14.597 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:56:14 smithi157 ceph-mon[134109]: pgmap v735: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 5.2 MiB/s wr, 422 op/s 2023-10-19T12:56:16.382 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:56:16 smithi195 ceph-mon[134493]: pgmap v736: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 5.6 MiB/s wr, 443 op/s 2023-10-19T12:56:16.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:56:16 smithi046 ceph-mon[98509]: pgmap v736: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 5.6 MiB/s wr, 443 op/s 2023-10-19T12:56:16.591 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:56:16 smithi157 ceph-mon[134109]: pgmap v736: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 5.6 MiB/s wr, 443 op/s 2023-10-19T12:56:16.702 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 735.0 s, 597.7 tps, lat 156.447 ms stddev 245.869 2023-10-19T12:56:18.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:56:18 smithi195 ceph-mon[134493]: pgmap v737: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 6.5 MiB/s wr, 484 op/s 2023-10-19T12:56:18.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:56:18 smithi046 ceph-mon[98509]: pgmap v737: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 6.5 MiB/s wr, 484 op/s 2023-10-19T12:56:18.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:56:18 smithi157 ceph-mon[134109]: pgmap v737: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 6.5 MiB/s wr, 484 op/s 2023-10-19T12:56:20.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:56:19 smithi195 ceph-mon[134493]: pgmap v738: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 6.7 MiB/s wr, 470 op/s 2023-10-19T12:56:20.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:56:19 smithi046 ceph-mon[98509]: pgmap v738: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 6.7 MiB/s wr, 470 op/s 2023-10-19T12:56:20.345 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:56:19 smithi157 ceph-mon[134109]: pgmap v738: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 6.7 MiB/s wr, 470 op/s 2023-10-19T12:56:21.133 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:56:20 smithi195 ceph-mon[134493]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-19T12:56:21.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:56:20 smithi046 ceph-mon[98509]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-19T12:56:21.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:56:20 smithi157 ceph-mon[134109]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-19T12:56:21.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 740.0 s, 440.5 tps, lat 241.088 ms stddev 277.097 2023-10-19T12:56:22.139 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:56:21 smithi195 ceph-mon[134493]: pgmap v739: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 5.9 MiB/s wr, 457 op/s 2023-10-19T12:56:22.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:56:21 smithi046 ceph-mon[98509]: pgmap v739: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 5.9 MiB/s wr, 457 op/s 2023-10-19T12:56:22.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:56:21 smithi157 ceph-mon[134109]: pgmap v739: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 5.9 MiB/s wr, 457 op/s 2023-10-19T12:56:24.384 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:56:24 smithi195 ceph-mon[134493]: pgmap v740: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 5.9 MiB/s wr, 441 op/s 2023-10-19T12:56:24.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:56:24 smithi046 ceph-mon[98509]: pgmap v740: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 5.9 MiB/s wr, 441 op/s 2023-10-19T12:56:24.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:56:24 smithi157 ceph-mon[134109]: pgmap v740: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 5.9 MiB/s wr, 441 op/s 2023-10-19T12:56:26.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:56:26 smithi195 ceph-mon[134493]: pgmap v741: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 6.0 MiB/s wr, 448 op/s 2023-10-19T12:56:26.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:56:26 smithi046 ceph-mon[98509]: pgmap v741: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 6.0 MiB/s wr, 448 op/s 2023-10-19T12:56:26.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:56:26 smithi157 ceph-mon[134109]: pgmap v741: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 6.0 MiB/s wr, 448 op/s 2023-10-19T12:56:26.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 745.0 s, 387.0 tps, lat 258.186 ms stddev 301.018 2023-10-19T12:56:28.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:56:28 smithi046 ceph-mon[98509]: pgmap v742: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 5.8 MiB/s wr, 494 op/s 2023-10-19T12:56:28.590 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:56:28 smithi157 ceph-mon[134109]: pgmap v742: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 5.8 MiB/s wr, 494 op/s 2023-10-19T12:56:28.634 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:56:28 smithi195 ceph-mon[134493]: pgmap v742: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 5.8 MiB/s wr, 494 op/s 2023-10-19T12:56:30.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:56:29 smithi046 ceph-mon[98509]: pgmap v743: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.0 MiB/s wr, 450 op/s 2023-10-19T12:56:30.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:56:29 smithi157 ceph-mon[134109]: pgmap v743: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.0 MiB/s wr, 450 op/s 2023-10-19T12:56:30.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:56:29 smithi195 ceph-mon[134493]: pgmap v743: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.0 MiB/s wr, 450 op/s 2023-10-19T12:56:30.521 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-19T12:56:30.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:56:30 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:56:31.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.005+0000 7f15871ff700 1 -- 172.21.15.46:0/1393783436 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f15801007a0 msgr2=0x7f1580100bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:56:31.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.005+0000 7f15871ff700 1 --2- 172.21.15.46:0/1393783436 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f15801007a0 0x7f1580100bc0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f156c0099c0 tx=0x7f156c009cd0 comp rx=0 tx=0).stop 2023-10-19T12:56:31.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.005+0000 7f15871ff700 1 -- 172.21.15.46:0/1393783436 shutdown_connections 2023-10-19T12:56:31.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.005+0000 7f15871ff700 1 --2- 172.21.15.46:0/1393783436 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1580102330 0x7f1580108be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:56:31.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.005+0000 7f15871ff700 1 --2- 172.21.15.46:0/1393783436 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f15801007a0 0x7f1580100bc0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:56:31.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.005+0000 7f15871ff700 1 --2- 172.21.15.46:0/1393783436 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1580101990 0x7f1580101df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:56:31.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.005+0000 7f15871ff700 1 -- 172.21.15.46:0/1393783436 >> 172.21.15.46:0/1393783436 conn(0x7f15800fbcf0 msgr2=0x7f15800fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:56:31.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.005+0000 7f15871ff700 1 -- 172.21.15.46:0/1393783436 shutdown_connections 2023-10-19T12:56:31.010 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.006+0000 7f15871ff700 1 -- 172.21.15.46:0/1393783436 wait complete. 2023-10-19T12:56:31.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.007+0000 7f15871ff700 1 Processor -- start 2023-10-19T12:56:31.011 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.007+0000 7f15871ff700 1 -- start start 2023-10-19T12:56:31.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.008+0000 7f15871ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f15801007a0 0x7f158006f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:56:31.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.008+0000 7f15871ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1580101990 0x7f158006f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:56:31.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.008+0000 7f15871ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1580102330 0x7f15801a6890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:56:31.012 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.008+0000 7f15871ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15800726a0 con 0x7f1580102330 2023-10-19T12:56:31.013 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.008+0000 7f15871ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1580072810 con 0x7f15801007a0 2023-10-19T12:56:31.013 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.008+0000 7f15871ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15801a6dd0 con 0x7f1580101990 2023-10-19T12:56:31.013 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.009+0000 7f158579c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1580102330 0x7f15801a6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:56:31.013 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.009+0000 7f158579c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1580102330 0x7f15801a6890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35680/0 (socket says 172.21.15.46:35680) 2023-10-19T12:56:31.014 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.009+0000 7f158579c700 1 -- 172.21.15.46:0/2017868460 learned_addr learned my addr 172.21.15.46:0/2017868460 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:56:31.014 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.010+0000 7f158579c700 1 -- 172.21.15.46:0/2017868460 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1580101990 msgr2=0x7f158006f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:56:31.014 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.010+0000 7f158579c700 1 --2- 172.21.15.46:0/2017868460 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1580101990 0x7f158006f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:56:31.014 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.010+0000 7f158579c700 1 -- 172.21.15.46:0/2017868460 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f15801007a0 msgr2=0x7f158006f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:56:31.015 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.010+0000 7f158579c700 1 --2- 172.21.15.46:0/2017868460 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f15801007a0 0x7f158006f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:56:31.015 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.010+0000 7f158579c700 1 -- 172.21.15.46:0/2017868460 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f156c0095f0 con 0x7f1580102330 2023-10-19T12:56:31.015 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.012+0000 7f158579c700 1 --2- 172.21.15.46:0/2017868460 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1580102330 0x7f15801a6890 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f1578007ee0 tx=0x7f157800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:56:31.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.012+0000 7f157dffb700 1 -- 172.21.15.46:0/2017868460 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1578017070 con 0x7f1580102330 2023-10-19T12:56:31.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.012+0000 7f15871ff700 1 -- 172.21.15.46:0/2017868460 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15801a6fd0 con 0x7f1580102330 2023-10-19T12:56:31.016 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.012+0000 7f15871ff700 1 -- 172.21.15.46:0/2017868460 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1580072d10 con 0x7f1580102330 2023-10-19T12:56:31.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.014+0000 7f157dffb700 1 -- 172.21.15.46:0/2017868460 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f157800f040 con 0x7f1580102330 2023-10-19T12:56:31.018 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.014+0000 7f157dffb700 1 -- 172.21.15.46:0/2017868460 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1578005740 con 0x7f1580102330 2023-10-19T12:56:31.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.025+0000 7f157dffb700 1 -- 172.21.15.46:0/2017868460 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f15780058a0 con 0x7f1580102330 2023-10-19T12:56:31.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.027+0000 7f159abf3b80 1 Processor -- start 2023-10-19T12:56:31.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.028+0000 7f159abf3b80 1 -- start start 2023-10-19T12:56:31.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.028+0000 7f159abf3b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557da271cae0 0x557da271cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:56:31.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.028+0000 7f159abf3b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557da271d440 0x557da271b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:56:31.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.028+0000 7f159abf3b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557da271bde0 0x557da271c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:56:31.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.028+0000 7f159abf3b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x557da26866e0 con 0x557da271bde0 2023-10-19T12:56:31.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.028+0000 7f159abf3b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x557da266cc60 con 0x557da271d440 2023-10-19T12:56:31.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.028+0000 7f159abf3b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x557da266a580 con 0x557da271cae0 2023-10-19T12:56:31.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.029+0000 7f157ffff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557da271cae0 0x557da271cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:56:31.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.029+0000 7f157ffff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557da271cae0 0x557da271cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:46782/0 (socket says 172.21.15.46:46782) 2023-10-19T12:56:31.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.029+0000 7f157ffff700 1 -- 172.21.15.46:0/568640099 learned_addr learned my addr 172.21.15.46:0/568640099 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:56:31.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.029+0000 7f157ffff700 1 --2- 172.21.15.46:0/568640099 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557da271bde0 0x557da271c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:56:31.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.030+0000 7f1584f9b700 1 --2- 172.21.15.46:0/568640099 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557da271d440 0x557da271b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:56:31.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.033+0000 7f157dffb700 1 --2- 172.21.15.46:0/2017868460 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f15700a1500 0x7f15700a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:56:31.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.033+0000 7f157dffb700 1 -- 172.21.15.46:0/2017868460 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f15780cc900 con 0x7f1580102330 2023-10-19T12:56:31.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.035+0000 7f158579c700 1 --2- 172.21.15.46:0/2017868460 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f15700a1500 0x7f15700a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:56:31.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.035+0000 7f157ffff700 1 -- 172.21.15.46:0/568640099 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557da271cae0 msgr2=0x557da271cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:56:31.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.035+0000 7f157ffff700 1 --2- 172.21.15.46:0/568640099 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557da271cae0 0x557da271cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:56:31.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.035+0000 7f157ffff700 1 -- 172.21.15.46:0/568640099 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557da271d440 msgr2=0x557da271b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:56:31.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.035+0000 7f157ffff700 1 --2- 172.21.15.46:0/568640099 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557da271d440 0x557da271b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:56:31.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.035+0000 7f157ffff700 1 -- 172.21.15.46:0/568640099 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557da26233f0 con 0x557da271bde0 2023-10-19T12:56:31.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.035+0000 7f157ffff700 1 --2- 172.21.15.46:0/568640099 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557da271bde0 0x557da271c260 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f15740134b0 tx=0x7f1574005b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=854c38a189055775 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:56:31.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.036+0000 7f158579c700 1 --2- 172.21.15.46:0/2017868460 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f15700a1500 0x7f15700a39c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f15780971c0 tx=0x7f157800b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:56:31.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.036+0000 7f156affd700 1 -- 172.21.15.46:0/568640099 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1574013d40 con 0x557da271bde0 2023-10-19T12:56:31.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.037+0000 7f156affd700 1 -- 172.21.15.46:0/568640099 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f15740044e0 con 0x557da271bde0 2023-10-19T12:56:31.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.037+0000 7f156affd700 1 -- 172.21.15.46:0/568640099 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1574011460 con 0x557da271bde0 2023-10-19T12:56:31.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.038+0000 7f159abf3b80 1 -- 172.21.15.46:0/568640099 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557da271bde0 msgr2=0x557da271c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:56:31.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.038+0000 7f159abf3b80 1 --2- 172.21.15.46:0/568640099 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557da271bde0 0x557da271c260 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f15740134b0 tx=0x7f1574005b50 comp rx=0 tx=0).stop 2023-10-19T12:56:31.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.038+0000 7f159abf3b80 1 -- 172.21.15.46:0/568640099 shutdown_connections 2023-10-19T12:56:31.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.038+0000 7f159abf3b80 1 --2- 172.21.15.46:0/568640099 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557da271bde0 0x557da271c260 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:56:31.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.038+0000 7f159abf3b80 1 --2- 172.21.15.46:0/568640099 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557da271cae0 0x557da271cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:56:31.042 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.038+0000 7f159abf3b80 1 --2- 172.21.15.46:0/568640099 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557da271d440 0x557da271b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:56:31.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.038+0000 7f159abf3b80 1 -- 172.21.15.46:0/568640099 >> 172.21.15.46:0/568640099 conn(0x557da2687720 msgr2=0x557da270db50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:56:31.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.038+0000 7f159abf3b80 1 -- 172.21.15.46:0/568640099 shutdown_connections 2023-10-19T12:56:31.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.038+0000 7f159abf3b80 1 -- 172.21.15.46:0/568640099 wait complete. 2023-10-19T12:56:31.043 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.039+0000 7f159abf3b80 1 -- start start 2023-10-19T12:56:31.044 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.039+0000 7f159abf3b80 1 Processor -- start 2023-10-19T12:56:31.045 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.040+0000 7f159abf3b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557da271bde0 0x557da2725300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:56:31.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.040+0000 7f159abf3b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557da271cae0 0x557da2725840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:56:31.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.040+0000 7f159abf3b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557da271d440 0x557da272c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:56:31.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.040+0000 7f159abf3b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x557da2665e70 con 0x557da271bde0 2023-10-19T12:56:31.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.040+0000 7f159abf3b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x557da2602710 con 0x557da271cae0 2023-10-19T12:56:31.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.040+0000 7f159abf3b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x557da26023b0 con 0x557da271d440 2023-10-19T12:56:31.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.040+0000 7f159abf3b80 10 client.0 _ll_register_callbacks cb 0x557da254ca80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:56:31.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.041+0000 7f157ffff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557da271d440 0x557da272c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:56:31.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.041+0000 7f157ffff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557da271d440 0x557da272c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:46794/0 (socket says 172.21.15.46:46794) 2023-10-19T12:56:31.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.041+0000 7f157ffff700 1 -- 172.21.15.46:0/4141794462 learned_addr learned my addr 172.21.15.46:0/4141794462 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:56:31.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.041+0000 7f157ffff700 1 --2- 172.21.15.46:0/4141794462 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557da271bde0 0x557da2725300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:56:31.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.041+0000 7f157ffff700 1 -- 172.21.15.46:0/4141794462 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557da271cae0 msgr2=0x557da2725840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:56:31.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.041+0000 7f157ffff700 1 --2- 172.21.15.46:0/4141794462 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557da271cae0 0x557da2725840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:56:31.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.041+0000 7f157ffff700 1 -- 172.21.15.46:0/4141794462 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557da271bde0 msgr2=0x557da2725300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:56:31.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.041+0000 7f157ffff700 1 --2- 172.21.15.46:0/4141794462 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557da271bde0 0x557da2725300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:56:31.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.041+0000 7f157ffff700 1 -- 172.21.15.46:0/4141794462 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f157400cd90 con 0x557da271d440 2023-10-19T12:56:31.049 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.042+0000 7f157ffff700 1 --2- 172.21.15.46:0/4141794462 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557da271d440 0x557da272c880 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f157400cd40 tx=0x7f1574004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c21b486811f37da8 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:56:31.049 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.042+0000 7f155ffff700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-10-19T12:56:31.049 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.042+0000 7f155ffff700 1 -- 172.21.15.46:0/4141794462 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1574003d60 con 0x557da271d440 2023-10-19T12:56:31.049 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.042+0000 7f155ffff700 1 -- 172.21.15.46:0/4141794462 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f1574003ec0 con 0x557da271d440 2023-10-19T12:56:31.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.044+0000 7f159abf3b80 1 -- 172.21.15.46:0/4141794462 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557da266aef0 con 0x557da271d440 2023-10-19T12:56:31.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.046+0000 7f155ffff700 1 -- 172.21.15.46:0/4141794462 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1574004080 con 0x557da271d440 2023-10-19T12:56:31.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.046+0000 7f159abf3b80 10 client.26194 fetch_fsmap learned FSMap version 52 2023-10-19T12:56:31.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.046+0000 7f159abf3b80 1 -- 172.21.15.46:0/4141794462 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) v3 -- 0x557da2490de0 con 0x557da271d440 2023-10-19T12:56:31.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.046+0000 7f155ffff700 1 -- 172.21.15.46:0/4141794462 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x557da266aef0 con 0x557da271d440 2023-10-19T12:56:31.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.048+0000 7f155ffff700 1 -- 172.21.15.46:0/4141794462 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 52) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f157401c470 con 0x557da271d440 2023-10-19T12:56:31.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.048+0000 7f159abf3b80 10 client.26194 fetch_fsmap finished waiting for FSMap version 52 2023-10-19T12:56:31.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.048+0000 7f159abf3b80 10 client.26194 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-19T12:56:31.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.048+0000 7f159abf3b80 20 client.26194 populate_metadata read hostname 'smithi046' 2023-10-19T12:56:31.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.048+0000 7f159abf3b80 1 --2- 172.21.15.46:0/4141794462 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x557da2731090 0x557da27334b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:56:31.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.048+0000 7f159abf3b80 4 client.26194 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-19T12:56:31.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.048+0000 7f159abf3b80 1 -- 172.21.15.46:0/4141794462 --> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557da26e28b0 con 0x557da2731090 2023-10-19T12:56:31.055 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.052+0000 7f1584f9b700 1 --2- 172.21.15.46:0/4141794462 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x557da2731090 0x557da27334b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:56:31.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.054+0000 7f155ffff700 10 client.26194 ms_handle_connect on v2:172.21.15.157:6838/552718978 2023-10-19T12:56:31.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.054+0000 7f1584f9b700 1 --2- 172.21.15.46:0/4141794462 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x557da2731090 0x557da27334b0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=78496bf7577a9fac server_cookie=55d585bd1329be46 in_seq=0 out_seq=0 2023-10-19T12:56:31.060 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.055+0000 7f155ffff700 1 -- 172.21.15.46:0/4141794462 <== mds.0 v2:172.21.15.157:6838/552718978 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x557da26e28b0 con 0x557da2731090 2023-10-19T12:56:31.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.056+0000 7f155ffff700 10 client.26194 handle_command_reply: tid=0 2023-10-19T12:56:31.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.056+0000 7f159abf3b80 1 client.26194 shutdown 2023-10-19T12:56:31.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.057+0000 7f159abf3b80 1 -- 172.21.15.46:0/4141794462 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557da271d440 msgr2=0x557da272c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:56:31.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.057+0000 7f159abf3b80 1 --2- 172.21.15.46:0/4141794462 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557da271d440 0x557da272c880 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f157400cd40 tx=0x7f1574004730 comp rx=0 tx=0).stop 2023-10-19T12:56:31.061 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.057+0000 7f159abf3b80 1 -- 172.21.15.46:0/4141794462 shutdown_connections 2023-10-19T12:56:31.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.057+0000 7f159abf3b80 1 --2- 172.21.15.46:0/4141794462 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557da271d440 0x557da272c880 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:56:31.062 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.057+0000 7f159abf3b80 1 --2- 172.21.15.46:0/4141794462 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x557da2731090 0x557da27334b0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:56:31.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.057+0000 7f159abf3b80 1 --2- 172.21.15.46:0/4141794462 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557da271bde0 0x557da2725300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:56:31.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.057+0000 7f159abf3b80 1 --2- 172.21.15.46:0/4141794462 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557da271cae0 0x557da2725840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:56:31.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.057+0000 7f159abf3b80 1 -- 172.21.15.46:0/4141794462 >> 172.21.15.46:0/4141794462 conn(0x557da2687720 msgr2=0x557da271a890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:56:31.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.057+0000 7f155ffff700 0 client.26194 ms_handle_reset on v2:172.21.15.157:6838/552718978 2023-10-19T12:56:31.063 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.058+0000 7f159abf3b80 1 -- 172.21.15.46:0/4141794462 shutdown_connections 2023-10-19T12:56:31.064 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.059+0000 7f159abf3b80 1 -- 172.21.15.46:0/4141794462 wait complete. 2023-10-19T12:56:31.064 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.060+0000 7f159abf3b80 20 client.26194 trim_cache size 0 max 16384 2023-10-19T12:56:31.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.104+0000 7f159abf3b80 1 Processor -- start 2023-10-19T12:56:31.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.104+0000 7f159abf3b80 1 -- start start 2023-10-19T12:56:31.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.104+0000 7f159abf3b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557da271bde0 0x557da270d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:56:31.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.104+0000 7f159abf3b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557da271cae0 0x557da272c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:56:31.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.104+0000 7f159abf3b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557da271d440 0x557da2725300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:56:31.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.104+0000 7f159abf3b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x557da24e6920 con 0x557da271cae0 2023-10-19T12:56:31.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.104+0000 7f159abf3b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x557da272da40 con 0x557da271bde0 2023-10-19T12:56:31.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.104+0000 7f159abf3b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x557da27243a0 con 0x557da271d440 2023-10-19T12:56:31.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.105+0000 7f157ffff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557da271bde0 0x557da270d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:56:31.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.105+0000 7f157ffff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557da271bde0 0x557da270d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:33538/0 (socket says 172.21.15.46:33538) 2023-10-19T12:56:31.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.105+0000 7f157ffff700 1 -- 172.21.15.46:0/1842219801 learned_addr learned my addr 172.21.15.46:0/1842219801 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:56:31.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.105+0000 7f157ffff700 1 --2- 172.21.15.46:0/1842219801 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557da271d440 0x557da2725300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:56:31.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.105+0000 7f157ffff700 1 -- 172.21.15.46:0/1842219801 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557da271d440 msgr2=0x557da2725300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:56:31.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.105+0000 7f157ffff700 1 --2- 172.21.15.46:0/1842219801 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557da271d440 0x557da2725300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:56:31.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.105+0000 7f157ffff700 1 -- 172.21.15.46:0/1842219801 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557da271cae0 msgr2=0x557da272c7a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-19T12:56:31.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.106+0000 7f157ffff700 1 --2- 172.21.15.46:0/1842219801 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557da271cae0 0x557da272c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:56:31.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.106+0000 7f157ffff700 1 -- 172.21.15.46:0/1842219801 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557da2479c60 con 0x557da271bde0 2023-10-19T12:56:31.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.106+0000 7f157ffff700 1 --2- 172.21.15.46:0/1842219801 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557da271bde0 0x557da270d810 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f15740106b0 tx=0x7f1574000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54026e87074464cb server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:56:31.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.107+0000 7f156b7fe700 1 -- 172.21.15.46:0/1842219801 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15740257a0 con 0x557da271bde0 2023-10-19T12:56:31.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.107+0000 7f156b7fe700 1 -- 172.21.15.46:0/1842219801 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1574022070 con 0x557da271bde0 2023-10-19T12:56:31.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.107+0000 7f156b7fe700 1 -- 172.21.15.46:0/1842219801 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f157401a500 con 0x557da271bde0 2023-10-19T12:56:31.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.108+0000 7f159abf3b80 1 -- 172.21.15.46:0/1842219801 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557da271bde0 msgr2=0x557da270d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:56:31.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.108+0000 7f159abf3b80 1 --2- 172.21.15.46:0/1842219801 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557da271bde0 0x557da270d810 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f15740106b0 tx=0x7f1574000bc0 comp rx=0 tx=0).stop 2023-10-19T12:56:31.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.108+0000 7f159abf3b80 1 -- 172.21.15.46:0/1842219801 shutdown_connections 2023-10-19T12:56:31.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.108+0000 7f159abf3b80 1 --2- 172.21.15.46:0/1842219801 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557da271d440 0x557da2725300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:56:31.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.108+0000 7f159abf3b80 1 --2- 172.21.15.46:0/1842219801 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557da271bde0 0x557da270d810 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:56:31.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.108+0000 7f159abf3b80 1 --2- 172.21.15.46:0/1842219801 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557da271cae0 0x557da272c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:56:31.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.108+0000 7f159abf3b80 1 -- 172.21.15.46:0/1842219801 >> 172.21.15.46:0/1842219801 conn(0x557da2687720 msgr2=0x557da2724830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:56:31.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.108+0000 7f159abf3b80 1 -- 172.21.15.46:0/1842219801 shutdown_connections 2023-10-19T12:56:31.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.108+0000 7f159abf3b80 1 -- 172.21.15.46:0/1842219801 wait complete. 2023-10-19T12:56:31.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.109+0000 7f159abf3b80 1 -- start start 2023-10-19T12:56:31.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.109+0000 7f159abf3b80 1 Processor -- start 2023-10-19T12:56:31.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.110+0000 7f159abf3b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557da271bde0 0x557da27285e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:56:31.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.110+0000 7f159abf3b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557da271cae0 0x557da2728b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:56:31.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.110+0000 7f157ffff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557da271bde0 0x557da27285e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:56:31.118 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.111+0000 7f159abf3b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557da271d440 0x557da272b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:56:31.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.111+0000 7f159abf3b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x557da272bef0 con 0x557da271d440 2023-10-19T12:56:31.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.111+0000 7f159abf3b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x557da272c060 con 0x557da271bde0 2023-10-19T12:56:31.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.111+0000 7f159abf3b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x557da272c1d0 con 0x557da271cae0 2023-10-19T12:56:31.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.111+0000 7f159abf3b80 10 client.0 _ll_register_callbacks cb 0x557da254ca80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:56:31.119 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.111+0000 7f1584f9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557da271cae0 0x557da2728b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:56:31.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.111+0000 7f1584f9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557da271cae0 0x557da2728b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:46820/0 (socket says 172.21.15.46:46820) 2023-10-19T12:56:31.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.111+0000 7f157ffff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557da271bde0 0x557da27285e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:33552/0 (socket says 172.21.15.46:33552) 2023-10-19T12:56:31.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.111+0000 7f157ffff700 1 -- 172.21.15.46:0/3672627580 learned_addr learned my addr 172.21.15.46:0/3672627580 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:56:31.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.112+0000 7f157ffff700 1 -- 172.21.15.46:0/3672627580 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557da271cae0 msgr2=0x557da2728b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:56:31.120 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.112+0000 7f157ffff700 1 --2- 172.21.15.46:0/3672627580 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557da271cae0 0x557da2728b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:56:31.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.112+0000 7f157ffff700 1 -- 172.21.15.46:0/3672627580 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557da271d440 msgr2=0x557da272b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:56:31.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.112+0000 7f157ffff700 1 --2- 172.21.15.46:0/3672627580 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557da271d440 0x557da272b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:56:31.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.112+0000 7f157ffff700 1 -- 172.21.15.46:0/3672627580 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557da2490de0 con 0x557da271bde0 2023-10-19T12:56:31.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.113+0000 7f1584f9b700 1 --2- 172.21.15.46:0/3672627580 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557da271cae0 0x557da2728b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T12:56:31.121 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.113+0000 7f157ffff700 1 --2- 172.21.15.46:0/3672627580 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557da271bde0 0x557da27285e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f157400c3a0 tx=0x7f15740039a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99a20ce5d573d59e server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:56:31.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.113+0000 7f155ffff700 10 client.0 ms_handle_connect on v2:172.21.15.157:3300/0 2023-10-19T12:56:31.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.113+0000 7f155ffff700 1 -- 172.21.15.46:0/3672627580 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1574025df0 con 0x557da271bde0 2023-10-19T12:56:31.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.113+0000 7f159abf3b80 1 -- 172.21.15.46:0/3672627580 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f15740044e0 con 0x557da271bde0 2023-10-19T12:56:31.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.113+0000 7f155ffff700 1 -- 172.21.15.46:0/3672627580 <== mon.2 v2:172.21.15.157:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f1574000e40 con 0x557da271bde0 2023-10-19T12:56:31.122 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.114+0000 7f155ffff700 1 -- 172.21.15.46:0/3672627580 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7f15740257a0 con 0x557da271bde0 2023-10-19T12:56:31.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.114+0000 7f159abf3b80 10 client.26186 fetch_fsmap learned FSMap version 52 2023-10-19T12:56:31.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.114+0000 7f159abf3b80 1 -- 172.21.15.46:0/3672627580 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) v3 -- 0x557da24b7250 con 0x557da271bde0 2023-10-19T12:56:31.123 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.114+0000 7f155ffff700 1 -- 172.21.15.46:0/3672627580 <== mon.2 v2:172.21.15.157:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f15740044e0 con 0x557da271bde0 2023-10-19T12:56:31.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.115+0000 7f155ffff700 1 -- 172.21.15.46:0/3672627580 <== mon.2 v2:172.21.15.157:3300/0 5 ==== fsmap(e 52) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f157401c470 con 0x557da271bde0 2023-10-19T12:56:31.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.115+0000 7f159abf3b80 10 client.26186 fetch_fsmap finished waiting for FSMap version 52 2023-10-19T12:56:31.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.115+0000 7f159abf3b80 10 client.26186 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-19T12:56:31.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.115+0000 7f159abf3b80 20 client.26186 populate_metadata read hostname 'smithi046' 2023-10-19T12:56:31.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.115+0000 7f159abf3b80 1 --2- 172.21.15.46:0/3672627580 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x557da2714ac0 0x557da2716ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:56:31.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.115+0000 7f159abf3b80 4 client.26186 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-19T12:56:31.125 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.115+0000 7f159abf3b80 1 -- 172.21.15.46:0/3672627580 --> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x557da265ee50 con 0x557da2714ac0 2023-10-19T12:56:31.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.116+0000 7f1584f9b700 1 --2- 172.21.15.46:0/3672627580 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x557da2714ac0 0x557da2716ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:56:31.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.118+0000 7f155ffff700 10 client.26186 ms_handle_connect on v2:172.21.15.157:6838/552718978 2023-10-19T12:56:31.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.118+0000 7f1584f9b700 1 --2- 172.21.15.46:0/3672627580 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x557da2714ac0 0x557da2716ee0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=55622b4a6a890137 server_cookie=7c5339d406a7fb0d in_seq=0 out_seq=0 2023-10-19T12:56:31.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.119+0000 7f155ffff700 1 -- 172.21.15.46:0/3672627580 <== mds.0 v2:172.21.15.157:6838/552718978 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x557da265ee50 con 0x557da2714ac0 2023-10-19T12:56:31.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.119+0000 7f155ffff700 10 client.26186 handle_command_reply: tid=0 2023-10-19T12:56:31.127 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.119+0000 7f159abf3b80 1 client.26186 shutdown 2023-10-19T12:56:31.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.122+0000 7f159abf3b80 1 -- 172.21.15.46:0/3672627580 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557da271bde0 msgr2=0x557da27285e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:56:31.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.122+0000 7f159abf3b80 1 --2- 172.21.15.46:0/3672627580 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557da271bde0 0x557da27285e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f157400c3a0 tx=0x7f15740039a0 comp rx=0 tx=0).stop 2023-10-19T12:56:31.128 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.122+0000 7f159abf3b80 1 -- 172.21.15.46:0/3672627580 shutdown_connections 2023-10-19T12:56:31.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.122+0000 7f159abf3b80 1 --2- 172.21.15.46:0/3672627580 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x557da2714ac0 0x557da2716ee0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:56:31.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.122+0000 7f159abf3b80 1 --2- 172.21.15.46:0/3672627580 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557da271d440 0x557da272b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:56:31.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.122+0000 7f155ffff700 0 client.26186 ms_handle_reset on v2:172.21.15.157:6838/552718978 2023-10-19T12:56:31.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.122+0000 7f159abf3b80 1 --2- 172.21.15.46:0/3672627580 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x557da271bde0 0x557da27285e0 secure :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f157400c3a0 tx=0x7f15740039a0 comp rx=0 tx=0).stop 2023-10-19T12:56:31.129 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.124+0000 7f159abf3b80 1 --2- 172.21.15.46:0/3672627580 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557da271cae0 0x557da2728b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:56:31.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.124+0000 7f159abf3b80 1 -- 172.21.15.46:0/3672627580 >> 172.21.15.46:0/3672627580 conn(0x557da2687720 msgr2=0x557da271fae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:56:31.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.125+0000 7f159abf3b80 1 -- 172.21.15.46:0/3672627580 shutdown_connections 2023-10-19T12:56:31.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.125+0000 7f159abf3b80 1 -- 172.21.15.46:0/3672627580 wait complete. 2023-10-19T12:56:31.130 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.125+0000 7f159abf3b80 20 client.26186 trim_cache size 0 max 16384 2023-10-19T12:56:31.131 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-10-19T12:56:31.131 INFO:teuthology.orchestra.run.smithi046.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-19T12:56:31.131 INFO:teuthology.orchestra.run.smithi046.stdout: "scrubs": { 2023-10-19T12:56:31.131 INFO:teuthology.orchestra.run.smithi046.stdout: "21e73f70-af16-4ae7-bc34-e6c54ba8e1ec": { 2023-10-19T12:56:31.132 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2023-10-19T12:56:31.132 INFO:teuthology.orchestra.run.smithi046.stdout: "tag": "21e73f70-af16-4ae7-bc34-e6c54ba8e1ec", 2023-10-19T12:56:31.132 INFO:teuthology.orchestra.run.smithi046.stdout: "options": "recursive,force" 2023-10-19T12:56:31.132 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:56:31.132 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:56:31.132 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-10-19T12:56:31.133 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.126+0000 7f15871ff700 1 -- 172.21.15.46:0/2017868460 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f15700a1500 msgr2=0x7f15700a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:56:31.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.126+0000 7f15871ff700 1 --2- 172.21.15.46:0/2017868460 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f15700a1500 0x7f15700a39c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f15780971c0 tx=0x7f157800b040 comp rx=0 tx=0).stop 2023-10-19T12:56:31.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.126+0000 7f15871ff700 1 -- 172.21.15.46:0/2017868460 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1580102330 msgr2=0x7f15801a6890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:56:31.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.126+0000 7f15871ff700 1 --2- 172.21.15.46:0/2017868460 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1580102330 0x7f15801a6890 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f1578007ee0 tx=0x7f157800d3b0 comp rx=0 tx=0).stop 2023-10-19T12:56:31.134 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.127+0000 7f15871ff700 1 -- 172.21.15.46:0/2017868460 shutdown_connections 2023-10-19T12:56:31.135 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.127+0000 7f15871ff700 1 --2- 172.21.15.46:0/2017868460 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1580102330 0x7f15801a6890 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:56:31.135 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.127+0000 7f15871ff700 1 --2- 172.21.15.46:0/2017868460 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f15801007a0 0x7f158006f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:56:31.135 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.127+0000 7f15871ff700 1 --2- 172.21.15.46:0/2017868460 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f15700a1500 0x7f15700a39c0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:56:31.135 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.127+0000 7f15871ff700 1 --2- 172.21.15.46:0/2017868460 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1580101990 0x7f158006f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:56:31.135 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.127+0000 7f15871ff700 1 -- 172.21.15.46:0/2017868460 >> 172.21.15.46:0/2017868460 conn(0x7f15800fbcf0 msgr2=0x7f1580104db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:56:31.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.127+0000 7f15871ff700 1 -- 172.21.15.46:0/2017868460 shutdown_connections 2023-10-19T12:56:31.136 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:56:31.127+0000 7f15871ff700 1 -- 172.21.15.46:0/2017868460 wait complete. 2023-10-19T12:56:31.171 INFO:tasks.cephfs.filesystem:scrub status for tag:21e73f70-af16-4ae7-bc34-e6c54ba8e1ec - {'path': '/', 'tag': '21e73f70-af16-4ae7-bc34-e6c54ba8e1ec', 'options': 'recursive,force'} 2023-10-19T12:56:31.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:56:30 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:56:31.389 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:56:30 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:56:31.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 750.0 s, 504.6 tps, lat 186.292 ms stddev 218.171 2023-10-19T12:56:32.730 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:56:32 smithi046 ceph-mon[98509]: pgmap v744: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 5.4 MiB/s wr, 478 op/s 2023-10-19T12:56:32.730 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:56:32 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:56:32.730 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:56:32 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:56:32.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:56:32 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:56:32.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:56:32 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:56:32.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:56:32 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:56:32.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:56:32 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:56:32.837 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:56:32 smithi157 ceph-mon[134109]: pgmap v744: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 5.4 MiB/s wr, 478 op/s 2023-10-19T12:56:32.838 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:56:32 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:56:32.838 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:56:32 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:56:32.838 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:56:32 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:56:32.838 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:56:32 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:56:32.838 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:56:32 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:56:32.839 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:56:32 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:56:32.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:56:32 smithi195 ceph-mon[134493]: pgmap v744: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 5.4 MiB/s wr, 478 op/s 2023-10-19T12:56:32.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:56:32 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:56:32.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:56:32 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:56:32.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:56:32 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:56:32.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:56:32 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:56:32.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:56:32 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:56:32.881 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:56:32 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:56:33.837 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:56:33 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:56:33.885 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:56:33 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:56:33.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:56:33 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:56:34.837 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:56:34 smithi157 ceph-mon[134109]: pgmap v745: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.7 MiB/s wr, 471 op/s 2023-10-19T12:56:34.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:56:34 smithi195 ceph-mon[134493]: pgmap v745: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.7 MiB/s wr, 471 op/s 2023-10-19T12:56:34.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:56:34 smithi046 ceph-mon[98509]: pgmap v745: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.7 MiB/s wr, 471 op/s 2023-10-19T12:56:36.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 755.0 s, 456.6 tps, lat 232.826 ms stddev 284.783 2023-10-19T12:56:36.837 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:56:36 smithi157 ceph-mon[134109]: pgmap v746: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.1 MiB/s wr, 460 op/s 2023-10-19T12:56:36.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:56:36 smithi195 ceph-mon[134493]: pgmap v746: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.1 MiB/s wr, 460 op/s 2023-10-19T12:56:36.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:56:36 smithi046 ceph-mon[98509]: pgmap v746: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.1 MiB/s wr, 460 op/s 2023-10-19T12:56:38.837 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:56:38 smithi157 ceph-mon[134109]: pgmap v747: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.1 MiB/s wr, 519 op/s 2023-10-19T12:56:38.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:56:38 smithi195 ceph-mon[134493]: pgmap v747: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.1 MiB/s wr, 519 op/s 2023-10-19T12:56:38.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:56:38 smithi046 ceph-mon[98509]: pgmap v747: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.1 MiB/s wr, 519 op/s 2023-10-19T12:56:40.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:56:39 smithi195 ceph-mon[134493]: pgmap v748: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.4 MiB/s wr, 452 op/s 2023-10-19T12:56:40.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:56:39 smithi046 ceph-mon[98509]: pgmap v748: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.4 MiB/s wr, 452 op/s 2023-10-19T12:56:40.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:56:39 smithi157 ceph-mon[134109]: pgmap v748: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.4 MiB/s wr, 452 op/s 2023-10-19T12:56:41.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 760.0 s, 445.8 tps, lat 225.511 ms stddev 243.234 2023-10-19T12:56:42.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:56:42 smithi195 ceph-mon[134493]: pgmap v749: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.7 MiB/s wr, 484 op/s 2023-10-19T12:56:42.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:56:42 smithi046 ceph-mon[98509]: pgmap v749: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.7 MiB/s wr, 484 op/s 2023-10-19T12:56:42.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:56:42 smithi157 ceph-mon[134109]: pgmap v749: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.7 MiB/s wr, 484 op/s 2023-10-19T12:56:44.384 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:56:44 smithi195 ceph-mon[134493]: pgmap v750: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.0 MiB/s wr, 426 op/s 2023-10-19T12:56:44.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:56:44 smithi046 ceph-mon[98509]: pgmap v750: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.0 MiB/s wr, 426 op/s 2023-10-19T12:56:44.589 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:56:44 smithi157 ceph-mon[134109]: pgmap v750: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.0 MiB/s wr, 426 op/s 2023-10-19T12:56:46.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:56:46 smithi046 ceph-mon[98509]: pgmap v751: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.5 MiB/s wr, 415 op/s 2023-10-19T12:56:46.590 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:56:46 smithi157 ceph-mon[134109]: pgmap v751: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.5 MiB/s wr, 415 op/s 2023-10-19T12:56:46.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:56:46 smithi195 ceph-mon[134493]: pgmap v751: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.5 MiB/s wr, 415 op/s 2023-10-19T12:56:46.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 765.0 s, 431.4 tps, lat 230.100 ms stddev 290.232 2023-10-19T12:56:48.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:56:48 smithi046 ceph-mon[98509]: pgmap v752: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 5.6 MiB/s wr, 471 op/s 2023-10-19T12:56:48.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:56:48 smithi157 ceph-mon[134109]: pgmap v752: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 5.6 MiB/s wr, 471 op/s 2023-10-19T12:56:48.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:56:48 smithi195 ceph-mon[134493]: pgmap v752: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 5.6 MiB/s wr, 471 op/s 2023-10-19T12:56:50.135 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:56:49 smithi195 ceph-mon[134493]: pgmap v753: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.4 MiB/s wr, 405 op/s 2023-10-19T12:56:50.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:56:49 smithi046 ceph-mon[98509]: pgmap v753: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.4 MiB/s wr, 405 op/s 2023-10-19T12:56:50.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:56:49 smithi157 ceph-mon[134109]: pgmap v753: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.4 MiB/s wr, 405 op/s 2023-10-19T12:56:51.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 770.0 s, 419.8 tps, lat 234.771 ms stddev 269.062 2023-10-19T12:56:52.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:56:52 smithi195 ceph-mon[134493]: pgmap v754: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 5.4 MiB/s wr, 455 op/s 2023-10-19T12:56:52.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:56:52 smithi046 ceph-mon[98509]: pgmap v754: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 5.4 MiB/s wr, 455 op/s 2023-10-19T12:56:52.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:56:52 smithi157 ceph-mon[134109]: pgmap v754: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 5.4 MiB/s wr, 455 op/s 2023-10-19T12:56:54.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:56:54 smithi195 ceph-mon[134493]: pgmap v755: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.3 MiB/s wr, 419 op/s 2023-10-19T12:56:54.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:56:54 smithi046 ceph-mon[98509]: pgmap v755: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.3 MiB/s wr, 419 op/s 2023-10-19T12:56:54.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:56:54 smithi157 ceph-mon[134109]: pgmap v755: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.3 MiB/s wr, 419 op/s 2023-10-19T12:56:56.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:56:56 smithi046 ceph-mon[98509]: pgmap v756: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.6 MiB/s wr, 411 op/s 2023-10-19T12:56:56.591 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:56:56 smithi157 ceph-mon[134109]: pgmap v756: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.6 MiB/s wr, 411 op/s 2023-10-19T12:56:56.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:56:56 smithi195 ceph-mon[134493]: pgmap v756: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.6 MiB/s wr, 411 op/s 2023-10-19T12:56:56.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 775.0 s, 429.8 tps, lat 238.187 ms stddev 276.073 2023-10-19T12:56:58.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:56:58 smithi046 ceph-mon[98509]: pgmap v757: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.4 MiB/s wr, 463 op/s 2023-10-19T12:56:58.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:56:58 smithi157 ceph-mon[134109]: pgmap v757: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.4 MiB/s wr, 463 op/s 2023-10-19T12:56:58.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:56:58 smithi195 ceph-mon[134493]: pgmap v757: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.4 MiB/s wr, 463 op/s 2023-10-19T12:57:00.131 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:56:59 smithi195 ceph-mon[134493]: pgmap v758: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.7 MiB/s wr, 409 op/s 2023-10-19T12:57:00.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:56:59 smithi046 ceph-mon[98509]: pgmap v758: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.7 MiB/s wr, 409 op/s 2023-10-19T12:57:00.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:56:59 smithi157 ceph-mon[134109]: pgmap v758: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.7 MiB/s wr, 409 op/s 2023-10-19T12:57:01.172 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-19T12:57:01.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.549+0000 7f697f7ff700 1 -- 172.21.15.46:0/550985957 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6978100380 msgr2=0x7f6978100800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:57:01.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.549+0000 7f697f7ff700 1 --2- 172.21.15.46:0/550985957 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6978100380 0x7f6978100800 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f696800b0a0 tx=0x7f696800b3b0 comp rx=0 tx=0).stop 2023-10-19T12:57:01.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.550+0000 7f697f7ff700 1 -- 172.21.15.46:0/550985957 shutdown_connections 2023-10-19T12:57:01.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.550+0000 7f697f7ff700 1 --2- 172.21.15.46:0/550985957 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6978100380 0x7f6978100800 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:57:01.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.550+0000 7f697f7ff700 1 --2- 172.21.15.46:0/550985957 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f69780ff060 0x7f69780ff480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:57:01.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.550+0000 7f697f7ff700 1 --2- 172.21.15.46:0/550985957 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f69780ff9c0 0x7f69780ffe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:57:01.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.550+0000 7f697f7ff700 1 -- 172.21.15.46:0/550985957 >> 172.21.15.46:0/550985957 conn(0x7f69780fac00 msgr2=0x7f69780fd040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:57:01.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.550+0000 7f697f7ff700 1 -- 172.21.15.46:0/550985957 shutdown_connections 2023-10-19T12:57:01.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.550+0000 7f697f7ff700 1 -- 172.21.15.46:0/550985957 wait complete. 2023-10-19T12:57:01.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.551+0000 7f697f7ff700 1 Processor -- start 2023-10-19T12:57:01.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.552+0000 7f697f7ff700 1 -- start start 2023-10-19T12:57:01.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.553+0000 7f697f7ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f69780ff060 0x7f6978198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:57:01.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.553+0000 7f697f7ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f69780ff9c0 0x7f6978198ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:57:01.557 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.553+0000 7f697f7ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6978100380 0x7f697819fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:57:01.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.553+0000 7f697cd9a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f69780ff9c0 0x7f6978198ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:57:01.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.553+0000 7f697cd9a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f69780ff9c0 0x7f6978198ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43346/0 (socket says 172.21.15.46:43346) 2023-10-19T12:57:01.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.553+0000 7f697cd9a700 1 -- 172.21.15.46:0/113200476 learned_addr learned my addr 172.21.15.46:0/113200476 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:57:01.560 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.554+0000 7f697d59b700 1 --2- 172.21.15.46:0/113200476 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f69780ff060 0x7f6978198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:57:01.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.557+0000 7f697dd9c700 1 --2- 172.21.15.46:0/113200476 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6978100380 0x7f697819fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:57:01.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.557+0000 7f697f7ff700 1 -- 172.21.15.46:0/113200476 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69781a04c0 con 0x7f69780ff9c0 2023-10-19T12:57:01.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.557+0000 7f697f7ff700 1 -- 172.21.15.46:0/113200476 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69781a0600 con 0x7f6978100380 2023-10-19T12:57:01.561 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.557+0000 7f697f7ff700 1 -- 172.21.15.46:0/113200476 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69781a0790 con 0x7f69780ff060 2023-10-19T12:57:01.575 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.558+0000 7f697d59b700 1 -- 172.21.15.46:0/113200476 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6978100380 msgr2=0x7f697819fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:57:01.575 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.558+0000 7f697d59b700 1 --2- 172.21.15.46:0/113200476 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6978100380 0x7f697819fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:57:01.575 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.558+0000 7f697d59b700 1 -- 172.21.15.46:0/113200476 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f69780ff9c0 msgr2=0x7f6978198ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:57:01.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.558+0000 7f697d59b700 1 --2- 172.21.15.46:0/113200476 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f69780ff9c0 0x7f6978198ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:57:01.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.558+0000 7f697d59b700 1 -- 172.21.15.46:0/113200476 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6968009d00 con 0x7f69780ff060 2023-10-19T12:57:01.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.558+0000 7f697d59b700 1 --2- 172.21.15.46:0/113200476 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f69780ff060 0x7f6978198990 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f697000b450 tx=0x7f697000b760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:57:01.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.558+0000 7f69767fc700 1 -- 172.21.15.46:0/113200476 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6970011830 con 0x7f69780ff060 2023-10-19T12:57:01.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.559+0000 7f69767fc700 1 -- 172.21.15.46:0/113200476 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6970011e50 con 0x7f69780ff060 2023-10-19T12:57:01.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.559+0000 7f69767fc700 1 -- 172.21.15.46:0/113200476 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6970010e00 con 0x7f69780ff060 2023-10-19T12:57:01.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.572+0000 7f697f7ff700 1 -- 172.21.15.46:0/113200476 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69781a0a70 con 0x7f69780ff060 2023-10-19T12:57:01.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.572+0000 7f697f7ff700 1 -- 172.21.15.46:0/113200476 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69781a0f00 con 0x7f69780ff060 2023-10-19T12:57:01.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.578+0000 7f6993184b80 1 Processor -- start 2023-10-19T12:57:01.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.580+0000 7f69767fc700 1 -- 172.21.15.46:0/113200476 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f6970010380 con 0x7f69780ff060 2023-10-19T12:57:01.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.580+0000 7f6993184b80 1 -- start start 2023-10-19T12:57:01.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.583+0000 7f6993184b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564e0453b2d0 0x564e0453b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:57:01.592 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.583+0000 7f6993184b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564e0453bc30 0x564e0453a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:57:01.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.583+0000 7f6993184b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564e0453a5d0 0x564e0453aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:57:01.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.583+0000 7f6993184b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e044ad6e0 con 0x564e0453bc30 2023-10-19T12:57:01.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.583+0000 7f6993184b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e04493c60 con 0x564e0453b2d0 2023-10-19T12:57:01.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.583+0000 7f6993184b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e04491580 con 0x564e0453a5d0 2023-10-19T12:57:01.593 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.584+0000 7f697dd9c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564e0453b2d0 0x564e0453b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:57:01.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.584+0000 7f697dd9c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564e0453b2d0 0x564e0453b6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:46898/0 (socket says 172.21.15.46:46898) 2023-10-19T12:57:01.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.584+0000 7f697dd9c700 1 -- 172.21.15.46:0/2267441608 learned_addr learned my addr 172.21.15.46:0/2267441608 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:57:01.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.584+0000 7f697dd9c700 1 -- 172.21.15.46:0/2267441608 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564e0453a5d0 msgr2=0x564e0453aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:57:01.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.584+0000 7f697dd9c700 1 --2- 172.21.15.46:0/2267441608 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564e0453a5d0 0x564e0453aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:57:01.594 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.584+0000 7f697dd9c700 1 -- 172.21.15.46:0/2267441608 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564e0453bc30 msgr2=0x564e0453a090 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-19T12:57:01.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.584+0000 7f69767fc700 1 --2- 172.21.15.46:0/113200476 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f69600a1480 0x7f69600a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:57:01.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.584+0000 7f697d59b700 1 --2- 172.21.15.46:0/2267441608 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564e0453bc30 0x564e0453a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:57:01.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.585+0000 7f697dd9c700 1 --2- 172.21.15.46:0/2267441608 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564e0453bc30 0x564e0453a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:57:01.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.585+0000 7f697dd9c700 1 -- 172.21.15.46:0/2267441608 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564e0444a3f0 con 0x564e0453b2d0 2023-10-19T12:57:01.595 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.585+0000 7f69767fc700 1 -- 172.21.15.46:0/113200476 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f69700ccb30 con 0x7f69780ff060 2023-10-19T12:57:01.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.585+0000 7f697dd9c700 1 --2- 172.21.15.46:0/2267441608 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564e0453b2d0 0x564e0453b6f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f696800b0a0 tx=0x7f6968009380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41e2d0e69c77a04f server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:57:01.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.585+0000 7f697dd9c700 1 --2- 172.21.15.46:0/113200476 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f69600a1480 0x7f69600a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:57:01.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.587+0000 7f695f7fe700 1 -- 172.21.15.46:0/2267441608 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696800e070 con 0x564e0453b2d0 2023-10-19T12:57:01.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.587+0000 7f695f7fe700 1 -- 172.21.15.46:0/2267441608 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f69680078c0 con 0x564e0453b2d0 2023-10-19T12:57:01.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.587+0000 7f695f7fe700 1 -- 172.21.15.46:0/2267441608 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696801b690 con 0x564e0453b2d0 2023-10-19T12:57:01.596 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.588+0000 7f6993184b80 1 -- 172.21.15.46:0/2267441608 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564e0453b2d0 msgr2=0x564e0453b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:57:01.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.588+0000 7f6993184b80 1 --2- 172.21.15.46:0/2267441608 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564e0453b2d0 0x564e0453b6f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f696800b0a0 tx=0x7f6968009380 comp rx=0 tx=0).stop 2023-10-19T12:57:01.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.588+0000 7f697dd9c700 1 --2- 172.21.15.46:0/113200476 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f69600a1480 0x7f69600a3940 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f6968026000 tx=0x7f6968029000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:57:01.597 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.589+0000 7f6993184b80 1 -- 172.21.15.46:0/2267441608 shutdown_connections 2023-10-19T12:57:01.598 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.589+0000 7f6993184b80 1 --2- 172.21.15.46:0/2267441608 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564e0453a5d0 0x564e0453aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:57:01.598 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.589+0000 7f6993184b80 1 --2- 172.21.15.46:0/2267441608 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564e0453b2d0 0x564e0453b6f0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:57:01.598 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.589+0000 7f6993184b80 1 --2- 172.21.15.46:0/2267441608 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564e0453bc30 0x564e0453a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:57:01.598 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.589+0000 7f6993184b80 1 -- 172.21.15.46:0/2267441608 >> 172.21.15.46:0/2267441608 conn(0x564e044ae720 msgr2=0x564e04534b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:57:01.599 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.589+0000 7f6993184b80 1 -- 172.21.15.46:0/2267441608 shutdown_connections 2023-10-19T12:57:01.599 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.589+0000 7f6993184b80 1 -- 172.21.15.46:0/2267441608 wait complete. 2023-10-19T12:57:01.599 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.591+0000 7f6993184b80 1 -- start start 2023-10-19T12:57:01.599 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.591+0000 7f6993184b80 1 Processor -- start 2023-10-19T12:57:01.599 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.592+0000 7f6993184b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564e0453a5d0 0x564e0455d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:57:01.599 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.592+0000 7f6993184b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564e0453b2d0 0x564e0455d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:57:01.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.592+0000 7f6993184b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564e0453bc30 0x564e04564920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:57:01.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.592+0000 7f6993184b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e0448ce70 con 0x564e0453a5d0 2023-10-19T12:57:01.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.592+0000 7f6993184b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e04429710 con 0x564e0453b2d0 2023-10-19T12:57:01.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.592+0000 7f6993184b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e044293b0 con 0x564e0453bc30 2023-10-19T12:57:01.600 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.592+0000 7f6993184b80 10 client.0 _ll_register_callbacks cb 0x564e04373a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:57:01.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.592+0000 7f697cd9a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564e0453b2d0 0x564e0455d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:57:01.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.592+0000 7f697cd9a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564e0453b2d0 0x564e0455d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:46900/0 (socket says 172.21.15.46:46900) 2023-10-19T12:57:01.601 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.592+0000 7f697cd9a700 1 -- 172.21.15.46:0/3230778048 learned_addr learned my addr 172.21.15.46:0/3230778048 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:57:01.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.593+0000 7f697d59b700 1 --2- 172.21.15.46:0/3230778048 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564e0453a5d0 0x564e0455d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:57:01.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.593+0000 7f697dd9c700 1 --2- 172.21.15.46:0/3230778048 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564e0453bc30 0x564e04564920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:57:01.602 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.594+0000 7f697d59b700 1 -- 172.21.15.46:0/3230778048 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564e0453bc30 msgr2=0x564e04564920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:57:01.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.594+0000 7f697d59b700 1 --2- 172.21.15.46:0/3230778048 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564e0453bc30 0x564e04564920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:57:01.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.594+0000 7f697d59b700 1 -- 172.21.15.46:0/3230778048 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564e0453b2d0 msgr2=0x564e0455d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:57:01.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.594+0000 7f697d59b700 1 --2- 172.21.15.46:0/3230778048 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564e0453b2d0 0x564e0455d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:57:01.603 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.594+0000 7f697d59b700 1 -- 172.21.15.46:0/3230778048 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f697810b700 con 0x564e0453a5d0 2023-10-19T12:57:01.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.595+0000 7f697d59b700 1 --2- 172.21.15.46:0/3230778048 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564e0453a5d0 0x564e0455d3f0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f6970099780 tx=0x7f6970099640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cde7ab2811905542 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:57:01.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.595+0000 7f695cff9700 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2023-10-19T12:57:01.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.596+0000 7f695cff9700 1 -- 172.21.15.46:0/3230778048 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69700a1b80 con 0x564e0453a5d0 2023-10-19T12:57:01.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.596+0000 7f695cff9700 1 -- 172.21.15.46:0/3230778048 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f697009a180 con 0x564e0453a5d0 2023-10-19T12:57:01.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.596+0000 7f6993184b80 1 -- 172.21.15.46:0/3230778048 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564e04491ef0 con 0x564e0453a5d0 2023-10-19T12:57:01.604 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.596+0000 7f695cff9700 1 -- 172.21.15.46:0/3230778048 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6970009280 con 0x564e0453a5d0 2023-10-19T12:57:01.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.596+0000 7f6993184b80 10 client.16008 fetch_fsmap learned FSMap version 52 2023-10-19T12:57:01.605 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.597+0000 7f6993184b80 1 -- 172.21.15.46:0/3230778048 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) v3 -- 0x564e042b7de0 con 0x564e0453a5d0 2023-10-19T12:57:01.606 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.599+0000 7f695cff9700 1 -- 172.21.15.46:0/3230778048 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x564e04491ef0 con 0x564e0453a5d0 2023-10-19T12:57:01.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.600+0000 7f695cff9700 1 -- 172.21.15.46:0/3230778048 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 52) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f6970099ce0 con 0x564e0453a5d0 2023-10-19T12:57:01.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.600+0000 7f6993184b80 10 client.16008 fetch_fsmap finished waiting for FSMap version 52 2023-10-19T12:57:01.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.600+0000 7f6993184b80 10 client.16008 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-19T12:57:01.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.600+0000 7f6993184b80 20 client.16008 populate_metadata read hostname 'smithi046' 2023-10-19T12:57:01.607 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.600+0000 7f6993184b80 1 --2- 172.21.15.46:0/3230778048 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x564e045691c0 0x564e0456b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:57:01.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.600+0000 7f6993184b80 4 client.16008 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-19T12:57:01.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.600+0000 7f6993184b80 1 -- 172.21.15.46:0/3230778048 --> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564e045098b0 con 0x564e045691c0 2023-10-19T12:57:01.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.600+0000 7f697cd9a700 1 --2- 172.21.15.46:0/3230778048 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x564e045691c0 0x564e0456b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:57:01.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.601+0000 7f697cd9a700 1 --2- 172.21.15.46:0/3230778048 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x564e045691c0 0x564e0456b5e0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d2e70ec1b35ab141 server_cookie=2ee6b53f9d709643 in_seq=0 out_seq=0 2023-10-19T12:57:01.608 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.601+0000 7f695cff9700 10 client.16008 ms_handle_connect on v2:172.21.15.157:6838/552718978 2023-10-19T12:57:01.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.602+0000 7f695cff9700 1 -- 172.21.15.46:0/3230778048 <== mds.0 v2:172.21.15.157:6838/552718978 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x564e045098b0 con 0x564e045691c0 2023-10-19T12:57:01.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.602+0000 7f695cff9700 10 client.16008 handle_command_reply: tid=0 2023-10-19T12:57:01.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.602+0000 7f6993184b80 1 client.16008 shutdown 2023-10-19T12:57:01.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.603+0000 7f6993184b80 1 -- 172.21.15.46:0/3230778048 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564e0453a5d0 msgr2=0x564e0455d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:57:01.609 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.603+0000 7f6993184b80 1 --2- 172.21.15.46:0/3230778048 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564e0453a5d0 0x564e0455d3f0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f6970099780 tx=0x7f6970099640 comp rx=0 tx=0).stop 2023-10-19T12:57:01.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.603+0000 7f6993184b80 1 -- 172.21.15.46:0/3230778048 shutdown_connections 2023-10-19T12:57:01.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.603+0000 7f6993184b80 1 --2- 172.21.15.46:0/3230778048 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564e0453bc30 0x564e04564920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:57:01.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.603+0000 7f6993184b80 1 --2- 172.21.15.46:0/3230778048 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x564e045691c0 0x564e0456b5e0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:57:01.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.603+0000 7f6993184b80 1 --2- 172.21.15.46:0/3230778048 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564e0453a5d0 0x564e0455d3f0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:57:01.610 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.603+0000 7f6993184b80 1 --2- 172.21.15.46:0/3230778048 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564e0453b2d0 0x564e0455d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:57:01.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.603+0000 7f6993184b80 1 -- 172.21.15.46:0/3230778048 >> 172.21.15.46:0/3230778048 conn(0x564e044ae720 msgr2=0x564e04539080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:57:01.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.603+0000 7f695cff9700 0 client.16008 ms_handle_reset on v2:172.21.15.157:6838/552718978 2023-10-19T12:57:01.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.603+0000 7f6993184b80 1 -- 172.21.15.46:0/3230778048 shutdown_connections 2023-10-19T12:57:01.611 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.604+0000 7f6993184b80 1 -- 172.21.15.46:0/3230778048 wait complete. 2023-10-19T12:57:01.612 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.604+0000 7f6993184b80 20 client.16008 trim_cache size 0 max 16384 2023-10-19T12:57:01.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.644+0000 7f6993184b80 1 Processor -- start 2023-10-19T12:57:01.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.645+0000 7f6993184b80 1 -- start start 2023-10-19T12:57:01.648 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.645+0000 7f6993184b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564e0453a5d0 0x564e04564fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:57:01.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.645+0000 7f6993184b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564e0453b2d0 0x564e045648b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:57:01.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.645+0000 7f6993184b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564e0453bc30 0x564e04541b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:57:01.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.645+0000 7f6993184b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e0430d920 con 0x564e0453bc30 2023-10-19T12:57:01.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.645+0000 7f6993184b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e045350a0 con 0x564e0453a5d0 2023-10-19T12:57:01.649 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.645+0000 7f6993184b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e0455e180 con 0x564e0453b2d0 2023-10-19T12:57:01.650 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.646+0000 7f697d59b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564e0453a5d0 0x564e04564fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:57:01.650 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.646+0000 7f697cd9a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564e0453b2d0 0x564e045648b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:57:01.651 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.646+0000 7f697cd9a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564e0453b2d0 0x564e045648b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:55804/0 (socket says 172.21.15.46:55804) 2023-10-19T12:57:01.651 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.646+0000 7f697cd9a700 1 -- 172.21.15.46:0/4031383522 learned_addr learned my addr 172.21.15.46:0/4031383522 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:57:01.651 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.647+0000 7f697dd9c700 1 --2- 172.21.15.46:0/4031383522 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564e0453bc30 0x564e04541b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:57:01.651 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.647+0000 7f697cd9a700 1 -- 172.21.15.46:0/4031383522 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564e0453a5d0 msgr2=0x564e04564fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:57:01.651 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.647+0000 7f697cd9a700 1 --2- 172.21.15.46:0/4031383522 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564e0453a5d0 0x564e04564fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:57:01.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.647+0000 7f697cd9a700 1 -- 172.21.15.46:0/4031383522 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564e0453bc30 msgr2=0x564e04541b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:57:01.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.647+0000 7f697cd9a700 1 --2- 172.21.15.46:0/4031383522 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564e0453bc30 0x564e04541b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:57:01.652 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.647+0000 7f697cd9a700 1 -- 172.21.15.46:0/4031383522 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564e042a0c60 con 0x564e0453b2d0 2023-10-19T12:57:01.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.648+0000 7f697cd9a700 1 --2- 172.21.15.46:0/4031383522 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564e0453b2d0 0x564e045648b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f696c000c00 tx=0x7f696c009aa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ed6a9f203074a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:57:01.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.648+0000 7f695ffff700 1 -- 172.21.15.46:0/4031383522 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696c01a070 con 0x564e0453b2d0 2023-10-19T12:57:01.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.649+0000 7f695ffff700 1 -- 172.21.15.46:0/4031383522 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f696c01e070 con 0x564e0453b2d0 2023-10-19T12:57:01.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.649+0000 7f695ffff700 1 -- 172.21.15.46:0/4031383522 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696c014c80 con 0x564e0453b2d0 2023-10-19T12:57:01.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.650+0000 7f6993184b80 1 -- 172.21.15.46:0/4031383522 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564e0453b2d0 msgr2=0x564e045648b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:57:01.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.650+0000 7f6993184b80 1 --2- 172.21.15.46:0/4031383522 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564e0453b2d0 0x564e045648b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f696c000c00 tx=0x7f696c009aa0 comp rx=0 tx=0).stop 2023-10-19T12:57:01.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.650+0000 7f6993184b80 1 -- 172.21.15.46:0/4031383522 shutdown_connections 2023-10-19T12:57:01.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.650+0000 7f6993184b80 1 --2- 172.21.15.46:0/4031383522 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564e0453bc30 0x564e04541b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:57:01.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.650+0000 7f6993184b80 1 --2- 172.21.15.46:0/4031383522 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564e0453a5d0 0x564e04564fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:57:01.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.650+0000 7f6993184b80 1 --2- 172.21.15.46:0/4031383522 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564e0453b2d0 0x564e045648b0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:57:01.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.650+0000 7f6993184b80 1 -- 172.21.15.46:0/4031383522 >> 172.21.15.46:0/4031383522 conn(0x564e044ae720 msgr2=0x564e0453a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:57:01.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.650+0000 7f6993184b80 1 -- 172.21.15.46:0/4031383522 shutdown_connections 2023-10-19T12:57:01.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.650+0000 7f6993184b80 1 -- 172.21.15.46:0/4031383522 wait complete. 2023-10-19T12:57:01.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.651+0000 7f6993184b80 1 -- start start 2023-10-19T12:57:01.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.652+0000 7f6993184b80 1 Processor -- start 2023-10-19T12:57:01.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.652+0000 7f6993184b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564e0453a5d0 0x564e04560590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:57:01.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.652+0000 7f6993184b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564e0453b2d0 0x564e04560ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:57:01.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.652+0000 7f6993184b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564e0453bc30 0x564e04563a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:57:01.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.652+0000 7f6993184b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e04563f90 con 0x564e0453a5d0 2023-10-19T12:57:01.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.652+0000 7f6993184b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e04564100 con 0x564e0453bc30 2023-10-19T12:57:01.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.652+0000 7f6993184b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e045642c0 con 0x564e0453b2d0 2023-10-19T12:57:01.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.652+0000 7f6993184b80 10 client.0 _ll_register_callbacks cb 0x564e04373a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:57:01.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.653+0000 7f697dd9c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564e0453bc30 0x564e04563a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:57:01.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.653+0000 7f697dd9c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564e0453bc30 0x564e04563a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:46918/0 (socket says 172.21.15.46:46918) 2023-10-19T12:57:01.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.653+0000 7f697cd9a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564e0453b2d0 0x564e04560ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:57:01.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.653+0000 7f697cd9a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564e0453b2d0 0x564e04560ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:55810/0 (socket says 172.21.15.46:55810) 2023-10-19T12:57:01.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.653+0000 7f697cd9a700 1 -- 172.21.15.46:0/3695603061 learned_addr learned my addr 172.21.15.46:0/3695603061 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:57:01.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.654+0000 7f697cd9a700 1 -- 172.21.15.46:0/3695603061 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564e0453bc30 msgr2=0x564e04563a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:57:01.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.654+0000 7f697cd9a700 1 --2- 172.21.15.46:0/3695603061 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564e0453bc30 0x564e04563a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:57:01.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.654+0000 7f697cd9a700 1 -- 172.21.15.46:0/3695603061 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564e0453a5d0 msgr2=0x564e04560590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:57:01.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.654+0000 7f697cd9a700 1 --2- 172.21.15.46:0/3695603061 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564e0453a5d0 0x564e04560590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:57:01.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.654+0000 7f697cd9a700 1 -- 172.21.15.46:0/3695603061 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f696c009880 con 0x564e0453b2d0 2023-10-19T12:57:01.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.654+0000 7f695cff9700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-10-19T12:57:01.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.654+0000 7f697cd9a700 1 --2- 172.21.15.46:0/3695603061 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564e0453b2d0 0x564e04560ad0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f696c00a010 tx=0x7f696c014440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=76a7706ffaf19254 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:57:01.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.655+0000 7f695cff9700 1 -- 172.21.15.46:0/3695603061 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696c01a070 con 0x564e0453b2d0 2023-10-19T12:57:01.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.655+0000 7f695cff9700 1 -- 172.21.15.46:0/3695603061 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f696c005b10 con 0x564e0453b2d0 2023-10-19T12:57:01.663 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.655+0000 7f6993184b80 1 -- 172.21.15.46:0/3695603061 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f69680078c0 con 0x564e0453b2d0 2023-10-19T12:57:01.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.656+0000 7f695cff9700 1 -- 172.21.15.46:0/3695603061 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7f696c005cd0 con 0x564e0453b2d0 2023-10-19T12:57:01.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.656+0000 7f6993184b80 10 client.26212 fetch_fsmap learned FSMap version 52 2023-10-19T12:57:01.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.656+0000 7f6993184b80 1 -- 172.21.15.46:0/3695603061 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) v3 -- 0x564e042de250 con 0x564e0453b2d0 2023-10-19T12:57:01.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.656+0000 7f695cff9700 1 -- 172.21.15.46:0/3695603061 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f69680078c0 con 0x564e0453b2d0 2023-10-19T12:57:01.664 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.657+0000 7f695cff9700 1 -- 172.21.15.46:0/3695603061 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 52) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f696c014a00 con 0x564e0453b2d0 2023-10-19T12:57:01.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.657+0000 7f6993184b80 10 client.26212 fetch_fsmap finished waiting for FSMap version 52 2023-10-19T12:57:01.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.657+0000 7f6993184b80 10 client.26212 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-19T12:57:01.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.657+0000 7f6993184b80 20 client.26212 populate_metadata read hostname 'smithi046' 2023-10-19T12:57:01.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.658+0000 7f6993184b80 1 --2- 172.21.15.46:0/3695603061 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x564e04558700 0x564e0455ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:57:01.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.658+0000 7f6993184b80 4 client.26212 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-19T12:57:01.665 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.658+0000 7f6993184b80 1 -- 172.21.15.46:0/3695603061 --> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x564e04485e50 con 0x564e04558700 2023-10-19T12:57:01.666 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.658+0000 7f697d59b700 1 --2- 172.21.15.46:0/3695603061 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x564e04558700 0x564e0455ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:57:01.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.659+0000 7f695cff9700 10 client.26212 ms_handle_connect on v2:172.21.15.157:6838/552718978 2023-10-19T12:57:01.667 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.659+0000 7f697d59b700 1 --2- 172.21.15.46:0/3695603061 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x564e04558700 0x564e0455ab20 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=40e5c16454615c12 server_cookie=a90e6e1540834bab in_seq=0 out_seq=0 2023-10-19T12:57:01.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.659+0000 7f695cff9700 1 -- 172.21.15.46:0/3695603061 <== mds.0 v2:172.21.15.157:6838/552718978 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x564e04485e50 con 0x564e04558700 2023-10-19T12:57:01.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.659+0000 7f695cff9700 10 client.26212 handle_command_reply: tid=0 2023-10-19T12:57:01.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.659+0000 7f6993184b80 1 client.26212 shutdown 2023-10-19T12:57:01.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.659+0000 7f6993184b80 1 -- 172.21.15.46:0/3695603061 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564e0453b2d0 msgr2=0x564e04560ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:57:01.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.659+0000 7f6993184b80 1 --2- 172.21.15.46:0/3695603061 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564e0453b2d0 0x564e04560ad0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f696c00a010 tx=0x7f696c014440 comp rx=0 tx=0).stop 2023-10-19T12:57:01.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.659+0000 7f6993184b80 1 -- 172.21.15.46:0/3695603061 shutdown_connections 2023-10-19T12:57:01.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.659+0000 7f6993184b80 1 --2- 172.21.15.46:0/3695603061 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x564e0453bc30 0x564e04563a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:57:01.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.659+0000 7f6993184b80 1 --2- 172.21.15.46:0/3695603061 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x564e04558700 0x564e0455ab20 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:57:01.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.659+0000 7f6993184b80 1 --2- 172.21.15.46:0/3695603061 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564e0453a5d0 0x564e04560590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:57:01.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.659+0000 7f6993184b80 1 --2- 172.21.15.46:0/3695603061 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564e0453b2d0 0x564e04560ad0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:57:01.669 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.659+0000 7f6993184b80 1 -- 172.21.15.46:0/3695603061 >> 172.21.15.46:0/3695603061 conn(0x564e044ae720 msgr2=0x564e0455c900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:57:01.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.660+0000 7f695cff9700 0 client.26212 ms_handle_reset on v2:172.21.15.157:6838/552718978 2023-10-19T12:57:01.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.660+0000 7f6993184b80 1 -- 172.21.15.46:0/3695603061 shutdown_connections 2023-10-19T12:57:01.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.660+0000 7f6993184b80 1 -- 172.21.15.46:0/3695603061 wait complete. 2023-10-19T12:57:01.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.660+0000 7f6993184b80 20 client.26212 trim_cache size 0 max 16384 2023-10-19T12:57:01.670 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-10-19T12:57:01.671 INFO:teuthology.orchestra.run.smithi046.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-19T12:57:01.671 INFO:teuthology.orchestra.run.smithi046.stdout: "scrubs": { 2023-10-19T12:57:01.671 INFO:teuthology.orchestra.run.smithi046.stdout: "21e73f70-af16-4ae7-bc34-e6c54ba8e1ec": { 2023-10-19T12:57:01.671 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2023-10-19T12:57:01.671 INFO:teuthology.orchestra.run.smithi046.stdout: "tag": "21e73f70-af16-4ae7-bc34-e6c54ba8e1ec", 2023-10-19T12:57:01.672 INFO:teuthology.orchestra.run.smithi046.stdout: "options": "recursive,force" 2023-10-19T12:57:01.672 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:57:01.672 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:57:01.672 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-10-19T12:57:01.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.661+0000 7f697f7ff700 1 -- 172.21.15.46:0/113200476 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f69600a1480 msgr2=0x7f69600a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:57:01.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.661+0000 7f697f7ff700 1 --2- 172.21.15.46:0/113200476 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f69600a1480 0x7f69600a3940 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f6968026000 tx=0x7f6968029000 comp rx=0 tx=0).stop 2023-10-19T12:57:01.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.661+0000 7f697f7ff700 1 -- 172.21.15.46:0/113200476 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f69780ff060 msgr2=0x7f6978198990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:57:01.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.661+0000 7f697f7ff700 1 --2- 172.21.15.46:0/113200476 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f69780ff060 0x7f6978198990 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f697000b450 tx=0x7f697000b760 comp rx=0 tx=0).stop 2023-10-19T12:57:01.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.662+0000 7f697f7ff700 1 -- 172.21.15.46:0/113200476 shutdown_connections 2023-10-19T12:57:01.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.662+0000 7f697f7ff700 1 --2- 172.21.15.46:0/113200476 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6978100380 0x7f697819fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:57:01.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.662+0000 7f697f7ff700 1 --2- 172.21.15.46:0/113200476 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f69600a1480 0x7f69600a3940 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:57:01.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.662+0000 7f697f7ff700 1 --2- 172.21.15.46:0/113200476 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f69780ff060 0x7f6978198990 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:57:01.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.662+0000 7f697f7ff700 1 --2- 172.21.15.46:0/113200476 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f69780ff9c0 0x7f6978198ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:57:01.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.662+0000 7f697f7ff700 1 -- 172.21.15.46:0/113200476 >> 172.21.15.46:0/113200476 conn(0x7f69780fac00 msgr2=0x7f69780fc370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:57:01.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.664+0000 7f697f7ff700 1 -- 172.21.15.46:0/113200476 shutdown_connections 2023-10-19T12:57:01.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:01.664+0000 7f697f7ff700 1 -- 172.21.15.46:0/113200476 wait complete. 2023-10-19T12:57:01.698 INFO:tasks.cephfs.filesystem:scrub status for tag:21e73f70-af16-4ae7-bc34-e6c54ba8e1ec - {'path': '/', 'tag': '21e73f70-af16-4ae7-bc34-e6c54ba8e1ec', 'options': 'recursive,force'} 2023-10-19T12:57:01.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 780.0 s, 388.0 tps, lat 246.878 ms stddev 276.115 2023-10-19T12:57:02.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:57:02 smithi195 ceph-mon[134493]: pgmap v759: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 5.1 MiB/s wr, 451 op/s 2023-10-19T12:57:02.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:57:02 smithi046 ceph-mon[98509]: pgmap v759: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 5.1 MiB/s wr, 451 op/s 2023-10-19T12:57:02.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:57:02 smithi157 ceph-mon[134109]: pgmap v759: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 5.1 MiB/s wr, 451 op/s 2023-10-19T12:57:04.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:57:04 smithi046 ceph-mon[98509]: pgmap v760: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 4.2 MiB/s wr, 400 op/s 2023-10-19T12:57:04.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:57:04 smithi157 ceph-mon[134109]: pgmap v760: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 4.2 MiB/s wr, 400 op/s 2023-10-19T12:57:04.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:57:04 smithi195 ceph-mon[134493]: pgmap v760: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 4.2 MiB/s wr, 400 op/s 2023-10-19T12:57:06.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:57:06 smithi046 ceph-mon[98509]: pgmap v761: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 4.0 MiB/s wr, 398 op/s 2023-10-19T12:57:06.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:57:06 smithi157 ceph-mon[134109]: pgmap v761: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 4.0 MiB/s wr, 398 op/s 2023-10-19T12:57:06.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:57:06 smithi195 ceph-mon[134493]: pgmap v761: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 4.0 MiB/s wr, 398 op/s 2023-10-19T12:57:06.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 785.0 s, 457.6 tps, lat 232.685 ms stddev 259.206 2023-10-19T12:57:08.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:57:08 smithi046 ceph-mon[98509]: pgmap v762: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 5.0 MiB/s wr, 457 op/s 2023-10-19T12:57:08.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:57:08 smithi157 ceph-mon[134109]: pgmap v762: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 5.0 MiB/s wr, 457 op/s 2023-10-19T12:57:08.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:57:08 smithi195 ceph-mon[134493]: pgmap v762: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 5.0 MiB/s wr, 457 op/s 2023-10-19T12:57:10.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:57:09 smithi195 ceph-mon[134493]: pgmap v763: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 4.5 MiB/s wr, 410 op/s 2023-10-19T12:57:10.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:57:09 smithi046 ceph-mon[98509]: pgmap v763: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 4.5 MiB/s wr, 410 op/s 2023-10-19T12:57:10.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:57:09 smithi157 ceph-mon[134109]: pgmap v763: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 4.5 MiB/s wr, 410 op/s 2023-10-19T12:57:11.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 790.0 s, 456.4 tps, lat 215.459 ms stddev 261.511 2023-10-19T12:57:12.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:57:12 smithi195 ceph-mon[134493]: pgmap v764: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 4.2 MiB/s wr, 408 op/s 2023-10-19T12:57:12.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:57:12 smithi046 ceph-mon[98509]: pgmap v764: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 4.2 MiB/s wr, 408 op/s 2023-10-19T12:57:12.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:57:12 smithi157 ceph-mon[134109]: pgmap v764: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 4.2 MiB/s wr, 408 op/s 2023-10-19T12:57:14.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:57:14 smithi046 ceph-mon[98509]: pgmap v765: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 4.6 MiB/s wr, 428 op/s 2023-10-19T12:57:14.589 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:57:14 smithi157 ceph-mon[134109]: pgmap v765: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 4.6 MiB/s wr, 428 op/s 2023-10-19T12:57:14.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:57:14 smithi195 ceph-mon[134493]: pgmap v765: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 4.6 MiB/s wr, 428 op/s 2023-10-19T12:57:16.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:57:16 smithi046 ceph-mon[98509]: pgmap v766: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 4.6 MiB/s wr, 433 op/s 2023-10-19T12:57:16.589 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:57:16 smithi157 ceph-mon[134109]: pgmap v766: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 4.6 MiB/s wr, 433 op/s 2023-10-19T12:57:16.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:57:16 smithi195 ceph-mon[134493]: pgmap v766: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 4.6 MiB/s wr, 433 op/s 2023-10-19T12:57:16.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 795.0 s, 436.0 tps, lat 223.337 ms stddev 273.563 2023-10-19T12:57:18.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:57:18 smithi046 ceph-mon[98509]: pgmap v767: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 5.1 MiB/s wr, 482 op/s 2023-10-19T12:57:18.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:57:18 smithi157 ceph-mon[134109]: pgmap v767: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 5.1 MiB/s wr, 482 op/s 2023-10-19T12:57:18.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:57:18 smithi195 ceph-mon[134493]: pgmap v767: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 5.1 MiB/s wr, 482 op/s 2023-10-19T12:57:20.134 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:57:19 smithi195 ceph-mon[134493]: pgmap v768: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 4.5 MiB/s wr, 426 op/s 2023-10-19T12:57:20.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:57:19 smithi046 ceph-mon[98509]: pgmap v768: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 4.5 MiB/s wr, 426 op/s 2023-10-19T12:57:20.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:57:19 smithi157 ceph-mon[134109]: pgmap v768: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 4.5 MiB/s wr, 426 op/s 2023-10-19T12:57:21.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 800.0 s, 433.6 tps, lat 236.154 ms stddev 304.784 2023-10-19T12:57:22.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:57:22 smithi195 ceph-mon[134493]: pgmap v769: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 4.5 MiB/s wr, 424 op/s 2023-10-19T12:57:22.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:57:22 smithi046 ceph-mon[98509]: pgmap v769: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 4.5 MiB/s wr, 424 op/s 2023-10-19T12:57:22.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:57:22 smithi157 ceph-mon[134109]: pgmap v769: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 4.5 MiB/s wr, 424 op/s 2023-10-19T12:57:24.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:57:24 smithi046 ceph-mon[98509]: pgmap v770: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 5.1 MiB/s wr, 480 op/s 2023-10-19T12:57:24.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:57:24 smithi157 ceph-mon[134109]: pgmap v770: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 5.1 MiB/s wr, 480 op/s 2023-10-19T12:57:24.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:57:24 smithi195 ceph-mon[134493]: pgmap v770: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 5.1 MiB/s wr, 480 op/s 2023-10-19T12:57:26.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:57:26 smithi046 ceph-mon[98509]: pgmap v771: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 4.4 MiB/s wr, 425 op/s 2023-10-19T12:57:26.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:57:26 smithi157 ceph-mon[134109]: pgmap v771: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 4.4 MiB/s wr, 425 op/s 2023-10-19T12:57:26.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:57:26 smithi195 ceph-mon[134493]: pgmap v771: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 4.4 MiB/s wr, 425 op/s 2023-10-19T12:57:26.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 805.0 s, 482.2 tps, lat 209.888 ms stddev 263.740 2023-10-19T12:57:28.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:57:28 smithi046 ceph-mon[98509]: pgmap v772: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 5.1 MiB/s wr, 485 op/s 2023-10-19T12:57:28.590 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:57:28 smithi157 ceph-mon[134109]: pgmap v772: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 5.1 MiB/s wr, 485 op/s 2023-10-19T12:57:28.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:57:28 smithi195 ceph-mon[134493]: pgmap v772: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 5.1 MiB/s wr, 485 op/s 2023-10-19T12:57:30.130 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:57:29 smithi195 ceph-mon[134493]: pgmap v773: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 4.9 MiB/s wr, 449 op/s 2023-10-19T12:57:30.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:57:29 smithi046 ceph-mon[98509]: pgmap v773: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 4.9 MiB/s wr, 449 op/s 2023-10-19T12:57:30.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:57:29 smithi157 ceph-mon[134109]: pgmap v773: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 4.9 MiB/s wr, 449 op/s 2023-10-19T12:57:31.698 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-19T12:57:31.700 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 810.0 s, 463.8 tps, lat 211.681 ms stddev 244.254 2023-10-19T12:57:32.101 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.096+0000 7f8759dff700 1 -- 172.21.15.46:0/2696584156 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f875410a390 msgr2=0x7f875410c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:57:32.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.096+0000 7f8759dff700 1 --2- 172.21.15.46:0/2696584156 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f875410a390 0x7f875410c7e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f87480074e0 tx=0x7f874800af90 comp rx=0 tx=0).stop 2023-10-19T12:57:32.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.098+0000 7f8759dff700 1 -- 172.21.15.46:0/2696584156 shutdown_connections 2023-10-19T12:57:32.102 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.098+0000 7f8759dff700 1 --2- 172.21.15.46:0/2696584156 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f875410ce70 0x7f875410f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:57:32.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.098+0000 7f8759dff700 1 --2- 172.21.15.46:0/2696584156 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f87541079d0 0x7f8754109dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:57:32.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.098+0000 7f8759dff700 1 --2- 172.21.15.46:0/2696584156 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f875410a390 0x7f875410c7e0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:57:32.103 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.098+0000 7f8759dff700 1 -- 172.21.15.46:0/2696584156 >> 172.21.15.46:0/2696584156 conn(0x7f875406d990 msgr2=0x7f875406fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:57:32.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.098+0000 7f8759dff700 1 -- 172.21.15.46:0/2696584156 shutdown_connections 2023-10-19T12:57:32.104 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.098+0000 7f8759dff700 1 -- 172.21.15.46:0/2696584156 wait complete. 2023-10-19T12:57:32.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.100+0000 7f8759dff700 1 Processor -- start 2023-10-19T12:57:32.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.101+0000 7f8759dff700 1 -- start start 2023-10-19T12:57:32.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.101+0000 7f8759dff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f87541079d0 0x7f87541a55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:57:32.105 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.102+0000 7f8759dff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f875410a390 0x7f87541a5b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:57:32.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.102+0000 7f8759dff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f875410ce70 0x7f87541acb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:57:32.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.102+0000 7f87537fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f87541079d0 0x7f87541a55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:57:32.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.102+0000 7f8759dff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87541ad0f0 con 0x7f875410ce70 2023-10-19T12:57:32.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.102+0000 7f8759dff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87541ad230 con 0x7f87541079d0 2023-10-19T12:57:32.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.102+0000 7f87537fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f87541079d0 0x7f87541a55c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:60282/0 (socket says 172.21.15.46:60282) 2023-10-19T12:57:32.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.102+0000 7f87537fe700 1 -- 172.21.15.46:0/3765796785 learned_addr learned my addr 172.21.15.46:0/3765796785 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:57:32.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.102+0000 7f8759dff700 1 -- 172.21.15.46:0/3765796785 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87541ad3c0 con 0x7f875410a390 2023-10-19T12:57:32.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.102+0000 7f8752ffd700 1 --2- 172.21.15.46:0/3765796785 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f875410a390 0x7f87541a5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:57:32.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.103+0000 7f87537fe700 1 -- 172.21.15.46:0/3765796785 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f875410a390 msgr2=0x7f87541a5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:57:32.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.103+0000 7f87537fe700 1 --2- 172.21.15.46:0/3765796785 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f875410a390 0x7f87541a5b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:57:32.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.103+0000 7f87537fe700 1 -- 172.21.15.46:0/3765796785 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f875410ce70 msgr2=0x7f87541acb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:57:32.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.103+0000 7f87537fe700 1 --2- 172.21.15.46:0/3765796785 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f875410ce70 0x7f87541acb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:57:32.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.103+0000 7f87537fe700 1 -- 172.21.15.46:0/3765796785 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87480071c0 con 0x7f87541079d0 2023-10-19T12:57:32.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.103+0000 7f87537fe700 1 --2- 172.21.15.46:0/3765796785 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f87541079d0 0x7f87541a55c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8744007f10 tx=0x7f874400d3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:57:32.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.105+0000 7f8750ff9700 1 -- 172.21.15.46:0/3765796785 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f874400ddd0 con 0x7f87541079d0 2023-10-19T12:57:32.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.105+0000 7f8750ff9700 1 -- 172.21.15.46:0/3765796785 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f874400f040 con 0x7f87541079d0 2023-10-19T12:57:32.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.105+0000 7f8750ff9700 1 -- 172.21.15.46:0/3765796785 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8744012770 con 0x7f87541079d0 2023-10-19T12:57:32.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.106+0000 7f8759dff700 1 -- 172.21.15.46:0/3765796785 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87541ad6a0 con 0x7f87541079d0 2023-10-19T12:57:32.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.107+0000 7f8759dff700 1 -- 172.21.15.46:0/3765796785 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87541adb30 con 0x7f87541079d0 2023-10-19T12:57:32.124 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.121+0000 7f8750ff9700 1 -- 172.21.15.46:0/3765796785 <== mon.2 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f8744004ad0 con 0x7f87541079d0 2023-10-19T12:57:32.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.123+0000 7f8750ff9700 1 --2- 172.21.15.46:0/3765796785 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f873c0a1600 0x7f873c0a3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:57:32.126 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.123+0000 7f8750ff9700 1 -- 172.21.15.46:0/3765796785 <== mon.2 v2:172.21.15.157:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f87440cc490 con 0x7f87541079d0 2023-10-19T12:57:32.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.125+0000 7f8752ffd700 1 --2- 172.21.15.46:0/3765796785 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f873c0a1600 0x7f873c0a3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:57:32.131 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.126+0000 7f8752ffd700 1 --2- 172.21.15.46:0/3765796785 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f873c0a1600 0x7f873c0a3ac0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f8748000c00 tx=0x7f8748005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:57:32.135 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.132+0000 7f876d742b80 1 Processor -- start 2023-10-19T12:57:32.137 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.134+0000 7f876d742b80 1 -- start start 2023-10-19T12:57:32.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.134+0000 7f876d742b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56494a5de2d0 0x56494a5de6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:57:32.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.134+0000 7f876d742b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56494a5dec30 0x56494a5dd090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:57:32.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.134+0000 7f876d742b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56494a5dd5d0 0x56494a5dda50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:57:32.138 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.135+0000 7f876d742b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x56494a5506e0 con 0x56494a5dec30 2023-10-19T12:57:32.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.135+0000 7f876d742b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x56494a536c60 con 0x56494a5de2d0 2023-10-19T12:57:32.139 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.135+0000 7f876d742b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56494a534580 con 0x56494a5dd5d0 2023-10-19T12:57:32.140 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.135+0000 7f8753fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56494a5dd5d0 0x56494a5dda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:57:32.140 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.137+0000 7f87537fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56494a5de2d0 0x56494a5de6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:57:32.140 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.137+0000 7f87537fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56494a5de2d0 0x56494a5de6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:60286/0 (socket says 172.21.15.46:60286) 2023-10-19T12:57:32.141 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.137+0000 7f87537fe700 1 -- 172.21.15.46:0/1938293088 learned_addr learned my addr 172.21.15.46:0/1938293088 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:57:32.143 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.140+0000 7f8752ffd700 1 --2- 172.21.15.46:0/1938293088 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56494a5dec30 0x56494a5dd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:57:32.144 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.141+0000 7f8753fff700 1 -- 172.21.15.46:0/1938293088 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56494a5de2d0 msgr2=0x56494a5de6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:57:32.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.141+0000 7f8753fff700 1 --2- 172.21.15.46:0/1938293088 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56494a5de2d0 0x56494a5de6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:57:32.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.141+0000 7f8753fff700 1 -- 172.21.15.46:0/1938293088 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56494a5dec30 msgr2=0x56494a5dd090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:57:32.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.141+0000 7f8753fff700 1 --2- 172.21.15.46:0/1938293088 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56494a5dec30 0x56494a5dd090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:57:32.145 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.141+0000 7f8753fff700 1 -- 172.21.15.46:0/1938293088 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56494a4ed3f0 con 0x56494a5dd5d0 2023-10-19T12:57:32.148 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.145+0000 7f8753fff700 1 --2- 172.21.15.46:0/1938293088 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56494a5dd5d0 0x56494a5dda50 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f874c009b50 tx=0x7f874c009e60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e220c4fca249e093 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:57:32.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.153+0000 7f8739ffb700 1 -- 172.21.15.46:0/1938293088 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f874c004230 con 0x56494a5dd5d0 2023-10-19T12:57:32.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.153+0000 7f8739ffb700 1 -- 172.21.15.46:0/1938293088 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f874c00ed40 con 0x56494a5dd5d0 2023-10-19T12:57:32.156 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.153+0000 7f8739ffb700 1 -- 172.21.15.46:0/1938293088 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f874c005020 con 0x56494a5dd5d0 2023-10-19T12:57:32.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.154+0000 7f876d742b80 1 -- 172.21.15.46:0/1938293088 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56494a5dd5d0 msgr2=0x56494a5dda50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:57:32.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.154+0000 7f876d742b80 1 --2- 172.21.15.46:0/1938293088 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56494a5dd5d0 0x56494a5dda50 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f874c009b50 tx=0x7f874c009e60 comp rx=0 tx=0).stop 2023-10-19T12:57:32.157 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.154+0000 7f876d742b80 1 -- 172.21.15.46:0/1938293088 shutdown_connections 2023-10-19T12:57:32.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.154+0000 7f876d742b80 1 --2- 172.21.15.46:0/1938293088 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56494a5dd5d0 0x56494a5dda50 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:57:32.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.154+0000 7f876d742b80 1 --2- 172.21.15.46:0/1938293088 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56494a5de2d0 0x56494a5de6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:57:32.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.154+0000 7f876d742b80 1 --2- 172.21.15.46:0/1938293088 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56494a5dec30 0x56494a5dd090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:57:32.158 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.154+0000 7f876d742b80 1 -- 172.21.15.46:0/1938293088 >> 172.21.15.46:0/1938293088 conn(0x56494a551720 msgr2=0x56494a5d7b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:57:32.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.154+0000 7f876d742b80 1 -- 172.21.15.46:0/1938293088 shutdown_connections 2023-10-19T12:57:32.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.154+0000 7f876d742b80 1 -- 172.21.15.46:0/1938293088 wait complete. 2023-10-19T12:57:32.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.155+0000 7f876d742b80 1 -- start start 2023-10-19T12:57:32.159 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.155+0000 7f876d742b80 1 Processor -- start 2023-10-19T12:57:32.160 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.157+0000 7f876d742b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56494a5dd5d0 0x56494a5e6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:57:32.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.159+0000 7f876d742b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56494a5de2d0 0x56494a5e70b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:57:32.162 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.159+0000 7f876d742b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56494a5dec30 0x56494a5ee0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:57:32.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.159+0000 7f87537fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56494a5dd5d0 0x56494a5e6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:57:32.163 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.159+0000 7f87537fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56494a5dd5d0 0x56494a5e6b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:57894/0 (socket says 172.21.15.46:57894) 2023-10-19T12:57:32.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.159+0000 7f87537fe700 1 -- 172.21.15.46:0/3769768491 learned_addr learned my addr 172.21.15.46:0/3769768491 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:57:32.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.159+0000 7f876d742b80 1 -- 172.21.15.46:0/3769768491 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x56494a52fe70 con 0x56494a5de2d0 2023-10-19T12:57:32.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.159+0000 7f876d742b80 1 -- 172.21.15.46:0/3769768491 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x56494a4cc710 con 0x56494a5dec30 2023-10-19T12:57:32.164 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.159+0000 7f876d742b80 1 -- 172.21.15.46:0/3769768491 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56494a4cc3b0 con 0x56494a5dd5d0 2023-10-19T12:57:32.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.159+0000 7f8752ffd700 1 --2- 172.21.15.46:0/3769768491 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56494a5de2d0 0x56494a5e70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:57:32.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.159+0000 7f876d742b80 10 client.0 _ll_register_callbacks cb 0x56494a416a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:57:32.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.160+0000 7f8753fff700 1 --2- 172.21.15.46:0/3769768491 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56494a5dec30 0x56494a5ee0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:57:32.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.160+0000 7f87537fe700 1 -- 172.21.15.46:0/3769768491 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56494a5dec30 msgr2=0x56494a5ee0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:57:32.165 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.160+0000 7f87537fe700 1 --2- 172.21.15.46:0/3769768491 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56494a5dec30 0x56494a5ee0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:57:32.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.160+0000 7f87537fe700 1 -- 172.21.15.46:0/3769768491 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56494a5de2d0 msgr2=0x56494a5e70b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:57:32.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.160+0000 7f87537fe700 1 --2- 172.21.15.46:0/3769768491 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56494a5de2d0 0x56494a5e70b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:57:32.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.160+0000 7f87537fe700 1 -- 172.21.15.46:0/3769768491 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f874c009800 con 0x56494a5dd5d0 2023-10-19T12:57:32.166 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.160+0000 7f8752ffd700 1 --2- 172.21.15.46:0/3769768491 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56494a5de2d0 0x56494a5e70b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:57:32.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.160+0000 7f87537fe700 1 --2- 172.21.15.46:0/3769768491 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56494a5dd5d0 0x56494a5e6b70 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f874400d7b0 tx=0x7f8744019270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c71ec55b4de5fa0a server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:57:32.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.160+0000 7f8732ffd700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-10-19T12:57:32.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.161+0000 7f8732ffd700 1 -- 172.21.15.46:0/3769768491 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87440b1ea0 con 0x56494a5dd5d0 2023-10-19T12:57:32.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.161+0000 7f8732ffd700 1 -- 172.21.15.46:0/3769768491 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f8744099ae0 con 0x56494a5dd5d0 2023-10-19T12:57:32.167 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.161+0000 7f876d742b80 1 -- 172.21.15.46:0/3769768491 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56494a534ef0 con 0x56494a5dd5d0 2023-10-19T12:57:32.168 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.161+0000 7f8732ffd700 1 -- 172.21.15.46:0/3769768491 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7f87440993e0 con 0x56494a5dd5d0 2023-10-19T12:57:32.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.162+0000 7f876d742b80 10 client.26224 fetch_fsmap learned FSMap version 52 2023-10-19T12:57:32.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.162+0000 7f876d742b80 1 -- 172.21.15.46:0/3769768491 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({fsmap=52}) v3 -- 0x56494a35ade0 con 0x56494a5dd5d0 2023-10-19T12:57:32.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.162+0000 7f8732ffd700 1 -- 172.21.15.46:0/3769768491 <== mon.1 v2:172.21.15.195:3300/0 4 ==== fsmap(e 52) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f87440cc160 con 0x56494a5dd5d0 2023-10-19T12:57:32.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.163+0000 7f876d742b80 10 client.26224 fetch_fsmap finished waiting for FSMap version 52 2023-10-19T12:57:32.169 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.163+0000 7f876d742b80 10 client.26224 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-19T12:57:32.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.163+0000 7f876d742b80 20 client.26224 populate_metadata read hostname 'smithi046' 2023-10-19T12:57:32.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.163+0000 7f876d742b80 1 --2- 172.21.15.46:0/3769768491 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x56494a5f26c0 0x56494a5f4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:57:32.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.163+0000 7f876d742b80 4 client.26224 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-19T12:57:32.170 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.163+0000 7f876d742b80 1 -- 172.21.15.46:0/3769768491 --> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56494a5ac8b0 con 0x56494a5f26c0 2023-10-19T12:57:32.171 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.166+0000 7f8752ffd700 1 --2- 172.21.15.46:0/3769768491 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x56494a5f26c0 0x56494a5f4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:57:32.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.167+0000 7f8752ffd700 1 --2- 172.21.15.46:0/3769768491 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x56494a5f26c0 0x56494a5f4ab0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1575b533efc054b2 server_cookie=92d088aba639a636 in_seq=0 out_seq=0 2023-10-19T12:57:32.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.167+0000 7f8732ffd700 10 client.26224 ms_handle_connect on v2:172.21.15.157:6838/552718978 2023-10-19T12:57:32.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.167+0000 7f8732ffd700 1 -- 172.21.15.46:0/3769768491 <== mds.0 v2:172.21.15.157:6838/552718978 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56494a5ac8b0 con 0x56494a5f26c0 2023-10-19T12:57:32.172 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.168+0000 7f8732ffd700 10 client.26224 handle_command_reply: tid=0 2023-10-19T12:57:32.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.168+0000 7f876d742b80 1 client.26224 shutdown 2023-10-19T12:57:32.173 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.170+0000 7f876d742b80 1 -- 172.21.15.46:0/3769768491 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56494a5dd5d0 msgr2=0x56494a5e6b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:57:32.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.170+0000 7f876d742b80 1 --2- 172.21.15.46:0/3769768491 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56494a5dd5d0 0x56494a5e6b70 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f874400d7b0 tx=0x7f8744019270 comp rx=0 tx=0).stop 2023-10-19T12:57:32.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.170+0000 7f876d742b80 1 -- 172.21.15.46:0/3769768491 shutdown_connections 2023-10-19T12:57:32.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.170+0000 7f876d742b80 1 --2- 172.21.15.46:0/3769768491 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56494a5dec30 0x56494a5ee0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:57:32.174 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.170+0000 7f876d742b80 1 --2- 172.21.15.46:0/3769768491 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56494a5dd5d0 0x56494a5e6b70 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:57:32.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.170+0000 7f876d742b80 1 --2- 172.21.15.46:0/3769768491 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x56494a5f26c0 0x56494a5f4ab0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:57:32.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.170+0000 7f8732ffd700 0 client.26224 ms_handle_reset on v2:172.21.15.157:6838/552718978 2023-10-19T12:57:32.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.170+0000 7f876d742b80 1 --2- 172.21.15.46:0/3769768491 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56494a5de2d0 0x56494a5e70b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:57:32.175 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.170+0000 7f876d742b80 1 -- 172.21.15.46:0/3769768491 >> 172.21.15.46:0/3769768491 conn(0x56494a551720 msgr2=0x56494a5d7b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:57:32.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.173+0000 7f876d742b80 1 -- 172.21.15.46:0/3769768491 shutdown_connections 2023-10-19T12:57:32.176 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.173+0000 7f876d742b80 1 -- 172.21.15.46:0/3769768491 wait complete. 2023-10-19T12:57:32.177 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.173+0000 7f876d742b80 20 client.26224 trim_cache size 0 max 16384 2023-10-19T12:57:32.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.211+0000 7f876d742b80 1 Processor -- start 2023-10-19T12:57:32.214 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.211+0000 7f876d742b80 1 -- start start 2023-10-19T12:57:32.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.212+0000 7f876d742b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56494a5dd5d0 0x56494a5dd090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:57:32.215 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.212+0000 7f876d742b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56494a5de2d0 0x56494a5ee0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:57:32.216 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.212+0000 7f876d742b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56494a5dec30 0x56494a5e6080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:57:32.216 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.212+0000 7f876d742b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x56494a3b0920 con 0x56494a5dd5d0 2023-10-19T12:57:32.216 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.212+0000 7f876d742b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x56494a5f24c0 con 0x56494a5dec30 2023-10-19T12:57:32.216 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.212+0000 7f876d742b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56494a5d9b80 con 0x56494a5de2d0 2023-10-19T12:57:32.217 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.212+0000 7f87537fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56494a5dd5d0 0x56494a5dd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:57:32.217 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.213+0000 7f87537fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56494a5dd5d0 0x56494a5dd090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34366/0 (socket says 172.21.15.46:34366) 2023-10-19T12:57:32.218 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.213+0000 7f8752ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56494a5de2d0 0x56494a5ee0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:57:32.218 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.213+0000 7f87537fe700 1 -- 172.21.15.46:0/2095779231 learned_addr learned my addr 172.21.15.46:0/2095779231 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:57:32.218 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.213+0000 7f8753fff700 1 --2- 172.21.15.46:0/2095779231 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56494a5dec30 0x56494a5e6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:57:32.218 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.213+0000 7f87537fe700 1 -- 172.21.15.46:0/2095779231 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56494a5de2d0 msgr2=0x56494a5ee0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:57:32.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.213+0000 7f87537fe700 1 --2- 172.21.15.46:0/2095779231 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56494a5de2d0 0x56494a5ee0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:57:32.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.213+0000 7f87537fe700 1 -- 172.21.15.46:0/2095779231 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56494a5dec30 msgr2=0x56494a5e6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:57:32.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.213+0000 7f87537fe700 1 --2- 172.21.15.46:0/2095779231 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56494a5dec30 0x56494a5e6080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:57:32.219 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.213+0000 7f87537fe700 1 -- 172.21.15.46:0/2095779231 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56494a343c60 con 0x56494a5dd5d0 2023-10-19T12:57:32.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.214+0000 7f87537fe700 1 --2- 172.21.15.46:0/2095779231 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56494a5dd5d0 0x56494a5dd090 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f8744007ee0 tx=0x7f87440ae000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ff757f3af825f82 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:57:32.220 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.215+0000 7f873a7fc700 1 -- 172.21.15.46:0/2095779231 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87440b1ea0 con 0x56494a5dd5d0 2023-10-19T12:57:32.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.217+0000 7f873a7fc700 1 -- 172.21.15.46:0/2095779231 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56494a534ef0 con 0x56494a5dd5d0 2023-10-19T12:57:32.221 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.217+0000 7f873a7fc700 1 -- 172.21.15.46:0/2095779231 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87440cc160 con 0x56494a5dd5d0 2023-10-19T12:57:32.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.218+0000 7f876d742b80 1 -- 172.21.15.46:0/2095779231 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56494a5dd5d0 msgr2=0x56494a5dd090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:57:32.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.218+0000 7f876d742b80 1 --2- 172.21.15.46:0/2095779231 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56494a5dd5d0 0x56494a5dd090 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f8744007ee0 tx=0x7f87440ae000 comp rx=0 tx=0).stop 2023-10-19T12:57:32.222 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.218+0000 7f876d742b80 1 -- 172.21.15.46:0/2095779231 shutdown_connections 2023-10-19T12:57:32.223 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.218+0000 7f876d742b80 1 --2- 172.21.15.46:0/2095779231 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56494a5dec30 0x56494a5e6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:57:32.223 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.218+0000 7f876d742b80 1 --2- 172.21.15.46:0/2095779231 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56494a5dd5d0 0x56494a5dd090 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:57:32.223 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.218+0000 7f876d742b80 1 --2- 172.21.15.46:0/2095779231 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56494a5de2d0 0x56494a5ee0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:57:32.224 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.218+0000 7f876d742b80 1 -- 172.21.15.46:0/2095779231 >> 172.21.15.46:0/2095779231 conn(0x56494a551720 msgr2=0x56494a5e4b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:57:32.224 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.218+0000 7f876d742b80 1 -- 172.21.15.46:0/2095779231 shutdown_connections 2023-10-19T12:57:32.224 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.218+0000 7f876d742b80 1 -- 172.21.15.46:0/2095779231 wait complete. 2023-10-19T12:57:32.225 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.219+0000 7f876d742b80 1 -- start start 2023-10-19T12:57:32.225 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.219+0000 7f876d742b80 1 Processor -- start 2023-10-19T12:57:32.227 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.221+0000 7f876d742b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56494a5dd5d0 0x56494a5ea160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:57:32.227 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.221+0000 7f876d742b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56494a5de2d0 0x56494a5ea6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:57:32.227 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.221+0000 7f876d742b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56494a5dec30 0x56494a5ed670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:57:32.227 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.222+0000 7f876d742b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x56494a5edbb0 con 0x56494a5dd5d0 2023-10-19T12:57:32.227 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.222+0000 7f876d742b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x56494a5edd20 con 0x56494a5de2d0 2023-10-19T12:57:32.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.222+0000 7f8753fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56494a5dec30 0x56494a5ed670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:57:32.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.222+0000 7f8753fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56494a5dec30 0x56494a5ed670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:57914/0 (socket says 172.21.15.46:57914) 2023-10-19T12:57:32.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.222+0000 7f8753fff700 1 -- 172.21.15.46:0/3817700719 learned_addr learned my addr 172.21.15.46:0/3817700719 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:57:32.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.222+0000 7f8752ffd700 1 --2- 172.21.15.46:0/3817700719 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56494a5de2d0 0x56494a5ea6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:57:32.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.222+0000 7f87537fe700 1 --2- 172.21.15.46:0/3817700719 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56494a5dd5d0 0x56494a5ea160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:57:32.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.222+0000 7f876d742b80 1 -- 172.21.15.46:0/3817700719 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56494a5edee0 con 0x56494a5dec30 2023-10-19T12:57:32.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.222+0000 7f876d742b80 10 client.0 _ll_register_callbacks cb 0x56494a416a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:57:32.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.223+0000 7f8753fff700 1 -- 172.21.15.46:0/3817700719 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56494a5de2d0 msgr2=0x56494a5ea6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:57:32.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.223+0000 7f8753fff700 1 --2- 172.21.15.46:0/3817700719 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56494a5de2d0 0x56494a5ea6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:57:32.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.223+0000 7f8753fff700 1 -- 172.21.15.46:0/3817700719 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56494a5dd5d0 msgr2=0x56494a5ea160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:57:32.230 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.223+0000 7f8753fff700 1 --2- 172.21.15.46:0/3817700719 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56494a5dd5d0 0x56494a5ea160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:57:32.230 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.223+0000 7f8753fff700 1 -- 172.21.15.46:0/3817700719 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56494a35ade0 con 0x56494a5dec30 2023-10-19T12:57:32.230 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.223+0000 7f87537fe700 1 --2- 172.21.15.46:0/3817700719 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56494a5dd5d0 0x56494a5ea160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T12:57:32.230 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.223+0000 7f8752ffd700 1 --2- 172.21.15.46:0/3817700719 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56494a5de2d0 0x56494a5ea6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:57:32.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.224+0000 7f8753fff700 1 --2- 172.21.15.46:0/3817700719 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56494a5dec30 0x56494a5ed670 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f874c0094f0 tx=0x7f874c018750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41cbc2cec9974547 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:57:32.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.224+0000 7f8732ffd700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-10-19T12:57:32.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.224+0000 7f8732ffd700 1 -- 172.21.15.46:0/3817700719 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f874c018b80 con 0x56494a5dec30 2023-10-19T12:57:32.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.225+0000 7f8732ffd700 1 -- 172.21.15.46:0/3817700719 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f874c014070 con 0x56494a5dec30 2023-10-19T12:57:32.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.225+0000 7f876d742b80 1 -- 172.21.15.46:0/3817700719 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f874c00ed40 con 0x56494a5dec30 2023-10-19T12:57:32.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.225+0000 7f8732ffd700 1 -- 172.21.15.46:0/3817700719 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7f874c018ce0 con 0x56494a5dec30 2023-10-19T12:57:32.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.225+0000 7f876d742b80 10 client.26230 fetch_fsmap learned FSMap version 52 2023-10-19T12:57:32.234 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.225+0000 7f876d742b80 1 -- 172.21.15.46:0/3817700719 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) v3 -- 0x56494a381250 con 0x56494a5dec30 2023-10-19T12:57:32.234 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.226+0000 7f8732ffd700 1 -- 172.21.15.46:0/3817700719 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f874c00ed40 con 0x56494a5dec30 2023-10-19T12:57:32.234 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.226+0000 7f8732ffd700 1 -- 172.21.15.46:0/3817700719 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 52) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f874c022070 con 0x56494a5dec30 2023-10-19T12:57:32.234 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.226+0000 7f876d742b80 10 client.26230 fetch_fsmap finished waiting for FSMap version 52 2023-10-19T12:57:32.234 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.226+0000 7f876d742b80 10 client.26230 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-19T12:57:32.235 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.226+0000 7f876d742b80 20 client.26230 populate_metadata read hostname 'smithi046' 2023-10-19T12:57:32.235 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.226+0000 7f876d742b80 1 --2- 172.21.15.46:0/3817700719 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x56494a5f26c0 0x56494a649730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:57:32.235 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.226+0000 7f876d742b80 4 client.26230 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-19T12:57:32.235 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.226+0000 7f876d742b80 1 -- 172.21.15.46:0/3817700719 --> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x56494a528e50 con 0x56494a5f26c0 2023-10-19T12:57:32.235 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.227+0000 7f87537fe700 1 --2- 172.21.15.46:0/3817700719 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x56494a5f26c0 0x56494a649730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:57:32.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.228+0000 7f8732ffd700 10 client.26230 ms_handle_connect on v2:172.21.15.157:6838/552718978 2023-10-19T12:57:32.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.228+0000 7f87537fe700 1 --2- 172.21.15.46:0/3817700719 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x56494a5f26c0 0x56494a649730 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2131f332281d7c6 server_cookie=d35150c4b1d94f8c in_seq=0 out_seq=0 2023-10-19T12:57:32.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.228+0000 7f8732ffd700 1 -- 172.21.15.46:0/3817700719 <== mds.0 v2:172.21.15.157:6838/552718978 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x56494a528e50 con 0x56494a5f26c0 2023-10-19T12:57:32.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.228+0000 7f8732ffd700 10 client.26230 handle_command_reply: tid=0 2023-10-19T12:57:32.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.229+0000 7f876d742b80 1 client.26230 shutdown 2023-10-19T12:57:32.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.229+0000 7f876d742b80 1 -- 172.21.15.46:0/3817700719 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56494a5dec30 msgr2=0x56494a5ed670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:57:32.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.229+0000 7f876d742b80 1 --2- 172.21.15.46:0/3817700719 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56494a5dec30 0x56494a5ed670 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f874c0094f0 tx=0x7f874c018750 comp rx=0 tx=0).stop 2023-10-19T12:57:32.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.229+0000 7f876d742b80 1 -- 172.21.15.46:0/3817700719 shutdown_connections 2023-10-19T12:57:32.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.229+0000 7f876d742b80 1 --2- 172.21.15.46:0/3817700719 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56494a5dec30 0x56494a5ed670 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:57:32.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.229+0000 7f876d742b80 1 --2- 172.21.15.46:0/3817700719 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x56494a5f26c0 0x56494a649730 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:57:32.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.229+0000 7f876d742b80 1 --2- 172.21.15.46:0/3817700719 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56494a5dd5d0 0x56494a5ea160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:57:32.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.229+0000 7f876d742b80 1 --2- 172.21.15.46:0/3817700719 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56494a5de2d0 0x56494a5ea6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:57:32.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.229+0000 7f8732ffd700 0 client.26230 ms_handle_reset on v2:172.21.15.157:6838/552718978 2023-10-19T12:57:32.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.229+0000 7f876d742b80 1 -- 172.21.15.46:0/3817700719 >> 172.21.15.46:0/3817700719 conn(0x56494a551720 msgr2=0x56494a5e6080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:57:32.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.230+0000 7f876d742b80 1 -- 172.21.15.46:0/3817700719 shutdown_connections 2023-10-19T12:57:32.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.230+0000 7f876d742b80 1 -- 172.21.15.46:0/3817700719 wait complete. 2023-10-19T12:57:32.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.230+0000 7f876d742b80 20 client.26230 trim_cache size 0 max 16384 2023-10-19T12:57:32.239 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-10-19T12:57:32.240 INFO:teuthology.orchestra.run.smithi046.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-19T12:57:32.240 INFO:teuthology.orchestra.run.smithi046.stdout: "scrubs": { 2023-10-19T12:57:32.240 INFO:teuthology.orchestra.run.smithi046.stdout: "21e73f70-af16-4ae7-bc34-e6c54ba8e1ec": { 2023-10-19T12:57:32.240 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2023-10-19T12:57:32.241 INFO:teuthology.orchestra.run.smithi046.stdout: "tag": "21e73f70-af16-4ae7-bc34-e6c54ba8e1ec", 2023-10-19T12:57:32.241 INFO:teuthology.orchestra.run.smithi046.stdout: "options": "recursive,force" 2023-10-19T12:57:32.241 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:57:32.241 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:57:32.241 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-10-19T12:57:32.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.231+0000 7f8759dff700 1 -- 172.21.15.46:0/3765796785 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f873c0a1600 msgr2=0x7f873c0a3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:57:32.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.231+0000 7f8759dff700 1 --2- 172.21.15.46:0/3765796785 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f873c0a1600 0x7f873c0a3ac0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f8748000c00 tx=0x7f8748005fb0 comp rx=0 tx=0).stop 2023-10-19T12:57:32.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.231+0000 7f8759dff700 1 -- 172.21.15.46:0/3765796785 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f87541079d0 msgr2=0x7f87541a55c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:57:32.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.231+0000 7f8759dff700 1 --2- 172.21.15.46:0/3765796785 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f87541079d0 0x7f87541a55c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8744007f10 tx=0x7f874400d3b0 comp rx=0 tx=0).stop 2023-10-19T12:57:32.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.232+0000 7f8759dff700 1 -- 172.21.15.46:0/3765796785 shutdown_connections 2023-10-19T12:57:32.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.232+0000 7f8759dff700 1 --2- 172.21.15.46:0/3765796785 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f875410ce70 0x7f87541acb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:57:32.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.232+0000 7f8759dff700 1 --2- 172.21.15.46:0/3765796785 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f87541079d0 0x7f87541a55c0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:57:32.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.232+0000 7f8759dff700 1 --2- 172.21.15.46:0/3765796785 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f873c0a1600 0x7f873c0a3ac0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:57:32.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.232+0000 7f8759dff700 1 --2- 172.21.15.46:0/3765796785 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f875410a390 0x7f87541a5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:57:32.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.232+0000 7f8759dff700 1 -- 172.21.15.46:0/3765796785 >> 172.21.15.46:0/3765796785 conn(0x7f875406d990 msgr2=0x7f87541084b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:57:32.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.232+0000 7f8759dff700 1 -- 172.21.15.46:0/3765796785 shutdown_connections 2023-10-19T12:57:32.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:57:32.233+0000 7f8759dff700 1 -- 172.21.15.46:0/3765796785 wait complete. 2023-10-19T12:57:32.270 INFO:tasks.cephfs.filesystem:scrub status for tag:21e73f70-af16-4ae7-bc34-e6c54ba8e1ec - {'path': '/', 'tag': '21e73f70-af16-4ae7-bc34-e6c54ba8e1ec', 'options': 'recursive,force'} 2023-10-19T12:57:32.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:57:32 smithi046 ceph-mon[98509]: pgmap v774: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 4.6 MiB/s wr, 443 op/s 2023-10-19T12:57:32.597 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:57:32 smithi157 ceph-mon[134109]: pgmap v774: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 4.6 MiB/s wr, 443 op/s 2023-10-19T12:57:32.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:57:32 smithi195 ceph-mon[134493]: pgmap v774: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 4.6 MiB/s wr, 443 op/s 2023-10-19T12:57:33.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:57:33 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:57:33.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:57:33 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:57:33.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:57:33 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:57:34.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:57:34 smithi046 ceph-mon[98509]: pgmap v775: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 4.8 MiB/s wr, 482 op/s 2023-10-19T12:57:34.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:57:34 smithi157 ceph-mon[134109]: pgmap v775: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 4.8 MiB/s wr, 482 op/s 2023-10-19T12:57:34.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:57:34 smithi195 ceph-mon[134493]: pgmap v775: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 4.8 MiB/s wr, 482 op/s 2023-10-19T12:57:35.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:57:35 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:57:35.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:57:35 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:57:35.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:57:35 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:57:35.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:57:35 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:57:35.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:57:35 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:57:35.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:57:35 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:57:35.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:57:35 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:57:35.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:57:35 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:57:35.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:57:35 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:57:36.700 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 815.0 s, 436.6 tps, lat 238.243 ms stddev 303.431 2023-10-19T12:57:36.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:57:36 smithi046 ceph-mon[98509]: pgmap v776: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 4.5 MiB/s wr, 443 op/s 2023-10-19T12:57:36.841 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:57:36 smithi157 ceph-mon[134109]: pgmap v776: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 4.5 MiB/s wr, 443 op/s 2023-10-19T12:57:36.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:57:36 smithi195 ceph-mon[134493]: pgmap v776: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 4.5 MiB/s wr, 443 op/s 2023-10-19T12:57:38.730 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:57:38 smithi046 ceph-mon[98509]: pgmap v777: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 5.0 MiB/s wr, 490 op/s 2023-10-19T12:57:38.837 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:57:38 smithi157 ceph-mon[134109]: pgmap v777: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 5.0 MiB/s wr, 490 op/s 2023-10-19T12:57:38.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:57:38 smithi195 ceph-mon[134493]: pgmap v777: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 5.0 MiB/s wr, 490 op/s 2023-10-19T12:57:40.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:57:39 smithi046 ceph-mon[98509]: pgmap v778: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 4.8 MiB/s wr, 447 op/s 2023-10-19T12:57:40.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:57:39 smithi157 ceph-mon[134109]: pgmap v778: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 4.8 MiB/s wr, 447 op/s 2023-10-19T12:57:40.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:57:39 smithi195 ceph-mon[134493]: pgmap v778: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 4.8 MiB/s wr, 447 op/s 2023-10-19T12:57:41.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 820.0 s, 590.8 tps, lat 169.759 ms stddev 267.471 2023-10-19T12:57:42.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:57:42 smithi046 ceph-mon[98509]: pgmap v779: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 4.4 MiB/s wr, 448 op/s 2023-10-19T12:57:42.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:57:42 smithi157 ceph-mon[134109]: pgmap v779: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 4.4 MiB/s wr, 448 op/s 2023-10-19T12:57:42.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:57:42 smithi195 ceph-mon[134493]: pgmap v779: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 4.4 MiB/s wr, 448 op/s 2023-10-19T12:57:44.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:57:44 smithi046 ceph-mon[98509]: pgmap v780: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 5.4 MiB/s wr, 531 op/s 2023-10-19T12:57:44.592 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:57:44 smithi157 ceph-mon[134109]: pgmap v780: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 5.4 MiB/s wr, 531 op/s 2023-10-19T12:57:44.635 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:57:44 smithi195 ceph-mon[134493]: pgmap v780: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 5.4 MiB/s wr, 531 op/s 2023-10-19T12:57:46.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:57:46 smithi046 ceph-mon[98509]: pgmap v781: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 5.1 MiB/s wr, 535 op/s 2023-10-19T12:57:46.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:57:46 smithi157 ceph-mon[134109]: pgmap v781: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 5.1 MiB/s wr, 535 op/s 2023-10-19T12:57:46.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:57:46 smithi195 ceph-mon[134493]: pgmap v781: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 5.1 MiB/s wr, 535 op/s 2023-10-19T12:57:46.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 825.0 s, 524.4 tps, lat 183.702 ms stddev 213.361 2023-10-19T12:57:48.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:57:48 smithi046 ceph-mon[98509]: pgmap v782: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 5.6 MiB/s wr, 569 op/s 2023-10-19T12:57:48.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:57:48 smithi157 ceph-mon[134109]: pgmap v782: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 5.6 MiB/s wr, 569 op/s 2023-10-19T12:57:48.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:57:48 smithi195 ceph-mon[134493]: pgmap v782: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 5.6 MiB/s wr, 569 op/s 2023-10-19T12:57:50.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:57:49 smithi046 ceph-mon[98509]: pgmap v783: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 5.5 MiB/s wr, 547 op/s 2023-10-19T12:57:50.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:57:49 smithi157 ceph-mon[134109]: pgmap v783: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 5.5 MiB/s wr, 547 op/s 2023-10-19T12:57:50.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:57:49 smithi195 ceph-mon[134493]: pgmap v783: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 5.5 MiB/s wr, 547 op/s 2023-10-19T12:57:51.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 830.0 s, 423.2 tps, lat 239.550 ms stddev 258.588 2023-10-19T12:57:52.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:57:52 smithi046 ceph-mon[98509]: pgmap v784: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 5.1 MiB/s wr, 520 op/s 2023-10-19T12:57:52.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:57:52 smithi157 ceph-mon[134109]: pgmap v784: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 5.1 MiB/s wr, 520 op/s 2023-10-19T12:57:52.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:57:52 smithi195 ceph-mon[134493]: pgmap v784: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 5.1 MiB/s wr, 520 op/s 2023-10-19T12:57:54.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:57:54 smithi046 ceph-mon[98509]: pgmap v785: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 5.3 MiB/s wr, 552 op/s 2023-10-19T12:57:54.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:57:54 smithi157 ceph-mon[134109]: pgmap v785: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 5.3 MiB/s wr, 552 op/s 2023-10-19T12:57:54.635 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:57:54 smithi195 ceph-mon[134493]: pgmap v785: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 5.3 MiB/s wr, 552 op/s 2023-10-19T12:57:56.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:57:56 smithi046 ceph-mon[98509]: pgmap v786: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 4.4 MiB/s wr, 469 op/s 2023-10-19T12:57:56.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:57:56 smithi157 ceph-mon[134109]: pgmap v786: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 4.4 MiB/s wr, 469 op/s 2023-10-19T12:57:56.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:57:56 smithi195 ceph-mon[134493]: pgmap v786: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 4.4 MiB/s wr, 469 op/s 2023-10-19T12:57:56.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 835.0 s, 407.4 tps, lat 220.675 ms stddev 269.156 2023-10-19T12:57:58.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:57:58 smithi046 ceph-mon[98509]: pgmap v787: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 4.7 MiB/s wr, 485 op/s 2023-10-19T12:57:58.592 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:57:58 smithi157 ceph-mon[134109]: pgmap v787: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 4.7 MiB/s wr, 485 op/s 2023-10-19T12:57:58.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:57:58 smithi195 ceph-mon[134493]: pgmap v787: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 4.7 MiB/s wr, 485 op/s 2023-10-19T12:58:00.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:57:59 smithi046 ceph-mon[98509]: pgmap v788: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 4.4 MiB/s wr, 449 op/s 2023-10-19T12:58:00.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:57:59 smithi157 ceph-mon[134109]: pgmap v788: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 4.4 MiB/s wr, 449 op/s 2023-10-19T12:58:00.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:57:59 smithi195 ceph-mon[134493]: pgmap v788: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 4.4 MiB/s wr, 449 op/s 2023-10-19T12:58:01.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 840.0 s, 432.0 tps, lat 248.967 ms stddev 417.936 2023-10-19T12:58:02.272 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-19T12:58:02.386 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:58:02 smithi046 ceph-mon[98509]: pgmap v789: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 3.7 MiB/s wr, 405 op/s 2023-10-19T12:58:02.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:58:02 smithi157 ceph-mon[134109]: pgmap v789: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 3.7 MiB/s wr, 405 op/s 2023-10-19T12:58:02.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:58:02 smithi195 ceph-mon[134493]: pgmap v789: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 3.7 MiB/s wr, 405 op/s 2023-10-19T12:58:02.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.650+0000 7fa75a5ff700 1 -- 172.21.15.46:0/452736965 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa754101220 msgr2=0x7fa754107ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:58:02.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.650+0000 7fa75a5ff700 1 --2- 172.21.15.46:0/452736965 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa754101220 0x7fa754107ad0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa74c00b0a0 tx=0x7fa74c00b3b0 comp rx=0 tx=0).stop 2023-10-19T12:58:02.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.651+0000 7fa75a5ff700 1 -- 172.21.15.46:0/452736965 shutdown_connections 2023-10-19T12:58:02.653 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.651+0000 7fa75a5ff700 1 --2- 172.21.15.46:0/452736965 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa754101220 0x7fa754107ad0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:58:02.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.651+0000 7fa75a5ff700 1 --2- 172.21.15.46:0/452736965 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7540ff690 0x7fa7540ffab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:58:02.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.651+0000 7fa75a5ff700 1 --2- 172.21.15.46:0/452736965 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa754100880 0x7fa754100ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:58:02.654 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.651+0000 7fa75a5ff700 1 -- 172.21.15.46:0/452736965 >> 172.21.15.46:0/452736965 conn(0x7fa7540fac00 msgr2=0x7fa7540fd040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:58:02.655 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.651+0000 7fa75a5ff700 1 -- 172.21.15.46:0/452736965 shutdown_connections 2023-10-19T12:58:02.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.651+0000 7fa75a5ff700 1 -- 172.21.15.46:0/452736965 wait complete. 2023-10-19T12:58:02.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.654+0000 7fa75a5ff700 1 Processor -- start 2023-10-19T12:58:02.656 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.654+0000 7fa75a5ff700 1 -- start start 2023-10-19T12:58:02.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.654+0000 7fa75a5ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa7540ff690 0x7fa7541989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:58:02.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.655+0000 7fa75a5ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa754100880 0x7fa754198f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:58:02.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.655+0000 7fa75a5ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa754101220 0x7fa75419ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:58:02.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.655+0000 7fa75a5ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7541a0500 con 0x7fa754100880 2023-10-19T12:58:02.657 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.655+0000 7fa75a5ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7541a0640 con 0x7fa754101220 2023-10-19T12:58:02.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.655+0000 7fa75a5ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7541a07d0 con 0x7fa7540ff690 2023-10-19T12:58:02.658 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.655+0000 7fa753fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa7540ff690 0x7fa7541989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:58:02.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.655+0000 7fa753fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa7540ff690 0x7fa7541989d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:57402/0 (socket says 172.21.15.46:57402) 2023-10-19T12:58:02.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.655+0000 7fa753fff700 1 -- 172.21.15.46:0/1090875710 learned_addr learned my addr 172.21.15.46:0/1090875710 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:58:02.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.655+0000 7fa758b9c700 1 --2- 172.21.15.46:0/1090875710 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa754101220 0x7fa75419ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:58:02.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.656+0000 7fa7537fe700 1 --2- 172.21.15.46:0/1090875710 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa754100880 0x7fa754198f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:58:02.659 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.656+0000 7fa753fff700 1 -- 172.21.15.46:0/1090875710 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa754101220 msgr2=0x7fa75419ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:58:02.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.656+0000 7fa753fff700 1 --2- 172.21.15.46:0/1090875710 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa754101220 0x7fa75419ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:58:02.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.656+0000 7fa753fff700 1 -- 172.21.15.46:0/1090875710 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa754100880 msgr2=0x7fa754198f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:58:02.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.656+0000 7fa753fff700 1 --2- 172.21.15.46:0/1090875710 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa754100880 0x7fa754198f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:58:02.660 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.657+0000 7fa753fff700 1 -- 172.21.15.46:0/1090875710 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa74c009d00 con 0x7fa7540ff690 2023-10-19T12:58:02.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.657+0000 7fa758b9c700 1 --2- 172.21.15.46:0/1090875710 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa754101220 0x7fa75419ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:58:02.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.658+0000 7fa753fff700 1 --2- 172.21.15.46:0/1090875710 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa7540ff690 0x7fa7541989d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa74400c990 tx=0x7fa74400cca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:58:02.661 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.658+0000 7fa7517fa700 1 -- 172.21.15.46:0/1090875710 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa744007b00 con 0x7fa7540ff690 2023-10-19T12:58:02.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.658+0000 7fa7517fa700 1 -- 172.21.15.46:0/1090875710 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa744007c60 con 0x7fa7540ff690 2023-10-19T12:58:02.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.658+0000 7fa7517fa700 1 -- 172.21.15.46:0/1090875710 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa744018660 con 0x7fa7540ff690 2023-10-19T12:58:02.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.658+0000 7fa75a5ff700 1 -- 172.21.15.46:0/1090875710 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7541a0ab0 con 0x7fa7540ff690 2023-10-19T12:58:02.662 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.659+0000 7fa75a5ff700 1 -- 172.21.15.46:0/1090875710 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7541a0f10 con 0x7fa7540ff690 2023-10-19T12:58:02.668 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.666+0000 7fa76df73b80 1 Processor -- start 2023-10-19T12:58:02.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.666+0000 7fa7517fa700 1 -- 172.21.15.46:0/1090875710 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fa74400f450 con 0x7fa7540ff690 2023-10-19T12:58:02.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.667+0000 7fa76df73b80 1 -- start start 2023-10-19T12:58:02.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.667+0000 7fa76df73b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5634fb79c2d0 0x5634fb79c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:58:02.670 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.667+0000 7fa76df73b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5634fb79cc30 0x5634fb79b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:58:02.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.667+0000 7fa76df73b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5634fb79b5d0 0x5634fb79ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:58:02.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.668+0000 7fa76df73b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634fb70e6e0 con 0x5634fb79b5d0 2023-10-19T12:58:02.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.668+0000 7fa76df73b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634fb6f4c60 con 0x5634fb79c2d0 2023-10-19T12:58:02.671 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.668+0000 7fa76df73b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634fb6f2580 con 0x5634fb79cc30 2023-10-19T12:58:02.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.668+0000 7fa758b9c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5634fb79c2d0 0x5634fb79c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:58:02.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.668+0000 7fa758b9c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5634fb79c2d0 0x5634fb79c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:38618/0 (socket says 172.21.15.46:38618) 2023-10-19T12:58:02.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.668+0000 7fa758b9c700 1 -- 172.21.15.46:0/705553145 learned_addr learned my addr 172.21.15.46:0/705553145 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:58:02.672 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.669+0000 7fa753fff700 1 --2- 172.21.15.46:0/705553145 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5634fb79cc30 0x5634fb79b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:58:02.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.669+0000 7fa7537fe700 1 --2- 172.21.15.46:0/705553145 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5634fb79b5d0 0x5634fb79ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:58:02.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.671+0000 7fa758b9c700 1 -- 172.21.15.46:0/705553145 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5634fb79cc30 msgr2=0x5634fb79b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:58:02.673 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.671+0000 7fa758b9c700 1 --2- 172.21.15.46:0/705553145 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5634fb79cc30 0x5634fb79b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:58:02.674 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.671+0000 7fa758b9c700 1 -- 172.21.15.46:0/705553145 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5634fb79b5d0 msgr2=0x5634fb79ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:58:02.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.671+0000 7fa7517fa700 1 --2- 172.21.15.46:0/1090875710 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fa73c0a1580 0x7fa73c0a3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:58:02.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.671+0000 7fa758b9c700 1 --2- 172.21.15.46:0/705553145 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5634fb79b5d0 0x5634fb79ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:58:02.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.671+0000 7fa758b9c700 1 -- 172.21.15.46:0/705553145 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5634fb6ab3f0 con 0x5634fb79c2d0 2023-10-19T12:58:02.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.671+0000 7fa7517fa700 1 -- 172.21.15.46:0/1090875710 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7fa7440ccff0 con 0x7fa7540ff690 2023-10-19T12:58:02.675 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.671+0000 7fa753fff700 1 --2- 172.21.15.46:0/705553145 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5634fb79cc30 0x5634fb79b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T12:58:02.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.671+0000 7fa7537fe700 1 --2- 172.21.15.46:0/705553145 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5634fb79b5d0 0x5634fb79ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T12:58:02.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.672+0000 7fa758b9c700 1 --2- 172.21.15.46:0/705553145 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5634fb79c2d0 0x5634fb79c6f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa74c00b0a0 tx=0x7fa74c009390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d94928ef3f1d9eb server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:58:02.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.672+0000 7fa73a7fc700 1 -- 172.21.15.46:0/705553145 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74c00e040 con 0x5634fb79c2d0 2023-10-19T12:58:02.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.672+0000 7fa73a7fc700 1 -- 172.21.15.46:0/705553145 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa74c0076e0 con 0x5634fb79c2d0 2023-10-19T12:58:02.676 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.672+0000 7fa73a7fc700 1 -- 172.21.15.46:0/705553145 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74c005350 con 0x5634fb79c2d0 2023-10-19T12:58:02.677 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.672+0000 7fa753fff700 1 --2- 172.21.15.46:0/1090875710 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fa73c0a1580 0x7fa73c0a3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:58:02.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.675+0000 7fa76df73b80 1 -- 172.21.15.46:0/705553145 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5634fb79c2d0 msgr2=0x5634fb79c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:58:02.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.675+0000 7fa753fff700 1 --2- 172.21.15.46:0/1090875710 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fa73c0a1580 0x7fa73c0a3a40 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fa7440963e0 tx=0x7fa744000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:58:02.678 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.675+0000 7fa76df73b80 1 --2- 172.21.15.46:0/705553145 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5634fb79c2d0 0x5634fb79c6f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa74c00b0a0 tx=0x7fa74c009390 comp rx=0 tx=0).stop 2023-10-19T12:58:02.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.675+0000 7fa76df73b80 1 -- 172.21.15.46:0/705553145 shutdown_connections 2023-10-19T12:58:02.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.675+0000 7fa76df73b80 1 --2- 172.21.15.46:0/705553145 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5634fb79b5d0 0x5634fb79ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:58:02.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.675+0000 7fa76df73b80 1 --2- 172.21.15.46:0/705553145 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5634fb79c2d0 0x5634fb79c6f0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:58:02.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.675+0000 7fa76df73b80 1 --2- 172.21.15.46:0/705553145 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5634fb79cc30 0x5634fb79b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:58:02.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.675+0000 7fa76df73b80 1 -- 172.21.15.46:0/705553145 >> 172.21.15.46:0/705553145 conn(0x5634fb70f720 msgr2=0x5634fb795b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:58:02.679 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.675+0000 7fa76df73b80 1 -- 172.21.15.46:0/705553145 shutdown_connections 2023-10-19T12:58:02.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.675+0000 7fa76df73b80 1 -- 172.21.15.46:0/705553145 wait complete. 2023-10-19T12:58:02.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.676+0000 7fa76df73b80 1 -- start start 2023-10-19T12:58:02.680 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.676+0000 7fa76df73b80 1 Processor -- start 2023-10-19T12:58:02.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.680+0000 7fa76df73b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5634fb79b5d0 0x5634fb7be230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:58:02.682 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.680+0000 7fa76df73b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5634fb79c2d0 0x5634fb7be770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:58:02.683 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.680+0000 7fa76df73b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5634fb79cc30 0x5634fb7c57b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:58:02.683 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.680+0000 7fa76df73b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634fb6ede70 con 0x5634fb79cc30 2023-10-19T12:58:02.684 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.680+0000 7fa76df73b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634fb68a710 con 0x5634fb79b5d0 2023-10-19T12:58:02.684 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.680+0000 7fa76df73b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634fb68a3b0 con 0x5634fb79c2d0 2023-10-19T12:58:02.684 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.680+0000 7fa76df73b80 10 client.0 _ll_register_callbacks cb 0x5634fb5d4a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:58:02.685 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.680+0000 7fa758b9c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5634fb79b5d0 0x5634fb7be230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:58:02.685 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.680+0000 7fa758b9c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5634fb79cc30 0x5634fb7c57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:58:02.685 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.681+0000 7fa758b9c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5634fb79cc30 0x5634fb7c57b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59394/0 (socket says 172.21.15.46:59394) 2023-10-19T12:58:02.685 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.681+0000 7fa758b9c700 1 -- 172.21.15.46:0/3646080804 learned_addr learned my addr 172.21.15.46:0/3646080804 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:58:02.685 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.681+0000 7fa7537fe700 1 --2- 172.21.15.46:0/3646080804 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5634fb79c2d0 0x5634fb7be770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:58:02.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.681+0000 7fa758b9c700 1 -- 172.21.15.46:0/3646080804 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5634fb79c2d0 msgr2=0x5634fb7be770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:58:02.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.681+0000 7fa758b9c700 1 --2- 172.21.15.46:0/3646080804 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5634fb79c2d0 0x5634fb7be770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:58:02.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.681+0000 7fa758b9c700 1 -- 172.21.15.46:0/3646080804 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5634fb79b5d0 msgr2=0x5634fb7be230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:58:02.686 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.681+0000 7fa758b9c700 1 --2- 172.21.15.46:0/3646080804 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5634fb79b5d0 0x5634fb7be230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:58:02.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.681+0000 7fa758b9c700 1 -- 172.21.15.46:0/3646080804 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa754108420 con 0x5634fb79cc30 2023-10-19T12:58:02.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.681+0000 7fa7537fe700 1 --2- 172.21.15.46:0/3646080804 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5634fb79c2d0 0x5634fb7be770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:58:02.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.682+0000 7fa758b9c700 1 --2- 172.21.15.46:0/3646080804 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5634fb79cc30 0x5634fb7c57b0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fa74c007a90 tx=0x7fa74c00b3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=313ad39755486617 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:58:02.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.683+0000 7fa7337fe700 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2023-10-19T12:58:02.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.683+0000 7fa7337fe700 1 -- 172.21.15.46:0/3646080804 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74c003a00 con 0x5634fb79cc30 2023-10-19T12:58:02.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.683+0000 7fa7337fe700 1 -- 172.21.15.46:0/3646080804 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7fa74c003b60 con 0x5634fb79cc30 2023-10-19T12:58:02.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.684+0000 7fa76df73b80 1 -- 172.21.15.46:0/3646080804 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5634fb6f2ef0 con 0x5634fb79cc30 2023-10-19T12:58:02.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.684+0000 7fa7337fe700 1 -- 172.21.15.46:0/3646080804 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa74c003d20 con 0x5634fb79cc30 2023-10-19T12:58:02.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.684+0000 7fa76df73b80 10 client.16029 fetch_fsmap learned FSMap version 52 2023-10-19T12:58:02.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.685+0000 7fa76df73b80 1 -- 172.21.15.46:0/3646080804 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) v3 -- 0x5634fb518de0 con 0x5634fb79cc30 2023-10-19T12:58:02.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.685+0000 7fa7337fe700 1 -- 172.21.15.46:0/3646080804 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa74c04a030 con 0x5634fb79cc30 2023-10-19T12:58:02.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.685+0000 7fa7337fe700 1 -- 172.21.15.46:0/3646080804 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 52) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fa74c024030 con 0x5634fb79cc30 2023-10-19T12:58:02.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.686+0000 7fa76df73b80 10 client.16029 fetch_fsmap finished waiting for FSMap version 52 2023-10-19T12:58:02.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.686+0000 7fa76df73b80 10 client.16029 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-19T12:58:02.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.686+0000 7fa76df73b80 20 client.16029 populate_metadata read hostname 'smithi046' 2023-10-19T12:58:02.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.686+0000 7fa76df73b80 1 --2- 172.21.15.46:0/3646080804 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x5634fb7b7c10 0x5634fb7ba030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:58:02.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.686+0000 7fa76df73b80 4 client.16029 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-19T12:58:02.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.686+0000 7fa76df73b80 1 -- 172.21.15.46:0/3646080804 --> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5634fb76a8b0 con 0x5634fb7b7c10 2023-10-19T12:58:02.692 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.686+0000 7fa7537fe700 1 --2- 172.21.15.46:0/3646080804 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x5634fb7b7c10 0x5634fb7ba030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:58:02.692 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.687+0000 7fa7337fe700 10 client.16029 ms_handle_connect on v2:172.21.15.157:6838/552718978 2023-10-19T12:58:02.692 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.688+0000 7fa7537fe700 1 --2- 172.21.15.46:0/3646080804 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x5634fb7b7c10 0x5634fb7ba030 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d9cc2b89ef4fa3c9 server_cookie=71eb94ff7b598d74 in_seq=0 out_seq=0 2023-10-19T12:58:02.693 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.689+0000 7fa7337fe700 1 -- 172.21.15.46:0/3646080804 <== mds.0 v2:172.21.15.157:6838/552718978 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5634fb76a8b0 con 0x5634fb7b7c10 2023-10-19T12:58:02.693 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.689+0000 7fa7337fe700 10 client.16029 handle_command_reply: tid=0 2023-10-19T12:58:02.693 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.689+0000 7fa76df73b80 1 client.16029 shutdown 2023-10-19T12:58:02.694 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.689+0000 7fa76df73b80 1 -- 172.21.15.46:0/3646080804 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5634fb79cc30 msgr2=0x5634fb7c57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:58:02.694 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.689+0000 7fa76df73b80 1 --2- 172.21.15.46:0/3646080804 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5634fb79cc30 0x5634fb7c57b0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fa74c007a90 tx=0x7fa74c00b3b0 comp rx=0 tx=0).stop 2023-10-19T12:58:02.694 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.690+0000 7fa76df73b80 1 -- 172.21.15.46:0/3646080804 shutdown_connections 2023-10-19T12:58:02.694 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.690+0000 7fa76df73b80 1 --2- 172.21.15.46:0/3646080804 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x5634fb7b7c10 0x5634fb7ba030 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:58:02.694 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.690+0000 7fa76df73b80 1 --2- 172.21.15.46:0/3646080804 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5634fb79cc30 0x5634fb7c57b0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:58:02.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.690+0000 7fa76df73b80 1 --2- 172.21.15.46:0/3646080804 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5634fb79b5d0 0x5634fb7be230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:58:02.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.690+0000 7fa76df73b80 1 --2- 172.21.15.46:0/3646080804 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5634fb79c2d0 0x5634fb7be770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:58:02.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.690+0000 7fa76df73b80 1 -- 172.21.15.46:0/3646080804 >> 172.21.15.46:0/3646080804 conn(0x5634fb70f720 msgr2=0x5634fb79a080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:58:02.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.690+0000 7fa7337fe700 0 client.16029 ms_handle_reset on v2:172.21.15.157:6838/552718978 2023-10-19T12:58:02.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.690+0000 7fa76df73b80 1 -- 172.21.15.46:0/3646080804 shutdown_connections 2023-10-19T12:58:02.695 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.690+0000 7fa76df73b80 1 -- 172.21.15.46:0/3646080804 wait complete. 2023-10-19T12:58:02.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.690+0000 7fa76df73b80 20 client.16029 trim_cache size 0 max 16384 2023-10-19T12:58:02.744 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.742+0000 7fa76df73b80 1 Processor -- start 2023-10-19T12:58:02.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.742+0000 7fa76df73b80 1 -- start start 2023-10-19T12:58:02.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.743+0000 7fa76df73b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5634fb79b5d0 0x5634fb796450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:58:02.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.743+0000 7fa76df73b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5634fb79c2d0 0x5634fb7cb4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:58:02.745 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.743+0000 7fa76df73b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5634fb79cc30 0x5634fb7be210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:58:02.746 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.743+0000 7fa76df73b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634fb56e920 con 0x5634fb79b5d0 2023-10-19T12:58:02.746 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.743+0000 7fa76df73b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634fb7bf270 con 0x5634fb79c2d0 2023-10-19T12:58:02.746 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.743+0000 7fa76df73b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634fb78dfd0 con 0x5634fb79cc30 2023-10-19T12:58:02.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.743+0000 7fa758b9c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5634fb79b5d0 0x5634fb796450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:58:02.747 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.744+0000 7fa7537fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5634fb79c2d0 0x5634fb7cb4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:58:02.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.744+0000 7fa758b9c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5634fb79b5d0 0x5634fb796450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59406/0 (socket says 172.21.15.46:59406) 2023-10-19T12:58:02.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.744+0000 7fa758b9c700 1 -- 172.21.15.46:0/690342904 learned_addr learned my addr 172.21.15.46:0/690342904 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:58:02.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.744+0000 7fa7537fe700 1 -- 172.21.15.46:0/690342904 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5634fb79cc30 msgr2=0x5634fb7be210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:58:02.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.744+0000 7fa7537fe700 1 --2- 172.21.15.46:0/690342904 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5634fb79cc30 0x5634fb7be210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:58:02.748 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.744+0000 7fa7537fe700 1 -- 172.21.15.46:0/690342904 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5634fb79b5d0 msgr2=0x5634fb796450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:58:02.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.744+0000 7fa7537fe700 1 --2- 172.21.15.46:0/690342904 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5634fb79b5d0 0x5634fb796450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:58:02.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.744+0000 7fa7537fe700 1 -- 172.21.15.46:0/690342904 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5634fb501c60 con 0x5634fb79c2d0 2023-10-19T12:58:02.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.745+0000 7fa7537fe700 1 --2- 172.21.15.46:0/690342904 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5634fb79c2d0 0x5634fb7cb4d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa748012450 tx=0x7fa7480044b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5da421128e5faf25 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:58:02.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.745+0000 7fa73affd700 1 -- 172.21.15.46:0/690342904 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa748017040 con 0x5634fb79c2d0 2023-10-19T12:58:02.749 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.745+0000 7fa73affd700 1 -- 172.21.15.46:0/690342904 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa748019040 con 0x5634fb79c2d0 2023-10-19T12:58:02.750 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.745+0000 7fa73affd700 1 -- 172.21.15.46:0/690342904 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa748012760 con 0x5634fb79c2d0 2023-10-19T12:58:02.751 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.746+0000 7fa76df73b80 1 -- 172.21.15.46:0/690342904 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5634fb79c2d0 msgr2=0x5634fb7cb4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:58:02.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.746+0000 7fa76df73b80 1 --2- 172.21.15.46:0/690342904 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5634fb79c2d0 0x5634fb7cb4d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa748012450 tx=0x7fa7480044b0 comp rx=0 tx=0).stop 2023-10-19T12:58:02.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.746+0000 7fa76df73b80 1 -- 172.21.15.46:0/690342904 shutdown_connections 2023-10-19T12:58:02.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.746+0000 7fa76df73b80 1 --2- 172.21.15.46:0/690342904 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5634fb79cc30 0x5634fb7be210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:58:02.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.746+0000 7fa76df73b80 1 --2- 172.21.15.46:0/690342904 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5634fb79b5d0 0x5634fb796450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:58:02.752 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.746+0000 7fa76df73b80 1 --2- 172.21.15.46:0/690342904 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5634fb79c2d0 0x5634fb7cb4d0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:58:02.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.746+0000 7fa76df73b80 1 -- 172.21.15.46:0/690342904 >> 172.21.15.46:0/690342904 conn(0x5634fb70f720 msgr2=0x5634fb795b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:58:02.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.746+0000 7fa76df73b80 1 -- 172.21.15.46:0/690342904 shutdown_connections 2023-10-19T12:58:02.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.746+0000 7fa76df73b80 1 -- 172.21.15.46:0/690342904 wait complete. 2023-10-19T12:58:02.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.747+0000 7fa76df73b80 1 -- start start 2023-10-19T12:58:02.753 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.747+0000 7fa76df73b80 1 Processor -- start 2023-10-19T12:58:02.754 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.748+0000 7fa76df73b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5634fb79b5d0 0x5634fb7ca650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:58:02.754 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.748+0000 7fa76df73b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5634fb79c2d0 0x5634fb7cab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:58:02.754 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.748+0000 7fa76df73b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5634fb79cc30 0x5634fb814610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:58:02.754 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.748+0000 7fa76df73b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634fb7cb270 con 0x5634fb79c2d0 2023-10-19T12:58:02.754 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.748+0000 7fa76df73b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634fb814b50 con 0x5634fb79b5d0 2023-10-19T12:58:02.755 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.748+0000 7fa76df73b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634fb814c90 con 0x5634fb79cc30 2023-10-19T12:58:02.755 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.748+0000 7fa76df73b80 10 client.0 _ll_register_callbacks cb 0x5634fb5d4a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:58:02.755 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.748+0000 7fa758b9c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5634fb79b5d0 0x5634fb7ca650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:58:02.755 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.749+0000 7fa758b9c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5634fb79b5d0 0x5634fb7ca650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:38658/0 (socket says 172.21.15.46:38658) 2023-10-19T12:58:02.755 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.749+0000 7fa758b9c700 1 -- 172.21.15.46:0/1081262258 learned_addr learned my addr 172.21.15.46:0/1081262258 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:58:02.756 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.749+0000 7fa758b9c700 1 --2- 172.21.15.46:0/1081262258 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5634fb79cc30 0x5634fb814610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:58:02.756 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.749+0000 7fa7537fe700 1 --2- 172.21.15.46:0/1081262258 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5634fb79c2d0 0x5634fb7cab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:58:02.756 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.749+0000 7fa758b9c700 1 -- 172.21.15.46:0/1081262258 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5634fb79cc30 msgr2=0x5634fb814610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:58:02.756 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.749+0000 7fa758b9c700 1 --2- 172.21.15.46:0/1081262258 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5634fb79cc30 0x5634fb814610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:58:02.756 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.749+0000 7fa758b9c700 1 -- 172.21.15.46:0/1081262258 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5634fb79c2d0 msgr2=0x5634fb7cab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:58:02.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.749+0000 7fa758b9c700 1 --2- 172.21.15.46:0/1081262258 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5634fb79c2d0 0x5634fb7cab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:58:02.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.749+0000 7fa758b9c700 1 -- 172.21.15.46:0/1081262258 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa748009d90 con 0x5634fb79b5d0 2023-10-19T12:58:02.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.750+0000 7fa758b9c700 1 --2- 172.21.15.46:0/1081262258 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5634fb79b5d0 0x5634fb7ca650 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa74c002230 tx=0x7fa74c00b3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a901cea4c767350 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:58:02.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.750+0000 7fa7337fe700 10 client.0 ms_handle_connect on v2:172.21.15.157:3300/0 2023-10-19T12:58:02.757 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.750+0000 7fa7337fe700 1 -- 172.21.15.46:0/1081262258 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74c00e040 con 0x5634fb79b5d0 2023-10-19T12:58:02.759 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.750+0000 7fa7337fe700 1 -- 172.21.15.46:0/1081262258 <== mon.2 v2:172.21.15.157:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7fa74c003e80 con 0x5634fb79b5d0 2023-10-19T12:58:02.759 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.750+0000 7fa76df73b80 1 -- 172.21.15.46:0/1081262258 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa74c0076e0 con 0x5634fb79b5d0 2023-10-19T12:58:02.760 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.750+0000 7fa7337fe700 1 -- 172.21.15.46:0/1081262258 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa74c003d20 con 0x5634fb79b5d0 2023-10-19T12:58:02.760 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.750+0000 7fa76df73b80 10 client.26237 fetch_fsmap learned FSMap version 52 2023-10-19T12:58:02.760 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.750+0000 7fa76df73b80 1 -- 172.21.15.46:0/1081262258 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) v3 -- 0x5634fb53f250 con 0x5634fb79b5d0 2023-10-19T12:58:02.760 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.751+0000 7fa7337fe700 1 -- 172.21.15.46:0/1081262258 <== mon.2 v2:172.21.15.157:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa74c0076e0 con 0x5634fb79b5d0 2023-10-19T12:58:02.760 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.751+0000 7fa7337fe700 1 -- 172.21.15.46:0/1081262258 <== mon.2 v2:172.21.15.157:3300/0 5 ==== fsmap(e 52) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fa74c024070 con 0x5634fb79b5d0 2023-10-19T12:58:02.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.751+0000 7fa76df73b80 10 client.26237 fetch_fsmap finished waiting for FSMap version 52 2023-10-19T12:58:02.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.751+0000 7fa76df73b80 10 client.26237 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-19T12:58:02.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.751+0000 7fa76df73b80 20 client.26237 populate_metadata read hostname 'smithi046' 2023-10-19T12:58:02.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.751+0000 7fa76df73b80 1 --2- 172.21.15.46:0/1081262258 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x5634fb816290 0x5634fb8186b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:58:02.761 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.751+0000 7fa76df73b80 4 client.26237 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-19T12:58:02.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.751+0000 7fa76df73b80 1 -- 172.21.15.46:0/1081262258 --> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5634fb6e6e50 con 0x5634fb816290 2023-10-19T12:58:02.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.752+0000 7fa7537fe700 1 --2- 172.21.15.46:0/1081262258 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x5634fb816290 0x5634fb8186b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:58:02.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.752+0000 7fa7537fe700 1 --2- 172.21.15.46:0/1081262258 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x5634fb816290 0x5634fb8186b0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b31e9eb27211fc05 server_cookie=b350cf13af559b42 in_seq=0 out_seq=0 2023-10-19T12:58:02.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.752+0000 7fa7337fe700 10 client.26237 ms_handle_connect on v2:172.21.15.157:6838/552718978 2023-10-19T12:58:02.762 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.753+0000 7fa7337fe700 1 -- 172.21.15.46:0/1081262258 <== mds.0 v2:172.21.15.157:6838/552718978 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x5634fb6e6e50 con 0x5634fb816290 2023-10-19T12:58:02.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.753+0000 7fa7337fe700 10 client.26237 handle_command_reply: tid=0 2023-10-19T12:58:02.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.753+0000 7fa76df73b80 1 client.26237 shutdown 2023-10-19T12:58:02.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.754+0000 7fa76df73b80 1 -- 172.21.15.46:0/1081262258 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5634fb79b5d0 msgr2=0x5634fb7ca650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:58:02.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.754+0000 7fa76df73b80 1 --2- 172.21.15.46:0/1081262258 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5634fb79b5d0 0x5634fb7ca650 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa74c002230 tx=0x7fa74c00b3b0 comp rx=0 tx=0).stop 2023-10-19T12:58:02.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.754+0000 7fa76df73b80 1 -- 172.21.15.46:0/1081262258 shutdown_connections 2023-10-19T12:58:02.763 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.754+0000 7fa76df73b80 1 --2- 172.21.15.46:0/1081262258 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5634fb79cc30 0x5634fb814610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:58:02.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.754+0000 7fa76df73b80 1 --2- 172.21.15.46:0/1081262258 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5634fb79b5d0 0x5634fb7ca650 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:58:02.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.754+0000 7fa76df73b80 1 --2- 172.21.15.46:0/1081262258 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x5634fb816290 0x5634fb8186b0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:58:02.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.754+0000 7fa76df73b80 1 --2- 172.21.15.46:0/1081262258 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5634fb79c2d0 0x5634fb7cab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:58:02.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.754+0000 7fa76df73b80 1 -- 172.21.15.46:0/1081262258 >> 172.21.15.46:0/1081262258 conn(0x5634fb70f720 msgr2=0x5634fb795a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:58:02.764 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.754+0000 7fa7337fe700 0 client.26237 ms_handle_reset on v2:172.21.15.157:6838/552718978 2023-10-19T12:58:02.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.754+0000 7fa76df73b80 1 -- 172.21.15.46:0/1081262258 shutdown_connections 2023-10-19T12:58:02.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.754+0000 7fa76df73b80 1 -- 172.21.15.46:0/1081262258 wait complete. 2023-10-19T12:58:02.765 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.755+0000 7fa76df73b80 20 client.26237 trim_cache size 0 max 16384 2023-10-19T12:58:02.765 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-10-19T12:58:02.766 INFO:teuthology.orchestra.run.smithi046.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-19T12:58:02.766 INFO:teuthology.orchestra.run.smithi046.stdout: "scrubs": { 2023-10-19T12:58:02.766 INFO:teuthology.orchestra.run.smithi046.stdout: "21e73f70-af16-4ae7-bc34-e6c54ba8e1ec": { 2023-10-19T12:58:02.766 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2023-10-19T12:58:02.766 INFO:teuthology.orchestra.run.smithi046.stdout: "tag": "21e73f70-af16-4ae7-bc34-e6c54ba8e1ec", 2023-10-19T12:58:02.767 INFO:teuthology.orchestra.run.smithi046.stdout: "options": "recursive,force" 2023-10-19T12:58:02.767 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:58:02.767 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:58:02.767 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-10-19T12:58:02.768 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.755+0000 7fa75a5ff700 1 -- 172.21.15.46:0/1090875710 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fa73c0a1580 msgr2=0x7fa73c0a3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:58:02.768 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.755+0000 7fa75a5ff700 1 --2- 172.21.15.46:0/1090875710 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fa73c0a1580 0x7fa73c0a3a40 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fa7440963e0 tx=0x7fa744000bc0 comp rx=0 tx=0).stop 2023-10-19T12:58:02.768 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.755+0000 7fa75a5ff700 1 -- 172.21.15.46:0/1090875710 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa7540ff690 msgr2=0x7fa7541989d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:58:02.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.755+0000 7fa75a5ff700 1 --2- 172.21.15.46:0/1090875710 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa7540ff690 0x7fa7541989d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa74400c990 tx=0x7fa74400cca0 comp rx=0 tx=0).stop 2023-10-19T12:58:02.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.755+0000 7fa75a5ff700 1 -- 172.21.15.46:0/1090875710 shutdown_connections 2023-10-19T12:58:02.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.755+0000 7fa75a5ff700 1 --2- 172.21.15.46:0/1090875710 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa754101220 0x7fa75419ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:58:02.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.755+0000 7fa75a5ff700 1 --2- 172.21.15.46:0/1090875710 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fa73c0a1580 0x7fa73c0a3a40 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:58:02.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.755+0000 7fa75a5ff700 1 --2- 172.21.15.46:0/1090875710 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa7540ff690 0x7fa7541989d0 secure :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa74400c990 tx=0x7fa74400cca0 comp rx=0 tx=0).stop 2023-10-19T12:58:02.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.755+0000 7fa75a5ff700 1 --2- 172.21.15.46:0/1090875710 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa754100880 0x7fa754198f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:58:02.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.755+0000 7fa75a5ff700 1 -- 172.21.15.46:0/1090875710 >> 172.21.15.46:0/1090875710 conn(0x7fa7540fac00 msgr2=0x7fa7540fc630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:58:02.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.756+0000 7fa75a5ff700 1 -- 172.21.15.46:0/1090875710 shutdown_connections 2023-10-19T12:58:02.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:02.756+0000 7fa75a5ff700 1 -- 172.21.15.46:0/1090875710 wait complete. 2023-10-19T12:58:02.793 INFO:tasks.cephfs.filesystem:scrub status for tag:21e73f70-af16-4ae7-bc34-e6c54ba8e1ec - {'path': '/', 'tag': '21e73f70-af16-4ae7-bc34-e6c54ba8e1ec', 'options': 'recursive,force'} 2023-10-19T12:58:04.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:58:04 smithi046 ceph-mon[98509]: pgmap v790: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 4.3 MiB/s wr, 465 op/s 2023-10-19T12:58:04.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:58:04 smithi157 ceph-mon[134109]: pgmap v790: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 4.3 MiB/s wr, 465 op/s 2023-10-19T12:58:04.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:58:04 smithi195 ceph-mon[134493]: pgmap v790: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 4.3 MiB/s wr, 465 op/s 2023-10-19T12:58:06.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:58:06 smithi046 ceph-mon[98509]: pgmap v791: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 3.9 MiB/s wr, 410 op/s 2023-10-19T12:58:06.590 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:58:06 smithi157 ceph-mon[134109]: pgmap v791: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 3.9 MiB/s wr, 410 op/s 2023-10-19T12:58:06.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:58:06 smithi195 ceph-mon[134493]: pgmap v791: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 3.9 MiB/s wr, 410 op/s 2023-10-19T12:58:06.700 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 845.0 s, 436.9 tps, lat 233.958 ms stddev 279.295 2023-10-19T12:58:08.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:58:08 smithi046 ceph-mon[98509]: pgmap v792: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 4.6 MiB/s wr, 482 op/s 2023-10-19T12:58:08.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:58:08 smithi157 ceph-mon[134109]: pgmap v792: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 4.6 MiB/s wr, 482 op/s 2023-10-19T12:58:08.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:58:08 smithi195 ceph-mon[134493]: pgmap v792: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 4.6 MiB/s wr, 482 op/s 2023-10-19T12:58:10.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:58:09 smithi046 ceph-mon[98509]: pgmap v793: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 4.4 MiB/s wr, 438 op/s 2023-10-19T12:58:10.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:58:09 smithi157 ceph-mon[134109]: pgmap v793: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 4.4 MiB/s wr, 438 op/s 2023-10-19T12:58:10.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:58:09 smithi195 ceph-mon[134493]: pgmap v793: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 4.4 MiB/s wr, 438 op/s 2023-10-19T12:58:11.703 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 850.0 s, 459.5 tps, lat 216.773 ms stddev 267.666 2023-10-19T12:58:12.483 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:58:12 smithi046 ceph-mon[98509]: pgmap v794: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 4.0 MiB/s wr, 411 op/s 2023-10-19T12:58:12.598 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:58:12 smithi157 ceph-mon[134109]: pgmap v794: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 4.0 MiB/s wr, 411 op/s 2023-10-19T12:58:12.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:58:12 smithi195 ceph-mon[134493]: pgmap v794: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 4.0 MiB/s wr, 411 op/s 2023-10-19T12:58:14.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:58:14 smithi046 ceph-mon[98509]: pgmap v795: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 4.7 MiB/s wr, 480 op/s 2023-10-19T12:58:14.594 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:58:14 smithi157 ceph-mon[134109]: pgmap v795: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 4.7 MiB/s wr, 480 op/s 2023-10-19T12:58:14.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:58:14 smithi195 ceph-mon[134493]: pgmap v795: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 4.7 MiB/s wr, 480 op/s 2023-10-19T12:58:16.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:58:16 smithi046 ceph-mon[98509]: pgmap v796: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 4.0 MiB/s wr, 419 op/s 2023-10-19T12:58:16.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:58:16 smithi157 ceph-mon[134109]: pgmap v796: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 4.0 MiB/s wr, 419 op/s 2023-10-19T12:58:16.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:58:16 smithi195 ceph-mon[134493]: pgmap v796: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 4.0 MiB/s wr, 419 op/s 2023-10-19T12:58:16.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 855.0 s, 437.5 tps, lat 220.921 ms stddev 300.471 2023-10-19T12:58:18.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:58:18 smithi046 ceph-mon[98509]: pgmap v797: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 4.7 MiB/s wr, 495 op/s 2023-10-19T12:58:18.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:58:18 smithi157 ceph-mon[134109]: pgmap v797: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 4.7 MiB/s wr, 495 op/s 2023-10-19T12:58:18.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:58:18 smithi195 ceph-mon[134493]: pgmap v797: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 4.7 MiB/s wr, 495 op/s 2023-10-19T12:58:20.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:58:19 smithi046 ceph-mon[98509]: pgmap v798: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 4.1 MiB/s wr, 425 op/s 2023-10-19T12:58:20.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:58:19 smithi157 ceph-mon[134109]: pgmap v798: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 4.1 MiB/s wr, 425 op/s 2023-10-19T12:58:20.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:58:19 smithi195 ceph-mon[134493]: pgmap v798: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 4.1 MiB/s wr, 425 op/s 2023-10-19T12:58:21.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 860.0 s, 632.8 tps, lat 164.417 ms stddev 199.412 2023-10-19T12:58:22.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:58:22 smithi046 ceph-mon[98509]: pgmap v799: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 3.7 MiB/s wr, 413 op/s 2023-10-19T12:58:22.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:58:22 smithi157 ceph-mon[134109]: pgmap v799: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 3.7 MiB/s wr, 413 op/s 2023-10-19T12:58:22.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:58:22 smithi195 ceph-mon[134493]: pgmap v799: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 3.7 MiB/s wr, 413 op/s 2023-10-19T12:58:24.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:58:24 smithi046 ceph-mon[98509]: pgmap v800: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 4.4 MiB/s wr, 485 op/s 2023-10-19T12:58:24.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:58:24 smithi157 ceph-mon[134109]: pgmap v800: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 4.4 MiB/s wr, 485 op/s 2023-10-19T12:58:24.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:58:24 smithi195 ceph-mon[134493]: pgmap v800: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 4.4 MiB/s wr, 485 op/s 2023-10-19T12:58:26.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:58:26 smithi046 ceph-mon[98509]: pgmap v801: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 4.3 MiB/s wr, 450 op/s 2023-10-19T12:58:26.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:58:26 smithi157 ceph-mon[134109]: pgmap v801: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 4.3 MiB/s wr, 450 op/s 2023-10-19T12:58:26.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:58:26 smithi195 ceph-mon[134493]: pgmap v801: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 4.3 MiB/s wr, 450 op/s 2023-10-19T12:58:26.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 865.0 s, 379.2 tps, lat 263.556 ms stddev 285.335 2023-10-19T12:58:28.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:58:28 smithi046 ceph-mon[98509]: pgmap v802: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 5.5 MiB/s wr, 555 op/s 2023-10-19T12:58:28.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:58:28 smithi157 ceph-mon[134109]: pgmap v802: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 5.5 MiB/s wr, 555 op/s 2023-10-19T12:58:28.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:58:28 smithi195 ceph-mon[134493]: pgmap v802: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 5.5 MiB/s wr, 555 op/s 2023-10-19T12:58:30.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:58:29 smithi046 ceph-mon[98509]: pgmap v803: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 5.2 MiB/s wr, 513 op/s 2023-10-19T12:58:30.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:58:29 smithi157 ceph-mon[134109]: pgmap v803: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 5.2 MiB/s wr, 513 op/s 2023-10-19T12:58:30.385 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:58:29 smithi195 ceph-mon[134493]: pgmap v803: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 5.2 MiB/s wr, 513 op/s 2023-10-19T12:58:31.702 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 870.0 s, 467.4 tps, lat 217.697 ms stddev 245.047 2023-10-19T12:58:32.478 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:58:32 smithi046 ceph-mon[98509]: pgmap v804: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 5.0 MiB/s wr, 515 op/s 2023-10-19T12:58:32.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:58:32 smithi157 ceph-mon[134109]: pgmap v804: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 5.0 MiB/s wr, 515 op/s 2023-10-19T12:58:32.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:58:32 smithi195 ceph-mon[134493]: pgmap v804: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 5.0 MiB/s wr, 515 op/s 2023-10-19T12:58:32.794 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-19T12:58:33.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.232+0000 7f8f549ff700 1 -- 172.21.15.46:0/2208991939 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8f501007a0 msgr2=0x7f8f50100bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:58:33.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.232+0000 7f8f549ff700 1 --2- 172.21.15.46:0/2208991939 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8f501007a0 0x7f8f50100bc0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f8f40009990 tx=0x7f8f40009ca0 comp rx=0 tx=0).stop 2023-10-19T12:58:33.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.233+0000 7f8f549ff700 1 -- 172.21.15.46:0/2208991939 shutdown_connections 2023-10-19T12:58:33.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.233+0000 7f8f549ff700 1 --2- 172.21.15.46:0/2208991939 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f50102330 0x7f8f50108be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:58:33.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.233+0000 7f8f549ff700 1 --2- 172.21.15.46:0/2208991939 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8f501007a0 0x7f8f50100bc0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:58:33.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.233+0000 7f8f549ff700 1 --2- 172.21.15.46:0/2208991939 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8f50101990 0x7f8f50101df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:58:33.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.233+0000 7f8f549ff700 1 -- 172.21.15.46:0/2208991939 >> 172.21.15.46:0/2208991939 conn(0x7f8f500fbcf0 msgr2=0x7f8f500fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:58:33.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.233+0000 7f8f549ff700 1 -- 172.21.15.46:0/2208991939 shutdown_connections 2023-10-19T12:58:33.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.233+0000 7f8f549ff700 1 -- 172.21.15.46:0/2208991939 wait complete. 2023-10-19T12:58:33.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.234+0000 7f8f549ff700 1 Processor -- start 2023-10-19T12:58:33.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.235+0000 7f8f549ff700 1 -- start start 2023-10-19T12:58:33.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.235+0000 7f8f549ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8f501007a0 0x7f8f50198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:58:33.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.235+0000 7f8f549ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f50101990 0x7f8f50198fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:58:33.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.235+0000 7f8f549ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8f50102330 0x7f8f5019ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:58:33.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.235+0000 7f8f549ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f501a0550 con 0x7f8f50101990 2023-10-19T12:58:33.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.235+0000 7f8f549ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f501a0690 con 0x7f8f501007a0 2023-10-19T12:58:33.241 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.235+0000 7f8f549ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f501a0820 con 0x7f8f50102330 2023-10-19T12:58:33.241 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.235+0000 7f8f4ed9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8f50102330 0x7f8f5019ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:58:33.241 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.236+0000 7f8f4ed9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8f50102330 0x7f8f5019ff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:56922/0 (socket says 172.21.15.46:56922) 2023-10-19T12:58:33.241 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.236+0000 7f8f4ed9d700 1 -- 172.21.15.46:0/2755469655 learned_addr learned my addr 172.21.15.46:0/2755469655 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:58:33.241 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.236+0000 7f8f4dd9b700 1 --2- 172.21.15.46:0/2755469655 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f50101990 0x7f8f50198fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:58:33.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.236+0000 7f8f4e59c700 1 --2- 172.21.15.46:0/2755469655 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8f501007a0 0x7f8f50198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:58:33.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.236+0000 7f8f4ed9d700 1 -- 172.21.15.46:0/2755469655 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8f501007a0 msgr2=0x7f8f50198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:58:33.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.236+0000 7f8f4ed9d700 1 --2- 172.21.15.46:0/2755469655 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8f501007a0 0x7f8f50198a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:58:33.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.236+0000 7f8f4ed9d700 1 -- 172.21.15.46:0/2755469655 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f50101990 msgr2=0x7f8f50198fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:58:33.242 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.236+0000 7f8f4ed9d700 1 --2- 172.21.15.46:0/2755469655 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f50101990 0x7f8f50198fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:58:33.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.236+0000 7f8f4ed9d700 1 -- 172.21.15.46:0/2755469655 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f400095f0 con 0x7f8f50102330 2023-10-19T12:58:33.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.236+0000 7f8f4e59c700 1 --2- 172.21.15.46:0/2755469655 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8f501007a0 0x7f8f50198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T12:58:33.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.237+0000 7f8f4ed9d700 1 --2- 172.21.15.46:0/2755469655 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8f50102330 0x7f8f5019ff80 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8f4800b970 tx=0x7f8f4800bd30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:58:33.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.237+0000 7f8f3f7fe700 1 -- 172.21.15.46:0/2755469655 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f4800c9b0 con 0x7f8f50102330 2023-10-19T12:58:33.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.237+0000 7f8f3f7fe700 1 -- 172.21.15.46:0/2755469655 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8f48014440 con 0x7f8f50102330 2023-10-19T12:58:33.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.237+0000 7f8f3f7fe700 1 -- 172.21.15.46:0/2755469655 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f480075d0 con 0x7f8f50102330 2023-10-19T12:58:33.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.237+0000 7f8f549ff700 1 -- 172.21.15.46:0/2755469655 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f501a0b00 con 0x7f8f50102330 2023-10-19T12:58:33.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.237+0000 7f8f549ff700 1 -- 172.21.15.46:0/2755469655 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f501a0fc0 con 0x7f8f50102330 2023-10-19T12:58:33.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.247+0000 7f8f3f7fe700 1 -- 172.21.15.46:0/2755469655 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f8f48007730 con 0x7f8f50102330 2023-10-19T12:58:33.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.247+0000 7f8f68407b80 1 Processor -- start 2023-10-19T12:58:33.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.248+0000 7f8f68407b80 1 -- start start 2023-10-19T12:58:33.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.248+0000 7f8f68407b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x555750057a90 0x555750057e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:58:33.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.248+0000 7f8f68407b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5557500583d0 0x555750058850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:58:33.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.248+0000 7f8f68407b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555750058d90 0x555750059210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:58:33.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.248+0000 7f8f68407b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55574ffc26e0 con 0x555750058d90 2023-10-19T12:58:33.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.248+0000 7f8f68407b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55574ffa8c60 con 0x555750057a90 2023-10-19T12:58:33.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.248+0000 7f8f68407b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55574ffa6580 con 0x5557500583d0 2023-10-19T12:58:33.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.249+0000 7f8f4dd9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x555750057a90 0x555750057e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:58:33.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.249+0000 7f8f4dd9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x555750057a90 0x555750057e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:56158/0 (socket says 172.21.15.46:56158) 2023-10-19T12:58:33.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.249+0000 7f8f4dd9b700 1 -- 172.21.15.46:0/4290642245 learned_addr learned my addr 172.21.15.46:0/4290642245 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:58:33.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.249+0000 7f8f4dd9b700 1 --2- 172.21.15.46:0/4290642245 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555750058d90 0x555750059210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:58:33.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.250+0000 7f8f4dd9b700 1 -- 172.21.15.46:0/4290642245 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5557500583d0 msgr2=0x555750058850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:58:33.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.250+0000 7f8f4dd9b700 1 --2- 172.21.15.46:0/4290642245 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5557500583d0 0x555750058850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:58:33.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.250+0000 7f8f4dd9b700 1 -- 172.21.15.46:0/4290642245 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555750058d90 msgr2=0x555750059210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:58:33.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.250+0000 7f8f4dd9b700 1 --2- 172.21.15.46:0/4290642245 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555750058d90 0x555750059210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:58:33.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.250+0000 7f8f4dd9b700 1 -- 172.21.15.46:0/4290642245 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55574ff5f3f0 con 0x555750057a90 2023-10-19T12:58:33.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.250+0000 7f8f4dd9b700 1 --2- 172.21.15.46:0/4290642245 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x555750057a90 0x555750057e90 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8f440165a0 tx=0x7f8f4400a370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b77de7c27801142 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:58:33.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.250+0000 7f8f3cff9700 1 -- 172.21.15.46:0/4290642245 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f44016bc0 con 0x555750057a90 2023-10-19T12:58:33.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.250+0000 7f8f3cff9700 1 -- 172.21.15.46:0/4290642245 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8f4400c070 con 0x555750057a90 2023-10-19T12:58:33.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.250+0000 7f8f3cff9700 1 -- 172.21.15.46:0/4290642245 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f44012390 con 0x555750057a90 2023-10-19T12:58:33.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.253+0000 7f8f68407b80 1 -- 172.21.15.46:0/4290642245 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x555750057a90 msgr2=0x555750057e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:58:33.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.253+0000 7f8f68407b80 1 --2- 172.21.15.46:0/4290642245 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x555750057a90 0x555750057e90 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8f440165a0 tx=0x7f8f4400a370 comp rx=0 tx=0).stop 2023-10-19T12:58:33.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.254+0000 7f8f3f7fe700 1 --2- 172.21.15.46:0/2755469655 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f8f380a14d0 0x7f8f380a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:58:33.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.255+0000 7f8f4dd9b700 1 --2- 172.21.15.46:0/2755469655 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f8f380a14d0 0x7f8f380a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:58:33.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.255+0000 7f8f68407b80 1 -- 172.21.15.46:0/4290642245 shutdown_connections 2023-10-19T12:58:33.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.255+0000 7f8f68407b80 1 --2- 172.21.15.46:0/4290642245 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555750058d90 0x555750059210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:58:33.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.255+0000 7f8f68407b80 1 --2- 172.21.15.46:0/4290642245 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x555750057a90 0x555750057e90 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:58:33.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.255+0000 7f8f68407b80 1 --2- 172.21.15.46:0/4290642245 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5557500583d0 0x555750058850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:58:33.260 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.255+0000 7f8f68407b80 1 -- 172.21.15.46:0/4290642245 >> 172.21.15.46:0/4290642245 conn(0x55574ffc3720 msgr2=0x555750049b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:58:33.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.255+0000 7f8f3f7fe700 1 -- 172.21.15.46:0/2755469655 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f8f48006e40 con 0x7f8f50102330 2023-10-19T12:58:33.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.256+0000 7f8f68407b80 1 -- 172.21.15.46:0/4290642245 shutdown_connections 2023-10-19T12:58:33.261 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.257+0000 7f8f68407b80 1 -- 172.21.15.46:0/4290642245 wait complete. 2023-10-19T12:58:33.262 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.257+0000 7f8f68407b80 1 -- start start 2023-10-19T12:58:33.263 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.258+0000 7f8f4dd9b700 1 --2- 172.21.15.46:0/2755469655 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f8f380a14d0 0x7f8f380a3990 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f8f4403b040 tx=0x7f8f44004750 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:58:33.263 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.258+0000 7f8f68407b80 1 Processor -- start 2023-10-19T12:58:33.263 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.258+0000 7f8f68407b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555750057a90 0x555750056810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:58:33.263 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.258+0000 7f8f68407b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5557500583d0 0x555750056d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:58:33.263 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.258+0000 7f8f68407b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x555750058d90 0x55575005ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:58:33.264 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.259+0000 7f8f4dd9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5557500583d0 0x555750056d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:58:33.264 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.259+0000 7f8f4dd9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5557500583d0 0x555750056d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:56946/0 (socket says 172.21.15.46:56946) 2023-10-19T12:58:33.264 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.259+0000 7f8f68407b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55574ffa1e70 con 0x555750057a90 2023-10-19T12:58:33.264 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.259+0000 7f8f68407b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55574ff3e710 con 0x555750058d90 2023-10-19T12:58:33.264 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.259+0000 7f8f68407b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55574ff3e3b0 con 0x5557500583d0 2023-10-19T12:58:33.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.259+0000 7f8f4dd9b700 1 -- 172.21.15.46:0/1385528860 learned_addr learned my addr 172.21.15.46:0/1385528860 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:58:33.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.259+0000 7f8f68407b80 10 client.0 _ll_register_callbacks cb 0x55574fe88a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:58:33.265 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.259+0000 7f8f4e59c700 1 --2- 172.21.15.46:0/1385528860 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555750057a90 0x555750056810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:58:33.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.260+0000 7f8f4dd9b700 1 -- 172.21.15.46:0/1385528860 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x555750058d90 msgr2=0x55575005ffc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-19T12:58:33.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.260+0000 7f8f4dd9b700 1 --2- 172.21.15.46:0/1385528860 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x555750058d90 0x55575005ffc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:58:33.266 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.260+0000 7f8f4dd9b700 1 -- 172.21.15.46:0/1385528860 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555750057a90 msgr2=0x555750056810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:58:33.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.260+0000 7f8f4dd9b700 1 --2- 172.21.15.46:0/1385528860 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555750057a90 0x555750056810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:58:33.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.260+0000 7f8f4dd9b700 1 -- 172.21.15.46:0/1385528860 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f4400e040 con 0x5557500583d0 2023-10-19T12:58:33.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.261+0000 7f8f4dd9b700 1 --2- 172.21.15.46:0/1385528860 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5557500583d0 0x555750056d50 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8f44016d00 tx=0x7f8f4400a2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7e8aed43abd175b server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:58:33.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.261+0000 7f8f35ffb700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-10-19T12:58:33.267 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.263+0000 7f8f35ffb700 1 -- 172.21.15.46:0/1385528860 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f44042630 con 0x5557500583d0 2023-10-19T12:58:33.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.263+0000 7f8f35ffb700 1 -- 172.21.15.46:0/1385528860 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f8f44042790 con 0x5557500583d0 2023-10-19T12:58:33.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.263+0000 7f8f68407b80 1 -- 172.21.15.46:0/1385528860 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55574ffa6ef0 con 0x5557500583d0 2023-10-19T12:58:33.268 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.263+0000 7f8f35ffb700 1 -- 172.21.15.46:0/1385528860 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8f44042950 con 0x5557500583d0 2023-10-19T12:58:33.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.264+0000 7f8f68407b80 10 client.26251 fetch_fsmap learned FSMap version 52 2023-10-19T12:58:33.269 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.264+0000 7f8f68407b80 1 -- 172.21.15.46:0/1385528860 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) v3 -- 0x55574fdccde0 con 0x5557500583d0 2023-10-19T12:58:33.270 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.267+0000 7f8f35ffb700 1 -- 172.21.15.46:0/1385528860 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55574ffa6ef0 con 0x5557500583d0 2023-10-19T12:58:33.270 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.267+0000 7f8f35ffb700 1 -- 172.21.15.46:0/1385528860 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 52) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f8f44050b40 con 0x5557500583d0 2023-10-19T12:58:33.270 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.267+0000 7f8f68407b80 10 client.26251 fetch_fsmap finished waiting for FSMap version 52 2023-10-19T12:58:33.271 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.267+0000 7f8f68407b80 10 client.26251 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-19T12:58:33.271 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.267+0000 7f8f68407b80 20 client.26251 populate_metadata read hostname 'smithi046' 2023-10-19T12:58:33.271 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.267+0000 7f8f68407b80 1 --2- 172.21.15.46:0/1385528860 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x555750064870 0x555750066c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:58:33.271 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.267+0000 7f8f68407b80 4 client.26251 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-19T12:58:33.271 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.267+0000 7f8f68407b80 1 -- 172.21.15.46:0/1385528860 --> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55575001e8b0 con 0x555750064870 2023-10-19T12:58:33.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.267+0000 7f8f4e59c700 1 --2- 172.21.15.46:0/1385528860 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x555750064870 0x555750066c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:58:33.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.271+0000 7f8f35ffb700 10 client.26251 ms_handle_connect on v2:172.21.15.157:6838/552718978 2023-10-19T12:58:33.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.271+0000 7f8f4e59c700 1 --2- 172.21.15.46:0/1385528860 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x555750064870 0x555750066c90 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5bff0c1b9aed390f server_cookie=2bedbfe95beea65b in_seq=0 out_seq=0 2023-10-19T12:58:33.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.272+0000 7f8f35ffb700 1 -- 172.21.15.46:0/1385528860 <== mds.0 v2:172.21.15.157:6838/552718978 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55575001e8b0 con 0x555750064870 2023-10-19T12:58:33.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.272+0000 7f8f35ffb700 10 client.26251 handle_command_reply: tid=0 2023-10-19T12:58:33.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.272+0000 7f8f68407b80 1 client.26251 shutdown 2023-10-19T12:58:33.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.273+0000 7f8f68407b80 1 -- 172.21.15.46:0/1385528860 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5557500583d0 msgr2=0x555750056d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:58:33.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.273+0000 7f8f68407b80 1 --2- 172.21.15.46:0/1385528860 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5557500583d0 0x555750056d50 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8f44016d00 tx=0x7f8f4400a2d0 comp rx=0 tx=0).stop 2023-10-19T12:58:33.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.273+0000 7f8f68407b80 1 -- 172.21.15.46:0/1385528860 shutdown_connections 2023-10-19T12:58:33.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.273+0000 7f8f68407b80 1 --2- 172.21.15.46:0/1385528860 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x555750058d90 0x55575005ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:58:33.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.273+0000 7f8f68407b80 1 --2- 172.21.15.46:0/1385528860 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x555750064870 0x555750066c90 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:58:33.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.273+0000 7f8f68407b80 1 --2- 172.21.15.46:0/1385528860 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555750057a90 0x555750056810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:58:33.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.273+0000 7f8f68407b80 1 --2- 172.21.15.46:0/1385528860 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5557500583d0 0x555750056d50 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:58:33.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.273+0000 7f8f35ffb700 0 client.26251 ms_handle_reset on v2:172.21.15.157:6838/552718978 2023-10-19T12:58:33.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.273+0000 7f8f68407b80 1 -- 172.21.15.46:0/1385528860 >> 172.21.15.46:0/1385528860 conn(0x55574ffc3720 msgr2=0x555750049b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:58:33.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.273+0000 7f8f68407b80 1 -- 172.21.15.46:0/1385528860 shutdown_connections 2023-10-19T12:58:33.278 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.273+0000 7f8f68407b80 1 -- 172.21.15.46:0/1385528860 wait complete. 2023-10-19T12:58:33.279 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.275+0000 7f8f68407b80 20 client.26251 trim_cache size 0 max 16384 2023-10-19T12:58:33.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.323+0000 7f8f68407b80 1 Processor -- start 2023-10-19T12:58:33.326 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.323+0000 7f8f68407b80 1 -- start start 2023-10-19T12:58:33.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.324+0000 7f8f68407b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555750057a90 0x555750057e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:58:33.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.324+0000 7f8f68407b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5557500583d0 0x55575005fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:58:33.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.324+0000 7f8f68407b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x555750058d90 0x555750055d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:58:33.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.324+0000 7f8f68407b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55574fe22920 con 0x5557500583d0 2023-10-19T12:58:33.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.324+0000 7f8f68407b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55575004b310 con 0x555750058d90 2023-10-19T12:58:33.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.324+0000 7f8f68407b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55575004bbb0 con 0x555750057a90 2023-10-19T12:58:33.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.324+0000 7f8f4e59c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555750057a90 0x555750057e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:58:33.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.325+0000 7f8f4e59c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555750057a90 0x555750057e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:56952/0 (socket says 172.21.15.46:56952) 2023-10-19T12:58:33.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.325+0000 7f8f4e59c700 1 -- 172.21.15.46:0/819436450 learned_addr learned my addr 172.21.15.46:0/819436450 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:58:33.329 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.325+0000 7f8f4e59c700 1 -- 172.21.15.46:0/819436450 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x555750058d90 msgr2=0x555750055d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:58:33.330 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.325+0000 7f8f4e59c700 1 --2- 172.21.15.46:0/819436450 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x555750058d90 0x555750055d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:58:33.330 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.325+0000 7f8f4e59c700 1 -- 172.21.15.46:0/819436450 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5557500583d0 msgr2=0x55575005fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:58:33.330 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.325+0000 7f8f4e59c700 1 --2- 172.21.15.46:0/819436450 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5557500583d0 0x55575005fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:58:33.330 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.325+0000 7f8f4e59c700 1 -- 172.21.15.46:0/819436450 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55574fdb5c60 con 0x555750057a90 2023-10-19T12:58:33.331 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.326+0000 7f8f4e59c700 1 --2- 172.21.15.46:0/819436450 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555750057a90 0x555750057e70 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8f400038c0 tx=0x7f8f40009ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=346bbb47c7fab3e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:58:33.331 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.326+0000 7f8f3d7fa700 1 -- 172.21.15.46:0/819436450 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f4001d040 con 0x555750057a90 2023-10-19T12:58:33.331 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.326+0000 7f8f3d7fa700 1 -- 172.21.15.46:0/819436450 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8f4001e040 con 0x555750057a90 2023-10-19T12:58:33.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.326+0000 7f8f3d7fa700 1 -- 172.21.15.46:0/819436450 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f400252d0 con 0x555750057a90 2023-10-19T12:58:33.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.327+0000 7f8f68407b80 1 -- 172.21.15.46:0/819436450 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555750057a90 msgr2=0x555750057e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:58:33.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.327+0000 7f8f68407b80 1 --2- 172.21.15.46:0/819436450 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555750057a90 0x555750057e70 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8f400038c0 tx=0x7f8f40009ca0 comp rx=0 tx=0).stop 2023-10-19T12:58:33.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.330+0000 7f8f68407b80 1 -- 172.21.15.46:0/819436450 shutdown_connections 2023-10-19T12:58:33.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.330+0000 7f8f68407b80 1 --2- 172.21.15.46:0/819436450 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x555750058d90 0x555750055d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:58:33.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.330+0000 7f8f68407b80 1 --2- 172.21.15.46:0/819436450 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555750057a90 0x555750057e70 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:58:33.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.330+0000 7f8f68407b80 1 --2- 172.21.15.46:0/819436450 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5557500583d0 0x55575005fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:58:33.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.330+0000 7f8f68407b80 1 -- 172.21.15.46:0/819436450 >> 172.21.15.46:0/819436450 conn(0x55574ffc3720 msgr2=0x555750059170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:58:33.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.330+0000 7f8f68407b80 1 -- 172.21.15.46:0/819436450 shutdown_connections 2023-10-19T12:58:33.334 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.330+0000 7f8f68407b80 1 -- 172.21.15.46:0/819436450 wait complete. 2023-10-19T12:58:33.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.331+0000 7f8f68407b80 1 -- start start 2023-10-19T12:58:33.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.331+0000 7f8f68407b80 1 Processor -- start 2023-10-19T12:58:33.335 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.332+0000 7f8f68407b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x555750057a90 0x55575005fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:58:33.336 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.332+0000 7f8f68407b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5557500583d0 0x55575005c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:58:33.336 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.332+0000 7f8f68407b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555750058d90 0x55575005cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:58:33.336 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.333+0000 7f8f68407b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55575005d270 con 0x5557500583d0 2023-10-19T12:58:33.338 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.333+0000 7f8f68407b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55575005d3e0 con 0x555750057a90 2023-10-19T12:58:33.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.333+0000 7f8f68407b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557500b8690 con 0x555750058d90 2023-10-19T12:58:33.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.333+0000 7f8f68407b80 10 client.0 _ll_register_callbacks cb 0x55574fe88a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:58:33.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.333+0000 7f8f4ed9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555750058d90 0x55575005cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:58:33.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.333+0000 7f8f4ed9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555750058d90 0x55575005cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:56962/0 (socket says 172.21.15.46:56962) 2023-10-19T12:58:33.339 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.333+0000 7f8f4ed9d700 1 -- 172.21.15.46:0/616268336 learned_addr learned my addr 172.21.15.46:0/616268336 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:58:33.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.333+0000 7f8f4e59c700 1 --2- 172.21.15.46:0/616268336 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x555750057a90 0x55575005fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:58:33.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.334+0000 7f8f4e59c700 1 -- 172.21.15.46:0/616268336 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555750058d90 msgr2=0x55575005cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:58:33.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.334+0000 7f8f4e59c700 1 --2- 172.21.15.46:0/616268336 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555750058d90 0x55575005cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:58:33.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.334+0000 7f8f4e59c700 1 -- 172.21.15.46:0/616268336 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5557500583d0 msgr2=0x55575005c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:58:33.340 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.334+0000 7f8f4e59c700 1 --2- 172.21.15.46:0/616268336 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5557500583d0 0x55575005c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:58:33.341 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.334+0000 7f8f4e59c700 1 -- 172.21.15.46:0/616268336 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f50109530 con 0x555750057a90 2023-10-19T12:58:33.341 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.334+0000 7f8f4ed9d700 1 --2- 172.21.15.46:0/616268336 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555750058d90 0x55575005cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:58:33.341 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.334+0000 7f8f4e59c700 1 --2- 172.21.15.46:0/616268336 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x555750057a90 0x55575005fd00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x555750064490 tx=0x7f8f400039e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be5c92126584814d server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:58:33.341 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.334+0000 7f8f35ffb700 10 client.0 ms_handle_connect on v2:172.21.15.157:3300/0 2023-10-19T12:58:33.341 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.335+0000 7f8f35ffb700 1 -- 172.21.15.46:0/616268336 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f40025bf0 con 0x555750057a90 2023-10-19T12:58:33.342 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.335+0000 7f8f35ffb700 1 -- 172.21.15.46:0/616268336 <== mon.2 v2:172.21.15.157:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f8f40025d50 con 0x555750057a90 2023-10-19T12:58:33.342 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.335+0000 7f8f68407b80 1 -- 172.21.15.46:0/616268336 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8f4400c070 con 0x555750057a90 2023-10-19T12:58:33.342 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.335+0000 7f8f35ffb700 1 -- 172.21.15.46:0/616268336 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8f40025040 con 0x555750057a90 2023-10-19T12:58:33.342 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.335+0000 7f8f68407b80 10 client.26246 fetch_fsmap learned FSMap version 52 2023-10-19T12:58:33.342 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.335+0000 7f8f68407b80 1 -- 172.21.15.46:0/616268336 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) v3 -- 0x55574fdf3250 con 0x555750057a90 2023-10-19T12:58:33.343 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.336+0000 7f8f35ffb700 1 -- 172.21.15.46:0/616268336 <== mon.2 v2:172.21.15.157:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8f4400c070 con 0x555750057a90 2023-10-19T12:58:33.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.336+0000 7f8f35ffb700 1 -- 172.21.15.46:0/616268336 <== mon.2 v2:172.21.15.157:3300/0 5 ==== fsmap(e 52) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f8f4000f460 con 0x555750057a90 2023-10-19T12:58:33.344 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.336+0000 7f8f68407b80 10 client.26246 fetch_fsmap finished waiting for FSMap version 52 2023-10-19T12:58:33.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.336+0000 7f8f68407b80 10 client.26246 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-19T12:58:33.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.336+0000 7f8f68407b80 20 client.26246 populate_metadata read hostname 'smithi046' 2023-10-19T12:58:33.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.336+0000 7f8f68407b80 1 --2- 172.21.15.46:0/616268336 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x5557500b9b30 0x5557500bbf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:58:33.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.336+0000 7f8f68407b80 4 client.26246 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-19T12:58:33.345 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.336+0000 7f8f68407b80 1 -- 172.21.15.46:0/616268336 --> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55574ff9ae50 con 0x5557500b9b30 2023-10-19T12:58:33.346 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.337+0000 7f8f4dd9b700 1 --2- 172.21.15.46:0/616268336 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x5557500b9b30 0x5557500bbf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:58:33.346 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.339+0000 7f8f35ffb700 10 client.26246 ms_handle_connect on v2:172.21.15.157:6838/552718978 2023-10-19T12:58:33.346 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.339+0000 7f8f4dd9b700 1 --2- 172.21.15.46:0/616268336 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x5557500b9b30 0x5557500bbf50 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=32deef5c48ee3db8 server_cookie=7b4c14ed92b55bde in_seq=0 out_seq=0 2023-10-19T12:58:33.346 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.339+0000 7f8f35ffb700 1 -- 172.21.15.46:0/616268336 <== mds.0 v2:172.21.15.157:6838/552718978 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55574ff9ae50 con 0x5557500b9b30 2023-10-19T12:58:33.346 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.339+0000 7f8f35ffb700 10 client.26246 handle_command_reply: tid=0 2023-10-19T12:58:33.347 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.339+0000 7f8f68407b80 1 client.26246 shutdown 2023-10-19T12:58:33.347 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.339+0000 7f8f68407b80 1 -- 172.21.15.46:0/616268336 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x555750057a90 msgr2=0x55575005fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:58:33.347 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.339+0000 7f8f68407b80 1 --2- 172.21.15.46:0/616268336 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x555750057a90 0x55575005fd00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x555750064490 tx=0x7f8f400039e0 comp rx=0 tx=0).stop 2023-10-19T12:58:33.347 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.339+0000 7f8f68407b80 1 -- 172.21.15.46:0/616268336 shutdown_connections 2023-10-19T12:58:33.347 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.339+0000 7f8f68407b80 1 --2- 172.21.15.46:0/616268336 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555750058d90 0x55575005cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:58:33.348 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.339+0000 7f8f68407b80 1 --2- 172.21.15.46:0/616268336 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x555750057a90 0x55575005fd00 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:58:33.348 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.340+0000 7f8f68407b80 1 --2- 172.21.15.46:0/616268336 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x5557500b9b30 0x5557500bbf50 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:58:33.348 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.340+0000 7f8f35ffb700 0 client.26246 ms_handle_reset on v2:172.21.15.157:6838/552718978 2023-10-19T12:58:33.348 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.340+0000 7f8f68407b80 1 --2- 172.21.15.46:0/616268336 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5557500583d0 0x55575005c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:58:33.348 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.340+0000 7f8f68407b80 1 -- 172.21.15.46:0/616268336 >> 172.21.15.46:0/616268336 conn(0x55574ffc3720 msgr2=0x555750055d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:58:33.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.340+0000 7f8f68407b80 1 -- 172.21.15.46:0/616268336 shutdown_connections 2023-10-19T12:58:33.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.340+0000 7f8f68407b80 1 -- 172.21.15.46:0/616268336 wait complete. 2023-10-19T12:58:33.349 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.340+0000 7f8f68407b80 20 client.26246 trim_cache size 0 max 16384 2023-10-19T12:58:33.349 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-10-19T12:58:33.350 INFO:teuthology.orchestra.run.smithi046.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-19T12:58:33.350 INFO:teuthology.orchestra.run.smithi046.stdout: "scrubs": { 2023-10-19T12:58:33.350 INFO:teuthology.orchestra.run.smithi046.stdout: "21e73f70-af16-4ae7-bc34-e6c54ba8e1ec": { 2023-10-19T12:58:33.350 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2023-10-19T12:58:33.350 INFO:teuthology.orchestra.run.smithi046.stdout: "tag": "21e73f70-af16-4ae7-bc34-e6c54ba8e1ec", 2023-10-19T12:58:33.351 INFO:teuthology.orchestra.run.smithi046.stdout: "options": "recursive,force" 2023-10-19T12:58:33.351 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:58:33.351 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:58:33.351 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-10-19T12:58:33.352 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.341+0000 7f8f549ff700 1 -- 172.21.15.46:0/2755469655 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f8f380a14d0 msgr2=0x7f8f380a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:58:33.352 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.341+0000 7f8f549ff700 1 --2- 172.21.15.46:0/2755469655 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f8f380a14d0 0x7f8f380a3990 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f8f4403b040 tx=0x7f8f44004750 comp rx=0 tx=0).stop 2023-10-19T12:58:33.352 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.341+0000 7f8f549ff700 1 -- 172.21.15.46:0/2755469655 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8f50102330 msgr2=0x7f8f5019ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:58:33.353 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.341+0000 7f8f549ff700 1 --2- 172.21.15.46:0/2755469655 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8f50102330 0x7f8f5019ff80 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8f4800b970 tx=0x7f8f4800bd30 comp rx=0 tx=0).stop 2023-10-19T12:58:33.353 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.343+0000 7f8f549ff700 1 -- 172.21.15.46:0/2755469655 shutdown_connections 2023-10-19T12:58:33.353 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.343+0000 7f8f549ff700 1 --2- 172.21.15.46:0/2755469655 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f8f380a14d0 0x7f8f380a3990 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:58:33.353 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.343+0000 7f8f549ff700 1 --2- 172.21.15.46:0/2755469655 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8f50102330 0x7f8f5019ff80 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:58:33.353 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.343+0000 7f8f549ff700 1 --2- 172.21.15.46:0/2755469655 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8f501007a0 0x7f8f50198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:58:33.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.343+0000 7f8f549ff700 1 --2- 172.21.15.46:0/2755469655 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f50101990 0x7f8f50198fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:58:33.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.343+0000 7f8f549ff700 1 -- 172.21.15.46:0/2755469655 >> 172.21.15.46:0/2755469655 conn(0x7f8f500fbcf0 msgr2=0x7f8f50072a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:58:33.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.343+0000 7f8f549ff700 1 -- 172.21.15.46:0/2755469655 shutdown_connections 2023-10-19T12:58:33.354 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:58:33.343+0000 7f8f549ff700 1 -- 172.21.15.46:0/2755469655 wait complete. 2023-10-19T12:58:33.382 INFO:tasks.cephfs.filesystem:scrub status for tag:21e73f70-af16-4ae7-bc34-e6c54ba8e1ec - {'path': '/', 'tag': '21e73f70-af16-4ae7-bc34-e6c54ba8e1ec', 'options': 'recursive,force'} 2023-10-19T12:58:34.478 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:58:34 smithi046 ceph-mon[98509]: pgmap v805: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 5.7 MiB/s wr, 562 op/s 2023-10-19T12:58:34.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:58:34 smithi157 ceph-mon[134109]: pgmap v805: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 5.7 MiB/s wr, 562 op/s 2023-10-19T12:58:34.633 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:58:34 smithi195 ceph-mon[134493]: pgmap v805: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 5.7 MiB/s wr, 562 op/s 2023-10-19T12:58:35.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:58:35 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:58:35.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:58:35 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:58:35.637 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:58:35 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:58:36.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:58:36 smithi157 ceph-mon[134109]: pgmap v806: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 5.2 MiB/s wr, 502 op/s 2023-10-19T12:58:36.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:58:36 smithi195 ceph-mon[134493]: pgmap v806: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 5.2 MiB/s wr, 502 op/s 2023-10-19T12:58:36.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 875.0 s, 601.8 tps, lat 154.972 ms stddev 183.181 2023-10-19T12:58:36.728 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:58:36 smithi046 ceph-mon[98509]: pgmap v806: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 5.2 MiB/s wr, 502 op/s 2023-10-19T12:58:37.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:58:37 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:58:37.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:58:37 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:58:37.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:58:37 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:58:37.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:58:37 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:58:37.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:58:37 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:58:37.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:58:37 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:58:37.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:58:37 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:58:37.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:58:37 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:58:37.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:58:37 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:58:38.837 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:58:38 smithi157 ceph-mon[134109]: pgmap v807: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 5.6 MiB/s wr, 537 op/s 2023-10-19T12:58:38.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:58:38 smithi195 ceph-mon[134493]: pgmap v807: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 5.6 MiB/s wr, 537 op/s 2023-10-19T12:58:38.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:58:38 smithi046 ceph-mon[98509]: pgmap v807: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 5.6 MiB/s wr, 537 op/s 2023-10-19T12:58:40.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:58:39 smithi046 ceph-mon[98509]: pgmap v808: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 4.9 MiB/s wr, 458 op/s 2023-10-19T12:58:40.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:58:39 smithi157 ceph-mon[134109]: pgmap v808: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 4.9 MiB/s wr, 458 op/s 2023-10-19T12:58:40.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:58:39 smithi195 ceph-mon[134493]: pgmap v808: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 4.9 MiB/s wr, 458 op/s 2023-10-19T12:58:41.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 880.0 s, 356.4 tps, lat 287.892 ms stddev 359.869 2023-10-19T12:58:42.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:58:42 smithi046 ceph-mon[98509]: pgmap v809: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 4.7 MiB/s wr, 410 op/s 2023-10-19T12:58:42.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:58:42 smithi157 ceph-mon[134109]: pgmap v809: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 4.7 MiB/s wr, 410 op/s 2023-10-19T12:58:42.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:58:42 smithi195 ceph-mon[134493]: pgmap v809: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 4.7 MiB/s wr, 410 op/s 2023-10-19T12:58:44.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:58:44 smithi046 ceph-mon[98509]: pgmap v810: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 6.3 MiB/s wr, 482 op/s 2023-10-19T12:58:44.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:58:44 smithi157 ceph-mon[134109]: pgmap v810: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 6.3 MiB/s wr, 482 op/s 2023-10-19T12:58:44.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:58:44 smithi195 ceph-mon[134493]: pgmap v810: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 6.3 MiB/s wr, 482 op/s 2023-10-19T12:58:46.592 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:58:46 smithi157 ceph-mon[134109]: pgmap v811: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 5.7 MiB/s wr, 419 op/s 2023-10-19T12:58:46.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:58:46 smithi195 ceph-mon[134493]: pgmap v811: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 5.7 MiB/s wr, 419 op/s 2023-10-19T12:58:46.700 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 885.0 s, 433.0 tps, lat 232.858 ms stddev 259.291 2023-10-19T12:58:46.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:58:46 smithi046 ceph-mon[98509]: pgmap v811: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 5.7 MiB/s wr, 419 op/s 2023-10-19T12:58:48.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:58:48 smithi157 ceph-mon[134109]: pgmap v812: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 6.8 MiB/s wr, 487 op/s 2023-10-19T12:58:48.640 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:58:48 smithi195 ceph-mon[134493]: pgmap v812: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 6.8 MiB/s wr, 487 op/s 2023-10-19T12:58:48.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:58:48 smithi046 ceph-mon[98509]: pgmap v812: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 6.8 MiB/s wr, 487 op/s 2023-10-19T12:58:50.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:58:49 smithi046 ceph-mon[98509]: pgmap v813: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 6.8 MiB/s wr, 456 op/s 2023-10-19T12:58:50.343 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:58:49 smithi157 ceph-mon[134109]: pgmap v813: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 6.8 MiB/s wr, 456 op/s 2023-10-19T12:58:50.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:58:49 smithi195 ceph-mon[134493]: pgmap v813: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 6.8 MiB/s wr, 456 op/s 2023-10-19T12:58:51.700 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 890.0 s, 462.4 tps, lat 216.648 ms stddev 282.114 2023-10-19T12:58:52.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:58:52 smithi046 ceph-mon[98509]: pgmap v814: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 6.5 MiB/s wr, 416 op/s 2023-10-19T12:58:52.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:58:52 smithi157 ceph-mon[134109]: pgmap v814: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 6.5 MiB/s wr, 416 op/s 2023-10-19T12:58:52.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:58:52 smithi195 ceph-mon[134493]: pgmap v814: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 6.5 MiB/s wr, 416 op/s 2023-10-19T12:58:54.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:58:54 smithi046 ceph-mon[98509]: pgmap v815: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 7.7 MiB/s wr, 515 op/s 2023-10-19T12:58:54.589 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:58:54 smithi157 ceph-mon[134109]: pgmap v815: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 7.7 MiB/s wr, 515 op/s 2023-10-19T12:58:54.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:58:54 smithi195 ceph-mon[134493]: pgmap v815: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 7.7 MiB/s wr, 515 op/s 2023-10-19T12:58:56.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:58:56 smithi046 ceph-mon[98509]: pgmap v816: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 6.7 MiB/s wr, 446 op/s 2023-10-19T12:58:56.589 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:58:56 smithi157 ceph-mon[134109]: pgmap v816: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 6.7 MiB/s wr, 446 op/s 2023-10-19T12:58:56.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:58:56 smithi195 ceph-mon[134493]: pgmap v816: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 6.7 MiB/s wr, 446 op/s 2023-10-19T12:58:56.701 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 895.0 s, 518.0 tps, lat 201.432 ms stddev 251.097 2023-10-19T12:58:58.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:58:58 smithi046 ceph-mon[98509]: pgmap v817: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 7.0 MiB/s wr, 486 op/s 2023-10-19T12:58:58.592 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:58:58 smithi157 ceph-mon[134109]: pgmap v817: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 7.0 MiB/s wr, 486 op/s 2023-10-19T12:58:58.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:58:58 smithi195 ceph-mon[134493]: pgmap v817: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 7.0 MiB/s wr, 486 op/s 2023-10-19T12:59:00.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:58:59 smithi046 ceph-mon[98509]: pgmap v818: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 6.7 MiB/s wr, 440 op/s 2023-10-19T12:59:00.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:58:59 smithi157 ceph-mon[134109]: pgmap v818: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 6.7 MiB/s wr, 440 op/s 2023-10-19T12:59:00.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:58:59 smithi195 ceph-mon[134493]: pgmap v818: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 6.7 MiB/s wr, 440 op/s 2023-10-19T12:59:01.702 INFO:teuthology.orchestra.run.smithi046.stderr:progress: 900.0 s, 456.5 tps, lat 216.498 ms stddev 263.234 2023-10-19T12:59:02.048 INFO:teuthology.orchestra.run.smithi046.stdout:transaction type: 2023-10-19T12:59:02.048 INFO:teuthology.orchestra.run.smithi046.stdout:scaling factor: 32 2023-10-19T12:59:02.048 INFO:teuthology.orchestra.run.smithi046.stdout:query mode: simple 2023-10-19T12:59:02.049 INFO:teuthology.orchestra.run.smithi046.stdout:number of clients: 100 2023-10-19T12:59:02.049 INFO:teuthology.orchestra.run.smithi046.stdout:number of threads: 4 2023-10-19T12:59:02.049 INFO:teuthology.orchestra.run.smithi046.stdout:duration: 900 s 2023-10-19T12:59:02.049 INFO:teuthology.orchestra.run.smithi046.stdout:number of transactions actually processed: 622298 2023-10-19T12:59:02.050 INFO:teuthology.orchestra.run.smithi046.stdout:latency average = 144.615 ms 2023-10-19T12:59:02.050 INFO:teuthology.orchestra.run.smithi046.stdout:latency stddev = 212.783 ms 2023-10-19T12:59:02.050 INFO:teuthology.orchestra.run.smithi046.stdout:tps = 691.177650 (including connections establishing) 2023-10-19T12:59:02.050 INFO:teuthology.orchestra.run.smithi046.stdout:tps = 691.184022 (excluding connections establishing) 2023-10-19T12:59:02.058 DEBUG:teuthology.orchestra.run.smithi046:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo systemctl stop postgresql' 2023-10-19T12:59:02.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:59:02 smithi046 ceph-mon[98509]: pgmap v819: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 6.4 MiB/s wr, 408 op/s 2023-10-19T12:59:02.598 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:59:02 smithi157 ceph-mon[134109]: pgmap v819: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 6.4 MiB/s wr, 408 op/s 2023-10-19T12:59:02.632 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:59:02 smithi195 ceph-mon[134493]: pgmap v819: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 6.4 MiB/s wr, 408 op/s 2023-10-19T12:59:03.383 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-19T12:59:03.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.767+0000 7f43fedff700 1 -- 172.21.15.46:0/742334700 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43f80763f0 msgr2=0x7f43f8076870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:59:03.771 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.767+0000 7f43fedff700 1 --2- 172.21.15.46:0/742334700 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43f80763f0 0x7f43f8076870 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f43e801c0d0 tx=0x7f43e801c3e0 comp rx=0 tx=0).stop 2023-10-19T12:59:03.771 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.767+0000 7f43fedff700 1 -- 172.21.15.46:0/742334700 shutdown_connections 2023-10-19T12:59:03.771 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.767+0000 7f43fedff700 1 --2- 172.21.15.46:0/742334700 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f43f8076db0 0x7f43f8077630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:59:03.771 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.767+0000 7f43fedff700 1 --2- 172.21.15.46:0/742334700 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f43f80751b0 0x7f43f80755d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:59:03.771 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.767+0000 7f43fedff700 1 --2- 172.21.15.46:0/742334700 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43f80763f0 0x7f43f8076870 secure :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f43e801c0d0 tx=0x7f43e801c3e0 comp rx=0 tx=0).stop 2023-10-19T12:59:03.772 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.767+0000 7f43fedff700 1 -- 172.21.15.46:0/742334700 >> 172.21.15.46:0/742334700 conn(0x7f43f80fdf60 msgr2=0x7f43f8100380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:59:03.772 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.768+0000 7f43fedff700 1 -- 172.21.15.46:0/742334700 shutdown_connections 2023-10-19T12:59:03.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.768+0000 7f43fedff700 1 -- 172.21.15.46:0/742334700 wait complete. 2023-10-19T12:59:03.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.770+0000 7f43fedff700 1 Processor -- start 2023-10-19T12:59:03.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.770+0000 7f43fedff700 1 -- start start 2023-10-19T12:59:03.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.770+0000 7f43fedff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f43f80751b0 0x7f43f8194720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:59:03.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.771+0000 7f43fedff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f43f8076db0 0x7f43f8194c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:59:03.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.771+0000 7f43fedff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43f8199c70 0x7f43f819c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:59:03.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.771+0000 7f43fedff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43f819c630 con 0x7f43f8076db0 2023-10-19T12:59:03.775 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.771+0000 7f43fedff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43f819c770 con 0x7f43f80751b0 2023-10-19T12:59:03.775 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.771+0000 7f43fedff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43f819c900 con 0x7f43f8199c70 2023-10-19T12:59:03.775 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.771+0000 7f43fcb9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f43f80751b0 0x7f43f8194720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:59:03.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.771+0000 7f43fd39c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43f8199c70 0x7f43f819c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:59:03.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.771+0000 7f43fcb9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f43f80751b0 0x7f43f8194720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:37750/0 (socket says 172.21.15.46:37750) 2023-10-19T12:59:03.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.771+0000 7f43fcb9b700 1 -- 172.21.15.46:0/3489276003 learned_addr learned my addr 172.21.15.46:0/3489276003 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:59:03.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.771+0000 7f43f7fff700 1 --2- 172.21.15.46:0/3489276003 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f43f8076db0 0x7f43f8194c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:59:03.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.771+0000 7f43fd39c700 1 -- 172.21.15.46:0/3489276003 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f43f80751b0 msgr2=0x7f43f8194720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:59:03.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.771+0000 7f43fd39c700 1 --2- 172.21.15.46:0/3489276003 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f43f80751b0 0x7f43f8194720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:59:03.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.771+0000 7f43fd39c700 1 -- 172.21.15.46:0/3489276003 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f43f8076db0 msgr2=0x7f43f8194c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:59:03.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.771+0000 7f43fd39c700 1 --2- 172.21.15.46:0/3489276003 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f43f8076db0 0x7f43f8194c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:59:03.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.771+0000 7f43fd39c700 1 -- 172.21.15.46:0/3489276003 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43e801ad10 con 0x7f43f8199c70 2023-10-19T12:59:03.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.772+0000 7f43fd39c700 1 --2- 172.21.15.46:0/3489276003 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43f8199c70 0x7f43f819c060 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f43e000d720 tx=0x7f43e000da30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:59:03.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.772+0000 7f43f5ffb700 1 -- 172.21.15.46:0/3489276003 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e0004220 con 0x7f43f8199c70 2023-10-19T12:59:03.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.772+0000 7f43f5ffb700 1 -- 172.21.15.46:0/3489276003 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f43e0004cf0 con 0x7f43f8199c70 2023-10-19T12:59:03.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.772+0000 7f43f5ffb700 1 -- 172.21.15.46:0/3489276003 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e00056a0 con 0x7f43f8199c70 2023-10-19T12:59:03.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.772+0000 7f43fedff700 1 -- 172.21.15.46:0/3489276003 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43f819cbe0 con 0x7f43f8199c70 2023-10-19T12:59:03.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.773+0000 7f43fedff700 1 -- 172.21.15.46:0/3489276003 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43f819d0a0 con 0x7f43f8199c70 2023-10-19T12:59:03.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.780+0000 7f43f5ffb700 1 -- 172.21.15.46:0/3489276003 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f43e0004380 con 0x7f43f8199c70 2023-10-19T12:59:03.787 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.785+0000 7f43f5ffb700 1 --2- 172.21.15.46:0/3489276003 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f43e40a1500 0x7f43e40a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:59:03.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.785+0000 7f43f5ffb700 1 -- 172.21.15.46:0/3489276003 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f43e00ccaa0 con 0x7f43f8199c70 2023-10-19T12:59:03.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.785+0000 7f4412623b80 1 Processor -- start 2023-10-19T12:59:03.788 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.785+0000 7f43fcb9b700 1 --2- 172.21.15.46:0/3489276003 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f43e40a1500 0x7f43e40a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:59:03.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.785+0000 7f4412623b80 1 -- start start 2023-10-19T12:59:03.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.786+0000 7f4412623b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5646d998b2d0 0x5646d998b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:59:03.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.786+0000 7f4412623b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5646d998bc30 0x5646d998a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:59:03.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.786+0000 7f4412623b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5646d998a5d0 0x5646d998aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:59:03.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.786+0000 7f4412623b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646d98fd6e0 con 0x5646d998b2d0 2023-10-19T12:59:03.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.786+0000 7f4412623b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646d98e3c60 con 0x5646d998bc30 2023-10-19T12:59:03.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.786+0000 7f4412623b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646d98e1580 con 0x5646d998a5d0 2023-10-19T12:59:03.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.786+0000 7f43fd39c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5646d998a5d0 0x5646d998aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:59:03.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.786+0000 7f43fd39c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5646d998a5d0 0x5646d998aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:44452/0 (socket says 172.21.15.46:44452) 2023-10-19T12:59:03.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.786+0000 7f43fd39c700 1 -- 172.21.15.46:0/2425236458 learned_addr learned my addr 172.21.15.46:0/2425236458 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:59:03.791 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.786+0000 7f43f7fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5646d998bc30 0x5646d998a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:59:03.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.787+0000 7f43fd39c700 1 -- 172.21.15.46:0/2425236458 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5646d998bc30 msgr2=0x5646d998a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:59:03.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.787+0000 7f43fd39c700 1 --2- 172.21.15.46:0/2425236458 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5646d998bc30 0x5646d998a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:59:03.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.787+0000 7f43fd39c700 1 -- 172.21.15.46:0/2425236458 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5646d998b2d0 msgr2=0x5646d998b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:59:03.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.787+0000 7f43fd39c700 1 --2- 172.21.15.46:0/2425236458 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5646d998b2d0 0x5646d998b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:59:03.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.787+0000 7f43fd39c700 1 -- 172.21.15.46:0/2425236458 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5646d989a3f0 con 0x5646d998a5d0 2023-10-19T12:59:03.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.787+0000 7f43f7fff700 1 --2- 172.21.15.46:0/2425236458 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5646d998bc30 0x5646d998a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:59:03.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.787+0000 7f43fd39c700 1 --2- 172.21.15.46:0/2425236458 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5646d998a5d0 0x5646d998aa50 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f43e0099980 tx=0x7f43e0099350 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ca2ef44878a8c82 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:59:03.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.788+0000 7f43eeffd700 1 -- 172.21.15.46:0/2425236458 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e00999f0 con 0x5646d998a5d0 2023-10-19T12:59:03.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.788+0000 7f43eeffd700 1 -- 172.21.15.46:0/2425236458 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f43e009db40 con 0x5646d998a5d0 2023-10-19T12:59:03.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.788+0000 7f43eeffd700 1 -- 172.21.15.46:0/2425236458 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e0099e50 con 0x5646d998a5d0 2023-10-19T12:59:03.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.789+0000 7f4412623b80 1 -- 172.21.15.46:0/2425236458 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5646d998a5d0 msgr2=0x5646d998aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:59:03.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.789+0000 7f43fcb9b700 1 --2- 172.21.15.46:0/3489276003 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f43e40a1500 0x7f43e40a39c0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f43f000ae90 tx=0x7f43f000a8a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:59:03.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.789+0000 7f4412623b80 1 --2- 172.21.15.46:0/2425236458 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5646d998a5d0 0x5646d998aa50 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f43e0099980 tx=0x7f43e0099350 comp rx=0 tx=0).stop 2023-10-19T12:59:03.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.789+0000 7f4412623b80 1 -- 172.21.15.46:0/2425236458 shutdown_connections 2023-10-19T12:59:03.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.789+0000 7f4412623b80 1 --2- 172.21.15.46:0/2425236458 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5646d998a5d0 0x5646d998aa50 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:59:03.796 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.789+0000 7f4412623b80 1 --2- 172.21.15.46:0/2425236458 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5646d998b2d0 0x5646d998b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:59:03.796 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.789+0000 7f4412623b80 1 --2- 172.21.15.46:0/2425236458 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5646d998bc30 0x5646d998a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:59:03.796 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.789+0000 7f4412623b80 1 -- 172.21.15.46:0/2425236458 >> 172.21.15.46:0/2425236458 conn(0x5646d98fe720 msgr2=0x5646d9984b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:59:03.796 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.789+0000 7f4412623b80 1 -- 172.21.15.46:0/2425236458 shutdown_connections 2023-10-19T12:59:03.796 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.789+0000 7f4412623b80 1 -- 172.21.15.46:0/2425236458 wait complete. 2023-10-19T12:59:03.798 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.790+0000 7f4412623b80 1 -- start start 2023-10-19T12:59:03.799 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.791+0000 7f4412623b80 1 Processor -- start 2023-10-19T12:59:03.799 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.791+0000 7f4412623b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5646d998a5d0 0x5646d99a4b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:59:03.799 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.791+0000 7f4412623b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5646d998b2d0 0x5646d99a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:59:03.799 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.791+0000 7f4412623b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5646d998bc30 0x5646d99ac0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:59:03.800 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.791+0000 7f4412623b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646d98dce70 con 0x5646d998bc30 2023-10-19T12:59:03.800 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.791+0000 7f4412623b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646d9879710 con 0x5646d998a5d0 2023-10-19T12:59:03.800 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.791+0000 7f4412623b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646d98793b0 con 0x5646d998b2d0 2023-10-19T12:59:03.800 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.791+0000 7f4412623b80 10 client.0 _ll_register_callbacks cb 0x5646d97c3a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:59:03.800 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.792+0000 7f43fcb9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5646d998a5d0 0x5646d99a4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:59:03.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.792+0000 7f43fcb9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5646d998a5d0 0x5646d99a4b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:37762/0 (socket says 172.21.15.46:37762) 2023-10-19T12:59:03.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.792+0000 7f43fcb9b700 1 -- 172.21.15.46:0/3677778867 learned_addr learned my addr 172.21.15.46:0/3677778867 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:59:03.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.792+0000 7f43fd39c700 1 --2- 172.21.15.46:0/3677778867 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5646d998bc30 0x5646d99ac0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:59:03.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.792+0000 7f43f7fff700 1 --2- 172.21.15.46:0/3677778867 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5646d998b2d0 0x5646d99a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:59:03.801 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.792+0000 7f43fcb9b700 1 -- 172.21.15.46:0/3677778867 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5646d998b2d0 msgr2=0x5646d99a50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:59:03.802 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.792+0000 7f43fcb9b700 1 --2- 172.21.15.46:0/3677778867 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5646d998b2d0 0x5646d99a50a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:59:03.802 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.792+0000 7f43fcb9b700 1 -- 172.21.15.46:0/3677778867 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5646d998bc30 msgr2=0x5646d99ac0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:59:03.802 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.792+0000 7f43fcb9b700 1 --2- 172.21.15.46:0/3677778867 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5646d998bc30 0x5646d99ac0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:59:03.802 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.792+0000 7f43fcb9b700 1 -- 172.21.15.46:0/3677778867 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43f8078060 con 0x5646d998a5d0 2023-10-19T12:59:03.802 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.793+0000 7f43fcb9b700 1 --2- 172.21.15.46:0/3677778867 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5646d998a5d0 0x5646d99a4b60 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f43f00129d0 tx=0x7f43f0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=614f124317353c6d server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:59:03.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.793+0000 7f43d7fff700 10 client.0 ms_handle_connect on v2:172.21.15.157:3300/0 2023-10-19T12:59:03.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.793+0000 7f43d7fff700 1 -- 172.21.15.46:0/3677778867 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f000ebd0 con 0x5646d998a5d0 2023-10-19T12:59:03.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.793+0000 7f4412623b80 1 -- 172.21.15.46:0/3677778867 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5646d98e1ef0 con 0x5646d998a5d0 2023-10-19T12:59:03.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.793+0000 7f43d7fff700 1 -- 172.21.15.46:0/3677778867 <== mon.2 v2:172.21.15.157:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f43f0012e40 con 0x5646d998a5d0 2023-10-19T12:59:03.803 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.794+0000 7f43d7fff700 1 -- 172.21.15.46:0/3677778867 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7f43f000ed30 con 0x5646d998a5d0 2023-10-19T12:59:03.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.794+0000 7f4412623b80 10 client.26258 fetch_fsmap learned FSMap version 52 2023-10-19T12:59:03.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.794+0000 7f4412623b80 1 -- 172.21.15.46:0/3677778867 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) v3 -- 0x7f43f819d0a0 con 0x5646d998a5d0 2023-10-19T12:59:03.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.795+0000 7f43d7fff700 1 -- 172.21.15.46:0/3677778867 <== mon.2 v2:172.21.15.157:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5646d98e1ef0 con 0x5646d998a5d0 2023-10-19T12:59:03.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.795+0000 7f43d7fff700 1 -- 172.21.15.46:0/3677778867 <== mon.2 v2:172.21.15.157:3300/0 5 ==== fsmap(e 52) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f43f001a070 con 0x5646d998a5d0 2023-10-19T12:59:03.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.795+0000 7f4412623b80 10 client.26258 fetch_fsmap finished waiting for FSMap version 52 2023-10-19T12:59:03.804 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.795+0000 7f4412623b80 10 client.26258 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-19T12:59:03.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.795+0000 7f4412623b80 20 client.26258 populate_metadata read hostname 'smithi046' 2023-10-19T12:59:03.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.795+0000 7f4412623b80 1 --2- 172.21.15.46:0/3677778867 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x5646d99b0890 0x5646d99b2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:59:03.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.795+0000 7f4412623b80 4 client.26258 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-19T12:59:03.805 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.795+0000 7f4412623b80 1 -- 172.21.15.46:0/3677778867 --> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5646d99598b0 con 0x5646d99b0890 2023-10-19T12:59:03.807 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.796+0000 7f43f7fff700 1 --2- 172.21.15.46:0/3677778867 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x5646d99b0890 0x5646d99b2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:59:03.807 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.797+0000 7f43f7fff700 1 --2- 172.21.15.46:0/3677778867 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x5646d99b0890 0x5646d99b2cd0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3bdcdac2d1c9c612 server_cookie=b648fc648a432ab8 in_seq=0 out_seq=0 2023-10-19T12:59:03.807 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.797+0000 7f43d7fff700 10 client.26258 ms_handle_connect on v2:172.21.15.157:6838/552718978 2023-10-19T12:59:03.808 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.797+0000 7f43d7fff700 1 -- 172.21.15.46:0/3677778867 <== mds.0 v2:172.21.15.157:6838/552718978 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5646d99598b0 con 0x5646d99b0890 2023-10-19T12:59:03.808 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.797+0000 7f43d7fff700 10 client.26258 handle_command_reply: tid=0 2023-10-19T12:59:03.808 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.798+0000 7f4412623b80 1 client.26258 shutdown 2023-10-19T12:59:03.808 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.798+0000 7f4412623b80 1 -- 172.21.15.46:0/3677778867 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5646d998a5d0 msgr2=0x5646d99a4b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:59:03.808 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.798+0000 7f4412623b80 1 --2- 172.21.15.46:0/3677778867 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5646d998a5d0 0x5646d99a4b60 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f43f00129d0 tx=0x7f43f0004750 comp rx=0 tx=0).stop 2023-10-19T12:59:03.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.798+0000 7f4412623b80 1 -- 172.21.15.46:0/3677778867 shutdown_connections 2023-10-19T12:59:03.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.798+0000 7f4412623b80 1 --2- 172.21.15.46:0/3677778867 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x5646d99b0890 0x5646d99b2cd0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:59:03.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.798+0000 7f4412623b80 1 --2- 172.21.15.46:0/3677778867 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5646d998bc30 0x5646d99ac0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:59:03.809 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.798+0000 7f4412623b80 1 --2- 172.21.15.46:0/3677778867 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5646d998a5d0 0x5646d99a4b60 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:59:03.810 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.798+0000 7f43d7fff700 0 client.26258 ms_handle_reset on v2:172.21.15.157:6838/552718978 2023-10-19T12:59:03.810 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.798+0000 7f4412623b80 1 --2- 172.21.15.46:0/3677778867 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5646d998b2d0 0x5646d99a50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:59:03.810 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.798+0000 7f4412623b80 1 -- 172.21.15.46:0/3677778867 >> 172.21.15.46:0/3677778867 conn(0x5646d98fe720 msgr2=0x5646d9989080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:59:03.810 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.799+0000 7f4412623b80 1 -- 172.21.15.46:0/3677778867 shutdown_connections 2023-10-19T12:59:03.810 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.799+0000 7f4412623b80 1 -- 172.21.15.46:0/3677778867 wait complete. 2023-10-19T12:59:03.811 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.799+0000 7f4412623b80 20 client.26258 trim_cache size 0 max 16384 2023-10-19T12:59:03.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.833+0000 7f4412623b80 1 Processor -- start 2023-10-19T12:59:03.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.833+0000 7f4412623b80 1 -- start start 2023-10-19T12:59:03.836 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.833+0000 7f4412623b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5646d998a5d0 0x5646d99a4070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:59:03.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.833+0000 7f4412623b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5646d998b2d0 0x5646d99ac0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:59:03.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.834+0000 7f4412623b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5646d998bc30 0x5646d9991b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:59:03.837 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.834+0000 7f4412623b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646d975d920 con 0x5646d998b2d0 2023-10-19T12:59:03.838 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.834+0000 7f4412623b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646d997d060 con 0x5646d998a5d0 2023-10-19T12:59:03.838 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.834+0000 7f4412623b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646d99a46d0 con 0x5646d998bc30 2023-10-19T12:59:03.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.837+0000 7f43fd39c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5646d998bc30 0x5646d9991b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:59:03.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.837+0000 7f43fd39c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5646d998bc30 0x5646d9991b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:44456/0 (socket says 172.21.15.46:44456) 2023-10-19T12:59:03.840 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.837+0000 7f43fd39c700 1 -- 172.21.15.46:0/2540784002 learned_addr learned my addr 172.21.15.46:0/2540784002 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:59:03.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.838+0000 7f43fcb9b700 1 --2- 172.21.15.46:0/2540784002 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5646d998a5d0 0x5646d99a4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:59:03.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.838+0000 7f43fd39c700 1 -- 172.21.15.46:0/2540784002 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5646d998a5d0 msgr2=0x5646d99a4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:59:03.841 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.838+0000 7f43f7fff700 1 --2- 172.21.15.46:0/2540784002 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5646d998b2d0 0x5646d99ac0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:59:03.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.838+0000 7f43fd39c700 1 --2- 172.21.15.46:0/2540784002 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5646d998a5d0 0x5646d99a4070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:59:03.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.838+0000 7f43fd39c700 1 -- 172.21.15.46:0/2540784002 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5646d998b2d0 msgr2=0x5646d99ac0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:59:03.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.838+0000 7f43fd39c700 1 --2- 172.21.15.46:0/2540784002 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5646d998b2d0 0x5646d99ac0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:59:03.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.838+0000 7f43fd39c700 1 -- 172.21.15.46:0/2540784002 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5646d9707de0 con 0x5646d998bc30 2023-10-19T12:59:03.842 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.838+0000 7f43fcb9b700 1 --2- 172.21.15.46:0/2540784002 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5646d998a5d0 0x5646d99a4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T12:59:03.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.838+0000 7f43f7fff700 1 --2- 172.21.15.46:0/2540784002 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5646d998b2d0 0x5646d99ac0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T12:59:03.843 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.838+0000 7f43fd39c700 1 --2- 172.21.15.46:0/2540784002 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5646d998bc30 0x5646d9991b20 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f43e00ca220 tx=0x7f43e0005800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=417bb709bc6e0f03 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:59:03.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.839+0000 7f43ef7fe700 1 -- 172.21.15.46:0/2540784002 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e0097b30 con 0x5646d998bc30 2023-10-19T12:59:03.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.839+0000 7f43ef7fe700 1 -- 172.21.15.46:0/2540784002 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f43e0097d90 con 0x5646d998bc30 2023-10-19T12:59:03.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.839+0000 7f43ef7fe700 1 -- 172.21.15.46:0/2540784002 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e0099c50 con 0x5646d998bc30 2023-10-19T12:59:03.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.840+0000 7f4412623b80 1 -- 172.21.15.46:0/2540784002 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5646d998bc30 msgr2=0x5646d9991b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:59:03.844 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.840+0000 7f4412623b80 1 --2- 172.21.15.46:0/2540784002 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5646d998bc30 0x5646d9991b20 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f43e00ca220 tx=0x7f43e0005800 comp rx=0 tx=0).stop 2023-10-19T12:59:03.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.840+0000 7f4412623b80 1 -- 172.21.15.46:0/2540784002 shutdown_connections 2023-10-19T12:59:03.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.840+0000 7f4412623b80 1 --2- 172.21.15.46:0/2540784002 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5646d998bc30 0x5646d9991b20 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:59:03.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.840+0000 7f4412623b80 1 --2- 172.21.15.46:0/2540784002 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5646d998a5d0 0x5646d99a4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:59:03.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.840+0000 7f4412623b80 1 --2- 172.21.15.46:0/2540784002 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5646d998b2d0 0x5646d99ac0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:59:03.845 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.840+0000 7f4412623b80 1 -- 172.21.15.46:0/2540784002 >> 172.21.15.46:0/2540784002 conn(0x5646d98fe720 msgr2=0x5646d9984b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:59:03.846 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.841+0000 7f4412623b80 1 -- 172.21.15.46:0/2540784002 shutdown_connections 2023-10-19T12:59:03.846 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.842+0000 7f4412623b80 1 -- 172.21.15.46:0/2540784002 wait complete. 2023-10-19T12:59:03.846 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.842+0000 7f4412623b80 1 -- start start 2023-10-19T12:59:03.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.842+0000 7f4412623b80 1 Processor -- start 2023-10-19T12:59:03.847 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.843+0000 7f4412623b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5646d998a5d0 0x5646d99ab0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:59:03.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.845+0000 7f4412623b80 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5646d998b2d0 0x5646d99ab620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:59:03.848 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.845+0000 7f4412623b80 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5646d998bc30 0x5646d9a04710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:59:03.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.845+0000 7f4412623b80 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646d9a04c50 con 0x5646d998b2d0 2023-10-19T12:59:03.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.845+0000 7f4412623b80 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646d9a04d90 con 0x5646d998bc30 2023-10-19T12:59:03.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.845+0000 7f4412623b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646d9a04f20 con 0x5646d998a5d0 2023-10-19T12:59:03.849 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.845+0000 7f43fd39c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5646d998bc30 0x5646d9a04710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:59:03.850 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.845+0000 7f43fd39c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5646d998bc30 0x5646d9a04710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:37780/0 (socket says 172.21.15.46:37780) 2023-10-19T12:59:03.850 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.845+0000 7f43fd39c700 1 -- 172.21.15.46:0/2464317815 learned_addr learned my addr 172.21.15.46:0/2464317815 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:59:03.850 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.845+0000 7f43f7fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5646d998b2d0 0x5646d99ab620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:59:03.850 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.845+0000 7f43fcb9b700 1 --2- 172.21.15.46:0/2464317815 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5646d998a5d0 0x5646d99ab0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:59:03.850 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.846+0000 7f4412623b80 10 client.0 _ll_register_callbacks cb 0x5646d97c3a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T12:59:03.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.846+0000 7f43fd39c700 1 -- 172.21.15.46:0/2464317815 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5646d998a5d0 msgr2=0x5646d99ab0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:59:03.852 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.846+0000 7f43fd39c700 1 --2- 172.21.15.46:0/2464317815 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5646d998a5d0 0x5646d99ab0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:59:03.852 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.846+0000 7f43fd39c700 1 -- 172.21.15.46:0/2464317815 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5646d998b2d0 msgr2=0x5646d99ab620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T12:59:03.852 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.846+0000 7f43fd39c700 1 --2- 172.21.15.46:0/2464317815 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5646d998b2d0 0x5646d99ab620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:59:03.852 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.846+0000 7f43fd39c700 1 -- 172.21.15.46:0/2464317815 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5646d989a3f0 con 0x5646d998bc30 2023-10-19T12:59:03.852 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.846+0000 7f43fd39c700 1 --2- 172.21.15.46:0/2464317815 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5646d998bc30 0x5646d9a04710 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f43e00a1850 tx=0x7f43e0097f70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd225db981e87770 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:59:03.853 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.847+0000 7f43d7fff700 10 client.0 ms_handle_connect on v2:172.21.15.157:3300/0 2023-10-19T12:59:03.853 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.847+0000 7f43d7fff700 1 -- 172.21.15.46:0/2464317815 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e00214b0 con 0x5646d998bc30 2023-10-19T12:59:03.853 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.847+0000 7f4412623b80 1 -- 172.21.15.46:0/2464317815 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f43e009db40 con 0x5646d998bc30 2023-10-19T12:59:03.853 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.847+0000 7f43d7fff700 1 -- 172.21.15.46:0/2464317815 <== mon.2 v2:172.21.15.157:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f43e0099c50 con 0x5646d998bc30 2023-10-19T12:59:03.853 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.847+0000 7f43d7fff700 1 -- 172.21.15.46:0/2464317815 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7f43e0099e10 con 0x5646d998bc30 2023-10-19T12:59:03.854 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.847+0000 7f4412623b80 10 client.26261 fetch_fsmap learned FSMap version 52 2023-10-19T12:59:03.854 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.847+0000 7f4412623b80 1 -- 172.21.15.46:0/2464317815 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) v3 -- 0x5646d96f0c60 con 0x5646d998bc30 2023-10-19T12:59:03.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.850+0000 7f43d7fff700 1 -- 172.21.15.46:0/2464317815 <== mon.2 v2:172.21.15.157:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f43e009db40 con 0x5646d998bc30 2023-10-19T12:59:03.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.850+0000 7f43d7fff700 1 -- 172.21.15.46:0/2464317815 <== mon.2 v2:172.21.15.157:3300/0 5 ==== fsmap(e 52) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f43e009ad20 con 0x5646d998bc30 2023-10-19T12:59:03.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.850+0000 7f4412623b80 10 client.26261 fetch_fsmap finished waiting for FSMap version 52 2023-10-19T12:59:03.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.850+0000 7f4412623b80 10 client.26261 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-19T12:59:03.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.850+0000 7f4412623b80 20 client.26261 populate_metadata read hostname 'smithi046' 2023-10-19T12:59:03.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.850+0000 7f4412623b80 1 --2- 172.21.15.46:0/2464317815 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x5646d99b0890 0x5646d9a08430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:59:03.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.850+0000 7f4412623b80 4 client.26261 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-19T12:59:03.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.850+0000 7f4412623b80 1 -- 172.21.15.46:0/2464317815 --> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5646d98d5e50 con 0x5646d99b0890 2023-10-19T12:59:03.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.850+0000 7f43fcb9b700 1 --2- 172.21.15.46:0/2464317815 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x5646d99b0890 0x5646d9a08430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:59:03.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.851+0000 7f43d7fff700 10 client.26261 ms_handle_connect on v2:172.21.15.157:6838/552718978 2023-10-19T12:59:03.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.851+0000 7f43fcb9b700 1 --2- 172.21.15.46:0/2464317815 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x5646d99b0890 0x5646d9a08430 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5829f0aef27f544 server_cookie=35e3fa623d07828d in_seq=0 out_seq=0 2023-10-19T12:59:03.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.851+0000 7f43d7fff700 1 -- 172.21.15.46:0/2464317815 <== mds.0 v2:172.21.15.157:6838/552718978 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x5646d98d5e50 con 0x5646d99b0890 2023-10-19T12:59:03.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.851+0000 7f43d7fff700 10 client.26261 handle_command_reply: tid=0 2023-10-19T12:59:03.858 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.851+0000 7f4412623b80 1 client.26261 shutdown 2023-10-19T12:59:03.858 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.852+0000 7f4412623b80 1 -- 172.21.15.46:0/2464317815 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5646d998bc30 msgr2=0x5646d9a04710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:59:03.858 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.852+0000 7f4412623b80 1 --2- 172.21.15.46:0/2464317815 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5646d998bc30 0x5646d9a04710 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f43e00a1850 tx=0x7f43e0097f70 comp rx=0 tx=0).stop 2023-10-19T12:59:03.858 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.852+0000 7f4412623b80 1 -- 172.21.15.46:0/2464317815 shutdown_connections 2023-10-19T12:59:03.858 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.852+0000 7f4412623b80 1 --2- 172.21.15.46:0/2464317815 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5646d998bc30 0x5646d9a04710 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:59:03.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.852+0000 7f4412623b80 1 --2- 172.21.15.46:0/2464317815 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5646d998a5d0 0x5646d99ab0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:59:03.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.852+0000 7f4412623b80 1 --2- 172.21.15.46:0/2464317815 >> [v2:172.21.15.157:6838/552718978,v1:172.21.15.157:6839/552718978] conn(0x5646d99b0890 0x5646d9a08430 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:59:03.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.852+0000 7f4412623b80 1 --2- 172.21.15.46:0/2464317815 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5646d998b2d0 0x5646d99ab620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:59:03.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.852+0000 7f43d7fff700 0 client.26261 ms_handle_reset on v2:172.21.15.157:6838/552718978 2023-10-19T12:59:03.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.852+0000 7f4412623b80 1 -- 172.21.15.46:0/2464317815 >> 172.21.15.46:0/2464317815 conn(0x5646d98fe720 msgr2=0x5646d998e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:59:03.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.852+0000 7f4412623b80 1 -- 172.21.15.46:0/2464317815 shutdown_connections 2023-10-19T12:59:03.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.852+0000 7f4412623b80 1 -- 172.21.15.46:0/2464317815 wait complete. 2023-10-19T12:59:03.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.852+0000 7f4412623b80 20 client.26261 trim_cache size 0 max 16384 2023-10-19T12:59:03.860 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-10-19T12:59:03.861 INFO:teuthology.orchestra.run.smithi046.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-19T12:59:03.861 INFO:teuthology.orchestra.run.smithi046.stdout: "scrubs": { 2023-10-19T12:59:03.861 INFO:teuthology.orchestra.run.smithi046.stdout: "21e73f70-af16-4ae7-bc34-e6c54ba8e1ec": { 2023-10-19T12:59:03.861 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2023-10-19T12:59:03.862 INFO:teuthology.orchestra.run.smithi046.stdout: "tag": "21e73f70-af16-4ae7-bc34-e6c54ba8e1ec", 2023-10-19T12:59:03.862 INFO:teuthology.orchestra.run.smithi046.stdout: "options": "recursive,force" 2023-10-19T12:59:03.862 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:03.862 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:03.862 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-10-19T12:59:03.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.853+0000 7f43fedff700 1 -- 172.21.15.46:0/3489276003 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f43e40a1500 msgr2=0x7f43e40a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:59:03.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.853+0000 7f43fedff700 1 --2- 172.21.15.46:0/3489276003 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f43e40a1500 0x7f43e40a39c0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f43f000ae90 tx=0x7f43f000a8a0 comp rx=0 tx=0).stop 2023-10-19T12:59:03.863 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.853+0000 7f43fedff700 1 -- 172.21.15.46:0/3489276003 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43f8199c70 msgr2=0x7f43f819c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:59:03.864 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.853+0000 7f43fedff700 1 --2- 172.21.15.46:0/3489276003 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43f8199c70 0x7f43f819c060 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f43e000d720 tx=0x7f43e000da30 comp rx=0 tx=0).stop 2023-10-19T12:59:03.864 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.854+0000 7f43fedff700 1 -- 172.21.15.46:0/3489276003 shutdown_connections 2023-10-19T12:59:03.864 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.854+0000 7f43fedff700 1 --2- 172.21.15.46:0/3489276003 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f43e40a1500 0x7f43e40a39c0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:59:03.864 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.854+0000 7f43fedff700 1 --2- 172.21.15.46:0/3489276003 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43f8199c70 0x7f43f819c060 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:59:03.864 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.854+0000 7f43fedff700 1 --2- 172.21.15.46:0/3489276003 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f43f80751b0 0x7f43f8194720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:59:03.865 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.854+0000 7f43fedff700 1 --2- 172.21.15.46:0/3489276003 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f43f8076db0 0x7f43f8194c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:59:03.865 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.854+0000 7f43fedff700 1 -- 172.21.15.46:0/3489276003 >> 172.21.15.46:0/3489276003 conn(0x7f43f80fdf60 msgr2=0x7f43f80ffa60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:59:03.865 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.854+0000 7f43fedff700 1 -- 172.21.15.46:0/3489276003 shutdown_connections 2023-10-19T12:59:03.865 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:03.854+0000 7f43fedff700 1 -- 172.21.15.46:0/3489276003 wait complete. 2023-10-19T12:59:03.895 INFO:tasks.cephfs.filesystem:scrub status for tag:21e73f70-af16-4ae7-bc34-e6c54ba8e1ec - {'path': '/', 'tag': '21e73f70-af16-4ae7-bc34-e6c54ba8e1ec', 'options': 'recursive,force'} 2023-10-19T12:59:03.896 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_f7420d7f8e55ceea786dcbf536c338ce920c21eb/qa/tasks/fwd_scrub.py", line 38, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_f7420d7f8e55ceea786dcbf536c338ce920c21eb/qa/tasks/fwd_scrub.py", line 55, in do_scrub self._scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_f7420d7f8e55ceea786dcbf536c338ce920c21eb/qa/tasks/fwd_scrub.py", line 76, in _scrub done = self.fs.wait_until_scrub_complete(tag=tag, sleep=30, timeout=self.scrub_timeout) File "/home/teuthworker/src/git.ceph.com_ceph-c_f7420d7f8e55ceea786dcbf536c338ce920c21eb/qa/tasks/cephfs/filesystem.py", line 1730, in wait_until_scrub_complete while proceed(): File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (31) after waiting for 900 seconds 2023-10-19T12:59:04.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:59:04 smithi046 ceph-mon[98509]: pgmap v820: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 7.7 MiB/s wr, 517 op/s 2023-10-19T12:59:04.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:59:04 smithi157 ceph-mon[134109]: pgmap v820: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 7.7 MiB/s wr, 517 op/s 2023-10-19T12:59:04.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:59:04 smithi195 ceph-mon[134493]: pgmap v820: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 7.7 MiB/s wr, 517 op/s 2023-10-19T12:59:06.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:59:06 smithi046 ceph-mon[98509]: pgmap v821: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 6.8 MiB/s wr, 483 op/s 2023-10-19T12:59:06.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:59:06 smithi157 ceph-mon[134109]: pgmap v821: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 6.8 MiB/s wr, 483 op/s 2023-10-19T12:59:06.632 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:59:06 smithi195 ceph-mon[134493]: pgmap v821: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 6.8 MiB/s wr, 483 op/s 2023-10-19T12:59:08.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:59:08 smithi157 ceph-mon[134109]: pgmap v822: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 6.3 MiB/s wr, 484 op/s 2023-10-19T12:59:08.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:59:08 smithi195 ceph-mon[134493]: pgmap v822: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 6.3 MiB/s wr, 484 op/s 2023-10-19T12:59:08.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:59:08 smithi046 ceph-mon[98509]: pgmap v822: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 6.3 MiB/s wr, 484 op/s 2023-10-19T12:59:10.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:59:09 smithi046 ceph-mon[98509]: pgmap v823: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 7.8 MiB/s wr, 673 op/s 2023-10-19T12:59:10.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:59:09 smithi157 ceph-mon[134109]: pgmap v823: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 7.8 MiB/s wr, 673 op/s 2023-10-19T12:59:10.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:59:09 smithi195 ceph-mon[134493]: pgmap v823: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 7.8 MiB/s wr, 673 op/s 2023-10-19T12:59:12.478 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:59:12 smithi046 ceph-mon[98509]: pgmap v824: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 7.2 MiB/s wr, 661 op/s 2023-10-19T12:59:12.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:59:12 smithi157 ceph-mon[134109]: pgmap v824: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 7.2 MiB/s wr, 661 op/s 2023-10-19T12:59:12.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:59:12 smithi195 ceph-mon[134493]: pgmap v824: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 7.2 MiB/s wr, 661 op/s 2023-10-19T12:59:14.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:59:14 smithi046 ceph-mon[98509]: pgmap v825: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 6.9 MiB/s wr, 708 op/s 2023-10-19T12:59:14.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:59:14 smithi157 ceph-mon[134109]: pgmap v825: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 6.9 MiB/s wr, 708 op/s 2023-10-19T12:59:14.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:59:14 smithi195 ceph-mon[134493]: pgmap v825: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 6.9 MiB/s wr, 708 op/s 2023-10-19T12:59:16.478 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:59:16 smithi046 ceph-mon[98509]: pgmap v826: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 6.0 MiB/s wr, 661 op/s 2023-10-19T12:59:16.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:59:16 smithi157 ceph-mon[134109]: pgmap v826: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 6.0 MiB/s wr, 661 op/s 2023-10-19T12:59:16.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:59:16 smithi195 ceph-mon[134493]: pgmap v826: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 6.0 MiB/s wr, 661 op/s 2023-10-19T12:59:17.204 DEBUG:teuthology.orchestra.run.smithi046:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2023-10-19T12:59:18.167 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/cephfs/postgres/: 2023-10-19T12:59:18.167 INFO:teuthology.orchestra.run.smithi046.stdout:total 0 2023-10-19T12:59:18.167 INFO:teuthology.orchestra.run.smithi046.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Oct 19 12:43 . 2023-10-19T12:59:18.167 INFO:teuthology.orchestra.run.smithi046.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 1 Oct 19 12:43 .. 2023-10-19T12:59:18.168 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Oct 19 12:59 data 2023-10-19T12:59:18.168 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:59:18.168 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/cephfs/postgres/data: 2023-10-19T12:59:18.168 INFO:teuthology.orchestra.run.smithi046.stdout:total 31 2023-10-19T12:59:18.168 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Oct 19 12:59 . 2023-10-19T12:59:18.169 INFO:teuthology.orchestra.run.smithi046.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Oct 19 12:43 .. 2023-10-19T12:59:18.169 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Oct 19 12:43 base 2023-10-19T12:59:18.169 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 30 Oct 19 12:43 current_logfiles 2023-10-19T12:59:18.169 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 59 Oct 19 12:43 global 2023-10-19T12:59:18.169 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Oct 19 12:43 log 2023-10-19T12:59:18.170 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 pg_commit_ts 2023-10-19T12:59:18.170 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 pg_dynshmem 2023-10-19T12:59:18.170 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 4269 Oct 19 12:43 pg_hba.conf 2023-10-19T12:59:18.170 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1636 Oct 19 12:43 pg_ident.conf 2023-10-19T12:59:18.170 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 19 12:59 pg_logical 2023-10-19T12:59:18.171 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Oct 19 12:43 pg_multixact 2023-10-19T12:59:18.171 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Oct 19 12:43 pg_notify 2023-10-19T12:59:18.171 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 pg_replslot 2023-10-19T12:59:18.172 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 pg_serial 2023-10-19T12:59:18.172 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 pg_snapshots 2023-10-19T12:59:18.172 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 19 12:59 pg_stat 2023-10-19T12:59:18.172 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:59 pg_stat_tmp 2023-10-19T12:59:18.172 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Oct 19 12:59 pg_subtrans 2023-10-19T12:59:18.173 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 pg_tblspc 2023-10-19T12:59:18.173 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 pg_twophase 2023-10-19T12:59:18.173 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 19 12:43 PG_VERSION 2023-10-19T12:59:18.173 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 64 Oct 19 12:59 pg_wal 2023-10-19T12:59:18.173 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Oct 19 12:43 pg_xact 2023-10-19T12:59:18.174 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 88 Oct 19 12:43 postgresql.auto.conf 2023-10-19T12:59:18.174 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 22989 Oct 19 12:43 postgresql.conf 2023-10-19T12:59:18.174 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 51 Oct 19 12:43 postmaster.opts 2023-10-19T12:59:18.174 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:59:18.174 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/cephfs/postgres/data/base: 2023-10-19T12:59:18.174 INFO:teuthology.orchestra.run.smithi046.stdout:total 0 2023-10-19T12:59:18.175 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Oct 19 12:43 . 2023-10-19T12:59:18.175 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Oct 19 12:59 .. 2023-10-19T12:59:18.175 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 293 Oct 19 12:43 1 2023-10-19T12:59:18.175 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 293 Oct 19 12:43 12346 2023-10-19T12:59:18.175 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 308 Oct 19 12:44 12347 2023-10-19T12:59:18.176 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:44 pgsql_tmp 2023-10-19T12:59:18.176 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:59:18.176 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/cephfs/postgres/data/base/1: 2023-10-19T12:59:18.176 INFO:teuthology.orchestra.run.smithi046.stdout:total 7193 2023-10-19T12:59:18.176 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 293 Oct 19 12:43 . 2023-10-19T12:59:18.176 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Oct 19 12:43 .. 2023-10-19T12:59:18.177 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 112 2023-10-19T12:59:18.177 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 113 2023-10-19T12:59:18.177 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Oct 19 12:43 12182 2023-10-19T12:59:18.177 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 12182_fsm 2023-10-19T12:59:18.177 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12182_vm 2023-10-19T12:59:18.178 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 12184 2023-10-19T12:59:18.178 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12186 2023-10-19T12:59:18.178 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12187 2023-10-19T12:59:18.178 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 12187_fsm 2023-10-19T12:59:18.178 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12187_vm 2023-10-19T12:59:18.179 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 12189 2023-10-19T12:59:18.179 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12191 2023-10-19T12:59:18.179 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12192 2023-10-19T12:59:18.179 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 12192_fsm 2023-10-19T12:59:18.179 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12192_vm 2023-10-19T12:59:18.180 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 12194 2023-10-19T12:59:18.180 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12196 2023-10-19T12:59:18.180 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12197 2023-10-19T12:59:18.180 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 12197_fsm 2023-10-19T12:59:18.180 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12197_vm 2023-10-19T12:59:18.180 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 12199 2023-10-19T12:59:18.181 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12201 2023-10-19T12:59:18.181 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12202 2023-10-19T12:59:18.181 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 12202_fsm 2023-10-19T12:59:18.181 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12202_vm 2023-10-19T12:59:18.181 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 12204 2023-10-19T12:59:18.182 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12206 2023-10-19T12:59:18.182 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12207 2023-10-19T12:59:18.182 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 12207_fsm 2023-10-19T12:59:18.182 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12207_vm 2023-10-19T12:59:18.182 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 12209 2023-10-19T12:59:18.183 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12211 2023-10-19T12:59:18.183 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 12212 2023-10-19T12:59:18.183 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 12214 2023-10-19T12:59:18.183 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12216 2023-10-19T12:59:18.183 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 73728 Oct 19 12:43 1247 2023-10-19T12:59:18.184 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 1247_fsm 2023-10-19T12:59:18.184 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 1247_vm 2023-10-19T12:59:18.184 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 393216 Oct 19 12:43 1249 2023-10-19T12:59:18.184 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 1249_fsm 2023-10-19T12:59:18.184 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 1249_vm 2023-10-19T12:59:18.184 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 606208 Oct 19 12:43 1255 2023-10-19T12:59:18.185 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 1255_fsm 2023-10-19T12:59:18.185 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 1255_vm 2023-10-19T12:59:18.185 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Oct 19 12:43 1259 2023-10-19T12:59:18.185 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 1259_fsm 2023-10-19T12:59:18.185 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 1259_vm 2023-10-19T12:59:18.186 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 1417 2023-10-19T12:59:18.186 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 1417_vm 2023-10-19T12:59:18.186 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 1418 2023-10-19T12:59:18.186 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 1418_vm 2023-10-19T12:59:18.186 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 174 2023-10-19T12:59:18.187 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 175 2023-10-19T12:59:18.187 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2187 2023-10-19T12:59:18.187 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2224 2023-10-19T12:59:18.187 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2224_vm 2023-10-19T12:59:18.187 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2328 2023-10-19T12:59:18.187 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2328_vm 2023-10-19T12:59:18.188 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2336 2023-10-19T12:59:18.188 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2336_vm 2023-10-19T12:59:18.188 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2337 2023-10-19T12:59:18.188 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2600 2023-10-19T12:59:18.188 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2600_fsm 2023-10-19T12:59:18.189 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2600_vm 2023-10-19T12:59:18.189 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2601 2023-10-19T12:59:18.189 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2601_fsm 2023-10-19T12:59:18.189 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2601_vm 2023-10-19T12:59:18.189 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 19 12:43 2602 2023-10-19T12:59:18.189 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2602_fsm 2023-10-19T12:59:18.190 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2602_vm 2023-10-19T12:59:18.190 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 19 12:43 2603 2023-10-19T12:59:18.190 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2603_fsm 2023-10-19T12:59:18.190 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2603_vm 2023-10-19T12:59:18.190 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2604 2023-10-19T12:59:18.191 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2604_vm 2023-10-19T12:59:18.191 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2605 2023-10-19T12:59:18.191 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2605_fsm 2023-10-19T12:59:18.191 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2605_vm 2023-10-19T12:59:18.191 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2606 2023-10-19T12:59:18.192 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2606_fsm 2023-10-19T12:59:18.192 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2606_vm 2023-10-19T12:59:18.192 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2607 2023-10-19T12:59:18.192 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2607_fsm 2023-10-19T12:59:18.192 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2607_vm 2023-10-19T12:59:18.192 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 442368 Oct 19 12:43 2608 2023-10-19T12:59:18.193 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2608_fsm 2023-10-19T12:59:18.193 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2608_vm 2023-10-19T12:59:18.193 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 286720 Oct 19 12:43 2609 2023-10-19T12:59:18.193 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2609_fsm 2023-10-19T12:59:18.193 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2609_vm 2023-10-19T12:59:18.193 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2610 2023-10-19T12:59:18.194 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2610_fsm 2023-10-19T12:59:18.194 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2610_vm 2023-10-19T12:59:18.194 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2611 2023-10-19T12:59:18.194 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2611_vm 2023-10-19T12:59:18.194 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2612 2023-10-19T12:59:18.195 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2612_fsm 2023-10-19T12:59:18.195 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2612_vm 2023-10-19T12:59:18.195 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2613 2023-10-19T12:59:18.195 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2613_vm 2023-10-19T12:59:18.195 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2615 2023-10-19T12:59:18.196 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2615_fsm 2023-10-19T12:59:18.196 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2615_vm 2023-10-19T12:59:18.196 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2616 2023-10-19T12:59:18.196 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2616_fsm 2023-10-19T12:59:18.196 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2616_vm 2023-10-19T12:59:18.196 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Oct 19 12:43 2617 2023-10-19T12:59:18.197 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2617_fsm 2023-10-19T12:59:18.197 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2617_vm 2023-10-19T12:59:18.197 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Oct 19 12:43 2618 2023-10-19T12:59:18.197 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2618_fsm 2023-10-19T12:59:18.197 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2618_vm 2023-10-19T12:59:18.197 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Oct 19 12:43 2619 2023-10-19T12:59:18.198 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2619_fsm 2023-10-19T12:59:18.198 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2619_vm 2023-10-19T12:59:18.198 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2620 2023-10-19T12:59:18.198 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2620_vm 2023-10-19T12:59:18.198 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2650 2023-10-19T12:59:18.199 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2651 2023-10-19T12:59:18.199 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2652 2023-10-19T12:59:18.199 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 19 12:43 2653 2023-10-19T12:59:18.199 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 19 12:43 2654 2023-10-19T12:59:18.199 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 19 12:43 2655 2023-10-19T12:59:18.199 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2656 2023-10-19T12:59:18.200 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2657 2023-10-19T12:59:18.200 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Oct 19 12:43 2658 2023-10-19T12:59:18.200 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Oct 19 12:43 2659 2023-10-19T12:59:18.200 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2660 2023-10-19T12:59:18.200 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2661 2023-10-19T12:59:18.201 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 19 12:43 2662 2023-10-19T12:59:18.201 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 19 12:43 2663 2023-10-19T12:59:18.201 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2664 2023-10-19T12:59:18.201 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2665 2023-10-19T12:59:18.201 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2666 2023-10-19T12:59:18.201 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2667 2023-10-19T12:59:18.202 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2668 2023-10-19T12:59:18.202 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2669 2023-10-19T12:59:18.202 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2670 2023-10-19T12:59:18.202 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 319488 Oct 19 12:43 2673 2023-10-19T12:59:18.202 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 376832 Oct 19 12:43 2674 2023-10-19T12:59:18.203 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 180224 Oct 19 12:43 2675 2023-10-19T12:59:18.203 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2678 2023-10-19T12:59:18.203 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2679 2023-10-19T12:59:18.203 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2680 2023-10-19T12:59:18.203 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2681 2023-10-19T12:59:18.203 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2682 2023-10-19T12:59:18.204 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2683 2023-10-19T12:59:18.204 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2684 2023-10-19T12:59:18.204 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2685 2023-10-19T12:59:18.204 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2686 2023-10-19T12:59:18.204 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2687 2023-10-19T12:59:18.205 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 19 12:43 2688 2023-10-19T12:59:18.205 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 19 12:43 2689 2023-10-19T12:59:18.205 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Oct 19 12:43 2690 2023-10-19T12:59:18.205 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 270336 Oct 19 12:43 2691 2023-10-19T12:59:18.205 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2692 2023-10-19T12:59:18.206 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2693 2023-10-19T12:59:18.206 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2696 2023-10-19T12:59:18.206 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2699 2023-10-19T12:59:18.206 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2701 2023-10-19T12:59:18.206 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2702 2023-10-19T12:59:18.207 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2703 2023-10-19T12:59:18.207 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 19 12:43 2704 2023-10-19T12:59:18.207 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2753 2023-10-19T12:59:18.207 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2753_fsm 2023-10-19T12:59:18.207 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2753_vm 2023-10-19T12:59:18.207 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2754 2023-10-19T12:59:18.208 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2755 2023-10-19T12:59:18.208 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 19 12:43 2756 2023-10-19T12:59:18.208 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 19 12:43 2757 2023-10-19T12:59:18.208 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2830 2023-10-19T12:59:18.208 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2830_vm 2023-10-19T12:59:18.209 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2831 2023-10-19T12:59:18.209 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2832 2023-10-19T12:59:18.209 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2832_vm 2023-10-19T12:59:18.209 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2833 2023-10-19T12:59:18.209 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2834 2023-10-19T12:59:18.210 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2834_vm 2023-10-19T12:59:18.210 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2835 2023-10-19T12:59:18.210 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2836 2023-10-19T12:59:18.210 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2836_vm 2023-10-19T12:59:18.211 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2837 2023-10-19T12:59:18.211 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 417792 Oct 19 12:43 2838 2023-10-19T12:59:18.211 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2838_fsm 2023-10-19T12:59:18.211 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2838_vm 2023-10-19T12:59:18.211 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2839 2023-10-19T12:59:18.211 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2840 2023-10-19T12:59:18.212 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2840_fsm 2023-10-19T12:59:18.212 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2840_vm 2023-10-19T12:59:18.212 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2841 2023-10-19T12:59:18.212 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2995 2023-10-19T12:59:18.212 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2995_vm 2023-10-19T12:59:18.213 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2996 2023-10-19T12:59:18.213 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3079 2023-10-19T12:59:18.213 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 3079_fsm 2023-10-19T12:59:18.213 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3079_vm 2023-10-19T12:59:18.213 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3080 2023-10-19T12:59:18.213 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3081 2023-10-19T12:59:18.214 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3085 2023-10-19T12:59:18.214 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3118 2023-10-19T12:59:18.214 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3118_vm 2023-10-19T12:59:18.214 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3119 2023-10-19T12:59:18.214 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3164 2023-10-19T12:59:18.215 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3256 2023-10-19T12:59:18.215 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3256_vm 2023-10-19T12:59:18.215 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3257 2023-10-19T12:59:18.215 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3258 2023-10-19T12:59:18.215 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3350 2023-10-19T12:59:18.216 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3350_vm 2023-10-19T12:59:18.216 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3351 2023-10-19T12:59:18.216 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3379 2023-10-19T12:59:18.216 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3380 2023-10-19T12:59:18.216 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3381 2023-10-19T12:59:18.216 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3381_vm 2023-10-19T12:59:18.217 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3394 2023-10-19T12:59:18.217 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 3394_fsm 2023-10-19T12:59:18.217 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3394_vm 2023-10-19T12:59:18.217 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3395 2023-10-19T12:59:18.217 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3439 2023-10-19T12:59:18.218 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3439_vm 2023-10-19T12:59:18.218 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3440 2023-10-19T12:59:18.218 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 19 12:43 3455 2023-10-19T12:59:18.218 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3456 2023-10-19T12:59:18.218 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 3456_fsm 2023-10-19T12:59:18.219 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3456_vm 2023-10-19T12:59:18.219 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3466 2023-10-19T12:59:18.219 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3466_vm 2023-10-19T12:59:18.219 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3467 2023-10-19T12:59:18.219 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3468 2023-10-19T12:59:18.220 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3501 2023-10-19T12:59:18.220 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3501_vm 2023-10-19T12:59:18.220 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3502 2023-10-19T12:59:18.220 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3503 2023-10-19T12:59:18.220 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3534 2023-10-19T12:59:18.220 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3541 2023-10-19T12:59:18.221 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 3541_fsm 2023-10-19T12:59:18.221 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3541_vm 2023-10-19T12:59:18.221 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3542 2023-10-19T12:59:18.221 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3574 2023-10-19T12:59:18.221 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3575 2023-10-19T12:59:18.221 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3576 2023-10-19T12:59:18.222 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3576_vm 2023-10-19T12:59:18.222 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3596 2023-10-19T12:59:18.222 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3596_vm 2023-10-19T12:59:18.222 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3597 2023-10-19T12:59:18.222 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3598 2023-10-19T12:59:18.223 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3598_vm 2023-10-19T12:59:18.223 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3599 2023-10-19T12:59:18.223 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3600 2023-10-19T12:59:18.223 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 3600_fsm 2023-10-19T12:59:18.223 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3600_vm 2023-10-19T12:59:18.223 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3601 2023-10-19T12:59:18.224 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 3601_fsm 2023-10-19T12:59:18.224 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3601_vm 2023-10-19T12:59:18.224 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3602 2023-10-19T12:59:18.224 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 3602_fsm 2023-10-19T12:59:18.224 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3602_vm 2023-10-19T12:59:18.225 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3603 2023-10-19T12:59:18.225 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 3603_fsm 2023-10-19T12:59:18.225 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3603_vm 2023-10-19T12:59:18.227 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3604 2023-10-19T12:59:18.227 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3605 2023-10-19T12:59:18.228 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3606 2023-10-19T12:59:18.228 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3607 2023-10-19T12:59:18.228 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3608 2023-10-19T12:59:18.228 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 19 12:43 3609 2023-10-19T12:59:18.228 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3712 2023-10-19T12:59:18.229 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3764 2023-10-19T12:59:18.229 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 3764_fsm 2023-10-19T12:59:18.229 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3764_vm 2023-10-19T12:59:18.229 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3766 2023-10-19T12:59:18.229 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3767 2023-10-19T12:59:18.230 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3997 2023-10-19T12:59:18.230 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 5002 2023-10-19T12:59:18.230 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 548 2023-10-19T12:59:18.230 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 549 2023-10-19T12:59:18.230 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 6102 2023-10-19T12:59:18.231 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 6102_vm 2023-10-19T12:59:18.231 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 6104 2023-10-19T12:59:18.231 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 6104_vm 2023-10-19T12:59:18.231 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 6106 2023-10-19T12:59:18.231 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 6106_vm 2023-10-19T12:59:18.231 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 6110 2023-10-19T12:59:18.232 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 6111 2023-10-19T12:59:18.232 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 6112 2023-10-19T12:59:18.232 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 6113 2023-10-19T12:59:18.232 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 6117 2023-10-19T12:59:18.232 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 826 2023-10-19T12:59:18.233 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 826_vm 2023-10-19T12:59:18.233 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 827 2023-10-19T12:59:18.233 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 828 2023-10-19T12:59:18.233 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Oct 19 12:43 pg_filenode.map 2023-10-19T12:59:18.233 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 19 12:43 PG_VERSION 2023-10-19T12:59:18.233 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:59:18.234 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/cephfs/postgres/data/base/12346: 2023-10-19T12:59:18.234 INFO:teuthology.orchestra.run.smithi046.stdout:total 7193 2023-10-19T12:59:18.234 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 293 Oct 19 12:43 . 2023-10-19T12:59:18.234 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Oct 19 12:43 .. 2023-10-19T12:59:18.234 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 112 2023-10-19T12:59:18.235 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 113 2023-10-19T12:59:18.235 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Oct 19 12:43 12182 2023-10-19T12:59:18.235 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 12182_fsm 2023-10-19T12:59:18.235 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12182_vm 2023-10-19T12:59:18.235 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 12184 2023-10-19T12:59:18.235 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12186 2023-10-19T12:59:18.236 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12187 2023-10-19T12:59:18.236 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 12187_fsm 2023-10-19T12:59:18.236 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12187_vm 2023-10-19T12:59:18.236 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 12189 2023-10-19T12:59:18.236 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12191 2023-10-19T12:59:18.237 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12192 2023-10-19T12:59:18.237 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 12192_fsm 2023-10-19T12:59:18.237 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12192_vm 2023-10-19T12:59:18.237 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 12194 2023-10-19T12:59:18.237 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12196 2023-10-19T12:59:18.237 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12197 2023-10-19T12:59:18.238 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 12197_fsm 2023-10-19T12:59:18.238 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12197_vm 2023-10-19T12:59:18.238 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 12199 2023-10-19T12:59:18.238 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12201 2023-10-19T12:59:18.238 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12202 2023-10-19T12:59:18.239 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 12202_fsm 2023-10-19T12:59:18.239 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12202_vm 2023-10-19T12:59:18.239 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 12204 2023-10-19T12:59:18.239 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12206 2023-10-19T12:59:18.239 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12207 2023-10-19T12:59:18.239 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 12207_fsm 2023-10-19T12:59:18.240 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12207_vm 2023-10-19T12:59:18.240 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 12209 2023-10-19T12:59:18.240 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12211 2023-10-19T12:59:18.240 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 12212 2023-10-19T12:59:18.240 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 12214 2023-10-19T12:59:18.240 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12216 2023-10-19T12:59:18.241 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 73728 Oct 19 12:43 1247 2023-10-19T12:59:18.241 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 1247_fsm 2023-10-19T12:59:18.241 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 1247_vm 2023-10-19T12:59:18.241 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 393216 Oct 19 12:43 1249 2023-10-19T12:59:18.241 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 1249_fsm 2023-10-19T12:59:18.242 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 1249_vm 2023-10-19T12:59:18.242 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 606208 Oct 19 12:43 1255 2023-10-19T12:59:18.242 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 1255_fsm 2023-10-19T12:59:18.242 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 1255_vm 2023-10-19T12:59:18.242 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Oct 19 12:43 1259 2023-10-19T12:59:18.243 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 1259_fsm 2023-10-19T12:59:18.243 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 1259_vm 2023-10-19T12:59:18.243 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 1417 2023-10-19T12:59:18.243 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 1417_vm 2023-10-19T12:59:18.243 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 1418 2023-10-19T12:59:18.244 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 1418_vm 2023-10-19T12:59:18.244 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 174 2023-10-19T12:59:18.244 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 175 2023-10-19T12:59:18.244 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2187 2023-10-19T12:59:18.244 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2224 2023-10-19T12:59:18.244 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2224_vm 2023-10-19T12:59:18.245 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2328 2023-10-19T12:59:18.245 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2328_vm 2023-10-19T12:59:18.245 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2336 2023-10-19T12:59:18.245 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2336_vm 2023-10-19T12:59:18.245 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2337 2023-10-19T12:59:18.246 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2600 2023-10-19T12:59:18.246 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2600_fsm 2023-10-19T12:59:18.246 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2600_vm 2023-10-19T12:59:18.246 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2601 2023-10-19T12:59:18.246 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2601_fsm 2023-10-19T12:59:18.246 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2601_vm 2023-10-19T12:59:18.247 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 19 12:43 2602 2023-10-19T12:59:18.247 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2602_fsm 2023-10-19T12:59:18.247 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2602_vm 2023-10-19T12:59:18.247 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 19 12:43 2603 2023-10-19T12:59:18.247 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2603_fsm 2023-10-19T12:59:18.248 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2603_vm 2023-10-19T12:59:18.248 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2604 2023-10-19T12:59:18.248 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2604_vm 2023-10-19T12:59:18.248 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2605 2023-10-19T12:59:18.248 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2605_fsm 2023-10-19T12:59:18.249 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2605_vm 2023-10-19T12:59:18.249 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2606 2023-10-19T12:59:18.249 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2606_fsm 2023-10-19T12:59:18.249 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2606_vm 2023-10-19T12:59:18.249 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2607 2023-10-19T12:59:18.250 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2607_fsm 2023-10-19T12:59:18.250 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2607_vm 2023-10-19T12:59:18.250 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 442368 Oct 19 12:43 2608 2023-10-19T12:59:18.250 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2608_fsm 2023-10-19T12:59:18.250 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2608_vm 2023-10-19T12:59:18.250 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 286720 Oct 19 12:43 2609 2023-10-19T12:59:18.251 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2609_fsm 2023-10-19T12:59:18.251 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2609_vm 2023-10-19T12:59:18.251 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2610 2023-10-19T12:59:18.251 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2610_fsm 2023-10-19T12:59:18.253 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2610_vm 2023-10-19T12:59:18.253 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2611 2023-10-19T12:59:18.253 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2611_vm 2023-10-19T12:59:18.254 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2612 2023-10-19T12:59:18.254 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2612_fsm 2023-10-19T12:59:18.254 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2612_vm 2023-10-19T12:59:18.254 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2613 2023-10-19T12:59:18.255 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2613_vm 2023-10-19T12:59:18.255 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2615 2023-10-19T12:59:18.255 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2615_fsm 2023-10-19T12:59:18.255 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2615_vm 2023-10-19T12:59:18.255 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2616 2023-10-19T12:59:18.255 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2616_fsm 2023-10-19T12:59:18.256 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2616_vm 2023-10-19T12:59:18.256 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Oct 19 12:43 2617 2023-10-19T12:59:18.256 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2617_fsm 2023-10-19T12:59:18.256 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2617_vm 2023-10-19T12:59:18.256 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Oct 19 12:43 2618 2023-10-19T12:59:18.257 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2618_fsm 2023-10-19T12:59:18.257 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2618_vm 2023-10-19T12:59:18.257 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Oct 19 12:43 2619 2023-10-19T12:59:18.257 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2619_fsm 2023-10-19T12:59:18.257 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2619_vm 2023-10-19T12:59:18.258 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2620 2023-10-19T12:59:18.258 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2620_vm 2023-10-19T12:59:18.258 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2650 2023-10-19T12:59:18.258 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2651 2023-10-19T12:59:18.258 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2652 2023-10-19T12:59:18.259 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 19 12:43 2653 2023-10-19T12:59:18.259 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 19 12:43 2654 2023-10-19T12:59:18.259 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 19 12:43 2655 2023-10-19T12:59:18.259 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2656 2023-10-19T12:59:18.259 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2657 2023-10-19T12:59:18.260 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Oct 19 12:43 2658 2023-10-19T12:59:18.260 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Oct 19 12:43 2659 2023-10-19T12:59:18.260 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2660 2023-10-19T12:59:18.260 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2661 2023-10-19T12:59:18.261 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 19 12:43 2662 2023-10-19T12:59:18.261 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 19 12:43 2663 2023-10-19T12:59:18.261 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2664 2023-10-19T12:59:18.261 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2665 2023-10-19T12:59:18.261 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2666 2023-10-19T12:59:18.261 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2667 2023-10-19T12:59:18.262 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2668 2023-10-19T12:59:18.262 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2669 2023-10-19T12:59:18.262 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2670 2023-10-19T12:59:18.262 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 319488 Oct 19 12:43 2673 2023-10-19T12:59:18.262 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 376832 Oct 19 12:43 2674 2023-10-19T12:59:18.263 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 180224 Oct 19 12:43 2675 2023-10-19T12:59:18.263 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2678 2023-10-19T12:59:18.263 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2679 2023-10-19T12:59:18.263 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2680 2023-10-19T12:59:18.263 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2681 2023-10-19T12:59:18.264 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2682 2023-10-19T12:59:18.264 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2683 2023-10-19T12:59:18.264 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2684 2023-10-19T12:59:18.264 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2685 2023-10-19T12:59:18.264 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2686 2023-10-19T12:59:18.264 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2687 2023-10-19T12:59:18.265 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 19 12:43 2688 2023-10-19T12:59:18.265 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 19 12:43 2689 2023-10-19T12:59:18.265 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Oct 19 12:43 2690 2023-10-19T12:59:18.265 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 270336 Oct 19 12:43 2691 2023-10-19T12:59:18.265 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2692 2023-10-19T12:59:18.266 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2693 2023-10-19T12:59:18.266 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2696 2023-10-19T12:59:18.266 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2699 2023-10-19T12:59:18.266 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2701 2023-10-19T12:59:18.266 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2702 2023-10-19T12:59:18.266 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2703 2023-10-19T12:59:18.267 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 19 12:43 2704 2023-10-19T12:59:18.267 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2753 2023-10-19T12:59:18.267 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2753_fsm 2023-10-19T12:59:18.267 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2753_vm 2023-10-19T12:59:18.267 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2754 2023-10-19T12:59:18.268 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2755 2023-10-19T12:59:18.268 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 19 12:43 2756 2023-10-19T12:59:18.268 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 19 12:43 2757 2023-10-19T12:59:18.268 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2830 2023-10-19T12:59:18.268 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2830_vm 2023-10-19T12:59:18.268 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2831 2023-10-19T12:59:18.269 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2832 2023-10-19T12:59:18.269 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2832_vm 2023-10-19T12:59:18.269 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2833 2023-10-19T12:59:18.269 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2834 2023-10-19T12:59:18.269 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2834_vm 2023-10-19T12:59:18.270 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2835 2023-10-19T12:59:18.270 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2836 2023-10-19T12:59:18.270 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2836_vm 2023-10-19T12:59:18.270 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2837 2023-10-19T12:59:18.271 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 417792 Oct 19 12:43 2838 2023-10-19T12:59:18.271 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2838_fsm 2023-10-19T12:59:18.271 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2838_vm 2023-10-19T12:59:18.271 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2839 2023-10-19T12:59:18.271 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2840 2023-10-19T12:59:18.272 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2840_fsm 2023-10-19T12:59:18.272 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2840_vm 2023-10-19T12:59:18.272 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2841 2023-10-19T12:59:18.272 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2995 2023-10-19T12:59:18.273 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2995_vm 2023-10-19T12:59:18.273 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2996 2023-10-19T12:59:18.273 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3079 2023-10-19T12:59:18.273 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 3079_fsm 2023-10-19T12:59:18.273 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3079_vm 2023-10-19T12:59:18.274 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3080 2023-10-19T12:59:18.274 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3081 2023-10-19T12:59:18.274 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3085 2023-10-19T12:59:18.274 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3118 2023-10-19T12:59:18.274 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3118_vm 2023-10-19T12:59:18.275 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3119 2023-10-19T12:59:18.275 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3164 2023-10-19T12:59:18.275 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3256 2023-10-19T12:59:18.275 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3256_vm 2023-10-19T12:59:18.275 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3257 2023-10-19T12:59:18.275 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3258 2023-10-19T12:59:18.276 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3350 2023-10-19T12:59:18.276 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3350_vm 2023-10-19T12:59:18.276 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3351 2023-10-19T12:59:18.276 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3379 2023-10-19T12:59:18.276 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3380 2023-10-19T12:59:18.277 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3381 2023-10-19T12:59:18.277 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3381_vm 2023-10-19T12:59:18.277 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3394 2023-10-19T12:59:18.277 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 3394_fsm 2023-10-19T12:59:18.277 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3394_vm 2023-10-19T12:59:18.278 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3395 2023-10-19T12:59:18.278 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3439 2023-10-19T12:59:18.278 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3439_vm 2023-10-19T12:59:18.278 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3440 2023-10-19T12:59:18.278 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 19 12:43 3455 2023-10-19T12:59:18.279 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3456 2023-10-19T12:59:18.279 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 3456_fsm 2023-10-19T12:59:18.279 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3456_vm 2023-10-19T12:59:18.279 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3466 2023-10-19T12:59:18.279 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3466_vm 2023-10-19T12:59:18.280 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3467 2023-10-19T12:59:18.280 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3468 2023-10-19T12:59:18.280 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3501 2023-10-19T12:59:18.280 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3501_vm 2023-10-19T12:59:18.280 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3502 2023-10-19T12:59:18.281 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3503 2023-10-19T12:59:18.281 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3534 2023-10-19T12:59:18.281 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3541 2023-10-19T12:59:18.281 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 3541_fsm 2023-10-19T12:59:18.281 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3541_vm 2023-10-19T12:59:18.281 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3542 2023-10-19T12:59:18.282 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3574 2023-10-19T12:59:18.282 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3575 2023-10-19T12:59:18.282 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3576 2023-10-19T12:59:18.282 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3576_vm 2023-10-19T12:59:18.282 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3596 2023-10-19T12:59:18.283 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3596_vm 2023-10-19T12:59:18.283 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3597 2023-10-19T12:59:18.283 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3598 2023-10-19T12:59:18.283 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3598_vm 2023-10-19T12:59:18.283 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3599 2023-10-19T12:59:18.283 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3600 2023-10-19T12:59:18.284 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 3600_fsm 2023-10-19T12:59:18.284 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3600_vm 2023-10-19T12:59:18.284 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3601 2023-10-19T12:59:18.284 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 3601_fsm 2023-10-19T12:59:18.284 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3601_vm 2023-10-19T12:59:18.285 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3602 2023-10-19T12:59:18.285 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 3602_fsm 2023-10-19T12:59:18.285 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3602_vm 2023-10-19T12:59:18.285 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3603 2023-10-19T12:59:18.285 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 3603_fsm 2023-10-19T12:59:18.285 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3603_vm 2023-10-19T12:59:18.286 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3604 2023-10-19T12:59:18.286 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3605 2023-10-19T12:59:18.286 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3606 2023-10-19T12:59:18.286 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3607 2023-10-19T12:59:18.286 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3608 2023-10-19T12:59:18.287 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 19 12:43 3609 2023-10-19T12:59:18.287 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3712 2023-10-19T12:59:18.287 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3764 2023-10-19T12:59:18.287 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 3764_fsm 2023-10-19T12:59:18.287 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3764_vm 2023-10-19T12:59:18.288 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3766 2023-10-19T12:59:18.288 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3767 2023-10-19T12:59:18.288 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3997 2023-10-19T12:59:18.288 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 5002 2023-10-19T12:59:18.288 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 548 2023-10-19T12:59:18.288 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 549 2023-10-19T12:59:18.289 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 6102 2023-10-19T12:59:18.289 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 6102_vm 2023-10-19T12:59:18.289 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 6104 2023-10-19T12:59:18.289 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 6104_vm 2023-10-19T12:59:18.289 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 6106 2023-10-19T12:59:18.290 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 6106_vm 2023-10-19T12:59:18.290 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 6110 2023-10-19T12:59:18.290 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 6111 2023-10-19T12:59:18.290 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 6112 2023-10-19T12:59:18.290 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 6113 2023-10-19T12:59:18.291 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 6117 2023-10-19T12:59:18.291 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 826 2023-10-19T12:59:18.291 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 826_vm 2023-10-19T12:59:18.291 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 827 2023-10-19T12:59:18.291 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 828 2023-10-19T12:59:18.292 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Oct 19 12:43 pg_filenode.map 2023-10-19T12:59:18.292 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 19 12:43 PG_VERSION 2023-10-19T12:59:18.292 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:59:18.292 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/cephfs/postgres/data/base/12347: 2023-10-19T12:59:18.292 INFO:teuthology.orchestra.run.smithi046.stdout:total 547504 2023-10-19T12:59:18.293 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 308 Oct 19 12:44 . 2023-10-19T12:59:18.293 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Oct 19 12:43 .. 2023-10-19T12:59:18.293 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 112 2023-10-19T12:59:18.293 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 113 2023-10-19T12:59:18.293 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Oct 19 12:43 12182 2023-10-19T12:59:18.294 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 12182_fsm 2023-10-19T12:59:18.294 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12182_vm 2023-10-19T12:59:18.294 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 12184 2023-10-19T12:59:18.294 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12186 2023-10-19T12:59:18.294 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12187 2023-10-19T12:59:18.295 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 12187_fsm 2023-10-19T12:59:18.295 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12187_vm 2023-10-19T12:59:18.295 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 12189 2023-10-19T12:59:18.295 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12191 2023-10-19T12:59:18.295 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12192 2023-10-19T12:59:18.296 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 12192_fsm 2023-10-19T12:59:18.296 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12192_vm 2023-10-19T12:59:18.296 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 12194 2023-10-19T12:59:18.296 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12196 2023-10-19T12:59:18.297 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12197 2023-10-19T12:59:18.297 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 12197_fsm 2023-10-19T12:59:18.297 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12197_vm 2023-10-19T12:59:18.297 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 12199 2023-10-19T12:59:18.297 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12201 2023-10-19T12:59:18.297 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12202 2023-10-19T12:59:18.298 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 12202_fsm 2023-10-19T12:59:18.298 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12202_vm 2023-10-19T12:59:18.298 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 12204 2023-10-19T12:59:18.298 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12206 2023-10-19T12:59:18.298 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12207 2023-10-19T12:59:18.299 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 12207_fsm 2023-10-19T12:59:18.299 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12207_vm 2023-10-19T12:59:18.299 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 12209 2023-10-19T12:59:18.299 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12211 2023-10-19T12:59:18.299 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 12212 2023-10-19T12:59:18.300 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 12214 2023-10-19T12:59:18.300 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 12216 2023-10-19T12:59:18.300 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 73728 Oct 19 12:44 1247 2023-10-19T12:59:18.300 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:44 1247_fsm 2023-10-19T12:59:18.300 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:44 1247_vm 2023-10-19T12:59:18.301 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 393216 Oct 19 12:44 1249 2023-10-19T12:59:18.301 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:44 1249_fsm 2023-10-19T12:59:18.301 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:44 1249_vm 2023-10-19T12:59:18.301 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 606208 Oct 19 12:43 1255 2023-10-19T12:59:18.301 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 1255_fsm 2023-10-19T12:59:18.302 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 1255_vm 2023-10-19T12:59:18.302 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Oct 19 12:59 1259 2023-10-19T12:59:18.302 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 1259_fsm 2023-10-19T12:59:18.302 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:44 1259_vm 2023-10-19T12:59:18.302 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 1417 2023-10-19T12:59:18.303 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 1417_vm 2023-10-19T12:59:18.303 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 1418 2023-10-19T12:59:18.303 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 1418_vm 2023-10-19T12:59:18.303 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 2129920 Oct 19 12:59 16387 2023-10-19T12:59:18.303 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:59 16387_fsm 2023-10-19T12:59:18.304 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:59 16387_vm 2023-10-19T12:59:18.304 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1753088 Oct 19 12:59 16393 2023-10-19T12:59:18.304 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:59 16393_fsm 2023-10-19T12:59:18.304 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:59 16393_vm 2023-10-19T12:59:18.304 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 441057280 Oct 19 12:59 16396 2023-10-19T12:59:18.305 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Oct 19 12:58 16396_fsm 2023-10-19T12:59:18.305 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:54 16396_vm 2023-10-19T12:59:18.305 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 19 12:59 16397 2023-10-19T12:59:18.305 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Oct 19 12:59 16399 2023-10-19T12:59:18.305 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 71901184 Oct 19 12:59 16401 2023-10-19T12:59:18.306 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 35840000 Oct 19 12:59 16403 2023-10-19T12:59:18.306 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 19 12:59 16403_fsm 2023-10-19T12:59:18.306 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 174 2023-10-19T12:59:18.306 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 175 2023-10-19T12:59:18.306 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2187 2023-10-19T12:59:18.307 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2224 2023-10-19T12:59:18.307 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2224_vm 2023-10-19T12:59:18.307 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2328 2023-10-19T12:59:18.307 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2328_vm 2023-10-19T12:59:18.307 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2336 2023-10-19T12:59:18.307 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2336_vm 2023-10-19T12:59:18.308 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2337 2023-10-19T12:59:18.308 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2600 2023-10-19T12:59:18.308 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2600_fsm 2023-10-19T12:59:18.308 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2600_vm 2023-10-19T12:59:18.308 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2601 2023-10-19T12:59:18.309 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2601_fsm 2023-10-19T12:59:18.309 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2601_vm 2023-10-19T12:59:18.309 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 19 12:43 2602 2023-10-19T12:59:18.309 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2602_fsm 2023-10-19T12:59:18.309 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2602_vm 2023-10-19T12:59:18.309 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 19 12:43 2603 2023-10-19T12:59:18.310 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2603_fsm 2023-10-19T12:59:18.310 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2603_vm 2023-10-19T12:59:18.310 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2604 2023-10-19T12:59:18.310 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2604_vm 2023-10-19T12:59:18.310 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2605 2023-10-19T12:59:18.311 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2605_fsm 2023-10-19T12:59:18.311 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2605_vm 2023-10-19T12:59:18.311 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:44 2606 2023-10-19T12:59:18.311 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2606_fsm 2023-10-19T12:59:18.311 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:44 2606_vm 2023-10-19T12:59:18.312 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2607 2023-10-19T12:59:18.312 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2607_fsm 2023-10-19T12:59:18.312 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2607_vm 2023-10-19T12:59:18.312 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 450560 Oct 19 12:44 2608 2023-10-19T12:59:18.312 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:44 2608_fsm 2023-10-19T12:59:18.312 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:44 2608_vm 2023-10-19T12:59:18.313 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 286720 Oct 19 12:43 2609 2023-10-19T12:59:18.313 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2609_fsm 2023-10-19T12:59:18.313 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2609_vm 2023-10-19T12:59:18.313 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 19 12:44 2610 2023-10-19T12:59:18.313 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:44 2610_fsm 2023-10-19T12:59:18.314 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:44 2610_vm 2023-10-19T12:59:18.314 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2611 2023-10-19T12:59:18.314 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2611_vm 2023-10-19T12:59:18.314 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2612 2023-10-19T12:59:18.314 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2612_fsm 2023-10-19T12:59:18.314 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2612_vm 2023-10-19T12:59:18.315 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2613 2023-10-19T12:59:18.315 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2613_vm 2023-10-19T12:59:18.315 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2615 2023-10-19T12:59:18.315 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2615_fsm 2023-10-19T12:59:18.315 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2615_vm 2023-10-19T12:59:18.316 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2616 2023-10-19T12:59:18.316 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2616_fsm 2023-10-19T12:59:18.316 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2616_vm 2023-10-19T12:59:18.316 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Oct 19 12:43 2617 2023-10-19T12:59:18.316 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2617_fsm 2023-10-19T12:59:18.316 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2617_vm 2023-10-19T12:59:18.317 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Oct 19 12:43 2618 2023-10-19T12:59:18.317 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2618_fsm 2023-10-19T12:59:18.317 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2618_vm 2023-10-19T12:59:18.317 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 155648 Oct 19 12:59 2619 2023-10-19T12:59:18.317 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:50 2619_fsm 2023-10-19T12:59:18.318 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:44 2619_vm 2023-10-19T12:59:18.318 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2620 2023-10-19T12:59:18.318 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2620_vm 2023-10-19T12:59:18.318 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2650 2023-10-19T12:59:18.318 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2651 2023-10-19T12:59:18.319 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2652 2023-10-19T12:59:18.319 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 19 12:43 2653 2023-10-19T12:59:18.319 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 19 12:43 2654 2023-10-19T12:59:18.319 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 19 12:43 2655 2023-10-19T12:59:18.319 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2656 2023-10-19T12:59:18.319 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2657 2023-10-19T12:59:18.320 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Oct 19 12:44 2658 2023-10-19T12:59:18.320 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Oct 19 12:44 2659 2023-10-19T12:59:18.320 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2660 2023-10-19T12:59:18.320 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2661 2023-10-19T12:59:18.320 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 19 12:44 2662 2023-10-19T12:59:18.321 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 19 12:44 2663 2023-10-19T12:59:18.321 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:44 2664 2023-10-19T12:59:18.321 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:44 2665 2023-10-19T12:59:18.321 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:44 2666 2023-10-19T12:59:18.321 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:44 2667 2023-10-19T12:59:18.321 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2668 2023-10-19T12:59:18.322 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2669 2023-10-19T12:59:18.322 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2670 2023-10-19T12:59:18.322 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 319488 Oct 19 12:44 2673 2023-10-19T12:59:18.322 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 376832 Oct 19 12:44 2674 2023-10-19T12:59:18.322 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 180224 Oct 19 12:43 2675 2023-10-19T12:59:18.323 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:44 2678 2023-10-19T12:59:18.323 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:44 2679 2023-10-19T12:59:18.323 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2680 2023-10-19T12:59:18.323 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2681 2023-10-19T12:59:18.323 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2682 2023-10-19T12:59:18.323 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2683 2023-10-19T12:59:18.324 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2684 2023-10-19T12:59:18.324 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2685 2023-10-19T12:59:18.324 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2686 2023-10-19T12:59:18.324 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2687 2023-10-19T12:59:18.324 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 19 12:43 2688 2023-10-19T12:59:18.325 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 19 12:43 2689 2023-10-19T12:59:18.325 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Oct 19 12:43 2690 2023-10-19T12:59:18.325 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 270336 Oct 19 12:43 2691 2023-10-19T12:59:18.325 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2692 2023-10-19T12:59:18.325 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2693 2023-10-19T12:59:18.326 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 19 12:51 2696 2023-10-19T12:59:18.326 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2699 2023-10-19T12:59:18.326 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2701 2023-10-19T12:59:18.326 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2702 2023-10-19T12:59:18.326 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:44 2703 2023-10-19T12:59:18.326 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 19 12:44 2704 2023-10-19T12:59:18.327 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2753 2023-10-19T12:59:18.327 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2753_fsm 2023-10-19T12:59:18.327 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2753_vm 2023-10-19T12:59:18.327 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2754 2023-10-19T12:59:18.327 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2755 2023-10-19T12:59:18.328 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 19 12:43 2756 2023-10-19T12:59:18.328 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 19 12:43 2757 2023-10-19T12:59:18.328 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2830 2023-10-19T12:59:18.328 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2830_vm 2023-10-19T12:59:18.328 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2831 2023-10-19T12:59:18.328 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2832 2023-10-19T12:59:18.329 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2832_vm 2023-10-19T12:59:18.329 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2833 2023-10-19T12:59:18.329 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2834 2023-10-19T12:59:18.329 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2834_vm 2023-10-19T12:59:18.329 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2835 2023-10-19T12:59:18.330 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2836 2023-10-19T12:59:18.330 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2836_vm 2023-10-19T12:59:18.330 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2837 2023-10-19T12:59:18.330 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 417792 Oct 19 12:43 2838 2023-10-19T12:59:18.330 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2838_fsm 2023-10-19T12:59:18.331 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2838_vm 2023-10-19T12:59:18.331 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2839 2023-10-19T12:59:18.331 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2840 2023-10-19T12:59:18.331 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2840_fsm 2023-10-19T12:59:18.331 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2840_vm 2023-10-19T12:59:18.332 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2841 2023-10-19T12:59:18.332 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2995 2023-10-19T12:59:18.332 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2995_vm 2023-10-19T12:59:18.332 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2996 2023-10-19T12:59:18.332 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3079 2023-10-19T12:59:18.332 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 3079_fsm 2023-10-19T12:59:18.333 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3079_vm 2023-10-19T12:59:18.333 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3080 2023-10-19T12:59:18.333 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3081 2023-10-19T12:59:18.333 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3085 2023-10-19T12:59:18.333 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3118 2023-10-19T12:59:18.334 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3118_vm 2023-10-19T12:59:18.334 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3119 2023-10-19T12:59:18.334 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3164 2023-10-19T12:59:18.334 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3256 2023-10-19T12:59:18.334 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3256_vm 2023-10-19T12:59:18.335 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3257 2023-10-19T12:59:18.335 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3258 2023-10-19T12:59:18.335 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3350 2023-10-19T12:59:18.335 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3350_vm 2023-10-19T12:59:18.335 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3351 2023-10-19T12:59:18.335 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3379 2023-10-19T12:59:18.336 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3380 2023-10-19T12:59:18.336 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3381 2023-10-19T12:59:18.336 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3381_vm 2023-10-19T12:59:18.336 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3394 2023-10-19T12:59:18.336 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 3394_fsm 2023-10-19T12:59:18.337 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3394_vm 2023-10-19T12:59:18.337 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3395 2023-10-19T12:59:18.337 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3439 2023-10-19T12:59:18.337 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3439_vm 2023-10-19T12:59:18.337 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3440 2023-10-19T12:59:18.337 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 19 12:44 3455 2023-10-19T12:59:18.338 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3456 2023-10-19T12:59:18.338 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 3456_fsm 2023-10-19T12:59:18.338 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3456_vm 2023-10-19T12:59:18.338 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3466 2023-10-19T12:59:18.338 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3466_vm 2023-10-19T12:59:18.339 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3467 2023-10-19T12:59:18.339 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3468 2023-10-19T12:59:18.339 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3501 2023-10-19T12:59:18.339 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3501_vm 2023-10-19T12:59:18.339 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3502 2023-10-19T12:59:18.340 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3503 2023-10-19T12:59:18.340 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3534 2023-10-19T12:59:18.340 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3541 2023-10-19T12:59:18.340 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 3541_fsm 2023-10-19T12:59:18.340 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3541_vm 2023-10-19T12:59:18.341 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3542 2023-10-19T12:59:18.341 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3574 2023-10-19T12:59:18.341 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3575 2023-10-19T12:59:18.341 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3576 2023-10-19T12:59:18.341 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3576_vm 2023-10-19T12:59:18.341 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3596 2023-10-19T12:59:18.342 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3596_vm 2023-10-19T12:59:18.342 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3597 2023-10-19T12:59:18.342 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3598 2023-10-19T12:59:18.342 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3598_vm 2023-10-19T12:59:18.342 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3599 2023-10-19T12:59:18.343 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3600 2023-10-19T12:59:18.343 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 3600_fsm 2023-10-19T12:59:18.343 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3600_vm 2023-10-19T12:59:18.343 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3601 2023-10-19T12:59:18.343 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 3601_fsm 2023-10-19T12:59:18.344 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3601_vm 2023-10-19T12:59:18.344 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3602 2023-10-19T12:59:18.344 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 3602_fsm 2023-10-19T12:59:18.344 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3602_vm 2023-10-19T12:59:18.344 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3603 2023-10-19T12:59:18.344 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 3603_fsm 2023-10-19T12:59:18.345 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3603_vm 2023-10-19T12:59:18.345 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3604 2023-10-19T12:59:18.345 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3605 2023-10-19T12:59:18.345 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3606 2023-10-19T12:59:18.345 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3607 2023-10-19T12:59:18.346 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3608 2023-10-19T12:59:18.346 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 19 12:43 3609 2023-10-19T12:59:18.346 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3712 2023-10-19T12:59:18.346 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3764 2023-10-19T12:59:18.346 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 3764_fsm 2023-10-19T12:59:18.347 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3764_vm 2023-10-19T12:59:18.347 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3766 2023-10-19T12:59:18.347 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 3767 2023-10-19T12:59:18.347 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3997 2023-10-19T12:59:18.347 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 5002 2023-10-19T12:59:18.347 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 548 2023-10-19T12:59:18.348 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 549 2023-10-19T12:59:18.348 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 6102 2023-10-19T12:59:18.348 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 6102_vm 2023-10-19T12:59:18.348 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 6104 2023-10-19T12:59:18.348 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 6104_vm 2023-10-19T12:59:18.349 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 6106 2023-10-19T12:59:18.349 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 6106_vm 2023-10-19T12:59:18.349 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 6110 2023-10-19T12:59:18.349 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 6111 2023-10-19T12:59:18.349 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 6112 2023-10-19T12:59:18.349 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 6113 2023-10-19T12:59:18.350 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 6117 2023-10-19T12:59:18.350 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 826 2023-10-19T12:59:18.350 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 826_vm 2023-10-19T12:59:18.350 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 827 2023-10-19T12:59:18.352 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 828 2023-10-19T12:59:18.352 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Oct 19 12:43 pg_filenode.map 2023-10-19T12:59:18.352 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 137860 Oct 19 12:43 pg_internal.init 2023-10-19T12:59:18.353 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 19 12:43 PG_VERSION 2023-10-19T12:59:18.353 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:59:18.353 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/cephfs/postgres/data/base/pgsql_tmp: 2023-10-19T12:59:18.353 INFO:teuthology.orchestra.run.smithi046.stdout:total 0 2023-10-19T12:59:18.353 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:44 . 2023-10-19T12:59:18.353 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Oct 19 12:43 .. 2023-10-19T12:59:18.354 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:59:18.354 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/cephfs/postgres/data/global: 2023-10-19T12:59:18.354 INFO:teuthology.orchestra.run.smithi046.stdout:total 574 2023-10-19T12:59:18.354 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 59 Oct 19 12:43 . 2023-10-19T12:59:18.354 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Oct 19 12:59 .. 2023-10-19T12:59:18.355 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 1136 2023-10-19T12:59:18.355 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 1136_fsm 2023-10-19T12:59:18.355 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 1136_vm 2023-10-19T12:59:18.355 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 1137 2023-10-19T12:59:18.355 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 1213 2023-10-19T12:59:18.356 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 1213_fsm 2023-10-19T12:59:18.356 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 1213_vm 2023-10-19T12:59:18.356 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 1214 2023-10-19T12:59:18.356 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 1214_fsm 2023-10-19T12:59:18.356 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 1214_vm 2023-10-19T12:59:18.357 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 1232 2023-10-19T12:59:18.357 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 1233 2023-10-19T12:59:18.357 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 1260 2023-10-19T12:59:18.357 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 1260_fsm 2023-10-19T12:59:18.357 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 1260_vm 2023-10-19T12:59:18.358 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 1261 2023-10-19T12:59:18.358 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 1261_fsm 2023-10-19T12:59:18.358 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 1261_vm 2023-10-19T12:59:18.358 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 1262 2023-10-19T12:59:18.358 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 1262_fsm 2023-10-19T12:59:18.359 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 1262_vm 2023-10-19T12:59:18.359 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2396 2023-10-19T12:59:18.359 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 19 12:43 2396_fsm 2023-10-19T12:59:18.359 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2396_vm 2023-10-19T12:59:18.359 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2397 2023-10-19T12:59:18.359 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2671 2023-10-19T12:59:18.360 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2672 2023-10-19T12:59:18.360 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2676 2023-10-19T12:59:18.360 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2677 2023-10-19T12:59:18.360 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2694 2023-10-19T12:59:18.360 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2695 2023-10-19T12:59:18.361 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2697 2023-10-19T12:59:18.361 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 19 12:43 2698 2023-10-19T12:59:18.361 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2846 2023-10-19T12:59:18.361 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2846_vm 2023-10-19T12:59:18.361 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2847 2023-10-19T12:59:18.362 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2964 2023-10-19T12:59:18.362 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2964_vm 2023-10-19T12:59:18.362 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2965 2023-10-19T12:59:18.362 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2966 2023-10-19T12:59:18.362 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 2966_vm 2023-10-19T12:59:18.363 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 2967 2023-10-19T12:59:18.363 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3592 2023-10-19T12:59:18.363 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 3592_vm 2023-10-19T12:59:18.363 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 3593 2023-10-19T12:59:18.363 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 4060 2023-10-19T12:59:18.364 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 4060_vm 2023-10-19T12:59:18.364 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 4061 2023-10-19T12:59:18.364 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 6000 2023-10-19T12:59:18.364 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 6000_vm 2023-10-19T12:59:18.364 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 6001 2023-10-19T12:59:18.365 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 6002 2023-10-19T12:59:18.365 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 6100 2023-10-19T12:59:18.365 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 6100_vm 2023-10-19T12:59:18.365 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 6114 2023-10-19T12:59:18.365 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 6115 2023-10-19T12:59:18.365 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:59 pg_control 2023-10-19T12:59:18.366 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Oct 19 12:43 pg_filenode.map 2023-10-19T12:59:18.366 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 21644 Oct 19 12:43 pg_internal.init 2023-10-19T12:59:18.366 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:59:18.366 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/cephfs/postgres/data/log: 2023-10-19T12:59:18.366 INFO:teuthology.orchestra.run.smithi046.stdout:total 1 2023-10-19T12:59:18.367 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Oct 19 12:43 . 2023-10-19T12:59:18.367 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Oct 19 12:59 .. 2023-10-19T12:59:18.367 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 910 Oct 19 12:59 postgresql-Thu.log 2023-10-19T12:59:18.367 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:59:18.367 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/cephfs/postgres/data/pg_commit_ts: 2023-10-19T12:59:18.368 INFO:teuthology.orchestra.run.smithi046.stdout:total 0 2023-10-19T12:59:18.368 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 . 2023-10-19T12:59:18.368 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Oct 19 12:59 .. 2023-10-19T12:59:18.368 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:59:18.368 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/cephfs/postgres/data/pg_dynshmem: 2023-10-19T12:59:18.369 INFO:teuthology.orchestra.run.smithi046.stdout:total 0 2023-10-19T12:59:18.369 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 . 2023-10-19T12:59:18.369 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Oct 19 12:59 .. 2023-10-19T12:59:18.369 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:59:18.369 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/cephfs/postgres/data/pg_logical: 2023-10-19T12:59:18.370 INFO:teuthology.orchestra.run.smithi046.stdout:total 1 2023-10-19T12:59:18.370 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 19 12:59 . 2023-10-19T12:59:18.370 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Oct 19 12:59 .. 2023-10-19T12:59:18.370 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 mappings 2023-10-19T12:59:18.370 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Oct 19 12:59 replorigin_checkpoint 2023-10-19T12:59:18.371 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 snapshots 2023-10-19T12:59:18.371 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:59:18.371 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/cephfs/postgres/data/pg_logical/mappings: 2023-10-19T12:59:18.371 INFO:teuthology.orchestra.run.smithi046.stdout:total 0 2023-10-19T12:59:18.371 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 . 2023-10-19T12:59:18.371 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 19 12:59 .. 2023-10-19T12:59:18.372 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:59:18.372 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/cephfs/postgres/data/pg_logical/snapshots: 2023-10-19T12:59:18.372 INFO:teuthology.orchestra.run.smithi046.stdout:total 0 2023-10-19T12:59:18.372 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 . 2023-10-19T12:59:18.372 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 19 12:59 .. 2023-10-19T12:59:18.373 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:59:18.373 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/cephfs/postgres/data/pg_multixact: 2023-10-19T12:59:18.373 INFO:teuthology.orchestra.run.smithi046.stdout:total 0 2023-10-19T12:59:18.373 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Oct 19 12:43 . 2023-10-19T12:59:18.373 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Oct 19 12:59 .. 2023-10-19T12:59:18.373 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Oct 19 12:43 members 2023-10-19T12:59:18.374 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Oct 19 12:43 offsets 2023-10-19T12:59:18.374 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:59:18.374 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/cephfs/postgres/data/pg_multixact/members: 2023-10-19T12:59:18.374 INFO:teuthology.orchestra.run.smithi046.stdout:total 8 2023-10-19T12:59:18.374 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Oct 19 12:43 . 2023-10-19T12:59:18.375 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Oct 19 12:43 .. 2023-10-19T12:59:18.375 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 0000 2023-10-19T12:59:18.375 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:59:18.375 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/cephfs/postgres/data/pg_multixact/offsets: 2023-10-19T12:59:18.375 INFO:teuthology.orchestra.run.smithi046.stdout:total 8 2023-10-19T12:59:18.375 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Oct 19 12:43 . 2023-10-19T12:59:18.376 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Oct 19 12:43 .. 2023-10-19T12:59:18.376 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:44 0000 2023-10-19T12:59:18.376 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:59:18.376 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/cephfs/postgres/data/pg_notify: 2023-10-19T12:59:18.376 INFO:teuthology.orchestra.run.smithi046.stdout:total 8 2023-10-19T12:59:18.377 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Oct 19 12:43 . 2023-10-19T12:59:18.377 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Oct 19 12:59 .. 2023-10-19T12:59:18.377 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 19 12:43 0000 2023-10-19T12:59:18.377 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:59:18.378 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/cephfs/postgres/data/pg_replslot: 2023-10-19T12:59:18.378 INFO:teuthology.orchestra.run.smithi046.stdout:total 0 2023-10-19T12:59:18.378 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 . 2023-10-19T12:59:18.378 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Oct 19 12:59 .. 2023-10-19T12:59:18.378 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:59:18.379 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/cephfs/postgres/data/pg_serial: 2023-10-19T12:59:18.379 INFO:teuthology.orchestra.run.smithi046.stdout:total 0 2023-10-19T12:59:18.379 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 . 2023-10-19T12:59:18.379 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Oct 19 12:59 .. 2023-10-19T12:59:18.379 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:59:18.380 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/cephfs/postgres/data/pg_snapshots: 2023-10-19T12:59:18.380 INFO:teuthology.orchestra.run.smithi046.stdout:total 0 2023-10-19T12:59:18.380 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 . 2023-10-19T12:59:18.380 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Oct 19 12:59 .. 2023-10-19T12:59:18.380 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:59:18.380 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/cephfs/postgres/data/pg_stat: 2023-10-19T12:59:18.381 INFO:teuthology.orchestra.run.smithi046.stdout:total 13 2023-10-19T12:59:18.381 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 19 12:59 . 2023-10-19T12:59:18.381 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Oct 19 12:59 .. 2023-10-19T12:59:18.381 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1864 Oct 19 12:59 db_0.stat 2023-10-19T12:59:18.381 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 9300 Oct 19 12:59 db_12347.stat 2023-10-19T12:59:18.382 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 607 Oct 19 12:59 global.stat 2023-10-19T12:59:18.382 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:59:18.382 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/cephfs/postgres/data/pg_stat_tmp: 2023-10-19T12:59:18.382 INFO:teuthology.orchestra.run.smithi046.stdout:total 0 2023-10-19T12:59:18.382 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:59 . 2023-10-19T12:59:18.383 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Oct 19 12:59 .. 2023-10-19T12:59:18.383 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:59:18.383 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/cephfs/postgres/data/pg_subtrans: 2023-10-19T12:59:18.383 INFO:teuthology.orchestra.run.smithi046.stdout:total 136 2023-10-19T12:59:18.383 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Oct 19 12:59 . 2023-10-19T12:59:18.383 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Oct 19 12:59 .. 2023-10-19T12:59:18.384 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 139264 Oct 19 12:59 0009 2023-10-19T12:59:18.384 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:59:18.384 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/cephfs/postgres/data/pg_tblspc: 2023-10-19T12:59:18.384 INFO:teuthology.orchestra.run.smithi046.stdout:total 0 2023-10-19T12:59:18.385 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 . 2023-10-19T12:59:18.385 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Oct 19 12:59 .. 2023-10-19T12:59:18.385 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:59:18.385 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/cephfs/postgres/data/pg_twophase: 2023-10-19T12:59:18.385 INFO:teuthology.orchestra.run.smithi046.stdout:total 0 2023-10-19T12:59:18.385 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 . 2023-10-19T12:59:18.386 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Oct 19 12:59 .. 2023-10-19T12:59:18.386 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:59:18.386 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/cephfs/postgres/data/pg_wal: 2023-10-19T12:59:18.386 INFO:teuthology.orchestra.run.smithi046.stdout:total 1032192 2023-10-19T12:59:18.386 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 64 Oct 19 12:59 . 2023-10-19T12:59:18.387 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Oct 19 12:59 .. 2023-10-19T12:59:18.387 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 19 12:58 0000000100000000000000C9 2023-10-19T12:59:18.387 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 19 12:58 0000000100000000000000CA 2023-10-19T12:59:18.387 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 19 12:58 0000000100000000000000CB 2023-10-19T12:59:18.387 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 19 12:58 0000000100000000000000CC 2023-10-19T12:59:18.387 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 19 12:58 0000000100000000000000CD 2023-10-19T12:59:18.388 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 19 12:59 0000000100000000000000CE 2023-10-19T12:59:18.388 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 19 12:50 0000000100000000000000CF 2023-10-19T12:59:18.388 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 19 12:49 0000000100000000000000D0 2023-10-19T12:59:18.388 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 19 12:49 0000000100000000000000D1 2023-10-19T12:59:18.388 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 19 12:49 0000000100000000000000D2 2023-10-19T12:59:18.389 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 19 12:50 0000000100000000000000D3 2023-10-19T12:59:18.389 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 19 12:51 0000000100000000000000D4 2023-10-19T12:59:18.389 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 19 12:50 0000000100000000000000D5 2023-10-19T12:59:18.389 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 19 12:53 0000000100000000000000D6 2023-10-19T12:59:18.389 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 19 12:52 0000000100000000000000D7 2023-10-19T12:59:18.390 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 19 12:52 0000000100000000000000D8 2023-10-19T12:59:18.390 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 19 12:52 0000000100000000000000D9 2023-10-19T12:59:18.390 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 19 12:51 0000000100000000000000DA 2023-10-19T12:59:18.390 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 19 12:52 0000000100000000000000DB 2023-10-19T12:59:18.390 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 19 12:52 0000000100000000000000DC 2023-10-19T12:59:18.390 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 19 12:52 0000000100000000000000DD 2023-10-19T12:59:18.391 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 19 12:52 0000000100000000000000DE 2023-10-19T12:59:18.391 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 19 12:54 0000000100000000000000DF 2023-10-19T12:59:18.391 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 19 12:51 0000000100000000000000E0 2023-10-19T12:59:18.391 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 19 12:54 0000000100000000000000E1 2023-10-19T12:59:18.391 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 19 12:53 0000000100000000000000E2 2023-10-19T12:59:18.392 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 19 12:51 0000000100000000000000E3 2023-10-19T12:59:18.392 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 19 12:52 0000000100000000000000E4 2023-10-19T12:59:18.392 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 19 12:54 0000000100000000000000E5 2023-10-19T12:59:18.392 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 19 12:52 0000000100000000000000E6 2023-10-19T12:59:18.392 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 19 12:54 0000000100000000000000E7 2023-10-19T12:59:18.392 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 19 12:53 0000000100000000000000E8 2023-10-19T12:59:18.393 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 19 12:51 0000000100000000000000E9 2023-10-19T12:59:18.393 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 19 12:51 0000000100000000000000EA 2023-10-19T12:59:18.393 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 19 12:53 0000000100000000000000EB 2023-10-19T12:59:18.393 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 19 12:52 0000000100000000000000EC 2023-10-19T12:59:18.393 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 19 12:54 0000000100000000000000ED 2023-10-19T12:59:18.394 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 19 12:53 0000000100000000000000EE 2023-10-19T12:59:18.394 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 19 12:57 0000000100000000000000EF 2023-10-19T12:59:18.394 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 19 12:55 0000000100000000000000F0 2023-10-19T12:59:18.394 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 19 12:56 0000000100000000000000F1 2023-10-19T12:59:18.394 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 19 12:55 0000000100000000000000F2 2023-10-19T12:59:18.395 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 19 12:55 0000000100000000000000F3 2023-10-19T12:59:18.395 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 19 12:56 0000000100000000000000F4 2023-10-19T12:59:18.395 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 19 12:55 0000000100000000000000F5 2023-10-19T12:59:18.395 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 19 12:58 0000000100000000000000F6 2023-10-19T12:59:18.395 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 19 12:55 0000000100000000000000F7 2023-10-19T12:59:18.395 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 19 12:55 0000000100000000000000F8 2023-10-19T12:59:18.396 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 19 12:58 0000000100000000000000F9 2023-10-19T12:59:18.396 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 19 12:55 0000000100000000000000FA 2023-10-19T12:59:18.396 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 19 12:55 0000000100000000000000FB 2023-10-19T12:59:18.396 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 19 12:56 0000000100000000000000FC 2023-10-19T12:59:18.396 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 19 12:56 0000000100000000000000FD 2023-10-19T12:59:18.397 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 19 12:58 0000000100000000000000FE 2023-10-19T12:59:18.397 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 19 12:55 0000000100000000000000FF 2023-10-19T12:59:18.397 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 19 12:57 000000010000000100000000 2023-10-19T12:59:18.397 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 19 12:56 000000010000000100000001 2023-10-19T12:59:18.397 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 19 12:55 000000010000000100000002 2023-10-19T12:59:18.398 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 19 12:57 000000010000000100000003 2023-10-19T12:59:18.398 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 19 12:56 000000010000000100000004 2023-10-19T12:59:18.398 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 19 12:56 000000010000000100000005 2023-10-19T12:59:18.398 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 19 12:57 000000010000000100000006 2023-10-19T12:59:18.398 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 19 12:55 000000010000000100000007 2023-10-19T12:59:18.399 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 archive_status 2023-10-19T12:59:18.399 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:59:18.399 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/cephfs/postgres/data/pg_wal/archive_status: 2023-10-19T12:59:18.399 INFO:teuthology.orchestra.run.smithi046.stdout:total 0 2023-10-19T12:59:18.399 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 19 12:43 . 2023-10-19T12:59:18.400 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 64 Oct 19 12:59 .. 2023-10-19T12:59:18.400 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:59:18.400 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/cephfs/postgres/data/pg_xact: 2023-10-19T12:59:18.400 INFO:teuthology.orchestra.run.smithi046.stdout:total 160 2023-10-19T12:59:18.400 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Oct 19 12:43 . 2023-10-19T12:59:18.400 INFO:teuthology.orchestra.run.smithi046.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Oct 19 12:59 .. 2023-10-19T12:59:18.401 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 163840 Oct 19 12:59 0000 2023-10-19T12:59:18.401 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2023-10-19T12:59:18.412 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2023-10-19T12:59:18.412 ERROR:teuthology.run_tasks:Manager failed: fwd_scrub Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_f7420d7f8e55ceea786dcbf536c338ce920c21eb/qa/tasks/fwd_scrub.py", line 164, in task stop_all_fwd_scrubbers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph-c_f7420d7f8e55ceea786dcbf536c338ce920c21eb/qa/tasks/fwd_scrub.py", line 99, in stop_all_fwd_scrubbers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: reached maximum tries (31) after waiting for 900 seconds 2023-10-19T12:59:18.412 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2023-10-19T12:59:18.421 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-19T12:59:18.478 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:59:18 smithi046 ceph-mon[98509]: pgmap v827: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.6 MiB/s wr, 621 op/s 2023-10-19T12:59:18.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:59:18 smithi157 ceph-mon[134109]: pgmap v827: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.6 MiB/s wr, 621 op/s 2023-10-19T12:59:18.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:59:18 smithi195 ceph-mon[134493]: pgmap v827: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.6 MiB/s wr, 621 op/s 2023-10-19T12:59:18.631 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:18.628+0000 7fcf2bdff700 1 -- 172.21.15.46:0/531072099 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf24101930 msgr2=0x7fcf24101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:59:18.631 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:18.628+0000 7fcf2bdff700 1 --2- 172.21.15.46:0/531072099 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf24101930 0x7fcf24101d90 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fcf140099c0 tx=0x7fcf14009cd0 comp rx=0 tx=0).stop 2023-10-19T12:59:18.631 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:18.628+0000 7fcf2bdff700 1 -- 172.21.15.46:0/531072099 shutdown_connections 2023-10-19T12:59:18.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:18.628+0000 7fcf2bdff700 1 --2- 172.21.15.46:0/531072099 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf241022d0 0x7fcf24108b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:59:18.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:18.628+0000 7fcf2bdff700 1 --2- 172.21.15.46:0/531072099 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf24100740 0x7fcf24100b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:59:18.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:18.628+0000 7fcf2bdff700 1 --2- 172.21.15.46:0/531072099 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf24101930 0x7fcf24101d90 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:59:18.632 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:18.628+0000 7fcf2bdff700 1 -- 172.21.15.46:0/531072099 >> 172.21.15.46:0/531072099 conn(0x7fcf240fbc90 msgr2=0x7fcf240fe0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:59:18.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:18.628+0000 7fcf2bdff700 1 -- 172.21.15.46:0/531072099 shutdown_connections 2023-10-19T12:59:18.633 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:18.628+0000 7fcf2bdff700 1 -- 172.21.15.46:0/531072099 wait complete. 2023-10-19T12:59:18.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:18.629+0000 7fcf2bdff700 1 Processor -- start 2023-10-19T12:59:18.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:18.629+0000 7fcf2bdff700 1 -- start start 2023-10-19T12:59:18.635 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:18.629+0000 7fcf2bdff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf24100740 0x7fcf24074550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:59:18.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:18.629+0000 7fcf2bdff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf24101930 0x7fcf24072be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:59:18.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:18.629+0000 7fcf2bdff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf241022d0 0x7fcf24073120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:59:18.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:18.630+0000 7fcf2bdff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2419a560 con 0x7fcf24100740 2023-10-19T12:59:18.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:18.630+0000 7fcf2bdff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf24073660 con 0x7fcf24101930 2023-10-19T12:59:18.636 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:18.630+0000 7fcf2bdff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf24073820 con 0x7fcf241022d0 2023-10-19T12:59:18.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:18.630+0000 7fcf29b9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf24100740 0x7fcf24074550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:59:18.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:18.630+0000 7fcf2939a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf24101930 0x7fcf24072be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:59:18.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:18.630+0000 7fcf2939a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf24101930 0x7fcf24072be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:50492/0 (socket says 172.21.15.46:50492) 2023-10-19T12:59:18.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:18.630+0000 7fcf2939a700 1 -- 172.21.15.46:0/2447289018 learned_addr learned my addr 172.21.15.46:0/2447289018 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:59:18.637 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:18.630+0000 7fcf2a39c700 1 --2- 172.21.15.46:0/2447289018 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf241022d0 0x7fcf24073120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:59:18.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:18.630+0000 7fcf29b9b700 1 -- 172.21.15.46:0/2447289018 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf241022d0 msgr2=0x7fcf24073120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:59:18.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:18.630+0000 7fcf29b9b700 1 --2- 172.21.15.46:0/2447289018 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf241022d0 0x7fcf24073120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:59:18.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:18.630+0000 7fcf29b9b700 1 -- 172.21.15.46:0/2447289018 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf24101930 msgr2=0x7fcf24072be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:59:18.638 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:18.630+0000 7fcf29b9b700 1 --2- 172.21.15.46:0/2447289018 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf24101930 0x7fcf24072be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:59:18.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:18.630+0000 7fcf29b9b700 1 -- 172.21.15.46:0/2447289018 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf140095f0 con 0x7fcf24100740 2023-10-19T12:59:18.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:18.630+0000 7fcf2939a700 1 --2- 172.21.15.46:0/2447289018 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf24101930 0x7fcf24072be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:59:18.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:18.630+0000 7fcf29b9b700 1 --2- 172.21.15.46:0/2447289018 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf24100740 0x7fcf24074550 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fcf2000e9c0 tx=0x7fcf2000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:59:18.639 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:18.631+0000 7fcf1affd700 1 -- 172.21.15.46:0/2447289018 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf2000cbd0 con 0x7fcf24100740 2023-10-19T12:59:18.640 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:18.631+0000 7fcf2bdff700 1 -- 172.21.15.46:0/2447289018 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf241a4f10 con 0x7fcf24100740 2023-10-19T12:59:18.640 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:18.631+0000 7fcf1affd700 1 -- 172.21.15.46:0/2447289018 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcf2000eeb0 con 0x7fcf24100740 2023-10-19T12:59:18.640 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:18.631+0000 7fcf1affd700 1 -- 172.21.15.46:0/2447289018 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf20003c70 con 0x7fcf24100740 2023-10-19T12:59:18.640 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:18.631+0000 7fcf2bdff700 1 -- 172.21.15.46:0/2447289018 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf241a5280 con 0x7fcf24100740 2023-10-19T12:59:18.640 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:18.632+0000 7fcf2bdff700 1 -- 172.21.15.46:0/2447289018 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf24107c10 con 0x7fcf24100740 2023-10-19T12:59:18.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:18.634+0000 7fcf1affd700 1 -- 172.21.15.46:0/2447289018 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fcf20003dd0 con 0x7fcf24100740 2023-10-19T12:59:18.641 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:18.636+0000 7fcf1affd700 1 --2- 172.21.15.46:0/2447289018 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fcf100a1480 0x7fcf100a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:59:18.642 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:18.636+0000 7fcf1affd700 1 -- 172.21.15.46:0/2447289018 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7fcf20014070 con 0x7fcf24100740 2023-10-19T12:59:18.642 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:18.637+0000 7fcf2939a700 1 --2- 172.21.15.46:0/2447289018 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fcf100a1480 0x7fcf100a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:59:18.642 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:18.637+0000 7fcf2939a700 1 --2- 172.21.15.46:0/2447289018 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fcf100a1480 0x7fcf100a3940 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fcf14004800 tx=0x7fcf1401a040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:59:18.643 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:18.640+0000 7fcf1affd700 1 -- 172.21.15.46:0/2447289018 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fcf20096640 con 0x7fcf24100740 2023-10-19T12:59:18.858 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:18.855+0000 7fcf2bdff700 1 -- 172.21.15.46:0/2447289018 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcf2410bfb0 con 0x7fcf24100740 2023-10-19T12:59:18.862 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:18.856+0000 7fcf1affd700 1 -- 172.21.15.46:0/2447289018 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) v1 ==== 74+0+24780 (secure 0 0 0) 0x7fcf20099c60 con 0x7fcf24100740 2023-10-19T12:59:18.863 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:59:18.863 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":92,"fsid":"96a8be3c-6e7b-11ee-8db6-212e2dc638e7","created":"2023-10-19T12:33:26.148713+0000","modified":"2023-10-19T12:43:28.761367+0000","last_up_change":"2023-10-19T12:40:30.761679+0000","last_in_change":"2023-10-19T12:40:13.663559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-19T12:37:07.175795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-19T12:41:16.895203+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-19T12:41:18.255601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-19T12:41:21.830455+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"346ce86b-a10a-4869-9fdb-c3c1d4161455","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6803","nonce":500237995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6805","nonce":500237995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6809","nonce":500237995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6807","nonce":500237995}]},"public_addr":"172.21.15.46:6803/500237995","cluster_addr":"172.21.15.46:6805/500237995","heartbeat_back_addr":"172.21.15.46:6809/500237995","heartbeat_front_addr":"172.21.15.46:6807/500237995","state":["exists","up"]},{"osd":1,"uuid":"02aae687-76c5-4124-bae4-9787ed571c28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6801","nonce":2496862790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6803","nonce":2496862790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6807","nonce":2496862790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6805","nonce":2496862790}]},"public_addr":"172.21.15.157:6801/2496862790","cluster_addr":"172.21.15.157:6803/2496862790","heartbeat_back_addr":"172.21.15.157:6807/2496862790","heartbeat_front_addr":"172.21.15.157:6805/2496862790","state":["exists","up"]},{"osd":2,"uuid":"d5360828-1f58-4380-b2ad-0c21ff850981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6801","nonce":4211767276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6803","nonce":4211767276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6807","nonce":4211767276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6805","nonce":4211767276}]},"public_addr":"172.21.15.195:6801/4211767276","cluster_addr":"172.21.15.195:6803/4211767276","heartbeat_back_addr":"172.21.15.195:6807/4211767276","heartbeat_front_addr":"172.21.15.195:6805/4211767276","state":["exists","up"]},{"osd":3,"uuid":"accb780f-49d0-43f8-b166-ee12c558ef00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6811","nonce":1964113352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6813","nonce":1964113352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6817","nonce":1964113352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6815","nonce":1964113352}]},"public_addr":"172.21.15.46:6811/1964113352","cluster_addr":"172.21.15.46:6813/1964113352","heartbeat_back_addr":"172.21.15.46:6817/1964113352","heartbeat_front_addr":"172.21.15.46:6815/1964113352","state":["exists","up"]},{"osd":4,"uuid":"e662886d-e989-4d02-8c1f-3c4671352b0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6809","nonce":3636910144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6811","nonce":3636910144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6815","nonce":3636910144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6813","nonce":3636910144}]},"public_addr":"172.21.15.157:6809/3636910144","cluster_addr":"172.21.15.157:6811/3636910144","heartbeat_back_addr":"172.21.15.157:6815/3636910144","heartbeat_front_addr":"172.21.15.157:6813/3636910144","state":["exists","up"]},{"osd":5,"uuid":"9597e0ce-14ea-407d-90fe-f74bccee38b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6809","nonce":4071287969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6811","nonce":4071287969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6815","nonce":4071287969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6813","nonce":4071287969}]},"public_addr":"172.21.15.195:6809/4071287969","cluster_addr":"172.21.15.195:6811/4071287969","heartbeat_back_addr":"172.21.15.195:6815/4071287969","heartbeat_front_addr":"172.21.15.195:6813/4071287969","state":["exists","up"]},{"osd":6,"uuid":"6b78ba38-f60e-4cb6-b01c-cecc1820e8e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6819","nonce":1842285555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6821","nonce":1842285555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6825","nonce":1842285555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6823","nonce":1842285555}]},"public_addr":"172.21.15.46:6819/1842285555","cluster_addr":"172.21.15.46:6821/1842285555","heartbeat_back_addr":"172.21.15.46:6825/1842285555","heartbeat_front_addr":"172.21.15.46:6823/1842285555","state":["exists","up"]},{"osd":7,"uuid":"59a0899f-3bcd-4db2-b544-24df3a536749","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6817","nonce":3498672588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6819","nonce":3498672588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6823","nonce":3498672588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6821","nonce":3498672588}]},"public_addr":"172.21.15.157:6817/3498672588","cluster_addr":"172.21.15.157:6819/3498672588","heartbeat_back_addr":"172.21.15.157:6823/3498672588","heartbeat_front_addr":"172.21.15.157:6821/3498672588","state":["exists","up"]},{"osd":8,"uuid":"9c3c9835-043a-4fb5-a9ee-edf8caf6b605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6817","nonce":74230104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6819","nonce":74230104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6823","nonce":74230104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6821","nonce":74230104}]},"public_addr":"172.21.15.195:6817/74230104","cluster_addr":"172.21.15.195:6819/74230104","heartbeat_back_addr":"172.21.15.195:6823/74230104","heartbeat_front_addr":"172.21.15.195:6821/74230104","state":["exists","up"]},{"osd":9,"uuid":"3f18f506-a577-4b7c-ae0d-9351c07e81f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6827","nonce":3472581046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6829","nonce":3472581046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6833","nonce":3472581046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6831","nonce":3472581046}]},"public_addr":"172.21.15.46:6827/3472581046","cluster_addr":"172.21.15.46:6829/3472581046","heartbeat_back_addr":"172.21.15.46:6833/3472581046","heartbeat_front_addr":"172.21.15.46:6831/3472581046","state":["exists","up"]},{"osd":10,"uuid":"1ed01854-443a-4acf-9293-7ca0d451a93d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6825","nonce":2378416559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6827","nonce":2378416559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6831","nonce":2378416559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6829","nonce":2378416559}]},"public_addr":"172.21.15.157:6825/2378416559","cluster_addr":"172.21.15.157:6827/2378416559","heartbeat_back_addr":"172.21.15.157:6831/2378416559","heartbeat_front_addr":"172.21.15.157:6829/2378416559","state":["exists","up"]},{"osd":11,"uuid":"021398c0-9184-4647-8220-e40f6705ca90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6825","nonce":3075632222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6827","nonce":3075632222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6831","nonce":3075632222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6829","nonce":3075632222}]},"public_addr":"172.21.15.195:6825/3075632222","cluster_addr":"172.21.15.195:6827/3075632222","heartbeat_back_addr":"172.21.15.195:6831/3075632222","heartbeat_front_addr":"172.21.15.195:6829/3075632222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:36:22.002614+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:36:44.098031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:37:04.518341+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:37:30.796462+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:37:52.756555+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:38:13.403168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:38:39.058472+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:39:01.106893+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:39:21.908334+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:39:46.843884+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:40:08.792020+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:40:29.282974+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":7}]},{"pgid":"3.1b","mappings":[{"from":3,"to":6},{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.39","mappings":[{"from":5,"to":8}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]},{"pgid":"4.6","mappings":[{"from":5,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.46:0/3248595150":"2023-10-20T12:34:26.552115+0000","172.21.15.46:0/3624849341":"2023-10-20T12:34:26.552115+0000","172.21.15.46:0/1844094590":"2023-10-20T12:34:26.552115+0000","172.21.15.46:6801/20022894":"2023-10-20T12:34:26.552115+0000","172.21.15.46:0/3969790632":"2023-10-20T12:34:00.135248+0000","172.21.15.46:0/2331135821":"2023-10-20T12:34:00.135248+0000","172.21.15.46:6800/51664346":"2023-10-20T12:34:00.135248+0000","172.21.15.46:6801/51664346":"2023-10-20T12:34:00.135248+0000","172.21.15.46:0/585851467":"2023-10-20T12:34:00.135248+0000","172.21.15.46:6800/20022894":"2023-10-20T12:34:26.552115+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-19T12:59:18.864 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:18.859+0000 7fcf2bdff700 1 -- 172.21.15.46:0/2447289018 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fcf100a1480 msgr2=0x7fcf100a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:59:18.864 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:18.859+0000 7fcf2bdff700 1 --2- 172.21.15.46:0/2447289018 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fcf100a1480 0x7fcf100a3940 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fcf14004800 tx=0x7fcf1401a040 comp rx=0 tx=0).stop 2023-10-19T12:59:18.864 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:18.859+0000 7fcf2bdff700 1 -- 172.21.15.46:0/2447289018 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf24100740 msgr2=0x7fcf24074550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:59:18.865 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:18.859+0000 7fcf2bdff700 1 --2- 172.21.15.46:0/2447289018 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf24100740 0x7fcf24074550 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fcf2000e9c0 tx=0x7fcf2000ecd0 comp rx=0 tx=0).stop 2023-10-19T12:59:18.865 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:18.859+0000 7fcf2bdff700 1 -- 172.21.15.46:0/2447289018 shutdown_connections 2023-10-19T12:59:18.865 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:18.859+0000 7fcf2bdff700 1 --2- 172.21.15.46:0/2447289018 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fcf100a1480 0x7fcf100a3940 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:59:18.865 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:18.859+0000 7fcf2bdff700 1 --2- 172.21.15.46:0/2447289018 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf241022d0 0x7fcf24073120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:59:18.865 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:18.859+0000 7fcf2bdff700 1 --2- 172.21.15.46:0/2447289018 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf24100740 0x7fcf24074550 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:59:18.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:18.859+0000 7fcf2bdff700 1 --2- 172.21.15.46:0/2447289018 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf24101930 0x7fcf24072be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:59:18.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:18.859+0000 7fcf2bdff700 1 -- 172.21.15.46:0/2447289018 >> 172.21.15.46:0/2447289018 conn(0x7fcf240fbc90 msgr2=0x7fcf24104d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:59:18.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:18.859+0000 7fcf2bdff700 1 -- 172.21.15.46:0/2447289018 shutdown_connections 2023-10-19T12:59:18.866 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:18.859+0000 7fcf2bdff700 1 -- 172.21.15.46:0/2447289018 wait complete. 2023-10-19T12:59:18.882 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-19T12:37:07.175795+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-19T12:41:16.895203+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-19T12:41:18.255601+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-19T12:41:21.830455+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-19T12:59:18.883 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-19T12:59:19.106 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.099+0000 7fd8e07ff700 1 -- 172.21.15.46:0/3034351380 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8d81012b0 msgr2=0x7fd8d81036a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:59:19.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.099+0000 7fd8e07ff700 1 --2- 172.21.15.46:0/3034351380 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8d81012b0 0x7fd8d81036a0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fd8d4009990 tx=0x7fd8d4009ca0 comp rx=0 tx=0).stop 2023-10-19T12:59:19.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.099+0000 7fd8e07ff700 1 -- 172.21.15.46:0/3034351380 shutdown_connections 2023-10-19T12:59:19.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.099+0000 7fd8e07ff700 1 --2- 172.21.15.46:0/3034351380 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd8d8106510 0x7fd8d8108900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:59:19.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.099+0000 7fd8e07ff700 1 --2- 172.21.15.46:0/3034351380 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8d81012b0 0x7fd8d81036a0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:59:19.107 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.099+0000 7fd8e07ff700 1 --2- 172.21.15.46:0/3034351380 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd8d8103be0 0x7fd8d8105fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:59:19.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.099+0000 7fd8e07ff700 1 -- 172.21.15.46:0/3034351380 >> 172.21.15.46:0/3034351380 conn(0x7fd8d80fac00 msgr2=0x7fd8d80fd040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:59:19.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.099+0000 7fd8e07ff700 1 -- 172.21.15.46:0/3034351380 shutdown_connections 2023-10-19T12:59:19.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.099+0000 7fd8e07ff700 1 -- 172.21.15.46:0/3034351380 wait complete. 2023-10-19T12:59:19.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.100+0000 7fd8e07ff700 1 Processor -- start 2023-10-19T12:59:19.108 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.100+0000 7fd8e07ff700 1 -- start start 2023-10-19T12:59:19.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.101+0000 7fd8e07ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd8d81012b0 0x7fd8d8198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:59:19.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.101+0000 7fd8e07ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd8d8103be0 0x7fd8d8198e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:59:19.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.101+0000 7fd8e07ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8d8106510 0x7fd8d819fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:59:19.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.101+0000 7fd8e07ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d81a0450 con 0x7fd8d8106510 2023-10-19T12:59:19.109 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.101+0000 7fd8e07ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d81a0590 con 0x7fd8d81012b0 2023-10-19T12:59:19.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.101+0000 7fd8e07ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d81a0720 con 0x7fd8d8103be0 2023-10-19T12:59:19.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.101+0000 7fd8de59b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd8d81012b0 0x7fd8d8198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:59:19.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.101+0000 7fd8de59b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd8d81012b0 0x7fd8d8198920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:50522/0 (socket says 172.21.15.46:50522) 2023-10-19T12:59:19.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.101+0000 7fd8de59b700 1 -- 172.21.15.46:0/3921702777 learned_addr learned my addr 172.21.15.46:0/3921702777 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:59:19.110 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.101+0000 7fd8ded9c700 1 --2- 172.21.15.46:0/3921702777 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8d8106510 0x7fd8d819fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:59:19.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.101+0000 7fd8ddd9a700 1 --2- 172.21.15.46:0/3921702777 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd8d8103be0 0x7fd8d8198e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:59:19.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.101+0000 7fd8de59b700 1 -- 172.21.15.46:0/3921702777 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd8d8103be0 msgr2=0x7fd8d8198e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:59:19.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.101+0000 7fd8de59b700 1 --2- 172.21.15.46:0/3921702777 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd8d8103be0 0x7fd8d8198e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:59:19.111 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.101+0000 7fd8de59b700 1 -- 172.21.15.46:0/3921702777 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8d8106510 msgr2=0x7fd8d819fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:59:19.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.101+0000 7fd8de59b700 1 --2- 172.21.15.46:0/3921702777 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8d8106510 0x7fd8d819fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:59:19.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.101+0000 7fd8de59b700 1 -- 172.21.15.46:0/3921702777 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8d40095f0 con 0x7fd8d81012b0 2023-10-19T12:59:19.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.102+0000 7fd8de59b700 1 --2- 172.21.15.46:0/3921702777 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd8d81012b0 0x7fd8d8198920 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd8d4000c00 tx=0x7fd8d4005740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:59:19.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.102+0000 7fd8cf7fe700 1 -- 172.21.15.46:0/3921702777 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d401d070 con 0x7fd8d81012b0 2023-10-19T12:59:19.112 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.102+0000 7fd8e07ff700 1 -- 172.21.15.46:0/3921702777 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8d81a09a0 con 0x7fd8d81012b0 2023-10-19T12:59:19.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.102+0000 7fd8cf7fe700 1 -- 172.21.15.46:0/3921702777 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd8d4021410 con 0x7fd8d81012b0 2023-10-19T12:59:19.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.102+0000 7fd8cf7fe700 1 -- 172.21.15.46:0/3921702777 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d4017650 con 0x7fd8d81012b0 2023-10-19T12:59:19.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.102+0000 7fd8e07ff700 1 -- 172.21.15.46:0/3921702777 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8d81a0e20 con 0x7fd8d81012b0 2023-10-19T12:59:19.113 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.103+0000 7fd8e07ff700 1 -- 172.21.15.46:0/3921702777 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8d8108090 con 0x7fd8d81012b0 2023-10-19T12:59:19.114 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.105+0000 7fd8cf7fe700 1 -- 172.21.15.46:0/3921702777 <== mon.2 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fd8d40217f0 con 0x7fd8d81012b0 2023-10-19T12:59:19.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.106+0000 7fd8cf7fe700 1 --2- 172.21.15.46:0/3921702777 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fd8c40a1500 0x7fd8c40a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:59:19.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.107+0000 7fd8cf7fe700 1 -- 172.21.15.46:0/3921702777 <== mon.2 v2:172.21.15.157:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7fd8d40cebf0 con 0x7fd8d81012b0 2023-10-19T12:59:19.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.107+0000 7fd8ddd9a700 1 --2- 172.21.15.46:0/3921702777 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fd8c40a1500 0x7fd8c40a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:59:19.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.107+0000 7fd8ddd9a700 1 --2- 172.21.15.46:0/3921702777 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fd8c40a1500 0x7fd8c40a39c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fd8c8005950 tx=0x7fd8c800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:59:19.115 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.111+0000 7fd8cf7fe700 1 -- 172.21.15.46:0/3921702777 <== mon.2 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd8d4097eb0 con 0x7fd8d81012b0 2023-10-19T12:59:19.327 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.324+0000 7fd8e07ff700 1 -- 172.21.15.46:0/3921702777 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd8d810bfd0 con 0x7fd8d81012b0 2023-10-19T12:59:19.328 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.325+0000 7fd8cf7fe700 1 -- 172.21.15.46:0/3921702777 <== mon.2 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v92) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd8d4026020 con 0x7fd8d81012b0 2023-10-19T12:59:19.329 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2023-10-19T12:59:19.331 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.328+0000 7fd8e07ff700 1 -- 172.21.15.46:0/3921702777 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fd8c40a1500 msgr2=0x7fd8c40a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:59:19.331 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.328+0000 7fd8e07ff700 1 --2- 172.21.15.46:0/3921702777 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fd8c40a1500 0x7fd8c40a39c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fd8c8005950 tx=0x7fd8c800b410 comp rx=0 tx=0).stop 2023-10-19T12:59:19.331 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.328+0000 7fd8e07ff700 1 -- 172.21.15.46:0/3921702777 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd8d81012b0 msgr2=0x7fd8d8198920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:59:19.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.328+0000 7fd8e07ff700 1 --2- 172.21.15.46:0/3921702777 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd8d81012b0 0x7fd8d8198920 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd8d4000c00 tx=0x7fd8d4005740 comp rx=0 tx=0).stop 2023-10-19T12:59:19.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.328+0000 7fd8e07ff700 1 -- 172.21.15.46:0/3921702777 shutdown_connections 2023-10-19T12:59:19.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.328+0000 7fd8e07ff700 1 --2- 172.21.15.46:0/3921702777 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8d8106510 0x7fd8d819fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:59:19.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.328+0000 7fd8e07ff700 1 --2- 172.21.15.46:0/3921702777 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd8d81012b0 0x7fd8d8198920 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:59:19.332 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.328+0000 7fd8e07ff700 1 --2- 172.21.15.46:0/3921702777 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fd8c40a1500 0x7fd8c40a39c0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:59:19.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.328+0000 7fd8e07ff700 1 --2- 172.21.15.46:0/3921702777 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd8d8103be0 0x7fd8d8198e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:59:19.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.328+0000 7fd8e07ff700 1 -- 172.21.15.46:0/3921702777 >> 172.21.15.46:0/3921702777 conn(0x7fd8d80fac00 msgr2=0x7fd8d8100b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:59:19.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.328+0000 7fd8e07ff700 1 -- 172.21.15.46:0/3921702777 shutdown_connections 2023-10-19T12:59:19.333 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.328+0000 7fd8e07ff700 1 -- 172.21.15.46:0/3921702777 wait complete. 2023-10-19T12:59:19.350 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-19T12:59:19.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:59:19 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/2447289018' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-19T12:59:19.566 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.559+0000 7f9b5fdff700 1 -- 172.21.15.46:0/1877043597 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9b58100880 msgr2=0x7f9b58100ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:59:19.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.559+0000 7f9b5fdff700 1 --2- 172.21.15.46:0/1877043597 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9b58100880 0x7f9b58100ce0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f9b480099c0 tx=0x7f9b48009cd0 comp rx=0 tx=0).stop 2023-10-19T12:59:19.567 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.559+0000 7f9b5fdff700 1 -- 172.21.15.46:0/1877043597 shutdown_connections 2023-10-19T12:59:19.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.559+0000 7f9b5fdff700 1 --2- 172.21.15.46:0/1877043597 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b58101220 0x7f9b58107ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:59:19.568 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.559+0000 7f9b5fdff700 1 --2- 172.21.15.46:0/1877043597 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9b580ff690 0x7f9b580ffab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:59:19.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.559+0000 7f9b5fdff700 1 --2- 172.21.15.46:0/1877043597 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9b58100880 0x7f9b58100ce0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:59:19.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.559+0000 7f9b5fdff700 1 -- 172.21.15.46:0/1877043597 >> 172.21.15.46:0/1877043597 conn(0x7f9b580fac00 msgr2=0x7f9b580fd040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:59:19.569 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.559+0000 7f9b5fdff700 1 -- 172.21.15.46:0/1877043597 shutdown_connections 2023-10-19T12:59:19.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.560+0000 7f9b5fdff700 1 -- 172.21.15.46:0/1877043597 wait complete. 2023-10-19T12:59:19.570 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.560+0000 7f9b5fdff700 1 Processor -- start 2023-10-19T12:59:19.571 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.561+0000 7f9b5fdff700 1 -- start start 2023-10-19T12:59:19.571 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.561+0000 7f9b5fdff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9b580ff690 0x7f9b581035d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:59:19.571 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.561+0000 7f9b5fdff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b58100880 0x7f9b58101c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:59:19.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.561+0000 7f9b5fdff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9b58101220 0x7f9b581021a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:59:19.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.561+0000 7f9b5fdff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b5819a5c0 con 0x7f9b58100880 2023-10-19T12:59:19.572 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.561+0000 7f9b5fdff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b581026e0 con 0x7f9b58101220 2023-10-19T12:59:19.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.561+0000 7f9b5fdff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b581028a0 con 0x7f9b580ff690 2023-10-19T12:59:19.573 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.561+0000 7f9b5d39a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b58100880 0x7f9b58101c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:59:19.574 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.561+0000 7f9b5d39a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b58100880 0x7f9b58101c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34872/0 (socket says 172.21.15.46:34872) 2023-10-19T12:59:19.574 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.561+0000 7f9b5d39a700 1 -- 172.21.15.46:0/707071628 learned_addr learned my addr 172.21.15.46:0/707071628 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:59:19.574 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.561+0000 7f9b5e39c700 1 --2- 172.21.15.46:0/707071628 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9b58101220 0x7f9b581021a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:59:19.575 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.561+0000 7f9b5db9b700 1 --2- 172.21.15.46:0/707071628 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9b580ff690 0x7f9b581035d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:59:19.575 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.562+0000 7f9b5d39a700 1 -- 172.21.15.46:0/707071628 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9b580ff690 msgr2=0x7f9b581035d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:59:19.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.562+0000 7f9b5d39a700 1 --2- 172.21.15.46:0/707071628 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9b580ff690 0x7f9b581035d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:59:19.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.562+0000 7f9b5d39a700 1 -- 172.21.15.46:0/707071628 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9b58101220 msgr2=0x7f9b581021a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:59:19.576 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.562+0000 7f9b5d39a700 1 --2- 172.21.15.46:0/707071628 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9b58101220 0x7f9b581021a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:59:19.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.562+0000 7f9b5d39a700 1 -- 172.21.15.46:0/707071628 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b50009c40 con 0x7f9b58100880 2023-10-19T12:59:19.577 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.562+0000 7f9b5d39a700 1 --2- 172.21.15.46:0/707071628 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b58100880 0x7f9b58101c60 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f9b48006010 tx=0x7f9b4800f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:59:19.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.562+0000 7f9b4effd700 1 -- 172.21.15.46:0/707071628 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4801d070 con 0x7f9b58100880 2023-10-19T12:59:19.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.562+0000 7f9b4effd700 1 -- 172.21.15.46:0/707071628 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9b48005030 con 0x7f9b58100880 2023-10-19T12:59:19.578 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.562+0000 7f9b5fdff700 1 -- 172.21.15.46:0/707071628 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b480095f0 con 0x7f9b58100880 2023-10-19T12:59:19.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.562+0000 7f9b4effd700 1 -- 172.21.15.46:0/707071628 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b48004b10 con 0x7f9b58100880 2023-10-19T12:59:19.579 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.562+0000 7f9b5fdff700 1 -- 172.21.15.46:0/707071628 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b581a5150 con 0x7f9b58100880 2023-10-19T12:59:19.580 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.563+0000 7f9b5fdff700 1 -- 172.21.15.46:0/707071628 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b580675a0 con 0x7f9b58100880 2023-10-19T12:59:19.582 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.566+0000 7f9b4effd700 1 -- 172.21.15.46:0/707071628 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f9b480054a0 con 0x7f9b58100880 2023-10-19T12:59:19.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.568+0000 7f9b4effd700 1 --2- 172.21.15.46:0/707071628 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f9b440a1480 0x7f9b440a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:59:19.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.568+0000 7f9b4effd700 1 -- 172.21.15.46:0/707071628 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f9b480ce180 con 0x7f9b58100880 2023-10-19T12:59:19.583 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.568+0000 7f9b5db9b700 1 --2- 172.21.15.46:0/707071628 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f9b440a1480 0x7f9b440a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:59:19.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.569+0000 7f9b5db9b700 1 --2- 172.21.15.46:0/707071628 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f9b440a1480 0x7f9b440a3940 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f9b581006e0 tx=0x7f9b54009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:59:19.584 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.571+0000 7f9b4effd700 1 -- 172.21.15.46:0/707071628 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f9b48097440 con 0x7f9b58100880 2023-10-19T12:59:19.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:59:19 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/2447289018' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-19T12:59:19.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:59:19 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/2447289018' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-19T12:59:19.789 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.786+0000 7f9b5fdff700 1 -- 172.21.15.46:0/707071628 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9b581a5380 con 0x7f9b58100880 2023-10-19T12:59:19.790 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.786+0000 7f9b4effd700 1 -- 172.21.15.46:0/707071628 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v92) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9b4809aa60 con 0x7f9b58100880 2023-10-19T12:59:19.790 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2023-10-19T12:59:19.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.789+0000 7f9b5fdff700 1 -- 172.21.15.46:0/707071628 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f9b440a1480 msgr2=0x7f9b440a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:59:19.792 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.789+0000 7f9b5fdff700 1 --2- 172.21.15.46:0/707071628 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f9b440a1480 0x7f9b440a3940 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f9b581006e0 tx=0x7f9b54009260 comp rx=0 tx=0).stop 2023-10-19T12:59:19.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.789+0000 7f9b5fdff700 1 -- 172.21.15.46:0/707071628 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b58100880 msgr2=0x7f9b58101c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:59:19.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.789+0000 7f9b5fdff700 1 --2- 172.21.15.46:0/707071628 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b58100880 0x7f9b58101c60 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f9b48006010 tx=0x7f9b4800f690 comp rx=0 tx=0).stop 2023-10-19T12:59:19.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.789+0000 7f9b5fdff700 1 -- 172.21.15.46:0/707071628 shutdown_connections 2023-10-19T12:59:19.793 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.789+0000 7f9b5fdff700 1 --2- 172.21.15.46:0/707071628 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9b58101220 0x7f9b581021a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:59:19.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.789+0000 7f9b5fdff700 1 --2- 172.21.15.46:0/707071628 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f9b440a1480 0x7f9b440a3940 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:59:19.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.789+0000 7f9b5fdff700 1 --2- 172.21.15.46:0/707071628 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9b580ff690 0x7f9b581035d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:59:19.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.789+0000 7f9b5fdff700 1 --2- 172.21.15.46:0/707071628 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b58100880 0x7f9b58101c60 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:59:19.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.789+0000 7f9b5fdff700 1 -- 172.21.15.46:0/707071628 >> 172.21.15.46:0/707071628 conn(0x7f9b580fac00 msgr2=0x7f9b580fc710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:59:19.794 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.789+0000 7f9b5fdff700 1 -- 172.21.15.46:0/707071628 shutdown_connections 2023-10-19T12:59:19.795 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:19.789+0000 7f9b5fdff700 1 -- 172.21.15.46:0/707071628 wait complete. 2023-10-19T12:59:19.811 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-19T12:59:20.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.017+0000 7f6c5f7ff700 1 -- 172.21.15.46:0/3134183418 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c58101990 msgr2=0x7f6c58101df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:59:20.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.017+0000 7f6c5f7ff700 1 --2- 172.21.15.46:0/3134183418 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c58101990 0x7f6c58101df0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6c48009990 tx=0x7f6c48009ca0 comp rx=0 tx=0).stop 2023-10-19T12:59:20.023 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.017+0000 7f6c5f7ff700 1 -- 172.21.15.46:0/3134183418 shutdown_connections 2023-10-19T12:59:20.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.017+0000 7f6c5f7ff700 1 --2- 172.21.15.46:0/3134183418 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c58102330 0x7f6c58108be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:59:20.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.017+0000 7f6c5f7ff700 1 --2- 172.21.15.46:0/3134183418 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6c581007a0 0x7f6c58100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:59:20.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.017+0000 7f6c5f7ff700 1 --2- 172.21.15.46:0/3134183418 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c58101990 0x7f6c58101df0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:59:20.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.017+0000 7f6c5f7ff700 1 -- 172.21.15.46:0/3134183418 >> 172.21.15.46:0/3134183418 conn(0x7f6c580fbcf0 msgr2=0x7f6c580fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:59:20.024 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.017+0000 7f6c5f7ff700 1 -- 172.21.15.46:0/3134183418 shutdown_connections 2023-10-19T12:59:20.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.017+0000 7f6c5f7ff700 1 -- 172.21.15.46:0/3134183418 wait complete. 2023-10-19T12:59:20.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.018+0000 7f6c5f7ff700 1 Processor -- start 2023-10-19T12:59:20.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.018+0000 7f6c5f7ff700 1 -- start start 2023-10-19T12:59:20.025 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.019+0000 7f6c5f7ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c581007a0 0x7f6c58198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:59:20.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.019+0000 7f6c5f7ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c58101990 0x7f6c58198e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:59:20.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.019+0000 7f6c5f7ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6c58102330 0x7f6c5819fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:59:20.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.019+0000 7f6c5f7ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c581a0470 con 0x7f6c581007a0 2023-10-19T12:59:20.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.019+0000 7f6c5f7ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c581a05b0 con 0x7f6c58102330 2023-10-19T12:59:20.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.019+0000 7f6c5f7ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c581a0740 con 0x7f6c58101990 2023-10-19T12:59:20.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.019+0000 7f6c5d59b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c581007a0 0x7f6c58198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:59:20.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.019+0000 7f6c5d59b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c581007a0 0x7f6c58198940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34888/0 (socket says 172.21.15.46:34888) 2023-10-19T12:59:20.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.019+0000 7f6c5d59b700 1 -- 172.21.15.46:0/4005078180 learned_addr learned my addr 172.21.15.46:0/4005078180 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:59:20.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.019+0000 7f6c5cd9a700 1 --2- 172.21.15.46:0/4005078180 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c58101990 0x7f6c58198e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:59:20.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.019+0000 7f6c5dd9c700 1 --2- 172.21.15.46:0/4005078180 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6c58102330 0x7f6c5819fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:59:20.028 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.019+0000 7f6c5d59b700 1 -- 172.21.15.46:0/4005078180 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c58101990 msgr2=0x7f6c58198e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:59:20.028 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.019+0000 7f6c5d59b700 1 --2- 172.21.15.46:0/4005078180 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c58101990 0x7f6c58198e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:59:20.028 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.019+0000 7f6c5d59b700 1 -- 172.21.15.46:0/4005078180 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6c58102330 msgr2=0x7f6c5819fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:59:20.028 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.019+0000 7f6c5d59b700 1 --2- 172.21.15.46:0/4005078180 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6c58102330 0x7f6c5819fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:59:20.028 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.019+0000 7f6c5d59b700 1 -- 172.21.15.46:0/4005078180 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c480095f0 con 0x7f6c581007a0 2023-10-19T12:59:20.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.020+0000 7f6c5d59b700 1 --2- 172.21.15.46:0/4005078180 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c581007a0 0x7f6c58198940 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f6c5400e970 tx=0x7f6c5400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:59:20.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.020+0000 7f6c4e7fc700 1 -- 172.21.15.46:0/4005078180 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c54009790 con 0x7f6c581007a0 2023-10-19T12:59:20.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.020+0000 7f6c5f7ff700 1 -- 172.21.15.46:0/4005078180 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c581a0a20 con 0x7f6c581007a0 2023-10-19T12:59:20.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.020+0000 7f6c4e7fc700 1 -- 172.21.15.46:0/4005078180 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6c5400c7e0 con 0x7f6c581007a0 2023-10-19T12:59:20.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.020+0000 7f6c4e7fc700 1 -- 172.21.15.46:0/4005078180 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c54003c70 con 0x7f6c581007a0 2023-10-19T12:59:20.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.020+0000 7f6c5f7ff700 1 -- 172.21.15.46:0/4005078180 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c581a0f30 con 0x7f6c581007a0 2023-10-19T12:59:20.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.021+0000 7f6c5f7ff700 1 -- 172.21.15.46:0/4005078180 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c580675a0 con 0x7f6c581007a0 2023-10-19T12:59:20.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.023+0000 7f6c4e7fc700 1 -- 172.21.15.46:0/4005078180 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f6c5400cc50 con 0x7f6c581007a0 2023-10-19T12:59:20.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.024+0000 7f6c4e7fc700 1 --2- 172.21.15.46:0/4005078180 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f6c440a1480 0x7f6c440a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:59:20.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.025+0000 7f6c4e7fc700 1 -- 172.21.15.46:0/4005078180 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f6c54014070 con 0x7f6c581007a0 2023-10-19T12:59:20.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.025+0000 7f6c5cd9a700 1 --2- 172.21.15.46:0/4005078180 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f6c440a1480 0x7f6c440a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:59:20.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.025+0000 7f6c5cd9a700 1 --2- 172.21.15.46:0/4005078180 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f6c440a1480 0x7f6c440a3940 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f6c4800b2e0 tx=0x7f6c48005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:59:20.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.027+0000 7f6c4e7fc700 1 -- 172.21.15.46:0/4005078180 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6c54096660 con 0x7f6c581007a0 2023-10-19T12:59:20.243 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.240+0000 7f6c5f7ff700 1 -- 172.21.15.46:0/4005078180 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6c5810c190 con 0x7f6c581007a0 2023-10-19T12:59:20.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.241+0000 7f6c4e7fc700 1 -- 172.21.15.46:0/4005078180 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v92) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6c54099c80 con 0x7f6c581007a0 2023-10-19T12:59:20.244 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2023-10-19T12:59:20.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.243+0000 7f6c5f7ff700 1 -- 172.21.15.46:0/4005078180 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f6c440a1480 msgr2=0x7f6c440a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:59:20.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.243+0000 7f6c5f7ff700 1 --2- 172.21.15.46:0/4005078180 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f6c440a1480 0x7f6c440a3940 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f6c4800b2e0 tx=0x7f6c48005fd0 comp rx=0 tx=0).stop 2023-10-19T12:59:20.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.243+0000 7f6c5f7ff700 1 -- 172.21.15.46:0/4005078180 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c581007a0 msgr2=0x7f6c58198940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:59:20.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.243+0000 7f6c5f7ff700 1 --2- 172.21.15.46:0/4005078180 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c581007a0 0x7f6c58198940 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f6c5400e970 tx=0x7f6c5400ec80 comp rx=0 tx=0).stop 2023-10-19T12:59:20.248 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.243+0000 7f6c5f7ff700 1 -- 172.21.15.46:0/4005078180 shutdown_connections 2023-10-19T12:59:20.248 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.243+0000 7f6c5f7ff700 1 --2- 172.21.15.46:0/4005078180 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6c58102330 0x7f6c5819fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:59:20.248 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.243+0000 7f6c5f7ff700 1 --2- 172.21.15.46:0/4005078180 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c581007a0 0x7f6c58198940 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:59:20.248 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.243+0000 7f6c5f7ff700 1 --2- 172.21.15.46:0/4005078180 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f6c440a1480 0x7f6c440a3940 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:59:20.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.243+0000 7f6c5f7ff700 1 --2- 172.21.15.46:0/4005078180 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c58101990 0x7f6c58198e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:59:20.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.243+0000 7f6c5f7ff700 1 -- 172.21.15.46:0/4005078180 >> 172.21.15.46:0/4005078180 conn(0x7f6c580fbcf0 msgr2=0x7f6c58072a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:59:20.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.244+0000 7f6c5f7ff700 1 -- 172.21.15.46:0/4005078180 shutdown_connections 2023-10-19T12:59:20.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.244+0000 7f6c5f7ff700 1 -- 172.21.15.46:0/4005078180 wait complete. 2023-10-19T12:59:20.266 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-19T12:59:20.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:59:20 smithi046 ceph-mon[98509]: pgmap v828: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 6.0 MiB/s wr, 668 op/s 2023-10-19T12:59:20.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:59:20 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/3921702777' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-19T12:59:20.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:59:20 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/707071628' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-19T12:59:20.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:59:20 smithi046 ceph-mon[98509]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-19T12:59:20.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.478+0000 7f90c21ff700 1 -- 172.21.15.46:0/1021434309 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f90bc101220 msgr2=0x7f90bc107ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:59:20.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.478+0000 7f90c21ff700 1 --2- 172.21.15.46:0/1021434309 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f90bc101220 0x7f90bc107ad0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f90b400f4c0 tx=0x7f90b400f7d0 comp rx=0 tx=0).stop 2023-10-19T12:59:20.481 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.478+0000 7f90c21ff700 1 -- 172.21.15.46:0/1021434309 shutdown_connections 2023-10-19T12:59:20.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.478+0000 7f90c21ff700 1 --2- 172.21.15.46:0/1021434309 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f90bc101220 0x7f90bc107ad0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:59:20.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.478+0000 7f90c21ff700 1 --2- 172.21.15.46:0/1021434309 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f90bc0ff690 0x7f90bc0ffab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:59:20.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.478+0000 7f90c21ff700 1 --2- 172.21.15.46:0/1021434309 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f90bc100880 0x7f90bc100ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:59:20.482 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.478+0000 7f90c21ff700 1 -- 172.21.15.46:0/1021434309 >> 172.21.15.46:0/1021434309 conn(0x7f90bc0fac00 msgr2=0x7f90bc0fd040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:59:20.483 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.478+0000 7f90c21ff700 1 -- 172.21.15.46:0/1021434309 shutdown_connections 2023-10-19T12:59:20.483 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.478+0000 7f90c21ff700 1 -- 172.21.15.46:0/1021434309 wait complete. 2023-10-19T12:59:20.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.479+0000 7f90c21ff700 1 Processor -- start 2023-10-19T12:59:20.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.479+0000 7f90c21ff700 1 -- start start 2023-10-19T12:59:20.485 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.479+0000 7f90c21ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f90bc0ff690 0x7f90bc1944a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:59:20.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.479+0000 7f90c21ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f90bc100880 0x7f90bc1949e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:59:20.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.479+0000 7f90c21ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f90bc101220 0x7f90bc19ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:59:20.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.479+0000 7f90c21ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90bc19bfd0 con 0x7f90bc100880 2023-10-19T12:59:20.486 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.479+0000 7f90c21ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90bc19c110 con 0x7f90bc101220 2023-10-19T12:59:20.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.479+0000 7f90c21ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90bc19c2a0 con 0x7f90bc0ff690 2023-10-19T12:59:20.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.480+0000 7f90bb7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f90bc0ff690 0x7f90bc1944a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:59:20.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.480+0000 7f90baffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f90bc100880 0x7f90bc1949e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:59:20.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.480+0000 7f90bb7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f90bc0ff690 0x7f90bc1944a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:60538/0 (socket says 172.21.15.46:60538) 2023-10-19T12:59:20.487 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.480+0000 7f90bbfff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f90bc101220 0x7f90bc19ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:59:20.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.480+0000 7f90bb7fe700 1 -- 172.21.15.46:0/952696378 learned_addr learned my addr 172.21.15.46:0/952696378 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:59:20.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.480+0000 7f90bb7fe700 1 -- 172.21.15.46:0/952696378 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f90bc101220 msgr2=0x7f90bc19ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:59:20.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.480+0000 7f90bb7fe700 1 --2- 172.21.15.46:0/952696378 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f90bc101220 0x7f90bc19ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:59:20.488 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.480+0000 7f90bb7fe700 1 -- 172.21.15.46:0/952696378 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f90bc100880 msgr2=0x7f90bc1949e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:59:20.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.480+0000 7f90bb7fe700 1 --2- 172.21.15.46:0/952696378 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f90bc100880 0x7f90bc1949e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:59:20.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.480+0000 7f90bb7fe700 1 -- 172.21.15.46:0/952696378 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90b400f170 con 0x7f90bc0ff690 2023-10-19T12:59:20.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.480+0000 7f90baffd700 1 --2- 172.21.15.46:0/952696378 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f90bc100880 0x7f90bc1949e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:59:20.489 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.480+0000 7f90bbfff700 1 --2- 172.21.15.46:0/952696378 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f90bc101220 0x7f90bc19ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T12:59:20.490 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.480+0000 7f90bb7fe700 1 --2- 172.21.15.46:0/952696378 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f90bc0ff690 0x7f90bc1944a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f90ac00e970 tx=0x7f90ac00ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:59:20.490 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.481+0000 7f90b8ff9700 1 -- 172.21.15.46:0/952696378 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90ac009790 con 0x7f90bc0ff690 2023-10-19T12:59:20.490 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.481+0000 7f90c21ff700 1 -- 172.21.15.46:0/952696378 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90bc19c580 con 0x7f90bc0ff690 2023-10-19T12:59:20.490 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.481+0000 7f90b8ff9700 1 -- 172.21.15.46:0/952696378 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f90ac00c7e0 con 0x7f90bc0ff690 2023-10-19T12:59:20.490 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.481+0000 7f90b8ff9700 1 -- 172.21.15.46:0/952696378 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90ac003c70 con 0x7f90bc0ff690 2023-10-19T12:59:20.491 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.481+0000 7f90c21ff700 1 -- 172.21.15.46:0/952696378 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90bc19cae0 con 0x7f90bc0ff690 2023-10-19T12:59:20.491 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.482+0000 7f90c21ff700 1 -- 172.21.15.46:0/952696378 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90bc106b10 con 0x7f90bc0ff690 2023-10-19T12:59:20.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.484+0000 7f90b8ff9700 1 -- 172.21.15.46:0/952696378 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f90ac00cc50 con 0x7f90bc0ff690 2023-10-19T12:59:20.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.485+0000 7f90b8ff9700 1 --2- 172.21.15.46:0/952696378 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f90a40a1480 0x7f90a40a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:59:20.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.486+0000 7f90b8ff9700 1 -- 172.21.15.46:0/952696378 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f90ac014070 con 0x7f90bc0ff690 2023-10-19T12:59:20.492 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.486+0000 7f90baffd700 1 --2- 172.21.15.46:0/952696378 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f90a40a1480 0x7f90a40a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:59:20.493 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.486+0000 7f90baffd700 1 --2- 172.21.15.46:0/952696378 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f90a40a1480 0x7f90a40a3940 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f90b0011490 tx=0x7f90b0009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:59:20.493 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.487+0000 7f90b8ff9700 1 -- 172.21.15.46:0/952696378 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f90ac096660 con 0x7f90bc0ff690 2023-10-19T12:59:20.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:59:20 smithi157 ceph-mon[134109]: pgmap v828: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 6.0 MiB/s wr, 668 op/s 2023-10-19T12:59:20.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:59:20 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/3921702777' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-19T12:59:20.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:59:20 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/707071628' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-19T12:59:20.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:59:20 smithi157 ceph-mon[134109]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-19T12:59:20.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:59:20 smithi195 ceph-mon[134493]: pgmap v828: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 6.0 MiB/s wr, 668 op/s 2023-10-19T12:59:20.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:59:20 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/3921702777' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-19T12:59:20.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:59:20 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/707071628' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-19T12:59:20.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:59:20 smithi195 ceph-mon[134493]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-19T12:59:20.706 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.701+0000 7f90c21ff700 1 -- 172.21.15.46:0/952696378 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f90bc109e90 con 0x7f90bc0ff690 2023-10-19T12:59:20.707 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.702+0000 7f90b8ff9700 1 -- 172.21.15.46:0/952696378 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v92) v1 ==== 103+0+11 (secure 0 0 0) 0x7f90ac003dd0 con 0x7f90bc0ff690 2023-10-19T12:59:20.707 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2023-10-19T12:59:20.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.705+0000 7f90c21ff700 1 -- 172.21.15.46:0/952696378 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f90a40a1480 msgr2=0x7f90a40a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:59:20.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.705+0000 7f90c21ff700 1 --2- 172.21.15.46:0/952696378 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f90a40a1480 0x7f90a40a3940 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f90b0011490 tx=0x7f90b0009260 comp rx=0 tx=0).stop 2023-10-19T12:59:20.709 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.705+0000 7f90c21ff700 1 -- 172.21.15.46:0/952696378 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f90bc0ff690 msgr2=0x7f90bc1944a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:59:20.710 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.705+0000 7f90c21ff700 1 --2- 172.21.15.46:0/952696378 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f90bc0ff690 0x7f90bc1944a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f90ac00e970 tx=0x7f90ac00ec80 comp rx=0 tx=0).stop 2023-10-19T12:59:20.710 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.705+0000 7f90c21ff700 1 -- 172.21.15.46:0/952696378 shutdown_connections 2023-10-19T12:59:20.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.705+0000 7f90c21ff700 1 --2- 172.21.15.46:0/952696378 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f90bc101220 0x7f90bc19ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:59:20.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.705+0000 7f90c21ff700 1 --2- 172.21.15.46:0/952696378 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f90a40a1480 0x7f90a40a3940 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:59:20.711 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.705+0000 7f90c21ff700 1 --2- 172.21.15.46:0/952696378 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f90bc0ff690 0x7f90bc1944a0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:59:20.712 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.705+0000 7f90c21ff700 1 --2- 172.21.15.46:0/952696378 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f90bc100880 0x7f90bc1949e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:59:20.712 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.705+0000 7f90c21ff700 1 -- 172.21.15.46:0/952696378 >> 172.21.15.46:0/952696378 conn(0x7f90bc0fac00 msgr2=0x7f90bc103c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:59:20.712 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.705+0000 7f90c21ff700 1 -- 172.21.15.46:0/952696378 shutdown_connections 2023-10-19T12:59:20.712 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.705+0000 7f90c21ff700 1 -- 172.21.15.46:0/952696378 wait complete. 2023-10-19T12:59:20.728 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2023-10-19T12:59:20.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.934+0000 7fe6457ff700 1 -- 172.21.15.46:0/3093042250 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe6400747d0 msgr2=0x7fe640072c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:59:20.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.934+0000 7fe6457ff700 1 --2- 172.21.15.46:0/3093042250 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe6400747d0 0x7fe640072c20 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe630009990 tx=0x7fe630009ca0 comp rx=0 tx=0).stop 2023-10-19T12:59:20.938 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.934+0000 7fe6457ff700 1 -- 172.21.15.46:0/3093042250 shutdown_connections 2023-10-19T12:59:20.939 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.934+0000 7fe6457ff700 1 --2- 172.21.15.46:0/3093042250 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe640108610 0x7fe64010aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:59:20.939 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.934+0000 7fe6457ff700 1 --2- 172.21.15.46:0/3093042250 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe6400747d0 0x7fe640072c20 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:59:20.939 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.934+0000 7fe6457ff700 1 --2- 172.21.15.46:0/3093042250 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe6400731f0 0x7fe640073670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:59:20.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.934+0000 7fe6457ff700 1 -- 172.21.15.46:0/3093042250 >> 172.21.15.46:0/3093042250 conn(0x7fe6400fbc90 msgr2=0x7fe6400fe0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:59:20.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.935+0000 7fe6457ff700 1 -- 172.21.15.46:0/3093042250 shutdown_connections 2023-10-19T12:59:20.940 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.935+0000 7fe6457ff700 1 -- 172.21.15.46:0/3093042250 wait complete. 2023-10-19T12:59:20.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.935+0000 7fe6457ff700 1 Processor -- start 2023-10-19T12:59:20.942 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.936+0000 7fe6457ff700 1 -- start start 2023-10-19T12:59:20.943 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.936+0000 7fe6457ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe6400731f0 0x7fe6401988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:59:20.943 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.936+0000 7fe6457ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe6400747d0 0x7fe640198e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:59:20.943 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.936+0000 7fe6457ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe640108610 0x7fe64019fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:59:20.943 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.936+0000 7fe6457ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6401a0400 con 0x7fe6400747d0 2023-10-19T12:59:20.943 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.936+0000 7fe6457ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6401a0540 con 0x7fe640108610 2023-10-19T12:59:20.944 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.936+0000 7fe6457ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6401a06d0 con 0x7fe6400731f0 2023-10-19T12:59:20.944 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.936+0000 7fe63effd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe6400731f0 0x7fe6401988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:59:20.944 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.936+0000 7fe63effd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe6400731f0 0x7fe6401988d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:60564/0 (socket says 172.21.15.46:60564) 2023-10-19T12:59:20.944 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.936+0000 7fe63effd700 1 -- 172.21.15.46:0/3451617291 learned_addr learned my addr 172.21.15.46:0/3451617291 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T12:59:20.944 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.936+0000 7fe63e7fc700 1 --2- 172.21.15.46:0/3451617291 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe6400747d0 0x7fe640198e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:59:20.945 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.936+0000 7fe63f7fe700 1 --2- 172.21.15.46:0/3451617291 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe640108610 0x7fe64019fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:59:20.945 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.937+0000 7fe63effd700 1 -- 172.21.15.46:0/3451617291 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe640108610 msgr2=0x7fe64019fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:59:20.945 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.937+0000 7fe63effd700 1 --2- 172.21.15.46:0/3451617291 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe640108610 0x7fe64019fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:59:20.945 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.937+0000 7fe63effd700 1 -- 172.21.15.46:0/3451617291 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe6400747d0 msgr2=0x7fe640198e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:59:20.946 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.937+0000 7fe63effd700 1 --2- 172.21.15.46:0/3451617291 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe6400747d0 0x7fe640198e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:59:20.946 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.937+0000 7fe63effd700 1 -- 172.21.15.46:0/3451617291 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe638009c40 con 0x7fe6400731f0 2023-10-19T12:59:20.946 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.937+0000 7fe63effd700 1 --2- 172.21.15.46:0/3451617291 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe6400731f0 0x7fe6401988d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe63000b680 tx=0x7fe630009580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:59:20.946 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.937+0000 7fe627fff700 1 -- 172.21.15.46:0/3451617291 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63001d070 con 0x7fe6400731f0 2023-10-19T12:59:20.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.937+0000 7fe6457ff700 1 -- 172.21.15.46:0/3451617291 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6300095f0 con 0x7fe6400731f0 2023-10-19T12:59:20.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.937+0000 7fe6457ff700 1 -- 172.21.15.46:0/3451617291 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6401a0c40 con 0x7fe6400731f0 2023-10-19T12:59:20.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.937+0000 7fe627fff700 1 -- 172.21.15.46:0/3451617291 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe630022470 con 0x7fe6400731f0 2023-10-19T12:59:20.947 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.938+0000 7fe627fff700 1 -- 172.21.15.46:0/3451617291 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe630017650 con 0x7fe6400731f0 2023-10-19T12:59:20.948 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.938+0000 7fe6457ff700 1 -- 172.21.15.46:0/3451617291 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe640107420 con 0x7fe6400731f0 2023-10-19T12:59:20.948 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.941+0000 7fe627fff700 1 -- 172.21.15.46:0/3451617291 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fe63000fb10 con 0x7fe6400731f0 2023-10-19T12:59:20.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.942+0000 7fe627fff700 1 --2- 172.21.15.46:0/3451617291 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fe6280a1480 0x7fe6280a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T12:59:20.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.942+0000 7fe627fff700 1 -- 172.21.15.46:0/3451617291 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7fe6300ce460 con 0x7fe6400731f0 2023-10-19T12:59:20.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.942+0000 7fe63e7fc700 1 --2- 172.21.15.46:0/3451617291 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fe6280a1480 0x7fe6280a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T12:59:20.949 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.943+0000 7fe63e7fc700 1 --2- 172.21.15.46:0/3451617291 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fe6280a1480 0x7fe6280a3940 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fe634009c60 tx=0x7fe634009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T12:59:20.950 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:20.944+0000 7fe627fff700 1 -- 172.21.15.46:0/3451617291 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fe63005d100 con 0x7fe6400731f0 2023-10-19T12:59:21.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:21.234+0000 7fe6457ff700 1 -- 172.21.15.46:0/3451617291 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) v1 -- 0x7fe64010e170 con 0x7fe6400731f0 2023-10-19T12:59:21.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:21.243+0000 7fe627fff700 1 -- 172.21.15.46:0/3451617291 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v18) v1 ==== 81+0+733877 (secure 0 0 0) 0x7fe630097720 con 0x7fe6400731f0 2023-10-19T12:59:21.255 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T12:59:21.256 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-10-19T12:59:21.256 INFO:teuthology.orchestra.run.smithi046.stdout: "epoch": 18, 2023-10-19T12:59:21.256 INFO:teuthology.orchestra.run.smithi046.stdout: "active_gid": 14150, 2023-10-19T12:59:21.256 INFO:teuthology.orchestra.run.smithi046.stdout: "active_name": "x", 2023-10-19T12:59:21.257 INFO:teuthology.orchestra.run.smithi046.stdout: "active_addrs": { 2023-10-19T12:59:21.257 INFO:teuthology.orchestra.run.smithi046.stdout: "addrvec": [ 2023-10-19T12:59:21.257 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:21.257 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v2", 2023-10-19T12:59:21.257 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.46:6800", 2023-10-19T12:59:21.257 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 3168073651 2023-10-19T12:59:21.258 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.258 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:21.258 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v1", 2023-10-19T12:59:21.258 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.46:6801", 2023-10-19T12:59:21.258 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 3168073651 2023-10-19T12:59:21.259 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:21.259 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2023-10-19T12:59:21.259 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.259 INFO:teuthology.orchestra.run.smithi046.stdout: "active_addr": "172.21.15.46:6801/3168073651", 2023-10-19T12:59:21.259 INFO:teuthology.orchestra.run.smithi046.stdout: "active_change": "2023-10-19T12:34:26.552234+0000", 2023-10-19T12:59:21.260 INFO:teuthology.orchestra.run.smithi046.stdout: "active_mgr_features": 4540138322906710015, 2023-10-19T12:59:21.260 INFO:teuthology.orchestra.run.smithi046.stdout: "available": true, 2023-10-19T12:59:21.260 INFO:teuthology.orchestra.run.smithi046.stdout: "standbys": [ 2023-10-19T12:59:21.260 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:21.260 INFO:teuthology.orchestra.run.smithi046.stdout: "gid": 24109, 2023-10-19T12:59:21.260 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "z", 2023-10-19T12:59:21.261 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr_features": 4540138322906710015, 2023-10-19T12:59:21.261 INFO:teuthology.orchestra.run.smithi046.stdout: "available_modules": [ 2023-10-19T12:59:21.261 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:21.261 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "alerts", 2023-10-19T12:59:21.261 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:21.262 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:21.262 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:21.262 INFO:teuthology.orchestra.run.smithi046.stdout: "interval": { 2023-10-19T12:59:21.262 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "interval", 2023-10-19T12:59:21.262 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2023-10-19T12:59:21.263 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.263 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.263 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "60", 2023-10-19T12:59:21.263 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.263 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.263 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.264 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "How frequently to reexamine health status", 2023-10-19T12:59:21.264 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.264 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.264 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.264 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.265 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:21.265 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:21.265 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.265 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.265 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.266 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:21.266 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.266 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.266 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:21.266 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:21.266 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:21.267 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:21.267 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:21.267 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:21.267 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:21.267 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:21.268 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.268 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.268 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.268 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.268 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.268 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:21.269 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:21.269 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:21.269 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.269 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.269 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:21.270 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.270 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.270 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.270 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.270 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.271 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.271 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.271 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.271 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:21.271 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:21.271 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.272 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.272 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.272 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:21.272 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.272 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.273 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:21.273 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:21.273 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:21.273 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:21.273 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:21.273 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:21.274 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:21.274 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:21.274 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.274 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.274 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.275 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.275 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.275 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:21.275 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:21.275 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:21.275 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.276 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.276 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:21.276 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.276 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.276 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.277 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.277 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.277 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.277 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.277 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.277 INFO:teuthology.orchestra.run.smithi046.stdout: "smtp_destination": { 2023-10-19T12:59:21.278 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "smtp_destination", 2023-10-19T12:59:21.278 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.278 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.278 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.278 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:21.279 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.279 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.279 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.279 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Email address to send alerts to", 2023-10-19T12:59:21.279 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.280 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.280 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.280 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.280 INFO:teuthology.orchestra.run.smithi046.stdout: "smtp_from_name": { 2023-10-19T12:59:21.280 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "smtp_from_name", 2023-10-19T12:59:21.280 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.281 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.281 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.281 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "Ceph", 2023-10-19T12:59:21.281 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.281 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.282 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.282 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Email From: name", 2023-10-19T12:59:21.282 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.282 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.282 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.283 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.283 INFO:teuthology.orchestra.run.smithi046.stdout: "smtp_host": { 2023-10-19T12:59:21.283 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "smtp_host", 2023-10-19T12:59:21.283 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.283 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.283 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.284 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:21.284 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.284 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.284 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.284 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "SMTP server", 2023-10-19T12:59:21.285 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.285 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.285 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.285 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.285 INFO:teuthology.orchestra.run.smithi046.stdout: "smtp_password": { 2023-10-19T12:59:21.286 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "smtp_password", 2023-10-19T12:59:21.286 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.286 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.286 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.286 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:21.286 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.287 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.287 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.287 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Password to authenticate with", 2023-10-19T12:59:21.287 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.287 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.288 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.288 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.288 INFO:teuthology.orchestra.run.smithi046.stdout: "smtp_port": { 2023-10-19T12:59:21.288 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "smtp_port", 2023-10-19T12:59:21.288 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:21.289 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.289 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.289 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "465", 2023-10-19T12:59:21.289 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.289 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.289 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.290 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "SMTP port", 2023-10-19T12:59:21.290 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.290 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.290 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.290 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.291 INFO:teuthology.orchestra.run.smithi046.stdout: "smtp_sender": { 2023-10-19T12:59:21.291 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "smtp_sender", 2023-10-19T12:59:21.291 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.291 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.291 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.292 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:21.292 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.292 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.292 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.292 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "SMTP envelope sender", 2023-10-19T12:59:21.293 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.293 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.293 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.293 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.293 INFO:teuthology.orchestra.run.smithi046.stdout: "smtp_ssl": { 2023-10-19T12:59:21.294 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "smtp_ssl", 2023-10-19T12:59:21.294 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:21.294 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.294 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.294 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:21.295 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.295 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.295 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.295 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Use SSL to connect to SMTP server", 2023-10-19T12:59:21.295 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.295 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.296 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.296 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.296 INFO:teuthology.orchestra.run.smithi046.stdout: "smtp_user": { 2023-10-19T12:59:21.296 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "smtp_user", 2023-10-19T12:59:21.296 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.297 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.297 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.297 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:21.297 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.297 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.297 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.298 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "User to authenticate as", 2023-10-19T12:59:21.298 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.298 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.298 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.298 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:21.299 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:21.299 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.299 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:21.299 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "balancer", 2023-10-19T12:59:21.299 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:21.300 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:21.300 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:21.300 INFO:teuthology.orchestra.run.smithi046.stdout: "active": { 2023-10-19T12:59:21.300 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "active", 2023-10-19T12:59:21.300 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:21.300 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.301 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.301 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:21.301 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.301 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.301 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.302 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "automatically balance PGs across cluster", 2023-10-19T12:59:21.302 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.302 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.302 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.302 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.302 INFO:teuthology.orchestra.run.smithi046.stdout: "begin_time": { 2023-10-19T12:59:21.303 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "begin_time", 2023-10-19T12:59:21.303 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.303 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.303 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.303 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0000", 2023-10-19T12:59:21.304 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.304 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.304 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.304 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "beginning time of day to automatically balance", 2023-10-19T12:59:21.304 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-19T12:59:21.305 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.305 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.305 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.305 INFO:teuthology.orchestra.run.smithi046.stdout: "begin_weekday": { 2023-10-19T12:59:21.305 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "begin_weekday", 2023-10-19T12:59:21.305 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "uint", 2023-10-19T12:59:21.306 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.306 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.306 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2023-10-19T12:59:21.306 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "0", 2023-10-19T12:59:21.306 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "6", 2023-10-19T12:59:21.307 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.307 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-10-19T12:59:21.307 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-10-19T12:59:21.307 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.307 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.307 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.308 INFO:teuthology.orchestra.run.smithi046.stdout: "crush_compat_max_iterations": { 2023-10-19T12:59:21.308 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "crush_compat_max_iterations", 2023-10-19T12:59:21.308 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "uint", 2023-10-19T12:59:21.308 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.308 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.309 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "25", 2023-10-19T12:59:21.309 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "1", 2023-10-19T12:59:21.309 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "250", 2023-10-19T12:59:21.309 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.309 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-10-19T12:59:21.310 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.310 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.310 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.310 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.310 INFO:teuthology.orchestra.run.smithi046.stdout: "crush_compat_metrics": { 2023-10-19T12:59:21.310 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "crush_compat_metrics", 2023-10-19T12:59:21.311 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.311 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.311 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.311 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "pgs,objects,bytes", 2023-10-19T12:59:21.311 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.312 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.312 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.312 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-10-19T12:59:21.312 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-10-19T12:59:21.312 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.313 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.313 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.313 INFO:teuthology.orchestra.run.smithi046.stdout: "crush_compat_step": { 2023-10-19T12:59:21.313 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "crush_compat_step", 2023-10-19T12:59:21.313 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "float", 2023-10-19T12:59:21.313 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.314 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.314 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0.5", 2023-10-19T12:59:21.314 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "0.001", 2023-10-19T12:59:21.314 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "0.999", 2023-10-19T12:59:21.315 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.315 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "aggressiveness of optimization", 2023-10-19T12:59:21.315 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-10-19T12:59:21.315 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.315 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.315 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.316 INFO:teuthology.orchestra.run.smithi046.stdout: "end_time": { 2023-10-19T12:59:21.316 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "end_time", 2023-10-19T12:59:21.316 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.316 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.316 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.317 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "2359", 2023-10-19T12:59:21.317 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.317 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.317 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.317 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "ending time of day to automatically balance", 2023-10-19T12:59:21.317 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-19T12:59:21.318 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.318 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.318 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.318 INFO:teuthology.orchestra.run.smithi046.stdout: "end_weekday": { 2023-10-19T12:59:21.318 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "end_weekday", 2023-10-19T12:59:21.319 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "uint", 2023-10-19T12:59:21.319 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.319 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.319 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2023-10-19T12:59:21.319 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "0", 2023-10-19T12:59:21.320 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "6", 2023-10-19T12:59:21.320 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.320 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-10-19T12:59:21.320 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-10-19T12:59:21.320 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.320 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.321 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.321 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:21.321 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:21.321 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.321 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.322 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.322 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:21.322 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.322 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.322 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:21.323 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:21.323 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:21.323 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:21.323 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:21.323 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:21.323 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:21.324 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:21.324 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.324 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.324 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.324 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.325 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.325 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:21.325 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:21.325 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:21.325 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.326 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.326 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:21.326 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.326 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.326 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.327 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.327 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.327 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.327 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.327 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.328 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:21.328 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:21.328 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.328 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.328 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.328 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:21.329 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.329 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.329 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:21.329 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:21.329 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:21.330 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:21.330 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:21.330 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:21.330 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:21.330 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:21.330 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.331 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.331 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.331 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.331 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.331 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:21.332 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:21.332 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:21.332 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.332 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.332 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:21.332 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.333 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.333 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.333 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.333 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.333 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.334 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.334 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.334 INFO:teuthology.orchestra.run.smithi046.stdout: "min_score": { 2023-10-19T12:59:21.334 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "min_score", 2023-10-19T12:59:21.334 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "float", 2023-10-19T12:59:21.335 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.335 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.335 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2023-10-19T12:59:21.335 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.335 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.335 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.336 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-10-19T12:59:21.336 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.336 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.336 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.336 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.337 INFO:teuthology.orchestra.run.smithi046.stdout: "mode": { 2023-10-19T12:59:21.337 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "mode", 2023-10-19T12:59:21.337 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.337 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.337 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.338 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "upmap", 2023-10-19T12:59:21.338 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.338 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.338 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:21.339 INFO:teuthology.orchestra.run.smithi046.stdout: "crush-compat", 2023-10-19T12:59:21.339 INFO:teuthology.orchestra.run.smithi046.stdout: "none", 2023-10-19T12:59:21.339 INFO:teuthology.orchestra.run.smithi046.stdout: "upmap" 2023-10-19T12:59:21.339 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:21.339 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Balancer mode", 2023-10-19T12:59:21.339 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.340 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.340 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.340 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.340 INFO:teuthology.orchestra.run.smithi046.stdout: "pool_ids": { 2023-10-19T12:59:21.340 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "pool_ids", 2023-10-19T12:59:21.341 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.341 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.341 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.341 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:21.341 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.342 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.342 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.342 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-10-19T12:59:21.342 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.342 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.342 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.343 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.343 INFO:teuthology.orchestra.run.smithi046.stdout: "sleep_interval": { 2023-10-19T12:59:21.343 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sleep_interval", 2023-10-19T12:59:21.343 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2023-10-19T12:59:21.343 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.344 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.344 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "60", 2023-10-19T12:59:21.344 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.344 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.344 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.345 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-10-19T12:59:21.345 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.345 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.345 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.345 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.345 INFO:teuthology.orchestra.run.smithi046.stdout: "upmap_max_deviation": { 2023-10-19T12:59:21.346 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "upmap_max_deviation", 2023-10-19T12:59:21.346 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:21.346 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.346 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.346 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "5", 2023-10-19T12:59:21.347 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "1", 2023-10-19T12:59:21.347 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.347 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.347 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "deviation below which no optimization is attempted", 2023-10-19T12:59:21.347 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-10-19T12:59:21.348 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.348 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.348 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.348 INFO:teuthology.orchestra.run.smithi046.stdout: "upmap_max_optimizations": { 2023-10-19T12:59:21.348 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "upmap_max_optimizations", 2023-10-19T12:59:21.349 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "uint", 2023-10-19T12:59:21.349 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.349 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.349 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "10", 2023-10-19T12:59:21.349 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.349 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.350 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.350 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-10-19T12:59:21.350 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.350 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.350 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.351 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:21.351 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:21.351 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.351 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:21.351 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "cephadm", 2023-10-19T12:59:21.351 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:21.352 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:21.352 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:21.352 INFO:teuthology.orchestra.run.smithi046.stdout: "agent_down_multiplier": { 2023-10-19T12:59:21.352 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "agent_down_multiplier", 2023-10-19T12:59:21.352 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "float", 2023-10-19T12:59:21.352 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.353 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.353 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "3.0", 2023-10-19T12:59:21.353 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.353 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.353 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.354 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-10-19T12:59:21.354 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.354 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.354 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.354 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.355 INFO:teuthology.orchestra.run.smithi046.stdout: "agent_refresh_rate": { 2023-10-19T12:59:21.355 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "agent_refresh_rate", 2023-10-19T12:59:21.355 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2023-10-19T12:59:21.355 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.355 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.356 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "20", 2023-10-19T12:59:21.356 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.356 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.356 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.356 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-10-19T12:59:21.357 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.357 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.357 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.357 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.357 INFO:teuthology.orchestra.run.smithi046.stdout: "agent_starting_port": { 2023-10-19T12:59:21.357 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "agent_starting_port", 2023-10-19T12:59:21.358 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:21.358 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.358 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.358 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "4721", 2023-10-19T12:59:21.358 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.359 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.359 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.359 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-10-19T12:59:21.359 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.359 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.360 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.360 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.360 INFO:teuthology.orchestra.run.smithi046.stdout: "allow_ptrace": { 2023-10-19T12:59:21.360 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "allow_ptrace", 2023-10-19T12:59:21.360 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:21.361 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.361 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.361 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:21.361 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.361 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.362 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.362 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-10-19T12:59:21.362 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-10-19T12:59:21.362 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.362 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.363 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.363 INFO:teuthology.orchestra.run.smithi046.stdout: "autotune_interval": { 2023-10-19T12:59:21.363 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "autotune_interval", 2023-10-19T12:59:21.363 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2023-10-19T12:59:21.363 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.363 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.364 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "600", 2023-10-19T12:59:21.364 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.364 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.364 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.364 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "how frequently to autotune daemon memory", 2023-10-19T12:59:21.365 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.365 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.365 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.365 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.365 INFO:teuthology.orchestra.run.smithi046.stdout: "autotune_memory_target_ratio": { 2023-10-19T12:59:21.366 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "autotune_memory_target_ratio", 2023-10-19T12:59:21.366 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "float", 2023-10-19T12:59:21.366 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.366 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.366 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0.7", 2023-10-19T12:59:21.367 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.367 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.367 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.367 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-10-19T12:59:21.367 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.367 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.368 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.368 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.368 INFO:teuthology.orchestra.run.smithi046.stdout: "cephadm_log_destination": { 2023-10-19T12:59:21.368 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "cephadm_log_destination", 2023-10-19T12:59:21.368 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.369 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.369 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.369 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:21.369 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.369 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.369 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:21.370 INFO:teuthology.orchestra.run.smithi046.stdout: "file", 2023-10-19T12:59:21.370 INFO:teuthology.orchestra.run.smithi046.stdout: "file,syslog", 2023-10-19T12:59:21.370 INFO:teuthology.orchestra.run.smithi046.stdout: "syslog" 2023-10-19T12:59:21.370 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:21.370 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Destination for cephadm command's persistent logging", 2023-10-19T12:59:21.371 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.371 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.371 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.371 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.371 INFO:teuthology.orchestra.run.smithi046.stdout: "cgroups_split": { 2023-10-19T12:59:21.372 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "cgroups_split", 2023-10-19T12:59:21.372 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:21.372 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.372 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.372 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:21.372 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.373 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.373 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.373 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-10-19T12:59:21.373 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.373 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.374 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.374 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.374 INFO:teuthology.orchestra.run.smithi046.stdout: "config_checks_enabled": { 2023-10-19T12:59:21.374 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "config_checks_enabled", 2023-10-19T12:59:21.374 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:21.374 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.375 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.375 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:21.375 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.375 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.375 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.376 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-10-19T12:59:21.376 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.376 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.376 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.376 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.376 INFO:teuthology.orchestra.run.smithi046.stdout: "config_dashboard": { 2023-10-19T12:59:21.377 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "config_dashboard", 2023-10-19T12:59:21.377 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:21.377 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.377 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.377 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:21.378 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.378 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.378 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.378 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-10-19T12:59:21.378 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.379 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.379 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.379 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.379 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_alertmanager": { 2023-10-19T12:59:21.379 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_alertmanager", 2023-10-19T12:59:21.379 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.380 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.380 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.380 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-10-19T12:59:21.380 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.380 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.381 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.381 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Prometheus container image", 2023-10-19T12:59:21.381 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.381 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.381 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.382 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.382 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_base": { 2023-10-19T12:59:21.382 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_base", 2023-10-19T12:59:21.382 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.382 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.383 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.383 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/ceph/ceph", 2023-10-19T12:59:21.383 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.383 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.383 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.383 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Container image name, without the tag", 2023-10-19T12:59:21.384 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.384 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.384 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.384 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.384 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_elasticsearch": { 2023-10-19T12:59:21.385 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_elasticsearch", 2023-10-19T12:59:21.385 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.385 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.385 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.385 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2023-10-19T12:59:21.386 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.386 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.386 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.386 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "elasticsearch container image", 2023-10-19T12:59:21.386 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.387 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.387 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.387 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.387 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_grafana": { 2023-10-19T12:59:21.387 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_grafana", 2023-10-19T12:59:21.388 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.388 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.388 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.388 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-10-19T12:59:21.388 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.388 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.389 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.389 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Prometheus container image", 2023-10-19T12:59:21.389 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.389 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.389 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.390 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.390 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_haproxy": { 2023-10-19T12:59:21.390 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_haproxy", 2023-10-19T12:59:21.390 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.390 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.391 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.391 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-10-19T12:59:21.391 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.391 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.391 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.392 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "HAproxy container image", 2023-10-19T12:59:21.392 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.392 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.392 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.392 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.393 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_jaeger_agent": { 2023-10-19T12:59:21.393 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_jaeger_agent", 2023-10-19T12:59:21.393 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.393 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.393 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.394 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2023-10-19T12:59:21.394 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.394 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.394 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.394 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Jaeger agent container image", 2023-10-19T12:59:21.394 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.395 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.395 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.395 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.395 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_jaeger_collector": { 2023-10-19T12:59:21.395 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_jaeger_collector", 2023-10-19T12:59:21.396 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.396 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.396 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.396 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2023-10-19T12:59:21.396 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.397 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.397 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.397 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Jaeger collector container image", 2023-10-19T12:59:21.397 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.397 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.397 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.398 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.398 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_jaeger_query": { 2023-10-19T12:59:21.398 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_jaeger_query", 2023-10-19T12:59:21.398 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.398 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.399 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.399 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2023-10-19T12:59:21.399 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.399 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.399 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.399 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Jaeger query container image", 2023-10-19T12:59:21.400 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.400 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.400 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.400 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.400 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_keepalived": { 2023-10-19T12:59:21.401 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_keepalived", 2023-10-19T12:59:21.401 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.401 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.401 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.401 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2023-10-19T12:59:21.401 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.402 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.402 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.402 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Keepalived container image", 2023-10-19T12:59:21.402 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.402 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.403 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.403 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.403 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_loki": { 2023-10-19T12:59:21.403 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_loki", 2023-10-19T12:59:21.403 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.403 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.404 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.404 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-10-19T12:59:21.404 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.404 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.404 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.405 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Loki container image", 2023-10-19T12:59:21.405 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.405 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.405 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.405 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.405 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_node_exporter": { 2023-10-19T12:59:21.406 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_node_exporter", 2023-10-19T12:59:21.406 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.406 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.406 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.406 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-10-19T12:59:21.407 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.407 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.407 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.407 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Prometheus container image", 2023-10-19T12:59:21.407 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.408 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.408 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.408 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.408 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_nvmeof": { 2023-10-19T12:59:21.408 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_nvmeof", 2023-10-19T12:59:21.409 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.409 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.409 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.409 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/ceph/nvmeof:0.0.3", 2023-10-19T12:59:21.409 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.409 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.410 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.410 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Nvme-of container image", 2023-10-19T12:59:21.410 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.410 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.410 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.411 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.411 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_prometheus": { 2023-10-19T12:59:21.411 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_prometheus", 2023-10-19T12:59:21.411 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.411 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.412 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.412 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-10-19T12:59:21.412 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.412 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.412 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.412 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Prometheus container image", 2023-10-19T12:59:21.413 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.413 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.413 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.413 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.413 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_promtail": { 2023-10-19T12:59:21.414 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_promtail", 2023-10-19T12:59:21.414 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.414 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.414 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.414 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-10-19T12:59:21.414 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.415 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.415 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.415 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Promtail container image", 2023-10-19T12:59:21.415 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.415 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.416 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.416 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.416 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_snmp_gateway": { 2023-10-19T12:59:21.416 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_snmp_gateway", 2023-10-19T12:59:21.416 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.417 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.417 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.417 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-10-19T12:59:21.417 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.417 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.417 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.418 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "SNMP Gateway container image", 2023-10-19T12:59:21.418 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.418 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.418 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.418 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.419 INFO:teuthology.orchestra.run.smithi046.stdout: "container_init": { 2023-10-19T12:59:21.419 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_init", 2023-10-19T12:59:21.419 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:21.419 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.419 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.419 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:21.420 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.420 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.420 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.420 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Run podman/docker with `--init`", 2023-10-19T12:59:21.420 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.421 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.421 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.421 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.421 INFO:teuthology.orchestra.run.smithi046.stdout: "daemon_cache_timeout": { 2023-10-19T12:59:21.421 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "daemon_cache_timeout", 2023-10-19T12:59:21.421 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2023-10-19T12:59:21.422 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.422 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.422 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "600", 2023-10-19T12:59:21.422 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.422 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.422 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.423 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-10-19T12:59:21.423 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.423 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.423 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.424 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.424 INFO:teuthology.orchestra.run.smithi046.stdout: "default_cephadm_command_timeout": { 2023-10-19T12:59:21.424 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "default_cephadm_command_timeout", 2023-10-19T12:59:21.424 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2023-10-19T12:59:21.424 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.424 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.425 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "900", 2023-10-19T12:59:21.425 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.425 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.425 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.425 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-10-19T12:59:21.425 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.426 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.426 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.426 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.426 INFO:teuthology.orchestra.run.smithi046.stdout: "default_registry": { 2023-10-19T12:59:21.426 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "default_registry", 2023-10-19T12:59:21.427 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.427 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.427 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.427 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "docker.io", 2023-10-19T12:59:21.427 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.428 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.428 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.428 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-10-19T12:59:21.428 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.428 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.429 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.429 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.429 INFO:teuthology.orchestra.run.smithi046.stdout: "device_cache_timeout": { 2023-10-19T12:59:21.429 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "device_cache_timeout", 2023-10-19T12:59:21.429 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2023-10-19T12:59:21.429 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.430 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.430 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "1800", 2023-10-19T12:59:21.430 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.430 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.430 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.431 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "seconds to cache device inventory", 2023-10-19T12:59:21.431 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.431 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.431 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.431 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.432 INFO:teuthology.orchestra.run.smithi046.stdout: "device_enhanced_scan": { 2023-10-19T12:59:21.432 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "device_enhanced_scan", 2023-10-19T12:59:21.432 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:21.432 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.432 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.432 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:21.433 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.433 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.433 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.433 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Use libstoragemgmt during device scans", 2023-10-19T12:59:21.433 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.434 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.434 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.434 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.434 INFO:teuthology.orchestra.run.smithi046.stdout: "facts_cache_timeout": { 2023-10-19T12:59:21.434 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "facts_cache_timeout", 2023-10-19T12:59:21.435 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2023-10-19T12:59:21.435 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.435 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.435 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "60", 2023-10-19T12:59:21.435 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.435 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.436 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.436 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "seconds to cache host facts data", 2023-10-19T12:59:21.436 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.436 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.436 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.437 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.437 INFO:teuthology.orchestra.run.smithi046.stdout: "host_check_interval": { 2023-10-19T12:59:21.437 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "host_check_interval", 2023-10-19T12:59:21.437 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2023-10-19T12:59:21.437 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.438 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.438 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "600", 2023-10-19T12:59:21.438 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.438 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.438 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.439 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "how frequently to perform a host check", 2023-10-19T12:59:21.439 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.439 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.439 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.439 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.439 INFO:teuthology.orchestra.run.smithi046.stdout: "inventory_list_all": { 2023-10-19T12:59:21.440 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "inventory_list_all", 2023-10-19T12:59:21.440 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:21.440 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.440 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.440 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:21.441 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.441 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.441 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.441 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2023-10-19T12:59:21.441 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.442 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.442 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.442 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.442 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:21.442 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:21.442 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.443 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.443 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.443 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:21.443 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.443 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.444 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:21.444 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:21.444 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:21.444 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:21.444 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:21.445 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:21.445 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:21.445 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:21.445 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.445 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.446 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.446 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.446 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.446 INFO:teuthology.orchestra.run.smithi046.stdout: "log_refresh_metadata": { 2023-10-19T12:59:21.446 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_refresh_metadata", 2023-10-19T12:59:21.447 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:21.447 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.447 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.447 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:21.447 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.448 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.448 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.448 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-10-19T12:59:21.448 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.448 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.448 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.449 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.449 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:21.449 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:21.449 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:21.449 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.450 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.450 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:21.450 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.450 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.450 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.451 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-10-19T12:59:21.451 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.451 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.451 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.451 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.451 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:21.452 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:21.452 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.452 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.452 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.452 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:21.453 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.453 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.453 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:21.453 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:21.453 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:21.454 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:21.454 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:21.454 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:21.454 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:21.454 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:21.455 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.455 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.455 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.455 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.455 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.455 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:21.456 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:21.456 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:21.456 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.456 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.456 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:21.457 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.457 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.457 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.457 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.457 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.458 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.458 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.458 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.458 INFO:teuthology.orchestra.run.smithi046.stdout: "manage_etc_ceph_ceph_conf": { 2023-10-19T12:59:21.458 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-10-19T12:59:21.459 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:21.459 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.459 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.459 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:21.459 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.460 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.460 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.460 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-10-19T12:59:21.460 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.460 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.460 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.461 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.461 INFO:teuthology.orchestra.run.smithi046.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-10-19T12:59:21.461 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-10-19T12:59:21.461 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.461 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.462 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.462 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "*", 2023-10-19T12:59:21.462 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.462 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.462 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.462 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-10-19T12:59:21.463 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.463 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.463 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.463 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.463 INFO:teuthology.orchestra.run.smithi046.stdout: "max_count_per_host": { 2023-10-19T12:59:21.464 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "max_count_per_host", 2023-10-19T12:59:21.464 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:21.464 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.464 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.464 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "10", 2023-10-19T12:59:21.464 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.465 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.465 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.465 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "max number of daemons per service per host", 2023-10-19T12:59:21.465 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.465 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.465 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.466 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.466 INFO:teuthology.orchestra.run.smithi046.stdout: "max_osd_draining_count": { 2023-10-19T12:59:21.466 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "max_osd_draining_count", 2023-10-19T12:59:21.466 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:21.466 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.467 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.467 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "10", 2023-10-19T12:59:21.467 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.467 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.467 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.468 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-10-19T12:59:21.468 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.468 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.468 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.468 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.468 INFO:teuthology.orchestra.run.smithi046.stdout: "migration_current": { 2023-10-19T12:59:21.469 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "migration_current", 2023-10-19T12:59:21.469 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:21.469 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.469 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.469 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:21.469 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.470 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.470 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.470 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "internal - do not modify", 2023-10-19T12:59:21.470 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.471 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.471 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.471 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.471 INFO:teuthology.orchestra.run.smithi046.stdout: "mode": { 2023-10-19T12:59:21.471 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "mode", 2023-10-19T12:59:21.471 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.472 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.472 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.472 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "root", 2023-10-19T12:59:21.472 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.472 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.473 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:21.473 INFO:teuthology.orchestra.run.smithi046.stdout: "cephadm-package", 2023-10-19T12:59:21.473 INFO:teuthology.orchestra.run.smithi046.stdout: "root" 2023-10-19T12:59:21.473 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:21.473 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "mode for remote execution of cephadm", 2023-10-19T12:59:21.473 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.474 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.474 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.474 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.474 INFO:teuthology.orchestra.run.smithi046.stdout: "prometheus_alerts_path": { 2023-10-19T12:59:21.474 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "prometheus_alerts_path", 2023-10-19T12:59:21.475 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.475 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.475 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.475 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-10-19T12:59:21.475 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.476 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.476 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.476 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-10-19T12:59:21.476 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.476 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.476 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.477 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.477 INFO:teuthology.orchestra.run.smithi046.stdout: "registry_insecure": { 2023-10-19T12:59:21.477 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "registry_insecure", 2023-10-19T12:59:21.477 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:21.477 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.477 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.478 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:21.478 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.478 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.478 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.479 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-10-19T12:59:21.479 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.479 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.479 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.479 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.479 INFO:teuthology.orchestra.run.smithi046.stdout: "registry_password": { 2023-10-19T12:59:21.480 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "registry_password", 2023-10-19T12:59:21.480 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.480 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.480 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.480 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:21.481 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.481 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.481 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.481 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-10-19T12:59:21.481 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.481 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.482 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.482 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.482 INFO:teuthology.orchestra.run.smithi046.stdout: "registry_url": { 2023-10-19T12:59:21.482 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "registry_url", 2023-10-19T12:59:21.482 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.483 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.483 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.483 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:21.483 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.483 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.484 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.484 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-10-19T12:59:21.484 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.484 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.484 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.484 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.485 INFO:teuthology.orchestra.run.smithi046.stdout: "registry_username": { 2023-10-19T12:59:21.485 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "registry_username", 2023-10-19T12:59:21.485 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.485 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.485 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.486 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:21.486 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.486 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.486 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.486 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-10-19T12:59:21.487 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.487 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.487 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.487 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.487 INFO:teuthology.orchestra.run.smithi046.stdout: "secure_monitoring_stack": { 2023-10-19T12:59:21.488 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "secure_monitoring_stack", 2023-10-19T12:59:21.488 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:21.488 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.488 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.488 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:21.489 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.489 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.489 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.489 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2023-10-19T12:59:21.489 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.490 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.490 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.490 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.490 INFO:teuthology.orchestra.run.smithi046.stdout: "service_discovery_port": { 2023-10-19T12:59:21.490 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "service_discovery_port", 2023-10-19T12:59:21.491 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:21.491 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.491 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.491 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "8765", 2023-10-19T12:59:21.491 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.491 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.492 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.492 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "cephadm service discovery port", 2023-10-19T12:59:21.492 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.492 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.492 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.493 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.493 INFO:teuthology.orchestra.run.smithi046.stdout: "ssh_config_file": { 2023-10-19T12:59:21.493 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ssh_config_file", 2023-10-19T12:59:21.493 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.493 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.494 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.494 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:21.494 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.494 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.494 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.494 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-10-19T12:59:21.495 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.495 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.495 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.495 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.495 INFO:teuthology.orchestra.run.smithi046.stdout: "use_agent": { 2023-10-19T12:59:21.496 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "use_agent", 2023-10-19T12:59:21.496 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:21.496 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.496 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.496 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:21.496 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.497 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.497 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.497 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-10-19T12:59:21.497 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.497 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.498 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.498 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.498 INFO:teuthology.orchestra.run.smithi046.stdout: "use_repo_digest": { 2023-10-19T12:59:21.498 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "use_repo_digest", 2023-10-19T12:59:21.498 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:21.499 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.499 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.499 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:21.499 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.499 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.500 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.500 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-10-19T12:59:21.500 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.500 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.500 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.500 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.501 INFO:teuthology.orchestra.run.smithi046.stdout: "warn_on_failed_host_check": { 2023-10-19T12:59:21.501 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "warn_on_failed_host_check", 2023-10-19T12:59:21.501 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:21.501 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.501 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.501 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:21.502 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.502 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.502 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.502 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "raise a health warning if the host check fails", 2023-10-19T12:59:21.502 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.503 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.503 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.503 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.503 INFO:teuthology.orchestra.run.smithi046.stdout: "warn_on_stray_daemons": { 2023-10-19T12:59:21.503 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "warn_on_stray_daemons", 2023-10-19T12:59:21.503 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:21.504 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.504 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.504 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:21.504 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.504 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.504 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.505 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-10-19T12:59:21.505 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.505 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.505 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.505 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.505 INFO:teuthology.orchestra.run.smithi046.stdout: "warn_on_stray_hosts": { 2023-10-19T12:59:21.506 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "warn_on_stray_hosts", 2023-10-19T12:59:21.506 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:21.506 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.506 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.506 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:21.507 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.507 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.507 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.507 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-10-19T12:59:21.507 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.508 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.508 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.508 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:21.508 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:21.508 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.508 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:21.509 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "crash", 2023-10-19T12:59:21.509 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:21.509 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:21.509 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:21.509 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:21.510 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:21.510 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.510 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.510 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.510 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:21.511 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.511 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.511 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:21.511 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:21.511 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:21.512 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:21.512 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:21.512 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:21.512 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:21.512 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:21.512 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.513 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.513 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.513 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.513 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.513 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:21.514 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:21.514 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:21.514 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.514 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.514 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:21.515 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.515 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.515 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.515 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.515 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.515 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.516 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.516 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.516 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:21.516 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:21.516 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.516 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.517 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.517 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:21.517 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.517 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.517 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:21.518 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:21.518 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:21.518 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:21.518 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:21.518 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:21.519 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:21.519 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:21.519 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.519 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.519 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.519 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.520 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.520 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:21.520 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:21.520 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:21.520 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.521 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.521 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:21.521 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.521 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.521 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.522 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.522 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.522 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.522 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.522 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.523 INFO:teuthology.orchestra.run.smithi046.stdout: "retain_interval": { 2023-10-19T12:59:21.523 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "retain_interval", 2023-10-19T12:59:21.523 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2023-10-19T12:59:21.523 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.523 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.524 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "31536000", 2023-10-19T12:59:21.524 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.524 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.524 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.524 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "how long to retain crashes before pruning them", 2023-10-19T12:59:21.524 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.525 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.525 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.525 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.525 INFO:teuthology.orchestra.run.smithi046.stdout: "warn_recent_interval": { 2023-10-19T12:59:21.525 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "warn_recent_interval", 2023-10-19T12:59:21.526 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2023-10-19T12:59:21.526 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.526 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.526 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "1209600", 2023-10-19T12:59:21.526 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.527 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.527 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.527 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "time interval in which to warn about recent crashes", 2023-10-19T12:59:21.527 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.527 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.529 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.529 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:21.529 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:21.530 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.530 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:21.530 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "dashboard", 2023-10-19T12:59:21.530 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:21.530 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:21.530 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:21.531 INFO:teuthology.orchestra.run.smithi046.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-10-19T12:59:21.531 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-10-19T12:59:21.531 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:21.531 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.531 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.532 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "10", 2023-10-19T12:59:21.532 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.532 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.532 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.532 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.533 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.533 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.533 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.533 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.533 INFO:teuthology.orchestra.run.smithi046.stdout: "ALERTMANAGER_API_HOST": { 2023-10-19T12:59:21.533 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ALERTMANAGER_API_HOST", 2023-10-19T12:59:21.534 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.534 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.534 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.534 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:21.534 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.535 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.535 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.535 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.535 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.535 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.536 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.536 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.536 INFO:teuthology.orchestra.run.smithi046.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-10-19T12:59:21.536 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-10-19T12:59:21.536 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:21.537 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.537 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.537 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:21.537 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.537 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.537 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.538 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.538 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.538 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.538 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.538 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.539 INFO:teuthology.orchestra.run.smithi046.stdout: "AUDIT_API_ENABLED": { 2023-10-19T12:59:21.539 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "AUDIT_API_ENABLED", 2023-10-19T12:59:21.539 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:21.539 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.539 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.539 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:21.540 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.540 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.540 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.540 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.540 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.541 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.541 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.541 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.541 INFO:teuthology.orchestra.run.smithi046.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-10-19T12:59:21.541 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-10-19T12:59:21.542 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:21.542 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.542 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.542 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:21.542 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.543 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.543 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.543 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.543 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.543 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.544 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.544 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.544 INFO:teuthology.orchestra.run.smithi046.stdout: "ENABLE_BROWSABLE_API": { 2023-10-19T12:59:21.544 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ENABLE_BROWSABLE_API", 2023-10-19T12:59:21.544 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:21.545 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.545 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.545 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:21.545 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.545 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.546 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.546 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.546 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.546 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.546 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.547 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.547 INFO:teuthology.orchestra.run.smithi046.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-10-19T12:59:21.547 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-10-19T12:59:21.547 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:21.547 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.548 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.548 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:21.548 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.548 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.548 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.548 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.549 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.549 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.549 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.549 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.549 INFO:teuthology.orchestra.run.smithi046.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-10-19T12:59:21.550 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-10-19T12:59:21.550 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:21.550 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.550 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.550 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:21.551 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.551 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.551 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.551 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.551 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.551 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.552 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.552 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.552 INFO:teuthology.orchestra.run.smithi046.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-10-19T12:59:21.552 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-10-19T12:59:21.552 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:21.553 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.553 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.553 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:21.553 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.553 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.553 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.554 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.554 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.554 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.554 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.554 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.554 INFO:teuthology.orchestra.run.smithi046.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-10-19T12:59:21.555 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-10-19T12:59:21.555 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:21.555 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.555 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.555 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:21.556 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.556 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.556 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.556 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.556 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.557 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.557 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.557 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.557 INFO:teuthology.orchestra.run.smithi046.stdout: "FEATURE_TOGGLE_NFS": { 2023-10-19T12:59:21.557 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-10-19T12:59:21.558 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:21.558 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.558 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.558 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:21.558 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.559 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.559 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.559 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.559 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.559 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.559 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.560 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.560 INFO:teuthology.orchestra.run.smithi046.stdout: "FEATURE_TOGGLE_RBD": { 2023-10-19T12:59:21.560 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-10-19T12:59:21.560 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:21.560 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.561 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.561 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:21.561 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.561 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.561 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.562 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.562 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.562 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.562 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.562 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.563 INFO:teuthology.orchestra.run.smithi046.stdout: "FEATURE_TOGGLE_RGW": { 2023-10-19T12:59:21.563 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-10-19T12:59:21.563 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:21.563 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.563 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.564 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:21.564 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.564 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.564 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.564 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.564 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.565 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.565 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.565 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.565 INFO:teuthology.orchestra.run.smithi046.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-10-19T12:59:21.565 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-10-19T12:59:21.566 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.566 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.566 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.566 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:21.566 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.567 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.567 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.567 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.567 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.567 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.567 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.568 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.568 INFO:teuthology.orchestra.run.smithi046.stdout: "GRAFANA_API_PASSWORD": { 2023-10-19T12:59:21.568 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "GRAFANA_API_PASSWORD", 2023-10-19T12:59:21.568 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.568 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.569 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.569 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "admin", 2023-10-19T12:59:21.569 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.569 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.569 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.569 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.570 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.570 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.570 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.570 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.570 INFO:teuthology.orchestra.run.smithi046.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-10-19T12:59:21.571 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-10-19T12:59:21.571 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:21.571 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.571 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.571 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:21.572 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.572 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.572 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.572 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.572 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.573 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.573 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.573 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.573 INFO:teuthology.orchestra.run.smithi046.stdout: "GRAFANA_API_URL": { 2023-10-19T12:59:21.573 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "GRAFANA_API_URL", 2023-10-19T12:59:21.574 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.574 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.574 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.574 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:21.574 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.574 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.575 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.575 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.575 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.575 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.576 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.576 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.576 INFO:teuthology.orchestra.run.smithi046.stdout: "GRAFANA_API_USERNAME": { 2023-10-19T12:59:21.576 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "GRAFANA_API_USERNAME", 2023-10-19T12:59:21.576 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.577 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.577 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.577 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "admin", 2023-10-19T12:59:21.577 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.577 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.578 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.578 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.578 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.578 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.578 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.579 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.579 INFO:teuthology.orchestra.run.smithi046.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-10-19T12:59:21.579 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-10-19T12:59:21.579 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.579 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.579 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.580 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:21.580 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.580 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.580 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.580 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.581 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.581 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.581 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.581 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.581 INFO:teuthology.orchestra.run.smithi046.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-10-19T12:59:21.581 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-10-19T12:59:21.582 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:21.582 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.582 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.582 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:21.582 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.583 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.583 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.583 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.583 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.583 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.584 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.584 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.584 INFO:teuthology.orchestra.run.smithi046.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-10-19T12:59:21.584 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-10-19T12:59:21.584 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:21.584 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.585 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.585 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:21.585 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.585 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.585 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.586 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.586 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.586 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.586 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.586 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.586 INFO:teuthology.orchestra.run.smithi046.stdout: "ISSUE_TRACKER_API_KEY": { 2023-10-19T12:59:21.587 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-10-19T12:59:21.587 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.587 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.587 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.588 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:21.588 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.588 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.588 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.588 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.588 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.589 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.589 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.589 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.589 INFO:teuthology.orchestra.run.smithi046.stdout: "PROMETHEUS_API_HOST": { 2023-10-19T12:59:21.589 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PROMETHEUS_API_HOST", 2023-10-19T12:59:21.590 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.590 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.590 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.590 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:21.590 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.591 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.591 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.591 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.591 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.591 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.591 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.592 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.592 INFO:teuthology.orchestra.run.smithi046.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-10-19T12:59:21.592 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-10-19T12:59:21.592 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:21.592 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.593 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.593 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:21.593 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.593 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.593 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.594 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.594 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.594 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.594 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.594 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.595 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-10-19T12:59:21.595 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-10-19T12:59:21.595 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:21.595 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.595 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.595 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:21.596 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.596 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.596 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.596 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.596 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.597 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.597 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.597 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.597 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-10-19T12:59:21.597 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-10-19T12:59:21.598 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:21.598 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.598 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.598 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:21.598 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.599 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.599 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.599 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.599 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.599 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.600 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.600 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.600 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-10-19T12:59:21.600 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-10-19T12:59:21.600 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:21.601 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.601 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.601 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:21.601 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.601 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.601 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.602 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.602 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.602 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.602 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.602 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.603 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-10-19T12:59:21.603 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-10-19T12:59:21.603 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:21.603 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.603 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.604 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:21.604 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.604 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.604 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.604 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.605 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.605 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.605 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.605 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.605 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-10-19T12:59:21.605 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-10-19T12:59:21.606 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:21.606 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.606 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.606 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:21.606 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.607 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.607 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.607 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.607 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.607 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.608 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.608 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.608 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-10-19T12:59:21.608 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-10-19T12:59:21.608 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:21.609 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.609 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.609 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:21.609 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.609 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.610 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.610 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.610 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.610 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.610 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.610 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.611 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-10-19T12:59:21.611 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-10-19T12:59:21.611 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:21.611 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.611 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.612 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:21.612 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.612 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.612 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.612 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.613 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.613 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.613 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.613 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.613 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_ENABLED": { 2023-10-19T12:59:21.614 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_ENABLED", 2023-10-19T12:59:21.614 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:21.614 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.614 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.614 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:21.615 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.615 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.615 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.615 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.615 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.615 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.616 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.616 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.616 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-10-19T12:59:21.616 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-10-19T12:59:21.616 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.617 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.617 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.617 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-10-19T12:59:21.617 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.617 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.618 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.618 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.618 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.618 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.618 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.618 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.619 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-10-19T12:59:21.619 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-10-19T12:59:21.619 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:21.619 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.619 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.620 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "10", 2023-10-19T12:59:21.620 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.620 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.620 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.620 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.620 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.621 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.621 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.621 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.621 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-10-19T12:59:21.621 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-10-19T12:59:21.622 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:21.622 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.622 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.622 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "8", 2023-10-19T12:59:21.622 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.623 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.623 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.623 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.623 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.623 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.624 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.624 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.624 INFO:teuthology.orchestra.run.smithi046.stdout: "REST_REQUESTS_TIMEOUT": { 2023-10-19T12:59:21.624 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-10-19T12:59:21.624 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:21.624 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.625 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.625 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "45", 2023-10-19T12:59:21.625 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.625 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.625 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.626 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.626 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.626 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.626 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.626 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.627 INFO:teuthology.orchestra.run.smithi046.stdout: "RGW_API_ACCESS_KEY": { 2023-10-19T12:59:21.627 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "RGW_API_ACCESS_KEY", 2023-10-19T12:59:21.627 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.627 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.627 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.628 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:21.628 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.628 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.628 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.628 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.629 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.629 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.629 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.629 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.629 INFO:teuthology.orchestra.run.smithi046.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-10-19T12:59:21.630 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-10-19T12:59:21.630 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.630 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.630 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.630 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "admin", 2023-10-19T12:59:21.631 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.631 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.631 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.631 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.631 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.631 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.632 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.632 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.632 INFO:teuthology.orchestra.run.smithi046.stdout: "RGW_API_SECRET_KEY": { 2023-10-19T12:59:21.632 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "RGW_API_SECRET_KEY", 2023-10-19T12:59:21.632 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.633 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.633 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.633 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:21.633 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.633 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.634 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.634 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.634 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.634 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.634 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.634 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.635 INFO:teuthology.orchestra.run.smithi046.stdout: "RGW_API_SSL_VERIFY": { 2023-10-19T12:59:21.635 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "RGW_API_SSL_VERIFY", 2023-10-19T12:59:21.635 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:21.635 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.635 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.636 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:21.636 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.636 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.636 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.636 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.637 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.637 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.637 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.637 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.637 INFO:teuthology.orchestra.run.smithi046.stdout: "UNSAFE_TLS_v1_2": { 2023-10-19T12:59:21.637 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "UNSAFE_TLS_v1_2", 2023-10-19T12:59:21.638 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:21.638 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.638 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.638 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:21.638 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.639 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.639 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.639 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.639 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.639 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.640 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.640 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.640 INFO:teuthology.orchestra.run.smithi046.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-10-19T12:59:21.640 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-10-19T12:59:21.640 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:21.640 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.641 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.641 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2023-10-19T12:59:21.641 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.641 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.641 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.642 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.642 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.642 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.642 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.642 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.643 INFO:teuthology.orchestra.run.smithi046.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-10-19T12:59:21.643 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-10-19T12:59:21.643 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:21.643 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.643 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.643 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "10", 2023-10-19T12:59:21.644 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.644 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.644 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.644 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.644 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.645 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.645 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.645 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.645 INFO:teuthology.orchestra.run.smithi046.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-10-19T12:59:21.645 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-10-19T12:59:21.646 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:21.646 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.646 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.646 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "5", 2023-10-19T12:59:21.646 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.647 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.647 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.647 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.647 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.647 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.647 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.648 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.648 INFO:teuthology.orchestra.run.smithi046.stdout: "cross_origin_url": { 2023-10-19T12:59:21.648 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "cross_origin_url", 2023-10-19T12:59:21.648 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.648 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.649 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.649 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:21.649 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.649 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.649 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.649 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.650 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.650 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.650 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.650 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.650 INFO:teuthology.orchestra.run.smithi046.stdout: "crt_file": { 2023-10-19T12:59:21.651 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "crt_file", 2023-10-19T12:59:21.651 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.651 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.651 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.651 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:21.652 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.652 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.652 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.652 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.652 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.653 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.653 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.653 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.653 INFO:teuthology.orchestra.run.smithi046.stdout: "debug": { 2023-10-19T12:59:21.653 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "debug", 2023-10-19T12:59:21.653 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:21.654 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.654 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.654 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:21.654 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.654 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.655 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.655 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Enable/disable debug options", 2023-10-19T12:59:21.655 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.655 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.655 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.655 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.656 INFO:teuthology.orchestra.run.smithi046.stdout: "jwt_token_ttl": { 2023-10-19T12:59:21.656 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "jwt_token_ttl", 2023-10-19T12:59:21.656 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:21.656 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.656 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.657 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "28800", 2023-10-19T12:59:21.657 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.657 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.657 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.657 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.658 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.658 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.658 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.658 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.658 INFO:teuthology.orchestra.run.smithi046.stdout: "key_file": { 2023-10-19T12:59:21.658 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "key_file", 2023-10-19T12:59:21.659 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.659 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.659 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.659 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:21.659 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.660 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.660 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.660 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.660 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.660 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.661 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.661 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.661 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:21.661 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:21.661 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.662 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.662 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.662 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:21.662 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.662 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.663 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:21.663 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:21.663 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:21.663 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:21.663 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:21.664 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:21.664 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:21.664 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:21.664 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.664 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.665 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.665 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.665 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.665 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:21.665 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:21.665 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:21.666 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.666 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.666 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:21.666 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.666 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.667 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.667 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.667 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.667 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.667 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.667 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.668 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:21.668 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:21.668 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.668 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.668 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.669 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:21.669 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.669 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.669 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:21.669 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:21.669 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:21.670 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:21.670 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:21.670 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:21.670 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:21.670 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:21.671 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.671 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.671 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.671 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.671 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.672 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:21.672 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:21.672 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:21.672 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.672 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.672 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:21.673 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.673 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.673 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.673 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.673 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.674 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.674 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.674 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.674 INFO:teuthology.orchestra.run.smithi046.stdout: "motd": { 2023-10-19T12:59:21.674 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "motd", 2023-10-19T12:59:21.674 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.675 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.675 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.675 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:21.675 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.675 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.676 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.676 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "The message of the day", 2023-10-19T12:59:21.676 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.676 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.676 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.677 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.677 INFO:teuthology.orchestra.run.smithi046.stdout: "redirect_resolve_ip_addr": { 2023-10-19T12:59:21.677 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "redirect_resolve_ip_addr", 2023-10-19T12:59:21.677 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:21.677 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.677 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.678 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:21.678 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.678 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.678 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.678 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.679 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.679 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.679 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.679 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.679 INFO:teuthology.orchestra.run.smithi046.stdout: "server_addr": { 2023-10-19T12:59:21.679 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "server_addr", 2023-10-19T12:59:21.680 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.680 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.680 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.680 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "::", 2023-10-19T12:59:21.680 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.680 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.681 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.681 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.681 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.681 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.681 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.682 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.682 INFO:teuthology.orchestra.run.smithi046.stdout: "server_port": { 2023-10-19T12:59:21.682 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "server_port", 2023-10-19T12:59:21.682 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:21.682 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.683 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.683 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "8080", 2023-10-19T12:59:21.683 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.683 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.683 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.683 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.684 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.684 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.684 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.684 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.684 INFO:teuthology.orchestra.run.smithi046.stdout: "ssl": { 2023-10-19T12:59:21.685 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ssl", 2023-10-19T12:59:21.685 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:21.685 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.685 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.685 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:21.685 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.686 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.686 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.686 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.686 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.686 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.687 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.687 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.687 INFO:teuthology.orchestra.run.smithi046.stdout: "ssl_server_port": { 2023-10-19T12:59:21.687 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ssl_server_port", 2023-10-19T12:59:21.687 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:21.688 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.688 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.688 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "8443", 2023-10-19T12:59:21.688 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.688 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.688 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.689 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.689 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.689 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.689 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.689 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.690 INFO:teuthology.orchestra.run.smithi046.stdout: "standby_behaviour": { 2023-10-19T12:59:21.690 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "standby_behaviour", 2023-10-19T12:59:21.690 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.690 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.690 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.691 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "redirect", 2023-10-19T12:59:21.691 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.691 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.691 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:21.691 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:21.691 INFO:teuthology.orchestra.run.smithi046.stdout: "redirect" 2023-10-19T12:59:21.692 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:21.692 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.692 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.692 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.692 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.693 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.693 INFO:teuthology.orchestra.run.smithi046.stdout: "standby_error_status_code": { 2023-10-19T12:59:21.693 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "standby_error_status_code", 2023-10-19T12:59:21.693 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:21.693 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.693 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.694 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "500", 2023-10-19T12:59:21.694 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "400", 2023-10-19T12:59:21.694 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "599", 2023-10-19T12:59:21.694 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.694 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.695 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.695 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.695 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.695 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.695 INFO:teuthology.orchestra.run.smithi046.stdout: "url_prefix": { 2023-10-19T12:59:21.696 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "url_prefix", 2023-10-19T12:59:21.696 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.696 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.696 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.696 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:21.696 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.697 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.697 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.697 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.697 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.697 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.698 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.698 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:21.698 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:21.698 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.698 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:21.699 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "devicehealth", 2023-10-19T12:59:21.699 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:21.699 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:21.699 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:21.699 INFO:teuthology.orchestra.run.smithi046.stdout: "enable_monitoring": { 2023-10-19T12:59:21.700 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "enable_monitoring", 2023-10-19T12:59:21.700 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:21.700 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.700 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.700 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:21.701 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.701 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.701 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.701 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "monitor device health metrics", 2023-10-19T12:59:21.701 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.702 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.702 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.702 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.702 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:21.702 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:21.703 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.703 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.703 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.703 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:21.703 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.703 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.704 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:21.704 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:21.704 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:21.704 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:21.704 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:21.705 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:21.705 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:21.705 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:21.705 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.705 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.705 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.706 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.706 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.706 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:21.706 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:21.706 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:21.707 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.707 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.707 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:21.707 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.707 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.707 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.708 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.708 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.708 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.708 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.708 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.708 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:21.709 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:21.709 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.709 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.709 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.709 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:21.710 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.710 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.710 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:21.710 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:21.710 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:21.710 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:21.711 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:21.711 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:21.711 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:21.711 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:21.711 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.712 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.712 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.712 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.712 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.712 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:21.712 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:21.713 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:21.713 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.713 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.713 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:21.713 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.714 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.714 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.714 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.714 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.714 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.715 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.715 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.715 INFO:teuthology.orchestra.run.smithi046.stdout: "mark_out_threshold": { 2023-10-19T12:59:21.715 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "mark_out_threshold", 2023-10-19T12:59:21.715 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2023-10-19T12:59:21.715 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.716 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.716 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "2419200", 2023-10-19T12:59:21.716 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.716 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.716 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.717 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-10-19T12:59:21.717 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.717 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.717 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.717 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.717 INFO:teuthology.orchestra.run.smithi046.stdout: "pool_name": { 2023-10-19T12:59:21.718 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "pool_name", 2023-10-19T12:59:21.718 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.718 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.718 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.718 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "device_health_metrics", 2023-10-19T12:59:21.719 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.719 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.719 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.719 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "name of pool in which to store device health metrics", 2023-10-19T12:59:21.719 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.720 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.720 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.720 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.720 INFO:teuthology.orchestra.run.smithi046.stdout: "retention_period": { 2023-10-19T12:59:21.720 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "retention_period", 2023-10-19T12:59:21.721 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2023-10-19T12:59:21.721 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.721 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.721 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "15552000", 2023-10-19T12:59:21.721 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.721 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.722 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.722 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "how long to retain device health metrics", 2023-10-19T12:59:21.722 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.722 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.722 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.723 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.723 INFO:teuthology.orchestra.run.smithi046.stdout: "scrape_frequency": { 2023-10-19T12:59:21.723 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "scrape_frequency", 2023-10-19T12:59:21.723 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2023-10-19T12:59:21.723 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.723 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.724 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "86400", 2023-10-19T12:59:21.724 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.724 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.724 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.724 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "how frequently to scrape device health metrics", 2023-10-19T12:59:21.725 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.725 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.725 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.725 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.725 INFO:teuthology.orchestra.run.smithi046.stdout: "self_heal": { 2023-10-19T12:59:21.725 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "self_heal", 2023-10-19T12:59:21.726 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:21.726 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.726 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.726 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:21.726 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.727 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.727 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.727 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-10-19T12:59:21.727 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.727 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.728 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.729 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.729 INFO:teuthology.orchestra.run.smithi046.stdout: "sleep_interval": { 2023-10-19T12:59:21.729 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sleep_interval", 2023-10-19T12:59:21.730 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2023-10-19T12:59:21.730 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.730 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.730 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "600", 2023-10-19T12:59:21.730 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.731 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.731 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.731 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "how frequently to wake up and check device health", 2023-10-19T12:59:21.731 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.731 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.732 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.732 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.732 INFO:teuthology.orchestra.run.smithi046.stdout: "warn_threshold": { 2023-10-19T12:59:21.732 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "warn_threshold", 2023-10-19T12:59:21.732 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2023-10-19T12:59:21.732 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.733 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.733 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "7257600", 2023-10-19T12:59:21.733 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.733 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.733 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.734 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-10-19T12:59:21.734 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.734 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.734 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.734 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:21.735 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:21.735 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.735 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:21.735 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "diskprediction_local", 2023-10-19T12:59:21.735 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:21.736 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:21.736 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:21.736 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:21.736 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:21.736 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.737 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.737 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.737 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:21.737 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.737 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.737 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:21.738 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:21.738 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:21.738 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:21.738 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:21.739 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:21.739 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:21.739 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:21.739 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.739 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.739 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.740 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.740 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.740 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:21.740 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:21.740 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:21.741 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.741 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.741 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:21.741 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.741 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.742 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.742 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.742 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.742 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.742 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.743 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.743 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:21.743 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:21.743 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.743 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.744 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.744 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:21.744 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.744 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.744 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:21.745 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:21.745 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:21.745 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:21.745 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:21.745 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:21.746 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:21.746 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:21.746 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.746 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.746 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.747 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.747 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.747 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:21.747 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:21.747 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:21.747 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.748 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.748 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:21.748 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.748 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.748 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.749 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.749 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.749 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.749 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.749 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.749 INFO:teuthology.orchestra.run.smithi046.stdout: "predict_interval": { 2023-10-19T12:59:21.750 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "predict_interval", 2023-10-19T12:59:21.750 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.750 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.750 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.750 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "86400", 2023-10-19T12:59:21.751 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.751 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.751 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.751 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.751 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.752 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.752 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.752 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.752 INFO:teuthology.orchestra.run.smithi046.stdout: "predictor_model": { 2023-10-19T12:59:21.752 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "predictor_model", 2023-10-19T12:59:21.752 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.753 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.753 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.753 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "prophetstor", 2023-10-19T12:59:21.753 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.753 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.754 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.754 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.754 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.754 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.754 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.754 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.755 INFO:teuthology.orchestra.run.smithi046.stdout: "sleep_interval": { 2023-10-19T12:59:21.755 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sleep_interval", 2023-10-19T12:59:21.755 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.755 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.755 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.756 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "600", 2023-10-19T12:59:21.756 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.756 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.756 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.756 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.757 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.757 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.757 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.757 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:21.757 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:21.757 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.758 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:21.758 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "influx", 2023-10-19T12:59:21.758 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": false, 2023-10-19T12:59:21.758 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "influxdb python module not found", 2023-10-19T12:59:21.759 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:21.759 INFO:teuthology.orchestra.run.smithi046.stdout: "batch_size": { 2023-10-19T12:59:21.759 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "batch_size", 2023-10-19T12:59:21.759 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:21.759 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.759 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.760 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "5000", 2023-10-19T12:59:21.760 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.760 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.760 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.760 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-10-19T12:59:21.761 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.761 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.761 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.761 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.761 INFO:teuthology.orchestra.run.smithi046.stdout: "database": { 2023-10-19T12:59:21.761 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "database", 2023-10-19T12:59:21.762 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.762 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.762 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.762 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "ceph", 2023-10-19T12:59:21.762 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.763 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.763 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.763 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-10-19T12:59:21.763 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.763 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.764 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.764 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.764 INFO:teuthology.orchestra.run.smithi046.stdout: "hostname": { 2023-10-19T12:59:21.764 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "hostname", 2023-10-19T12:59:21.764 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.765 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.765 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.765 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:21.765 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.765 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.765 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.766 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "InfluxDB server hostname", 2023-10-19T12:59:21.766 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.766 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.766 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.766 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.767 INFO:teuthology.orchestra.run.smithi046.stdout: "interval": { 2023-10-19T12:59:21.767 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "interval", 2023-10-19T12:59:21.767 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2023-10-19T12:59:21.767 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.767 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.768 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "30", 2023-10-19T12:59:21.768 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "5", 2023-10-19T12:59:21.768 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.768 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.768 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-10-19T12:59:21.768 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.769 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.769 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.769 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.769 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:21.769 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:21.770 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.770 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.770 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.770 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:21.771 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.771 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.771 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:21.771 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:21.771 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:21.771 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:21.772 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:21.772 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:21.772 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:21.772 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:21.772 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.773 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.773 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.773 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.773 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.773 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:21.774 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:21.774 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:21.774 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.774 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.774 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:21.774 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.775 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.775 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.775 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.775 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.775 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.776 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.776 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.776 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:21.776 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:21.776 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.777 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.777 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.777 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:21.777 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.777 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.778 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:21.778 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:21.778 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:21.778 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:21.778 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:21.779 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:21.779 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:21.779 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:21.779 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.779 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.779 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.780 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.780 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.780 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:21.780 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:21.780 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:21.781 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.781 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.781 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:21.781 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.781 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.781 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.782 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.782 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.782 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.782 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.782 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.782 INFO:teuthology.orchestra.run.smithi046.stdout: "password": { 2023-10-19T12:59:21.783 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "password", 2023-10-19T12:59:21.783 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.783 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.783 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.783 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:21.784 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.784 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.784 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.784 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "password of InfluxDB server user", 2023-10-19T12:59:21.784 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.784 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.785 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.785 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.785 INFO:teuthology.orchestra.run.smithi046.stdout: "port": { 2023-10-19T12:59:21.785 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "port", 2023-10-19T12:59:21.785 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:21.786 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.786 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.786 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "8086", 2023-10-19T12:59:21.786 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.786 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.787 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.787 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "InfluxDB server port", 2023-10-19T12:59:21.787 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.787 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.787 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.787 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.788 INFO:teuthology.orchestra.run.smithi046.stdout: "ssl": { 2023-10-19T12:59:21.788 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ssl", 2023-10-19T12:59:21.788 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.788 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.788 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.789 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "false", 2023-10-19T12:59:21.789 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.789 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.789 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.789 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-10-19T12:59:21.790 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.790 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.790 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.790 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.790 INFO:teuthology.orchestra.run.smithi046.stdout: "threads": { 2023-10-19T12:59:21.791 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "threads", 2023-10-19T12:59:21.791 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:21.791 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.791 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.791 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "5", 2023-10-19T12:59:21.791 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "1", 2023-10-19T12:59:21.792 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "32", 2023-10-19T12:59:21.792 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.792 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-10-19T12:59:21.792 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.792 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.793 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.793 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.793 INFO:teuthology.orchestra.run.smithi046.stdout: "username": { 2023-10-19T12:59:21.793 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "username", 2023-10-19T12:59:21.793 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.794 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.794 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.794 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:21.794 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.794 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.794 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.795 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "username of InfluxDB server user", 2023-10-19T12:59:21.795 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.795 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.795 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.795 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.796 INFO:teuthology.orchestra.run.smithi046.stdout: "verify_ssl": { 2023-10-19T12:59:21.796 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "verify_ssl", 2023-10-19T12:59:21.796 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.796 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.796 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.797 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "true", 2023-10-19T12:59:21.797 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.797 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.797 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.797 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-10-19T12:59:21.798 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.798 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.798 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.798 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:21.798 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:21.799 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.799 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:21.799 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "insights", 2023-10-19T12:59:21.799 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:21.799 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:21.799 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:21.800 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:21.800 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:21.800 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.800 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.800 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.801 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:21.801 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.801 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.801 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:21.801 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:21.801 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:21.802 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:21.802 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:21.802 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:21.802 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:21.802 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:21.803 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.803 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.803 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.803 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.803 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.804 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:21.804 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:21.804 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:21.804 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.804 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.805 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:21.805 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.805 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.805 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.805 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.805 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.806 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.806 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.806 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.806 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:21.807 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:21.807 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.807 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.807 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.807 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:21.807 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.808 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.808 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:21.808 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:21.808 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:21.808 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:21.809 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:21.809 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:21.809 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:21.809 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:21.809 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.810 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.810 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.810 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.810 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.810 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:21.811 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:21.811 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:21.811 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.811 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.811 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:21.811 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.812 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.812 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.812 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.812 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.812 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.813 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.813 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:21.813 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:21.813 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.813 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:21.813 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "iostat", 2023-10-19T12:59:21.814 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:21.814 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:21.814 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:21.814 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:21.814 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:21.815 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.815 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.815 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.815 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:21.815 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.815 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.816 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:21.816 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:21.816 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:21.816 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:21.816 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:21.817 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:21.817 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:21.817 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:21.817 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.817 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.817 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.818 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.818 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.818 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:21.818 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:21.818 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:21.819 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.819 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.819 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:21.819 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.819 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.820 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.820 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.820 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.820 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.820 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.821 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.821 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:21.821 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:21.821 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.821 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.822 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.822 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:21.822 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.822 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.822 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:21.822 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:21.823 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:21.823 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:21.823 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:21.823 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:21.823 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:21.824 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:21.824 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.824 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.824 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.824 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.824 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.825 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:21.825 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:21.825 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:21.825 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.825 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.825 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:21.826 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.826 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.826 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.826 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.826 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.827 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.827 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.827 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:21.827 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:21.827 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.827 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:21.828 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "k8sevents", 2023-10-19T12:59:21.828 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:21.828 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:21.828 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:21.828 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph_event_retention_days": { 2023-10-19T12:59:21.829 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ceph_event_retention_days", 2023-10-19T12:59:21.829 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:21.829 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.829 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.829 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "7", 2023-10-19T12:59:21.830 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.830 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.830 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.830 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Days to hold ceph event information within local cache", 2023-10-19T12:59:21.830 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.830 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.831 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.831 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.831 INFO:teuthology.orchestra.run.smithi046.stdout: "config_check_secs": { 2023-10-19T12:59:21.831 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "config_check_secs", 2023-10-19T12:59:21.831 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:21.832 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.832 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.832 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "10", 2023-10-19T12:59:21.832 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "10", 2023-10-19T12:59:21.832 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.833 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.833 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2023-10-19T12:59:21.833 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.833 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.834 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.834 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.834 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:21.834 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:21.834 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.834 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.835 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.835 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:21.835 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.835 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.835 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:21.836 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:21.836 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:21.836 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:21.836 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:21.836 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:21.836 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:21.837 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:21.837 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.837 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.837 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.837 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.838 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.838 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:21.838 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:21.838 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:21.838 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.839 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.839 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:21.839 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.839 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.839 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.840 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.840 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.840 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.840 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.840 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.840 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:21.841 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:21.841 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.841 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.841 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.841 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:21.842 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.842 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.842 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:21.842 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:21.842 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:21.843 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:21.843 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:21.843 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:21.843 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:21.843 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:21.844 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.844 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.844 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.844 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.844 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.845 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:21.845 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:21.845 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:21.845 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.845 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.845 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:21.846 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.846 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.846 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.846 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.846 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.847 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.847 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.847 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:21.847 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:21.847 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.848 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:21.848 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "localpool", 2023-10-19T12:59:21.848 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:21.848 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:21.848 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:21.849 INFO:teuthology.orchestra.run.smithi046.stdout: "failure_domain": { 2023-10-19T12:59:21.849 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "failure_domain", 2023-10-19T12:59:21.849 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.849 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.849 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.849 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "host", 2023-10-19T12:59:21.850 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.850 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.850 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.850 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "failure domain for any created local pool", 2023-10-19T12:59:21.850 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-10-19T12:59:21.851 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.851 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.851 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.851 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:21.851 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:21.852 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.852 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.852 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.852 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:21.852 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.852 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.853 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:21.853 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:21.853 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:21.853 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:21.853 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:21.854 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:21.854 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:21.854 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:21.854 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.854 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.855 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.855 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.855 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.855 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:21.855 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:21.855 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:21.856 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.856 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.856 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:21.856 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.856 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.857 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.857 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.857 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.857 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.857 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.857 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.858 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:21.858 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:21.858 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.858 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.858 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.859 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:21.859 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.859 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.859 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:21.859 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:21.860 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:21.860 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:21.860 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:21.860 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:21.860 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:21.860 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:21.861 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.861 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.861 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.861 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.861 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.862 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:21.862 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:21.862 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:21.862 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.862 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.862 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:21.863 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.863 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.863 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.863 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.863 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.864 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.864 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.864 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.864 INFO:teuthology.orchestra.run.smithi046.stdout: "min_size": { 2023-10-19T12:59:21.864 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "min_size", 2023-10-19T12:59:21.864 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:21.865 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.865 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.865 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:21.865 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.865 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.866 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.866 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "default min_size for any created local pool", 2023-10-19T12:59:21.866 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-10-19T12:59:21.866 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.866 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.867 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.867 INFO:teuthology.orchestra.run.smithi046.stdout: "num_rep": { 2023-10-19T12:59:21.867 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "num_rep", 2023-10-19T12:59:21.867 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:21.867 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.867 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.868 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "3", 2023-10-19T12:59:21.868 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.868 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.868 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.868 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "default replica count for any created local pool", 2023-10-19T12:59:21.869 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.869 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.869 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.869 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.869 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_num": { 2023-10-19T12:59:21.869 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "pg_num", 2023-10-19T12:59:21.870 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:21.870 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.870 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.870 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "128", 2023-10-19T12:59:21.870 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.871 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.871 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.871 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "default pg_num for any created local pool", 2023-10-19T12:59:21.871 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.871 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.872 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.872 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.872 INFO:teuthology.orchestra.run.smithi046.stdout: "prefix": { 2023-10-19T12:59:21.872 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "prefix", 2023-10-19T12:59:21.872 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.873 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.873 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.873 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:21.873 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.873 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.873 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.874 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "name prefix for any created local pool", 2023-10-19T12:59:21.874 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.874 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.874 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.874 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.875 INFO:teuthology.orchestra.run.smithi046.stdout: "subtree": { 2023-10-19T12:59:21.875 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "subtree", 2023-10-19T12:59:21.875 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.875 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.875 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.875 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "rack", 2023-10-19T12:59:21.876 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.876 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.876 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.876 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "CRUSH level for which to create a local pool", 2023-10-19T12:59:21.876 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-10-19T12:59:21.877 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.877 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.877 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:21.877 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:21.877 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.878 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:21.878 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "mds_autoscaler", 2023-10-19T12:59:21.878 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:21.878 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:21.878 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:21.879 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:21.879 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:21.879 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.879 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.879 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.879 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:21.880 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.880 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.880 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:21.880 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:21.880 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:21.881 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:21.881 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:21.881 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:21.881 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:21.881 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:21.882 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.882 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.882 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.882 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.882 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.883 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:21.883 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:21.883 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:21.883 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.883 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.883 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:21.884 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.884 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.884 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.884 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.884 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.885 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.885 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.885 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.885 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:21.885 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:21.885 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.886 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.886 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.886 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:21.886 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.886 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.887 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:21.887 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:21.887 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:21.887 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:21.887 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:21.888 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:21.888 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:21.888 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:21.888 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.888 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.888 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.889 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.889 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.889 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:21.889 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:21.889 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:21.890 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.890 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.890 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:21.890 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.890 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.891 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.891 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.891 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.891 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.891 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.891 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:21.892 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:21.892 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.892 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:21.892 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "mirroring", 2023-10-19T12:59:21.892 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:21.893 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:21.893 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:21.893 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:21.893 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:21.893 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.894 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.894 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.894 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:21.894 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.894 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.895 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:21.895 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:21.895 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:21.895 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:21.895 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:21.895 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:21.896 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:21.896 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:21.896 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.896 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.896 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.897 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.897 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.897 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:21.897 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:21.897 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:21.897 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.898 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.898 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:21.898 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.898 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.898 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.899 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.899 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.899 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.899 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.899 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.900 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:21.900 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:21.900 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.900 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.900 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.900 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:21.901 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.901 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.901 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:21.901 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:21.901 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:21.902 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:21.902 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:21.902 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:21.902 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:21.902 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:21.903 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.903 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.903 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.903 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.903 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.904 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:21.904 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:21.904 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:21.904 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.904 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.905 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:21.905 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.905 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.905 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.905 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.905 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.906 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.906 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.906 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:21.906 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:21.906 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.907 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:21.907 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "nfs", 2023-10-19T12:59:21.907 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:21.907 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:21.907 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:21.907 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:21.908 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:21.908 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.908 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.908 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.908 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:21.908 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.909 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.909 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:21.909 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:21.909 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:21.909 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:21.910 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:21.910 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:21.910 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:21.910 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:21.911 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.911 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.911 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.911 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.911 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.911 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:21.912 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:21.912 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:21.912 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.912 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.912 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:21.913 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.913 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.913 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.913 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.913 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.913 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.914 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.914 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.914 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:21.914 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:21.915 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.915 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.915 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.915 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:21.915 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.916 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.916 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:21.916 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:21.916 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:21.916 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:21.916 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:21.917 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:21.917 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:21.917 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:21.917 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.917 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.918 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.918 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.918 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.918 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:21.918 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:21.919 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:21.919 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.919 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.919 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:21.919 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.919 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.920 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.920 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.920 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.920 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.920 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.921 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:21.921 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:21.921 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.921 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:21.921 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "orchestrator", 2023-10-19T12:59:21.922 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:21.922 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:21.922 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:21.922 INFO:teuthology.orchestra.run.smithi046.stdout: "fail_fs": { 2023-10-19T12:59:21.922 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "fail_fs", 2023-10-19T12:59:21.923 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:21.923 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.923 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.923 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:21.923 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.924 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.924 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.924 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2023-10-19T12:59:21.924 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.924 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.924 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.925 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.925 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:21.925 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:21.925 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.925 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.926 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.926 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:21.926 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.926 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.926 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:21.927 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:21.927 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:21.927 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:21.927 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:21.927 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:21.928 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:21.928 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:21.928 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.928 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.928 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.928 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.929 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.929 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:21.929 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:21.929 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:21.929 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.930 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.930 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:21.930 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.930 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.930 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.931 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.931 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.931 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.931 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.931 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.931 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:21.934 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:21.934 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.934 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.934 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.934 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:21.935 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.935 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.935 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:21.935 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:21.935 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:21.936 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:21.936 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:21.936 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:21.936 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:21.936 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:21.937 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.937 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.937 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.937 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.937 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.937 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:21.938 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:21.938 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:21.938 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.938 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.938 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:21.939 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.939 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.939 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.939 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.939 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.940 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.940 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.940 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.940 INFO:teuthology.orchestra.run.smithi046.stdout: "orchestrator": { 2023-10-19T12:59:21.940 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "orchestrator", 2023-10-19T12:59:21.941 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.941 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.941 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.941 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:21.941 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.941 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.942 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:21.942 INFO:teuthology.orchestra.run.smithi046.stdout: "cephadm", 2023-10-19T12:59:21.942 INFO:teuthology.orchestra.run.smithi046.stdout: "rook", 2023-10-19T12:59:21.942 INFO:teuthology.orchestra.run.smithi046.stdout: "test_orchestrator" 2023-10-19T12:59:21.942 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:21.943 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Orchestrator backend", 2023-10-19T12:59:21.943 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.943 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.943 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.943 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:21.944 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:21.944 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.944 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:21.944 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "osd_perf_query", 2023-10-19T12:59:21.944 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:21.945 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:21.945 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:21.945 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:21.945 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:21.945 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.945 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.946 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.946 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:21.946 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.946 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.946 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:21.947 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:21.947 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:21.947 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:21.947 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:21.947 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:21.948 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:21.948 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:21.948 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.948 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.948 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.949 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.949 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.949 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:21.949 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:21.949 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:21.950 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.950 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.950 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:21.950 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.950 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.950 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.951 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.951 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.951 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.951 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.951 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.952 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:21.952 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:21.952 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.952 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.952 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.952 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:21.953 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.953 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.953 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:21.953 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:21.953 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:21.954 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:21.954 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:21.954 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:21.954 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:21.954 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:21.955 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.955 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.955 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.955 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.955 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.956 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:21.956 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:21.956 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:21.956 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.956 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.957 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:21.957 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.957 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.957 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.957 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.958 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.958 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.958 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.958 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:21.958 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:21.958 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.959 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:21.959 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "osd_support", 2023-10-19T12:59:21.959 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:21.959 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:21.959 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:21.960 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:21.960 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:21.960 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.960 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.960 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.961 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:21.961 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.961 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.961 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:21.961 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:21.961 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:21.962 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:21.962 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:21.962 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:21.962 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:21.962 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:21.963 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.963 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.963 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.963 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.963 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.964 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:21.964 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:21.964 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:21.964 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.964 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.964 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:21.965 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.965 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.965 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.965 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.965 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.966 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.966 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.966 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.966 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:21.966 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:21.966 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.967 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.967 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.967 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:21.967 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.967 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.968 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:21.968 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:21.968 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:21.968 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:21.968 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:21.969 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:21.969 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:21.969 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:21.969 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.969 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.969 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.970 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.970 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.970 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:21.970 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:21.970 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:21.971 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.971 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.971 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:21.971 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.971 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.972 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.972 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.972 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.972 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.972 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.972 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:21.973 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:21.973 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.973 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:21.973 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "pg_autoscaler", 2023-10-19T12:59:21.973 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:21.974 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:21.974 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:21.974 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:21.974 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:21.974 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.975 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.975 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.975 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:21.975 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.975 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.975 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:21.976 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:21.976 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:21.976 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:21.976 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:21.976 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:21.977 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:21.977 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:21.977 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.977 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.977 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.978 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.978 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.978 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:21.978 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:21.978 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:21.979 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.979 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.979 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:21.979 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.979 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.979 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.980 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.980 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.980 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.980 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.980 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.981 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:21.981 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:21.981 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:21.981 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.981 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.981 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:21.982 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.982 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.982 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:21.982 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:21.982 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:21.983 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:21.983 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:21.983 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:21.983 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:21.983 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:21.984 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.984 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.984 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.984 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.984 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.984 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:21.985 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:21.985 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:21.985 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.985 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.985 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:21.986 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.986 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.986 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.986 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.986 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.987 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.987 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.987 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.987 INFO:teuthology.orchestra.run.smithi046.stdout: "sleep_interval": { 2023-10-19T12:59:21.987 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sleep_interval", 2023-10-19T12:59:21.987 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2023-10-19T12:59:21.988 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.988 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.988 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "60", 2023-10-19T12:59:21.988 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.988 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.989 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.989 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.989 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.989 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.989 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.990 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.990 INFO:teuthology.orchestra.run.smithi046.stdout: "threshold": { 2023-10-19T12:59:21.990 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "threshold", 2023-10-19T12:59:21.990 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "float", 2023-10-19T12:59:21.990 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.991 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.991 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "3.0", 2023-10-19T12:59:21.991 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "1.0", 2023-10-19T12:59:21.991 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.991 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.992 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "scaling threshold", 2023-10-19T12:59:21.992 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-10-19T12:59:21.992 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.992 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.992 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:21.993 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:21.993 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.993 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:21.993 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "progress", 2023-10-19T12:59:21.993 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:21.994 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:21.994 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:21.994 INFO:teuthology.orchestra.run.smithi046.stdout: "allow_pg_recovery_event": { 2023-10-19T12:59:21.994 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "allow_pg_recovery_event", 2023-10-19T12:59:21.994 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:21.995 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.995 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:21.995 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:21.995 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.995 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.995 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.996 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "allow the module to show pg recovery progress", 2023-10-19T12:59:21.996 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.996 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.996 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.996 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.997 INFO:teuthology.orchestra.run.smithi046.stdout: "enabled": { 2023-10-19T12:59:21.997 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "enabled", 2023-10-19T12:59:21.997 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:21.997 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:21.997 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:21.998 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:21.998 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:21.998 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:21.998 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:21.998 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:21.999 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:21.999 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:21.999 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:21.999 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:21.999 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:22.000 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:22.000 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.000 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.000 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.000 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:22.001 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.001 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.001 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:22.001 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:22.001 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:22.002 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:22.002 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:22.002 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:22.002 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:22.002 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:22.003 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.003 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.003 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.003 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.003 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.003 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:22.004 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:22.004 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.004 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.004 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.004 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:22.004 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.005 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.005 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.005 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.005 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.005 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.006 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.006 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.006 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:22.006 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:22.006 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.007 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.007 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.007 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:22.007 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.007 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.008 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:22.008 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:22.008 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:22.008 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:22.008 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:22.008 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:22.009 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:22.009 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:22.009 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.009 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.009 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.010 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.010 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.010 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:22.010 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:22.010 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.011 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.011 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.011 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:22.011 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.011 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.012 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.012 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.012 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.012 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.012 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.012 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.013 INFO:teuthology.orchestra.run.smithi046.stdout: "max_completed_events": { 2023-10-19T12:59:22.013 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "max_completed_events", 2023-10-19T12:59:22.013 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:22.013 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.013 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.014 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "50", 2023-10-19T12:59:22.014 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.014 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.014 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.014 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "number of past completed events to remember", 2023-10-19T12:59:22.015 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.015 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.015 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.015 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.015 INFO:teuthology.orchestra.run.smithi046.stdout: "sleep_interval": { 2023-10-19T12:59:22.016 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sleep_interval", 2023-10-19T12:59:22.016 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2023-10-19T12:59:22.016 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.016 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.016 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "5", 2023-10-19T12:59:22.017 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.017 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.017 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.017 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "how long the module is going to sleep", 2023-10-19T12:59:22.017 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.017 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.018 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.018 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:22.018 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:22.018 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.018 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:22.019 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "prometheus", 2023-10-19T12:59:22.019 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:22.019 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:22.019 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:22.019 INFO:teuthology.orchestra.run.smithi046.stdout: "cache": { 2023-10-19T12:59:22.020 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "cache", 2023-10-19T12:59:22.020 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.020 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.020 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.020 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:22.020 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.021 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.021 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.021 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.021 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.021 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.022 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.022 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.022 INFO:teuthology.orchestra.run.smithi046.stdout: "exclude_perf_counters": { 2023-10-19T12:59:22.022 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "exclude_perf_counters", 2023-10-19T12:59:22.022 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.023 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.023 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.023 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:22.023 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.023 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.023 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.024 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Do not include perf-counters in the metrics output", 2023-10-19T12:59:22.024 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2023-10-19T12:59:22.024 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.024 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.024 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.025 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:22.025 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:22.025 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.025 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.025 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.026 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:22.026 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.026 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.026 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:22.026 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:22.027 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:22.027 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:22.027 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:22.027 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:22.027 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:22.028 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:22.028 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.028 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.028 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.028 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.028 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.029 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:22.029 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:22.029 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.029 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.029 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.030 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:22.030 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.030 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.030 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.030 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.031 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.031 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.031 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.031 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.031 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:22.031 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:22.032 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.032 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.032 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.032 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:22.032 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.033 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.033 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:22.033 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:22.033 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:22.033 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:22.033 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:22.034 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:22.034 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:22.034 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:22.034 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.034 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.035 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.035 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.035 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.035 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:22.035 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:22.036 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.036 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.036 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.036 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:22.036 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.036 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.037 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.037 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.037 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.037 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.037 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.038 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.038 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_stats_pools": { 2023-10-19T12:59:22.038 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rbd_stats_pools", 2023-10-19T12:59:22.038 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.038 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.039 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.039 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:22.039 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.039 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.039 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.039 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.040 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.040 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.040 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.040 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.040 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_stats_pools_refresh_interval": { 2023-10-19T12:59:22.041 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-10-19T12:59:22.041 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:22.041 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.041 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.041 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "300", 2023-10-19T12:59:22.042 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.042 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.042 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.042 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.042 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.042 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.043 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.043 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.043 INFO:teuthology.orchestra.run.smithi046.stdout: "scrape_interval": { 2023-10-19T12:59:22.043 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "scrape_interval", 2023-10-19T12:59:22.043 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "float", 2023-10-19T12:59:22.044 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.044 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.044 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "15.0", 2023-10-19T12:59:22.044 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.044 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.045 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.045 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.045 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.045 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.045 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.045 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.046 INFO:teuthology.orchestra.run.smithi046.stdout: "server_addr": { 2023-10-19T12:59:22.046 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "server_addr", 2023-10-19T12:59:22.046 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.046 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.046 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.047 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "::", 2023-10-19T12:59:22.047 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.047 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.047 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.047 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-10-19T12:59:22.048 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.048 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.048 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.048 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.048 INFO:teuthology.orchestra.run.smithi046.stdout: "server_port": { 2023-10-19T12:59:22.049 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "server_port", 2023-10-19T12:59:22.049 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:22.049 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.049 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.049 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "9283", 2023-10-19T12:59:22.049 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.050 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.050 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.050 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-10-19T12:59:22.050 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.050 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.051 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.051 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.051 INFO:teuthology.orchestra.run.smithi046.stdout: "stale_cache_strategy": { 2023-10-19T12:59:22.051 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "stale_cache_strategy", 2023-10-19T12:59:22.051 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.052 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.052 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.052 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "log", 2023-10-19T12:59:22.052 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.052 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.052 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.053 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.053 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.053 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.053 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.053 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.054 INFO:teuthology.orchestra.run.smithi046.stdout: "standby_behaviour": { 2023-10-19T12:59:22.054 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "standby_behaviour", 2023-10-19T12:59:22.054 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.054 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.054 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.055 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "default", 2023-10-19T12:59:22.055 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.055 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.055 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:22.055 INFO:teuthology.orchestra.run.smithi046.stdout: "default", 2023-10-19T12:59:22.056 INFO:teuthology.orchestra.run.smithi046.stdout: "error" 2023-10-19T12:59:22.056 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:22.056 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.056 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.056 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.056 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.057 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.057 INFO:teuthology.orchestra.run.smithi046.stdout: "standby_error_status_code": { 2023-10-19T12:59:22.057 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "standby_error_status_code", 2023-10-19T12:59:22.057 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:22.057 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.058 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.058 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "500", 2023-10-19T12:59:22.058 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "400", 2023-10-19T12:59:22.058 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "599", 2023-10-19T12:59:22.058 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.059 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.059 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.059 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.059 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.059 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:22.059 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:22.060 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.060 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:22.060 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rbd_support", 2023-10-19T12:59:22.060 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:22.060 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:22.061 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:22.061 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:22.061 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:22.061 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.061 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.062 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.062 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:22.062 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.062 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.062 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:22.062 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:22.063 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:22.063 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:22.063 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:22.063 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:22.063 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:22.064 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:22.064 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.064 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.064 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.064 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.065 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.065 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:22.065 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:22.065 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.065 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.066 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.066 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:22.066 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.066 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.066 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.067 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.067 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.067 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.067 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.067 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.067 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:22.068 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:22.068 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.068 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.068 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.068 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:22.069 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.069 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.069 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:22.069 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:22.069 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:22.069 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:22.070 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:22.070 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:22.070 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:22.070 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:22.070 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.071 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.071 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.071 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.071 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.071 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:22.071 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:22.072 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.072 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.072 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.072 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:22.072 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.073 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.073 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.073 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.073 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.073 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.074 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.074 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.074 INFO:teuthology.orchestra.run.smithi046.stdout: "max_concurrent_snap_create": { 2023-10-19T12:59:22.074 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "max_concurrent_snap_create", 2023-10-19T12:59:22.074 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:22.075 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.075 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.075 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "10", 2023-10-19T12:59:22.075 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.075 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.075 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.076 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.076 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.076 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.076 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.076 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.077 INFO:teuthology.orchestra.run.smithi046.stdout: "mirror_snapshot_schedule": { 2023-10-19T12:59:22.077 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "mirror_snapshot_schedule", 2023-10-19T12:59:22.077 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.077 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.077 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.078 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:22.078 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.078 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.078 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.078 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.078 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.079 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.079 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.079 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.079 INFO:teuthology.orchestra.run.smithi046.stdout: "trash_purge_schedule": { 2023-10-19T12:59:22.079 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "trash_purge_schedule", 2023-10-19T12:59:22.080 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.080 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.080 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.080 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:22.080 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.081 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.081 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.081 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.081 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.081 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.082 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.082 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:22.082 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:22.082 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.082 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:22.083 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "restful", 2023-10-19T12:59:22.083 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:22.083 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:22.083 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:22.083 INFO:teuthology.orchestra.run.smithi046.stdout: "enable_auth": { 2023-10-19T12:59:22.084 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "enable_auth", 2023-10-19T12:59:22.084 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.084 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.084 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.084 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:22.084 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.085 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.085 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.085 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.085 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.085 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.086 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.086 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.086 INFO:teuthology.orchestra.run.smithi046.stdout: "key_file": { 2023-10-19T12:59:22.086 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "key_file", 2023-10-19T12:59:22.086 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.087 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.087 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.087 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:22.087 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.087 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.087 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.088 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.088 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.088 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.088 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.088 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.089 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:22.089 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:22.089 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.089 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.089 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.090 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:22.090 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.090 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.090 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:22.090 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:22.091 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:22.091 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:22.091 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:22.091 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:22.091 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:22.092 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:22.092 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.092 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.092 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.092 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.092 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.093 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:22.093 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:22.093 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.093 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.093 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.094 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:22.094 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.094 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.094 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.094 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.095 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.095 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.095 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.095 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.095 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:22.095 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:22.096 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.096 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.096 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.096 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:22.096 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.097 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.097 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:22.097 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:22.097 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:22.097 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:22.097 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:22.098 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:22.098 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:22.098 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:22.098 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.099 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.099 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.099 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.099 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.099 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:22.100 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:22.100 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.100 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.100 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.100 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:22.101 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.101 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.101 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.101 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.101 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.101 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.102 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.102 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.102 INFO:teuthology.orchestra.run.smithi046.stdout: "server_addr": { 2023-10-19T12:59:22.102 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "server_addr", 2023-10-19T12:59:22.102 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.102 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.103 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.103 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:22.103 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.103 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.103 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.104 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.104 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.104 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.104 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.104 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.105 INFO:teuthology.orchestra.run.smithi046.stdout: "server_port": { 2023-10-19T12:59:22.105 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "server_port", 2023-10-19T12:59:22.105 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.105 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.105 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.105 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:22.106 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.106 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.106 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.106 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.106 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.107 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.107 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.107 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:22.107 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:22.107 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.108 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:22.108 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rgw", 2023-10-19T12:59:22.108 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:22.108 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:22.108 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:22.109 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:22.109 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:22.109 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.109 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.109 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.109 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:22.110 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.110 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.110 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:22.110 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:22.110 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:22.111 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:22.111 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:22.111 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:22.111 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:22.111 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:22.112 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.112 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.112 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.112 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.112 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.112 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:22.113 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:22.113 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.113 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.113 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.113 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:22.114 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.114 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.114 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.114 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.114 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.115 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.115 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.115 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.115 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:22.115 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:22.115 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.116 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.116 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.116 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:22.116 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.116 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.117 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:22.117 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:22.117 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:22.117 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:22.117 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:22.117 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:22.118 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:22.118 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:22.118 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.118 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.118 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.119 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.119 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.119 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:22.119 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:22.119 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.120 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.120 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.120 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:22.120 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.120 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.121 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.121 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.121 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.121 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.121 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.121 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:22.122 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:22.122 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.122 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:22.122 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rook", 2023-10-19T12:59:22.122 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:22.123 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:22.123 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:22.123 INFO:teuthology.orchestra.run.smithi046.stdout: "drive_group_interval": { 2023-10-19T12:59:22.123 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "drive_group_interval", 2023-10-19T12:59:22.123 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "float", 2023-10-19T12:59:22.123 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.124 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.124 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "300.0", 2023-10-19T12:59:22.124 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.124 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.124 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.124 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2023-10-19T12:59:22.125 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.125 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.125 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.125 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.125 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:22.126 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:22.126 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.126 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.126 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.126 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:22.127 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.127 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.127 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:22.127 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:22.127 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:22.127 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:22.128 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:22.128 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:22.128 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:22.128 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:22.128 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.129 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.129 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.129 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.129 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.129 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:22.130 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:22.130 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.130 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.130 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.130 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:22.131 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.131 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.131 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.131 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.131 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.131 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.132 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.132 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.132 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:22.132 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:22.132 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.132 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.133 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.133 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:22.133 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.133 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.133 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:22.133 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:22.134 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:22.134 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:22.134 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:22.134 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:22.135 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:22.135 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:22.135 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.135 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.135 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.136 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.136 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.136 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:22.136 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:22.136 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.136 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.137 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.137 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:22.137 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.137 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.137 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.138 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.138 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.138 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.138 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.138 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.138 INFO:teuthology.orchestra.run.smithi046.stdout: "storage_class": { 2023-10-19T12:59:22.139 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "storage_class", 2023-10-19T12:59:22.139 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.139 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.139 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.139 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "local", 2023-10-19T12:59:22.140 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.140 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.140 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.140 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "storage class name for LSO-discovered PVs", 2023-10-19T12:59:22.140 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.141 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.141 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.141 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:22.141 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:22.141 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.141 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:22.142 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "selftest", 2023-10-19T12:59:22.142 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:22.142 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:22.142 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:22.142 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:22.143 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:22.143 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.143 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.143 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.143 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:22.144 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.144 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.144 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:22.144 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:22.144 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:22.145 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:22.145 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:22.145 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:22.145 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:22.145 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:22.146 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.146 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.146 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.146 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.146 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.147 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:22.147 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:22.147 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.147 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.147 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.148 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:22.148 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.148 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.148 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.148 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.149 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.149 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.149 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.149 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.149 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:22.149 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:22.150 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.150 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.150 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.150 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:22.150 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.151 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.151 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:22.151 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:22.151 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:22.151 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:22.152 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:22.152 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:22.152 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:22.152 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:22.152 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.152 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.153 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.153 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.153 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.153 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:22.153 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:22.154 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.154 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.154 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.154 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:22.154 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.155 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.155 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.155 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.155 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.155 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.155 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.156 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.156 INFO:teuthology.orchestra.run.smithi046.stdout: "roption1": { 2023-10-19T12:59:22.156 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "roption1", 2023-10-19T12:59:22.156 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.156 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.156 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.157 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:22.157 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.157 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.157 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.157 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.158 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.158 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.158 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.158 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.158 INFO:teuthology.orchestra.run.smithi046.stdout: "roption2": { 2023-10-19T12:59:22.159 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "roption2", 2023-10-19T12:59:22.159 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.159 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.159 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.159 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "xyz", 2023-10-19T12:59:22.159 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.160 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.160 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.160 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.160 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.160 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.160 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.161 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.161 INFO:teuthology.orchestra.run.smithi046.stdout: "rwoption1": { 2023-10-19T12:59:22.161 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rwoption1", 2023-10-19T12:59:22.161 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.161 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.161 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.162 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:22.162 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.162 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.162 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.162 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.163 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.163 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.163 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.163 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.163 INFO:teuthology.orchestra.run.smithi046.stdout: "rwoption2": { 2023-10-19T12:59:22.163 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rwoption2", 2023-10-19T12:59:22.164 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:22.164 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.164 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.164 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:22.164 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.164 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.165 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.165 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.165 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.165 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.165 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.165 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.166 INFO:teuthology.orchestra.run.smithi046.stdout: "rwoption3": { 2023-10-19T12:59:22.166 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rwoption3", 2023-10-19T12:59:22.166 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "float", 2023-10-19T12:59:22.166 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.166 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.167 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:22.167 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.167 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.167 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.167 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.168 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.168 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.168 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.168 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.168 INFO:teuthology.orchestra.run.smithi046.stdout: "rwoption4": { 2023-10-19T12:59:22.168 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rwoption4", 2023-10-19T12:59:22.169 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.169 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.169 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.169 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:22.169 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.169 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.170 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.170 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.170 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.170 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.170 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.171 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.171 INFO:teuthology.orchestra.run.smithi046.stdout: "rwoption5": { 2023-10-19T12:59:22.171 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rwoption5", 2023-10-19T12:59:22.171 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.171 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.171 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.172 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:22.172 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.172 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.172 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.172 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.172 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.173 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.173 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.173 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.173 INFO:teuthology.orchestra.run.smithi046.stdout: "rwoption6": { 2023-10-19T12:59:22.173 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rwoption6", 2023-10-19T12:59:22.173 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.174 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.174 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.174 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:22.174 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.174 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.175 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.175 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.175 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.175 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.175 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.176 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.176 INFO:teuthology.orchestra.run.smithi046.stdout: "rwoption7": { 2023-10-19T12:59:22.176 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rwoption7", 2023-10-19T12:59:22.176 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:22.176 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.176 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.177 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:22.177 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "1", 2023-10-19T12:59:22.177 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "42", 2023-10-19T12:59:22.177 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.177 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.178 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.178 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.178 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.178 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.178 INFO:teuthology.orchestra.run.smithi046.stdout: "testkey": { 2023-10-19T12:59:22.179 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "testkey", 2023-10-19T12:59:22.179 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.179 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.179 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.179 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:22.179 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.180 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.180 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.180 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.180 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.180 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.181 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.181 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.181 INFO:teuthology.orchestra.run.smithi046.stdout: "testlkey": { 2023-10-19T12:59:22.181 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "testlkey", 2023-10-19T12:59:22.181 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.182 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.182 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.182 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:22.182 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.182 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.183 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.183 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.183 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.183 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.183 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.184 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.184 INFO:teuthology.orchestra.run.smithi046.stdout: "testnewline": { 2023-10-19T12:59:22.184 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "testnewline", 2023-10-19T12:59:22.184 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.184 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.184 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.185 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:22.185 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.185 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.185 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.185 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.185 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.186 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.186 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.186 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:22.186 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:22.186 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.186 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:22.187 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "snap_schedule", 2023-10-19T12:59:22.187 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:22.187 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:22.187 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:22.187 INFO:teuthology.orchestra.run.smithi046.stdout: "allow_m_granularity": { 2023-10-19T12:59:22.188 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "allow_m_granularity", 2023-10-19T12:59:22.188 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.188 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.188 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.188 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:22.189 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.189 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.189 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.189 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "allow minute scheduled snapshots", 2023-10-19T12:59:22.189 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.190 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.190 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.190 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.190 INFO:teuthology.orchestra.run.smithi046.stdout: "dump_on_update": { 2023-10-19T12:59:22.190 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "dump_on_update", 2023-10-19T12:59:22.190 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.191 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.191 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.191 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:22.191 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.191 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.192 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.192 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "dump database to debug log on update", 2023-10-19T12:59:22.192 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.192 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.192 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.193 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.193 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:22.193 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:22.193 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.193 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.193 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.194 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:22.194 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.194 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.194 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:22.194 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:22.195 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:22.195 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:22.195 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:22.195 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:22.195 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:22.195 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:22.196 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.196 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.196 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.196 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.196 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.197 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:22.197 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:22.197 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.197 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.197 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.198 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:22.198 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.198 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.198 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.198 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.199 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.199 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.199 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.199 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.199 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:22.200 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:22.200 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.200 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.200 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.200 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:22.200 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.201 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.201 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:22.201 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:22.201 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:22.201 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:22.202 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:22.202 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:22.202 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:22.202 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:22.202 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.203 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.203 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.203 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.203 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.203 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:22.204 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:22.204 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.204 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.204 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.204 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:22.205 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.205 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.205 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.205 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.205 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.205 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.206 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.206 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:22.206 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:22.206 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.206 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:22.207 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "stats", 2023-10-19T12:59:22.207 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:22.207 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:22.207 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:22.207 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:22.208 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:22.208 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.208 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.208 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.208 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:22.209 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.209 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.209 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:22.209 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:22.209 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:22.210 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:22.210 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:22.210 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:22.210 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:22.210 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:22.211 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.211 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.211 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.211 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.211 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.211 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:22.212 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:22.212 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.212 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.212 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.212 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:22.212 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.213 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.213 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.213 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.213 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.213 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.214 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.214 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.214 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:22.214 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:22.214 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.215 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.215 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.215 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:22.215 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.215 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.215 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:22.216 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:22.216 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:22.216 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:22.216 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:22.216 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:22.217 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:22.217 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:22.217 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.217 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.217 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.218 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.218 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.218 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:22.218 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:22.218 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.219 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.219 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.219 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:22.219 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.219 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.219 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.220 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.220 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.220 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.220 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.220 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:22.220 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:22.221 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.221 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:22.221 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "status", 2023-10-19T12:59:22.221 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:22.221 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:22.222 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:22.222 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:22.222 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:22.222 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.222 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.223 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.223 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:22.223 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.223 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.223 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:22.223 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:22.224 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:22.224 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:22.224 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:22.224 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:22.224 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:22.225 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:22.225 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.225 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.225 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.225 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.225 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.226 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:22.226 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:22.226 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.226 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.226 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.227 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:22.227 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.227 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.227 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.227 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.227 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.228 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.228 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.228 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.228 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:22.228 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:22.229 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.229 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.229 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.229 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:22.229 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.230 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.230 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:22.230 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:22.230 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:22.230 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:22.231 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:22.231 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:22.231 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:22.231 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:22.231 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.231 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.232 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.232 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.232 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.232 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:22.232 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:22.232 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.233 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.233 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.233 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:22.233 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.233 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.234 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.234 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.234 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.234 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.234 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.235 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:22.235 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:22.235 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.235 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:22.235 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "telegraf", 2023-10-19T12:59:22.236 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:22.236 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:22.236 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:22.236 INFO:teuthology.orchestra.run.smithi046.stdout: "address": { 2023-10-19T12:59:22.236 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "address", 2023-10-19T12:59:22.236 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.237 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.237 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.237 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-10-19T12:59:22.237 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.237 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.238 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.238 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.238 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.238 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.238 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.239 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.239 INFO:teuthology.orchestra.run.smithi046.stdout: "interval": { 2023-10-19T12:59:22.239 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "interval", 2023-10-19T12:59:22.239 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2023-10-19T12:59:22.239 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.240 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.240 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "15", 2023-10-19T12:59:22.240 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.240 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.240 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.240 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.241 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.241 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.241 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.241 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.241 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:22.242 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:22.242 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.242 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.242 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.242 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:22.243 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.243 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.243 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:22.243 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:22.243 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:22.243 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:22.244 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:22.244 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:22.244 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:22.244 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:22.244 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.244 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.245 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.245 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.245 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.245 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:22.245 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:22.245 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.246 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.246 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.246 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:22.246 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.246 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.247 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.247 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.247 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.247 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.247 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.248 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.248 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:22.248 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:22.248 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.248 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.249 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.249 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:22.249 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.249 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.249 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:22.249 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:22.250 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:22.250 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:22.250 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:22.250 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:22.250 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:22.251 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:22.251 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.251 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.251 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.251 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.252 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.252 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:22.252 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:22.252 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.252 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.253 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.253 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:22.253 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.253 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.253 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.253 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.254 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.254 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.254 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.254 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:22.254 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:22.255 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.255 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:22.255 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "telemetry", 2023-10-19T12:59:22.255 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:22.255 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:22.256 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:22.256 INFO:teuthology.orchestra.run.smithi046.stdout: "channel_basic": { 2023-10-19T12:59:22.256 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "channel_basic", 2023-10-19T12:59:22.256 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.256 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.256 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.257 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:22.257 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.257 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.257 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.257 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Share basic cluster information (size, version)", 2023-10-19T12:59:22.258 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.258 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.258 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.258 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.258 INFO:teuthology.orchestra.run.smithi046.stdout: "channel_crash": { 2023-10-19T12:59:22.259 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "channel_crash", 2023-10-19T12:59:22.259 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.259 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.259 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.259 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:22.260 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.260 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.260 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.260 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-10-19T12:59:22.260 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.261 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.261 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.261 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.261 INFO:teuthology.orchestra.run.smithi046.stdout: "channel_device": { 2023-10-19T12:59:22.261 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "channel_device", 2023-10-19T12:59:22.262 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.262 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.262 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.262 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:22.262 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.263 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.263 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.263 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-10-19T12:59:22.263 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.263 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.263 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.264 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.264 INFO:teuthology.orchestra.run.smithi046.stdout: "channel_ident": { 2023-10-19T12:59:22.264 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "channel_ident", 2023-10-19T12:59:22.264 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.264 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.265 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.265 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:22.265 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.265 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.265 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.266 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-10-19T12:59:22.266 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.266 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.266 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.266 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.267 INFO:teuthology.orchestra.run.smithi046.stdout: "channel_perf": { 2023-10-19T12:59:22.267 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "channel_perf", 2023-10-19T12:59:22.267 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.267 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.267 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.267 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:22.268 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.268 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.268 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.268 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Share various performance metrics of a cluster", 2023-10-19T12:59:22.268 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.269 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.269 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.269 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.269 INFO:teuthology.orchestra.run.smithi046.stdout: "contact": { 2023-10-19T12:59:22.269 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "contact", 2023-10-19T12:59:22.270 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.270 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.270 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.270 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:22.270 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.271 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.271 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.271 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.271 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.271 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.271 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.272 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.272 INFO:teuthology.orchestra.run.smithi046.stdout: "description": { 2023-10-19T12:59:22.272 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "description", 2023-10-19T12:59:22.272 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.272 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.273 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.273 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:22.273 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.273 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.273 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.273 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.274 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.274 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.274 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.274 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.274 INFO:teuthology.orchestra.run.smithi046.stdout: "device_url": { 2023-10-19T12:59:22.275 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "device_url", 2023-10-19T12:59:22.275 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.275 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.275 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.275 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-10-19T12:59:22.275 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.276 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.276 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.276 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.276 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.276 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.277 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.277 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.277 INFO:teuthology.orchestra.run.smithi046.stdout: "enabled": { 2023-10-19T12:59:22.277 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "enabled", 2023-10-19T12:59:22.277 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.278 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.278 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.278 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:22.278 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.278 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.278 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.279 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.279 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.279 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.279 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.280 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.280 INFO:teuthology.orchestra.run.smithi046.stdout: "interval": { 2023-10-19T12:59:22.280 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "interval", 2023-10-19T12:59:22.280 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:22.280 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.280 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.281 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "24", 2023-10-19T12:59:22.281 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "8", 2023-10-19T12:59:22.281 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.281 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.281 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.282 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.282 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.282 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.282 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.282 INFO:teuthology.orchestra.run.smithi046.stdout: "last_opt_revision": { 2023-10-19T12:59:22.283 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "last_opt_revision", 2023-10-19T12:59:22.283 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:22.283 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.283 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.283 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "1", 2023-10-19T12:59:22.284 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.284 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.284 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.284 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.284 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.284 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.285 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.285 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.285 INFO:teuthology.orchestra.run.smithi046.stdout: "leaderboard": { 2023-10-19T12:59:22.285 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "leaderboard", 2023-10-19T12:59:22.285 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.286 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.286 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.286 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:22.286 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.286 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.287 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.287 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.287 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.287 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.287 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.287 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.288 INFO:teuthology.orchestra.run.smithi046.stdout: "leaderboard_description": { 2023-10-19T12:59:22.288 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "leaderboard_description", 2023-10-19T12:59:22.288 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.288 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.288 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.289 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:22.289 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.289 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.289 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.289 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.289 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.290 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.290 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.290 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.290 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:22.290 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:22.291 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.291 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.291 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.291 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:22.291 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.292 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.292 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:22.292 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:22.292 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:22.292 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:22.292 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:22.293 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:22.293 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:22.293 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:22.293 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.293 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.294 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.294 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.294 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.294 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:22.294 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:22.295 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.295 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.295 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.295 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:22.295 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.295 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.296 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.296 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.296 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.296 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.296 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.297 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.297 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:22.297 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:22.297 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.297 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.297 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.298 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:22.298 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.298 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.298 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:22.298 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:22.299 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:22.299 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:22.299 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:22.299 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:22.299 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:22.299 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:22.300 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.300 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.300 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.300 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.300 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.301 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:22.301 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:22.301 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.301 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.301 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.301 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:22.302 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.302 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.302 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.302 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.302 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.303 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.303 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.303 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.303 INFO:teuthology.orchestra.run.smithi046.stdout: "organization": { 2023-10-19T12:59:22.303 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "organization", 2023-10-19T12:59:22.304 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.304 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.304 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.304 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:22.304 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.304 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.305 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.305 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.305 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.305 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.305 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.306 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.306 INFO:teuthology.orchestra.run.smithi046.stdout: "proxy": { 2023-10-19T12:59:22.306 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "proxy", 2023-10-19T12:59:22.306 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.306 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.306 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.307 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:22.307 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.307 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.307 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.307 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.308 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.308 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.308 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.308 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.308 INFO:teuthology.orchestra.run.smithi046.stdout: "url": { 2023-10-19T12:59:22.308 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "url", 2023-10-19T12:59:22.309 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.309 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.309 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.309 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-10-19T12:59:22.309 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.310 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.310 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.310 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.310 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.310 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.310 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.311 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:22.311 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:22.311 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.311 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:22.311 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "test_orchestrator", 2023-10-19T12:59:22.312 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:22.312 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:22.312 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:22.312 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:22.312 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:22.313 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.313 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.313 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.313 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:22.313 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.313 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.314 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:22.314 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:22.314 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:22.314 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:22.314 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:22.315 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:22.315 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:22.315 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:22.315 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.315 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.316 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.316 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.316 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.316 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:22.316 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:22.317 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.317 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.317 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.317 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:22.317 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.317 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.318 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.318 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.318 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.318 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.318 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.319 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.319 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:22.319 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:22.319 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.319 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.320 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.320 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:22.320 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.320 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.320 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:22.320 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:22.321 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:22.321 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:22.321 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:22.321 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:22.321 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:22.322 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:22.322 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.322 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.322 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.322 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.323 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.323 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:22.323 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:22.323 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.323 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.324 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.324 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:22.324 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.324 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.324 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.325 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.325 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.325 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.325 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.325 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:22.325 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:22.326 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.326 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:22.326 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "volumes", 2023-10-19T12:59:22.326 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:22.326 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:22.327 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:22.327 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:22.327 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:22.327 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.327 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.328 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.328 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:22.328 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.328 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.328 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:22.329 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:22.329 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:22.329 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:22.329 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:22.329 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:22.330 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:22.330 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:22.330 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.330 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.330 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.330 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.331 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.331 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:22.331 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:22.331 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.331 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.332 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.332 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:22.332 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.332 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.332 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.333 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.333 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.333 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.333 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.333 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.333 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:22.334 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:22.334 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.334 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.334 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.334 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:22.335 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.335 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.335 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:22.335 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:22.335 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:22.335 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:22.336 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:22.336 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:22.336 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:22.336 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:22.336 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.337 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.337 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.337 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.337 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.337 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:22.337 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:22.338 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.338 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.338 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.338 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:22.338 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.339 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.339 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.339 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.339 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.339 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.341 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.342 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.342 INFO:teuthology.orchestra.run.smithi046.stdout: "max_concurrent_clones": { 2023-10-19T12:59:22.342 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "max_concurrent_clones", 2023-10-19T12:59:22.342 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:22.342 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.343 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.343 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "4", 2023-10-19T12:59:22.343 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.343 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.343 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.343 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Number of asynchronous cloner threads", 2023-10-19T12:59:22.344 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.344 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.344 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.344 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.344 INFO:teuthology.orchestra.run.smithi046.stdout: "periodic_async_work": { 2023-10-19T12:59:22.345 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "periodic_async_work", 2023-10-19T12:59:22.345 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.345 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.345 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.345 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:22.345 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.346 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.346 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.346 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Periodically check for async work", 2023-10-19T12:59:22.346 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.346 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.347 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.347 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.347 INFO:teuthology.orchestra.run.smithi046.stdout: "snapshot_clone_delay": { 2023-10-19T12:59:22.347 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "snapshot_clone_delay", 2023-10-19T12:59:22.347 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:22.348 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.348 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.348 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2023-10-19T12:59:22.348 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.348 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.348 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.349 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-10-19T12:59:22.349 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.349 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.349 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.349 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:22.350 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:22.350 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.350 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:22.350 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "zabbix", 2023-10-19T12:59:22.350 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:22.351 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:22.351 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:22.351 INFO:teuthology.orchestra.run.smithi046.stdout: "discovery_interval": { 2023-10-19T12:59:22.351 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "discovery_interval", 2023-10-19T12:59:22.351 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "uint", 2023-10-19T12:59:22.352 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.352 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.352 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "100", 2023-10-19T12:59:22.352 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.352 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.352 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.353 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.353 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.353 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.353 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.353 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.354 INFO:teuthology.orchestra.run.smithi046.stdout: "identifier": { 2023-10-19T12:59:22.354 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "identifier", 2023-10-19T12:59:22.354 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.354 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.354 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.355 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:22.355 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.355 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.355 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.355 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.356 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.356 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.356 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.356 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.356 INFO:teuthology.orchestra.run.smithi046.stdout: "interval": { 2023-10-19T12:59:22.356 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "interval", 2023-10-19T12:59:22.357 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2023-10-19T12:59:22.357 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.357 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.357 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "60", 2023-10-19T12:59:22.357 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.357 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.358 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.358 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.358 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.358 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.358 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.359 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.359 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:22.359 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:22.359 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.359 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.359 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.360 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:22.360 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.360 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.360 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:22.360 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:22.361 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:22.361 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:22.361 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:22.361 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:22.361 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:22.362 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:22.362 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.362 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.362 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.362 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.363 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.363 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:22.363 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:22.363 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.363 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.364 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.364 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:22.364 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.364 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.364 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.365 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.365 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.365 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.365 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.365 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.366 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:22.366 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:22.366 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.366 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.366 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.366 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:22.367 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.367 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.367 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:22.367 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:22.367 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:22.368 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:22.368 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:22.368 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:22.368 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:22.368 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:22.369 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.369 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.369 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.369 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.370 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.370 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:22.370 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:22.370 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.371 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.371 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.371 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:22.371 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.371 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.372 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.372 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.372 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.372 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.373 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.373 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.373 INFO:teuthology.orchestra.run.smithi046.stdout: "zabbix_host": { 2023-10-19T12:59:22.373 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "zabbix_host", 2023-10-19T12:59:22.374 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.374 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.374 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.374 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:22.374 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.375 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.375 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.375 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.375 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.375 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.376 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.376 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.376 INFO:teuthology.orchestra.run.smithi046.stdout: "zabbix_port": { 2023-10-19T12:59:22.376 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "zabbix_port", 2023-10-19T12:59:22.376 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:22.377 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.377 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.377 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "10051", 2023-10-19T12:59:22.377 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.377 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.378 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.378 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.378 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.378 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.378 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.379 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.379 INFO:teuthology.orchestra.run.smithi046.stdout: "zabbix_sender": { 2023-10-19T12:59:22.379 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "zabbix_sender", 2023-10-19T12:59:22.379 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.379 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.379 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.380 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-10-19T12:59:22.380 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.380 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.380 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.380 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.381 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.381 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.381 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.381 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:22.381 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:22.382 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:22.382 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2023-10-19T12:59:22.382 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.382 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:22.382 INFO:teuthology.orchestra.run.smithi046.stdout: "gid": 24116, 2023-10-19T12:59:22.382 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "y", 2023-10-19T12:59:22.383 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr_features": 4540138322906710015, 2023-10-19T12:59:22.383 INFO:teuthology.orchestra.run.smithi046.stdout: "available_modules": [ 2023-10-19T12:59:22.383 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:22.383 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "alerts", 2023-10-19T12:59:22.383 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:22.384 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:22.384 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:22.384 INFO:teuthology.orchestra.run.smithi046.stdout: "interval": { 2023-10-19T12:59:22.384 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "interval", 2023-10-19T12:59:22.384 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2023-10-19T12:59:22.384 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.385 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.385 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "60", 2023-10-19T12:59:22.385 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.385 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.385 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.386 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "How frequently to reexamine health status", 2023-10-19T12:59:22.386 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.386 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.386 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.386 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.387 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:22.387 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:22.387 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.387 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.388 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.388 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:22.388 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.388 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.388 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:22.388 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:22.389 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:22.389 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:22.389 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:22.389 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:22.389 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:22.390 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:22.390 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.390 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.390 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.390 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.391 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.391 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:22.391 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:22.391 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.391 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.392 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.392 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:22.392 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.392 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.392 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.393 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.393 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.393 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.393 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.393 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.393 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:22.394 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:22.394 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.394 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.394 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.394 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:22.395 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.395 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.395 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:22.395 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:22.395 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:22.396 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:22.396 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:22.396 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:22.396 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:22.396 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:22.397 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.397 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.397 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.397 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.397 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.397 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:22.398 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:22.398 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.398 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.398 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.398 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:22.399 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.399 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.399 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.399 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.399 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.400 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.400 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.400 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.400 INFO:teuthology.orchestra.run.smithi046.stdout: "smtp_destination": { 2023-10-19T12:59:22.400 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "smtp_destination", 2023-10-19T12:59:22.400 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.401 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.401 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.401 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:22.401 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.401 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.402 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.402 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Email address to send alerts to", 2023-10-19T12:59:22.402 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.402 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.402 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.403 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.403 INFO:teuthology.orchestra.run.smithi046.stdout: "smtp_from_name": { 2023-10-19T12:59:22.403 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "smtp_from_name", 2023-10-19T12:59:22.403 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.403 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.404 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.404 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "Ceph", 2023-10-19T12:59:22.404 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.404 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.404 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.404 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Email From: name", 2023-10-19T12:59:22.405 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.405 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.405 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.405 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.405 INFO:teuthology.orchestra.run.smithi046.stdout: "smtp_host": { 2023-10-19T12:59:22.406 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "smtp_host", 2023-10-19T12:59:22.406 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.406 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.406 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.406 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:22.407 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.407 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.407 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.407 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "SMTP server", 2023-10-19T12:59:22.407 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.408 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.408 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.408 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.408 INFO:teuthology.orchestra.run.smithi046.stdout: "smtp_password": { 2023-10-19T12:59:22.408 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "smtp_password", 2023-10-19T12:59:22.408 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.409 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.409 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.409 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:22.409 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.409 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.410 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.410 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Password to authenticate with", 2023-10-19T12:59:22.410 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.410 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.410 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.411 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.411 INFO:teuthology.orchestra.run.smithi046.stdout: "smtp_port": { 2023-10-19T12:59:22.411 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "smtp_port", 2023-10-19T12:59:22.411 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:22.411 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.411 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.412 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "465", 2023-10-19T12:59:22.412 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.412 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.412 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.412 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "SMTP port", 2023-10-19T12:59:22.413 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.413 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.413 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.413 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.413 INFO:teuthology.orchestra.run.smithi046.stdout: "smtp_sender": { 2023-10-19T12:59:22.413 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "smtp_sender", 2023-10-19T12:59:22.414 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.414 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.414 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.414 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:22.414 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.415 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.415 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.415 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "SMTP envelope sender", 2023-10-19T12:59:22.415 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.415 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.416 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.416 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.416 INFO:teuthology.orchestra.run.smithi046.stdout: "smtp_ssl": { 2023-10-19T12:59:22.416 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "smtp_ssl", 2023-10-19T12:59:22.416 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.416 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.417 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.417 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:22.417 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.417 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.417 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.418 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Use SSL to connect to SMTP server", 2023-10-19T12:59:22.418 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.418 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.418 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.418 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.419 INFO:teuthology.orchestra.run.smithi046.stdout: "smtp_user": { 2023-10-19T12:59:22.419 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "smtp_user", 2023-10-19T12:59:22.419 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.419 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.419 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.419 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:22.420 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.420 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.420 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.420 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "User to authenticate as", 2023-10-19T12:59:22.420 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.421 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.421 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.421 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:22.421 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:22.421 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.422 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:22.422 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "balancer", 2023-10-19T12:59:22.422 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:22.422 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:22.422 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:22.423 INFO:teuthology.orchestra.run.smithi046.stdout: "active": { 2023-10-19T12:59:22.423 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "active", 2023-10-19T12:59:22.423 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.423 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.423 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.423 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:22.424 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.424 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.424 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.424 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "automatically balance PGs across cluster", 2023-10-19T12:59:22.424 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.425 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.425 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.425 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.425 INFO:teuthology.orchestra.run.smithi046.stdout: "begin_time": { 2023-10-19T12:59:22.425 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "begin_time", 2023-10-19T12:59:22.425 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.426 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.426 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.426 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0000", 2023-10-19T12:59:22.426 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.426 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.427 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.427 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "beginning time of day to automatically balance", 2023-10-19T12:59:22.427 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-19T12:59:22.427 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.427 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.428 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.428 INFO:teuthology.orchestra.run.smithi046.stdout: "begin_weekday": { 2023-10-19T12:59:22.428 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "begin_weekday", 2023-10-19T12:59:22.428 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "uint", 2023-10-19T12:59:22.428 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.429 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.429 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2023-10-19T12:59:22.429 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "0", 2023-10-19T12:59:22.429 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "6", 2023-10-19T12:59:22.429 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.429 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-10-19T12:59:22.430 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-10-19T12:59:22.430 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.430 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.430 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.430 INFO:teuthology.orchestra.run.smithi046.stdout: "crush_compat_max_iterations": { 2023-10-19T12:59:22.431 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "crush_compat_max_iterations", 2023-10-19T12:59:22.431 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "uint", 2023-10-19T12:59:22.431 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.431 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.431 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "25", 2023-10-19T12:59:22.432 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "1", 2023-10-19T12:59:22.432 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "250", 2023-10-19T12:59:22.432 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.432 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-10-19T12:59:22.432 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.432 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.433 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.433 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.433 INFO:teuthology.orchestra.run.smithi046.stdout: "crush_compat_metrics": { 2023-10-19T12:59:22.433 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "crush_compat_metrics", 2023-10-19T12:59:22.433 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.434 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.434 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.434 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "pgs,objects,bytes", 2023-10-19T12:59:22.434 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.434 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.434 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.435 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-10-19T12:59:22.435 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-10-19T12:59:22.435 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.435 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.435 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.436 INFO:teuthology.orchestra.run.smithi046.stdout: "crush_compat_step": { 2023-10-19T12:59:22.436 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "crush_compat_step", 2023-10-19T12:59:22.436 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "float", 2023-10-19T12:59:22.436 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.436 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.437 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0.5", 2023-10-19T12:59:22.437 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "0.001", 2023-10-19T12:59:22.437 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "0.999", 2023-10-19T12:59:22.437 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.437 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "aggressiveness of optimization", 2023-10-19T12:59:22.437 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-10-19T12:59:22.438 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.438 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.438 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.438 INFO:teuthology.orchestra.run.smithi046.stdout: "end_time": { 2023-10-19T12:59:22.438 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "end_time", 2023-10-19T12:59:22.439 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.439 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.439 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.439 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "2359", 2023-10-19T12:59:22.439 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.440 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.440 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.440 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "ending time of day to automatically balance", 2023-10-19T12:59:22.440 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-19T12:59:22.440 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.441 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.441 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.441 INFO:teuthology.orchestra.run.smithi046.stdout: "end_weekday": { 2023-10-19T12:59:22.441 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "end_weekday", 2023-10-19T12:59:22.441 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "uint", 2023-10-19T12:59:22.441 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.442 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.442 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2023-10-19T12:59:22.442 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "0", 2023-10-19T12:59:22.442 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "6", 2023-10-19T12:59:22.442 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.443 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-10-19T12:59:22.443 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-10-19T12:59:22.443 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.443 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.443 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.444 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:22.444 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:22.444 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.444 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.444 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.444 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:22.445 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.445 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.445 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:22.445 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:22.445 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:22.446 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:22.446 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:22.446 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:22.446 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:22.446 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:22.446 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.447 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.447 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.447 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.447 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.447 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:22.448 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:22.448 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.448 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.448 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.448 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:22.448 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.449 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.449 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.449 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.449 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.449 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.450 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.450 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.450 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:22.450 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:22.450 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.451 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.451 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.451 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:22.451 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.451 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.452 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:22.452 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:22.452 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:22.452 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:22.452 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:22.453 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:22.453 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:22.453 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:22.453 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.453 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.454 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.454 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.454 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.454 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:22.454 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:22.455 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.455 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.455 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.455 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:22.455 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.455 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.456 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.456 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.456 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.456 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.456 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.457 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.457 INFO:teuthology.orchestra.run.smithi046.stdout: "min_score": { 2023-10-19T12:59:22.457 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "min_score", 2023-10-19T12:59:22.457 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "float", 2023-10-19T12:59:22.457 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.457 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.458 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2023-10-19T12:59:22.458 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.458 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.458 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.458 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-10-19T12:59:22.459 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.459 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.459 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.459 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.459 INFO:teuthology.orchestra.run.smithi046.stdout: "mode": { 2023-10-19T12:59:22.460 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "mode", 2023-10-19T12:59:22.460 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.460 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.460 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.460 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "upmap", 2023-10-19T12:59:22.461 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.461 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.461 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:22.461 INFO:teuthology.orchestra.run.smithi046.stdout: "crush-compat", 2023-10-19T12:59:22.461 INFO:teuthology.orchestra.run.smithi046.stdout: "none", 2023-10-19T12:59:22.461 INFO:teuthology.orchestra.run.smithi046.stdout: "upmap" 2023-10-19T12:59:22.462 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:22.462 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Balancer mode", 2023-10-19T12:59:22.462 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.462 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.462 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.463 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.463 INFO:teuthology.orchestra.run.smithi046.stdout: "pool_ids": { 2023-10-19T12:59:22.463 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "pool_ids", 2023-10-19T12:59:22.463 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.463 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.464 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.464 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:22.464 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.464 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.464 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.464 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-10-19T12:59:22.465 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.465 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.465 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.465 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.465 INFO:teuthology.orchestra.run.smithi046.stdout: "sleep_interval": { 2023-10-19T12:59:22.466 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sleep_interval", 2023-10-19T12:59:22.466 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2023-10-19T12:59:22.466 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.466 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.466 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "60", 2023-10-19T12:59:22.467 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.467 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.467 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.467 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-10-19T12:59:22.467 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.468 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.468 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.468 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.468 INFO:teuthology.orchestra.run.smithi046.stdout: "upmap_max_deviation": { 2023-10-19T12:59:22.468 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "upmap_max_deviation", 2023-10-19T12:59:22.468 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:22.469 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.469 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.469 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "5", 2023-10-19T12:59:22.469 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "1", 2023-10-19T12:59:22.469 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.470 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.470 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "deviation below which no optimization is attempted", 2023-10-19T12:59:22.470 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-10-19T12:59:22.470 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.470 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.471 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.471 INFO:teuthology.orchestra.run.smithi046.stdout: "upmap_max_optimizations": { 2023-10-19T12:59:22.471 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "upmap_max_optimizations", 2023-10-19T12:59:22.471 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "uint", 2023-10-19T12:59:22.471 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.472 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.472 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "10", 2023-10-19T12:59:22.472 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.472 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.472 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.473 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-10-19T12:59:22.473 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.473 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.473 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.473 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:22.473 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:22.474 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.474 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:22.474 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "cephadm", 2023-10-19T12:59:22.474 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:22.474 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:22.475 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:22.475 INFO:teuthology.orchestra.run.smithi046.stdout: "agent_down_multiplier": { 2023-10-19T12:59:22.475 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "agent_down_multiplier", 2023-10-19T12:59:22.475 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "float", 2023-10-19T12:59:22.475 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.476 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.476 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "3.0", 2023-10-19T12:59:22.476 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.476 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.476 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.476 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-10-19T12:59:22.477 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.477 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.477 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.477 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.477 INFO:teuthology.orchestra.run.smithi046.stdout: "agent_refresh_rate": { 2023-10-19T12:59:22.478 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "agent_refresh_rate", 2023-10-19T12:59:22.478 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2023-10-19T12:59:22.478 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.478 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.478 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "20", 2023-10-19T12:59:22.479 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.479 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.479 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.479 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-10-19T12:59:22.479 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.480 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.480 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.480 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.480 INFO:teuthology.orchestra.run.smithi046.stdout: "agent_starting_port": { 2023-10-19T12:59:22.480 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "agent_starting_port", 2023-10-19T12:59:22.480 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:22.481 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.481 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.481 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "4721", 2023-10-19T12:59:22.481 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.481 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.482 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.482 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-10-19T12:59:22.482 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.482 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.482 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.483 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.483 INFO:teuthology.orchestra.run.smithi046.stdout: "allow_ptrace": { 2023-10-19T12:59:22.483 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "allow_ptrace", 2023-10-19T12:59:22.483 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.483 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.483 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.484 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:22.484 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.484 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.484 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.484 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-10-19T12:59:22.485 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-10-19T12:59:22.485 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.485 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.485 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.485 INFO:teuthology.orchestra.run.smithi046.stdout: "autotune_interval": { 2023-10-19T12:59:22.486 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "autotune_interval", 2023-10-19T12:59:22.486 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2023-10-19T12:59:22.486 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.486 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.486 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "600", 2023-10-19T12:59:22.487 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.487 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.487 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.487 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "how frequently to autotune daemon memory", 2023-10-19T12:59:22.487 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.487 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.488 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.488 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.488 INFO:teuthology.orchestra.run.smithi046.stdout: "autotune_memory_target_ratio": { 2023-10-19T12:59:22.488 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "autotune_memory_target_ratio", 2023-10-19T12:59:22.488 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "float", 2023-10-19T12:59:22.489 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.489 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.489 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0.7", 2023-10-19T12:59:22.489 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.489 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.489 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.490 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-10-19T12:59:22.490 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.490 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.490 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.490 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.491 INFO:teuthology.orchestra.run.smithi046.stdout: "cephadm_log_destination": { 2023-10-19T12:59:22.491 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "cephadm_log_destination", 2023-10-19T12:59:22.491 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.491 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.491 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.492 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:22.492 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.492 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.492 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:22.492 INFO:teuthology.orchestra.run.smithi046.stdout: "file", 2023-10-19T12:59:22.492 INFO:teuthology.orchestra.run.smithi046.stdout: "file,syslog", 2023-10-19T12:59:22.493 INFO:teuthology.orchestra.run.smithi046.stdout: "syslog" 2023-10-19T12:59:22.493 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:22.493 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Destination for cephadm command's persistent logging", 2023-10-19T12:59:22.493 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.494 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.494 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.494 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.494 INFO:teuthology.orchestra.run.smithi046.stdout: "cgroups_split": { 2023-10-19T12:59:22.494 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "cgroups_split", 2023-10-19T12:59:22.495 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.495 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.495 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.495 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:22.495 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.495 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.496 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.496 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-10-19T12:59:22.496 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.496 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.496 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.496 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.497 INFO:teuthology.orchestra.run.smithi046.stdout: "config_checks_enabled": { 2023-10-19T12:59:22.497 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "config_checks_enabled", 2023-10-19T12:59:22.497 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.497 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.497 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.498 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:22.498 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.498 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.498 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.498 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-10-19T12:59:22.498 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.499 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.499 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.499 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.499 INFO:teuthology.orchestra.run.smithi046.stdout: "config_dashboard": { 2023-10-19T12:59:22.499 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "config_dashboard", 2023-10-19T12:59:22.500 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.500 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.500 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.500 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:22.500 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.501 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.501 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.501 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-10-19T12:59:22.501 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.501 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.502 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.502 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.502 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_alertmanager": { 2023-10-19T12:59:22.502 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_alertmanager", 2023-10-19T12:59:22.502 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.503 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.503 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.503 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-10-19T12:59:22.503 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.503 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.504 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.504 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Prometheus container image", 2023-10-19T12:59:22.504 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.504 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.504 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.505 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.505 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_base": { 2023-10-19T12:59:22.505 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_base", 2023-10-19T12:59:22.505 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.505 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.505 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.506 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/ceph/ceph", 2023-10-19T12:59:22.506 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.506 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.506 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.506 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Container image name, without the tag", 2023-10-19T12:59:22.507 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.507 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.507 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.507 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.507 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_elasticsearch": { 2023-10-19T12:59:22.508 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_elasticsearch", 2023-10-19T12:59:22.508 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.508 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.508 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.508 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2023-10-19T12:59:22.508 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.509 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.509 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.509 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "elasticsearch container image", 2023-10-19T12:59:22.509 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.509 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.510 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.510 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.510 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_grafana": { 2023-10-19T12:59:22.510 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_grafana", 2023-10-19T12:59:22.510 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.511 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.511 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.511 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-10-19T12:59:22.511 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.511 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.511 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.512 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Prometheus container image", 2023-10-19T12:59:22.512 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.512 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.512 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.512 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.513 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_haproxy": { 2023-10-19T12:59:22.513 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_haproxy", 2023-10-19T12:59:22.513 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.513 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.513 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.514 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-10-19T12:59:22.514 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.514 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.514 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.514 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "HAproxy container image", 2023-10-19T12:59:22.514 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.515 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.515 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.515 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.515 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_jaeger_agent": { 2023-10-19T12:59:22.515 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_jaeger_agent", 2023-10-19T12:59:22.516 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.516 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.516 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.516 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2023-10-19T12:59:22.516 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.517 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.517 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.517 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Jaeger agent container image", 2023-10-19T12:59:22.517 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.517 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.517 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.518 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.518 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_jaeger_collector": { 2023-10-19T12:59:22.518 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_jaeger_collector", 2023-10-19T12:59:22.518 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.518 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.519 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.519 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2023-10-19T12:59:22.519 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.519 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.519 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.519 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Jaeger collector container image", 2023-10-19T12:59:22.520 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.520 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.520 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.520 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.520 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_jaeger_query": { 2023-10-19T12:59:22.521 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_jaeger_query", 2023-10-19T12:59:22.521 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.521 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.521 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.521 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2023-10-19T12:59:22.521 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.522 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.522 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.522 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Jaeger query container image", 2023-10-19T12:59:22.522 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.522 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.523 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.523 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.523 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_keepalived": { 2023-10-19T12:59:22.523 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_keepalived", 2023-10-19T12:59:22.523 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.524 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.524 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.524 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2023-10-19T12:59:22.524 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.524 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.525 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.525 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Keepalived container image", 2023-10-19T12:59:22.525 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.525 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.525 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.526 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.526 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_loki": { 2023-10-19T12:59:22.526 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_loki", 2023-10-19T12:59:22.526 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.526 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.526 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.527 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-10-19T12:59:22.527 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.527 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.527 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.527 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Loki container image", 2023-10-19T12:59:22.528 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.528 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.528 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.528 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.528 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_node_exporter": { 2023-10-19T12:59:22.529 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_node_exporter", 2023-10-19T12:59:22.529 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.529 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.529 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.529 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-10-19T12:59:22.529 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.530 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.530 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.530 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Prometheus container image", 2023-10-19T12:59:22.530 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.530 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.531 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.531 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.531 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_nvmeof": { 2023-10-19T12:59:22.531 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_nvmeof", 2023-10-19T12:59:22.531 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.531 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.532 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.532 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/ceph/nvmeof:0.0.3", 2023-10-19T12:59:22.532 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.532 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.532 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.533 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Nvme-of container image", 2023-10-19T12:59:22.533 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.533 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.533 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.533 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.533 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_prometheus": { 2023-10-19T12:59:22.534 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_prometheus", 2023-10-19T12:59:22.534 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.534 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.534 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.534 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-10-19T12:59:22.535 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.535 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.535 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.535 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Prometheus container image", 2023-10-19T12:59:22.535 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.536 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.536 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.536 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.536 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_promtail": { 2023-10-19T12:59:22.536 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_promtail", 2023-10-19T12:59:22.536 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.537 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.537 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.537 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-10-19T12:59:22.537 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.537 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.538 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.538 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Promtail container image", 2023-10-19T12:59:22.538 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.538 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.538 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.538 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.539 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_snmp_gateway": { 2023-10-19T12:59:22.539 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_snmp_gateway", 2023-10-19T12:59:22.539 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.539 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.539 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.540 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-10-19T12:59:22.540 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.540 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.540 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.540 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "SNMP Gateway container image", 2023-10-19T12:59:22.540 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.541 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.541 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.541 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.541 INFO:teuthology.orchestra.run.smithi046.stdout: "container_init": { 2023-10-19T12:59:22.541 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_init", 2023-10-19T12:59:22.542 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.542 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.542 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.542 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:22.542 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.543 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.543 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.543 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Run podman/docker with `--init`", 2023-10-19T12:59:22.543 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.543 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.545 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.545 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.545 INFO:teuthology.orchestra.run.smithi046.stdout: "daemon_cache_timeout": { 2023-10-19T12:59:22.546 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "daemon_cache_timeout", 2023-10-19T12:59:22.546 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2023-10-19T12:59:22.546 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.546 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.546 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "600", 2023-10-19T12:59:22.547 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.547 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.547 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.547 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-10-19T12:59:22.547 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.547 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.548 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.548 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.548 INFO:teuthology.orchestra.run.smithi046.stdout: "default_cephadm_command_timeout": { 2023-10-19T12:59:22.548 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "default_cephadm_command_timeout", 2023-10-19T12:59:22.548 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2023-10-19T12:59:22.549 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.549 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.549 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "900", 2023-10-19T12:59:22.549 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.549 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.549 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.550 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-10-19T12:59:22.550 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.550 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.550 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.550 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.551 INFO:teuthology.orchestra.run.smithi046.stdout: "default_registry": { 2023-10-19T12:59:22.551 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "default_registry", 2023-10-19T12:59:22.551 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.551 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.551 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.552 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "docker.io", 2023-10-19T12:59:22.552 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.552 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.552 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.552 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-10-19T12:59:22.552 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.553 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.553 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.553 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.553 INFO:teuthology.orchestra.run.smithi046.stdout: "device_cache_timeout": { 2023-10-19T12:59:22.553 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "device_cache_timeout", 2023-10-19T12:59:22.554 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2023-10-19T12:59:22.554 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.554 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.554 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "1800", 2023-10-19T12:59:22.554 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.554 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.555 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.555 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "seconds to cache device inventory", 2023-10-19T12:59:22.555 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.555 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.555 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.556 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.556 INFO:teuthology.orchestra.run.smithi046.stdout: "device_enhanced_scan": { 2023-10-19T12:59:22.556 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "device_enhanced_scan", 2023-10-19T12:59:22.556 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.556 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.556 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.557 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:22.557 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.557 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.557 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.557 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Use libstoragemgmt during device scans", 2023-10-19T12:59:22.558 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.558 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.558 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.558 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.558 INFO:teuthology.orchestra.run.smithi046.stdout: "facts_cache_timeout": { 2023-10-19T12:59:22.559 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "facts_cache_timeout", 2023-10-19T12:59:22.559 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2023-10-19T12:59:22.559 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.559 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.559 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "60", 2023-10-19T12:59:22.560 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.560 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.560 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.560 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "seconds to cache host facts data", 2023-10-19T12:59:22.560 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.561 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.561 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.561 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.561 INFO:teuthology.orchestra.run.smithi046.stdout: "host_check_interval": { 2023-10-19T12:59:22.561 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "host_check_interval", 2023-10-19T12:59:22.562 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2023-10-19T12:59:22.562 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.562 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.562 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "600", 2023-10-19T12:59:22.562 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.562 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.563 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.563 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "how frequently to perform a host check", 2023-10-19T12:59:22.563 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.563 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.563 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.564 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.564 INFO:teuthology.orchestra.run.smithi046.stdout: "inventory_list_all": { 2023-10-19T12:59:22.564 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "inventory_list_all", 2023-10-19T12:59:22.564 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.564 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.565 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.565 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:22.565 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.565 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.565 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.565 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2023-10-19T12:59:22.566 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.566 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.566 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.566 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.566 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:22.567 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:22.567 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.567 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.567 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.567 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:22.568 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.568 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.568 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:22.568 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:22.568 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:22.569 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:22.569 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:22.569 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:22.569 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:22.569 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:22.569 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.570 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.570 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.570 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.570 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.570 INFO:teuthology.orchestra.run.smithi046.stdout: "log_refresh_metadata": { 2023-10-19T12:59:22.571 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_refresh_metadata", 2023-10-19T12:59:22.571 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.571 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.571 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.571 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:22.572 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.572 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.572 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.572 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-10-19T12:59:22.572 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.572 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.573 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.573 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.573 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:22.573 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:22.573 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.574 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.574 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.574 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:22.574 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.574 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.575 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.575 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-10-19T12:59:22.575 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.575 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.575 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.575 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.576 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:22.576 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:22.576 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.576 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.576 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.577 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:22.577 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.577 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.577 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:22.577 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:22.578 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:22.578 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:22.578 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:22.578 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:22.578 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:22.579 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:22.579 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.579 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.579 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.579 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.579 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.580 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:22.580 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:22.580 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.580 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.580 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.581 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:22.581 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.581 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.581 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.581 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.582 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.582 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.582 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.582 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.582 INFO:teuthology.orchestra.run.smithi046.stdout: "manage_etc_ceph_ceph_conf": { 2023-10-19T12:59:22.582 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-10-19T12:59:22.583 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.583 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.583 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.583 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:22.583 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.584 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.584 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.584 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-10-19T12:59:22.584 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.584 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.585 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.585 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.585 INFO:teuthology.orchestra.run.smithi046.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-10-19T12:59:22.585 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-10-19T12:59:22.585 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.585 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.586 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.586 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "*", 2023-10-19T12:59:22.586 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.586 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.586 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.587 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-10-19T12:59:22.587 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.587 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.587 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.587 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.587 INFO:teuthology.orchestra.run.smithi046.stdout: "max_count_per_host": { 2023-10-19T12:59:22.588 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "max_count_per_host", 2023-10-19T12:59:22.588 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:22.588 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.588 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.588 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "10", 2023-10-19T12:59:22.589 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.589 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.589 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.589 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "max number of daemons per service per host", 2023-10-19T12:59:22.589 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.589 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.590 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.590 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.590 INFO:teuthology.orchestra.run.smithi046.stdout: "max_osd_draining_count": { 2023-10-19T12:59:22.590 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "max_osd_draining_count", 2023-10-19T12:59:22.590 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:22.591 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.591 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.591 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "10", 2023-10-19T12:59:22.591 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.591 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.592 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.592 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-10-19T12:59:22.592 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.592 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.592 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.593 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.593 INFO:teuthology.orchestra.run.smithi046.stdout: "migration_current": { 2023-10-19T12:59:22.593 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "migration_current", 2023-10-19T12:59:22.593 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:22.593 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.594 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.594 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:22.594 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.594 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.594 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.594 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "internal - do not modify", 2023-10-19T12:59:22.595 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.595 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.595 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.595 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.595 INFO:teuthology.orchestra.run.smithi046.stdout: "mode": { 2023-10-19T12:59:22.596 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "mode", 2023-10-19T12:59:22.596 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.596 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.596 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.596 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "root", 2023-10-19T12:59:22.596 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.597 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.597 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:22.597 INFO:teuthology.orchestra.run.smithi046.stdout: "cephadm-package", 2023-10-19T12:59:22.597 INFO:teuthology.orchestra.run.smithi046.stdout: "root" 2023-10-19T12:59:22.597 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:22.598 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "mode for remote execution of cephadm", 2023-10-19T12:59:22.598 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.598 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.598 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.598 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.599 INFO:teuthology.orchestra.run.smithi046.stdout: "prometheus_alerts_path": { 2023-10-19T12:59:22.599 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "prometheus_alerts_path", 2023-10-19T12:59:22.599 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.599 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.599 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.599 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-10-19T12:59:22.600 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.600 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.600 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.600 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-10-19T12:59:22.600 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.601 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.601 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.601 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.601 INFO:teuthology.orchestra.run.smithi046.stdout: "registry_insecure": { 2023-10-19T12:59:22.601 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "registry_insecure", 2023-10-19T12:59:22.602 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.602 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.602 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.602 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:22.602 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.603 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.603 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.603 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-10-19T12:59:22.603 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.603 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.603 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.604 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.604 INFO:teuthology.orchestra.run.smithi046.stdout: "registry_password": { 2023-10-19T12:59:22.604 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "registry_password", 2023-10-19T12:59:22.604 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.604 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.605 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.605 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:22.605 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.605 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.605 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.606 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-10-19T12:59:22.606 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.606 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.606 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.606 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.607 INFO:teuthology.orchestra.run.smithi046.stdout: "registry_url": { 2023-10-19T12:59:22.607 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "registry_url", 2023-10-19T12:59:22.607 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.607 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.607 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.608 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:22.608 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.608 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.608 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.608 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-10-19T12:59:22.608 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.609 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.609 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.609 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.609 INFO:teuthology.orchestra.run.smithi046.stdout: "registry_username": { 2023-10-19T12:59:22.609 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "registry_username", 2023-10-19T12:59:22.610 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.610 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.610 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.610 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:22.610 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.611 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.611 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.611 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-10-19T12:59:22.611 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.611 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.611 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.612 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.612 INFO:teuthology.orchestra.run.smithi046.stdout: "secure_monitoring_stack": { 2023-10-19T12:59:22.612 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "secure_monitoring_stack", 2023-10-19T12:59:22.612 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.612 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.613 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.613 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:22.613 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.613 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.613 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.613 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2023-10-19T12:59:22.614 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.614 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.614 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.614 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.614 INFO:teuthology.orchestra.run.smithi046.stdout: "service_discovery_port": { 2023-10-19T12:59:22.615 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "service_discovery_port", 2023-10-19T12:59:22.615 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:22.615 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.615 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.615 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "8765", 2023-10-19T12:59:22.616 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.616 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.616 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.616 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "cephadm service discovery port", 2023-10-19T12:59:22.616 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.617 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.617 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.617 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.617 INFO:teuthology.orchestra.run.smithi046.stdout: "ssh_config_file": { 2023-10-19T12:59:22.617 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ssh_config_file", 2023-10-19T12:59:22.618 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.618 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.618 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.618 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:22.618 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.619 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.619 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.619 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-10-19T12:59:22.619 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.619 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.619 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.620 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.620 INFO:teuthology.orchestra.run.smithi046.stdout: "use_agent": { 2023-10-19T12:59:22.620 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "use_agent", 2023-10-19T12:59:22.620 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.620 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.620 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.621 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:22.621 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.621 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.621 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.621 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-10-19T12:59:22.622 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.622 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.622 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.622 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.622 INFO:teuthology.orchestra.run.smithi046.stdout: "use_repo_digest": { 2023-10-19T12:59:22.623 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "use_repo_digest", 2023-10-19T12:59:22.623 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.623 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.623 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.623 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:22.623 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.624 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.624 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.624 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-10-19T12:59:22.624 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.624 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.625 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.625 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.625 INFO:teuthology.orchestra.run.smithi046.stdout: "warn_on_failed_host_check": { 2023-10-19T12:59:22.625 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "warn_on_failed_host_check", 2023-10-19T12:59:22.625 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.626 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.626 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.626 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:22.626 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.626 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.627 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.627 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "raise a health warning if the host check fails", 2023-10-19T12:59:22.627 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.627 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.627 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.627 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.628 INFO:teuthology.orchestra.run.smithi046.stdout: "warn_on_stray_daemons": { 2023-10-19T12:59:22.628 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "warn_on_stray_daemons", 2023-10-19T12:59:22.628 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.628 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.628 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.629 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:22.629 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.629 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.629 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.629 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-10-19T12:59:22.629 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.630 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.630 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.630 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.630 INFO:teuthology.orchestra.run.smithi046.stdout: "warn_on_stray_hosts": { 2023-10-19T12:59:22.630 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "warn_on_stray_hosts", 2023-10-19T12:59:22.631 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.631 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.631 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.631 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:22.631 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.632 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.632 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.632 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-10-19T12:59:22.632 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.632 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.633 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.633 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:22.633 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:22.633 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.633 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:22.633 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "crash", 2023-10-19T12:59:22.634 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:22.634 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:22.634 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:22.634 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:22.634 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:22.635 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.635 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.635 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.635 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:22.635 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.636 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.636 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:22.636 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:22.636 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:22.636 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:22.637 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:22.637 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:22.637 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:22.637 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:22.637 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.637 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.638 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.638 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.638 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.638 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:22.638 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:22.639 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.639 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.639 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.639 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:22.639 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.640 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.640 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.640 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.640 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.640 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.640 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.641 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.641 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:22.641 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:22.641 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.641 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.642 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.642 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:22.642 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.642 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.642 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:22.643 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:22.643 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:22.643 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:22.643 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:22.643 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:22.643 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:22.644 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:22.644 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.644 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.644 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.644 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.645 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.645 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:22.645 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:22.645 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.645 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.646 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.646 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:22.646 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.646 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.646 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.646 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.647 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.647 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.647 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.647 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.647 INFO:teuthology.orchestra.run.smithi046.stdout: "retain_interval": { 2023-10-19T12:59:22.648 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "retain_interval", 2023-10-19T12:59:22.648 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2023-10-19T12:59:22.648 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.648 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.648 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "31536000", 2023-10-19T12:59:22.649 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.649 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.649 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.649 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "how long to retain crashes before pruning them", 2023-10-19T12:59:22.649 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.649 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.650 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.650 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.650 INFO:teuthology.orchestra.run.smithi046.stdout: "warn_recent_interval": { 2023-10-19T12:59:22.650 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "warn_recent_interval", 2023-10-19T12:59:22.650 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2023-10-19T12:59:22.651 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.651 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.651 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "1209600", 2023-10-19T12:59:22.651 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.651 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.652 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.652 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "time interval in which to warn about recent crashes", 2023-10-19T12:59:22.652 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.652 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.652 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.652 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:22.653 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:22.653 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.653 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:22.653 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "dashboard", 2023-10-19T12:59:22.653 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:22.654 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:22.654 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:22.654 INFO:teuthology.orchestra.run.smithi046.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-10-19T12:59:22.654 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-10-19T12:59:22.654 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:22.655 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.655 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.655 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "10", 2023-10-19T12:59:22.655 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.655 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.655 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.656 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.656 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.656 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.656 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.656 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.657 INFO:teuthology.orchestra.run.smithi046.stdout: "ALERTMANAGER_API_HOST": { 2023-10-19T12:59:22.657 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ALERTMANAGER_API_HOST", 2023-10-19T12:59:22.657 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.657 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.657 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.658 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:22.658 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.658 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.658 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.658 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.659 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.659 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.659 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.659 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.659 INFO:teuthology.orchestra.run.smithi046.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-10-19T12:59:22.660 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-10-19T12:59:22.660 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.660 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.660 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.660 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:22.660 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.661 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.661 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.661 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.661 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.661 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.662 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.662 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.662 INFO:teuthology.orchestra.run.smithi046.stdout: "AUDIT_API_ENABLED": { 2023-10-19T12:59:22.662 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "AUDIT_API_ENABLED", 2023-10-19T12:59:22.662 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.663 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.663 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.663 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:22.663 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.663 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.664 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.664 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.664 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.664 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.664 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.664 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.665 INFO:teuthology.orchestra.run.smithi046.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-10-19T12:59:22.665 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-10-19T12:59:22.665 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.665 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.665 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.666 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:22.666 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.666 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.666 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.666 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.667 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.667 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.667 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.667 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.667 INFO:teuthology.orchestra.run.smithi046.stdout: "ENABLE_BROWSABLE_API": { 2023-10-19T12:59:22.667 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ENABLE_BROWSABLE_API", 2023-10-19T12:59:22.668 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.668 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.668 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.668 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:22.668 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.669 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.669 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.669 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.669 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.669 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.669 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.670 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.670 INFO:teuthology.orchestra.run.smithi046.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-10-19T12:59:22.670 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-10-19T12:59:22.670 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.670 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.671 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.671 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:22.671 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.671 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.671 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.672 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.672 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.672 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.672 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.672 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.672 INFO:teuthology.orchestra.run.smithi046.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-10-19T12:59:22.673 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-10-19T12:59:22.673 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.673 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.673 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.673 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:22.674 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.674 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.674 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.674 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.674 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.674 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.675 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.675 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.675 INFO:teuthology.orchestra.run.smithi046.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-10-19T12:59:22.675 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-10-19T12:59:22.675 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.676 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.676 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.676 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:22.676 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.676 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.676 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.677 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.677 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.677 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.677 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.677 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.678 INFO:teuthology.orchestra.run.smithi046.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-10-19T12:59:22.678 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-10-19T12:59:22.678 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.678 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.678 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.678 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:22.679 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.679 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.679 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.679 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.679 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.680 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.680 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.680 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.680 INFO:teuthology.orchestra.run.smithi046.stdout: "FEATURE_TOGGLE_NFS": { 2023-10-19T12:59:22.680 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-10-19T12:59:22.681 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.681 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.681 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.681 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:22.681 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.681 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.682 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.682 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.682 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.682 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.682 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.683 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.683 INFO:teuthology.orchestra.run.smithi046.stdout: "FEATURE_TOGGLE_RBD": { 2023-10-19T12:59:22.683 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-10-19T12:59:22.683 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.683 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.683 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.684 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:22.684 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.684 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.684 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.684 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.685 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.685 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.685 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.685 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.685 INFO:teuthology.orchestra.run.smithi046.stdout: "FEATURE_TOGGLE_RGW": { 2023-10-19T12:59:22.686 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-10-19T12:59:22.686 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.686 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.686 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.686 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:22.687 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.687 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.687 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.687 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.687 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.688 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.688 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.688 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.688 INFO:teuthology.orchestra.run.smithi046.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-10-19T12:59:22.688 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-10-19T12:59:22.688 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.689 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.689 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.689 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:22.689 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.689 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.690 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.690 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.690 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.690 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.690 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.691 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.691 INFO:teuthology.orchestra.run.smithi046.stdout: "GRAFANA_API_PASSWORD": { 2023-10-19T12:59:22.691 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "GRAFANA_API_PASSWORD", 2023-10-19T12:59:22.691 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.691 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.692 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.692 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "admin", 2023-10-19T12:59:22.692 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.692 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.692 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.692 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.693 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.693 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.693 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.693 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.693 INFO:teuthology.orchestra.run.smithi046.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-10-19T12:59:22.694 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-10-19T12:59:22.694 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.694 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.694 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.694 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:22.695 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.695 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.695 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.695 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.695 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.695 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.696 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.696 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.696 INFO:teuthology.orchestra.run.smithi046.stdout: "GRAFANA_API_URL": { 2023-10-19T12:59:22.696 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "GRAFANA_API_URL", 2023-10-19T12:59:22.696 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.697 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.697 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.697 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:22.697 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.697 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.697 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.698 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.698 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.698 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.698 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.698 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.699 INFO:teuthology.orchestra.run.smithi046.stdout: "GRAFANA_API_USERNAME": { 2023-10-19T12:59:22.699 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "GRAFANA_API_USERNAME", 2023-10-19T12:59:22.699 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.699 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.699 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.700 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "admin", 2023-10-19T12:59:22.700 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.700 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.700 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.700 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.701 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.701 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.701 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.701 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.701 INFO:teuthology.orchestra.run.smithi046.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-10-19T12:59:22.701 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-10-19T12:59:22.702 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.702 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.702 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.702 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:22.702 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.703 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.703 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.703 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.703 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.703 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.704 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.704 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.704 INFO:teuthology.orchestra.run.smithi046.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-10-19T12:59:22.704 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-10-19T12:59:22.704 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.704 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.705 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.705 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:22.705 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.705 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.705 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.706 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.706 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.706 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.706 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.706 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.707 INFO:teuthology.orchestra.run.smithi046.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-10-19T12:59:22.707 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-10-19T12:59:22.707 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.707 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.707 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.708 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:22.708 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.708 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.708 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.708 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.708 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.709 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.709 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.709 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.709 INFO:teuthology.orchestra.run.smithi046.stdout: "ISSUE_TRACKER_API_KEY": { 2023-10-19T12:59:22.709 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-10-19T12:59:22.710 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.710 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.710 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.710 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:22.710 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.710 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.711 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.711 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.711 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.711 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.711 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.712 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.712 INFO:teuthology.orchestra.run.smithi046.stdout: "PROMETHEUS_API_HOST": { 2023-10-19T12:59:22.712 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PROMETHEUS_API_HOST", 2023-10-19T12:59:22.712 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.712 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.713 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.713 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:22.713 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.713 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.713 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.714 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.714 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.714 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.714 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.714 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.714 INFO:teuthology.orchestra.run.smithi046.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-10-19T12:59:22.715 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-10-19T12:59:22.715 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.715 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.715 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.715 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:22.716 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.716 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.716 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.716 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.716 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.716 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.717 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.717 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.717 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-10-19T12:59:22.717 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-10-19T12:59:22.717 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.718 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.718 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.718 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:22.718 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.718 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.719 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.719 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.719 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.719 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.719 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.720 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.720 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-10-19T12:59:22.720 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-10-19T12:59:22.720 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.720 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.721 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.721 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:22.721 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.721 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.721 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.721 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.722 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.722 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.722 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.722 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.722 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-10-19T12:59:22.723 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-10-19T12:59:22.723 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.723 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.723 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.723 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:22.724 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.724 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.724 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.724 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.724 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.724 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.725 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.725 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.725 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-10-19T12:59:22.725 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-10-19T12:59:22.725 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.726 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.726 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.726 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:22.726 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.726 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.727 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.727 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.727 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.727 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.727 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.728 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.728 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-10-19T12:59:22.728 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-10-19T12:59:22.728 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.728 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.728 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.729 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:22.729 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.729 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.729 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.729 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.730 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.730 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.730 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.730 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.730 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-10-19T12:59:22.731 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-10-19T12:59:22.731 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.731 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.731 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.731 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:22.731 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.732 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.732 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.732 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.732 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.732 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.733 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.733 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.733 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-10-19T12:59:22.733 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-10-19T12:59:22.733 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.733 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.734 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.734 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:22.734 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.734 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.734 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.735 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.735 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.735 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.735 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.735 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.736 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_ENABLED": { 2023-10-19T12:59:22.736 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_ENABLED", 2023-10-19T12:59:22.736 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.736 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.736 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.737 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:22.737 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.737 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.737 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.737 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.737 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.738 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.738 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.738 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.738 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-10-19T12:59:22.738 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-10-19T12:59:22.739 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.739 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.739 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.739 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-10-19T12:59:22.739 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.740 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.740 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.740 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.740 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.740 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.741 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.741 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.741 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-10-19T12:59:22.741 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-10-19T12:59:22.741 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:22.742 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.742 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.742 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "10", 2023-10-19T12:59:22.742 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.742 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.743 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.743 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.743 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.743 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.743 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.743 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.744 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-10-19T12:59:22.744 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-10-19T12:59:22.744 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:22.744 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.744 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.745 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "8", 2023-10-19T12:59:22.745 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.745 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.745 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.745 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.745 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.746 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.746 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.746 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.746 INFO:teuthology.orchestra.run.smithi046.stdout: "REST_REQUESTS_TIMEOUT": { 2023-10-19T12:59:22.746 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-10-19T12:59:22.747 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:22.747 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.747 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.747 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "45", 2023-10-19T12:59:22.747 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.748 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.748 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.748 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.748 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.748 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.748 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.749 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.749 INFO:teuthology.orchestra.run.smithi046.stdout: "RGW_API_ACCESS_KEY": { 2023-10-19T12:59:22.749 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "RGW_API_ACCESS_KEY", 2023-10-19T12:59:22.749 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.749 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.750 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.750 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:22.750 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.750 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.750 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.751 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.751 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.751 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.751 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.753 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.753 INFO:teuthology.orchestra.run.smithi046.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-10-19T12:59:22.753 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-10-19T12:59:22.754 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.754 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.754 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.754 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "admin", 2023-10-19T12:59:22.754 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.755 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.755 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.755 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.755 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.755 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.755 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.756 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.756 INFO:teuthology.orchestra.run.smithi046.stdout: "RGW_API_SECRET_KEY": { 2023-10-19T12:59:22.756 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "RGW_API_SECRET_KEY", 2023-10-19T12:59:22.756 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.756 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.757 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.757 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:22.757 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.757 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.757 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.757 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.758 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.758 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.758 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.758 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.758 INFO:teuthology.orchestra.run.smithi046.stdout: "RGW_API_SSL_VERIFY": { 2023-10-19T12:59:22.759 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "RGW_API_SSL_VERIFY", 2023-10-19T12:59:22.759 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.759 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.759 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.759 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:22.759 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.760 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.760 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.760 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.760 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.760 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.761 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.761 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.761 INFO:teuthology.orchestra.run.smithi046.stdout: "UNSAFE_TLS_v1_2": { 2023-10-19T12:59:22.761 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "UNSAFE_TLS_v1_2", 2023-10-19T12:59:22.761 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.761 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.762 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.762 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:22.762 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.762 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.762 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.763 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.763 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.763 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.763 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.763 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.764 INFO:teuthology.orchestra.run.smithi046.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-10-19T12:59:22.764 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-10-19T12:59:22.764 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:22.764 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.764 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.765 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2023-10-19T12:59:22.765 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.765 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.765 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.765 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.766 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.766 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.766 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.766 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.766 INFO:teuthology.orchestra.run.smithi046.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-10-19T12:59:22.767 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-10-19T12:59:22.767 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:22.767 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.767 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.767 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "10", 2023-10-19T12:59:22.767 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.768 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.768 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.768 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.768 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.768 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.769 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.769 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.769 INFO:teuthology.orchestra.run.smithi046.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-10-19T12:59:22.769 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-10-19T12:59:22.769 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:22.769 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.770 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.770 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "5", 2023-10-19T12:59:22.770 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.770 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.770 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.771 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.771 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.771 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.771 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.771 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.772 INFO:teuthology.orchestra.run.smithi046.stdout: "cross_origin_url": { 2023-10-19T12:59:22.772 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "cross_origin_url", 2023-10-19T12:59:22.772 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.772 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.772 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.773 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:22.773 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.773 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.773 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.773 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.773 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.774 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.774 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.774 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.774 INFO:teuthology.orchestra.run.smithi046.stdout: "crt_file": { 2023-10-19T12:59:22.774 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "crt_file", 2023-10-19T12:59:22.775 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.775 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.775 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.775 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:22.775 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.776 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.776 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.776 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.776 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.776 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.777 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.777 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.777 INFO:teuthology.orchestra.run.smithi046.stdout: "debug": { 2023-10-19T12:59:22.777 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "debug", 2023-10-19T12:59:22.777 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.777 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.778 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.778 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:22.778 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.778 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.778 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.779 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Enable/disable debug options", 2023-10-19T12:59:22.779 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.779 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.779 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.779 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.780 INFO:teuthology.orchestra.run.smithi046.stdout: "jwt_token_ttl": { 2023-10-19T12:59:22.780 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "jwt_token_ttl", 2023-10-19T12:59:22.780 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:22.780 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.780 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.780 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "28800", 2023-10-19T12:59:22.781 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.781 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.781 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.781 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.781 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.782 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.782 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.782 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.782 INFO:teuthology.orchestra.run.smithi046.stdout: "key_file": { 2023-10-19T12:59:22.782 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "key_file", 2023-10-19T12:59:22.783 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.783 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.783 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.783 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:22.783 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.783 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.784 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.784 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.784 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.784 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.784 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.785 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.785 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:22.785 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:22.785 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.785 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.785 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.786 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:22.786 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.786 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.786 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:22.786 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:22.787 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:22.787 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:22.787 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:22.787 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:22.787 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:22.788 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:22.788 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.788 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.788 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.788 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.788 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.789 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:22.789 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:22.789 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.789 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.789 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.789 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:22.790 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.790 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.790 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.790 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.790 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.791 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.791 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.791 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.791 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:22.791 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:22.791 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.792 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.792 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.792 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:22.792 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.792 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.793 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:22.793 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:22.793 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:22.793 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:22.793 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:22.793 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:22.794 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:22.794 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:22.794 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.794 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.794 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.795 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.795 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.795 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:22.795 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:22.795 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.796 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.796 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.796 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:22.796 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.796 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.796 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.797 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.797 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.797 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.797 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.797 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.798 INFO:teuthology.orchestra.run.smithi046.stdout: "motd": { 2023-10-19T12:59:22.798 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "motd", 2023-10-19T12:59:22.798 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.798 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.798 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.799 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:22.799 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.799 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.799 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.799 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "The message of the day", 2023-10-19T12:59:22.800 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.800 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.800 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.800 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.800 INFO:teuthology.orchestra.run.smithi046.stdout: "redirect_resolve_ip_addr": { 2023-10-19T12:59:22.800 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "redirect_resolve_ip_addr", 2023-10-19T12:59:22.801 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.801 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.801 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.801 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:22.801 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.801 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.802 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.802 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.802 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.802 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.802 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.803 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.803 INFO:teuthology.orchestra.run.smithi046.stdout: "server_addr": { 2023-10-19T12:59:22.803 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "server_addr", 2023-10-19T12:59:22.803 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.803 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.804 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.804 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "::", 2023-10-19T12:59:22.804 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.804 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.804 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.804 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.805 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.805 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.805 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.805 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.805 INFO:teuthology.orchestra.run.smithi046.stdout: "server_port": { 2023-10-19T12:59:22.806 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "server_port", 2023-10-19T12:59:22.806 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:22.806 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.806 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.806 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "8080", 2023-10-19T12:59:22.807 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.807 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.807 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.807 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.807 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.808 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.808 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.808 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.808 INFO:teuthology.orchestra.run.smithi046.stdout: "ssl": { 2023-10-19T12:59:22.808 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ssl", 2023-10-19T12:59:22.808 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.809 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.809 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.809 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:22.809 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.809 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.809 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.810 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.810 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.810 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.810 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.810 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.811 INFO:teuthology.orchestra.run.smithi046.stdout: "ssl_server_port": { 2023-10-19T12:59:22.811 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ssl_server_port", 2023-10-19T12:59:22.811 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:22.811 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.811 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.812 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "8443", 2023-10-19T12:59:22.812 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.812 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.812 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.812 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.812 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.813 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.813 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.813 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.813 INFO:teuthology.orchestra.run.smithi046.stdout: "standby_behaviour": { 2023-10-19T12:59:22.813 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "standby_behaviour", 2023-10-19T12:59:22.814 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.814 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.814 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.814 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "redirect", 2023-10-19T12:59:22.814 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.815 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.815 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:22.815 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:22.815 INFO:teuthology.orchestra.run.smithi046.stdout: "redirect" 2023-10-19T12:59:22.815 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:22.816 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.816 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.816 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.816 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.816 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.816 INFO:teuthology.orchestra.run.smithi046.stdout: "standby_error_status_code": { 2023-10-19T12:59:22.817 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "standby_error_status_code", 2023-10-19T12:59:22.817 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:22.817 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.817 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.817 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "500", 2023-10-19T12:59:22.818 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "400", 2023-10-19T12:59:22.818 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "599", 2023-10-19T12:59:22.818 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.818 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.818 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.819 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.819 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.819 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.819 INFO:teuthology.orchestra.run.smithi046.stdout: "url_prefix": { 2023-10-19T12:59:22.819 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "url_prefix", 2023-10-19T12:59:22.819 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.820 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.820 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.820 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:22.820 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.820 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.820 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.821 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.821 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.821 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.821 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.821 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:22.821 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:22.822 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.822 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:22.822 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "devicehealth", 2023-10-19T12:59:22.822 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:22.822 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:22.823 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:22.823 INFO:teuthology.orchestra.run.smithi046.stdout: "enable_monitoring": { 2023-10-19T12:59:22.823 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "enable_monitoring", 2023-10-19T12:59:22.823 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.823 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.823 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.824 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:22.824 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.824 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.824 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.824 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "monitor device health metrics", 2023-10-19T12:59:22.824 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.825 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.825 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.825 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.825 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:22.825 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:22.826 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.826 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.826 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.826 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:22.826 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.827 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.827 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:22.827 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:22.827 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:22.827 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:22.827 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:22.828 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:22.828 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:22.828 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:22.828 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.828 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.828 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.829 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.829 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.829 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:22.829 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:22.829 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.830 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.830 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.830 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:22.830 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.830 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.830 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.831 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.831 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.831 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.831 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.831 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.831 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:22.832 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:22.832 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.832 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.832 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.832 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:22.832 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.833 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.833 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:22.833 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:22.833 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:22.833 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:22.834 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:22.834 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:22.834 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:22.834 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:22.834 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.835 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.835 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.835 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.835 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.835 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:22.835 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:22.836 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.836 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.836 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.836 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:22.836 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.837 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.837 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.837 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.837 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.837 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.837 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.838 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.838 INFO:teuthology.orchestra.run.smithi046.stdout: "mark_out_threshold": { 2023-10-19T12:59:22.838 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "mark_out_threshold", 2023-10-19T12:59:22.838 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2023-10-19T12:59:22.838 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.839 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.839 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "2419200", 2023-10-19T12:59:22.839 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.839 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.839 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.839 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-10-19T12:59:22.840 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.840 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.840 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.840 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.840 INFO:teuthology.orchestra.run.smithi046.stdout: "pool_name": { 2023-10-19T12:59:22.841 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "pool_name", 2023-10-19T12:59:22.841 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.841 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.841 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.841 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "device_health_metrics", 2023-10-19T12:59:22.841 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.842 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.842 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.842 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "name of pool in which to store device health metrics", 2023-10-19T12:59:22.842 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.842 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.843 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.843 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.843 INFO:teuthology.orchestra.run.smithi046.stdout: "retention_period": { 2023-10-19T12:59:22.843 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "retention_period", 2023-10-19T12:59:22.843 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2023-10-19T12:59:22.843 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.844 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.844 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "15552000", 2023-10-19T12:59:22.844 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.844 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.844 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.845 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "how long to retain device health metrics", 2023-10-19T12:59:22.845 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.845 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.845 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.845 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.845 INFO:teuthology.orchestra.run.smithi046.stdout: "scrape_frequency": { 2023-10-19T12:59:22.846 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "scrape_frequency", 2023-10-19T12:59:22.846 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2023-10-19T12:59:22.846 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.846 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.846 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "86400", 2023-10-19T12:59:22.847 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.847 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.847 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.847 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "how frequently to scrape device health metrics", 2023-10-19T12:59:22.847 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.847 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.848 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.848 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.848 INFO:teuthology.orchestra.run.smithi046.stdout: "self_heal": { 2023-10-19T12:59:22.848 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "self_heal", 2023-10-19T12:59:22.848 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.849 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.849 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.849 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:22.849 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.849 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.849 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.850 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-10-19T12:59:22.850 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.850 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.850 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.850 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.850 INFO:teuthology.orchestra.run.smithi046.stdout: "sleep_interval": { 2023-10-19T12:59:22.851 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sleep_interval", 2023-10-19T12:59:22.851 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2023-10-19T12:59:22.851 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.851 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.851 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "600", 2023-10-19T12:59:22.851 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.852 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.852 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.852 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "how frequently to wake up and check device health", 2023-10-19T12:59:22.852 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.852 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.853 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.853 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.853 INFO:teuthology.orchestra.run.smithi046.stdout: "warn_threshold": { 2023-10-19T12:59:22.853 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "warn_threshold", 2023-10-19T12:59:22.854 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2023-10-19T12:59:22.854 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.854 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.854 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "7257600", 2023-10-19T12:59:22.855 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.855 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.855 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.855 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-10-19T12:59:22.855 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.856 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.856 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.856 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:22.856 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:22.856 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.857 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:22.857 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "diskprediction_local", 2023-10-19T12:59:22.857 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:22.857 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:22.858 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:22.858 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:22.858 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:22.858 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.858 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.859 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.859 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:22.859 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.859 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.860 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:22.860 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:22.860 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:22.860 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:22.860 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:22.861 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:22.861 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:22.861 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:22.861 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.862 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.862 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.862 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.862 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.862 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:22.863 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:22.863 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.863 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.863 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.864 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:22.864 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.864 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.864 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.864 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.865 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.865 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.865 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.865 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.866 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:22.866 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:22.866 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.866 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.866 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.867 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:22.867 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.867 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.867 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:22.868 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:22.868 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:22.868 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:22.868 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:22.868 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:22.869 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:22.869 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:22.869 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.869 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.869 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.870 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.870 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.870 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:22.870 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:22.870 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.871 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.871 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.871 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:22.871 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.871 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.872 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.872 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.872 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.872 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.872 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.873 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.873 INFO:teuthology.orchestra.run.smithi046.stdout: "predict_interval": { 2023-10-19T12:59:22.873 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "predict_interval", 2023-10-19T12:59:22.873 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.873 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.873 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.874 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "86400", 2023-10-19T12:59:22.874 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.874 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.874 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.874 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.875 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.875 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.875 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.875 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.875 INFO:teuthology.orchestra.run.smithi046.stdout: "predictor_model": { 2023-10-19T12:59:22.876 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "predictor_model", 2023-10-19T12:59:22.876 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.876 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.876 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.876 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "prophetstor", 2023-10-19T12:59:22.876 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.877 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.877 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.877 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.877 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.877 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.878 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.878 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.878 INFO:teuthology.orchestra.run.smithi046.stdout: "sleep_interval": { 2023-10-19T12:59:22.878 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sleep_interval", 2023-10-19T12:59:22.878 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.879 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.879 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.879 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "600", 2023-10-19T12:59:22.879 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.879 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.880 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.880 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.880 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.880 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.880 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.880 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:22.881 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:22.881 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.881 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:22.881 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "influx", 2023-10-19T12:59:22.881 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": false, 2023-10-19T12:59:22.882 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "influxdb python module not found", 2023-10-19T12:59:22.882 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:22.882 INFO:teuthology.orchestra.run.smithi046.stdout: "batch_size": { 2023-10-19T12:59:22.882 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "batch_size", 2023-10-19T12:59:22.882 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:22.883 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.883 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.883 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "5000", 2023-10-19T12:59:22.883 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.883 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.883 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.884 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-10-19T12:59:22.884 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.884 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.884 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.884 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.884 INFO:teuthology.orchestra.run.smithi046.stdout: "database": { 2023-10-19T12:59:22.885 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "database", 2023-10-19T12:59:22.885 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.885 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.885 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.885 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "ceph", 2023-10-19T12:59:22.886 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.886 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.886 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.886 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-10-19T12:59:22.886 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.887 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.887 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.887 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.887 INFO:teuthology.orchestra.run.smithi046.stdout: "hostname": { 2023-10-19T12:59:22.887 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "hostname", 2023-10-19T12:59:22.888 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.888 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.888 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.888 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:22.888 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.888 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.889 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.889 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "InfluxDB server hostname", 2023-10-19T12:59:22.889 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.889 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.889 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.890 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.890 INFO:teuthology.orchestra.run.smithi046.stdout: "interval": { 2023-10-19T12:59:22.890 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "interval", 2023-10-19T12:59:22.890 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2023-10-19T12:59:22.890 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.891 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.891 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "30", 2023-10-19T12:59:22.891 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "5", 2023-10-19T12:59:22.891 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.891 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.891 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-10-19T12:59:22.892 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.892 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.892 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.892 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.892 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:22.892 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:22.893 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.893 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.893 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.893 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:22.893 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.894 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.894 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:22.894 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:22.894 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:22.894 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:22.895 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:22.895 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:22.895 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:22.895 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:22.895 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.896 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.896 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.896 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.896 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.896 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:22.897 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:22.897 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.897 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.897 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.897 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:22.898 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.898 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.898 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.898 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.898 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.898 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.899 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.899 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.899 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:22.899 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:22.899 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.900 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.900 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.900 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:22.900 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.900 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.900 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:22.901 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:22.901 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:22.901 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:22.901 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:22.901 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:22.902 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:22.902 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:22.902 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.902 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.902 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.902 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.903 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.903 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:22.903 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:22.903 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.903 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.904 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.904 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:22.904 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.904 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.904 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.905 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.905 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.905 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.905 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.905 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.906 INFO:teuthology.orchestra.run.smithi046.stdout: "password": { 2023-10-19T12:59:22.906 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "password", 2023-10-19T12:59:22.906 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.906 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.906 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.907 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:22.907 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.907 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.907 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.907 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "password of InfluxDB server user", 2023-10-19T12:59:22.907 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.908 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.908 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.908 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.908 INFO:teuthology.orchestra.run.smithi046.stdout: "port": { 2023-10-19T12:59:22.908 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "port", 2023-10-19T12:59:22.909 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:22.909 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.909 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.909 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "8086", 2023-10-19T12:59:22.909 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.910 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.910 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.910 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "InfluxDB server port", 2023-10-19T12:59:22.910 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.910 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.911 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.911 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.911 INFO:teuthology.orchestra.run.smithi046.stdout: "ssl": { 2023-10-19T12:59:22.911 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ssl", 2023-10-19T12:59:22.911 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.911 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.912 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.912 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "false", 2023-10-19T12:59:22.912 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.912 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.912 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.913 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-10-19T12:59:22.913 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.913 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.913 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.913 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.913 INFO:teuthology.orchestra.run.smithi046.stdout: "threads": { 2023-10-19T12:59:22.914 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "threads", 2023-10-19T12:59:22.914 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:22.914 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.914 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.914 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "5", 2023-10-19T12:59:22.915 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "1", 2023-10-19T12:59:22.915 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "32", 2023-10-19T12:59:22.915 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.915 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-10-19T12:59:22.915 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.916 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.916 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.916 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.916 INFO:teuthology.orchestra.run.smithi046.stdout: "username": { 2023-10-19T12:59:22.916 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "username", 2023-10-19T12:59:22.916 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.917 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.917 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.917 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:22.917 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.917 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.918 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.918 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "username of InfluxDB server user", 2023-10-19T12:59:22.918 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.918 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.918 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.919 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.919 INFO:teuthology.orchestra.run.smithi046.stdout: "verify_ssl": { 2023-10-19T12:59:22.919 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "verify_ssl", 2023-10-19T12:59:22.919 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.919 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.919 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.920 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "true", 2023-10-19T12:59:22.920 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.920 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.920 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.920 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-10-19T12:59:22.921 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.921 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.921 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.921 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:22.921 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:22.921 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.922 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:22.922 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "insights", 2023-10-19T12:59:22.922 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:22.922 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:22.922 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:22.923 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:22.923 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:22.923 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.923 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.923 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.924 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:22.924 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.924 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.924 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:22.924 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:22.924 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:22.925 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:22.925 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:22.925 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:22.925 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:22.925 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:22.926 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.926 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.926 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.926 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.926 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.927 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:22.927 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:22.927 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.927 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.927 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.927 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:22.928 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.928 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.928 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.928 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.928 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.929 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.929 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.929 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.929 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:22.929 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:22.930 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.930 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.930 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.930 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:22.930 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.931 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.931 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:22.931 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:22.931 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:22.931 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:22.931 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:22.932 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:22.932 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:22.932 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:22.932 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.932 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.932 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.933 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.933 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.933 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:22.933 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:22.933 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.934 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.934 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.934 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:22.934 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.934 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.935 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.935 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.935 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.935 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.935 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.935 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:22.936 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:22.936 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.936 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:22.936 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "iostat", 2023-10-19T12:59:22.936 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:22.937 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:22.937 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:22.937 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:22.937 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:22.937 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.938 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.938 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.938 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:22.938 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.938 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.938 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:22.939 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:22.939 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:22.939 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:22.939 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:22.939 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:22.940 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:22.940 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:22.940 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.940 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.940 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.941 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.941 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.941 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:22.941 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:22.941 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.942 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.942 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.942 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:22.942 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.942 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.943 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.943 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.943 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.943 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.943 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.944 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.944 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:22.944 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:22.944 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.944 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.944 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.945 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:22.945 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.945 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.945 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:22.945 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:22.946 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:22.946 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:22.946 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:22.946 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:22.946 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:22.947 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:22.947 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.947 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.947 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.947 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.948 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.948 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:22.948 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:22.948 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.948 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.948 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.949 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:22.949 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.949 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.949 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.949 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.950 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.950 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.950 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.950 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:22.950 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:22.951 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.951 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:22.951 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "k8sevents", 2023-10-19T12:59:22.951 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:22.951 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:22.951 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:22.952 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph_event_retention_days": { 2023-10-19T12:59:22.952 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ceph_event_retention_days", 2023-10-19T12:59:22.952 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:22.952 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.952 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.953 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "7", 2023-10-19T12:59:22.953 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.953 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.953 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.953 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Days to hold ceph event information within local cache", 2023-10-19T12:59:22.954 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.954 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.954 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.954 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.954 INFO:teuthology.orchestra.run.smithi046.stdout: "config_check_secs": { 2023-10-19T12:59:22.955 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "config_check_secs", 2023-10-19T12:59:22.955 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:22.955 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.955 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:22.955 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "10", 2023-10-19T12:59:22.955 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "10", 2023-10-19T12:59:22.956 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.956 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.956 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2023-10-19T12:59:22.956 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.956 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.957 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.957 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.957 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:22.957 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:22.957 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.958 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.958 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.958 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:22.958 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.958 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.959 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:22.959 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:22.959 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:22.959 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:22.959 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:22.959 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:22.960 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:22.960 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:22.960 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.960 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.960 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.961 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.961 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.961 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:22.961 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:22.961 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.962 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.962 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.962 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:22.962 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.962 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.962 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.963 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.963 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.963 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.963 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.963 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.964 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:22.964 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:22.964 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.964 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.964 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.965 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:22.965 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.965 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.965 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:22.965 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:22.965 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:22.966 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:22.966 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:22.966 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:22.966 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:22.966 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:22.967 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.967 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.967 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.967 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.967 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.968 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:22.968 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:22.968 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.968 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.968 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.968 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:22.969 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.969 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.969 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.969 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.969 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.970 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.970 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.970 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:22.970 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:22.970 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.970 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:22.971 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "localpool", 2023-10-19T12:59:22.971 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:22.971 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:22.971 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:22.971 INFO:teuthology.orchestra.run.smithi046.stdout: "failure_domain": { 2023-10-19T12:59:22.972 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "failure_domain", 2023-10-19T12:59:22.972 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.972 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.972 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.972 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "host", 2023-10-19T12:59:22.973 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.973 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.973 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.973 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "failure domain for any created local pool", 2023-10-19T12:59:22.973 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-10-19T12:59:22.974 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.974 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.974 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.974 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:22.974 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:22.974 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.975 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.975 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.975 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:22.975 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.975 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.976 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:22.976 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:22.976 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:22.976 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:22.976 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:22.976 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:22.977 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:22.977 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:22.977 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.977 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.977 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.978 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.978 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.978 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:22.978 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:22.978 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.979 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.979 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.979 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:22.979 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.979 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.980 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.980 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.980 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.980 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.980 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.980 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.981 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:22.981 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:22.981 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.981 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.981 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.982 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:22.982 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.982 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.982 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:22.982 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:22.982 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:22.983 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:22.983 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:22.983 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:22.983 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:22.983 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:22.984 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.984 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.984 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.984 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.984 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.985 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:22.985 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:22.985 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:22.985 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.985 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.985 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:22.986 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.986 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.986 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.986 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:22.986 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.987 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.987 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.987 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.987 INFO:teuthology.orchestra.run.smithi046.stdout: "min_size": { 2023-10-19T12:59:22.987 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "min_size", 2023-10-19T12:59:22.988 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:22.988 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.988 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.988 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:22.988 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.988 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.989 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.989 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "default min_size for any created local pool", 2023-10-19T12:59:22.989 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-10-19T12:59:22.989 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.989 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.990 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.990 INFO:teuthology.orchestra.run.smithi046.stdout: "num_rep": { 2023-10-19T12:59:22.990 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "num_rep", 2023-10-19T12:59:22.990 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:22.990 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.991 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.991 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "3", 2023-10-19T12:59:22.991 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.991 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.991 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.991 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "default replica count for any created local pool", 2023-10-19T12:59:22.992 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.992 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.992 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.992 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.992 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_num": { 2023-10-19T12:59:22.993 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "pg_num", 2023-10-19T12:59:22.993 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:22.993 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.993 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.993 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "128", 2023-10-19T12:59:22.993 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.994 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.994 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.994 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "default pg_num for any created local pool", 2023-10-19T12:59:22.994 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.994 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.995 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.995 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.995 INFO:teuthology.orchestra.run.smithi046.stdout: "prefix": { 2023-10-19T12:59:22.995 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "prefix", 2023-10-19T12:59:22.995 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.995 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.996 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.996 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:22.996 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.996 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.996 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.997 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "name prefix for any created local pool", 2023-10-19T12:59:22.997 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:22.997 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:22.997 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:22.997 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:22.998 INFO:teuthology.orchestra.run.smithi046.stdout: "subtree": { 2023-10-19T12:59:22.998 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "subtree", 2023-10-19T12:59:22.998 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:22.998 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:22.998 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:22.998 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "rack", 2023-10-19T12:59:22.999 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:22.999 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:22.999 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:22.999 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "CRUSH level for which to create a local pool", 2023-10-19T12:59:22.999 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-10-19T12:59:23.000 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.000 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.000 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:23.000 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:23.000 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.001 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:23.001 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "mds_autoscaler", 2023-10-19T12:59:23.001 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:23.001 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:23.001 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:23.001 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:23.002 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:23.002 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.002 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.002 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.002 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:23.003 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.003 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.003 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:23.003 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:23.003 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:23.004 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:23.004 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:23.004 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:23.004 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:23.004 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:23.005 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.005 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.005 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.005 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.005 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.005 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:23.006 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:23.006 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.006 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.006 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.006 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:23.007 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.007 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.007 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.007 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.007 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.008 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.008 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.008 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.008 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:23.008 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:23.008 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.009 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.009 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.009 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:23.009 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.009 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.010 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:23.010 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:23.010 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:23.010 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:23.010 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:23.011 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:23.011 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:23.011 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:23.011 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.011 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.011 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.012 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.012 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.012 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:23.012 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:23.013 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.013 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.013 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.013 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:23.013 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.014 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.014 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.014 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.015 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.015 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.015 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.015 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:23.016 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:23.016 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.016 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:23.016 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "mirroring", 2023-10-19T12:59:23.016 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:23.016 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:23.017 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:23.017 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:23.017 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:23.017 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.017 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.018 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.018 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:23.018 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.018 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.018 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:23.019 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:23.019 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:23.019 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:23.019 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:23.019 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:23.020 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:23.020 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:23.020 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.020 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.020 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.020 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.021 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.021 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:23.021 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:23.021 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.021 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.022 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.022 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:23.022 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.022 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.023 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.023 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.023 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.023 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.023 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.024 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.024 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:23.024 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:23.024 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.024 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.025 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.025 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:23.025 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.025 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.025 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:23.026 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:23.026 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:23.026 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:23.026 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:23.026 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:23.027 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:23.027 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:23.027 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.027 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.028 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.028 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.028 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.028 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:23.028 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:23.029 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.029 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.029 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.029 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:23.030 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.030 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.030 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.030 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.030 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.031 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.031 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.031 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:23.031 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:23.032 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.032 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:23.032 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "nfs", 2023-10-19T12:59:23.032 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:23.032 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:23.033 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:23.033 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:23.034 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:23.034 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.034 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.034 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.035 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:23.035 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.035 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.035 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:23.035 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:23.036 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:23.036 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:23.036 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:23.036 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:23.036 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:23.036 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:23.037 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.037 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.037 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.037 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.037 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.038 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:23.038 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:23.038 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.038 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.038 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.039 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:23.039 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.039 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.039 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.040 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.040 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.040 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.040 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.040 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.041 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:23.041 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:23.041 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.041 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.041 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.042 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:23.042 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.042 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.042 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:23.042 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:23.042 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:23.043 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:23.043 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:23.043 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:23.043 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:23.043 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:23.044 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.044 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.044 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.044 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.044 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.045 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:23.045 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:23.045 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.045 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.045 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.045 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:23.046 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.046 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.046 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.046 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.046 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.047 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.047 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.047 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:23.047 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:23.047 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.048 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:23.048 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "orchestrator", 2023-10-19T12:59:23.048 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:23.048 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:23.048 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:23.048 INFO:teuthology.orchestra.run.smithi046.stdout: "fail_fs": { 2023-10-19T12:59:23.049 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "fail_fs", 2023-10-19T12:59:23.049 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.049 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.049 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.049 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:23.050 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.050 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.050 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.050 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2023-10-19T12:59:23.050 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.050 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.051 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.051 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.051 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:23.051 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:23.051 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.052 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.052 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.052 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:23.052 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.052 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.053 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:23.053 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:23.053 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:23.053 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:23.053 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:23.054 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:23.054 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:23.054 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:23.054 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.054 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.055 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.055 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.055 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.055 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:23.055 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:23.056 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.056 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.056 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.056 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:23.056 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.057 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.057 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.057 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.057 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.057 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.058 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.058 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.058 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:23.058 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:23.058 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.059 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.059 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.059 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:23.059 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.059 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.060 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:23.060 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:23.060 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:23.060 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:23.060 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:23.061 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:23.061 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:23.061 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:23.061 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.061 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.062 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.062 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.062 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.062 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:23.062 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:23.063 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.063 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.063 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.063 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:23.063 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.064 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.064 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.064 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.064 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.064 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.065 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.065 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.065 INFO:teuthology.orchestra.run.smithi046.stdout: "orchestrator": { 2023-10-19T12:59:23.065 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "orchestrator", 2023-10-19T12:59:23.065 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.066 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.066 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.066 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:23.066 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.066 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.067 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:23.067 INFO:teuthology.orchestra.run.smithi046.stdout: "cephadm", 2023-10-19T12:59:23.067 INFO:teuthology.orchestra.run.smithi046.stdout: "rook", 2023-10-19T12:59:23.067 INFO:teuthology.orchestra.run.smithi046.stdout: "test_orchestrator" 2023-10-19T12:59:23.067 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:23.068 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Orchestrator backend", 2023-10-19T12:59:23.068 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.068 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.068 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.068 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:23.069 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:23.069 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.069 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:23.069 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "osd_perf_query", 2023-10-19T12:59:23.069 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:23.070 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:23.070 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:23.070 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:23.070 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:23.070 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.071 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.071 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.071 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:23.071 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.071 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.071 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:23.072 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:23.072 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:23.072 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:23.072 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:23.072 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:23.073 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:23.073 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:23.073 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.073 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.073 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.074 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.074 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.074 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:23.074 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:23.074 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.075 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.075 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.075 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:23.075 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.075 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.076 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.076 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.076 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.076 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.076 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.077 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.077 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:23.077 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:23.077 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.077 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.077 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.078 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:23.078 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.078 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.078 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:23.078 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:23.079 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:23.079 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:23.079 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:23.079 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:23.079 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:23.080 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:23.080 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.080 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.080 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.080 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.081 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.081 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:23.081 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:23.081 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.081 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.081 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.082 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:23.082 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.082 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.082 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.082 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.083 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.083 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.083 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.083 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:23.083 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:23.084 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.084 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:23.084 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "osd_support", 2023-10-19T12:59:23.084 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:23.084 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:23.085 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:23.085 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:23.085 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:23.085 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.085 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.086 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.086 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:23.086 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.086 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.086 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:23.086 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:23.087 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:23.087 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:23.087 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:23.087 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:23.087 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:23.088 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:23.088 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.088 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.088 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.088 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.089 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.089 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:23.089 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:23.089 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.089 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.090 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.090 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:23.090 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.090 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.090 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.091 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.091 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.091 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.091 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.091 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.092 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:23.092 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:23.092 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.092 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.092 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.093 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:23.093 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.093 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.093 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:23.094 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:23.094 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:23.094 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:23.094 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:23.094 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:23.095 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:23.095 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:23.095 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.095 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.095 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.096 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.096 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.096 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:23.096 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:23.096 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.097 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.097 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.097 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:23.097 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.098 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.098 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.098 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.098 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.099 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.099 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.099 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:23.099 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:23.099 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.100 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:23.100 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "pg_autoscaler", 2023-10-19T12:59:23.100 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:23.100 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:23.100 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:23.101 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:23.101 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:23.101 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.101 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.101 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.101 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:23.102 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.102 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.102 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:23.102 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:23.102 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:23.103 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:23.103 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:23.103 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:23.103 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:23.103 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:23.104 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.104 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.104 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.104 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.104 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.105 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:23.105 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:23.105 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.105 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.105 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.106 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:23.106 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.106 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.106 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.106 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.107 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.107 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.107 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.107 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.107 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:23.108 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:23.108 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.108 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.108 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.108 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:23.109 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.109 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.109 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:23.109 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:23.109 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:23.110 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:23.110 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:23.110 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:23.110 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:23.110 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:23.110 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.111 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.111 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.111 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.111 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.111 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:23.112 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:23.112 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.112 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.112 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.113 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:23.113 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.113 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.113 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.113 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.114 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.114 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.114 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.114 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.115 INFO:teuthology.orchestra.run.smithi046.stdout: "sleep_interval": { 2023-10-19T12:59:23.115 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sleep_interval", 2023-10-19T12:59:23.115 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2023-10-19T12:59:23.115 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.115 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.116 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "60", 2023-10-19T12:59:23.116 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.116 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.116 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.116 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.117 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.117 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.117 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.117 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.117 INFO:teuthology.orchestra.run.smithi046.stdout: "threshold": { 2023-10-19T12:59:23.118 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "threshold", 2023-10-19T12:59:23.118 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "float", 2023-10-19T12:59:23.118 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.118 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.118 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "3.0", 2023-10-19T12:59:23.119 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "1.0", 2023-10-19T12:59:23.119 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.119 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.119 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "scaling threshold", 2023-10-19T12:59:23.119 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-10-19T12:59:23.120 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.120 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.120 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:23.120 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:23.120 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.120 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:23.121 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "progress", 2023-10-19T12:59:23.121 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:23.121 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:23.121 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:23.121 INFO:teuthology.orchestra.run.smithi046.stdout: "allow_pg_recovery_event": { 2023-10-19T12:59:23.122 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "allow_pg_recovery_event", 2023-10-19T12:59:23.122 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.122 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.122 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.122 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:23.123 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.123 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.123 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.123 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "allow the module to show pg recovery progress", 2023-10-19T12:59:23.123 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.123 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.124 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.124 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.124 INFO:teuthology.orchestra.run.smithi046.stdout: "enabled": { 2023-10-19T12:59:23.124 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "enabled", 2023-10-19T12:59:23.124 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.124 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.125 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.125 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:23.125 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.125 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.125 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.126 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.126 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.126 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.126 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.126 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.126 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:23.127 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:23.127 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.127 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.127 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.128 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:23.128 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.128 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.128 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:23.129 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:23.129 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:23.129 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:23.129 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:23.129 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:23.129 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:23.130 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:23.130 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.130 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.130 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.131 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.131 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.131 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:23.131 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:23.131 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.132 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.132 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.132 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:23.132 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.132 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.132 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.133 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.133 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.133 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.133 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.133 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.134 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:23.134 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:23.134 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.134 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.135 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.135 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:23.135 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.135 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.135 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:23.135 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:23.136 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:23.136 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:23.136 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:23.136 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:23.136 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:23.137 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:23.137 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.137 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.137 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.138 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.138 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.138 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:23.138 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:23.138 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.139 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.139 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.139 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:23.139 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.139 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.140 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.140 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.140 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.140 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.140 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.141 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.141 INFO:teuthology.orchestra.run.smithi046.stdout: "max_completed_events": { 2023-10-19T12:59:23.141 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "max_completed_events", 2023-10-19T12:59:23.141 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:23.142 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.142 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.142 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "50", 2023-10-19T12:59:23.142 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.142 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.143 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.143 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "number of past completed events to remember", 2023-10-19T12:59:23.143 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.143 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.143 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.144 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.144 INFO:teuthology.orchestra.run.smithi046.stdout: "sleep_interval": { 2023-10-19T12:59:23.144 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sleep_interval", 2023-10-19T12:59:23.144 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2023-10-19T12:59:23.144 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.145 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.145 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "5", 2023-10-19T12:59:23.145 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.145 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.145 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.146 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "how long the module is going to sleep", 2023-10-19T12:59:23.146 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.146 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.146 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.146 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:23.147 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:23.147 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.147 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:23.147 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "prometheus", 2023-10-19T12:59:23.147 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:23.148 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:23.148 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:23.148 INFO:teuthology.orchestra.run.smithi046.stdout: "cache": { 2023-10-19T12:59:23.148 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "cache", 2023-10-19T12:59:23.148 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.149 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.149 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.149 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:23.149 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.149 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.150 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.150 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.150 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.150 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.150 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.151 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.151 INFO:teuthology.orchestra.run.smithi046.stdout: "exclude_perf_counters": { 2023-10-19T12:59:23.151 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "exclude_perf_counters", 2023-10-19T12:59:23.151 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.152 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.152 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.152 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:23.152 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.152 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.153 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.153 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Do not include perf-counters in the metrics output", 2023-10-19T12:59:23.153 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2023-10-19T12:59:23.153 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.153 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.153 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.154 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:23.154 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:23.154 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.154 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.154 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.155 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:23.155 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.157 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.157 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:23.157 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:23.158 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:23.158 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:23.158 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:23.158 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:23.158 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:23.159 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:23.159 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.159 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.159 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.159 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.160 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.160 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:23.160 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:23.160 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.160 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.161 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.161 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:23.161 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.161 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.161 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.162 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.162 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.162 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.162 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.162 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.162 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:23.163 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:23.163 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.163 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.163 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.163 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:23.163 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.164 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.164 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:23.164 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:23.164 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:23.164 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:23.164 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:23.165 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:23.165 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:23.165 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:23.165 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.166 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.166 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.166 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.166 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.166 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:23.167 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:23.167 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.167 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.167 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.167 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:23.168 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.168 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.168 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.168 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.168 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.169 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.169 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.169 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.169 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_stats_pools": { 2023-10-19T12:59:23.169 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rbd_stats_pools", 2023-10-19T12:59:23.170 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.170 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.170 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.170 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:23.170 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.171 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.171 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.171 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.171 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.171 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.172 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.172 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.172 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_stats_pools_refresh_interval": { 2023-10-19T12:59:23.172 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-10-19T12:59:23.172 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:23.172 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.173 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.173 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "300", 2023-10-19T12:59:23.173 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.173 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.173 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.174 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.174 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.174 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.174 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.174 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.175 INFO:teuthology.orchestra.run.smithi046.stdout: "scrape_interval": { 2023-10-19T12:59:23.175 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "scrape_interval", 2023-10-19T12:59:23.175 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "float", 2023-10-19T12:59:23.175 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.175 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.176 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "15.0", 2023-10-19T12:59:23.176 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.176 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.176 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.176 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.177 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.177 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.177 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.177 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.177 INFO:teuthology.orchestra.run.smithi046.stdout: "server_addr": { 2023-10-19T12:59:23.178 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "server_addr", 2023-10-19T12:59:23.178 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.178 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.178 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.178 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "::", 2023-10-19T12:59:23.179 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.179 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.179 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.179 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-10-19T12:59:23.179 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.180 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.180 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.180 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.180 INFO:teuthology.orchestra.run.smithi046.stdout: "server_port": { 2023-10-19T12:59:23.180 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "server_port", 2023-10-19T12:59:23.181 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:23.181 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.181 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.181 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "9283", 2023-10-19T12:59:23.181 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.182 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.182 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.182 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-10-19T12:59:23.182 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.182 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.182 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.183 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.183 INFO:teuthology.orchestra.run.smithi046.stdout: "stale_cache_strategy": { 2023-10-19T12:59:23.183 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "stale_cache_strategy", 2023-10-19T12:59:23.183 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.183 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.184 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.184 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "log", 2023-10-19T12:59:23.184 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.184 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.184 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.185 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.185 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.185 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.185 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.185 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.186 INFO:teuthology.orchestra.run.smithi046.stdout: "standby_behaviour": { 2023-10-19T12:59:23.186 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "standby_behaviour", 2023-10-19T12:59:23.186 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.186 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.186 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.187 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "default", 2023-10-19T12:59:23.187 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.187 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.187 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:23.187 INFO:teuthology.orchestra.run.smithi046.stdout: "default", 2023-10-19T12:59:23.188 INFO:teuthology.orchestra.run.smithi046.stdout: "error" 2023-10-19T12:59:23.188 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:23.188 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.188 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.188 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.188 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.189 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.189 INFO:teuthology.orchestra.run.smithi046.stdout: "standby_error_status_code": { 2023-10-19T12:59:23.189 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "standby_error_status_code", 2023-10-19T12:59:23.189 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:23.189 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.190 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.190 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "500", 2023-10-19T12:59:23.190 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "400", 2023-10-19T12:59:23.190 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "599", 2023-10-19T12:59:23.191 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.191 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.191 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.191 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.191 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.192 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:23.192 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:23.192 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.192 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:23.192 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rbd_support", 2023-10-19T12:59:23.193 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:23.193 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:23.193 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:23.193 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:23.193 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:23.193 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.194 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.194 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.194 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:23.194 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.194 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.195 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:23.195 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:23.195 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:23.195 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:23.195 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:23.196 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:23.196 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:23.196 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:23.196 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.196 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.197 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.197 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.197 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.197 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:23.197 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:23.197 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.198 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.198 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.198 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:23.198 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.198 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.199 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.199 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.199 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.199 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.199 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.200 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.200 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:23.200 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:23.200 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.200 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.201 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.201 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:23.201 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.201 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.201 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:23.202 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:23.202 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:23.202 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:23.202 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:23.202 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:23.203 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:23.203 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:23.203 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.203 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.203 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.204 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.204 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.204 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:23.204 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:23.204 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.205 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.205 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.205 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:23.205 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.205 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.205 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.206 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.206 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.206 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.206 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.207 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.207 INFO:teuthology.orchestra.run.smithi046.stdout: "max_concurrent_snap_create": { 2023-10-19T12:59:23.207 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "max_concurrent_snap_create", 2023-10-19T12:59:23.207 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:23.207 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.208 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.208 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "10", 2023-10-19T12:59:23.208 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.208 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.208 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.209 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.209 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.209 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.209 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.209 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.210 INFO:teuthology.orchestra.run.smithi046.stdout: "mirror_snapshot_schedule": { 2023-10-19T12:59:23.210 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "mirror_snapshot_schedule", 2023-10-19T12:59:23.210 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.210 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.210 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.211 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:23.211 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.211 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.211 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.212 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.212 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.212 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.212 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.212 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.213 INFO:teuthology.orchestra.run.smithi046.stdout: "trash_purge_schedule": { 2023-10-19T12:59:23.213 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "trash_purge_schedule", 2023-10-19T12:59:23.213 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.213 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.213 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.214 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:23.214 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.214 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.214 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.215 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.215 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.215 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.215 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.215 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:23.216 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:23.216 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.216 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:23.216 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "restful", 2023-10-19T12:59:23.217 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:23.217 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:23.217 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:23.217 INFO:teuthology.orchestra.run.smithi046.stdout: "enable_auth": { 2023-10-19T12:59:23.217 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "enable_auth", 2023-10-19T12:59:23.217 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.218 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.218 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.218 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:23.218 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.219 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.219 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.219 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.219 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.219 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.220 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.220 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.220 INFO:teuthology.orchestra.run.smithi046.stdout: "key_file": { 2023-10-19T12:59:23.220 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "key_file", 2023-10-19T12:59:23.220 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.221 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.221 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.221 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:23.221 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.221 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.222 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.222 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.222 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.222 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.222 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.223 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.223 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:23.223 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:23.223 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.223 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.223 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.224 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:23.224 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.224 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.224 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:23.224 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:23.225 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:23.225 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:23.225 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:23.225 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:23.225 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:23.226 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:23.226 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.226 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.226 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.226 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.227 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.227 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:23.227 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:23.227 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.227 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.228 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.228 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:23.228 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.228 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.228 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.229 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.229 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.229 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.229 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.229 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.229 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:23.230 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:23.230 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.230 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.230 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.230 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:23.231 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.231 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.231 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:23.231 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:23.231 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:23.232 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:23.232 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:23.232 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:23.232 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:23.232 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:23.233 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.233 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.233 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.233 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.233 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.234 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:23.234 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:23.234 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.234 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.234 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.234 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:23.235 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.235 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.235 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.235 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.236 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.236 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.236 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.236 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.236 INFO:teuthology.orchestra.run.smithi046.stdout: "server_addr": { 2023-10-19T12:59:23.237 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "server_addr", 2023-10-19T12:59:23.237 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.237 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.237 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.237 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:23.238 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.238 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.238 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.238 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.239 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.239 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.239 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.239 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.239 INFO:teuthology.orchestra.run.smithi046.stdout: "server_port": { 2023-10-19T12:59:23.240 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "server_port", 2023-10-19T12:59:23.240 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.240 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.240 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.240 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:23.241 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.241 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.241 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.241 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.241 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.241 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.242 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.242 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:23.242 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:23.242 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.242 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:23.243 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rgw", 2023-10-19T12:59:23.243 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:23.243 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:23.243 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:23.243 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:23.244 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:23.244 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.244 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.244 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.244 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:23.245 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.245 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.245 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:23.245 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:23.245 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:23.246 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:23.246 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:23.246 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:23.246 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:23.246 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:23.247 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.247 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.247 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.247 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.247 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.248 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:23.248 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:23.248 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.248 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.248 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.249 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:23.249 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.249 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.249 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.249 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.250 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.250 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.250 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.250 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.250 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:23.251 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:23.251 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.251 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.251 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.251 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:23.252 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.252 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.252 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:23.252 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:23.252 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:23.253 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:23.253 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:23.253 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:23.253 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:23.253 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:23.253 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.254 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.254 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.254 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.254 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.254 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:23.255 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:23.255 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.255 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.255 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.255 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:23.255 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.256 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.256 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.256 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.256 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.256 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.257 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.257 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:23.257 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:23.257 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.257 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:23.258 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rook", 2023-10-19T12:59:23.258 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:23.258 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:23.258 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:23.258 INFO:teuthology.orchestra.run.smithi046.stdout: "drive_group_interval": { 2023-10-19T12:59:23.259 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "drive_group_interval", 2023-10-19T12:59:23.259 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "float", 2023-10-19T12:59:23.259 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.259 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.259 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "300.0", 2023-10-19T12:59:23.260 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.260 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.260 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.260 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2023-10-19T12:59:23.260 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.261 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.261 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.261 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.261 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:23.261 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:23.261 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.262 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.262 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.262 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:23.262 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.262 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.263 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:23.263 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:23.263 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:23.263 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:23.263 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:23.264 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:23.264 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:23.264 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:23.264 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.264 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.265 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.265 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.265 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.265 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:23.265 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:23.265 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.266 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.266 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.266 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:23.266 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.266 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.267 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.267 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.267 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.267 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.267 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.268 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.268 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:23.268 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:23.268 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.268 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.268 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.269 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:23.269 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.269 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.269 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:23.269 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:23.269 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:23.270 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:23.270 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:23.270 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:23.270 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:23.270 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:23.271 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.271 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.271 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.271 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.271 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.272 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:23.272 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:23.272 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.272 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.272 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.273 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:23.273 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.273 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.273 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.274 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.274 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.274 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.274 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.274 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.275 INFO:teuthology.orchestra.run.smithi046.stdout: "storage_class": { 2023-10-19T12:59:23.275 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "storage_class", 2023-10-19T12:59:23.275 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.275 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.276 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.276 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "local", 2023-10-19T12:59:23.276 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.276 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.276 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.276 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "storage class name for LSO-discovered PVs", 2023-10-19T12:59:23.277 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.277 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.277 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.277 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:23.277 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:23.278 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.278 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:23.278 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "selftest", 2023-10-19T12:59:23.278 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:23.278 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:23.278 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:23.279 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:23.279 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:23.279 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.279 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.279 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.280 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:23.280 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.280 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.280 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:23.280 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:23.281 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:23.281 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:23.281 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:23.281 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:23.281 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:23.282 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:23.282 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.282 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.282 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.282 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.283 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.283 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:23.283 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:23.283 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.284 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.284 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.284 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:23.284 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.284 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.285 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.285 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.285 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.285 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.285 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.286 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.286 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:23.286 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:23.286 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.286 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.287 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.287 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:23.287 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.287 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.288 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:23.288 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:23.288 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:23.288 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:23.288 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:23.288 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:23.289 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:23.289 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:23.289 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.289 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.289 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.290 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.290 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.290 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:23.290 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:23.291 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.291 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.291 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.291 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:23.291 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.291 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.292 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.292 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.292 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.292 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.293 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.293 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.293 INFO:teuthology.orchestra.run.smithi046.stdout: "roption1": { 2023-10-19T12:59:23.293 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "roption1", 2023-10-19T12:59:23.293 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.293 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.294 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.294 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:23.294 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.294 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.294 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.295 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.295 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.295 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.295 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.295 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.296 INFO:teuthology.orchestra.run.smithi046.stdout: "roption2": { 2023-10-19T12:59:23.296 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "roption2", 2023-10-19T12:59:23.296 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.296 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.296 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.296 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "xyz", 2023-10-19T12:59:23.297 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.297 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.297 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.297 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.298 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.298 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.298 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.298 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.298 INFO:teuthology.orchestra.run.smithi046.stdout: "rwoption1": { 2023-10-19T12:59:23.299 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rwoption1", 2023-10-19T12:59:23.299 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.299 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.299 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.299 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:23.300 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.300 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.300 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.300 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.300 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.301 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.301 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.301 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.301 INFO:teuthology.orchestra.run.smithi046.stdout: "rwoption2": { 2023-10-19T12:59:23.301 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rwoption2", 2023-10-19T12:59:23.302 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:23.302 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.302 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.302 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:23.302 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.303 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.303 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.303 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.303 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.303 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.303 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.304 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.304 INFO:teuthology.orchestra.run.smithi046.stdout: "rwoption3": { 2023-10-19T12:59:23.304 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rwoption3", 2023-10-19T12:59:23.304 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "float", 2023-10-19T12:59:23.304 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.305 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.305 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:23.305 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.305 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.305 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.306 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.306 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.306 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.306 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.306 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.307 INFO:teuthology.orchestra.run.smithi046.stdout: "rwoption4": { 2023-10-19T12:59:23.307 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rwoption4", 2023-10-19T12:59:23.307 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.307 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.307 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.307 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:23.308 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.308 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.308 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.308 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.308 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.309 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.309 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.309 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.309 INFO:teuthology.orchestra.run.smithi046.stdout: "rwoption5": { 2023-10-19T12:59:23.309 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rwoption5", 2023-10-19T12:59:23.310 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.310 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.310 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.310 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:23.310 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.311 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.311 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.311 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.311 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.311 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.311 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.312 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.312 INFO:teuthology.orchestra.run.smithi046.stdout: "rwoption6": { 2023-10-19T12:59:23.312 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rwoption6", 2023-10-19T12:59:23.312 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.312 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.313 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.313 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:23.313 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.313 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.314 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.314 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.314 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.314 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.314 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.315 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.315 INFO:teuthology.orchestra.run.smithi046.stdout: "rwoption7": { 2023-10-19T12:59:23.315 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rwoption7", 2023-10-19T12:59:23.315 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:23.315 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.315 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.316 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:23.316 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "1", 2023-10-19T12:59:23.316 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "42", 2023-10-19T12:59:23.316 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.316 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.316 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.317 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.317 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.317 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.317 INFO:teuthology.orchestra.run.smithi046.stdout: "testkey": { 2023-10-19T12:59:23.317 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "testkey", 2023-10-19T12:59:23.318 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.318 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.318 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.318 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:23.318 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.319 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.319 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.319 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.319 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.319 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.319 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.320 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.320 INFO:teuthology.orchestra.run.smithi046.stdout: "testlkey": { 2023-10-19T12:59:23.320 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "testlkey", 2023-10-19T12:59:23.320 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.320 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.321 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.321 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:23.321 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.321 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.322 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.322 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.322 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.322 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.322 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.323 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.323 INFO:teuthology.orchestra.run.smithi046.stdout: "testnewline": { 2023-10-19T12:59:23.323 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "testnewline", 2023-10-19T12:59:23.323 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.323 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.324 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.324 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:23.324 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.324 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.324 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.324 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.325 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.325 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.325 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.325 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:23.325 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:23.326 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.326 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:23.326 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "snap_schedule", 2023-10-19T12:59:23.326 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:23.326 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:23.327 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:23.327 INFO:teuthology.orchestra.run.smithi046.stdout: "allow_m_granularity": { 2023-10-19T12:59:23.327 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "allow_m_granularity", 2023-10-19T12:59:23.327 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.327 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.328 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.328 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:23.328 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.328 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.328 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.329 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "allow minute scheduled snapshots", 2023-10-19T12:59:23.329 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.329 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.329 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.330 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.330 INFO:teuthology.orchestra.run.smithi046.stdout: "dump_on_update": { 2023-10-19T12:59:23.330 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "dump_on_update", 2023-10-19T12:59:23.330 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.330 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.330 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.331 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:23.331 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.331 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.331 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.331 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "dump database to debug log on update", 2023-10-19T12:59:23.332 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.332 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.332 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.332 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.332 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:23.333 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:23.333 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.333 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.333 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.333 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:23.333 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.334 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.334 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:23.334 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:23.334 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:23.334 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:23.335 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:23.335 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:23.335 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:23.335 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:23.335 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.336 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.336 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.336 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.336 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.336 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:23.337 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:23.337 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.337 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.337 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.337 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:23.338 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.338 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.338 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.338 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.339 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.339 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.339 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.339 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.339 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:23.340 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:23.340 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.340 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.340 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.340 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:23.341 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.341 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.341 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:23.341 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:23.341 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:23.342 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:23.342 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:23.342 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:23.342 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:23.342 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:23.343 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.343 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.343 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.343 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.344 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.344 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:23.344 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:23.344 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.345 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.345 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.345 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:23.345 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.345 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.346 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.346 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.346 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.346 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.346 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.347 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:23.347 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:23.347 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.347 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:23.348 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "stats", 2023-10-19T12:59:23.348 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:23.348 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:23.348 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:23.348 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:23.349 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:23.349 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.349 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.349 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.349 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:23.350 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.350 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.350 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:23.350 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:23.350 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:23.351 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:23.351 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:23.351 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:23.351 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:23.351 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:23.352 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.352 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.352 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.352 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.353 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.353 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:23.353 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:23.353 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.353 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.353 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.354 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:23.354 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.354 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.354 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.354 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.355 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.355 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.355 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.355 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.355 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:23.356 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:23.356 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.356 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.356 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.356 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:23.357 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.357 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.357 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:23.357 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:23.358 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:23.358 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:23.358 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:23.358 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:23.358 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:23.361 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:23.361 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.361 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.362 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.362 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.362 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.362 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:23.363 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:23.363 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.363 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.363 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.363 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:23.364 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.364 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.364 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.364 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.365 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.365 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.365 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.365 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:23.366 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:23.366 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.366 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:23.366 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "status", 2023-10-19T12:59:23.367 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:23.367 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:23.367 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:23.367 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:23.367 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:23.368 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.368 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.368 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.368 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:23.369 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.369 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.369 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:23.369 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:23.369 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:23.370 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:23.370 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:23.370 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:23.370 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:23.371 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:23.371 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.371 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.371 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.372 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.372 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.372 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:23.372 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:23.373 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.373 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.373 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.373 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:23.374 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.374 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.374 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.374 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.374 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.375 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.375 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.375 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.375 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:23.375 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:23.376 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.376 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.376 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.376 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:23.376 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.377 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.377 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:23.377 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:23.377 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:23.377 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:23.378 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:23.378 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:23.378 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:23.378 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:23.379 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.379 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.379 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.379 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.379 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.380 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:23.380 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:23.380 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.380 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.380 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.381 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:23.381 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.381 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.381 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.381 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.382 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.382 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.382 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.382 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:23.383 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:23.383 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.383 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:23.383 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "telegraf", 2023-10-19T12:59:23.383 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:23.383 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:23.384 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:23.384 INFO:teuthology.orchestra.run.smithi046.stdout: "address": { 2023-10-19T12:59:23.384 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "address", 2023-10-19T12:59:23.384 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.384 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.385 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.385 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-10-19T12:59:23.385 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.385 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.385 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.386 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.386 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.386 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.386 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.386 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.387 INFO:teuthology.orchestra.run.smithi046.stdout: "interval": { 2023-10-19T12:59:23.387 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "interval", 2023-10-19T12:59:23.387 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2023-10-19T12:59:23.388 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.388 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.388 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "15", 2023-10-19T12:59:23.388 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.388 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.389 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.389 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.389 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.389 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.389 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.390 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.390 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:23.390 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:23.391 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.391 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.391 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.391 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:23.391 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.392 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.392 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:23.392 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:23.392 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:23.392 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:23.393 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:23.393 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:23.393 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:23.393 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:23.393 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.394 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.394 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.394 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.394 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.394 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:23.395 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:23.395 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.395 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.395 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.395 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:23.396 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.396 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.396 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.396 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.397 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.397 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.397 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.397 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.398 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:23.398 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:23.398 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.398 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.398 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.399 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:23.399 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.399 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.399 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:23.400 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:23.400 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:23.400 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:23.400 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:23.401 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:23.401 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:23.401 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:23.402 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.402 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.402 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.403 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.403 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.403 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:23.403 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:23.403 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.403 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.404 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.404 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:23.404 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.404 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.405 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.405 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.405 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.405 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.405 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.406 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:23.406 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:23.406 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.406 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:23.406 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "telemetry", 2023-10-19T12:59:23.407 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:23.407 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:23.407 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:23.407 INFO:teuthology.orchestra.run.smithi046.stdout: "channel_basic": { 2023-10-19T12:59:23.407 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "channel_basic", 2023-10-19T12:59:23.408 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.408 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.408 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.408 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:23.409 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.409 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.409 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.409 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Share basic cluster information (size, version)", 2023-10-19T12:59:23.409 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.410 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.410 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.410 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.410 INFO:teuthology.orchestra.run.smithi046.stdout: "channel_crash": { 2023-10-19T12:59:23.410 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "channel_crash", 2023-10-19T12:59:23.411 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.411 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.411 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.411 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:23.411 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.412 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.412 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.412 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-10-19T12:59:23.412 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.412 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.413 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.413 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.413 INFO:teuthology.orchestra.run.smithi046.stdout: "channel_device": { 2023-10-19T12:59:23.413 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "channel_device", 2023-10-19T12:59:23.413 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.414 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.414 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.414 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:23.414 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.414 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.415 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.415 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-10-19T12:59:23.415 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.415 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.415 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.416 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.416 INFO:teuthology.orchestra.run.smithi046.stdout: "channel_ident": { 2023-10-19T12:59:23.416 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "channel_ident", 2023-10-19T12:59:23.416 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.416 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.417 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.417 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:23.417 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.417 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.417 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.418 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-10-19T12:59:23.418 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.418 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.418 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.419 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.419 INFO:teuthology.orchestra.run.smithi046.stdout: "channel_perf": { 2023-10-19T12:59:23.419 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "channel_perf", 2023-10-19T12:59:23.419 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.419 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.420 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.420 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:23.420 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.420 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.421 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.421 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Share various performance metrics of a cluster", 2023-10-19T12:59:23.421 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.421 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.421 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.422 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.422 INFO:teuthology.orchestra.run.smithi046.stdout: "contact": { 2023-10-19T12:59:23.422 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "contact", 2023-10-19T12:59:23.422 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.422 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.423 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.423 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:23.423 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.423 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.423 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.424 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.424 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.424 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.424 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.424 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.425 INFO:teuthology.orchestra.run.smithi046.stdout: "description": { 2023-10-19T12:59:23.425 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "description", 2023-10-19T12:59:23.425 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.425 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.425 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.426 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:23.426 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.426 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.426 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.426 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.427 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.427 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.427 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.427 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.427 INFO:teuthology.orchestra.run.smithi046.stdout: "device_url": { 2023-10-19T12:59:23.427 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "device_url", 2023-10-19T12:59:23.428 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.428 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.428 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.428 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-10-19T12:59:23.428 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.429 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.429 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.429 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.429 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.429 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.430 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.430 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.430 INFO:teuthology.orchestra.run.smithi046.stdout: "enabled": { 2023-10-19T12:59:23.430 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "enabled", 2023-10-19T12:59:23.431 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.431 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.431 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.431 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:23.431 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.432 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.432 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.432 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.432 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.432 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.433 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.433 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.433 INFO:teuthology.orchestra.run.smithi046.stdout: "interval": { 2023-10-19T12:59:23.433 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "interval", 2023-10-19T12:59:23.433 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:23.434 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.434 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.434 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "24", 2023-10-19T12:59:23.434 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "8", 2023-10-19T12:59:23.435 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.435 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.435 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.435 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.435 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.435 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.436 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.436 INFO:teuthology.orchestra.run.smithi046.stdout: "last_opt_revision": { 2023-10-19T12:59:23.436 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "last_opt_revision", 2023-10-19T12:59:23.436 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:23.436 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.437 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.437 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "1", 2023-10-19T12:59:23.437 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.437 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.437 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.438 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.438 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.438 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.438 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.438 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.439 INFO:teuthology.orchestra.run.smithi046.stdout: "leaderboard": { 2023-10-19T12:59:23.439 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "leaderboard", 2023-10-19T12:59:23.439 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.439 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.439 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.440 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:23.440 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.440 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.440 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.440 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.441 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.441 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.441 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.441 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.441 INFO:teuthology.orchestra.run.smithi046.stdout: "leaderboard_description": { 2023-10-19T12:59:23.442 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "leaderboard_description", 2023-10-19T12:59:23.442 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.442 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.442 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.442 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:23.443 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.443 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.443 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.443 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.443 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.444 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.444 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.444 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.444 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:23.444 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:23.444 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.445 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.445 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.445 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:23.445 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.446 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.446 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:23.446 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:23.446 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:23.446 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:23.447 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:23.447 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:23.447 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:23.447 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:23.447 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.448 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.448 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.448 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.448 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.448 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:23.449 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:23.449 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.449 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.449 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.449 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:23.450 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.450 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.450 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.450 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.451 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.451 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.451 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.451 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.451 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:23.451 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:23.452 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.452 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.452 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.452 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:23.452 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.453 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.453 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:23.453 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:23.453 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:23.453 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:23.453 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:23.454 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:23.454 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:23.454 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:23.454 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.454 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.455 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.455 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.455 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.455 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:23.455 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:23.456 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.456 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.456 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.456 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:23.456 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.456 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.457 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.457 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.457 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.457 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.457 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.458 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.458 INFO:teuthology.orchestra.run.smithi046.stdout: "organization": { 2023-10-19T12:59:23.458 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "organization", 2023-10-19T12:59:23.458 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.458 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.459 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.459 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:23.459 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.459 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.459 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.460 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.460 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.460 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.460 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.460 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.460 INFO:teuthology.orchestra.run.smithi046.stdout: "proxy": { 2023-10-19T12:59:23.461 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "proxy", 2023-10-19T12:59:23.461 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.461 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.461 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.461 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:23.462 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.462 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.462 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.462 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.462 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.463 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.463 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.463 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.463 INFO:teuthology.orchestra.run.smithi046.stdout: "url": { 2023-10-19T12:59:23.463 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "url", 2023-10-19T12:59:23.464 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.464 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.464 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.464 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-10-19T12:59:23.464 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.465 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.465 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.465 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.465 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.465 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.466 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.466 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:23.466 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:23.466 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.466 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:23.467 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "test_orchestrator", 2023-10-19T12:59:23.467 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:23.467 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:23.467 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:23.467 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:23.468 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:23.468 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.468 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.468 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.468 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:23.468 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.469 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.469 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:23.469 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:23.469 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:23.469 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:23.470 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:23.470 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:23.470 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:23.470 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:23.470 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.471 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.471 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.471 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.471 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.471 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:23.472 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:23.472 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.472 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.472 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.472 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:23.473 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.473 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.473 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.473 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.473 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.474 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.474 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.474 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.474 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:23.475 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:23.475 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.475 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.475 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.475 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:23.476 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.476 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.476 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:23.476 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:23.476 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:23.477 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:23.477 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:23.477 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:23.477 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:23.477 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:23.477 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.478 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.478 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.478 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.478 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.478 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:23.479 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:23.479 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.479 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.479 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.479 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:23.480 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.480 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.480 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.480 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.480 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.481 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.481 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.481 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:23.481 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:23.481 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.482 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:23.482 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "volumes", 2023-10-19T12:59:23.482 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:23.482 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:23.482 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:23.483 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:23.483 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:23.483 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.483 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.483 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.484 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:23.484 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.484 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.484 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:23.484 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:23.485 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:23.485 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:23.485 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:23.485 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:23.485 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:23.486 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:23.486 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.486 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.486 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.486 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.487 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.487 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:23.487 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:23.487 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.487 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.488 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.488 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:23.488 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.488 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.488 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.489 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.489 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.489 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.489 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.489 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.489 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:23.490 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:23.490 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.490 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.490 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.490 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:23.491 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.491 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.491 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:23.491 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:23.491 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:23.492 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:23.492 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:23.492 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:23.492 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:23.492 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:23.493 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.493 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.493 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.493 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.493 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.494 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:23.494 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:23.494 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.494 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.494 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.495 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:23.495 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.495 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.495 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.495 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.496 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.496 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.496 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.496 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.497 INFO:teuthology.orchestra.run.smithi046.stdout: "max_concurrent_clones": { 2023-10-19T12:59:23.497 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "max_concurrent_clones", 2023-10-19T12:59:23.497 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:23.497 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.497 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.497 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "4", 2023-10-19T12:59:23.498 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.498 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.498 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.498 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Number of asynchronous cloner threads", 2023-10-19T12:59:23.498 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.499 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.499 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.499 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.499 INFO:teuthology.orchestra.run.smithi046.stdout: "periodic_async_work": { 2023-10-19T12:59:23.499 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "periodic_async_work", 2023-10-19T12:59:23.500 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.500 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.500 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.500 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:23.500 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.501 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.501 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.501 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Periodically check for async work", 2023-10-19T12:59:23.501 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.501 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.502 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.502 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.502 INFO:teuthology.orchestra.run.smithi046.stdout: "snapshot_clone_delay": { 2023-10-19T12:59:23.502 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "snapshot_clone_delay", 2023-10-19T12:59:23.502 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:23.503 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.503 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.503 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2023-10-19T12:59:23.503 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.504 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.504 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.504 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-10-19T12:59:23.504 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.505 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.505 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.505 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:23.505 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:23.505 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.506 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:23.506 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "zabbix", 2023-10-19T12:59:23.506 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:23.506 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:23.507 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:23.507 INFO:teuthology.orchestra.run.smithi046.stdout: "discovery_interval": { 2023-10-19T12:59:23.507 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "discovery_interval", 2023-10-19T12:59:23.507 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "uint", 2023-10-19T12:59:23.507 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.508 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.508 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "100", 2023-10-19T12:59:23.508 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.508 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.508 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.509 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.509 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.509 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.509 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.509 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.509 INFO:teuthology.orchestra.run.smithi046.stdout: "identifier": { 2023-10-19T12:59:23.510 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "identifier", 2023-10-19T12:59:23.510 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.510 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.510 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.510 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:23.511 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.511 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.511 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.511 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.511 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.512 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.512 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.512 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.512 INFO:teuthology.orchestra.run.smithi046.stdout: "interval": { 2023-10-19T12:59:23.512 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "interval", 2023-10-19T12:59:23.512 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2023-10-19T12:59:23.513 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.513 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.513 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "60", 2023-10-19T12:59:23.513 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.513 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.514 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.514 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.514 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.514 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.514 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.515 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.515 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:23.515 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:23.515 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.515 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.515 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.516 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:23.516 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.516 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.516 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:23.516 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:23.516 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:23.517 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:23.517 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:23.517 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:23.517 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:23.517 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:23.518 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.518 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.518 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.518 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.518 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.519 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:23.519 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:23.519 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.519 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.519 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.519 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:23.520 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.520 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.520 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.520 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.520 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.521 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.521 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.521 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.521 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:23.522 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:23.522 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.522 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.522 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.522 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:23.523 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.523 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.523 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:23.523 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:23.523 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:23.523 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:23.524 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:23.524 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:23.524 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:23.524 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:23.525 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.525 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.525 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.525 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.525 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.526 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:23.526 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:23.526 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.526 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.526 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.527 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:23.527 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.527 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.527 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.527 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.527 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.528 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.528 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.528 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.528 INFO:teuthology.orchestra.run.smithi046.stdout: "zabbix_host": { 2023-10-19T12:59:23.528 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "zabbix_host", 2023-10-19T12:59:23.528 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.529 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.529 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.529 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:23.529 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.529 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.529 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.530 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.530 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.530 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.530 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.530 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.531 INFO:teuthology.orchestra.run.smithi046.stdout: "zabbix_port": { 2023-10-19T12:59:23.531 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "zabbix_port", 2023-10-19T12:59:23.531 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:23.532 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.532 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.532 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "10051", 2023-10-19T12:59:23.532 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.532 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.533 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.533 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.533 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.533 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.533 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.533 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.534 INFO:teuthology.orchestra.run.smithi046.stdout: "zabbix_sender": { 2023-10-19T12:59:23.534 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "zabbix_sender", 2023-10-19T12:59:23.534 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.534 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.535 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.535 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-10-19T12:59:23.535 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.535 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.535 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.535 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.536 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.536 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.536 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.536 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:23.536 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:23.537 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:23.537 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2023-10-19T12:59:23.537 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:23.537 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:23.537 INFO:teuthology.orchestra.run.smithi046.stdout: "modules": [ 2023-10-19T12:59:23.538 INFO:teuthology.orchestra.run.smithi046.stdout: "cephadm", 2023-10-19T12:59:23.538 INFO:teuthology.orchestra.run.smithi046.stdout: "dashboard", 2023-10-19T12:59:23.538 INFO:teuthology.orchestra.run.smithi046.stdout: "iostat", 2023-10-19T12:59:23.538 INFO:teuthology.orchestra.run.smithi046.stdout: "nfs", 2023-10-19T12:59:23.538 INFO:teuthology.orchestra.run.smithi046.stdout: "restful" 2023-10-19T12:59:23.539 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:23.539 INFO:teuthology.orchestra.run.smithi046.stdout: "available_modules": [ 2023-10-19T12:59:23.539 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:23.539 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "alerts", 2023-10-19T12:59:23.539 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:23.540 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:23.540 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:23.540 INFO:teuthology.orchestra.run.smithi046.stdout: "interval": { 2023-10-19T12:59:23.540 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "interval", 2023-10-19T12:59:23.540 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2023-10-19T12:59:23.540 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.541 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.541 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "60", 2023-10-19T12:59:23.541 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.541 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.541 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.542 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "How frequently to reexamine health status", 2023-10-19T12:59:23.542 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.542 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.542 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.542 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.543 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:23.543 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:23.543 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.543 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.543 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.544 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:23.544 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.544 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.544 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:23.544 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:23.545 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:23.545 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:23.545 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:23.545 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:23.545 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:23.546 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:23.546 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.546 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.546 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.546 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.546 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.547 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:23.547 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:23.547 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.547 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.547 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.548 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:23.548 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.548 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.548 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.548 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.548 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.549 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.549 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.549 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.549 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:23.549 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:23.550 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.550 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.550 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.550 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:23.550 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.551 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.551 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:23.551 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:23.551 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:23.551 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:23.552 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:23.552 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:23.552 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:23.552 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:23.552 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.552 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.553 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.553 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.553 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.553 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:23.553 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:23.554 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.554 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.554 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.554 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:23.554 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.555 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.555 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.555 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.555 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.555 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.556 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.556 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.556 INFO:teuthology.orchestra.run.smithi046.stdout: "smtp_destination": { 2023-10-19T12:59:23.556 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "smtp_destination", 2023-10-19T12:59:23.556 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.557 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.557 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.557 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:23.557 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.557 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.557 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.558 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Email address to send alerts to", 2023-10-19T12:59:23.558 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.558 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.558 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.558 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.559 INFO:teuthology.orchestra.run.smithi046.stdout: "smtp_from_name": { 2023-10-19T12:59:23.559 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "smtp_from_name", 2023-10-19T12:59:23.559 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.559 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.559 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.560 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "Ceph", 2023-10-19T12:59:23.560 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.560 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.560 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.560 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Email From: name", 2023-10-19T12:59:23.561 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.561 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.561 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.561 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.561 INFO:teuthology.orchestra.run.smithi046.stdout: "smtp_host": { 2023-10-19T12:59:23.562 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "smtp_host", 2023-10-19T12:59:23.562 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.562 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.562 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.562 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:23.563 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.563 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.563 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.563 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "SMTP server", 2023-10-19T12:59:23.563 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.564 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.565 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.565 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.565 INFO:teuthology.orchestra.run.smithi046.stdout: "smtp_password": { 2023-10-19T12:59:23.566 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "smtp_password", 2023-10-19T12:59:23.566 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.566 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.566 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.567 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:23.567 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.567 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.567 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.567 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Password to authenticate with", 2023-10-19T12:59:23.568 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.568 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.568 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.568 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.568 INFO:teuthology.orchestra.run.smithi046.stdout: "smtp_port": { 2023-10-19T12:59:23.569 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "smtp_port", 2023-10-19T12:59:23.569 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:23.569 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.569 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.569 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "465", 2023-10-19T12:59:23.570 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.570 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.570 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.570 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "SMTP port", 2023-10-19T12:59:23.570 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.571 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.571 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.571 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.571 INFO:teuthology.orchestra.run.smithi046.stdout: "smtp_sender": { 2023-10-19T12:59:23.571 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "smtp_sender", 2023-10-19T12:59:23.572 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.572 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.572 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.572 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:23.572 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.573 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.573 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.573 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "SMTP envelope sender", 2023-10-19T12:59:23.573 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.573 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.574 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.574 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.574 INFO:teuthology.orchestra.run.smithi046.stdout: "smtp_ssl": { 2023-10-19T12:59:23.574 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "smtp_ssl", 2023-10-19T12:59:23.574 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.575 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.575 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.575 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:23.575 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.575 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.575 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.576 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Use SSL to connect to SMTP server", 2023-10-19T12:59:23.576 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.576 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.576 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.576 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.577 INFO:teuthology.orchestra.run.smithi046.stdout: "smtp_user": { 2023-10-19T12:59:23.577 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "smtp_user", 2023-10-19T12:59:23.577 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.577 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.577 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.578 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:23.578 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.578 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.578 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.578 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "User to authenticate as", 2023-10-19T12:59:23.579 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.579 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.579 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.579 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:23.579 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:23.580 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.580 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:23.580 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "balancer", 2023-10-19T12:59:23.580 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:23.580 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:23.580 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:23.581 INFO:teuthology.orchestra.run.smithi046.stdout: "active": { 2023-10-19T12:59:23.581 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "active", 2023-10-19T12:59:23.581 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.581 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.581 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.582 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:23.582 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.582 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.582 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.582 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "automatically balance PGs across cluster", 2023-10-19T12:59:23.583 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.583 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.583 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.583 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.583 INFO:teuthology.orchestra.run.smithi046.stdout: "begin_time": { 2023-10-19T12:59:23.583 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "begin_time", 2023-10-19T12:59:23.584 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.584 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.584 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.584 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0000", 2023-10-19T12:59:23.585 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.585 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.585 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.585 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "beginning time of day to automatically balance", 2023-10-19T12:59:23.585 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-19T12:59:23.585 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.586 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.586 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.586 INFO:teuthology.orchestra.run.smithi046.stdout: "begin_weekday": { 2023-10-19T12:59:23.586 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "begin_weekday", 2023-10-19T12:59:23.586 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "uint", 2023-10-19T12:59:23.587 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.587 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.587 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2023-10-19T12:59:23.587 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "0", 2023-10-19T12:59:23.587 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "6", 2023-10-19T12:59:23.588 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.588 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-10-19T12:59:23.588 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-10-19T12:59:23.588 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.588 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.588 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.589 INFO:teuthology.orchestra.run.smithi046.stdout: "crush_compat_max_iterations": { 2023-10-19T12:59:23.589 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "crush_compat_max_iterations", 2023-10-19T12:59:23.589 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "uint", 2023-10-19T12:59:23.589 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.589 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.590 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "25", 2023-10-19T12:59:23.590 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "1", 2023-10-19T12:59:23.590 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "250", 2023-10-19T12:59:23.590 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.590 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-10-19T12:59:23.591 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.591 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.591 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.591 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.591 INFO:teuthology.orchestra.run.smithi046.stdout: "crush_compat_metrics": { 2023-10-19T12:59:23.592 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "crush_compat_metrics", 2023-10-19T12:59:23.592 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.592 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.592 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.592 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "pgs,objects,bytes", 2023-10-19T12:59:23.592 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.593 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.593 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.593 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-10-19T12:59:23.593 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-10-19T12:59:23.593 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.594 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.594 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.594 INFO:teuthology.orchestra.run.smithi046.stdout: "crush_compat_step": { 2023-10-19T12:59:23.594 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "crush_compat_step", 2023-10-19T12:59:23.594 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "float", 2023-10-19T12:59:23.595 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.595 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.595 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0.5", 2023-10-19T12:59:23.595 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "0.001", 2023-10-19T12:59:23.595 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "0.999", 2023-10-19T12:59:23.596 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.596 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "aggressiveness of optimization", 2023-10-19T12:59:23.596 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-10-19T12:59:23.596 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.596 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.597 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.597 INFO:teuthology.orchestra.run.smithi046.stdout: "end_time": { 2023-10-19T12:59:23.597 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "end_time", 2023-10-19T12:59:23.597 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.597 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.598 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.598 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "2359", 2023-10-19T12:59:23.598 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.598 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.599 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.599 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "ending time of day to automatically balance", 2023-10-19T12:59:23.599 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-19T12:59:23.599 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.599 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.600 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.600 INFO:teuthology.orchestra.run.smithi046.stdout: "end_weekday": { 2023-10-19T12:59:23.600 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "end_weekday", 2023-10-19T12:59:23.600 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "uint", 2023-10-19T12:59:23.600 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.601 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.601 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2023-10-19T12:59:23.601 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "0", 2023-10-19T12:59:23.601 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "6", 2023-10-19T12:59:23.601 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.602 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-10-19T12:59:23.602 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-10-19T12:59:23.602 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.602 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.602 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.603 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:23.603 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:23.603 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.603 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.603 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.604 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:23.604 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.604 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.604 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:23.604 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:23.604 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:23.605 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:23.605 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:23.605 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:23.605 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:23.605 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:23.606 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.606 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.606 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.606 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.606 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.607 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:23.607 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:23.607 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.607 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.607 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.608 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:23.608 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.608 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.608 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.608 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.608 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.609 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.609 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.609 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.609 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:23.609 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:23.610 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.610 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.610 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.610 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:23.610 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.611 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.611 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:23.611 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:23.611 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:23.611 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:23.612 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:23.612 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:23.612 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:23.612 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:23.612 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.612 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.613 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.613 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.613 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.613 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:23.613 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:23.613 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.614 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.614 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.614 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:23.614 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.614 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.615 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.615 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.615 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.615 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.615 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.616 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.616 INFO:teuthology.orchestra.run.smithi046.stdout: "min_score": { 2023-10-19T12:59:23.616 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "min_score", 2023-10-19T12:59:23.616 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "float", 2023-10-19T12:59:23.616 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.617 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.617 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2023-10-19T12:59:23.617 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.617 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.617 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.618 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-10-19T12:59:23.618 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.618 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.618 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.618 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.619 INFO:teuthology.orchestra.run.smithi046.stdout: "mode": { 2023-10-19T12:59:23.619 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "mode", 2023-10-19T12:59:23.619 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.619 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.619 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.620 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "upmap", 2023-10-19T12:59:23.620 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.620 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.620 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:23.620 INFO:teuthology.orchestra.run.smithi046.stdout: "crush-compat", 2023-10-19T12:59:23.621 INFO:teuthology.orchestra.run.smithi046.stdout: "none", 2023-10-19T12:59:23.621 INFO:teuthology.orchestra.run.smithi046.stdout: "upmap" 2023-10-19T12:59:23.621 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:23.621 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Balancer mode", 2023-10-19T12:59:23.621 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.621 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.622 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.622 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.622 INFO:teuthology.orchestra.run.smithi046.stdout: "pool_ids": { 2023-10-19T12:59:23.622 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "pool_ids", 2023-10-19T12:59:23.623 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.623 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.623 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.623 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:23.623 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.623 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.624 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.624 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-10-19T12:59:23.624 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.624 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.624 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.625 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.625 INFO:teuthology.orchestra.run.smithi046.stdout: "sleep_interval": { 2023-10-19T12:59:23.625 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sleep_interval", 2023-10-19T12:59:23.625 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2023-10-19T12:59:23.625 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.625 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.626 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "60", 2023-10-19T12:59:23.626 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.626 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.626 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.626 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-10-19T12:59:23.627 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.627 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.627 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.627 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.627 INFO:teuthology.orchestra.run.smithi046.stdout: "upmap_max_deviation": { 2023-10-19T12:59:23.627 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "upmap_max_deviation", 2023-10-19T12:59:23.628 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:23.628 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.628 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.628 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "5", 2023-10-19T12:59:23.628 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "1", 2023-10-19T12:59:23.629 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.629 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.629 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "deviation below which no optimization is attempted", 2023-10-19T12:59:23.629 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-10-19T12:59:23.629 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.630 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.630 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.630 INFO:teuthology.orchestra.run.smithi046.stdout: "upmap_max_optimizations": { 2023-10-19T12:59:23.630 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "upmap_max_optimizations", 2023-10-19T12:59:23.630 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "uint", 2023-10-19T12:59:23.631 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.631 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.631 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "10", 2023-10-19T12:59:23.631 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.631 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.632 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.632 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-10-19T12:59:23.632 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.632 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.632 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.633 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:23.633 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:23.633 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.633 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:23.633 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "cephadm", 2023-10-19T12:59:23.634 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:23.634 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:23.634 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:23.634 INFO:teuthology.orchestra.run.smithi046.stdout: "agent_down_multiplier": { 2023-10-19T12:59:23.634 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "agent_down_multiplier", 2023-10-19T12:59:23.635 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "float", 2023-10-19T12:59:23.635 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.635 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.635 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "3.0", 2023-10-19T12:59:23.635 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.635 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.636 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.636 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-10-19T12:59:23.636 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.636 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.636 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.637 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.637 INFO:teuthology.orchestra.run.smithi046.stdout: "agent_refresh_rate": { 2023-10-19T12:59:23.637 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "agent_refresh_rate", 2023-10-19T12:59:23.637 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2023-10-19T12:59:23.637 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.638 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.638 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "20", 2023-10-19T12:59:23.638 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.638 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.638 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.639 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-10-19T12:59:23.639 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.639 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.639 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.639 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.640 INFO:teuthology.orchestra.run.smithi046.stdout: "agent_starting_port": { 2023-10-19T12:59:23.640 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "agent_starting_port", 2023-10-19T12:59:23.640 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:23.640 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.640 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.640 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "4721", 2023-10-19T12:59:23.641 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.641 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.641 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.641 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-10-19T12:59:23.641 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.642 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.642 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.642 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.642 INFO:teuthology.orchestra.run.smithi046.stdout: "allow_ptrace": { 2023-10-19T12:59:23.642 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "allow_ptrace", 2023-10-19T12:59:23.643 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.643 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.643 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.643 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:23.643 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.643 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.644 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.644 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-10-19T12:59:23.644 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-10-19T12:59:23.644 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.644 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.645 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.645 INFO:teuthology.orchestra.run.smithi046.stdout: "autotune_interval": { 2023-10-19T12:59:23.645 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "autotune_interval", 2023-10-19T12:59:23.645 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2023-10-19T12:59:23.645 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.646 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.646 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "600", 2023-10-19T12:59:23.646 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.646 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.647 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.647 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "how frequently to autotune daemon memory", 2023-10-19T12:59:23.647 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.647 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.647 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.647 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.648 INFO:teuthology.orchestra.run.smithi046.stdout: "autotune_memory_target_ratio": { 2023-10-19T12:59:23.648 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "autotune_memory_target_ratio", 2023-10-19T12:59:23.648 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "float", 2023-10-19T12:59:23.648 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.649 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.649 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0.7", 2023-10-19T12:59:23.649 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.649 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.649 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.650 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-10-19T12:59:23.650 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.650 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.650 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.650 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.651 INFO:teuthology.orchestra.run.smithi046.stdout: "cephadm_log_destination": { 2023-10-19T12:59:23.651 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "cephadm_log_destination", 2023-10-19T12:59:23.651 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.651 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.652 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.652 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:23.652 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.652 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.652 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:23.653 INFO:teuthology.orchestra.run.smithi046.stdout: "file", 2023-10-19T12:59:23.653 INFO:teuthology.orchestra.run.smithi046.stdout: "file,syslog", 2023-10-19T12:59:23.653 INFO:teuthology.orchestra.run.smithi046.stdout: "syslog" 2023-10-19T12:59:23.653 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:23.654 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Destination for cephadm command's persistent logging", 2023-10-19T12:59:23.654 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.654 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.654 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.654 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.655 INFO:teuthology.orchestra.run.smithi046.stdout: "cgroups_split": { 2023-10-19T12:59:23.655 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "cgroups_split", 2023-10-19T12:59:23.655 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.655 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.655 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.656 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:23.656 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.656 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.656 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.656 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-10-19T12:59:23.656 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.657 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.657 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.657 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.657 INFO:teuthology.orchestra.run.smithi046.stdout: "config_checks_enabled": { 2023-10-19T12:59:23.657 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "config_checks_enabled", 2023-10-19T12:59:23.658 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.658 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.658 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.658 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:23.658 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.659 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.659 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.659 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-10-19T12:59:23.659 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.659 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.659 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.660 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.660 INFO:teuthology.orchestra.run.smithi046.stdout: "config_dashboard": { 2023-10-19T12:59:23.660 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "config_dashboard", 2023-10-19T12:59:23.660 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.660 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.661 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.661 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:23.661 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.661 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.661 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.662 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-10-19T12:59:23.662 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.662 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.662 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.662 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.663 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_alertmanager": { 2023-10-19T12:59:23.663 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_alertmanager", 2023-10-19T12:59:23.663 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.663 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.664 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.664 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-10-19T12:59:23.664 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.664 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.664 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.665 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Prometheus container image", 2023-10-19T12:59:23.665 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.665 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.665 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.665 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.666 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_base": { 2023-10-19T12:59:23.666 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_base", 2023-10-19T12:59:23.666 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.666 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.666 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.667 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/ceph/ceph", 2023-10-19T12:59:23.667 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.667 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.667 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.667 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Container image name, without the tag", 2023-10-19T12:59:23.668 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.668 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.668 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.668 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.668 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_elasticsearch": { 2023-10-19T12:59:23.669 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_elasticsearch", 2023-10-19T12:59:23.669 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.669 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.669 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.669 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2023-10-19T12:59:23.670 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.670 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.670 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.670 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "elasticsearch container image", 2023-10-19T12:59:23.670 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.671 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.671 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.671 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.671 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_grafana": { 2023-10-19T12:59:23.671 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_grafana", 2023-10-19T12:59:23.672 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.672 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.672 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.672 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-10-19T12:59:23.672 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.672 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.673 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.673 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Prometheus container image", 2023-10-19T12:59:23.673 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.673 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.673 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.673 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.674 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_haproxy": { 2023-10-19T12:59:23.674 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_haproxy", 2023-10-19T12:59:23.674 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.674 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.674 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.675 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-10-19T12:59:23.675 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.675 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.675 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.675 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "HAproxy container image", 2023-10-19T12:59:23.675 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.676 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.676 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.676 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.676 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_jaeger_agent": { 2023-10-19T12:59:23.676 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_jaeger_agent", 2023-10-19T12:59:23.677 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.677 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.677 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.677 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2023-10-19T12:59:23.677 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.678 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.678 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.678 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Jaeger agent container image", 2023-10-19T12:59:23.678 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.678 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.679 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.679 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.679 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_jaeger_collector": { 2023-10-19T12:59:23.679 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_jaeger_collector", 2023-10-19T12:59:23.679 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.679 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.680 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.680 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2023-10-19T12:59:23.680 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.680 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.680 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.681 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Jaeger collector container image", 2023-10-19T12:59:23.681 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.681 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.681 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.681 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.682 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_jaeger_query": { 2023-10-19T12:59:23.682 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_jaeger_query", 2023-10-19T12:59:23.682 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.682 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.682 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.683 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2023-10-19T12:59:23.683 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.683 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.683 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.683 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Jaeger query container image", 2023-10-19T12:59:23.683 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.684 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.684 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.684 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.684 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_keepalived": { 2023-10-19T12:59:23.684 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_keepalived", 2023-10-19T12:59:23.685 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.685 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.685 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.685 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2023-10-19T12:59:23.685 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.686 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.686 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.686 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Keepalived container image", 2023-10-19T12:59:23.686 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.686 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.687 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.687 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.687 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_loki": { 2023-10-19T12:59:23.687 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_loki", 2023-10-19T12:59:23.687 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.687 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.688 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.688 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-10-19T12:59:23.688 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.688 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.688 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.689 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Loki container image", 2023-10-19T12:59:23.689 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.689 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.689 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.689 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.690 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_node_exporter": { 2023-10-19T12:59:23.690 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_node_exporter", 2023-10-19T12:59:23.690 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.690 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.690 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.691 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-10-19T12:59:23.691 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.691 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.691 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.691 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Prometheus container image", 2023-10-19T12:59:23.692 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.692 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.692 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.692 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.692 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_nvmeof": { 2023-10-19T12:59:23.692 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_nvmeof", 2023-10-19T12:59:23.693 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.693 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.693 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.693 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/ceph/nvmeof:0.0.3", 2023-10-19T12:59:23.693 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.694 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.694 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.694 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Nvme-of container image", 2023-10-19T12:59:23.694 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.694 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.694 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.695 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.695 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_prometheus": { 2023-10-19T12:59:23.695 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_prometheus", 2023-10-19T12:59:23.695 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.695 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.696 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.696 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-10-19T12:59:23.696 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.696 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.696 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.697 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Prometheus container image", 2023-10-19T12:59:23.697 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.697 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.697 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.697 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.697 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_promtail": { 2023-10-19T12:59:23.698 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_promtail", 2023-10-19T12:59:23.698 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.698 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.698 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.699 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-10-19T12:59:23.699 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.699 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.699 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.699 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Promtail container image", 2023-10-19T12:59:23.700 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.700 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.700 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.700 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.700 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_snmp_gateway": { 2023-10-19T12:59:23.700 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_snmp_gateway", 2023-10-19T12:59:23.701 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.701 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.701 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.701 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-10-19T12:59:23.701 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.702 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.702 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.702 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "SNMP Gateway container image", 2023-10-19T12:59:23.702 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.702 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.703 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.703 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.703 INFO:teuthology.orchestra.run.smithi046.stdout: "container_init": { 2023-10-19T12:59:23.703 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_init", 2023-10-19T12:59:23.704 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.704 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.704 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.704 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:23.704 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.705 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.705 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.705 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Run podman/docker with `--init`", 2023-10-19T12:59:23.705 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.705 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.706 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.706 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.706 INFO:teuthology.orchestra.run.smithi046.stdout: "daemon_cache_timeout": { 2023-10-19T12:59:23.706 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "daemon_cache_timeout", 2023-10-19T12:59:23.706 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2023-10-19T12:59:23.707 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.707 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.707 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "600", 2023-10-19T12:59:23.707 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.707 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.707 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.708 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-10-19T12:59:23.708 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.708 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.708 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.708 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.709 INFO:teuthology.orchestra.run.smithi046.stdout: "default_cephadm_command_timeout": { 2023-10-19T12:59:23.709 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "default_cephadm_command_timeout", 2023-10-19T12:59:23.709 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2023-10-19T12:59:23.709 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.709 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.709 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "900", 2023-10-19T12:59:23.710 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.710 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.710 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.710 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-10-19T12:59:23.710 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.711 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.711 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.711 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.711 INFO:teuthology.orchestra.run.smithi046.stdout: "default_registry": { 2023-10-19T12:59:23.711 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "default_registry", 2023-10-19T12:59:23.711 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.712 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.712 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.712 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "docker.io", 2023-10-19T12:59:23.712 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.712 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.713 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.713 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-10-19T12:59:23.713 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.713 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.713 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.713 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.714 INFO:teuthology.orchestra.run.smithi046.stdout: "device_cache_timeout": { 2023-10-19T12:59:23.714 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "device_cache_timeout", 2023-10-19T12:59:23.714 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2023-10-19T12:59:23.714 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.714 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.715 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "1800", 2023-10-19T12:59:23.715 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.715 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.715 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.716 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "seconds to cache device inventory", 2023-10-19T12:59:23.716 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.716 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.716 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.716 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.717 INFO:teuthology.orchestra.run.smithi046.stdout: "device_enhanced_scan": { 2023-10-19T12:59:23.717 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "device_enhanced_scan", 2023-10-19T12:59:23.717 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.717 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.717 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.717 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:23.718 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.718 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.718 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.718 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Use libstoragemgmt during device scans", 2023-10-19T12:59:23.718 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.719 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.719 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.719 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.719 INFO:teuthology.orchestra.run.smithi046.stdout: "facts_cache_timeout": { 2023-10-19T12:59:23.719 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "facts_cache_timeout", 2023-10-19T12:59:23.720 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2023-10-19T12:59:23.720 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.720 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.720 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "60", 2023-10-19T12:59:23.720 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.720 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.721 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.721 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "seconds to cache host facts data", 2023-10-19T12:59:23.721 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.721 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.721 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.722 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.722 INFO:teuthology.orchestra.run.smithi046.stdout: "host_check_interval": { 2023-10-19T12:59:23.722 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "host_check_interval", 2023-10-19T12:59:23.722 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2023-10-19T12:59:23.722 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.723 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.723 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "600", 2023-10-19T12:59:23.723 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.723 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.723 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.724 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "how frequently to perform a host check", 2023-10-19T12:59:23.724 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.724 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.724 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.724 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.724 INFO:teuthology.orchestra.run.smithi046.stdout: "inventory_list_all": { 2023-10-19T12:59:23.725 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "inventory_list_all", 2023-10-19T12:59:23.725 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.725 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.725 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.725 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:23.726 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.726 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.726 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.726 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2023-10-19T12:59:23.726 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.727 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.727 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.727 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.727 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:23.727 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:23.728 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.728 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.728 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.728 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:23.728 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.729 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.729 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:23.729 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:23.729 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:23.729 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:23.730 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:23.730 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:23.730 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:23.730 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:23.730 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.731 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.731 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.731 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.731 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.731 INFO:teuthology.orchestra.run.smithi046.stdout: "log_refresh_metadata": { 2023-10-19T12:59:23.731 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_refresh_metadata", 2023-10-19T12:59:23.732 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.732 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.732 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.732 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:23.732 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.733 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.733 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.733 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-10-19T12:59:23.733 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.733 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.734 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.734 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.734 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:23.734 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:23.734 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.735 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.735 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.735 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:23.735 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.735 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.736 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.736 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-10-19T12:59:23.736 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.736 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.736 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.737 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.737 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:23.737 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:23.737 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.737 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.737 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.738 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:23.738 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.738 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.738 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:23.738 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:23.739 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:23.739 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:23.739 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:23.739 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:23.739 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:23.739 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:23.740 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.740 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.740 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.740 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.740 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.740 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:23.741 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:23.741 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.741 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.741 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.741 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:23.742 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.742 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.742 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.742 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.742 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.742 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.743 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.743 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.743 INFO:teuthology.orchestra.run.smithi046.stdout: "manage_etc_ceph_ceph_conf": { 2023-10-19T12:59:23.743 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-10-19T12:59:23.743 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.744 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.744 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.744 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:23.744 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.744 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.745 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.745 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-10-19T12:59:23.745 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.745 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.745 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.745 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.746 INFO:teuthology.orchestra.run.smithi046.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-10-19T12:59:23.746 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-10-19T12:59:23.746 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.746 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.746 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.747 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "*", 2023-10-19T12:59:23.747 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.747 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.747 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.747 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-10-19T12:59:23.747 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.748 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.748 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.748 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.748 INFO:teuthology.orchestra.run.smithi046.stdout: "max_count_per_host": { 2023-10-19T12:59:23.748 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "max_count_per_host", 2023-10-19T12:59:23.749 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:23.749 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.749 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.749 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "10", 2023-10-19T12:59:23.749 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.749 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.750 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.750 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "max number of daemons per service per host", 2023-10-19T12:59:23.750 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.750 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.750 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.751 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.751 INFO:teuthology.orchestra.run.smithi046.stdout: "max_osd_draining_count": { 2023-10-19T12:59:23.751 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "max_osd_draining_count", 2023-10-19T12:59:23.751 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:23.751 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.751 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.752 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "10", 2023-10-19T12:59:23.752 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.752 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.752 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.752 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-10-19T12:59:23.753 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.753 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.753 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.753 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.753 INFO:teuthology.orchestra.run.smithi046.stdout: "migration_current": { 2023-10-19T12:59:23.754 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "migration_current", 2023-10-19T12:59:23.754 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:23.754 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.754 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.754 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:23.755 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.755 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.755 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.755 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "internal - do not modify", 2023-10-19T12:59:23.755 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.756 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.756 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.756 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.756 INFO:teuthology.orchestra.run.smithi046.stdout: "mode": { 2023-10-19T12:59:23.756 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "mode", 2023-10-19T12:59:23.757 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.757 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.757 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.757 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "root", 2023-10-19T12:59:23.757 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.758 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.758 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:23.758 INFO:teuthology.orchestra.run.smithi046.stdout: "cephadm-package", 2023-10-19T12:59:23.758 INFO:teuthology.orchestra.run.smithi046.stdout: "root" 2023-10-19T12:59:23.758 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:23.759 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "mode for remote execution of cephadm", 2023-10-19T12:59:23.759 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.759 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.759 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.759 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.759 INFO:teuthology.orchestra.run.smithi046.stdout: "prometheus_alerts_path": { 2023-10-19T12:59:23.760 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "prometheus_alerts_path", 2023-10-19T12:59:23.760 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.760 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.760 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.760 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-10-19T12:59:23.761 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.761 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.761 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.761 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-10-19T12:59:23.761 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.762 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.762 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.762 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.762 INFO:teuthology.orchestra.run.smithi046.stdout: "registry_insecure": { 2023-10-19T12:59:23.762 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "registry_insecure", 2023-10-19T12:59:23.763 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.763 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.763 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.763 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:23.763 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.763 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.764 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.764 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-10-19T12:59:23.764 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.764 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.764 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.765 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.765 INFO:teuthology.orchestra.run.smithi046.stdout: "registry_password": { 2023-10-19T12:59:23.765 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "registry_password", 2023-10-19T12:59:23.765 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.765 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.766 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.766 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:23.766 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.766 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.766 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.766 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-10-19T12:59:23.767 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.767 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.767 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.767 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.767 INFO:teuthology.orchestra.run.smithi046.stdout: "registry_url": { 2023-10-19T12:59:23.768 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "registry_url", 2023-10-19T12:59:23.768 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.768 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.768 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.768 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:23.769 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.769 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.769 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.769 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-10-19T12:59:23.769 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.770 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.770 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.770 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.770 INFO:teuthology.orchestra.run.smithi046.stdout: "registry_username": { 2023-10-19T12:59:23.770 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "registry_username", 2023-10-19T12:59:23.771 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.771 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.771 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.771 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:23.771 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.771 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.772 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.772 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-10-19T12:59:23.772 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.772 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.772 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.773 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.773 INFO:teuthology.orchestra.run.smithi046.stdout: "secure_monitoring_stack": { 2023-10-19T12:59:23.773 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "secure_monitoring_stack", 2023-10-19T12:59:23.773 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.773 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.774 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.774 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:23.774 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.774 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.774 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.775 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2023-10-19T12:59:23.775 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.775 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.775 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.775 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.776 INFO:teuthology.orchestra.run.smithi046.stdout: "service_discovery_port": { 2023-10-19T12:59:23.776 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "service_discovery_port", 2023-10-19T12:59:23.776 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:23.776 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.776 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.776 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "8765", 2023-10-19T12:59:23.777 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.777 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.777 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.777 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "cephadm service discovery port", 2023-10-19T12:59:23.777 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.778 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.778 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.778 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.778 INFO:teuthology.orchestra.run.smithi046.stdout: "ssh_config_file": { 2023-10-19T12:59:23.778 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ssh_config_file", 2023-10-19T12:59:23.778 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.779 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.779 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.779 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:23.779 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.779 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.780 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.780 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-10-19T12:59:23.780 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.780 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.780 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.780 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.781 INFO:teuthology.orchestra.run.smithi046.stdout: "use_agent": { 2023-10-19T12:59:23.781 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "use_agent", 2023-10-19T12:59:23.781 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.781 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.781 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.782 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:23.782 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.782 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.782 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.782 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-10-19T12:59:23.783 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.783 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.783 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.783 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.783 INFO:teuthology.orchestra.run.smithi046.stdout: "use_repo_digest": { 2023-10-19T12:59:23.783 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "use_repo_digest", 2023-10-19T12:59:23.784 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.784 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.784 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.784 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:23.784 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.785 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.785 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.785 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-10-19T12:59:23.785 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.785 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.786 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.786 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.786 INFO:teuthology.orchestra.run.smithi046.stdout: "warn_on_failed_host_check": { 2023-10-19T12:59:23.786 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "warn_on_failed_host_check", 2023-10-19T12:59:23.786 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.786 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.787 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.787 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:23.787 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.787 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.787 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.788 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "raise a health warning if the host check fails", 2023-10-19T12:59:23.788 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.788 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.788 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.788 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.789 INFO:teuthology.orchestra.run.smithi046.stdout: "warn_on_stray_daemons": { 2023-10-19T12:59:23.789 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "warn_on_stray_daemons", 2023-10-19T12:59:23.789 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.789 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.790 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.790 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:23.790 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.790 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.790 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.791 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-10-19T12:59:23.791 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.791 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.791 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.791 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.791 INFO:teuthology.orchestra.run.smithi046.stdout: "warn_on_stray_hosts": { 2023-10-19T12:59:23.792 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "warn_on_stray_hosts", 2023-10-19T12:59:23.792 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.792 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.792 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.792 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:23.793 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.793 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.793 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.793 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-10-19T12:59:23.793 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.793 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.794 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.794 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:23.794 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:23.794 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.794 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:23.795 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "crash", 2023-10-19T12:59:23.795 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:23.795 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:23.795 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:23.795 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:23.796 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:23.796 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.796 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.796 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.796 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:23.797 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.797 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.797 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:23.797 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:23.797 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:23.797 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:23.798 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:23.798 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:23.798 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:23.798 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:23.798 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.799 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.799 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.799 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.799 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.799 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:23.800 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:23.800 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.800 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.800 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.800 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:23.800 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.801 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.801 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.801 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.801 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.801 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.802 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.802 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.802 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:23.802 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:23.802 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.803 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.803 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.803 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:23.803 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.803 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.804 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:23.804 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:23.804 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:23.804 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:23.804 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:23.805 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:23.805 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:23.805 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:23.805 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.805 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.806 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.806 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.806 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.806 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:23.806 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:23.807 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.807 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.807 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.807 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:23.807 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.808 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.808 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.808 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.808 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.808 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.808 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.809 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.809 INFO:teuthology.orchestra.run.smithi046.stdout: "retain_interval": { 2023-10-19T12:59:23.809 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "retain_interval", 2023-10-19T12:59:23.809 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2023-10-19T12:59:23.809 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.810 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.810 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "31536000", 2023-10-19T12:59:23.810 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.810 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.810 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.811 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "how long to retain crashes before pruning them", 2023-10-19T12:59:23.811 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.811 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.811 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.811 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.812 INFO:teuthology.orchestra.run.smithi046.stdout: "warn_recent_interval": { 2023-10-19T12:59:23.812 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "warn_recent_interval", 2023-10-19T12:59:23.812 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2023-10-19T12:59:23.812 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.812 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.813 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "1209600", 2023-10-19T12:59:23.813 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.813 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.813 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.813 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "time interval in which to warn about recent crashes", 2023-10-19T12:59:23.814 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.814 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.814 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.814 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:23.814 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:23.815 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.815 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:23.815 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "dashboard", 2023-10-19T12:59:23.815 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:23.815 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:23.816 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:23.816 INFO:teuthology.orchestra.run.smithi046.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-10-19T12:59:23.816 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-10-19T12:59:23.816 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:23.816 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.817 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.817 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "10", 2023-10-19T12:59:23.817 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.817 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.817 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.817 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.818 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.818 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.818 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.818 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.818 INFO:teuthology.orchestra.run.smithi046.stdout: "ALERTMANAGER_API_HOST": { 2023-10-19T12:59:23.819 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ALERTMANAGER_API_HOST", 2023-10-19T12:59:23.819 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.819 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.819 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.819 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:23.820 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.820 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.820 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.820 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.820 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.820 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.821 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.821 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.821 INFO:teuthology.orchestra.run.smithi046.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-10-19T12:59:23.821 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-10-19T12:59:23.821 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.822 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.822 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.822 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:23.822 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.822 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.822 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.823 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.823 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.823 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.823 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.823 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.824 INFO:teuthology.orchestra.run.smithi046.stdout: "AUDIT_API_ENABLED": { 2023-10-19T12:59:23.824 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "AUDIT_API_ENABLED", 2023-10-19T12:59:23.824 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.824 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.824 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.824 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:23.825 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.825 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.825 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.825 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.826 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.826 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.826 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.826 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.826 INFO:teuthology.orchestra.run.smithi046.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-10-19T12:59:23.827 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-10-19T12:59:23.827 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.827 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.827 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.827 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:23.827 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.828 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.828 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.828 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.828 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.828 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.829 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.829 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.829 INFO:teuthology.orchestra.run.smithi046.stdout: "ENABLE_BROWSABLE_API": { 2023-10-19T12:59:23.829 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ENABLE_BROWSABLE_API", 2023-10-19T12:59:23.829 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.830 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.830 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.830 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:23.830 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.830 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.831 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.831 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.831 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.831 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.831 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.832 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.832 INFO:teuthology.orchestra.run.smithi046.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-10-19T12:59:23.832 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-10-19T12:59:23.832 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.832 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.833 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.833 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:23.833 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.833 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.834 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.834 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.834 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.834 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.834 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.835 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.835 INFO:teuthology.orchestra.run.smithi046.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-10-19T12:59:23.835 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-10-19T12:59:23.835 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.835 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.836 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.836 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:23.836 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.836 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.836 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.837 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.837 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.837 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.837 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.837 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.837 INFO:teuthology.orchestra.run.smithi046.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-10-19T12:59:23.838 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-10-19T12:59:23.838 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.838 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.838 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.838 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:23.839 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.839 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.839 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.839 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.839 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.840 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.840 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.840 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.840 INFO:teuthology.orchestra.run.smithi046.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-10-19T12:59:23.840 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-10-19T12:59:23.841 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.841 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.841 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.841 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:23.841 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.842 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.842 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.842 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.842 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.842 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.842 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.843 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.843 INFO:teuthology.orchestra.run.smithi046.stdout: "FEATURE_TOGGLE_NFS": { 2023-10-19T12:59:23.843 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-10-19T12:59:23.843 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.843 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.844 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.844 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:23.844 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.844 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.844 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.845 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.845 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.845 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.845 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.845 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.846 INFO:teuthology.orchestra.run.smithi046.stdout: "FEATURE_TOGGLE_RBD": { 2023-10-19T12:59:23.846 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-10-19T12:59:23.846 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.846 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.846 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.847 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:23.847 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.847 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.847 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.847 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.848 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.848 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.848 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.848 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.848 INFO:teuthology.orchestra.run.smithi046.stdout: "FEATURE_TOGGLE_RGW": { 2023-10-19T12:59:23.848 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-10-19T12:59:23.849 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.849 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.849 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.849 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:23.849 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.850 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.850 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.850 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.850 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.850 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.851 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.851 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.851 INFO:teuthology.orchestra.run.smithi046.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-10-19T12:59:23.851 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-10-19T12:59:23.852 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.852 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.852 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.852 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:23.852 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.853 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.853 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.853 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.853 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.854 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.854 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.854 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.854 INFO:teuthology.orchestra.run.smithi046.stdout: "GRAFANA_API_PASSWORD": { 2023-10-19T12:59:23.854 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "GRAFANA_API_PASSWORD", 2023-10-19T12:59:23.855 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.855 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.855 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.855 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "admin", 2023-10-19T12:59:23.855 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.856 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.856 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.856 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.856 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.856 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.857 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.857 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.857 INFO:teuthology.orchestra.run.smithi046.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-10-19T12:59:23.857 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-10-19T12:59:23.857 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.858 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.858 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.858 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:23.858 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.858 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.859 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.859 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.859 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.859 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.859 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.860 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.860 INFO:teuthology.orchestra.run.smithi046.stdout: "GRAFANA_API_URL": { 2023-10-19T12:59:23.860 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "GRAFANA_API_URL", 2023-10-19T12:59:23.860 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.861 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.861 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.861 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:23.861 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.861 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.861 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.862 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.862 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.862 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.862 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.862 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.863 INFO:teuthology.orchestra.run.smithi046.stdout: "GRAFANA_API_USERNAME": { 2023-10-19T12:59:23.863 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "GRAFANA_API_USERNAME", 2023-10-19T12:59:23.863 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.863 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.863 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.864 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "admin", 2023-10-19T12:59:23.864 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.864 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.864 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.864 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.865 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.865 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.865 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.865 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.865 INFO:teuthology.orchestra.run.smithi046.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-10-19T12:59:23.866 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-10-19T12:59:23.866 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.866 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.866 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.866 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:23.866 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.867 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.867 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.867 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.867 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.867 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.868 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.868 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.868 INFO:teuthology.orchestra.run.smithi046.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-10-19T12:59:23.868 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-10-19T12:59:23.868 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.869 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.869 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.869 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:23.869 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.869 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.869 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.870 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.870 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.870 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.870 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.870 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.871 INFO:teuthology.orchestra.run.smithi046.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-10-19T12:59:23.871 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-10-19T12:59:23.871 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.871 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.871 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.872 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:23.872 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.872 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.872 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.872 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.872 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.873 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.873 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.873 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.873 INFO:teuthology.orchestra.run.smithi046.stdout: "ISSUE_TRACKER_API_KEY": { 2023-10-19T12:59:23.873 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-10-19T12:59:23.874 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.874 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.874 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.874 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:23.874 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.875 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.875 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.875 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.875 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.875 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.876 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.876 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.876 INFO:teuthology.orchestra.run.smithi046.stdout: "PROMETHEUS_API_HOST": { 2023-10-19T12:59:23.876 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PROMETHEUS_API_HOST", 2023-10-19T12:59:23.876 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.877 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.877 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.877 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:23.877 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.877 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.878 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.878 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.878 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.878 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.878 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.879 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.879 INFO:teuthology.orchestra.run.smithi046.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-10-19T12:59:23.879 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-10-19T12:59:23.879 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.880 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.880 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.880 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:23.880 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.881 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.881 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.881 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.881 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.881 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.882 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.882 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.882 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-10-19T12:59:23.882 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-10-19T12:59:23.883 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.883 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.883 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.883 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:23.884 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.884 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.884 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.884 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.885 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.885 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.885 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.885 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.886 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-10-19T12:59:23.886 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-10-19T12:59:23.886 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.886 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.887 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.887 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:23.887 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.887 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.887 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.888 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.888 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.888 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.888 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.889 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.889 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-10-19T12:59:23.889 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-10-19T12:59:23.889 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.890 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.890 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.890 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:23.890 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.890 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.891 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.891 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.891 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.891 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.892 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.892 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.892 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-10-19T12:59:23.892 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-10-19T12:59:23.893 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.893 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.893 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.893 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:23.893 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.894 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.894 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.894 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.894 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.895 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.895 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.895 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.895 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-10-19T12:59:23.895 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-10-19T12:59:23.896 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.896 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.896 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.896 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:23.896 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.897 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.897 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.897 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.897 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.897 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.897 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.898 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.898 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-10-19T12:59:23.898 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-10-19T12:59:23.898 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.899 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.899 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.899 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:23.899 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.899 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.899 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.900 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.900 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.900 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.900 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.900 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.901 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-10-19T12:59:23.901 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-10-19T12:59:23.901 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.901 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.901 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.902 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:23.902 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.902 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.902 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.902 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.903 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.903 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.903 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.903 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.903 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_ENABLED": { 2023-10-19T12:59:23.903 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_ENABLED", 2023-10-19T12:59:23.904 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.904 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.904 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.904 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:23.905 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.905 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.905 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.905 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.905 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.906 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.906 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.906 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.906 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-10-19T12:59:23.906 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-10-19T12:59:23.907 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.907 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.907 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.907 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-10-19T12:59:23.908 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.908 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.908 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.908 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.908 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.909 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.909 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.909 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.909 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-10-19T12:59:23.909 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-10-19T12:59:23.910 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:23.910 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.910 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.910 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "10", 2023-10-19T12:59:23.911 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.911 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.911 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.911 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.911 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.912 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.912 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.912 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.912 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-10-19T12:59:23.912 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-10-19T12:59:23.913 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:23.913 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.913 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.913 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "8", 2023-10-19T12:59:23.914 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.914 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.914 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.914 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.914 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.915 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.915 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.915 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.915 INFO:teuthology.orchestra.run.smithi046.stdout: "REST_REQUESTS_TIMEOUT": { 2023-10-19T12:59:23.915 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-10-19T12:59:23.916 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:23.916 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.916 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.916 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "45", 2023-10-19T12:59:23.916 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.916 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.917 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.917 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.917 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.917 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.917 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.917 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.918 INFO:teuthology.orchestra.run.smithi046.stdout: "RGW_API_ACCESS_KEY": { 2023-10-19T12:59:23.918 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "RGW_API_ACCESS_KEY", 2023-10-19T12:59:23.918 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.918 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.918 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.919 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:23.919 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.919 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.919 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.919 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.920 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.920 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.920 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.920 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.920 INFO:teuthology.orchestra.run.smithi046.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-10-19T12:59:23.921 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-10-19T12:59:23.921 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.921 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.921 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.922 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "admin", 2023-10-19T12:59:23.922 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.922 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.922 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.922 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.922 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.923 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.923 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.923 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.923 INFO:teuthology.orchestra.run.smithi046.stdout: "RGW_API_SECRET_KEY": { 2023-10-19T12:59:23.923 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "RGW_API_SECRET_KEY", 2023-10-19T12:59:23.923 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.924 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.924 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.924 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:23.924 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.924 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.925 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.925 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.925 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.925 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.925 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.926 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.926 INFO:teuthology.orchestra.run.smithi046.stdout: "RGW_API_SSL_VERIFY": { 2023-10-19T12:59:23.926 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "RGW_API_SSL_VERIFY", 2023-10-19T12:59:23.926 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.926 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.927 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.927 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:23.927 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.927 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.927 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.928 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.928 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.928 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.928 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.928 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.929 INFO:teuthology.orchestra.run.smithi046.stdout: "UNSAFE_TLS_v1_2": { 2023-10-19T12:59:23.929 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "UNSAFE_TLS_v1_2", 2023-10-19T12:59:23.929 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.929 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.929 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.930 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:23.930 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.930 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.930 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.930 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.931 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.931 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.931 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.931 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.931 INFO:teuthology.orchestra.run.smithi046.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-10-19T12:59:23.932 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-10-19T12:59:23.932 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:23.932 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.932 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.932 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2023-10-19T12:59:23.933 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.933 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.933 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.933 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.933 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.934 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.934 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.934 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.934 INFO:teuthology.orchestra.run.smithi046.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-10-19T12:59:23.934 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-10-19T12:59:23.935 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:23.935 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.935 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.935 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "10", 2023-10-19T12:59:23.935 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.935 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.936 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.936 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.936 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.936 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.936 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.937 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.937 INFO:teuthology.orchestra.run.smithi046.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-10-19T12:59:23.937 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-10-19T12:59:23.937 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:23.937 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.937 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.938 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "5", 2023-10-19T12:59:23.938 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.938 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.938 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.938 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.939 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.939 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.939 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.939 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.939 INFO:teuthology.orchestra.run.smithi046.stdout: "cross_origin_url": { 2023-10-19T12:59:23.940 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "cross_origin_url", 2023-10-19T12:59:23.940 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.940 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.940 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.940 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:23.940 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.941 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.941 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.941 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.941 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.942 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.942 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.942 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.942 INFO:teuthology.orchestra.run.smithi046.stdout: "crt_file": { 2023-10-19T12:59:23.942 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "crt_file", 2023-10-19T12:59:23.943 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.943 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.943 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.943 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:23.943 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.943 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.944 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.944 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.944 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.944 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.944 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.945 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.945 INFO:teuthology.orchestra.run.smithi046.stdout: "debug": { 2023-10-19T12:59:23.945 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "debug", 2023-10-19T12:59:23.945 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.945 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.946 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.946 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:23.946 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.946 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.946 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.947 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Enable/disable debug options", 2023-10-19T12:59:23.947 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.947 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.947 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.947 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.948 INFO:teuthology.orchestra.run.smithi046.stdout: "jwt_token_ttl": { 2023-10-19T12:59:23.948 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "jwt_token_ttl", 2023-10-19T12:59:23.948 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:23.948 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.948 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.948 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "28800", 2023-10-19T12:59:23.949 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.949 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.949 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.949 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.949 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.949 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.950 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.950 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.950 INFO:teuthology.orchestra.run.smithi046.stdout: "key_file": { 2023-10-19T12:59:23.950 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "key_file", 2023-10-19T12:59:23.950 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.951 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.951 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.951 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:23.951 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.951 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.952 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.952 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.952 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.952 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.952 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.953 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.953 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:23.953 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:23.953 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.953 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.953 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.954 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:23.954 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.954 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.954 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:23.954 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:23.954 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:23.955 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:23.955 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:23.955 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:23.955 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:23.955 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:23.956 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.956 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.956 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.956 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.956 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.956 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:23.957 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:23.957 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.957 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.957 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.957 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:23.958 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.958 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.958 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.958 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.958 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.958 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.959 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.959 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.959 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:23.959 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:23.959 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.959 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.960 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.960 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:23.960 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.960 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.960 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:23.960 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:23.961 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:23.961 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:23.961 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:23.961 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:23.961 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:23.962 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:23.962 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.962 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.962 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.962 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.963 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.963 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:23.963 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:23.963 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.963 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.964 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.964 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:23.964 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.964 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.964 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.965 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.965 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.965 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.965 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.965 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.965 INFO:teuthology.orchestra.run.smithi046.stdout: "motd": { 2023-10-19T12:59:23.966 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "motd", 2023-10-19T12:59:23.966 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.966 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.966 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.966 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:23.967 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.967 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.967 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.967 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "The message of the day", 2023-10-19T12:59:23.967 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.967 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.968 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.968 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.968 INFO:teuthology.orchestra.run.smithi046.stdout: "redirect_resolve_ip_addr": { 2023-10-19T12:59:23.968 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "redirect_resolve_ip_addr", 2023-10-19T12:59:23.968 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.969 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.969 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.969 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:23.969 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.969 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.970 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.970 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.970 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.970 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.970 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.971 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.971 INFO:teuthology.orchestra.run.smithi046.stdout: "server_addr": { 2023-10-19T12:59:23.971 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "server_addr", 2023-10-19T12:59:23.971 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.971 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.972 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.972 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "::", 2023-10-19T12:59:23.972 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.972 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.972 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.973 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.973 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.973 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.973 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.973 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.974 INFO:teuthology.orchestra.run.smithi046.stdout: "server_port": { 2023-10-19T12:59:23.974 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "server_port", 2023-10-19T12:59:23.974 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:23.974 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.974 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.975 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "8080", 2023-10-19T12:59:23.975 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.975 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.975 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.975 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.976 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.976 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.976 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.976 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.976 INFO:teuthology.orchestra.run.smithi046.stdout: "ssl": { 2023-10-19T12:59:23.976 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ssl", 2023-10-19T12:59:23.977 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.977 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.977 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.977 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:23.977 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.978 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.978 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.978 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.978 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.978 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.978 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.979 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.979 INFO:teuthology.orchestra.run.smithi046.stdout: "ssl_server_port": { 2023-10-19T12:59:23.979 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ssl_server_port", 2023-10-19T12:59:23.979 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:23.979 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.980 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.980 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "8443", 2023-10-19T12:59:23.980 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.980 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.980 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.981 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.981 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.981 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.981 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.981 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.982 INFO:teuthology.orchestra.run.smithi046.stdout: "standby_behaviour": { 2023-10-19T12:59:23.982 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "standby_behaviour", 2023-10-19T12:59:23.982 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.982 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.982 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.982 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "redirect", 2023-10-19T12:59:23.983 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.983 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.983 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:23.983 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:23.983 INFO:teuthology.orchestra.run.smithi046.stdout: "redirect" 2023-10-19T12:59:23.984 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:23.984 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.984 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.984 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.984 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.985 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.985 INFO:teuthology.orchestra.run.smithi046.stdout: "standby_error_status_code": { 2023-10-19T12:59:23.985 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "standby_error_status_code", 2023-10-19T12:59:23.985 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:23.985 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.985 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.986 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "500", 2023-10-19T12:59:23.986 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "400", 2023-10-19T12:59:23.986 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "599", 2023-10-19T12:59:23.986 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.986 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.987 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.987 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.987 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.987 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.987 INFO:teuthology.orchestra.run.smithi046.stdout: "url_prefix": { 2023-10-19T12:59:23.988 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "url_prefix", 2023-10-19T12:59:23.988 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.988 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.988 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:23.988 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:23.989 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.989 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.989 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.989 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.989 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.990 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.990 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.990 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:23.990 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:23.990 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.991 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:23.991 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "devicehealth", 2023-10-19T12:59:23.991 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:23.991 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:23.991 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:23.991 INFO:teuthology.orchestra.run.smithi046.stdout: "enable_monitoring": { 2023-10-19T12:59:23.992 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "enable_monitoring", 2023-10-19T12:59:23.992 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.992 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.992 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.992 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:23.992 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.993 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.993 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.993 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "monitor device health metrics", 2023-10-19T12:59:23.993 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.993 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.993 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.994 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.994 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:23.994 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:23.994 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:23.994 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.995 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.995 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:23.995 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.995 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.995 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:23.996 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:23.996 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:23.996 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:23.996 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:23.996 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:23.997 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:23.997 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:23.997 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:23.997 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:23.997 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:23.997 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:23.998 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:23.998 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:23.998 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:23.998 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:23.998 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:23.998 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:23.999 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:23.999 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:23.999 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:23.999 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:23.999 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.000 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.000 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.000 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.000 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.000 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:24.000 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:24.001 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.001 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.001 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.001 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:24.001 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.001 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.002 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:24.002 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:24.002 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:24.002 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:24.002 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:24.003 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:24.003 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:24.003 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:24.003 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.004 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.004 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.004 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.004 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.004 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:24.005 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:24.005 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:24.005 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.005 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.005 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:24.005 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.006 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.006 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.006 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.006 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.006 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.007 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.007 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.007 INFO:teuthology.orchestra.run.smithi046.stdout: "mark_out_threshold": { 2023-10-19T12:59:24.007 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "mark_out_threshold", 2023-10-19T12:59:24.007 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2023-10-19T12:59:24.008 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.008 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.008 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "2419200", 2023-10-19T12:59:24.008 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.008 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.009 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.009 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-10-19T12:59:24.009 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.009 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.009 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.009 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.010 INFO:teuthology.orchestra.run.smithi046.stdout: "pool_name": { 2023-10-19T12:59:24.010 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "pool_name", 2023-10-19T12:59:24.010 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.010 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.010 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.011 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "device_health_metrics", 2023-10-19T12:59:24.011 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.011 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.011 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.011 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "name of pool in which to store device health metrics", 2023-10-19T12:59:24.011 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.012 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.012 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.012 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.012 INFO:teuthology.orchestra.run.smithi046.stdout: "retention_period": { 2023-10-19T12:59:24.012 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "retention_period", 2023-10-19T12:59:24.013 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2023-10-19T12:59:24.013 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.013 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.013 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "15552000", 2023-10-19T12:59:24.013 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.014 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.014 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.014 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "how long to retain device health metrics", 2023-10-19T12:59:24.014 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.014 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.015 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.015 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.015 INFO:teuthology.orchestra.run.smithi046.stdout: "scrape_frequency": { 2023-10-19T12:59:24.015 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "scrape_frequency", 2023-10-19T12:59:24.015 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2023-10-19T12:59:24.015 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.016 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.016 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "86400", 2023-10-19T12:59:24.016 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.016 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.016 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.017 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "how frequently to scrape device health metrics", 2023-10-19T12:59:24.017 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.017 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.017 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.017 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.018 INFO:teuthology.orchestra.run.smithi046.stdout: "self_heal": { 2023-10-19T12:59:24.018 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "self_heal", 2023-10-19T12:59:24.018 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:24.018 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.018 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.018 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:24.019 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.019 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.019 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.019 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-10-19T12:59:24.019 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.020 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.020 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.020 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.020 INFO:teuthology.orchestra.run.smithi046.stdout: "sleep_interval": { 2023-10-19T12:59:24.020 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sleep_interval", 2023-10-19T12:59:24.021 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2023-10-19T12:59:24.021 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.021 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.021 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "600", 2023-10-19T12:59:24.021 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.022 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.022 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.022 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "how frequently to wake up and check device health", 2023-10-19T12:59:24.022 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.022 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.023 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.023 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.023 INFO:teuthology.orchestra.run.smithi046.stdout: "warn_threshold": { 2023-10-19T12:59:24.023 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "warn_threshold", 2023-10-19T12:59:24.023 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2023-10-19T12:59:24.023 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.024 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.024 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "7257600", 2023-10-19T12:59:24.024 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.024 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.024 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.024 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-10-19T12:59:24.025 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.025 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.025 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.025 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:24.025 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:24.026 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.026 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:24.026 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "diskprediction_local", 2023-10-19T12:59:24.026 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:24.026 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:24.027 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:24.027 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:24.027 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:24.027 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.027 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.027 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.028 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:24.028 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.028 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.028 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:24.028 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:24.028 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:24.029 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:24.029 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:24.029 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:24.029 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:24.029 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:24.029 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.030 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.030 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.030 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.030 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.030 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:24.031 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:24.031 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:24.031 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.031 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.031 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:24.031 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.032 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.034 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.034 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.034 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.034 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.034 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.035 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.035 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:24.035 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:24.035 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.035 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.036 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.036 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:24.036 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.036 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.036 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:24.036 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:24.037 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:24.037 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:24.037 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:24.037 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:24.037 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:24.037 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:24.038 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.038 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.038 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.038 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.038 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.039 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:24.039 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:24.039 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:24.039 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.039 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.039 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:24.040 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.040 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.040 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.040 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.040 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.040 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.041 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.041 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.041 INFO:teuthology.orchestra.run.smithi046.stdout: "predict_interval": { 2023-10-19T12:59:24.041 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "predict_interval", 2023-10-19T12:59:24.041 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.041 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.042 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:24.042 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "86400", 2023-10-19T12:59:24.042 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.042 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.042 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.043 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.043 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.043 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.043 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.043 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.044 INFO:teuthology.orchestra.run.smithi046.stdout: "predictor_model": { 2023-10-19T12:59:24.044 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "predictor_model", 2023-10-19T12:59:24.044 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.044 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.044 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:24.044 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "prophetstor", 2023-10-19T12:59:24.045 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.045 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.045 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.045 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.045 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.045 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.046 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.046 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.046 INFO:teuthology.orchestra.run.smithi046.stdout: "sleep_interval": { 2023-10-19T12:59:24.046 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sleep_interval", 2023-10-19T12:59:24.046 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.047 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.047 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:24.047 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "600", 2023-10-19T12:59:24.047 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.047 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.048 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.048 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.048 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.048 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.048 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.049 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:24.049 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:24.049 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.049 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:24.049 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "influx", 2023-10-19T12:59:24.050 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": false, 2023-10-19T12:59:24.050 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "influxdb python module not found", 2023-10-19T12:59:24.050 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:24.050 INFO:teuthology.orchestra.run.smithi046.stdout: "batch_size": { 2023-10-19T12:59:24.050 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "batch_size", 2023-10-19T12:59:24.051 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:24.051 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.051 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:24.051 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "5000", 2023-10-19T12:59:24.051 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.052 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.052 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.052 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-10-19T12:59:24.052 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.052 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.053 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.053 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.053 INFO:teuthology.orchestra.run.smithi046.stdout: "database": { 2023-10-19T12:59:24.053 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "database", 2023-10-19T12:59:24.053 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.054 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.054 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:24.054 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "ceph", 2023-10-19T12:59:24.054 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.054 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.054 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.055 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-10-19T12:59:24.055 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.055 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.055 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.055 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.056 INFO:teuthology.orchestra.run.smithi046.stdout: "hostname": { 2023-10-19T12:59:24.056 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "hostname", 2023-10-19T12:59:24.056 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.056 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.056 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:24.056 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:24.057 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.057 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.057 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.057 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "InfluxDB server hostname", 2023-10-19T12:59:24.057 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.057 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.058 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.058 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.058 INFO:teuthology.orchestra.run.smithi046.stdout: "interval": { 2023-10-19T12:59:24.058 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "interval", 2023-10-19T12:59:24.058 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2023-10-19T12:59:24.059 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.059 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:24.059 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "30", 2023-10-19T12:59:24.059 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "5", 2023-10-19T12:59:24.059 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.059 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.060 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-10-19T12:59:24.060 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.060 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.060 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.060 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.061 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:24.061 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:24.061 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.061 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.061 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.061 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:24.062 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.062 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.062 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:24.062 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:24.062 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:24.063 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:24.063 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:24.063 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:24.063 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:24.063 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:24.064 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.064 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.064 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.064 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.064 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.065 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:24.065 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:24.065 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:24.065 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.065 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.066 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:24.066 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.066 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.066 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.066 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.067 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.067 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.067 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.067 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.067 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:24.067 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:24.068 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.068 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.068 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.069 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:24.069 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.069 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.069 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:24.069 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:24.069 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:24.070 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:24.070 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:24.070 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:24.070 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:24.070 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:24.071 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.071 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.071 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.071 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.071 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.072 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:24.072 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:24.072 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:24.072 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.072 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.073 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:24.073 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.073 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.073 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.073 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.073 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.074 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.074 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.074 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.074 INFO:teuthology.orchestra.run.smithi046.stdout: "password": { 2023-10-19T12:59:24.074 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "password", 2023-10-19T12:59:24.075 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.075 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.075 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:24.075 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:24.076 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.076 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.076 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.076 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "password of InfluxDB server user", 2023-10-19T12:59:24.076 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.077 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.077 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.077 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.077 INFO:teuthology.orchestra.run.smithi046.stdout: "port": { 2023-10-19T12:59:24.077 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "port", 2023-10-19T12:59:24.078 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:24.078 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.078 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:24.078 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "8086", 2023-10-19T12:59:24.078 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.079 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.079 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.079 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "InfluxDB server port", 2023-10-19T12:59:24.079 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.079 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.080 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.080 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.080 INFO:teuthology.orchestra.run.smithi046.stdout: "ssl": { 2023-10-19T12:59:24.080 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ssl", 2023-10-19T12:59:24.080 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.081 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.081 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:24.081 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "false", 2023-10-19T12:59:24.081 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.081 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.081 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.082 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-10-19T12:59:24.082 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.082 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.082 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.082 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.083 INFO:teuthology.orchestra.run.smithi046.stdout: "threads": { 2023-10-19T12:59:24.083 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "threads", 2023-10-19T12:59:24.083 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:24.083 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.083 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:24.084 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "5", 2023-10-19T12:59:24.084 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "1", 2023-10-19T12:59:24.084 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "32", 2023-10-19T12:59:24.084 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.084 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-10-19T12:59:24.085 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.085 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.085 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.085 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.085 INFO:teuthology.orchestra.run.smithi046.stdout: "username": { 2023-10-19T12:59:24.086 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "username", 2023-10-19T12:59:24.086 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.086 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.086 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:24.086 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:24.087 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.087 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.087 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.087 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "username of InfluxDB server user", 2023-10-19T12:59:24.087 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.087 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.088 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.088 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.088 INFO:teuthology.orchestra.run.smithi046.stdout: "verify_ssl": { 2023-10-19T12:59:24.088 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "verify_ssl", 2023-10-19T12:59:24.088 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.089 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.089 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:24.089 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "true", 2023-10-19T12:59:24.089 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.089 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.090 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.090 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-10-19T12:59:24.090 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.090 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.090 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.091 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:24.091 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:24.091 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.091 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:24.091 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "insights", 2023-10-19T12:59:24.092 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:24.092 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:24.092 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:24.092 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:24.092 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:24.092 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.093 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.093 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.093 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:24.093 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.093 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.094 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:24.094 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:24.094 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:24.094 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:24.094 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:24.095 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:24.095 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:24.095 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:24.095 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.095 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.095 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.096 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.096 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.096 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:24.096 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:24.096 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:24.097 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.097 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.097 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:24.097 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.097 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.098 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.098 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.098 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.098 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.098 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.098 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.099 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:24.099 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:24.099 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.099 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.099 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.100 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:24.100 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.100 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.100 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:24.100 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:24.100 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:24.101 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:24.101 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:24.101 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:24.101 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:24.101 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:24.102 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.102 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.102 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.102 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.102 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.102 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:24.103 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:24.103 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:24.103 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.103 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.103 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:24.103 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.104 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.104 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.104 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.104 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.104 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.105 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.105 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:24.105 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:24.105 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.105 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:24.105 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "iostat", 2023-10-19T12:59:24.106 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:24.106 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:24.106 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:24.106 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:24.106 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:24.107 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.107 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.107 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.107 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:24.107 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.108 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.108 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:24.108 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:24.108 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:24.108 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:24.109 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:24.109 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:24.109 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:24.109 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:24.109 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.109 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.110 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.110 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.110 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.110 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:24.110 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:24.111 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:24.111 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.111 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.111 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:24.111 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.112 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.112 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.112 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.112 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.112 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.112 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.113 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.113 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:24.113 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:24.113 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.113 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.114 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.114 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:24.114 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.114 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.114 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:24.114 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:24.115 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:24.115 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:24.115 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:24.115 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:24.115 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:24.116 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:24.116 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.116 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.116 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.116 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.116 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.117 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:24.117 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:24.117 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:24.117 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.117 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.118 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:24.118 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.118 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.118 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.118 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.119 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.119 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.119 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.119 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:24.119 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:24.120 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.120 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:24.120 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "k8sevents", 2023-10-19T12:59:24.120 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:24.120 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:24.121 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:24.121 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph_event_retention_days": { 2023-10-19T12:59:24.121 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ceph_event_retention_days", 2023-10-19T12:59:24.121 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:24.121 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.121 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:24.122 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "7", 2023-10-19T12:59:24.122 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.122 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.122 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.122 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Days to hold ceph event information within local cache", 2023-10-19T12:59:24.123 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.123 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.123 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.123 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.123 INFO:teuthology.orchestra.run.smithi046.stdout: "config_check_secs": { 2023-10-19T12:59:24.124 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "config_check_secs", 2023-10-19T12:59:24.124 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:24.124 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.124 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:24.124 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "10", 2023-10-19T12:59:24.125 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "10", 2023-10-19T12:59:24.125 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.125 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.125 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2023-10-19T12:59:24.125 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.125 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.126 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.126 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.126 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:24.126 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:24.126 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.127 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.127 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.127 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:24.127 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.127 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.127 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:24.128 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:24.128 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:24.128 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:24.128 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:24.128 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:24.129 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:24.129 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:24.129 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.129 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.130 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.130 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.130 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.130 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:24.130 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:24.131 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:24.131 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.131 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.131 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:24.132 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.132 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.132 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.132 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.132 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.133 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.133 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.133 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.133 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:24.133 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:24.133 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.134 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.134 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.134 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:24.134 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.135 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.135 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:24.135 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:24.135 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:24.135 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:24.136 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:24.136 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:24.136 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:24.136 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:24.136 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.136 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.137 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.137 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.137 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.137 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:24.137 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:24.138 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:24.138 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.138 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.138 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:24.138 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.139 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.139 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.139 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.139 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.139 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.140 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.140 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:24.140 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:24.140 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.140 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:24.141 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "localpool", 2023-10-19T12:59:24.141 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:24.141 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:24.141 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:24.141 INFO:teuthology.orchestra.run.smithi046.stdout: "failure_domain": { 2023-10-19T12:59:24.141 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "failure_domain", 2023-10-19T12:59:24.142 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.142 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.142 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.142 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "host", 2023-10-19T12:59:24.142 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.143 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.143 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.143 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "failure domain for any created local pool", 2023-10-19T12:59:24.143 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-10-19T12:59:24.143 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.143 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.144 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.144 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:24.144 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:24.144 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.144 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.145 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.145 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:24.145 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.145 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.145 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:24.146 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:24.146 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:24.146 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:24.146 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:24.146 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:24.146 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:24.147 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:24.147 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.147 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.147 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.147 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.148 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.148 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:24.148 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:24.148 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:24.148 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.149 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.149 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:24.149 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.149 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.149 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.149 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.150 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.150 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.150 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.150 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.150 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:24.151 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:24.151 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.151 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.151 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.151 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:24.152 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.152 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.152 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:24.152 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:24.152 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:24.153 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:24.153 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:24.153 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:24.153 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:24.153 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:24.154 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.154 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.154 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.154 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.155 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.155 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:24.155 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:24.155 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:24.155 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.155 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.156 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:24.156 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.156 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.156 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.156 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.157 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.157 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.157 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.157 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.157 INFO:teuthology.orchestra.run.smithi046.stdout: "min_size": { 2023-10-19T12:59:24.158 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "min_size", 2023-10-19T12:59:24.158 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:24.158 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.158 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.158 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:24.159 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.159 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.159 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.159 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "default min_size for any created local pool", 2023-10-19T12:59:24.159 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-10-19T12:59:24.160 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.160 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.160 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.160 INFO:teuthology.orchestra.run.smithi046.stdout: "num_rep": { 2023-10-19T12:59:24.160 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "num_rep", 2023-10-19T12:59:24.160 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:24.161 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.161 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.161 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "3", 2023-10-19T12:59:24.161 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.161 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.162 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.162 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "default replica count for any created local pool", 2023-10-19T12:59:24.162 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.162 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.162 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.163 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.163 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_num": { 2023-10-19T12:59:24.163 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "pg_num", 2023-10-19T12:59:24.163 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:24.163 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.164 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.164 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "128", 2023-10-19T12:59:24.164 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.164 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.164 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.165 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "default pg_num for any created local pool", 2023-10-19T12:59:24.165 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.165 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.165 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.165 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.166 INFO:teuthology.orchestra.run.smithi046.stdout: "prefix": { 2023-10-19T12:59:24.166 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "prefix", 2023-10-19T12:59:24.166 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.166 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.167 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.167 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:24.167 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.167 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.167 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.167 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "name prefix for any created local pool", 2023-10-19T12:59:24.168 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.168 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.168 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.168 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.168 INFO:teuthology.orchestra.run.smithi046.stdout: "subtree": { 2023-10-19T12:59:24.169 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "subtree", 2023-10-19T12:59:24.169 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.169 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.169 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.169 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "rack", 2023-10-19T12:59:24.170 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.170 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.170 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.170 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "CRUSH level for which to create a local pool", 2023-10-19T12:59:24.170 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-10-19T12:59:24.171 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.171 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.171 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:24.171 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:24.171 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.172 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:24.172 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "mds_autoscaler", 2023-10-19T12:59:24.172 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:24.172 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:24.172 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:24.173 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:24.173 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:24.173 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.173 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.173 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.174 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:24.174 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.174 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.174 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:24.174 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:24.175 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:24.175 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:24.175 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:24.175 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:24.175 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:24.175 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:24.176 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.176 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.176 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.176 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.176 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.176 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:24.177 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:24.177 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:24.177 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.177 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.177 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:24.177 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.178 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.178 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.178 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.178 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.178 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.181 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.181 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.181 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:24.181 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:24.182 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.182 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.182 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.182 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:24.182 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.183 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.183 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:24.183 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:24.183 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:24.183 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:24.184 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:24.184 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:24.184 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:24.184 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:24.184 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.184 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.185 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.185 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.185 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.185 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:24.185 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:24.186 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:24.186 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.186 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.186 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:24.186 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.187 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.187 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.187 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.187 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.187 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.188 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.188 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:24.188 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:24.188 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.188 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:24.189 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "mirroring", 2023-10-19T12:59:24.189 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:24.189 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:24.189 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:24.189 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:24.190 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:24.190 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.190 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.190 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.190 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:24.191 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.191 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.191 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:24.191 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:24.191 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:24.191 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:24.192 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:24.192 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:24.192 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:24.192 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:24.192 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.193 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.193 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.193 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.193 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.193 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:24.193 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:24.194 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:24.194 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.194 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.194 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:24.194 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.195 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.195 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.195 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.195 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.195 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.195 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.196 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.196 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:24.196 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:24.196 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.196 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.197 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.197 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:24.197 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.197 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.197 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:24.197 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:24.198 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:24.198 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:24.198 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:24.198 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:24.198 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:24.199 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:24.199 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.199 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.199 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.199 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.200 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.200 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:24.200 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:24.200 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:24.200 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.201 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.201 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:24.201 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.201 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.201 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.202 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.202 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.202 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.202 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.202 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:24.203 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:24.203 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.203 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:24.203 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "nfs", 2023-10-19T12:59:24.203 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:24.204 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:24.204 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:24.204 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:24.204 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:24.205 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.205 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.205 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.205 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:24.205 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.206 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.206 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:24.206 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:24.206 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:24.206 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:24.207 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:24.207 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:24.207 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:24.207 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:24.207 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.208 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.208 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.208 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.208 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.208 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:24.209 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:24.209 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:24.209 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.209 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.209 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:24.210 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.210 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.210 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.210 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.210 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.211 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.211 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.211 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.211 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:24.211 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:24.212 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.212 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.212 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.212 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:24.212 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.213 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.213 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:24.213 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:24.213 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:24.213 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:24.213 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:24.214 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:24.214 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:24.214 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:24.214 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.215 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.215 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.215 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.215 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.215 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:24.216 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:24.216 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:24.216 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.216 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.216 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:24.217 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.217 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.217 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.217 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.217 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.217 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.218 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.218 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:24.218 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:24.218 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.218 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:24.219 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "orchestrator", 2023-10-19T12:59:24.219 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:24.219 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:24.219 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:24.219 INFO:teuthology.orchestra.run.smithi046.stdout: "fail_fs": { 2023-10-19T12:59:24.220 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "fail_fs", 2023-10-19T12:59:24.220 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:24.220 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.220 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:24.220 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:24.221 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.221 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.221 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.221 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2023-10-19T12:59:24.221 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.222 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.222 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.222 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.222 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:24.222 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:24.223 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.223 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.223 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.223 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:24.223 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.223 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.224 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:24.224 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:24.224 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:24.224 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:24.224 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:24.225 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:24.225 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:24.225 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:24.225 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.225 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.225 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.226 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.226 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.226 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:24.226 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:24.226 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:24.227 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.227 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.227 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:24.227 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.227 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.228 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.228 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.228 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.228 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.228 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.228 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.229 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:24.229 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:24.229 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.229 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.229 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.230 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:24.230 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.230 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.230 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:24.230 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:24.231 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:24.231 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:24.231 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:24.231 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:24.231 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:24.232 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:24.232 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.232 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.232 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.232 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.233 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.233 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:24.233 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:24.233 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:24.233 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.233 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.234 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:24.234 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.234 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.234 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.234 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.235 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.235 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.235 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.235 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.235 INFO:teuthology.orchestra.run.smithi046.stdout: "orchestrator": { 2023-10-19T12:59:24.236 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "orchestrator", 2023-10-19T12:59:24.236 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.236 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.236 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.236 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:24.237 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.237 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.237 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:24.237 INFO:teuthology.orchestra.run.smithi046.stdout: "cephadm", 2023-10-19T12:59:24.237 INFO:teuthology.orchestra.run.smithi046.stdout: "rook", 2023-10-19T12:59:24.237 INFO:teuthology.orchestra.run.smithi046.stdout: "test_orchestrator" 2023-10-19T12:59:24.238 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:24.238 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Orchestrator backend", 2023-10-19T12:59:24.238 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.238 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.238 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.239 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:24.239 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:24.239 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.239 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:24.239 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "osd_perf_query", 2023-10-19T12:59:24.239 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:24.240 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:24.240 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:24.240 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:24.240 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:24.240 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.240 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.241 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.241 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:24.241 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.241 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.241 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:24.242 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:24.242 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:24.242 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:24.242 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:24.242 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:24.243 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:24.243 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:24.243 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.243 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.243 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.244 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.244 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.244 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:24.244 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:24.244 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:24.244 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.245 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.245 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:24.245 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.245 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.245 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.246 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.246 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.246 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.246 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.247 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.247 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:24.247 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:24.247 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.247 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.248 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.248 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:24.248 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.248 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.248 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:24.249 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:24.249 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:24.249 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:24.249 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:24.249 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:24.250 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:24.250 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:24.250 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.250 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.250 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.251 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.251 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.251 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:24.251 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:24.251 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:24.252 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.252 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.252 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:24.252 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.252 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.252 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.253 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.253 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.253 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.253 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.253 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:24.254 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:24.254 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.254 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:24.254 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "osd_support", 2023-10-19T12:59:24.254 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:24.255 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:24.255 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:24.255 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:24.255 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:24.255 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.256 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.256 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.256 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:24.256 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.256 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.256 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:24.257 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:24.257 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:24.257 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:24.257 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:24.257 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:24.258 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:24.258 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:24.258 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.258 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.258 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.259 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.259 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.259 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:24.259 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:24.259 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:24.260 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.260 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.260 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:24.260 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.260 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.261 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.261 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.261 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.261 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.262 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.262 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.262 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:24.262 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:24.262 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.263 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.263 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.263 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:24.263 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.263 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.263 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:24.264 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:24.264 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:24.264 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:24.264 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:24.265 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:24.265 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:24.265 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:24.265 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.265 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.265 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.266 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.266 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.266 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:24.266 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:24.266 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:24.267 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.267 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.267 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:24.267 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.267 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.268 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.268 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.268 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.268 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.268 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.268 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:24.269 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:24.269 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.269 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:24.269 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "pg_autoscaler", 2023-10-19T12:59:24.269 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:24.270 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:24.270 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:24.270 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:24.270 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:24.270 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.271 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.271 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.271 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:24.271 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.271 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.272 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:24.272 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:24.272 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:24.272 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:24.273 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:24.273 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:24.273 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:24.273 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:24.273 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.274 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.274 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.274 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.274 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.274 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:24.275 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:24.275 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:24.275 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.275 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.275 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:24.276 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.276 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.276 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.276 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.276 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.277 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.277 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.277 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.277 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:24.277 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:24.277 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.278 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.278 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.278 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:24.278 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.278 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.279 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:24.279 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:24.279 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:24.279 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:24.279 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:24.280 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:24.280 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:24.280 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:24.280 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.280 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.281 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.281 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.281 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.281 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:24.281 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:24.281 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:24.282 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.282 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.282 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:24.282 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.282 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.283 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.283 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.283 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.283 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.283 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.284 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.284 INFO:teuthology.orchestra.run.smithi046.stdout: "sleep_interval": { 2023-10-19T12:59:24.284 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sleep_interval", 2023-10-19T12:59:24.284 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2023-10-19T12:59:24.284 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.284 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:24.285 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "60", 2023-10-19T12:59:24.285 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.285 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.285 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.285 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.286 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.286 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.286 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.286 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.286 INFO:teuthology.orchestra.run.smithi046.stdout: "threshold": { 2023-10-19T12:59:24.287 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "threshold", 2023-10-19T12:59:24.287 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "float", 2023-10-19T12:59:24.287 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.287 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:24.287 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "3.0", 2023-10-19T12:59:24.288 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "1.0", 2023-10-19T12:59:24.288 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.288 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.288 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "scaling threshold", 2023-10-19T12:59:24.288 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-10-19T12:59:24.288 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.289 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.289 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:24.289 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:24.289 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.289 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:24.290 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "progress", 2023-10-19T12:59:24.290 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:24.290 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:24.290 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:24.290 INFO:teuthology.orchestra.run.smithi046.stdout: "allow_pg_recovery_event": { 2023-10-19T12:59:24.291 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "allow_pg_recovery_event", 2023-10-19T12:59:24.291 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:24.291 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.291 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.291 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:24.292 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.292 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.292 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.292 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "allow the module to show pg recovery progress", 2023-10-19T12:59:24.292 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.293 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.293 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.293 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.293 INFO:teuthology.orchestra.run.smithi046.stdout: "enabled": { 2023-10-19T12:59:24.293 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "enabled", 2023-10-19T12:59:24.294 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:24.294 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.294 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:24.294 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:24.294 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.295 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.295 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.295 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.295 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.295 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.295 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.296 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.296 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:24.296 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:24.296 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.296 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.297 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.297 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:24.297 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.297 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.297 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:24.297 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:24.298 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:24.298 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:24.298 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:24.298 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:24.298 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:24.299 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:24.299 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.299 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.299 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.299 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.300 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.300 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:24.300 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:24.300 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:24.300 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.301 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.301 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:24.301 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.301 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.301 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.301 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.302 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.302 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.302 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.302 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.302 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:24.303 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:24.303 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.303 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.303 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.303 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:24.304 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.304 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.304 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:24.304 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:24.305 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:24.305 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:24.305 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:24.305 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:24.305 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:24.306 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:24.306 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.306 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.306 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.306 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.307 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.307 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:24.307 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:24.307 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:24.307 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.307 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.308 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:24.308 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.308 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.308 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.308 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.309 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.309 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.309 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.309 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.309 INFO:teuthology.orchestra.run.smithi046.stdout: "max_completed_events": { 2023-10-19T12:59:24.310 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "max_completed_events", 2023-10-19T12:59:24.310 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:24.310 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.310 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.310 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "50", 2023-10-19T12:59:24.311 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.311 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.311 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.311 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "number of past completed events to remember", 2023-10-19T12:59:24.311 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.312 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.312 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.312 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.312 INFO:teuthology.orchestra.run.smithi046.stdout: "sleep_interval": { 2023-10-19T12:59:24.312 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sleep_interval", 2023-10-19T12:59:24.312 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2023-10-19T12:59:24.313 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.313 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.313 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "5", 2023-10-19T12:59:24.313 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.313 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.314 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.314 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "how long the module is going to sleep", 2023-10-19T12:59:24.314 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.314 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.314 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.314 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:24.315 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:24.315 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.315 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:24.315 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "prometheus", 2023-10-19T12:59:24.315 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:24.316 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:24.316 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:24.316 INFO:teuthology.orchestra.run.smithi046.stdout: "cache": { 2023-10-19T12:59:24.316 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "cache", 2023-10-19T12:59:24.316 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:24.317 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.317 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:24.317 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:24.317 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.317 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.318 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.318 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.318 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.318 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.318 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.319 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.319 INFO:teuthology.orchestra.run.smithi046.stdout: "exclude_perf_counters": { 2023-10-19T12:59:24.319 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "exclude_perf_counters", 2023-10-19T12:59:24.319 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:24.319 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.319 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.320 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:24.320 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.320 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.320 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.320 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Do not include perf-counters in the metrics output", 2023-10-19T12:59:24.321 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2023-10-19T12:59:24.321 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.321 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.321 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.321 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:24.322 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:24.322 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.322 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.322 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.322 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:24.323 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.323 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.323 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:24.323 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:24.323 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:24.323 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:24.324 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:24.324 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:24.324 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:24.324 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:24.324 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.324 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.325 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.325 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.325 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.325 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:24.325 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:24.325 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:24.326 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.326 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.326 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:24.326 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.326 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.327 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.327 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.327 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.327 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.327 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.327 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.328 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:24.328 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:24.328 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.328 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.328 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.329 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:24.329 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.329 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.329 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:24.329 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:24.330 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:24.330 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:24.330 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:24.330 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:24.330 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:24.330 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:24.331 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.331 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.331 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.331 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.331 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.332 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:24.332 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:24.332 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:24.332 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.332 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.332 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:24.333 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.333 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.333 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.333 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.333 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.333 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.334 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.334 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.334 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_stats_pools": { 2023-10-19T12:59:24.334 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rbd_stats_pools", 2023-10-19T12:59:24.334 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.335 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.335 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:24.335 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:24.335 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.335 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.335 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.336 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.336 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.336 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.336 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.336 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.337 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_stats_pools_refresh_interval": { 2023-10-19T12:59:24.337 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-10-19T12:59:24.337 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:24.337 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.337 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:24.337 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "300", 2023-10-19T12:59:24.338 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.338 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.338 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.338 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.338 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.339 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.339 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.339 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.339 INFO:teuthology.orchestra.run.smithi046.stdout: "scrape_interval": { 2023-10-19T12:59:24.339 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "scrape_interval", 2023-10-19T12:59:24.340 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "float", 2023-10-19T12:59:24.340 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.340 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:24.340 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "15.0", 2023-10-19T12:59:24.340 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.341 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.341 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.341 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.341 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.341 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.342 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.342 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.342 INFO:teuthology.orchestra.run.smithi046.stdout: "server_addr": { 2023-10-19T12:59:24.342 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "server_addr", 2023-10-19T12:59:24.342 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.343 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.343 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:24.343 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "::", 2023-10-19T12:59:24.343 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.343 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.343 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.344 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-10-19T12:59:24.344 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.344 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.344 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.344 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.345 INFO:teuthology.orchestra.run.smithi046.stdout: "server_port": { 2023-10-19T12:59:24.345 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "server_port", 2023-10-19T12:59:24.345 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:24.345 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.345 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.346 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "9283", 2023-10-19T12:59:24.346 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.346 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.346 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.346 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-10-19T12:59:24.347 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.347 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.347 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.347 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.347 INFO:teuthology.orchestra.run.smithi046.stdout: "stale_cache_strategy": { 2023-10-19T12:59:24.347 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "stale_cache_strategy", 2023-10-19T12:59:24.348 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.348 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.348 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:24.348 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "log", 2023-10-19T12:59:24.348 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.349 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.349 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.349 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.349 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.349 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.349 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.350 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.350 INFO:teuthology.orchestra.run.smithi046.stdout: "standby_behaviour": { 2023-10-19T12:59:24.350 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "standby_behaviour", 2023-10-19T12:59:24.350 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.350 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.351 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.351 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "default", 2023-10-19T12:59:24.351 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.351 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.351 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:24.351 INFO:teuthology.orchestra.run.smithi046.stdout: "default", 2023-10-19T12:59:24.352 INFO:teuthology.orchestra.run.smithi046.stdout: "error" 2023-10-19T12:59:24.352 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:24.352 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.352 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.352 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.352 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.353 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.353 INFO:teuthology.orchestra.run.smithi046.stdout: "standby_error_status_code": { 2023-10-19T12:59:24.353 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "standby_error_status_code", 2023-10-19T12:59:24.353 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:24.353 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.353 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.354 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "500", 2023-10-19T12:59:24.354 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "400", 2023-10-19T12:59:24.354 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "599", 2023-10-19T12:59:24.354 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.354 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.354 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.355 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.355 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.355 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:24.355 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:24.355 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.355 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:24.356 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rbd_support", 2023-10-19T12:59:24.356 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:24.356 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:24.356 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:24.357 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:24.357 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:24.357 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.357 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.357 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.358 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:24.358 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.358 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.358 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:24.358 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:24.359 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:24.359 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:24.359 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:24.359 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:24.359 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:24.359 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:24.360 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.360 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.360 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.360 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.361 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.361 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:24.361 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:24.361 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:24.361 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.361 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.362 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:24.362 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.362 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.362 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.362 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.363 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.363 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.363 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.363 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.363 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:24.364 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:24.364 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.364 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.364 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.364 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:24.365 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.365 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.365 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:24.365 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:24.365 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:24.365 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:24.366 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:24.366 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:24.366 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:24.366 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:24.367 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.367 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.367 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.367 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.367 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.367 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:24.368 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:24.368 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:24.368 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.368 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.368 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:24.369 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.369 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.369 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.369 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.369 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.370 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.370 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.370 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.370 INFO:teuthology.orchestra.run.smithi046.stdout: "max_concurrent_snap_create": { 2023-10-19T12:59:24.370 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "max_concurrent_snap_create", 2023-10-19T12:59:24.371 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:24.371 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.371 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:24.371 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "10", 2023-10-19T12:59:24.371 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.372 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.372 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.372 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.372 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.372 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.372 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.373 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.373 INFO:teuthology.orchestra.run.smithi046.stdout: "mirror_snapshot_schedule": { 2023-10-19T12:59:24.373 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "mirror_snapshot_schedule", 2023-10-19T12:59:24.373 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.373 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.374 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:24.374 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:24.374 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.374 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.374 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.375 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.375 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.375 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.375 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.375 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.376 INFO:teuthology.orchestra.run.smithi046.stdout: "trash_purge_schedule": { 2023-10-19T12:59:24.376 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "trash_purge_schedule", 2023-10-19T12:59:24.376 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.376 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.376 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:24.377 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:24.377 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.377 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.377 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.377 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.377 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.378 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.378 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.378 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:24.378 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:24.378 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.379 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:24.379 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "restful", 2023-10-19T12:59:24.379 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:24.379 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:24.379 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:24.380 INFO:teuthology.orchestra.run.smithi046.stdout: "enable_auth": { 2023-10-19T12:59:24.380 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "enable_auth", 2023-10-19T12:59:24.380 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:24.380 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.380 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:24.381 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:24.381 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.381 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.381 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.382 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.382 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.382 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.382 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.382 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.383 INFO:teuthology.orchestra.run.smithi046.stdout: "key_file": { 2023-10-19T12:59:24.383 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "key_file", 2023-10-19T12:59:24.383 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.383 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.383 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:24.384 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:24.384 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.384 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.384 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.384 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.384 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.385 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.385 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.385 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.385 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:24.385 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:24.386 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.386 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.386 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.386 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:24.386 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.387 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.387 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:24.387 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:24.387 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:24.387 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:24.388 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:24.388 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:24.388 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:24.388 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:24.388 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.389 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.389 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.389 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.389 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.389 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:24.389 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:24.390 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:24.390 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.390 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.390 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:24.390 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.391 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.391 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.391 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.391 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.391 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.391 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.392 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.392 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:24.392 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:24.392 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.392 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.393 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.393 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:24.393 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.393 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.393 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:24.394 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:24.394 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:24.394 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:24.394 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:24.394 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:24.395 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:24.395 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:24.395 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.395 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.395 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.396 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.396 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.396 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:24.396 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:24.396 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:24.397 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.397 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.397 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:24.397 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.397 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.398 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.398 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.398 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.398 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.398 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.398 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.399 INFO:teuthology.orchestra.run.smithi046.stdout: "server_addr": { 2023-10-19T12:59:24.399 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "server_addr", 2023-10-19T12:59:24.399 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.399 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.399 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:24.400 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:24.400 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.400 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.400 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.401 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.401 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.401 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.401 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.401 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.402 INFO:teuthology.orchestra.run.smithi046.stdout: "server_port": { 2023-10-19T12:59:24.402 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "server_port", 2023-10-19T12:59:24.402 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.402 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.402 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:24.403 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:24.403 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.403 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.403 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.403 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.404 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.404 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.404 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.404 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:24.404 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:24.405 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.405 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:24.405 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rgw", 2023-10-19T12:59:24.405 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:24.405 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:24.406 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:24.406 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:24.406 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:24.406 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.406 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.407 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.407 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:24.407 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.407 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.407 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:24.408 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:24.408 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:24.408 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:24.408 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:24.408 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:24.409 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:24.409 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:24.409 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.409 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.410 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.410 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.410 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.410 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:24.410 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:24.411 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:24.411 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.411 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.411 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:24.411 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.412 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.412 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.412 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.412 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.412 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.412 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.413 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.413 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:24.413 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:24.413 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.413 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.413 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.414 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:24.414 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.414 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.414 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:24.414 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:24.415 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:24.415 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:24.415 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:24.415 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:24.415 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:24.415 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:24.416 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.416 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.416 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.416 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.416 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.417 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:24.417 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:24.417 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:24.417 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.417 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.417 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:24.418 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.418 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.418 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.418 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.418 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.419 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.419 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.419 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:24.419 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:24.419 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.419 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:24.420 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rook", 2023-10-19T12:59:24.420 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:24.420 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:24.420 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:24.420 INFO:teuthology.orchestra.run.smithi046.stdout: "drive_group_interval": { 2023-10-19T12:59:24.421 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "drive_group_interval", 2023-10-19T12:59:24.421 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "float", 2023-10-19T12:59:24.421 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.421 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:24.421 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "300.0", 2023-10-19T12:59:24.422 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.422 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.422 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.422 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2023-10-19T12:59:24.422 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.423 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.423 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.423 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.423 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:24.423 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:24.423 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.424 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.424 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.424 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:24.424 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.424 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.425 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:24.425 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:24.425 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:24.425 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:24.425 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:24.425 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:24.426 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:24.426 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:24.426 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.426 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.427 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.427 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.427 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.427 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:24.427 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:24.428 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:24.428 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.428 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.428 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:24.428 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.429 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.429 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.429 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.429 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.429 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.429 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.430 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.430 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:24.430 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:24.430 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.430 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.431 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.431 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:24.431 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.431 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.431 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:24.432 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:24.432 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:24.432 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:24.432 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:24.432 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:24.433 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:24.433 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:24.433 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.433 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.433 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.433 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.434 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.434 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:24.434 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:24.434 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:24.434 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.435 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.435 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:24.435 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.435 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.435 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.436 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.436 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.436 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.436 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.436 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.436 INFO:teuthology.orchestra.run.smithi046.stdout: "storage_class": { 2023-10-19T12:59:24.437 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "storage_class", 2023-10-19T12:59:24.437 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.437 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.437 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:24.437 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "local", 2023-10-19T12:59:24.438 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.438 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.438 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.438 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "storage class name for LSO-discovered PVs", 2023-10-19T12:59:24.439 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.439 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.439 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.439 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:24.439 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:24.440 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.440 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:24.440 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "selftest", 2023-10-19T12:59:24.440 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:24.440 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:24.441 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:24.441 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:24.441 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:24.441 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.441 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.441 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.442 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:24.442 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.442 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.442 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:24.442 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:24.443 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:24.443 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:24.443 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:24.443 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:24.443 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:24.444 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:24.444 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.444 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.444 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.444 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.445 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.445 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:24.445 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:24.445 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:24.445 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.445 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.446 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:24.446 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.446 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.446 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.447 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.447 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.447 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.447 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.448 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.448 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:24.448 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:24.448 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.448 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.449 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.449 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:24.449 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.449 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.450 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:24.450 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:24.450 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:24.450 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:24.451 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:24.451 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:24.451 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:24.451 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:24.451 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.452 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.452 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.452 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.452 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.452 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:24.453 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:24.453 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:24.453 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.453 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.454 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:24.454 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.454 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.454 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.455 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.455 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.455 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.455 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.455 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.456 INFO:teuthology.orchestra.run.smithi046.stdout: "roption1": { 2023-10-19T12:59:24.456 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "roption1", 2023-10-19T12:59:24.456 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.456 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.457 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:24.457 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:24.457 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.457 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.457 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.458 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.458 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.458 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.458 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.459 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.459 INFO:teuthology.orchestra.run.smithi046.stdout: "roption2": { 2023-10-19T12:59:24.459 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "roption2", 2023-10-19T12:59:24.459 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.460 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.460 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:24.460 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "xyz", 2023-10-19T12:59:24.460 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.460 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.461 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.461 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.461 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.461 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.461 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.461 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.462 INFO:teuthology.orchestra.run.smithi046.stdout: "rwoption1": { 2023-10-19T12:59:24.462 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rwoption1", 2023-10-19T12:59:24.462 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.462 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.462 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:24.463 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:24.463 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.463 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.463 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.463 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.464 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.464 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.464 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.464 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.464 INFO:teuthology.orchestra.run.smithi046.stdout: "rwoption2": { 2023-10-19T12:59:24.465 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rwoption2", 2023-10-19T12:59:24.465 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:24.465 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.465 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:24.465 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:24.466 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.466 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.466 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.466 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.466 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.467 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.467 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.467 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.467 INFO:teuthology.orchestra.run.smithi046.stdout: "rwoption3": { 2023-10-19T12:59:24.467 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rwoption3", 2023-10-19T12:59:24.467 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "float", 2023-10-19T12:59:24.468 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.468 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:24.468 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:24.468 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.469 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.469 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.469 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.469 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.469 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.470 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.470 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.470 INFO:teuthology.orchestra.run.smithi046.stdout: "rwoption4": { 2023-10-19T12:59:24.470 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rwoption4", 2023-10-19T12:59:24.470 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.471 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.471 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:24.471 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:24.471 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.471 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.471 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.472 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.472 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.472 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.472 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.472 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.473 INFO:teuthology.orchestra.run.smithi046.stdout: "rwoption5": { 2023-10-19T12:59:24.473 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rwoption5", 2023-10-19T12:59:24.473 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:24.473 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.473 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:24.474 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:24.474 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.474 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.474 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.474 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.475 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.475 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.475 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.475 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.475 INFO:teuthology.orchestra.run.smithi046.stdout: "rwoption6": { 2023-10-19T12:59:24.476 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rwoption6", 2023-10-19T12:59:24.476 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:24.476 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.476 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:24.476 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:24.476 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.477 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.477 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.477 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.477 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.477 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.478 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.478 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.478 INFO:teuthology.orchestra.run.smithi046.stdout: "rwoption7": { 2023-10-19T12:59:24.478 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rwoption7", 2023-10-19T12:59:24.478 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:24.479 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.479 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:24.479 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:24.479 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "1", 2023-10-19T12:59:24.479 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "42", 2023-10-19T12:59:24.480 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.480 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.480 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.480 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.480 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.480 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.481 INFO:teuthology.orchestra.run.smithi046.stdout: "testkey": { 2023-10-19T12:59:24.481 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "testkey", 2023-10-19T12:59:24.481 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.481 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.481 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:24.482 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:24.482 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.482 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.482 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.482 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.483 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.483 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.483 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.483 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.483 INFO:teuthology.orchestra.run.smithi046.stdout: "testlkey": { 2023-10-19T12:59:24.484 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "testlkey", 2023-10-19T12:59:24.484 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.484 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.484 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:24.484 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:24.485 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.485 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.485 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.485 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.485 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.486 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.486 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.486 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.486 INFO:teuthology.orchestra.run.smithi046.stdout: "testnewline": { 2023-10-19T12:59:24.486 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "testnewline", 2023-10-19T12:59:24.486 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.487 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.487 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:24.487 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:24.487 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.487 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.488 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.488 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.488 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.488 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.489 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.489 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:24.489 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:24.489 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.489 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:24.490 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "snap_schedule", 2023-10-19T12:59:24.490 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:24.490 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:24.490 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:24.490 INFO:teuthology.orchestra.run.smithi046.stdout: "allow_m_granularity": { 2023-10-19T12:59:24.491 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "allow_m_granularity", 2023-10-19T12:59:24.491 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:24.491 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.491 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.492 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:24.492 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.492 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.492 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.492 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "allow minute scheduled snapshots", 2023-10-19T12:59:24.493 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.493 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.493 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.493 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.493 INFO:teuthology.orchestra.run.smithi046.stdout: "dump_on_update": { 2023-10-19T12:59:24.493 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "dump_on_update", 2023-10-19T12:59:24.494 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:24.494 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.494 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.494 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:24.494 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.495 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.495 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.495 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "dump database to debug log on update", 2023-10-19T12:59:24.495 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.495 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.496 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.496 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.496 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:24.496 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:24.496 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.497 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.497 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.497 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:24.497 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.497 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.498 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:24.498 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:24.498 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:24.498 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:24.498 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:24.499 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:24.499 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:24.499 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:24.499 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.499 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.500 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.500 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.500 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.500 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:24.500 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:24.501 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:24.501 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.501 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.501 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:24.501 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.502 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.502 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.502 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.502 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.502 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.502 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.503 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.503 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:24.503 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:24.503 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.503 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.504 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.504 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:24.504 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.504 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.504 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:24.505 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:24.505 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:24.505 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:24.505 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:24.505 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:24.506 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:24.506 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:24.506 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.506 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.507 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.507 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.507 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.507 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:24.507 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:24.508 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:24.508 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.508 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.508 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:24.508 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.508 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.509 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.509 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.509 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.509 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.509 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.510 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:24.510 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:24.510 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.510 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:24.510 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "stats", 2023-10-19T12:59:24.511 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:24.511 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:24.511 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:24.511 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:24.511 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:24.512 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.512 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.512 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.512 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:24.512 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.512 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.513 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:24.513 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:24.513 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:24.513 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:24.513 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:24.514 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:24.514 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:24.514 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:24.514 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.514 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.515 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.515 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.515 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.515 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:24.515 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:24.516 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:24.516 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.516 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.516 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:24.516 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.517 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.517 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.517 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.517 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.517 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.518 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.518 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.518 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:24.518 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:24.518 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.518 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.519 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.519 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:24.519 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.519 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.519 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:24.520 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:24.520 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:24.520 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:24.520 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:24.520 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:24.521 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:24.521 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:24.521 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.521 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.521 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.521 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.522 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.522 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:24.522 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:24.522 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:24.522 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.523 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.523 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:24.523 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.523 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.523 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.524 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.524 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.524 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.524 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.524 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:24.525 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:24.525 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.525 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:24.525 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "status", 2023-10-19T12:59:24.525 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:24.526 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:24.526 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:24.526 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:24.526 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:24.526 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.526 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.527 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.527 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:24.527 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.527 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.527 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:24.528 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:24.528 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:24.528 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:24.528 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:24.528 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:24.529 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:24.529 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:24.529 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.529 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.529 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.529 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.530 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.530 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:24.530 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:24.530 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:24.530 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.531 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.531 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:24.531 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.531 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.532 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.532 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.532 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.532 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.532 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.533 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.533 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:24.533 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:24.533 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.533 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.533 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.534 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:24.534 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.534 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.534 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:24.534 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:24.535 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:24.535 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:24.535 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:24.535 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:24.535 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:24.536 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:24.536 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.536 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.536 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.536 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.537 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.537 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:24.537 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:24.537 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:24.537 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.538 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.538 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:24.538 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.538 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.538 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.539 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.539 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.539 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.539 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.539 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:24.540 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:24.540 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.540 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:24.540 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "telegraf", 2023-10-19T12:59:24.540 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:24.540 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:24.541 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:24.541 INFO:teuthology.orchestra.run.smithi046.stdout: "address": { 2023-10-19T12:59:24.541 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "address", 2023-10-19T12:59:24.541 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.541 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.542 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:24.542 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-10-19T12:59:24.542 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.542 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.542 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.543 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.543 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.543 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.543 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.543 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.544 INFO:teuthology.orchestra.run.smithi046.stdout: "interval": { 2023-10-19T12:59:24.544 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "interval", 2023-10-19T12:59:24.544 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2023-10-19T12:59:24.544 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.544 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:24.545 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "15", 2023-10-19T12:59:24.545 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.545 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.545 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.545 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.545 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.546 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.546 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.546 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.546 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:24.546 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:24.547 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.547 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.547 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.547 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:24.547 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.548 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.548 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:24.548 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:24.548 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:24.548 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:24.549 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:24.549 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:24.549 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:24.549 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:24.549 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.550 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.550 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.550 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.550 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.551 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:24.551 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:24.551 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:24.551 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.551 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.552 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:24.552 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.552 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.552 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.552 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.553 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.553 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.553 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.553 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.553 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:24.554 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:24.554 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.554 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.554 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.554 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:24.555 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.555 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.555 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:24.555 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:24.556 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:24.556 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:24.556 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:24.556 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:24.556 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:24.556 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:24.557 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.557 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.557 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.557 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.558 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.558 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:24.558 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:24.558 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:24.558 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.559 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.559 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:24.559 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.559 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.559 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.560 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.560 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.560 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.560 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.560 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:24.561 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:24.561 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.561 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:24.561 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "telemetry", 2023-10-19T12:59:24.562 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:24.562 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:24.562 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:24.562 INFO:teuthology.orchestra.run.smithi046.stdout: "channel_basic": { 2023-10-19T12:59:24.562 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "channel_basic", 2023-10-19T12:59:24.563 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:24.563 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.563 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:24.563 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:24.564 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.564 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.564 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.564 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Share basic cluster information (size, version)", 2023-10-19T12:59:24.564 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.565 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.565 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.565 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.565 INFO:teuthology.orchestra.run.smithi046.stdout: "channel_crash": { 2023-10-19T12:59:24.566 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "channel_crash", 2023-10-19T12:59:24.566 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:24.566 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.566 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:24.566 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:24.567 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.567 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.567 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.567 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-10-19T12:59:24.567 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.568 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.568 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.568 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.568 INFO:teuthology.orchestra.run.smithi046.stdout: "channel_device": { 2023-10-19T12:59:24.568 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "channel_device", 2023-10-19T12:59:24.568 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:24.569 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.569 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:24.569 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2023-10-19T12:59:24.569 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.569 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.570 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.570 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-10-19T12:59:24.570 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.570 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.570 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.571 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.571 INFO:teuthology.orchestra.run.smithi046.stdout: "channel_ident": { 2023-10-19T12:59:24.571 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "channel_ident", 2023-10-19T12:59:24.571 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:24.571 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.572 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:24.572 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:24.572 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.572 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.572 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.572 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-10-19T12:59:24.573 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.573 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.573 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.573 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.573 INFO:teuthology.orchestra.run.smithi046.stdout: "channel_perf": { 2023-10-19T12:59:24.574 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "channel_perf", 2023-10-19T12:59:24.574 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:24.574 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.574 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:24.574 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:24.575 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.575 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.575 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.575 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Share various performance metrics of a cluster", 2023-10-19T12:59:24.575 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.575 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.576 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.576 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.576 INFO:teuthology.orchestra.run.smithi046.stdout: "contact": { 2023-10-19T12:59:24.576 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "contact", 2023-10-19T12:59:24.576 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.577 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.577 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:24.577 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:24.577 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.577 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.578 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.578 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.578 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.578 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.579 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.579 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.579 INFO:teuthology.orchestra.run.smithi046.stdout: "description": { 2023-10-19T12:59:24.579 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "description", 2023-10-19T12:59:24.579 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.579 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.580 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:24.580 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:24.580 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.580 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.580 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.581 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.581 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.581 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.581 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.581 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.582 INFO:teuthology.orchestra.run.smithi046.stdout: "device_url": { 2023-10-19T12:59:24.582 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "device_url", 2023-10-19T12:59:24.582 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.582 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.582 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:24.583 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-10-19T12:59:24.583 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.583 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.583 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.584 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.584 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.584 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.584 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.584 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.585 INFO:teuthology.orchestra.run.smithi046.stdout: "enabled": { 2023-10-19T12:59:24.585 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "enabled", 2023-10-19T12:59:24.585 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:24.585 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.585 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:24.586 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:24.586 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.586 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.586 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.587 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.587 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.587 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.587 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.587 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.588 INFO:teuthology.orchestra.run.smithi046.stdout: "interval": { 2023-10-19T12:59:24.588 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "interval", 2023-10-19T12:59:24.588 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:24.588 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.588 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:24.589 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "24", 2023-10-19T12:59:24.589 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "8", 2023-10-19T12:59:24.589 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.589 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.589 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.590 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.590 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.590 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.590 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.590 INFO:teuthology.orchestra.run.smithi046.stdout: "last_opt_revision": { 2023-10-19T12:59:24.591 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "last_opt_revision", 2023-10-19T12:59:24.591 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:24.591 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.591 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:24.591 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "1", 2023-10-19T12:59:24.592 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.592 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.592 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.592 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.592 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.593 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.593 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.593 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.593 INFO:teuthology.orchestra.run.smithi046.stdout: "leaderboard": { 2023-10-19T12:59:24.593 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "leaderboard", 2023-10-19T12:59:24.593 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:24.594 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.594 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:24.594 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:24.594 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.594 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.595 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.595 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.595 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.595 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.595 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.595 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.596 INFO:teuthology.orchestra.run.smithi046.stdout: "leaderboard_description": { 2023-10-19T12:59:24.596 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "leaderboard_description", 2023-10-19T12:59:24.596 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.596 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.596 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:24.597 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:24.597 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.597 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.597 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.597 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.598 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.598 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.598 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.598 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.598 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:24.599 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:24.599 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.599 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.599 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.599 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:24.600 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.600 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.600 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:24.600 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:24.600 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:24.601 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:24.601 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:24.601 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:24.601 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:24.601 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:24.601 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.602 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.602 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.602 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.602 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.602 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:24.603 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:24.603 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:24.603 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.603 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.603 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:24.604 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.604 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.604 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.604 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.604 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.605 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.605 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.605 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.605 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:24.605 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:24.606 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.606 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.606 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.606 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:24.606 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.607 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.607 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:24.607 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:24.607 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:24.607 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:24.608 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:24.608 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:24.608 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:24.608 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:24.608 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.609 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.609 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.609 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.609 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.609 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:24.610 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:24.610 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:24.610 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.610 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.610 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:24.611 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.611 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.611 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.611 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.611 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.612 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.612 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.612 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.612 INFO:teuthology.orchestra.run.smithi046.stdout: "organization": { 2023-10-19T12:59:24.613 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "organization", 2023-10-19T12:59:24.613 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.613 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.613 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:24.613 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:24.614 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.614 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.614 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.614 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.615 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.615 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.615 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.615 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.615 INFO:teuthology.orchestra.run.smithi046.stdout: "proxy": { 2023-10-19T12:59:24.616 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "proxy", 2023-10-19T12:59:24.616 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.616 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.616 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:24.617 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:24.617 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.617 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.617 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.617 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.618 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.618 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.618 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.618 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.618 INFO:teuthology.orchestra.run.smithi046.stdout: "url": { 2023-10-19T12:59:24.618 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "url", 2023-10-19T12:59:24.619 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.619 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.619 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:24.619 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-10-19T12:59:24.619 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.620 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.620 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.620 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.620 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.620 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.621 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.621 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:24.621 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:24.621 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.621 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:24.622 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "test_orchestrator", 2023-10-19T12:59:24.622 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:24.622 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:24.622 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:24.622 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:24.623 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:24.623 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.623 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.623 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.623 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:24.624 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.624 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.624 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:24.624 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:24.624 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:24.625 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:24.625 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:24.625 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:24.625 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:24.625 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:24.626 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.626 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.626 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.626 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.626 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.627 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:24.627 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:24.627 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:24.627 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.627 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.628 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:24.628 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.628 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.628 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.629 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.629 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.629 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.629 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.629 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.630 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:24.630 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:24.630 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.630 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.630 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.631 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:24.631 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.631 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.631 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:24.631 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:24.632 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:24.632 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:24.632 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:24.632 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:24.632 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:24.633 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:24.633 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.633 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.633 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.633 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.634 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.634 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:24.634 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:24.634 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:24.635 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.635 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.635 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:24.635 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.635 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.635 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.636 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.636 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.636 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.636 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.636 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:24.637 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:24.637 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.637 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:24.637 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "volumes", 2023-10-19T12:59:24.637 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:24.638 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:24.638 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:24.638 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:24.638 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:24.639 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.639 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.639 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.639 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:24.639 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.640 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.640 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:24.640 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:24.640 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:24.640 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:24.641 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:24.641 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:24.641 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:24.641 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:24.641 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.641 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.642 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.642 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.642 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.642 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:24.642 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:24.643 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:24.643 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.643 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.643 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:24.643 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.644 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.644 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.644 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.644 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.644 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.645 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.645 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.645 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:24.645 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:24.645 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.646 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.646 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.646 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:24.646 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.646 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.647 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:24.647 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:24.647 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:24.647 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:24.647 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:24.648 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:24.648 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:24.648 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:24.648 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.648 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.649 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.649 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.649 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.649 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:24.649 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:24.650 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:24.650 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.650 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.650 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:24.650 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.651 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.651 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.651 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.651 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.651 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.652 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.652 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.652 INFO:teuthology.orchestra.run.smithi046.stdout: "max_concurrent_clones": { 2023-10-19T12:59:24.652 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "max_concurrent_clones", 2023-10-19T12:59:24.652 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:24.653 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.653 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:24.653 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "4", 2023-10-19T12:59:24.653 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.653 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.653 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.654 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Number of asynchronous cloner threads", 2023-10-19T12:59:24.654 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.654 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.654 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.654 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.655 INFO:teuthology.orchestra.run.smithi046.stdout: "periodic_async_work": { 2023-10-19T12:59:24.655 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "periodic_async_work", 2023-10-19T12:59:24.655 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:24.655 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.655 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:24.656 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:24.656 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.656 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.656 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.656 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Periodically check for async work", 2023-10-19T12:59:24.656 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.657 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.657 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.657 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.657 INFO:teuthology.orchestra.run.smithi046.stdout: "snapshot_clone_delay": { 2023-10-19T12:59:24.657 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "snapshot_clone_delay", 2023-10-19T12:59:24.657 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:24.658 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.658 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:24.658 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2023-10-19T12:59:24.658 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.658 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.659 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.659 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-10-19T12:59:24.659 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.659 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.660 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.660 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:24.660 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:24.660 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.660 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:24.660 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "zabbix", 2023-10-19T12:59:24.661 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2023-10-19T12:59:24.661 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2023-10-19T12:59:24.661 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2023-10-19T12:59:24.661 INFO:teuthology.orchestra.run.smithi046.stdout: "discovery_interval": { 2023-10-19T12:59:24.661 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "discovery_interval", 2023-10-19T12:59:24.662 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "uint", 2023-10-19T12:59:24.662 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.662 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:24.662 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "100", 2023-10-19T12:59:24.662 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.663 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.663 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.663 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.663 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.663 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.664 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.664 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.664 INFO:teuthology.orchestra.run.smithi046.stdout: "identifier": { 2023-10-19T12:59:24.664 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "identifier", 2023-10-19T12:59:24.664 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.665 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.665 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:24.665 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:24.665 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.665 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.665 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.666 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.666 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.666 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.666 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.666 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.667 INFO:teuthology.orchestra.run.smithi046.stdout: "interval": { 2023-10-19T12:59:24.667 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "interval", 2023-10-19T12:59:24.667 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2023-10-19T12:59:24.667 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.667 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:24.667 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "60", 2023-10-19T12:59:24.668 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.668 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.668 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.668 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.668 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.668 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.669 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.669 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.669 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2023-10-19T12:59:24.669 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2023-10-19T12:59:24.669 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.670 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.670 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.670 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:24.670 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.670 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.671 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:24.671 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:24.671 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:24.671 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:24.671 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:24.671 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:24.672 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:24.672 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:24.672 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.672 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.672 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.672 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.673 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.673 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2023-10-19T12:59:24.673 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2023-10-19T12:59:24.673 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:24.673 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.674 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.674 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:24.674 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.674 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.674 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.674 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.675 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.675 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.675 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.675 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.675 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2023-10-19T12:59:24.676 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2023-10-19T12:59:24.676 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.676 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.676 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.676 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2023-10-19T12:59:24.676 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.677 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.677 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2023-10-19T12:59:24.677 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2023-10-19T12:59:24.677 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2023-10-19T12:59:24.677 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2023-10-19T12:59:24.677 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2023-10-19T12:59:24.678 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2023-10-19T12:59:24.678 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2023-10-19T12:59:24.678 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:24.678 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.678 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.679 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.679 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.679 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.679 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2023-10-19T12:59:24.679 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2023-10-19T12:59:24.680 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2023-10-19T12:59:24.680 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.680 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2023-10-19T12:59:24.680 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2023-10-19T12:59:24.680 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.681 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.681 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.681 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.681 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.681 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.682 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.682 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.682 INFO:teuthology.orchestra.run.smithi046.stdout: "zabbix_host": { 2023-10-19T12:59:24.682 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "zabbix_host", 2023-10-19T12:59:24.682 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.683 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.683 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:24.683 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2023-10-19T12:59:24.683 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.683 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.683 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.684 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.684 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.684 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.684 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.684 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.685 INFO:teuthology.orchestra.run.smithi046.stdout: "zabbix_port": { 2023-10-19T12:59:24.685 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "zabbix_port", 2023-10-19T12:59:24.685 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2023-10-19T12:59:24.685 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.685 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:24.686 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "10051", 2023-10-19T12:59:24.686 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.686 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.686 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.686 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.687 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.687 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.687 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.687 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.687 INFO:teuthology.orchestra.run.smithi046.stdout: "zabbix_sender": { 2023-10-19T12:59:24.687 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "zabbix_sender", 2023-10-19T12:59:24.688 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2023-10-19T12:59:24.688 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2023-10-19T12:59:24.688 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2023-10-19T12:59:24.688 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-10-19T12:59:24.688 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2023-10-19T12:59:24.689 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2023-10-19T12:59:24.689 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2023-10-19T12:59:24.689 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2023-10-19T12:59:24.689 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2023-10-19T12:59:24.689 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2023-10-19T12:59:24.689 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2023-10-19T12:59:24.690 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:24.690 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:24.690 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:24.690 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:24.691 INFO:teuthology.orchestra.run.smithi046.stdout: "services": { 2023-10-19T12:59:24.691 INFO:teuthology.orchestra.run.smithi046.stdout: "dashboard": "https://172.21.15.46:8443/" 2023-10-19T12:59:24.691 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.691 INFO:teuthology.orchestra.run.smithi046.stdout: "always_on_modules": { 2023-10-19T12:59:24.691 INFO:teuthology.orchestra.run.smithi046.stdout: "octopus": [ 2023-10-19T12:59:24.691 INFO:teuthology.orchestra.run.smithi046.stdout: "balancer", 2023-10-19T12:59:24.692 INFO:teuthology.orchestra.run.smithi046.stdout: "crash", 2023-10-19T12:59:24.692 INFO:teuthology.orchestra.run.smithi046.stdout: "devicehealth", 2023-10-19T12:59:24.692 INFO:teuthology.orchestra.run.smithi046.stdout: "orchestrator", 2023-10-19T12:59:24.692 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_autoscaler", 2023-10-19T12:59:24.693 INFO:teuthology.orchestra.run.smithi046.stdout: "progress", 2023-10-19T12:59:24.693 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_support", 2023-10-19T12:59:24.693 INFO:teuthology.orchestra.run.smithi046.stdout: "status", 2023-10-19T12:59:24.693 INFO:teuthology.orchestra.run.smithi046.stdout: "telemetry", 2023-10-19T12:59:24.693 INFO:teuthology.orchestra.run.smithi046.stdout: "volumes" 2023-10-19T12:59:24.693 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:24.694 INFO:teuthology.orchestra.run.smithi046.stdout: "pacific": [ 2023-10-19T12:59:24.694 INFO:teuthology.orchestra.run.smithi046.stdout: "balancer", 2023-10-19T12:59:24.694 INFO:teuthology.orchestra.run.smithi046.stdout: "crash", 2023-10-19T12:59:24.694 INFO:teuthology.orchestra.run.smithi046.stdout: "devicehealth", 2023-10-19T12:59:24.694 INFO:teuthology.orchestra.run.smithi046.stdout: "orchestrator", 2023-10-19T12:59:24.695 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_autoscaler", 2023-10-19T12:59:24.695 INFO:teuthology.orchestra.run.smithi046.stdout: "progress", 2023-10-19T12:59:24.695 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_support", 2023-10-19T12:59:24.695 INFO:teuthology.orchestra.run.smithi046.stdout: "status", 2023-10-19T12:59:24.695 INFO:teuthology.orchestra.run.smithi046.stdout: "telemetry", 2023-10-19T12:59:24.695 INFO:teuthology.orchestra.run.smithi046.stdout: "volumes" 2023-10-19T12:59:24.696 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:24.696 INFO:teuthology.orchestra.run.smithi046.stdout: "quincy": [ 2023-10-19T12:59:24.696 INFO:teuthology.orchestra.run.smithi046.stdout: "balancer", 2023-10-19T12:59:24.696 INFO:teuthology.orchestra.run.smithi046.stdout: "crash", 2023-10-19T12:59:24.696 INFO:teuthology.orchestra.run.smithi046.stdout: "devicehealth", 2023-10-19T12:59:24.697 INFO:teuthology.orchestra.run.smithi046.stdout: "orchestrator", 2023-10-19T12:59:24.697 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_autoscaler", 2023-10-19T12:59:24.697 INFO:teuthology.orchestra.run.smithi046.stdout: "progress", 2023-10-19T12:59:24.697 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_support", 2023-10-19T12:59:24.697 INFO:teuthology.orchestra.run.smithi046.stdout: "status", 2023-10-19T12:59:24.698 INFO:teuthology.orchestra.run.smithi046.stdout: "telemetry", 2023-10-19T12:59:24.698 INFO:teuthology.orchestra.run.smithi046.stdout: "volumes" 2023-10-19T12:59:24.698 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2023-10-19T12:59:24.698 INFO:teuthology.orchestra.run.smithi046.stdout: "reef": [ 2023-10-19T12:59:24.698 INFO:teuthology.orchestra.run.smithi046.stdout: "balancer", 2023-10-19T12:59:24.698 INFO:teuthology.orchestra.run.smithi046.stdout: "crash", 2023-10-19T12:59:24.699 INFO:teuthology.orchestra.run.smithi046.stdout: "devicehealth", 2023-10-19T12:59:24.699 INFO:teuthology.orchestra.run.smithi046.stdout: "orchestrator", 2023-10-19T12:59:24.699 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_autoscaler", 2023-10-19T12:59:24.699 INFO:teuthology.orchestra.run.smithi046.stdout: "progress", 2023-10-19T12:59:24.699 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_support", 2023-10-19T12:59:24.699 INFO:teuthology.orchestra.run.smithi046.stdout: "status", 2023-10-19T12:59:24.700 INFO:teuthology.orchestra.run.smithi046.stdout: "telemetry", 2023-10-19T12:59:24.700 INFO:teuthology.orchestra.run.smithi046.stdout: "volumes" 2023-10-19T12:59:24.700 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2023-10-19T12:59:24.700 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.700 INFO:teuthology.orchestra.run.smithi046.stdout: "last_failure_osd_epoch": 3, 2023-10-19T12:59:24.701 INFO:teuthology.orchestra.run.smithi046.stdout: "active_clients": [ 2023-10-19T12:59:24.701 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:24.701 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "devicehealth", 2023-10-19T12:59:24.701 INFO:teuthology.orchestra.run.smithi046.stdout: "addrvec": [ 2023-10-19T12:59:24.701 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:24.702 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v2", 2023-10-19T12:59:24.702 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.46:0", 2023-10-19T12:59:24.702 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 1486483489 2023-10-19T12:59:24.702 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:24.702 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2023-10-19T12:59:24.703 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.703 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:24.703 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "libcephsqlite", 2023-10-19T12:59:24.703 INFO:teuthology.orchestra.run.smithi046.stdout: "addrvec": [ 2023-10-19T12:59:24.703 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:24.703 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v2", 2023-10-19T12:59:24.704 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.46:0", 2023-10-19T12:59:24.704 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 745338950 2023-10-19T12:59:24.704 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:24.704 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2023-10-19T12:59:24.704 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.705 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:24.705 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rbd_support", 2023-10-19T12:59:24.705 INFO:teuthology.orchestra.run.smithi046.stdout: "addrvec": [ 2023-10-19T12:59:24.705 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:24.705 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v2", 2023-10-19T12:59:24.705 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.46:0", 2023-10-19T12:59:24.706 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 2009695275 2023-10-19T12:59:24.706 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:24.706 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2023-10-19T12:59:24.706 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:24.706 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:24.707 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "volumes", 2023-10-19T12:59:24.707 INFO:teuthology.orchestra.run.smithi046.stdout: "addrvec": [ 2023-10-19T12:59:24.707 INFO:teuthology.orchestra.run.smithi046.stdout: { 2023-10-19T12:59:24.707 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v2", 2023-10-19T12:59:24.707 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.46:0", 2023-10-19T12:59:24.708 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 3807180824 2023-10-19T12:59:24.708 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:24.708 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2023-10-19T12:59:24.708 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:24.708 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2023-10-19T12:59:24.708 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-10-19T12:59:24.711 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:59:21 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/4005078180' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-19T12:59:24.711 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:59:21 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/952696378' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-19T12:59:24.711 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:59:22 smithi195 ceph-mon[134493]: pgmap v829: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 3.5 MiB/s wr, 397 op/s 2023-10-19T12:59:24.711 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:59:22 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/3451617291' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2023-10-19T12:59:24.712 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:59:24 smithi195 ceph-mon[134493]: pgmap v830: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 3.0 MiB/s wr, 340 op/s 2023-10-19T12:59:24.712 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:59:21 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/4005078180' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-19T12:59:24.712 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:59:21 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/952696378' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-19T12:59:24.712 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:59:22 smithi157 ceph-mon[134109]: pgmap v829: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 3.5 MiB/s wr, 397 op/s 2023-10-19T12:59:24.712 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:59:22 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/3451617291' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2023-10-19T12:59:24.713 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:59:24 smithi157 ceph-mon[134109]: pgmap v830: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 3.0 MiB/s wr, 340 op/s 2023-10-19T12:59:24.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:21.250+0000 7fe6457ff700 1 -- 172.21.15.46:0/3451617291 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fe6280a1480 msgr2=0x7fe6280a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:59:24.713 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:21.250+0000 7fe6457ff700 1 --2- 172.21.15.46:0/3451617291 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fe6280a1480 0x7fe6280a3940 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fe634009c60 tx=0x7fe634009260 comp rx=0 tx=0).stop 2023-10-19T12:59:24.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:21.250+0000 7fe6457ff700 1 -- 172.21.15.46:0/3451617291 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe6400731f0 msgr2=0x7fe6401988d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T12:59:24.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:21.250+0000 7fe6457ff700 1 --2- 172.21.15.46:0/3451617291 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe6400731f0 0x7fe6401988d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe63000b680 tx=0x7fe630009580 comp rx=0 tx=0).stop 2023-10-19T12:59:24.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:21.250+0000 7fe6457ff700 1 -- 172.21.15.46:0/3451617291 shutdown_connections 2023-10-19T12:59:24.714 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:21.250+0000 7fe6457ff700 1 --2- 172.21.15.46:0/3451617291 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe640108610 0x7fe64019fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:59:24.715 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:21.250+0000 7fe6457ff700 1 --2- 172.21.15.46:0/3451617291 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fe6280a1480 0x7fe6280a3940 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:59:24.715 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:21.250+0000 7fe6457ff700 1 --2- 172.21.15.46:0/3451617291 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe6400731f0 0x7fe6401988d0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:59:24.715 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:21.250+0000 7fe6457ff700 1 --2- 172.21.15.46:0/3451617291 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe6400747d0 0x7fe640198e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T12:59:24.715 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:21.250+0000 7fe6457ff700 1 -- 172.21.15.46:0/3451617291 >> 172.21.15.46:0/3451617291 conn(0x7fe6400fbc90 msgr2=0x7fe640104560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T12:59:24.715 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:21.250+0000 7fe6457ff700 1 -- 172.21.15.46:0/3451617291 shutdown_connections 2023-10-19T12:59:24.715 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T12:59:21.250+0000 7fe6457ff700 1 -- 172.21.15.46:0/3451617291 wait complete. 2023-10-19T12:59:24.721 DEBUG:tasks.check_counter:Getting stats from a 2023-10-19T12:59:24.722 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph daemon mds.a perf dump 2023-10-19T12:59:24.723 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:59:21 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/4005078180' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-19T12:59:24.723 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:59:21 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/952696378' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-19T12:59:24.723 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:59:22 smithi046 ceph-mon[98509]: pgmap v829: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 3.5 MiB/s wr, 397 op/s 2023-10-19T12:59:24.723 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:59:22 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/3451617291' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2023-10-19T12:59:24.724 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:59:24 smithi046 ceph-mon[98509]: pgmap v830: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 3.0 MiB/s wr, 340 op/s 2023-10-19T12:59:25.494 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-19T12:59:26.162 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:59:25 smithi046 ceph-mon[98509]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-19T12:59:26.163 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:59:25 smithi046 ceph-mon[98509]: pgmap v831: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 2.2 MiB/s wr, 257 op/s 2023-10-19T12:59:26.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:59:25 smithi157 ceph-mon[134109]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-19T12:59:26.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:59:25 smithi157 ceph-mon[134109]: pgmap v831: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 2.2 MiB/s wr, 257 op/s 2023-10-19T12:59:26.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:59:25 smithi195 ceph-mon[134493]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-19T12:59:26.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:59:25 smithi195 ceph-mon[134493]: pgmap v831: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 2.2 MiB/s wr, 257 op/s 2023-10-19T12:59:27.405 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-10-19T12:59:27.405 INFO:teuthology.orchestra.run.smithi046.stdout: "AsyncMessenger::Worker-0": { 2023-10-19T12:59:27.406 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_messages": 2294, 2023-10-19T12:59:27.406 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_messages": 2296, 2023-10-19T12:59:27.406 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_bytes": 1934875, 2023-10-19T12:59:27.406 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_bytes": 713435, 2023-10-19T12:59:27.407 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_created_connections": 6, 2023-10-19T12:59:27.407 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_active_connections": 2, 2023-10-19T12:59:27.407 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_total_time": 0.332423128, 2023-10-19T12:59:27.407 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_send_time": 0.091269869, 2023-10-19T12:59:27.407 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_recv_time": 0.073760161, 2023-10-19T12:59:27.408 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_fast_dispatch_time": 0.131103718, 2023-10-19T12:59:27.408 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_messages_queue_lat": { 2023-10-19T12:59:27.408 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 2294, 2023-10-19T12:59:27.408 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.430035033, 2023-10-19T12:59:27.409 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000187460 2023-10-19T12:59:27.409 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:27.409 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_handle_ack_lat": { 2023-10-19T12:59:27.409 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2023-10-19T12:59:27.409 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2023-10-19T12:59:27.410 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2023-10-19T12:59:27.410 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:27.410 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-19T12:59:27.410 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_encrypted_bytes": 0 2023-10-19T12:59:27.410 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:27.411 INFO:teuthology.orchestra.run.smithi046.stdout: "AsyncMessenger::Worker-1": { 2023-10-19T12:59:27.411 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_messages": 1314, 2023-10-19T12:59:27.411 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_messages": 1284, 2023-10-19T12:59:27.411 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_bytes": 928426, 2023-10-19T12:59:27.411 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_bytes": 483319, 2023-10-19T12:59:27.412 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_created_connections": 5, 2023-10-19T12:59:27.412 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_active_connections": 3, 2023-10-19T12:59:27.412 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_total_time": 0.232898696, 2023-10-19T12:59:27.412 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_send_time": 0.080858237, 2023-10-19T12:59:27.412 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_recv_time": 0.055252642, 2023-10-19T12:59:27.413 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_fast_dispatch_time": 0.073379262, 2023-10-19T12:59:27.413 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_messages_queue_lat": { 2023-10-19T12:59:27.413 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 1283, 2023-10-19T12:59:27.413 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.253478231, 2023-10-19T12:59:27.413 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000197566 2023-10-19T12:59:27.414 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:27.414 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_handle_ack_lat": { 2023-10-19T12:59:27.414 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2023-10-19T12:59:27.414 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2023-10-19T12:59:27.415 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2023-10-19T12:59:27.415 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:27.415 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_encrypted_bytes": 686448, 2023-10-19T12:59:27.415 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_encrypted_bytes": 178160 2023-10-19T12:59:27.416 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:27.416 INFO:teuthology.orchestra.run.smithi046.stdout: "AsyncMessenger::Worker-2": { 2023-10-19T12:59:27.416 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_messages": 7, 2023-10-19T12:59:27.416 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_messages": 227, 2023-10-19T12:59:27.417 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_bytes": 3580, 2023-10-19T12:59:27.417 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_bytes": 547383, 2023-10-19T12:59:27.417 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_created_connections": 6, 2023-10-19T12:59:27.418 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_active_connections": 3, 2023-10-19T12:59:27.418 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_total_time": 0.038332520, 2023-10-19T12:59:27.418 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_send_time": 0.028969202, 2023-10-19T12:59:27.419 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_recv_time": 0.006083921, 2023-10-19T12:59:27.419 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_fast_dispatch_time": 0.000028102, 2023-10-19T12:59:27.419 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_messages_queue_lat": { 2023-10-19T12:59:27.420 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 226, 2023-10-19T12:59:27.420 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.055944839, 2023-10-19T12:59:27.420 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000247543 2023-10-19T12:59:27.421 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:27.421 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_handle_ack_lat": { 2023-10-19T12:59:27.421 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2023-10-19T12:59:27.421 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2023-10-19T12:59:27.422 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2023-10-19T12:59:27.422 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:27.422 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_encrypted_bytes": 3312, 2023-10-19T12:59:27.423 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_encrypted_bytes": 547072 2023-10-19T12:59:27.423 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:27.424 INFO:teuthology.orchestra.run.smithi046.stdout: "cct": { 2023-10-19T12:59:27.424 INFO:teuthology.orchestra.run.smithi046.stdout: "total_workers": 1, 2023-10-19T12:59:27.424 INFO:teuthology.orchestra.run.smithi046.stdout: "unhealthy_workers": 0 2023-10-19T12:59:27.425 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:27.425 INFO:teuthology.orchestra.run.smithi046.stdout: "finisher-MDSRank": { 2023-10-19T12:59:27.425 INFO:teuthology.orchestra.run.smithi046.stdout: "queue_len": 0, 2023-10-19T12:59:27.426 INFO:teuthology.orchestra.run.smithi046.stdout: "complete_latency": { 2023-10-19T12:59:27.426 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 5296, 2023-10-19T12:59:27.426 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.289435520, 2023-10-19T12:59:27.427 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000054651 2023-10-19T12:59:27.427 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:27.427 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:27.427 INFO:teuthology.orchestra.run.smithi046.stdout: "finisher-PurgeQueue": { 2023-10-19T12:59:27.428 INFO:teuthology.orchestra.run.smithi046.stdout: "queue_len": 0, 2023-10-19T12:59:27.428 INFO:teuthology.orchestra.run.smithi046.stdout: "complete_latency": { 2023-10-19T12:59:27.428 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2023-10-19T12:59:27.429 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2023-10-19T12:59:27.429 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2023-10-19T12:59:27.429 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:27.430 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:27.430 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2023-10-19T12:59:27.430 INFO:teuthology.orchestra.run.smithi046.stdout: "request": 0, 2023-10-19T12:59:27.431 INFO:teuthology.orchestra.run.smithi046.stdout: "reply": 0, 2023-10-19T12:59:27.431 INFO:teuthology.orchestra.run.smithi046.stdout: "reply_latency": { 2023-10-19T12:59:27.431 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2023-10-19T12:59:27.431 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2023-10-19T12:59:27.432 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2023-10-19T12:59:27.433 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:27.433 INFO:teuthology.orchestra.run.smithi046.stdout: "slow_reply": 0, 2023-10-19T12:59:27.433 INFO:teuthology.orchestra.run.smithi046.stdout: "forward": 0, 2023-10-19T12:59:27.433 INFO:teuthology.orchestra.run.smithi046.stdout: "dir_fetch_complete": 0, 2023-10-19T12:59:27.433 INFO:teuthology.orchestra.run.smithi046.stdout: "dir_fetch_keys": 0, 2023-10-19T12:59:27.434 INFO:teuthology.orchestra.run.smithi046.stdout: "dir_commit": 0, 2023-10-19T12:59:27.434 INFO:teuthology.orchestra.run.smithi046.stdout: "dir_split": 0, 2023-10-19T12:59:27.434 INFO:teuthology.orchestra.run.smithi046.stdout: "dir_merge": 0, 2023-10-19T12:59:27.434 INFO:teuthology.orchestra.run.smithi046.stdout: "inodes": 284, 2023-10-19T12:59:27.435 INFO:teuthology.orchestra.run.smithi046.stdout: "inodes_top": 0, 2023-10-19T12:59:27.435 INFO:teuthology.orchestra.run.smithi046.stdout: "inodes_bottom": 0, 2023-10-19T12:59:27.435 INFO:teuthology.orchestra.run.smithi046.stdout: "inodes_pin_tail": 284, 2023-10-19T12:59:27.435 INFO:teuthology.orchestra.run.smithi046.stdout: "inodes_pinned": 284, 2023-10-19T12:59:27.436 INFO:teuthology.orchestra.run.smithi046.stdout: "inodes_expired": 0, 2023-10-19T12:59:27.436 INFO:teuthology.orchestra.run.smithi046.stdout: "inodes_with_caps": 0, 2023-10-19T12:59:27.436 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": 0, 2023-10-19T12:59:27.436 INFO:teuthology.orchestra.run.smithi046.stdout: "subtrees": 11, 2023-10-19T12:59:27.437 INFO:teuthology.orchestra.run.smithi046.stdout: "traverse": 0, 2023-10-19T12:59:27.437 INFO:teuthology.orchestra.run.smithi046.stdout: "traverse_hit": 0, 2023-10-19T12:59:27.437 INFO:teuthology.orchestra.run.smithi046.stdout: "traverse_forward": 0, 2023-10-19T12:59:27.437 INFO:teuthology.orchestra.run.smithi046.stdout: "traverse_discover": 0, 2023-10-19T12:59:27.437 INFO:teuthology.orchestra.run.smithi046.stdout: "traverse_dir_fetch": 0, 2023-10-19T12:59:27.438 INFO:teuthology.orchestra.run.smithi046.stdout: "traverse_remote_ino": 0, 2023-10-19T12:59:27.438 INFO:teuthology.orchestra.run.smithi046.stdout: "traverse_lock": 0, 2023-10-19T12:59:27.438 INFO:teuthology.orchestra.run.smithi046.stdout: "load_cent": 0, 2023-10-19T12:59:27.438 INFO:teuthology.orchestra.run.smithi046.stdout: "q": 0, 2023-10-19T12:59:27.438 INFO:teuthology.orchestra.run.smithi046.stdout: "exported": 0, 2023-10-19T12:59:27.439 INFO:teuthology.orchestra.run.smithi046.stdout: "exported_inodes": 0, 2023-10-19T12:59:27.439 INFO:teuthology.orchestra.run.smithi046.stdout: "imported": 0, 2023-10-19T12:59:27.439 INFO:teuthology.orchestra.run.smithi046.stdout: "imported_inodes": 0, 2023-10-19T12:59:27.439 INFO:teuthology.orchestra.run.smithi046.stdout: "openino_dir_fetch": 0, 2023-10-19T12:59:27.439 INFO:teuthology.orchestra.run.smithi046.stdout: "openino_backtrace_fetch": 0, 2023-10-19T12:59:27.440 INFO:teuthology.orchestra.run.smithi046.stdout: "openino_peer_discover": 0, 2023-10-19T12:59:27.440 INFO:teuthology.orchestra.run.smithi046.stdout: "root_rfiles": 0, 2023-10-19T12:59:27.440 INFO:teuthology.orchestra.run.smithi046.stdout: "root_rbytes": 0, 2023-10-19T12:59:27.440 INFO:teuthology.orchestra.run.smithi046.stdout: "root_rsnaps": 0, 2023-10-19T12:59:27.440 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_backtrace_fetch": 0, 2023-10-19T12:59:27.441 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_set_tag": 0, 2023-10-19T12:59:27.441 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_backtrace_repaired": 0, 2023-10-19T12:59:27.441 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_inotable_repaired": 0, 2023-10-19T12:59:27.441 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_dir_inodes": 0, 2023-10-19T12:59:27.442 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_dir_base_inodes": 0, 2023-10-19T12:59:27.442 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_dirfrag_rstats": 0, 2023-10-19T12:59:27.442 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_file_inodes": 0, 2023-10-19T12:59:27.442 INFO:teuthology.orchestra.run.smithi046.stdout: "handle_inode_file_caps": 0, 2023-10-19T12:59:27.443 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph_cap_op_revoke": 0, 2023-10-19T12:59:27.443 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph_cap_op_grant": 0, 2023-10-19T12:59:27.443 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph_cap_op_trunc": 0, 2023-10-19T12:59:27.443 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-19T12:59:27.444 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-19T12:59:27.444 INFO:teuthology.orchestra.run.smithi046.stdout: "handle_client_caps": 0, 2023-10-19T12:59:27.444 INFO:teuthology.orchestra.run.smithi046.stdout: "handle_client_caps_dirty": 0, 2023-10-19T12:59:27.444 INFO:teuthology.orchestra.run.smithi046.stdout: "handle_client_cap_release": 0, 2023-10-19T12:59:27.445 INFO:teuthology.orchestra.run.smithi046.stdout: "process_request_cap_release": 0 2023-10-19T12:59:27.445 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:27.445 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_cache": { 2023-10-19T12:59:27.445 INFO:teuthology.orchestra.run.smithi046.stdout: "dir_update": 0, 2023-10-19T12:59:27.446 INFO:teuthology.orchestra.run.smithi046.stdout: "dir_update_receipt": 0, 2023-10-19T12:59:27.446 INFO:teuthology.orchestra.run.smithi046.stdout: "dir_try_discover": 0, 2023-10-19T12:59:27.446 INFO:teuthology.orchestra.run.smithi046.stdout: "dir_send_discover": 0, 2023-10-19T12:59:27.446 INFO:teuthology.orchestra.run.smithi046.stdout: "dir_handle_discover": 0, 2023-10-19T12:59:27.447 INFO:teuthology.orchestra.run.smithi046.stdout: "num_strays": 0, 2023-10-19T12:59:27.447 INFO:teuthology.orchestra.run.smithi046.stdout: "num_strays_delayed": 0, 2023-10-19T12:59:27.447 INFO:teuthology.orchestra.run.smithi046.stdout: "num_strays_enqueuing": 0, 2023-10-19T12:59:27.448 INFO:teuthology.orchestra.run.smithi046.stdout: "strays_created": 0, 2023-10-19T12:59:27.448 INFO:teuthology.orchestra.run.smithi046.stdout: "strays_enqueued": 0, 2023-10-19T12:59:27.448 INFO:teuthology.orchestra.run.smithi046.stdout: "strays_reintegrated": 0, 2023-10-19T12:59:27.448 INFO:teuthology.orchestra.run.smithi046.stdout: "strays_migrated": 0, 2023-10-19T12:59:27.449 INFO:teuthology.orchestra.run.smithi046.stdout: "num_recovering_processing": 0, 2023-10-19T12:59:27.449 INFO:teuthology.orchestra.run.smithi046.stdout: "num_recovering_enqueued": 0, 2023-10-19T12:59:27.449 INFO:teuthology.orchestra.run.smithi046.stdout: "num_recovering_prioritized": 0, 2023-10-19T12:59:27.450 INFO:teuthology.orchestra.run.smithi046.stdout: "recovery_started": 0, 2023-10-19T12:59:27.450 INFO:teuthology.orchestra.run.smithi046.stdout: "recovery_completed": 0, 2023-10-19T12:59:27.450 INFO:teuthology.orchestra.run.smithi046.stdout: "ireq_enqueue_scrub": 0, 2023-10-19T12:59:27.450 INFO:teuthology.orchestra.run.smithi046.stdout: "ireq_exportdir": 0, 2023-10-19T12:59:27.450 INFO:teuthology.orchestra.run.smithi046.stdout: "ireq_flush": 0, 2023-10-19T12:59:27.451 INFO:teuthology.orchestra.run.smithi046.stdout: "ireq_fragmentdir": 0, 2023-10-19T12:59:27.451 INFO:teuthology.orchestra.run.smithi046.stdout: "ireq_fragstats": 0, 2023-10-19T12:59:27.451 INFO:teuthology.orchestra.run.smithi046.stdout: "ireq_inodestats": 0 2023-10-19T12:59:27.451 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:27.451 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_log": { 2023-10-19T12:59:27.452 INFO:teuthology.orchestra.run.smithi046.stdout: "evlrg": 0, 2023-10-19T12:59:27.452 INFO:teuthology.orchestra.run.smithi046.stdout: "evadd": 0, 2023-10-19T12:59:27.452 INFO:teuthology.orchestra.run.smithi046.stdout: "evex": 0, 2023-10-19T12:59:27.452 INFO:teuthology.orchestra.run.smithi046.stdout: "evtrm": 0, 2023-10-19T12:59:27.452 INFO:teuthology.orchestra.run.smithi046.stdout: "ev": 926, 2023-10-19T12:59:27.453 INFO:teuthology.orchestra.run.smithi046.stdout: "evexg": 0, 2023-10-19T12:59:27.453 INFO:teuthology.orchestra.run.smithi046.stdout: "evexd": 0, 2023-10-19T12:59:27.453 INFO:teuthology.orchestra.run.smithi046.stdout: "segadd": 0, 2023-10-19T12:59:27.453 INFO:teuthology.orchestra.run.smithi046.stdout: "segex": 0, 2023-10-19T12:59:27.453 INFO:teuthology.orchestra.run.smithi046.stdout: "segtrm": 0, 2023-10-19T12:59:27.454 INFO:teuthology.orchestra.run.smithi046.stdout: "seg": 2, 2023-10-19T12:59:27.454 INFO:teuthology.orchestra.run.smithi046.stdout: "segmjr": 2, 2023-10-19T12:59:27.455 INFO:teuthology.orchestra.run.smithi046.stdout: "segexg": 0, 2023-10-19T12:59:27.457 INFO:teuthology.orchestra.run.smithi046.stdout: "segexd": 0, 2023-10-19T12:59:27.458 INFO:teuthology.orchestra.run.smithi046.stdout: "expos": 4194304, 2023-10-19T12:59:27.458 INFO:teuthology.orchestra.run.smithi046.stdout: "wrpos": 5453732, 2023-10-19T12:59:27.458 INFO:teuthology.orchestra.run.smithi046.stdout: "rdpos": 5453133, 2023-10-19T12:59:27.458 INFO:teuthology.orchestra.run.smithi046.stdout: "jlat": { 2023-10-19T12:59:27.459 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2023-10-19T12:59:27.459 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2023-10-19T12:59:27.459 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2023-10-19T12:59:27.459 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:27.459 INFO:teuthology.orchestra.run.smithi046.stdout: "replayed": 926 2023-10-19T12:59:27.460 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:27.460 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_mem": { 2023-10-19T12:59:27.460 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 256, 2023-10-19T12:59:27.460 INFO:teuthology.orchestra.run.smithi046.stdout: "ino+": 274, 2023-10-19T12:59:27.460 INFO:teuthology.orchestra.run.smithi046.stdout: "ino-": 18, 2023-10-19T12:59:27.461 INFO:teuthology.orchestra.run.smithi046.stdout: "dir": 21, 2023-10-19T12:59:27.461 INFO:teuthology.orchestra.run.smithi046.stdout: "dir+": 21, 2023-10-19T12:59:27.461 INFO:teuthology.orchestra.run.smithi046.stdout: "dir-": 0, 2023-10-19T12:59:27.461 INFO:teuthology.orchestra.run.smithi046.stdout: "dn": 284, 2023-10-19T12:59:27.461 INFO:teuthology.orchestra.run.smithi046.stdout: "dn+": 284, 2023-10-19T12:59:27.462 INFO:teuthology.orchestra.run.smithi046.stdout: "dn-": 0, 2023-10-19T12:59:27.462 INFO:teuthology.orchestra.run.smithi046.stdout: "cap": 0, 2023-10-19T12:59:27.462 INFO:teuthology.orchestra.run.smithi046.stdout: "cap+": 0, 2023-10-19T12:59:27.462 INFO:teuthology.orchestra.run.smithi046.stdout: "cap-": 0, 2023-10-19T12:59:27.462 INFO:teuthology.orchestra.run.smithi046.stdout: "rss": 49704, 2023-10-19T12:59:27.463 INFO:teuthology.orchestra.run.smithi046.stdout: "heap": 207152 2023-10-19T12:59:27.463 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:27.463 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_server": { 2023-10-19T12:59:27.463 INFO:teuthology.orchestra.run.smithi046.stdout: "dispatch_client_request": 0, 2023-10-19T12:59:27.463 INFO:teuthology.orchestra.run.smithi046.stdout: "dispatch_server_request": 0, 2023-10-19T12:59:27.464 INFO:teuthology.orchestra.run.smithi046.stdout: "handle_client_request": 0, 2023-10-19T12:59:27.464 INFO:teuthology.orchestra.run.smithi046.stdout: "handle_client_session": 0, 2023-10-19T12:59:27.464 INFO:teuthology.orchestra.run.smithi046.stdout: "handle_peer_request": 0, 2023-10-19T12:59:27.464 INFO:teuthology.orchestra.run.smithi046.stdout: "req_create_latency": { 2023-10-19T12:59:27.464 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2023-10-19T12:59:27.464 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2023-10-19T12:59:27.465 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2023-10-19T12:59:27.465 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:27.465 INFO:teuthology.orchestra.run.smithi046.stdout: "req_getattr_latency": { 2023-10-19T12:59:27.465 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2023-10-19T12:59:27.465 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2023-10-19T12:59:27.466 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2023-10-19T12:59:27.466 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:27.466 INFO:teuthology.orchestra.run.smithi046.stdout: "req_getfilelock_latency": { 2023-10-19T12:59:27.466 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2023-10-19T12:59:27.466 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2023-10-19T12:59:27.467 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2023-10-19T12:59:27.467 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:27.467 INFO:teuthology.orchestra.run.smithi046.stdout: "req_link_latency": { 2023-10-19T12:59:27.467 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2023-10-19T12:59:27.467 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2023-10-19T12:59:27.468 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2023-10-19T12:59:27.468 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:27.469 INFO:teuthology.orchestra.run.smithi046.stdout: "req_lookup_latency": { 2023-10-19T12:59:27.469 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2023-10-19T12:59:27.469 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2023-10-19T12:59:27.469 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2023-10-19T12:59:27.469 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:27.469 INFO:teuthology.orchestra.run.smithi046.stdout: "req_lookuphash_latency": { 2023-10-19T12:59:27.470 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2023-10-19T12:59:27.470 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2023-10-19T12:59:27.470 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2023-10-19T12:59:27.470 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:27.470 INFO:teuthology.orchestra.run.smithi046.stdout: "req_lookupino_latency": { 2023-10-19T12:59:27.471 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2023-10-19T12:59:27.471 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2023-10-19T12:59:27.471 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2023-10-19T12:59:27.471 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:27.472 INFO:teuthology.orchestra.run.smithi046.stdout: "req_lookupname_latency": { 2023-10-19T12:59:27.472 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2023-10-19T12:59:27.472 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2023-10-19T12:59:27.472 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2023-10-19T12:59:27.472 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:27.473 INFO:teuthology.orchestra.run.smithi046.stdout: "req_lookupparent_latency": { 2023-10-19T12:59:27.473 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2023-10-19T12:59:27.473 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2023-10-19T12:59:27.473 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2023-10-19T12:59:27.473 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:27.473 INFO:teuthology.orchestra.run.smithi046.stdout: "req_lookupsnap_latency": { 2023-10-19T12:59:27.474 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2023-10-19T12:59:27.474 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2023-10-19T12:59:27.474 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2023-10-19T12:59:27.474 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:27.474 INFO:teuthology.orchestra.run.smithi046.stdout: "req_lssnap_latency": { 2023-10-19T12:59:27.475 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2023-10-19T12:59:27.475 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2023-10-19T12:59:27.475 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2023-10-19T12:59:27.475 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:27.475 INFO:teuthology.orchestra.run.smithi046.stdout: "req_mkdir_latency": { 2023-10-19T12:59:27.476 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2023-10-19T12:59:27.476 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2023-10-19T12:59:27.476 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2023-10-19T12:59:27.476 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:27.476 INFO:teuthology.orchestra.run.smithi046.stdout: "req_mknod_latency": { 2023-10-19T12:59:27.477 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2023-10-19T12:59:27.477 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2023-10-19T12:59:27.477 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2023-10-19T12:59:27.477 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:27.477 INFO:teuthology.orchestra.run.smithi046.stdout: "req_mksnap_latency": { 2023-10-19T12:59:27.478 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2023-10-19T12:59:27.478 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2023-10-19T12:59:27.478 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2023-10-19T12:59:27.478 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:27.478 INFO:teuthology.orchestra.run.smithi046.stdout: "req_open_latency": { 2023-10-19T12:59:27.479 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2023-10-19T12:59:27.479 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2023-10-19T12:59:27.479 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2023-10-19T12:59:27.479 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:27.480 INFO:teuthology.orchestra.run.smithi046.stdout: "req_readdir_latency": { 2023-10-19T12:59:27.480 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2023-10-19T12:59:27.480 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2023-10-19T12:59:27.480 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2023-10-19T12:59:27.480 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:27.481 INFO:teuthology.orchestra.run.smithi046.stdout: "req_rename_latency": { 2023-10-19T12:59:27.481 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2023-10-19T12:59:27.481 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2023-10-19T12:59:27.481 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2023-10-19T12:59:27.481 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:27.481 INFO:teuthology.orchestra.run.smithi046.stdout: "req_renamesnap_latency": { 2023-10-19T12:59:27.482 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2023-10-19T12:59:27.482 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2023-10-19T12:59:27.482 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2023-10-19T12:59:27.482 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:27.482 INFO:teuthology.orchestra.run.smithi046.stdout: "req_snapdiff_latency": { 2023-10-19T12:59:27.483 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2023-10-19T12:59:27.483 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2023-10-19T12:59:27.483 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2023-10-19T12:59:27.483 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:27.483 INFO:teuthology.orchestra.run.smithi046.stdout: "req_rmdir_latency": { 2023-10-19T12:59:27.484 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2023-10-19T12:59:27.484 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2023-10-19T12:59:27.484 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2023-10-19T12:59:27.484 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:27.484 INFO:teuthology.orchestra.run.smithi046.stdout: "req_rmsnap_latency": { 2023-10-19T12:59:27.484 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2023-10-19T12:59:27.485 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2023-10-19T12:59:27.485 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2023-10-19T12:59:27.485 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:27.485 INFO:teuthology.orchestra.run.smithi046.stdout: "req_rmxattr_latency": { 2023-10-19T12:59:27.485 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2023-10-19T12:59:27.486 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2023-10-19T12:59:27.486 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2023-10-19T12:59:27.486 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:27.486 INFO:teuthology.orchestra.run.smithi046.stdout: "req_setattr_latency": { 2023-10-19T12:59:27.486 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2023-10-19T12:59:27.487 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2023-10-19T12:59:27.487 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2023-10-19T12:59:27.487 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:27.487 INFO:teuthology.orchestra.run.smithi046.stdout: "req_setdirlayout_latency": { 2023-10-19T12:59:27.487 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2023-10-19T12:59:27.488 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2023-10-19T12:59:27.488 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2023-10-19T12:59:27.488 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:27.488 INFO:teuthology.orchestra.run.smithi046.stdout: "req_setfilelock_latency": { 2023-10-19T12:59:27.488 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2023-10-19T12:59:27.488 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2023-10-19T12:59:27.489 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2023-10-19T12:59:27.489 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:27.489 INFO:teuthology.orchestra.run.smithi046.stdout: "req_setlayout_latency": { 2023-10-19T12:59:27.489 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2023-10-19T12:59:27.489 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2023-10-19T12:59:27.490 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2023-10-19T12:59:27.490 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:27.490 INFO:teuthology.orchestra.run.smithi046.stdout: "req_setxattr_latency": { 2023-10-19T12:59:27.490 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2023-10-19T12:59:27.490 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2023-10-19T12:59:27.491 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2023-10-19T12:59:27.491 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:27.491 INFO:teuthology.orchestra.run.smithi046.stdout: "req_symlink_latency": { 2023-10-19T12:59:27.491 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2023-10-19T12:59:27.491 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2023-10-19T12:59:27.492 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2023-10-19T12:59:27.492 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:27.492 INFO:teuthology.orchestra.run.smithi046.stdout: "req_unlink_latency": { 2023-10-19T12:59:27.492 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2023-10-19T12:59:27.492 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2023-10-19T12:59:27.492 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2023-10-19T12:59:27.493 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:27.493 INFO:teuthology.orchestra.run.smithi046.stdout: "cap_revoke_eviction": 0, 2023-10-19T12:59:27.493 INFO:teuthology.orchestra.run.smithi046.stdout: "cap_acquisition_throttle": 0, 2023-10-19T12:59:27.493 INFO:teuthology.orchestra.run.smithi046.stdout: "req_getvxattr_latency": { 2023-10-19T12:59:27.493 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2023-10-19T12:59:27.494 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2023-10-19T12:59:27.494 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2023-10-19T12:59:27.494 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:27.494 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:27.494 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_sessions": { 2023-10-19T12:59:27.495 INFO:teuthology.orchestra.run.smithi046.stdout: "session_count": 1, 2023-10-19T12:59:27.495 INFO:teuthology.orchestra.run.smithi046.stdout: "session_add": 2, 2023-10-19T12:59:27.495 INFO:teuthology.orchestra.run.smithi046.stdout: "session_remove": 1, 2023-10-19T12:59:27.495 INFO:teuthology.orchestra.run.smithi046.stdout: "sessions_open": 1, 2023-10-19T12:59:27.495 INFO:teuthology.orchestra.run.smithi046.stdout: "sessions_stale": 0, 2023-10-19T12:59:27.495 INFO:teuthology.orchestra.run.smithi046.stdout: "total_load": 0, 2023-10-19T12:59:27.496 INFO:teuthology.orchestra.run.smithi046.stdout: "average_load": 0, 2023-10-19T12:59:27.496 INFO:teuthology.orchestra.run.smithi046.stdout: "avg_session_uptime": 2655, 2023-10-19T12:59:27.496 INFO:teuthology.orchestra.run.smithi046.stdout: "mdthresh_evicted": 0 2023-10-19T12:59:27.496 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:27.496 INFO:teuthology.orchestra.run.smithi046.stdout: "mempool": { 2023-10-19T12:59:27.497 INFO:teuthology.orchestra.run.smithi046.stdout: "bloom_filter_bytes": 0, 2023-10-19T12:59:27.497 INFO:teuthology.orchestra.run.smithi046.stdout: "bloom_filter_items": 0, 2023-10-19T12:59:27.497 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_alloc_bytes": 0, 2023-10-19T12:59:27.497 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_alloc_items": 0, 2023-10-19T12:59:27.497 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_data_bytes": 0, 2023-10-19T12:59:27.497 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_data_items": 0, 2023-10-19T12:59:27.498 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-19T12:59:27.498 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_onode_items": 0, 2023-10-19T12:59:27.498 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-19T12:59:27.498 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_meta_items": 0, 2023-10-19T12:59:27.498 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_other_bytes": 0, 2023-10-19T12:59:27.499 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_other_items": 0, 2023-10-19T12:59:27.499 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-19T12:59:27.499 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_buffer_items": 0, 2023-10-19T12:59:27.499 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_extent_bytes": 0, 2023-10-19T12:59:27.499 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_extent_items": 0, 2023-10-19T12:59:27.499 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_blob_bytes": 0, 2023-10-19T12:59:27.500 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_blob_items": 0, 2023-10-19T12:59:27.500 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-19T12:59:27.500 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_shared_blob_items": 0, 2023-10-19T12:59:27.500 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-19T12:59:27.500 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_inline_bl_items": 0, 2023-10-19T12:59:27.501 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_fsck_bytes": 0, 2023-10-19T12:59:27.501 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_fsck_items": 0, 2023-10-19T12:59:27.501 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_txc_bytes": 0, 2023-10-19T12:59:27.501 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_txc_items": 0, 2023-10-19T12:59:27.501 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-19T12:59:27.501 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_writing_deferred_items": 0, 2023-10-19T12:59:27.502 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_writing_bytes": 0, 2023-10-19T12:59:27.502 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_writing_items": 0, 2023-10-19T12:59:27.502 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_bytes": 0, 2023-10-19T12:59:27.502 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_items": 0, 2023-10-19T12:59:27.502 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_file_reader_bytes": 0, 2023-10-19T12:59:27.503 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_file_reader_items": 0, 2023-10-19T12:59:27.503 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_file_writer_bytes": 0, 2023-10-19T12:59:27.503 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_file_writer_items": 0, 2023-10-19T12:59:27.503 INFO:teuthology.orchestra.run.smithi046.stdout: "buffer_anon_bytes": 199343, 2023-10-19T12:59:27.503 INFO:teuthology.orchestra.run.smithi046.stdout: "buffer_anon_items": 300, 2023-10-19T12:59:27.504 INFO:teuthology.orchestra.run.smithi046.stdout: "buffer_meta_bytes": 0, 2023-10-19T12:59:27.504 INFO:teuthology.orchestra.run.smithi046.stdout: "buffer_meta_items": 0, 2023-10-19T12:59:27.504 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_bytes": 0, 2023-10-19T12:59:27.504 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_items": 0, 2023-10-19T12:59:27.504 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_mapbl_bytes": 0, 2023-10-19T12:59:27.504 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_mapbl_items": 0, 2023-10-19T12:59:27.505 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pglog_bytes": 0, 2023-10-19T12:59:27.505 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pglog_items": 0, 2023-10-19T12:59:27.505 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_bytes": 9280, 2023-10-19T12:59:27.505 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_items": 179, 2023-10-19T12:59:27.505 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_mapping_bytes": 0, 2023-10-19T12:59:27.506 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_mapping_items": 0, 2023-10-19T12:59:27.506 INFO:teuthology.orchestra.run.smithi046.stdout: "pgmap_bytes": 0, 2023-10-19T12:59:27.506 INFO:teuthology.orchestra.run.smithi046.stdout: "pgmap_items": 0, 2023-10-19T12:59:27.506 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_co_bytes": 806901, 2023-10-19T12:59:27.506 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_co_items": 7296, 2023-10-19T12:59:27.507 INFO:teuthology.orchestra.run.smithi046.stdout: "unittest_1_bytes": 0, 2023-10-19T12:59:27.507 INFO:teuthology.orchestra.run.smithi046.stdout: "unittest_1_items": 0, 2023-10-19T12:59:27.508 INFO:teuthology.orchestra.run.smithi046.stdout: "unittest_2_bytes": 0, 2023-10-19T12:59:27.508 INFO:teuthology.orchestra.run.smithi046.stdout: "unittest_2_items": 0 2023-10-19T12:59:27.508 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:27.509 INFO:teuthology.orchestra.run.smithi046.stdout: "objecter": { 2023-10-19T12:59:27.509 INFO:teuthology.orchestra.run.smithi046.stdout: "op_active": 0, 2023-10-19T12:59:27.509 INFO:teuthology.orchestra.run.smithi046.stdout: "op_laggy": 0, 2023-10-19T12:59:27.509 INFO:teuthology.orchestra.run.smithi046.stdout: "op_send": 3276, 2023-10-19T12:59:27.509 INFO:teuthology.orchestra.run.smithi046.stdout: "op_send_bytes": 21, 2023-10-19T12:59:27.510 INFO:teuthology.orchestra.run.smithi046.stdout: "op_resend": 3, 2023-10-19T12:59:27.510 INFO:teuthology.orchestra.run.smithi046.stdout: "op_reply": 3276, 2023-10-19T12:59:27.510 INFO:teuthology.orchestra.run.smithi046.stdout: "op_latency": { 2023-10-19T12:59:27.510 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 3276, 2023-10-19T12:59:27.510 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 12.886873186, 2023-10-19T12:59:27.511 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.003933721 2023-10-19T12:59:27.511 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:27.511 INFO:teuthology.orchestra.run.smithi046.stdout: "op_inflight": 0, 2023-10-19T12:59:27.511 INFO:teuthology.orchestra.run.smithi046.stdout: "oplen_avg": { 2023-10-19T12:59:27.511 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 3276, 2023-10-19T12:59:27.512 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 3277 2023-10-19T12:59:27.512 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:27.512 INFO:teuthology.orchestra.run.smithi046.stdout: "op": 3276, 2023-10-19T12:59:27.512 INFO:teuthology.orchestra.run.smithi046.stdout: "op_r": 3276, 2023-10-19T12:59:27.512 INFO:teuthology.orchestra.run.smithi046.stdout: "op_w": 0, 2023-10-19T12:59:27.514 INFO:teuthology.orchestra.run.smithi046.stdout: "op_rmw": 0, 2023-10-19T12:59:27.514 INFO:teuthology.orchestra.run.smithi046.stdout: "op_pg": 0, 2023-10-19T12:59:27.514 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_stat": 2026, 2023-10-19T12:59:27.514 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_create": 0, 2023-10-19T12:59:27.515 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_read": 1248, 2023-10-19T12:59:27.515 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_write": 0, 2023-10-19T12:59:27.515 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_writefull": 0, 2023-10-19T12:59:27.516 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_writesame": 0, 2023-10-19T12:59:27.516 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_append": 0, 2023-10-19T12:59:27.516 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_zero": 0, 2023-10-19T12:59:27.516 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_truncate": 0, 2023-10-19T12:59:27.516 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_delete": 0, 2023-10-19T12:59:27.517 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_mapext": 0, 2023-10-19T12:59:27.517 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_sparse_read": 0, 2023-10-19T12:59:27.517 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_clonerange": 0, 2023-10-19T12:59:27.517 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_getxattr": 1, 2023-10-19T12:59:27.517 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_setxattr": 0, 2023-10-19T12:59:27.518 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_cmpxattr": 0, 2023-10-19T12:59:27.518 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_rmxattr": 0, 2023-10-19T12:59:27.518 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_resetxattrs": 0, 2023-10-19T12:59:27.518 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_call": 0, 2023-10-19T12:59:27.518 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_watch": 0, 2023-10-19T12:59:27.519 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_notify": 0, 2023-10-19T12:59:27.519 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_src_cmpxattr": 0, 2023-10-19T12:59:27.519 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_pgls": 0, 2023-10-19T12:59:27.519 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_pgls_filter": 0, 2023-10-19T12:59:27.519 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_other": 0, 2023-10-19T12:59:27.520 INFO:teuthology.orchestra.run.smithi046.stdout: "linger_active": 0, 2023-10-19T12:59:27.520 INFO:teuthology.orchestra.run.smithi046.stdout: "linger_send": 0, 2023-10-19T12:59:27.520 INFO:teuthology.orchestra.run.smithi046.stdout: "linger_resend": 0, 2023-10-19T12:59:27.520 INFO:teuthology.orchestra.run.smithi046.stdout: "linger_ping": 0, 2023-10-19T12:59:27.520 INFO:teuthology.orchestra.run.smithi046.stdout: "poolop_active": 0, 2023-10-19T12:59:27.521 INFO:teuthology.orchestra.run.smithi046.stdout: "poolop_send": 0, 2023-10-19T12:59:27.521 INFO:teuthology.orchestra.run.smithi046.stdout: "poolop_resend": 0, 2023-10-19T12:59:27.521 INFO:teuthology.orchestra.run.smithi046.stdout: "poolstat_active": 0, 2023-10-19T12:59:27.521 INFO:teuthology.orchestra.run.smithi046.stdout: "poolstat_send": 0, 2023-10-19T12:59:27.521 INFO:teuthology.orchestra.run.smithi046.stdout: "poolstat_resend": 0, 2023-10-19T12:59:27.522 INFO:teuthology.orchestra.run.smithi046.stdout: "statfs_active": 0, 2023-10-19T12:59:27.522 INFO:teuthology.orchestra.run.smithi046.stdout: "statfs_send": 0, 2023-10-19T12:59:27.522 INFO:teuthology.orchestra.run.smithi046.stdout: "statfs_resend": 0, 2023-10-19T12:59:27.522 INFO:teuthology.orchestra.run.smithi046.stdout: "command_active": 0, 2023-10-19T12:59:27.522 INFO:teuthology.orchestra.run.smithi046.stdout: "command_send": 0, 2023-10-19T12:59:27.523 INFO:teuthology.orchestra.run.smithi046.stdout: "command_resend": 0, 2023-10-19T12:59:27.523 INFO:teuthology.orchestra.run.smithi046.stdout: "map_epoch": 92, 2023-10-19T12:59:27.523 INFO:teuthology.orchestra.run.smithi046.stdout: "map_full": 0, 2023-10-19T12:59:27.523 INFO:teuthology.orchestra.run.smithi046.stdout: "map_inc": 4, 2023-10-19T12:59:27.523 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_sessions": 5, 2023-10-19T12:59:27.524 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_session_open": 7, 2023-10-19T12:59:27.524 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_session_close": 2, 2023-10-19T12:59:27.524 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_laggy": 0, 2023-10-19T12:59:27.524 INFO:teuthology.orchestra.run.smithi046.stdout: "omap_wr": 0, 2023-10-19T12:59:27.524 INFO:teuthology.orchestra.run.smithi046.stdout: "omap_rd": 2, 2023-10-19T12:59:27.524 INFO:teuthology.orchestra.run.smithi046.stdout: "omap_del": 0 2023-10-19T12:59:27.525 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:27.525 INFO:teuthology.orchestra.run.smithi046.stdout: "oft": { 2023-10-19T12:59:27.525 INFO:teuthology.orchestra.run.smithi046.stdout: "omap_total_objs": 0, 2023-10-19T12:59:27.525 INFO:teuthology.orchestra.run.smithi046.stdout: "omap_total_kv_pairs": 0, 2023-10-19T12:59:27.525 INFO:teuthology.orchestra.run.smithi046.stdout: "omap_total_updates": 0, 2023-10-19T12:59:27.526 INFO:teuthology.orchestra.run.smithi046.stdout: "omap_total_removes": 0 2023-10-19T12:59:27.526 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:27.526 INFO:teuthology.orchestra.run.smithi046.stdout: "osd-slow-ops": { 2023-10-19T12:59:27.526 INFO:teuthology.orchestra.run.smithi046.stdout: "slow_ops_count": 0 2023-10-19T12:59:27.526 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:27.527 INFO:teuthology.orchestra.run.smithi046.stdout: "purge_queue": { 2023-10-19T12:59:27.527 INFO:teuthology.orchestra.run.smithi046.stdout: "pq_executing_ops": 0, 2023-10-19T12:59:27.527 INFO:teuthology.orchestra.run.smithi046.stdout: "pq_executing_ops_high_water": 0, 2023-10-19T12:59:27.527 INFO:teuthology.orchestra.run.smithi046.stdout: "pq_executing": 0, 2023-10-19T12:59:27.527 INFO:teuthology.orchestra.run.smithi046.stdout: "pq_executing_high_water": 0, 2023-10-19T12:59:27.527 INFO:teuthology.orchestra.run.smithi046.stdout: "pq_executed": 0, 2023-10-19T12:59:27.528 INFO:teuthology.orchestra.run.smithi046.stdout: "pq_item_in_journal": 0 2023-10-19T12:59:27.528 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:27.528 INFO:teuthology.orchestra.run.smithi046.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-19T12:59:27.528 INFO:teuthology.orchestra.run.smithi046.stdout: "val": 0, 2023-10-19T12:59:27.528 INFO:teuthology.orchestra.run.smithi046.stdout: "max": 104857600, 2023-10-19T12:59:27.529 INFO:teuthology.orchestra.run.smithi046.stdout: "get_started": 0, 2023-10-19T12:59:27.529 INFO:teuthology.orchestra.run.smithi046.stdout: "get": 3611, 2023-10-19T12:59:27.529 INFO:teuthology.orchestra.run.smithi046.stdout: "get_sum": 2521871, 2023-10-19T12:59:27.529 INFO:teuthology.orchestra.run.smithi046.stdout: "get_or_fail_fail": 0, 2023-10-19T12:59:27.530 INFO:teuthology.orchestra.run.smithi046.stdout: "get_or_fail_success": 3611, 2023-10-19T12:59:27.530 INFO:teuthology.orchestra.run.smithi046.stdout: "take": 0, 2023-10-19T12:59:27.530 INFO:teuthology.orchestra.run.smithi046.stdout: "take_sum": 0, 2023-10-19T12:59:27.530 INFO:teuthology.orchestra.run.smithi046.stdout: "put": 3611, 2023-10-19T12:59:27.531 INFO:teuthology.orchestra.run.smithi046.stdout: "put_sum": 2521871, 2023-10-19T12:59:27.531 INFO:teuthology.orchestra.run.smithi046.stdout: "wait": { 2023-10-19T12:59:27.531 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2023-10-19T12:59:27.531 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2023-10-19T12:59:27.531 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2023-10-19T12:59:27.532 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:27.532 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:27.532 INFO:teuthology.orchestra.run.smithi046.stdout: "throttle-objecter_bytes": { 2023-10-19T12:59:27.532 INFO:teuthology.orchestra.run.smithi046.stdout: "val": 0, 2023-10-19T12:59:27.532 INFO:teuthology.orchestra.run.smithi046.stdout: "max": 104857600, 2023-10-19T12:59:27.533 INFO:teuthology.orchestra.run.smithi046.stdout: "get_started": 0, 2023-10-19T12:59:27.533 INFO:teuthology.orchestra.run.smithi046.stdout: "get": 0, 2023-10-19T12:59:27.533 INFO:teuthology.orchestra.run.smithi046.stdout: "get_sum": 0, 2023-10-19T12:59:27.533 INFO:teuthology.orchestra.run.smithi046.stdout: "get_or_fail_fail": 0, 2023-10-19T12:59:27.533 INFO:teuthology.orchestra.run.smithi046.stdout: "get_or_fail_success": 0, 2023-10-19T12:59:27.533 INFO:teuthology.orchestra.run.smithi046.stdout: "take": 3276, 2023-10-19T12:59:27.534 INFO:teuthology.orchestra.run.smithi046.stdout: "take_sum": 1259433, 2023-10-19T12:59:27.534 INFO:teuthology.orchestra.run.smithi046.stdout: "put": 3276, 2023-10-19T12:59:27.534 INFO:teuthology.orchestra.run.smithi046.stdout: "put_sum": 1259433, 2023-10-19T12:59:27.534 INFO:teuthology.orchestra.run.smithi046.stdout: "wait": { 2023-10-19T12:59:27.534 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2023-10-19T12:59:27.535 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2023-10-19T12:59:27.535 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2023-10-19T12:59:27.535 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:27.535 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:27.535 INFO:teuthology.orchestra.run.smithi046.stdout: "throttle-objecter_ops": { 2023-10-19T12:59:27.536 INFO:teuthology.orchestra.run.smithi046.stdout: "val": 0, 2023-10-19T12:59:27.536 INFO:teuthology.orchestra.run.smithi046.stdout: "max": 1024, 2023-10-19T12:59:27.536 INFO:teuthology.orchestra.run.smithi046.stdout: "get_started": 0, 2023-10-19T12:59:27.536 INFO:teuthology.orchestra.run.smithi046.stdout: "get": 0, 2023-10-19T12:59:27.536 INFO:teuthology.orchestra.run.smithi046.stdout: "get_sum": 0, 2023-10-19T12:59:27.536 INFO:teuthology.orchestra.run.smithi046.stdout: "get_or_fail_fail": 0, 2023-10-19T12:59:27.537 INFO:teuthology.orchestra.run.smithi046.stdout: "get_or_fail_success": 0, 2023-10-19T12:59:27.537 INFO:teuthology.orchestra.run.smithi046.stdout: "take": 3276, 2023-10-19T12:59:27.537 INFO:teuthology.orchestra.run.smithi046.stdout: "take_sum": 3276, 2023-10-19T12:59:27.537 INFO:teuthology.orchestra.run.smithi046.stdout: "put": 3276, 2023-10-19T12:59:27.537 INFO:teuthology.orchestra.run.smithi046.stdout: "put_sum": 3276, 2023-10-19T12:59:27.538 INFO:teuthology.orchestra.run.smithi046.stdout: "wait": { 2023-10-19T12:59:27.538 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2023-10-19T12:59:27.538 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2023-10-19T12:59:27.538 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2023-10-19T12:59:27.538 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:27.539 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:27.539 INFO:teuthology.orchestra.run.smithi046.stdout: "throttle-write_buf_throttle": { 2023-10-19T12:59:27.539 INFO:teuthology.orchestra.run.smithi046.stdout: "val": 0, 2023-10-19T12:59:27.539 INFO:teuthology.orchestra.run.smithi046.stdout: "max": 3758096384, 2023-10-19T12:59:27.539 INFO:teuthology.orchestra.run.smithi046.stdout: "get_started": 0, 2023-10-19T12:59:27.539 INFO:teuthology.orchestra.run.smithi046.stdout: "get": 0, 2023-10-19T12:59:27.540 INFO:teuthology.orchestra.run.smithi046.stdout: "get_sum": 0, 2023-10-19T12:59:27.540 INFO:teuthology.orchestra.run.smithi046.stdout: "get_or_fail_fail": 0, 2023-10-19T12:59:27.540 INFO:teuthology.orchestra.run.smithi046.stdout: "get_or_fail_success": 0, 2023-10-19T12:59:27.540 INFO:teuthology.orchestra.run.smithi046.stdout: "take": 0, 2023-10-19T12:59:27.540 INFO:teuthology.orchestra.run.smithi046.stdout: "take_sum": 0, 2023-10-19T12:59:27.541 INFO:teuthology.orchestra.run.smithi046.stdout: "put": 0, 2023-10-19T12:59:27.541 INFO:teuthology.orchestra.run.smithi046.stdout: "put_sum": 0, 2023-10-19T12:59:27.541 INFO:teuthology.orchestra.run.smithi046.stdout: "wait": { 2023-10-19T12:59:27.541 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2023-10-19T12:59:27.541 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2023-10-19T12:59:27.542 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2023-10-19T12:59:27.542 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:27.542 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:27.542 INFO:teuthology.orchestra.run.smithi046.stdout: "throttle-write_buf_throttle-0x558e676baa00": { 2023-10-19T12:59:27.542 INFO:teuthology.orchestra.run.smithi046.stdout: "val": 0, 2023-10-19T12:59:27.543 INFO:teuthology.orchestra.run.smithi046.stdout: "max": 3758096384, 2023-10-19T12:59:27.543 INFO:teuthology.orchestra.run.smithi046.stdout: "get_started": 0, 2023-10-19T12:59:27.543 INFO:teuthology.orchestra.run.smithi046.stdout: "get": 0, 2023-10-19T12:59:27.543 INFO:teuthology.orchestra.run.smithi046.stdout: "get_sum": 0, 2023-10-19T12:59:27.543 INFO:teuthology.orchestra.run.smithi046.stdout: "get_or_fail_fail": 0, 2023-10-19T12:59:27.543 INFO:teuthology.orchestra.run.smithi046.stdout: "get_or_fail_success": 0, 2023-10-19T12:59:27.544 INFO:teuthology.orchestra.run.smithi046.stdout: "take": 0, 2023-10-19T12:59:27.544 INFO:teuthology.orchestra.run.smithi046.stdout: "take_sum": 0, 2023-10-19T12:59:27.544 INFO:teuthology.orchestra.run.smithi046.stdout: "put": 0, 2023-10-19T12:59:27.544 INFO:teuthology.orchestra.run.smithi046.stdout: "put_sum": 0, 2023-10-19T12:59:27.544 INFO:teuthology.orchestra.run.smithi046.stdout: "wait": { 2023-10-19T12:59:27.545 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2023-10-19T12:59:27.545 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2023-10-19T12:59:27.545 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2023-10-19T12:59:27.545 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:27.545 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:27.545 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-10-19T12:59:27.903 INFO:tasks.check_counter:Daemon mds.a mds.exported=0 2023-10-19T12:59:27.903 INFO:tasks.check_counter:Daemon mds.a mds.imported=0 2023-10-19T12:59:27.903 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update=0 2023-10-19T12:59:27.903 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update_receipt=0 2023-10-19T12:59:27.904 DEBUG:tasks.check_counter:Getting stats from d 2023-10-19T12:59:27.904 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph daemon mds.d perf dump 2023-10-19T12:59:28.478 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:59:28 smithi046 ceph-mon[98509]: pgmap v832: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 1.3 MiB/s wr, 170 op/s 2023-10-19T12:59:28.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:59:28 smithi157 ceph-mon[134109]: pgmap v832: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 1.3 MiB/s wr, 170 op/s 2023-10-19T12:59:28.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:59:28 smithi195 ceph-mon[134493]: pgmap v832: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 1.3 MiB/s wr, 170 op/s 2023-10-19T12:59:28.655 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-19T12:59:30.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:59:29 smithi046 ceph-mon[98509]: pgmap v833: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 890 KiB/s wr, 119 op/s 2023-10-19T12:59:30.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:59:29 smithi157 ceph-mon[134109]: pgmap v833: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 890 KiB/s wr, 119 op/s 2023-10-19T12:59:30.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:59:29 smithi195 ceph-mon[134493]: pgmap v833: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 890 KiB/s wr, 119 op/s 2023-10-19T12:59:30.453 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-10-19T12:59:30.454 INFO:teuthology.orchestra.run.smithi046.stdout: "AsyncMessenger::Worker-0": { 2023-10-19T12:59:30.454 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_messages": 0, 2023-10-19T12:59:30.454 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_messages": 2, 2023-10-19T12:59:30.454 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_bytes": 0, 2023-10-19T12:59:30.454 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_bytes": 0, 2023-10-19T12:59:30.455 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_created_connections": 4, 2023-10-19T12:59:30.455 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_active_connections": 0, 2023-10-19T12:59:30.455 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_total_time": 0.003649715, 2023-10-19T12:59:30.455 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_send_time": 0.000000000, 2023-10-19T12:59:30.456 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_recv_time": 0.000763314, 2023-10-19T12:59:30.456 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-10-19T12:59:30.456 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_messages_queue_lat": { 2023-10-19T12:59:30.456 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2023-10-19T12:59:30.456 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2023-10-19T12:59:30.457 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2023-10-19T12:59:30.457 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:30.457 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_handle_ack_lat": { 2023-10-19T12:59:30.457 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2023-10-19T12:59:30.457 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2023-10-19T12:59:30.458 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2023-10-19T12:59:30.458 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:30.458 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-19T12:59:30.458 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_encrypted_bytes": 0 2023-10-19T12:59:30.458 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:30.459 INFO:teuthology.orchestra.run.smithi046.stdout: "AsyncMessenger::Worker-1": { 2023-10-19T12:59:30.459 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_messages": 302, 2023-10-19T12:59:30.459 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_messages": 299, 2023-10-19T12:59:30.459 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_bytes": 496704, 2023-10-19T12:59:30.460 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_bytes": 179744, 2023-10-19T12:59:30.460 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_created_connections": 2, 2023-10-19T12:59:30.460 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_active_connections": 1, 2023-10-19T12:59:30.460 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_total_time": 0.083623509, 2023-10-19T12:59:30.460 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_send_time": 0.043786101, 2023-10-19T12:59:30.461 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_recv_time": 0.023489978, 2023-10-19T12:59:30.461 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_fast_dispatch_time": 0.010080728, 2023-10-19T12:59:30.461 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_messages_queue_lat": { 2023-10-19T12:59:30.461 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 298, 2023-10-19T12:59:30.461 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.061585938, 2023-10-19T12:59:30.462 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000206664 2023-10-19T12:59:30.462 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:30.462 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_handle_ack_lat": { 2023-10-19T12:59:30.462 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2023-10-19T12:59:30.462 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2023-10-19T12:59:30.463 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2023-10-19T12:59:30.463 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:30.463 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_encrypted_bytes": 496704, 2023-10-19T12:59:30.463 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_encrypted_bytes": 179744 2023-10-19T12:59:30.463 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:30.464 INFO:teuthology.orchestra.run.smithi046.stdout: "AsyncMessenger::Worker-2": { 2023-10-19T12:59:30.464 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_messages": 6, 2023-10-19T12:59:30.464 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_messages": 230, 2023-10-19T12:59:30.464 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_bytes": 3312, 2023-10-19T12:59:30.464 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_bytes": 193984, 2023-10-19T12:59:30.465 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_created_connections": 4, 2023-10-19T12:59:30.465 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_active_connections": 2, 2023-10-19T12:59:30.465 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_total_time": 0.037692836, 2023-10-19T12:59:30.465 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_send_time": 0.032204337, 2023-10-19T12:59:30.466 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_recv_time": 0.002890681, 2023-10-19T12:59:30.466 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-10-19T12:59:30.466 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_messages_queue_lat": { 2023-10-19T12:59:30.466 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 229, 2023-10-19T12:59:30.467 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.050431081, 2023-10-19T12:59:30.467 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000220223 2023-10-19T12:59:30.467 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:30.467 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_handle_ack_lat": { 2023-10-19T12:59:30.467 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2023-10-19T12:59:30.468 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2023-10-19T12:59:30.468 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2023-10-19T12:59:30.468 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:30.468 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_encrypted_bytes": 3312, 2023-10-19T12:59:30.468 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_encrypted_bytes": 193984 2023-10-19T12:59:30.469 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:30.469 INFO:teuthology.orchestra.run.smithi046.stdout: "cct": { 2023-10-19T12:59:30.469 INFO:teuthology.orchestra.run.smithi046.stdout: "total_workers": 0, 2023-10-19T12:59:30.469 INFO:teuthology.orchestra.run.smithi046.stdout: "unhealthy_workers": 0 2023-10-19T12:59:30.469 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:30.470 INFO:teuthology.orchestra.run.smithi046.stdout: "mempool": { 2023-10-19T12:59:30.470 INFO:teuthology.orchestra.run.smithi046.stdout: "bloom_filter_bytes": 0, 2023-10-19T12:59:30.470 INFO:teuthology.orchestra.run.smithi046.stdout: "bloom_filter_items": 0, 2023-10-19T12:59:30.470 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_alloc_bytes": 0, 2023-10-19T12:59:30.470 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_alloc_items": 0, 2023-10-19T12:59:30.471 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_data_bytes": 0, 2023-10-19T12:59:30.471 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_data_items": 0, 2023-10-19T12:59:30.471 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-19T12:59:30.471 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_onode_items": 0, 2023-10-19T12:59:30.471 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-19T12:59:30.471 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_meta_items": 0, 2023-10-19T12:59:30.472 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_other_bytes": 0, 2023-10-19T12:59:30.472 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_other_items": 0, 2023-10-19T12:59:30.472 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-19T12:59:30.472 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_buffer_items": 0, 2023-10-19T12:59:30.473 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_extent_bytes": 0, 2023-10-19T12:59:30.473 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_extent_items": 0, 2023-10-19T12:59:30.473 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_blob_bytes": 0, 2023-10-19T12:59:30.473 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_blob_items": 0, 2023-10-19T12:59:30.473 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-19T12:59:30.474 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_shared_blob_items": 0, 2023-10-19T12:59:30.474 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-19T12:59:30.474 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_inline_bl_items": 0, 2023-10-19T12:59:30.474 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_fsck_bytes": 0, 2023-10-19T12:59:30.474 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_fsck_items": 0, 2023-10-19T12:59:30.475 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_txc_bytes": 0, 2023-10-19T12:59:30.475 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_txc_items": 0, 2023-10-19T12:59:30.475 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-19T12:59:30.475 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_writing_deferred_items": 0, 2023-10-19T12:59:30.475 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_writing_bytes": 0, 2023-10-19T12:59:30.476 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_writing_items": 0, 2023-10-19T12:59:30.476 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_bytes": 0, 2023-10-19T12:59:30.476 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_items": 0, 2023-10-19T12:59:30.476 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_file_reader_bytes": 0, 2023-10-19T12:59:30.476 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_file_reader_items": 0, 2023-10-19T12:59:30.476 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_file_writer_bytes": 0, 2023-10-19T12:59:30.477 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_file_writer_items": 0, 2023-10-19T12:59:30.477 INFO:teuthology.orchestra.run.smithi046.stdout: "buffer_anon_bytes": 148738, 2023-10-19T12:59:30.477 INFO:teuthology.orchestra.run.smithi046.stdout: "buffer_anon_items": 31, 2023-10-19T12:59:30.477 INFO:teuthology.orchestra.run.smithi046.stdout: "buffer_meta_bytes": 0, 2023-10-19T12:59:30.477 INFO:teuthology.orchestra.run.smithi046.stdout: "buffer_meta_items": 0, 2023-10-19T12:59:30.477 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_bytes": 0, 2023-10-19T12:59:30.478 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_items": 0, 2023-10-19T12:59:30.478 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_mapbl_bytes": 0, 2023-10-19T12:59:30.478 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_mapbl_items": 0, 2023-10-19T12:59:30.478 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pglog_bytes": 0, 2023-10-19T12:59:30.478 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pglog_items": 0, 2023-10-19T12:59:30.478 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_bytes": 0, 2023-10-19T12:59:30.479 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_items": 0, 2023-10-19T12:59:30.479 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_mapping_bytes": 0, 2023-10-19T12:59:30.479 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_mapping_items": 0, 2023-10-19T12:59:30.479 INFO:teuthology.orchestra.run.smithi046.stdout: "pgmap_bytes": 0, 2023-10-19T12:59:30.479 INFO:teuthology.orchestra.run.smithi046.stdout: "pgmap_items": 0, 2023-10-19T12:59:30.479 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_co_bytes": 928, 2023-10-19T12:59:30.480 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_co_items": 2, 2023-10-19T12:59:30.480 INFO:teuthology.orchestra.run.smithi046.stdout: "unittest_1_bytes": 0, 2023-10-19T12:59:30.480 INFO:teuthology.orchestra.run.smithi046.stdout: "unittest_1_items": 0, 2023-10-19T12:59:30.480 INFO:teuthology.orchestra.run.smithi046.stdout: "unittest_2_bytes": 0, 2023-10-19T12:59:30.480 INFO:teuthology.orchestra.run.smithi046.stdout: "unittest_2_items": 0 2023-10-19T12:59:30.480 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:30.481 INFO:teuthology.orchestra.run.smithi046.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-19T12:59:30.481 INFO:teuthology.orchestra.run.smithi046.stdout: "val": 0, 2023-10-19T12:59:30.481 INFO:teuthology.orchestra.run.smithi046.stdout: "max": 104857600, 2023-10-19T12:59:30.481 INFO:teuthology.orchestra.run.smithi046.stdout: "get_started": 0, 2023-10-19T12:59:30.481 INFO:teuthology.orchestra.run.smithi046.stdout: "get": 304, 2023-10-19T12:59:30.482 INFO:teuthology.orchestra.run.smithi046.stdout: "get_sum": 454010, 2023-10-19T12:59:30.482 INFO:teuthology.orchestra.run.smithi046.stdout: "get_or_fail_fail": 0, 2023-10-19T12:59:30.482 INFO:teuthology.orchestra.run.smithi046.stdout: "get_or_fail_success": 304, 2023-10-19T12:59:30.482 INFO:teuthology.orchestra.run.smithi046.stdout: "take": 0, 2023-10-19T12:59:30.482 INFO:teuthology.orchestra.run.smithi046.stdout: "take_sum": 0, 2023-10-19T12:59:30.482 INFO:teuthology.orchestra.run.smithi046.stdout: "put": 304, 2023-10-19T12:59:30.483 INFO:teuthology.orchestra.run.smithi046.stdout: "put_sum": 454010, 2023-10-19T12:59:30.483 INFO:teuthology.orchestra.run.smithi046.stdout: "wait": { 2023-10-19T12:59:30.483 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2023-10-19T12:59:30.483 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2023-10-19T12:59:30.483 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2023-10-19T12:59:30.483 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:30.484 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:30.484 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-10-19T12:59:30.955 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2023-10-19T12:59:30.955 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2023-10-19T12:59:30.956 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2023-10-19T12:59:30.956 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2023-10-19T12:59:30.956 DEBUG:tasks.check_counter:Getting stats from g 2023-10-19T12:59:30.957 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph daemon mds.g perf dump 2023-10-19T12:59:31.709 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-19T12:59:32.295 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:59:32 smithi046 ceph-mon[98509]: pgmap v834: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 16 KiB/s wr, 17 op/s 2023-10-19T12:59:32.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:59:32 smithi157 ceph-mon[134109]: pgmap v834: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 16 KiB/s wr, 17 op/s 2023-10-19T12:59:32.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:59:32 smithi195 ceph-mon[134493]: pgmap v834: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 16 KiB/s wr, 17 op/s 2023-10-19T12:59:33.305 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-10-19T12:59:33.305 INFO:teuthology.orchestra.run.smithi046.stdout: "AsyncMessenger::Worker-0": { 2023-10-19T12:59:33.305 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_messages": 998, 2023-10-19T12:59:33.306 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_messages": 998, 2023-10-19T12:59:33.306 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_bytes": 336921, 2023-10-19T12:59:33.306 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_bytes": 309583, 2023-10-19T12:59:33.306 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_created_connections": 7, 2023-10-19T12:59:33.307 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_active_connections": 2, 2023-10-19T12:59:33.307 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_total_time": 0.207525320, 2023-10-19T12:59:33.307 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_send_time": 0.082848643, 2023-10-19T12:59:33.307 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_recv_time": 0.037453723, 2023-10-19T12:59:33.307 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_fast_dispatch_time": 0.063467836, 2023-10-19T12:59:33.308 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_messages_queue_lat": { 2023-10-19T12:59:33.308 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 997, 2023-10-19T12:59:33.308 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.252441364, 2023-10-19T12:59:33.308 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000253200 2023-10-19T12:59:33.308 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:33.309 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_handle_ack_lat": { 2023-10-19T12:59:33.309 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2023-10-19T12:59:33.309 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2023-10-19T12:59:33.309 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2023-10-19T12:59:33.309 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:33.309 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_encrypted_bytes": 2992, 2023-10-19T12:59:33.310 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_encrypted_bytes": 448 2023-10-19T12:59:33.310 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:33.310 INFO:teuthology.orchestra.run.smithi046.stdout: "AsyncMessenger::Worker-1": { 2023-10-19T12:59:33.310 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_messages": 1985, 2023-10-19T12:59:33.311 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_messages": 2209, 2023-10-19T12:59:33.311 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_bytes": 1517820, 2023-10-19T12:59:33.311 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_bytes": 1081177, 2023-10-19T12:59:33.311 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_created_connections": 5, 2023-10-19T12:59:33.311 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_active_connections": 4, 2023-10-19T12:59:33.312 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_total_time": 0.269232915, 2023-10-19T12:59:33.312 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_send_time": 0.085322231, 2023-10-19T12:59:33.312 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_recv_time": 0.053416521, 2023-10-19T12:59:33.312 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_fast_dispatch_time": 0.111179210, 2023-10-19T12:59:33.312 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_messages_queue_lat": { 2023-10-19T12:59:33.312 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 2207, 2023-10-19T12:59:33.313 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.331365269, 2023-10-19T12:59:33.313 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000150142 2023-10-19T12:59:33.313 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:33.313 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_handle_ack_lat": { 2023-10-19T12:59:33.313 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2023-10-19T12:59:33.313 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2023-10-19T12:59:33.314 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2023-10-19T12:59:33.314 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:33.314 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_encrypted_bytes": 160, 2023-10-19T12:59:33.314 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_encrypted_bytes": 464096 2023-10-19T12:59:33.315 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:33.315 INFO:teuthology.orchestra.run.smithi046.stdout: "AsyncMessenger::Worker-2": { 2023-10-19T12:59:33.315 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_messages": 338, 2023-10-19T12:59:33.315 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_messages": 308, 2023-10-19T12:59:33.315 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_bytes": 688340, 2023-10-19T12:59:33.315 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_bytes": 180352, 2023-10-19T12:59:33.316 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_created_connections": 5, 2023-10-19T12:59:33.316 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_active_connections": 3, 2023-10-19T12:59:33.316 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_total_time": 0.073513191, 2023-10-19T12:59:33.316 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_send_time": 0.034362641, 2023-10-19T12:59:33.316 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_recv_time": 0.027774278, 2023-10-19T12:59:33.317 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_fast_dispatch_time": 0.009304900, 2023-10-19T12:59:33.317 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_messages_queue_lat": { 2023-10-19T12:59:33.317 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 307, 2023-10-19T12:59:33.317 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.069294093, 2023-10-19T12:59:33.317 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000225713 2023-10-19T12:59:33.317 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:33.318 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_handle_ack_lat": { 2023-10-19T12:59:33.318 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2023-10-19T12:59:33.318 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2023-10-19T12:59:33.318 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2023-10-19T12:59:33.318 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:33.319 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_encrypted_bytes": 686992, 2023-10-19T12:59:33.319 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_encrypted_bytes": 179408 2023-10-19T12:59:33.319 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:33.319 INFO:teuthology.orchestra.run.smithi046.stdout: "cct": { 2023-10-19T12:59:33.319 INFO:teuthology.orchestra.run.smithi046.stdout: "total_workers": 1, 2023-10-19T12:59:33.319 INFO:teuthology.orchestra.run.smithi046.stdout: "unhealthy_workers": 0 2023-10-19T12:59:33.320 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:33.320 INFO:teuthology.orchestra.run.smithi046.stdout: "finisher-MDSRank": { 2023-10-19T12:59:33.320 INFO:teuthology.orchestra.run.smithi046.stdout: "queue_len": 0, 2023-10-19T12:59:33.320 INFO:teuthology.orchestra.run.smithi046.stdout: "complete_latency": { 2023-10-19T12:59:33.320 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 4728, 2023-10-19T12:59:33.321 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.207298878, 2023-10-19T12:59:33.321 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000043844 2023-10-19T12:59:33.321 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:33.321 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:33.321 INFO:teuthology.orchestra.run.smithi046.stdout: "finisher-PurgeQueue": { 2023-10-19T12:59:33.322 INFO:teuthology.orchestra.run.smithi046.stdout: "queue_len": 0, 2023-10-19T12:59:33.322 INFO:teuthology.orchestra.run.smithi046.stdout: "complete_latency": { 2023-10-19T12:59:33.322 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2023-10-19T12:59:33.322 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2023-10-19T12:59:33.323 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2023-10-19T12:59:33.323 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:33.323 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:33.323 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2023-10-19T12:59:33.323 INFO:teuthology.orchestra.run.smithi046.stdout: "request": 0, 2023-10-19T12:59:33.323 INFO:teuthology.orchestra.run.smithi046.stdout: "reply": 0, 2023-10-19T12:59:33.324 INFO:teuthology.orchestra.run.smithi046.stdout: "reply_latency": { 2023-10-19T12:59:33.324 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2023-10-19T12:59:33.324 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2023-10-19T12:59:33.324 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2023-10-19T12:59:33.324 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:33.325 INFO:teuthology.orchestra.run.smithi046.stdout: "slow_reply": 0, 2023-10-19T12:59:33.325 INFO:teuthology.orchestra.run.smithi046.stdout: "forward": 0, 2023-10-19T12:59:33.325 INFO:teuthology.orchestra.run.smithi046.stdout: "dir_fetch_complete": 0, 2023-10-19T12:59:33.325 INFO:teuthology.orchestra.run.smithi046.stdout: "dir_fetch_keys": 0, 2023-10-19T12:59:33.325 INFO:teuthology.orchestra.run.smithi046.stdout: "dir_commit": 0, 2023-10-19T12:59:33.325 INFO:teuthology.orchestra.run.smithi046.stdout: "dir_split": 0, 2023-10-19T12:59:33.326 INFO:teuthology.orchestra.run.smithi046.stdout: "dir_merge": 0, 2023-10-19T12:59:33.326 INFO:teuthology.orchestra.run.smithi046.stdout: "inodes": 231, 2023-10-19T12:59:33.326 INFO:teuthology.orchestra.run.smithi046.stdout: "inodes_top": 0, 2023-10-19T12:59:33.326 INFO:teuthology.orchestra.run.smithi046.stdout: "inodes_bottom": 0, 2023-10-19T12:59:33.326 INFO:teuthology.orchestra.run.smithi046.stdout: "inodes_pin_tail": 231, 2023-10-19T12:59:33.327 INFO:teuthology.orchestra.run.smithi046.stdout: "inodes_pinned": 231, 2023-10-19T12:59:33.327 INFO:teuthology.orchestra.run.smithi046.stdout: "inodes_expired": 3, 2023-10-19T12:59:33.327 INFO:teuthology.orchestra.run.smithi046.stdout: "inodes_with_caps": 0, 2023-10-19T12:59:33.327 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": 0, 2023-10-19T12:59:33.327 INFO:teuthology.orchestra.run.smithi046.stdout: "subtrees": 8, 2023-10-19T12:59:33.328 INFO:teuthology.orchestra.run.smithi046.stdout: "traverse": 0, 2023-10-19T12:59:33.328 INFO:teuthology.orchestra.run.smithi046.stdout: "traverse_hit": 0, 2023-10-19T12:59:33.328 INFO:teuthology.orchestra.run.smithi046.stdout: "traverse_forward": 0, 2023-10-19T12:59:33.328 INFO:teuthology.orchestra.run.smithi046.stdout: "traverse_discover": 0, 2023-10-19T12:59:33.328 INFO:teuthology.orchestra.run.smithi046.stdout: "traverse_dir_fetch": 0, 2023-10-19T12:59:33.329 INFO:teuthology.orchestra.run.smithi046.stdout: "traverse_remote_ino": 0, 2023-10-19T12:59:33.329 INFO:teuthology.orchestra.run.smithi046.stdout: "traverse_lock": 0, 2023-10-19T12:59:33.329 INFO:teuthology.orchestra.run.smithi046.stdout: "load_cent": 0, 2023-10-19T12:59:33.329 INFO:teuthology.orchestra.run.smithi046.stdout: "q": 0, 2023-10-19T12:59:33.329 INFO:teuthology.orchestra.run.smithi046.stdout: "exported": 0, 2023-10-19T12:59:33.330 INFO:teuthology.orchestra.run.smithi046.stdout: "exported_inodes": 0, 2023-10-19T12:59:33.330 INFO:teuthology.orchestra.run.smithi046.stdout: "imported": 0, 2023-10-19T12:59:33.330 INFO:teuthology.orchestra.run.smithi046.stdout: "imported_inodes": 0, 2023-10-19T12:59:33.330 INFO:teuthology.orchestra.run.smithi046.stdout: "openino_dir_fetch": 0, 2023-10-19T12:59:33.330 INFO:teuthology.orchestra.run.smithi046.stdout: "openino_backtrace_fetch": 0, 2023-10-19T12:59:33.331 INFO:teuthology.orchestra.run.smithi046.stdout: "openino_peer_discover": 0, 2023-10-19T12:59:33.331 INFO:teuthology.orchestra.run.smithi046.stdout: "root_rfiles": 0, 2023-10-19T12:59:33.331 INFO:teuthology.orchestra.run.smithi046.stdout: "root_rbytes": 0, 2023-10-19T12:59:33.331 INFO:teuthology.orchestra.run.smithi046.stdout: "root_rsnaps": 0, 2023-10-19T12:59:33.331 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_backtrace_fetch": 0, 2023-10-19T12:59:33.332 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_set_tag": 0, 2023-10-19T12:59:33.332 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_backtrace_repaired": 0, 2023-10-19T12:59:33.332 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_inotable_repaired": 0, 2023-10-19T12:59:33.332 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_dir_inodes": 0, 2023-10-19T12:59:33.332 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_dir_base_inodes": 0, 2023-10-19T12:59:33.333 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_dirfrag_rstats": 0, 2023-10-19T12:59:33.333 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_file_inodes": 0, 2023-10-19T12:59:33.333 INFO:teuthology.orchestra.run.smithi046.stdout: "handle_inode_file_caps": 0, 2023-10-19T12:59:33.333 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph_cap_op_revoke": 0, 2023-10-19T12:59:33.333 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph_cap_op_grant": 0, 2023-10-19T12:59:33.333 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph_cap_op_trunc": 0, 2023-10-19T12:59:33.334 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-19T12:59:33.334 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-19T12:59:33.334 INFO:teuthology.orchestra.run.smithi046.stdout: "handle_client_caps": 0, 2023-10-19T12:59:33.334 INFO:teuthology.orchestra.run.smithi046.stdout: "handle_client_caps_dirty": 0, 2023-10-19T12:59:33.334 INFO:teuthology.orchestra.run.smithi046.stdout: "handle_client_cap_release": 0, 2023-10-19T12:59:33.335 INFO:teuthology.orchestra.run.smithi046.stdout: "process_request_cap_release": 0 2023-10-19T12:59:33.335 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:33.335 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_cache": { 2023-10-19T12:59:33.335 INFO:teuthology.orchestra.run.smithi046.stdout: "dir_update": 0, 2023-10-19T12:59:33.335 INFO:teuthology.orchestra.run.smithi046.stdout: "dir_update_receipt": 0, 2023-10-19T12:59:33.336 INFO:teuthology.orchestra.run.smithi046.stdout: "dir_try_discover": 0, 2023-10-19T12:59:33.336 INFO:teuthology.orchestra.run.smithi046.stdout: "dir_send_discover": 0, 2023-10-19T12:59:33.336 INFO:teuthology.orchestra.run.smithi046.stdout: "dir_handle_discover": 0, 2023-10-19T12:59:33.336 INFO:teuthology.orchestra.run.smithi046.stdout: "num_strays": 0, 2023-10-19T12:59:33.336 INFO:teuthology.orchestra.run.smithi046.stdout: "num_strays_delayed": 0, 2023-10-19T12:59:33.337 INFO:teuthology.orchestra.run.smithi046.stdout: "num_strays_enqueuing": 0, 2023-10-19T12:59:33.337 INFO:teuthology.orchestra.run.smithi046.stdout: "strays_created": 0, 2023-10-19T12:59:33.337 INFO:teuthology.orchestra.run.smithi046.stdout: "strays_enqueued": 0, 2023-10-19T12:59:33.337 INFO:teuthology.orchestra.run.smithi046.stdout: "strays_reintegrated": 0, 2023-10-19T12:59:33.337 INFO:teuthology.orchestra.run.smithi046.stdout: "strays_migrated": 0, 2023-10-19T12:59:33.337 INFO:teuthology.orchestra.run.smithi046.stdout: "num_recovering_processing": 0, 2023-10-19T12:59:33.338 INFO:teuthology.orchestra.run.smithi046.stdout: "num_recovering_enqueued": 0, 2023-10-19T12:59:33.338 INFO:teuthology.orchestra.run.smithi046.stdout: "num_recovering_prioritized": 0, 2023-10-19T12:59:33.338 INFO:teuthology.orchestra.run.smithi046.stdout: "recovery_started": 0, 2023-10-19T12:59:33.338 INFO:teuthology.orchestra.run.smithi046.stdout: "recovery_completed": 0, 2023-10-19T12:59:33.338 INFO:teuthology.orchestra.run.smithi046.stdout: "ireq_enqueue_scrub": 0, 2023-10-19T12:59:33.339 INFO:teuthology.orchestra.run.smithi046.stdout: "ireq_exportdir": 0, 2023-10-19T12:59:33.339 INFO:teuthology.orchestra.run.smithi046.stdout: "ireq_flush": 0, 2023-10-19T12:59:33.339 INFO:teuthology.orchestra.run.smithi046.stdout: "ireq_fragmentdir": 0, 2023-10-19T12:59:33.339 INFO:teuthology.orchestra.run.smithi046.stdout: "ireq_fragstats": 0, 2023-10-19T12:59:33.339 INFO:teuthology.orchestra.run.smithi046.stdout: "ireq_inodestats": 0 2023-10-19T12:59:33.339 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:33.340 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_log": { 2023-10-19T12:59:33.340 INFO:teuthology.orchestra.run.smithi046.stdout: "evlrg": 0, 2023-10-19T12:59:33.340 INFO:teuthology.orchestra.run.smithi046.stdout: "evadd": 0, 2023-10-19T12:59:33.340 INFO:teuthology.orchestra.run.smithi046.stdout: "evex": 0, 2023-10-19T12:59:33.340 INFO:teuthology.orchestra.run.smithi046.stdout: "evtrm": 0, 2023-10-19T12:59:33.341 INFO:teuthology.orchestra.run.smithi046.stdout: "ev": 631, 2023-10-19T12:59:33.341 INFO:teuthology.orchestra.run.smithi046.stdout: "evexg": 0, 2023-10-19T12:59:33.341 INFO:teuthology.orchestra.run.smithi046.stdout: "evexd": 0, 2023-10-19T12:59:33.341 INFO:teuthology.orchestra.run.smithi046.stdout: "segadd": 0, 2023-10-19T12:59:33.341 INFO:teuthology.orchestra.run.smithi046.stdout: "segex": 0, 2023-10-19T12:59:33.341 INFO:teuthology.orchestra.run.smithi046.stdout: "segtrm": 0, 2023-10-19T12:59:33.342 INFO:teuthology.orchestra.run.smithi046.stdout: "seg": 2, 2023-10-19T12:59:33.342 INFO:teuthology.orchestra.run.smithi046.stdout: "segmjr": 2, 2023-10-19T12:59:33.342 INFO:teuthology.orchestra.run.smithi046.stdout: "segexg": 0, 2023-10-19T12:59:33.342 INFO:teuthology.orchestra.run.smithi046.stdout: "segexd": 0, 2023-10-19T12:59:33.342 INFO:teuthology.orchestra.run.smithi046.stdout: "expos": 4194304, 2023-10-19T12:59:33.342 INFO:teuthology.orchestra.run.smithi046.stdout: "wrpos": 5207948, 2023-10-19T12:59:33.343 INFO:teuthology.orchestra.run.smithi046.stdout: "rdpos": 5207374, 2023-10-19T12:59:33.343 INFO:teuthology.orchestra.run.smithi046.stdout: "jlat": { 2023-10-19T12:59:33.343 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2023-10-19T12:59:33.343 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2023-10-19T12:59:33.343 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2023-10-19T12:59:33.344 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:33.344 INFO:teuthology.orchestra.run.smithi046.stdout: "replayed": 631 2023-10-19T12:59:33.344 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:33.344 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_mem": { 2023-10-19T12:59:33.344 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 232, 2023-10-19T12:59:33.344 INFO:teuthology.orchestra.run.smithi046.stdout: "ino+": 318, 2023-10-19T12:59:33.345 INFO:teuthology.orchestra.run.smithi046.stdout: "ino-": 86, 2023-10-19T12:59:33.345 INFO:teuthology.orchestra.run.smithi046.stdout: "dir": 15, 2023-10-19T12:59:33.345 INFO:teuthology.orchestra.run.smithi046.stdout: "dir+": 17, 2023-10-19T12:59:33.345 INFO:teuthology.orchestra.run.smithi046.stdout: "dir-": 2, 2023-10-19T12:59:33.345 INFO:teuthology.orchestra.run.smithi046.stdout: "dn": 231, 2023-10-19T12:59:33.345 INFO:teuthology.orchestra.run.smithi046.stdout: "dn+": 323, 2023-10-19T12:59:33.346 INFO:teuthology.orchestra.run.smithi046.stdout: "dn-": 92, 2023-10-19T12:59:33.346 INFO:teuthology.orchestra.run.smithi046.stdout: "cap": 0, 2023-10-19T12:59:33.346 INFO:teuthology.orchestra.run.smithi046.stdout: "cap+": 0, 2023-10-19T12:59:33.346 INFO:teuthology.orchestra.run.smithi046.stdout: "cap-": 0, 2023-10-19T12:59:33.346 INFO:teuthology.orchestra.run.smithi046.stdout: "rss": 49820, 2023-10-19T12:59:33.347 INFO:teuthology.orchestra.run.smithi046.stdout: "heap": 207152 2023-10-19T12:59:33.347 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:33.347 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_server": { 2023-10-19T12:59:33.347 INFO:teuthology.orchestra.run.smithi046.stdout: "dispatch_client_request": 0, 2023-10-19T12:59:33.347 INFO:teuthology.orchestra.run.smithi046.stdout: "dispatch_server_request": 0, 2023-10-19T12:59:33.347 INFO:teuthology.orchestra.run.smithi046.stdout: "handle_client_request": 0, 2023-10-19T12:59:33.348 INFO:teuthology.orchestra.run.smithi046.stdout: "handle_client_session": 0, 2023-10-19T12:59:33.348 INFO:teuthology.orchestra.run.smithi046.stdout: "handle_peer_request": 0, 2023-10-19T12:59:33.348 INFO:teuthology.orchestra.run.smithi046.stdout: "req_create_latency": { 2023-10-19T12:59:33.348 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2023-10-19T12:59:33.348 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2023-10-19T12:59:33.348 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2023-10-19T12:59:33.349 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:33.349 INFO:teuthology.orchestra.run.smithi046.stdout: "req_getattr_latency": { 2023-10-19T12:59:33.349 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2023-10-19T12:59:33.349 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2023-10-19T12:59:33.349 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2023-10-19T12:59:33.350 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:33.350 INFO:teuthology.orchestra.run.smithi046.stdout: "req_getfilelock_latency": { 2023-10-19T12:59:33.350 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2023-10-19T12:59:33.350 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2023-10-19T12:59:33.350 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2023-10-19T12:59:33.351 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:33.351 INFO:teuthology.orchestra.run.smithi046.stdout: "req_link_latency": { 2023-10-19T12:59:33.351 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2023-10-19T12:59:33.351 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2023-10-19T12:59:33.351 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2023-10-19T12:59:33.351 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:33.352 INFO:teuthology.orchestra.run.smithi046.stdout: "req_lookup_latency": { 2023-10-19T12:59:33.352 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2023-10-19T12:59:33.352 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2023-10-19T12:59:33.352 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2023-10-19T12:59:33.352 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:33.353 INFO:teuthology.orchestra.run.smithi046.stdout: "req_lookuphash_latency": { 2023-10-19T12:59:33.353 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2023-10-19T12:59:33.353 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2023-10-19T12:59:33.353 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2023-10-19T12:59:33.353 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:33.353 INFO:teuthology.orchestra.run.smithi046.stdout: "req_lookupino_latency": { 2023-10-19T12:59:33.354 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2023-10-19T12:59:33.354 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2023-10-19T12:59:33.354 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2023-10-19T12:59:33.354 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:33.354 INFO:teuthology.orchestra.run.smithi046.stdout: "req_lookupname_latency": { 2023-10-19T12:59:33.355 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2023-10-19T12:59:33.355 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2023-10-19T12:59:33.355 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2023-10-19T12:59:33.355 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:33.355 INFO:teuthology.orchestra.run.smithi046.stdout: "req_lookupparent_latency": { 2023-10-19T12:59:33.355 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2023-10-19T12:59:33.356 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2023-10-19T12:59:33.356 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2023-10-19T12:59:33.356 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:33.356 INFO:teuthology.orchestra.run.smithi046.stdout: "req_lookupsnap_latency": { 2023-10-19T12:59:33.356 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2023-10-19T12:59:33.357 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2023-10-19T12:59:33.357 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2023-10-19T12:59:33.357 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:33.357 INFO:teuthology.orchestra.run.smithi046.stdout: "req_lssnap_latency": { 2023-10-19T12:59:33.358 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2023-10-19T12:59:33.358 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2023-10-19T12:59:33.358 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2023-10-19T12:59:33.358 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:33.358 INFO:teuthology.orchestra.run.smithi046.stdout: "req_mkdir_latency": { 2023-10-19T12:59:33.359 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2023-10-19T12:59:33.359 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2023-10-19T12:59:33.359 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2023-10-19T12:59:33.359 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:33.359 INFO:teuthology.orchestra.run.smithi046.stdout: "req_mknod_latency": { 2023-10-19T12:59:33.360 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2023-10-19T12:59:33.360 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2023-10-19T12:59:33.360 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2023-10-19T12:59:33.360 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:33.360 INFO:teuthology.orchestra.run.smithi046.stdout: "req_mksnap_latency": { 2023-10-19T12:59:33.361 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2023-10-19T12:59:33.361 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2023-10-19T12:59:33.361 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2023-10-19T12:59:33.361 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:33.361 INFO:teuthology.orchestra.run.smithi046.stdout: "req_open_latency": { 2023-10-19T12:59:33.362 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2023-10-19T12:59:33.362 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2023-10-19T12:59:33.362 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2023-10-19T12:59:33.362 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:33.362 INFO:teuthology.orchestra.run.smithi046.stdout: "req_readdir_latency": { 2023-10-19T12:59:33.362 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2023-10-19T12:59:33.363 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2023-10-19T12:59:33.363 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2023-10-19T12:59:33.363 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:33.363 INFO:teuthology.orchestra.run.smithi046.stdout: "req_rename_latency": { 2023-10-19T12:59:33.363 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2023-10-19T12:59:33.363 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2023-10-19T12:59:33.364 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2023-10-19T12:59:33.364 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:33.364 INFO:teuthology.orchestra.run.smithi046.stdout: "req_renamesnap_latency": { 2023-10-19T12:59:33.364 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2023-10-19T12:59:33.364 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2023-10-19T12:59:33.364 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2023-10-19T12:59:33.365 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:33.365 INFO:teuthology.orchestra.run.smithi046.stdout: "req_snapdiff_latency": { 2023-10-19T12:59:33.365 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2023-10-19T12:59:33.365 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2023-10-19T12:59:33.365 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2023-10-19T12:59:33.365 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:33.366 INFO:teuthology.orchestra.run.smithi046.stdout: "req_rmdir_latency": { 2023-10-19T12:59:33.366 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2023-10-19T12:59:33.366 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2023-10-19T12:59:33.366 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2023-10-19T12:59:33.366 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:33.367 INFO:teuthology.orchestra.run.smithi046.stdout: "req_rmsnap_latency": { 2023-10-19T12:59:33.367 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2023-10-19T12:59:33.367 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2023-10-19T12:59:33.367 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2023-10-19T12:59:33.367 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:33.368 INFO:teuthology.orchestra.run.smithi046.stdout: "req_rmxattr_latency": { 2023-10-19T12:59:33.368 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2023-10-19T12:59:33.368 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2023-10-19T12:59:33.368 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2023-10-19T12:59:33.368 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:33.368 INFO:teuthology.orchestra.run.smithi046.stdout: "req_setattr_latency": { 2023-10-19T12:59:33.369 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2023-10-19T12:59:33.369 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2023-10-19T12:59:33.369 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2023-10-19T12:59:33.369 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:33.369 INFO:teuthology.orchestra.run.smithi046.stdout: "req_setdirlayout_latency": { 2023-10-19T12:59:33.369 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2023-10-19T12:59:33.370 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2023-10-19T12:59:33.370 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2023-10-19T12:59:33.370 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:33.370 INFO:teuthology.orchestra.run.smithi046.stdout: "req_setfilelock_latency": { 2023-10-19T12:59:33.370 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2023-10-19T12:59:33.370 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2023-10-19T12:59:33.371 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2023-10-19T12:59:33.371 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:33.371 INFO:teuthology.orchestra.run.smithi046.stdout: "req_setlayout_latency": { 2023-10-19T12:59:33.371 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2023-10-19T12:59:33.371 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2023-10-19T12:59:33.372 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2023-10-19T12:59:33.372 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:33.372 INFO:teuthology.orchestra.run.smithi046.stdout: "req_setxattr_latency": { 2023-10-19T12:59:33.372 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2023-10-19T12:59:33.372 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2023-10-19T12:59:33.372 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2023-10-19T12:59:33.373 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:33.373 INFO:teuthology.orchestra.run.smithi046.stdout: "req_symlink_latency": { 2023-10-19T12:59:33.373 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2023-10-19T12:59:33.373 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2023-10-19T12:59:33.373 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2023-10-19T12:59:33.374 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:33.374 INFO:teuthology.orchestra.run.smithi046.stdout: "req_unlink_latency": { 2023-10-19T12:59:33.374 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2023-10-19T12:59:33.374 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2023-10-19T12:59:33.375 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2023-10-19T12:59:33.375 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:33.375 INFO:teuthology.orchestra.run.smithi046.stdout: "cap_revoke_eviction": 0, 2023-10-19T12:59:33.375 INFO:teuthology.orchestra.run.smithi046.stdout: "cap_acquisition_throttle": 0, 2023-10-19T12:59:33.375 INFO:teuthology.orchestra.run.smithi046.stdout: "req_getvxattr_latency": { 2023-10-19T12:59:33.376 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2023-10-19T12:59:33.376 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2023-10-19T12:59:33.376 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2023-10-19T12:59:33.376 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:33.376 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:33.377 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_sessions": { 2023-10-19T12:59:33.377 INFO:teuthology.orchestra.run.smithi046.stdout: "session_count": 1, 2023-10-19T12:59:33.377 INFO:teuthology.orchestra.run.smithi046.stdout: "session_add": 1, 2023-10-19T12:59:33.377 INFO:teuthology.orchestra.run.smithi046.stdout: "session_remove": 0, 2023-10-19T12:59:33.377 INFO:teuthology.orchestra.run.smithi046.stdout: "sessions_open": 1, 2023-10-19T12:59:33.378 INFO:teuthology.orchestra.run.smithi046.stdout: "sessions_stale": 0, 2023-10-19T12:59:33.378 INFO:teuthology.orchestra.run.smithi046.stdout: "total_load": 0, 2023-10-19T12:59:33.378 INFO:teuthology.orchestra.run.smithi046.stdout: "average_load": 0, 2023-10-19T12:59:33.378 INFO:teuthology.orchestra.run.smithi046.stdout: "avg_session_uptime": 2661, 2023-10-19T12:59:33.378 INFO:teuthology.orchestra.run.smithi046.stdout: "mdthresh_evicted": 0 2023-10-19T12:59:33.379 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:33.379 INFO:teuthology.orchestra.run.smithi046.stdout: "mempool": { 2023-10-19T12:59:33.379 INFO:teuthology.orchestra.run.smithi046.stdout: "bloom_filter_bytes": 0, 2023-10-19T12:59:33.379 INFO:teuthology.orchestra.run.smithi046.stdout: "bloom_filter_items": 0, 2023-10-19T12:59:33.379 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_alloc_bytes": 0, 2023-10-19T12:59:33.380 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_alloc_items": 0, 2023-10-19T12:59:33.380 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_data_bytes": 0, 2023-10-19T12:59:33.380 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_data_items": 0, 2023-10-19T12:59:33.380 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-19T12:59:33.380 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_onode_items": 0, 2023-10-19T12:59:33.381 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-19T12:59:33.381 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_meta_items": 0, 2023-10-19T12:59:33.381 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_other_bytes": 0, 2023-10-19T12:59:33.381 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_other_items": 0, 2023-10-19T12:59:33.381 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-19T12:59:33.382 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_buffer_items": 0, 2023-10-19T12:59:33.382 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_extent_bytes": 0, 2023-10-19T12:59:33.382 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_extent_items": 0, 2023-10-19T12:59:33.382 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_blob_bytes": 0, 2023-10-19T12:59:33.382 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_blob_items": 0, 2023-10-19T12:59:33.383 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-19T12:59:33.383 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_shared_blob_items": 0, 2023-10-19T12:59:33.383 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-19T12:59:33.383 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_inline_bl_items": 0, 2023-10-19T12:59:33.383 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_fsck_bytes": 0, 2023-10-19T12:59:33.383 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_fsck_items": 0, 2023-10-19T12:59:33.384 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_txc_bytes": 0, 2023-10-19T12:59:33.385 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_txc_items": 0, 2023-10-19T12:59:33.385 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-19T12:59:33.385 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_writing_deferred_items": 0, 2023-10-19T12:59:33.386 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_writing_bytes": 0, 2023-10-19T12:59:33.386 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_writing_items": 0, 2023-10-19T12:59:33.386 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_bytes": 0, 2023-10-19T12:59:33.386 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_items": 0, 2023-10-19T12:59:33.386 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_file_reader_bytes": 0, 2023-10-19T12:59:33.387 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_file_reader_items": 0, 2023-10-19T12:59:33.387 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_file_writer_bytes": 0, 2023-10-19T12:59:33.387 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_file_writer_items": 0, 2023-10-19T12:59:33.387 INFO:teuthology.orchestra.run.smithi046.stdout: "buffer_anon_bytes": 206572, 2023-10-19T12:59:33.387 INFO:teuthology.orchestra.run.smithi046.stdout: "buffer_anon_items": 281, 2023-10-19T12:59:33.387 INFO:teuthology.orchestra.run.smithi046.stdout: "buffer_meta_bytes": 0, 2023-10-19T12:59:33.388 INFO:teuthology.orchestra.run.smithi046.stdout: "buffer_meta_items": 0, 2023-10-19T12:59:33.388 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_bytes": 0, 2023-10-19T12:59:33.388 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_items": 0, 2023-10-19T12:59:33.388 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_mapbl_bytes": 0, 2023-10-19T12:59:33.388 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_mapbl_items": 0, 2023-10-19T12:59:33.388 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pglog_bytes": 0, 2023-10-19T12:59:33.389 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pglog_items": 0, 2023-10-19T12:59:33.389 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_bytes": 9280, 2023-10-19T12:59:33.389 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_items": 179, 2023-10-19T12:59:33.389 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_mapping_bytes": 0, 2023-10-19T12:59:33.389 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_mapping_items": 0, 2023-10-19T12:59:33.390 INFO:teuthology.orchestra.run.smithi046.stdout: "pgmap_bytes": 0, 2023-10-19T12:59:33.390 INFO:teuthology.orchestra.run.smithi046.stdout: "pgmap_items": 0, 2023-10-19T12:59:33.390 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_co_bytes": 707071, 2023-10-19T12:59:33.390 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_co_items": 6487, 2023-10-19T12:59:33.390 INFO:teuthology.orchestra.run.smithi046.stdout: "unittest_1_bytes": 0, 2023-10-19T12:59:33.391 INFO:teuthology.orchestra.run.smithi046.stdout: "unittest_1_items": 0, 2023-10-19T12:59:33.391 INFO:teuthology.orchestra.run.smithi046.stdout: "unittest_2_bytes": 0, 2023-10-19T12:59:33.391 INFO:teuthology.orchestra.run.smithi046.stdout: "unittest_2_items": 0 2023-10-19T12:59:33.391 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:33.391 INFO:teuthology.orchestra.run.smithi046.stdout: "objecter": { 2023-10-19T12:59:33.392 INFO:teuthology.orchestra.run.smithi046.stdout: "op_active": 0, 2023-10-19T12:59:33.392 INFO:teuthology.orchestra.run.smithi046.stdout: "op_laggy": 0, 2023-10-19T12:59:33.392 INFO:teuthology.orchestra.run.smithi046.stdout: "op_send": 2981, 2023-10-19T12:59:33.392 INFO:teuthology.orchestra.run.smithi046.stdout: "op_send_bytes": 21, 2023-10-19T12:59:33.392 INFO:teuthology.orchestra.run.smithi046.stdout: "op_resend": 3, 2023-10-19T12:59:33.392 INFO:teuthology.orchestra.run.smithi046.stdout: "op_reply": 2981, 2023-10-19T12:59:33.393 INFO:teuthology.orchestra.run.smithi046.stdout: "op_latency": { 2023-10-19T12:59:33.393 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 2981, 2023-10-19T12:59:33.393 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 73.774273486, 2023-10-19T12:59:33.393 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.024748162 2023-10-19T12:59:33.393 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:33.393 INFO:teuthology.orchestra.run.smithi046.stdout: "op_inflight": 0, 2023-10-19T12:59:33.394 INFO:teuthology.orchestra.run.smithi046.stdout: "oplen_avg": { 2023-10-19T12:59:33.394 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 2981, 2023-10-19T12:59:33.394 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 2982 2023-10-19T12:59:33.394 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:33.394 INFO:teuthology.orchestra.run.smithi046.stdout: "op": 2981, 2023-10-19T12:59:33.395 INFO:teuthology.orchestra.run.smithi046.stdout: "op_r": 2981, 2023-10-19T12:59:33.395 INFO:teuthology.orchestra.run.smithi046.stdout: "op_w": 0, 2023-10-19T12:59:33.395 INFO:teuthology.orchestra.run.smithi046.stdout: "op_rmw": 0, 2023-10-19T12:59:33.395 INFO:teuthology.orchestra.run.smithi046.stdout: "op_pg": 0, 2023-10-19T12:59:33.395 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_stat": 1876, 2023-10-19T12:59:33.395 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_create": 0, 2023-10-19T12:59:33.396 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_read": 1103, 2023-10-19T12:59:33.396 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_write": 0, 2023-10-19T12:59:33.396 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_writefull": 0, 2023-10-19T12:59:33.396 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_writesame": 0, 2023-10-19T12:59:33.396 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_append": 0, 2023-10-19T12:59:33.397 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_zero": 0, 2023-10-19T12:59:33.397 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_truncate": 0, 2023-10-19T12:59:33.397 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_delete": 0, 2023-10-19T12:59:33.397 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_mapext": 0, 2023-10-19T12:59:33.397 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_sparse_read": 0, 2023-10-19T12:59:33.398 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_clonerange": 0, 2023-10-19T12:59:33.398 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_getxattr": 1, 2023-10-19T12:59:33.398 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_setxattr": 0, 2023-10-19T12:59:33.398 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_cmpxattr": 0, 2023-10-19T12:59:33.398 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_rmxattr": 0, 2023-10-19T12:59:33.399 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_resetxattrs": 0, 2023-10-19T12:59:33.399 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_call": 0, 2023-10-19T12:59:33.399 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_watch": 0, 2023-10-19T12:59:33.399 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_notify": 0, 2023-10-19T12:59:33.399 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_src_cmpxattr": 0, 2023-10-19T12:59:33.400 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_pgls": 0, 2023-10-19T12:59:33.400 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_pgls_filter": 0, 2023-10-19T12:59:33.400 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_other": 0, 2023-10-19T12:59:33.400 INFO:teuthology.orchestra.run.smithi046.stdout: "linger_active": 0, 2023-10-19T12:59:33.400 INFO:teuthology.orchestra.run.smithi046.stdout: "linger_send": 0, 2023-10-19T12:59:33.400 INFO:teuthology.orchestra.run.smithi046.stdout: "linger_resend": 0, 2023-10-19T12:59:33.401 INFO:teuthology.orchestra.run.smithi046.stdout: "linger_ping": 0, 2023-10-19T12:59:33.401 INFO:teuthology.orchestra.run.smithi046.stdout: "poolop_active": 0, 2023-10-19T12:59:33.401 INFO:teuthology.orchestra.run.smithi046.stdout: "poolop_send": 0, 2023-10-19T12:59:33.401 INFO:teuthology.orchestra.run.smithi046.stdout: "poolop_resend": 0, 2023-10-19T12:59:33.401 INFO:teuthology.orchestra.run.smithi046.stdout: "poolstat_active": 0, 2023-10-19T12:59:33.401 INFO:teuthology.orchestra.run.smithi046.stdout: "poolstat_send": 0, 2023-10-19T12:59:33.402 INFO:teuthology.orchestra.run.smithi046.stdout: "poolstat_resend": 0, 2023-10-19T12:59:33.402 INFO:teuthology.orchestra.run.smithi046.stdout: "statfs_active": 0, 2023-10-19T12:59:33.402 INFO:teuthology.orchestra.run.smithi046.stdout: "statfs_send": 0, 2023-10-19T12:59:33.402 INFO:teuthology.orchestra.run.smithi046.stdout: "statfs_resend": 0, 2023-10-19T12:59:33.402 INFO:teuthology.orchestra.run.smithi046.stdout: "command_active": 0, 2023-10-19T12:59:33.403 INFO:teuthology.orchestra.run.smithi046.stdout: "command_send": 0, 2023-10-19T12:59:33.403 INFO:teuthology.orchestra.run.smithi046.stdout: "command_resend": 0, 2023-10-19T12:59:33.403 INFO:teuthology.orchestra.run.smithi046.stdout: "map_epoch": 92, 2023-10-19T12:59:33.403 INFO:teuthology.orchestra.run.smithi046.stdout: "map_full": 0, 2023-10-19T12:59:33.403 INFO:teuthology.orchestra.run.smithi046.stdout: "map_inc": 4, 2023-10-19T12:59:33.404 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_sessions": 6, 2023-10-19T12:59:33.404 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_session_open": 8, 2023-10-19T12:59:33.404 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_session_close": 2, 2023-10-19T12:59:33.404 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_laggy": 0, 2023-10-19T12:59:33.404 INFO:teuthology.orchestra.run.smithi046.stdout: "omap_wr": 0, 2023-10-19T12:59:33.404 INFO:teuthology.orchestra.run.smithi046.stdout: "omap_rd": 2, 2023-10-19T12:59:33.405 INFO:teuthology.orchestra.run.smithi046.stdout: "omap_del": 0 2023-10-19T12:59:33.405 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:33.405 INFO:teuthology.orchestra.run.smithi046.stdout: "oft": { 2023-10-19T12:59:33.405 INFO:teuthology.orchestra.run.smithi046.stdout: "omap_total_objs": 0, 2023-10-19T12:59:33.405 INFO:teuthology.orchestra.run.smithi046.stdout: "omap_total_kv_pairs": 0, 2023-10-19T12:59:33.405 INFO:teuthology.orchestra.run.smithi046.stdout: "omap_total_updates": 0, 2023-10-19T12:59:33.406 INFO:teuthology.orchestra.run.smithi046.stdout: "omap_total_removes": 0 2023-10-19T12:59:33.406 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:33.406 INFO:teuthology.orchestra.run.smithi046.stdout: "osd-slow-ops": { 2023-10-19T12:59:33.406 INFO:teuthology.orchestra.run.smithi046.stdout: "slow_ops_count": 0 2023-10-19T12:59:33.406 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:33.407 INFO:teuthology.orchestra.run.smithi046.stdout: "purge_queue": { 2023-10-19T12:59:33.407 INFO:teuthology.orchestra.run.smithi046.stdout: "pq_executing_ops": 0, 2023-10-19T12:59:33.407 INFO:teuthology.orchestra.run.smithi046.stdout: "pq_executing_ops_high_water": 0, 2023-10-19T12:59:33.407 INFO:teuthology.orchestra.run.smithi046.stdout: "pq_executing": 0, 2023-10-19T12:59:33.407 INFO:teuthology.orchestra.run.smithi046.stdout: "pq_executing_high_water": 0, 2023-10-19T12:59:33.408 INFO:teuthology.orchestra.run.smithi046.stdout: "pq_executed": 0, 2023-10-19T12:59:33.408 INFO:teuthology.orchestra.run.smithi046.stdout: "pq_item_in_journal": 0 2023-10-19T12:59:33.408 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:33.408 INFO:teuthology.orchestra.run.smithi046.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-19T12:59:33.408 INFO:teuthology.orchestra.run.smithi046.stdout: "val": 0, 2023-10-19T12:59:33.409 INFO:teuthology.orchestra.run.smithi046.stdout: "max": 104857600, 2023-10-19T12:59:33.409 INFO:teuthology.orchestra.run.smithi046.stdout: "get_started": 0, 2023-10-19T12:59:33.409 INFO:teuthology.orchestra.run.smithi046.stdout: "get": 3317, 2023-10-19T12:59:33.409 INFO:teuthology.orchestra.run.smithi046.stdout: "get_sum": 2224470, 2023-10-19T12:59:33.409 INFO:teuthology.orchestra.run.smithi046.stdout: "get_or_fail_fail": 0, 2023-10-19T12:59:33.410 INFO:teuthology.orchestra.run.smithi046.stdout: "get_or_fail_success": 3317, 2023-10-19T12:59:33.410 INFO:teuthology.orchestra.run.smithi046.stdout: "take": 0, 2023-10-19T12:59:33.410 INFO:teuthology.orchestra.run.smithi046.stdout: "take_sum": 0, 2023-10-19T12:59:33.410 INFO:teuthology.orchestra.run.smithi046.stdout: "put": 3317, 2023-10-19T12:59:33.410 INFO:teuthology.orchestra.run.smithi046.stdout: "put_sum": 2224470, 2023-10-19T12:59:33.411 INFO:teuthology.orchestra.run.smithi046.stdout: "wait": { 2023-10-19T12:59:33.411 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2023-10-19T12:59:33.411 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2023-10-19T12:59:33.411 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2023-10-19T12:59:33.411 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:33.412 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:33.412 INFO:teuthology.orchestra.run.smithi046.stdout: "throttle-objecter_bytes": { 2023-10-19T12:59:33.412 INFO:teuthology.orchestra.run.smithi046.stdout: "val": 0, 2023-10-19T12:59:33.412 INFO:teuthology.orchestra.run.smithi046.stdout: "max": 104857600, 2023-10-19T12:59:33.412 INFO:teuthology.orchestra.run.smithi046.stdout: "get_started": 0, 2023-10-19T12:59:33.412 INFO:teuthology.orchestra.run.smithi046.stdout: "get": 0, 2023-10-19T12:59:33.413 INFO:teuthology.orchestra.run.smithi046.stdout: "get_sum": 0, 2023-10-19T12:59:33.413 INFO:teuthology.orchestra.run.smithi046.stdout: "get_or_fail_fail": 0, 2023-10-19T12:59:33.413 INFO:teuthology.orchestra.run.smithi046.stdout: "get_or_fail_success": 0, 2023-10-19T12:59:33.413 INFO:teuthology.orchestra.run.smithi046.stdout: "take": 2981, 2023-10-19T12:59:33.413 INFO:teuthology.orchestra.run.smithi046.stdout: "take_sum": 1013649, 2023-10-19T12:59:33.414 INFO:teuthology.orchestra.run.smithi046.stdout: "put": 2981, 2023-10-19T12:59:33.414 INFO:teuthology.orchestra.run.smithi046.stdout: "put_sum": 1013649, 2023-10-19T12:59:33.414 INFO:teuthology.orchestra.run.smithi046.stdout: "wait": { 2023-10-19T12:59:33.414 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2023-10-19T12:59:33.414 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2023-10-19T12:59:33.415 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2023-10-19T12:59:33.415 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:33.415 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:33.415 INFO:teuthology.orchestra.run.smithi046.stdout: "throttle-objecter_ops": { 2023-10-19T12:59:33.415 INFO:teuthology.orchestra.run.smithi046.stdout: "val": 0, 2023-10-19T12:59:33.416 INFO:teuthology.orchestra.run.smithi046.stdout: "max": 1024, 2023-10-19T12:59:33.416 INFO:teuthology.orchestra.run.smithi046.stdout: "get_started": 0, 2023-10-19T12:59:33.416 INFO:teuthology.orchestra.run.smithi046.stdout: "get": 0, 2023-10-19T12:59:33.416 INFO:teuthology.orchestra.run.smithi046.stdout: "get_sum": 0, 2023-10-19T12:59:33.416 INFO:teuthology.orchestra.run.smithi046.stdout: "get_or_fail_fail": 0, 2023-10-19T12:59:33.417 INFO:teuthology.orchestra.run.smithi046.stdout: "get_or_fail_success": 0, 2023-10-19T12:59:33.417 INFO:teuthology.orchestra.run.smithi046.stdout: "take": 2981, 2023-10-19T12:59:33.417 INFO:teuthology.orchestra.run.smithi046.stdout: "take_sum": 2981, 2023-10-19T12:59:33.417 INFO:teuthology.orchestra.run.smithi046.stdout: "put": 2981, 2023-10-19T12:59:33.417 INFO:teuthology.orchestra.run.smithi046.stdout: "put_sum": 2981, 2023-10-19T12:59:33.418 INFO:teuthology.orchestra.run.smithi046.stdout: "wait": { 2023-10-19T12:59:33.418 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2023-10-19T12:59:33.418 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2023-10-19T12:59:33.418 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2023-10-19T12:59:33.418 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:33.419 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:33.419 INFO:teuthology.orchestra.run.smithi046.stdout: "throttle-write_buf_throttle": { 2023-10-19T12:59:33.419 INFO:teuthology.orchestra.run.smithi046.stdout: "val": 0, 2023-10-19T12:59:33.419 INFO:teuthology.orchestra.run.smithi046.stdout: "max": 3758096384, 2023-10-19T12:59:33.419 INFO:teuthology.orchestra.run.smithi046.stdout: "get_started": 0, 2023-10-19T12:59:33.420 INFO:teuthology.orchestra.run.smithi046.stdout: "get": 0, 2023-10-19T12:59:33.420 INFO:teuthology.orchestra.run.smithi046.stdout: "get_sum": 0, 2023-10-19T12:59:33.420 INFO:teuthology.orchestra.run.smithi046.stdout: "get_or_fail_fail": 0, 2023-10-19T12:59:33.420 INFO:teuthology.orchestra.run.smithi046.stdout: "get_or_fail_success": 0, 2023-10-19T12:59:33.420 INFO:teuthology.orchestra.run.smithi046.stdout: "take": 0, 2023-10-19T12:59:33.420 INFO:teuthology.orchestra.run.smithi046.stdout: "take_sum": 0, 2023-10-19T12:59:33.421 INFO:teuthology.orchestra.run.smithi046.stdout: "put": 0, 2023-10-19T12:59:33.421 INFO:teuthology.orchestra.run.smithi046.stdout: "put_sum": 0, 2023-10-19T12:59:33.421 INFO:teuthology.orchestra.run.smithi046.stdout: "wait": { 2023-10-19T12:59:33.421 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2023-10-19T12:59:33.421 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2023-10-19T12:59:33.422 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2023-10-19T12:59:33.422 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:33.422 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:33.422 INFO:teuthology.orchestra.run.smithi046.stdout: "throttle-write_buf_throttle-0x55b9c2e34a00": { 2023-10-19T12:59:33.422 INFO:teuthology.orchestra.run.smithi046.stdout: "val": 0, 2023-10-19T12:59:33.423 INFO:teuthology.orchestra.run.smithi046.stdout: "max": 3758096384, 2023-10-19T12:59:33.423 INFO:teuthology.orchestra.run.smithi046.stdout: "get_started": 0, 2023-10-19T12:59:33.423 INFO:teuthology.orchestra.run.smithi046.stdout: "get": 0, 2023-10-19T12:59:33.423 INFO:teuthology.orchestra.run.smithi046.stdout: "get_sum": 0, 2023-10-19T12:59:33.423 INFO:teuthology.orchestra.run.smithi046.stdout: "get_or_fail_fail": 0, 2023-10-19T12:59:33.424 INFO:teuthology.orchestra.run.smithi046.stdout: "get_or_fail_success": 0, 2023-10-19T12:59:33.424 INFO:teuthology.orchestra.run.smithi046.stdout: "take": 0, 2023-10-19T12:59:33.424 INFO:teuthology.orchestra.run.smithi046.stdout: "take_sum": 0, 2023-10-19T12:59:33.424 INFO:teuthology.orchestra.run.smithi046.stdout: "put": 0, 2023-10-19T12:59:33.424 INFO:teuthology.orchestra.run.smithi046.stdout: "put_sum": 0, 2023-10-19T12:59:33.424 INFO:teuthology.orchestra.run.smithi046.stdout: "wait": { 2023-10-19T12:59:33.425 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2023-10-19T12:59:33.425 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2023-10-19T12:59:33.425 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2023-10-19T12:59:33.425 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:33.425 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:33.426 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-10-19T12:59:33.806 INFO:tasks.check_counter:Daemon mds.g mds.exported=0 2023-10-19T12:59:33.807 INFO:tasks.check_counter:Daemon mds.g mds.imported=0 2023-10-19T12:59:33.808 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update=0 2023-10-19T12:59:33.808 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update_receipt=0 2023-10-19T12:59:33.808 DEBUG:tasks.check_counter:Getting stats from j 2023-10-19T12:59:33.808 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph daemon mds.j perf dump 2023-10-19T12:59:34.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:59:34 smithi046 ceph-mon[98509]: pgmap v835: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 13 KiB/s wr, 19 op/s 2023-10-19T12:59:34.562 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-19T12:59:34.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:59:34 smithi157 ceph-mon[134109]: pgmap v835: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 13 KiB/s wr, 19 op/s 2023-10-19T12:59:34.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:59:34 smithi195 ceph-mon[134493]: pgmap v835: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 13 KiB/s wr, 19 op/s 2023-10-19T12:59:36.170 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2023-10-19T12:59:36.171 INFO:teuthology.orchestra.run.smithi046.stdout: "AsyncMessenger::Worker-0": { 2023-10-19T12:59:36.171 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_messages": 4, 2023-10-19T12:59:36.171 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_messages": 4, 2023-10-19T12:59:36.171 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_bytes": 2992, 2023-10-19T12:59:36.171 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_bytes": 448, 2023-10-19T12:59:36.172 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_created_connections": 4, 2023-10-19T12:59:36.172 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_active_connections": 0, 2023-10-19T12:59:36.172 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_total_time": 0.004198814, 2023-10-19T12:59:36.172 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_send_time": 0.000091319, 2023-10-19T12:59:36.172 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_recv_time": 0.001236807, 2023-10-19T12:59:36.172 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-10-19T12:59:36.173 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_messages_queue_lat": { 2023-10-19T12:59:36.173 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 3, 2023-10-19T12:59:36.173 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.001198628, 2023-10-19T12:59:36.173 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000399542 2023-10-19T12:59:36.173 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:36.173 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_handle_ack_lat": { 2023-10-19T12:59:36.174 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2023-10-19T12:59:36.174 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2023-10-19T12:59:36.174 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2023-10-19T12:59:36.174 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:36.174 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_encrypted_bytes": 2992, 2023-10-19T12:59:36.175 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_encrypted_bytes": 448 2023-10-19T12:59:36.175 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:36.175 INFO:teuthology.orchestra.run.smithi046.stdout: "AsyncMessenger::Worker-1": { 2023-10-19T12:59:36.175 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_messages": 304, 2023-10-19T12:59:36.175 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_messages": 301, 2023-10-19T12:59:36.175 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_bytes": 497248, 2023-10-19T12:59:36.176 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_bytes": 180992, 2023-10-19T12:59:36.176 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_created_connections": 2, 2023-10-19T12:59:36.176 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_active_connections": 1, 2023-10-19T12:59:36.176 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_total_time": 0.087501401, 2023-10-19T12:59:36.176 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_send_time": 0.047150301, 2023-10-19T12:59:36.176 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_recv_time": 0.024414091, 2023-10-19T12:59:36.177 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_fast_dispatch_time": 0.009337479, 2023-10-19T12:59:36.177 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_messages_queue_lat": { 2023-10-19T12:59:36.177 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 300, 2023-10-19T12:59:36.177 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.061031691, 2023-10-19T12:59:36.177 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000203438 2023-10-19T12:59:36.177 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:36.178 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_handle_ack_lat": { 2023-10-19T12:59:36.178 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2023-10-19T12:59:36.178 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2023-10-19T12:59:36.178 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2023-10-19T12:59:36.178 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:36.179 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_encrypted_bytes": 497248, 2023-10-19T12:59:36.179 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_encrypted_bytes": 180992 2023-10-19T12:59:36.179 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:36.179 INFO:teuthology.orchestra.run.smithi046.stdout: "AsyncMessenger::Worker-2": { 2023-10-19T12:59:36.179 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_messages": 2, 2023-10-19T12:59:36.179 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_messages": 230, 2023-10-19T12:59:36.180 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_bytes": 320, 2023-10-19T12:59:36.180 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_bytes": 193888, 2023-10-19T12:59:36.180 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_created_connections": 4, 2023-10-19T12:59:36.180 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_active_connections": 2, 2023-10-19T12:59:36.180 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_total_time": 0.030718374, 2023-10-19T12:59:36.181 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_send_time": 0.024100046, 2023-10-19T12:59:36.181 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_recv_time": 0.002782845, 2023-10-19T12:59:36.181 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-10-19T12:59:36.181 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_messages_queue_lat": { 2023-10-19T12:59:36.181 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 228, 2023-10-19T12:59:36.182 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.042750554, 2023-10-19T12:59:36.182 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000187502 2023-10-19T12:59:36.182 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:36.182 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_handle_ack_lat": { 2023-10-19T12:59:36.182 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2023-10-19T12:59:36.182 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2023-10-19T12:59:36.183 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2023-10-19T12:59:36.183 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:36.183 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_encrypted_bytes": 320, 2023-10-19T12:59:36.183 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_encrypted_bytes": 193888 2023-10-19T12:59:36.183 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:36.184 INFO:teuthology.orchestra.run.smithi046.stdout: "cct": { 2023-10-19T12:59:36.184 INFO:teuthology.orchestra.run.smithi046.stdout: "total_workers": 0, 2023-10-19T12:59:36.184 INFO:teuthology.orchestra.run.smithi046.stdout: "unhealthy_workers": 0 2023-10-19T12:59:36.184 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:36.184 INFO:teuthology.orchestra.run.smithi046.stdout: "mempool": { 2023-10-19T12:59:36.185 INFO:teuthology.orchestra.run.smithi046.stdout: "bloom_filter_bytes": 0, 2023-10-19T12:59:36.185 INFO:teuthology.orchestra.run.smithi046.stdout: "bloom_filter_items": 0, 2023-10-19T12:59:36.185 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_alloc_bytes": 0, 2023-10-19T12:59:36.185 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_alloc_items": 0, 2023-10-19T12:59:36.186 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_data_bytes": 0, 2023-10-19T12:59:36.186 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_data_items": 0, 2023-10-19T12:59:36.186 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-19T12:59:36.186 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_onode_items": 0, 2023-10-19T12:59:36.186 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-19T12:59:36.187 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_meta_items": 0, 2023-10-19T12:59:36.187 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_other_bytes": 0, 2023-10-19T12:59:36.187 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_other_items": 0, 2023-10-19T12:59:36.187 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-19T12:59:36.187 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_buffer_items": 0, 2023-10-19T12:59:36.187 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_extent_bytes": 0, 2023-10-19T12:59:36.188 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_extent_items": 0, 2023-10-19T12:59:36.188 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_blob_bytes": 0, 2023-10-19T12:59:36.188 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_blob_items": 0, 2023-10-19T12:59:36.188 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-19T12:59:36.188 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_shared_blob_items": 0, 2023-10-19T12:59:36.189 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-19T12:59:36.189 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_inline_bl_items": 0, 2023-10-19T12:59:36.189 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_fsck_bytes": 0, 2023-10-19T12:59:36.189 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_fsck_items": 0, 2023-10-19T12:59:36.189 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_txc_bytes": 0, 2023-10-19T12:59:36.189 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_txc_items": 0, 2023-10-19T12:59:36.190 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-19T12:59:36.190 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_writing_deferred_items": 0, 2023-10-19T12:59:36.190 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_writing_bytes": 0, 2023-10-19T12:59:36.190 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_writing_items": 0, 2023-10-19T12:59:36.190 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_bytes": 0, 2023-10-19T12:59:36.191 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_items": 0, 2023-10-19T12:59:36.191 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_file_reader_bytes": 0, 2023-10-19T12:59:36.191 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_file_reader_items": 0, 2023-10-19T12:59:36.191 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_file_writer_bytes": 0, 2023-10-19T12:59:36.191 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_file_writer_items": 0, 2023-10-19T12:59:36.191 INFO:teuthology.orchestra.run.smithi046.stdout: "buffer_anon_bytes": 149752, 2023-10-19T12:59:36.192 INFO:teuthology.orchestra.run.smithi046.stdout: "buffer_anon_items": 31, 2023-10-19T12:59:36.192 INFO:teuthology.orchestra.run.smithi046.stdout: "buffer_meta_bytes": 0, 2023-10-19T12:59:36.192 INFO:teuthology.orchestra.run.smithi046.stdout: "buffer_meta_items": 0, 2023-10-19T12:59:36.192 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_bytes": 0, 2023-10-19T12:59:36.192 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_items": 0, 2023-10-19T12:59:36.193 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_mapbl_bytes": 0, 2023-10-19T12:59:36.193 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_mapbl_items": 0, 2023-10-19T12:59:36.193 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pglog_bytes": 0, 2023-10-19T12:59:36.193 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pglog_items": 0, 2023-10-19T12:59:36.193 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_bytes": 0, 2023-10-19T12:59:36.194 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_items": 0, 2023-10-19T12:59:36.194 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_mapping_bytes": 0, 2023-10-19T12:59:36.194 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_mapping_items": 0, 2023-10-19T12:59:36.194 INFO:teuthology.orchestra.run.smithi046.stdout: "pgmap_bytes": 0, 2023-10-19T12:59:36.194 INFO:teuthology.orchestra.run.smithi046.stdout: "pgmap_items": 0, 2023-10-19T12:59:36.194 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_co_bytes": 928, 2023-10-19T12:59:36.195 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_co_items": 2, 2023-10-19T12:59:36.195 INFO:teuthology.orchestra.run.smithi046.stdout: "unittest_1_bytes": 0, 2023-10-19T12:59:36.195 INFO:teuthology.orchestra.run.smithi046.stdout: "unittest_1_items": 0, 2023-10-19T12:59:36.195 INFO:teuthology.orchestra.run.smithi046.stdout: "unittest_2_bytes": 0, 2023-10-19T12:59:36.195 INFO:teuthology.orchestra.run.smithi046.stdout: "unittest_2_items": 0 2023-10-19T12:59:36.196 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2023-10-19T12:59:36.196 INFO:teuthology.orchestra.run.smithi046.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-19T12:59:36.196 INFO:teuthology.orchestra.run.smithi046.stdout: "val": 0, 2023-10-19T12:59:36.196 INFO:teuthology.orchestra.run.smithi046.stdout: "max": 104857600, 2023-10-19T12:59:36.196 INFO:teuthology.orchestra.run.smithi046.stdout: "get_started": 0, 2023-10-19T12:59:36.196 INFO:teuthology.orchestra.run.smithi046.stdout: "get": 306, 2023-10-19T12:59:36.197 INFO:teuthology.orchestra.run.smithi046.stdout: "get_sum": 454270, 2023-10-19T12:59:36.197 INFO:teuthology.orchestra.run.smithi046.stdout: "get_or_fail_fail": 0, 2023-10-19T12:59:36.197 INFO:teuthology.orchestra.run.smithi046.stdout: "get_or_fail_success": 306, 2023-10-19T12:59:36.197 INFO:teuthology.orchestra.run.smithi046.stdout: "take": 0, 2023-10-19T12:59:36.197 INFO:teuthology.orchestra.run.smithi046.stdout: "take_sum": 0, 2023-10-19T12:59:36.197 INFO:teuthology.orchestra.run.smithi046.stdout: "put": 306, 2023-10-19T12:59:36.198 INFO:teuthology.orchestra.run.smithi046.stdout: "put_sum": 454270, 2023-10-19T12:59:36.198 INFO:teuthology.orchestra.run.smithi046.stdout: "wait": { 2023-10-19T12:59:36.198 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2023-10-19T12:59:36.198 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2023-10-19T12:59:36.198 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2023-10-19T12:59:36.199 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:36.199 INFO:teuthology.orchestra.run.smithi046.stdout: } 2023-10-19T12:59:36.199 INFO:teuthology.orchestra.run.smithi046.stdout:} 2023-10-19T12:59:36.440 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:59:36 smithi046 ceph-mon[98509]: pgmap v836: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 KiB/s wr, 17 op/s 2023-10-19T12:59:36.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:59:36 smithi157 ceph-mon[134109]: pgmap v836: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 KiB/s wr, 17 op/s 2023-10-19T12:59:36.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:59:36 smithi195 ceph-mon[134493]: pgmap v836: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 KiB/s wr, 17 op/s 2023-10-19T12:59:36.767 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2023-10-19T12:59:36.767 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2023-10-19T12:59:36.768 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2023-10-19T12:59:36.768 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2023-10-19T12:59:36.768 DEBUG:tasks.check_counter:Getting stats from b 2023-10-19T12:59:36.769 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph daemon mds.b perf dump 2023-10-19T12:59:37.194 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:59:37 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:59:37.475 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.b/config 2023-10-19T12:59:37.478 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:59:37 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:59:37.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:59:37 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-19T12:59:38.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:59:38 smithi157 ceph-mon[134109]: pgmap v837: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 10 KiB/s wr, 17 op/s 2023-10-19T12:59:38.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:59:38 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:59:38.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:59:38 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:59:38.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:59:38 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:59:38.478 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:59:38 smithi046 ceph-mon[98509]: pgmap v837: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 10 KiB/s wr, 17 op/s 2023-10-19T12:59:38.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:59:38 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:59:38.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:59:38 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:59:38.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:59:38 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:59:38.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:59:38 smithi195 ceph-mon[134493]: pgmap v837: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 10 KiB/s wr, 17 op/s 2023-10-19T12:59:38.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:59:38 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-19T12:59:38.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:59:38 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-19T12:59:38.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:59:38 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' 2023-10-19T12:59:40.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:59:39 smithi046 ceph-mon[98509]: pgmap v838: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.7 KiB/s wr, 16 op/s 2023-10-19T12:59:40.263 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2023-10-19T12:59:40.264 INFO:teuthology.orchestra.run.smithi157.stdout: "AsyncMessenger::Worker-0": { 2023-10-19T12:59:40.264 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_messages": 3926, 2023-10-19T12:59:40.264 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_messages": 4735, 2023-10-19T12:59:40.264 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_bytes": 1206925, 2023-10-19T12:59:40.265 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_bytes": 10026399, 2023-10-19T12:59:40.265 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_created_connections": 15, 2023-10-19T12:59:40.265 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_active_connections": 6, 2023-10-19T12:59:40.265 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_total_time": 0.275720203, 2023-10-19T12:59:40.265 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_send_time": 0.097757922, 2023-10-19T12:59:40.266 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_recv_time": 0.110811932, 2023-10-19T12:59:40.266 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_fast_dispatch_time": 0.062882412, 2023-10-19T12:59:40.266 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_messages_queue_lat": { 2023-10-19T12:59:40.266 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 4728, 2023-10-19T12:59:40.267 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 1.423040886, 2023-10-19T12:59:40.267 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000300981 2023-10-19T12:59:40.267 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:40.267 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_handle_ack_lat": { 2023-10-19T12:59:40.267 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 4588, 2023-10-19T12:59:40.268 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000908057, 2023-10-19T12:59:40.268 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000197 2023-10-19T12:59:40.268 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:40.268 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-19T12:59:40.268 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_encrypted_bytes": 0 2023-10-19T12:59:40.269 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:40.269 INFO:teuthology.orchestra.run.smithi157.stdout: "AsyncMessenger::Worker-1": { 2023-10-19T12:59:40.269 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_messages": 5201470, 2023-10-19T12:59:40.269 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_messages": 5203499, 2023-10-19T12:59:40.269 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_bytes": 822940601, 2023-10-19T12:59:40.270 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_bytes": 845229093, 2023-10-19T12:59:40.270 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_created_connections": 9, 2023-10-19T12:59:40.270 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_active_connections": 5, 2023-10-19T12:59:40.270 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_total_time": 200.625552107, 2023-10-19T12:59:40.271 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_send_time": 88.042552683, 2023-10-19T12:59:40.271 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_recv_time": 139.958292874, 2023-10-19T12:59:40.271 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_fast_dispatch_time": 0.100613311, 2023-10-19T12:59:40.272 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_messages_queue_lat": { 2023-10-19T12:59:40.272 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 5203503, 2023-10-19T12:59:40.272 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 94.770025324, 2023-10-19T12:59:40.273 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000018212 2023-10-19T12:59:40.273 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:40.273 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_handle_ack_lat": { 2023-10-19T12:59:40.274 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 10329851, 2023-10-19T12:59:40.274 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 1.141412887, 2023-10-19T12:59:40.275 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000110 2023-10-19T12:59:40.275 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:40.275 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_encrypted_bytes": 3152, 2023-10-19T12:59:40.275 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_encrypted_bytes": 486544 2023-10-19T12:59:40.276 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:40.276 INFO:teuthology.orchestra.run.smithi157.stdout: "AsyncMessenger::Worker-2": { 2023-10-19T12:59:40.276 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_messages": 7655, 2023-10-19T12:59:40.276 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_messages": 10362, 2023-10-19T12:59:40.277 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_bytes": 3196248, 2023-10-19T12:59:40.277 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_bytes": 5869037, 2023-10-19T12:59:40.277 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_created_connections": 84, 2023-10-19T12:59:40.277 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_active_connections": 9, 2023-10-19T12:59:40.277 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_total_time": 0.561903835, 2023-10-19T12:59:40.278 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_send_time": 0.190169970, 2023-10-19T12:59:40.278 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_recv_time": 0.308337108, 2023-10-19T12:59:40.278 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_fast_dispatch_time": 0.107780059, 2023-10-19T12:59:40.278 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_messages_queue_lat": { 2023-10-19T12:59:40.278 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 10361, 2023-10-19T12:59:40.279 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 1.306454237, 2023-10-19T12:59:40.279 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000126093 2023-10-19T12:59:40.279 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:40.279 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_handle_ack_lat": { 2023-10-19T12:59:40.279 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 10691, 2023-10-19T12:59:40.280 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.002553262, 2023-10-19T12:59:40.280 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000238 2023-10-19T12:59:40.280 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:40.280 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_encrypted_bytes": 773584, 2023-10-19T12:59:40.280 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_encrypted_bytes": 218608 2023-10-19T12:59:40.281 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:40.281 INFO:teuthology.orchestra.run.smithi157.stdout: "cct": { 2023-10-19T12:59:40.281 INFO:teuthology.orchestra.run.smithi157.stdout: "total_workers": 1, 2023-10-19T12:59:40.281 INFO:teuthology.orchestra.run.smithi157.stdout: "unhealthy_workers": 0 2023-10-19T12:59:40.281 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:40.282 INFO:teuthology.orchestra.run.smithi157.stdout: "finisher-MDSRank": { 2023-10-19T12:59:40.282 INFO:teuthology.orchestra.run.smithi157.stdout: "queue_len": 0, 2023-10-19T12:59:40.282 INFO:teuthology.orchestra.run.smithi157.stdout: "complete_latency": { 2023-10-19T12:59:40.282 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 2028, 2023-10-19T12:59:40.282 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 1.803771971, 2023-10-19T12:59:40.283 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000889433 2023-10-19T12:59:40.283 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-10-19T12:59:40.283 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:40.283 INFO:teuthology.orchestra.run.smithi157.stdout: "finisher-PurgeQueue": { 2023-10-19T12:59:40.283 INFO:teuthology.orchestra.run.smithi157.stdout: "queue_len": 0, 2023-10-19T12:59:40.283 INFO:teuthology.orchestra.run.smithi157.stdout: "complete_latency": { 2023-10-19T12:59:40.284 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 158, 2023-10-19T12:59:40.284 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.008626869, 2023-10-19T12:59:40.284 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000054600 2023-10-19T12:59:40.284 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-10-19T12:59:40.284 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:40.285 INFO:teuthology.orchestra.run.smithi157.stdout: "mds": { 2023-10-19T12:59:40.285 INFO:teuthology.orchestra.run.smithi157.stdout: "request": 2244, 2023-10-19T12:59:40.285 INFO:teuthology.orchestra.run.smithi157.stdout: "reply": 2015, 2023-10-19T12:59:40.285 INFO:teuthology.orchestra.run.smithi157.stdout: "reply_latency": { 2023-10-19T12:59:40.285 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 2015, 2023-10-19T12:59:40.286 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 8.241377941, 2023-10-19T12:59:40.286 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.004090013 2023-10-19T12:59:40.286 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:40.286 INFO:teuthology.orchestra.run.smithi157.stdout: "slow_reply": 0, 2023-10-19T12:59:40.286 INFO:teuthology.orchestra.run.smithi157.stdout: "forward": 229, 2023-10-19T12:59:40.287 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_fetch_complete": 0, 2023-10-19T12:59:40.287 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_fetch_keys": 0, 2023-10-19T12:59:40.287 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_commit": 39, 2023-10-19T12:59:40.287 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_split": 3, 2023-10-19T12:59:40.287 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_merge": 0, 2023-10-19T12:59:40.288 INFO:teuthology.orchestra.run.smithi157.stdout: "inodes": 586, 2023-10-19T12:59:40.288 INFO:teuthology.orchestra.run.smithi157.stdout: "inodes_top": 0, 2023-10-19T12:59:40.288 INFO:teuthology.orchestra.run.smithi157.stdout: "inodes_bottom": 556, 2023-10-19T12:59:40.288 INFO:teuthology.orchestra.run.smithi157.stdout: "inodes_pin_tail": 30, 2023-10-19T12:59:40.288 INFO:teuthology.orchestra.run.smithi157.stdout: "inodes_pinned": 584, 2023-10-19T12:59:40.288 INFO:teuthology.orchestra.run.smithi157.stdout: "inodes_expired": 911, 2023-10-19T12:59:40.289 INFO:teuthology.orchestra.run.smithi157.stdout: "inodes_with_caps": 541, 2023-10-19T12:59:40.289 INFO:teuthology.orchestra.run.smithi157.stdout: "caps": 541, 2023-10-19T12:59:40.289 INFO:teuthology.orchestra.run.smithi157.stdout: "subtrees": 19, 2023-10-19T12:59:40.290 INFO:teuthology.orchestra.run.smithi157.stdout: "traverse": 2704, 2023-10-19T12:59:40.290 INFO:teuthology.orchestra.run.smithi157.stdout: "traverse_hit": 1926, 2023-10-19T12:59:40.290 INFO:teuthology.orchestra.run.smithi157.stdout: "traverse_forward": 219, 2023-10-19T12:59:40.291 INFO:teuthology.orchestra.run.smithi157.stdout: "traverse_discover": 1, 2023-10-19T12:59:40.291 INFO:teuthology.orchestra.run.smithi157.stdout: "traverse_dir_fetch": 0, 2023-10-19T12:59:40.291 INFO:teuthology.orchestra.run.smithi157.stdout: "traverse_remote_ino": 0, 2023-10-19T12:59:40.292 INFO:teuthology.orchestra.run.smithi157.stdout: "traverse_lock": 1, 2023-10-19T12:59:40.292 INFO:teuthology.orchestra.run.smithi157.stdout: "load_cent": 7978, 2023-10-19T12:59:40.292 INFO:teuthology.orchestra.run.smithi157.stdout: "q": 4, 2023-10-19T12:59:40.293 INFO:teuthology.orchestra.run.smithi157.stdout: "exported": 33, 2023-10-19T12:59:40.293 INFO:teuthology.orchestra.run.smithi157.stdout: "exported_inodes": 954, 2023-10-19T12:59:40.293 INFO:teuthology.orchestra.run.smithi157.stdout: "imported": 17, 2023-10-19T12:59:40.294 INFO:teuthology.orchestra.run.smithi157.stdout: "imported_inodes": 500, 2023-10-19T12:59:40.294 INFO:teuthology.orchestra.run.smithi157.stdout: "openino_dir_fetch": 0, 2023-10-19T12:59:40.294 INFO:teuthology.orchestra.run.smithi157.stdout: "openino_backtrace_fetch": 364, 2023-10-19T12:59:40.295 INFO:teuthology.orchestra.run.smithi157.stdout: "openino_peer_discover": 0, 2023-10-19T12:59:40.295 INFO:teuthology.orchestra.run.smithi157.stdout: "root_rfiles": 1037, 2023-10-19T12:59:40.296 INFO:teuthology.orchestra.run.smithi157.stdout: "root_rbytes": 1633282866, 2023-10-19T12:59:40.296 INFO:teuthology.orchestra.run.smithi157.stdout: "root_rsnaps": 0, 2023-10-19T12:59:40.296 INFO:teuthology.orchestra.run.smithi157.stdout: "scrub_backtrace_fetch": 364, 2023-10-19T12:59:40.296 INFO:teuthology.orchestra.run.smithi157.stdout: "scrub_set_tag": 0, 2023-10-19T12:59:40.297 INFO:teuthology.orchestra.run.smithi157.stdout: "scrub_backtrace_repaired": 0, 2023-10-19T12:59:40.297 INFO:teuthology.orchestra.run.smithi157.stdout: "scrub_inotable_repaired": 0, 2023-10-19T12:59:40.297 INFO:teuthology.orchestra.run.smithi157.stdout: "scrub_dir_inodes": 38, 2023-10-19T12:59:40.297 INFO:teuthology.orchestra.run.smithi157.stdout: "scrub_dir_base_inodes": 2, 2023-10-19T12:59:40.298 INFO:teuthology.orchestra.run.smithi157.stdout: "scrub_dirfrag_rstats": 36, 2023-10-19T12:59:40.298 INFO:teuthology.orchestra.run.smithi157.stdout: "scrub_file_inodes": 326, 2023-10-19T12:59:40.298 INFO:teuthology.orchestra.run.smithi157.stdout: "handle_inode_file_caps": 11, 2023-10-19T12:59:40.298 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph_cap_op_revoke": 109, 2023-10-19T12:59:40.298 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph_cap_op_grant": 1263, 2023-10-19T12:59:40.299 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph_cap_op_trunc": 0, 2023-10-19T12:59:40.299 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-19T12:59:40.299 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-19T12:59:40.299 INFO:teuthology.orchestra.run.smithi157.stdout: "handle_client_caps": 1128, 2023-10-19T12:59:40.299 INFO:teuthology.orchestra.run.smithi157.stdout: "handle_client_caps_dirty": 912, 2023-10-19T12:59:40.300 INFO:teuthology.orchestra.run.smithi157.stdout: "handle_client_cap_release": 34, 2023-10-19T12:59:40.300 INFO:teuthology.orchestra.run.smithi157.stdout: "process_request_cap_release": 181 2023-10-19T12:59:40.300 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:40.300 INFO:teuthology.orchestra.run.smithi157.stdout: "mds_cache": { 2023-10-19T12:59:40.300 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_update": 201, 2023-10-19T12:59:40.301 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_update_receipt": 0, 2023-10-19T12:59:40.301 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_try_discover": 0, 2023-10-19T12:59:40.301 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_send_discover": 1, 2023-10-19T12:59:40.301 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_handle_discover": 789, 2023-10-19T12:59:40.301 INFO:teuthology.orchestra.run.smithi157.stdout: "num_strays": 0, 2023-10-19T12:59:40.301 INFO:teuthology.orchestra.run.smithi157.stdout: "num_strays_delayed": 0, 2023-10-19T12:59:40.302 INFO:teuthology.orchestra.run.smithi157.stdout: "num_strays_enqueuing": 0, 2023-10-19T12:59:40.302 INFO:teuthology.orchestra.run.smithi157.stdout: "strays_created": 39, 2023-10-19T12:59:40.302 INFO:teuthology.orchestra.run.smithi157.stdout: "strays_enqueued": 38, 2023-10-19T12:59:40.302 INFO:teuthology.orchestra.run.smithi157.stdout: "strays_reintegrated": 1, 2023-10-19T12:59:40.302 INFO:teuthology.orchestra.run.smithi157.stdout: "strays_migrated": 0, 2023-10-19T12:59:40.303 INFO:teuthology.orchestra.run.smithi157.stdout: "num_recovering_processing": 0, 2023-10-19T12:59:40.303 INFO:teuthology.orchestra.run.smithi157.stdout: "num_recovering_enqueued": 0, 2023-10-19T12:59:40.303 INFO:teuthology.orchestra.run.smithi157.stdout: "num_recovering_prioritized": 0, 2023-10-19T12:59:40.303 INFO:teuthology.orchestra.run.smithi157.stdout: "recovery_started": 0, 2023-10-19T12:59:40.303 INFO:teuthology.orchestra.run.smithi157.stdout: "recovery_completed": 0, 2023-10-19T12:59:40.304 INFO:teuthology.orchestra.run.smithi157.stdout: "ireq_enqueue_scrub": 2, 2023-10-19T12:59:40.304 INFO:teuthology.orchestra.run.smithi157.stdout: "ireq_exportdir": 33, 2023-10-19T12:59:40.304 INFO:teuthology.orchestra.run.smithi157.stdout: "ireq_flush": 0, 2023-10-19T12:59:40.304 INFO:teuthology.orchestra.run.smithi157.stdout: "ireq_fragmentdir": 3, 2023-10-19T12:59:40.304 INFO:teuthology.orchestra.run.smithi157.stdout: "ireq_fragstats": 0, 2023-10-19T12:59:40.305 INFO:teuthology.orchestra.run.smithi157.stdout: "ireq_inodestats": 0 2023-10-19T12:59:40.305 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:40.305 INFO:teuthology.orchestra.run.smithi157.stdout: "mds_log": { 2023-10-19T12:59:40.306 INFO:teuthology.orchestra.run.smithi157.stdout: "evlrg": 0, 2023-10-19T12:59:40.306 INFO:teuthology.orchestra.run.smithi157.stdout: "evadd": 3092, 2023-10-19T12:59:40.306 INFO:teuthology.orchestra.run.smithi157.stdout: "evex": 0, 2023-10-19T12:59:40.306 INFO:teuthology.orchestra.run.smithi157.stdout: "evtrm": 0, 2023-10-19T12:59:40.306 INFO:teuthology.orchestra.run.smithi157.stdout: "ev": 3092, 2023-10-19T12:59:40.307 INFO:teuthology.orchestra.run.smithi157.stdout: "evexg": 0, 2023-10-19T12:59:40.307 INFO:teuthology.orchestra.run.smithi157.stdout: "evexd": 0, 2023-10-19T12:59:40.307 INFO:teuthology.orchestra.run.smithi157.stdout: "segadd": 6, 2023-10-19T12:59:40.307 INFO:teuthology.orchestra.run.smithi157.stdout: "segex": 0, 2023-10-19T12:59:40.308 INFO:teuthology.orchestra.run.smithi157.stdout: "segtrm": 0, 2023-10-19T12:59:40.308 INFO:teuthology.orchestra.run.smithi157.stdout: "seg": 6, 2023-10-19T12:59:40.308 INFO:teuthology.orchestra.run.smithi157.stdout: "segmjr": 2, 2023-10-19T12:59:40.308 INFO:teuthology.orchestra.run.smithi157.stdout: "segexg": 0, 2023-10-19T12:59:40.308 INFO:teuthology.orchestra.run.smithi157.stdout: "segexd": 0, 2023-10-19T12:59:40.308 INFO:teuthology.orchestra.run.smithi157.stdout: "expos": 4194304, 2023-10-19T12:59:40.309 INFO:teuthology.orchestra.run.smithi157.stdout: "wrpos": 12743893, 2023-10-19T12:59:40.309 INFO:teuthology.orchestra.run.smithi157.stdout: "rdpos": 0, 2023-10-19T12:59:40.309 INFO:teuthology.orchestra.run.smithi157.stdout: "jlat": { 2023-10-19T12:59:40.309 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 1393, 2023-10-19T12:59:40.309 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 19.598038682, 2023-10-19T12:59:40.310 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.014068943 2023-10-19T12:59:40.310 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:40.310 INFO:teuthology.orchestra.run.smithi157.stdout: "replayed": 0 2023-10-19T12:59:40.310 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:40.311 INFO:teuthology.orchestra.run.smithi157.stdout: "mds_mem": { 2023-10-19T12:59:40.311 INFO:teuthology.orchestra.run.smithi157.stdout: "ino": 565, 2023-10-19T12:59:40.311 INFO:teuthology.orchestra.run.smithi157.stdout: "ino+": 1430, 2023-10-19T12:59:40.311 INFO:teuthology.orchestra.run.smithi157.stdout: "ino-": 865, 2023-10-19T12:59:40.312 INFO:teuthology.orchestra.run.smithi157.stdout: "dir": 67, 2023-10-19T12:59:40.312 INFO:teuthology.orchestra.run.smithi157.stdout: "dir+": 77, 2023-10-19T12:59:40.312 INFO:teuthology.orchestra.run.smithi157.stdout: "dir-": 10, 2023-10-19T12:59:40.312 INFO:teuthology.orchestra.run.smithi157.stdout: "dn": 586, 2023-10-19T12:59:40.312 INFO:teuthology.orchestra.run.smithi157.stdout: "dn+": 1843, 2023-10-19T12:59:40.313 INFO:teuthology.orchestra.run.smithi157.stdout: "dn-": 1257, 2023-10-19T12:59:40.313 INFO:teuthology.orchestra.run.smithi157.stdout: "cap": 541, 2023-10-19T12:59:40.313 INFO:teuthology.orchestra.run.smithi157.stdout: "cap+": 1665, 2023-10-19T12:59:40.313 INFO:teuthology.orchestra.run.smithi157.stdout: "cap-": 1124, 2023-10-19T12:59:40.314 INFO:teuthology.orchestra.run.smithi157.stdout: "rss": 63512, 2023-10-19T12:59:40.314 INFO:teuthology.orchestra.run.smithi157.stdout: "heap": 207152 2023-10-19T12:59:40.314 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:40.314 INFO:teuthology.orchestra.run.smithi157.stdout: "mds_server": { 2023-10-19T12:59:40.315 INFO:teuthology.orchestra.run.smithi157.stdout: "dispatch_client_request": 2438, 2023-10-19T12:59:40.315 INFO:teuthology.orchestra.run.smithi157.stdout: "dispatch_server_request": 79, 2023-10-19T12:59:40.315 INFO:teuthology.orchestra.run.smithi157.stdout: "handle_client_request": 2244, 2023-10-19T12:59:40.315 INFO:teuthology.orchestra.run.smithi157.stdout: "handle_client_session": 312, 2023-10-19T12:59:40.315 INFO:teuthology.orchestra.run.smithi157.stdout: "handle_peer_request": 184, 2023-10-19T12:59:40.316 INFO:teuthology.orchestra.run.smithi157.stdout: "req_create_latency": { 2023-10-19T12:59:40.316 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 1008, 2023-10-19T12:59:40.316 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 5.282639624, 2023-10-19T12:59:40.316 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.005240713 2023-10-19T12:59:40.316 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:40.317 INFO:teuthology.orchestra.run.smithi157.stdout: "req_getattr_latency": { 2023-10-19T12:59:40.317 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 70, 2023-10-19T12:59:40.317 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 1.781753576, 2023-10-19T12:59:40.317 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.025453622 2023-10-19T12:59:40.317 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:40.318 INFO:teuthology.orchestra.run.smithi157.stdout: "req_getfilelock_latency": { 2023-10-19T12:59:40.318 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:40.318 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:40.318 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:40.318 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:40.319 INFO:teuthology.orchestra.run.smithi157.stdout: "req_link_latency": { 2023-10-19T12:59:40.319 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 1, 2023-10-19T12:59:40.319 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000911629, 2023-10-19T12:59:40.319 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000911629 2023-10-19T12:59:40.319 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:40.319 INFO:teuthology.orchestra.run.smithi157.stdout: "req_lookup_latency": { 2023-10-19T12:59:40.320 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 284, 2023-10-19T12:59:40.320 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.167458172, 2023-10-19T12:59:40.320 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000589641 2023-10-19T12:59:40.320 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:40.320 INFO:teuthology.orchestra.run.smithi157.stdout: "req_lookuphash_latency": { 2023-10-19T12:59:40.321 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:40.321 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:40.321 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:40.321 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:40.321 INFO:teuthology.orchestra.run.smithi157.stdout: "req_lookupino_latency": { 2023-10-19T12:59:40.322 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:40.322 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:40.322 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:40.322 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:40.322 INFO:teuthology.orchestra.run.smithi157.stdout: "req_lookupname_latency": { 2023-10-19T12:59:40.322 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:40.323 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:40.323 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:40.323 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:40.323 INFO:teuthology.orchestra.run.smithi157.stdout: "req_lookupparent_latency": { 2023-10-19T12:59:40.323 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:40.324 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:40.324 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:40.324 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:40.324 INFO:teuthology.orchestra.run.smithi157.stdout: "req_lookupsnap_latency": { 2023-10-19T12:59:40.324 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:40.324 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:40.325 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:40.325 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:40.325 INFO:teuthology.orchestra.run.smithi157.stdout: "req_lssnap_latency": { 2023-10-19T12:59:40.325 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:40.325 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:40.326 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:40.326 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:40.326 INFO:teuthology.orchestra.run.smithi157.stdout: "req_mkdir_latency": { 2023-10-19T12:59:40.326 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 35, 2023-10-19T12:59:40.326 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.522305062, 2023-10-19T12:59:40.327 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.014923001 2023-10-19T12:59:40.327 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:40.327 INFO:teuthology.orchestra.run.smithi157.stdout: "req_mknod_latency": { 2023-10-19T12:59:40.327 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:40.327 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:40.328 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:40.328 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:40.328 INFO:teuthology.orchestra.run.smithi157.stdout: "req_mksnap_latency": { 2023-10-19T12:59:40.328 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:40.328 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:40.328 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:40.329 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:40.329 INFO:teuthology.orchestra.run.smithi157.stdout: "req_open_latency": { 2023-10-19T12:59:40.329 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 497, 2023-10-19T12:59:40.329 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.146449098, 2023-10-19T12:59:40.329 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000294666 2023-10-19T12:59:40.330 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:40.330 INFO:teuthology.orchestra.run.smithi157.stdout: "req_readdir_latency": { 2023-10-19T12:59:40.330 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 60, 2023-10-19T12:59:40.330 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.097755650, 2023-10-19T12:59:40.330 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.001629260 2023-10-19T12:59:40.331 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:40.331 INFO:teuthology.orchestra.run.smithi157.stdout: "req_rename_latency": { 2023-10-19T12:59:40.331 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 31, 2023-10-19T12:59:40.331 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.182427390, 2023-10-19T12:59:40.331 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.005884754 2023-10-19T12:59:40.332 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:40.332 INFO:teuthology.orchestra.run.smithi157.stdout: "req_renamesnap_latency": { 2023-10-19T12:59:40.332 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:40.332 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:40.332 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:40.332 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:40.333 INFO:teuthology.orchestra.run.smithi157.stdout: "req_snapdiff_latency": { 2023-10-19T12:59:40.333 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:40.333 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:40.333 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:40.333 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:40.334 INFO:teuthology.orchestra.run.smithi157.stdout: "req_rmdir_latency": { 2023-10-19T12:59:40.334 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:40.334 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:40.334 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:40.334 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:40.334 INFO:teuthology.orchestra.run.smithi157.stdout: "req_rmsnap_latency": { 2023-10-19T12:59:40.335 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:40.335 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:40.335 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:40.335 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:40.335 INFO:teuthology.orchestra.run.smithi157.stdout: "req_rmxattr_latency": { 2023-10-19T12:59:40.336 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:40.336 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:40.336 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:40.336 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:40.336 INFO:teuthology.orchestra.run.smithi157.stdout: "req_setattr_latency": { 2023-10-19T12:59:40.337 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 2, 2023-10-19T12:59:40.337 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.001504114, 2023-10-19T12:59:40.337 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000752057 2023-10-19T12:59:40.337 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:40.337 INFO:teuthology.orchestra.run.smithi157.stdout: "req_setdirlayout_latency": { 2023-10-19T12:59:40.338 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:40.338 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:40.338 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:40.338 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:40.338 INFO:teuthology.orchestra.run.smithi157.stdout: "req_setfilelock_latency": { 2023-10-19T12:59:40.339 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:40.339 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:40.339 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:40.339 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:40.339 INFO:teuthology.orchestra.run.smithi157.stdout: "req_setlayout_latency": { 2023-10-19T12:59:40.340 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:40.340 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:40.340 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:40.340 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:40.340 INFO:teuthology.orchestra.run.smithi157.stdout: "req_setxattr_latency": { 2023-10-19T12:59:40.340 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 7, 2023-10-19T12:59:40.341 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.018151822, 2023-10-19T12:59:40.341 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.002593117 2023-10-19T12:59:40.341 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:40.341 INFO:teuthology.orchestra.run.smithi157.stdout: "req_symlink_latency": { 2023-10-19T12:59:40.341 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:40.342 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:40.342 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:40.342 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:40.342 INFO:teuthology.orchestra.run.smithi157.stdout: "req_unlink_latency": { 2023-10-19T12:59:40.342 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 20, 2023-10-19T12:59:40.343 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.040021804, 2023-10-19T12:59:40.343 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.002001090 2023-10-19T12:59:40.343 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:40.343 INFO:teuthology.orchestra.run.smithi157.stdout: "cap_revoke_eviction": 0, 2023-10-19T12:59:40.343 INFO:teuthology.orchestra.run.smithi157.stdout: "cap_acquisition_throttle": 0, 2023-10-19T12:59:40.344 INFO:teuthology.orchestra.run.smithi157.stdout: "req_getvxattr_latency": { 2023-10-19T12:59:40.344 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:40.344 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:40.344 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:40.344 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-10-19T12:59:40.345 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:40.345 INFO:teuthology.orchestra.run.smithi157.stdout: "mds_sessions": { 2023-10-19T12:59:40.345 INFO:teuthology.orchestra.run.smithi157.stdout: "session_count": 1, 2023-10-19T12:59:40.345 INFO:teuthology.orchestra.run.smithi157.stdout: "session_add": 3, 2023-10-19T12:59:40.345 INFO:teuthology.orchestra.run.smithi157.stdout: "session_remove": 2, 2023-10-19T12:59:40.345 INFO:teuthology.orchestra.run.smithi157.stdout: "sessions_open": 1, 2023-10-19T12:59:40.346 INFO:teuthology.orchestra.run.smithi157.stdout: "sessions_stale": 0, 2023-10-19T12:59:40.346 INFO:teuthology.orchestra.run.smithi157.stdout: "total_load": 62, 2023-10-19T12:59:40.346 INFO:teuthology.orchestra.run.smithi157.stdout: "average_load": 62, 2023-10-19T12:59:40.346 INFO:teuthology.orchestra.run.smithi157.stdout: "avg_session_uptime": 971, 2023-10-19T12:59:40.346 INFO:teuthology.orchestra.run.smithi157.stdout: "mdthresh_evicted": 0 2023-10-19T12:59:40.347 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:40.347 INFO:teuthology.orchestra.run.smithi157.stdout: "mempool": { 2023-10-19T12:59:40.347 INFO:teuthology.orchestra.run.smithi157.stdout: "bloom_filter_bytes": 0, 2023-10-19T12:59:40.347 INFO:teuthology.orchestra.run.smithi157.stdout: "bloom_filter_items": 0, 2023-10-19T12:59:40.347 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_alloc_bytes": 0, 2023-10-19T12:59:40.348 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_alloc_items": 0, 2023-10-19T12:59:40.348 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_data_bytes": 0, 2023-10-19T12:59:40.348 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_data_items": 0, 2023-10-19T12:59:40.348 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-19T12:59:40.348 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_onode_items": 0, 2023-10-19T12:59:40.348 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-19T12:59:40.349 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_meta_items": 0, 2023-10-19T12:59:40.349 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_other_bytes": 0, 2023-10-19T12:59:40.349 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_other_items": 0, 2023-10-19T12:59:40.349 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-19T12:59:40.349 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_buffer_items": 0, 2023-10-19T12:59:40.350 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_extent_bytes": 0, 2023-10-19T12:59:40.350 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_extent_items": 0, 2023-10-19T12:59:40.350 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_blob_bytes": 0, 2023-10-19T12:59:40.350 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_blob_items": 0, 2023-10-19T12:59:40.350 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-19T12:59:40.351 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_shared_blob_items": 0, 2023-10-19T12:59:40.351 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-19T12:59:40.351 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_inline_bl_items": 0, 2023-10-19T12:59:40.351 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_fsck_bytes": 0, 2023-10-19T12:59:40.351 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_fsck_items": 0, 2023-10-19T12:59:40.352 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_txc_bytes": 0, 2023-10-19T12:59:40.352 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_txc_items": 0, 2023-10-19T12:59:40.352 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-19T12:59:40.352 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_writing_deferred_items": 0, 2023-10-19T12:59:40.352 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_writing_bytes": 0, 2023-10-19T12:59:40.352 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_writing_items": 0, 2023-10-19T12:59:40.353 INFO:teuthology.orchestra.run.smithi157.stdout: "bluefs_bytes": 0, 2023-10-19T12:59:40.353 INFO:teuthology.orchestra.run.smithi157.stdout: "bluefs_items": 0, 2023-10-19T12:59:40.353 INFO:teuthology.orchestra.run.smithi157.stdout: "bluefs_file_reader_bytes": 0, 2023-10-19T12:59:40.353 INFO:teuthology.orchestra.run.smithi157.stdout: "bluefs_file_reader_items": 0, 2023-10-19T12:59:40.353 INFO:teuthology.orchestra.run.smithi157.stdout: "bluefs_file_writer_bytes": 0, 2023-10-19T12:59:40.354 INFO:teuthology.orchestra.run.smithi157.stdout: "bluefs_file_writer_items": 0, 2023-10-19T12:59:40.354 INFO:teuthology.orchestra.run.smithi157.stdout: "buffer_anon_bytes": 373287, 2023-10-19T12:59:40.354 INFO:teuthology.orchestra.run.smithi157.stdout: "buffer_anon_items": 673, 2023-10-19T12:59:40.354 INFO:teuthology.orchestra.run.smithi157.stdout: "buffer_meta_bytes": 264, 2023-10-19T12:59:40.354 INFO:teuthology.orchestra.run.smithi157.stdout: "buffer_meta_items": 3, 2023-10-19T12:59:40.355 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_bytes": 0, 2023-10-19T12:59:40.355 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_items": 0, 2023-10-19T12:59:40.355 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_mapbl_bytes": 0, 2023-10-19T12:59:40.355 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_mapbl_items": 0, 2023-10-19T12:59:40.355 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_pglog_bytes": 0, 2023-10-19T12:59:40.355 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_pglog_items": 0, 2023-10-19T12:59:40.356 INFO:teuthology.orchestra.run.smithi157.stdout: "osdmap_bytes": 9280, 2023-10-19T12:59:40.356 INFO:teuthology.orchestra.run.smithi157.stdout: "osdmap_items": 179, 2023-10-19T12:59:40.356 INFO:teuthology.orchestra.run.smithi157.stdout: "osdmap_mapping_bytes": 0, 2023-10-19T12:59:40.356 INFO:teuthology.orchestra.run.smithi157.stdout: "osdmap_mapping_items": 0, 2023-10-19T12:59:40.356 INFO:teuthology.orchestra.run.smithi157.stdout: "pgmap_bytes": 0, 2023-10-19T12:59:40.357 INFO:teuthology.orchestra.run.smithi157.stdout: "pgmap_items": 0, 2023-10-19T12:59:40.357 INFO:teuthology.orchestra.run.smithi157.stdout: "mds_co_bytes": 2032600, 2023-10-19T12:59:40.357 INFO:teuthology.orchestra.run.smithi157.stdout: "mds_co_items": 21478, 2023-10-19T12:59:40.357 INFO:teuthology.orchestra.run.smithi157.stdout: "unittest_1_bytes": 0, 2023-10-19T12:59:40.357 INFO:teuthology.orchestra.run.smithi157.stdout: "unittest_1_items": 0, 2023-10-19T12:59:40.358 INFO:teuthology.orchestra.run.smithi157.stdout: "unittest_2_bytes": 0, 2023-10-19T12:59:40.358 INFO:teuthology.orchestra.run.smithi157.stdout: "unittest_2_items": 0 2023-10-19T12:59:40.358 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:40.358 INFO:teuthology.orchestra.run.smithi157.stdout: "objecter": { 2023-10-19T12:59:40.358 INFO:teuthology.orchestra.run.smithi157.stdout: "op_active": 0, 2023-10-19T12:59:40.359 INFO:teuthology.orchestra.run.smithi157.stdout: "op_laggy": 0, 2023-10-19T12:59:40.359 INFO:teuthology.orchestra.run.smithi157.stdout: "op_send": 2583, 2023-10-19T12:59:40.359 INFO:teuthology.orchestra.run.smithi157.stdout: "op_send_bytes": 8968621, 2023-10-19T12:59:40.359 INFO:teuthology.orchestra.run.smithi157.stdout: "op_resend": 37, 2023-10-19T12:59:40.359 INFO:teuthology.orchestra.run.smithi157.stdout: "op_reply": 2583, 2023-10-19T12:59:40.360 INFO:teuthology.orchestra.run.smithi157.stdout: "op_latency": { 2023-10-19T12:59:40.360 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 2583, 2023-10-19T12:59:40.360 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 51.800106537, 2023-10-19T12:59:40.360 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.020054241 2023-10-19T12:59:40.360 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:40.360 INFO:teuthology.orchestra.run.smithi157.stdout: "op_inflight": 0, 2023-10-19T12:59:40.361 INFO:teuthology.orchestra.run.smithi157.stdout: "oplen_avg": { 2023-10-19T12:59:40.361 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 2583, 2023-10-19T12:59:40.361 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 2684 2023-10-19T12:59:40.361 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:40.361 INFO:teuthology.orchestra.run.smithi157.stdout: "op": 2583, 2023-10-19T12:59:40.362 INFO:teuthology.orchestra.run.smithi157.stdout: "op_r": 385, 2023-10-19T12:59:40.362 INFO:teuthology.orchestra.run.smithi157.stdout: "op_w": 2198, 2023-10-19T12:59:40.362 INFO:teuthology.orchestra.run.smithi157.stdout: "op_rmw": 0, 2023-10-19T12:59:40.362 INFO:teuthology.orchestra.run.smithi157.stdout: "op_pg": 0, 2023-10-19T12:59:40.362 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_stat": 0, 2023-10-19T12:59:40.362 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_create": 11, 2023-10-19T12:59:40.363 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_read": 19, 2023-10-19T12:59:40.363 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_write": 1410, 2023-10-19T12:59:40.363 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_writefull": 84, 2023-10-19T12:59:40.363 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_writesame": 0, 2023-10-19T12:59:40.363 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_append": 0, 2023-10-19T12:59:40.363 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_zero": 0, 2023-10-19T12:59:40.364 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_truncate": 3, 2023-10-19T12:59:40.364 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_delete": 605, 2023-10-19T12:59:40.364 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_mapext": 0, 2023-10-19T12:59:40.364 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_sparse_read": 0, 2023-10-19T12:59:40.364 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_clonerange": 0, 2023-10-19T12:59:40.365 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_getxattr": 366, 2023-10-19T12:59:40.365 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_setxattr": 22, 2023-10-19T12:59:40.365 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_cmpxattr": 0, 2023-10-19T12:59:40.365 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_rmxattr": 0, 2023-10-19T12:59:40.365 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_resetxattrs": 0, 2023-10-19T12:59:40.365 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_call": 0, 2023-10-19T12:59:40.366 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_watch": 0, 2023-10-19T12:59:40.366 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_notify": 0, 2023-10-19T12:59:40.366 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_src_cmpxattr": 0, 2023-10-19T12:59:40.366 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_pgls": 0, 2023-10-19T12:59:40.366 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_pgls_filter": 0, 2023-10-19T12:59:40.367 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_other": 0, 2023-10-19T12:59:40.367 INFO:teuthology.orchestra.run.smithi157.stdout: "linger_active": 0, 2023-10-19T12:59:40.367 INFO:teuthology.orchestra.run.smithi157.stdout: "linger_send": 0, 2023-10-19T12:59:40.367 INFO:teuthology.orchestra.run.smithi157.stdout: "linger_resend": 0, 2023-10-19T12:59:40.367 INFO:teuthology.orchestra.run.smithi157.stdout: "linger_ping": 0, 2023-10-19T12:59:40.368 INFO:teuthology.orchestra.run.smithi157.stdout: "poolop_active": 0, 2023-10-19T12:59:40.368 INFO:teuthology.orchestra.run.smithi157.stdout: "poolop_send": 0, 2023-10-19T12:59:40.368 INFO:teuthology.orchestra.run.smithi157.stdout: "poolop_resend": 0, 2023-10-19T12:59:40.368 INFO:teuthology.orchestra.run.smithi157.stdout: "poolstat_active": 0, 2023-10-19T12:59:40.368 INFO:teuthology.orchestra.run.smithi157.stdout: "poolstat_send": 0, 2023-10-19T12:59:40.368 INFO:teuthology.orchestra.run.smithi157.stdout: "poolstat_resend": 0, 2023-10-19T12:59:40.369 INFO:teuthology.orchestra.run.smithi157.stdout: "statfs_active": 0, 2023-10-19T12:59:40.369 INFO:teuthology.orchestra.run.smithi157.stdout: "statfs_send": 0, 2023-10-19T12:59:40.369 INFO:teuthology.orchestra.run.smithi157.stdout: "statfs_resend": 0, 2023-10-19T12:59:40.369 INFO:teuthology.orchestra.run.smithi157.stdout: "command_active": 0, 2023-10-19T12:59:40.369 INFO:teuthology.orchestra.run.smithi157.stdout: "command_send": 0, 2023-10-19T12:59:40.369 INFO:teuthology.orchestra.run.smithi157.stdout: "command_resend": 0, 2023-10-19T12:59:40.370 INFO:teuthology.orchestra.run.smithi157.stdout: "map_epoch": 92, 2023-10-19T12:59:40.370 INFO:teuthology.orchestra.run.smithi157.stdout: "map_full": 0, 2023-10-19T12:59:40.370 INFO:teuthology.orchestra.run.smithi157.stdout: "map_inc": 9, 2023-10-19T12:59:40.370 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_sessions": 12, 2023-10-19T12:59:40.370 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_session_open": 12, 2023-10-19T12:59:40.371 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_session_close": 0, 2023-10-19T12:59:40.371 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_laggy": 0, 2023-10-19T12:59:40.371 INFO:teuthology.orchestra.run.smithi157.stdout: "omap_wr": 136, 2023-10-19T12:59:40.371 INFO:teuthology.orchestra.run.smithi157.stdout: "omap_rd": 0, 2023-10-19T12:59:40.371 INFO:teuthology.orchestra.run.smithi157.stdout: "omap_del": 28 2023-10-19T12:59:40.372 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:40.372 INFO:teuthology.orchestra.run.smithi157.stdout: "oft": { 2023-10-19T12:59:40.372 INFO:teuthology.orchestra.run.smithi157.stdout: "omap_total_objs": 1, 2023-10-19T12:59:40.372 INFO:teuthology.orchestra.run.smithi157.stdout: "omap_total_kv_pairs": 0, 2023-10-19T12:59:40.372 INFO:teuthology.orchestra.run.smithi157.stdout: "omap_total_updates": 0, 2023-10-19T12:59:40.373 INFO:teuthology.orchestra.run.smithi157.stdout: "omap_total_removes": 0 2023-10-19T12:59:40.373 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:40.373 INFO:teuthology.orchestra.run.smithi157.stdout: "osd-slow-ops": { 2023-10-19T12:59:40.373 INFO:teuthology.orchestra.run.smithi157.stdout: "slow_ops_count": 0 2023-10-19T12:59:40.373 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:40.373 INFO:teuthology.orchestra.run.smithi157.stdout: "purge_queue": { 2023-10-19T12:59:40.374 INFO:teuthology.orchestra.run.smithi157.stdout: "pq_executing_ops": 0, 2023-10-19T12:59:40.374 INFO:teuthology.orchestra.run.smithi157.stdout: "pq_executing_ops_high_water": 17, 2023-10-19T12:59:40.374 INFO:teuthology.orchestra.run.smithi157.stdout: "pq_executing": 0, 2023-10-19T12:59:40.374 INFO:teuthology.orchestra.run.smithi157.stdout: "pq_executing_high_water": 5, 2023-10-19T12:59:40.374 INFO:teuthology.orchestra.run.smithi157.stdout: "pq_executed": 38, 2023-10-19T12:59:40.375 INFO:teuthology.orchestra.run.smithi157.stdout: "pq_item_in_journal": 0 2023-10-19T12:59:40.375 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:40.375 INFO:teuthology.orchestra.run.smithi157.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-19T12:59:40.375 INFO:teuthology.orchestra.run.smithi157.stdout: "val": 0, 2023-10-19T12:59:40.375 INFO:teuthology.orchestra.run.smithi157.stdout: "max": 104857600, 2023-10-19T12:59:40.376 INFO:teuthology.orchestra.run.smithi157.stdout: "get_started": 0, 2023-10-19T12:59:40.376 INFO:teuthology.orchestra.run.smithi157.stdout: "get": 5213050, 2023-10-19T12:59:40.376 INFO:teuthology.orchestra.run.smithi157.stdout: "get_sum": 358216584, 2023-10-19T12:59:40.376 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_fail": 0, 2023-10-19T12:59:40.376 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_success": 5213050, 2023-10-19T12:59:40.376 INFO:teuthology.orchestra.run.smithi157.stdout: "take": 0, 2023-10-19T12:59:40.377 INFO:teuthology.orchestra.run.smithi157.stdout: "take_sum": 0, 2023-10-19T12:59:40.377 INFO:teuthology.orchestra.run.smithi157.stdout: "put": 5213049, 2023-10-19T12:59:40.377 INFO:teuthology.orchestra.run.smithi157.stdout: "put_sum": 358216516, 2023-10-19T12:59:40.377 INFO:teuthology.orchestra.run.smithi157.stdout: "wait": { 2023-10-19T12:59:40.377 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:40.378 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:40.378 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:40.378 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-10-19T12:59:40.378 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:40.378 INFO:teuthology.orchestra.run.smithi157.stdout: "throttle-objecter_bytes": { 2023-10-19T12:59:40.379 INFO:teuthology.orchestra.run.smithi157.stdout: "val": 0, 2023-10-19T12:59:40.379 INFO:teuthology.orchestra.run.smithi157.stdout: "max": 104857600, 2023-10-19T12:59:40.379 INFO:teuthology.orchestra.run.smithi157.stdout: "get_started": 0, 2023-10-19T12:59:40.379 INFO:teuthology.orchestra.run.smithi157.stdout: "get": 0, 2023-10-19T12:59:40.379 INFO:teuthology.orchestra.run.smithi157.stdout: "get_sum": 0, 2023-10-19T12:59:40.379 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_fail": 0, 2023-10-19T12:59:40.380 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_success": 0, 2023-10-19T12:59:40.380 INFO:teuthology.orchestra.run.smithi157.stdout: "take": 2583, 2023-10-19T12:59:40.380 INFO:teuthology.orchestra.run.smithi157.stdout: "take_sum": 8972763, 2023-10-19T12:59:40.380 INFO:teuthology.orchestra.run.smithi157.stdout: "put": 2583, 2023-10-19T12:59:40.380 INFO:teuthology.orchestra.run.smithi157.stdout: "put_sum": 8972763, 2023-10-19T12:59:40.381 INFO:teuthology.orchestra.run.smithi157.stdout: "wait": { 2023-10-19T12:59:40.381 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:40.381 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:40.381 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:40.381 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-10-19T12:59:40.382 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:40.382 INFO:teuthology.orchestra.run.smithi157.stdout: "throttle-objecter_ops": { 2023-10-19T12:59:40.382 INFO:teuthology.orchestra.run.smithi157.stdout: "val": 0, 2023-10-19T12:59:40.382 INFO:teuthology.orchestra.run.smithi157.stdout: "max": 1024, 2023-10-19T12:59:40.382 INFO:teuthology.orchestra.run.smithi157.stdout: "get_started": 0, 2023-10-19T12:59:40.383 INFO:teuthology.orchestra.run.smithi157.stdout: "get": 0, 2023-10-19T12:59:40.383 INFO:teuthology.orchestra.run.smithi157.stdout: "get_sum": 0, 2023-10-19T12:59:40.383 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_fail": 0, 2023-10-19T12:59:40.383 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_success": 0, 2023-10-19T12:59:40.383 INFO:teuthology.orchestra.run.smithi157.stdout: "take": 2583, 2023-10-19T12:59:40.383 INFO:teuthology.orchestra.run.smithi157.stdout: "take_sum": 2583, 2023-10-19T12:59:40.384 INFO:teuthology.orchestra.run.smithi157.stdout: "put": 2583, 2023-10-19T12:59:40.384 INFO:teuthology.orchestra.run.smithi157.stdout: "put_sum": 2583, 2023-10-19T12:59:40.384 INFO:teuthology.orchestra.run.smithi157.stdout: "wait": { 2023-10-19T12:59:40.384 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:40.384 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:40.384 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:40.385 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-10-19T12:59:40.385 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:40.385 INFO:teuthology.orchestra.run.smithi157.stdout: "throttle-write_buf_throttle": { 2023-10-19T12:59:40.385 INFO:teuthology.orchestra.run.smithi157.stdout: "val": 0, 2023-10-19T12:59:40.385 INFO:teuthology.orchestra.run.smithi157.stdout: "max": 3758096384, 2023-10-19T12:59:40.386 INFO:teuthology.orchestra.run.smithi157.stdout: "get_started": 0, 2023-10-19T12:59:40.386 INFO:teuthology.orchestra.run.smithi157.stdout: "get": 38, 2023-10-19T12:59:40.386 INFO:teuthology.orchestra.run.smithi157.stdout: "get_sum": 4142, 2023-10-19T12:59:40.386 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_fail": 0, 2023-10-19T12:59:40.386 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_success": 38, 2023-10-19T12:59:40.386 INFO:teuthology.orchestra.run.smithi157.stdout: "take": 0, 2023-10-19T12:59:40.387 INFO:teuthology.orchestra.run.smithi157.stdout: "take_sum": 0, 2023-10-19T12:59:40.387 INFO:teuthology.orchestra.run.smithi157.stdout: "put": 17, 2023-10-19T12:59:40.387 INFO:teuthology.orchestra.run.smithi157.stdout: "put_sum": 4142, 2023-10-19T12:59:40.387 INFO:teuthology.orchestra.run.smithi157.stdout: "wait": { 2023-10-19T12:59:40.387 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:40.388 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:40.388 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:40.388 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-10-19T12:59:40.388 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:40.388 INFO:teuthology.orchestra.run.smithi157.stdout: "throttle-write_buf_throttle-0x5562e8e766e0": { 2023-10-19T12:59:40.389 INFO:teuthology.orchestra.run.smithi157.stdout: "val": 0, 2023-10-19T12:59:40.389 INFO:teuthology.orchestra.run.smithi157.stdout: "max": 3758096384, 2023-10-19T12:59:40.389 INFO:teuthology.orchestra.run.smithi157.stdout: "get_started": 0, 2023-10-19T12:59:40.389 INFO:teuthology.orchestra.run.smithi157.stdout: "get": 3092, 2023-10-19T12:59:40.389 INFO:teuthology.orchestra.run.smithi157.stdout: "get_sum": 8549589, 2023-10-19T12:59:40.389 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_fail": 0, 2023-10-19T12:59:40.390 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_success": 3092, 2023-10-19T12:59:40.390 INFO:teuthology.orchestra.run.smithi157.stdout: "take": 0, 2023-10-19T12:59:40.390 INFO:teuthology.orchestra.run.smithi157.stdout: "take_sum": 0, 2023-10-19T12:59:40.390 INFO:teuthology.orchestra.run.smithi157.stdout: "put": 1393, 2023-10-19T12:59:40.390 INFO:teuthology.orchestra.run.smithi157.stdout: "put_sum": 8549589, 2023-10-19T12:59:40.391 INFO:teuthology.orchestra.run.smithi157.stdout: "wait": { 2023-10-19T12:59:40.391 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:40.391 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:40.391 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:40.391 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-10-19T12:59:40.392 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-10-19T12:59:40.392 INFO:teuthology.orchestra.run.smithi157.stdout:} 2023-10-19T12:59:40.392 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:59:39 smithi195 ceph-mon[134493]: pgmap v838: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.7 KiB/s wr, 16 op/s 2023-10-19T12:59:40.393 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:59:39 smithi157 ceph-mon[134109]: pgmap v838: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.7 KiB/s wr, 16 op/s 2023-10-19T12:59:42.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:59:42 smithi046 ceph-mon[98509]: pgmap v839: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.2 KiB/s wr, 13 op/s 2023-10-19T12:59:42.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:59:42 smithi157 ceph-mon[134109]: pgmap v839: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.2 KiB/s wr, 13 op/s 2023-10-19T12:59:42.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:59:42 smithi195 ceph-mon[134493]: pgmap v839: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.2 KiB/s wr, 13 op/s 2023-10-19T12:59:43.155 INFO:tasks.check_counter:Daemon mds.b mds.exported=33 2023-10-19T12:59:43.155 INFO:tasks.check_counter:Daemon mds.b mds.imported=17 2023-10-19T12:59:43.155 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=201 2023-10-19T12:59:43.155 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=0 2023-10-19T12:59:43.156 DEBUG:tasks.check_counter:Getting stats from e 2023-10-19T12:59:43.156 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph daemon mds.e perf dump 2023-10-19T12:59:43.825 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.b/config 2023-10-19T12:59:44.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:59:44 smithi157 ceph-mon[134109]: pgmap v840: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.9 KiB/s wr, 15 op/s 2023-10-19T12:59:44.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:59:44 smithi157 ceph-mon[134109]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-19T12:59:44.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:59:44 smithi046 ceph-mon[98509]: pgmap v840: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.9 KiB/s wr, 15 op/s 2023-10-19T12:59:44.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:59:44 smithi046 ceph-mon[98509]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-19T12:59:44.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:59:44 smithi195 ceph-mon[134493]: pgmap v840: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.9 KiB/s wr, 15 op/s 2023-10-19T12:59:44.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:59:44 smithi195 ceph-mon[134493]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-19T12:59:46.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:59:46 smithi046 ceph-mon[98509]: pgmap v841: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 4.7 KiB/s wr, 13 op/s 2023-10-19T12:59:46.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:59:46 smithi157 ceph-mon[134109]: pgmap v841: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 4.7 KiB/s wr, 13 op/s 2023-10-19T12:59:46.630 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2023-10-19T12:59:46.630 INFO:teuthology.orchestra.run.smithi157.stdout: "AsyncMessenger::Worker-0": { 2023-10-19T12:59:46.630 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_messages": 1557, 2023-10-19T12:59:46.630 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_messages": 1526, 2023-10-19T12:59:46.631 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_bytes": 5286420, 2023-10-19T12:59:46.631 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_bytes": 560854, 2023-10-19T12:59:46.631 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_created_connections": 5, 2023-10-19T12:59:46.631 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_active_connections": 1, 2023-10-19T12:59:46.631 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_total_time": 0.151633268, 2023-10-19T12:59:46.632 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_send_time": 0.049269506, 2023-10-19T12:59:46.632 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_recv_time": 0.044730252, 2023-10-19T12:59:46.632 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_fast_dispatch_time": 0.048041712, 2023-10-19T12:59:46.632 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_messages_queue_lat": { 2023-10-19T12:59:46.632 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 1525, 2023-10-19T12:59:46.632 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.301428033, 2023-10-19T12:59:46.633 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000197657 2023-10-19T12:59:46.633 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:46.633 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_handle_ack_lat": { 2023-10-19T12:59:46.633 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:46.633 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:46.634 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:46.634 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:46.634 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_encrypted_bytes": 695152, 2023-10-19T12:59:46.634 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_encrypted_bytes": 183296 2023-10-19T12:59:46.634 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:46.634 INFO:teuthology.orchestra.run.smithi157.stdout: "AsyncMessenger::Worker-1": { 2023-10-19T12:59:46.635 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_messages": 991, 2023-10-19T12:59:46.635 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_messages": 1218, 2023-10-19T12:59:46.635 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_bytes": 472522, 2023-10-19T12:59:46.635 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_bytes": 775304, 2023-10-19T12:59:46.635 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_created_connections": 6, 2023-10-19T12:59:46.636 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_active_connections": 4, 2023-10-19T12:59:46.636 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_total_time": 0.085780211, 2023-10-19T12:59:46.636 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_send_time": 0.024179124, 2023-10-19T12:59:46.636 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_recv_time": 0.018579310, 2023-10-19T12:59:46.636 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_fast_dispatch_time": 0.035652413, 2023-10-19T12:59:46.637 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_messages_queue_lat": { 2023-10-19T12:59:46.637 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 1217, 2023-10-19T12:59:46.637 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.266814348, 2023-10-19T12:59:46.637 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000219239 2023-10-19T12:59:46.637 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:46.637 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_handle_ack_lat": { 2023-10-19T12:59:46.638 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:46.638 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:46.638 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:46.638 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:46.638 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_encrypted_bytes": 3152, 2023-10-19T12:59:46.639 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_encrypted_bytes": 468592 2023-10-19T12:59:46.639 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:46.639 INFO:teuthology.orchestra.run.smithi157.stdout: "AsyncMessenger::Worker-2": { 2023-10-19T12:59:46.639 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_messages": 1361, 2023-10-19T12:59:46.639 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_messages": 1362, 2023-10-19T12:59:46.640 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_bytes": 4544206, 2023-10-19T12:59:46.640 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_bytes": 422967, 2023-10-19T12:59:46.640 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_created_connections": 4, 2023-10-19T12:59:46.640 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_active_connections": 3, 2023-10-19T12:59:46.640 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_total_time": 0.104864632, 2023-10-19T12:59:46.641 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_send_time": 0.024519530, 2023-10-19T12:59:46.641 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_recv_time": 0.030858182, 2023-10-19T12:59:46.641 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_fast_dispatch_time": 0.041247838, 2023-10-19T12:59:46.641 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_messages_queue_lat": { 2023-10-19T12:59:46.641 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 1360, 2023-10-19T12:59:46.641 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.292430412, 2023-10-19T12:59:46.642 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000215022 2023-10-19T12:59:46.642 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:46.642 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_handle_ack_lat": { 2023-10-19T12:59:46.642 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:46.642 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:46.643 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:46.643 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:46.643 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-19T12:59:46.643 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_encrypted_bytes": 0 2023-10-19T12:59:46.643 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:46.643 INFO:teuthology.orchestra.run.smithi157.stdout: "cct": { 2023-10-19T12:59:46.644 INFO:teuthology.orchestra.run.smithi157.stdout: "total_workers": 1, 2023-10-19T12:59:46.644 INFO:teuthology.orchestra.run.smithi157.stdout: "unhealthy_workers": 0 2023-10-19T12:59:46.644 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:46.644 INFO:teuthology.orchestra.run.smithi157.stdout: "finisher-MDSRank": { 2023-10-19T12:59:46.644 INFO:teuthology.orchestra.run.smithi157.stdout: "queue_len": 0, 2023-10-19T12:59:46.644 INFO:teuthology.orchestra.run.smithi157.stdout: "complete_latency": { 2023-10-19T12:59:46.645 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 5929, 2023-10-19T12:59:46.645 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.152399460, 2023-10-19T12:59:46.645 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000025704 2023-10-19T12:59:46.645 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-10-19T12:59:46.645 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:46.646 INFO:teuthology.orchestra.run.smithi157.stdout: "finisher-PurgeQueue": { 2023-10-19T12:59:46.646 INFO:teuthology.orchestra.run.smithi157.stdout: "queue_len": 0, 2023-10-19T12:59:46.646 INFO:teuthology.orchestra.run.smithi157.stdout: "complete_latency": { 2023-10-19T12:59:46.646 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:46.646 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:46.646 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:46.647 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-10-19T12:59:46.647 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:46.647 INFO:teuthology.orchestra.run.smithi157.stdout: "mds": { 2023-10-19T12:59:46.647 INFO:teuthology.orchestra.run.smithi157.stdout: "request": 0, 2023-10-19T12:59:46.647 INFO:teuthology.orchestra.run.smithi157.stdout: "reply": 0, 2023-10-19T12:59:46.648 INFO:teuthology.orchestra.run.smithi157.stdout: "reply_latency": { 2023-10-19T12:59:46.648 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:46.648 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:46.648 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:46.648 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:46.649 INFO:teuthology.orchestra.run.smithi157.stdout: "slow_reply": 0, 2023-10-19T12:59:46.649 INFO:teuthology.orchestra.run.smithi157.stdout: "forward": 0, 2023-10-19T12:59:46.649 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_fetch_complete": 0, 2023-10-19T12:59:46.649 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_fetch_keys": 0, 2023-10-19T12:59:46.649 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_commit": 0, 2023-10-19T12:59:46.650 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_split": 0, 2023-10-19T12:59:46.650 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_merge": 0, 2023-10-19T12:59:46.650 INFO:teuthology.orchestra.run.smithi157.stdout: "inodes": 496, 2023-10-19T12:59:46.650 INFO:teuthology.orchestra.run.smithi157.stdout: "inodes_top": 0, 2023-10-19T12:59:46.650 INFO:teuthology.orchestra.run.smithi157.stdout: "inodes_bottom": 0, 2023-10-19T12:59:46.651 INFO:teuthology.orchestra.run.smithi157.stdout: "inodes_pin_tail": 496, 2023-10-19T12:59:46.651 INFO:teuthology.orchestra.run.smithi157.stdout: "inodes_pinned": 496, 2023-10-19T12:59:46.651 INFO:teuthology.orchestra.run.smithi157.stdout: "inodes_expired": 60, 2023-10-19T12:59:46.651 INFO:teuthology.orchestra.run.smithi157.stdout: "inodes_with_caps": 0, 2023-10-19T12:59:46.651 INFO:teuthology.orchestra.run.smithi157.stdout: "caps": 0, 2023-10-19T12:59:46.651 INFO:teuthology.orchestra.run.smithi157.stdout: "subtrees": 24, 2023-10-19T12:59:46.652 INFO:teuthology.orchestra.run.smithi157.stdout: "traverse": 0, 2023-10-19T12:59:46.652 INFO:teuthology.orchestra.run.smithi157.stdout: "traverse_hit": 0, 2023-10-19T12:59:46.652 INFO:teuthology.orchestra.run.smithi157.stdout: "traverse_forward": 0, 2023-10-19T12:59:46.652 INFO:teuthology.orchestra.run.smithi157.stdout: "traverse_discover": 0, 2023-10-19T12:59:46.652 INFO:teuthology.orchestra.run.smithi157.stdout: "traverse_dir_fetch": 0, 2023-10-19T12:59:46.653 INFO:teuthology.orchestra.run.smithi157.stdout: "traverse_remote_ino": 0, 2023-10-19T12:59:46.653 INFO:teuthology.orchestra.run.smithi157.stdout: "traverse_lock": 0, 2023-10-19T12:59:46.653 INFO:teuthology.orchestra.run.smithi157.stdout: "load_cent": 0, 2023-10-19T12:59:46.653 INFO:teuthology.orchestra.run.smithi157.stdout: "q": 0, 2023-10-19T12:59:46.653 INFO:teuthology.orchestra.run.smithi157.stdout: "exported": 0, 2023-10-19T12:59:46.654 INFO:teuthology.orchestra.run.smithi157.stdout: "exported_inodes": 0, 2023-10-19T12:59:46.654 INFO:teuthology.orchestra.run.smithi157.stdout: "imported": 0, 2023-10-19T12:59:46.654 INFO:teuthology.orchestra.run.smithi157.stdout: "imported_inodes": 0, 2023-10-19T12:59:46.654 INFO:teuthology.orchestra.run.smithi157.stdout: "openino_dir_fetch": 0, 2023-10-19T12:59:46.654 INFO:teuthology.orchestra.run.smithi157.stdout: "openino_backtrace_fetch": 0, 2023-10-19T12:59:46.654 INFO:teuthology.orchestra.run.smithi157.stdout: "openino_peer_discover": 0, 2023-10-19T12:59:46.655 INFO:teuthology.orchestra.run.smithi157.stdout: "root_rfiles": 1037, 2023-10-19T12:59:46.655 INFO:teuthology.orchestra.run.smithi157.stdout: "root_rbytes": 1633283982, 2023-10-19T12:59:46.655 INFO:teuthology.orchestra.run.smithi157.stdout: "root_rsnaps": 0, 2023-10-19T12:59:46.655 INFO:teuthology.orchestra.run.smithi157.stdout: "scrub_backtrace_fetch": 0, 2023-10-19T12:59:46.655 INFO:teuthology.orchestra.run.smithi157.stdout: "scrub_set_tag": 0, 2023-10-19T12:59:46.656 INFO:teuthology.orchestra.run.smithi157.stdout: "scrub_backtrace_repaired": 0, 2023-10-19T12:59:46.656 INFO:teuthology.orchestra.run.smithi157.stdout: "scrub_inotable_repaired": 0, 2023-10-19T12:59:46.656 INFO:teuthology.orchestra.run.smithi157.stdout: "scrub_dir_inodes": 0, 2023-10-19T12:59:46.656 INFO:teuthology.orchestra.run.smithi157.stdout: "scrub_dir_base_inodes": 0, 2023-10-19T12:59:46.656 INFO:teuthology.orchestra.run.smithi157.stdout: "scrub_dirfrag_rstats": 0, 2023-10-19T12:59:46.657 INFO:teuthology.orchestra.run.smithi157.stdout: "scrub_file_inodes": 0, 2023-10-19T12:59:46.657 INFO:teuthology.orchestra.run.smithi157.stdout: "handle_inode_file_caps": 0, 2023-10-19T12:59:46.657 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph_cap_op_revoke": 0, 2023-10-19T12:59:46.657 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph_cap_op_grant": 0, 2023-10-19T12:59:46.657 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph_cap_op_trunc": 0, 2023-10-19T12:59:46.657 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-19T12:59:46.658 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-19T12:59:46.658 INFO:teuthology.orchestra.run.smithi157.stdout: "handle_client_caps": 0, 2023-10-19T12:59:46.658 INFO:teuthology.orchestra.run.smithi157.stdout: "handle_client_caps_dirty": 0, 2023-10-19T12:59:46.658 INFO:teuthology.orchestra.run.smithi157.stdout: "handle_client_cap_release": 0, 2023-10-19T12:59:46.658 INFO:teuthology.orchestra.run.smithi157.stdout: "process_request_cap_release": 0 2023-10-19T12:59:46.659 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:46.659 INFO:teuthology.orchestra.run.smithi157.stdout: "mds_cache": { 2023-10-19T12:59:46.659 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_update": 0, 2023-10-19T12:59:46.659 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_update_receipt": 0, 2023-10-19T12:59:46.659 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_try_discover": 0, 2023-10-19T12:59:46.659 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_send_discover": 0, 2023-10-19T12:59:46.660 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_handle_discover": 0, 2023-10-19T12:59:46.660 INFO:teuthology.orchestra.run.smithi157.stdout: "num_strays": 0, 2023-10-19T12:59:46.660 INFO:teuthology.orchestra.run.smithi157.stdout: "num_strays_delayed": 0, 2023-10-19T12:59:46.660 INFO:teuthology.orchestra.run.smithi157.stdout: "num_strays_enqueuing": 0, 2023-10-19T12:59:46.660 INFO:teuthology.orchestra.run.smithi157.stdout: "strays_created": 0, 2023-10-19T12:59:46.660 INFO:teuthology.orchestra.run.smithi157.stdout: "strays_enqueued": 0, 2023-10-19T12:59:46.661 INFO:teuthology.orchestra.run.smithi157.stdout: "strays_reintegrated": 0, 2023-10-19T12:59:46.661 INFO:teuthology.orchestra.run.smithi157.stdout: "strays_migrated": 0, 2023-10-19T12:59:46.661 INFO:teuthology.orchestra.run.smithi157.stdout: "num_recovering_processing": 0, 2023-10-19T12:59:46.661 INFO:teuthology.orchestra.run.smithi157.stdout: "num_recovering_enqueued": 0, 2023-10-19T12:59:46.661 INFO:teuthology.orchestra.run.smithi157.stdout: "num_recovering_prioritized": 0, 2023-10-19T12:59:46.662 INFO:teuthology.orchestra.run.smithi157.stdout: "recovery_started": 0, 2023-10-19T12:59:46.662 INFO:teuthology.orchestra.run.smithi157.stdout: "recovery_completed": 0, 2023-10-19T12:59:46.662 INFO:teuthology.orchestra.run.smithi157.stdout: "ireq_enqueue_scrub": 0, 2023-10-19T12:59:46.662 INFO:teuthology.orchestra.run.smithi157.stdout: "ireq_exportdir": 0, 2023-10-19T12:59:46.662 INFO:teuthology.orchestra.run.smithi157.stdout: "ireq_flush": 0, 2023-10-19T12:59:46.662 INFO:teuthology.orchestra.run.smithi157.stdout: "ireq_fragmentdir": 0, 2023-10-19T12:59:46.663 INFO:teuthology.orchestra.run.smithi157.stdout: "ireq_fragstats": 0, 2023-10-19T12:59:46.663 INFO:teuthology.orchestra.run.smithi157.stdout: "ireq_inodestats": 0 2023-10-19T12:59:46.663 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:46.663 INFO:teuthology.orchestra.run.smithi157.stdout: "mds_log": { 2023-10-19T12:59:46.663 INFO:teuthology.orchestra.run.smithi157.stdout: "evlrg": 0, 2023-10-19T12:59:46.663 INFO:teuthology.orchestra.run.smithi157.stdout: "evadd": 0, 2023-10-19T12:59:46.664 INFO:teuthology.orchestra.run.smithi157.stdout: "evex": 0, 2023-10-19T12:59:46.664 INFO:teuthology.orchestra.run.smithi157.stdout: "evtrm": 0, 2023-10-19T12:59:46.664 INFO:teuthology.orchestra.run.smithi157.stdout: "ev": 3106, 2023-10-19T12:59:46.664 INFO:teuthology.orchestra.run.smithi157.stdout: "evexg": 0, 2023-10-19T12:59:46.664 INFO:teuthology.orchestra.run.smithi157.stdout: "evexd": 0, 2023-10-19T12:59:46.664 INFO:teuthology.orchestra.run.smithi157.stdout: "segadd": 0, 2023-10-19T12:59:46.665 INFO:teuthology.orchestra.run.smithi157.stdout: "segex": 0, 2023-10-19T12:59:46.665 INFO:teuthology.orchestra.run.smithi157.stdout: "segtrm": 0, 2023-10-19T12:59:46.665 INFO:teuthology.orchestra.run.smithi157.stdout: "seg": 6, 2023-10-19T12:59:46.665 INFO:teuthology.orchestra.run.smithi157.stdout: "segmjr": 2, 2023-10-19T12:59:46.665 INFO:teuthology.orchestra.run.smithi157.stdout: "segexg": 0, 2023-10-19T12:59:46.666 INFO:teuthology.orchestra.run.smithi157.stdout: "segexd": 0, 2023-10-19T12:59:46.666 INFO:teuthology.orchestra.run.smithi157.stdout: "expos": 4194304, 2023-10-19T12:59:46.666 INFO:teuthology.orchestra.run.smithi157.stdout: "wrpos": 12808494, 2023-10-19T12:59:46.666 INFO:teuthology.orchestra.run.smithi157.stdout: "rdpos": 12800824, 2023-10-19T12:59:46.666 INFO:teuthology.orchestra.run.smithi157.stdout: "jlat": { 2023-10-19T12:59:46.666 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:46.667 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:46.667 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:46.667 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:46.667 INFO:teuthology.orchestra.run.smithi157.stdout: "replayed": 3106 2023-10-19T12:59:46.667 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:46.668 INFO:teuthology.orchestra.run.smithi157.stdout: "mds_mem": { 2023-10-19T12:59:46.668 INFO:teuthology.orchestra.run.smithi157.stdout: "ino": 442, 2023-10-19T12:59:46.668 INFO:teuthology.orchestra.run.smithi157.stdout: "ino+": 1472, 2023-10-19T12:59:46.668 INFO:teuthology.orchestra.run.smithi157.stdout: "ino-": 1030, 2023-10-19T12:59:46.668 INFO:teuthology.orchestra.run.smithi157.stdout: "dir": 57, 2023-10-19T12:59:46.669 INFO:teuthology.orchestra.run.smithi157.stdout: "dir+": 69, 2023-10-19T12:59:46.669 INFO:teuthology.orchestra.run.smithi157.stdout: "dir-": 12, 2023-10-19T12:59:46.669 INFO:teuthology.orchestra.run.smithi157.stdout: "dn": 496, 2023-10-19T12:59:46.669 INFO:teuthology.orchestra.run.smithi157.stdout: "dn+": 1577, 2023-10-19T12:59:46.669 INFO:teuthology.orchestra.run.smithi157.stdout: "dn-": 1081, 2023-10-19T12:59:46.669 INFO:teuthology.orchestra.run.smithi157.stdout: "cap": 0, 2023-10-19T12:59:46.670 INFO:teuthology.orchestra.run.smithi157.stdout: "cap+": 0, 2023-10-19T12:59:46.670 INFO:teuthology.orchestra.run.smithi157.stdout: "cap-": 0, 2023-10-19T12:59:46.670 INFO:teuthology.orchestra.run.smithi157.stdout: "rss": 52280, 2023-10-19T12:59:46.670 INFO:teuthology.orchestra.run.smithi157.stdout: "heap": 207152 2023-10-19T12:59:46.671 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:46.671 INFO:teuthology.orchestra.run.smithi157.stdout: "mds_server": { 2023-10-19T12:59:46.671 INFO:teuthology.orchestra.run.smithi157.stdout: "dispatch_client_request": 0, 2023-10-19T12:59:46.671 INFO:teuthology.orchestra.run.smithi157.stdout: "dispatch_server_request": 0, 2023-10-19T12:59:46.671 INFO:teuthology.orchestra.run.smithi157.stdout: "handle_client_request": 0, 2023-10-19T12:59:46.671 INFO:teuthology.orchestra.run.smithi157.stdout: "handle_client_session": 0, 2023-10-19T12:59:46.672 INFO:teuthology.orchestra.run.smithi157.stdout: "handle_peer_request": 0, 2023-10-19T12:59:46.672 INFO:teuthology.orchestra.run.smithi157.stdout: "req_create_latency": { 2023-10-19T12:59:46.672 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:46.672 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:46.672 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:46.673 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:46.673 INFO:teuthology.orchestra.run.smithi157.stdout: "req_getattr_latency": { 2023-10-19T12:59:46.673 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:46.673 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:46.673 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:46.674 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:46.674 INFO:teuthology.orchestra.run.smithi157.stdout: "req_getfilelock_latency": { 2023-10-19T12:59:46.674 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:46.674 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:46.674 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:46.675 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:46.675 INFO:teuthology.orchestra.run.smithi157.stdout: "req_link_latency": { 2023-10-19T12:59:46.675 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:46.675 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:46.675 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:46.676 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:46.676 INFO:teuthology.orchestra.run.smithi157.stdout: "req_lookup_latency": { 2023-10-19T12:59:46.676 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:46.676 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:46.676 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:46.676 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:46.677 INFO:teuthology.orchestra.run.smithi157.stdout: "req_lookuphash_latency": { 2023-10-19T12:59:46.677 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:46.677 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:46.677 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:46.677 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:46.678 INFO:teuthology.orchestra.run.smithi157.stdout: "req_lookupino_latency": { 2023-10-19T12:59:46.678 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:46.678 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:46.678 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:46.678 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:46.679 INFO:teuthology.orchestra.run.smithi157.stdout: "req_lookupname_latency": { 2023-10-19T12:59:46.679 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:46.679 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:46.679 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:46.679 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:46.679 INFO:teuthology.orchestra.run.smithi157.stdout: "req_lookupparent_latency": { 2023-10-19T12:59:46.680 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:46.680 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:46.680 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:46.680 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:46.680 INFO:teuthology.orchestra.run.smithi157.stdout: "req_lookupsnap_latency": { 2023-10-19T12:59:46.680 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:46.681 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:46.681 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:46.681 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:46.681 INFO:teuthology.orchestra.run.smithi157.stdout: "req_lssnap_latency": { 2023-10-19T12:59:46.681 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:46.681 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:46.682 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:46.682 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:46.682 INFO:teuthology.orchestra.run.smithi157.stdout: "req_mkdir_latency": { 2023-10-19T12:59:46.682 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:46.682 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:46.683 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:46.683 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:46.683 INFO:teuthology.orchestra.run.smithi157.stdout: "req_mknod_latency": { 2023-10-19T12:59:46.683 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:46.683 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:46.684 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:46.684 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:46.684 INFO:teuthology.orchestra.run.smithi157.stdout: "req_mksnap_latency": { 2023-10-19T12:59:46.684 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:46.684 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:46.684 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:46.685 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:46.685 INFO:teuthology.orchestra.run.smithi157.stdout: "req_open_latency": { 2023-10-19T12:59:46.685 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:46.685 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:46.685 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:46.685 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:46.686 INFO:teuthology.orchestra.run.smithi157.stdout: "req_readdir_latency": { 2023-10-19T12:59:46.686 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:46.686 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:46.686 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:46.686 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:46.686 INFO:teuthology.orchestra.run.smithi157.stdout: "req_rename_latency": { 2023-10-19T12:59:46.687 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:46.687 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:46.687 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:46.687 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:46.687 INFO:teuthology.orchestra.run.smithi157.stdout: "req_renamesnap_latency": { 2023-10-19T12:59:46.687 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:46.688 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:46.688 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:46.688 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:46.688 INFO:teuthology.orchestra.run.smithi157.stdout: "req_snapdiff_latency": { 2023-10-19T12:59:46.688 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:46.688 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:46.689 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:46.689 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:46.689 INFO:teuthology.orchestra.run.smithi157.stdout: "req_rmdir_latency": { 2023-10-19T12:59:46.689 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:46.689 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:46.690 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:46.690 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:46.690 INFO:teuthology.orchestra.run.smithi157.stdout: "req_rmsnap_latency": { 2023-10-19T12:59:46.690 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:46.690 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:46.691 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:46.691 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:46.691 INFO:teuthology.orchestra.run.smithi157.stdout: "req_rmxattr_latency": { 2023-10-19T12:59:46.691 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:46.691 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:46.692 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:46.692 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:46.692 INFO:teuthology.orchestra.run.smithi157.stdout: "req_setattr_latency": { 2023-10-19T12:59:46.692 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:46.692 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:46.692 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:46.693 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:46.693 INFO:teuthology.orchestra.run.smithi157.stdout: "req_setdirlayout_latency": { 2023-10-19T12:59:46.693 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:46.693 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:46.693 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:46.693 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:46.694 INFO:teuthology.orchestra.run.smithi157.stdout: "req_setfilelock_latency": { 2023-10-19T12:59:46.694 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:46.694 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:46.694 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:46.694 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:46.694 INFO:teuthology.orchestra.run.smithi157.stdout: "req_setlayout_latency": { 2023-10-19T12:59:46.695 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:46.695 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:46.695 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:46.695 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:46.695 INFO:teuthology.orchestra.run.smithi157.stdout: "req_setxattr_latency": { 2023-10-19T12:59:46.696 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:46.696 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:46.696 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:46.696 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:46.696 INFO:teuthology.orchestra.run.smithi157.stdout: "req_symlink_latency": { 2023-10-19T12:59:46.697 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:46.697 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:46.697 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:46.697 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:46.697 INFO:teuthology.orchestra.run.smithi157.stdout: "req_unlink_latency": { 2023-10-19T12:59:46.697 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:46.698 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:46.698 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:46.698 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:46.698 INFO:teuthology.orchestra.run.smithi157.stdout: "cap_revoke_eviction": 0, 2023-10-19T12:59:46.698 INFO:teuthology.orchestra.run.smithi157.stdout: "cap_acquisition_throttle": 0, 2023-10-19T12:59:46.699 INFO:teuthology.orchestra.run.smithi157.stdout: "req_getvxattr_latency": { 2023-10-19T12:59:46.699 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:46.699 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:46.699 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:46.699 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-10-19T12:59:46.700 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:46.700 INFO:teuthology.orchestra.run.smithi157.stdout: "mds_sessions": { 2023-10-19T12:59:46.700 INFO:teuthology.orchestra.run.smithi157.stdout: "session_count": 1, 2023-10-19T12:59:46.700 INFO:teuthology.orchestra.run.smithi157.stdout: "session_add": 3, 2023-10-19T12:59:46.700 INFO:teuthology.orchestra.run.smithi157.stdout: "session_remove": 2, 2023-10-19T12:59:46.701 INFO:teuthology.orchestra.run.smithi157.stdout: "sessions_open": 1, 2023-10-19T12:59:46.701 INFO:teuthology.orchestra.run.smithi157.stdout: "sessions_stale": 0, 2023-10-19T12:59:46.701 INFO:teuthology.orchestra.run.smithi157.stdout: "total_load": 0, 2023-10-19T12:59:46.701 INFO:teuthology.orchestra.run.smithi157.stdout: "average_load": 0, 2023-10-19T12:59:46.701 INFO:teuthology.orchestra.run.smithi157.stdout: "avg_session_uptime": 2888, 2023-10-19T12:59:46.702 INFO:teuthology.orchestra.run.smithi157.stdout: "mdthresh_evicted": 0 2023-10-19T12:59:46.702 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:46.702 INFO:teuthology.orchestra.run.smithi157.stdout: "mempool": { 2023-10-19T12:59:46.702 INFO:teuthology.orchestra.run.smithi157.stdout: "bloom_filter_bytes": 0, 2023-10-19T12:59:46.702 INFO:teuthology.orchestra.run.smithi157.stdout: "bloom_filter_items": 0, 2023-10-19T12:59:46.702 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_alloc_bytes": 0, 2023-10-19T12:59:46.703 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_alloc_items": 0, 2023-10-19T12:59:46.703 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_data_bytes": 0, 2023-10-19T12:59:46.703 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_data_items": 0, 2023-10-19T12:59:46.703 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-19T12:59:46.703 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_onode_items": 0, 2023-10-19T12:59:46.704 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-19T12:59:46.704 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_meta_items": 0, 2023-10-19T12:59:46.704 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_other_bytes": 0, 2023-10-19T12:59:46.704 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_other_items": 0, 2023-10-19T12:59:46.704 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-19T12:59:46.705 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_buffer_items": 0, 2023-10-19T12:59:46.705 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_extent_bytes": 0, 2023-10-19T12:59:46.705 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_extent_items": 0, 2023-10-19T12:59:46.705 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_blob_bytes": 0, 2023-10-19T12:59:46.705 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_blob_items": 0, 2023-10-19T12:59:46.706 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-19T12:59:46.706 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_shared_blob_items": 0, 2023-10-19T12:59:46.706 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-19T12:59:46.706 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_inline_bl_items": 0, 2023-10-19T12:59:46.706 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_fsck_bytes": 0, 2023-10-19T12:59:46.707 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_fsck_items": 0, 2023-10-19T12:59:46.707 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_txc_bytes": 0, 2023-10-19T12:59:46.707 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_txc_items": 0, 2023-10-19T12:59:46.707 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-19T12:59:46.707 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_writing_deferred_items": 0, 2023-10-19T12:59:46.707 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_writing_bytes": 0, 2023-10-19T12:59:46.708 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_writing_items": 0, 2023-10-19T12:59:46.708 INFO:teuthology.orchestra.run.smithi157.stdout: "bluefs_bytes": 0, 2023-10-19T12:59:46.708 INFO:teuthology.orchestra.run.smithi157.stdout: "bluefs_items": 0, 2023-10-19T12:59:46.708 INFO:teuthology.orchestra.run.smithi157.stdout: "bluefs_file_reader_bytes": 0, 2023-10-19T12:59:46.708 INFO:teuthology.orchestra.run.smithi157.stdout: "bluefs_file_reader_items": 0, 2023-10-19T12:59:46.708 INFO:teuthology.orchestra.run.smithi157.stdout: "bluefs_file_writer_bytes": 0, 2023-10-19T12:59:46.709 INFO:teuthology.orchestra.run.smithi157.stdout: "bluefs_file_writer_items": 0, 2023-10-19T12:59:46.709 INFO:teuthology.orchestra.run.smithi157.stdout: "buffer_anon_bytes": 205932, 2023-10-19T12:59:46.709 INFO:teuthology.orchestra.run.smithi157.stdout: "buffer_anon_items": 478, 2023-10-19T12:59:46.709 INFO:teuthology.orchestra.run.smithi157.stdout: "buffer_meta_bytes": 0, 2023-10-19T12:59:46.709 INFO:teuthology.orchestra.run.smithi157.stdout: "buffer_meta_items": 0, 2023-10-19T12:59:46.710 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_bytes": 0, 2023-10-19T12:59:46.710 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_items": 0, 2023-10-19T12:59:46.710 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_mapbl_bytes": 0, 2023-10-19T12:59:46.710 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_mapbl_items": 0, 2023-10-19T12:59:46.710 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_pglog_bytes": 0, 2023-10-19T12:59:46.711 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_pglog_items": 0, 2023-10-19T12:59:46.711 INFO:teuthology.orchestra.run.smithi157.stdout: "osdmap_bytes": 9280, 2023-10-19T12:59:46.711 INFO:teuthology.orchestra.run.smithi157.stdout: "osdmap_items": 179, 2023-10-19T12:59:46.711 INFO:teuthology.orchestra.run.smithi157.stdout: "osdmap_mapping_bytes": 0, 2023-10-19T12:59:46.711 INFO:teuthology.orchestra.run.smithi157.stdout: "osdmap_mapping_items": 0, 2023-10-19T12:59:46.712 INFO:teuthology.orchestra.run.smithi157.stdout: "pgmap_bytes": 0, 2023-10-19T12:59:46.712 INFO:teuthology.orchestra.run.smithi157.stdout: "pgmap_items": 0, 2023-10-19T12:59:46.712 INFO:teuthology.orchestra.run.smithi157.stdout: "mds_co_bytes": 1424560, 2023-10-19T12:59:46.712 INFO:teuthology.orchestra.run.smithi157.stdout: "mds_co_items": 12763, 2023-10-19T12:59:46.712 INFO:teuthology.orchestra.run.smithi157.stdout: "unittest_1_bytes": 0, 2023-10-19T12:59:46.713 INFO:teuthology.orchestra.run.smithi157.stdout: "unittest_1_items": 0, 2023-10-19T12:59:46.713 INFO:teuthology.orchestra.run.smithi157.stdout: "unittest_2_bytes": 0, 2023-10-19T12:59:46.713 INFO:teuthology.orchestra.run.smithi157.stdout: "unittest_2_items": 0 2023-10-19T12:59:46.713 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:46.713 INFO:teuthology.orchestra.run.smithi157.stdout: "objecter": { 2023-10-19T12:59:46.713 INFO:teuthology.orchestra.run.smithi157.stdout: "op_active": 0, 2023-10-19T12:59:46.714 INFO:teuthology.orchestra.run.smithi157.stdout: "op_laggy": 0, 2023-10-19T12:59:46.714 INFO:teuthology.orchestra.run.smithi157.stdout: "op_send": 3560, 2023-10-19T12:59:46.714 INFO:teuthology.orchestra.run.smithi157.stdout: "op_send_bytes": 26, 2023-10-19T12:59:46.714 INFO:teuthology.orchestra.run.smithi157.stdout: "op_resend": 4, 2023-10-19T12:59:46.714 INFO:teuthology.orchestra.run.smithi157.stdout: "op_reply": 3560, 2023-10-19T12:59:46.715 INFO:teuthology.orchestra.run.smithi157.stdout: "op_latency": { 2023-10-19T12:59:46.715 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 3560, 2023-10-19T12:59:46.715 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 17.316707251, 2023-10-19T12:59:46.715 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.004864243 2023-10-19T12:59:46.715 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:46.715 INFO:teuthology.orchestra.run.smithi157.stdout: "op_inflight": 0, 2023-10-19T12:59:46.716 INFO:teuthology.orchestra.run.smithi157.stdout: "oplen_avg": { 2023-10-19T12:59:46.716 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 3560, 2023-10-19T12:59:46.716 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 3561 2023-10-19T12:59:46.716 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:46.716 INFO:teuthology.orchestra.run.smithi157.stdout: "op": 3560, 2023-10-19T12:59:46.716 INFO:teuthology.orchestra.run.smithi157.stdout: "op_r": 3560, 2023-10-19T12:59:46.717 INFO:teuthology.orchestra.run.smithi157.stdout: "op_w": 0, 2023-10-19T12:59:46.717 INFO:teuthology.orchestra.run.smithi157.stdout: "op_rmw": 0, 2023-10-19T12:59:46.717 INFO:teuthology.orchestra.run.smithi157.stdout: "op_pg": 0, 2023-10-19T12:59:46.717 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_stat": 2126, 2023-10-19T12:59:46.717 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_create": 0, 2023-10-19T12:59:46.718 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_read": 1431, 2023-10-19T12:59:46.718 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_write": 0, 2023-10-19T12:59:46.718 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_writefull": 0, 2023-10-19T12:59:46.718 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_writesame": 0, 2023-10-19T12:59:46.718 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_append": 0, 2023-10-19T12:59:46.719 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_zero": 0, 2023-10-19T12:59:46.719 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_truncate": 0, 2023-10-19T12:59:46.719 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_delete": 0, 2023-10-19T12:59:46.719 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_mapext": 0, 2023-10-19T12:59:46.719 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_sparse_read": 0, 2023-10-19T12:59:46.719 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_clonerange": 0, 2023-10-19T12:59:46.720 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_getxattr": 2, 2023-10-19T12:59:46.720 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_setxattr": 0, 2023-10-19T12:59:46.720 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_cmpxattr": 0, 2023-10-19T12:59:46.720 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_rmxattr": 0, 2023-10-19T12:59:46.720 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_resetxattrs": 0, 2023-10-19T12:59:46.721 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_call": 0, 2023-10-19T12:59:46.721 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_watch": 0, 2023-10-19T12:59:46.721 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_notify": 0, 2023-10-19T12:59:46.721 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_src_cmpxattr": 0, 2023-10-19T12:59:46.721 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_pgls": 0, 2023-10-19T12:59:46.721 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_pgls_filter": 0, 2023-10-19T12:59:46.722 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_other": 0, 2023-10-19T12:59:46.722 INFO:teuthology.orchestra.run.smithi157.stdout: "linger_active": 0, 2023-10-19T12:59:46.722 INFO:teuthology.orchestra.run.smithi157.stdout: "linger_send": 0, 2023-10-19T12:59:46.722 INFO:teuthology.orchestra.run.smithi157.stdout: "linger_resend": 0, 2023-10-19T12:59:46.722 INFO:teuthology.orchestra.run.smithi157.stdout: "linger_ping": 0, 2023-10-19T12:59:46.723 INFO:teuthology.orchestra.run.smithi157.stdout: "poolop_active": 0, 2023-10-19T12:59:46.723 INFO:teuthology.orchestra.run.smithi157.stdout: "poolop_send": 0, 2023-10-19T12:59:46.723 INFO:teuthology.orchestra.run.smithi157.stdout: "poolop_resend": 0, 2023-10-19T12:59:46.723 INFO:teuthology.orchestra.run.smithi157.stdout: "poolstat_active": 0, 2023-10-19T12:59:46.723 INFO:teuthology.orchestra.run.smithi157.stdout: "poolstat_send": 0, 2023-10-19T12:59:46.724 INFO:teuthology.orchestra.run.smithi157.stdout: "poolstat_resend": 0, 2023-10-19T12:59:46.724 INFO:teuthology.orchestra.run.smithi157.stdout: "statfs_active": 0, 2023-10-19T12:59:46.724 INFO:teuthology.orchestra.run.smithi157.stdout: "statfs_send": 0, 2023-10-19T12:59:46.724 INFO:teuthology.orchestra.run.smithi157.stdout: "statfs_resend": 0, 2023-10-19T12:59:46.724 INFO:teuthology.orchestra.run.smithi157.stdout: "command_active": 0, 2023-10-19T12:59:46.725 INFO:teuthology.orchestra.run.smithi157.stdout: "command_send": 0, 2023-10-19T12:59:46.725 INFO:teuthology.orchestra.run.smithi157.stdout: "command_resend": 0, 2023-10-19T12:59:46.725 INFO:teuthology.orchestra.run.smithi157.stdout: "map_epoch": 92, 2023-10-19T12:59:46.725 INFO:teuthology.orchestra.run.smithi157.stdout: "map_full": 0, 2023-10-19T12:59:46.725 INFO:teuthology.orchestra.run.smithi157.stdout: "map_inc": 4, 2023-10-19T12:59:46.725 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_sessions": 5, 2023-10-19T12:59:46.726 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_session_open": 6, 2023-10-19T12:59:46.726 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_session_close": 1, 2023-10-19T12:59:46.726 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_laggy": 0, 2023-10-19T12:59:46.726 INFO:teuthology.orchestra.run.smithi157.stdout: "omap_wr": 0, 2023-10-19T12:59:46.726 INFO:teuthology.orchestra.run.smithi157.stdout: "omap_rd": 2, 2023-10-19T12:59:46.727 INFO:teuthology.orchestra.run.smithi157.stdout: "omap_del": 0 2023-10-19T12:59:46.727 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:46.727 INFO:teuthology.orchestra.run.smithi157.stdout: "oft": { 2023-10-19T12:59:46.727 INFO:teuthology.orchestra.run.smithi157.stdout: "omap_total_objs": 0, 2023-10-19T12:59:46.727 INFO:teuthology.orchestra.run.smithi157.stdout: "omap_total_kv_pairs": 0, 2023-10-19T12:59:46.727 INFO:teuthology.orchestra.run.smithi157.stdout: "omap_total_updates": 0, 2023-10-19T12:59:46.728 INFO:teuthology.orchestra.run.smithi157.stdout: "omap_total_removes": 0 2023-10-19T12:59:46.728 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:46.728 INFO:teuthology.orchestra.run.smithi157.stdout: "osd-slow-ops": { 2023-10-19T12:59:46.728 INFO:teuthology.orchestra.run.smithi157.stdout: "slow_ops_count": 0 2023-10-19T12:59:46.728 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:46.729 INFO:teuthology.orchestra.run.smithi157.stdout: "purge_queue": { 2023-10-19T12:59:46.729 INFO:teuthology.orchestra.run.smithi157.stdout: "pq_executing_ops": 0, 2023-10-19T12:59:46.729 INFO:teuthology.orchestra.run.smithi157.stdout: "pq_executing_ops_high_water": 0, 2023-10-19T12:59:46.729 INFO:teuthology.orchestra.run.smithi157.stdout: "pq_executing": 0, 2023-10-19T12:59:46.729 INFO:teuthology.orchestra.run.smithi157.stdout: "pq_executing_high_water": 0, 2023-10-19T12:59:46.730 INFO:teuthology.orchestra.run.smithi157.stdout: "pq_executed": 0, 2023-10-19T12:59:46.730 INFO:teuthology.orchestra.run.smithi157.stdout: "pq_item_in_journal": 0 2023-10-19T12:59:46.730 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:46.730 INFO:teuthology.orchestra.run.smithi157.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-19T12:59:46.730 INFO:teuthology.orchestra.run.smithi157.stdout: "val": 0, 2023-10-19T12:59:46.731 INFO:teuthology.orchestra.run.smithi157.stdout: "max": 104857600, 2023-10-19T12:59:46.731 INFO:teuthology.orchestra.run.smithi157.stdout: "get_started": 0, 2023-10-19T12:59:46.731 INFO:teuthology.orchestra.run.smithi157.stdout: "get": 3905, 2023-10-19T12:59:46.731 INFO:teuthology.orchestra.run.smithi157.stdout: "get_sum": 9931216, 2023-10-19T12:59:46.731 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_fail": 0, 2023-10-19T12:59:46.732 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_success": 3905, 2023-10-19T12:59:46.732 INFO:teuthology.orchestra.run.smithi157.stdout: "take": 0, 2023-10-19T12:59:46.732 INFO:teuthology.orchestra.run.smithi157.stdout: "take_sum": 0, 2023-10-19T12:59:46.732 INFO:teuthology.orchestra.run.smithi157.stdout: "put": 3905, 2023-10-19T12:59:46.732 INFO:teuthology.orchestra.run.smithi157.stdout: "put_sum": 9931216, 2023-10-19T12:59:46.733 INFO:teuthology.orchestra.run.smithi157.stdout: "wait": { 2023-10-19T12:59:46.733 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:46.733 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:46.733 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:46.733 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-10-19T12:59:46.734 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:46.734 INFO:teuthology.orchestra.run.smithi157.stdout: "throttle-objecter_bytes": { 2023-10-19T12:59:46.734 INFO:teuthology.orchestra.run.smithi157.stdout: "val": 0, 2023-10-19T12:59:46.734 INFO:teuthology.orchestra.run.smithi157.stdout: "max": 104857600, 2023-10-19T12:59:46.735 INFO:teuthology.orchestra.run.smithi157.stdout: "get_started": 0, 2023-10-19T12:59:46.735 INFO:teuthology.orchestra.run.smithi157.stdout: "get": 0, 2023-10-19T12:59:46.735 INFO:teuthology.orchestra.run.smithi157.stdout: "get_sum": 0, 2023-10-19T12:59:46.735 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_fail": 0, 2023-10-19T12:59:46.735 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_success": 0, 2023-10-19T12:59:46.736 INFO:teuthology.orchestra.run.smithi157.stdout: "take": 3560, 2023-10-19T12:59:46.736 INFO:teuthology.orchestra.run.smithi157.stdout: "take_sum": 8614200, 2023-10-19T12:59:46.736 INFO:teuthology.orchestra.run.smithi157.stdout: "put": 3560, 2023-10-19T12:59:46.736 INFO:teuthology.orchestra.run.smithi157.stdout: "put_sum": 8614200, 2023-10-19T12:59:46.736 INFO:teuthology.orchestra.run.smithi157.stdout: "wait": { 2023-10-19T12:59:46.736 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:46.737 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:46.737 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:46.737 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-10-19T12:59:46.737 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:46.737 INFO:teuthology.orchestra.run.smithi157.stdout: "throttle-objecter_ops": { 2023-10-19T12:59:46.738 INFO:teuthology.orchestra.run.smithi157.stdout: "val": 0, 2023-10-19T12:59:46.738 INFO:teuthology.orchestra.run.smithi157.stdout: "max": 1024, 2023-10-19T12:59:46.738 INFO:teuthology.orchestra.run.smithi157.stdout: "get_started": 0, 2023-10-19T12:59:46.738 INFO:teuthology.orchestra.run.smithi157.stdout: "get": 0, 2023-10-19T12:59:46.739 INFO:teuthology.orchestra.run.smithi157.stdout: "get_sum": 0, 2023-10-19T12:59:46.739 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_fail": 0, 2023-10-19T12:59:46.739 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_success": 0, 2023-10-19T12:59:46.739 INFO:teuthology.orchestra.run.smithi157.stdout: "take": 3560, 2023-10-19T12:59:46.739 INFO:teuthology.orchestra.run.smithi157.stdout: "take_sum": 3560, 2023-10-19T12:59:46.739 INFO:teuthology.orchestra.run.smithi157.stdout: "put": 3560, 2023-10-19T12:59:46.740 INFO:teuthology.orchestra.run.smithi157.stdout: "put_sum": 3560, 2023-10-19T12:59:46.740 INFO:teuthology.orchestra.run.smithi157.stdout: "wait": { 2023-10-19T12:59:46.740 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:46.740 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:46.740 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:46.741 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-10-19T12:59:46.741 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:46.741 INFO:teuthology.orchestra.run.smithi157.stdout: "throttle-write_buf_throttle": { 2023-10-19T12:59:46.741 INFO:teuthology.orchestra.run.smithi157.stdout: "val": 0, 2023-10-19T12:59:46.741 INFO:teuthology.orchestra.run.smithi157.stdout: "max": 3758096384, 2023-10-19T12:59:46.742 INFO:teuthology.orchestra.run.smithi157.stdout: "get_started": 0, 2023-10-19T12:59:46.742 INFO:teuthology.orchestra.run.smithi157.stdout: "get": 0, 2023-10-19T12:59:46.742 INFO:teuthology.orchestra.run.smithi157.stdout: "get_sum": 0, 2023-10-19T12:59:46.742 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_fail": 0, 2023-10-19T12:59:46.742 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_success": 0, 2023-10-19T12:59:46.743 INFO:teuthology.orchestra.run.smithi157.stdout: "take": 0, 2023-10-19T12:59:46.743 INFO:teuthology.orchestra.run.smithi157.stdout: "take_sum": 0, 2023-10-19T12:59:46.743 INFO:teuthology.orchestra.run.smithi157.stdout: "put": 0, 2023-10-19T12:59:46.743 INFO:teuthology.orchestra.run.smithi157.stdout: "put_sum": 0, 2023-10-19T12:59:46.743 INFO:teuthology.orchestra.run.smithi157.stdout: "wait": { 2023-10-19T12:59:46.744 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:46.744 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:46.744 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:46.744 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-10-19T12:59:46.744 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:46.745 INFO:teuthology.orchestra.run.smithi157.stdout: "throttle-write_buf_throttle-0x55c632426960": { 2023-10-19T12:59:46.745 INFO:teuthology.orchestra.run.smithi157.stdout: "val": 0, 2023-10-19T12:59:46.745 INFO:teuthology.orchestra.run.smithi157.stdout: "max": 3758096384, 2023-10-19T12:59:46.745 INFO:teuthology.orchestra.run.smithi157.stdout: "get_started": 0, 2023-10-19T12:59:46.745 INFO:teuthology.orchestra.run.smithi157.stdout: "get": 0, 2023-10-19T12:59:46.746 INFO:teuthology.orchestra.run.smithi157.stdout: "get_sum": 0, 2023-10-19T12:59:46.746 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_fail": 0, 2023-10-19T12:59:46.746 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_success": 0, 2023-10-19T12:59:46.746 INFO:teuthology.orchestra.run.smithi157.stdout: "take": 0, 2023-10-19T12:59:46.746 INFO:teuthology.orchestra.run.smithi157.stdout: "take_sum": 0, 2023-10-19T12:59:46.747 INFO:teuthology.orchestra.run.smithi157.stdout: "put": 0, 2023-10-19T12:59:46.747 INFO:teuthology.orchestra.run.smithi157.stdout: "put_sum": 0, 2023-10-19T12:59:46.747 INFO:teuthology.orchestra.run.smithi157.stdout: "wait": { 2023-10-19T12:59:46.747 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:46.747 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:46.748 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:46.748 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-10-19T12:59:46.748 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-10-19T12:59:46.748 INFO:teuthology.orchestra.run.smithi157.stdout:} 2023-10-19T12:59:46.749 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:59:46 smithi195 ceph-mon[134493]: pgmap v841: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 4.7 KiB/s wr, 13 op/s 2023-10-19T12:59:47.748 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2023-10-19T12:59:47.748 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2023-10-19T12:59:47.748 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=0 2023-10-19T12:59:47.748 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=0 2023-10-19T12:59:47.749 DEBUG:tasks.check_counter:Getting stats from h 2023-10-19T12:59:47.749 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph daemon mds.h perf dump 2023-10-19T12:59:48.416 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.b/config 2023-10-19T12:59:48.478 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:59:48 smithi046 ceph-mon[98509]: pgmap v842: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2023-10-19T12:59:48.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:59:48 smithi157 ceph-mon[134109]: pgmap v842: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2023-10-19T12:59:48.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:59:48 smithi195 ceph-mon[134493]: pgmap v842: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2023-10-19T12:59:49.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:59:49 smithi046 ceph-mon[98509]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-19T12:59:49.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:59:49 smithi157 ceph-mon[134109]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-19T12:59:49.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:59:49 smithi195 ceph-mon[134493]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-19T12:59:50.478 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:59:50 smithi046 ceph-mon[98509]: pgmap v843: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 16 op/s 2023-10-19T12:59:50.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:59:50 smithi157 ceph-mon[134109]: pgmap v843: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 16 op/s 2023-10-19T12:59:50.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:59:50 smithi195 ceph-mon[134493]: pgmap v843: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 16 op/s 2023-10-19T12:59:50.882 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2023-10-19T12:59:50.883 INFO:teuthology.orchestra.run.smithi157.stdout: "AsyncMessenger::Worker-0": { 2023-10-19T12:59:50.883 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_messages": 5282784, 2023-10-19T12:59:50.883 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_messages": 5282100, 2023-10-19T12:59:50.883 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_bytes": 856675483, 2023-10-19T12:59:50.883 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_bytes": 836512944, 2023-10-19T12:59:50.884 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_created_connections": 15, 2023-10-19T12:59:50.884 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_active_connections": 4, 2023-10-19T12:59:50.884 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_total_time": 212.296461398, 2023-10-19T12:59:50.884 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_send_time": 94.104560846, 2023-10-19T12:59:50.884 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_recv_time": 148.607965336, 2023-10-19T12:59:50.885 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_fast_dispatch_time": 0.011015221, 2023-10-19T12:59:50.885 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_messages_queue_lat": { 2023-10-19T12:59:50.885 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 5282098, 2023-10-19T12:59:50.885 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 76.289725538, 2023-10-19T12:59:50.885 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000014443 2023-10-19T12:59:50.885 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:50.886 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_handle_ack_lat": { 2023-10-19T12:59:50.886 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 10318770, 2023-10-19T12:59:50.886 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 1.117424035, 2023-10-19T12:59:50.886 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000108 2023-10-19T12:59:50.886 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:50.887 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-19T12:59:50.887 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_encrypted_bytes": 0 2023-10-19T12:59:50.887 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:50.887 INFO:teuthology.orchestra.run.smithi157.stdout: "AsyncMessenger::Worker-1": { 2023-10-19T12:59:50.887 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_messages": 598, 2023-10-19T12:59:50.888 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_messages": 808, 2023-10-19T12:59:50.888 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_bytes": 484577, 2023-10-19T12:59:50.888 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_bytes": 1001791, 2023-10-19T12:59:50.888 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_created_connections": 10, 2023-10-19T12:59:50.888 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_active_connections": 7, 2023-10-19T12:59:50.888 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_total_time": 0.044014221, 2023-10-19T12:59:50.889 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_send_time": 0.019670607, 2023-10-19T12:59:50.889 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_recv_time": 0.025803686, 2023-10-19T12:59:50.889 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_fast_dispatch_time": 0.001696570, 2023-10-19T12:59:50.889 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_messages_queue_lat": { 2023-10-19T12:59:50.889 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 807, 2023-10-19T12:59:50.890 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.265229593, 2023-10-19T12:59:50.890 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000328661 2023-10-19T12:59:50.890 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:50.890 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_handle_ack_lat": { 2023-10-19T12:59:50.890 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 909, 2023-10-19T12:59:50.891 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000179422, 2023-10-19T12:59:50.891 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000197 2023-10-19T12:59:50.891 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:50.891 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_encrypted_bytes": 3312, 2023-10-19T12:59:50.891 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_encrypted_bytes": 562032 2023-10-19T12:59:50.892 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:50.892 INFO:teuthology.orchestra.run.smithi157.stdout: "AsyncMessenger::Worker-2": { 2023-10-19T12:59:50.892 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_messages": 667, 2023-10-19T12:59:50.892 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_messages": 640, 2023-10-19T12:59:50.892 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_bytes": 939987, 2023-10-19T12:59:50.893 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_bytes": 451997, 2023-10-19T12:59:50.893 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_created_connections": 9, 2023-10-19T12:59:50.893 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_active_connections": 6, 2023-10-19T12:59:50.893 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_total_time": 0.059242110, 2023-10-19T12:59:50.893 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_send_time": 0.020518811, 2023-10-19T12:59:50.893 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_recv_time": 0.032746549, 2023-10-19T12:59:50.894 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_fast_dispatch_time": 0.009788016, 2023-10-19T12:59:50.894 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_messages_queue_lat": { 2023-10-19T12:59:50.894 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 639, 2023-10-19T12:59:50.894 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.196218909, 2023-10-19T12:59:50.894 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000307071 2023-10-19T12:59:50.895 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:50.895 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_handle_ack_lat": { 2023-10-19T12:59:50.895 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 367, 2023-10-19T12:59:50.895 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000081625, 2023-10-19T12:59:50.895 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000222 2023-10-19T12:59:50.896 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:50.896 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_encrypted_bytes": 713808, 2023-10-19T12:59:50.896 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_encrypted_bytes": 189408 2023-10-19T12:59:50.896 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:50.896 INFO:teuthology.orchestra.run.smithi157.stdout: "cct": { 2023-10-19T12:59:50.897 INFO:teuthology.orchestra.run.smithi157.stdout: "total_workers": 1, 2023-10-19T12:59:50.897 INFO:teuthology.orchestra.run.smithi157.stdout: "unhealthy_workers": 0 2023-10-19T12:59:50.897 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:50.897 INFO:teuthology.orchestra.run.smithi157.stdout: "finisher-MDSRank": { 2023-10-19T12:59:50.897 INFO:teuthology.orchestra.run.smithi157.stdout: "queue_len": 0, 2023-10-19T12:59:50.897 INFO:teuthology.orchestra.run.smithi157.stdout: "complete_latency": { 2023-10-19T12:59:50.898 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 504, 2023-10-19T12:59:50.898 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.118953568, 2023-10-19T12:59:50.898 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000236018 2023-10-19T12:59:50.898 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-10-19T12:59:50.898 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:50.899 INFO:teuthology.orchestra.run.smithi157.stdout: "finisher-PurgeQueue": { 2023-10-19T12:59:50.899 INFO:teuthology.orchestra.run.smithi157.stdout: "queue_len": 0, 2023-10-19T12:59:50.899 INFO:teuthology.orchestra.run.smithi157.stdout: "complete_latency": { 2023-10-19T12:59:50.899 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 2, 2023-10-19T12:59:50.899 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000012883, 2023-10-19T12:59:50.900 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000006441 2023-10-19T12:59:50.900 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-10-19T12:59:50.900 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:50.900 INFO:teuthology.orchestra.run.smithi157.stdout: "mds": { 2023-10-19T12:59:50.900 INFO:teuthology.orchestra.run.smithi157.stdout: "request": 212, 2023-10-19T12:59:50.901 INFO:teuthology.orchestra.run.smithi157.stdout: "reply": 204, 2023-10-19T12:59:50.901 INFO:teuthology.orchestra.run.smithi157.stdout: "reply_latency": { 2023-10-19T12:59:50.901 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 204, 2023-10-19T12:59:50.901 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.105972933, 2023-10-19T12:59:50.901 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000519475 2023-10-19T12:59:50.902 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:50.902 INFO:teuthology.orchestra.run.smithi157.stdout: "slow_reply": 0, 2023-10-19T12:59:50.902 INFO:teuthology.orchestra.run.smithi157.stdout: "forward": 8, 2023-10-19T12:59:50.902 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_fetch_complete": 0, 2023-10-19T12:59:50.902 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_fetch_keys": 0, 2023-10-19T12:59:50.902 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_commit": 11, 2023-10-19T12:59:50.903 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_split": 0, 2023-10-19T12:59:50.903 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_merge": 0, 2023-10-19T12:59:50.903 INFO:teuthology.orchestra.run.smithi157.stdout: "inodes": 252, 2023-10-19T12:59:50.903 INFO:teuthology.orchestra.run.smithi157.stdout: "inodes_top": 6, 2023-10-19T12:59:50.903 INFO:teuthology.orchestra.run.smithi157.stdout: "inodes_bottom": 236, 2023-10-19T12:59:50.903 INFO:teuthology.orchestra.run.smithi157.stdout: "inodes_pin_tail": 10, 2023-10-19T12:59:50.904 INFO:teuthology.orchestra.run.smithi157.stdout: "inodes_pinned": 241, 2023-10-19T12:59:50.904 INFO:teuthology.orchestra.run.smithi157.stdout: "inodes_expired": 92, 2023-10-19T12:59:50.904 INFO:teuthology.orchestra.run.smithi157.stdout: "inodes_with_caps": 223, 2023-10-19T12:59:50.904 INFO:teuthology.orchestra.run.smithi157.stdout: "caps": 223, 2023-10-19T12:59:50.904 INFO:teuthology.orchestra.run.smithi157.stdout: "subtrees": 15, 2023-10-19T12:59:50.905 INFO:teuthology.orchestra.run.smithi157.stdout: "traverse": 640, 2023-10-19T12:59:50.905 INFO:teuthology.orchestra.run.smithi157.stdout: "traverse_hit": 577, 2023-10-19T12:59:50.905 INFO:teuthology.orchestra.run.smithi157.stdout: "traverse_forward": 8, 2023-10-19T12:59:50.905 INFO:teuthology.orchestra.run.smithi157.stdout: "traverse_discover": 20, 2023-10-19T12:59:50.905 INFO:teuthology.orchestra.run.smithi157.stdout: "traverse_dir_fetch": 0, 2023-10-19T12:59:50.905 INFO:teuthology.orchestra.run.smithi157.stdout: "traverse_remote_ino": 0, 2023-10-19T12:59:50.906 INFO:teuthology.orchestra.run.smithi157.stdout: "traverse_lock": 0, 2023-10-19T12:59:50.906 INFO:teuthology.orchestra.run.smithi157.stdout: "load_cent": 383, 2023-10-19T12:59:50.906 INFO:teuthology.orchestra.run.smithi157.stdout: "q": 0, 2023-10-19T12:59:50.906 INFO:teuthology.orchestra.run.smithi157.stdout: "exported": 2, 2023-10-19T12:59:50.906 INFO:teuthology.orchestra.run.smithi157.stdout: "exported_inodes": 89, 2023-10-19T12:59:50.907 INFO:teuthology.orchestra.run.smithi157.stdout: "imported": 8, 2023-10-19T12:59:50.907 INFO:teuthology.orchestra.run.smithi157.stdout: "imported_inodes": 312, 2023-10-19T12:59:50.907 INFO:teuthology.orchestra.run.smithi157.stdout: "openino_dir_fetch": 0, 2023-10-19T12:59:50.907 INFO:teuthology.orchestra.run.smithi157.stdout: "openino_backtrace_fetch": 156, 2023-10-19T12:59:50.907 INFO:teuthology.orchestra.run.smithi157.stdout: "openino_peer_discover": 0, 2023-10-19T12:59:50.907 INFO:teuthology.orchestra.run.smithi157.stdout: "root_rfiles": 1037, 2023-10-19T12:59:50.908 INFO:teuthology.orchestra.run.smithi157.stdout: "root_rbytes": 1633283982, 2023-10-19T12:59:50.908 INFO:teuthology.orchestra.run.smithi157.stdout: "root_rsnaps": 0, 2023-10-19T12:59:50.908 INFO:teuthology.orchestra.run.smithi157.stdout: "scrub_backtrace_fetch": 156, 2023-10-19T12:59:50.908 INFO:teuthology.orchestra.run.smithi157.stdout: "scrub_set_tag": 0, 2023-10-19T12:59:50.908 INFO:teuthology.orchestra.run.smithi157.stdout: "scrub_backtrace_repaired": 0, 2023-10-19T12:59:50.909 INFO:teuthology.orchestra.run.smithi157.stdout: "scrub_inotable_repaired": 0, 2023-10-19T12:59:50.909 INFO:teuthology.orchestra.run.smithi157.stdout: "scrub_dir_inodes": 0, 2023-10-19T12:59:50.909 INFO:teuthology.orchestra.run.smithi157.stdout: "scrub_dir_base_inodes": 0, 2023-10-19T12:59:50.909 INFO:teuthology.orchestra.run.smithi157.stdout: "scrub_dirfrag_rstats": 0, 2023-10-19T12:59:50.909 INFO:teuthology.orchestra.run.smithi157.stdout: "scrub_file_inodes": 156, 2023-10-19T12:59:50.909 INFO:teuthology.orchestra.run.smithi157.stdout: "handle_inode_file_caps": 0, 2023-10-19T12:59:50.910 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph_cap_op_revoke": 1, 2023-10-19T12:59:50.910 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph_cap_op_grant": 27, 2023-10-19T12:59:50.910 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph_cap_op_trunc": 0, 2023-10-19T12:59:50.910 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-19T12:59:50.910 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-19T12:59:50.911 INFO:teuthology.orchestra.run.smithi157.stdout: "handle_client_caps": 103, 2023-10-19T12:59:50.911 INFO:teuthology.orchestra.run.smithi157.stdout: "handle_client_caps_dirty": 68, 2023-10-19T12:59:50.911 INFO:teuthology.orchestra.run.smithi157.stdout: "handle_client_cap_release": 7, 2023-10-19T12:59:50.911 INFO:teuthology.orchestra.run.smithi157.stdout: "process_request_cap_release": 5 2023-10-19T12:59:50.911 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:50.911 INFO:teuthology.orchestra.run.smithi157.stdout: "mds_cache": { 2023-10-19T12:59:50.912 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_update": 12, 2023-10-19T12:59:50.912 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_update_receipt": 478, 2023-10-19T12:59:50.912 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_try_discover": 249, 2023-10-19T12:59:50.912 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_send_discover": 430, 2023-10-19T12:59:50.912 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_handle_discover": 12, 2023-10-19T12:59:50.912 INFO:teuthology.orchestra.run.smithi157.stdout: "num_strays": 0, 2023-10-19T12:59:50.913 INFO:teuthology.orchestra.run.smithi157.stdout: "num_strays_delayed": 0, 2023-10-19T12:59:50.913 INFO:teuthology.orchestra.run.smithi157.stdout: "num_strays_enqueuing": 0, 2023-10-19T12:59:50.913 INFO:teuthology.orchestra.run.smithi157.stdout: "strays_created": 0, 2023-10-19T12:59:50.913 INFO:teuthology.orchestra.run.smithi157.stdout: "strays_enqueued": 0, 2023-10-19T12:59:50.913 INFO:teuthology.orchestra.run.smithi157.stdout: "strays_reintegrated": 0, 2023-10-19T12:59:50.913 INFO:teuthology.orchestra.run.smithi157.stdout: "strays_migrated": 0, 2023-10-19T12:59:50.914 INFO:teuthology.orchestra.run.smithi157.stdout: "num_recovering_processing": 0, 2023-10-19T12:59:50.914 INFO:teuthology.orchestra.run.smithi157.stdout: "num_recovering_enqueued": 0, 2023-10-19T12:59:50.914 INFO:teuthology.orchestra.run.smithi157.stdout: "num_recovering_prioritized": 0, 2023-10-19T12:59:50.914 INFO:teuthology.orchestra.run.smithi157.stdout: "recovery_started": 0, 2023-10-19T12:59:50.914 INFO:teuthology.orchestra.run.smithi157.stdout: "recovery_completed": 0, 2023-10-19T12:59:50.915 INFO:teuthology.orchestra.run.smithi157.stdout: "ireq_enqueue_scrub": 0, 2023-10-19T12:59:50.915 INFO:teuthology.orchestra.run.smithi157.stdout: "ireq_exportdir": 2, 2023-10-19T12:59:50.915 INFO:teuthology.orchestra.run.smithi157.stdout: "ireq_flush": 0, 2023-10-19T12:59:50.915 INFO:teuthology.orchestra.run.smithi157.stdout: "ireq_fragmentdir": 0, 2023-10-19T12:59:50.915 INFO:teuthology.orchestra.run.smithi157.stdout: "ireq_fragstats": 0, 2023-10-19T12:59:50.915 INFO:teuthology.orchestra.run.smithi157.stdout: "ireq_inodestats": 0 2023-10-19T12:59:50.916 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:50.916 INFO:teuthology.orchestra.run.smithi157.stdout: "mds_log": { 2023-10-19T12:59:50.916 INFO:teuthology.orchestra.run.smithi157.stdout: "evlrg": 0, 2023-10-19T12:59:50.916 INFO:teuthology.orchestra.run.smithi157.stdout: "evadd": 631, 2023-10-19T12:59:50.916 INFO:teuthology.orchestra.run.smithi157.stdout: "evex": 0, 2023-10-19T12:59:50.916 INFO:teuthology.orchestra.run.smithi157.stdout: "evtrm": 0, 2023-10-19T12:59:50.917 INFO:teuthology.orchestra.run.smithi157.stdout: "ev": 631, 2023-10-19T12:59:50.917 INFO:teuthology.orchestra.run.smithi157.stdout: "evexg": 0, 2023-10-19T12:59:50.917 INFO:teuthology.orchestra.run.smithi157.stdout: "evexd": 0, 2023-10-19T12:59:50.917 INFO:teuthology.orchestra.run.smithi157.stdout: "segadd": 2, 2023-10-19T12:59:50.917 INFO:teuthology.orchestra.run.smithi157.stdout: "segex": 0, 2023-10-19T12:59:50.917 INFO:teuthology.orchestra.run.smithi157.stdout: "segtrm": 0, 2023-10-19T12:59:50.918 INFO:teuthology.orchestra.run.smithi157.stdout: "seg": 2, 2023-10-19T12:59:50.918 INFO:teuthology.orchestra.run.smithi157.stdout: "segmjr": 2, 2023-10-19T12:59:50.918 INFO:teuthology.orchestra.run.smithi157.stdout: "segexg": 0, 2023-10-19T12:59:50.918 INFO:teuthology.orchestra.run.smithi157.stdout: "segexd": 0, 2023-10-19T12:59:50.918 INFO:teuthology.orchestra.run.smithi157.stdout: "expos": 4194304, 2023-10-19T12:59:50.919 INFO:teuthology.orchestra.run.smithi157.stdout: "wrpos": 5207948, 2023-10-19T12:59:50.919 INFO:teuthology.orchestra.run.smithi157.stdout: "rdpos": 0, 2023-10-19T12:59:50.919 INFO:teuthology.orchestra.run.smithi157.stdout: "jlat": { 2023-10-19T12:59:50.919 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 151, 2023-10-19T12:59:50.919 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 3.767115563, 2023-10-19T12:59:50.919 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.024947785 2023-10-19T12:59:50.920 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:50.920 INFO:teuthology.orchestra.run.smithi157.stdout: "replayed": 0 2023-10-19T12:59:50.920 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:50.920 INFO:teuthology.orchestra.run.smithi157.stdout: "mds_mem": { 2023-10-19T12:59:50.920 INFO:teuthology.orchestra.run.smithi157.stdout: "ino": 252, 2023-10-19T12:59:50.921 INFO:teuthology.orchestra.run.smithi157.stdout: "ino+": 341, 2023-10-19T12:59:50.921 INFO:teuthology.orchestra.run.smithi157.stdout: "ino-": 89, 2023-10-19T12:59:50.921 INFO:teuthology.orchestra.run.smithi157.stdout: "dir": 43, 2023-10-19T12:59:50.921 INFO:teuthology.orchestra.run.smithi157.stdout: "dir+": 245, 2023-10-19T12:59:50.921 INFO:teuthology.orchestra.run.smithi157.stdout: "dir-": 202, 2023-10-19T12:59:50.921 INFO:teuthology.orchestra.run.smithi157.stdout: "dn": 252, 2023-10-19T12:59:50.922 INFO:teuthology.orchestra.run.smithi157.stdout: "dn+": 347, 2023-10-19T12:59:50.922 INFO:teuthology.orchestra.run.smithi157.stdout: "dn-": 95, 2023-10-19T12:59:50.922 INFO:teuthology.orchestra.run.smithi157.stdout: "cap": 223, 2023-10-19T12:59:50.922 INFO:teuthology.orchestra.run.smithi157.stdout: "cap+": 520, 2023-10-19T12:59:50.922 INFO:teuthology.orchestra.run.smithi157.stdout: "cap-": 297, 2023-10-19T12:59:50.923 INFO:teuthology.orchestra.run.smithi157.stdout: "rss": 55580, 2023-10-19T12:59:50.923 INFO:teuthology.orchestra.run.smithi157.stdout: "heap": 198960 2023-10-19T12:59:50.923 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:50.923 INFO:teuthology.orchestra.run.smithi157.stdout: "mds_server": { 2023-10-19T12:59:50.923 INFO:teuthology.orchestra.run.smithi157.stdout: "dispatch_client_request": 215, 2023-10-19T12:59:50.924 INFO:teuthology.orchestra.run.smithi157.stdout: "dispatch_server_request": 0, 2023-10-19T12:59:50.924 INFO:teuthology.orchestra.run.smithi157.stdout: "handle_client_request": 212, 2023-10-19T12:59:50.924 INFO:teuthology.orchestra.run.smithi157.stdout: "handle_client_session": 13, 2023-10-19T12:59:50.924 INFO:teuthology.orchestra.run.smithi157.stdout: "handle_peer_request": 1, 2023-10-19T12:59:50.924 INFO:teuthology.orchestra.run.smithi157.stdout: "req_create_latency": { 2023-10-19T12:59:50.924 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 1, 2023-10-19T12:59:50.925 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.004478888, 2023-10-19T12:59:50.925 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.004478888 2023-10-19T12:59:50.925 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:50.925 INFO:teuthology.orchestra.run.smithi157.stdout: "req_getattr_latency": { 2023-10-19T12:59:50.925 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:50.926 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:50.926 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:50.926 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:50.926 INFO:teuthology.orchestra.run.smithi157.stdout: "req_getfilelock_latency": { 2023-10-19T12:59:50.926 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:50.927 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:50.927 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:50.927 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:50.927 INFO:teuthology.orchestra.run.smithi157.stdout: "req_link_latency": { 2023-10-19T12:59:50.927 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:50.928 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:50.928 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:50.928 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:50.928 INFO:teuthology.orchestra.run.smithi157.stdout: "req_lookup_latency": { 2023-10-19T12:59:50.928 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 177, 2023-10-19T12:59:50.929 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.081209607, 2023-10-19T12:59:50.929 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000458811 2023-10-19T12:59:50.929 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:50.929 INFO:teuthology.orchestra.run.smithi157.stdout: "req_lookuphash_latency": { 2023-10-19T12:59:50.929 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:50.930 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:50.930 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:50.930 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:50.930 INFO:teuthology.orchestra.run.smithi157.stdout: "req_lookupino_latency": { 2023-10-19T12:59:50.930 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 1, 2023-10-19T12:59:50.931 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000161427, 2023-10-19T12:59:50.931 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000161427 2023-10-19T12:59:50.931 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:50.931 INFO:teuthology.orchestra.run.smithi157.stdout: "req_lookupname_latency": { 2023-10-19T12:59:50.931 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:50.931 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:50.932 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:50.932 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:50.932 INFO:teuthology.orchestra.run.smithi157.stdout: "req_lookupparent_latency": { 2023-10-19T12:59:50.932 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:50.932 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:50.933 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:50.933 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:50.933 INFO:teuthology.orchestra.run.smithi157.stdout: "req_lookupsnap_latency": { 2023-10-19T12:59:50.933 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:50.933 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:50.934 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:50.934 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:50.934 INFO:teuthology.orchestra.run.smithi157.stdout: "req_lssnap_latency": { 2023-10-19T12:59:50.934 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:50.934 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:50.935 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:50.935 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:50.935 INFO:teuthology.orchestra.run.smithi157.stdout: "req_mkdir_latency": { 2023-10-19T12:59:50.935 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:50.935 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:50.936 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:50.936 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:50.936 INFO:teuthology.orchestra.run.smithi157.stdout: "req_mknod_latency": { 2023-10-19T12:59:50.936 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:50.936 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:50.936 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:50.937 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:50.937 INFO:teuthology.orchestra.run.smithi157.stdout: "req_mksnap_latency": { 2023-10-19T12:59:50.937 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:50.937 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:50.937 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:50.937 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:50.938 INFO:teuthology.orchestra.run.smithi157.stdout: "req_open_latency": { 2023-10-19T12:59:50.938 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 19, 2023-10-19T12:59:50.938 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.013534771, 2023-10-19T12:59:50.938 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000712356 2023-10-19T12:59:50.938 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:50.939 INFO:teuthology.orchestra.run.smithi157.stdout: "req_readdir_latency": { 2023-10-19T12:59:50.939 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 6, 2023-10-19T12:59:50.939 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.006588240, 2023-10-19T12:59:50.939 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.001098040 2023-10-19T12:59:50.939 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:50.939 INFO:teuthology.orchestra.run.smithi157.stdout: "req_rename_latency": { 2023-10-19T12:59:50.940 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:50.940 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:50.940 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:50.940 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:50.940 INFO:teuthology.orchestra.run.smithi157.stdout: "req_renamesnap_latency": { 2023-10-19T12:59:50.940 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:50.941 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:50.941 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:50.941 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:50.941 INFO:teuthology.orchestra.run.smithi157.stdout: "req_snapdiff_latency": { 2023-10-19T12:59:50.941 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:50.942 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:50.942 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:50.942 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:50.942 INFO:teuthology.orchestra.run.smithi157.stdout: "req_rmdir_latency": { 2023-10-19T12:59:50.942 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:50.942 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:50.943 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:50.943 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:50.943 INFO:teuthology.orchestra.run.smithi157.stdout: "req_rmsnap_latency": { 2023-10-19T12:59:50.943 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:50.943 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:50.944 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:50.944 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:50.944 INFO:teuthology.orchestra.run.smithi157.stdout: "req_rmxattr_latency": { 2023-10-19T12:59:50.944 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:50.944 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:50.944 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:50.945 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:50.945 INFO:teuthology.orchestra.run.smithi157.stdout: "req_setattr_latency": { 2023-10-19T12:59:50.945 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:50.945 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:50.945 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:50.946 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:50.946 INFO:teuthology.orchestra.run.smithi157.stdout: "req_setdirlayout_latency": { 2023-10-19T12:59:50.946 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:50.946 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:50.946 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:50.947 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:50.947 INFO:teuthology.orchestra.run.smithi157.stdout: "req_setfilelock_latency": { 2023-10-19T12:59:50.947 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:50.947 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:50.947 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:50.948 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:50.948 INFO:teuthology.orchestra.run.smithi157.stdout: "req_setlayout_latency": { 2023-10-19T12:59:50.948 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:50.948 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:50.948 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:50.948 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:50.949 INFO:teuthology.orchestra.run.smithi157.stdout: "req_setxattr_latency": { 2023-10-19T12:59:50.949 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:50.949 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:50.949 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:50.949 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:50.950 INFO:teuthology.orchestra.run.smithi157.stdout: "req_symlink_latency": { 2023-10-19T12:59:50.950 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:50.950 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:50.950 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:50.950 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:50.951 INFO:teuthology.orchestra.run.smithi157.stdout: "req_unlink_latency": { 2023-10-19T12:59:50.951 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:50.951 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:50.951 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:50.951 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:50.952 INFO:teuthology.orchestra.run.smithi157.stdout: "cap_revoke_eviction": 0, 2023-10-19T12:59:50.952 INFO:teuthology.orchestra.run.smithi157.stdout: "cap_acquisition_throttle": 0, 2023-10-19T12:59:50.952 INFO:teuthology.orchestra.run.smithi157.stdout: "req_getvxattr_latency": { 2023-10-19T12:59:50.952 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:50.952 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:50.953 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:50.953 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-10-19T12:59:50.953 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:50.953 INFO:teuthology.orchestra.run.smithi157.stdout: "mds_sessions": { 2023-10-19T12:59:50.953 INFO:teuthology.orchestra.run.smithi157.stdout: "session_count": 1, 2023-10-19T12:59:50.954 INFO:teuthology.orchestra.run.smithi157.stdout: "session_add": 1, 2023-10-19T12:59:50.954 INFO:teuthology.orchestra.run.smithi157.stdout: "session_remove": 0, 2023-10-19T12:59:50.954 INFO:teuthology.orchestra.run.smithi157.stdout: "sessions_open": 1, 2023-10-19T12:59:50.954 INFO:teuthology.orchestra.run.smithi157.stdout: "sessions_stale": 0, 2023-10-19T12:59:50.954 INFO:teuthology.orchestra.run.smithi157.stdout: "total_load": 23, 2023-10-19T12:59:50.955 INFO:teuthology.orchestra.run.smithi157.stdout: "average_load": 23, 2023-10-19T12:59:50.955 INFO:teuthology.orchestra.run.smithi157.stdout: "avg_session_uptime": 969, 2023-10-19T12:59:50.955 INFO:teuthology.orchestra.run.smithi157.stdout: "mdthresh_evicted": 0 2023-10-19T12:59:50.955 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:50.955 INFO:teuthology.orchestra.run.smithi157.stdout: "mempool": { 2023-10-19T12:59:50.955 INFO:teuthology.orchestra.run.smithi157.stdout: "bloom_filter_bytes": 0, 2023-10-19T12:59:50.956 INFO:teuthology.orchestra.run.smithi157.stdout: "bloom_filter_items": 0, 2023-10-19T12:59:50.956 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_alloc_bytes": 0, 2023-10-19T12:59:50.956 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_alloc_items": 0, 2023-10-19T12:59:50.956 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_data_bytes": 0, 2023-10-19T12:59:50.956 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_data_items": 0, 2023-10-19T12:59:50.957 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-19T12:59:50.957 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_onode_items": 0, 2023-10-19T12:59:50.957 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-19T12:59:50.957 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_meta_items": 0, 2023-10-19T12:59:50.957 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_other_bytes": 0, 2023-10-19T12:59:50.958 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_other_items": 0, 2023-10-19T12:59:50.958 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-19T12:59:50.958 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_buffer_items": 0, 2023-10-19T12:59:50.958 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_extent_bytes": 0, 2023-10-19T12:59:50.958 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_extent_items": 0, 2023-10-19T12:59:50.959 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_blob_bytes": 0, 2023-10-19T12:59:50.959 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_blob_items": 0, 2023-10-19T12:59:50.959 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-19T12:59:50.959 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_shared_blob_items": 0, 2023-10-19T12:59:50.959 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-19T12:59:50.959 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_inline_bl_items": 0, 2023-10-19T12:59:50.960 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_fsck_bytes": 0, 2023-10-19T12:59:50.960 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_fsck_items": 0, 2023-10-19T12:59:50.960 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_txc_bytes": 0, 2023-10-19T12:59:50.960 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_txc_items": 0, 2023-10-19T12:59:50.960 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-19T12:59:50.961 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_writing_deferred_items": 0, 2023-10-19T12:59:50.961 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_writing_bytes": 0, 2023-10-19T12:59:50.961 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_writing_items": 0, 2023-10-19T12:59:50.961 INFO:teuthology.orchestra.run.smithi157.stdout: "bluefs_bytes": 0, 2023-10-19T12:59:50.961 INFO:teuthology.orchestra.run.smithi157.stdout: "bluefs_items": 0, 2023-10-19T12:59:50.962 INFO:teuthology.orchestra.run.smithi157.stdout: "bluefs_file_reader_bytes": 0, 2023-10-19T12:59:50.962 INFO:teuthology.orchestra.run.smithi157.stdout: "bluefs_file_reader_items": 0, 2023-10-19T12:59:50.962 INFO:teuthology.orchestra.run.smithi157.stdout: "bluefs_file_writer_bytes": 0, 2023-10-19T12:59:50.962 INFO:teuthology.orchestra.run.smithi157.stdout: "bluefs_file_writer_items": 0, 2023-10-19T12:59:50.962 INFO:teuthology.orchestra.run.smithi157.stdout: "buffer_anon_bytes": 304863, 2023-10-19T12:59:50.963 INFO:teuthology.orchestra.run.smithi157.stdout: "buffer_anon_items": 360, 2023-10-19T12:59:50.963 INFO:teuthology.orchestra.run.smithi157.stdout: "buffer_meta_bytes": 0, 2023-10-19T12:59:50.963 INFO:teuthology.orchestra.run.smithi157.stdout: "buffer_meta_items": 0, 2023-10-19T12:59:50.963 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_bytes": 0, 2023-10-19T12:59:50.963 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_items": 0, 2023-10-19T12:59:50.963 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_mapbl_bytes": 0, 2023-10-19T12:59:50.964 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_mapbl_items": 0, 2023-10-19T12:59:50.964 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_pglog_bytes": 0, 2023-10-19T12:59:50.964 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_pglog_items": 0, 2023-10-19T12:59:50.964 INFO:teuthology.orchestra.run.smithi157.stdout: "osdmap_bytes": 9280, 2023-10-19T12:59:50.964 INFO:teuthology.orchestra.run.smithi157.stdout: "osdmap_items": 179, 2023-10-19T12:59:50.965 INFO:teuthology.orchestra.run.smithi157.stdout: "osdmap_mapping_bytes": 0, 2023-10-19T12:59:50.965 INFO:teuthology.orchestra.run.smithi157.stdout: "osdmap_mapping_items": 0, 2023-10-19T12:59:50.965 INFO:teuthology.orchestra.run.smithi157.stdout: "pgmap_bytes": 0, 2023-10-19T12:59:50.965 INFO:teuthology.orchestra.run.smithi157.stdout: "pgmap_items": 0, 2023-10-19T12:59:50.965 INFO:teuthology.orchestra.run.smithi157.stdout: "mds_co_bytes": 901617, 2023-10-19T12:59:50.965 INFO:teuthology.orchestra.run.smithi157.stdout: "mds_co_items": 9270, 2023-10-19T12:59:50.966 INFO:teuthology.orchestra.run.smithi157.stdout: "unittest_1_bytes": 0, 2023-10-19T12:59:50.966 INFO:teuthology.orchestra.run.smithi157.stdout: "unittest_1_items": 0, 2023-10-19T12:59:50.966 INFO:teuthology.orchestra.run.smithi157.stdout: "unittest_2_bytes": 0, 2023-10-19T12:59:50.966 INFO:teuthology.orchestra.run.smithi157.stdout: "unittest_2_items": 0 2023-10-19T12:59:50.966 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:50.967 INFO:teuthology.orchestra.run.smithi157.stdout: "objecter": { 2023-10-19T12:59:50.967 INFO:teuthology.orchestra.run.smithi157.stdout: "op_active": 0, 2023-10-19T12:59:50.967 INFO:teuthology.orchestra.run.smithi157.stdout: "op_laggy": 0, 2023-10-19T12:59:50.967 INFO:teuthology.orchestra.run.smithi157.stdout: "op_send": 403, 2023-10-19T12:59:50.967 INFO:teuthology.orchestra.run.smithi157.stdout: "op_send_bytes": 1053734, 2023-10-19T12:59:50.968 INFO:teuthology.orchestra.run.smithi157.stdout: "op_resend": 33, 2023-10-19T12:59:50.968 INFO:teuthology.orchestra.run.smithi157.stdout: "op_reply": 403, 2023-10-19T12:59:50.968 INFO:teuthology.orchestra.run.smithi157.stdout: "op_latency": { 2023-10-19T12:59:50.968 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 403, 2023-10-19T12:59:50.968 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 7.378872910, 2023-10-19T12:59:50.968 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.018309858 2023-10-19T12:59:50.969 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:50.969 INFO:teuthology.orchestra.run.smithi157.stdout: "op_inflight": 0, 2023-10-19T12:59:50.969 INFO:teuthology.orchestra.run.smithi157.stdout: "oplen_avg": { 2023-10-19T12:59:50.969 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 403, 2023-10-19T12:59:50.969 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 442 2023-10-19T12:59:50.970 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:50.970 INFO:teuthology.orchestra.run.smithi157.stdout: "op": 403, 2023-10-19T12:59:50.970 INFO:teuthology.orchestra.run.smithi157.stdout: "op_r": 156, 2023-10-19T12:59:50.970 INFO:teuthology.orchestra.run.smithi157.stdout: "op_w": 247, 2023-10-19T12:59:50.970 INFO:teuthology.orchestra.run.smithi157.stdout: "op_rmw": 0, 2023-10-19T12:59:50.971 INFO:teuthology.orchestra.run.smithi157.stdout: "op_pg": 0, 2023-10-19T12:59:50.971 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_stat": 0, 2023-10-19T12:59:50.971 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_create": 10, 2023-10-19T12:59:50.971 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_read": 0, 2023-10-19T12:59:50.971 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_write": 151, 2023-10-19T12:59:50.972 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_writefull": 51, 2023-10-19T12:59:50.974 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_writesame": 0, 2023-10-19T12:59:50.974 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_append": 0, 2023-10-19T12:59:50.975 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_zero": 0, 2023-10-19T12:59:50.975 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_truncate": 0, 2023-10-19T12:59:50.975 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_delete": 6, 2023-10-19T12:59:50.975 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_mapext": 0, 2023-10-19T12:59:50.975 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_sparse_read": 0, 2023-10-19T12:59:50.976 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_clonerange": 0, 2023-10-19T12:59:50.976 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_getxattr": 156, 2023-10-19T12:59:50.976 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_setxattr": 20, 2023-10-19T12:59:50.976 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_cmpxattr": 0, 2023-10-19T12:59:50.976 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_rmxattr": 0, 2023-10-19T12:59:50.977 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_resetxattrs": 0, 2023-10-19T12:59:50.977 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_call": 0, 2023-10-19T12:59:50.977 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_watch": 0, 2023-10-19T12:59:50.977 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_notify": 0, 2023-10-19T12:59:50.977 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_src_cmpxattr": 0, 2023-10-19T12:59:50.978 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_pgls": 0, 2023-10-19T12:59:50.978 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_pgls_filter": 0, 2023-10-19T12:59:50.978 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_other": 0, 2023-10-19T12:59:50.978 INFO:teuthology.orchestra.run.smithi157.stdout: "linger_active": 0, 2023-10-19T12:59:50.978 INFO:teuthology.orchestra.run.smithi157.stdout: "linger_send": 0, 2023-10-19T12:59:50.979 INFO:teuthology.orchestra.run.smithi157.stdout: "linger_resend": 0, 2023-10-19T12:59:50.979 INFO:teuthology.orchestra.run.smithi157.stdout: "linger_ping": 0, 2023-10-19T12:59:50.979 INFO:teuthology.orchestra.run.smithi157.stdout: "poolop_active": 0, 2023-10-19T12:59:50.979 INFO:teuthology.orchestra.run.smithi157.stdout: "poolop_send": 0, 2023-10-19T12:59:50.979 INFO:teuthology.orchestra.run.smithi157.stdout: "poolop_resend": 0, 2023-10-19T12:59:50.980 INFO:teuthology.orchestra.run.smithi157.stdout: "poolstat_active": 0, 2023-10-19T12:59:50.981 INFO:teuthology.orchestra.run.smithi157.stdout: "poolstat_send": 0, 2023-10-19T12:59:50.981 INFO:teuthology.orchestra.run.smithi157.stdout: "poolstat_resend": 0, 2023-10-19T12:59:50.982 INFO:teuthology.orchestra.run.smithi157.stdout: "statfs_active": 0, 2023-10-19T12:59:50.982 INFO:teuthology.orchestra.run.smithi157.stdout: "statfs_send": 0, 2023-10-19T12:59:50.982 INFO:teuthology.orchestra.run.smithi157.stdout: "statfs_resend": 0, 2023-10-19T12:59:50.982 INFO:teuthology.orchestra.run.smithi157.stdout: "command_active": 0, 2023-10-19T12:59:50.983 INFO:teuthology.orchestra.run.smithi157.stdout: "command_send": 0, 2023-10-19T12:59:50.983 INFO:teuthology.orchestra.run.smithi157.stdout: "command_resend": 0, 2023-10-19T12:59:50.984 INFO:teuthology.orchestra.run.smithi157.stdout: "map_epoch": 92, 2023-10-19T12:59:50.984 INFO:teuthology.orchestra.run.smithi157.stdout: "map_full": 0, 2023-10-19T12:59:50.984 INFO:teuthology.orchestra.run.smithi157.stdout: "map_inc": 4, 2023-10-19T12:59:50.985 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_sessions": 12, 2023-10-19T12:59:50.985 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_session_open": 12, 2023-10-19T12:59:50.986 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_session_close": 0, 2023-10-19T12:59:50.986 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_laggy": 0, 2023-10-19T12:59:50.986 INFO:teuthology.orchestra.run.smithi157.stdout: "omap_wr": 41, 2023-10-19T12:59:50.987 INFO:teuthology.orchestra.run.smithi157.stdout: "omap_rd": 0, 2023-10-19T12:59:50.987 INFO:teuthology.orchestra.run.smithi157.stdout: "omap_del": 7 2023-10-19T12:59:50.988 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:50.988 INFO:teuthology.orchestra.run.smithi157.stdout: "oft": { 2023-10-19T12:59:50.989 INFO:teuthology.orchestra.run.smithi157.stdout: "omap_total_objs": 1, 2023-10-19T12:59:50.989 INFO:teuthology.orchestra.run.smithi157.stdout: "omap_total_kv_pairs": 0, 2023-10-19T12:59:50.989 INFO:teuthology.orchestra.run.smithi157.stdout: "omap_total_updates": 0, 2023-10-19T12:59:50.990 INFO:teuthology.orchestra.run.smithi157.stdout: "omap_total_removes": 0 2023-10-19T12:59:50.990 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:50.991 INFO:teuthology.orchestra.run.smithi157.stdout: "osd-slow-ops": { 2023-10-19T12:59:50.991 INFO:teuthology.orchestra.run.smithi157.stdout: "slow_ops_count": 0 2023-10-19T12:59:50.991 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:50.992 INFO:teuthology.orchestra.run.smithi157.stdout: "purge_queue": { 2023-10-19T12:59:50.992 INFO:teuthology.orchestra.run.smithi157.stdout: "pq_executing_ops": 0, 2023-10-19T12:59:50.992 INFO:teuthology.orchestra.run.smithi157.stdout: "pq_executing_ops_high_water": 0, 2023-10-19T12:59:50.993 INFO:teuthology.orchestra.run.smithi157.stdout: "pq_executing": 0, 2023-10-19T12:59:50.993 INFO:teuthology.orchestra.run.smithi157.stdout: "pq_executing_high_water": 0, 2023-10-19T12:59:50.994 INFO:teuthology.orchestra.run.smithi157.stdout: "pq_executed": 0, 2023-10-19T12:59:50.994 INFO:teuthology.orchestra.run.smithi157.stdout: "pq_item_in_journal": 0 2023-10-19T12:59:50.995 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:50.995 INFO:teuthology.orchestra.run.smithi157.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-19T12:59:50.995 INFO:teuthology.orchestra.run.smithi157.stdout: "val": 0, 2023-10-19T12:59:50.996 INFO:teuthology.orchestra.run.smithi157.stdout: "max": 104857600, 2023-10-19T12:59:50.996 INFO:teuthology.orchestra.run.smithi157.stdout: "get_started": 0, 2023-10-19T12:59:50.997 INFO:teuthology.orchestra.run.smithi157.stdout: "get": 5284047, 2023-10-19T12:59:50.997 INFO:teuthology.orchestra.run.smithi157.stdout: "get_sum": 382520617, 2023-10-19T12:59:50.997 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_fail": 0, 2023-10-19T12:59:50.998 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_success": 5284047, 2023-10-19T12:59:50.998 INFO:teuthology.orchestra.run.smithi157.stdout: "take": 0, 2023-10-19T12:59:50.999 INFO:teuthology.orchestra.run.smithi157.stdout: "take_sum": 0, 2023-10-19T12:59:50.999 INFO:teuthology.orchestra.run.smithi157.stdout: "put": 5284047, 2023-10-19T12:59:50.999 INFO:teuthology.orchestra.run.smithi157.stdout: "put_sum": 382520617, 2023-10-19T12:59:51.000 INFO:teuthology.orchestra.run.smithi157.stdout: "wait": { 2023-10-19T12:59:51.000 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:51.001 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:51.001 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:51.001 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-10-19T12:59:51.002 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:51.002 INFO:teuthology.orchestra.run.smithi157.stdout: "throttle-objecter_bytes": { 2023-10-19T12:59:51.003 INFO:teuthology.orchestra.run.smithi157.stdout: "val": 0, 2023-10-19T12:59:51.003 INFO:teuthology.orchestra.run.smithi157.stdout: "max": 104857600, 2023-10-19T12:59:51.003 INFO:teuthology.orchestra.run.smithi157.stdout: "get_started": 0, 2023-10-19T12:59:51.004 INFO:teuthology.orchestra.run.smithi157.stdout: "get": 0, 2023-10-19T12:59:51.004 INFO:teuthology.orchestra.run.smithi157.stdout: "get_sum": 0, 2023-10-19T12:59:51.005 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_fail": 0, 2023-10-19T12:59:51.005 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_success": 0, 2023-10-19T12:59:51.005 INFO:teuthology.orchestra.run.smithi157.stdout: "take": 403, 2023-10-19T12:59:51.006 INFO:teuthology.orchestra.run.smithi157.stdout: "take_sum": 1053734, 2023-10-19T12:59:51.006 INFO:teuthology.orchestra.run.smithi157.stdout: "put": 403, 2023-10-19T12:59:51.007 INFO:teuthology.orchestra.run.smithi157.stdout: "put_sum": 1053734, 2023-10-19T12:59:51.007 INFO:teuthology.orchestra.run.smithi157.stdout: "wait": { 2023-10-19T12:59:51.007 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:51.008 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:51.008 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:51.009 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-10-19T12:59:51.009 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:51.009 INFO:teuthology.orchestra.run.smithi157.stdout: "throttle-objecter_ops": { 2023-10-19T12:59:51.010 INFO:teuthology.orchestra.run.smithi157.stdout: "val": 0, 2023-10-19T12:59:51.010 INFO:teuthology.orchestra.run.smithi157.stdout: "max": 1024, 2023-10-19T12:59:51.011 INFO:teuthology.orchestra.run.smithi157.stdout: "get_started": 0, 2023-10-19T12:59:51.011 INFO:teuthology.orchestra.run.smithi157.stdout: "get": 0, 2023-10-19T12:59:51.012 INFO:teuthology.orchestra.run.smithi157.stdout: "get_sum": 0, 2023-10-19T12:59:51.012 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_fail": 0, 2023-10-19T12:59:51.012 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_success": 0, 2023-10-19T12:59:51.013 INFO:teuthology.orchestra.run.smithi157.stdout: "take": 403, 2023-10-19T12:59:51.013 INFO:teuthology.orchestra.run.smithi157.stdout: "take_sum": 403, 2023-10-19T12:59:51.013 INFO:teuthology.orchestra.run.smithi157.stdout: "put": 403, 2023-10-19T12:59:51.014 INFO:teuthology.orchestra.run.smithi157.stdout: "put_sum": 403, 2023-10-19T12:59:51.014 INFO:teuthology.orchestra.run.smithi157.stdout: "wait": { 2023-10-19T12:59:51.015 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:51.015 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:51.015 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:51.016 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-10-19T12:59:51.016 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:51.017 INFO:teuthology.orchestra.run.smithi157.stdout: "throttle-write_buf_throttle": { 2023-10-19T12:59:51.017 INFO:teuthology.orchestra.run.smithi157.stdout: "val": 0, 2023-10-19T12:59:51.017 INFO:teuthology.orchestra.run.smithi157.stdout: "max": 3758096384, 2023-10-19T12:59:51.018 INFO:teuthology.orchestra.run.smithi157.stdout: "get_started": 0, 2023-10-19T12:59:51.018 INFO:teuthology.orchestra.run.smithi157.stdout: "get": 0, 2023-10-19T12:59:51.019 INFO:teuthology.orchestra.run.smithi157.stdout: "get_sum": 0, 2023-10-19T12:59:51.019 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_fail": 0, 2023-10-19T12:59:51.019 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_success": 0, 2023-10-19T12:59:51.019 INFO:teuthology.orchestra.run.smithi157.stdout: "take": 0, 2023-10-19T12:59:51.020 INFO:teuthology.orchestra.run.smithi157.stdout: "take_sum": 0, 2023-10-19T12:59:51.020 INFO:teuthology.orchestra.run.smithi157.stdout: "put": 0, 2023-10-19T12:59:51.020 INFO:teuthology.orchestra.run.smithi157.stdout: "put_sum": 0, 2023-10-19T12:59:51.020 INFO:teuthology.orchestra.run.smithi157.stdout: "wait": { 2023-10-19T12:59:51.020 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:51.021 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:51.021 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:51.021 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-10-19T12:59:51.021 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:51.021 INFO:teuthology.orchestra.run.smithi157.stdout: "throttle-write_buf_throttle-0x55d23e99c6e0": { 2023-10-19T12:59:51.022 INFO:teuthology.orchestra.run.smithi157.stdout: "val": 0, 2023-10-19T12:59:51.022 INFO:teuthology.orchestra.run.smithi157.stdout: "max": 3758096384, 2023-10-19T12:59:51.022 INFO:teuthology.orchestra.run.smithi157.stdout: "get_started": 0, 2023-10-19T12:59:51.022 INFO:teuthology.orchestra.run.smithi157.stdout: "get": 631, 2023-10-19T12:59:51.022 INFO:teuthology.orchestra.run.smithi157.stdout: "get_sum": 1013644, 2023-10-19T12:59:51.023 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_fail": 0, 2023-10-19T12:59:51.023 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_success": 631, 2023-10-19T12:59:51.023 INFO:teuthology.orchestra.run.smithi157.stdout: "take": 0, 2023-10-19T12:59:51.023 INFO:teuthology.orchestra.run.smithi157.stdout: "take_sum": 0, 2023-10-19T12:59:51.023 INFO:teuthology.orchestra.run.smithi157.stdout: "put": 151, 2023-10-19T12:59:51.023 INFO:teuthology.orchestra.run.smithi157.stdout: "put_sum": 1013644, 2023-10-19T12:59:51.024 INFO:teuthology.orchestra.run.smithi157.stdout: "wait": { 2023-10-19T12:59:51.024 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:51.024 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:51.024 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:51.024 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-10-19T12:59:51.024 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-10-19T12:59:51.025 INFO:teuthology.orchestra.run.smithi157.stdout:} 2023-10-19T12:59:51.703 INFO:tasks.check_counter:Daemon mds.h mds.exported=2 2023-10-19T12:59:51.703 INFO:tasks.check_counter:Daemon mds.h mds.imported=8 2023-10-19T12:59:51.703 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=12 2023-10-19T12:59:51.704 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=478 2023-10-19T12:59:51.704 DEBUG:tasks.check_counter:Getting stats from k 2023-10-19T12:59:51.704 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph daemon mds.k perf dump 2023-10-19T12:59:52.355 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.b/config 2023-10-19T12:59:52.478 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:59:52 smithi046 ceph-mon[98509]: pgmap v844: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 13 op/s 2023-10-19T12:59:52.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:59:52 smithi157 ceph-mon[134109]: pgmap v844: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 13 op/s 2023-10-19T12:59:52.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:59:52 smithi195 ceph-mon[134493]: pgmap v844: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 13 op/s 2023-10-19T12:59:54.273 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2023-10-19T12:59:54.273 INFO:teuthology.orchestra.run.smithi157.stdout: "AsyncMessenger::Worker-0": { 2023-10-19T12:59:54.274 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_messages": 353, 2023-10-19T12:59:54.274 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_messages": 319, 2023-10-19T12:59:54.274 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_bytes": 706562, 2023-10-19T12:59:54.274 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_bytes": 187021, 2023-10-19T12:59:54.275 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_created_connections": 6, 2023-10-19T12:59:54.275 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_active_connections": 1, 2023-10-19T12:59:54.275 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_total_time": 0.043965121, 2023-10-19T12:59:54.275 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_send_time": 0.014661920, 2023-10-19T12:59:54.275 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_recv_time": 0.020293334, 2023-10-19T12:59:54.276 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_fast_dispatch_time": 0.008286558, 2023-10-19T12:59:54.276 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_messages_queue_lat": { 2023-10-19T12:59:54.276 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 319, 2023-10-19T12:59:54.276 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.078203286, 2023-10-19T12:59:54.276 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000245151 2023-10-19T12:59:54.276 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:54.277 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_handle_ack_lat": { 2023-10-19T12:59:54.277 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:54.277 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:54.277 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:54.277 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:54.277 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_encrypted_bytes": 705728, 2023-10-19T12:59:54.278 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_encrypted_bytes": 186704 2023-10-19T12:59:54.278 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:54.278 INFO:teuthology.orchestra.run.smithi157.stdout: "AsyncMessenger::Worker-1": { 2023-10-19T12:59:54.278 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_messages": 976, 2023-10-19T12:59:54.278 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_messages": 1208, 2023-10-19T12:59:54.279 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_bytes": 239946, 2023-10-19T12:59:54.279 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_bytes": 859223, 2023-10-19T12:59:54.279 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_created_connections": 6, 2023-10-19T12:59:54.279 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_active_connections": 4, 2023-10-19T12:59:54.279 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_total_time": 0.092208881, 2023-10-19T12:59:54.280 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_send_time": 0.025419337, 2023-10-19T12:59:54.280 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_recv_time": 0.019604089, 2023-10-19T12:59:54.280 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_fast_dispatch_time": 0.039093634, 2023-10-19T12:59:54.280 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_messages_queue_lat": { 2023-10-19T12:59:54.280 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 1206, 2023-10-19T12:59:54.280 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.396715749, 2023-10-19T12:59:54.281 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000328951 2023-10-19T12:59:54.281 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:54.281 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_handle_ack_lat": { 2023-10-19T12:59:54.281 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:54.281 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:54.282 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:54.282 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:54.282 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_encrypted_bytes": 320, 2023-10-19T12:59:54.282 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_encrypted_bytes": 556304 2023-10-19T12:59:54.282 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:54.283 INFO:teuthology.orchestra.run.smithi157.stdout: "AsyncMessenger::Worker-2": { 2023-10-19T12:59:54.283 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_messages": 2320, 2023-10-19T12:59:54.283 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_messages": 2322, 2023-10-19T12:59:54.283 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_bytes": 2929664, 2023-10-19T12:59:54.283 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_bytes": 721578, 2023-10-19T12:59:54.283 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_created_connections": 4, 2023-10-19T12:59:54.284 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_active_connections": 3, 2023-10-19T12:59:54.284 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_total_time": 0.193894490, 2023-10-19T12:59:54.284 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_send_time": 0.053985892, 2023-10-19T12:59:54.284 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_recv_time": 0.049024271, 2023-10-19T12:59:54.284 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_running_fast_dispatch_time": 0.075427069, 2023-10-19T12:59:54.285 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_messages_queue_lat": { 2023-10-19T12:59:54.285 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 2320, 2023-10-19T12:59:54.285 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.509339811, 2023-10-19T12:59:54.285 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000219543 2023-10-19T12:59:54.285 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:54.286 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_handle_ack_lat": { 2023-10-19T12:59:54.286 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:54.286 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:54.286 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:54.286 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:54.286 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-19T12:59:54.287 INFO:teuthology.orchestra.run.smithi157.stdout: "msgr_send_encrypted_bytes": 0 2023-10-19T12:59:54.287 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:54.287 INFO:teuthology.orchestra.run.smithi157.stdout: "cct": { 2023-10-19T12:59:54.287 INFO:teuthology.orchestra.run.smithi157.stdout: "total_workers": 1, 2023-10-19T12:59:54.287 INFO:teuthology.orchestra.run.smithi157.stdout: "unhealthy_workers": 0 2023-10-19T12:59:54.287 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:54.288 INFO:teuthology.orchestra.run.smithi157.stdout: "finisher-MDSRank": { 2023-10-19T12:59:54.288 INFO:teuthology.orchestra.run.smithi157.stdout: "queue_len": 0, 2023-10-19T12:59:54.288 INFO:teuthology.orchestra.run.smithi157.stdout: "complete_latency": { 2023-10-19T12:59:54.288 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 5572, 2023-10-19T12:59:54.288 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.147971834, 2023-10-19T12:59:54.289 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000026556 2023-10-19T12:59:54.289 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-10-19T12:59:54.289 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:54.289 INFO:teuthology.orchestra.run.smithi157.stdout: "finisher-PurgeQueue": { 2023-10-19T12:59:54.290 INFO:teuthology.orchestra.run.smithi157.stdout: "queue_len": 0, 2023-10-19T12:59:54.290 INFO:teuthology.orchestra.run.smithi157.stdout: "complete_latency": { 2023-10-19T12:59:54.290 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:54.290 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:54.290 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:54.291 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-10-19T12:59:54.291 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:54.291 INFO:teuthology.orchestra.run.smithi157.stdout: "mds": { 2023-10-19T12:59:54.291 INFO:teuthology.orchestra.run.smithi157.stdout: "request": 0, 2023-10-19T12:59:54.291 INFO:teuthology.orchestra.run.smithi157.stdout: "reply": 0, 2023-10-19T12:59:54.292 INFO:teuthology.orchestra.run.smithi157.stdout: "reply_latency": { 2023-10-19T12:59:54.292 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:54.292 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:54.292 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:54.292 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:54.293 INFO:teuthology.orchestra.run.smithi157.stdout: "slow_reply": 0, 2023-10-19T12:59:54.293 INFO:teuthology.orchestra.run.smithi157.stdout: "forward": 0, 2023-10-19T12:59:54.293 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_fetch_complete": 0, 2023-10-19T12:59:54.293 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_fetch_keys": 0, 2023-10-19T12:59:54.293 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_commit": 0, 2023-10-19T12:59:54.294 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_split": 0, 2023-10-19T12:59:54.294 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_merge": 0, 2023-10-19T12:59:54.294 INFO:teuthology.orchestra.run.smithi157.stdout: "inodes": 323, 2023-10-19T12:59:54.294 INFO:teuthology.orchestra.run.smithi157.stdout: "inodes_top": 0, 2023-10-19T12:59:54.294 INFO:teuthology.orchestra.run.smithi157.stdout: "inodes_bottom": 0, 2023-10-19T12:59:54.294 INFO:teuthology.orchestra.run.smithi157.stdout: "inodes_pin_tail": 323, 2023-10-19T12:59:54.295 INFO:teuthology.orchestra.run.smithi157.stdout: "inodes_pinned": 323, 2023-10-19T12:59:54.295 INFO:teuthology.orchestra.run.smithi157.stdout: "inodes_expired": 28, 2023-10-19T12:59:54.295 INFO:teuthology.orchestra.run.smithi157.stdout: "inodes_with_caps": 0, 2023-10-19T12:59:54.295 INFO:teuthology.orchestra.run.smithi157.stdout: "caps": 0, 2023-10-19T12:59:54.295 INFO:teuthology.orchestra.run.smithi157.stdout: "subtrees": 8, 2023-10-19T12:59:54.295 INFO:teuthology.orchestra.run.smithi157.stdout: "traverse": 0, 2023-10-19T12:59:54.296 INFO:teuthology.orchestra.run.smithi157.stdout: "traverse_hit": 0, 2023-10-19T12:59:54.296 INFO:teuthology.orchestra.run.smithi157.stdout: "traverse_forward": 0, 2023-10-19T12:59:54.296 INFO:teuthology.orchestra.run.smithi157.stdout: "traverse_discover": 0, 2023-10-19T12:59:54.296 INFO:teuthology.orchestra.run.smithi157.stdout: "traverse_dir_fetch": 0, 2023-10-19T12:59:54.296 INFO:teuthology.orchestra.run.smithi157.stdout: "traverse_remote_ino": 0, 2023-10-19T12:59:54.297 INFO:teuthology.orchestra.run.smithi157.stdout: "traverse_lock": 0, 2023-10-19T12:59:54.297 INFO:teuthology.orchestra.run.smithi157.stdout: "load_cent": 0, 2023-10-19T12:59:54.297 INFO:teuthology.orchestra.run.smithi157.stdout: "q": 0, 2023-10-19T12:59:54.297 INFO:teuthology.orchestra.run.smithi157.stdout: "exported": 0, 2023-10-19T12:59:54.297 INFO:teuthology.orchestra.run.smithi157.stdout: "exported_inodes": 0, 2023-10-19T12:59:54.297 INFO:teuthology.orchestra.run.smithi157.stdout: "imported": 0, 2023-10-19T12:59:54.298 INFO:teuthology.orchestra.run.smithi157.stdout: "imported_inodes": 0, 2023-10-19T12:59:54.298 INFO:teuthology.orchestra.run.smithi157.stdout: "openino_dir_fetch": 0, 2023-10-19T12:59:54.298 INFO:teuthology.orchestra.run.smithi157.stdout: "openino_backtrace_fetch": 0, 2023-10-19T12:59:54.298 INFO:teuthology.orchestra.run.smithi157.stdout: "openino_peer_discover": 0, 2023-10-19T12:59:54.298 INFO:teuthology.orchestra.run.smithi157.stdout: "root_rfiles": 0, 2023-10-19T12:59:54.299 INFO:teuthology.orchestra.run.smithi157.stdout: "root_rbytes": 0, 2023-10-19T12:59:54.299 INFO:teuthology.orchestra.run.smithi157.stdout: "root_rsnaps": 0, 2023-10-19T12:59:54.299 INFO:teuthology.orchestra.run.smithi157.stdout: "scrub_backtrace_fetch": 0, 2023-10-19T12:59:54.299 INFO:teuthology.orchestra.run.smithi157.stdout: "scrub_set_tag": 0, 2023-10-19T12:59:54.299 INFO:teuthology.orchestra.run.smithi157.stdout: "scrub_backtrace_repaired": 0, 2023-10-19T12:59:54.300 INFO:teuthology.orchestra.run.smithi157.stdout: "scrub_inotable_repaired": 0, 2023-10-19T12:59:54.300 INFO:teuthology.orchestra.run.smithi157.stdout: "scrub_dir_inodes": 0, 2023-10-19T12:59:54.300 INFO:teuthology.orchestra.run.smithi157.stdout: "scrub_dir_base_inodes": 0, 2023-10-19T12:59:54.300 INFO:teuthology.orchestra.run.smithi157.stdout: "scrub_dirfrag_rstats": 0, 2023-10-19T12:59:54.300 INFO:teuthology.orchestra.run.smithi157.stdout: "scrub_file_inodes": 0, 2023-10-19T12:59:54.300 INFO:teuthology.orchestra.run.smithi157.stdout: "handle_inode_file_caps": 0, 2023-10-19T12:59:54.301 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph_cap_op_revoke": 0, 2023-10-19T12:59:54.301 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph_cap_op_grant": 0, 2023-10-19T12:59:54.301 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph_cap_op_trunc": 0, 2023-10-19T12:59:54.301 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-19T12:59:54.301 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-19T12:59:54.301 INFO:teuthology.orchestra.run.smithi157.stdout: "handle_client_caps": 0, 2023-10-19T12:59:54.302 INFO:teuthology.orchestra.run.smithi157.stdout: "handle_client_caps_dirty": 0, 2023-10-19T12:59:54.302 INFO:teuthology.orchestra.run.smithi157.stdout: "handle_client_cap_release": 0, 2023-10-19T12:59:54.302 INFO:teuthology.orchestra.run.smithi157.stdout: "process_request_cap_release": 0 2023-10-19T12:59:54.302 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:54.302 INFO:teuthology.orchestra.run.smithi157.stdout: "mds_cache": { 2023-10-19T12:59:54.303 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_update": 0, 2023-10-19T12:59:54.303 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_update_receipt": 0, 2023-10-19T12:59:54.303 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_try_discover": 0, 2023-10-19T12:59:54.303 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_send_discover": 0, 2023-10-19T12:59:54.303 INFO:teuthology.orchestra.run.smithi157.stdout: "dir_handle_discover": 0, 2023-10-19T12:59:54.303 INFO:teuthology.orchestra.run.smithi157.stdout: "num_strays": 0, 2023-10-19T12:59:54.304 INFO:teuthology.orchestra.run.smithi157.stdout: "num_strays_delayed": 0, 2023-10-19T12:59:54.304 INFO:teuthology.orchestra.run.smithi157.stdout: "num_strays_enqueuing": 0, 2023-10-19T12:59:54.304 INFO:teuthology.orchestra.run.smithi157.stdout: "strays_created": 0, 2023-10-19T12:59:54.304 INFO:teuthology.orchestra.run.smithi157.stdout: "strays_enqueued": 0, 2023-10-19T12:59:54.304 INFO:teuthology.orchestra.run.smithi157.stdout: "strays_reintegrated": 0, 2023-10-19T12:59:54.304 INFO:teuthology.orchestra.run.smithi157.stdout: "strays_migrated": 0, 2023-10-19T12:59:54.305 INFO:teuthology.orchestra.run.smithi157.stdout: "num_recovering_processing": 0, 2023-10-19T12:59:54.305 INFO:teuthology.orchestra.run.smithi157.stdout: "num_recovering_enqueued": 0, 2023-10-19T12:59:54.305 INFO:teuthology.orchestra.run.smithi157.stdout: "num_recovering_prioritized": 0, 2023-10-19T12:59:54.305 INFO:teuthology.orchestra.run.smithi157.stdout: "recovery_started": 0, 2023-10-19T12:59:54.305 INFO:teuthology.orchestra.run.smithi157.stdout: "recovery_completed": 0, 2023-10-19T12:59:54.305 INFO:teuthology.orchestra.run.smithi157.stdout: "ireq_enqueue_scrub": 0, 2023-10-19T12:59:54.306 INFO:teuthology.orchestra.run.smithi157.stdout: "ireq_exportdir": 0, 2023-10-19T12:59:54.306 INFO:teuthology.orchestra.run.smithi157.stdout: "ireq_flush": 0, 2023-10-19T12:59:54.306 INFO:teuthology.orchestra.run.smithi157.stdout: "ireq_fragmentdir": 0, 2023-10-19T12:59:54.306 INFO:teuthology.orchestra.run.smithi157.stdout: "ireq_fragstats": 0, 2023-10-19T12:59:54.306 INFO:teuthology.orchestra.run.smithi157.stdout: "ireq_inodestats": 0 2023-10-19T12:59:54.307 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:54.307 INFO:teuthology.orchestra.run.smithi157.stdout: "mds_log": { 2023-10-19T12:59:54.307 INFO:teuthology.orchestra.run.smithi157.stdout: "evlrg": 0, 2023-10-19T12:59:54.307 INFO:teuthology.orchestra.run.smithi157.stdout: "evadd": 0, 2023-10-19T12:59:54.307 INFO:teuthology.orchestra.run.smithi157.stdout: "evex": 0, 2023-10-19T12:59:54.308 INFO:teuthology.orchestra.run.smithi157.stdout: "evtrm": 0, 2023-10-19T12:59:54.308 INFO:teuthology.orchestra.run.smithi157.stdout: "ev": 1481, 2023-10-19T12:59:54.308 INFO:teuthology.orchestra.run.smithi157.stdout: "evexg": 0, 2023-10-19T12:59:54.308 INFO:teuthology.orchestra.run.smithi157.stdout: "evexd": 0, 2023-10-19T12:59:54.308 INFO:teuthology.orchestra.run.smithi157.stdout: "segadd": 0, 2023-10-19T12:59:54.308 INFO:teuthology.orchestra.run.smithi157.stdout: "segex": 0, 2023-10-19T12:59:54.309 INFO:teuthology.orchestra.run.smithi157.stdout: "segtrm": 0, 2023-10-19T12:59:54.309 INFO:teuthology.orchestra.run.smithi157.stdout: "seg": 3, 2023-10-19T12:59:54.309 INFO:teuthology.orchestra.run.smithi157.stdout: "segmjr": 2, 2023-10-19T12:59:54.309 INFO:teuthology.orchestra.run.smithi157.stdout: "segexg": 0, 2023-10-19T12:59:54.309 INFO:teuthology.orchestra.run.smithi157.stdout: "segexd": 0, 2023-10-19T12:59:54.310 INFO:teuthology.orchestra.run.smithi157.stdout: "expos": 4194304, 2023-10-19T12:59:54.310 INFO:teuthology.orchestra.run.smithi157.stdout: "wrpos": 6439623, 2023-10-19T12:59:54.310 INFO:teuthology.orchestra.run.smithi157.stdout: "rdpos": 6439562, 2023-10-19T12:59:54.310 INFO:teuthology.orchestra.run.smithi157.stdout: "jlat": { 2023-10-19T12:59:54.310 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:54.310 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:54.311 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:54.311 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:54.311 INFO:teuthology.orchestra.run.smithi157.stdout: "replayed": 1481 2023-10-19T12:59:54.311 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:54.311 INFO:teuthology.orchestra.run.smithi157.stdout: "mds_mem": { 2023-10-19T12:59:54.312 INFO:teuthology.orchestra.run.smithi157.stdout: "ino": 133, 2023-10-19T12:59:54.312 INFO:teuthology.orchestra.run.smithi157.stdout: "ino+": 556, 2023-10-19T12:59:54.312 INFO:teuthology.orchestra.run.smithi157.stdout: "ino-": 423, 2023-10-19T12:59:54.312 INFO:teuthology.orchestra.run.smithi157.stdout: "dir": 19, 2023-10-19T12:59:54.312 INFO:teuthology.orchestra.run.smithi157.stdout: "dir+": 38, 2023-10-19T12:59:54.312 INFO:teuthology.orchestra.run.smithi157.stdout: "dir-": 19, 2023-10-19T12:59:54.312 INFO:teuthology.orchestra.run.smithi157.stdout: "dn": 323, 2023-10-19T12:59:54.313 INFO:teuthology.orchestra.run.smithi157.stdout: "dn+": 601, 2023-10-19T12:59:54.313 INFO:teuthology.orchestra.run.smithi157.stdout: "dn-": 278, 2023-10-19T12:59:54.313 INFO:teuthology.orchestra.run.smithi157.stdout: "cap": 0, 2023-10-19T12:59:54.313 INFO:teuthology.orchestra.run.smithi157.stdout: "cap+": 0, 2023-10-19T12:59:54.313 INFO:teuthology.orchestra.run.smithi157.stdout: "cap-": 0, 2023-10-19T12:59:54.314 INFO:teuthology.orchestra.run.smithi157.stdout: "rss": 48612, 2023-10-19T12:59:54.314 INFO:teuthology.orchestra.run.smithi157.stdout: "heap": 207152 2023-10-19T12:59:54.314 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:54.314 INFO:teuthology.orchestra.run.smithi157.stdout: "mds_server": { 2023-10-19T12:59:54.314 INFO:teuthology.orchestra.run.smithi157.stdout: "dispatch_client_request": 0, 2023-10-19T12:59:54.314 INFO:teuthology.orchestra.run.smithi157.stdout: "dispatch_server_request": 0, 2023-10-19T12:59:54.315 INFO:teuthology.orchestra.run.smithi157.stdout: "handle_client_request": 0, 2023-10-19T12:59:54.315 INFO:teuthology.orchestra.run.smithi157.stdout: "handle_client_session": 0, 2023-10-19T12:59:54.315 INFO:teuthology.orchestra.run.smithi157.stdout: "handle_peer_request": 0, 2023-10-19T12:59:54.315 INFO:teuthology.orchestra.run.smithi157.stdout: "req_create_latency": { 2023-10-19T12:59:54.315 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:54.315 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:54.316 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:54.316 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:54.316 INFO:teuthology.orchestra.run.smithi157.stdout: "req_getattr_latency": { 2023-10-19T12:59:54.316 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:54.316 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:54.316 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:54.317 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:54.317 INFO:teuthology.orchestra.run.smithi157.stdout: "req_getfilelock_latency": { 2023-10-19T12:59:54.317 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:54.317 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:54.317 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:54.317 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:54.318 INFO:teuthology.orchestra.run.smithi157.stdout: "req_link_latency": { 2023-10-19T12:59:54.318 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:54.318 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:54.318 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:54.318 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:54.319 INFO:teuthology.orchestra.run.smithi157.stdout: "req_lookup_latency": { 2023-10-19T12:59:54.319 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:54.319 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:54.319 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:54.319 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:54.319 INFO:teuthology.orchestra.run.smithi157.stdout: "req_lookuphash_latency": { 2023-10-19T12:59:54.320 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:54.320 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:54.320 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:54.320 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:54.320 INFO:teuthology.orchestra.run.smithi157.stdout: "req_lookupino_latency": { 2023-10-19T12:59:54.320 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:54.321 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:54.321 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:54.321 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:54.321 INFO:teuthology.orchestra.run.smithi157.stdout: "req_lookupname_latency": { 2023-10-19T12:59:54.321 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:54.321 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:54.322 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:54.322 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:54.322 INFO:teuthology.orchestra.run.smithi157.stdout: "req_lookupparent_latency": { 2023-10-19T12:59:54.322 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:54.322 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:54.323 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:54.323 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:54.323 INFO:teuthology.orchestra.run.smithi157.stdout: "req_lookupsnap_latency": { 2023-10-19T12:59:54.323 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:54.323 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:54.323 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:54.324 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:54.324 INFO:teuthology.orchestra.run.smithi157.stdout: "req_lssnap_latency": { 2023-10-19T12:59:54.324 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:54.324 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:54.324 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:54.324 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:54.325 INFO:teuthology.orchestra.run.smithi157.stdout: "req_mkdir_latency": { 2023-10-19T12:59:54.325 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:54.325 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:54.325 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:54.325 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:54.326 INFO:teuthology.orchestra.run.smithi157.stdout: "req_mknod_latency": { 2023-10-19T12:59:54.326 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:54.326 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:54.326 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:54.326 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:54.326 INFO:teuthology.orchestra.run.smithi157.stdout: "req_mksnap_latency": { 2023-10-19T12:59:54.327 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:54.327 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:54.327 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:54.327 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:54.327 INFO:teuthology.orchestra.run.smithi157.stdout: "req_open_latency": { 2023-10-19T12:59:54.328 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:54.328 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:54.328 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:54.328 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:54.328 INFO:teuthology.orchestra.run.smithi157.stdout: "req_readdir_latency": { 2023-10-19T12:59:54.329 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:54.329 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:54.329 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:54.329 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:54.329 INFO:teuthology.orchestra.run.smithi157.stdout: "req_rename_latency": { 2023-10-19T12:59:54.329 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:54.330 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:54.330 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:54.330 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:54.330 INFO:teuthology.orchestra.run.smithi157.stdout: "req_renamesnap_latency": { 2023-10-19T12:59:54.330 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:54.331 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:54.331 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:54.331 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:54.331 INFO:teuthology.orchestra.run.smithi157.stdout: "req_snapdiff_latency": { 2023-10-19T12:59:54.331 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:54.331 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:54.332 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:54.332 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:54.332 INFO:teuthology.orchestra.run.smithi157.stdout: "req_rmdir_latency": { 2023-10-19T12:59:54.332 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:54.332 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:54.332 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:54.333 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:54.333 INFO:teuthology.orchestra.run.smithi157.stdout: "req_rmsnap_latency": { 2023-10-19T12:59:54.333 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:54.333 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:54.333 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:54.333 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:54.334 INFO:teuthology.orchestra.run.smithi157.stdout: "req_rmxattr_latency": { 2023-10-19T12:59:54.334 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:54.334 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:54.334 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:54.334 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:54.335 INFO:teuthology.orchestra.run.smithi157.stdout: "req_setattr_latency": { 2023-10-19T12:59:54.335 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:54.335 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:54.335 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:54.335 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:54.336 INFO:teuthology.orchestra.run.smithi157.stdout: "req_setdirlayout_latency": { 2023-10-19T12:59:54.336 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:54.336 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:54.336 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:54.336 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:54.336 INFO:teuthology.orchestra.run.smithi157.stdout: "req_setfilelock_latency": { 2023-10-19T12:59:54.337 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:54.337 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:54.337 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:54.337 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:54.337 INFO:teuthology.orchestra.run.smithi157.stdout: "req_setlayout_latency": { 2023-10-19T12:59:54.338 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:54.338 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:54.338 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:54.338 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:54.338 INFO:teuthology.orchestra.run.smithi157.stdout: "req_setxattr_latency": { 2023-10-19T12:59:54.339 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:54.339 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:54.339 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:54.339 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:54.339 INFO:teuthology.orchestra.run.smithi157.stdout: "req_symlink_latency": { 2023-10-19T12:59:54.340 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:54.340 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:54.340 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:54.340 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:54.340 INFO:teuthology.orchestra.run.smithi157.stdout: "req_unlink_latency": { 2023-10-19T12:59:54.341 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:54.341 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:54.341 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:54.341 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:54.341 INFO:teuthology.orchestra.run.smithi157.stdout: "cap_revoke_eviction": 0, 2023-10-19T12:59:54.342 INFO:teuthology.orchestra.run.smithi157.stdout: "cap_acquisition_throttle": 0, 2023-10-19T12:59:54.342 INFO:teuthology.orchestra.run.smithi157.stdout: "req_getvxattr_latency": { 2023-10-19T12:59:54.342 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:54.342 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:54.342 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:54.343 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-10-19T12:59:54.343 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:54.343 INFO:teuthology.orchestra.run.smithi157.stdout: "mds_sessions": { 2023-10-19T12:59:54.343 INFO:teuthology.orchestra.run.smithi157.stdout: "session_count": 1, 2023-10-19T12:59:54.343 INFO:teuthology.orchestra.run.smithi157.stdout: "session_add": 1, 2023-10-19T12:59:54.344 INFO:teuthology.orchestra.run.smithi157.stdout: "session_remove": 0, 2023-10-19T12:59:54.344 INFO:teuthology.orchestra.run.smithi157.stdout: "sessions_open": 1, 2023-10-19T12:59:54.344 INFO:teuthology.orchestra.run.smithi157.stdout: "sessions_stale": 0, 2023-10-19T12:59:54.344 INFO:teuthology.orchestra.run.smithi157.stdout: "total_load": 0, 2023-10-19T12:59:54.344 INFO:teuthology.orchestra.run.smithi157.stdout: "average_load": 0, 2023-10-19T12:59:54.345 INFO:teuthology.orchestra.run.smithi157.stdout: "avg_session_uptime": 2894, 2023-10-19T12:59:54.345 INFO:teuthology.orchestra.run.smithi157.stdout: "mdthresh_evicted": 0 2023-10-19T12:59:54.345 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:54.345 INFO:teuthology.orchestra.run.smithi157.stdout: "mempool": { 2023-10-19T12:59:54.345 INFO:teuthology.orchestra.run.smithi157.stdout: "bloom_filter_bytes": 0, 2023-10-19T12:59:54.346 INFO:teuthology.orchestra.run.smithi157.stdout: "bloom_filter_items": 0, 2023-10-19T12:59:54.346 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_alloc_bytes": 0, 2023-10-19T12:59:54.346 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_alloc_items": 0, 2023-10-19T12:59:54.346 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_data_bytes": 0, 2023-10-19T12:59:54.346 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_data_items": 0, 2023-10-19T12:59:54.346 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-19T12:59:54.347 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_onode_items": 0, 2023-10-19T12:59:54.347 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-19T12:59:54.347 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_meta_items": 0, 2023-10-19T12:59:54.347 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_other_bytes": 0, 2023-10-19T12:59:54.348 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_other_items": 0, 2023-10-19T12:59:54.348 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-19T12:59:54.348 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_cache_buffer_items": 0, 2023-10-19T12:59:54.348 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_extent_bytes": 0, 2023-10-19T12:59:54.348 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_extent_items": 0, 2023-10-19T12:59:54.348 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_blob_bytes": 0, 2023-10-19T12:59:54.349 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_blob_items": 0, 2023-10-19T12:59:54.349 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-19T12:59:54.349 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_shared_blob_items": 0, 2023-10-19T12:59:54.349 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-19T12:59:54.349 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_inline_bl_items": 0, 2023-10-19T12:59:54.350 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_fsck_bytes": 0, 2023-10-19T12:59:54.350 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_fsck_items": 0, 2023-10-19T12:59:54.350 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_txc_bytes": 0, 2023-10-19T12:59:54.350 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_txc_items": 0, 2023-10-19T12:59:54.350 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-19T12:59:54.351 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_writing_deferred_items": 0, 2023-10-19T12:59:54.351 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_writing_bytes": 0, 2023-10-19T12:59:54.351 INFO:teuthology.orchestra.run.smithi157.stdout: "bluestore_writing_items": 0, 2023-10-19T12:59:54.351 INFO:teuthology.orchestra.run.smithi157.stdout: "bluefs_bytes": 0, 2023-10-19T12:59:54.352 INFO:teuthology.orchestra.run.smithi157.stdout: "bluefs_items": 0, 2023-10-19T12:59:54.352 INFO:teuthology.orchestra.run.smithi157.stdout: "bluefs_file_reader_bytes": 0, 2023-10-19T12:59:54.352 INFO:teuthology.orchestra.run.smithi157.stdout: "bluefs_file_reader_items": 0, 2023-10-19T12:59:54.352 INFO:teuthology.orchestra.run.smithi157.stdout: "bluefs_file_writer_bytes": 0, 2023-10-19T12:59:54.352 INFO:teuthology.orchestra.run.smithi157.stdout: "bluefs_file_writer_items": 0, 2023-10-19T12:59:54.352 INFO:teuthology.orchestra.run.smithi157.stdout: "buffer_anon_bytes": 195603, 2023-10-19T12:59:54.353 INFO:teuthology.orchestra.run.smithi157.stdout: "buffer_anon_items": 179, 2023-10-19T12:59:54.353 INFO:teuthology.orchestra.run.smithi157.stdout: "buffer_meta_bytes": 0, 2023-10-19T12:59:54.353 INFO:teuthology.orchestra.run.smithi157.stdout: "buffer_meta_items": 0, 2023-10-19T12:59:54.353 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_bytes": 0, 2023-10-19T12:59:54.353 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_items": 0, 2023-10-19T12:59:54.353 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_mapbl_bytes": 0, 2023-10-19T12:59:54.354 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_mapbl_items": 0, 2023-10-19T12:59:54.354 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_pglog_bytes": 0, 2023-10-19T12:59:54.354 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_pglog_items": 0, 2023-10-19T12:59:54.354 INFO:teuthology.orchestra.run.smithi157.stdout: "osdmap_bytes": 9280, 2023-10-19T12:59:54.354 INFO:teuthology.orchestra.run.smithi157.stdout: "osdmap_items": 179, 2023-10-19T12:59:54.355 INFO:teuthology.orchestra.run.smithi157.stdout: "osdmap_mapping_bytes": 0, 2023-10-19T12:59:54.355 INFO:teuthology.orchestra.run.smithi157.stdout: "osdmap_mapping_items": 0, 2023-10-19T12:59:54.355 INFO:teuthology.orchestra.run.smithi157.stdout: "pgmap_bytes": 0, 2023-10-19T12:59:54.355 INFO:teuthology.orchestra.run.smithi157.stdout: "pgmap_items": 0, 2023-10-19T12:59:54.355 INFO:teuthology.orchestra.run.smithi157.stdout: "mds_co_bytes": 553670, 2023-10-19T12:59:54.356 INFO:teuthology.orchestra.run.smithi157.stdout: "mds_co_items": 4517, 2023-10-19T12:59:54.356 INFO:teuthology.orchestra.run.smithi157.stdout: "unittest_1_bytes": 0, 2023-10-19T12:59:54.356 INFO:teuthology.orchestra.run.smithi157.stdout: "unittest_1_items": 0, 2023-10-19T12:59:54.356 INFO:teuthology.orchestra.run.smithi157.stdout: "unittest_2_bytes": 0, 2023-10-19T12:59:54.356 INFO:teuthology.orchestra.run.smithi157.stdout: "unittest_2_items": 0 2023-10-19T12:59:54.356 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:54.357 INFO:teuthology.orchestra.run.smithi157.stdout: "objecter": { 2023-10-19T12:59:54.357 INFO:teuthology.orchestra.run.smithi157.stdout: "op_active": 0, 2023-10-19T12:59:54.357 INFO:teuthology.orchestra.run.smithi157.stdout: "op_laggy": 0, 2023-10-19T12:59:54.357 INFO:teuthology.orchestra.run.smithi157.stdout: "op_send": 3295, 2023-10-19T12:59:54.357 INFO:teuthology.orchestra.run.smithi157.stdout: "op_send_bytes": 21, 2023-10-19T12:59:54.357 INFO:teuthology.orchestra.run.smithi157.stdout: "op_resend": 3, 2023-10-19T12:59:54.358 INFO:teuthology.orchestra.run.smithi157.stdout: "op_reply": 3295, 2023-10-19T12:59:54.358 INFO:teuthology.orchestra.run.smithi157.stdout: "op_latency": { 2023-10-19T12:59:54.358 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 3295, 2023-10-19T12:59:54.358 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 17.540700525, 2023-10-19T12:59:54.358 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.005323429 2023-10-19T12:59:54.359 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:54.359 INFO:teuthology.orchestra.run.smithi157.stdout: "op_inflight": 0, 2023-10-19T12:59:54.359 INFO:teuthology.orchestra.run.smithi157.stdout: "oplen_avg": { 2023-10-19T12:59:54.359 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 3295, 2023-10-19T12:59:54.359 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 3296 2023-10-19T12:59:54.360 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:54.360 INFO:teuthology.orchestra.run.smithi157.stdout: "op": 3295, 2023-10-19T12:59:54.360 INFO:teuthology.orchestra.run.smithi157.stdout: "op_r": 3295, 2023-10-19T12:59:54.360 INFO:teuthology.orchestra.run.smithi157.stdout: "op_w": 0, 2023-10-19T12:59:54.361 INFO:teuthology.orchestra.run.smithi157.stdout: "op_rmw": 0, 2023-10-19T12:59:54.361 INFO:teuthology.orchestra.run.smithi157.stdout: "op_pg": 0, 2023-10-19T12:59:54.361 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_stat": 2043, 2023-10-19T12:59:54.361 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_create": 0, 2023-10-19T12:59:54.362 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_read": 1250, 2023-10-19T12:59:54.362 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_write": 0, 2023-10-19T12:59:54.362 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_writefull": 0, 2023-10-19T12:59:54.362 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_writesame": 0, 2023-10-19T12:59:54.362 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_append": 0, 2023-10-19T12:59:54.363 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_zero": 0, 2023-10-19T12:59:54.363 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_truncate": 0, 2023-10-19T12:59:54.363 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_delete": 0, 2023-10-19T12:59:54.363 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_mapext": 0, 2023-10-19T12:59:54.363 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_sparse_read": 0, 2023-10-19T12:59:54.364 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_clonerange": 0, 2023-10-19T12:59:54.364 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_getxattr": 1, 2023-10-19T12:59:54.364 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_setxattr": 0, 2023-10-19T12:59:54.364 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_cmpxattr": 0, 2023-10-19T12:59:54.365 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_rmxattr": 0, 2023-10-19T12:59:54.365 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_resetxattrs": 0, 2023-10-19T12:59:54.365 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_call": 0, 2023-10-19T12:59:54.365 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_watch": 0, 2023-10-19T12:59:54.365 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_notify": 0, 2023-10-19T12:59:54.366 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_src_cmpxattr": 0, 2023-10-19T12:59:54.366 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_pgls": 0, 2023-10-19T12:59:54.366 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_pgls_filter": 0, 2023-10-19T12:59:54.366 INFO:teuthology.orchestra.run.smithi157.stdout: "osdop_other": 0, 2023-10-19T12:59:54.366 INFO:teuthology.orchestra.run.smithi157.stdout: "linger_active": 0, 2023-10-19T12:59:54.367 INFO:teuthology.orchestra.run.smithi157.stdout: "linger_send": 0, 2023-10-19T12:59:54.367 INFO:teuthology.orchestra.run.smithi157.stdout: "linger_resend": 0, 2023-10-19T12:59:54.367 INFO:teuthology.orchestra.run.smithi157.stdout: "linger_ping": 0, 2023-10-19T12:59:54.367 INFO:teuthology.orchestra.run.smithi157.stdout: "poolop_active": 0, 2023-10-19T12:59:54.367 INFO:teuthology.orchestra.run.smithi157.stdout: "poolop_send": 0, 2023-10-19T12:59:54.367 INFO:teuthology.orchestra.run.smithi157.stdout: "poolop_resend": 0, 2023-10-19T12:59:54.368 INFO:teuthology.orchestra.run.smithi157.stdout: "poolstat_active": 0, 2023-10-19T12:59:54.368 INFO:teuthology.orchestra.run.smithi157.stdout: "poolstat_send": 0, 2023-10-19T12:59:54.368 INFO:teuthology.orchestra.run.smithi157.stdout: "poolstat_resend": 0, 2023-10-19T12:59:54.368 INFO:teuthology.orchestra.run.smithi157.stdout: "statfs_active": 0, 2023-10-19T12:59:54.368 INFO:teuthology.orchestra.run.smithi157.stdout: "statfs_send": 0, 2023-10-19T12:59:54.368 INFO:teuthology.orchestra.run.smithi157.stdout: "statfs_resend": 0, 2023-10-19T12:59:54.369 INFO:teuthology.orchestra.run.smithi157.stdout: "command_active": 0, 2023-10-19T12:59:54.369 INFO:teuthology.orchestra.run.smithi157.stdout: "command_send": 0, 2023-10-19T12:59:54.369 INFO:teuthology.orchestra.run.smithi157.stdout: "command_resend": 0, 2023-10-19T12:59:54.369 INFO:teuthology.orchestra.run.smithi157.stdout: "map_epoch": 92, 2023-10-19T12:59:54.369 INFO:teuthology.orchestra.run.smithi157.stdout: "map_full": 0, 2023-10-19T12:59:54.370 INFO:teuthology.orchestra.run.smithi157.stdout: "map_inc": 4, 2023-10-19T12:59:54.370 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_sessions": 5, 2023-10-19T12:59:54.370 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_session_open": 6, 2023-10-19T12:59:54.370 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_session_close": 1, 2023-10-19T12:59:54.370 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_laggy": 0, 2023-10-19T12:59:54.370 INFO:teuthology.orchestra.run.smithi157.stdout: "omap_wr": 0, 2023-10-19T12:59:54.371 INFO:teuthology.orchestra.run.smithi157.stdout: "omap_rd": 2, 2023-10-19T12:59:54.371 INFO:teuthology.orchestra.run.smithi157.stdout: "omap_del": 0 2023-10-19T12:59:54.371 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:54.371 INFO:teuthology.orchestra.run.smithi157.stdout: "oft": { 2023-10-19T12:59:54.371 INFO:teuthology.orchestra.run.smithi157.stdout: "omap_total_objs": 0, 2023-10-19T12:59:54.372 INFO:teuthology.orchestra.run.smithi157.stdout: "omap_total_kv_pairs": 0, 2023-10-19T12:59:54.372 INFO:teuthology.orchestra.run.smithi157.stdout: "omap_total_updates": 0, 2023-10-19T12:59:54.372 INFO:teuthology.orchestra.run.smithi157.stdout: "omap_total_removes": 0 2023-10-19T12:59:54.372 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:54.372 INFO:teuthology.orchestra.run.smithi157.stdout: "osd-slow-ops": { 2023-10-19T12:59:54.372 INFO:teuthology.orchestra.run.smithi157.stdout: "slow_ops_count": 0 2023-10-19T12:59:54.373 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:54.373 INFO:teuthology.orchestra.run.smithi157.stdout: "purge_queue": { 2023-10-19T12:59:54.373 INFO:teuthology.orchestra.run.smithi157.stdout: "pq_executing_ops": 0, 2023-10-19T12:59:54.373 INFO:teuthology.orchestra.run.smithi157.stdout: "pq_executing_ops_high_water": 0, 2023-10-19T12:59:54.373 INFO:teuthology.orchestra.run.smithi157.stdout: "pq_executing": 0, 2023-10-19T12:59:54.373 INFO:teuthology.orchestra.run.smithi157.stdout: "pq_executing_high_water": 0, 2023-10-19T12:59:54.374 INFO:teuthology.orchestra.run.smithi157.stdout: "pq_executed": 0, 2023-10-19T12:59:54.374 INFO:teuthology.orchestra.run.smithi157.stdout: "pq_item_in_journal": 0 2023-10-19T12:59:54.374 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:54.374 INFO:teuthology.orchestra.run.smithi157.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-19T12:59:54.374 INFO:teuthology.orchestra.run.smithi157.stdout: "val": 0, 2023-10-19T12:59:54.375 INFO:teuthology.orchestra.run.smithi157.stdout: "max": 104857600, 2023-10-19T12:59:54.375 INFO:teuthology.orchestra.run.smithi157.stdout: "get_started": 0, 2023-10-19T12:59:54.375 INFO:teuthology.orchestra.run.smithi157.stdout: "get": 3645, 2023-10-19T12:59:54.375 INFO:teuthology.orchestra.run.smithi157.stdout: "get_sum": 3527336, 2023-10-19T12:59:54.375 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_fail": 0, 2023-10-19T12:59:54.376 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_success": 3645, 2023-10-19T12:59:54.376 INFO:teuthology.orchestra.run.smithi157.stdout: "take": 0, 2023-10-19T12:59:54.376 INFO:teuthology.orchestra.run.smithi157.stdout: "take_sum": 0, 2023-10-19T12:59:54.376 INFO:teuthology.orchestra.run.smithi157.stdout: "put": 3645, 2023-10-19T12:59:54.376 INFO:teuthology.orchestra.run.smithi157.stdout: "put_sum": 3527336, 2023-10-19T12:59:54.376 INFO:teuthology.orchestra.run.smithi157.stdout: "wait": { 2023-10-19T12:59:54.377 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:54.377 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:54.377 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:54.377 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-10-19T12:59:54.377 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:54.377 INFO:teuthology.orchestra.run.smithi157.stdout: "throttle-objecter_bytes": { 2023-10-19T12:59:54.378 INFO:teuthology.orchestra.run.smithi157.stdout: "val": 0, 2023-10-19T12:59:54.378 INFO:teuthology.orchestra.run.smithi157.stdout: "max": 104857600, 2023-10-19T12:59:54.378 INFO:teuthology.orchestra.run.smithi157.stdout: "get_started": 0, 2023-10-19T12:59:54.378 INFO:teuthology.orchestra.run.smithi157.stdout: "get": 0, 2023-10-19T12:59:54.378 INFO:teuthology.orchestra.run.smithi157.stdout: "get_sum": 0, 2023-10-19T12:59:54.379 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_fail": 0, 2023-10-19T12:59:54.379 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_success": 0, 2023-10-19T12:59:54.379 INFO:teuthology.orchestra.run.smithi157.stdout: "take": 3295, 2023-10-19T12:59:54.379 INFO:teuthology.orchestra.run.smithi157.stdout: "take_sum": 2245324, 2023-10-19T12:59:54.379 INFO:teuthology.orchestra.run.smithi157.stdout: "put": 3295, 2023-10-19T12:59:54.379 INFO:teuthology.orchestra.run.smithi157.stdout: "put_sum": 2245324, 2023-10-19T12:59:54.380 INFO:teuthology.orchestra.run.smithi157.stdout: "wait": { 2023-10-19T12:59:54.380 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:54.380 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:54.380 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:54.380 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-10-19T12:59:54.381 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:54.381 INFO:teuthology.orchestra.run.smithi157.stdout: "throttle-objecter_ops": { 2023-10-19T12:59:54.381 INFO:teuthology.orchestra.run.smithi157.stdout: "val": 0, 2023-10-19T12:59:54.381 INFO:teuthology.orchestra.run.smithi157.stdout: "max": 1024, 2023-10-19T12:59:54.381 INFO:teuthology.orchestra.run.smithi157.stdout: "get_started": 0, 2023-10-19T12:59:54.381 INFO:teuthology.orchestra.run.smithi157.stdout: "get": 0, 2023-10-19T12:59:54.382 INFO:teuthology.orchestra.run.smithi157.stdout: "get_sum": 0, 2023-10-19T12:59:54.382 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_fail": 0, 2023-10-19T12:59:54.382 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_success": 0, 2023-10-19T12:59:54.382 INFO:teuthology.orchestra.run.smithi157.stdout: "take": 3295, 2023-10-19T12:59:54.382 INFO:teuthology.orchestra.run.smithi157.stdout: "take_sum": 3295, 2023-10-19T12:59:54.382 INFO:teuthology.orchestra.run.smithi157.stdout: "put": 3295, 2023-10-19T12:59:54.383 INFO:teuthology.orchestra.run.smithi157.stdout: "put_sum": 3295, 2023-10-19T12:59:54.383 INFO:teuthology.orchestra.run.smithi157.stdout: "wait": { 2023-10-19T12:59:54.383 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:54.383 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:54.383 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:54.383 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-10-19T12:59:54.384 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:54.384 INFO:teuthology.orchestra.run.smithi157.stdout: "throttle-write_buf_throttle": { 2023-10-19T12:59:54.384 INFO:teuthology.orchestra.run.smithi157.stdout: "val": 0, 2023-10-19T12:59:54.384 INFO:teuthology.orchestra.run.smithi157.stdout: "max": 3758096384, 2023-10-19T12:59:54.384 INFO:teuthology.orchestra.run.smithi157.stdout: "get_started": 0, 2023-10-19T12:59:54.384 INFO:teuthology.orchestra.run.smithi157.stdout: "get": 0, 2023-10-19T12:59:54.385 INFO:teuthology.orchestra.run.smithi157.stdout: "get_sum": 0, 2023-10-19T12:59:54.385 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_fail": 0, 2023-10-19T12:59:54.385 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_success": 0, 2023-10-19T12:59:54.385 INFO:teuthology.orchestra.run.smithi157.stdout: "take": 0, 2023-10-19T12:59:54.385 INFO:teuthology.orchestra.run.smithi157.stdout: "take_sum": 0, 2023-10-19T12:59:54.385 INFO:teuthology.orchestra.run.smithi157.stdout: "put": 0, 2023-10-19T12:59:54.386 INFO:teuthology.orchestra.run.smithi157.stdout: "put_sum": 0, 2023-10-19T12:59:54.386 INFO:teuthology.orchestra.run.smithi157.stdout: "wait": { 2023-10-19T12:59:54.386 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:54.386 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:54.386 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:54.387 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-10-19T12:59:54.387 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-19T12:59:54.387 INFO:teuthology.orchestra.run.smithi157.stdout: "throttle-write_buf_throttle-0x5598e6058960": { 2023-10-19T12:59:54.387 INFO:teuthology.orchestra.run.smithi157.stdout: "val": 0, 2023-10-19T12:59:54.387 INFO:teuthology.orchestra.run.smithi157.stdout: "max": 3758096384, 2023-10-19T12:59:54.387 INFO:teuthology.orchestra.run.smithi157.stdout: "get_started": 0, 2023-10-19T12:59:54.388 INFO:teuthology.orchestra.run.smithi157.stdout: "get": 0, 2023-10-19T12:59:54.388 INFO:teuthology.orchestra.run.smithi157.stdout: "get_sum": 0, 2023-10-19T12:59:54.388 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_fail": 0, 2023-10-19T12:59:54.388 INFO:teuthology.orchestra.run.smithi157.stdout: "get_or_fail_success": 0, 2023-10-19T12:59:54.388 INFO:teuthology.orchestra.run.smithi157.stdout: "take": 0, 2023-10-19T12:59:54.389 INFO:teuthology.orchestra.run.smithi157.stdout: "take_sum": 0, 2023-10-19T12:59:54.389 INFO:teuthology.orchestra.run.smithi157.stdout: "put": 0, 2023-10-19T12:59:54.389 INFO:teuthology.orchestra.run.smithi157.stdout: "put_sum": 0, 2023-10-19T12:59:54.389 INFO:teuthology.orchestra.run.smithi157.stdout: "wait": { 2023-10-19T12:59:54.389 INFO:teuthology.orchestra.run.smithi157.stdout: "avgcount": 0, 2023-10-19T12:59:54.389 INFO:teuthology.orchestra.run.smithi157.stdout: "sum": 0.000000000, 2023-10-19T12:59:54.390 INFO:teuthology.orchestra.run.smithi157.stdout: "avgtime": 0.000000000 2023-10-19T12:59:54.390 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-10-19T12:59:54.390 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-10-19T12:59:54.390 INFO:teuthology.orchestra.run.smithi157.stdout:} 2023-10-19T12:59:54.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:59:54 smithi046 ceph-mon[98509]: pgmap v845: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 14 op/s 2023-10-19T12:59:54.488 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:59:54 smithi157 ceph-mon[134109]: pgmap v845: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 14 op/s 2023-10-19T12:59:54.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:59:54 smithi195 ceph-mon[134493]: pgmap v845: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 14 op/s 2023-10-19T12:59:55.240 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2023-10-19T12:59:55.241 INFO:tasks.check_counter:Daemon mds.k mds.imported=0 2023-10-19T12:59:55.241 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update=0 2023-10-19T12:59:55.241 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update_receipt=0 2023-10-19T12:59:55.241 DEBUG:tasks.check_counter:Getting stats from c 2023-10-19T12:59:55.242 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph daemon mds.c perf dump 2023-10-19T12:59:55.887 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.c/config 2023-10-19T12:59:56.395 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:59:56 smithi195 ceph-mon[134493]: pgmap v846: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 13 op/s 2023-10-19T12:59:56.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:59:56 smithi046 ceph-mon[98509]: pgmap v846: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 13 op/s 2023-10-19T12:59:56.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:59:56 smithi157 ceph-mon[134109]: pgmap v846: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 13 op/s 2023-10-19T12:59:57.335 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2023-10-19T12:59:57.335 INFO:teuthology.orchestra.run.smithi195.stdout: "AsyncMessenger::Worker-0": { 2023-10-19T12:59:57.335 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_messages": 4340, 2023-10-19T12:59:57.336 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages": 7100, 2023-10-19T12:59:57.336 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_bytes": 1253189, 2023-10-19T12:59:57.336 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_bytes": 5116447, 2023-10-19T12:59:57.336 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_created_connections": 16, 2023-10-19T12:59:57.336 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_active_connections": 3, 2023-10-19T12:59:57.336 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_total_time": 0.312477976, 2023-10-19T12:59:57.337 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_send_time": 0.135068194, 2023-10-19T12:59:57.337 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_recv_time": 0.179555873, 2023-10-19T12:59:57.337 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_fast_dispatch_time": 0.022954467, 2023-10-19T12:59:57.337 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages_queue_lat": { 2023-10-19T12:59:57.337 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 7098, 2023-10-19T12:59:57.338 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.883833172, 2023-10-19T12:59:57.338 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000124518 2023-10-19T12:59:57.338 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:57.338 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_handle_ack_lat": { 2023-10-19T12:59:57.338 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 7501, 2023-10-19T12:59:57.339 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.001723339, 2023-10-19T12:59:57.339 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000229 2023-10-19T12:59:57.339 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:57.339 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-19T12:59:57.339 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_encrypted_bytes": 0 2023-10-19T12:59:57.340 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:57.340 INFO:teuthology.orchestra.run.smithi195.stdout: "AsyncMessenger::Worker-1": { 2023-10-19T12:59:57.340 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_messages": 1031, 2023-10-19T12:59:57.340 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages": 993, 2023-10-19T12:59:57.340 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_bytes": 1038103, 2023-10-19T12:59:57.341 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_bytes": 602727, 2023-10-19T12:59:57.341 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_created_connections": 10, 2023-10-19T12:59:57.341 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_active_connections": 8, 2023-10-19T12:59:57.341 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_total_time": 0.096791064, 2023-10-19T12:59:57.341 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_send_time": 0.034932686, 2023-10-19T12:59:57.341 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_recv_time": 0.044214950, 2023-10-19T12:59:57.342 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_fast_dispatch_time": 0.019356092, 2023-10-19T12:59:57.342 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages_queue_lat": { 2023-10-19T12:59:57.342 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 993, 2023-10-19T12:59:57.342 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.160006095, 2023-10-19T12:59:57.342 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000161134 2023-10-19T12:59:57.343 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:57.343 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_handle_ack_lat": { 2023-10-19T12:59:57.343 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 499, 2023-10-19T12:59:57.343 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000094733, 2023-10-19T12:59:57.343 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000189 2023-10-19T12:59:57.343 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:57.344 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_encrypted_bytes": 727648, 2023-10-19T12:59:57.344 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_encrypted_bytes": 193072 2023-10-19T12:59:57.344 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:57.344 INFO:teuthology.orchestra.run.smithi195.stdout: "AsyncMessenger::Worker-2": { 2023-10-19T12:59:57.344 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_messages": 3520, 2023-10-19T12:59:57.344 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages": 2857, 2023-10-19T12:59:57.345 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_bytes": 1630000, 2023-10-19T12:59:57.345 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_bytes": 1763641, 2023-10-19T12:59:57.345 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_created_connections": 9, 2023-10-19T12:59:57.345 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_active_connections": 5, 2023-10-19T12:59:57.345 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_total_time": 0.215121395, 2023-10-19T12:59:57.346 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_send_time": 0.077896687, 2023-10-19T12:59:57.346 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_recv_time": 0.153639202, 2023-10-19T12:59:57.346 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_fast_dispatch_time": 0.014514752, 2023-10-19T12:59:57.346 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages_queue_lat": { 2023-10-19T12:59:57.346 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 2855, 2023-10-19T12:59:57.346 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.596045305, 2023-10-19T12:59:57.347 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000208772 2023-10-19T12:59:57.347 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:57.347 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_handle_ack_lat": { 2023-10-19T12:59:57.347 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 5264, 2023-10-19T12:59:57.347 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.001109174, 2023-10-19T12:59:57.348 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000210 2023-10-19T12:59:57.348 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:57.348 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_encrypted_bytes": 160, 2023-10-19T12:59:57.348 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_encrypted_bytes": 479120 2023-10-19T12:59:57.348 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:57.348 INFO:teuthology.orchestra.run.smithi195.stdout: "cct": { 2023-10-19T12:59:57.349 INFO:teuthology.orchestra.run.smithi195.stdout: "total_workers": 1, 2023-10-19T12:59:57.349 INFO:teuthology.orchestra.run.smithi195.stdout: "unhealthy_workers": 0 2023-10-19T12:59:57.349 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:57.349 INFO:teuthology.orchestra.run.smithi195.stdout: "finisher-MDSRank": { 2023-10-19T12:59:57.349 INFO:teuthology.orchestra.run.smithi195.stdout: "queue_len": 0, 2023-10-19T12:59:57.349 INFO:teuthology.orchestra.run.smithi195.stdout: "complete_latency": { 2023-10-19T12:59:57.350 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 1278, 2023-10-19T12:59:57.350 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.552213781, 2023-10-19T12:59:57.350 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000432092 2023-10-19T12:59:57.350 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-10-19T12:59:57.350 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:57.351 INFO:teuthology.orchestra.run.smithi195.stdout: "finisher-PurgeQueue": { 2023-10-19T12:59:57.351 INFO:teuthology.orchestra.run.smithi195.stdout: "queue_len": 0, 2023-10-19T12:59:57.351 INFO:teuthology.orchestra.run.smithi195.stdout: "complete_latency": { 2023-10-19T12:59:57.351 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 748, 2023-10-19T12:59:57.351 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.034963603, 2023-10-19T12:59:57.351 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000046742 2023-10-19T12:59:57.352 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-10-19T12:59:57.352 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:57.352 INFO:teuthology.orchestra.run.smithi195.stdout: "mds": { 2023-10-19T12:59:57.352 INFO:teuthology.orchestra.run.smithi195.stdout: "request": 832, 2023-10-19T12:59:57.352 INFO:teuthology.orchestra.run.smithi195.stdout: "reply": 740, 2023-10-19T12:59:57.352 INFO:teuthology.orchestra.run.smithi195.stdout: "reply_latency": { 2023-10-19T12:59:57.353 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 740, 2023-10-19T12:59:57.353 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 79.705892623, 2023-10-19T12:59:57.353 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.107710665 2023-10-19T12:59:57.353 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:57.353 INFO:teuthology.orchestra.run.smithi195.stdout: "slow_reply": 0, 2023-10-19T12:59:57.353 INFO:teuthology.orchestra.run.smithi195.stdout: "forward": 92, 2023-10-19T12:59:57.354 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_fetch_complete": 0, 2023-10-19T12:59:57.354 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_fetch_keys": 0, 2023-10-19T12:59:57.354 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_commit": 11, 2023-10-19T12:59:57.354 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_split": 0, 2023-10-19T12:59:57.354 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_merge": 0, 2023-10-19T12:59:57.355 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes": 144, 2023-10-19T12:59:57.355 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_top": 0, 2023-10-19T12:59:57.355 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_bottom": 48, 2023-10-19T12:59:57.355 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_pin_tail": 96, 2023-10-19T12:59:57.355 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_pinned": 144, 2023-10-19T12:59:57.355 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_expired": 278, 2023-10-19T12:59:57.356 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_with_caps": 119, 2023-10-19T12:59:57.356 INFO:teuthology.orchestra.run.smithi195.stdout: "caps": 119, 2023-10-19T12:59:57.356 INFO:teuthology.orchestra.run.smithi195.stdout: "subtrees": 13, 2023-10-19T12:59:57.356 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse": 2194, 2023-10-19T12:59:57.356 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_hit": 1804, 2023-10-19T12:59:57.357 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_forward": 92, 2023-10-19T12:59:57.357 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_discover": 33, 2023-10-19T12:59:57.357 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_dir_fetch": 0, 2023-10-19T12:59:57.357 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_remote_ino": 0, 2023-10-19T12:59:57.357 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_lock": 55, 2023-10-19T12:59:57.357 INFO:teuthology.orchestra.run.smithi195.stdout: "load_cent": 554, 2023-10-19T12:59:57.358 INFO:teuthology.orchestra.run.smithi195.stdout: "q": 0, 2023-10-19T12:59:57.358 INFO:teuthology.orchestra.run.smithi195.stdout: "exported": 9, 2023-10-19T12:59:57.358 INFO:teuthology.orchestra.run.smithi195.stdout: "exported_inodes": 266, 2023-10-19T12:59:57.358 INFO:teuthology.orchestra.run.smithi195.stdout: "imported": 15, 2023-10-19T12:59:57.358 INFO:teuthology.orchestra.run.smithi195.stdout: "imported_inodes": 382, 2023-10-19T12:59:57.359 INFO:teuthology.orchestra.run.smithi195.stdout: "openino_dir_fetch": 0, 2023-10-19T12:59:57.359 INFO:teuthology.orchestra.run.smithi195.stdout: "openino_backtrace_fetch": 163, 2023-10-19T12:59:57.359 INFO:teuthology.orchestra.run.smithi195.stdout: "openino_peer_discover": 0, 2023-10-19T12:59:57.359 INFO:teuthology.orchestra.run.smithi195.stdout: "root_rfiles": 1037, 2023-10-19T12:59:57.359 INFO:teuthology.orchestra.run.smithi195.stdout: "root_rbytes": 1633283982, 2023-10-19T12:59:57.360 INFO:teuthology.orchestra.run.smithi195.stdout: "root_rsnaps": 0, 2023-10-19T12:59:57.360 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_backtrace_fetch": 163, 2023-10-19T12:59:57.360 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_set_tag": 0, 2023-10-19T12:59:57.360 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_backtrace_repaired": 0, 2023-10-19T12:59:57.360 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_inotable_repaired": 0, 2023-10-19T12:59:57.360 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_dir_inodes": 2, 2023-10-19T12:59:57.361 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_dir_base_inodes": 0, 2023-10-19T12:59:57.361 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_dirfrag_rstats": 2, 2023-10-19T12:59:57.361 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_file_inodes": 161, 2023-10-19T12:59:57.361 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_inode_file_caps": 80, 2023-10-19T12:59:57.361 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_cap_op_revoke": 135, 2023-10-19T12:59:57.362 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_cap_op_grant": 549, 2023-10-19T12:59:57.362 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_cap_op_trunc": 0, 2023-10-19T12:59:57.362 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-19T12:59:57.362 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-19T12:59:57.362 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_client_caps": 473, 2023-10-19T12:59:57.362 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_client_caps_dirty": 213, 2023-10-19T12:59:57.363 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_client_cap_release": 125, 2023-10-19T12:59:57.363 INFO:teuthology.orchestra.run.smithi195.stdout: "process_request_cap_release": 739 2023-10-19T12:59:57.363 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:57.363 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_cache": { 2023-10-19T12:59:57.363 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_update": 89, 2023-10-19T12:59:57.364 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_update_receipt": 423, 2023-10-19T12:59:57.364 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_try_discover": 226, 2023-10-19T12:59:57.364 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_send_discover": 375, 2023-10-19T12:59:57.364 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_handle_discover": 184, 2023-10-19T12:59:57.364 INFO:teuthology.orchestra.run.smithi195.stdout: "num_strays": 0, 2023-10-19T12:59:57.364 INFO:teuthology.orchestra.run.smithi195.stdout: "num_strays_delayed": 0, 2023-10-19T12:59:57.365 INFO:teuthology.orchestra.run.smithi195.stdout: "num_strays_enqueuing": 0, 2023-10-19T12:59:57.365 INFO:teuthology.orchestra.run.smithi195.stdout: "strays_created": 188, 2023-10-19T12:59:57.365 INFO:teuthology.orchestra.run.smithi195.stdout: "strays_enqueued": 188, 2023-10-19T12:59:57.365 INFO:teuthology.orchestra.run.smithi195.stdout: "strays_reintegrated": 0, 2023-10-19T12:59:57.365 INFO:teuthology.orchestra.run.smithi195.stdout: "strays_migrated": 0, 2023-10-19T12:59:57.366 INFO:teuthology.orchestra.run.smithi195.stdout: "num_recovering_processing": 0, 2023-10-19T12:59:57.366 INFO:teuthology.orchestra.run.smithi195.stdout: "num_recovering_enqueued": 0, 2023-10-19T12:59:57.366 INFO:teuthology.orchestra.run.smithi195.stdout: "num_recovering_prioritized": 0, 2023-10-19T12:59:57.366 INFO:teuthology.orchestra.run.smithi195.stdout: "recovery_started": 0, 2023-10-19T12:59:57.366 INFO:teuthology.orchestra.run.smithi195.stdout: "recovery_completed": 0, 2023-10-19T12:59:57.367 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_enqueue_scrub": 0, 2023-10-19T12:59:57.367 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_exportdir": 9, 2023-10-19T12:59:57.367 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_flush": 0, 2023-10-19T12:59:57.367 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_fragmentdir": 0, 2023-10-19T12:59:57.367 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_fragstats": 0, 2023-10-19T12:59:57.367 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_inodestats": 0 2023-10-19T12:59:57.368 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:57.368 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_log": { 2023-10-19T12:59:57.368 INFO:teuthology.orchestra.run.smithi195.stdout: "evlrg": 0, 2023-10-19T12:59:57.368 INFO:teuthology.orchestra.run.smithi195.stdout: "evadd": 1481, 2023-10-19T12:59:57.368 INFO:teuthology.orchestra.run.smithi195.stdout: "evex": 0, 2023-10-19T12:59:57.369 INFO:teuthology.orchestra.run.smithi195.stdout: "evtrm": 0, 2023-10-19T12:59:57.369 INFO:teuthology.orchestra.run.smithi195.stdout: "ev": 1481, 2023-10-19T12:59:57.369 INFO:teuthology.orchestra.run.smithi195.stdout: "evexg": 0, 2023-10-19T12:59:57.369 INFO:teuthology.orchestra.run.smithi195.stdout: "evexd": 0, 2023-10-19T12:59:57.369 INFO:teuthology.orchestra.run.smithi195.stdout: "segadd": 3, 2023-10-19T12:59:57.369 INFO:teuthology.orchestra.run.smithi195.stdout: "segex": 0, 2023-10-19T12:59:57.370 INFO:teuthology.orchestra.run.smithi195.stdout: "segtrm": 0, 2023-10-19T12:59:57.370 INFO:teuthology.orchestra.run.smithi195.stdout: "seg": 3, 2023-10-19T12:59:57.370 INFO:teuthology.orchestra.run.smithi195.stdout: "segmjr": 2, 2023-10-19T12:59:57.370 INFO:teuthology.orchestra.run.smithi195.stdout: "segexg": 0, 2023-10-19T12:59:57.370 INFO:teuthology.orchestra.run.smithi195.stdout: "segexd": 0, 2023-10-19T12:59:57.371 INFO:teuthology.orchestra.run.smithi195.stdout: "expos": 4194304, 2023-10-19T12:59:57.371 INFO:teuthology.orchestra.run.smithi195.stdout: "wrpos": 6439623, 2023-10-19T12:59:57.371 INFO:teuthology.orchestra.run.smithi195.stdout: "rdpos": 0, 2023-10-19T12:59:57.371 INFO:teuthology.orchestra.run.smithi195.stdout: "jlat": { 2023-10-19T12:59:57.371 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 437, 2023-10-19T12:59:57.371 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 3.572949805, 2023-10-19T12:59:57.372 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.008176086 2023-10-19T12:59:57.372 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:57.372 INFO:teuthology.orchestra.run.smithi195.stdout: "replayed": 0 2023-10-19T12:59:57.372 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:57.372 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_mem": { 2023-10-19T12:59:57.372 INFO:teuthology.orchestra.run.smithi195.stdout: "ino": 142, 2023-10-19T12:59:57.373 INFO:teuthology.orchestra.run.smithi195.stdout: "ino+": 565, 2023-10-19T12:59:57.373 INFO:teuthology.orchestra.run.smithi195.stdout: "ino-": 423, 2023-10-19T12:59:57.373 INFO:teuthology.orchestra.run.smithi195.stdout: "dir": 35, 2023-10-19T12:59:57.373 INFO:teuthology.orchestra.run.smithi195.stdout: "dir+": 220, 2023-10-19T12:59:57.373 INFO:teuthology.orchestra.run.smithi195.stdout: "dir-": 185, 2023-10-19T12:59:57.374 INFO:teuthology.orchestra.run.smithi195.stdout: "dn": 144, 2023-10-19T12:59:57.374 INFO:teuthology.orchestra.run.smithi195.stdout: "dn+": 610, 2023-10-19T12:59:57.374 INFO:teuthology.orchestra.run.smithi195.stdout: "dn-": 466, 2023-10-19T12:59:57.374 INFO:teuthology.orchestra.run.smithi195.stdout: "cap": 119, 2023-10-19T12:59:57.374 INFO:teuthology.orchestra.run.smithi195.stdout: "cap+": 493, 2023-10-19T12:59:57.374 INFO:teuthology.orchestra.run.smithi195.stdout: "cap-": 374, 2023-10-19T12:59:57.375 INFO:teuthology.orchestra.run.smithi195.stdout: "rss": 54304, 2023-10-19T12:59:57.375 INFO:teuthology.orchestra.run.smithi195.stdout: "heap": 198960 2023-10-19T12:59:57.375 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:57.375 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_server": { 2023-10-19T12:59:57.375 INFO:teuthology.orchestra.run.smithi195.stdout: "dispatch_client_request": 2163, 2023-10-19T12:59:57.375 INFO:teuthology.orchestra.run.smithi195.stdout: "dispatch_server_request": 45, 2023-10-19T12:59:57.376 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_client_request": 832, 2023-10-19T12:59:57.376 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_client_session": 18, 2023-10-19T12:59:57.376 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_peer_request": 483, 2023-10-19T12:59:57.376 INFO:teuthology.orchestra.run.smithi195.stdout: "req_create_latency": { 2023-10-19T12:59:57.376 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 186, 2023-10-19T12:59:57.377 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.300188844, 2023-10-19T12:59:57.377 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.001613918 2023-10-19T12:59:57.377 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:57.377 INFO:teuthology.orchestra.run.smithi195.stdout: "req_getattr_latency": { 2023-10-19T12:59:57.377 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 14, 2023-10-19T12:59:57.377 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.609677881, 2023-10-19T12:59:57.378 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.043548420 2023-10-19T12:59:57.378 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:57.378 INFO:teuthology.orchestra.run.smithi195.stdout: "req_getfilelock_latency": { 2023-10-19T12:59:57.378 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T12:59:57.378 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T12:59:57.379 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T12:59:57.379 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:57.379 INFO:teuthology.orchestra.run.smithi195.stdout: "req_link_latency": { 2023-10-19T12:59:57.379 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T12:59:57.379 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T12:59:57.379 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T12:59:57.380 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:57.380 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookup_latency": { 2023-10-19T12:59:57.380 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 244, 2023-10-19T12:59:57.380 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 76.953580744, 2023-10-19T12:59:57.380 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.315383527 2023-10-19T12:59:57.380 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:57.381 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookuphash_latency": { 2023-10-19T12:59:57.381 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T12:59:57.381 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T12:59:57.381 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T12:59:57.381 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:57.382 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookupino_latency": { 2023-10-19T12:59:57.382 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T12:59:57.382 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T12:59:57.382 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T12:59:57.382 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:57.382 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookupname_latency": { 2023-10-19T12:59:57.383 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T12:59:57.383 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T12:59:57.383 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T12:59:57.383 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:57.383 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookupparent_latency": { 2023-10-19T12:59:57.384 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T12:59:57.384 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T12:59:57.384 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T12:59:57.384 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:57.384 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookupsnap_latency": { 2023-10-19T12:59:57.384 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T12:59:57.385 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T12:59:57.385 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T12:59:57.385 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:57.385 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lssnap_latency": { 2023-10-19T12:59:57.385 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T12:59:57.386 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T12:59:57.386 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T12:59:57.386 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:57.386 INFO:teuthology.orchestra.run.smithi195.stdout: "req_mkdir_latency": { 2023-10-19T12:59:57.386 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T12:59:57.387 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T12:59:57.387 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T12:59:57.387 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:57.387 INFO:teuthology.orchestra.run.smithi195.stdout: "req_mknod_latency": { 2023-10-19T12:59:57.387 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T12:59:57.387 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T12:59:57.388 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T12:59:57.388 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:57.388 INFO:teuthology.orchestra.run.smithi195.stdout: "req_mksnap_latency": { 2023-10-19T12:59:57.388 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T12:59:57.388 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T12:59:57.388 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T12:59:57.389 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:57.389 INFO:teuthology.orchestra.run.smithi195.stdout: "req_open_latency": { 2023-10-19T12:59:57.389 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 108, 2023-10-19T12:59:57.389 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.054201787, 2023-10-19T12:59:57.389 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000501868 2023-10-19T12:59:57.389 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:57.390 INFO:teuthology.orchestra.run.smithi195.stdout: "req_readdir_latency": { 2023-10-19T12:59:57.390 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T12:59:57.390 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T12:59:57.390 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T12:59:57.390 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:57.391 INFO:teuthology.orchestra.run.smithi195.stdout: "req_rename_latency": { 2023-10-19T12:59:57.391 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 184, 2023-10-19T12:59:57.391 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 1.778621748, 2023-10-19T12:59:57.391 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.009666422 2023-10-19T12:59:57.391 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:57.391 INFO:teuthology.orchestra.run.smithi195.stdout: "req_renamesnap_latency": { 2023-10-19T12:59:57.392 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T12:59:57.392 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T12:59:57.392 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T12:59:57.392 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:57.392 INFO:teuthology.orchestra.run.smithi195.stdout: "req_snapdiff_latency": { 2023-10-19T12:59:57.392 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T12:59:57.393 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T12:59:57.393 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T12:59:57.393 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:57.393 INFO:teuthology.orchestra.run.smithi195.stdout: "req_rmdir_latency": { 2023-10-19T12:59:57.393 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T12:59:57.393 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T12:59:57.393 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T12:59:57.394 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:57.394 INFO:teuthology.orchestra.run.smithi195.stdout: "req_rmsnap_latency": { 2023-10-19T12:59:57.394 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T12:59:57.394 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T12:59:57.395 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T12:59:57.395 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:57.395 INFO:teuthology.orchestra.run.smithi195.stdout: "req_rmxattr_latency": { 2023-10-19T12:59:57.395 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T12:59:57.395 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T12:59:57.396 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T12:59:57.396 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:57.396 INFO:teuthology.orchestra.run.smithi195.stdout: "req_setattr_latency": { 2023-10-19T12:59:57.396 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T12:59:57.396 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T12:59:57.397 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T12:59:57.397 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:57.397 INFO:teuthology.orchestra.run.smithi195.stdout: "req_setdirlayout_latency": { 2023-10-19T12:59:57.397 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T12:59:57.397 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T12:59:57.397 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T12:59:57.398 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:57.398 INFO:teuthology.orchestra.run.smithi195.stdout: "req_setfilelock_latency": { 2023-10-19T12:59:57.398 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T12:59:57.398 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T12:59:57.398 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T12:59:57.399 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:57.399 INFO:teuthology.orchestra.run.smithi195.stdout: "req_setlayout_latency": { 2023-10-19T12:59:57.399 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T12:59:57.399 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T12:59:57.399 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T12:59:57.399 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:57.400 INFO:teuthology.orchestra.run.smithi195.stdout: "req_setxattr_latency": { 2023-10-19T12:59:57.400 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T12:59:57.400 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T12:59:57.400 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T12:59:57.400 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:57.400 INFO:teuthology.orchestra.run.smithi195.stdout: "req_symlink_latency": { 2023-10-19T12:59:57.401 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T12:59:57.401 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T12:59:57.401 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T12:59:57.401 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:57.401 INFO:teuthology.orchestra.run.smithi195.stdout: "req_unlink_latency": { 2023-10-19T12:59:57.402 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 4, 2023-10-19T12:59:57.402 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.009621619, 2023-10-19T12:59:57.402 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.002405404 2023-10-19T12:59:57.402 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:57.402 INFO:teuthology.orchestra.run.smithi195.stdout: "cap_revoke_eviction": 0, 2023-10-19T12:59:57.402 INFO:teuthology.orchestra.run.smithi195.stdout: "cap_acquisition_throttle": 0, 2023-10-19T12:59:57.403 INFO:teuthology.orchestra.run.smithi195.stdout: "req_getvxattr_latency": { 2023-10-19T12:59:57.403 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T12:59:57.403 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T12:59:57.403 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T12:59:57.403 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-10-19T12:59:57.403 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:57.404 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_sessions": { 2023-10-19T12:59:57.404 INFO:teuthology.orchestra.run.smithi195.stdout: "session_count": 1, 2023-10-19T12:59:57.404 INFO:teuthology.orchestra.run.smithi195.stdout: "session_add": 1, 2023-10-19T12:59:57.404 INFO:teuthology.orchestra.run.smithi195.stdout: "session_remove": 0, 2023-10-19T12:59:57.404 INFO:teuthology.orchestra.run.smithi195.stdout: "sessions_open": 1, 2023-10-19T12:59:57.405 INFO:teuthology.orchestra.run.smithi195.stdout: "sessions_stale": 0, 2023-10-19T12:59:57.405 INFO:teuthology.orchestra.run.smithi195.stdout: "total_load": 68, 2023-10-19T12:59:57.405 INFO:teuthology.orchestra.run.smithi195.stdout: "average_load": 68, 2023-10-19T12:59:57.405 INFO:teuthology.orchestra.run.smithi195.stdout: "avg_session_uptime": 988, 2023-10-19T12:59:57.405 INFO:teuthology.orchestra.run.smithi195.stdout: "mdthresh_evicted": 0 2023-10-19T12:59:57.405 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:57.406 INFO:teuthology.orchestra.run.smithi195.stdout: "mempool": { 2023-10-19T12:59:57.406 INFO:teuthology.orchestra.run.smithi195.stdout: "bloom_filter_bytes": 0, 2023-10-19T12:59:57.406 INFO:teuthology.orchestra.run.smithi195.stdout: "bloom_filter_items": 0, 2023-10-19T12:59:57.406 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_alloc_bytes": 0, 2023-10-19T12:59:57.406 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_alloc_items": 0, 2023-10-19T12:59:57.407 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_data_bytes": 0, 2023-10-19T12:59:57.407 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_data_items": 0, 2023-10-19T12:59:57.407 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-19T12:59:57.407 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_onode_items": 0, 2023-10-19T12:59:57.407 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-19T12:59:57.408 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_meta_items": 0, 2023-10-19T12:59:57.408 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_other_bytes": 0, 2023-10-19T12:59:57.408 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_other_items": 0, 2023-10-19T12:59:57.408 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-19T12:59:57.408 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_buffer_items": 0, 2023-10-19T12:59:57.408 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_extent_bytes": 0, 2023-10-19T12:59:57.409 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_extent_items": 0, 2023-10-19T12:59:57.409 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_blob_bytes": 0, 2023-10-19T12:59:57.409 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_blob_items": 0, 2023-10-19T12:59:57.409 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-19T12:59:57.409 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_shared_blob_items": 0, 2023-10-19T12:59:57.409 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-19T12:59:57.410 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_inline_bl_items": 0, 2023-10-19T12:59:57.410 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_fsck_bytes": 0, 2023-10-19T12:59:57.410 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_fsck_items": 0, 2023-10-19T12:59:57.410 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_txc_bytes": 0, 2023-10-19T12:59:57.410 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_txc_items": 0, 2023-10-19T12:59:57.411 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-19T12:59:57.411 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_writing_deferred_items": 0, 2023-10-19T12:59:57.411 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_writing_bytes": 0, 2023-10-19T12:59:57.411 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_writing_items": 0, 2023-10-19T12:59:57.411 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_bytes": 0, 2023-10-19T12:59:57.411 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_items": 0, 2023-10-19T12:59:57.412 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_file_reader_bytes": 0, 2023-10-19T12:59:57.412 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_file_reader_items": 0, 2023-10-19T12:59:57.412 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_file_writer_bytes": 0, 2023-10-19T12:59:57.412 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_file_writer_items": 0, 2023-10-19T12:59:57.412 INFO:teuthology.orchestra.run.smithi195.stdout: "buffer_anon_bytes": 321764, 2023-10-19T12:59:57.412 INFO:teuthology.orchestra.run.smithi195.stdout: "buffer_anon_items": 253, 2023-10-19T12:59:57.413 INFO:teuthology.orchestra.run.smithi195.stdout: "buffer_meta_bytes": 88, 2023-10-19T12:59:57.413 INFO:teuthology.orchestra.run.smithi195.stdout: "buffer_meta_items": 1, 2023-10-19T12:59:57.413 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_bytes": 0, 2023-10-19T12:59:57.413 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_items": 0, 2023-10-19T12:59:57.413 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_mapbl_bytes": 0, 2023-10-19T12:59:57.413 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_mapbl_items": 0, 2023-10-19T12:59:57.414 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_pglog_bytes": 0, 2023-10-19T12:59:57.414 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_pglog_items": 0, 2023-10-19T12:59:57.414 INFO:teuthology.orchestra.run.smithi195.stdout: "osdmap_bytes": 9280, 2023-10-19T12:59:57.414 INFO:teuthology.orchestra.run.smithi195.stdout: "osdmap_items": 179, 2023-10-19T12:59:57.414 INFO:teuthology.orchestra.run.smithi195.stdout: "osdmap_mapping_bytes": 0, 2023-10-19T12:59:57.415 INFO:teuthology.orchestra.run.smithi195.stdout: "osdmap_mapping_items": 0, 2023-10-19T12:59:57.415 INFO:teuthology.orchestra.run.smithi195.stdout: "pgmap_bytes": 0, 2023-10-19T12:59:57.415 INFO:teuthology.orchestra.run.smithi195.stdout: "pgmap_items": 0, 2023-10-19T12:59:57.415 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_co_bytes": 520527, 2023-10-19T12:59:57.415 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_co_items": 4924, 2023-10-19T12:59:57.415 INFO:teuthology.orchestra.run.smithi195.stdout: "unittest_1_bytes": 0, 2023-10-19T12:59:57.416 INFO:teuthology.orchestra.run.smithi195.stdout: "unittest_1_items": 0, 2023-10-19T12:59:57.416 INFO:teuthology.orchestra.run.smithi195.stdout: "unittest_2_bytes": 0, 2023-10-19T12:59:57.416 INFO:teuthology.orchestra.run.smithi195.stdout: "unittest_2_items": 0 2023-10-19T12:59:57.416 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:57.416 INFO:teuthology.orchestra.run.smithi195.stdout: "objecter": { 2023-10-19T12:59:57.416 INFO:teuthology.orchestra.run.smithi195.stdout: "op_active": 0, 2023-10-19T12:59:57.417 INFO:teuthology.orchestra.run.smithi195.stdout: "op_laggy": 0, 2023-10-19T12:59:57.417 INFO:teuthology.orchestra.run.smithi195.stdout: "op_send": 1408, 2023-10-19T12:59:57.417 INFO:teuthology.orchestra.run.smithi195.stdout: "op_send_bytes": 2331705, 2023-10-19T12:59:57.417 INFO:teuthology.orchestra.run.smithi195.stdout: "op_resend": 28, 2023-10-19T12:59:57.417 INFO:teuthology.orchestra.run.smithi195.stdout: "op_reply": 1408, 2023-10-19T12:59:57.418 INFO:teuthology.orchestra.run.smithi195.stdout: "op_latency": { 2023-10-19T12:59:57.418 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 1408, 2023-10-19T12:59:57.418 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 26.935507386, 2023-10-19T12:59:57.418 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.019130331 2023-10-19T12:59:57.418 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:57.419 INFO:teuthology.orchestra.run.smithi195.stdout: "op_inflight": 0, 2023-10-19T12:59:57.419 INFO:teuthology.orchestra.run.smithi195.stdout: "oplen_avg": { 2023-10-19T12:59:57.419 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 1408, 2023-10-19T12:59:57.419 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 1534 2023-10-19T12:59:57.419 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:57.419 INFO:teuthology.orchestra.run.smithi195.stdout: "op": 1408, 2023-10-19T12:59:57.420 INFO:teuthology.orchestra.run.smithi195.stdout: "op_r": 258, 2023-10-19T12:59:57.420 INFO:teuthology.orchestra.run.smithi195.stdout: "op_w": 1150, 2023-10-19T12:59:57.420 INFO:teuthology.orchestra.run.smithi195.stdout: "op_rmw": 0, 2023-10-19T12:59:57.420 INFO:teuthology.orchestra.run.smithi195.stdout: "op_pg": 0, 2023-10-19T12:59:57.420 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_stat": 0, 2023-10-19T12:59:57.420 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_create": 10, 2023-10-19T12:59:57.421 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_read": 95, 2023-10-19T12:59:57.421 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_write": 532, 2023-10-19T12:59:57.421 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_writefull": 124, 2023-10-19T12:59:57.421 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_writesame": 0, 2023-10-19T12:59:57.421 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_append": 0, 2023-10-19T12:59:57.422 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_zero": 0, 2023-10-19T12:59:57.422 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_truncate": 0, 2023-10-19T12:59:57.422 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_delete": 388, 2023-10-19T12:59:57.422 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_mapext": 0, 2023-10-19T12:59:57.422 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_sparse_read": 0, 2023-10-19T12:59:57.422 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_clonerange": 0, 2023-10-19T12:59:57.423 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_getxattr": 163, 2023-10-19T12:59:57.423 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_setxattr": 20, 2023-10-19T12:59:57.423 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_cmpxattr": 0, 2023-10-19T12:59:57.423 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_rmxattr": 0, 2023-10-19T12:59:57.423 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_resetxattrs": 0, 2023-10-19T12:59:57.424 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_call": 0, 2023-10-19T12:59:57.424 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_watch": 0, 2023-10-19T12:59:57.424 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_notify": 0, 2023-10-19T12:59:57.424 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_src_cmpxattr": 0, 2023-10-19T12:59:57.424 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_pgls": 0, 2023-10-19T12:59:57.425 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_pgls_filter": 0, 2023-10-19T12:59:57.425 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_other": 0, 2023-10-19T12:59:57.425 INFO:teuthology.orchestra.run.smithi195.stdout: "linger_active": 0, 2023-10-19T12:59:57.425 INFO:teuthology.orchestra.run.smithi195.stdout: "linger_send": 0, 2023-10-19T12:59:57.425 INFO:teuthology.orchestra.run.smithi195.stdout: "linger_resend": 0, 2023-10-19T12:59:57.425 INFO:teuthology.orchestra.run.smithi195.stdout: "linger_ping": 0, 2023-10-19T12:59:57.426 INFO:teuthology.orchestra.run.smithi195.stdout: "poolop_active": 0, 2023-10-19T12:59:57.426 INFO:teuthology.orchestra.run.smithi195.stdout: "poolop_send": 0, 2023-10-19T12:59:57.426 INFO:teuthology.orchestra.run.smithi195.stdout: "poolop_resend": 0, 2023-10-19T12:59:57.426 INFO:teuthology.orchestra.run.smithi195.stdout: "poolstat_active": 0, 2023-10-19T12:59:57.426 INFO:teuthology.orchestra.run.smithi195.stdout: "poolstat_send": 0, 2023-10-19T12:59:57.427 INFO:teuthology.orchestra.run.smithi195.stdout: "poolstat_resend": 0, 2023-10-19T12:59:57.427 INFO:teuthology.orchestra.run.smithi195.stdout: "statfs_active": 0, 2023-10-19T12:59:57.427 INFO:teuthology.orchestra.run.smithi195.stdout: "statfs_send": 0, 2023-10-19T12:59:57.427 INFO:teuthology.orchestra.run.smithi195.stdout: "statfs_resend": 0, 2023-10-19T12:59:57.427 INFO:teuthology.orchestra.run.smithi195.stdout: "command_active": 0, 2023-10-19T12:59:57.427 INFO:teuthology.orchestra.run.smithi195.stdout: "command_send": 0, 2023-10-19T12:59:57.428 INFO:teuthology.orchestra.run.smithi195.stdout: "command_resend": 0, 2023-10-19T12:59:57.428 INFO:teuthology.orchestra.run.smithi195.stdout: "map_epoch": 92, 2023-10-19T12:59:57.428 INFO:teuthology.orchestra.run.smithi195.stdout: "map_full": 0, 2023-10-19T12:59:57.428 INFO:teuthology.orchestra.run.smithi195.stdout: "map_inc": 4, 2023-10-19T12:59:57.428 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_sessions": 12, 2023-10-19T12:59:57.429 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_session_open": 12, 2023-10-19T12:59:57.429 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_session_close": 0, 2023-10-19T12:59:57.429 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_laggy": 0, 2023-10-19T12:59:57.429 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_wr": 146, 2023-10-19T12:59:57.429 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_rd": 0, 2023-10-19T12:59:57.429 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_del": 56 2023-10-19T12:59:57.430 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:57.430 INFO:teuthology.orchestra.run.smithi195.stdout: "oft": { 2023-10-19T12:59:57.430 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_total_objs": 1, 2023-10-19T12:59:57.430 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_total_kv_pairs": 0, 2023-10-19T12:59:57.430 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_total_updates": 0, 2023-10-19T12:59:57.431 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_total_removes": 0 2023-10-19T12:59:57.431 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:57.431 INFO:teuthology.orchestra.run.smithi195.stdout: "osd-slow-ops": { 2023-10-19T12:59:57.431 INFO:teuthology.orchestra.run.smithi195.stdout: "slow_ops_count": 0 2023-10-19T12:59:57.431 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:57.432 INFO:teuthology.orchestra.run.smithi195.stdout: "purge_queue": { 2023-10-19T12:59:57.432 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executing_ops": 0, 2023-10-19T12:59:57.432 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executing_ops_high_water": 10, 2023-10-19T12:59:57.432 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executing": 0, 2023-10-19T12:59:57.432 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executing_high_water": 5, 2023-10-19T12:59:57.432 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executed": 188, 2023-10-19T12:59:57.433 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_item_in_journal": 0 2023-10-19T12:59:57.433 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:57.433 INFO:teuthology.orchestra.run.smithi195.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-19T12:59:57.433 INFO:teuthology.orchestra.run.smithi195.stdout: "val": 0, 2023-10-19T12:59:57.433 INFO:teuthology.orchestra.run.smithi195.stdout: "max": 104857600, 2023-10-19T12:59:57.434 INFO:teuthology.orchestra.run.smithi195.stdout: "get_started": 0, 2023-10-19T12:59:57.434 INFO:teuthology.orchestra.run.smithi195.stdout: "get": 8887, 2023-10-19T12:59:57.434 INFO:teuthology.orchestra.run.smithi195.stdout: "get_sum": 3122799, 2023-10-19T12:59:57.434 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_fail": 0, 2023-10-19T12:59:57.434 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_success": 8887, 2023-10-19T12:59:57.435 INFO:teuthology.orchestra.run.smithi195.stdout: "take": 0, 2023-10-19T12:59:57.435 INFO:teuthology.orchestra.run.smithi195.stdout: "take_sum": 0, 2023-10-19T12:59:57.435 INFO:teuthology.orchestra.run.smithi195.stdout: "put": 8887, 2023-10-19T12:59:57.435 INFO:teuthology.orchestra.run.smithi195.stdout: "put_sum": 3122799, 2023-10-19T12:59:57.435 INFO:teuthology.orchestra.run.smithi195.stdout: "wait": { 2023-10-19T12:59:57.435 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T12:59:57.436 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T12:59:57.436 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T12:59:57.436 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-10-19T12:59:57.436 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:57.436 INFO:teuthology.orchestra.run.smithi195.stdout: "throttle-objecter_bytes": { 2023-10-19T12:59:57.436 INFO:teuthology.orchestra.run.smithi195.stdout: "val": 0, 2023-10-19T12:59:57.437 INFO:teuthology.orchestra.run.smithi195.stdout: "max": 104857600, 2023-10-19T12:59:57.437 INFO:teuthology.orchestra.run.smithi195.stdout: "get_started": 0, 2023-10-19T12:59:57.437 INFO:teuthology.orchestra.run.smithi195.stdout: "get": 0, 2023-10-19T12:59:57.437 INFO:teuthology.orchestra.run.smithi195.stdout: "get_sum": 0, 2023-10-19T12:59:57.437 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_fail": 0, 2023-10-19T12:59:57.438 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_success": 0, 2023-10-19T12:59:57.438 INFO:teuthology.orchestra.run.smithi195.stdout: "take": 1408, 2023-10-19T12:59:57.438 INFO:teuthology.orchestra.run.smithi195.stdout: "take_sum": 2352197, 2023-10-19T12:59:57.438 INFO:teuthology.orchestra.run.smithi195.stdout: "put": 1408, 2023-10-19T12:59:57.438 INFO:teuthology.orchestra.run.smithi195.stdout: "put_sum": 2352197, 2023-10-19T12:59:57.439 INFO:teuthology.orchestra.run.smithi195.stdout: "wait": { 2023-10-19T12:59:57.439 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T12:59:57.439 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T12:59:57.439 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T12:59:57.439 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-10-19T12:59:57.439 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:57.440 INFO:teuthology.orchestra.run.smithi195.stdout: "throttle-objecter_ops": { 2023-10-19T12:59:57.440 INFO:teuthology.orchestra.run.smithi195.stdout: "val": 0, 2023-10-19T12:59:57.440 INFO:teuthology.orchestra.run.smithi195.stdout: "max": 1024, 2023-10-19T12:59:57.440 INFO:teuthology.orchestra.run.smithi195.stdout: "get_started": 0, 2023-10-19T12:59:57.440 INFO:teuthology.orchestra.run.smithi195.stdout: "get": 0, 2023-10-19T12:59:57.441 INFO:teuthology.orchestra.run.smithi195.stdout: "get_sum": 0, 2023-10-19T12:59:57.441 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_fail": 0, 2023-10-19T12:59:57.441 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_success": 0, 2023-10-19T12:59:57.441 INFO:teuthology.orchestra.run.smithi195.stdout: "take": 1408, 2023-10-19T12:59:57.441 INFO:teuthology.orchestra.run.smithi195.stdout: "take_sum": 1408, 2023-10-19T12:59:57.441 INFO:teuthology.orchestra.run.smithi195.stdout: "put": 1408, 2023-10-19T12:59:57.442 INFO:teuthology.orchestra.run.smithi195.stdout: "put_sum": 1408, 2023-10-19T12:59:57.442 INFO:teuthology.orchestra.run.smithi195.stdout: "wait": { 2023-10-19T12:59:57.442 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T12:59:57.442 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T12:59:57.442 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T12:59:57.443 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-10-19T12:59:57.443 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:57.443 INFO:teuthology.orchestra.run.smithi195.stdout: "throttle-write_buf_throttle": { 2023-10-19T12:59:57.443 INFO:teuthology.orchestra.run.smithi195.stdout: "val": 0, 2023-10-19T12:59:57.443 INFO:teuthology.orchestra.run.smithi195.stdout: "max": 3758096384, 2023-10-19T12:59:57.444 INFO:teuthology.orchestra.run.smithi195.stdout: "get_started": 0, 2023-10-19T12:59:57.444 INFO:teuthology.orchestra.run.smithi195.stdout: "get": 188, 2023-10-19T12:59:57.444 INFO:teuthology.orchestra.run.smithi195.stdout: "get_sum": 20492, 2023-10-19T12:59:57.444 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_fail": 0, 2023-10-19T12:59:57.444 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_success": 188, 2023-10-19T12:59:57.444 INFO:teuthology.orchestra.run.smithi195.stdout: "take": 0, 2023-10-19T12:59:57.445 INFO:teuthology.orchestra.run.smithi195.stdout: "take_sum": 0, 2023-10-19T12:59:57.445 INFO:teuthology.orchestra.run.smithi195.stdout: "put": 95, 2023-10-19T12:59:57.445 INFO:teuthology.orchestra.run.smithi195.stdout: "put_sum": 20492, 2023-10-19T12:59:57.445 INFO:teuthology.orchestra.run.smithi195.stdout: "wait": { 2023-10-19T12:59:57.445 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T12:59:57.445 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T12:59:57.446 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T12:59:57.446 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-10-19T12:59:57.446 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:57.446 INFO:teuthology.orchestra.run.smithi195.stdout: "throttle-write_buf_throttle-0x56076a2306e0": { 2023-10-19T12:59:57.446 INFO:teuthology.orchestra.run.smithi195.stdout: "val": 0, 2023-10-19T12:59:57.447 INFO:teuthology.orchestra.run.smithi195.stdout: "max": 3758096384, 2023-10-19T12:59:57.447 INFO:teuthology.orchestra.run.smithi195.stdout: "get_started": 0, 2023-10-19T12:59:57.447 INFO:teuthology.orchestra.run.smithi195.stdout: "get": 1481, 2023-10-19T12:59:57.447 INFO:teuthology.orchestra.run.smithi195.stdout: "get_sum": 2245319, 2023-10-19T12:59:57.447 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_fail": 0, 2023-10-19T12:59:57.448 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_success": 1481, 2023-10-19T12:59:57.448 INFO:teuthology.orchestra.run.smithi195.stdout: "take": 0, 2023-10-19T12:59:57.448 INFO:teuthology.orchestra.run.smithi195.stdout: "take_sum": 0, 2023-10-19T12:59:57.448 INFO:teuthology.orchestra.run.smithi195.stdout: "put": 437, 2023-10-19T12:59:57.448 INFO:teuthology.orchestra.run.smithi195.stdout: "put_sum": 2245319, 2023-10-19T12:59:57.448 INFO:teuthology.orchestra.run.smithi195.stdout: "wait": { 2023-10-19T12:59:57.449 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T12:59:57.449 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T12:59:57.449 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T12:59:57.449 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-10-19T12:59:57.449 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-10-19T12:59:57.450 INFO:teuthology.orchestra.run.smithi195.stdout:} 2023-10-19T12:59:57.841 INFO:tasks.check_counter:Daemon mds.c mds.exported=9 2023-10-19T12:59:57.842 INFO:tasks.check_counter:Daemon mds.c mds.imported=15 2023-10-19T12:59:57.842 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=89 2023-10-19T12:59:57.842 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=423 2023-10-19T12:59:57.842 DEBUG:tasks.check_counter:Getting stats from f 2023-10-19T12:59:57.843 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph daemon mds.f perf dump 2023-10-19T12:59:58.402 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.c/config 2023-10-19T12:59:58.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:59:58 smithi046 ceph-mon[98509]: pgmap v847: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 13 op/s 2023-10-19T12:59:58.589 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:59:58 smithi157 ceph-mon[134109]: pgmap v847: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 13 op/s 2023-10-19T12:59:58.621 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:59:58 smithi195 ceph-mon[134493]: pgmap v847: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 13 op/s 2023-10-19T12:59:59.773 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2023-10-19T12:59:59.774 INFO:teuthology.orchestra.run.smithi195.stdout: "AsyncMessenger::Worker-0": { 2023-10-19T12:59:59.774 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_messages": 1133, 2023-10-19T12:59:59.774 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages": 1110, 2023-10-19T12:59:59.774 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_bytes": 1060445, 2023-10-19T12:59:59.775 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_bytes": 1881260, 2023-10-19T12:59:59.775 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_created_connections": 15, 2023-10-19T12:59:59.775 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_active_connections": 8, 2023-10-19T12:59:59.775 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_total_time": 0.116429195, 2023-10-19T12:59:59.775 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_send_time": 0.041858526, 2023-10-19T12:59:59.776 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_recv_time": 0.048603732, 2023-10-19T12:59:59.776 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_fast_dispatch_time": 0.024287331, 2023-10-19T12:59:59.776 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages_queue_lat": { 2023-10-19T12:59:59.776 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 1108, 2023-10-19T12:59:59.776 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.213979187, 2023-10-19T12:59:59.777 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000193122 2023-10-19T12:59:59.777 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:59.777 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_handle_ack_lat": { 2023-10-19T12:59:59.777 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 506, 2023-10-19T12:59:59.777 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000105979, 2023-10-19T12:59:59.778 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000209 2023-10-19T12:59:59.778 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:59.778 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_encrypted_bytes": 722864, 2023-10-19T12:59:59.778 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_encrypted_bytes": 190592 2023-10-19T12:59:59.778 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:59.779 INFO:teuthology.orchestra.run.smithi195.stdout: "AsyncMessenger::Worker-1": { 2023-10-19T12:59:59.779 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_messages": 3483, 2023-10-19T12:59:59.779 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages": 3012, 2023-10-19T12:59:59.779 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_bytes": 1539318, 2023-10-19T12:59:59.779 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_bytes": 1682066, 2023-10-19T12:59:59.780 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_created_connections": 10, 2023-10-19T12:59:59.780 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_active_connections": 5, 2023-10-19T12:59:59.780 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_total_time": 0.228741133, 2023-10-19T12:59:59.780 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_send_time": 0.083371605, 2023-10-19T12:59:59.780 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_recv_time": 0.193575395, 2023-10-19T12:59:59.780 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_fast_dispatch_time": 0.008330587, 2023-10-19T12:59:59.781 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages_queue_lat": { 2023-10-19T12:59:59.781 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 3014, 2023-10-19T12:59:59.781 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.500583104, 2023-10-19T12:59:59.781 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000166085 2023-10-19T12:59:59.781 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:59.781 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_handle_ack_lat": { 2023-10-19T12:59:59.782 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 5745, 2023-10-19T12:59:59.782 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.001237993, 2023-10-19T12:59:59.782 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000215 2023-10-19T12:59:59.782 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:59.782 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_encrypted_bytes": 320, 2023-10-19T12:59:59.783 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_encrypted_bytes": 565344 2023-10-19T12:59:59.783 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:59.783 INFO:teuthology.orchestra.run.smithi195.stdout: "AsyncMessenger::Worker-2": { 2023-10-19T12:59:59.783 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_messages": 1430, 2023-10-19T12:59:59.783 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages": 1705, 2023-10-19T12:59:59.784 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_bytes": 549854, 2023-10-19T12:59:59.784 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_bytes": 995836, 2023-10-19T12:59:59.784 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_created_connections": 12, 2023-10-19T12:59:59.784 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_active_connections": 7, 2023-10-19T12:59:59.784 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_total_time": 0.101360998, 2023-10-19T12:59:59.785 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_send_time": 0.034925880, 2023-10-19T12:59:59.785 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_recv_time": 0.079908315, 2023-10-19T12:59:59.785 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_fast_dispatch_time": 0.004601598, 2023-10-19T12:59:59.785 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages_queue_lat": { 2023-10-19T12:59:59.785 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 1701, 2023-10-19T12:59:59.786 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.211027503, 2023-10-19T12:59:59.786 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000124060 2023-10-19T12:59:59.786 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:59.786 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_handle_ack_lat": { 2023-10-19T12:59:59.786 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 1407, 2023-10-19T12:59:59.787 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000755413, 2023-10-19T12:59:59.787 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000536 2023-10-19T12:59:59.787 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:59.787 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_encrypted_bytes": 1920, 2023-10-19T12:59:59.787 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_encrypted_bytes": 1568 2023-10-19T12:59:59.788 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:59.788 INFO:teuthology.orchestra.run.smithi195.stdout: "cct": { 2023-10-19T12:59:59.788 INFO:teuthology.orchestra.run.smithi195.stdout: "total_workers": 1, 2023-10-19T12:59:59.788 INFO:teuthology.orchestra.run.smithi195.stdout: "unhealthy_workers": 0 2023-10-19T12:59:59.788 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:59.789 INFO:teuthology.orchestra.run.smithi195.stdout: "finisher-MDSRank": { 2023-10-19T12:59:59.789 INFO:teuthology.orchestra.run.smithi195.stdout: "queue_len": 0, 2023-10-19T12:59:59.789 INFO:teuthology.orchestra.run.smithi195.stdout: "complete_latency": { 2023-10-19T12:59:59.789 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 904, 2023-10-19T12:59:59.789 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.185785413, 2023-10-19T12:59:59.789 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000205514 2023-10-19T12:59:59.790 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-10-19T12:59:59.790 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:59.790 INFO:teuthology.orchestra.run.smithi195.stdout: "finisher-PurgeQueue": { 2023-10-19T12:59:59.790 INFO:teuthology.orchestra.run.smithi195.stdout: "queue_len": 0, 2023-10-19T12:59:59.791 INFO:teuthology.orchestra.run.smithi195.stdout: "complete_latency": { 2023-10-19T12:59:59.791 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 129, 2023-10-19T12:59:59.791 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.004665040, 2023-10-19T12:59:59.791 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000036163 2023-10-19T12:59:59.791 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-10-19T12:59:59.792 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:59.792 INFO:teuthology.orchestra.run.smithi195.stdout: "mds": { 2023-10-19T12:59:59.792 INFO:teuthology.orchestra.run.smithi195.stdout: "request": 452, 2023-10-19T12:59:59.792 INFO:teuthology.orchestra.run.smithi195.stdout: "reply": 328, 2023-10-19T12:59:59.792 INFO:teuthology.orchestra.run.smithi195.stdout: "reply_latency": { 2023-10-19T12:59:59.793 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 328, 2023-10-19T12:59:59.793 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.390661090, 2023-10-19T12:59:59.793 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.001191039 2023-10-19T12:59:59.793 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:59.793 INFO:teuthology.orchestra.run.smithi195.stdout: "slow_reply": 0, 2023-10-19T12:59:59.794 INFO:teuthology.orchestra.run.smithi195.stdout: "forward": 124, 2023-10-19T12:59:59.794 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_fetch_complete": 0, 2023-10-19T12:59:59.794 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_fetch_keys": 0, 2023-10-19T12:59:59.794 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_commit": 11, 2023-10-19T12:59:59.794 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_split": 0, 2023-10-19T12:59:59.795 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_merge": 0, 2023-10-19T12:59:59.795 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes": 285, 2023-10-19T12:59:59.795 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_top": 6, 2023-10-19T12:59:59.795 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_bottom": 279, 2023-10-19T12:59:59.795 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_pin_tail": 0, 2023-10-19T12:59:59.796 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_pinned": 276, 2023-10-19T12:59:59.796 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_expired": 0, 2023-10-19T12:59:59.796 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_with_caps": 246, 2023-10-19T12:59:59.796 INFO:teuthology.orchestra.run.smithi195.stdout: "caps": 246, 2023-10-19T12:59:59.797 INFO:teuthology.orchestra.run.smithi195.stdout: "subtrees": 19, 2023-10-19T12:59:59.797 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse": 1011, 2023-10-19T12:59:59.797 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_hit": 754, 2023-10-19T12:59:59.797 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_forward": 122, 2023-10-19T12:59:59.797 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_discover": 22, 2023-10-19T12:59:59.798 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_dir_fetch": 0, 2023-10-19T12:59:59.798 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_remote_ino": 0, 2023-10-19T12:59:59.798 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_lock": 8, 2023-10-19T12:59:59.798 INFO:teuthology.orchestra.run.smithi195.stdout: "load_cent": 449, 2023-10-19T12:59:59.798 INFO:teuthology.orchestra.run.smithi195.stdout: "q": 0, 2023-10-19T12:59:59.799 INFO:teuthology.orchestra.run.smithi195.stdout: "exported": 0, 2023-10-19T12:59:59.799 INFO:teuthology.orchestra.run.smithi195.stdout: "exported_inodes": 0, 2023-10-19T12:59:59.799 INFO:teuthology.orchestra.run.smithi195.stdout: "imported": 9, 2023-10-19T12:59:59.799 INFO:teuthology.orchestra.run.smithi195.stdout: "imported_inodes": 239, 2023-10-19T12:59:59.799 INFO:teuthology.orchestra.run.smithi195.stdout: "openino_dir_fetch": 0, 2023-10-19T12:59:59.800 INFO:teuthology.orchestra.run.smithi195.stdout: "openino_backtrace_fetch": 162, 2023-10-19T12:59:59.800 INFO:teuthology.orchestra.run.smithi195.stdout: "openino_peer_discover": 0, 2023-10-19T12:59:59.800 INFO:teuthology.orchestra.run.smithi195.stdout: "root_rfiles": 1037, 2023-10-19T12:59:59.800 INFO:teuthology.orchestra.run.smithi195.stdout: "root_rbytes": 1633283982, 2023-10-19T12:59:59.800 INFO:teuthology.orchestra.run.smithi195.stdout: "root_rsnaps": 0, 2023-10-19T12:59:59.801 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_backtrace_fetch": 162, 2023-10-19T12:59:59.801 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_set_tag": 0, 2023-10-19T12:59:59.801 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_backtrace_repaired": 0, 2023-10-19T12:59:59.801 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_inotable_repaired": 0, 2023-10-19T12:59:59.801 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_dir_inodes": 0, 2023-10-19T12:59:59.802 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_dir_base_inodes": 0, 2023-10-19T12:59:59.802 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_dirfrag_rstats": 0, 2023-10-19T12:59:59.802 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_file_inodes": 162, 2023-10-19T12:59:59.802 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_inode_file_caps": 0, 2023-10-19T12:59:59.802 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_cap_op_revoke": 4, 2023-10-19T12:59:59.803 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_cap_op_grant": 175, 2023-10-19T12:59:59.803 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_cap_op_trunc": 0, 2023-10-19T12:59:59.803 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-19T12:59:59.803 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-19T12:59:59.803 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_client_caps": 464, 2023-10-19T12:59:59.803 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_client_caps_dirty": 385, 2023-10-19T12:59:59.804 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_client_cap_release": 28, 2023-10-19T12:59:59.804 INFO:teuthology.orchestra.run.smithi195.stdout: "process_request_cap_release": 90 2023-10-19T12:59:59.804 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:59.804 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_cache": { 2023-10-19T12:59:59.804 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_update": 82, 2023-10-19T12:59:59.804 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_update_receipt": 413, 2023-10-19T12:59:59.805 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_try_discover": 217, 2023-10-19T12:59:59.805 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_send_discover": 363, 2023-10-19T12:59:59.805 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_handle_discover": 94, 2023-10-19T12:59:59.805 INFO:teuthology.orchestra.run.smithi195.stdout: "num_strays": 0, 2023-10-19T12:59:59.805 INFO:teuthology.orchestra.run.smithi195.stdout: "num_strays_delayed": 0, 2023-10-19T12:59:59.805 INFO:teuthology.orchestra.run.smithi195.stdout: "num_strays_enqueuing": 0, 2023-10-19T12:59:59.806 INFO:teuthology.orchestra.run.smithi195.stdout: "strays_created": 18, 2023-10-19T12:59:59.806 INFO:teuthology.orchestra.run.smithi195.stdout: "strays_enqueued": 18, 2023-10-19T12:59:59.806 INFO:teuthology.orchestra.run.smithi195.stdout: "strays_reintegrated": 0, 2023-10-19T12:59:59.806 INFO:teuthology.orchestra.run.smithi195.stdout: "strays_migrated": 0, 2023-10-19T12:59:59.807 INFO:teuthology.orchestra.run.smithi195.stdout: "num_recovering_processing": 0, 2023-10-19T12:59:59.807 INFO:teuthology.orchestra.run.smithi195.stdout: "num_recovering_enqueued": 0, 2023-10-19T12:59:59.807 INFO:teuthology.orchestra.run.smithi195.stdout: "num_recovering_prioritized": 0, 2023-10-19T12:59:59.807 INFO:teuthology.orchestra.run.smithi195.stdout: "recovery_started": 0, 2023-10-19T12:59:59.808 INFO:teuthology.orchestra.run.smithi195.stdout: "recovery_completed": 0, 2023-10-19T12:59:59.808 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_enqueue_scrub": 0, 2023-10-19T12:59:59.808 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_exportdir": 0, 2023-10-19T12:59:59.808 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_flush": 0, 2023-10-19T12:59:59.808 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_fragmentdir": 0, 2023-10-19T12:59:59.808 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_fragstats": 0, 2023-10-19T12:59:59.809 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_inodestats": 0 2023-10-19T12:59:59.809 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:59.809 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_log": { 2023-10-19T12:59:59.809 INFO:teuthology.orchestra.run.smithi195.stdout: "evlrg": 0, 2023-10-19T12:59:59.809 INFO:teuthology.orchestra.run.smithi195.stdout: "evadd": 944, 2023-10-19T12:59:59.809 INFO:teuthology.orchestra.run.smithi195.stdout: "evex": 0, 2023-10-19T12:59:59.810 INFO:teuthology.orchestra.run.smithi195.stdout: "evtrm": 0, 2023-10-19T12:59:59.810 INFO:teuthology.orchestra.run.smithi195.stdout: "ev": 944, 2023-10-19T12:59:59.810 INFO:teuthology.orchestra.run.smithi195.stdout: "evexg": 0, 2023-10-19T12:59:59.810 INFO:teuthology.orchestra.run.smithi195.stdout: "evexd": 0, 2023-10-19T12:59:59.810 INFO:teuthology.orchestra.run.smithi195.stdout: "segadd": 2, 2023-10-19T12:59:59.811 INFO:teuthology.orchestra.run.smithi195.stdout: "segex": 0, 2023-10-19T12:59:59.811 INFO:teuthology.orchestra.run.smithi195.stdout: "segtrm": 0, 2023-10-19T12:59:59.811 INFO:teuthology.orchestra.run.smithi195.stdout: "seg": 2, 2023-10-19T12:59:59.811 INFO:teuthology.orchestra.run.smithi195.stdout: "segmjr": 2, 2023-10-19T12:59:59.811 INFO:teuthology.orchestra.run.smithi195.stdout: "segexg": 0, 2023-10-19T12:59:59.812 INFO:teuthology.orchestra.run.smithi195.stdout: "segexd": 0, 2023-10-19T12:59:59.812 INFO:teuthology.orchestra.run.smithi195.stdout: "expos": 4194304, 2023-10-19T12:59:59.812 INFO:teuthology.orchestra.run.smithi195.stdout: "wrpos": 5480162, 2023-10-19T12:59:59.812 INFO:teuthology.orchestra.run.smithi195.stdout: "rdpos": 0, 2023-10-19T12:59:59.812 INFO:teuthology.orchestra.run.smithi195.stdout: "jlat": { 2023-10-19T12:59:59.812 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 325, 2023-10-19T12:59:59.813 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 8.100471996, 2023-10-19T12:59:59.813 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.024924529 2023-10-19T12:59:59.813 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:59.813 INFO:teuthology.orchestra.run.smithi195.stdout: "replayed": 0 2023-10-19T12:59:59.813 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:59.814 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_mem": { 2023-10-19T12:59:59.814 INFO:teuthology.orchestra.run.smithi195.stdout: "ino": 275, 2023-10-19T12:59:59.814 INFO:teuthology.orchestra.run.smithi195.stdout: "ino+": 293, 2023-10-19T12:59:59.814 INFO:teuthology.orchestra.run.smithi195.stdout: "ino-": 18, 2023-10-19T12:59:59.814 INFO:teuthology.orchestra.run.smithi195.stdout: "dir": 52, 2023-10-19T12:59:59.815 INFO:teuthology.orchestra.run.smithi195.stdout: "dir+": 215, 2023-10-19T12:59:59.815 INFO:teuthology.orchestra.run.smithi195.stdout: "dir-": 163, 2023-10-19T12:59:59.815 INFO:teuthology.orchestra.run.smithi195.stdout: "dn": 285, 2023-10-19T12:59:59.815 INFO:teuthology.orchestra.run.smithi195.stdout: "dn+": 306, 2023-10-19T12:59:59.815 INFO:teuthology.orchestra.run.smithi195.stdout: "dn-": 21, 2023-10-19T12:59:59.815 INFO:teuthology.orchestra.run.smithi195.stdout: "cap": 232, 2023-10-19T12:59:59.816 INFO:teuthology.orchestra.run.smithi195.stdout: "cap+": 433, 2023-10-19T12:59:59.816 INFO:teuthology.orchestra.run.smithi195.stdout: "cap-": 201, 2023-10-19T12:59:59.816 INFO:teuthology.orchestra.run.smithi195.stdout: "rss": 54936, 2023-10-19T12:59:59.816 INFO:teuthology.orchestra.run.smithi195.stdout: "heap": 198960 2023-10-19T12:59:59.816 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:59.816 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_server": { 2023-10-19T12:59:59.817 INFO:teuthology.orchestra.run.smithi195.stdout: "dispatch_client_request": 592, 2023-10-19T12:59:59.817 INFO:teuthology.orchestra.run.smithi195.stdout: "dispatch_server_request": 0, 2023-10-19T12:59:59.817 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_client_request": 452, 2023-10-19T12:59:59.817 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_client_session": 33, 2023-10-19T12:59:59.818 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_peer_request": 42, 2023-10-19T12:59:59.818 INFO:teuthology.orchestra.run.smithi195.stdout: "req_create_latency": { 2023-10-19T12:59:59.818 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 24, 2023-10-19T12:59:59.818 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.104105305, 2023-10-19T12:59:59.819 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.004337721 2023-10-19T12:59:59.819 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:59.819 INFO:teuthology.orchestra.run.smithi195.stdout: "req_getattr_latency": { 2023-10-19T12:59:59.819 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 1, 2023-10-19T12:59:59.819 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000226472, 2023-10-19T12:59:59.819 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000226472 2023-10-19T12:59:59.820 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:59.820 INFO:teuthology.orchestra.run.smithi195.stdout: "req_getfilelock_latency": { 2023-10-19T12:59:59.820 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T12:59:59.820 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T12:59:59.820 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T12:59:59.820 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:59.821 INFO:teuthology.orchestra.run.smithi195.stdout: "req_link_latency": { 2023-10-19T12:59:59.821 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T12:59:59.821 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T12:59:59.821 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T12:59:59.821 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:59.822 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookup_latency": { 2023-10-19T12:59:59.822 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 230, 2023-10-19T12:59:59.822 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.155367352, 2023-10-19T12:59:59.822 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000675510 2023-10-19T12:59:59.822 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:59.823 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookuphash_latency": { 2023-10-19T12:59:59.823 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T12:59:59.823 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T12:59:59.823 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T12:59:59.823 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:59.823 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookupino_latency": { 2023-10-19T12:59:59.824 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 1, 2023-10-19T12:59:59.824 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000122477, 2023-10-19T12:59:59.824 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000122477 2023-10-19T12:59:59.824 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:59.824 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookupname_latency": { 2023-10-19T12:59:59.825 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T12:59:59.825 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T12:59:59.825 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T12:59:59.825 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:59.825 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookupparent_latency": { 2023-10-19T12:59:59.826 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T12:59:59.826 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T12:59:59.826 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T12:59:59.826 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:59.827 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookupsnap_latency": { 2023-10-19T12:59:59.827 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T12:59:59.827 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T12:59:59.827 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T12:59:59.827 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:59.828 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lssnap_latency": { 2023-10-19T12:59:59.828 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T12:59:59.828 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T12:59:59.828 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T12:59:59.829 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:59.829 INFO:teuthology.orchestra.run.smithi195.stdout: "req_mkdir_latency": { 2023-10-19T12:59:59.829 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T12:59:59.829 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T12:59:59.829 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T12:59:59.830 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:59.830 INFO:teuthology.orchestra.run.smithi195.stdout: "req_mknod_latency": { 2023-10-19T12:59:59.830 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T12:59:59.830 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T12:59:59.830 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T12:59:59.831 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:59.831 INFO:teuthology.orchestra.run.smithi195.stdout: "req_mksnap_latency": { 2023-10-19T12:59:59.831 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T12:59:59.831 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T12:59:59.831 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T12:59:59.832 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:59.832 INFO:teuthology.orchestra.run.smithi195.stdout: "req_open_latency": { 2023-10-19T12:59:59.832 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 38, 2023-10-19T12:59:59.832 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.022461856, 2023-10-19T12:59:59.832 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000591101 2023-10-19T12:59:59.832 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:59.833 INFO:teuthology.orchestra.run.smithi195.stdout: "req_readdir_latency": { 2023-10-19T12:59:59.833 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 16, 2023-10-19T12:59:59.833 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.011311439, 2023-10-19T12:59:59.833 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000706964 2023-10-19T12:59:59.833 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:59.834 INFO:teuthology.orchestra.run.smithi195.stdout: "req_rename_latency": { 2023-10-19T12:59:59.834 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 8, 2023-10-19T12:59:59.834 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.038701696, 2023-10-19T12:59:59.834 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.004837712 2023-10-19T12:59:59.834 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:59.835 INFO:teuthology.orchestra.run.smithi195.stdout: "req_renamesnap_latency": { 2023-10-19T12:59:59.835 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T12:59:59.835 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T12:59:59.835 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T12:59:59.835 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:59.836 INFO:teuthology.orchestra.run.smithi195.stdout: "req_snapdiff_latency": { 2023-10-19T12:59:59.836 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T12:59:59.836 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T12:59:59.836 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T12:59:59.836 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:59.836 INFO:teuthology.orchestra.run.smithi195.stdout: "req_rmdir_latency": { 2023-10-19T12:59:59.837 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T12:59:59.837 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T12:59:59.837 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T12:59:59.837 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:59.837 INFO:teuthology.orchestra.run.smithi195.stdout: "req_rmsnap_latency": { 2023-10-19T12:59:59.838 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T12:59:59.838 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T12:59:59.838 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T12:59:59.838 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:59.839 INFO:teuthology.orchestra.run.smithi195.stdout: "req_rmxattr_latency": { 2023-10-19T12:59:59.839 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T12:59:59.839 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T12:59:59.839 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T12:59:59.839 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:59.840 INFO:teuthology.orchestra.run.smithi195.stdout: "req_setattr_latency": { 2023-10-19T12:59:59.840 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T12:59:59.840 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T12:59:59.840 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T12:59:59.840 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:59.840 INFO:teuthology.orchestra.run.smithi195.stdout: "req_setdirlayout_latency": { 2023-10-19T12:59:59.841 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T12:59:59.841 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T12:59:59.841 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T12:59:59.841 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:59.841 INFO:teuthology.orchestra.run.smithi195.stdout: "req_setfilelock_latency": { 2023-10-19T12:59:59.841 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T12:59:59.842 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T12:59:59.842 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T12:59:59.842 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:59.842 INFO:teuthology.orchestra.run.smithi195.stdout: "req_setlayout_latency": { 2023-10-19T12:59:59.842 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T12:59:59.843 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T12:59:59.843 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T12:59:59.843 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:59.843 INFO:teuthology.orchestra.run.smithi195.stdout: "req_setxattr_latency": { 2023-10-19T12:59:59.843 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T12:59:59.843 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T12:59:59.844 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T12:59:59.844 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:59.844 INFO:teuthology.orchestra.run.smithi195.stdout: "req_symlink_latency": { 2023-10-19T12:59:59.844 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T12:59:59.844 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T12:59:59.845 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T12:59:59.845 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:59.845 INFO:teuthology.orchestra.run.smithi195.stdout: "req_unlink_latency": { 2023-10-19T12:59:59.845 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 10, 2023-10-19T12:59:59.845 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.058364493, 2023-10-19T12:59:59.845 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.005836449 2023-10-19T12:59:59.846 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:59.846 INFO:teuthology.orchestra.run.smithi195.stdout: "cap_revoke_eviction": 0, 2023-10-19T12:59:59.846 INFO:teuthology.orchestra.run.smithi195.stdout: "cap_acquisition_throttle": 0, 2023-10-19T12:59:59.846 INFO:teuthology.orchestra.run.smithi195.stdout: "req_getvxattr_latency": { 2023-10-19T12:59:59.846 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T12:59:59.847 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T12:59:59.847 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T12:59:59.847 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-10-19T12:59:59.847 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:59.848 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_sessions": { 2023-10-19T12:59:59.848 INFO:teuthology.orchestra.run.smithi195.stdout: "session_count": 1, 2023-10-19T12:59:59.848 INFO:teuthology.orchestra.run.smithi195.stdout: "session_add": 2, 2023-10-19T12:59:59.848 INFO:teuthology.orchestra.run.smithi195.stdout: "session_remove": 1, 2023-10-19T12:59:59.848 INFO:teuthology.orchestra.run.smithi195.stdout: "sessions_open": 1, 2023-10-19T12:59:59.849 INFO:teuthology.orchestra.run.smithi195.stdout: "sessions_stale": 0, 2023-10-19T12:59:59.849 INFO:teuthology.orchestra.run.smithi195.stdout: "total_load": 42, 2023-10-19T12:59:59.849 INFO:teuthology.orchestra.run.smithi195.stdout: "average_load": 42, 2023-10-19T12:59:59.849 INFO:teuthology.orchestra.run.smithi195.stdout: "avg_session_uptime": 980, 2023-10-19T12:59:59.850 INFO:teuthology.orchestra.run.smithi195.stdout: "mdthresh_evicted": 0 2023-10-19T12:59:59.850 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:59.850 INFO:teuthology.orchestra.run.smithi195.stdout: "mempool": { 2023-10-19T12:59:59.850 INFO:teuthology.orchestra.run.smithi195.stdout: "bloom_filter_bytes": 0, 2023-10-19T12:59:59.850 INFO:teuthology.orchestra.run.smithi195.stdout: "bloom_filter_items": 0, 2023-10-19T12:59:59.851 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_alloc_bytes": 0, 2023-10-19T12:59:59.851 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_alloc_items": 0, 2023-10-19T12:59:59.851 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_data_bytes": 0, 2023-10-19T12:59:59.851 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_data_items": 0, 2023-10-19T12:59:59.851 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-19T12:59:59.852 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_onode_items": 0, 2023-10-19T12:59:59.852 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-19T12:59:59.852 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_meta_items": 0, 2023-10-19T12:59:59.852 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_other_bytes": 0, 2023-10-19T12:59:59.852 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_other_items": 0, 2023-10-19T12:59:59.852 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-19T12:59:59.853 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_buffer_items": 0, 2023-10-19T12:59:59.853 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_extent_bytes": 0, 2023-10-19T12:59:59.853 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_extent_items": 0, 2023-10-19T12:59:59.853 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_blob_bytes": 0, 2023-10-19T12:59:59.853 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_blob_items": 0, 2023-10-19T12:59:59.854 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-19T12:59:59.854 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_shared_blob_items": 0, 2023-10-19T12:59:59.854 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-19T12:59:59.854 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_inline_bl_items": 0, 2023-10-19T12:59:59.854 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_fsck_bytes": 0, 2023-10-19T12:59:59.855 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_fsck_items": 0, 2023-10-19T12:59:59.855 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_txc_bytes": 0, 2023-10-19T12:59:59.855 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_txc_items": 0, 2023-10-19T12:59:59.855 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-19T12:59:59.855 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_writing_deferred_items": 0, 2023-10-19T12:59:59.856 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_writing_bytes": 0, 2023-10-19T12:59:59.856 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_writing_items": 0, 2023-10-19T12:59:59.856 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_bytes": 0, 2023-10-19T12:59:59.856 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_items": 0, 2023-10-19T12:59:59.856 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_file_reader_bytes": 0, 2023-10-19T12:59:59.856 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_file_reader_items": 0, 2023-10-19T12:59:59.857 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_file_writer_bytes": 0, 2023-10-19T12:59:59.857 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_file_writer_items": 0, 2023-10-19T12:59:59.857 INFO:teuthology.orchestra.run.smithi195.stdout: "buffer_anon_bytes": 303872, 2023-10-19T12:59:59.857 INFO:teuthology.orchestra.run.smithi195.stdout: "buffer_anon_items": 387, 2023-10-19T12:59:59.857 INFO:teuthology.orchestra.run.smithi195.stdout: "buffer_meta_bytes": 704, 2023-10-19T12:59:59.858 INFO:teuthology.orchestra.run.smithi195.stdout: "buffer_meta_items": 8, 2023-10-19T12:59:59.858 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_bytes": 0, 2023-10-19T12:59:59.858 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_items": 0, 2023-10-19T12:59:59.858 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_mapbl_bytes": 0, 2023-10-19T12:59:59.858 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_mapbl_items": 0, 2023-10-19T12:59:59.859 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_pglog_bytes": 0, 2023-10-19T12:59:59.859 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_pglog_items": 0, 2023-10-19T12:59:59.859 INFO:teuthology.orchestra.run.smithi195.stdout: "osdmap_bytes": 9280, 2023-10-19T12:59:59.859 INFO:teuthology.orchestra.run.smithi195.stdout: "osdmap_items": 179, 2023-10-19T12:59:59.860 INFO:teuthology.orchestra.run.smithi195.stdout: "osdmap_mapping_bytes": 0, 2023-10-19T12:59:59.860 INFO:teuthology.orchestra.run.smithi195.stdout: "osdmap_mapping_items": 0, 2023-10-19T12:59:59.860 INFO:teuthology.orchestra.run.smithi195.stdout: "pgmap_bytes": 0, 2023-10-19T12:59:59.860 INFO:teuthology.orchestra.run.smithi195.stdout: "pgmap_items": 0, 2023-10-19T12:59:59.860 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_co_bytes": 997670, 2023-10-19T12:59:59.861 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_co_items": 9993, 2023-10-19T12:59:59.861 INFO:teuthology.orchestra.run.smithi195.stdout: "unittest_1_bytes": 0, 2023-10-19T12:59:59.861 INFO:teuthology.orchestra.run.smithi195.stdout: "unittest_1_items": 0, 2023-10-19T12:59:59.861 INFO:teuthology.orchestra.run.smithi195.stdout: "unittest_2_bytes": 0, 2023-10-19T12:59:59.861 INFO:teuthology.orchestra.run.smithi195.stdout: "unittest_2_items": 0 2023-10-19T12:59:59.861 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:59.862 INFO:teuthology.orchestra.run.smithi195.stdout: "objecter": { 2023-10-19T12:59:59.862 INFO:teuthology.orchestra.run.smithi195.stdout: "op_active": 0, 2023-10-19T12:59:59.862 INFO:teuthology.orchestra.run.smithi195.stdout: "op_laggy": 0, 2023-10-19T12:59:59.862 INFO:teuthology.orchestra.run.smithi195.stdout: "op_send": 727, 2023-10-19T12:59:59.862 INFO:teuthology.orchestra.run.smithi195.stdout: "op_send_bytes": 1303268, 2023-10-19T12:59:59.863 INFO:teuthology.orchestra.run.smithi195.stdout: "op_resend": 28, 2023-10-19T12:59:59.863 INFO:teuthology.orchestra.run.smithi195.stdout: "op_reply": 727, 2023-10-19T12:59:59.863 INFO:teuthology.orchestra.run.smithi195.stdout: "op_latency": { 2023-10-19T12:59:59.863 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 727, 2023-10-19T12:59:59.863 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 13.675751575, 2023-10-19T12:59:59.863 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.018811212 2023-10-19T12:59:59.864 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:59.864 INFO:teuthology.orchestra.run.smithi195.stdout: "op_inflight": 0, 2023-10-19T12:59:59.864 INFO:teuthology.orchestra.run.smithi195.stdout: "oplen_avg": { 2023-10-19T12:59:59.864 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 727, 2023-10-19T12:59:59.864 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 814 2023-10-19T12:59:59.864 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:59.865 INFO:teuthology.orchestra.run.smithi195.stdout: "op": 727, 2023-10-19T12:59:59.865 INFO:teuthology.orchestra.run.smithi195.stdout: "op_r": 179, 2023-10-19T12:59:59.865 INFO:teuthology.orchestra.run.smithi195.stdout: "op_w": 548, 2023-10-19T12:59:59.865 INFO:teuthology.orchestra.run.smithi195.stdout: "op_rmw": 0, 2023-10-19T12:59:59.865 INFO:teuthology.orchestra.run.smithi195.stdout: "op_pg": 0, 2023-10-19T12:59:59.866 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_stat": 0, 2023-10-19T12:59:59.866 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_create": 10, 2023-10-19T12:59:59.866 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_read": 17, 2023-10-19T12:59:59.866 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_write": 342, 2023-10-19T12:59:59.866 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_writefull": 80, 2023-10-19T12:59:59.867 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_writesame": 0, 2023-10-19T12:59:59.867 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_append": 0, 2023-10-19T12:59:59.867 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_zero": 0, 2023-10-19T12:59:59.867 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_truncate": 0, 2023-10-19T12:59:59.868 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_delete": 48, 2023-10-19T12:59:59.868 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_mapext": 0, 2023-10-19T12:59:59.868 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_sparse_read": 0, 2023-10-19T12:59:59.869 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_clonerange": 0, 2023-10-19T12:59:59.869 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_getxattr": 162, 2023-10-19T12:59:59.869 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_setxattr": 20, 2023-10-19T12:59:59.869 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_cmpxattr": 0, 2023-10-19T12:59:59.870 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_rmxattr": 0, 2023-10-19T12:59:59.870 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_resetxattrs": 0, 2023-10-19T12:59:59.870 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_call": 0, 2023-10-19T12:59:59.871 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_watch": 0, 2023-10-19T12:59:59.871 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_notify": 0, 2023-10-19T12:59:59.871 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_src_cmpxattr": 0, 2023-10-19T12:59:59.871 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_pgls": 0, 2023-10-19T12:59:59.871 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_pgls_filter": 0, 2023-10-19T12:59:59.872 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_other": 0, 2023-10-19T12:59:59.872 INFO:teuthology.orchestra.run.smithi195.stdout: "linger_active": 0, 2023-10-19T12:59:59.872 INFO:teuthology.orchestra.run.smithi195.stdout: "linger_send": 0, 2023-10-19T12:59:59.872 INFO:teuthology.orchestra.run.smithi195.stdout: "linger_resend": 0, 2023-10-19T12:59:59.872 INFO:teuthology.orchestra.run.smithi195.stdout: "linger_ping": 0, 2023-10-19T12:59:59.872 INFO:teuthology.orchestra.run.smithi195.stdout: "poolop_active": 0, 2023-10-19T12:59:59.873 INFO:teuthology.orchestra.run.smithi195.stdout: "poolop_send": 0, 2023-10-19T12:59:59.873 INFO:teuthology.orchestra.run.smithi195.stdout: "poolop_resend": 0, 2023-10-19T12:59:59.873 INFO:teuthology.orchestra.run.smithi195.stdout: "poolstat_active": 0, 2023-10-19T12:59:59.873 INFO:teuthology.orchestra.run.smithi195.stdout: "poolstat_send": 0, 2023-10-19T12:59:59.873 INFO:teuthology.orchestra.run.smithi195.stdout: "poolstat_resend": 0, 2023-10-19T12:59:59.874 INFO:teuthology.orchestra.run.smithi195.stdout: "statfs_active": 0, 2023-10-19T12:59:59.874 INFO:teuthology.orchestra.run.smithi195.stdout: "statfs_send": 0, 2023-10-19T12:59:59.874 INFO:teuthology.orchestra.run.smithi195.stdout: "statfs_resend": 0, 2023-10-19T12:59:59.874 INFO:teuthology.orchestra.run.smithi195.stdout: "command_active": 0, 2023-10-19T12:59:59.874 INFO:teuthology.orchestra.run.smithi195.stdout: "command_send": 0, 2023-10-19T12:59:59.875 INFO:teuthology.orchestra.run.smithi195.stdout: "command_resend": 0, 2023-10-19T12:59:59.875 INFO:teuthology.orchestra.run.smithi195.stdout: "map_epoch": 92, 2023-10-19T12:59:59.875 INFO:teuthology.orchestra.run.smithi195.stdout: "map_full": 0, 2023-10-19T12:59:59.875 INFO:teuthology.orchestra.run.smithi195.stdout: "map_inc": 4, 2023-10-19T12:59:59.875 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_sessions": 12, 2023-10-19T12:59:59.875 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_session_open": 12, 2023-10-19T12:59:59.876 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_session_close": 0, 2023-10-19T12:59:59.876 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_laggy": 0, 2023-10-19T12:59:59.876 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_wr": 107, 2023-10-19T12:59:59.876 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_rd": 0, 2023-10-19T12:59:59.876 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_del": 28 2023-10-19T12:59:59.877 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:59.877 INFO:teuthology.orchestra.run.smithi195.stdout: "oft": { 2023-10-19T12:59:59.877 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_total_objs": 1, 2023-10-19T12:59:59.877 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_total_kv_pairs": 0, 2023-10-19T12:59:59.877 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_total_updates": 0, 2023-10-19T12:59:59.877 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_total_removes": 0 2023-10-19T12:59:59.878 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:59.878 INFO:teuthology.orchestra.run.smithi195.stdout: "osd-slow-ops": { 2023-10-19T12:59:59.878 INFO:teuthology.orchestra.run.smithi195.stdout: "slow_ops_count": 0 2023-10-19T12:59:59.878 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:59.878 INFO:teuthology.orchestra.run.smithi195.stdout: "purge_queue": { 2023-10-19T12:59:59.879 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executing_ops": 0, 2023-10-19T12:59:59.879 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executing_ops_high_water": 6, 2023-10-19T12:59:59.879 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executing": 0, 2023-10-19T12:59:59.879 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executing_high_water": 3, 2023-10-19T12:59:59.879 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executed": 18, 2023-10-19T12:59:59.880 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_item_in_journal": 0 2023-10-19T12:59:59.880 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:59.880 INFO:teuthology.orchestra.run.smithi195.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-19T12:59:59.880 INFO:teuthology.orchestra.run.smithi195.stdout: "val": 0, 2023-10-19T12:59:59.880 INFO:teuthology.orchestra.run.smithi195.stdout: "max": 104857600, 2023-10-19T12:59:59.881 INFO:teuthology.orchestra.run.smithi195.stdout: "get_started": 0, 2023-10-19T12:59:59.881 INFO:teuthology.orchestra.run.smithi195.stdout: "get": 6042, 2023-10-19T12:59:59.881 INFO:teuthology.orchestra.run.smithi195.stdout: "get_sum": 2600824, 2023-10-19T12:59:59.881 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_fail": 0, 2023-10-19T12:59:59.881 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_success": 6042, 2023-10-19T12:59:59.882 INFO:teuthology.orchestra.run.smithi195.stdout: "take": 0, 2023-10-19T12:59:59.882 INFO:teuthology.orchestra.run.smithi195.stdout: "take_sum": 0, 2023-10-19T12:59:59.882 INFO:teuthology.orchestra.run.smithi195.stdout: "put": 6042, 2023-10-19T12:59:59.882 INFO:teuthology.orchestra.run.smithi195.stdout: "put_sum": 2600824, 2023-10-19T12:59:59.882 INFO:teuthology.orchestra.run.smithi195.stdout: "wait": { 2023-10-19T12:59:59.883 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T12:59:59.883 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T12:59:59.883 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T12:59:59.883 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-10-19T12:59:59.884 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:59.884 INFO:teuthology.orchestra.run.smithi195.stdout: "throttle-objecter_bytes": { 2023-10-19T12:59:59.884 INFO:teuthology.orchestra.run.smithi195.stdout: "val": 0, 2023-10-19T12:59:59.885 INFO:teuthology.orchestra.run.smithi195.stdout: "max": 104857600, 2023-10-19T12:59:59.885 INFO:teuthology.orchestra.run.smithi195.stdout: "get_started": 0, 2023-10-19T12:59:59.886 INFO:teuthology.orchestra.run.smithi195.stdout: "get": 0, 2023-10-19T12:59:59.886 INFO:teuthology.orchestra.run.smithi195.stdout: "get_sum": 0, 2023-10-19T12:59:59.886 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_fail": 0, 2023-10-19T12:59:59.886 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_success": 0, 2023-10-19T12:59:59.886 INFO:teuthology.orchestra.run.smithi195.stdout: "take": 727, 2023-10-19T12:59:59.887 INFO:teuthology.orchestra.run.smithi195.stdout: "take_sum": 1305230, 2023-10-19T12:59:59.887 INFO:teuthology.orchestra.run.smithi195.stdout: "put": 727, 2023-10-19T12:59:59.887 INFO:teuthology.orchestra.run.smithi195.stdout: "put_sum": 1305230, 2023-10-19T12:59:59.887 INFO:teuthology.orchestra.run.smithi195.stdout: "wait": { 2023-10-19T12:59:59.887 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T12:59:59.888 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T12:59:59.888 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T12:59:59.888 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-10-19T12:59:59.888 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:59.888 INFO:teuthology.orchestra.run.smithi195.stdout: "throttle-objecter_ops": { 2023-10-19T12:59:59.889 INFO:teuthology.orchestra.run.smithi195.stdout: "val": 0, 2023-10-19T12:59:59.889 INFO:teuthology.orchestra.run.smithi195.stdout: "max": 1024, 2023-10-19T12:59:59.889 INFO:teuthology.orchestra.run.smithi195.stdout: "get_started": 0, 2023-10-19T12:59:59.889 INFO:teuthology.orchestra.run.smithi195.stdout: "get": 0, 2023-10-19T12:59:59.889 INFO:teuthology.orchestra.run.smithi195.stdout: "get_sum": 0, 2023-10-19T12:59:59.889 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_fail": 0, 2023-10-19T12:59:59.890 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_success": 0, 2023-10-19T12:59:59.890 INFO:teuthology.orchestra.run.smithi195.stdout: "take": 727, 2023-10-19T12:59:59.890 INFO:teuthology.orchestra.run.smithi195.stdout: "take_sum": 727, 2023-10-19T12:59:59.890 INFO:teuthology.orchestra.run.smithi195.stdout: "put": 727, 2023-10-19T12:59:59.890 INFO:teuthology.orchestra.run.smithi195.stdout: "put_sum": 727, 2023-10-19T12:59:59.891 INFO:teuthology.orchestra.run.smithi195.stdout: "wait": { 2023-10-19T12:59:59.891 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T12:59:59.891 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T12:59:59.891 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T12:59:59.892 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-10-19T12:59:59.892 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:59.892 INFO:teuthology.orchestra.run.smithi195.stdout: "throttle-write_buf_throttle": { 2023-10-19T12:59:59.892 INFO:teuthology.orchestra.run.smithi195.stdout: "val": 0, 2023-10-19T12:59:59.892 INFO:teuthology.orchestra.run.smithi195.stdout: "max": 3758096384, 2023-10-19T12:59:59.893 INFO:teuthology.orchestra.run.smithi195.stdout: "get_started": 0, 2023-10-19T12:59:59.893 INFO:teuthology.orchestra.run.smithi195.stdout: "get": 18, 2023-10-19T12:59:59.893 INFO:teuthology.orchestra.run.smithi195.stdout: "get_sum": 1962, 2023-10-19T12:59:59.893 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_fail": 0, 2023-10-19T12:59:59.893 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_success": 18, 2023-10-19T12:59:59.894 INFO:teuthology.orchestra.run.smithi195.stdout: "take": 0, 2023-10-19T12:59:59.894 INFO:teuthology.orchestra.run.smithi195.stdout: "take_sum": 0, 2023-10-19T12:59:59.894 INFO:teuthology.orchestra.run.smithi195.stdout: "put": 17, 2023-10-19T12:59:59.894 INFO:teuthology.orchestra.run.smithi195.stdout: "put_sum": 1962, 2023-10-19T12:59:59.894 INFO:teuthology.orchestra.run.smithi195.stdout: "wait": { 2023-10-19T12:59:59.895 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T12:59:59.895 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T12:59:59.895 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T12:59:59.895 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-10-19T12:59:59.895 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T12:59:59.895 INFO:teuthology.orchestra.run.smithi195.stdout: "throttle-write_buf_throttle-0x55a46518a6e0": { 2023-10-19T12:59:59.896 INFO:teuthology.orchestra.run.smithi195.stdout: "val": 24134, 2023-10-19T12:59:59.896 INFO:teuthology.orchestra.run.smithi195.stdout: "max": 3758096384, 2023-10-19T12:59:59.896 INFO:teuthology.orchestra.run.smithi195.stdout: "get_started": 0, 2023-10-19T12:59:59.896 INFO:teuthology.orchestra.run.smithi195.stdout: "get": 944, 2023-10-19T12:59:59.896 INFO:teuthology.orchestra.run.smithi195.stdout: "get_sum": 1285858, 2023-10-19T12:59:59.896 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_fail": 0, 2023-10-19T12:59:59.897 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_success": 944, 2023-10-19T12:59:59.897 INFO:teuthology.orchestra.run.smithi195.stdout: "take": 0, 2023-10-19T12:59:59.897 INFO:teuthology.orchestra.run.smithi195.stdout: "take_sum": 0, 2023-10-19T12:59:59.897 INFO:teuthology.orchestra.run.smithi195.stdout: "put": 325, 2023-10-19T12:59:59.897 INFO:teuthology.orchestra.run.smithi195.stdout: "put_sum": 1261724, 2023-10-19T12:59:59.897 INFO:teuthology.orchestra.run.smithi195.stdout: "wait": { 2023-10-19T12:59:59.898 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T12:59:59.898 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T12:59:59.898 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T12:59:59.898 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-10-19T12:59:59.899 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-10-19T12:59:59.899 INFO:teuthology.orchestra.run.smithi195.stdout:} 2023-10-19T13:00:00.057 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 12:59:59 smithi195 ceph-mon[134493]: pgmap v848: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 12 op/s 2023-10-19T13:00:00.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 12:59:59 smithi046 ceph-mon[98509]: pgmap v848: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 12 op/s 2023-10-19T13:00:00.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 12:59:59 smithi157 ceph-mon[134109]: pgmap v848: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 12 op/s 2023-10-19T13:00:00.350 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2023-10-19T13:00:00.350 INFO:tasks.check_counter:Daemon mds.f mds.imported=9 2023-10-19T13:00:00.350 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=82 2023-10-19T13:00:00.350 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=413 2023-10-19T13:00:00.351 DEBUG:tasks.check_counter:Getting stats from i 2023-10-19T13:00:00.351 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph daemon mds.i perf dump 2023-10-19T13:00:00.923 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.c/config 2023-10-19T13:00:01.228 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 13:00:00 smithi046 ceph-mon[98509]: overall HEALTH_OK 2023-10-19T13:00:01.333 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 13:00:00 smithi195 ceph-mon[134493]: overall HEALTH_OK 2023-10-19T13:00:01.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 13:00:00 smithi157 ceph-mon[134109]: overall HEALTH_OK 2023-10-19T13:00:02.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 13:00:01 smithi046 ceph-mon[98509]: pgmap v849: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.4 KiB/s wr, 9 op/s 2023-10-19T13:00:02.292 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2023-10-19T13:00:02.292 INFO:teuthology.orchestra.run.smithi195.stdout: "AsyncMessenger::Worker-0": { 2023-10-19T13:00:02.292 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_messages": 8703, 2023-10-19T13:00:02.292 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages": 5896, 2023-10-19T13:00:02.293 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_bytes": 3720141, 2023-10-19T13:00:02.293 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_bytes": 5526360, 2023-10-19T13:00:02.293 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_created_connections": 9, 2023-10-19T13:00:02.293 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_active_connections": 3, 2023-10-19T13:00:02.293 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_total_time": 0.474755459, 2023-10-19T13:00:02.293 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_send_time": 0.180732578, 2023-10-19T13:00:02.294 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_recv_time": 0.325320090, 2023-10-19T13:00:02.294 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_fast_dispatch_time": 0.047307275, 2023-10-19T13:00:02.294 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages_queue_lat": { 2023-10-19T13:00:02.294 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 5900, 2023-10-19T13:00:02.294 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.662118438, 2023-10-19T13:00:02.295 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000112223 2023-10-19T13:00:02.295 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:02.295 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_handle_ack_lat": { 2023-10-19T13:00:02.295 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 10811, 2023-10-19T13:00:02.295 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.001707351, 2023-10-19T13:00:02.296 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000157 2023-10-19T13:00:02.296 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:02.296 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_encrypted_bytes": 731760, 2023-10-19T13:00:02.296 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_encrypted_bytes": 191152 2023-10-19T13:00:02.296 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:02.296 INFO:teuthology.orchestra.run.smithi195.stdout: "AsyncMessenger::Worker-1": { 2023-10-19T13:00:02.297 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_messages": 4635, 2023-10-19T13:00:02.297 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages": 5821, 2023-10-19T13:00:02.297 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_bytes": 1465690, 2023-10-19T13:00:02.297 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_bytes": 3450948, 2023-10-19T13:00:02.297 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_created_connections": 15, 2023-10-19T13:00:02.298 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_active_connections": 9, 2023-10-19T13:00:02.298 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_total_time": 0.239018631, 2023-10-19T13:00:02.298 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_send_time": 0.108541249, 2023-10-19T13:00:02.298 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_recv_time": 0.177980678, 2023-10-19T13:00:02.298 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_fast_dispatch_time": 0.001149861, 2023-10-19T13:00:02.299 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages_queue_lat": { 2023-10-19T13:00:02.299 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 5815, 2023-10-19T13:00:02.299 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.378070475, 2023-10-19T13:00:02.299 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000065016 2023-10-19T13:00:02.299 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:02.300 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_handle_ack_lat": { 2023-10-19T13:00:02.300 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 5179, 2023-10-19T13:00:02.300 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.001554836, 2023-10-19T13:00:02.300 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000300 2023-10-19T13:00:02.300 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:02.301 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_encrypted_bytes": 160, 2023-10-19T13:00:02.301 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_encrypted_bytes": 480736 2023-10-19T13:00:02.301 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:02.301 INFO:teuthology.orchestra.run.smithi195.stdout: "AsyncMessenger::Worker-2": { 2023-10-19T13:00:02.301 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_messages": 609, 2023-10-19T13:00:02.302 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages": 613, 2023-10-19T13:00:02.302 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_bytes": 314304, 2023-10-19T13:00:02.302 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_bytes": 446158, 2023-10-19T13:00:02.302 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_created_connections": 11, 2023-10-19T13:00:02.302 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_active_connections": 6, 2023-10-19T13:00:02.303 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_total_time": 0.046018703, 2023-10-19T13:00:02.303 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_send_time": 0.014302040, 2023-10-19T13:00:02.303 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_recv_time": 0.025995572, 2023-10-19T13:00:02.303 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_fast_dispatch_time": 0.008355632, 2023-10-19T13:00:02.303 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages_queue_lat": { 2023-10-19T13:00:02.304 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 611, 2023-10-19T13:00:02.304 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.135212581, 2023-10-19T13:00:02.304 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000221297 2023-10-19T13:00:02.304 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:02.304 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_handle_ack_lat": { 2023-10-19T13:00:02.305 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 611, 2023-10-19T13:00:02.305 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000182557, 2023-10-19T13:00:02.305 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000298 2023-10-19T13:00:02.305 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:02.305 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-19T13:00:02.305 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_encrypted_bytes": 0 2023-10-19T13:00:02.306 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:02.306 INFO:teuthology.orchestra.run.smithi195.stdout: "cct": { 2023-10-19T13:00:02.306 INFO:teuthology.orchestra.run.smithi195.stdout: "total_workers": 1, 2023-10-19T13:00:02.306 INFO:teuthology.orchestra.run.smithi195.stdout: "unhealthy_workers": 0 2023-10-19T13:00:02.307 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:02.307 INFO:teuthology.orchestra.run.smithi195.stdout: "finisher-MDSRank": { 2023-10-19T13:00:02.307 INFO:teuthology.orchestra.run.smithi195.stdout: "queue_len": 0, 2023-10-19T13:00:02.307 INFO:teuthology.orchestra.run.smithi195.stdout: "complete_latency": { 2023-10-19T13:00:02.307 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 2749, 2023-10-19T13:00:02.307 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 1.088625979, 2023-10-19T13:00:02.308 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000396007 2023-10-19T13:00:02.308 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-10-19T13:00:02.308 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:02.308 INFO:teuthology.orchestra.run.smithi195.stdout: "finisher-PurgeQueue": { 2023-10-19T13:00:02.308 INFO:teuthology.orchestra.run.smithi195.stdout: "queue_len": 0, 2023-10-19T13:00:02.309 INFO:teuthology.orchestra.run.smithi195.stdout: "complete_latency": { 2023-10-19T13:00:02.309 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 41, 2023-10-19T13:00:02.309 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.003242507, 2023-10-19T13:00:02.309 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000079085 2023-10-19T13:00:02.309 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-10-19T13:00:02.309 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:02.310 INFO:teuthology.orchestra.run.smithi195.stdout: "mds": { 2023-10-19T13:00:02.310 INFO:teuthology.orchestra.run.smithi195.stdout: "request": 1898, 2023-10-19T13:00:02.310 INFO:teuthology.orchestra.run.smithi195.stdout: "reply": 1883, 2023-10-19T13:00:02.310 INFO:teuthology.orchestra.run.smithi195.stdout: "reply_latency": { 2023-10-19T13:00:02.310 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 1883, 2023-10-19T13:00:02.311 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 3.541666373, 2023-10-19T13:00:02.311 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.001880863 2023-10-19T13:00:02.311 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:02.311 INFO:teuthology.orchestra.run.smithi195.stdout: "slow_reply": 0, 2023-10-19T13:00:02.311 INFO:teuthology.orchestra.run.smithi195.stdout: "forward": 15, 2023-10-19T13:00:02.312 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_fetch_complete": 0, 2023-10-19T13:00:02.312 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_fetch_keys": 0, 2023-10-19T13:00:02.312 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_commit": 11, 2023-10-19T13:00:02.312 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_split": 0, 2023-10-19T13:00:02.312 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_merge": 0, 2023-10-19T13:00:02.313 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes": 475, 2023-10-19T13:00:02.313 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_top": 15, 2023-10-19T13:00:02.313 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_bottom": 426, 2023-10-19T13:00:02.313 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_pin_tail": 34, 2023-10-19T13:00:02.313 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_pinned": 450, 2023-10-19T13:00:02.313 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_expired": 462, 2023-10-19T13:00:02.314 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_with_caps": 71, 2023-10-19T13:00:02.314 INFO:teuthology.orchestra.run.smithi195.stdout: "caps": 71, 2023-10-19T13:00:02.314 INFO:teuthology.orchestra.run.smithi195.stdout: "subtrees": 16, 2023-10-19T13:00:02.314 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse": 5301, 2023-10-19T13:00:02.314 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_hit": 4079, 2023-10-19T13:00:02.315 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_forward": 12, 2023-10-19T13:00:02.315 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_discover": 136, 2023-10-19T13:00:02.315 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_dir_fetch": 0, 2023-10-19T13:00:02.315 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_remote_ino": 0, 2023-10-19T13:00:02.315 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_lock": 404, 2023-10-19T13:00:02.315 INFO:teuthology.orchestra.run.smithi195.stdout: "load_cent": 744, 2023-10-19T13:00:02.316 INFO:teuthology.orchestra.run.smithi195.stdout: "q": 0, 2023-10-19T13:00:02.316 INFO:teuthology.orchestra.run.smithi195.stdout: "exported": 7, 2023-10-19T13:00:02.316 INFO:teuthology.orchestra.run.smithi195.stdout: "exported_inodes": 151, 2023-10-19T13:00:02.316 INFO:teuthology.orchestra.run.smithi195.stdout: "imported": 8, 2023-10-19T13:00:02.316 INFO:teuthology.orchestra.run.smithi195.stdout: "imported_inodes": 147, 2023-10-19T13:00:02.316 INFO:teuthology.orchestra.run.smithi195.stdout: "openino_dir_fetch": 0, 2023-10-19T13:00:02.317 INFO:teuthology.orchestra.run.smithi195.stdout: "openino_backtrace_fetch": 152, 2023-10-19T13:00:02.317 INFO:teuthology.orchestra.run.smithi195.stdout: "openino_peer_discover": 0, 2023-10-19T13:00:02.317 INFO:teuthology.orchestra.run.smithi195.stdout: "root_rfiles": 1037, 2023-10-19T13:00:02.317 INFO:teuthology.orchestra.run.smithi195.stdout: "root_rbytes": 1633283982, 2023-10-19T13:00:02.317 INFO:teuthology.orchestra.run.smithi195.stdout: "root_rsnaps": 0, 2023-10-19T13:00:02.317 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_backtrace_fetch": 152, 2023-10-19T13:00:02.318 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_set_tag": 0, 2023-10-19T13:00:02.318 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_backtrace_repaired": 0, 2023-10-19T13:00:02.318 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_inotable_repaired": 0, 2023-10-19T13:00:02.318 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_dir_inodes": 3, 2023-10-19T13:00:02.318 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_dir_base_inodes": 0, 2023-10-19T13:00:02.319 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_dirfrag_rstats": 3, 2023-10-19T13:00:02.319 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_file_inodes": 149, 2023-10-19T13:00:02.319 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_inode_file_caps": 0, 2023-10-19T13:00:02.319 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_cap_op_revoke": 526, 2023-10-19T13:00:02.319 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_cap_op_grant": 1114, 2023-10-19T13:00:02.319 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_cap_op_trunc": 0, 2023-10-19T13:00:02.320 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-19T13:00:02.320 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-19T13:00:02.320 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_client_caps": 1450, 2023-10-19T13:00:02.320 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_client_caps_dirty": 650, 2023-10-19T13:00:02.320 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_client_cap_release": 77, 2023-10-19T13:00:02.321 INFO:teuthology.orchestra.run.smithi195.stdout: "process_request_cap_release": 1164 2023-10-19T13:00:02.321 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:02.321 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_cache": { 2023-10-19T13:00:02.321 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_update": 303, 2023-10-19T13:00:02.321 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_update_receipt": 155, 2023-10-19T13:00:02.322 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_try_discover": 90, 2023-10-19T13:00:02.322 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_send_discover": 214, 2023-10-19T13:00:02.322 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_handle_discover": 304, 2023-10-19T13:00:02.322 INFO:teuthology.orchestra.run.smithi195.stdout: "num_strays": 0, 2023-10-19T13:00:02.322 INFO:teuthology.orchestra.run.smithi195.stdout: "num_strays_delayed": 0, 2023-10-19T13:00:02.322 INFO:teuthology.orchestra.run.smithi195.stdout: "num_strays_enqueuing": 0, 2023-10-19T13:00:02.323 INFO:teuthology.orchestra.run.smithi195.stdout: "strays_created": 270, 2023-10-19T13:00:02.323 INFO:teuthology.orchestra.run.smithi195.stdout: "strays_enqueued": 8, 2023-10-19T13:00:02.323 INFO:teuthology.orchestra.run.smithi195.stdout: "strays_reintegrated": 262, 2023-10-19T13:00:02.323 INFO:teuthology.orchestra.run.smithi195.stdout: "strays_migrated": 0, 2023-10-19T13:00:02.323 INFO:teuthology.orchestra.run.smithi195.stdout: "num_recovering_processing": 0, 2023-10-19T13:00:02.324 INFO:teuthology.orchestra.run.smithi195.stdout: "num_recovering_enqueued": 0, 2023-10-19T13:00:02.324 INFO:teuthology.orchestra.run.smithi195.stdout: "num_recovering_prioritized": 0, 2023-10-19T13:00:02.324 INFO:teuthology.orchestra.run.smithi195.stdout: "recovery_started": 0, 2023-10-19T13:00:02.324 INFO:teuthology.orchestra.run.smithi195.stdout: "recovery_completed": 0, 2023-10-19T13:00:02.324 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_enqueue_scrub": 0, 2023-10-19T13:00:02.325 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_exportdir": 7, 2023-10-19T13:00:02.325 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_flush": 0, 2023-10-19T13:00:02.325 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_fragmentdir": 0, 2023-10-19T13:00:02.325 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_fragstats": 0, 2023-10-19T13:00:02.325 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_inodestats": 0 2023-10-19T13:00:02.326 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:02.326 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_log": { 2023-10-19T13:00:02.326 INFO:teuthology.orchestra.run.smithi195.stdout: "evlrg": 0, 2023-10-19T13:00:02.326 INFO:teuthology.orchestra.run.smithi195.stdout: "evadd": 1985, 2023-10-19T13:00:02.326 INFO:teuthology.orchestra.run.smithi195.stdout: "evex": 0, 2023-10-19T13:00:02.327 INFO:teuthology.orchestra.run.smithi195.stdout: "evtrm": 0, 2023-10-19T13:00:02.327 INFO:teuthology.orchestra.run.smithi195.stdout: "ev": 1985, 2023-10-19T13:00:02.327 INFO:teuthology.orchestra.run.smithi195.stdout: "evexg": 0, 2023-10-19T13:00:02.327 INFO:teuthology.orchestra.run.smithi195.stdout: "evexd": 0, 2023-10-19T13:00:02.327 INFO:teuthology.orchestra.run.smithi195.stdout: "segadd": 3, 2023-10-19T13:00:02.327 INFO:teuthology.orchestra.run.smithi195.stdout: "segex": 0, 2023-10-19T13:00:02.328 INFO:teuthology.orchestra.run.smithi195.stdout: "segtrm": 0, 2023-10-19T13:00:02.328 INFO:teuthology.orchestra.run.smithi195.stdout: "seg": 3, 2023-10-19T13:00:02.328 INFO:teuthology.orchestra.run.smithi195.stdout: "segmjr": 2, 2023-10-19T13:00:02.328 INFO:teuthology.orchestra.run.smithi195.stdout: "segexg": 0, 2023-10-19T13:00:02.328 INFO:teuthology.orchestra.run.smithi195.stdout: "segexd": 0, 2023-10-19T13:00:02.329 INFO:teuthology.orchestra.run.smithi195.stdout: "expos": 4194304, 2023-10-19T13:00:02.329 INFO:teuthology.orchestra.run.smithi195.stdout: "wrpos": 7642081, 2023-10-19T13:00:02.329 INFO:teuthology.orchestra.run.smithi195.stdout: "rdpos": 0, 2023-10-19T13:00:02.329 INFO:teuthology.orchestra.run.smithi195.stdout: "jlat": { 2023-10-19T13:00:02.329 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 1264, 2023-10-19T13:00:02.330 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 4.756424408, 2023-10-19T13:00:02.330 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.003762993 2023-10-19T13:00:02.330 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:02.330 INFO:teuthology.orchestra.run.smithi195.stdout: "replayed": 0 2023-10-19T13:00:02.330 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:02.331 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_mem": { 2023-10-19T13:00:02.331 INFO:teuthology.orchestra.run.smithi195.stdout: "ino": 119, 2023-10-19T13:00:02.331 INFO:teuthology.orchestra.run.smithi195.stdout: "ino+": 440, 2023-10-19T13:00:02.331 INFO:teuthology.orchestra.run.smithi195.stdout: "ino-": 321, 2023-10-19T13:00:02.331 INFO:teuthology.orchestra.run.smithi195.stdout: "dir": 52, 2023-10-19T13:00:02.331 INFO:teuthology.orchestra.run.smithi195.stdout: "dir+": 94, 2023-10-19T13:00:02.332 INFO:teuthology.orchestra.run.smithi195.stdout: "dir-": 42, 2023-10-19T13:00:02.332 INFO:teuthology.orchestra.run.smithi195.stdout: "dn": 475, 2023-10-19T13:00:02.332 INFO:teuthology.orchestra.run.smithi195.stdout: "dn+": 945, 2023-10-19T13:00:02.332 INFO:teuthology.orchestra.run.smithi195.stdout: "dn-": 470, 2023-10-19T13:00:02.332 INFO:teuthology.orchestra.run.smithi195.stdout: "cap": 71, 2023-10-19T13:00:02.333 INFO:teuthology.orchestra.run.smithi195.stdout: "cap+": 449, 2023-10-19T13:00:02.333 INFO:teuthology.orchestra.run.smithi195.stdout: "cap-": 378, 2023-10-19T13:00:02.333 INFO:teuthology.orchestra.run.smithi195.stdout: "rss": 56252, 2023-10-19T13:00:02.333 INFO:teuthology.orchestra.run.smithi195.stdout: "heap": 198960 2023-10-19T13:00:02.333 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:02.334 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_server": { 2023-10-19T13:00:02.334 INFO:teuthology.orchestra.run.smithi195.stdout: "dispatch_client_request": 3019, 2023-10-19T13:00:02.334 INFO:teuthology.orchestra.run.smithi195.stdout: "dispatch_server_request": 315, 2023-10-19T13:00:02.334 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_client_request": 1898, 2023-10-19T13:00:02.334 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_client_session": 538, 2023-10-19T13:00:02.335 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_peer_request": 484, 2023-10-19T13:00:02.335 INFO:teuthology.orchestra.run.smithi195.stdout: "req_create_latency": { 2023-10-19T13:00:02.337 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 73, 2023-10-19T13:00:02.337 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.069743792, 2023-10-19T13:00:02.337 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000955394 2023-10-19T13:00:02.337 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:02.338 INFO:teuthology.orchestra.run.smithi195.stdout: "req_getattr_latency": { 2023-10-19T13:00:02.338 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 24, 2023-10-19T13:00:02.338 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.053109942, 2023-10-19T13:00:02.338 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.002212914 2023-10-19T13:00:02.338 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:02.339 INFO:teuthology.orchestra.run.smithi195.stdout: "req_getfilelock_latency": { 2023-10-19T13:00:02.339 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T13:00:02.339 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T13:00:02.339 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T13:00:02.339 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:02.340 INFO:teuthology.orchestra.run.smithi195.stdout: "req_link_latency": { 2023-10-19T13:00:02.340 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 262, 2023-10-19T13:00:02.340 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.488831318, 2023-10-19T13:00:02.340 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.001865768 2023-10-19T13:00:02.340 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:02.341 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookup_latency": { 2023-10-19T13:00:02.341 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 803, 2023-10-19T13:00:02.341 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.776328073, 2023-10-19T13:00:02.341 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000966784 2023-10-19T13:00:02.341 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:02.341 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookuphash_latency": { 2023-10-19T13:00:02.342 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T13:00:02.342 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T13:00:02.342 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T13:00:02.342 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:02.343 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookupino_latency": { 2023-10-19T13:00:02.343 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T13:00:02.343 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T13:00:02.343 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T13:00:02.343 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:02.344 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookupname_latency": { 2023-10-19T13:00:02.344 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T13:00:02.344 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T13:00:02.344 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T13:00:02.344 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:02.345 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookupparent_latency": { 2023-10-19T13:00:02.345 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T13:00:02.345 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T13:00:02.345 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T13:00:02.345 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:02.346 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookupsnap_latency": { 2023-10-19T13:00:02.346 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T13:00:02.346 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T13:00:02.346 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T13:00:02.346 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:02.346 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lssnap_latency": { 2023-10-19T13:00:02.347 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T13:00:02.347 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T13:00:02.347 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T13:00:02.347 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:02.347 INFO:teuthology.orchestra.run.smithi195.stdout: "req_mkdir_latency": { 2023-10-19T13:00:02.348 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T13:00:02.348 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T13:00:02.348 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T13:00:02.348 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:02.348 INFO:teuthology.orchestra.run.smithi195.stdout: "req_mknod_latency": { 2023-10-19T13:00:02.349 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T13:00:02.349 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T13:00:02.349 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T13:00:02.349 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:02.349 INFO:teuthology.orchestra.run.smithi195.stdout: "req_mksnap_latency": { 2023-10-19T13:00:02.349 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T13:00:02.350 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T13:00:02.350 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T13:00:02.350 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:02.350 INFO:teuthology.orchestra.run.smithi195.stdout: "req_open_latency": { 2023-10-19T13:00:02.350 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 172, 2023-10-19T13:00:02.351 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.185383977, 2023-10-19T13:00:02.351 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.001077813 2023-10-19T13:00:02.351 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:02.351 INFO:teuthology.orchestra.run.smithi195.stdout: "req_readdir_latency": { 2023-10-19T13:00:02.351 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 14, 2023-10-19T13:00:02.351 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.022399800, 2023-10-19T13:00:02.352 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.001599985 2023-10-19T13:00:02.352 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:02.352 INFO:teuthology.orchestra.run.smithi195.stdout: "req_rename_latency": { 2023-10-19T13:00:02.352 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 273, 2023-10-19T13:00:02.352 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 1.593847284, 2023-10-19T13:00:02.353 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.005838268 2023-10-19T13:00:02.353 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:02.353 INFO:teuthology.orchestra.run.smithi195.stdout: "req_renamesnap_latency": { 2023-10-19T13:00:02.353 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T13:00:02.353 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T13:00:02.353 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T13:00:02.354 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:02.354 INFO:teuthology.orchestra.run.smithi195.stdout: "req_snapdiff_latency": { 2023-10-19T13:00:02.354 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T13:00:02.354 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T13:00:02.354 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T13:00:02.355 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:02.355 INFO:teuthology.orchestra.run.smithi195.stdout: "req_rmdir_latency": { 2023-10-19T13:00:02.355 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T13:00:02.355 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T13:00:02.355 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T13:00:02.356 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:02.356 INFO:teuthology.orchestra.run.smithi195.stdout: "req_rmsnap_latency": { 2023-10-19T13:00:02.356 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T13:00:02.356 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T13:00:02.356 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T13:00:02.356 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:02.357 INFO:teuthology.orchestra.run.smithi195.stdout: "req_rmxattr_latency": { 2023-10-19T13:00:02.357 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T13:00:02.357 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T13:00:02.357 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T13:00:02.357 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:02.358 INFO:teuthology.orchestra.run.smithi195.stdout: "req_setattr_latency": { 2023-10-19T13:00:02.358 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T13:00:02.358 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T13:00:02.358 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T13:00:02.358 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:02.359 INFO:teuthology.orchestra.run.smithi195.stdout: "req_setdirlayout_latency": { 2023-10-19T13:00:02.359 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T13:00:02.359 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T13:00:02.359 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T13:00:02.359 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:02.359 INFO:teuthology.orchestra.run.smithi195.stdout: "req_setfilelock_latency": { 2023-10-19T13:00:02.360 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T13:00:02.360 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T13:00:02.360 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T13:00:02.360 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:02.361 INFO:teuthology.orchestra.run.smithi195.stdout: "req_setlayout_latency": { 2023-10-19T13:00:02.361 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T13:00:02.361 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T13:00:02.361 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T13:00:02.361 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:02.362 INFO:teuthology.orchestra.run.smithi195.stdout: "req_setxattr_latency": { 2023-10-19T13:00:02.362 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T13:00:02.362 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T13:00:02.362 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T13:00:02.362 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:02.363 INFO:teuthology.orchestra.run.smithi195.stdout: "req_symlink_latency": { 2023-10-19T13:00:02.363 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T13:00:02.363 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T13:00:02.363 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T13:00:02.363 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:02.364 INFO:teuthology.orchestra.run.smithi195.stdout: "req_unlink_latency": { 2023-10-19T13:00:02.364 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 262, 2023-10-19T13:00:02.364 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.352022187, 2023-10-19T13:00:02.364 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.001343596 2023-10-19T13:00:02.364 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:02.364 INFO:teuthology.orchestra.run.smithi195.stdout: "cap_revoke_eviction": 0, 2023-10-19T13:00:02.365 INFO:teuthology.orchestra.run.smithi195.stdout: "cap_acquisition_throttle": 0, 2023-10-19T13:00:02.365 INFO:teuthology.orchestra.run.smithi195.stdout: "req_getvxattr_latency": { 2023-10-19T13:00:02.365 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T13:00:02.365 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T13:00:02.365 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T13:00:02.366 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-10-19T13:00:02.366 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:02.366 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_sessions": { 2023-10-19T13:00:02.366 INFO:teuthology.orchestra.run.smithi195.stdout: "session_count": 1, 2023-10-19T13:00:02.366 INFO:teuthology.orchestra.run.smithi195.stdout: "session_add": 1, 2023-10-19T13:00:02.367 INFO:teuthology.orchestra.run.smithi195.stdout: "session_remove": 0, 2023-10-19T13:00:02.367 INFO:teuthology.orchestra.run.smithi195.stdout: "sessions_open": 1, 2023-10-19T13:00:02.367 INFO:teuthology.orchestra.run.smithi195.stdout: "sessions_stale": 0, 2023-10-19T13:00:02.367 INFO:teuthology.orchestra.run.smithi195.stdout: "total_load": 270, 2023-10-19T13:00:02.367 INFO:teuthology.orchestra.run.smithi195.stdout: "average_load": 270, 2023-10-19T13:00:02.367 INFO:teuthology.orchestra.run.smithi195.stdout: "avg_session_uptime": 976, 2023-10-19T13:00:02.368 INFO:teuthology.orchestra.run.smithi195.stdout: "mdthresh_evicted": 0 2023-10-19T13:00:02.368 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:02.368 INFO:teuthology.orchestra.run.smithi195.stdout: "mempool": { 2023-10-19T13:00:02.368 INFO:teuthology.orchestra.run.smithi195.stdout: "bloom_filter_bytes": 0, 2023-10-19T13:00:02.368 INFO:teuthology.orchestra.run.smithi195.stdout: "bloom_filter_items": 0, 2023-10-19T13:00:02.369 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_alloc_bytes": 0, 2023-10-19T13:00:02.369 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_alloc_items": 0, 2023-10-19T13:00:02.369 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_data_bytes": 0, 2023-10-19T13:00:02.369 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_data_items": 0, 2023-10-19T13:00:02.369 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-19T13:00:02.370 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_onode_items": 0, 2023-10-19T13:00:02.370 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-19T13:00:02.370 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_meta_items": 0, 2023-10-19T13:00:02.370 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_other_bytes": 0, 2023-10-19T13:00:02.370 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_other_items": 0, 2023-10-19T13:00:02.371 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-19T13:00:02.371 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_buffer_items": 0, 2023-10-19T13:00:02.371 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_extent_bytes": 0, 2023-10-19T13:00:02.371 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_extent_items": 0, 2023-10-19T13:00:02.371 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_blob_bytes": 0, 2023-10-19T13:00:02.371 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_blob_items": 0, 2023-10-19T13:00:02.372 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-19T13:00:02.372 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_shared_blob_items": 0, 2023-10-19T13:00:02.372 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-19T13:00:02.372 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_inline_bl_items": 0, 2023-10-19T13:00:02.372 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_fsck_bytes": 0, 2023-10-19T13:00:02.373 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_fsck_items": 0, 2023-10-19T13:00:02.373 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_txc_bytes": 0, 2023-10-19T13:00:02.373 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_txc_items": 0, 2023-10-19T13:00:02.373 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-19T13:00:02.373 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_writing_deferred_items": 0, 2023-10-19T13:00:02.374 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_writing_bytes": 0, 2023-10-19T13:00:02.374 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_writing_items": 0, 2023-10-19T13:00:02.374 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_bytes": 0, 2023-10-19T13:00:02.374 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_items": 0, 2023-10-19T13:00:02.374 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_file_reader_bytes": 0, 2023-10-19T13:00:02.374 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_file_reader_items": 0, 2023-10-19T13:00:02.375 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_file_writer_bytes": 0, 2023-10-19T13:00:02.375 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_file_writer_items": 0, 2023-10-19T13:00:02.375 INFO:teuthology.orchestra.run.smithi195.stdout: "buffer_anon_bytes": 371720, 2023-10-19T13:00:02.375 INFO:teuthology.orchestra.run.smithi195.stdout: "buffer_anon_items": 217, 2023-10-19T13:00:02.375 INFO:teuthology.orchestra.run.smithi195.stdout: "buffer_meta_bytes": 0, 2023-10-19T13:00:02.376 INFO:teuthology.orchestra.run.smithi195.stdout: "buffer_meta_items": 0, 2023-10-19T13:00:02.376 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_bytes": 0, 2023-10-19T13:00:02.376 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_items": 0, 2023-10-19T13:00:02.376 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_mapbl_bytes": 0, 2023-10-19T13:00:02.376 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_mapbl_items": 0, 2023-10-19T13:00:02.377 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_pglog_bytes": 0, 2023-10-19T13:00:02.377 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_pglog_items": 0, 2023-10-19T13:00:02.377 INFO:teuthology.orchestra.run.smithi195.stdout: "osdmap_bytes": 9280, 2023-10-19T13:00:02.377 INFO:teuthology.orchestra.run.smithi195.stdout: "osdmap_items": 179, 2023-10-19T13:00:02.377 INFO:teuthology.orchestra.run.smithi195.stdout: "osdmap_mapping_bytes": 0, 2023-10-19T13:00:02.377 INFO:teuthology.orchestra.run.smithi195.stdout: "osdmap_mapping_items": 0, 2023-10-19T13:00:02.378 INFO:teuthology.orchestra.run.smithi195.stdout: "pgmap_bytes": 0, 2023-10-19T13:00:02.378 INFO:teuthology.orchestra.run.smithi195.stdout: "pgmap_items": 0, 2023-10-19T13:00:02.378 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_co_bytes": 745008, 2023-10-19T13:00:02.378 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_co_items": 21921, 2023-10-19T13:00:02.378 INFO:teuthology.orchestra.run.smithi195.stdout: "unittest_1_bytes": 0, 2023-10-19T13:00:02.379 INFO:teuthology.orchestra.run.smithi195.stdout: "unittest_1_items": 0, 2023-10-19T13:00:02.379 INFO:teuthology.orchestra.run.smithi195.stdout: "unittest_2_bytes": 0, 2023-10-19T13:00:02.379 INFO:teuthology.orchestra.run.smithi195.stdout: "unittest_2_items": 0 2023-10-19T13:00:02.379 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:02.379 INFO:teuthology.orchestra.run.smithi195.stdout: "objecter": { 2023-10-19T13:00:02.380 INFO:teuthology.orchestra.run.smithi195.stdout: "op_active": 0, 2023-10-19T13:00:02.380 INFO:teuthology.orchestra.run.smithi195.stdout: "op_laggy": 0, 2023-10-19T13:00:02.380 INFO:teuthology.orchestra.run.smithi195.stdout: "op_send": 1649, 2023-10-19T13:00:02.380 INFO:teuthology.orchestra.run.smithi195.stdout: "op_send_bytes": 3510388, 2023-10-19T13:00:02.380 INFO:teuthology.orchestra.run.smithi195.stdout: "op_resend": 33, 2023-10-19T13:00:02.380 INFO:teuthology.orchestra.run.smithi195.stdout: "op_reply": 1649, 2023-10-19T13:00:02.381 INFO:teuthology.orchestra.run.smithi195.stdout: "op_latency": { 2023-10-19T13:00:02.381 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 1649, 2023-10-19T13:00:02.381 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 10.300812079, 2023-10-19T13:00:02.381 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.006246702 2023-10-19T13:00:02.381 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:02.382 INFO:teuthology.orchestra.run.smithi195.stdout: "op_inflight": 0, 2023-10-19T13:00:02.382 INFO:teuthology.orchestra.run.smithi195.stdout: "oplen_avg": { 2023-10-19T13:00:02.382 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 1649, 2023-10-19T13:00:02.382 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 1818 2023-10-19T13:00:02.382 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:02.382 INFO:teuthology.orchestra.run.smithi195.stdout: "op": 1649, 2023-10-19T13:00:02.383 INFO:teuthology.orchestra.run.smithi195.stdout: "op_r": 156, 2023-10-19T13:00:02.383 INFO:teuthology.orchestra.run.smithi195.stdout: "op_w": 1493, 2023-10-19T13:00:02.383 INFO:teuthology.orchestra.run.smithi195.stdout: "op_rmw": 0, 2023-10-19T13:00:02.383 INFO:teuthology.orchestra.run.smithi195.stdout: "op_pg": 0, 2023-10-19T13:00:02.383 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_stat": 0, 2023-10-19T13:00:02.384 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_create": 10, 2023-10-19T13:00:02.384 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_read": 4, 2023-10-19T13:00:02.384 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_write": 1268, 2023-10-19T13:00:02.384 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_writefull": 65, 2023-10-19T13:00:02.384 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_writesame": 0, 2023-10-19T13:00:02.384 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_append": 0, 2023-10-19T13:00:02.385 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_zero": 0, 2023-10-19T13:00:02.385 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_truncate": 0, 2023-10-19T13:00:02.385 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_delete": 28, 2023-10-19T13:00:02.385 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_mapext": 0, 2023-10-19T13:00:02.385 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_sparse_read": 0, 2023-10-19T13:00:02.385 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_clonerange": 0, 2023-10-19T13:00:02.386 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_getxattr": 152, 2023-10-19T13:00:02.386 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_setxattr": 20, 2023-10-19T13:00:02.386 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_cmpxattr": 0, 2023-10-19T13:00:02.386 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_rmxattr": 0, 2023-10-19T13:00:02.386 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_resetxattrs": 0, 2023-10-19T13:00:02.387 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_call": 0, 2023-10-19T13:00:02.387 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_watch": 0, 2023-10-19T13:00:02.387 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_notify": 0, 2023-10-19T13:00:02.387 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_src_cmpxattr": 0, 2023-10-19T13:00:02.387 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_pgls": 0, 2023-10-19T13:00:02.387 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_pgls_filter": 0, 2023-10-19T13:00:02.388 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_other": 0, 2023-10-19T13:00:02.388 INFO:teuthology.orchestra.run.smithi195.stdout: "linger_active": 0, 2023-10-19T13:00:02.388 INFO:teuthology.orchestra.run.smithi195.stdout: "linger_send": 0, 2023-10-19T13:00:02.388 INFO:teuthology.orchestra.run.smithi195.stdout: "linger_resend": 0, 2023-10-19T13:00:02.388 INFO:teuthology.orchestra.run.smithi195.stdout: "linger_ping": 0, 2023-10-19T13:00:02.389 INFO:teuthology.orchestra.run.smithi195.stdout: "poolop_active": 0, 2023-10-19T13:00:02.389 INFO:teuthology.orchestra.run.smithi195.stdout: "poolop_send": 0, 2023-10-19T13:00:02.389 INFO:teuthology.orchestra.run.smithi195.stdout: "poolop_resend": 0, 2023-10-19T13:00:02.389 INFO:teuthology.orchestra.run.smithi195.stdout: "poolstat_active": 0, 2023-10-19T13:00:02.389 INFO:teuthology.orchestra.run.smithi195.stdout: "poolstat_send": 0, 2023-10-19T13:00:02.390 INFO:teuthology.orchestra.run.smithi195.stdout: "poolstat_resend": 0, 2023-10-19T13:00:02.390 INFO:teuthology.orchestra.run.smithi195.stdout: "statfs_active": 0, 2023-10-19T13:00:02.390 INFO:teuthology.orchestra.run.smithi195.stdout: "statfs_send": 0, 2023-10-19T13:00:02.390 INFO:teuthology.orchestra.run.smithi195.stdout: "statfs_resend": 0, 2023-10-19T13:00:02.390 INFO:teuthology.orchestra.run.smithi195.stdout: "command_active": 0, 2023-10-19T13:00:02.391 INFO:teuthology.orchestra.run.smithi195.stdout: "command_send": 0, 2023-10-19T13:00:02.391 INFO:teuthology.orchestra.run.smithi195.stdout: "command_resend": 0, 2023-10-19T13:00:02.391 INFO:teuthology.orchestra.run.smithi195.stdout: "map_epoch": 92, 2023-10-19T13:00:02.391 INFO:teuthology.orchestra.run.smithi195.stdout: "map_full": 0, 2023-10-19T13:00:02.391 INFO:teuthology.orchestra.run.smithi195.stdout: "map_inc": 4, 2023-10-19T13:00:02.392 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_sessions": 12, 2023-10-19T13:00:02.392 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_session_open": 12, 2023-10-19T13:00:02.392 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_session_close": 0, 2023-10-19T13:00:02.392 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_laggy": 0, 2023-10-19T13:00:02.392 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_wr": 188, 2023-10-19T13:00:02.393 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_rd": 0, 2023-10-19T13:00:02.393 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_del": 83 2023-10-19T13:00:02.393 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:02.393 INFO:teuthology.orchestra.run.smithi195.stdout: "oft": { 2023-10-19T13:00:02.393 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_total_objs": 1, 2023-10-19T13:00:02.394 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_total_kv_pairs": 0, 2023-10-19T13:00:02.394 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_total_updates": 0, 2023-10-19T13:00:02.394 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_total_removes": 0 2023-10-19T13:00:02.394 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:02.394 INFO:teuthology.orchestra.run.smithi195.stdout: "osd-slow-ops": { 2023-10-19T13:00:02.395 INFO:teuthology.orchestra.run.smithi195.stdout: "slow_ops_count": 0 2023-10-19T13:00:02.395 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:02.395 INFO:teuthology.orchestra.run.smithi195.stdout: "purge_queue": { 2023-10-19T13:00:02.395 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executing_ops": 0, 2023-10-19T13:00:02.395 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executing_ops_high_water": 10, 2023-10-19T13:00:02.396 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executing": 0, 2023-10-19T13:00:02.396 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executing_high_water": 5, 2023-10-19T13:00:02.396 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executed": 8, 2023-10-19T13:00:02.396 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_item_in_journal": 0 2023-10-19T13:00:02.396 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:02.396 INFO:teuthology.orchestra.run.smithi195.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-19T13:00:02.397 INFO:teuthology.orchestra.run.smithi195.stdout: "val": 0, 2023-10-19T13:00:02.397 INFO:teuthology.orchestra.run.smithi195.stdout: "max": 104857600, 2023-10-19T13:00:02.397 INFO:teuthology.orchestra.run.smithi195.stdout: "get_started": 0, 2023-10-19T13:00:02.397 INFO:teuthology.orchestra.run.smithi195.stdout: "get": 13943, 2023-10-19T13:00:02.397 INFO:teuthology.orchestra.run.smithi195.stdout: "get_sum": 4287188, 2023-10-19T13:00:02.397 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_fail": 0, 2023-10-19T13:00:02.398 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_success": 13943, 2023-10-19T13:00:02.398 INFO:teuthology.orchestra.run.smithi195.stdout: "take": 0, 2023-10-19T13:00:02.398 INFO:teuthology.orchestra.run.smithi195.stdout: "take_sum": 0, 2023-10-19T13:00:02.398 INFO:teuthology.orchestra.run.smithi195.stdout: "put": 13943, 2023-10-19T13:00:02.398 INFO:teuthology.orchestra.run.smithi195.stdout: "put_sum": 4287188, 2023-10-19T13:00:02.399 INFO:teuthology.orchestra.run.smithi195.stdout: "wait": { 2023-10-19T13:00:02.399 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T13:00:02.399 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T13:00:02.399 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T13:00:02.399 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-10-19T13:00:02.400 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:02.400 INFO:teuthology.orchestra.run.smithi195.stdout: "throttle-objecter_bytes": { 2023-10-19T13:00:02.400 INFO:teuthology.orchestra.run.smithi195.stdout: "val": 0, 2023-10-19T13:00:02.400 INFO:teuthology.orchestra.run.smithi195.stdout: "max": 104857600, 2023-10-19T13:00:02.400 INFO:teuthology.orchestra.run.smithi195.stdout: "get_started": 0, 2023-10-19T13:00:02.401 INFO:teuthology.orchestra.run.smithi195.stdout: "get": 0, 2023-10-19T13:00:02.401 INFO:teuthology.orchestra.run.smithi195.stdout: "get_sum": 0, 2023-10-19T13:00:02.401 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_fail": 0, 2023-10-19T13:00:02.401 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_success": 0, 2023-10-19T13:00:02.401 INFO:teuthology.orchestra.run.smithi195.stdout: "take": 1649, 2023-10-19T13:00:02.401 INFO:teuthology.orchestra.run.smithi195.stdout: "take_sum": 3511260, 2023-10-19T13:00:02.402 INFO:teuthology.orchestra.run.smithi195.stdout: "put": 1649, 2023-10-19T13:00:02.402 INFO:teuthology.orchestra.run.smithi195.stdout: "put_sum": 3511260, 2023-10-19T13:00:02.402 INFO:teuthology.orchestra.run.smithi195.stdout: "wait": { 2023-10-19T13:00:02.402 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T13:00:02.403 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T13:00:02.403 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T13:00:02.403 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-10-19T13:00:02.403 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:02.403 INFO:teuthology.orchestra.run.smithi195.stdout: "throttle-objecter_ops": { 2023-10-19T13:00:02.404 INFO:teuthology.orchestra.run.smithi195.stdout: "val": 0, 2023-10-19T13:00:02.404 INFO:teuthology.orchestra.run.smithi195.stdout: "max": 1024, 2023-10-19T13:00:02.404 INFO:teuthology.orchestra.run.smithi195.stdout: "get_started": 0, 2023-10-19T13:00:02.404 INFO:teuthology.orchestra.run.smithi195.stdout: "get": 0, 2023-10-19T13:00:02.404 INFO:teuthology.orchestra.run.smithi195.stdout: "get_sum": 0, 2023-10-19T13:00:02.404 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_fail": 0, 2023-10-19T13:00:02.405 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_success": 0, 2023-10-19T13:00:02.405 INFO:teuthology.orchestra.run.smithi195.stdout: "take": 1649, 2023-10-19T13:00:02.405 INFO:teuthology.orchestra.run.smithi195.stdout: "take_sum": 1649, 2023-10-19T13:00:02.405 INFO:teuthology.orchestra.run.smithi195.stdout: "put": 1649, 2023-10-19T13:00:02.405 INFO:teuthology.orchestra.run.smithi195.stdout: "put_sum": 1649, 2023-10-19T13:00:02.406 INFO:teuthology.orchestra.run.smithi195.stdout: "wait": { 2023-10-19T13:00:02.406 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T13:00:02.406 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T13:00:02.406 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T13:00:02.406 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-10-19T13:00:02.407 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:02.407 INFO:teuthology.orchestra.run.smithi195.stdout: "throttle-write_buf_throttle": { 2023-10-19T13:00:02.407 INFO:teuthology.orchestra.run.smithi195.stdout: "val": 0, 2023-10-19T13:00:02.407 INFO:teuthology.orchestra.run.smithi195.stdout: "max": 3758096384, 2023-10-19T13:00:02.407 INFO:teuthology.orchestra.run.smithi195.stdout: "get_started": 0, 2023-10-19T13:00:02.407 INFO:teuthology.orchestra.run.smithi195.stdout: "get": 8, 2023-10-19T13:00:02.408 INFO:teuthology.orchestra.run.smithi195.stdout: "get_sum": 872, 2023-10-19T13:00:02.408 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_fail": 0, 2023-10-19T13:00:02.408 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_success": 8, 2023-10-19T13:00:02.408 INFO:teuthology.orchestra.run.smithi195.stdout: "take": 0, 2023-10-19T13:00:02.408 INFO:teuthology.orchestra.run.smithi195.stdout: "take_sum": 0, 2023-10-19T13:00:02.409 INFO:teuthology.orchestra.run.smithi195.stdout: "put": 4, 2023-10-19T13:00:02.409 INFO:teuthology.orchestra.run.smithi195.stdout: "put_sum": 872, 2023-10-19T13:00:02.409 INFO:teuthology.orchestra.run.smithi195.stdout: "wait": { 2023-10-19T13:00:02.409 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T13:00:02.409 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T13:00:02.410 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T13:00:02.410 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-10-19T13:00:02.410 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:02.410 INFO:teuthology.orchestra.run.smithi195.stdout: "throttle-write_buf_throttle-0x556bd6eb46e0": { 2023-10-19T13:00:02.410 INFO:teuthology.orchestra.run.smithi195.stdout: "val": 0, 2023-10-19T13:00:02.411 INFO:teuthology.orchestra.run.smithi195.stdout: "max": 3758096384, 2023-10-19T13:00:02.411 INFO:teuthology.orchestra.run.smithi195.stdout: "get_started": 0, 2023-10-19T13:00:02.411 INFO:teuthology.orchestra.run.smithi195.stdout: "get": 1985, 2023-10-19T13:00:02.411 INFO:teuthology.orchestra.run.smithi195.stdout: "get_sum": 3447777, 2023-10-19T13:00:02.411 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_fail": 0, 2023-10-19T13:00:02.411 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_success": 1985, 2023-10-19T13:00:02.412 INFO:teuthology.orchestra.run.smithi195.stdout: "take": 0, 2023-10-19T13:00:02.412 INFO:teuthology.orchestra.run.smithi195.stdout: "take_sum": 0, 2023-10-19T13:00:02.412 INFO:teuthology.orchestra.run.smithi195.stdout: "put": 1264, 2023-10-19T13:00:02.412 INFO:teuthology.orchestra.run.smithi195.stdout: "put_sum": 3447777, 2023-10-19T13:00:02.412 INFO:teuthology.orchestra.run.smithi195.stdout: "wait": { 2023-10-19T13:00:02.413 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T13:00:02.413 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T13:00:02.413 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T13:00:02.413 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-10-19T13:00:02.413 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-10-19T13:00:02.414 INFO:teuthology.orchestra.run.smithi195.stdout:} 2023-10-19T13:00:02.414 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 13:00:01 smithi157 ceph-mon[134109]: pgmap v849: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.4 KiB/s wr, 9 op/s 2023-10-19T13:00:02.415 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 13:00:01 smithi195 ceph-mon[134493]: pgmap v849: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.4 KiB/s wr, 9 op/s 2023-10-19T13:00:02.666 INFO:tasks.check_counter:Daemon mds.i mds.exported=7 2023-10-19T13:00:02.666 INFO:tasks.check_counter:Daemon mds.i mds.imported=8 2023-10-19T13:00:02.667 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=303 2023-10-19T13:00:02.667 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=155 2023-10-19T13:00:02.667 DEBUG:tasks.check_counter:Getting stats from l 2023-10-19T13:00:02.667 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:f7420d7f8e55ceea786dcbf536c338ce920c21eb shell --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 -- ceph daemon mds.l perf dump 2023-10-19T13:00:03.226 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/mon.c/config 2023-10-19T13:00:04.329 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 13:00:04 smithi195 ceph-mon[134493]: pgmap v850: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 2.1 KiB/s wr, 11 op/s 2023-10-19T13:00:04.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 13:00:04 smithi046 ceph-mon[98509]: pgmap v850: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 2.1 KiB/s wr, 11 op/s 2023-10-19T13:00:04.558 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2023-10-19T13:00:04.558 INFO:teuthology.orchestra.run.smithi195.stdout: "AsyncMessenger::Worker-0": { 2023-10-19T13:00:04.558 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_messages": 1437, 2023-10-19T13:00:04.559 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages": 1405, 2023-10-19T13:00:04.559 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_bytes": 1068448, 2023-10-19T13:00:04.559 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_bytes": 525874, 2023-10-19T13:00:04.559 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_created_connections": 5, 2023-10-19T13:00:04.559 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_active_connections": 1, 2023-10-19T13:00:04.560 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_total_time": 0.153166382, 2023-10-19T13:00:04.560 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_send_time": 0.045013599, 2023-10-19T13:00:04.560 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_recv_time": 0.046806399, 2023-10-19T13:00:04.560 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_fast_dispatch_time": 0.050080972, 2023-10-19T13:00:04.560 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages_queue_lat": { 2023-10-19T13:00:04.561 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 1404, 2023-10-19T13:00:04.561 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.318146290, 2023-10-19T13:00:04.561 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000226599 2023-10-19T13:00:04.561 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:04.561 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_handle_ack_lat": { 2023-10-19T13:00:04.562 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T13:00:04.562 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T13:00:04.562 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T13:00:04.562 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:04.562 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_encrypted_bytes": 703552, 2023-10-19T13:00:04.563 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_encrypted_bytes": 188128 2023-10-19T13:00:04.563 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:04.563 INFO:teuthology.orchestra.run.smithi195.stdout: "AsyncMessenger::Worker-1": { 2023-10-19T13:00:04.563 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_messages": 8, 2023-10-19T13:00:04.563 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages": 241, 2023-10-19T13:00:04.564 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_bytes": 3868, 2023-10-19T13:00:04.564 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_bytes": 562716, 2023-10-19T13:00:04.564 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_created_connections": 6, 2023-10-19T13:00:04.564 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_active_connections": 3, 2023-10-19T13:00:04.564 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_total_time": 0.013221731, 2023-10-19T13:00:04.565 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_send_time": 0.008498016, 2023-10-19T13:00:04.565 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_recv_time": 0.002231128, 2023-10-19T13:00:04.565 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_fast_dispatch_time": 0.000486635, 2023-10-19T13:00:04.565 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages_queue_lat": { 2023-10-19T13:00:04.565 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 240, 2023-10-19T13:00:04.566 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.080118492, 2023-10-19T13:00:04.566 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000333827 2023-10-19T13:00:04.566 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:04.566 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_handle_ack_lat": { 2023-10-19T13:00:04.567 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T13:00:04.567 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T13:00:04.567 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T13:00:04.567 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:04.567 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_encrypted_bytes": 3312, 2023-10-19T13:00:04.567 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_encrypted_bytes": 562032 2023-10-19T13:00:04.568 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:04.568 INFO:teuthology.orchestra.run.smithi195.stdout: "AsyncMessenger::Worker-2": { 2023-10-19T13:00:04.568 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_messages": 2276, 2023-10-19T13:00:04.568 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages": 2277, 2023-10-19T13:00:04.568 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_bytes": 4026172, 2023-10-19T13:00:04.569 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_bytes": 707532, 2023-10-19T13:00:04.569 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_created_connections": 5, 2023-10-19T13:00:04.569 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_active_connections": 3, 2023-10-19T13:00:04.569 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_total_time": 0.148464675, 2023-10-19T13:00:04.569 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_send_time": 0.040394747, 2023-10-19T13:00:04.570 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_recv_time": 0.038103550, 2023-10-19T13:00:04.570 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_fast_dispatch_time": 0.061045267, 2023-10-19T13:00:04.570 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages_queue_lat": { 2023-10-19T13:00:04.570 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 2275, 2023-10-19T13:00:04.570 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.367633658, 2023-10-19T13:00:04.571 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000161597 2023-10-19T13:00:04.571 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:04.571 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_handle_ack_lat": { 2023-10-19T13:00:04.571 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T13:00:04.571 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T13:00:04.572 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T13:00:04.572 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:04.572 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-19T13:00:04.572 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_encrypted_bytes": 0 2023-10-19T13:00:04.572 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:04.572 INFO:teuthology.orchestra.run.smithi195.stdout: "cct": { 2023-10-19T13:00:04.573 INFO:teuthology.orchestra.run.smithi195.stdout: "total_workers": 1, 2023-10-19T13:00:04.573 INFO:teuthology.orchestra.run.smithi195.stdout: "unhealthy_workers": 0 2023-10-19T13:00:04.573 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:04.573 INFO:teuthology.orchestra.run.smithi195.stdout: "finisher-MDSRank": { 2023-10-19T13:00:04.573 INFO:teuthology.orchestra.run.smithi195.stdout: "queue_len": 0, 2023-10-19T13:00:04.574 INFO:teuthology.orchestra.run.smithi195.stdout: "complete_latency": { 2023-10-19T13:00:04.574 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 5576, 2023-10-19T13:00:04.574 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.140715595, 2023-10-19T13:00:04.574 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000025235 2023-10-19T13:00:04.574 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-10-19T13:00:04.575 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:04.575 INFO:teuthology.orchestra.run.smithi195.stdout: "finisher-PurgeQueue": { 2023-10-19T13:00:04.575 INFO:teuthology.orchestra.run.smithi195.stdout: "queue_len": 0, 2023-10-19T13:00:04.575 INFO:teuthology.orchestra.run.smithi195.stdout: "complete_latency": { 2023-10-19T13:00:04.575 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T13:00:04.576 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T13:00:04.576 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T13:00:04.576 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-10-19T13:00:04.576 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:04.576 INFO:teuthology.orchestra.run.smithi195.stdout: "mds": { 2023-10-19T13:00:04.577 INFO:teuthology.orchestra.run.smithi195.stdout: "request": 0, 2023-10-19T13:00:04.577 INFO:teuthology.orchestra.run.smithi195.stdout: "reply": 0, 2023-10-19T13:00:04.577 INFO:teuthology.orchestra.run.smithi195.stdout: "reply_latency": { 2023-10-19T13:00:04.577 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T13:00:04.577 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T13:00:04.578 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T13:00:04.578 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:04.578 INFO:teuthology.orchestra.run.smithi195.stdout: "slow_reply": 0, 2023-10-19T13:00:04.578 INFO:teuthology.orchestra.run.smithi195.stdout: "forward": 0, 2023-10-19T13:00:04.578 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_fetch_complete": 0, 2023-10-19T13:00:04.579 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_fetch_keys": 0, 2023-10-19T13:00:04.579 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_commit": 0, 2023-10-19T13:00:04.579 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_split": 0, 2023-10-19T13:00:04.579 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_merge": 0, 2023-10-19T13:00:04.579 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes": 443, 2023-10-19T13:00:04.579 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_top": 0, 2023-10-19T13:00:04.580 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_bottom": 0, 2023-10-19T13:00:04.580 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_pin_tail": 443, 2023-10-19T13:00:04.580 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_pinned": 443, 2023-10-19T13:00:04.580 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_expired": 28, 2023-10-19T13:00:04.580 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_with_caps": 0, 2023-10-19T13:00:04.581 INFO:teuthology.orchestra.run.smithi195.stdout: "caps": 0, 2023-10-19T13:00:04.581 INFO:teuthology.orchestra.run.smithi195.stdout: "subtrees": 3, 2023-10-19T13:00:04.581 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse": 0, 2023-10-19T13:00:04.581 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_hit": 0, 2023-10-19T13:00:04.581 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_forward": 0, 2023-10-19T13:00:04.582 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_discover": 0, 2023-10-19T13:00:04.582 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_dir_fetch": 0, 2023-10-19T13:00:04.582 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_remote_ino": 0, 2023-10-19T13:00:04.582 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_lock": 0, 2023-10-19T13:00:04.582 INFO:teuthology.orchestra.run.smithi195.stdout: "load_cent": 0, 2023-10-19T13:00:04.583 INFO:teuthology.orchestra.run.smithi195.stdout: "q": 0, 2023-10-19T13:00:04.583 INFO:teuthology.orchestra.run.smithi195.stdout: "exported": 0, 2023-10-19T13:00:04.583 INFO:teuthology.orchestra.run.smithi195.stdout: "exported_inodes": 0, 2023-10-19T13:00:04.583 INFO:teuthology.orchestra.run.smithi195.stdout: "imported": 0, 2023-10-19T13:00:04.583 INFO:teuthology.orchestra.run.smithi195.stdout: "imported_inodes": 0, 2023-10-19T13:00:04.583 INFO:teuthology.orchestra.run.smithi195.stdout: "openino_dir_fetch": 0, 2023-10-19T13:00:04.584 INFO:teuthology.orchestra.run.smithi195.stdout: "openino_backtrace_fetch": 0, 2023-10-19T13:00:04.584 INFO:teuthology.orchestra.run.smithi195.stdout: "openino_peer_discover": 0, 2023-10-19T13:00:04.584 INFO:teuthology.orchestra.run.smithi195.stdout: "root_rfiles": 0, 2023-10-19T13:00:04.584 INFO:teuthology.orchestra.run.smithi195.stdout: "root_rbytes": 0, 2023-10-19T13:00:04.584 INFO:teuthology.orchestra.run.smithi195.stdout: "root_rsnaps": 0, 2023-10-19T13:00:04.585 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_backtrace_fetch": 0, 2023-10-19T13:00:04.585 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_set_tag": 0, 2023-10-19T13:00:04.585 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_backtrace_repaired": 0, 2023-10-19T13:00:04.585 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_inotable_repaired": 0, 2023-10-19T13:00:04.585 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_dir_inodes": 0, 2023-10-19T13:00:04.586 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_dir_base_inodes": 0, 2023-10-19T13:00:04.586 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_dirfrag_rstats": 0, 2023-10-19T13:00:04.586 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_file_inodes": 0, 2023-10-19T13:00:04.586 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_inode_file_caps": 0, 2023-10-19T13:00:04.586 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_cap_op_revoke": 0, 2023-10-19T13:00:04.587 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_cap_op_grant": 0, 2023-10-19T13:00:04.587 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_cap_op_trunc": 0, 2023-10-19T13:00:04.587 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-19T13:00:04.587 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-19T13:00:04.587 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_client_caps": 0, 2023-10-19T13:00:04.588 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_client_caps_dirty": 0, 2023-10-19T13:00:04.588 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_client_cap_release": 0, 2023-10-19T13:00:04.588 INFO:teuthology.orchestra.run.smithi195.stdout: "process_request_cap_release": 0 2023-10-19T13:00:04.588 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:04.588 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_cache": { 2023-10-19T13:00:04.589 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_update": 0, 2023-10-19T13:00:04.589 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_update_receipt": 0, 2023-10-19T13:00:04.589 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_try_discover": 0, 2023-10-19T13:00:04.589 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_send_discover": 0, 2023-10-19T13:00:04.589 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_handle_discover": 0, 2023-10-19T13:00:04.590 INFO:teuthology.orchestra.run.smithi195.stdout: "num_strays": 0, 2023-10-19T13:00:04.590 INFO:teuthology.orchestra.run.smithi195.stdout: "num_strays_delayed": 0, 2023-10-19T13:00:04.590 INFO:teuthology.orchestra.run.smithi195.stdout: "num_strays_enqueuing": 0, 2023-10-19T13:00:04.590 INFO:teuthology.orchestra.run.smithi195.stdout: "strays_created": 0, 2023-10-19T13:00:04.590 INFO:teuthology.orchestra.run.smithi195.stdout: "strays_enqueued": 0, 2023-10-19T13:00:04.591 INFO:teuthology.orchestra.run.smithi195.stdout: "strays_reintegrated": 0, 2023-10-19T13:00:04.591 INFO:teuthology.orchestra.run.smithi195.stdout: "strays_migrated": 0, 2023-10-19T13:00:04.591 INFO:teuthology.orchestra.run.smithi195.stdout: "num_recovering_processing": 0, 2023-10-19T13:00:04.591 INFO:teuthology.orchestra.run.smithi195.stdout: "num_recovering_enqueued": 0, 2023-10-19T13:00:04.591 INFO:teuthology.orchestra.run.smithi195.stdout: "num_recovering_prioritized": 0, 2023-10-19T13:00:04.592 INFO:teuthology.orchestra.run.smithi195.stdout: "recovery_started": 0, 2023-10-19T13:00:04.592 INFO:teuthology.orchestra.run.smithi195.stdout: "recovery_completed": 0, 2023-10-19T13:00:04.592 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_enqueue_scrub": 0, 2023-10-19T13:00:04.592 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_exportdir": 0, 2023-10-19T13:00:04.592 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_flush": 0, 2023-10-19T13:00:04.593 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_fragmentdir": 0, 2023-10-19T13:00:04.593 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_fragstats": 0, 2023-10-19T13:00:04.593 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_inodestats": 0 2023-10-19T13:00:04.593 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:04.593 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_log": { 2023-10-19T13:00:04.593 INFO:teuthology.orchestra.run.smithi195.stdout: "evlrg": 0, 2023-10-19T13:00:04.594 INFO:teuthology.orchestra.run.smithi195.stdout: "evadd": 0, 2023-10-19T13:00:04.594 INFO:teuthology.orchestra.run.smithi195.stdout: "evex": 0, 2023-10-19T13:00:04.594 INFO:teuthology.orchestra.run.smithi195.stdout: "evtrm": 0, 2023-10-19T13:00:04.594 INFO:teuthology.orchestra.run.smithi195.stdout: "ev": 1985, 2023-10-19T13:00:04.594 INFO:teuthology.orchestra.run.smithi195.stdout: "evexg": 0, 2023-10-19T13:00:04.595 INFO:teuthology.orchestra.run.smithi195.stdout: "evexd": 0, 2023-10-19T13:00:04.595 INFO:teuthology.orchestra.run.smithi195.stdout: "segadd": 0, 2023-10-19T13:00:04.595 INFO:teuthology.orchestra.run.smithi195.stdout: "segex": 0, 2023-10-19T13:00:04.595 INFO:teuthology.orchestra.run.smithi195.stdout: "segtrm": 0, 2023-10-19T13:00:04.595 INFO:teuthology.orchestra.run.smithi195.stdout: "seg": 3, 2023-10-19T13:00:04.596 INFO:teuthology.orchestra.run.smithi195.stdout: "segmjr": 2, 2023-10-19T13:00:04.596 INFO:teuthology.orchestra.run.smithi195.stdout: "segexg": 0, 2023-10-19T13:00:04.596 INFO:teuthology.orchestra.run.smithi195.stdout: "segexd": 0, 2023-10-19T13:00:04.596 INFO:teuthology.orchestra.run.smithi195.stdout: "expos": 4194304, 2023-10-19T13:00:04.596 INFO:teuthology.orchestra.run.smithi195.stdout: "wrpos": 7642081, 2023-10-19T13:00:04.596 INFO:teuthology.orchestra.run.smithi195.stdout: "rdpos": 7641507, 2023-10-19T13:00:04.597 INFO:teuthology.orchestra.run.smithi195.stdout: "jlat": { 2023-10-19T13:00:04.597 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T13:00:04.597 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T13:00:04.597 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T13:00:04.597 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:04.598 INFO:teuthology.orchestra.run.smithi195.stdout: "replayed": 1985 2023-10-19T13:00:04.598 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:04.598 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_mem": { 2023-10-19T13:00:04.598 INFO:teuthology.orchestra.run.smithi195.stdout: "ino": 76, 2023-10-19T13:00:04.598 INFO:teuthology.orchestra.run.smithi195.stdout: "ino+": 207, 2023-10-19T13:00:04.599 INFO:teuthology.orchestra.run.smithi195.stdout: "ino-": 131, 2023-10-19T13:00:04.599 INFO:teuthology.orchestra.run.smithi195.stdout: "dir": 12, 2023-10-19T13:00:04.599 INFO:teuthology.orchestra.run.smithi195.stdout: "dir+": 22, 2023-10-19T13:00:04.599 INFO:teuthology.orchestra.run.smithi195.stdout: "dir-": 10, 2023-10-19T13:00:04.599 INFO:teuthology.orchestra.run.smithi195.stdout: "dn": 443, 2023-10-19T13:00:04.600 INFO:teuthology.orchestra.run.smithi195.stdout: "dn+": 600, 2023-10-19T13:00:04.600 INFO:teuthology.orchestra.run.smithi195.stdout: "dn-": 157, 2023-10-19T13:00:04.600 INFO:teuthology.orchestra.run.smithi195.stdout: "cap": 0, 2023-10-19T13:00:04.600 INFO:teuthology.orchestra.run.smithi195.stdout: "cap+": 0, 2023-10-19T13:00:04.600 INFO:teuthology.orchestra.run.smithi195.stdout: "cap-": 0, 2023-10-19T13:00:04.601 INFO:teuthology.orchestra.run.smithi195.stdout: "rss": 49628, 2023-10-19T13:00:04.601 INFO:teuthology.orchestra.run.smithi195.stdout: "heap": 207152 2023-10-19T13:00:04.601 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:04.601 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_server": { 2023-10-19T13:00:04.601 INFO:teuthology.orchestra.run.smithi195.stdout: "dispatch_client_request": 0, 2023-10-19T13:00:04.602 INFO:teuthology.orchestra.run.smithi195.stdout: "dispatch_server_request": 0, 2023-10-19T13:00:04.602 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_client_request": 0, 2023-10-19T13:00:04.602 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_client_session": 0, 2023-10-19T13:00:04.602 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_peer_request": 0, 2023-10-19T13:00:04.602 INFO:teuthology.orchestra.run.smithi195.stdout: "req_create_latency": { 2023-10-19T13:00:04.603 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T13:00:04.603 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T13:00:04.603 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T13:00:04.603 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:04.603 INFO:teuthology.orchestra.run.smithi195.stdout: "req_getattr_latency": { 2023-10-19T13:00:04.604 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T13:00:04.604 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T13:00:04.604 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T13:00:04.604 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:04.604 INFO:teuthology.orchestra.run.smithi195.stdout: "req_getfilelock_latency": { 2023-10-19T13:00:04.605 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T13:00:04.605 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T13:00:04.605 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T13:00:04.605 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:04.605 INFO:teuthology.orchestra.run.smithi195.stdout: "req_link_latency": { 2023-10-19T13:00:04.605 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T13:00:04.606 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T13:00:04.606 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T13:00:04.606 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:04.606 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookup_latency": { 2023-10-19T13:00:04.606 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T13:00:04.607 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T13:00:04.607 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T13:00:04.607 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:04.607 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookuphash_latency": { 2023-10-19T13:00:04.607 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T13:00:04.608 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T13:00:04.608 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T13:00:04.608 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:04.608 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookupino_latency": { 2023-10-19T13:00:04.608 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T13:00:04.609 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T13:00:04.609 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T13:00:04.609 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:04.609 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookupname_latency": { 2023-10-19T13:00:04.609 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T13:00:04.610 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T13:00:04.610 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T13:00:04.610 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:04.610 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookupparent_latency": { 2023-10-19T13:00:04.610 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T13:00:04.611 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T13:00:04.611 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T13:00:04.611 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:04.611 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookupsnap_latency": { 2023-10-19T13:00:04.611 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T13:00:04.611 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T13:00:04.612 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T13:00:04.612 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:04.612 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lssnap_latency": { 2023-10-19T13:00:04.612 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T13:00:04.612 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T13:00:04.612 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T13:00:04.613 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:04.613 INFO:teuthology.orchestra.run.smithi195.stdout: "req_mkdir_latency": { 2023-10-19T13:00:04.613 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T13:00:04.613 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T13:00:04.613 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T13:00:04.614 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:04.614 INFO:teuthology.orchestra.run.smithi195.stdout: "req_mknod_latency": { 2023-10-19T13:00:04.614 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T13:00:04.614 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T13:00:04.614 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T13:00:04.615 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:04.615 INFO:teuthology.orchestra.run.smithi195.stdout: "req_mksnap_latency": { 2023-10-19T13:00:04.615 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T13:00:04.615 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T13:00:04.615 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T13:00:04.615 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:04.616 INFO:teuthology.orchestra.run.smithi195.stdout: "req_open_latency": { 2023-10-19T13:00:04.616 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T13:00:04.616 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T13:00:04.616 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T13:00:04.616 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:04.617 INFO:teuthology.orchestra.run.smithi195.stdout: "req_readdir_latency": { 2023-10-19T13:00:04.617 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T13:00:04.617 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T13:00:04.617 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T13:00:04.617 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:04.617 INFO:teuthology.orchestra.run.smithi195.stdout: "req_rename_latency": { 2023-10-19T13:00:04.618 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T13:00:04.618 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T13:00:04.618 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T13:00:04.618 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:04.618 INFO:teuthology.orchestra.run.smithi195.stdout: "req_renamesnap_latency": { 2023-10-19T13:00:04.619 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T13:00:04.619 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T13:00:04.619 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T13:00:04.619 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:04.619 INFO:teuthology.orchestra.run.smithi195.stdout: "req_snapdiff_latency": { 2023-10-19T13:00:04.619 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T13:00:04.620 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T13:00:04.620 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T13:00:04.620 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:04.620 INFO:teuthology.orchestra.run.smithi195.stdout: "req_rmdir_latency": { 2023-10-19T13:00:04.620 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T13:00:04.620 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T13:00:04.621 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T13:00:04.621 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:04.621 INFO:teuthology.orchestra.run.smithi195.stdout: "req_rmsnap_latency": { 2023-10-19T13:00:04.621 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T13:00:04.621 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T13:00:04.621 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T13:00:04.622 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:04.622 INFO:teuthology.orchestra.run.smithi195.stdout: "req_rmxattr_latency": { 2023-10-19T13:00:04.622 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T13:00:04.622 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T13:00:04.622 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T13:00:04.622 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:04.623 INFO:teuthology.orchestra.run.smithi195.stdout: "req_setattr_latency": { 2023-10-19T13:00:04.623 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T13:00:04.623 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T13:00:04.623 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T13:00:04.623 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:04.624 INFO:teuthology.orchestra.run.smithi195.stdout: "req_setdirlayout_latency": { 2023-10-19T13:00:04.624 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T13:00:04.624 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T13:00:04.624 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T13:00:04.624 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:04.625 INFO:teuthology.orchestra.run.smithi195.stdout: "req_setfilelock_latency": { 2023-10-19T13:00:04.625 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T13:00:04.625 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T13:00:04.625 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T13:00:04.625 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:04.625 INFO:teuthology.orchestra.run.smithi195.stdout: "req_setlayout_latency": { 2023-10-19T13:00:04.626 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T13:00:04.626 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T13:00:04.626 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T13:00:04.626 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:04.626 INFO:teuthology.orchestra.run.smithi195.stdout: "req_setxattr_latency": { 2023-10-19T13:00:04.627 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T13:00:04.627 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T13:00:04.627 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T13:00:04.627 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:04.627 INFO:teuthology.orchestra.run.smithi195.stdout: "req_symlink_latency": { 2023-10-19T13:00:04.628 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T13:00:04.628 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T13:00:04.628 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T13:00:04.628 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:04.628 INFO:teuthology.orchestra.run.smithi195.stdout: "req_unlink_latency": { 2023-10-19T13:00:04.629 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T13:00:04.629 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T13:00:04.629 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T13:00:04.629 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:04.629 INFO:teuthology.orchestra.run.smithi195.stdout: "cap_revoke_eviction": 0, 2023-10-19T13:00:04.629 INFO:teuthology.orchestra.run.smithi195.stdout: "cap_acquisition_throttle": 0, 2023-10-19T13:00:04.630 INFO:teuthology.orchestra.run.smithi195.stdout: "req_getvxattr_latency": { 2023-10-19T13:00:04.630 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T13:00:04.630 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T13:00:04.630 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T13:00:04.630 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-10-19T13:00:04.631 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:04.631 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_sessions": { 2023-10-19T13:00:04.631 INFO:teuthology.orchestra.run.smithi195.stdout: "session_count": 1, 2023-10-19T13:00:04.631 INFO:teuthology.orchestra.run.smithi195.stdout: "session_add": 1, 2023-10-19T13:00:04.631 INFO:teuthology.orchestra.run.smithi195.stdout: "session_remove": 0, 2023-10-19T13:00:04.632 INFO:teuthology.orchestra.run.smithi195.stdout: "sessions_open": 1, 2023-10-19T13:00:04.632 INFO:teuthology.orchestra.run.smithi195.stdout: "sessions_stale": 0, 2023-10-19T13:00:04.632 INFO:teuthology.orchestra.run.smithi195.stdout: "total_load": 0, 2023-10-19T13:00:04.632 INFO:teuthology.orchestra.run.smithi195.stdout: "average_load": 0, 2023-10-19T13:00:04.632 INFO:teuthology.orchestra.run.smithi195.stdout: "avg_session_uptime": 2954, 2023-10-19T13:00:04.633 INFO:teuthology.orchestra.run.smithi195.stdout: "mdthresh_evicted": 0 2023-10-19T13:00:04.633 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:04.633 INFO:teuthology.orchestra.run.smithi195.stdout: "mempool": { 2023-10-19T13:00:04.633 INFO:teuthology.orchestra.run.smithi195.stdout: "bloom_filter_bytes": 0, 2023-10-19T13:00:04.633 INFO:teuthology.orchestra.run.smithi195.stdout: "bloom_filter_items": 0, 2023-10-19T13:00:04.634 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_alloc_bytes": 0, 2023-10-19T13:00:04.634 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_alloc_items": 0, 2023-10-19T13:00:04.634 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_data_bytes": 0, 2023-10-19T13:00:04.634 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_data_items": 0, 2023-10-19T13:00:04.634 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-19T13:00:04.635 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_onode_items": 0, 2023-10-19T13:00:04.635 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-19T13:00:04.635 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_meta_items": 0, 2023-10-19T13:00:04.635 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_other_bytes": 0, 2023-10-19T13:00:04.635 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_other_items": 0, 2023-10-19T13:00:04.636 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-19T13:00:04.636 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_buffer_items": 0, 2023-10-19T13:00:04.636 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_extent_bytes": 0, 2023-10-19T13:00:04.636 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_extent_items": 0, 2023-10-19T13:00:04.636 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_blob_bytes": 0, 2023-10-19T13:00:04.636 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_blob_items": 0, 2023-10-19T13:00:04.637 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-19T13:00:04.637 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_shared_blob_items": 0, 2023-10-19T13:00:04.637 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-19T13:00:04.637 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_inline_bl_items": 0, 2023-10-19T13:00:04.637 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_fsck_bytes": 0, 2023-10-19T13:00:04.638 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_fsck_items": 0, 2023-10-19T13:00:04.638 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_txc_bytes": 0, 2023-10-19T13:00:04.638 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_txc_items": 0, 2023-10-19T13:00:04.638 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-19T13:00:04.638 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_writing_deferred_items": 0, 2023-10-19T13:00:04.639 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_writing_bytes": 0, 2023-10-19T13:00:04.639 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_writing_items": 0, 2023-10-19T13:00:04.639 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_bytes": 0, 2023-10-19T13:00:04.639 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_items": 0, 2023-10-19T13:00:04.639 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_file_reader_bytes": 0, 2023-10-19T13:00:04.639 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_file_reader_items": 0, 2023-10-19T13:00:04.640 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_file_writer_bytes": 0, 2023-10-19T13:00:04.640 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_file_writer_items": 0, 2023-10-19T13:00:04.640 INFO:teuthology.orchestra.run.smithi195.stdout: "buffer_anon_bytes": 185391, 2023-10-19T13:00:04.640 INFO:teuthology.orchestra.run.smithi195.stdout: "buffer_anon_items": 118, 2023-10-19T13:00:04.640 INFO:teuthology.orchestra.run.smithi195.stdout: "buffer_meta_bytes": 0, 2023-10-19T13:00:04.641 INFO:teuthology.orchestra.run.smithi195.stdout: "buffer_meta_items": 0, 2023-10-19T13:00:04.641 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_bytes": 0, 2023-10-19T13:00:04.641 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_items": 0, 2023-10-19T13:00:04.641 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_mapbl_bytes": 0, 2023-10-19T13:00:04.641 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_mapbl_items": 0, 2023-10-19T13:00:04.641 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_pglog_bytes": 0, 2023-10-19T13:00:04.642 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_pglog_items": 0, 2023-10-19T13:00:04.642 INFO:teuthology.orchestra.run.smithi195.stdout: "osdmap_bytes": 9280, 2023-10-19T13:00:04.642 INFO:teuthology.orchestra.run.smithi195.stdout: "osdmap_items": 179, 2023-10-19T13:00:04.642 INFO:teuthology.orchestra.run.smithi195.stdout: "osdmap_mapping_bytes": 0, 2023-10-19T13:00:04.642 INFO:teuthology.orchestra.run.smithi195.stdout: "osdmap_mapping_items": 0, 2023-10-19T13:00:04.643 INFO:teuthology.orchestra.run.smithi195.stdout: "pgmap_bytes": 0, 2023-10-19T13:00:04.643 INFO:teuthology.orchestra.run.smithi195.stdout: "pgmap_items": 0, 2023-10-19T13:00:04.643 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_co_bytes": 515205, 2023-10-19T13:00:04.643 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_co_items": 16795, 2023-10-19T13:00:04.643 INFO:teuthology.orchestra.run.smithi195.stdout: "unittest_1_bytes": 0, 2023-10-19T13:00:04.644 INFO:teuthology.orchestra.run.smithi195.stdout: "unittest_1_items": 0, 2023-10-19T13:00:04.644 INFO:teuthology.orchestra.run.smithi195.stdout: "unittest_2_bytes": 0, 2023-10-19T13:00:04.644 INFO:teuthology.orchestra.run.smithi195.stdout: "unittest_2_items": 0 2023-10-19T13:00:04.644 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:04.644 INFO:teuthology.orchestra.run.smithi195.stdout: "objecter": { 2023-10-19T13:00:04.644 INFO:teuthology.orchestra.run.smithi195.stdout: "op_active": 0, 2023-10-19T13:00:04.645 INFO:teuthology.orchestra.run.smithi195.stdout: "op_laggy": 0, 2023-10-19T13:00:04.645 INFO:teuthology.orchestra.run.smithi195.stdout: "op_send": 3363, 2023-10-19T13:00:04.645 INFO:teuthology.orchestra.run.smithi195.stdout: "op_send_bytes": 21, 2023-10-19T13:00:04.645 INFO:teuthology.orchestra.run.smithi195.stdout: "op_resend": 3, 2023-10-19T13:00:04.645 INFO:teuthology.orchestra.run.smithi195.stdout: "op_reply": 3363, 2023-10-19T13:00:04.646 INFO:teuthology.orchestra.run.smithi195.stdout: "op_latency": { 2023-10-19T13:00:04.646 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 3363, 2023-10-19T13:00:04.646 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 15.720716499, 2023-10-19T13:00:04.646 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.004674610 2023-10-19T13:00:04.646 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:04.647 INFO:teuthology.orchestra.run.smithi195.stdout: "op_inflight": 0, 2023-10-19T13:00:04.647 INFO:teuthology.orchestra.run.smithi195.stdout: "oplen_avg": { 2023-10-19T13:00:04.647 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 3363, 2023-10-19T13:00:04.647 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 3364 2023-10-19T13:00:04.647 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:04.648 INFO:teuthology.orchestra.run.smithi195.stdout: "op": 3363, 2023-10-19T13:00:04.648 INFO:teuthology.orchestra.run.smithi195.stdout: "op_r": 3363, 2023-10-19T13:00:04.648 INFO:teuthology.orchestra.run.smithi195.stdout: "op_w": 0, 2023-10-19T13:00:04.648 INFO:teuthology.orchestra.run.smithi195.stdout: "op_rmw": 0, 2023-10-19T13:00:04.648 INFO:teuthology.orchestra.run.smithi195.stdout: "op_pg": 0, 2023-10-19T13:00:04.649 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_stat": 2057, 2023-10-19T13:00:04.649 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_create": 0, 2023-10-19T13:00:04.649 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_read": 1304, 2023-10-19T13:00:04.649 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_write": 0, 2023-10-19T13:00:04.649 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_writefull": 0, 2023-10-19T13:00:04.649 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_writesame": 0, 2023-10-19T13:00:04.650 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_append": 0, 2023-10-19T13:00:04.650 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_zero": 0, 2023-10-19T13:00:04.650 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_truncate": 0, 2023-10-19T13:00:04.650 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_delete": 0, 2023-10-19T13:00:04.650 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_mapext": 0, 2023-10-19T13:00:04.651 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_sparse_read": 0, 2023-10-19T13:00:04.651 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_clonerange": 0, 2023-10-19T13:00:04.651 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_getxattr": 1, 2023-10-19T13:00:04.651 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_setxattr": 0, 2023-10-19T13:00:04.651 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_cmpxattr": 0, 2023-10-19T13:00:04.651 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_rmxattr": 0, 2023-10-19T13:00:04.652 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_resetxattrs": 0, 2023-10-19T13:00:04.652 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_call": 0, 2023-10-19T13:00:04.652 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_watch": 0, 2023-10-19T13:00:04.652 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_notify": 0, 2023-10-19T13:00:04.652 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_src_cmpxattr": 0, 2023-10-19T13:00:04.652 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_pgls": 0, 2023-10-19T13:00:04.653 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_pgls_filter": 0, 2023-10-19T13:00:04.653 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_other": 0, 2023-10-19T13:00:04.653 INFO:teuthology.orchestra.run.smithi195.stdout: "linger_active": 0, 2023-10-19T13:00:04.653 INFO:teuthology.orchestra.run.smithi195.stdout: "linger_send": 0, 2023-10-19T13:00:04.653 INFO:teuthology.orchestra.run.smithi195.stdout: "linger_resend": 0, 2023-10-19T13:00:04.654 INFO:teuthology.orchestra.run.smithi195.stdout: "linger_ping": 0, 2023-10-19T13:00:04.654 INFO:teuthology.orchestra.run.smithi195.stdout: "poolop_active": 0, 2023-10-19T13:00:04.654 INFO:teuthology.orchestra.run.smithi195.stdout: "poolop_send": 0, 2023-10-19T13:00:04.654 INFO:teuthology.orchestra.run.smithi195.stdout: "poolop_resend": 0, 2023-10-19T13:00:04.654 INFO:teuthology.orchestra.run.smithi195.stdout: "poolstat_active": 0, 2023-10-19T13:00:04.655 INFO:teuthology.orchestra.run.smithi195.stdout: "poolstat_send": 0, 2023-10-19T13:00:04.655 INFO:teuthology.orchestra.run.smithi195.stdout: "poolstat_resend": 0, 2023-10-19T13:00:04.655 INFO:teuthology.orchestra.run.smithi195.stdout: "statfs_active": 0, 2023-10-19T13:00:04.655 INFO:teuthology.orchestra.run.smithi195.stdout: "statfs_send": 0, 2023-10-19T13:00:04.655 INFO:teuthology.orchestra.run.smithi195.stdout: "statfs_resend": 0, 2023-10-19T13:00:04.656 INFO:teuthology.orchestra.run.smithi195.stdout: "command_active": 0, 2023-10-19T13:00:04.656 INFO:teuthology.orchestra.run.smithi195.stdout: "command_send": 0, 2023-10-19T13:00:04.656 INFO:teuthology.orchestra.run.smithi195.stdout: "command_resend": 0, 2023-10-19T13:00:04.656 INFO:teuthology.orchestra.run.smithi195.stdout: "map_epoch": 92, 2023-10-19T13:00:04.656 INFO:teuthology.orchestra.run.smithi195.stdout: "map_full": 0, 2023-10-19T13:00:04.657 INFO:teuthology.orchestra.run.smithi195.stdout: "map_inc": 4, 2023-10-19T13:00:04.657 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_sessions": 4, 2023-10-19T13:00:04.657 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_session_open": 6, 2023-10-19T13:00:04.657 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_session_close": 2, 2023-10-19T13:00:04.657 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_laggy": 0, 2023-10-19T13:00:04.657 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_wr": 0, 2023-10-19T13:00:04.658 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_rd": 2, 2023-10-19T13:00:04.658 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_del": 0 2023-10-19T13:00:04.658 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:04.658 INFO:teuthology.orchestra.run.smithi195.stdout: "oft": { 2023-10-19T13:00:04.658 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_total_objs": 0, 2023-10-19T13:00:04.659 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_total_kv_pairs": 0, 2023-10-19T13:00:04.659 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_total_updates": 0, 2023-10-19T13:00:04.659 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_total_removes": 0 2023-10-19T13:00:04.659 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:04.659 INFO:teuthology.orchestra.run.smithi195.stdout: "osd-slow-ops": { 2023-10-19T13:00:04.660 INFO:teuthology.orchestra.run.smithi195.stdout: "slow_ops_count": 0 2023-10-19T13:00:04.660 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:04.660 INFO:teuthology.orchestra.run.smithi195.stdout: "purge_queue": { 2023-10-19T13:00:04.660 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executing_ops": 0, 2023-10-19T13:00:04.660 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executing_ops_high_water": 0, 2023-10-19T13:00:04.661 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executing": 0, 2023-10-19T13:00:04.661 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executing_high_water": 0, 2023-10-19T13:00:04.661 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executed": 0, 2023-10-19T13:00:04.661 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_item_in_journal": 0 2023-10-19T13:00:04.661 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:04.662 INFO:teuthology.orchestra.run.smithi195.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-19T13:00:04.662 INFO:teuthology.orchestra.run.smithi195.stdout: "val": 0, 2023-10-19T13:00:04.662 INFO:teuthology.orchestra.run.smithi195.stdout: "max": 104857600, 2023-10-19T13:00:04.662 INFO:teuthology.orchestra.run.smithi195.stdout: "get_started": 0, 2023-10-19T13:00:04.662 INFO:teuthology.orchestra.run.smithi195.stdout: "get": 3717, 2023-10-19T13:00:04.663 INFO:teuthology.orchestra.run.smithi195.stdout: "get_sum": 4743016, 2023-10-19T13:00:04.663 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_fail": 0, 2023-10-19T13:00:04.663 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_success": 3717, 2023-10-19T13:00:04.663 INFO:teuthology.orchestra.run.smithi195.stdout: "take": 0, 2023-10-19T13:00:04.663 INFO:teuthology.orchestra.run.smithi195.stdout: "take_sum": 0, 2023-10-19T13:00:04.663 INFO:teuthology.orchestra.run.smithi195.stdout: "put": 3717, 2023-10-19T13:00:04.664 INFO:teuthology.orchestra.run.smithi195.stdout: "put_sum": 4743016, 2023-10-19T13:00:04.664 INFO:teuthology.orchestra.run.smithi195.stdout: "wait": { 2023-10-19T13:00:04.664 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T13:00:04.664 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T13:00:04.664 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T13:00:04.665 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-10-19T13:00:04.665 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:04.665 INFO:teuthology.orchestra.run.smithi195.stdout: "throttle-objecter_bytes": { 2023-10-19T13:00:04.665 INFO:teuthology.orchestra.run.smithi195.stdout: "val": 0, 2023-10-19T13:00:04.665 INFO:teuthology.orchestra.run.smithi195.stdout: "max": 104857600, 2023-10-19T13:00:04.666 INFO:teuthology.orchestra.run.smithi195.stdout: "get_started": 0, 2023-10-19T13:00:04.666 INFO:teuthology.orchestra.run.smithi195.stdout: "get": 0, 2023-10-19T13:00:04.666 INFO:teuthology.orchestra.run.smithi195.stdout: "get_sum": 0, 2023-10-19T13:00:04.666 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_fail": 0, 2023-10-19T13:00:04.666 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_success": 0, 2023-10-19T13:00:04.667 INFO:teuthology.orchestra.run.smithi195.stdout: "take": 3363, 2023-10-19T13:00:04.667 INFO:teuthology.orchestra.run.smithi195.stdout: "take_sum": 3447782, 2023-10-19T13:00:04.667 INFO:teuthology.orchestra.run.smithi195.stdout: "put": 3363, 2023-10-19T13:00:04.667 INFO:teuthology.orchestra.run.smithi195.stdout: "put_sum": 3447782, 2023-10-19T13:00:04.667 INFO:teuthology.orchestra.run.smithi195.stdout: "wait": { 2023-10-19T13:00:04.667 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T13:00:04.668 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T13:00:04.668 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T13:00:04.668 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-10-19T13:00:04.668 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:04.668 INFO:teuthology.orchestra.run.smithi195.stdout: "throttle-objecter_ops": { 2023-10-19T13:00:04.669 INFO:teuthology.orchestra.run.smithi195.stdout: "val": 0, 2023-10-19T13:00:04.669 INFO:teuthology.orchestra.run.smithi195.stdout: "max": 1024, 2023-10-19T13:00:04.669 INFO:teuthology.orchestra.run.smithi195.stdout: "get_started": 0, 2023-10-19T13:00:04.669 INFO:teuthology.orchestra.run.smithi195.stdout: "get": 0, 2023-10-19T13:00:04.669 INFO:teuthology.orchestra.run.smithi195.stdout: "get_sum": 0, 2023-10-19T13:00:04.670 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_fail": 0, 2023-10-19T13:00:04.670 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_success": 0, 2023-10-19T13:00:04.670 INFO:teuthology.orchestra.run.smithi195.stdout: "take": 3363, 2023-10-19T13:00:04.670 INFO:teuthology.orchestra.run.smithi195.stdout: "take_sum": 3363, 2023-10-19T13:00:04.670 INFO:teuthology.orchestra.run.smithi195.stdout: "put": 3363, 2023-10-19T13:00:04.671 INFO:teuthology.orchestra.run.smithi195.stdout: "put_sum": 3363, 2023-10-19T13:00:04.671 INFO:teuthology.orchestra.run.smithi195.stdout: "wait": { 2023-10-19T13:00:04.671 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T13:00:04.671 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T13:00:04.671 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T13:00:04.671 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-10-19T13:00:04.672 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:04.672 INFO:teuthology.orchestra.run.smithi195.stdout: "throttle-write_buf_throttle": { 2023-10-19T13:00:04.672 INFO:teuthology.orchestra.run.smithi195.stdout: "val": 0, 2023-10-19T13:00:04.672 INFO:teuthology.orchestra.run.smithi195.stdout: "max": 3758096384, 2023-10-19T13:00:04.672 INFO:teuthology.orchestra.run.smithi195.stdout: "get_started": 0, 2023-10-19T13:00:04.673 INFO:teuthology.orchestra.run.smithi195.stdout: "get": 0, 2023-10-19T13:00:04.673 INFO:teuthology.orchestra.run.smithi195.stdout: "get_sum": 0, 2023-10-19T13:00:04.673 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_fail": 0, 2023-10-19T13:00:04.673 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_success": 0, 2023-10-19T13:00:04.673 INFO:teuthology.orchestra.run.smithi195.stdout: "take": 0, 2023-10-19T13:00:04.673 INFO:teuthology.orchestra.run.smithi195.stdout: "take_sum": 0, 2023-10-19T13:00:04.674 INFO:teuthology.orchestra.run.smithi195.stdout: "put": 0, 2023-10-19T13:00:04.674 INFO:teuthology.orchestra.run.smithi195.stdout: "put_sum": 0, 2023-10-19T13:00:04.674 INFO:teuthology.orchestra.run.smithi195.stdout: "wait": { 2023-10-19T13:00:04.674 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T13:00:04.674 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T13:00:04.675 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T13:00:04.675 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-10-19T13:00:04.675 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-10-19T13:00:04.675 INFO:teuthology.orchestra.run.smithi195.stdout: "throttle-write_buf_throttle-0x5612ac2b0960": { 2023-10-19T13:00:04.675 INFO:teuthology.orchestra.run.smithi195.stdout: "val": 0, 2023-10-19T13:00:04.676 INFO:teuthology.orchestra.run.smithi195.stdout: "max": 3758096384, 2023-10-19T13:00:04.676 INFO:teuthology.orchestra.run.smithi195.stdout: "get_started": 0, 2023-10-19T13:00:04.676 INFO:teuthology.orchestra.run.smithi195.stdout: "get": 0, 2023-10-19T13:00:04.676 INFO:teuthology.orchestra.run.smithi195.stdout: "get_sum": 0, 2023-10-19T13:00:04.676 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_fail": 0, 2023-10-19T13:00:04.677 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_success": 0, 2023-10-19T13:00:04.677 INFO:teuthology.orchestra.run.smithi195.stdout: "take": 0, 2023-10-19T13:00:04.677 INFO:teuthology.orchestra.run.smithi195.stdout: "take_sum": 0, 2023-10-19T13:00:04.677 INFO:teuthology.orchestra.run.smithi195.stdout: "put": 0, 2023-10-19T13:00:04.677 INFO:teuthology.orchestra.run.smithi195.stdout: "put_sum": 0, 2023-10-19T13:00:04.678 INFO:teuthology.orchestra.run.smithi195.stdout: "wait": { 2023-10-19T13:00:04.678 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-10-19T13:00:04.678 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-10-19T13:00:04.678 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-10-19T13:00:04.678 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-10-19T13:00:04.679 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-10-19T13:00:04.679 INFO:teuthology.orchestra.run.smithi195.stdout:} 2023-10-19T13:00:04.679 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 13:00:04 smithi157 ceph-mon[134109]: pgmap v850: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 2.1 KiB/s wr, 11 op/s 2023-10-19T13:00:04.970 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2023-10-19T13:00:04.970 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2023-10-19T13:00:04.970 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update=0 2023-10-19T13:00:04.971 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update_receipt=0 2023-10-19T13:00:04.971 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-10-19T13:00:04.983 INFO:tasks.kclient:Unmounting kernel clients... 2023-10-19T13:00:04.983 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-10-19T13:00:04.984 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-19T13:00:05.046 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-10-19T13:00:05.047 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-19T13:00:05.133 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-19T13:00:05.391 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.388+0000 7ff29a9ff700 1 -- 172.21.15.46:0/285867414 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff294102970 msgr2=0x7ff294102d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T13:00:05.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.388+0000 7ff29a9ff700 1 --2- 172.21.15.46:0/285867414 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff294102970 0x7ff294102d90 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff284009990 tx=0x7ff284009ca0 comp rx=0 tx=0).stop 2023-10-19T13:00:05.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.388+0000 7ff29a9ff700 1 -- 172.21.15.46:0/285867414 shutdown_connections 2023-10-19T13:00:05.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.388+0000 7ff29a9ff700 1 --2- 172.21.15.46:0/285867414 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff294104500 0x7ff29410adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:05.392 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.388+0000 7ff29a9ff700 1 --2- 172.21.15.46:0/285867414 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff294102970 0x7ff294102d90 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:05.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.388+0000 7ff29a9ff700 1 --2- 172.21.15.46:0/285867414 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff294103b60 0x7ff294103fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:05.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.388+0000 7ff29a9ff700 1 -- 172.21.15.46:0/285867414 >> 172.21.15.46:0/285867414 conn(0x7ff2940fdf00 msgr2=0x7ff294100320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T13:00:05.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.388+0000 7ff29a9ff700 1 -- 172.21.15.46:0/285867414 shutdown_connections 2023-10-19T13:00:05.393 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.388+0000 7ff29a9ff700 1 -- 172.21.15.46:0/285867414 wait complete. 2023-10-19T13:00:05.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.389+0000 7ff29a9ff700 1 Processor -- start 2023-10-19T13:00:05.395 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.389+0000 7ff29a9ff700 1 -- start start 2023-10-19T13:00:05.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.390+0000 7ff29a9ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff294102970 0x7ff2941988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T13:00:05.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.390+0000 7ff29a9ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff294103b60 0x7ff294198e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T13:00:05.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.390+0000 7ff29a9ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff294104500 0x7ff29419fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T13:00:05.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.390+0000 7ff29a9ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2941a0420 con 0x7ff294103b60 2023-10-19T13:00:05.396 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.390+0000 7ff29a9ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2941a0560 con 0x7ff294104500 2023-10-19T13:00:05.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.390+0000 7ff29a9ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2941a06f0 con 0x7ff294102970 2023-10-19T13:00:05.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.390+0000 7ff2937fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff294103b60 0x7ff294198e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T13:00:05.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.390+0000 7ff293fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff294102970 0x7ff2941988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T13:00:05.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.390+0000 7ff293fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff294102970 0x7ff2941988f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:35822/0 (socket says 172.21.15.46:35822) 2023-10-19T13:00:05.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.390+0000 7ff293fff700 1 -- 172.21.15.46:0/767524392 learned_addr learned my addr 172.21.15.46:0/767524392 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T13:00:05.397 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.390+0000 7ff298f9c700 1 --2- 172.21.15.46:0/767524392 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff294104500 0x7ff29419fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T13:00:05.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.390+0000 7ff293fff700 1 -- 172.21.15.46:0/767524392 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff294104500 msgr2=0x7ff29419fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T13:00:05.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.390+0000 7ff293fff700 1 --2- 172.21.15.46:0/767524392 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff294104500 0x7ff29419fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:05.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.390+0000 7ff293fff700 1 -- 172.21.15.46:0/767524392 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff294103b60 msgr2=0x7ff294198e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T13:00:05.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.390+0000 7ff293fff700 1 --2- 172.21.15.46:0/767524392 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff294103b60 0x7ff294198e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:05.398 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.390+0000 7ff293fff700 1 -- 172.21.15.46:0/767524392 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2840095f0 con 0x7ff294102970 2023-10-19T13:00:05.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.390+0000 7ff298f9c700 1 --2- 172.21.15.46:0/767524392 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff294104500 0x7ff29419fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T13:00:05.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.390+0000 7ff2937fe700 1 --2- 172.21.15.46:0/767524392 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff294103b60 0x7ff294198e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T13:00:05.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.391+0000 7ff293fff700 1 --2- 172.21.15.46:0/767524392 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff294102970 0x7ff2941988f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff28400b680 tx=0x7ff284004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T13:00:05.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.391+0000 7ff2917fa700 1 -- 172.21.15.46:0/767524392 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff28401d070 con 0x7ff294102970 2023-10-19T13:00:05.399 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.391+0000 7ff29a9ff700 1 -- 172.21.15.46:0/767524392 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2941a0970 con 0x7ff294102970 2023-10-19T13:00:05.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.391+0000 7ff2917fa700 1 -- 172.21.15.46:0/767524392 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff284021410 con 0x7ff294102970 2023-10-19T13:00:05.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.391+0000 7ff2917fa700 1 -- 172.21.15.46:0/767524392 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff284017650 con 0x7ff294102970 2023-10-19T13:00:05.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.391+0000 7ff29a9ff700 1 -- 172.21.15.46:0/767524392 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2941a0df0 con 0x7ff294102970 2023-10-19T13:00:05.400 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.392+0000 7ff29a9ff700 1 -- 172.21.15.46:0/767524392 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff294109df0 con 0x7ff294102970 2023-10-19T13:00:05.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.394+0000 7ff2917fa700 1 -- 172.21.15.46:0/767524392 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7ff284021580 con 0x7ff294102970 2023-10-19T13:00:05.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.395+0000 7ff2917fa700 1 --2- 172.21.15.46:0/767524392 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7ff27c0a1480 0x7ff27c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T13:00:05.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.395+0000 7ff2917fa700 1 -- 172.21.15.46:0/767524392 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7ff2840ce520 con 0x7ff294102970 2023-10-19T13:00:05.401 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.396+0000 7ff2937fe700 1 --2- 172.21.15.46:0/767524392 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7ff27c0a1480 0x7ff27c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T13:00:05.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.396+0000 7ff2937fe700 1 --2- 172.21.15.46:0/767524392 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7ff27c0a1480 0x7ff27c0a3940 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7ff288011490 tx=0x7ff288009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T13:00:05.402 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.399+0000 7ff2917fa700 1 -- 172.21.15.46:0/767524392 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff2840977e0 con 0x7ff294102970 2023-10-19T13:00:05.615 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.612+0000 7ff29a9ff700 1 -- 172.21.15.46:0/767524392 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff2941097d0 con 0x7ff294102970 2023-10-19T13:00:05.617 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.614+0000 7ff2917fa700 1 -- 172.21.15.46:0/767524392 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) v1 ==== 74+0+24780 (secure 0 0 0) 0x7ff28409ae00 con 0x7ff294102970 2023-10-19T13:00:05.617 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T13:00:05.618 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":92,"fsid":"96a8be3c-6e7b-11ee-8db6-212e2dc638e7","created":"2023-10-19T12:33:26.148713+0000","modified":"2023-10-19T12:43:28.761367+0000","last_up_change":"2023-10-19T12:40:30.761679+0000","last_in_change":"2023-10-19T12:40:13.663559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-19T12:37:07.175795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-19T12:41:16.895203+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-19T12:41:18.255601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-19T12:41:21.830455+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"346ce86b-a10a-4869-9fdb-c3c1d4161455","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6803","nonce":500237995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6805","nonce":500237995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6809","nonce":500237995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6807","nonce":500237995}]},"public_addr":"172.21.15.46:6803/500237995","cluster_addr":"172.21.15.46:6805/500237995","heartbeat_back_addr":"172.21.15.46:6809/500237995","heartbeat_front_addr":"172.21.15.46:6807/500237995","state":["exists","up"]},{"osd":1,"uuid":"02aae687-76c5-4124-bae4-9787ed571c28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6801","nonce":2496862790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6803","nonce":2496862790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6807","nonce":2496862790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6805","nonce":2496862790}]},"public_addr":"172.21.15.157:6801/2496862790","cluster_addr":"172.21.15.157:6803/2496862790","heartbeat_back_addr":"172.21.15.157:6807/2496862790","heartbeat_front_addr":"172.21.15.157:6805/2496862790","state":["exists","up"]},{"osd":2,"uuid":"d5360828-1f58-4380-b2ad-0c21ff850981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6801","nonce":4211767276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6803","nonce":4211767276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6807","nonce":4211767276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6805","nonce":4211767276}]},"public_addr":"172.21.15.195:6801/4211767276","cluster_addr":"172.21.15.195:6803/4211767276","heartbeat_back_addr":"172.21.15.195:6807/4211767276","heartbeat_front_addr":"172.21.15.195:6805/4211767276","state":["exists","up"]},{"osd":3,"uuid":"accb780f-49d0-43f8-b166-ee12c558ef00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6811","nonce":1964113352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6813","nonce":1964113352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6817","nonce":1964113352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6815","nonce":1964113352}]},"public_addr":"172.21.15.46:6811/1964113352","cluster_addr":"172.21.15.46:6813/1964113352","heartbeat_back_addr":"172.21.15.46:6817/1964113352","heartbeat_front_addr":"172.21.15.46:6815/1964113352","state":["exists","up"]},{"osd":4,"uuid":"e662886d-e989-4d02-8c1f-3c4671352b0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6809","nonce":3636910144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6811","nonce":3636910144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6815","nonce":3636910144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6813","nonce":3636910144}]},"public_addr":"172.21.15.157:6809/3636910144","cluster_addr":"172.21.15.157:6811/3636910144","heartbeat_back_addr":"172.21.15.157:6815/3636910144","heartbeat_front_addr":"172.21.15.157:6813/3636910144","state":["exists","up"]},{"osd":5,"uuid":"9597e0ce-14ea-407d-90fe-f74bccee38b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6809","nonce":4071287969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6811","nonce":4071287969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6815","nonce":4071287969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6813","nonce":4071287969}]},"public_addr":"172.21.15.195:6809/4071287969","cluster_addr":"172.21.15.195:6811/4071287969","heartbeat_back_addr":"172.21.15.195:6815/4071287969","heartbeat_front_addr":"172.21.15.195:6813/4071287969","state":["exists","up"]},{"osd":6,"uuid":"6b78ba38-f60e-4cb6-b01c-cecc1820e8e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6819","nonce":1842285555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6821","nonce":1842285555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6825","nonce":1842285555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6823","nonce":1842285555}]},"public_addr":"172.21.15.46:6819/1842285555","cluster_addr":"172.21.15.46:6821/1842285555","heartbeat_back_addr":"172.21.15.46:6825/1842285555","heartbeat_front_addr":"172.21.15.46:6823/1842285555","state":["exists","up"]},{"osd":7,"uuid":"59a0899f-3bcd-4db2-b544-24df3a536749","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6817","nonce":3498672588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6819","nonce":3498672588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6823","nonce":3498672588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6821","nonce":3498672588}]},"public_addr":"172.21.15.157:6817/3498672588","cluster_addr":"172.21.15.157:6819/3498672588","heartbeat_back_addr":"172.21.15.157:6823/3498672588","heartbeat_front_addr":"172.21.15.157:6821/3498672588","state":["exists","up"]},{"osd":8,"uuid":"9c3c9835-043a-4fb5-a9ee-edf8caf6b605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6817","nonce":74230104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6819","nonce":74230104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6823","nonce":74230104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6821","nonce":74230104}]},"public_addr":"172.21.15.195:6817/74230104","cluster_addr":"172.21.15.195:6819/74230104","heartbeat_back_addr":"172.21.15.195:6823/74230104","heartbeat_front_addr":"172.21.15.195:6821/74230104","state":["exists","up"]},{"osd":9,"uuid":"3f18f506-a577-4b7c-ae0d-9351c07e81f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6827","nonce":3472581046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6829","nonce":3472581046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6833","nonce":3472581046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6831","nonce":3472581046}]},"public_addr":"172.21.15.46:6827/3472581046","cluster_addr":"172.21.15.46:6829/3472581046","heartbeat_back_addr":"172.21.15.46:6833/3472581046","heartbeat_front_addr":"172.21.15.46:6831/3472581046","state":["exists","up"]},{"osd":10,"uuid":"1ed01854-443a-4acf-9293-7ca0d451a93d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6825","nonce":2378416559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6827","nonce":2378416559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6831","nonce":2378416559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6829","nonce":2378416559}]},"public_addr":"172.21.15.157:6825/2378416559","cluster_addr":"172.21.15.157:6827/2378416559","heartbeat_back_addr":"172.21.15.157:6831/2378416559","heartbeat_front_addr":"172.21.15.157:6829/2378416559","state":["exists","up"]},{"osd":11,"uuid":"021398c0-9184-4647-8220-e40f6705ca90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6825","nonce":3075632222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6827","nonce":3075632222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6831","nonce":3075632222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6829","nonce":3075632222}]},"public_addr":"172.21.15.195:6825/3075632222","cluster_addr":"172.21.15.195:6827/3075632222","heartbeat_back_addr":"172.21.15.195:6831/3075632222","heartbeat_front_addr":"172.21.15.195:6829/3075632222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:36:22.002614+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:36:44.098031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:37:04.518341+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:37:30.796462+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:37:52.756555+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:38:13.403168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:38:39.058472+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:39:01.106893+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:39:21.908334+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:39:46.843884+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:40:08.792020+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:40:29.282974+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":7}]},{"pgid":"3.1b","mappings":[{"from":3,"to":6},{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.39","mappings":[{"from":5,"to":8}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]},{"pgid":"4.6","mappings":[{"from":5,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.46:0/3248595150":"2023-10-20T12:34:26.552115+0000","172.21.15.46:0/3624849341":"2023-10-20T12:34:26.552115+0000","172.21.15.46:0/1844094590":"2023-10-20T12:34:26.552115+0000","172.21.15.46:6801/20022894":"2023-10-20T12:34:26.552115+0000","172.21.15.46:0/3969790632":"2023-10-20T12:34:00.135248+0000","172.21.15.46:0/2331135821":"2023-10-20T12:34:00.135248+0000","172.21.15.46:6800/51664346":"2023-10-20T12:34:00.135248+0000","172.21.15.46:6801/51664346":"2023-10-20T12:34:00.135248+0000","172.21.15.46:0/585851467":"2023-10-20T12:34:00.135248+0000","172.21.15.46:6800/20022894":"2023-10-20T12:34:26.552115+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-19T13:00:05.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.616+0000 7ff29a9ff700 1 -- 172.21.15.46:0/767524392 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7ff27c0a1480 msgr2=0x7ff27c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T13:00:05.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.616+0000 7ff29a9ff700 1 --2- 172.21.15.46:0/767524392 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7ff27c0a1480 0x7ff27c0a3940 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7ff288011490 tx=0x7ff288009260 comp rx=0 tx=0).stop 2023-10-19T13:00:05.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.617+0000 7ff29a9ff700 1 -- 172.21.15.46:0/767524392 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff294102970 msgr2=0x7ff2941988f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T13:00:05.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.617+0000 7ff29a9ff700 1 --2- 172.21.15.46:0/767524392 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff294102970 0x7ff2941988f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff28400b680 tx=0x7ff284004730 comp rx=0 tx=0).stop 2023-10-19T13:00:05.620 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.617+0000 7ff29a9ff700 1 -- 172.21.15.46:0/767524392 shutdown_connections 2023-10-19T13:00:05.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.617+0000 7ff29a9ff700 1 --2- 172.21.15.46:0/767524392 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff294104500 0x7ff29419fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:05.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.617+0000 7ff29a9ff700 1 --2- 172.21.15.46:0/767524392 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7ff27c0a1480 0x7ff27c0a3940 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:05.621 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.617+0000 7ff29a9ff700 1 --2- 172.21.15.46:0/767524392 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff294102970 0x7ff2941988f0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:05.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.617+0000 7ff29a9ff700 1 --2- 172.21.15.46:0/767524392 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff294103b60 0x7ff294198e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:05.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.617+0000 7ff29a9ff700 1 -- 172.21.15.46:0/767524392 >> 172.21.15.46:0/767524392 conn(0x7ff2940fdf00 msgr2=0x7ff294106f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T13:00:05.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.617+0000 7ff29a9ff700 1 -- 172.21.15.46:0/767524392 shutdown_connections 2023-10-19T13:00:05.622 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.617+0000 7ff29a9ff700 1 -- 172.21.15.46:0/767524392 wait complete. 2023-10-19T13:00:05.639 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-19T12:37:07.175795+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-19T12:41:16.895203+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-19T12:41:18.255601+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-19T12:41:21.830455+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-19T13:00:05.640 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-19T13:00:05.850 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.846+0000 7fa2b6dff700 1 -- 172.21.15.46:0/3528552316 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa2b0101990 msgr2=0x7fa2b0101df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T13:00:05.850 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.846+0000 7fa2b6dff700 1 --2- 172.21.15.46:0/3528552316 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa2b0101990 0x7fa2b0101df0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa29c009990 tx=0x7fa29c009ca0 comp rx=0 tx=0).stop 2023-10-19T13:00:05.850 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.846+0000 7fa2b6dff700 1 -- 172.21.15.46:0/3528552316 shutdown_connections 2023-10-19T13:00:05.850 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.846+0000 7fa2b6dff700 1 --2- 172.21.15.46:0/3528552316 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa2b0102330 0x7fa2b0108be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:05.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.847+0000 7fa2b6dff700 1 --2- 172.21.15.46:0/3528552316 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa2b01007a0 0x7fa2b0100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:05.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.847+0000 7fa2b6dff700 1 --2- 172.21.15.46:0/3528552316 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa2b0101990 0x7fa2b0101df0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:05.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.847+0000 7fa2b6dff700 1 -- 172.21.15.46:0/3528552316 >> 172.21.15.46:0/3528552316 conn(0x7fa2b00fbcf0 msgr2=0x7fa2b00fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T13:00:05.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.847+0000 7fa2b6dff700 1 -- 172.21.15.46:0/3528552316 shutdown_connections 2023-10-19T13:00:05.851 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.847+0000 7fa2b6dff700 1 -- 172.21.15.46:0/3528552316 wait complete. 2023-10-19T13:00:05.853 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.848+0000 7fa2b6dff700 1 Processor -- start 2023-10-19T13:00:05.853 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.848+0000 7fa2b6dff700 1 -- start start 2023-10-19T13:00:05.854 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.848+0000 7fa2b6dff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa2b01007a0 0x7fa2b0198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T13:00:05.854 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.848+0000 7fa2b6dff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa2b0101990 0x7fa2b0198e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T13:00:05.854 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.848+0000 7fa2b6dff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa2b0102330 0x7fa2b019fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T13:00:05.854 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.848+0000 7fa2b6dff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b01a0450 con 0x7fa2b0102330 2023-10-19T13:00:05.854 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.848+0000 7fa2b6dff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b01a0590 con 0x7fa2b0101990 2023-10-19T13:00:05.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.848+0000 7fa2b6dff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b01a0720 con 0x7fa2b01007a0 2023-10-19T13:00:05.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.849+0000 7fa2affff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa2b0101990 0x7fa2b0198e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T13:00:05.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.849+0000 7fa2b539c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa2b0102330 0x7fa2b019fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T13:00:05.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.849+0000 7fa2affff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa2b0101990 0x7fa2b0198e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:47000/0 (socket says 172.21.15.46:47000) 2023-10-19T13:00:05.855 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.849+0000 7fa2affff700 1 -- 172.21.15.46:0/667390059 learned_addr learned my addr 172.21.15.46:0/667390059 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T13:00:05.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.849+0000 7fa2b4b9b700 1 --2- 172.21.15.46:0/667390059 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa2b01007a0 0x7fa2b0198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T13:00:05.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.849+0000 7fa2b539c700 1 -- 172.21.15.46:0/667390059 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa2b01007a0 msgr2=0x7fa2b0198920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T13:00:05.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.849+0000 7fa2b539c700 1 --2- 172.21.15.46:0/667390059 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa2b01007a0 0x7fa2b0198920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:05.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.849+0000 7fa2b539c700 1 -- 172.21.15.46:0/667390059 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa2b0101990 msgr2=0x7fa2b0198e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T13:00:05.856 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.849+0000 7fa2b539c700 1 --2- 172.21.15.46:0/667390059 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa2b0101990 0x7fa2b0198e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:05.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.849+0000 7fa2b539c700 1 -- 172.21.15.46:0/667390059 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa29c0095f0 con 0x7fa2b0102330 2023-10-19T13:00:05.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.849+0000 7fa2b539c700 1 --2- 172.21.15.46:0/667390059 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa2b0102330 0x7fa2b019fe80 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fa2a800efc0 tx=0x7fa2a800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T13:00:05.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.850+0000 7fa2adffb700 1 -- 172.21.15.46:0/667390059 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a8018070 con 0x7fa2b0102330 2023-10-19T13:00:05.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.850+0000 7fa2adffb700 1 -- 172.21.15.46:0/667390059 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa2a800f040 con 0x7fa2b0102330 2023-10-19T13:00:05.857 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.850+0000 7fa2b6dff700 1 -- 172.21.15.46:0/667390059 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2b01a09a0 con 0x7fa2b0102330 2023-10-19T13:00:05.858 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.850+0000 7fa2adffb700 1 -- 172.21.15.46:0/667390059 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a800cd40 con 0x7fa2b0102330 2023-10-19T13:00:05.858 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.850+0000 7fa2b6dff700 1 -- 172.21.15.46:0/667390059 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2b01a0e60 con 0x7fa2b0102330 2023-10-19T13:00:05.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.851+0000 7fa2b6dff700 1 -- 172.21.15.46:0/667390059 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2b00675a0 con 0x7fa2b0102330 2023-10-19T13:00:05.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.853+0000 7fa2adffb700 1 -- 172.21.15.46:0/667390059 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fa2a8003a00 con 0x7fa2b0102330 2023-10-19T13:00:05.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.854+0000 7fa2adffb700 1 --2- 172.21.15.46:0/667390059 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fa2a00a1480 0x7fa2a00a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T13:00:05.859 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.854+0000 7fa2adffb700 1 -- 172.21.15.46:0/667390059 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7fa2a80cd6b0 con 0x7fa2b0102330 2023-10-19T13:00:05.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.854+0000 7fa2b4b9b700 1 --2- 172.21.15.46:0/667390059 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fa2a00a1480 0x7fa2a00a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T13:00:05.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.855+0000 7fa2b4b9b700 1 --2- 172.21.15.46:0/667390059 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fa2a00a1480 0x7fa2a00a3940 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fa2b01017f0 tx=0x7fa2a4009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T13:00:05.860 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:05.857+0000 7fa2adffb700 1 -- 172.21.15.46:0/667390059 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa2a8096970 con 0x7fa2b0102330 2023-10-19T13:00:06.078 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.075+0000 7fa2b6dff700 1 -- 172.21.15.46:0/667390059 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa2b010c190 con 0x7fa2b0102330 2023-10-19T13:00:06.079 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.076+0000 7fa2adffb700 1 -- 172.21.15.46:0/667390059 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v92) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa2a8099f90 con 0x7fa2b0102330 2023-10-19T13:00:06.079 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2023-10-19T13:00:06.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.079+0000 7fa2b6dff700 1 -- 172.21.15.46:0/667390059 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fa2a00a1480 msgr2=0x7fa2a00a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T13:00:06.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.079+0000 7fa2b6dff700 1 --2- 172.21.15.46:0/667390059 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fa2a00a1480 0x7fa2a00a3940 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fa2b01017f0 tx=0x7fa2a4009260 comp rx=0 tx=0).stop 2023-10-19T13:00:06.082 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.079+0000 7fa2b6dff700 1 -- 172.21.15.46:0/667390059 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa2b0102330 msgr2=0x7fa2b019fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T13:00:06.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.079+0000 7fa2b6dff700 1 --2- 172.21.15.46:0/667390059 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa2b0102330 0x7fa2b019fe80 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fa2a800efc0 tx=0x7fa2a800c3a0 comp rx=0 tx=0).stop 2023-10-19T13:00:06.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.079+0000 7fa2b6dff700 1 -- 172.21.15.46:0/667390059 shutdown_connections 2023-10-19T13:00:06.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.079+0000 7fa2b6dff700 1 --2- 172.21.15.46:0/667390059 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa2b0102330 0x7fa2b019fe80 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:06.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.079+0000 7fa2b6dff700 1 --2- 172.21.15.46:0/667390059 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fa2a00a1480 0x7fa2a00a3940 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:06.083 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.079+0000 7fa2b6dff700 1 --2- 172.21.15.46:0/667390059 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa2b01007a0 0x7fa2b0198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:06.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.079+0000 7fa2b6dff700 1 --2- 172.21.15.46:0/667390059 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa2b0101990 0x7fa2b0198e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:06.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.079+0000 7fa2b6dff700 1 -- 172.21.15.46:0/667390059 >> 172.21.15.46:0/667390059 conn(0x7fa2b00fbcf0 msgr2=0x7fa2b0072a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T13:00:06.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.079+0000 7fa2b6dff700 1 -- 172.21.15.46:0/667390059 shutdown_connections 2023-10-19T13:00:06.084 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.079+0000 7fa2b6dff700 1 -- 172.21.15.46:0/667390059 wait complete. 2023-10-19T13:00:06.101 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-19T13:00:06.311 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.308+0000 7f95f07ff700 1 -- 172.21.15.46:0/3068796696 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f95e81007a0 msgr2=0x7f95e8100bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T13:00:06.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.308+0000 7f95f07ff700 1 --2- 172.21.15.46:0/3068796696 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f95e81007a0 0x7f95e8100bc0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f95e40099c0 tx=0x7f95e4009cd0 comp rx=0 tx=0).stop 2023-10-19T13:00:06.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.308+0000 7f95f07ff700 1 -- 172.21.15.46:0/3068796696 shutdown_connections 2023-10-19T13:00:06.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.308+0000 7f95f07ff700 1 --2- 172.21.15.46:0/3068796696 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f95e8102330 0x7f95e8108be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:06.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.308+0000 7f95f07ff700 1 --2- 172.21.15.46:0/3068796696 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f95e81007a0 0x7f95e8100bc0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:06.312 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.308+0000 7f95f07ff700 1 --2- 172.21.15.46:0/3068796696 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95e8101990 0x7f95e8101df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:06.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.308+0000 7f95f07ff700 1 -- 172.21.15.46:0/3068796696 >> 172.21.15.46:0/3068796696 conn(0x7f95e80fbcf0 msgr2=0x7f95e80fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T13:00:06.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.308+0000 7f95f07ff700 1 -- 172.21.15.46:0/3068796696 shutdown_connections 2023-10-19T13:00:06.313 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.308+0000 7f95f07ff700 1 -- 172.21.15.46:0/3068796696 wait complete. 2023-10-19T13:00:06.315 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.309+0000 7f95f07ff700 1 Processor -- start 2023-10-19T13:00:06.315 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.310+0000 7f95f07ff700 1 -- start start 2023-10-19T13:00:06.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.310+0000 7f95f07ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f95e81007a0 0x7f95e81967a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T13:00:06.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.310+0000 7f95f07ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f95e8101990 0x7f95e8196ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T13:00:06.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.310+0000 7f95f07ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95e8102330 0x7f95e819dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T13:00:06.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.310+0000 7f95f07ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95e819e280 con 0x7f95e8102330 2023-10-19T13:00:06.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.310+0000 7f95f07ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95e819e3c0 con 0x7f95e81007a0 2023-10-19T13:00:06.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.310+0000 7f95f07ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95e819e550 con 0x7f95e8101990 2023-10-19T13:00:06.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.310+0000 7f95ee59b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f95e81007a0 0x7f95e81967a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T13:00:06.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.310+0000 7f95ee59b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f95e81007a0 0x7f95e81967a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:47012/0 (socket says 172.21.15.46:47012) 2023-10-19T13:00:06.317 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.310+0000 7f95ee59b700 1 -- 172.21.15.46:0/3551205510 learned_addr learned my addr 172.21.15.46:0/3551205510 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T13:00:06.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.311+0000 7f95edd9a700 1 --2- 172.21.15.46:0/3551205510 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f95e8101990 0x7f95e8196ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T13:00:06.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.311+0000 7f95eed9c700 1 --2- 172.21.15.46:0/3551205510 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95e8102330 0x7f95e819dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T13:00:06.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.311+0000 7f95ee59b700 1 -- 172.21.15.46:0/3551205510 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f95e8101990 msgr2=0x7f95e8196ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T13:00:06.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.311+0000 7f95ee59b700 1 --2- 172.21.15.46:0/3551205510 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f95e8101990 0x7f95e8196ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:06.318 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.311+0000 7f95ee59b700 1 -- 172.21.15.46:0/3551205510 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95e8102330 msgr2=0x7f95e819dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T13:00:06.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.311+0000 7f95ee59b700 1 --2- 172.21.15.46:0/3551205510 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95e8102330 0x7f95e819dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:06.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.311+0000 7f95ee59b700 1 -- 172.21.15.46:0/3551205510 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95e40095f0 con 0x7f95e81007a0 2023-10-19T13:00:06.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.311+0000 7f95edd9a700 1 --2- 172.21.15.46:0/3551205510 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f95e8101990 0x7f95e8196ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T13:00:06.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.311+0000 7f95ee59b700 1 --2- 172.21.15.46:0/3551205510 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f95e81007a0 0x7f95e81967a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f95e4003730 tx=0x7f95e400fab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T13:00:06.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.311+0000 7f95df7fe700 1 -- 172.21.15.46:0/3551205510 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e401d070 con 0x7f95e81007a0 2023-10-19T13:00:06.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.311+0000 7f95df7fe700 1 -- 172.21.15.46:0/3551205510 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f95e400bda0 con 0x7f95e81007a0 2023-10-19T13:00:06.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.311+0000 7f95f07ff700 1 -- 172.21.15.46:0/3551205510 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95e819e7d0 con 0x7f95e81007a0 2023-10-19T13:00:06.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.311+0000 7f95df7fe700 1 -- 172.21.15.46:0/3551205510 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e4004c70 con 0x7f95e81007a0 2023-10-19T13:00:06.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.312+0000 7f95f07ff700 1 -- 172.21.15.46:0/3551205510 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95e819ec50 con 0x7f95e81007a0 2023-10-19T13:00:06.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.312+0000 7f95f07ff700 1 -- 172.21.15.46:0/3551205510 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95e8107c90 con 0x7f95e81007a0 2023-10-19T13:00:06.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.315+0000 7f95df7fe700 1 -- 172.21.15.46:0/3551205510 <== mon.2 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f95e4005050 con 0x7f95e81007a0 2023-10-19T13:00:06.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.316+0000 7f95df7fe700 1 --2- 172.21.15.46:0/3551205510 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f95d40a1500 0x7f95d40a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T13:00:06.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.316+0000 7f95df7fe700 1 -- 172.21.15.46:0/3551205510 <== mon.2 v2:172.21.15.157:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f95e40ce2f0 con 0x7f95e81007a0 2023-10-19T13:00:06.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.316+0000 7f95edd9a700 1 --2- 172.21.15.46:0/3551205510 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f95d40a1500 0x7f95d40a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T13:00:06.322 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.317+0000 7f95edd9a700 1 --2- 172.21.15.46:0/3551205510 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f95d40a1500 0x7f95d40a39c0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f95d8009cb0 tx=0x7f95d8009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T13:00:06.323 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.319+0000 7f95df7fe700 1 -- 172.21.15.46:0/3551205510 <== mon.2 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f95e40975b0 con 0x7f95e81007a0 2023-10-19T13:00:06.478 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 13:00:06 smithi046 ceph-mon[98509]: pgmap v851: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.9 KiB/s wr, 11 op/s 2023-10-19T13:00:06.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 13:00:06 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/767524392' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-19T13:00:06.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 13:00:06 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/667390059' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-19T13:00:06.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.535+0000 7f95f07ff700 1 -- 172.21.15.46:0/3551205510 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f95e810c000 con 0x7f95e81007a0 2023-10-19T13:00:06.538 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.535+0000 7f95df7fe700 1 -- 172.21.15.46:0/3551205510 <== mon.2 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v92) v1 ==== 104+0+11 (secure 0 0 0) 0x7f95e409abd0 con 0x7f95e81007a0 2023-10-19T13:00:06.539 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2023-10-19T13:00:06.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.538+0000 7f95f07ff700 1 -- 172.21.15.46:0/3551205510 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f95d40a1500 msgr2=0x7f95d40a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T13:00:06.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.538+0000 7f95f07ff700 1 --2- 172.21.15.46:0/3551205510 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f95d40a1500 0x7f95d40a39c0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f95d8009cb0 tx=0x7f95d8009260 comp rx=0 tx=0).stop 2023-10-19T13:00:06.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.538+0000 7f95f07ff700 1 -- 172.21.15.46:0/3551205510 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f95e81007a0 msgr2=0x7f95e81967a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T13:00:06.541 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.538+0000 7f95f07ff700 1 --2- 172.21.15.46:0/3551205510 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f95e81007a0 0x7f95e81967a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f95e4003730 tx=0x7f95e400fab0 comp rx=0 tx=0).stop 2023-10-19T13:00:06.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.538+0000 7f95f07ff700 1 -- 172.21.15.46:0/3551205510 shutdown_connections 2023-10-19T13:00:06.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.538+0000 7f95f07ff700 1 --2- 172.21.15.46:0/3551205510 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95e8102330 0x7f95e819dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:06.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.538+0000 7f95f07ff700 1 --2- 172.21.15.46:0/3551205510 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f95e81007a0 0x7f95e81967a0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:06.542 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.538+0000 7f95f07ff700 1 --2- 172.21.15.46:0/3551205510 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f95d40a1500 0x7f95d40a39c0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:06.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.538+0000 7f95f07ff700 1 --2- 172.21.15.46:0/3551205510 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f95e8101990 0x7f95e8196ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:06.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.538+0000 7f95f07ff700 1 -- 172.21.15.46:0/3551205510 >> 172.21.15.46:0/3551205510 conn(0x7f95e80fbcf0 msgr2=0x7f95e8104dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T13:00:06.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.538+0000 7f95f07ff700 1 -- 172.21.15.46:0/3551205510 shutdown_connections 2023-10-19T13:00:06.543 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.538+0000 7f95f07ff700 1 -- 172.21.15.46:0/3551205510 wait complete. 2023-10-19T13:00:06.560 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-19T13:00:06.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 13:00:06 smithi157 ceph-mon[134109]: pgmap v851: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.9 KiB/s wr, 11 op/s 2023-10-19T13:00:06.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 13:00:06 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/767524392' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-19T13:00:06.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 13:00:06 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/667390059' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-19T13:00:06.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 13:00:06 smithi195 ceph-mon[134493]: pgmap v851: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.9 KiB/s wr, 11 op/s 2023-10-19T13:00:06.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 13:00:06 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/767524392' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-19T13:00:06.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 13:00:06 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/667390059' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-19T13:00:06.768 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.765+0000 7f509fbff700 1 -- 172.21.15.46:0/317950411 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f50981007a0 msgr2=0x7f5098100bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T13:00:06.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.765+0000 7f509fbff700 1 --2- 172.21.15.46:0/317950411 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f50981007a0 0x7f5098100bc0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f50940099c0 tx=0x7f5094009cd0 comp rx=0 tx=0).stop 2023-10-19T13:00:06.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.765+0000 7f509fbff700 1 -- 172.21.15.46:0/317950411 shutdown_connections 2023-10-19T13:00:06.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.765+0000 7f509fbff700 1 --2- 172.21.15.46:0/317950411 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5098102330 0x7f5098108be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:06.769 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.765+0000 7f509fbff700 1 --2- 172.21.15.46:0/317950411 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f50981007a0 0x7f5098100bc0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:06.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.765+0000 7f509fbff700 1 --2- 172.21.15.46:0/317950411 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5098101990 0x7f5098101df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:06.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.765+0000 7f509fbff700 1 -- 172.21.15.46:0/317950411 >> 172.21.15.46:0/317950411 conn(0x7f50980fbcf0 msgr2=0x7f50980fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T13:00:06.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.765+0000 7f509fbff700 1 -- 172.21.15.46:0/317950411 shutdown_connections 2023-10-19T13:00:06.770 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.765+0000 7f509fbff700 1 -- 172.21.15.46:0/317950411 wait complete. 2023-10-19T13:00:06.772 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.766+0000 7f509fbff700 1 Processor -- start 2023-10-19T13:00:06.772 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.767+0000 7f509fbff700 1 -- start start 2023-10-19T13:00:06.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.767+0000 7f509fbff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f50981007a0 0x7f5098198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T13:00:06.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.767+0000 7f509fbff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5098101990 0x7f5098198e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T13:00:06.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.767+0000 7f509fbff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5098102330 0x7f509819feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T13:00:06.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.767+0000 7f509fbff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50981a0480 con 0x7f5098101990 2023-10-19T13:00:06.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.767+0000 7f509fbff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50981a05c0 con 0x7f50981007a0 2023-10-19T13:00:06.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.767+0000 7f509fbff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50981a0750 con 0x7f5098102330 2023-10-19T13:00:06.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.767+0000 7f509d99b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f50981007a0 0x7f5098198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T13:00:06.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.767+0000 7f509d99b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f50981007a0 0x7f5098198950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:47036/0 (socket says 172.21.15.46:47036) 2023-10-19T13:00:06.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.767+0000 7f509d99b700 1 -- 172.21.15.46:0/503558272 learned_addr learned my addr 172.21.15.46:0/503558272 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T13:00:06.774 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.767+0000 7f509d19a700 1 --2- 172.21.15.46:0/503558272 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5098101990 0x7f5098198e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T13:00:06.775 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.767+0000 7f509e19c700 1 --2- 172.21.15.46:0/503558272 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5098102330 0x7f509819feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T13:00:06.775 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.767+0000 7f509d99b700 1 -- 172.21.15.46:0/503558272 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5098102330 msgr2=0x7f509819feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T13:00:06.775 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.767+0000 7f509d99b700 1 --2- 172.21.15.46:0/503558272 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5098102330 0x7f509819feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:06.775 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.768+0000 7f509d99b700 1 -- 172.21.15.46:0/503558272 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5098101990 msgr2=0x7f5098198e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T13:00:06.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.768+0000 7f509d99b700 1 --2- 172.21.15.46:0/503558272 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5098101990 0x7f5098198e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:06.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.768+0000 7f509d99b700 1 -- 172.21.15.46:0/503558272 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50940095f0 con 0x7f50981007a0 2023-10-19T13:00:06.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.768+0000 7f509d99b700 1 --2- 172.21.15.46:0/503558272 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f50981007a0 0x7f5098198950 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f5094003730 tx=0x7f509400f690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T13:00:06.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.768+0000 7f508effd700 1 -- 172.21.15.46:0/503558272 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f509401d070 con 0x7f50981007a0 2023-10-19T13:00:06.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.768+0000 7f508effd700 1 -- 172.21.15.46:0/503558272 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5094005050 con 0x7f50981007a0 2023-10-19T13:00:06.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.768+0000 7f509fbff700 1 -- 172.21.15.46:0/503558272 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50981a09d0 con 0x7f50981007a0 2023-10-19T13:00:06.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.768+0000 7f508effd700 1 -- 172.21.15.46:0/503558272 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5094004af0 con 0x7f50981007a0 2023-10-19T13:00:06.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.768+0000 7f509fbff700 1 -- 172.21.15.46:0/503558272 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50981a0df0 con 0x7f50981007a0 2023-10-19T13:00:06.777 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.769+0000 7f509fbff700 1 -- 172.21.15.46:0/503558272 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50980675a0 con 0x7f50981007a0 2023-10-19T13:00:06.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.771+0000 7f508effd700 1 -- 172.21.15.46:0/503558272 <== mon.2 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f50940051c0 con 0x7f50981007a0 2023-10-19T13:00:06.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.773+0000 7f508effd700 1 --2- 172.21.15.46:0/503558272 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f50840a1480 0x7f50840a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T13:00:06.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.773+0000 7f508effd700 1 -- 172.21.15.46:0/503558272 <== mon.2 v2:172.21.15.157:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f50940ce2e0 con 0x7f50981007a0 2023-10-19T13:00:06.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.773+0000 7f509d19a700 1 --2- 172.21.15.46:0/503558272 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f50840a1480 0x7f50840a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T13:00:06.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.774+0000 7f509d19a700 1 --2- 172.21.15.46:0/503558272 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f50840a1480 0x7f50840a3940 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f5088009c60 tx=0x7f5088009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T13:00:06.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.777+0000 7f508effd700 1 -- 172.21.15.46:0/503558272 <== mon.2 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f50940975a0 con 0x7f50981007a0 2023-10-19T13:00:06.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.992+0000 7f509fbff700 1 -- 172.21.15.46:0/503558272 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f50981a10e0 con 0x7f50981007a0 2023-10-19T13:00:06.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.993+0000 7f508effd700 1 -- 172.21.15.46:0/503558272 <== mon.2 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v92) v1 ==== 100+0+11 (secure 0 0 0) 0x7f509409abc0 con 0x7f50981007a0 2023-10-19T13:00:06.997 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2023-10-19T13:00:06.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.995+0000 7f509fbff700 1 -- 172.21.15.46:0/503558272 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f50840a1480 msgr2=0x7f50840a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T13:00:06.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.995+0000 7f509fbff700 1 --2- 172.21.15.46:0/503558272 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f50840a1480 0x7f50840a3940 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f5088009c60 tx=0x7f5088009260 comp rx=0 tx=0).stop 2023-10-19T13:00:06.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.995+0000 7f509fbff700 1 -- 172.21.15.46:0/503558272 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f50981007a0 msgr2=0x7f5098198950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T13:00:06.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.995+0000 7f509fbff700 1 --2- 172.21.15.46:0/503558272 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f50981007a0 0x7f5098198950 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f5094003730 tx=0x7f509400f690 comp rx=0 tx=0).stop 2023-10-19T13:00:07.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.995+0000 7f509fbff700 1 -- 172.21.15.46:0/503558272 shutdown_connections 2023-10-19T13:00:07.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.995+0000 7f509fbff700 1 --2- 172.21.15.46:0/503558272 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f50840a1480 0x7f50840a3940 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:07.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.995+0000 7f509fbff700 1 --2- 172.21.15.46:0/503558272 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5098102330 0x7f509819feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:07.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.995+0000 7f509fbff700 1 --2- 172.21.15.46:0/503558272 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f50981007a0 0x7f5098198950 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:07.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.995+0000 7f509fbff700 1 --2- 172.21.15.46:0/503558272 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5098101990 0x7f5098198e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:07.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.995+0000 7f509fbff700 1 -- 172.21.15.46:0/503558272 >> 172.21.15.46:0/503558272 conn(0x7f50980fbcf0 msgr2=0x7f50981071b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T13:00:07.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.996+0000 7f509fbff700 1 -- 172.21.15.46:0/503558272 shutdown_connections 2023-10-19T13:00:07.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:06.996+0000 7f509fbff700 1 -- 172.21.15.46:0/503558272 wait complete. 2023-10-19T13:00:07.018 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-19T13:00:07.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.225+0000 7f70a2dff700 1 -- 172.21.15.46:0/2798151816 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f709c101990 msgr2=0x7f709c101df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T13:00:07.228 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.225+0000 7f70a2dff700 1 --2- 172.21.15.46:0/2798151816 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f709c101990 0x7f709c101df0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f70880099c0 tx=0x7f7088009cd0 comp rx=0 tx=0).stop 2023-10-19T13:00:07.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.225+0000 7f70a2dff700 1 -- 172.21.15.46:0/2798151816 shutdown_connections 2023-10-19T13:00:07.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.225+0000 7f70a2dff700 1 --2- 172.21.15.46:0/2798151816 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f709c102330 0x7f709c108be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:07.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.225+0000 7f70a2dff700 1 --2- 172.21.15.46:0/2798151816 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f709c1007a0 0x7f709c100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:07.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.225+0000 7f70a2dff700 1 --2- 172.21.15.46:0/2798151816 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f709c101990 0x7f709c101df0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:07.229 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.225+0000 7f70a2dff700 1 -- 172.21.15.46:0/2798151816 >> 172.21.15.46:0/2798151816 conn(0x7f709c0fbcf0 msgr2=0x7f709c0fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T13:00:07.230 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.225+0000 7f70a2dff700 1 -- 172.21.15.46:0/2798151816 shutdown_connections 2023-10-19T13:00:07.230 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.225+0000 7f70a2dff700 1 -- 172.21.15.46:0/2798151816 wait complete. 2023-10-19T13:00:07.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.226+0000 7f70a2dff700 1 Processor -- start 2023-10-19T13:00:07.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.226+0000 7f70a2dff700 1 -- start start 2023-10-19T13:00:07.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.226+0000 7f70a2dff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f709c1007a0 0x7f709c198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T13:00:07.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.226+0000 7f70a2dff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f709c101990 0x7f709c198e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T13:00:07.232 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.226+0000 7f70a2dff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f709c102330 0x7f709c19fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T13:00:07.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.226+0000 7f70a2dff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f709c1a0400 con 0x7f709c1007a0 2023-10-19T13:00:07.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.226+0000 7f70a2dff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f709c1a0540 con 0x7f709c101990 2023-10-19T13:00:07.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.226+0000 7f70a2dff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f709c1a06d0 con 0x7f709c102330 2023-10-19T13:00:07.233 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.227+0000 7f70a0b9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f709c1007a0 0x7f709c198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T13:00:07.234 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.227+0000 7f709bfff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f709c101990 0x7f709c198e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T13:00:07.234 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.227+0000 7f70a0b9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f709c1007a0 0x7f709c198920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51652/0 (socket says 172.21.15.46:51652) 2023-10-19T13:00:07.234 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.227+0000 7f70a0b9b700 1 -- 172.21.15.46:0/1934502286 learned_addr learned my addr 172.21.15.46:0/1934502286 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T13:00:07.234 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.227+0000 7f70a139c700 1 --2- 172.21.15.46:0/1934502286 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f709c102330 0x7f709c19fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T13:00:07.234 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.227+0000 7f70a0b9b700 1 -- 172.21.15.46:0/1934502286 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f709c102330 msgr2=0x7f709c19fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T13:00:07.235 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.227+0000 7f70a0b9b700 1 --2- 172.21.15.46:0/1934502286 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f709c102330 0x7f709c19fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:07.235 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.227+0000 7f70a0b9b700 1 -- 172.21.15.46:0/1934502286 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f709c101990 msgr2=0x7f709c198e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T13:00:07.235 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.227+0000 7f70a0b9b700 1 --2- 172.21.15.46:0/1934502286 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f709c101990 0x7f709c198e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:07.235 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.227+0000 7f70a0b9b700 1 -- 172.21.15.46:0/1934502286 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70880095f0 con 0x7f709c1007a0 2023-10-19T13:00:07.235 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.227+0000 7f709bfff700 1 --2- 172.21.15.46:0/1934502286 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f709c101990 0x7f709c198e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T13:00:07.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.227+0000 7f70a0b9b700 1 --2- 172.21.15.46:0/1934502286 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f709c1007a0 0x7f709c198920 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f709000e970 tx=0x7f709000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T13:00:07.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.227+0000 7f7099ffb700 1 -- 172.21.15.46:0/1934502286 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7090009790 con 0x7f709c1007a0 2023-10-19T13:00:07.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.228+0000 7f7099ffb700 1 -- 172.21.15.46:0/1934502286 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f709000c7e0 con 0x7f709c1007a0 2023-10-19T13:00:07.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.228+0000 7f70a2dff700 1 -- 172.21.15.46:0/1934502286 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f709c1a09b0 con 0x7f709c1007a0 2023-10-19T13:00:07.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.228+0000 7f7099ffb700 1 -- 172.21.15.46:0/1934502286 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7090003c70 con 0x7f709c1007a0 2023-10-19T13:00:07.236 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.228+0000 7f70a2dff700 1 -- 172.21.15.46:0/1934502286 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f709c1a0f10 con 0x7f709c1007a0 2023-10-19T13:00:07.237 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.229+0000 7f70a2dff700 1 -- 172.21.15.46:0/1934502286 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f709c0675a0 con 0x7f709c1007a0 2023-10-19T13:00:07.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.231+0000 7f7099ffb700 1 -- 172.21.15.46:0/1934502286 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f709000cc50 con 0x7f709c1007a0 2023-10-19T13:00:07.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.232+0000 7f7099ffb700 1 --2- 172.21.15.46:0/1934502286 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f708c0a1500 0x7f708c0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T13:00:07.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.232+0000 7f7099ffb700 1 -- 172.21.15.46:0/1934502286 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f7090014070 con 0x7f709c1007a0 2023-10-19T13:00:07.238 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.232+0000 7f709bfff700 1 --2- 172.21.15.46:0/1934502286 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f708c0a1500 0x7f708c0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T13:00:07.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.233+0000 7f709bfff700 1 --2- 172.21.15.46:0/1934502286 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f708c0a1500 0x7f708c0a39c0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f7088003730 tx=0x7f708801a040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T13:00:07.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.236+0000 7f7099ffb700 1 -- 172.21.15.46:0/1934502286 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7090096490 con 0x7f709c1007a0 2023-10-19T13:00:07.453 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.450+0000 7f70a2dff700 1 -- 172.21.15.46:0/1934502286 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f709c1a1260 con 0x7f709c1007a0 2023-10-19T13:00:07.454 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.450+0000 7f7099ffb700 1 -- 172.21.15.46:0/1934502286 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v92) v1 ==== 103+0+11 (secure 0 0 0) 0x7f7090003dd0 con 0x7f709c1007a0 2023-10-19T13:00:07.454 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2023-10-19T13:00:07.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.453+0000 7f70a2dff700 1 -- 172.21.15.46:0/1934502286 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f708c0a1500 msgr2=0x7f708c0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T13:00:07.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.453+0000 7f70a2dff700 1 --2- 172.21.15.46:0/1934502286 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f708c0a1500 0x7f708c0a39c0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f7088003730 tx=0x7f708801a040 comp rx=0 tx=0).stop 2023-10-19T13:00:07.456 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.453+0000 7f70a2dff700 1 -- 172.21.15.46:0/1934502286 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f709c1007a0 msgr2=0x7f709c198920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T13:00:07.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.453+0000 7f70a2dff700 1 --2- 172.21.15.46:0/1934502286 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f709c1007a0 0x7f709c198920 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f709000e970 tx=0x7f709000ec80 comp rx=0 tx=0).stop 2023-10-19T13:00:07.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.453+0000 7f70a2dff700 1 -- 172.21.15.46:0/1934502286 shutdown_connections 2023-10-19T13:00:07.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.453+0000 7f70a2dff700 1 --2- 172.21.15.46:0/1934502286 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f708c0a1500 0x7f708c0a39c0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:07.457 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.453+0000 7f70a2dff700 1 --2- 172.21.15.46:0/1934502286 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f709c102330 0x7f709c19fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:07.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.453+0000 7f70a2dff700 1 --2- 172.21.15.46:0/1934502286 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f709c1007a0 0x7f709c198920 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:07.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.453+0000 7f70a2dff700 1 --2- 172.21.15.46:0/1934502286 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f709c101990 0x7f709c198e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:07.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.453+0000 7f70a2dff700 1 -- 172.21.15.46:0/1934502286 >> 172.21.15.46:0/1934502286 conn(0x7f709c0fbcf0 msgr2=0x7f709c072a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T13:00:07.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.453+0000 7f70a2dff700 1 -- 172.21.15.46:0/1934502286 shutdown_connections 2023-10-19T13:00:07.458 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.453+0000 7f70a2dff700 1 -- 172.21.15.46:0/1934502286 wait complete. 2023-10-19T13:00:07.473 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 13:00:07 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/3551205510' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-19T13:00:07.473 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 13:00:07 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/503558272' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-19T13:00:07.476 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-19T13:00:07.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 13:00:07 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/3551205510' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-19T13:00:07.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 13:00:07 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/503558272' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-19T13:00:07.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 13:00:07 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/3551205510' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-19T13:00:07.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 13:00:07 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/503558272' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-19T13:00:07.683 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.680+0000 7f03c63ff700 1 -- 172.21.15.46:0/462001790 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f03c00731f0 msgr2=0x7f03c0073670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T13:00:07.684 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.680+0000 7f03c63ff700 1 --2- 172.21.15.46:0/462001790 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f03c00731f0 0x7f03c0073670 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f03b4009990 tx=0x7f03b4009ca0 comp rx=0 tx=0).stop 2023-10-19T13:00:07.684 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.680+0000 7f03c63ff700 1 -- 172.21.15.46:0/462001790 shutdown_connections 2023-10-19T13:00:07.684 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.680+0000 7f03c63ff700 1 --2- 172.21.15.46:0/462001790 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f03c01085f0 0x7f03c010aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:07.684 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.680+0000 7f03c63ff700 1 --2- 172.21.15.46:0/462001790 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f03c00747d0 0x7f03c0072c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:07.684 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.680+0000 7f03c63ff700 1 --2- 172.21.15.46:0/462001790 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f03c00731f0 0x7f03c0073670 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:07.685 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.680+0000 7f03c63ff700 1 -- 172.21.15.46:0/462001790 >> 172.21.15.46:0/462001790 conn(0x7f03c00fbc90 msgr2=0x7f03c00fe0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T13:00:07.685 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.680+0000 7f03c63ff700 1 -- 172.21.15.46:0/462001790 shutdown_connections 2023-10-19T13:00:07.685 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.681+0000 7f03c63ff700 1 -- 172.21.15.46:0/462001790 wait complete. 2023-10-19T13:00:07.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.681+0000 7f03c63ff700 1 Processor -- start 2023-10-19T13:00:07.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.682+0000 7f03c63ff700 1 -- start start 2023-10-19T13:00:07.687 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.682+0000 7f03c63ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f03c00731f0 0x7f03c01988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T13:00:07.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.682+0000 7f03c63ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f03c00747d0 0x7f03c0198df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T13:00:07.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.682+0000 7f03c63ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f03c01085f0 0x7f03c019fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T13:00:07.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.682+0000 7f03c63ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03c01a03e0 con 0x7f03c01085f0 2023-10-19T13:00:07.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.682+0000 7f03c63ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03c01a0520 con 0x7f03c00747d0 2023-10-19T13:00:07.688 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.682+0000 7f03c63ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03c01a06b0 con 0x7f03c00731f0 2023-10-19T13:00:07.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.682+0000 7f03c499c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f03c01085f0 0x7f03c019fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T13:00:07.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.682+0000 7f03bf7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f03c00747d0 0x7f03c0198df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T13:00:07.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.682+0000 7f03bffff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f03c00731f0 0x7f03c01988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T13:00:07.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.682+0000 7f03bf7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f03c00747d0 0x7f03c0198df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:47050/0 (socket says 172.21.15.46:47050) 2023-10-19T13:00:07.689 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.682+0000 7f03bf7fe700 1 -- 172.21.15.46:0/2406934290 learned_addr learned my addr 172.21.15.46:0/2406934290 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T13:00:07.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.682+0000 7f03bffff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f03c00731f0 0x7f03c01988b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.46:35918/0 (socket says 172.21.15.46:35918) 2023-10-19T13:00:07.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.683+0000 7f03c499c700 1 -- 172.21.15.46:0/2406934290 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f03c00731f0 msgr2=0x7f03c01988b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T13:00:07.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.683+0000 7f03c499c700 1 --2- 172.21.15.46:0/2406934290 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f03c00731f0 0x7f03c01988b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:07.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.683+0000 7f03c499c700 1 -- 172.21.15.46:0/2406934290 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f03c00747d0 msgr2=0x7f03c0198df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T13:00:07.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.683+0000 7f03c499c700 1 --2- 172.21.15.46:0/2406934290 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f03c00747d0 0x7f03c0198df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:07.690 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.683+0000 7f03c499c700 1 -- 172.21.15.46:0/2406934290 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03b0009520 con 0x7f03c01085f0 2023-10-19T13:00:07.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.683+0000 7f03bffff700 1 --2- 172.21.15.46:0/2406934290 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f03c00731f0 0x7f03c01988b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T13:00:07.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.683+0000 7f03c499c700 1 --2- 172.21.15.46:0/2406934290 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f03c01085f0 0x7f03c019fe10 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f03b800efc0 tx=0x7f03b800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T13:00:07.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.683+0000 7f03bd7fa700 1 -- 172.21.15.46:0/2406934290 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b8018070 con 0x7f03c01085f0 2023-10-19T13:00:07.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.683+0000 7f03c63ff700 1 -- 172.21.15.46:0/2406934290 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03b40095f0 con 0x7f03c01085f0 2023-10-19T13:00:07.691 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.683+0000 7f03bd7fa700 1 -- 172.21.15.46:0/2406934290 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f03b800f040 con 0x7f03c01085f0 2023-10-19T13:00:07.692 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.683+0000 7f03bd7fa700 1 -- 172.21.15.46:0/2406934290 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b800cd40 con 0x7f03c01085f0 2023-10-19T13:00:07.692 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.683+0000 7f03c63ff700 1 -- 172.21.15.46:0/2406934290 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03c01a0cb0 con 0x7f03c01085f0 2023-10-19T13:00:07.692 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.684+0000 7f03c63ff700 1 -- 172.21.15.46:0/2406934290 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03c0107400 con 0x7f03c01085f0 2023-10-19T13:00:07.693 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.686+0000 7f03bd7fa700 1 -- 172.21.15.46:0/2406934290 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f03b8003a00 con 0x7f03c01085f0 2023-10-19T13:00:07.693 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.689+0000 7f03bd7fa700 1 --2- 172.21.15.46:0/2406934290 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f03a80a1500 0x7f03a80a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T13:00:07.693 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.689+0000 7f03bd7fa700 1 -- 172.21.15.46:0/2406934290 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f03b80ccc70 con 0x7f03c01085f0 2023-10-19T13:00:07.694 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.689+0000 7f03bffff700 1 --2- 172.21.15.46:0/2406934290 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f03a80a1500 0x7f03a80a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T13:00:07.694 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.690+0000 7f03bffff700 1 --2- 172.21.15.46:0/2406934290 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f03a80a1500 0x7f03a80a39c0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f03b0009fd0 tx=0x7f03b0009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T13:00:07.696 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.693+0000 7f03bd7fa700 1 -- 172.21.15.46:0/2406934290 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f03b8095f30 con 0x7f03c01085f0 2023-10-19T13:00:07.928 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.926+0000 7f03c63ff700 1 -- 172.21.15.46:0/2406934290 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f03c0067530 con 0x7f03c01085f0 2023-10-19T13:00:07.929 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.926+0000 7f03bd7fa700 1 -- 172.21.15.46:0/2406934290 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v92) v1 ==== 81+0+583 (secure 0 0 0) 0x7f03b801b320 con 0x7f03c01085f0 2023-10-19T13:00:07.929 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/3248595150 2023-10-20T12:34:26.552115+0000 2023-10-19T13:00:07.930 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/3624849341 2023-10-20T12:34:26.552115+0000 2023-10-19T13:00:07.930 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/1844094590 2023-10-20T12:34:26.552115+0000 2023-10-19T13:00:07.930 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6801/20022894 2023-10-20T12:34:26.552115+0000 2023-10-19T13:00:07.930 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/3969790632 2023-10-20T12:34:00.135248+0000 2023-10-19T13:00:07.931 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/2331135821 2023-10-20T12:34:00.135248+0000 2023-10-19T13:00:07.931 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6800/51664346 2023-10-20T12:34:00.135248+0000 2023-10-19T13:00:07.931 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6801/51664346 2023-10-20T12:34:00.135248+0000 2023-10-19T13:00:07.931 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/585851467 2023-10-20T12:34:00.135248+0000 2023-10-19T13:00:07.931 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6800/20022894 2023-10-20T12:34:26.552115+0000 2023-10-19T13:00:07.932 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.929+0000 7f03c63ff700 1 -- 172.21.15.46:0/2406934290 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f03a80a1500 msgr2=0x7f03a80a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T13:00:07.932 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.929+0000 7f03c63ff700 1 --2- 172.21.15.46:0/2406934290 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f03a80a1500 0x7f03a80a39c0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f03b0009fd0 tx=0x7f03b0009260 comp rx=0 tx=0).stop 2023-10-19T13:00:07.932 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.929+0000 7f03c63ff700 1 -- 172.21.15.46:0/2406934290 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f03c01085f0 msgr2=0x7f03c019fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T13:00:07.933 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.929+0000 7f03c63ff700 1 --2- 172.21.15.46:0/2406934290 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f03c01085f0 0x7f03c019fe10 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f03b800efc0 tx=0x7f03b800c3a0 comp rx=0 tx=0).stop 2023-10-19T13:00:07.933 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.929+0000 7f03c63ff700 1 -- 172.21.15.46:0/2406934290 shutdown_connections 2023-10-19T13:00:07.933 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.929+0000 7f03c63ff700 1 --2- 172.21.15.46:0/2406934290 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f03c01085f0 0x7f03c019fe10 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:07.933 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.929+0000 7f03c63ff700 1 --2- 172.21.15.46:0/2406934290 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f03a80a1500 0x7f03a80a39c0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:07.933 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.929+0000 7f03c63ff700 1 --2- 172.21.15.46:0/2406934290 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f03c00731f0 0x7f03c01988b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:07.934 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.929+0000 7f03c63ff700 1 --2- 172.21.15.46:0/2406934290 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f03c00747d0 0x7f03c0198df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:07.934 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.929+0000 7f03c63ff700 1 -- 172.21.15.46:0/2406934290 >> 172.21.15.46:0/2406934290 conn(0x7f03c00fbc90 msgr2=0x7f03c0104540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T13:00:07.934 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.929+0000 7f03c63ff700 1 -- 172.21.15.46:0/2406934290 shutdown_connections 2023-10-19T13:00:07.934 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:07.929+0000 7f03c63ff700 1 -- 172.21.15.46:0/2406934290 wait complete. 2023-10-19T13:00:07.935 INFO:teuthology.orchestra.run.smithi046.stderr:listed 10 entries 2023-10-19T13:00:07.951 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-19T13:00:07.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T13:00:07.951 DEBUG:teuthology.orchestra.run.smithi046:> sudo umount /tmp/cephfs 2023-10-19T13:00:08.120 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi046.front.sepia.ceph.com 2023-10-19T13:00:08.120 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T13:00:08.121 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest && exec rmdir -- /tmp/cephfs) 2023-10-19T13:00:08.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T13:00:08.250 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list 2023-10-19T13:00:08.329 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-ns--tmp-cephfs (id: 0) 2023-10-19T13:00:08.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T13:00:08.330 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns delete ceph-ns--tmp-cephfs 2023-10-19T13:00:08.403 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T13:00:08.403 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link delete ceph-brx 2023-10-19T13:00:08.462 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 13:00:08 smithi046 ceph-mon[98509]: pgmap v852: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.0 KiB/s wr, 12 op/s 2023-10-19T13:00:08.462 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 13:00:08 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/1934502286' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-19T13:00:08.462 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 13:00:08 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/2406934290' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-10-19T13:00:08.508 INFO:tasks.kclient:Unmounting kernel clients... 2023-10-19T13:00:08.509 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2023-10-19T13:00:08.509 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-19T13:00:08.554 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16351428k,nr_inodes=4087857,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=41,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3276240k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/sda1 /var/lib/containers/storage/overlay ext4 rw,seclabel,relatime 0 0 overlay /var/lib/containers/storage/overlay/982624e5d552b7460ffa5415a7675477254bf70e2aac4653ed3b916eae4e4023/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/GUFHGFTAR4CUTSR7KJT7DOVIDV:/var/lib/containers/storage/overlay/l/4Y7RGGN6EDZJEQ55P4VCSQNGT6,upperdir=/var/lib/containers/storage/overlay/982624e5d552b7460ffa5415a7675477254bf70e2aac4653ed3b916eae4e4023/diff,workdir=/var/lib/containers/storage/overlay/982624e5d552b7460ffa5415a7675477254bf70e2aac4653ed3b916eae4e4023/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/d5b8b3c8416fced17346997e0b0bc46630368cb854b03020a08ee543f171a5b3/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/GUFHGFTAR4CUTSR7KJT7DOVIDV:/var/lib/containers/storage/overlay/l/4Y7RGGN6EDZJEQ55P4VCSQNGT6,upperdir=/var/lib/containers/storage/overlay/d5b8b3c8416fced17346997e0b0bc46630368cb854b03020a08ee543f171a5b3/diff,workdir=/var/lib/containers/storage/overlay/d5b8b3c8416fced17346997e0b0bc46630368cb854b03020a08ee543f171a5b3/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 tmpfs /run/user/0 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3276240k,mode=700 0 0 binfmt_misc /proc/sys/fs/binfmt_misc binfmt_misc rw,relatime 0 0 overlay /var/lib/containers/storage/overlay/5bce7eab21c97f113f5f46cc903d708d935999a2132e3ff2d720cf54986ba199/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/GUFHGFTAR4CUTSR7KJT7DOVIDV:/var/lib/containers/storage/overlay/l/4Y7RGGN6EDZJEQ55P4VCSQNGT6,upperdir=/var/lib/containers/storage/overlay/5bce7eab21c97f113f5f46cc903d708d935999a2132e3ff2d720cf54986ba199/diff,workdir=/var/lib/containers/storage/overlay/5bce7eab21c97f113f5f46cc903d708d935999a2132e3ff2d720cf54986ba199/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/e51592e5e941ddc34dd09f9d31df23e60b42be403131ab7e8b529d4ed4482dd2/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/GUFHGFTAR4CUTSR7KJT7DOVIDV:/var/lib/containers/storage/overlay/l/4Y7RGGN6EDZJEQ55P4VCSQNGT6,upperdir=/var/lib/containers/storage/overlay/e51592e5e941ddc34dd09f9d31df23e60b42be403131ab7e8b529d4ed4482dd2/diff,workdir=/var/lib/containers/storage/overlay/e51592e5e941ddc34dd09f9d31df23e60b42be403131ab7e8b529d4ed4482dd2/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/0065cb72b3d8f75737f0d0e5d0757558b40d7657fd7af4ef1490f8f1f934fef1/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/GUFHGFTAR4CUTSR7KJT7DOVIDV:/var/lib/containers/storage/overlay/l/4Y7RGGN6EDZJEQ55P4VCSQNGT6,upperdir=/var/lib/containers/storage/overlay/0065cb72b3d8f75737f0d0e5d0757558b40d7657fd7af4ef1490f8f1f934fef1/diff,workdir=/var/lib/containers/storage/overlay/0065cb72b3d8f75737f0d0e5d0757558b40d7657fd7af4ef1490f8f1f934fef1/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/a0a5599af662a92f3e252f6e66d5ea5a3012d30d1fff02979fbcb475078659c1/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/GUFHGFTAR4CUTSR7KJT7DOVIDV:/var/lib/containers/storage/overlay/l/4Y7RGGN6EDZJEQ55P4VCSQNGT6,upperdir=/var/lib/containers/storage/overlay/a0a5599af662a92f3e252f6e66d5ea5a3012d30d1fff02979fbcb475078659c1/diff,workdir=/var/lib/containers/storage/overlay/a0a5599af662a92f3e252f6e66d5ea5a3012d30d1fff02979fbcb475078659c1/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/fab8dcca3950e180451851e88e50a966149d55fd964e3ecb5c6c6f63b5a8b5ce/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/GUFHGFTAR4CUTSR7KJT7DOVIDV:/var/lib/containers/storage/overlay/l/4Y7RGGN6EDZJEQ55P4VCSQNGT6,upperdir=/var/lib/containers/storage/overlay/fab8dcca3950e180451851e88e50a966149d55fd964e3ecb5c6c6f63b5a8b5ce/diff,workdir=/var/lib/containers/storage/overlay/fab8dcca3950e180451851e88e50a966149d55fd964e3ecb5c6c6f63b5a8b5ce/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/72db17cc2a8f8f2fe73dd3f1f370eeab26fe52222f51c484101017f52bce60ef/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/GUFHGFTAR4CUTSR7KJT7DOVIDV:/var/lib/containers/storage/overlay/l/4Y7RGGN6EDZJEQ55P4VCSQNGT6,upperdir=/var/lib/containers/storage/overlay/72db17cc2a8f8f2fe73dd3f1f370eeab26fe52222f51c484101017f52bce60ef/diff,workdir=/var/lib/containers/storage/overlay/72db17cc2a8f8f2fe73dd3f1f370eeab26fe52222f51c484101017f52bce60ef/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/b1b3ab1114d1c8b37bce4b5585d9821e46436d2b37b88f646ede532c798bd046/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/GUFHGFTAR4CUTSR7KJT7DOVIDV:/var/lib/containers/storage/overlay/l/4Y7RGGN6EDZJEQ55P4VCSQNGT6,upperdir=/var/lib/containers/storage/overlay/b1b3ab1114d1c8b37bce4b5585d9821e46436d2b37b88f646ede532c798bd046/diff,workdir=/var/lib/containers/storage/overlay/b1b3ab1114d1c8b37bce4b5585d9821e46436d2b37b88f646ede532c798bd046/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/66b1345a44b563987ac8a606e524f7ab200a5d6345f887cf32c3bc86febf3982/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/GUFHGFTAR4CUTSR7KJT7DOVIDV:/var/lib/containers/storage/overlay/l/4Y7RGGN6EDZJEQ55P4VCSQNGT6,upperdir=/var/lib/containers/storage/overlay/66b1345a44b563987ac8a606e524f7ab200a5d6345f887cf32c3bc86febf3982/diff,workdir=/var/lib/containers/storage/overlay/66b1345a44b563987ac8a606e524f7ab200a5d6345f887cf32c3bc86febf3982/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 2023-10-19T13:00:08.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T13:00:08.555 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list 2023-10-19T13:00:08.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 13:00:08 smithi157 ceph-mon[134109]: pgmap v852: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.0 KiB/s wr, 12 op/s 2023-10-19T13:00:08.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 13:00:08 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/1934502286' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-19T13:00:08.588 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 13:00:08 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/2406934290' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-10-19T13:00:08.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 13:00:08 smithi195 ceph-mon[134493]: pgmap v852: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.0 KiB/s wr, 12 op/s 2023-10-19T13:00:08.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 13:00:08 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/1934502286' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-19T13:00:08.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 13:00:08 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/2406934290' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-10-19T13:00:08.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T13:00:08.641 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link delete ceph-brx 2023-10-19T13:00:08.822 INFO:teuthology.orchestra.run.smithi046.stderr:Cannot find device "ceph-brx" 2023-10-19T13:00:08.825 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-19T13:00:08.826 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2023-10-19T13:00:08.837 INFO:tasks.cephadm:Teardown begin 2023-10-19T13:00:08.837 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-19T13:00:08.838 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-19T13:00:09.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.043+0000 7f97e75ff700 1 -- 172.21.15.46:0/4195529749 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f97e00731d0 msgr2=0x7f97e0073650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T13:00:09.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.043+0000 7f97e75ff700 1 --2- 172.21.15.46:0/4195529749 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f97e00731d0 0x7f97e0073650 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f97d0009990 tx=0x7f97d0009ca0 comp rx=0 tx=0).stop 2023-10-19T13:00:09.046 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.043+0000 7f97e75ff700 1 -- 172.21.15.46:0/4195529749 shutdown_connections 2023-10-19T13:00:09.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.043+0000 7f97e75ff700 1 --2- 172.21.15.46:0/4195529749 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97e0108630 0x7f97e010aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:09.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.043+0000 7f97e75ff700 1 --2- 172.21.15.46:0/4195529749 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f97e00747b0 0x7f97e0072c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:09.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.043+0000 7f97e75ff700 1 --2- 172.21.15.46:0/4195529749 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f97e00731d0 0x7f97e0073650 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:09.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.043+0000 7f97e75ff700 1 -- 172.21.15.46:0/4195529749 >> 172.21.15.46:0/4195529749 conn(0x7f97e00fbc90 msgr2=0x7f97e00fe0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T13:00:09.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.043+0000 7f97e75ff700 1 -- 172.21.15.46:0/4195529749 shutdown_connections 2023-10-19T13:00:09.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.043+0000 7f97e75ff700 1 -- 172.21.15.46:0/4195529749 wait complete. 2023-10-19T13:00:09.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.044+0000 7f97e75ff700 1 Processor -- start 2023-10-19T13:00:09.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.044+0000 7f97e75ff700 1 -- start start 2023-10-19T13:00:09.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.044+0000 7f97e75ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97e00731d0 0x7f97e0198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T13:00:09.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.044+0000 7f97e75ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f97e00747b0 0x7f97e0198db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T13:00:09.050 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.044+0000 7f97e75ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f97e0108630 0x7f97e019fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T13:00:09.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.044+0000 7f97e75ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97e01a03a0 con 0x7f97e00731d0 2023-10-19T13:00:09.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.044+0000 7f97e75ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97e01a04e0 con 0x7f97e0108630 2023-10-19T13:00:09.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.044+0000 7f97e75ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97e01a0670 con 0x7f97e00747b0 2023-10-19T13:00:09.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.045+0000 7f97e539b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97e00731d0 0x7f97e0198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T13:00:09.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.045+0000 7f97e539b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97e00731d0 0x7f97e0198870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51684/0 (socket says 172.21.15.46:51684) 2023-10-19T13:00:09.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.045+0000 7f97e539b700 1 -- 172.21.15.46:0/1561541253 learned_addr learned my addr 172.21.15.46:0/1561541253 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T13:00:09.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.045+0000 7f97e5b9c700 1 --2- 172.21.15.46:0/1561541253 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f97e0108630 0x7f97e019fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T13:00:09.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.045+0000 7f97e4b9a700 1 --2- 172.21.15.46:0/1561541253 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f97e00747b0 0x7f97e0198db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T13:00:09.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.045+0000 7f97e539b700 1 -- 172.21.15.46:0/1561541253 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f97e00747b0 msgr2=0x7f97e0198db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T13:00:09.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.045+0000 7f97e539b700 1 --2- 172.21.15.46:0/1561541253 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f97e00747b0 0x7f97e0198db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:09.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.045+0000 7f97e539b700 1 -- 172.21.15.46:0/1561541253 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f97e0108630 msgr2=0x7f97e019fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T13:00:09.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.045+0000 7f97e539b700 1 --2- 172.21.15.46:0/1561541253 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f97e0108630 0x7f97e019fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:09.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.045+0000 7f97e539b700 1 -- 172.21.15.46:0/1561541253 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97d00095f0 con 0x7f97e00731d0 2023-10-19T13:00:09.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.045+0000 7f97e539b700 1 --2- 172.21.15.46:0/1561541253 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97e00731d0 0x7f97e0198870 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f97dc00e9a0 tx=0x7f97dc00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T13:00:09.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.045+0000 7f97d67fc700 1 -- 172.21.15.46:0/1561541253 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97dc009790 con 0x7f97e00731d0 2023-10-19T13:00:09.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.046+0000 7f97e75ff700 1 -- 172.21.15.46:0/1561541253 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97e01a0950 con 0x7f97e00731d0 2023-10-19T13:00:09.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.046+0000 7f97d67fc700 1 -- 172.21.15.46:0/1561541253 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f97dc010430 con 0x7f97e00731d0 2023-10-19T13:00:09.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.046+0000 7f97d67fc700 1 -- 172.21.15.46:0/1561541253 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97dc018680 con 0x7f97e00731d0 2023-10-19T13:00:09.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.046+0000 7f97e75ff700 1 -- 172.21.15.46:0/1561541253 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97e01a0eb0 con 0x7f97e00731d0 2023-10-19T13:00:09.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.047+0000 7f97e75ff700 1 -- 172.21.15.46:0/1561541253 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97e0107440 con 0x7f97e00731d0 2023-10-19T13:00:09.055 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.049+0000 7f97d67fc700 1 -- 172.21.15.46:0/1561541253 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f97dc0105a0 con 0x7f97e00731d0 2023-10-19T13:00:09.056 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.050+0000 7f97d67fc700 1 --2- 172.21.15.46:0/1561541253 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f97cc0a1480 0x7f97cc0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T13:00:09.056 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.050+0000 7f97d67fc700 1 -- 172.21.15.46:0/1561541253 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f97dc014070 con 0x7f97e00731d0 2023-10-19T13:00:09.056 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.050+0000 7f97e4b9a700 1 --2- 172.21.15.46:0/1561541253 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f97cc0a1480 0x7f97cc0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T13:00:09.056 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.051+0000 7f97e4b9a700 1 --2- 172.21.15.46:0/1561541253 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f97cc0a1480 0x7f97cc0a3940 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f97d000b2e0 tx=0x7f97d000b750 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T13:00:09.057 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.053+0000 7f97d67fc700 1 -- 172.21.15.46:0/1561541253 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f97dc096700 con 0x7f97e00731d0 2023-10-19T13:00:09.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.313+0000 7f97e75ff700 1 -- 172.21.15.46:0/1561541253 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f97e0067530 con 0x7f97e00731d0 2023-10-19T13:00:09.316 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.314+0000 7f97d67fc700 1 -- 172.21.15.46:0/1561541253 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+11382 (secure 0 0 0) 0x7f97dc099d20 con 0x7f97e00731d0 2023-10-19T13:00:09.317 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T13:00:09.317 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":56,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14580,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/2235286008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":2235286008},{"type":"v1","addr":"172.21.15.46:6835","nonce":2235286008}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14592,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/339398444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":339398444},{"type":"v1","addr":"172.21.15.46:6837","nonce":339398444}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":56,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-19T12:41:18.815780+0000","modified":"2023-10-19T12:59:47.450495+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24680,"mds_1":24655,"mds_2":24643,"mds_3":24631,"mds_4":24629},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14640":{"gid":14640,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.46:6839/1655843965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":1655843965},{"type":"v1","addr":"172.21.15.46:6839","nonce":1655843965}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14652":{"gid":14652,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.46:6841/4204925553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6840","nonce":4204925553},{"type":"v1","addr":"172.21.15.46:6841","nonce":4204925553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24560":{"gid":24560,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.157:6833/1687745569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":1687745569},{"type":"v1","addr":"172.21.15.157:6833","nonce":1687745569}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24574":{"gid":24574,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.195:6833/3629933235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3629933235},{"type":"v1","addr":"172.21.15.195:6833","nonce":3629933235}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24602":{"gid":24602,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.157:6835/108432552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":108432552},{"type":"v1","addr":"172.21.15.157:6835","nonce":108432552}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24629":{"gid":24629,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":13,"addr":"172.21.15.157:6837/2629536514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6836","nonce":2629536514},{"type":"v1","addr":"172.21.15.157:6837","nonce":2629536514}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24631":{"gid":24631,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.195:6835/1406909915","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":1406909915},{"type":"v1","addr":"172.21.15.195:6835","nonce":1406909915}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24643":{"gid":24643,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":13,"addr":"172.21.15.195:6837/293916188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":293916188},{"type":"v1","addr":"172.21.15.195:6837","nonce":293916188}]},"join_fscid":-1,"export_targets":[0,1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24655":{"gid":24655,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":11,"addr":"172.21.15.195:6839/4094901934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6838","nonce":4094901934},{"type":"v1","addr":"172.21.15.195:6839","nonce":4094901934}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24680":{"gid":24680,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.157:6839/552718978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6838","nonce":552718978},{"type":"v1","addr":"172.21.15.157:6839","nonce":552718978}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-19T13:00:09.319 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.316+0000 7f97e75ff700 1 -- 172.21.15.46:0/1561541253 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f97cc0a1480 msgr2=0x7f97cc0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T13:00:09.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.316+0000 7f97e75ff700 1 --2- 172.21.15.46:0/1561541253 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f97cc0a1480 0x7f97cc0a3940 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f97d000b2e0 tx=0x7f97d000b750 comp rx=0 tx=0).stop 2023-10-19T13:00:09.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.316+0000 7f97e75ff700 1 -- 172.21.15.46:0/1561541253 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97e00731d0 msgr2=0x7f97e0198870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T13:00:09.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.316+0000 7f97e75ff700 1 --2- 172.21.15.46:0/1561541253 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97e00731d0 0x7f97e0198870 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f97dc00e9a0 tx=0x7f97dc00ecb0 comp rx=0 tx=0).stop 2023-10-19T13:00:09.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.316+0000 7f97e75ff700 1 -- 172.21.15.46:0/1561541253 shutdown_connections 2023-10-19T13:00:09.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.316+0000 7f97e75ff700 1 --2- 172.21.15.46:0/1561541253 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f97e0108630 0x7f97e019fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:09.320 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.316+0000 7f97e75ff700 1 --2- 172.21.15.46:0/1561541253 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97e00731d0 0x7f97e0198870 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:09.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.316+0000 7f97e75ff700 1 --2- 172.21.15.46:0/1561541253 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f97cc0a1480 0x7f97cc0a3940 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:09.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.316+0000 7f97e75ff700 1 --2- 172.21.15.46:0/1561541253 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f97e00747b0 0x7f97e0198db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:09.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.316+0000 7f97e75ff700 1 -- 172.21.15.46:0/1561541253 >> 172.21.15.46:0/1561541253 conn(0x7f97e00fbc90 msgr2=0x7f97e0104580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T13:00:09.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.317+0000 7f97e75ff700 1 -- 172.21.15.46:0/1561541253 shutdown_connections 2023-10-19T13:00:09.321 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.317+0000 7f97e75ff700 1 -- 172.21.15.46:0/1561541253 wait complete. 2023-10-19T13:00:09.322 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 56 2023-10-19T13:00:09.338 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-19T13:00:09.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.541+0000 7fe6cd3ff700 1 -- 172.21.15.46:0/3235370761 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe6c8100740 msgr2=0x7fe6c8100b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T13:00:09.544 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.541+0000 7fe6cd3ff700 1 --2- 172.21.15.46:0/3235370761 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe6c8100740 0x7fe6c8100b60 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe6b80099c0 tx=0x7fe6b8009cd0 comp rx=0 tx=0).stop 2023-10-19T13:00:09.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.541+0000 7fe6cd3ff700 1 -- 172.21.15.46:0/3235370761 shutdown_connections 2023-10-19T13:00:09.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.541+0000 7fe6cd3ff700 1 --2- 172.21.15.46:0/3235370761 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe6c81022d0 0x7fe6c8108b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:09.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.541+0000 7fe6cd3ff700 1 --2- 172.21.15.46:0/3235370761 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe6c8100740 0x7fe6c8100b60 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:09.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.541+0000 7fe6cd3ff700 1 --2- 172.21.15.46:0/3235370761 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe6c8101930 0x7fe6c8101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:09.545 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.541+0000 7fe6cd3ff700 1 -- 172.21.15.46:0/3235370761 >> 172.21.15.46:0/3235370761 conn(0x7fe6c80fbc90 msgr2=0x7fe6c80fe0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T13:00:09.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.541+0000 7fe6cd3ff700 1 -- 172.21.15.46:0/3235370761 shutdown_connections 2023-10-19T13:00:09.546 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.541+0000 7fe6cd3ff700 1 -- 172.21.15.46:0/3235370761 wait complete. 2023-10-19T13:00:09.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.542+0000 7fe6cd3ff700 1 Processor -- start 2023-10-19T13:00:09.548 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.542+0000 7fe6cd3ff700 1 -- start start 2023-10-19T13:00:09.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.542+0000 7fe6cd3ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe6c8100740 0x7fe6c81988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T13:00:09.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.542+0000 7fe6cd3ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe6c8101930 0x7fe6c8198de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T13:00:09.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.542+0000 7fe6cd3ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe6c81022d0 0x7fe6c819fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T13:00:09.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.542+0000 7fe6cd3ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c81a03d0 con 0x7fe6c81022d0 2023-10-19T13:00:09.549 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.542+0000 7fe6cd3ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c81a0510 con 0x7fe6c8100740 2023-10-19T13:00:09.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.542+0000 7fe6cd3ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c81a06a0 con 0x7fe6c8101930 2023-10-19T13:00:09.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.543+0000 7fe6c6ffd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe6c8100740 0x7fe6c81988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T13:00:09.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.543+0000 7fe6c77fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe6c81022d0 0x7fe6c819fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T13:00:09.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.543+0000 7fe6c6ffd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe6c8100740 0x7fe6c81988a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:47110/0 (socket says 172.21.15.46:47110) 2023-10-19T13:00:09.550 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.543+0000 7fe6c6ffd700 1 -- 172.21.15.46:0/4191276079 learned_addr learned my addr 172.21.15.46:0/4191276079 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T13:00:09.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.543+0000 7fe6c77fe700 1 --2- 172.21.15.46:0/4191276079 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe6c81022d0 0x7fe6c819fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51710/0 (socket says 172.21.15.46:51710) 2023-10-19T13:00:09.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.543+0000 7fe6c67fc700 1 --2- 172.21.15.46:0/4191276079 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe6c8101930 0x7fe6c8198de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T13:00:09.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.543+0000 7fe6c6ffd700 1 -- 172.21.15.46:0/4191276079 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe6c8101930 msgr2=0x7fe6c8198de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T13:00:09.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.543+0000 7fe6c6ffd700 1 --2- 172.21.15.46:0/4191276079 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe6c8101930 0x7fe6c8198de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:09.551 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.543+0000 7fe6c6ffd700 1 -- 172.21.15.46:0/4191276079 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe6c81022d0 msgr2=0x7fe6c819fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T13:00:09.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.543+0000 7fe6c6ffd700 1 --2- 172.21.15.46:0/4191276079 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe6c81022d0 0x7fe6c819fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:09.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.543+0000 7fe6c6ffd700 1 -- 172.21.15.46:0/4191276079 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6c0009c40 con 0x7fe6c8100740 2023-10-19T13:00:09.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.543+0000 7fe6c77fe700 1 --2- 172.21.15.46:0/4191276079 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe6c81022d0 0x7fe6c819fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T13:00:09.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.543+0000 7fe6c6ffd700 1 --2- 172.21.15.46:0/4191276079 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe6c8100740 0x7fe6c81988a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe6b80095c0 tx=0x7fe6b800f710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T13:00:09.552 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.543+0000 7fe6affff700 1 -- 172.21.15.46:0/4191276079 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b801c070 con 0x7fe6c8100740 2023-10-19T13:00:09.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.544+0000 7fe6affff700 1 -- 172.21.15.46:0/4191276079 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe6b80058e0 con 0x7fe6c8100740 2023-10-19T13:00:09.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.544+0000 7fe6cd3ff700 1 -- 172.21.15.46:0/4191276079 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6b80095f0 con 0x7fe6c8100740 2023-10-19T13:00:09.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.544+0000 7fe6affff700 1 -- 172.21.15.46:0/4191276079 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b8022bd0 con 0x7fe6c8100740 2023-10-19T13:00:09.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.544+0000 7fe6cd3ff700 1 -- 172.21.15.46:0/4191276079 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6c81a0c40 con 0x7fe6c8100740 2023-10-19T13:00:09.553 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.545+0000 7fe6cd3ff700 1 -- 172.21.15.46:0/4191276079 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6c8067530 con 0x7fe6c8100740 2023-10-19T13:00:09.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.546+0000 7fe6affff700 1 -- 172.21.15.46:0/4191276079 <== mon.2 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fe6b8020070 con 0x7fe6c8100740 2023-10-19T13:00:09.554 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.548+0000 7fe6affff700 1 --2- 172.21.15.46:0/4191276079 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fe6b00a1480 0x7fe6b00a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T13:00:09.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.548+0000 7fe6affff700 1 -- 172.21.15.46:0/4191276079 <== mon.2 v2:172.21.15.157:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7fe6b80ce160 con 0x7fe6c8100740 2023-10-19T13:00:09.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.548+0000 7fe6c67fc700 1 --2- 172.21.15.46:0/4191276079 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fe6b00a1480 0x7fe6b00a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T13:00:09.555 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.549+0000 7fe6c67fc700 1 --2- 172.21.15.46:0/4191276079 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fe6b00a1480 0x7fe6b00a3940 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc009c60 tx=0x7fe6bc009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T13:00:09.556 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.553+0000 7fe6affff700 1 -- 172.21.15.46:0/4191276079 <== mon.2 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fe6b8097540 con 0x7fe6c8100740 2023-10-19T13:00:09.817 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.814+0000 7fe6cd3ff700 1 -- 172.21.15.46:0/4191276079 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe6c810bf50 con 0x7fe6c8100740 2023-10-19T13:00:09.818 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.815+0000 7fe6affff700 1 -- 172.21.15.46:0/4191276079 <== mon.2 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+11382 (secure 0 0 0) 0x7fe6b8027090 con 0x7fe6c8100740 2023-10-19T13:00:09.818 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T13:00:09.819 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":56,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14580,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/2235286008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":2235286008},{"type":"v1","addr":"172.21.15.46:6835","nonce":2235286008}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14592,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/339398444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":339398444},{"type":"v1","addr":"172.21.15.46:6837","nonce":339398444}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":56,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-19T12:41:18.815780+0000","modified":"2023-10-19T12:59:47.450495+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24680,"mds_1":24655,"mds_2":24643,"mds_3":24631,"mds_4":24629},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14640":{"gid":14640,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.46:6839/1655843965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":1655843965},{"type":"v1","addr":"172.21.15.46:6839","nonce":1655843965}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14652":{"gid":14652,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.46:6841/4204925553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6840","nonce":4204925553},{"type":"v1","addr":"172.21.15.46:6841","nonce":4204925553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24560":{"gid":24560,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.157:6833/1687745569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":1687745569},{"type":"v1","addr":"172.21.15.157:6833","nonce":1687745569}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24574":{"gid":24574,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.195:6833/3629933235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3629933235},{"type":"v1","addr":"172.21.15.195:6833","nonce":3629933235}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24602":{"gid":24602,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.157:6835/108432552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":108432552},{"type":"v1","addr":"172.21.15.157:6835","nonce":108432552}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24629":{"gid":24629,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":13,"addr":"172.21.15.157:6837/2629536514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6836","nonce":2629536514},{"type":"v1","addr":"172.21.15.157:6837","nonce":2629536514}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24631":{"gid":24631,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":14,"addr":"172.21.15.195:6835/1406909915","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":1406909915},{"type":"v1","addr":"172.21.15.195:6835","nonce":1406909915}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24643":{"gid":24643,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":13,"addr":"172.21.15.195:6837/293916188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":293916188},{"type":"v1","addr":"172.21.15.195:6837","nonce":293916188}]},"join_fscid":-1,"export_targets":[0,1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24655":{"gid":24655,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":11,"addr":"172.21.15.195:6839/4094901934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6838","nonce":4094901934},{"type":"v1","addr":"172.21.15.195:6839","nonce":4094901934}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24680":{"gid":24680,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.157:6839/552718978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6838","nonce":552718978},{"type":"v1","addr":"172.21.15.157:6839","nonce":552718978}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-19T13:00:09.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.817+0000 7fe6cd3ff700 1 -- 172.21.15.46:0/4191276079 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fe6b00a1480 msgr2=0x7fe6b00a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T13:00:09.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.818+0000 7fe6cd3ff700 1 --2- 172.21.15.46:0/4191276079 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fe6b00a1480 0x7fe6b00a3940 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc009c60 tx=0x7fe6bc009260 comp rx=0 tx=0).stop 2023-10-19T13:00:09.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.818+0000 7fe6cd3ff700 1 -- 172.21.15.46:0/4191276079 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe6c8100740 msgr2=0x7fe6c81988a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T13:00:09.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.818+0000 7fe6cd3ff700 1 --2- 172.21.15.46:0/4191276079 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe6c8100740 0x7fe6c81988a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe6b80095c0 tx=0x7fe6b800f710 comp rx=0 tx=0).stop 2023-10-19T13:00:09.821 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.818+0000 7fe6cd3ff700 1 -- 172.21.15.46:0/4191276079 shutdown_connections 2023-10-19T13:00:09.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.818+0000 7fe6cd3ff700 1 --2- 172.21.15.46:0/4191276079 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe6c81022d0 0x7fe6c819fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:09.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.818+0000 7fe6cd3ff700 1 --2- 172.21.15.46:0/4191276079 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe6c8100740 0x7fe6c81988a0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:09.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.818+0000 7fe6cd3ff700 1 --2- 172.21.15.46:0/4191276079 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7fe6b00a1480 0x7fe6b00a3940 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:09.822 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.818+0000 7fe6cd3ff700 1 --2- 172.21.15.46:0/4191276079 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe6c8101930 0x7fe6c8198de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:09.823 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.818+0000 7fe6cd3ff700 1 -- 172.21.15.46:0/4191276079 >> 172.21.15.46:0/4191276079 conn(0x7fe6c80fbc90 msgr2=0x7fe6c81070f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T13:00:09.823 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.818+0000 7fe6cd3ff700 1 -- 172.21.15.46:0/4191276079 shutdown_connections 2023-10-19T13:00:09.823 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:09.818+0000 7fe6cd3ff700 1 -- 172.21.15.46:0/4191276079 wait complete. 2023-10-19T13:00:09.823 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 56 2023-10-19T13:00:09.840 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-19T13:00:10.047 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.044+0000 7ff0943ff700 1 -- 172.21.15.46:0/2902883795 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff08c0731f0 msgr2=0x7ff08c073670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T13:00:10.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.044+0000 7ff0943ff700 1 --2- 172.21.15.46:0/2902883795 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff08c0731f0 0x7ff08c073670 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff07c009990 tx=0x7ff07c009ca0 comp rx=0 tx=0).stop 2023-10-19T13:00:10.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.044+0000 7ff0943ff700 1 -- 172.21.15.46:0/2902883795 shutdown_connections 2023-10-19T13:00:10.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.044+0000 7ff0943ff700 1 --2- 172.21.15.46:0/2902883795 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff08c108610 0x7ff08c10aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:10.048 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.044+0000 7ff0943ff700 1 --2- 172.21.15.46:0/2902883795 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff08c0747d0 0x7ff08c072c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:10.049 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.044+0000 7ff0943ff700 1 --2- 172.21.15.46:0/2902883795 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff08c0731f0 0x7ff08c073670 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:10.049 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.044+0000 7ff0943ff700 1 -- 172.21.15.46:0/2902883795 >> 172.21.15.46:0/2902883795 conn(0x7ff08c0fbc90 msgr2=0x7ff08c0fe0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T13:00:10.049 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.044+0000 7ff0943ff700 1 -- 172.21.15.46:0/2902883795 shutdown_connections 2023-10-19T13:00:10.049 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.044+0000 7ff0943ff700 1 -- 172.21.15.46:0/2902883795 wait complete. 2023-10-19T13:00:10.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.045+0000 7ff0943ff700 1 Processor -- start 2023-10-19T13:00:10.051 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.046+0000 7ff0943ff700 1 -- start start 2023-10-19T13:00:10.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.046+0000 7ff0943ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff08c0731f0 0x7ff08c198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T13:00:10.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.046+0000 7ff0943ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff08c0747d0 0x7ff08c198e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T13:00:10.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.046+0000 7ff0943ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff08c108610 0x7ff08c19fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T13:00:10.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.046+0000 7ff0943ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff08c1a0450 con 0x7ff08c0731f0 2023-10-19T13:00:10.052 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.046+0000 7ff0943ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff08c1a0590 con 0x7ff08c108610 2023-10-19T13:00:10.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.046+0000 7ff0943ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff08c1a0720 con 0x7ff08c0747d0 2023-10-19T13:00:10.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.046+0000 7ff09299c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff08c108610 0x7ff08c19fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T13:00:10.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.046+0000 7ff09219b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff08c0731f0 0x7ff08c198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T13:00:10.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.046+0000 7ff09299c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff08c108610 0x7ff08c19fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:47118/0 (socket says 172.21.15.46:47118) 2023-10-19T13:00:10.053 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.046+0000 7ff09299c700 1 -- 172.21.15.46:0/318798081 learned_addr learned my addr 172.21.15.46:0/318798081 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T13:00:10.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.046+0000 7ff09199a700 1 --2- 172.21.15.46:0/318798081 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff08c0747d0 0x7ff08c198e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T13:00:10.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.047+0000 7ff09299c700 1 -- 172.21.15.46:0/318798081 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff08c0747d0 msgr2=0x7ff08c198e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T13:00:10.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.047+0000 7ff09299c700 1 --2- 172.21.15.46:0/318798081 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff08c0747d0 0x7ff08c198e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:10.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.047+0000 7ff09299c700 1 -- 172.21.15.46:0/318798081 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff08c0731f0 msgr2=0x7ff08c198920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T13:00:10.054 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.047+0000 7ff09299c700 1 --2- 172.21.15.46:0/318798081 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff08c0731f0 0x7ff08c198920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:10.055 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.047+0000 7ff09299c700 1 -- 172.21.15.46:0/318798081 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff084009c40 con 0x7ff08c108610 2023-10-19T13:00:10.055 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.047+0000 7ff09299c700 1 --2- 172.21.15.46:0/318798081 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff08c108610 0x7ff08c19fe80 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff08400c370 tx=0x7ff08400c680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T13:00:10.055 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.047+0000 7ff0837fe700 1 -- 172.21.15.46:0/318798081 <== mon.2 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff084017070 con 0x7ff08c108610 2023-10-19T13:00:10.055 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.047+0000 7ff0837fe700 1 -- 172.21.15.46:0/318798081 <== mon.2 v2:172.21.15.157:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff08400f040 con 0x7ff08c108610 2023-10-19T13:00:10.055 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.047+0000 7ff0943ff700 1 -- 172.21.15.46:0/318798081 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff07c0095f0 con 0x7ff08c108610 2023-10-19T13:00:10.056 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.047+0000 7ff0837fe700 1 -- 172.21.15.46:0/318798081 <== mon.2 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff08400e050 con 0x7ff08c108610 2023-10-19T13:00:10.056 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.047+0000 7ff0943ff700 1 -- 172.21.15.46:0/318798081 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff08c1a0d20 con 0x7ff08c108610 2023-10-19T13:00:10.056 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.048+0000 7ff0943ff700 1 -- 172.21.15.46:0/318798081 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff08c107420 con 0x7ff08c108610 2023-10-19T13:00:10.057 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.050+0000 7ff0837fe700 1 -- 172.21.15.46:0/318798081 <== mon.2 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7ff08400cb60 con 0x7ff08c108610 2023-10-19T13:00:10.057 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.051+0000 7ff0837fe700 1 --2- 172.21.15.46:0/318798081 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7ff0780a1500 0x7ff0780a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T13:00:10.057 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.052+0000 7ff0837fe700 1 -- 172.21.15.46:0/318798081 <== mon.2 v2:172.21.15.157:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7ff0840cca20 con 0x7ff08c108610 2023-10-19T13:00:10.057 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.052+0000 7ff09219b700 1 --2- 172.21.15.46:0/318798081 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7ff0780a1500 0x7ff0780a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T13:00:10.058 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.052+0000 7ff09219b700 1 --2- 172.21.15.46:0/318798081 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7ff0780a1500 0x7ff0780a39c0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7ff088009c60 tx=0x7ff088009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T13:00:10.058 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.055+0000 7ff0837fe700 1 -- 172.21.15.46:0/318798081 <== mon.2 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff084095c50 con 0x7ff08c108610 2023-10-19T13:00:10.228 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 13:00:09 smithi046 ceph-mon[98509]: pgmap v853: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.7 KiB/s wr, 13 op/s 2023-10-19T13:00:10.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 13:00:09 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/1561541253' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-19T13:00:10.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 13:00:09 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/4191276079' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-19T13:00:10.270 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.267+0000 7ff0943ff700 1 -- 172.21.15.46:0/318798081 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff08c067530 con 0x7ff08c108610 2023-10-19T13:00:10.272 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.269+0000 7ff0837fe700 1 -- 172.21.15.46:0/318798081 <== mon.2 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) v1 ==== 74+0+24780 (secure 0 0 0) 0x7ff084099270 con 0x7ff08c108610 2023-10-19T13:00:10.272 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-10-19T13:00:10.272 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":92,"fsid":"96a8be3c-6e7b-11ee-8db6-212e2dc638e7","created":"2023-10-19T12:33:26.148713+0000","modified":"2023-10-19T12:43:28.761367+0000","last_up_change":"2023-10-19T12:40:30.761679+0000","last_in_change":"2023-10-19T12:40:13.663559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-19T12:37:07.175795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-19T12:41:16.895203+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-19T12:41:18.255601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-19T12:41:21.830455+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"346ce86b-a10a-4869-9fdb-c3c1d4161455","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6803","nonce":500237995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6805","nonce":500237995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6809","nonce":500237995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":500237995},{"type":"v1","addr":"172.21.15.46:6807","nonce":500237995}]},"public_addr":"172.21.15.46:6803/500237995","cluster_addr":"172.21.15.46:6805/500237995","heartbeat_back_addr":"172.21.15.46:6809/500237995","heartbeat_front_addr":"172.21.15.46:6807/500237995","state":["exists","up"]},{"osd":1,"uuid":"02aae687-76c5-4124-bae4-9787ed571c28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6801","nonce":2496862790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6803","nonce":2496862790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6807","nonce":2496862790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2496862790},{"type":"v1","addr":"172.21.15.157:6805","nonce":2496862790}]},"public_addr":"172.21.15.157:6801/2496862790","cluster_addr":"172.21.15.157:6803/2496862790","heartbeat_back_addr":"172.21.15.157:6807/2496862790","heartbeat_front_addr":"172.21.15.157:6805/2496862790","state":["exists","up"]},{"osd":2,"uuid":"d5360828-1f58-4380-b2ad-0c21ff850981","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6801","nonce":4211767276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6803","nonce":4211767276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6807","nonce":4211767276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":4211767276},{"type":"v1","addr":"172.21.15.195:6805","nonce":4211767276}]},"public_addr":"172.21.15.195:6801/4211767276","cluster_addr":"172.21.15.195:6803/4211767276","heartbeat_back_addr":"172.21.15.195:6807/4211767276","heartbeat_front_addr":"172.21.15.195:6805/4211767276","state":["exists","up"]},{"osd":3,"uuid":"accb780f-49d0-43f8-b166-ee12c558ef00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6811","nonce":1964113352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6813","nonce":1964113352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6817","nonce":1964113352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":1964113352},{"type":"v1","addr":"172.21.15.46:6815","nonce":1964113352}]},"public_addr":"172.21.15.46:6811/1964113352","cluster_addr":"172.21.15.46:6813/1964113352","heartbeat_back_addr":"172.21.15.46:6817/1964113352","heartbeat_front_addr":"172.21.15.46:6815/1964113352","state":["exists","up"]},{"osd":4,"uuid":"e662886d-e989-4d02-8c1f-3c4671352b0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6809","nonce":3636910144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6811","nonce":3636910144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6815","nonce":3636910144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3636910144},{"type":"v1","addr":"172.21.15.157:6813","nonce":3636910144}]},"public_addr":"172.21.15.157:6809/3636910144","cluster_addr":"172.21.15.157:6811/3636910144","heartbeat_back_addr":"172.21.15.157:6815/3636910144","heartbeat_front_addr":"172.21.15.157:6813/3636910144","state":["exists","up"]},{"osd":5,"uuid":"9597e0ce-14ea-407d-90fe-f74bccee38b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6809","nonce":4071287969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6811","nonce":4071287969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6815","nonce":4071287969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":4071287969},{"type":"v1","addr":"172.21.15.195:6813","nonce":4071287969}]},"public_addr":"172.21.15.195:6809/4071287969","cluster_addr":"172.21.15.195:6811/4071287969","heartbeat_back_addr":"172.21.15.195:6815/4071287969","heartbeat_front_addr":"172.21.15.195:6813/4071287969","state":["exists","up"]},{"osd":6,"uuid":"6b78ba38-f60e-4cb6-b01c-cecc1820e8e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6819","nonce":1842285555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6821","nonce":1842285555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6825","nonce":1842285555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":1842285555},{"type":"v1","addr":"172.21.15.46:6823","nonce":1842285555}]},"public_addr":"172.21.15.46:6819/1842285555","cluster_addr":"172.21.15.46:6821/1842285555","heartbeat_back_addr":"172.21.15.46:6825/1842285555","heartbeat_front_addr":"172.21.15.46:6823/1842285555","state":["exists","up"]},{"osd":7,"uuid":"59a0899f-3bcd-4db2-b544-24df3a536749","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6817","nonce":3498672588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6819","nonce":3498672588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6823","nonce":3498672588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":3498672588},{"type":"v1","addr":"172.21.15.157:6821","nonce":3498672588}]},"public_addr":"172.21.15.157:6817/3498672588","cluster_addr":"172.21.15.157:6819/3498672588","heartbeat_back_addr":"172.21.15.157:6823/3498672588","heartbeat_front_addr":"172.21.15.157:6821/3498672588","state":["exists","up"]},{"osd":8,"uuid":"9c3c9835-043a-4fb5-a9ee-edf8caf6b605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6817","nonce":74230104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6819","nonce":74230104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6823","nonce":74230104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":74230104},{"type":"v1","addr":"172.21.15.195:6821","nonce":74230104}]},"public_addr":"172.21.15.195:6817/74230104","cluster_addr":"172.21.15.195:6819/74230104","heartbeat_back_addr":"172.21.15.195:6823/74230104","heartbeat_front_addr":"172.21.15.195:6821/74230104","state":["exists","up"]},{"osd":9,"uuid":"3f18f506-a577-4b7c-ae0d-9351c07e81f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6827","nonce":3472581046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6829","nonce":3472581046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6833","nonce":3472581046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":3472581046},{"type":"v1","addr":"172.21.15.46:6831","nonce":3472581046}]},"public_addr":"172.21.15.46:6827/3472581046","cluster_addr":"172.21.15.46:6829/3472581046","heartbeat_back_addr":"172.21.15.46:6833/3472581046","heartbeat_front_addr":"172.21.15.46:6831/3472581046","state":["exists","up"]},{"osd":10,"uuid":"1ed01854-443a-4acf-9293-7ca0d451a93d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6825","nonce":2378416559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6827","nonce":2378416559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6831","nonce":2378416559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":2378416559},{"type":"v1","addr":"172.21.15.157:6829","nonce":2378416559}]},"public_addr":"172.21.15.157:6825/2378416559","cluster_addr":"172.21.15.157:6827/2378416559","heartbeat_back_addr":"172.21.15.157:6831/2378416559","heartbeat_front_addr":"172.21.15.157:6829/2378416559","state":["exists","up"]},{"osd":11,"uuid":"021398c0-9184-4647-8220-e40f6705ca90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6825","nonce":3075632222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6827","nonce":3075632222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6831","nonce":3075632222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":3075632222},{"type":"v1","addr":"172.21.15.195:6829","nonce":3075632222}]},"public_addr":"172.21.15.195:6825/3075632222","cluster_addr":"172.21.15.195:6827/3075632222","heartbeat_back_addr":"172.21.15.195:6831/3075632222","heartbeat_front_addr":"172.21.15.195:6829/3075632222","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:36:22.002614+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:36:44.098031+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:37:04.518341+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:37:30.796462+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:37:52.756555+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:38:13.403168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:38:39.058472+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:39:01.106893+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:39:21.908334+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:39:46.843884+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:40:08.792020+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T12:40:29.282974+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":7}]},{"pgid":"3.1b","mappings":[{"from":3,"to":6},{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.39","mappings":[{"from":5,"to":8}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]},{"pgid":"4.6","mappings":[{"from":5,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.46:0/3248595150":"2023-10-20T12:34:26.552115+0000","172.21.15.46:0/3624849341":"2023-10-20T12:34:26.552115+0000","172.21.15.46:0/1844094590":"2023-10-20T12:34:26.552115+0000","172.21.15.46:6801/20022894":"2023-10-20T12:34:26.552115+0000","172.21.15.46:0/3969790632":"2023-10-20T12:34:00.135248+0000","172.21.15.46:0/2331135821":"2023-10-20T12:34:00.135248+0000","172.21.15.46:6800/51664346":"2023-10-20T12:34:00.135248+0000","172.21.15.46:6801/51664346":"2023-10-20T12:34:00.135248+0000","172.21.15.46:0/585851467":"2023-10-20T12:34:00.135248+0000","172.21.15.46:6800/20022894":"2023-10-20T12:34:26.552115+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-19T13:00:10.274 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.271+0000 7ff0943ff700 1 -- 172.21.15.46:0/318798081 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7ff0780a1500 msgr2=0x7ff0780a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T13:00:10.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.271+0000 7ff0943ff700 1 --2- 172.21.15.46:0/318798081 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7ff0780a1500 0x7ff0780a39c0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7ff088009c60 tx=0x7ff088009260 comp rx=0 tx=0).stop 2023-10-19T13:00:10.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.271+0000 7ff0943ff700 1 -- 172.21.15.46:0/318798081 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff08c108610 msgr2=0x7ff08c19fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T13:00:10.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.271+0000 7ff0943ff700 1 --2- 172.21.15.46:0/318798081 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff08c108610 0x7ff08c19fe80 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff08400c370 tx=0x7ff08400c680 comp rx=0 tx=0).stop 2023-10-19T13:00:10.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.271+0000 7ff0943ff700 1 -- 172.21.15.46:0/318798081 shutdown_connections 2023-10-19T13:00:10.275 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.271+0000 7ff0943ff700 1 --2- 172.21.15.46:0/318798081 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff08c108610 0x7ff08c19fe80 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:10.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.271+0000 7ff0943ff700 1 --2- 172.21.15.46:0/318798081 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff08c0731f0 0x7ff08c198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:10.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.271+0000 7ff0943ff700 1 --2- 172.21.15.46:0/318798081 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7ff0780a1500 0x7ff0780a39c0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:10.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.271+0000 7ff0943ff700 1 --2- 172.21.15.46:0/318798081 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff08c0747d0 0x7ff08c198e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:10.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.271+0000 7ff0943ff700 1 -- 172.21.15.46:0/318798081 >> 172.21.15.46:0/318798081 conn(0x7ff08c0fbc90 msgr2=0x7ff08c104560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T13:00:10.276 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.271+0000 7ff0943ff700 1 -- 172.21.15.46:0/318798081 shutdown_connections 2023-10-19T13:00:10.277 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.271+0000 7ff0943ff700 1 -- 172.21.15.46:0/318798081 wait complete. 2023-10-19T13:00:10.293 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-19T13:00:10.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 13:00:09 smithi157 ceph-mon[134109]: pgmap v853: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.7 KiB/s wr, 13 op/s 2023-10-19T13:00:10.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 13:00:09 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/1561541253' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-19T13:00:10.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 13:00:09 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/4191276079' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-19T13:00:10.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 13:00:09 smithi195 ceph-mon[134493]: pgmap v853: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.7 KiB/s wr, 13 op/s 2023-10-19T13:00:10.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 13:00:09 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/1561541253' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-19T13:00:10.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 13:00:09 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/4191276079' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-19T13:00:10.501 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.498+0000 7f36f85ff700 1 -- 172.21.15.46:0/260011592 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f36f0101910 msgr2=0x7f36f0101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T13:00:10.501 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.498+0000 7f36f85ff700 1 --2- 172.21.15.46:0/260011592 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f36f0101910 0x7f36f0101d70 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f36e00099c0 tx=0x7f36e0009cd0 comp rx=0 tx=0).stop 2023-10-19T13:00:10.502 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.498+0000 7f36f85ff700 1 -- 172.21.15.46:0/260011592 shutdown_connections 2023-10-19T13:00:10.502 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.498+0000 7f36f85ff700 1 --2- 172.21.15.46:0/260011592 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f36f01022b0 0x7f36f0108b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:10.502 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.498+0000 7f36f85ff700 1 --2- 172.21.15.46:0/260011592 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36f0100720 0x7f36f0100b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:10.502 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.498+0000 7f36f85ff700 1 --2- 172.21.15.46:0/260011592 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f36f0101910 0x7f36f0101d70 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:10.503 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.498+0000 7f36f85ff700 1 -- 172.21.15.46:0/260011592 >> 172.21.15.46:0/260011592 conn(0x7f36f00fbc90 msgr2=0x7f36f00fe0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T13:00:10.503 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.498+0000 7f36f85ff700 1 -- 172.21.15.46:0/260011592 shutdown_connections 2023-10-19T13:00:10.503 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.498+0000 7f36f85ff700 1 -- 172.21.15.46:0/260011592 wait complete. 2023-10-19T13:00:10.505 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.499+0000 7f36f85ff700 1 Processor -- start 2023-10-19T13:00:10.505 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.499+0000 7f36f85ff700 1 -- start start 2023-10-19T13:00:10.505 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.499+0000 7f36f85ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36f0100720 0x7f36f0198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T13:00:10.506 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.499+0000 7f36f85ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f36f0101910 0x7f36f0198e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T13:00:10.506 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.499+0000 7f36f85ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f36f01022b0 0x7f36f019fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T13:00:10.506 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.500+0000 7f36f85ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36f01a03e0 con 0x7f36f0100720 2023-10-19T13:00:10.506 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.500+0000 7f36f85ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36f01a0520 con 0x7f36f0101910 2023-10-19T13:00:10.506 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.500+0000 7f36f85ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36f01a06b0 con 0x7f36f01022b0 2023-10-19T13:00:10.507 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.500+0000 7f36f639b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36f0100720 0x7f36f0198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T13:00:10.507 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.500+0000 7f36f5b9a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f36f0101910 0x7f36f0198e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T13:00:10.507 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.500+0000 7f36f5b9a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f36f0101910 0x7f36f0198e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:47136/0 (socket says 172.21.15.46:47136) 2023-10-19T13:00:10.507 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.500+0000 7f36f5b9a700 1 -- 172.21.15.46:0/3035519015 learned_addr learned my addr 172.21.15.46:0/3035519015 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T13:00:10.507 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.500+0000 7f36f6b9c700 1 --2- 172.21.15.46:0/3035519015 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f36f01022b0 0x7f36f019fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T13:00:10.508 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.500+0000 7f36f639b700 1 -- 172.21.15.46:0/3035519015 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f36f01022b0 msgr2=0x7f36f019fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T13:00:10.508 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.500+0000 7f36f639b700 1 --2- 172.21.15.46:0/3035519015 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f36f01022b0 0x7f36f019fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:10.508 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.500+0000 7f36f639b700 1 -- 172.21.15.46:0/3035519015 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f36f0101910 msgr2=0x7f36f0198e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T13:00:10.508 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.500+0000 7f36f639b700 1 --2- 172.21.15.46:0/3035519015 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f36f0101910 0x7f36f0198e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:10.508 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.500+0000 7f36f639b700 1 -- 172.21.15.46:0/3035519015 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36e00095f0 con 0x7f36f0100720 2023-10-19T13:00:10.509 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.500+0000 7f36f6b9c700 1 --2- 172.21.15.46:0/3035519015 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f36f01022b0 0x7f36f019fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T13:00:10.509 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.500+0000 7f36f639b700 1 --2- 172.21.15.46:0/3035519015 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36f0100720 0x7f36f0198900 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f36ec00e9c0 tx=0x7f36ec00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T13:00:10.509 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.501+0000 7f36e77fe700 1 -- 172.21.15.46:0/3035519015 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ec00cbd0 con 0x7f36f0100720 2023-10-19T13:00:10.509 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.501+0000 7f36e77fe700 1 -- 172.21.15.46:0/3035519015 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f36ec00eeb0 con 0x7f36f0100720 2023-10-19T13:00:10.509 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.501+0000 7f36f85ff700 1 -- 172.21.15.46:0/3035519015 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36f01a0990 con 0x7f36f0100720 2023-10-19T13:00:10.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.501+0000 7f36e77fe700 1 -- 172.21.15.46:0/3035519015 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ec003c70 con 0x7f36f0100720 2023-10-19T13:00:10.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.501+0000 7f36f85ff700 1 -- 172.21.15.46:0/3035519015 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36f01a0ef0 con 0x7f36f0100720 2023-10-19T13:00:10.510 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.502+0000 7f36f85ff700 1 -- 172.21.15.46:0/3035519015 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36f0067530 con 0x7f36f0100720 2023-10-19T13:00:10.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.504+0000 7f36e77fe700 1 -- 172.21.15.46:0/3035519015 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f36ec003dd0 con 0x7f36f0100720 2023-10-19T13:00:10.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.505+0000 7f36e77fe700 1 --2- 172.21.15.46:0/3035519015 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f36dc0a1500 0x7f36dc0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T13:00:10.511 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.505+0000 7f36e77fe700 1 -- 172.21.15.46:0/3035519015 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9202+0+0 (secure 0 0 0) 0x7f36ec014070 con 0x7f36f0100720 2023-10-19T13:00:10.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.505+0000 7f36f5b9a700 1 --2- 172.21.15.46:0/3035519015 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f36dc0a1500 0x7f36dc0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T13:00:10.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.506+0000 7f36f5b9a700 1 --2- 172.21.15.46:0/3035519015 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f36dc0a1500 0x7f36dc0a39c0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f36e0005b00 tx=0x7f36e0005a90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T13:00:10.512 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.509+0000 7f36e77fe700 1 -- 172.21.15.46:0/3035519015 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f36ec0965f0 con 0x7f36f0100720 2023-10-19T13:00:10.773 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.771+0000 7f36f85ff700 1 -- 172.21.15.46:0/3035519015 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f36f010bf90 con 0x7f36f0100720 2023-10-19T13:00:10.776 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.773+0000 7f36e77fe700 1 -- 172.21.15.46:0/3035519015 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v57) v1 ==== 161+0+0 (secure 0 0 0) 0x7f36ec099c10 con 0x7f36f0100720 2023-10-19T13:00:10.779 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.776+0000 7f36f85ff700 1 -- 172.21.15.46:0/3035519015 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f36dc0a1500 msgr2=0x7f36dc0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T13:00:10.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.776+0000 7f36f85ff700 1 --2- 172.21.15.46:0/3035519015 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f36dc0a1500 0x7f36dc0a39c0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f36e0005b00 tx=0x7f36e0005a90 comp rx=0 tx=0).stop 2023-10-19T13:00:10.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.776+0000 7f36f85ff700 1 -- 172.21.15.46:0/3035519015 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36f0100720 msgr2=0x7f36f0198900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T13:00:10.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.776+0000 7f36f85ff700 1 --2- 172.21.15.46:0/3035519015 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36f0100720 0x7f36f0198900 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f36ec00e9c0 tx=0x7f36ec00ecd0 comp rx=0 tx=0).stop 2023-10-19T13:00:10.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.776+0000 7f36f85ff700 1 -- 172.21.15.46:0/3035519015 shutdown_connections 2023-10-19T13:00:10.780 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.776+0000 7f36f85ff700 1 --2- 172.21.15.46:0/3035519015 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f36dc0a1500 0x7f36dc0a39c0 secure :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f36e0005b00 tx=0x7f36e0005a90 comp rx=0 tx=0).stop 2023-10-19T13:00:10.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.776+0000 7f36f85ff700 1 --2- 172.21.15.46:0/3035519015 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f36f01022b0 0x7f36f019fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:10.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.776+0000 7f36f85ff700 1 --2- 172.21.15.46:0/3035519015 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36f0100720 0x7f36f0198900 secure :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f36ec00e9c0 tx=0x7f36ec00ecd0 comp rx=0 tx=0).stop 2023-10-19T13:00:10.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.776+0000 7f36f85ff700 1 --2- 172.21.15.46:0/3035519015 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f36f0101910 0x7f36f0198e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:10.781 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.776+0000 7f36f85ff700 1 -- 172.21.15.46:0/3035519015 >> 172.21.15.46:0/3035519015 conn(0x7f36f00fbc90 msgr2=0x7f36f01070e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T13:00:10.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.778+0000 7f36f85ff700 1 -- 172.21.15.46:0/3035519015 shutdown_connections 2023-10-19T13:00:10.782 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:10.778+0000 7f36f85ff700 1 -- 172.21.15.46:0/3035519015 wait complete. 2023-10-19T13:00:10.782 INFO:teuthology.orchestra.run.smithi046.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-19T13:00:10.801 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-19T13:00:11.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:11.026+0000 7f900c3ff700 1 -- 172.21.15.46:0/67679777 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9004101990 msgr2=0x7f9004101df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T13:00:11.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:11.026+0000 7f900c3ff700 1 --2- 172.21.15.46:0/67679777 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9004101990 0x7f9004101df0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f8ff40099c0 tx=0x7f8ff4009cd0 comp rx=0 tx=0).stop 2023-10-19T13:00:11.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:11.026+0000 7f900c3ff700 1 -- 172.21.15.46:0/67679777 shutdown_connections 2023-10-19T13:00:11.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:11.026+0000 7f900c3ff700 1 --2- 172.21.15.46:0/67679777 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9004102330 0x7f9004108be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:11.030 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:11.026+0000 7f900c3ff700 1 --2- 172.21.15.46:0/67679777 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f90041007a0 0x7f9004100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:11.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:11.026+0000 7f900c3ff700 1 --2- 172.21.15.46:0/67679777 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9004101990 0x7f9004101df0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:11.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:11.026+0000 7f900c3ff700 1 -- 172.21.15.46:0/67679777 >> 172.21.15.46:0/67679777 conn(0x7f90040fbcf0 msgr2=0x7f90040fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T13:00:11.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:11.026+0000 7f900c3ff700 1 -- 172.21.15.46:0/67679777 shutdown_connections 2023-10-19T13:00:11.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:11.026+0000 7f900c3ff700 1 -- 172.21.15.46:0/67679777 wait complete. 2023-10-19T13:00:11.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:11.027+0000 7f900c3ff700 1 Processor -- start 2023-10-19T13:00:11.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:11.027+0000 7f900c3ff700 1 -- start start 2023-10-19T13:00:11.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:11.028+0000 7f900c3ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f90041007a0 0x7f90041988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T13:00:11.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:11.028+0000 7f900c3ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9004101990 0x7f9004198e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T13:00:11.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:11.028+0000 7f900c3ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9004102330 0x7f900419fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T13:00:11.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:11.028+0000 7f900c3ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90041a0420 con 0x7f90041007a0 2023-10-19T13:00:11.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:11.028+0000 7f900c3ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90041a0560 con 0x7f9004102330 2023-10-19T13:00:11.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:11.028+0000 7f900c3ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90041a06f0 con 0x7f9004101990 2023-10-19T13:00:11.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:11.028+0000 7f900a19b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f90041007a0 0x7f90041988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T13:00:11.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:11.028+0000 7f900a19b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f90041007a0 0x7f90041988f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51792/0 (socket says 172.21.15.46:51792) 2023-10-19T13:00:11.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:11.028+0000 7f900a19b700 1 -- 172.21.15.46:0/2518012780 learned_addr learned my addr 172.21.15.46:0/2518012780 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T13:00:11.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:11.028+0000 7f900a99c700 1 --2- 172.21.15.46:0/2518012780 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9004102330 0x7f900419fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T13:00:11.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:11.028+0000 7f900999a700 1 --2- 172.21.15.46:0/2518012780 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9004101990 0x7f9004198e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T13:00:11.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:11.028+0000 7f900a19b700 1 -- 172.21.15.46:0/2518012780 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9004101990 msgr2=0x7f9004198e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T13:00:11.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:11.029+0000 7f900a19b700 1 --2- 172.21.15.46:0/2518012780 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9004101990 0x7f9004198e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:11.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:11.029+0000 7f900a19b700 1 -- 172.21.15.46:0/2518012780 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9004102330 msgr2=0x7f900419fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T13:00:11.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:11.029+0000 7f900a19b700 1 --2- 172.21.15.46:0/2518012780 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9004102330 0x7f900419fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:11.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:11.029+0000 7f900a19b700 1 -- 172.21.15.46:0/2518012780 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9000009520 con 0x7f90041007a0 2023-10-19T13:00:11.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:11.029+0000 7f900a99c700 1 --2- 172.21.15.46:0/2518012780 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9004102330 0x7f900419fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T13:00:11.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:11.029+0000 7f900a19b700 1 --2- 172.21.15.46:0/2518012780 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f90041007a0 0x7f90041988f0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f900000ea50 tx=0x7f900000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T13:00:11.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:11.029+0000 7f8ffb7fe700 1 -- 172.21.15.46:0/2518012780 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f900000cbd0 con 0x7f90041007a0 2023-10-19T13:00:11.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:11.029+0000 7f8ffb7fe700 1 -- 172.21.15.46:0/2518012780 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f900000cd30 con 0x7f90041007a0 2023-10-19T13:00:11.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:11.029+0000 7f8ffb7fe700 1 -- 172.21.15.46:0/2518012780 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9000018680 con 0x7f90041007a0 2023-10-19T13:00:11.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:11.029+0000 7f900c3ff700 1 -- 172.21.15.46:0/2518012780 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ff40095f0 con 0x7f90041007a0 2023-10-19T13:00:11.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:11.029+0000 7f900c3ff700 1 -- 172.21.15.46:0/2518012780 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90041a0d00 con 0x7f90041007a0 2023-10-19T13:00:11.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:11.030+0000 7f900c3ff700 1 -- 172.21.15.46:0/2518012780 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90040675a0 con 0x7f90041007a0 2023-10-19T13:00:11.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:11.032+0000 7f8ffb7fe700 1 -- 172.21.15.46:0/2518012780 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f9000010430 con 0x7f90041007a0 2023-10-19T13:00:11.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:11.034+0000 7f8ffb7fe700 1 --2- 172.21.15.46:0/2518012780 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f8ff00a1480 0x7f8ff00a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T13:00:11.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:11.034+0000 7f8ffb7fe700 1 -- 172.21.15.46:0/2518012780 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9632+0+0 (secure 0 0 0) 0x7f9000014070 con 0x7f90041007a0 2023-10-19T13:00:11.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:11.034+0000 7f900999a700 1 --2- 172.21.15.46:0/2518012780 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f8ff00a1480 0x7f8ff00a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T13:00:11.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:11.035+0000 7f900999a700 1 --2- 172.21.15.46:0/2518012780 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f8ff00a1480 0x7f8ff00a3940 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f8ff4006010 tx=0x7f8ff400b540 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T13:00:11.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:11.038+0000 7f8ffb7fe700 1 -- 172.21.15.46:0/2518012780 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f9000096800 con 0x7f90041007a0 2023-10-19T13:00:11.130 INFO:journalctl@ceph.mds.i.smithi195.stdout:Oct 19 13:00:10 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mds-i[172086]: ignoring --setuser ceph since I am not root 2023-10-19T13:00:11.130 INFO:journalctl@ceph.mds.i.smithi195.stdout:Oct 19 13:00:10 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mds-i[172086]: ignoring --setgroup ceph since I am not root 2023-10-19T13:00:11.131 INFO:journalctl@ceph.mds.i.smithi195.stdout:Oct 19 13:00:10 smithi195 ceph-mds[172111]: -- 172.21.15.195:0/3663944940 <== mon.1 v2:172.21.15.195:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5598117f71e0 con 0x5598117cc800 2023-10-19T13:00:11.131 INFO:journalctl@ceph.mds.i.smithi195.stdout:Oct 19 13:00:10 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mds-i[172086]: starting mds.i at 2023-10-19T13:00:11.131 INFO:journalctl@ceph.mds.l.smithi195.stdout:Oct 19 13:00:10 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mds-l[171056]: ignoring --setuser ceph since I am not root 2023-10-19T13:00:11.132 INFO:journalctl@ceph.mds.l.smithi195.stdout:Oct 19 13:00:10 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mds-l[171056]: ignoring --setgroup ceph since I am not root 2023-10-19T13:00:11.132 INFO:journalctl@ceph.mds.l.smithi195.stdout:Oct 19 13:00:10 smithi195 ceph-mds[171081]: -- 172.21.15.195:0/1246735038 <== mon.1 v2:172.21.15.195:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55b3998c11e0 con 0x55b399896800 2023-10-19T13:00:11.132 INFO:journalctl@ceph.mds.l.smithi195.stdout:Oct 19 13:00:10 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mds-l[171056]: starting mds.l at 2023-10-19T13:00:11.132 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 13:00:10 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/318798081' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-19T13:00:11.133 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 13:00:10 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/3035519015' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2023-10-19T13:00:11.133 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 13:00:10 smithi195 ceph-mon[134493]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2023-10-19T13:00:11.133 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 13:00:10 smithi195 ceph-mon[134493]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-19T13:00:11.133 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 13:00:10 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/3035519015' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2023-10-19T13:00:11.133 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 13:00:10 smithi195 ceph-mon[134493]: osdmap e93: 12 total, 12 up, 12 in 2023-10-19T13:00:11.133 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 13:00:10 smithi195 ceph-mon[134493]: fsmap cephfs:0/5 2 up:standby, 5 failed 2023-10-19T13:00:11.134 INFO:journalctl@ceph.mds.c.smithi195.stdout:Oct 19 13:00:10 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mds-c[171737]: ignoring --setuser ceph since I am not root 2023-10-19T13:00:11.134 INFO:journalctl@ceph.mds.c.smithi195.stdout:Oct 19 13:00:10 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mds-c[171737]: ignoring --setgroup ceph since I am not root 2023-10-19T13:00:11.134 INFO:journalctl@ceph.mds.c.smithi195.stdout:Oct 19 13:00:10 smithi195 ceph-mds[171761]: -- 172.21.15.195:0/3935486342 <== mon.1 v2:172.21.15.195:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5555f1c6b1e0 con 0x5555f1c41000 2023-10-19T13:00:11.135 INFO:journalctl@ceph.mds.c.smithi195.stdout:Oct 19 13:00:10 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mds-c[171737]: starting mds.c at 2023-10-19T13:00:11.135 INFO:journalctl@ceph.mds.f.smithi195.stdout:Oct 19 13:00:10 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mds-f[171398]: ignoring --setuser ceph since I am not root 2023-10-19T13:00:11.135 INFO:journalctl@ceph.mds.f.smithi195.stdout:Oct 19 13:00:10 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mds-f[171398]: ignoring --setgroup ceph since I am not root 2023-10-19T13:00:11.135 INFO:journalctl@ceph.mds.f.smithi195.stdout:Oct 19 13:00:10 smithi195 ceph-mds[171422]: -- 172.21.15.195:0/3342541645 <== mon.1 v2:172.21.15.195:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x557ddebdb1e0 con 0x557ddebb1000 2023-10-19T13:00:11.135 INFO:journalctl@ceph.mds.f.smithi195.stdout:Oct 19 13:00:10 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mds-f[171398]: starting mds.f at 2023-10-19T13:00:11.229 INFO:journalctl@ceph.mds.a.smithi046.stdout:Oct 19 13:00:10 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mds-a[150002]: ignoring --setuser ceph since I am not root 2023-10-19T13:00:11.229 INFO:journalctl@ceph.mds.a.smithi046.stdout:Oct 19 13:00:10 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mds-a[150002]: ignoring --setgroup ceph since I am not root 2023-10-19T13:00:11.229 INFO:journalctl@ceph.mds.a.smithi046.stdout:Oct 19 13:00:10 smithi046 ceph-mds[150026]: -- 172.21.15.46:0/3679636055 <== mon.2 v2:172.21.15.157:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5608e04fb1e0 con 0x5608e04d3000 2023-10-19T13:00:11.229 INFO:journalctl@ceph.mds.a.smithi046.stdout:Oct 19 13:00:10 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mds-a[150002]: starting mds.a at 2023-10-19T13:00:11.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 13:00:10 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mon-a[98485]: 2023-10-19T13:00:10.771+0000 7fb3f2c5b700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-19T13:00:11.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 13:00:10 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/318798081' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-19T13:00:11.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 13:00:10 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/3035519015' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2023-10-19T13:00:11.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 13:00:10 smithi046 ceph-mon[98509]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2023-10-19T13:00:11.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 13:00:10 smithi046 ceph-mon[98509]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-19T13:00:11.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 13:00:10 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/3035519015' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2023-10-19T13:00:11.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 13:00:10 smithi046 ceph-mon[98509]: osdmap e93: 12 total, 12 up, 12 in 2023-10-19T13:00:11.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 13:00:10 smithi046 ceph-mon[98509]: fsmap cephfs:0/5 2 up:standby, 5 failed 2023-10-19T13:00:11.231 INFO:journalctl@ceph.mds.g.smithi046.stdout:Oct 19 13:00:10 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mds-g[149610]: ignoring --setuser ceph since I am not root 2023-10-19T13:00:11.232 INFO:journalctl@ceph.mds.g.smithi046.stdout:Oct 19 13:00:10 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mds-g[149610]: ignoring --setgroup ceph since I am not root 2023-10-19T13:00:11.232 INFO:journalctl@ceph.mds.g.smithi046.stdout:Oct 19 13:00:10 smithi046 ceph-mds[149634]: -- 172.21.15.46:0/2492348837 <== mon.2 v2:172.21.15.157:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5607566231e0 con 0x5607565fa800 2023-10-19T13:00:11.232 INFO:journalctl@ceph.mds.g.smithi046.stdout:Oct 19 13:00:10 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mds-g[149610]: starting mds.g at 2023-10-19T13:00:11.301 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:11.298+0000 7f900c3ff700 1 -- 172.21.15.46:0/2518012780 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f90041a0ff0 con 0x7f90041007a0 2023-10-19T13:00:11.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 13:00:10 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/318798081' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-19T13:00:11.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 13:00:10 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/3035519015' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2023-10-19T13:00:11.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 13:00:10 smithi157 ceph-mon[134109]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2023-10-19T13:00:11.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 13:00:10 smithi157 ceph-mon[134109]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-19T13:00:11.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 13:00:10 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/3035519015' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2023-10-19T13:00:11.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 13:00:10 smithi157 ceph-mon[134109]: osdmap e93: 12 total, 12 up, 12 in 2023-10-19T13:00:11.339 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 13:00:10 smithi157 ceph-mon[134109]: fsmap cephfs:0/5 2 up:standby, 5 failed 2023-10-19T13:00:11.339 INFO:journalctl@ceph.mds.b.smithi157.stdout:Oct 19 13:00:10 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mds-b[170841]: ignoring --setuser ceph since I am not root 2023-10-19T13:00:11.339 INFO:journalctl@ceph.mds.b.smithi157.stdout:Oct 19 13:00:10 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mds-b[170841]: ignoring --setgroup ceph since I am not root 2023-10-19T13:00:11.339 INFO:journalctl@ceph.mds.b.smithi157.stdout:Oct 19 13:00:10 smithi157 ceph-mds[170865]: -- 172.21.15.157:0/789885064 <== mon.1 v2:172.21.15.195:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55a798a6b1e0 con 0x55a798a40800 2023-10-19T13:00:11.340 INFO:journalctl@ceph.mds.b.smithi157.stdout:Oct 19 13:00:10 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mds-b[170841]: starting mds.b at 2023-10-19T13:00:11.340 INFO:journalctl@ceph.mds.e.smithi157.stdout:Oct 19 13:00:10 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mds-e[170160]: ignoring --setuser ceph since I am not root 2023-10-19T13:00:11.340 INFO:journalctl@ceph.mds.e.smithi157.stdout:Oct 19 13:00:10 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mds-e[170160]: ignoring --setgroup ceph since I am not root 2023-10-19T13:00:11.340 INFO:journalctl@ceph.mds.e.smithi157.stdout:Oct 19 13:00:10 smithi157 ceph-mds[170184]: -- 172.21.15.157:0/915578913 <== mon.2 v2:172.21.15.157:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x556c57be51e0 con 0x556c57bbb000 2023-10-19T13:00:11.341 INFO:journalctl@ceph.mds.e.smithi157.stdout:Oct 19 13:00:10 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mds-e[170160]: starting mds.e at 2023-10-19T13:00:11.341 INFO:journalctl@ceph.mds.h.smithi157.stdout:Oct 19 13:00:10 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mds-h[170501]: ignoring --setuser ceph since I am not root 2023-10-19T13:00:11.341 INFO:journalctl@ceph.mds.h.smithi157.stdout:Oct 19 13:00:10 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mds-h[170501]: ignoring --setgroup ceph since I am not root 2023-10-19T13:00:11.342 INFO:journalctl@ceph.mds.h.smithi157.stdout:Oct 19 13:00:10 smithi157 ceph-mds[170525]: -- 172.21.15.157:0/2498677617 <== mon.1 v2:172.21.15.195:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5593e8cb91e0 con 0x5593e8c8ec00 2023-10-19T13:00:11.342 INFO:journalctl@ceph.mds.h.smithi157.stdout:Oct 19 13:00:10 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mds-h[170501]: starting mds.h at 2023-10-19T13:00:11.342 INFO:journalctl@ceph.mds.k.smithi157.stdout:Oct 19 13:00:10 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mds-k[169815]: ignoring --setuser ceph since I am not root 2023-10-19T13:00:11.342 INFO:journalctl@ceph.mds.k.smithi157.stdout:Oct 19 13:00:10 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mds-k[169815]: ignoring --setgroup ceph since I am not root 2023-10-19T13:00:11.342 INFO:journalctl@ceph.mds.k.smithi157.stdout:Oct 19 13:00:10 smithi157 ceph-mds[169839]: -- 172.21.15.157:0/3646768811 <== mon.2 v2:172.21.15.157:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x560c54a071e0 con 0x560c549dc800 2023-10-19T13:00:11.343 INFO:journalctl@ceph.mds.k.smithi157.stdout:Oct 19 13:00:10 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mds-k[169815]: starting mds.k at 2023-10-19T13:00:11.778 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:11.775+0000 7f8ffb7fe700 1 -- 172.21.15.46:0/2518012780 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v58) v1 ==== 104+0+0 (secure 0 0 0) 0x7f9000099e20 con 0x7f90041007a0 2023-10-19T13:00:11.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:11.780+0000 7f900c3ff700 1 -- 172.21.15.46:0/2518012780 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f8ff00a1480 msgr2=0x7f8ff00a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T13:00:11.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:11.780+0000 7f900c3ff700 1 --2- 172.21.15.46:0/2518012780 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f8ff00a1480 0x7f8ff00a3940 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f8ff4006010 tx=0x7f8ff400b540 comp rx=0 tx=0).stop 2023-10-19T13:00:11.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:11.780+0000 7f900c3ff700 1 -- 172.21.15.46:0/2518012780 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f90041007a0 msgr2=0x7f90041988f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T13:00:11.783 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:11.780+0000 7f900c3ff700 1 --2- 172.21.15.46:0/2518012780 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f90041007a0 0x7f90041988f0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f900000ea50 tx=0x7f900000ed60 comp rx=0 tx=0).stop 2023-10-19T13:00:11.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:11.780+0000 7f900c3ff700 1 -- 172.21.15.46:0/2518012780 shutdown_connections 2023-10-19T13:00:11.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:11.780+0000 7f900c3ff700 1 --2- 172.21.15.46:0/2518012780 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9004102330 0x7f900419fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:11.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:11.780+0000 7f900c3ff700 1 --2- 172.21.15.46:0/2518012780 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f90041007a0 0x7f90041988f0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:11.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:11.780+0000 7f900c3ff700 1 --2- 172.21.15.46:0/2518012780 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f8ff00a1480 0x7f8ff00a3940 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:11.784 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:11.780+0000 7f900c3ff700 1 --2- 172.21.15.46:0/2518012780 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9004101990 0x7f9004198e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:11.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:11.780+0000 7f900c3ff700 1 -- 172.21.15.46:0/2518012780 >> 172.21.15.46:0/2518012780 conn(0x7f90040fbcf0 msgr2=0x7f90041071b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T13:00:11.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:11.780+0000 7f900c3ff700 1 -- 172.21.15.46:0/2518012780 shutdown_connections 2023-10-19T13:00:11.785 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:11.780+0000 7f900c3ff700 1 -- 172.21.15.46:0/2518012780 wait complete. 2023-10-19T13:00:11.809 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-19T13:00:12.026 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:12.023+0000 7f17cf9ff700 1 -- 172.21.15.46:0/3479469865 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17c81007a0 msgr2=0x7f17c8100bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T13:00:12.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:12.023+0000 7f17cf9ff700 1 --2- 172.21.15.46:0/3479469865 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17c81007a0 0x7f17c8100bc0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f17c40099c0 tx=0x7f17c4009cd0 comp rx=0 tx=0).stop 2023-10-19T13:00:12.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:12.023+0000 7f17cf9ff700 1 -- 172.21.15.46:0/3479469865 shutdown_connections 2023-10-19T13:00:12.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:12.023+0000 7f17cf9ff700 1 --2- 172.21.15.46:0/3479469865 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f17c8102330 0x7f17c8108be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:12.027 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:12.023+0000 7f17cf9ff700 1 --2- 172.21.15.46:0/3479469865 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17c81007a0 0x7f17c8100bc0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:12.028 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:12.023+0000 7f17cf9ff700 1 --2- 172.21.15.46:0/3479469865 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f17c8101990 0x7f17c8101df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:12.028 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:12.023+0000 7f17cf9ff700 1 -- 172.21.15.46:0/3479469865 >> 172.21.15.46:0/3479469865 conn(0x7f17c80fbcf0 msgr2=0x7f17c80fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T13:00:12.028 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:12.023+0000 7f17cf9ff700 1 -- 172.21.15.46:0/3479469865 shutdown_connections 2023-10-19T13:00:12.029 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:12.023+0000 7f17cf9ff700 1 -- 172.21.15.46:0/3479469865 wait complete. 2023-10-19T13:00:12.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:12.024+0000 7f17cf9ff700 1 Processor -- start 2023-10-19T13:00:12.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:12.024+0000 7f17cf9ff700 1 -- start start 2023-10-19T13:00:12.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:12.024+0000 7f17cf9ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f17c81007a0 0x7f17c8074550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T13:00:12.031 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:12.025+0000 7f17cf9ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f17c8101990 0x7f17c8072be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T13:00:12.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:12.025+0000 7f17cf9ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17c8102330 0x7f17c8073120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T13:00:12.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:12.025+0000 7f17cf9ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c80738c0 con 0x7f17c8102330 2023-10-19T13:00:12.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:12.025+0000 7f17cf9ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c8073a30 con 0x7f17c8101990 2023-10-19T13:00:12.032 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:12.025+0000 7f17cf9ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c81a07b0 con 0x7f17c81007a0 2023-10-19T13:00:12.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:12.025+0000 7f17cdf9c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17c8102330 0x7f17c8073120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T13:00:12.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:12.025+0000 7f17cdf9c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17c8102330 0x7f17c8073120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51814/0 (socket says 172.21.15.46:51814) 2023-10-19T13:00:12.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:12.025+0000 7f17cd79b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f17c81007a0 0x7f17c8074550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T13:00:12.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:12.025+0000 7f17cdf9c700 1 -- 172.21.15.46:0/834968453 learned_addr learned my addr 172.21.15.46:0/834968453 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T13:00:12.033 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:12.025+0000 7f17ccf9a700 1 --2- 172.21.15.46:0/834968453 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f17c8101990 0x7f17c8072be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T13:00:12.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:12.025+0000 7f17cdf9c700 1 -- 172.21.15.46:0/834968453 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f17c81007a0 msgr2=0x7f17c8074550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T13:00:12.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:12.025+0000 7f17cdf9c700 1 --2- 172.21.15.46:0/834968453 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f17c81007a0 0x7f17c8074550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:12.034 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:12.025+0000 7f17cdf9c700 1 -- 172.21.15.46:0/834968453 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f17c8101990 msgr2=0x7f17c8072be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T13:00:12.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:12.025+0000 7f17cdf9c700 1 --2- 172.21.15.46:0/834968453 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f17c8101990 0x7f17c8072be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:12.035 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:12.025+0000 7f17cdf9c700 1 -- 172.21.15.46:0/834968453 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17c40095f0 con 0x7f17c8102330 2023-10-19T13:00:12.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:12.026+0000 7f17cdf9c700 1 --2- 172.21.15.46:0/834968453 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17c8102330 0x7f17c8073120 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f17c000ef30 tx=0x7f17c000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T13:00:12.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:12.026+0000 7f17be7fc700 1 -- 172.21.15.46:0/834968453 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c0018070 con 0x7f17c8102330 2023-10-19T13:00:12.036 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:12.026+0000 7f17be7fc700 1 -- 172.21.15.46:0/834968453 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f17c000f040 con 0x7f17c8102330 2023-10-19T13:00:12.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:12.026+0000 7f17be7fc700 1 -- 172.21.15.46:0/834968453 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c000cca0 con 0x7f17c8102330 2023-10-19T13:00:12.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:12.026+0000 7f17cf9ff700 1 -- 172.21.15.46:0/834968453 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17c81a09e0 con 0x7f17c8102330 2023-10-19T13:00:12.037 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:12.026+0000 7f17cf9ff700 1 -- 172.21.15.46:0/834968453 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17c81a0ea0 con 0x7f17c8102330 2023-10-19T13:00:12.038 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:12.027+0000 7f17cf9ff700 1 -- 172.21.15.46:0/834968453 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17c8107bc0 con 0x7f17c8102330 2023-10-19T13:00:12.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:12.029+0000 7f17be7fc700 1 -- 172.21.15.46:0/834968453 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f17c0003a00 con 0x7f17c8102330 2023-10-19T13:00:12.039 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:12.031+0000 7f17be7fc700 1 --2- 172.21.15.46:0/834968453 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f17b40a1500 0x7f17b40a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T13:00:12.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:12.032+0000 7f17be7fc700 1 -- 172.21.15.46:0/834968453 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9632+0+0 (secure 0 0 0) 0x7f17c00cccb0 con 0x7f17c8102330 2023-10-19T13:00:12.040 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:12.032+0000 7f17cd79b700 1 --2- 172.21.15.46:0/834968453 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f17b40a1500 0x7f17b40a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T13:00:12.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:12.032+0000 7f17cd79b700 1 --2- 172.21.15.46:0/834968453 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f17b40a1500 0x7f17b40a39c0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f17c4009990 tx=0x7f17c4000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T13:00:12.041 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:12.036+0000 7f17be7fc700 1 -- 172.21.15.46:0/834968453 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f17c0095df0 con 0x7f17c8102330 2023-10-19T13:00:12.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 13:00:11 smithi046 ceph-mon[98509]: pgmap v855: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 13 op/s 2023-10-19T13:00:12.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 13:00:11 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/2518012780' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2023-10-19T13:00:12.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 13:00:11 smithi046 ceph-mon[98509]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2023-10-19T13:00:12.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 13:00:11 smithi046 ceph-mon[98509]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-10-19T13:00:12.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 13:00:11 smithi046 ceph-mon[98509]: Cluster is now healthy 2023-10-19T13:00:12.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 13:00:11 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/2518012780' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2023-10-19T13:00:12.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 13:00:11 smithi046 ceph-mon[98509]: mds.? [v2:172.21.15.195:6832/3748963491,v1:172.21.15.195:6833/3748963491] up:boot 2023-10-19T13:00:12.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 13:00:11 smithi046 ceph-mon[98509]: mds.? [v2:172.21.15.195:6838/1870759771,v1:172.21.15.195:6839/1870759771] up:boot 2023-10-19T13:00:12.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 13:00:11 smithi046 ceph-mon[98509]: mds.? [v2:172.21.15.195:6834/885637269,v1:172.21.15.195:6835/885637269] up:boot 2023-10-19T13:00:12.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 13:00:11 smithi046 ceph-mon[98509]: mds.? [v2:172.21.15.195:6836/1948748098,v1:172.21.15.195:6837/1948748098] up:boot 2023-10-19T13:00:12.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 13:00:11 smithi046 ceph-mon[98509]: mds.? [v2:172.21.15.46:6838/3408222901,v1:172.21.15.46:6840/3408222901] up:boot 2023-10-19T13:00:12.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 13:00:11 smithi046 ceph-mon[98509]: mds.? [v2:172.21.15.46:6839/3359554110,v1:172.21.15.46:6841/3359554110] up:boot 2023-10-19T13:00:12.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 13:00:11 smithi046 ceph-mon[98509]: mds.? [v2:172.21.15.157:6838/3762166723,v1:172.21.15.157:6839/3762166723] up:boot 2023-10-19T13:00:12.232 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 13:00:11 smithi046 ceph-mon[98509]: mds.? [v2:172.21.15.157:6835/3490754735,v1:172.21.15.157:6836/3490754735] up:boot 2023-10-19T13:00:12.232 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 13:00:11 smithi046 ceph-mon[98509]: mds.? [v2:172.21.15.157:6834/2447352402,v1:172.21.15.157:6837/2447352402] up:boot 2023-10-19T13:00:12.232 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 13:00:11 smithi046 ceph-mon[98509]: mds.? [v2:172.21.15.157:6832/2789043563,v1:172.21.15.157:6833/2789043563] up:boot 2023-10-19T13:00:12.232 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 13:00:11 smithi046 ceph-mon[98509]: fsmap 12 up:standby 2023-10-19T13:00:12.232 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 13:00:11 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-10-19T13:00:12.233 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 13:00:11 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-10-19T13:00:12.233 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 13:00:11 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-10-19T13:00:12.233 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 13:00:11 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-10-19T13:00:12.233 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 13:00:11 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-10-19T13:00:12.233 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 13:00:11 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-10-19T13:00:12.233 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 13:00:11 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-10-19T13:00:12.234 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 13:00:11 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-10-19T13:00:12.234 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 13:00:11 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-10-19T13:00:12.234 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 13:00:11 smithi046 ceph-mon[98509]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-10-19T13:00:12.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:12.249+0000 7f17cf9ff700 1 -- 172.21.15.46:0/834968453 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f17c80675a0 con 0x7f17c8102330 2023-10-19T13:00:12.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 13:00:11 smithi157 ceph-mon[134109]: pgmap v855: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 13 op/s 2023-10-19T13:00:12.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 13:00:11 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/2518012780' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2023-10-19T13:00:12.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 13:00:11 smithi157 ceph-mon[134109]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2023-10-19T13:00:12.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 13:00:11 smithi157 ceph-mon[134109]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-10-19T13:00:12.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 13:00:11 smithi157 ceph-mon[134109]: Cluster is now healthy 2023-10-19T13:00:12.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 13:00:11 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/2518012780' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2023-10-19T13:00:12.339 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 13:00:11 smithi157 ceph-mon[134109]: mds.? [v2:172.21.15.195:6832/3748963491,v1:172.21.15.195:6833/3748963491] up:boot 2023-10-19T13:00:12.339 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 13:00:11 smithi157 ceph-mon[134109]: mds.? [v2:172.21.15.195:6838/1870759771,v1:172.21.15.195:6839/1870759771] up:boot 2023-10-19T13:00:12.339 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 13:00:11 smithi157 ceph-mon[134109]: mds.? [v2:172.21.15.195:6834/885637269,v1:172.21.15.195:6835/885637269] up:boot 2023-10-19T13:00:12.339 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 13:00:11 smithi157 ceph-mon[134109]: mds.? [v2:172.21.15.195:6836/1948748098,v1:172.21.15.195:6837/1948748098] up:boot 2023-10-19T13:00:12.339 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 13:00:11 smithi157 ceph-mon[134109]: mds.? [v2:172.21.15.46:6838/3408222901,v1:172.21.15.46:6840/3408222901] up:boot 2023-10-19T13:00:12.340 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 13:00:11 smithi157 ceph-mon[134109]: mds.? [v2:172.21.15.46:6839/3359554110,v1:172.21.15.46:6841/3359554110] up:boot 2023-10-19T13:00:12.340 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 13:00:11 smithi157 ceph-mon[134109]: mds.? [v2:172.21.15.157:6838/3762166723,v1:172.21.15.157:6839/3762166723] up:boot 2023-10-19T13:00:12.340 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 13:00:11 smithi157 ceph-mon[134109]: mds.? [v2:172.21.15.157:6835/3490754735,v1:172.21.15.157:6836/3490754735] up:boot 2023-10-19T13:00:12.340 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 13:00:11 smithi157 ceph-mon[134109]: mds.? [v2:172.21.15.157:6834/2447352402,v1:172.21.15.157:6837/2447352402] up:boot 2023-10-19T13:00:12.340 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 13:00:11 smithi157 ceph-mon[134109]: mds.? [v2:172.21.15.157:6832/2789043563,v1:172.21.15.157:6833/2789043563] up:boot 2023-10-19T13:00:12.340 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 13:00:11 smithi157 ceph-mon[134109]: fsmap 12 up:standby 2023-10-19T13:00:12.341 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 13:00:11 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-10-19T13:00:12.341 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 13:00:11 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-10-19T13:00:12.341 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 13:00:11 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-10-19T13:00:12.341 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 13:00:11 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-10-19T13:00:12.341 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 13:00:11 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-10-19T13:00:12.342 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 13:00:11 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-10-19T13:00:12.342 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 13:00:11 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-10-19T13:00:12.342 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 13:00:11 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-10-19T13:00:12.342 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 13:00:11 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-10-19T13:00:12.342 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 13:00:11 smithi157 ceph-mon[134109]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-10-19T13:00:12.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 13:00:11 smithi195 ceph-mon[134493]: pgmap v855: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 13 op/s 2023-10-19T13:00:12.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 13:00:11 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/2518012780' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2023-10-19T13:00:12.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 13:00:11 smithi195 ceph-mon[134493]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2023-10-19T13:00:12.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 13:00:11 smithi195 ceph-mon[134493]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-10-19T13:00:12.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 13:00:11 smithi195 ceph-mon[134493]: Cluster is now healthy 2023-10-19T13:00:12.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 13:00:11 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/2518012780' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2023-10-19T13:00:12.382 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 13:00:11 smithi195 ceph-mon[134493]: mds.? [v2:172.21.15.195:6832/3748963491,v1:172.21.15.195:6833/3748963491] up:boot 2023-10-19T13:00:12.382 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 13:00:11 smithi195 ceph-mon[134493]: mds.? [v2:172.21.15.195:6838/1870759771,v1:172.21.15.195:6839/1870759771] up:boot 2023-10-19T13:00:12.382 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 13:00:11 smithi195 ceph-mon[134493]: mds.? [v2:172.21.15.195:6834/885637269,v1:172.21.15.195:6835/885637269] up:boot 2023-10-19T13:00:12.382 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 13:00:11 smithi195 ceph-mon[134493]: mds.? [v2:172.21.15.195:6836/1948748098,v1:172.21.15.195:6837/1948748098] up:boot 2023-10-19T13:00:12.382 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 13:00:11 smithi195 ceph-mon[134493]: mds.? [v2:172.21.15.46:6838/3408222901,v1:172.21.15.46:6840/3408222901] up:boot 2023-10-19T13:00:12.383 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 13:00:11 smithi195 ceph-mon[134493]: mds.? [v2:172.21.15.46:6839/3359554110,v1:172.21.15.46:6841/3359554110] up:boot 2023-10-19T13:00:12.383 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 13:00:11 smithi195 ceph-mon[134493]: mds.? [v2:172.21.15.157:6838/3762166723,v1:172.21.15.157:6839/3762166723] up:boot 2023-10-19T13:00:12.383 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 13:00:11 smithi195 ceph-mon[134493]: mds.? [v2:172.21.15.157:6835/3490754735,v1:172.21.15.157:6836/3490754735] up:boot 2023-10-19T13:00:12.383 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 13:00:11 smithi195 ceph-mon[134493]: mds.? [v2:172.21.15.157:6834/2447352402,v1:172.21.15.157:6837/2447352402] up:boot 2023-10-19T13:00:12.383 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 13:00:11 smithi195 ceph-mon[134493]: mds.? [v2:172.21.15.157:6832/2789043563,v1:172.21.15.157:6833/2789043563] up:boot 2023-10-19T13:00:12.383 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 13:00:11 smithi195 ceph-mon[134493]: fsmap 12 up:standby 2023-10-19T13:00:12.384 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 13:00:11 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-10-19T13:00:12.384 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 13:00:11 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-10-19T13:00:12.384 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 13:00:11 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-10-19T13:00:12.384 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 13:00:11 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-10-19T13:00:12.384 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 13:00:11 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-10-19T13:00:12.385 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 13:00:11 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-10-19T13:00:12.385 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 13:00:11 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-10-19T13:00:12.385 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 13:00:11 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-10-19T13:00:12.385 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 13:00:11 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-10-19T13:00:12.385 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 13:00:11 smithi195 ceph-mon[134493]: from='mgr.14150 172.21.15.46:0/268180630' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-10-19T13:00:12.990 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:12.987+0000 7f17be7fc700 1 -- 172.21.15.46:0/834968453 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v94) v1 ==== 181+0+0 (secure 0 0 0) 0x7f17c0099410 con 0x7f17c8102330 2023-10-19T13:00:12.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:12.991+0000 7f17cf9ff700 1 -- 172.21.15.46:0/834968453 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f17b40a1500 msgr2=0x7f17b40a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T13:00:12.994 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:12.991+0000 7f17cf9ff700 1 --2- 172.21.15.46:0/834968453 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f17b40a1500 0x7f17b40a39c0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f17c4009990 tx=0x7f17c4000bc0 comp rx=0 tx=0).stop 2023-10-19T13:00:12.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:12.991+0000 7f17cf9ff700 1 -- 172.21.15.46:0/834968453 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17c8102330 msgr2=0x7f17c8073120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T13:00:12.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:12.991+0000 7f17cf9ff700 1 --2- 172.21.15.46:0/834968453 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17c8102330 0x7f17c8073120 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f17c000ef30 tx=0x7f17c000c3a0 comp rx=0 tx=0).stop 2023-10-19T13:00:12.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:12.992+0000 7f17cf9ff700 1 -- 172.21.15.46:0/834968453 shutdown_connections 2023-10-19T13:00:12.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:12.992+0000 7f17cf9ff700 1 --2- 172.21.15.46:0/834968453 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17c8102330 0x7f17c8073120 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:12.996 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:12.992+0000 7f17cf9ff700 1 --2- 172.21.15.46:0/834968453 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f17b40a1500 0x7f17b40a39c0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:12.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:12.992+0000 7f17cf9ff700 1 --2- 172.21.15.46:0/834968453 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f17c81007a0 0x7f17c8074550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:12.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:12.992+0000 7f17cf9ff700 1 --2- 172.21.15.46:0/834968453 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f17c8101990 0x7f17c8072be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:12.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:12.992+0000 7f17cf9ff700 1 -- 172.21.15.46:0/834968453 >> 172.21.15.46:0/834968453 conn(0x7f17c80fbcf0 msgr2=0x7f17c8104d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T13:00:12.997 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:12.992+0000 7f17cf9ff700 1 -- 172.21.15.46:0/834968453 shutdown_connections 2023-10-19T13:00:12.998 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:12.993+0000 7f17cf9ff700 1 -- 172.21.15.46:0/834968453 wait complete. 2023-10-19T13:00:12.998 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_metadata' removed 2023-10-19T13:00:13.020 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-19T13:00:13.239 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:13.236+0000 7f18277ff700 1 -- 172.21.15.46:0/3006479006 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1820108150 msgr2=0x7f182010eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T13:00:13.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:13.236+0000 7f18277ff700 1 --2- 172.21.15.46:0/3006479006 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1820108150 0x7f182010eb30 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f1814009990 tx=0x7f1814009ca0 comp rx=0 tx=0).stop 2023-10-19T13:00:13.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:13.236+0000 7f18277ff700 1 -- 172.21.15.46:0/3006479006 shutdown_connections 2023-10-19T13:00:13.240 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:13.236+0000 7f18277ff700 1 --2- 172.21.15.46:0/3006479006 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f182010f070 0x7f1820111460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:13.241 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:13.236+0000 7f18277ff700 1 --2- 172.21.15.46:0/3006479006 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f18201077f0 0x7f1820107c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:13.241 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:13.236+0000 7f18277ff700 1 --2- 172.21.15.46:0/3006479006 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1820108150 0x7f182010eb30 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:13.241 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:13.236+0000 7f18277ff700 1 -- 172.21.15.46:0/3006479006 >> 172.21.15.46:0/3006479006 conn(0x7f182006d7d0 msgr2=0x7f182006fc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T13:00:13.241 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:13.236+0000 7f18277ff700 1 -- 172.21.15.46:0/3006479006 shutdown_connections 2023-10-19T13:00:13.241 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:13.236+0000 7f18277ff700 1 -- 172.21.15.46:0/3006479006 wait complete. 2023-10-19T13:00:13.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:13.237+0000 7f18277ff700 1 Processor -- start 2023-10-19T13:00:13.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:13.237+0000 7f18277ff700 1 -- start start 2023-10-19T13:00:13.244 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:13.238+0000 7f18277ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f18201077f0 0x7f18201a1140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T13:00:13.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:13.238+0000 7f18277ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1820108150 0x7f18201a1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T13:00:13.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:13.238+0000 7f18277ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f182010f070 0x7f18201a86a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T13:00:13.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:13.238+0000 7f18277ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18201a8c70 con 0x7f18201077f0 2023-10-19T13:00:13.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:13.238+0000 7f18277ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18201a8db0 con 0x7f1820108150 2023-10-19T13:00:13.245 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:13.238+0000 7f18277ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18201a8f40 con 0x7f182010f070 2023-10-19T13:00:13.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:13.238+0000 7f182559b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f18201077f0 0x7f18201a1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T13:00:13.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:13.238+0000 7f182559b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f18201077f0 0x7f18201a1140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50924/0 (socket says 172.21.15.46:50924) 2023-10-19T13:00:13.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:13.238+0000 7f182559b700 1 -- 172.21.15.46:0/2085416398 learned_addr learned my addr 172.21.15.46:0/2085416398 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T13:00:13.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:13.238+0000 7f1825d9c700 1 --2- 172.21.15.46:0/2085416398 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f182010f070 0x7f18201a86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T13:00:13.246 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:13.238+0000 7f1824d9a700 1 --2- 172.21.15.46:0/2085416398 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1820108150 0x7f18201a1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T13:00:13.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:13.238+0000 7f182559b700 1 -- 172.21.15.46:0/2085416398 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f182010f070 msgr2=0x7f18201a86a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T13:00:13.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:13.238+0000 7f182559b700 1 --2- 172.21.15.46:0/2085416398 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f182010f070 0x7f18201a86a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:13.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:13.238+0000 7f182559b700 1 -- 172.21.15.46:0/2085416398 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1820108150 msgr2=0x7f18201a1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T13:00:13.247 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:13.238+0000 7f182559b700 1 --2- 172.21.15.46:0/2085416398 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1820108150 0x7f18201a1680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:13.248 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:13.238+0000 7f182559b700 1 -- 172.21.15.46:0/2085416398 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18140095f0 con 0x7f18201077f0 2023-10-19T13:00:13.248 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:13.239+0000 7f182559b700 1 --2- 172.21.15.46:0/2085416398 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f18201077f0 0x7f18201a1140 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f18180060b0 tx=0x7f181800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T13:00:13.248 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:13.239+0000 7f181e7fc700 1 -- 172.21.15.46:0/2085416398 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f181800ddd0 con 0x7f18201077f0 2023-10-19T13:00:13.248 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:13.239+0000 7f181e7fc700 1 -- 172.21.15.46:0/2085416398 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f181800f040 con 0x7f18201077f0 2023-10-19T13:00:13.248 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:13.239+0000 7f18277ff700 1 -- 172.21.15.46:0/2085416398 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18201a9220 con 0x7f18201077f0 2023-10-19T13:00:13.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:13.239+0000 7f181e7fc700 1 -- 172.21.15.46:0/2085416398 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1818014690 con 0x7f18201077f0 2023-10-19T13:00:13.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:13.239+0000 7f18277ff700 1 -- 172.21.15.46:0/2085416398 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18201a9780 con 0x7f18201077f0 2023-10-19T13:00:13.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:13.240+0000 7f18277ff700 1 -- 172.21.15.46:0/2085416398 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f182010e2c0 con 0x7f18201077f0 2023-10-19T13:00:13.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:13.242+0000 7f181e7fc700 1 -- 172.21.15.46:0/2085416398 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f1818015400 con 0x7f18201077f0 2023-10-19T13:00:13.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:13.243+0000 7f181e7fc700 1 --2- 172.21.15.46:0/2085416398 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f18080a1500 0x7f18080a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T13:00:13.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:13.244+0000 7f181e7fc700 1 -- 172.21.15.46:0/2085416398 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f18180cca10 con 0x7f18201077f0 2023-10-19T13:00:13.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:13.244+0000 7f1824d9a700 1 --2- 172.21.15.46:0/2085416398 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f18080a1500 0x7f18080a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T13:00:13.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:13.244+0000 7f1824d9a700 1 --2- 172.21.15.46:0/2085416398 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f18080a1500 0x7f18080a39c0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f1814006010 tx=0x7f18140037b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T13:00:13.251 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:13.248+0000 7f181e7fc700 1 -- 172.21.15.46:0/2085416398 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f1818095ce0 con 0x7f18201077f0 2023-10-19T13:00:13.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 13:00:12 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/834968453' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-19T13:00:13.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 13:00:12 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/834968453' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-19T13:00:13.460 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:13.457+0000 7f18277ff700 1 -- 172.21.15.46:0/2085416398 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f18200675a0 con 0x7f18201077f0 2023-10-19T13:00:13.478 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 13:00:12 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/834968453' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-19T13:00:13.995 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:13.992+0000 7f181e7fc700 1 -- 172.21.15.46:0/2085416398 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v95) v1 ==== 169+0+0 (secure 0 0 0) 0x7f1818099300 con 0x7f18201077f0 2023-10-19T13:00:13.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:13.996+0000 7f18277ff700 1 -- 172.21.15.46:0/2085416398 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f18080a1500 msgr2=0x7f18080a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T13:00:13.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:13.996+0000 7f18277ff700 1 --2- 172.21.15.46:0/2085416398 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f18080a1500 0x7f18080a39c0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f1814006010 tx=0x7f18140037b0 comp rx=0 tx=0).stop 2023-10-19T13:00:13.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:13.996+0000 7f18277ff700 1 -- 172.21.15.46:0/2085416398 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f18201077f0 msgr2=0x7f18201a1140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T13:00:13.999 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:13.996+0000 7f18277ff700 1 --2- 172.21.15.46:0/2085416398 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f18201077f0 0x7f18201a1140 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f18180060b0 tx=0x7f181800d3b0 comp rx=0 tx=0).stop 2023-10-19T13:00:14.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:13.996+0000 7f18277ff700 1 -- 172.21.15.46:0/2085416398 shutdown_connections 2023-10-19T13:00:14.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:13.996+0000 7f18277ff700 1 --2- 172.21.15.46:0/2085416398 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f18080a1500 0x7f18080a39c0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:14.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:13.996+0000 7f18277ff700 1 --2- 172.21.15.46:0/2085416398 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f182010f070 0x7f18201a86a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:14.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:13.996+0000 7f18277ff700 1 --2- 172.21.15.46:0/2085416398 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f18201077f0 0x7f18201a1140 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:14.000 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:13.996+0000 7f18277ff700 1 --2- 172.21.15.46:0/2085416398 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1820108150 0x7f18201a1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:14.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:13.996+0000 7f18277ff700 1 -- 172.21.15.46:0/2085416398 >> 172.21.15.46:0/2085416398 conn(0x7f182006d7d0 msgr2=0x7f182006f520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T13:00:14.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:13.996+0000 7f18277ff700 1 -- 172.21.15.46:0/2085416398 shutdown_connections 2023-10-19T13:00:14.002 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:13.996+0000 7f18277ff700 1 -- 172.21.15.46:0/2085416398 wait complete. 2023-10-19T13:00:14.002 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_data' removed 2023-10-19T13:00:14.023 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-10-19T13:00:14.248 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:14.245+0000 7f40215ff700 1 -- 172.21.15.46:0/874256228 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f401c101990 msgr2=0x7f401c101df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T13:00:14.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:14.245+0000 7f40215ff700 1 --2- 172.21.15.46:0/874256228 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f401c101990 0x7f401c101df0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f40100099c0 tx=0x7f4010009cd0 comp rx=0 tx=0).stop 2023-10-19T13:00:14.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:14.245+0000 7f40215ff700 1 -- 172.21.15.46:0/874256228 shutdown_connections 2023-10-19T13:00:14.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:14.245+0000 7f40215ff700 1 --2- 172.21.15.46:0/874256228 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f401c102330 0x7f401c108be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:14.249 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:14.245+0000 7f40215ff700 1 --2- 172.21.15.46:0/874256228 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f401c1007a0 0x7f401c100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:14.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:14.245+0000 7f40215ff700 1 --2- 172.21.15.46:0/874256228 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f401c101990 0x7f401c101df0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:14.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:14.245+0000 7f40215ff700 1 -- 172.21.15.46:0/874256228 >> 172.21.15.46:0/874256228 conn(0x7f401c0fbcf0 msgr2=0x7f401c0fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T13:00:14.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:14.245+0000 7f40215ff700 1 -- 172.21.15.46:0/874256228 shutdown_connections 2023-10-19T13:00:14.250 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:14.245+0000 7f40215ff700 1 -- 172.21.15.46:0/874256228 wait complete. 2023-10-19T13:00:14.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:14.246+0000 7f40215ff700 1 Processor -- start 2023-10-19T13:00:14.252 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:14.246+0000 7f40215ff700 1 -- start start 2023-10-19T13:00:14.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:14.247+0000 7f40215ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f401c1007a0 0x7f401c198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T13:00:14.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:14.247+0000 7f40215ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f401c101990 0x7f401c198e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T13:00:14.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:14.247+0000 7f40215ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f401c102330 0x7f401c19fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T13:00:14.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:14.247+0000 7f40215ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f401c1a0450 con 0x7f401c101990 2023-10-19T13:00:14.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:14.247+0000 7f40215ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f401c1a0590 con 0x7f401c1007a0 2023-10-19T13:00:14.253 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:14.247+0000 7f40215ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f401c1a0720 con 0x7f401c102330 2023-10-19T13:00:14.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:14.247+0000 7f401affd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f401c1007a0 0x7f401c198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T13:00:14.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:14.247+0000 7f401a7fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f401c101990 0x7f401c198e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T13:00:14.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:14.247+0000 7f401affd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f401c1007a0 0x7f401c198920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.46:44348/0 (socket says 172.21.15.46:44348) 2023-10-19T13:00:14.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:14.247+0000 7f401affd700 1 -- 172.21.15.46:0/2326474498 learned_addr learned my addr 172.21.15.46:0/2326474498 (peer_addr_for_me v2:172.21.15.46:0/0) 2023-10-19T13:00:14.254 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:14.247+0000 7f401b7fe700 1 --2- 172.21.15.46:0/2326474498 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f401c102330 0x7f401c19fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T13:00:14.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:14.247+0000 7f401a7fc700 1 -- 172.21.15.46:0/2326474498 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f401c102330 msgr2=0x7f401c19fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T13:00:14.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:14.247+0000 7f401a7fc700 1 --2- 172.21.15.46:0/2326474498 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f401c102330 0x7f401c19fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:14.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:14.247+0000 7f401a7fc700 1 -- 172.21.15.46:0/2326474498 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f401c1007a0 msgr2=0x7f401c198920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T13:00:14.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:14.247+0000 7f401a7fc700 1 --2- 172.21.15.46:0/2326474498 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f401c1007a0 0x7f401c198920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:14.255 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:14.247+0000 7f401a7fc700 1 -- 172.21.15.46:0/2326474498 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40100095f0 con 0x7f401c101990 2023-10-19T13:00:14.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:14.248+0000 7f401a7fc700 1 --2- 172.21.15.46:0/2326474498 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f401c101990 0x7f401c198e60 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f40100098e0 tx=0x7f401000fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T13:00:14.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:14.248+0000 7f4003fff700 1 -- 172.21.15.46:0/2326474498 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f401001d070 con 0x7f401c101990 2023-10-19T13:00:14.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:14.248+0000 7f4003fff700 1 -- 172.21.15.46:0/2326474498 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f401000bda0 con 0x7f401c101990 2023-10-19T13:00:14.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:14.248+0000 7f40215ff700 1 -- 172.21.15.46:0/2326474498 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f401c1a09a0 con 0x7f401c101990 2023-10-19T13:00:14.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:14.248+0000 7f4003fff700 1 -- 172.21.15.46:0/2326474498 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40100173f0 con 0x7f401c101990 2023-10-19T13:00:14.256 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:14.248+0000 7f40215ff700 1 -- 172.21.15.46:0/2326474498 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f401c1a0e20 con 0x7f401c101990 2023-10-19T13:00:14.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:14.249+0000 7f40215ff700 1 -- 172.21.15.46:0/2326474498 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f401c0675a0 con 0x7f401c101990 2023-10-19T13:00:14.257 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:14.251+0000 7f4003fff700 1 -- 172.21.15.46:0/2326474498 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f4010022470 con 0x7f401c101990 2023-10-19T13:00:14.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:14.252+0000 7f4003fff700 1 --2- 172.21.15.46:0/2326474498 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f40040a1500 0x7f40040a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T13:00:14.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:14.253+0000 7f4003fff700 1 -- 172.21.15.46:0/2326474498 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 8424+0+0 (secure 0 0 0) 0x7f40100cdf60 con 0x7f401c101990 2023-10-19T13:00:14.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:14.253+0000 7f401affd700 1 --2- 172.21.15.46:0/2326474498 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f40040a1500 0x7f40040a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T13:00:14.258 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:14.253+0000 7f401affd700 1 --2- 172.21.15.46:0/2326474498 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f40040a1500 0x7f40040a39c0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f400c00bd70 tx=0x7f400c00b4a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T13:00:14.259 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:14.257+0000 7f4003fff700 1 -- 172.21.15.46:0/2326474498 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f4010097530 con 0x7f401c101990 2023-10-19T13:00:14.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 13:00:13 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/834968453' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2023-10-19T13:00:14.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 13:00:13 smithi157 ceph-mon[134109]: osdmap e94: 12 total, 12 up, 12 in 2023-10-19T13:00:14.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 13:00:13 smithi157 ceph-mon[134109]: pgmap v857: 97 pgs: 97 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail 2023-10-19T13:00:14.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 13:00:13 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/2085416398' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-19T13:00:14.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 13:00:13 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/834968453' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2023-10-19T13:00:14.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 13:00:13 smithi195 ceph-mon[134493]: osdmap e94: 12 total, 12 up, 12 in 2023-10-19T13:00:14.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 13:00:13 smithi195 ceph-mon[134493]: pgmap v857: 97 pgs: 97 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail 2023-10-19T13:00:14.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 13:00:13 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/2085416398' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-19T13:00:14.474 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:14.471+0000 7f40215ff700 1 -- 172.21.15.46:0/2326474498 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f401c1a10c0 con 0x7f401c101990 2023-10-19T13:00:14.478 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 13:00:13 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/834968453' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2023-10-19T13:00:14.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 13:00:13 smithi046 ceph-mon[98509]: osdmap e94: 12 total, 12 up, 12 in 2023-10-19T13:00:14.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 13:00:13 smithi046 ceph-mon[98509]: pgmap v857: 97 pgs: 97 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail 2023-10-19T13:00:14.479 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 13:00:13 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/2085416398' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-19T13:00:15.001 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:14.998+0000 7f4003fff700 1 -- 172.21.15.46:0/2326474498 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v96) v1 ==== 178+0+0 (secure 0 0 0) 0x7f401009ab50 con 0x7f401c101990 2023-10-19T13:00:15.006 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:15.003+0000 7f40215ff700 1 -- 172.21.15.46:0/2326474498 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f40040a1500 msgr2=0x7f40040a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T13:00:15.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:15.003+0000 7f40215ff700 1 --2- 172.21.15.46:0/2326474498 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f40040a1500 0x7f40040a39c0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f400c00bd70 tx=0x7f400c00b4a0 comp rx=0 tx=0).stop 2023-10-19T13:00:15.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:15.003+0000 7f40215ff700 1 -- 172.21.15.46:0/2326474498 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f401c101990 msgr2=0x7f401c198e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T13:00:15.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:15.003+0000 7f40215ff700 1 --2- 172.21.15.46:0/2326474498 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f401c101990 0x7f401c198e60 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f40100098e0 tx=0x7f401000fa00 comp rx=0 tx=0).stop 2023-10-19T13:00:15.007 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:15.004+0000 7f40215ff700 1 -- 172.21.15.46:0/2326474498 shutdown_connections 2023-10-19T13:00:15.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:15.004+0000 7f40215ff700 1 --2- 172.21.15.46:0/2326474498 >> [v2:172.21.15.46:6800/3168073651,v1:172.21.15.46:6801/3168073651] conn(0x7f40040a1500 0x7f40040a39c0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:15.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:15.004+0000 7f40215ff700 1 --2- 172.21.15.46:0/2326474498 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f401c102330 0x7f401c19fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:15.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:15.004+0000 7f40215ff700 1 --2- 172.21.15.46:0/2326474498 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f401c1007a0 0x7f401c198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:15.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:15.004+0000 7f40215ff700 1 --2- 172.21.15.46:0/2326474498 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f401c101990 0x7f401c198e60 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T13:00:15.008 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:15.004+0000 7f40215ff700 1 -- 172.21.15.46:0/2326474498 >> 172.21.15.46:0/2326474498 conn(0x7f401c0fbcf0 msgr2=0x7f401c107180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T13:00:15.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:15.004+0000 7f40215ff700 1 -- 172.21.15.46:0/2326474498 shutdown_connections 2023-10-19T13:00:15.009 INFO:teuthology.orchestra.run.smithi046.stderr:2023-10-19T13:00:15.004+0000 7f40215ff700 1 -- 172.21.15.46:0/2326474498 wait complete. 2023-10-19T13:00:15.010 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_data_ec' removed 2023-10-19T13:00:15.042 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-10-19T13:00:15.154 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-10-19T13:00:15.218 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-10-19T13:00:15.248 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 13:00:14 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/2085416398' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2023-10-19T13:00:15.248 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 13:00:14 smithi195 ceph-mon[134493]: osdmap e95: 12 total, 12 up, 12 in 2023-10-19T13:00:15.248 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 13:00:14 smithi195 ceph-mon[134493]: from='client.? 172.21.15.46:0/2326474498' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-19T13:00:15.257 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2023-10-19T13:00:15.257 DEBUG:teuthology.orchestra.run.smithi046:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-10-19T13:00:15.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 13:00:14 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/2085416398' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2023-10-19T13:00:15.337 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 13:00:14 smithi157 ceph-mon[134109]: osdmap e95: 12 total, 12 up, 12 in 2023-10-19T13:00:15.338 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 13:00:14 smithi157 ceph-mon[134109]: from='client.? 172.21.15.46:0/2326474498' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-19T13:00:15.339 DEBUG:teuthology.orchestra.run.smithi157:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-10-19T13:00:15.357 DEBUG:teuthology.orchestra.run.smithi195:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-10-19T13:00:15.374 INFO:tasks.cephadm:Stopping all daemons... 2023-10-19T13:00:15.374 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2023-10-19T13:00:15.374 DEBUG:teuthology.orchestra.run.smithi046:> sudo systemctl stop ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@mon.a 2023-10-19T13:00:15.459 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 13:00:14 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/2085416398' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2023-10-19T13:00:15.459 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 13:00:14 smithi046 ceph-mon[98509]: osdmap e95: 12 total, 12 up, 12 in 2023-10-19T13:00:15.460 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 13:00:14 smithi046 ceph-mon[98509]: from='client.? 172.21.15.46:0/2326474498' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-19T13:00:15.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 13:00:15 smithi046 systemd[1]: Stopping Ceph mon.a for 96a8be3c-6e7b-11ee-8db6-212e2dc638e7... 2023-10-19T13:00:16.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 13:00:15 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mon-a[98485]: 2023-10-19T13:00:15.944+0000 7fb3f8466700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-10-19T13:00:16.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 13:00:15 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mon-a[98485]: 2023-10-19T13:00:15.944+0000 7fb3f8466700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2023-10-19T13:00:16.728 INFO:journalctl@ceph.mon.a.smithi046.stdout:Oct 19 13:00:16 smithi046 bash[175766]: ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mon-a 2023-10-19T13:00:16.997 DEBUG:teuthology.orchestra.run.smithi046:> sudo pkill -f 'journalctl -f -n 0 -u ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@mon.a.service' 2023-10-19T13:00:17.101 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-19T13:00:17.102 INFO:tasks.cephadm.mon.a:Stopped mon.a 2023-10-19T13:00:17.102 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2023-10-19T13:00:17.103 DEBUG:teuthology.orchestra.run.smithi157:> sudo systemctl stop ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@mon.b 2023-10-19T13:00:17.587 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 13:00:17 smithi157 systemd[1]: Stopping Ceph mon.b for 96a8be3c-6e7b-11ee-8db6-212e2dc638e7... 2023-10-19T13:00:18.087 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 13:00:17 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mon-b[134085]: 2023-10-19T13:00:17.666+0000 7f4c6574a700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-10-19T13:00:18.088 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 13:00:17 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mon-b[134085]: 2023-10-19T13:00:17.666+0000 7f4c6574a700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2023-10-19T13:00:18.837 INFO:journalctl@ceph.mon.b.smithi157.stdout:Oct 19 13:00:18 smithi157 bash[176853]: ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mon-b 2023-10-19T13:00:18.862 DEBUG:teuthology.orchestra.run.smithi157:> sudo pkill -f 'journalctl -f -n 0 -u ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@mon.b.service' 2023-10-19T13:00:18.929 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-19T13:00:18.929 INFO:tasks.cephadm.mon.c:Stopped mon.b 2023-10-19T13:00:18.930 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2023-10-19T13:00:18.930 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@mon.c 2023-10-19T13:00:19.346 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 13:00:18 smithi195 systemd[1]: Stopping Ceph mon.c for 96a8be3c-6e7b-11ee-8db6-212e2dc638e7... 2023-10-19T13:00:19.627 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 13:00:19 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mon-c[134465]: 2023-10-19T13:00:19.343+0000 7f1020a80700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-10-19T13:00:19.627 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 13:00:19 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mon-c[134465]: 2023-10-19T13:00:19.343+0000 7f1020a80700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2023-10-19T13:00:19.859 DEBUG:teuthology.orchestra.run.smithi195:> sudo pkill -f 'journalctl -f -n 0 -u ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@mon.c.service' 2023-10-19T13:00:19.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 13:00:19 smithi195 bash[177820]: ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mon-c 2023-10-19T13:00:19.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 13:00:19 smithi195 systemd[1]: ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@mon.c.service: Succeeded. 2023-10-19T13:00:19.880 INFO:journalctl@ceph.mon.c.smithi195.stdout:Oct 19 13:00:19 smithi195 systemd[1]: Stopped Ceph mon.c for 96a8be3c-6e7b-11ee-8db6-212e2dc638e7. 2023-10-19T13:00:19.910 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-19T13:00:19.910 INFO:tasks.cephadm.mon.c:Stopped mon.c 2023-10-19T13:00:19.911 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2023-10-19T13:00:19.911 DEBUG:teuthology.orchestra.run.smithi046:> sudo systemctl stop ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@mgr.x 2023-10-19T13:00:20.434 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 13:00:20 smithi046 systemd[1]: Stopping Ceph mgr.x for 96a8be3c-6e7b-11ee-8db6-212e2dc638e7... 2023-10-19T13:00:20.435 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 13:00:20 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: 2023-10-19T13:00:20.429+0000 7ff4b9569700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-19T13:00:20.435 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 13:00:20 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x[98760]: 2023-10-19T13:00:20.429+0000 7ff4b9569700 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2023-10-19T13:00:20.979 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Oct 19 13:00:20 smithi046 bash[175918]: ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-x 2023-10-19T13:00:21.221 DEBUG:teuthology.orchestra.run.smithi046:> sudo pkill -f 'journalctl -f -n 0 -u ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@mgr.x.service' 2023-10-19T13:00:21.313 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-19T13:00:21.314 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2023-10-19T13:00:21.314 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2023-10-19T13:00:21.314 DEBUG:teuthology.orchestra.run.smithi157:> sudo systemctl stop ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@mgr.y 2023-10-19T13:00:21.765 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 19 13:00:21 smithi157 systemd[1]: Stopping Ceph mgr.y for 96a8be3c-6e7b-11ee-8db6-212e2dc638e7... 2023-10-19T13:00:22.024 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 19 13:00:21 smithi157 bash[177011]: ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-y 2023-10-19T13:00:22.208 INFO:journalctl@ceph.mgr.y.smithi157.stdout:Oct 19 13:00:22 smithi157 systemd[1]: ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@mgr.y.service: Main process exited, code=exited, status=143/n/a 2023-10-19T13:00:22.211 DEBUG:teuthology.orchestra.run.smithi157:> sudo pkill -f 'journalctl -f -n 0 -u ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@mgr.y.service' 2023-10-19T13:00:22.247 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-19T13:00:22.248 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2023-10-19T13:00:22.248 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2023-10-19T13:00:22.248 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@mgr.z 2023-10-19T13:00:22.630 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Oct 19 13:00:22 smithi195 systemd[1]: Stopping Ceph mgr.z for 96a8be3c-6e7b-11ee-8db6-212e2dc638e7... 2023-10-19T13:00:22.954 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Oct 19 13:00:22 smithi195 bash[177975]: ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mgr-z 2023-10-19T13:00:23.134 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Oct 19 13:00:22 smithi195 systemd[1]: ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@mgr.z.service: Main process exited, code=exited, status=143/n/a 2023-10-19T13:00:23.139 DEBUG:teuthology.orchestra.run.smithi195:> sudo pkill -f 'journalctl -f -n 0 -u ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@mgr.z.service' 2023-10-19T13:00:23.177 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-19T13:00:23.178 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2023-10-19T13:00:23.178 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2023-10-19T13:00:23.178 DEBUG:teuthology.orchestra.run.smithi046:> sudo systemctl stop ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@osd.0 2023-10-19T13:00:23.729 INFO:journalctl@ceph.osd.0.smithi046.stdout:Oct 19 13:00:23 smithi046 systemd[1]: Stopping Ceph osd.0 for 96a8be3c-6e7b-11ee-8db6-212e2dc638e7... 2023-10-19T13:00:25.478 INFO:journalctl@ceph.osd.0.smithi046.stdout:Oct 19 13:00:25 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-0[117765]: 2023-10-19T13:00:25.064+0000 7fcd6ad35700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-19T13:00:25.479 INFO:journalctl@ceph.osd.0.smithi046.stdout:Oct 19 13:00:25 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-0[117765]: 2023-10-19T13:00:25.064+0000 7fcd6ad35700 -1 osd.0 96 *** Got signal Terminated *** 2023-10-19T13:00:25.479 INFO:journalctl@ceph.osd.0.smithi046.stdout:Oct 19 13:00:25 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-0[117765]: 2023-10-19T13:00:25.064+0000 7fcd6ad35700 -1 osd.0 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-19T13:00:31.229 INFO:journalctl@ceph.osd.0.smithi046.stdout:Oct 19 13:00:30 smithi046 bash[176066]: ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-0 2023-10-19T13:00:33.192 DEBUG:teuthology.orchestra.run.smithi046:> sudo pkill -f 'journalctl -f -n 0 -u ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@osd.0.service' 2023-10-19T13:00:33.286 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-19T13:00:33.287 INFO:tasks.cephadm.osd.0:Stopped osd.0 2023-10-19T13:00:33.287 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2023-10-19T13:00:33.287 DEBUG:teuthology.orchestra.run.smithi157:> sudo systemctl stop ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@osd.1 2023-10-19T13:00:33.588 INFO:journalctl@ceph.osd.1.smithi157.stdout:Oct 19 13:00:33 smithi157 systemd[1]: Stopping Ceph osd.1 for 96a8be3c-6e7b-11ee-8db6-212e2dc638e7... 2023-10-19T13:00:34.087 INFO:journalctl@ceph.osd.1.smithi157.stdout:Oct 19 13:00:33 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-1[139168]: 2023-10-19T13:00:33.643+0000 7feec3543700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-19T13:00:34.088 INFO:journalctl@ceph.osd.1.smithi157.stdout:Oct 19 13:00:33 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-1[139168]: 2023-10-19T13:00:33.643+0000 7feec3543700 -1 osd.1 96 *** Got signal Terminated *** 2023-10-19T13:00:34.088 INFO:journalctl@ceph.osd.1.smithi157.stdout:Oct 19 13:00:33 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-1[139168]: 2023-10-19T13:00:33.643+0000 7feec3543700 -1 osd.1 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-19T13:00:39.837 INFO:journalctl@ceph.osd.1.smithi157.stdout:Oct 19 13:00:39 smithi157 bash[177159]: ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-1 2023-10-19T13:00:41.227 DEBUG:teuthology.orchestra.run.smithi157:> sudo pkill -f 'journalctl -f -n 0 -u ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@osd.1.service' 2023-10-19T13:00:41.267 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-19T13:00:41.268 INFO:tasks.cephadm.osd.1:Stopped osd.1 2023-10-19T13:00:41.268 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2023-10-19T13:00:41.268 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@osd.2 2023-10-19T13:00:41.626 INFO:journalctl@ceph.osd.2.smithi195.stdout:Oct 19 13:00:41 smithi195 systemd[1]: Stopping Ceph osd.2 for 96a8be3c-6e7b-11ee-8db6-212e2dc638e7... 2023-10-19T13:00:41.880 INFO:journalctl@ceph.osd.2.smithi195.stdout:Oct 19 13:00:41 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-2[140262]: 2023-10-19T13:00:41.623+0000 7f26848db700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-19T13:00:41.880 INFO:journalctl@ceph.osd.2.smithi195.stdout:Oct 19 13:00:41 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-2[140262]: 2023-10-19T13:00:41.623+0000 7f26848db700 -1 osd.2 96 *** Got signal Terminated *** 2023-10-19T13:00:41.881 INFO:journalctl@ceph.osd.2.smithi195.stdout:Oct 19 13:00:41 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-2[140262]: 2023-10-19T13:00:41.623+0000 7f26848db700 -1 osd.2 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-19T13:00:47.880 INFO:journalctl@ceph.osd.2.smithi195.stdout:Oct 19 13:00:47 smithi195 bash[178125]: ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-2 2023-10-19T13:00:48.955 DEBUG:teuthology.orchestra.run.smithi195:> sudo pkill -f 'journalctl -f -n 0 -u ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@osd.2.service' 2023-10-19T13:00:48.995 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-19T13:00:48.995 INFO:tasks.cephadm.osd.2:Stopped osd.2 2023-10-19T13:00:48.995 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2023-10-19T13:00:48.996 DEBUG:teuthology.orchestra.run.smithi046:> sudo systemctl stop ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@osd.3 2023-10-19T13:00:49.478 INFO:journalctl@ceph.osd.3.smithi046.stdout:Oct 19 13:00:49 smithi046 systemd[1]: Stopping Ceph osd.3 for 96a8be3c-6e7b-11ee-8db6-212e2dc638e7... 2023-10-19T13:00:49.979 INFO:journalctl@ceph.osd.3.smithi046.stdout:Oct 19 13:00:49 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-3[125604]: 2023-10-19T13:00:49.520+0000 7ffa0eb41700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-19T13:00:49.979 INFO:journalctl@ceph.osd.3.smithi046.stdout:Oct 19 13:00:49 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-3[125604]: 2023-10-19T13:00:49.520+0000 7ffa0eb41700 -1 osd.3 96 *** Got signal Terminated *** 2023-10-19T13:00:49.979 INFO:journalctl@ceph.osd.3.smithi046.stdout:Oct 19 13:00:49 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-3[125604]: 2023-10-19T13:00:49.520+0000 7ffa0eb41700 -1 osd.3 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-19T13:00:52.587 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:00:52 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:00:52.256+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:28.496192+0000 front 2023-10-19T13:00:28.496224+0000 (oldest deadline 2023-10-19T13:00:51.396132+0000) 2023-10-19T13:00:53.229 INFO:journalctl@ceph.osd.3.smithi046.stdout:Oct 19 13:00:52 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-3[125604]: 2023-10-19T13:00:52.881+0000 7ffa09133700 -1 osd.3 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:27.353297+0000 front 2023-10-19T13:00:27.353413+0000 (oldest deadline 2023-10-19T13:00:52.053463+0000) 2023-10-19T13:00:53.587 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:00:53 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:00:53.300+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:28.496192+0000 front 2023-10-19T13:00:28.496224+0000 (oldest deadline 2023-10-19T13:00:51.396132+0000) 2023-10-19T13:00:53.880 INFO:journalctl@ceph.osd.5.smithi195.stdout:Oct 19 13:00:53 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-5[148917]: 2023-10-19T13:00:53.412+0000 7fa34d80a700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:28.872341+0000 front 2023-10-19T13:00:28.872501+0000 (oldest deadline 2023-10-19T13:00:52.972362+0000) 2023-10-19T13:00:53.880 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:00:53 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:00:53.585+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:27.021692+0000 front 2023-10-19T13:00:27.021669+0000 (oldest deadline 2023-10-19T13:00:52.921759+0000) 2023-10-19T13:00:54.228 INFO:journalctl@ceph.osd.3.smithi046.stdout:Oct 19 13:00:53 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-3[125604]: 2023-10-19T13:00:53.912+0000 7ffa09133700 -1 osd.3 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:27.353297+0000 front 2023-10-19T13:00:27.353413+0000 (oldest deadline 2023-10-19T13:00:52.053463+0000) 2023-10-19T13:00:54.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:00:53 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:00:53.885+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:29.654587+0000 front 2023-10-19T13:00:29.654675+0000 (oldest deadline 2023-10-19T13:00:53.154854+0000) 2023-10-19T13:00:54.587 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:00:54 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:00:54.283+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:28.496192+0000 front 2023-10-19T13:00:28.496224+0000 (oldest deadline 2023-10-19T13:00:51.396132+0000) 2023-10-19T13:00:54.880 INFO:journalctl@ceph.osd.5.smithi195.stdout:Oct 19 13:00:54 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-5[148917]: 2023-10-19T13:00:54.396+0000 7fa34d80a700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:28.872341+0000 front 2023-10-19T13:00:28.872501+0000 (oldest deadline 2023-10-19T13:00:52.972362+0000) 2023-10-19T13:00:54.880 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:00:54 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:00:54.625+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:27.021692+0000 front 2023-10-19T13:00:27.021669+0000 (oldest deadline 2023-10-19T13:00:52.921759+0000) 2023-10-19T13:00:55.228 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:00:54 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:00:54.925+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:29.654587+0000 front 2023-10-19T13:00:29.654675+0000 (oldest deadline 2023-10-19T13:00:53.154854+0000) 2023-10-19T13:00:55.587 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:00:55 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:00:55.327+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:28.496192+0000 front 2023-10-19T13:00:28.496224+0000 (oldest deadline 2023-10-19T13:00:51.396132+0000) 2023-10-19T13:00:55.630 INFO:journalctl@ceph.osd.5.smithi195.stdout:Oct 19 13:00:55 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-5[148917]: 2023-10-19T13:00:55.419+0000 7fa34d80a700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:28.872341+0000 front 2023-10-19T13:00:28.872501+0000 (oldest deadline 2023-10-19T13:00:52.972362+0000) 2023-10-19T13:00:55.630 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:00:55 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T13:00:55.268+0000 7ff1ce306700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:29.065630+0000 front 2023-10-19T13:00:29.065546+0000 (oldest deadline 2023-10-19T13:00:54.365627+0000) 2023-10-19T13:00:55.728 INFO:journalctl@ceph.osd.3.smithi046.stdout:Oct 19 13:00:55 smithi046 bash[176356]: ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-3 2023-10-19T13:00:56.130 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:00:55 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:00:55.635+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:27.021692+0000 front 2023-10-19T13:00:27.021669+0000 (oldest deadline 2023-10-19T13:00:52.921759+0000) 2023-10-19T13:00:56.228 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:00:55 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:00:55.892+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:29.654587+0000 front 2023-10-19T13:00:29.654675+0000 (oldest deadline 2023-10-19T13:00:53.154854+0000) 2023-10-19T13:00:56.630 INFO:journalctl@ceph.osd.5.smithi195.stdout:Oct 19 13:00:56 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-5[148917]: 2023-10-19T13:00:56.386+0000 7fa34d80a700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:28.872341+0000 front 2023-10-19T13:00:28.872501+0000 (oldest deadline 2023-10-19T13:00:52.972362+0000) 2023-10-19T13:00:56.630 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:00:56 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T13:00:56.227+0000 7ff1ce306700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:29.065630+0000 front 2023-10-19T13:00:29.065546+0000 (oldest deadline 2023-10-19T13:00:54.365627+0000) 2023-10-19T13:00:56.837 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:00:56 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:00:56.358+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:28.496192+0000 front 2023-10-19T13:00:28.496224+0000 (oldest deadline 2023-10-19T13:00:51.396132+0000) 2023-10-19T13:00:57.130 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:00:56 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:00:56.646+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:27.021692+0000 front 2023-10-19T13:00:27.021669+0000 (oldest deadline 2023-10-19T13:00:52.921759+0000) 2023-10-19T13:00:57.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:00:56 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:00:56.915+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:29.654587+0000 front 2023-10-19T13:00:29.654675+0000 (oldest deadline 2023-10-19T13:00:53.154854+0000) 2023-10-19T13:00:57.469 DEBUG:teuthology.orchestra.run.smithi046:> sudo pkill -f 'journalctl -f -n 0 -u ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@osd.3.service' 2023-10-19T13:00:57.533 INFO:journalctl@ceph.osd.3.smithi046.stdout:Oct 19 13:00:57 smithi046 systemd[1]: ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@osd.3.service: Succeeded. 2023-10-19T13:00:57.534 INFO:journalctl@ceph.osd.3.smithi046.stdout:Oct 19 13:00:57 smithi046 systemd[1]: Stopped Ceph osd.3 for 96a8be3c-6e7b-11ee-8db6-212e2dc638e7. 2023-10-19T13:00:57.565 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-19T13:00:57.566 INFO:tasks.cephadm.osd.3:Stopped osd.3 2023-10-19T13:00:57.566 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2023-10-19T13:00:57.566 DEBUG:teuthology.orchestra.run.smithi157:> sudo systemctl stop ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@osd.4 2023-10-19T13:00:57.630 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:00:57 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T13:00:57.215+0000 7ff1ce306700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:29.065630+0000 front 2023-10-19T13:00:29.065546+0000 (oldest deadline 2023-10-19T13:00:54.365627+0000) 2023-10-19T13:00:57.630 INFO:journalctl@ceph.osd.5.smithi195.stdout:Oct 19 13:00:57 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-5[148917]: 2023-10-19T13:00:57.377+0000 7fa34d80a700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:28.872341+0000 front 2023-10-19T13:00:28.872501+0000 (oldest deadline 2023-10-19T13:00:52.972362+0000) 2023-10-19T13:00:57.837 INFO:journalctl@ceph.osd.4.smithi157.stdout:Oct 19 13:00:57 smithi157 systemd[1]: Stopping Ceph osd.4 for 96a8be3c-6e7b-11ee-8db6-212e2dc638e7... 2023-10-19T13:00:57.838 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:00:57 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:00:57.380+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:28.496192+0000 front 2023-10-19T13:00:28.496224+0000 (oldest deadline 2023-10-19T13:00:51.396132+0000) 2023-10-19T13:00:58.130 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:00:57 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:00:57.634+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:27.021692+0000 front 2023-10-19T13:00:27.021669+0000 (oldest deadline 2023-10-19T13:00:52.921759+0000) 2023-10-19T13:00:58.228 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:00:57 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:00:57.889+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:29.654587+0000 front 2023-10-19T13:00:29.654675+0000 (oldest deadline 2023-10-19T13:00:53.154854+0000) 2023-10-19T13:00:58.337 INFO:journalctl@ceph.osd.4.smithi157.stdout:Oct 19 13:00:57 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-4[147065]: 2023-10-19T13:00:57.932+0000 7fd1ba7ff700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-19T13:00:58.338 INFO:journalctl@ceph.osd.4.smithi157.stdout:Oct 19 13:00:57 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-4[147065]: 2023-10-19T13:00:57.932+0000 7fd1ba7ff700 -1 osd.4 96 *** Got signal Terminated *** 2023-10-19T13:00:58.338 INFO:journalctl@ceph.osd.4.smithi157.stdout:Oct 19 13:00:57 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-4[147065]: 2023-10-19T13:00:57.932+0000 7fd1ba7ff700 -1 osd.4 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-19T13:00:58.630 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:00:58 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T13:00:58.198+0000 7ff1ce306700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:29.065630+0000 front 2023-10-19T13:00:29.065546+0000 (oldest deadline 2023-10-19T13:00:54.365627+0000) 2023-10-19T13:00:58.631 INFO:journalctl@ceph.osd.5.smithi195.stdout:Oct 19 13:00:58 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-5[148917]: 2023-10-19T13:00:58.416+0000 7fa34d80a700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:28.872341+0000 front 2023-10-19T13:00:28.872501+0000 (oldest deadline 2023-10-19T13:00:52.972362+0000) 2023-10-19T13:00:58.837 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:00:58 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:00:58.399+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:28.496192+0000 front 2023-10-19T13:00:28.496224+0000 (oldest deadline 2023-10-19T13:00:51.396132+0000) 2023-10-19T13:00:59.130 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:00:58 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:00:58.677+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:27.021692+0000 front 2023-10-19T13:00:27.021669+0000 (oldest deadline 2023-10-19T13:00:52.921759+0000) 2023-10-19T13:00:59.228 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:00:58 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:00:58.885+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:29.654587+0000 front 2023-10-19T13:00:29.654675+0000 (oldest deadline 2023-10-19T13:00:53.154854+0000) 2023-10-19T13:00:59.630 INFO:journalctl@ceph.osd.5.smithi195.stdout:Oct 19 13:00:59 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-5[148917]: 2023-10-19T13:00:59.413+0000 7fa34d80a700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:28.872341+0000 front 2023-10-19T13:00:28.872501+0000 (oldest deadline 2023-10-19T13:00:52.972362+0000) 2023-10-19T13:00:59.630 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:00:59 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T13:00:59.165+0000 7ff1ce306700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:29.065630+0000 front 2023-10-19T13:00:29.065546+0000 (oldest deadline 2023-10-19T13:00:54.365627+0000) 2023-10-19T13:00:59.837 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:00:59 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:00:59.404+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:28.496192+0000 front 2023-10-19T13:00:28.496224+0000 (oldest deadline 2023-10-19T13:00:51.396132+0000) 2023-10-19T13:01:00.130 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:00:59 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:00:59.628+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:27.021692+0000 front 2023-10-19T13:00:27.021669+0000 (oldest deadline 2023-10-19T13:00:52.921759+0000) 2023-10-19T13:01:00.228 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:00:59 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:00:59.874+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:29.654587+0000 front 2023-10-19T13:00:29.654675+0000 (oldest deadline 2023-10-19T13:00:53.154854+0000) 2023-10-19T13:01:00.587 INFO:journalctl@ceph.osd.7.smithi157.stdout:Oct 19 13:01:00 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-7[155800]: 2023-10-19T13:01:00.331+0000 7fa0f9071700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:35.451625+0000 front 2023-10-19T13:00:35.451648+0000 (oldest deadline 2023-10-19T13:00:59.551942+0000) 2023-10-19T13:01:00.588 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:00 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:00.399+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:28.496192+0000 front 2023-10-19T13:00:28.496224+0000 (oldest deadline 2023-10-19T13:00:51.396132+0000) 2023-10-19T13:01:00.588 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:00 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:00.399+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:35.497430+0000 front 2023-10-19T13:00:35.497454+0000 (oldest deadline 2023-10-19T13:01:00.197598+0000) 2023-10-19T13:01:00.630 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:01:00 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T13:01:00.207+0000 7ff1ce306700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:29.065630+0000 front 2023-10-19T13:00:29.065546+0000 (oldest deadline 2023-10-19T13:00:54.365627+0000) 2023-10-19T13:01:00.630 INFO:journalctl@ceph.osd.5.smithi195.stdout:Oct 19 13:01:00 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-5[148917]: 2023-10-19T13:01:00.446+0000 7fa34d80a700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:28.872341+0000 front 2023-10-19T13:00:28.872501+0000 (oldest deadline 2023-10-19T13:00:52.972362+0000) 2023-10-19T13:01:01.130 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:00 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:00.671+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:27.021692+0000 front 2023-10-19T13:00:27.021669+0000 (oldest deadline 2023-10-19T13:00:52.921759+0000) 2023-10-19T13:01:01.228 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:00 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:00.889+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:29.654587+0000 front 2023-10-19T13:00:29.654675+0000 (oldest deadline 2023-10-19T13:00:53.154854+0000) 2023-10-19T13:01:01.483 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:01:01 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T13:01:01.226+0000 7ff1ce306700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:29.065630+0000 front 2023-10-19T13:00:29.065546+0000 (oldest deadline 2023-10-19T13:00:54.365627+0000) 2023-10-19T13:01:01.604 INFO:journalctl@ceph.osd.7.smithi157.stdout:Oct 19 13:01:01 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-7[155800]: 2023-10-19T13:01:01.336+0000 7fa0f9071700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:35.451625+0000 front 2023-10-19T13:00:35.451648+0000 (oldest deadline 2023-10-19T13:00:59.551942+0000) 2023-10-19T13:01:01.605 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:01 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:01.367+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:28.496192+0000 front 2023-10-19T13:00:28.496224+0000 (oldest deadline 2023-10-19T13:00:51.396132+0000) 2023-10-19T13:01:01.605 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:01 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:01.367+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:35.497430+0000 front 2023-10-19T13:00:35.497454+0000 (oldest deadline 2023-10-19T13:01:00.197598+0000) 2023-10-19T13:01:01.880 INFO:journalctl@ceph.osd.5.smithi195.stdout:Oct 19 13:01:01 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-5[148917]: 2023-10-19T13:01:01.481+0000 7fa34d80a700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:28.872341+0000 front 2023-10-19T13:00:28.872501+0000 (oldest deadline 2023-10-19T13:00:52.972362+0000) 2023-10-19T13:01:01.881 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:01 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:01.692+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:27.021692+0000 front 2023-10-19T13:00:27.021669+0000 (oldest deadline 2023-10-19T13:00:52.921759+0000) 2023-10-19T13:01:02.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:01 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:01.883+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:29.654587+0000 front 2023-10-19T13:00:29.654675+0000 (oldest deadline 2023-10-19T13:00:53.154854+0000) 2023-10-19T13:01:02.498 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:01:02 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T13:01:02.239+0000 7ff1ce306700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:29.065630+0000 front 2023-10-19T13:00:29.065546+0000 (oldest deadline 2023-10-19T13:00:54.365627+0000) 2023-10-19T13:01:02.837 INFO:journalctl@ceph.osd.7.smithi157.stdout:Oct 19 13:01:02 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-7[155800]: 2023-10-19T13:01:02.360+0000 7fa0f9071700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:35.451625+0000 front 2023-10-19T13:00:35.451648+0000 (oldest deadline 2023-10-19T13:00:59.551942+0000) 2023-10-19T13:01:02.838 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:02 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:02.398+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:28.496192+0000 front 2023-10-19T13:00:28.496224+0000 (oldest deadline 2023-10-19T13:00:51.396132+0000) 2023-10-19T13:01:02.839 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:02 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:02.398+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:35.497430+0000 front 2023-10-19T13:00:35.497454+0000 (oldest deadline 2023-10-19T13:01:00.197598+0000) 2023-10-19T13:01:02.880 INFO:journalctl@ceph.osd.5.smithi195.stdout:Oct 19 13:01:02 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-5[148917]: 2023-10-19T13:01:02.495+0000 7fa34d80a700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:28.872341+0000 front 2023-10-19T13:00:28.872501+0000 (oldest deadline 2023-10-19T13:00:52.972362+0000) 2023-10-19T13:01:02.881 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:02 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:02.673+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:27.021692+0000 front 2023-10-19T13:00:27.021669+0000 (oldest deadline 2023-10-19T13:00:52.921759+0000) 2023-10-19T13:01:02.919 INFO:journalctl@ceph.osd.6.smithi046.stdout:Oct 19 13:01:02 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-6[133654]: 2023-10-19T13:01:02.493+0000 7f7c3a553700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:38.243596+0000 front 2023-10-19T13:00:38.243703+0000 (oldest deadline 2023-10-19T13:01:01.743611+0000) 2023-10-19T13:01:03.228 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:02 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:02.916+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:29.654587+0000 front 2023-10-19T13:00:29.654675+0000 (oldest deadline 2023-10-19T13:00:53.154854+0000) 2023-10-19T13:01:03.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:02 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:02.916+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:36.056505+0000 front 2023-10-19T13:00:36.056472+0000 (oldest deadline 2023-10-19T13:01:01.956648+0000) 2023-10-19T13:01:03.630 INFO:journalctl@ceph.osd.5.smithi195.stdout:Oct 19 13:01:03 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-5[148917]: 2023-10-19T13:01:03.448+0000 7fa34d80a700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:28.872341+0000 front 2023-10-19T13:00:28.872501+0000 (oldest deadline 2023-10-19T13:00:52.972362+0000) 2023-10-19T13:01:03.631 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:01:03 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T13:01:03.201+0000 7ff1ce306700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:29.065630+0000 front 2023-10-19T13:00:29.065546+0000 (oldest deadline 2023-10-19T13:00:54.365627+0000) 2023-10-19T13:01:03.729 INFO:journalctl@ceph.osd.6.smithi046.stdout:Oct 19 13:01:03 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-6[133654]: 2023-10-19T13:01:03.449+0000 7f7c3a553700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:38.243596+0000 front 2023-10-19T13:00:38.243703+0000 (oldest deadline 2023-10-19T13:01:01.743611+0000) 2023-10-19T13:01:03.838 INFO:journalctl@ceph.osd.7.smithi157.stdout:Oct 19 13:01:03 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-7[155800]: 2023-10-19T13:01:03.379+0000 7fa0f9071700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:35.451625+0000 front 2023-10-19T13:00:35.451648+0000 (oldest deadline 2023-10-19T13:00:59.551942+0000) 2023-10-19T13:01:03.838 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:03 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:03.445+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:28.496192+0000 front 2023-10-19T13:00:28.496224+0000 (oldest deadline 2023-10-19T13:00:51.396132+0000) 2023-10-19T13:01:03.838 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:03 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:03.445+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:35.497430+0000 front 2023-10-19T13:00:35.497454+0000 (oldest deadline 2023-10-19T13:01:00.197598+0000) 2023-10-19T13:01:04.130 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:03 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:03.660+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:27.021692+0000 front 2023-10-19T13:00:27.021669+0000 (oldest deadline 2023-10-19T13:00:52.921759+0000) 2023-10-19T13:01:04.130 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:03 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:03.660+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:38.624261+0000 front 2023-10-19T13:00:38.624276+0000 (oldest deadline 2023-10-19T13:01:03.324346+0000) 2023-10-19T13:01:04.228 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:03 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:03.907+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:29.654587+0000 front 2023-10-19T13:00:29.654675+0000 (oldest deadline 2023-10-19T13:00:53.154854+0000) 2023-10-19T13:01:04.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:03 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:03.907+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:36.056505+0000 front 2023-10-19T13:00:36.056472+0000 (oldest deadline 2023-10-19T13:01:01.956648+0000) 2023-10-19T13:01:04.337 INFO:journalctl@ceph.osd.4.smithi157.stdout:Oct 19 13:01:03 smithi157 bash[177439]: ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-4 2023-10-19T13:01:04.492 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:01:04 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T13:01:04.202+0000 7ff1ce306700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:29.065630+0000 front 2023-10-19T13:00:29.065546+0000 (oldest deadline 2023-10-19T13:00:54.365627+0000) 2023-10-19T13:01:04.837 INFO:journalctl@ceph.osd.7.smithi157.stdout:Oct 19 13:01:04 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-7[155800]: 2023-10-19T13:01:04.389+0000 7fa0f9071700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:35.451625+0000 front 2023-10-19T13:00:35.451648+0000 (oldest deadline 2023-10-19T13:00:59.551942+0000) 2023-10-19T13:01:04.838 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:04 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:04.453+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:28.496192+0000 front 2023-10-19T13:00:28.496224+0000 (oldest deadline 2023-10-19T13:00:51.396132+0000) 2023-10-19T13:01:04.838 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:04 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:04.453+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:35.497430+0000 front 2023-10-19T13:00:35.497454+0000 (oldest deadline 2023-10-19T13:01:00.197598+0000) 2023-10-19T13:01:04.880 INFO:journalctl@ceph.osd.5.smithi195.stdout:Oct 19 13:01:04 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-5[148917]: 2023-10-19T13:01:04.489+0000 7fa34d80a700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:28.872341+0000 front 2023-10-19T13:00:28.872501+0000 (oldest deadline 2023-10-19T13:00:52.972362+0000) 2023-10-19T13:01:04.880 INFO:journalctl@ceph.osd.5.smithi195.stdout:Oct 19 13:01:04 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-5[148917]: 2023-10-19T13:01:04.489+0000 7fa34d80a700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:38.273572+0000 front 2023-10-19T13:00:38.273613+0000 (oldest deadline 2023-10-19T13:01:03.474267+0000) 2023-10-19T13:01:04.881 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:04 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:04.683+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:27.021692+0000 front 2023-10-19T13:00:27.021669+0000 (oldest deadline 2023-10-19T13:00:52.921759+0000) 2023-10-19T13:01:04.881 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:04 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:04.684+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:38.624261+0000 front 2023-10-19T13:00:38.624276+0000 (oldest deadline 2023-10-19T13:01:03.324346+0000) 2023-10-19T13:01:04.945 INFO:journalctl@ceph.osd.6.smithi046.stdout:Oct 19 13:01:04 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-6[133654]: 2023-10-19T13:01:04.490+0000 7f7c3a553700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:38.243596+0000 front 2023-10-19T13:00:38.243703+0000 (oldest deadline 2023-10-19T13:01:01.743611+0000) 2023-10-19T13:01:05.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:04 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:04.942+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:29.654587+0000 front 2023-10-19T13:00:29.654675+0000 (oldest deadline 2023-10-19T13:00:53.154854+0000) 2023-10-19T13:01:05.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:04 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:04.942+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:36.056505+0000 front 2023-10-19T13:00:36.056472+0000 (oldest deadline 2023-10-19T13:01:01.956648+0000) 2023-10-19T13:01:05.276 DEBUG:teuthology.orchestra.run.smithi157:> sudo pkill -f 'journalctl -f -n 0 -u ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@osd.4.service' 2023-10-19T13:01:05.318 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-19T13:01:05.318 INFO:tasks.cephadm.osd.4:Stopped osd.4 2023-10-19T13:01:05.318 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2023-10-19T13:01:05.319 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@osd.5 2023-10-19T13:01:05.497 INFO:journalctl@ceph.osd.5.smithi195.stdout:Oct 19 13:01:05 smithi195 systemd[1]: Stopping Ceph osd.5 for 96a8be3c-6e7b-11ee-8db6-212e2dc638e7... 2023-10-19T13:01:05.497 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:01:05 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T13:01:05.207+0000 7ff1ce306700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:29.065630+0000 front 2023-10-19T13:00:29.065546+0000 (oldest deadline 2023-10-19T13:00:54.365627+0000) 2023-10-19T13:01:05.587 INFO:journalctl@ceph.osd.7.smithi157.stdout:Oct 19 13:01:05 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-7[155800]: 2023-10-19T13:01:05.349+0000 7fa0f9071700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:35.451625+0000 front 2023-10-19T13:00:35.451648+0000 (oldest deadline 2023-10-19T13:00:59.551942+0000) 2023-10-19T13:01:05.588 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:05 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:05.436+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:28.496192+0000 front 2023-10-19T13:00:28.496224+0000 (oldest deadline 2023-10-19T13:00:51.396132+0000) 2023-10-19T13:01:05.588 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:05 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:05.436+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:35.497430+0000 front 2023-10-19T13:00:35.497454+0000 (oldest deadline 2023-10-19T13:01:00.197598+0000) 2023-10-19T13:01:05.880 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:05 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:05.654+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:27.021692+0000 front 2023-10-19T13:00:27.021669+0000 (oldest deadline 2023-10-19T13:00:52.921759+0000) 2023-10-19T13:01:05.880 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:05 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:05.654+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:38.624261+0000 front 2023-10-19T13:00:38.624276+0000 (oldest deadline 2023-10-19T13:01:03.324346+0000) 2023-10-19T13:01:05.881 INFO:journalctl@ceph.osd.5.smithi195.stdout:Oct 19 13:01:05 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-5[148917]: 2023-10-19T13:01:05.493+0000 7fa34d80a700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:28.872341+0000 front 2023-10-19T13:00:28.872501+0000 (oldest deadline 2023-10-19T13:00:52.972362+0000) 2023-10-19T13:01:05.881 INFO:journalctl@ceph.osd.5.smithi195.stdout:Oct 19 13:01:05 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-5[148917]: 2023-10-19T13:01:05.493+0000 7fa34d80a700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:38.273572+0000 front 2023-10-19T13:00:38.273613+0000 (oldest deadline 2023-10-19T13:01:03.474267+0000) 2023-10-19T13:01:05.881 INFO:journalctl@ceph.osd.5.smithi195.stdout:Oct 19 13:01:05 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-5[148917]: 2023-10-19T13:01:05.685+0000 7fa352216700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-19T13:01:05.881 INFO:journalctl@ceph.osd.5.smithi195.stdout:Oct 19 13:01:05 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-5[148917]: 2023-10-19T13:01:05.685+0000 7fa352216700 -1 osd.5 96 *** Got signal Terminated *** 2023-10-19T13:01:05.882 INFO:journalctl@ceph.osd.5.smithi195.stdout:Oct 19 13:01:05 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-5[148917]: 2023-10-19T13:01:05.685+0000 7fa352216700 -1 osd.5 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-19T13:01:05.899 INFO:journalctl@ceph.osd.6.smithi046.stdout:Oct 19 13:01:05 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-6[133654]: 2023-10-19T13:01:05.498+0000 7f7c3a553700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:38.243596+0000 front 2023-10-19T13:00:38.243703+0000 (oldest deadline 2023-10-19T13:01:01.743611+0000) 2023-10-19T13:01:06.228 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:05 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:05.896+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:29.654587+0000 front 2023-10-19T13:00:29.654675+0000 (oldest deadline 2023-10-19T13:00:53.154854+0000) 2023-10-19T13:01:06.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:05 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:05.896+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:36.056505+0000 front 2023-10-19T13:00:36.056472+0000 (oldest deadline 2023-10-19T13:01:01.956648+0000) 2023-10-19T13:01:06.483 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:01:06 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T13:01:06.207+0000 7ff1ce306700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:29.065630+0000 front 2023-10-19T13:00:29.065546+0000 (oldest deadline 2023-10-19T13:00:54.365627+0000) 2023-10-19T13:01:06.837 INFO:journalctl@ceph.osd.7.smithi157.stdout:Oct 19 13:01:06 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-7[155800]: 2023-10-19T13:01:06.344+0000 7fa0f9071700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:35.451625+0000 front 2023-10-19T13:00:35.451648+0000 (oldest deadline 2023-10-19T13:00:59.551942+0000) 2023-10-19T13:01:06.838 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:06 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:06.409+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:28.496192+0000 front 2023-10-19T13:00:28.496224+0000 (oldest deadline 2023-10-19T13:00:51.396132+0000) 2023-10-19T13:01:06.838 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:06 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:06.409+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:35.497430+0000 front 2023-10-19T13:00:35.497454+0000 (oldest deadline 2023-10-19T13:01:00.197598+0000) 2023-10-19T13:01:06.880 INFO:journalctl@ceph.osd.5.smithi195.stdout:Oct 19 13:01:06 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-5[148917]: 2023-10-19T13:01:06.479+0000 7fa34d80a700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:28.872341+0000 front 2023-10-19T13:00:28.872501+0000 (oldest deadline 2023-10-19T13:00:52.972362+0000) 2023-10-19T13:01:06.881 INFO:journalctl@ceph.osd.5.smithi195.stdout:Oct 19 13:01:06 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-5[148917]: 2023-10-19T13:01:06.479+0000 7fa34d80a700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:38.273572+0000 front 2023-10-19T13:00:38.273613+0000 (oldest deadline 2023-10-19T13:01:03.474267+0000) 2023-10-19T13:01:06.881 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:06 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:06.613+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:27.021692+0000 front 2023-10-19T13:00:27.021669+0000 (oldest deadline 2023-10-19T13:00:52.921759+0000) 2023-10-19T13:01:06.882 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:06 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:06.613+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:38.624261+0000 front 2023-10-19T13:00:38.624276+0000 (oldest deadline 2023-10-19T13:01:03.324346+0000) 2023-10-19T13:01:06.882 INFO:journalctl@ceph.osd.6.smithi046.stdout:Oct 19 13:01:06 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-6[133654]: 2023-10-19T13:01:06.484+0000 7f7c3a553700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:38.243596+0000 front 2023-10-19T13:00:38.243703+0000 (oldest deadline 2023-10-19T13:01:01.743611+0000) 2023-10-19T13:01:07.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:06 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:06.879+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:29.654587+0000 front 2023-10-19T13:00:29.654675+0000 (oldest deadline 2023-10-19T13:00:53.154854+0000) 2023-10-19T13:01:07.230 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:06 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:06.879+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:36.056505+0000 front 2023-10-19T13:00:36.056472+0000 (oldest deadline 2023-10-19T13:01:01.956648+0000) 2023-10-19T13:01:07.488 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:01:07 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T13:01:07.230+0000 7ff1ce306700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:29.065630+0000 front 2023-10-19T13:00:29.065546+0000 (oldest deadline 2023-10-19T13:00:54.365627+0000) 2023-10-19T13:01:07.837 INFO:journalctl@ceph.osd.7.smithi157.stdout:Oct 19 13:01:07 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-7[155800]: 2023-10-19T13:01:07.379+0000 7fa0f9071700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:35.451625+0000 front 2023-10-19T13:00:35.451648+0000 (oldest deadline 2023-10-19T13:00:59.551942+0000) 2023-10-19T13:01:07.838 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:07 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:07.388+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:28.496192+0000 front 2023-10-19T13:00:28.496224+0000 (oldest deadline 2023-10-19T13:00:51.396132+0000) 2023-10-19T13:01:07.838 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:07 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:07.388+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:35.497430+0000 front 2023-10-19T13:00:35.497454+0000 (oldest deadline 2023-10-19T13:01:00.197598+0000) 2023-10-19T13:01:07.880 INFO:journalctl@ceph.osd.5.smithi195.stdout:Oct 19 13:01:07 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-5[148917]: 2023-10-19T13:01:07.485+0000 7fa34d80a700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:28.872341+0000 front 2023-10-19T13:00:28.872501+0000 (oldest deadline 2023-10-19T13:00:52.972362+0000) 2023-10-19T13:01:07.880 INFO:journalctl@ceph.osd.5.smithi195.stdout:Oct 19 13:01:07 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-5[148917]: 2023-10-19T13:01:07.485+0000 7fa34d80a700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:38.273572+0000 front 2023-10-19T13:00:38.273613+0000 (oldest deadline 2023-10-19T13:01:03.474267+0000) 2023-10-19T13:01:07.881 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:07 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:07.607+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:27.021692+0000 front 2023-10-19T13:00:27.021669+0000 (oldest deadline 2023-10-19T13:00:52.921759+0000) 2023-10-19T13:01:07.881 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:07 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:07.607+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:38.624261+0000 front 2023-10-19T13:00:38.624276+0000 (oldest deadline 2023-10-19T13:01:03.324346+0000) 2023-10-19T13:01:07.920 INFO:journalctl@ceph.osd.6.smithi046.stdout:Oct 19 13:01:07 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-6[133654]: 2023-10-19T13:01:07.513+0000 7f7c3a553700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:38.243596+0000 front 2023-10-19T13:00:38.243703+0000 (oldest deadline 2023-10-19T13:01:01.743611+0000) 2023-10-19T13:01:08.228 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:07 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:07.917+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:29.654587+0000 front 2023-10-19T13:00:29.654675+0000 (oldest deadline 2023-10-19T13:00:53.154854+0000) 2023-10-19T13:01:08.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:07 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:07.917+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:36.056505+0000 front 2023-10-19T13:00:36.056472+0000 (oldest deadline 2023-10-19T13:01:01.956648+0000) 2023-10-19T13:01:08.516 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:01:08 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T13:01:08.235+0000 7ff1ce306700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:29.065630+0000 front 2023-10-19T13:00:29.065546+0000 (oldest deadline 2023-10-19T13:00:54.365627+0000) 2023-10-19T13:01:08.837 INFO:journalctl@ceph.osd.7.smithi157.stdout:Oct 19 13:01:08 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-7[155800]: 2023-10-19T13:01:08.398+0000 7fa0f9071700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:35.451625+0000 front 2023-10-19T13:00:35.451648+0000 (oldest deadline 2023-10-19T13:00:59.551942+0000) 2023-10-19T13:01:08.838 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:08 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:08.350+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:28.496192+0000 front 2023-10-19T13:00:28.496224+0000 (oldest deadline 2023-10-19T13:00:51.396132+0000) 2023-10-19T13:01:08.838 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:08 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:08.350+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:35.497430+0000 front 2023-10-19T13:00:35.497454+0000 (oldest deadline 2023-10-19T13:01:00.197598+0000) 2023-10-19T13:01:08.880 INFO:journalctl@ceph.osd.5.smithi195.stdout:Oct 19 13:01:08 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-5[148917]: 2023-10-19T13:01:08.514+0000 7fa34d80a700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:28.872341+0000 front 2023-10-19T13:00:28.872501+0000 (oldest deadline 2023-10-19T13:00:52.972362+0000) 2023-10-19T13:01:08.880 INFO:journalctl@ceph.osd.5.smithi195.stdout:Oct 19 13:01:08 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-5[148917]: 2023-10-19T13:01:08.514+0000 7fa34d80a700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:38.273572+0000 front 2023-10-19T13:00:38.273613+0000 (oldest deadline 2023-10-19T13:01:03.474267+0000) 2023-10-19T13:01:08.880 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:08 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:08.634+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:27.021692+0000 front 2023-10-19T13:00:27.021669+0000 (oldest deadline 2023-10-19T13:00:52.921759+0000) 2023-10-19T13:01:08.881 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:08 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:08.634+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:38.624261+0000 front 2023-10-19T13:00:38.624276+0000 (oldest deadline 2023-10-19T13:01:03.324346+0000) 2023-10-19T13:01:08.881 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:08 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:08.634+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:43.324834+0000 front 2023-10-19T13:00:43.324935+0000 (oldest deadline 2023-10-19T13:01:08.624965+0000) 2023-10-19T13:01:08.969 INFO:journalctl@ceph.osd.6.smithi046.stdout:Oct 19 13:01:08 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-6[133654]: 2023-10-19T13:01:08.541+0000 7f7c3a553700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:38.243596+0000 front 2023-10-19T13:00:38.243703+0000 (oldest deadline 2023-10-19T13:01:01.743611+0000) 2023-10-19T13:01:09.228 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:08 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:08.966+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:29.654587+0000 front 2023-10-19T13:00:29.654675+0000 (oldest deadline 2023-10-19T13:00:53.154854+0000) 2023-10-19T13:01:09.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:08 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:08.966+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:36.056505+0000 front 2023-10-19T13:00:36.056472+0000 (oldest deadline 2023-10-19T13:01:01.956648+0000) 2023-10-19T13:01:09.554 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:01:09 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T13:01:09.188+0000 7ff1ce306700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:29.065630+0000 front 2023-10-19T13:00:29.065546+0000 (oldest deadline 2023-10-19T13:00:54.365627+0000) 2023-10-19T13:01:09.837 INFO:journalctl@ceph.osd.7.smithi157.stdout:Oct 19 13:01:09 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-7[155800]: 2023-10-19T13:01:09.378+0000 7fa0f9071700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:35.451625+0000 front 2023-10-19T13:00:35.451648+0000 (oldest deadline 2023-10-19T13:00:59.551942+0000) 2023-10-19T13:01:09.838 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:09 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:09.384+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:28.496192+0000 front 2023-10-19T13:00:28.496224+0000 (oldest deadline 2023-10-19T13:00:51.396132+0000) 2023-10-19T13:01:09.838 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:09 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:09.384+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:35.497430+0000 front 2023-10-19T13:00:35.497454+0000 (oldest deadline 2023-10-19T13:01:00.197598+0000) 2023-10-19T13:01:09.838 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:09 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:09.384+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:44.799397+0000 front 2023-10-19T13:00:44.799340+0000 (oldest deadline 2023-10-19T13:01:08.899496+0000) 2023-10-19T13:01:09.880 INFO:journalctl@ceph.osd.5.smithi195.stdout:Oct 19 13:01:09 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-5[148917]: 2023-10-19T13:01:09.550+0000 7fa34d80a700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:28.872341+0000 front 2023-10-19T13:00:28.872501+0000 (oldest deadline 2023-10-19T13:00:52.972362+0000) 2023-10-19T13:01:09.880 INFO:journalctl@ceph.osd.5.smithi195.stdout:Oct 19 13:01:09 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-5[148917]: 2023-10-19T13:01:09.550+0000 7fa34d80a700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:38.273572+0000 front 2023-10-19T13:00:38.273613+0000 (oldest deadline 2023-10-19T13:01:03.474267+0000) 2023-10-19T13:01:09.881 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:09 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:09.681+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:27.021692+0000 front 2023-10-19T13:00:27.021669+0000 (oldest deadline 2023-10-19T13:00:52.921759+0000) 2023-10-19T13:01:09.881 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:09 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:09.681+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:38.624261+0000 front 2023-10-19T13:00:38.624276+0000 (oldest deadline 2023-10-19T13:01:03.324346+0000) 2023-10-19T13:01:09.881 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:09 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:09.681+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:43.324834+0000 front 2023-10-19T13:00:43.324935+0000 (oldest deadline 2023-10-19T13:01:08.624965+0000) 2023-10-19T13:01:09.928 INFO:journalctl@ceph.osd.6.smithi046.stdout:Oct 19 13:01:09 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-6[133654]: 2023-10-19T13:01:09.519+0000 7f7c3a553700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:38.243596+0000 front 2023-10-19T13:00:38.243703+0000 (oldest deadline 2023-10-19T13:01:01.743611+0000) 2023-10-19T13:01:09.928 INFO:journalctl@ceph.osd.6.smithi046.stdout:Oct 19 13:01:09 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-6[133654]: 2023-10-19T13:01:09.519+0000 7f7c3a553700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:44.044985+0000 front 2023-10-19T13:00:44.044856+0000 (oldest deadline 2023-10-19T13:01:09.344996+0000) 2023-10-19T13:01:10.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:09 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:09.925+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:29.654587+0000 front 2023-10-19T13:00:29.654675+0000 (oldest deadline 2023-10-19T13:00:53.154854+0000) 2023-10-19T13:01:10.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:09 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:09.925+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:36.056505+0000 front 2023-10-19T13:00:36.056472+0000 (oldest deadline 2023-10-19T13:01:01.956648+0000) 2023-10-19T13:01:10.585 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:01:10 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T13:01:10.172+0000 7ff1ce306700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:29.065630+0000 front 2023-10-19T13:00:29.065546+0000 (oldest deadline 2023-10-19T13:00:54.365627+0000) 2023-10-19T13:01:10.837 INFO:journalctl@ceph.osd.7.smithi157.stdout:Oct 19 13:01:10 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-7[155800]: 2023-10-19T13:01:10.419+0000 7fa0f9071700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:35.451625+0000 front 2023-10-19T13:00:35.451648+0000 (oldest deadline 2023-10-19T13:00:59.551942+0000) 2023-10-19T13:01:10.837 INFO:journalctl@ceph.osd.7.smithi157.stdout:Oct 19 13:01:10 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-7[155800]: 2023-10-19T13:01:10.419+0000 7fa0f9071700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:44.253063+0000 front 2023-10-19T13:00:44.253109+0000 (oldest deadline 2023-10-19T13:01:09.553096+0000) 2023-10-19T13:01:10.838 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:10 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:10.380+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:28.496192+0000 front 2023-10-19T13:00:28.496224+0000 (oldest deadline 2023-10-19T13:00:51.396132+0000) 2023-10-19T13:01:10.838 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:10 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:10.380+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:35.497430+0000 front 2023-10-19T13:00:35.497454+0000 (oldest deadline 2023-10-19T13:01:00.197598+0000) 2023-10-19T13:01:10.839 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:10 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:10.380+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:44.799397+0000 front 2023-10-19T13:00:44.799340+0000 (oldest deadline 2023-10-19T13:01:08.899496+0000) 2023-10-19T13:01:10.880 INFO:journalctl@ceph.osd.5.smithi195.stdout:Oct 19 13:01:10 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-5[148917]: 2023-10-19T13:01:10.582+0000 7fa34d80a700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:28.872341+0000 front 2023-10-19T13:00:28.872501+0000 (oldest deadline 2023-10-19T13:00:52.972362+0000) 2023-10-19T13:01:10.880 INFO:journalctl@ceph.osd.5.smithi195.stdout:Oct 19 13:01:10 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-5[148917]: 2023-10-19T13:01:10.582+0000 7fa34d80a700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:38.273572+0000 front 2023-10-19T13:00:38.273613+0000 (oldest deadline 2023-10-19T13:01:03.474267+0000) 2023-10-19T13:01:10.881 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:10 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:10.716+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:27.021692+0000 front 2023-10-19T13:00:27.021669+0000 (oldest deadline 2023-10-19T13:00:52.921759+0000) 2023-10-19T13:01:10.881 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:10 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:10.716+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:38.624261+0000 front 2023-10-19T13:00:38.624276+0000 (oldest deadline 2023-10-19T13:01:03.324346+0000) 2023-10-19T13:01:10.881 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:10 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:10.716+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:43.324834+0000 front 2023-10-19T13:00:43.324935+0000 (oldest deadline 2023-10-19T13:01:08.624965+0000) 2023-10-19T13:01:10.906 INFO:journalctl@ceph.osd.6.smithi046.stdout:Oct 19 13:01:10 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-6[133654]: 2023-10-19T13:01:10.479+0000 7f7c3a553700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:38.243596+0000 front 2023-10-19T13:00:38.243703+0000 (oldest deadline 2023-10-19T13:01:01.743611+0000) 2023-10-19T13:01:10.906 INFO:journalctl@ceph.osd.6.smithi046.stdout:Oct 19 13:01:10 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-6[133654]: 2023-10-19T13:01:10.479+0000 7f7c3a553700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:44.044985+0000 front 2023-10-19T13:00:44.044856+0000 (oldest deadline 2023-10-19T13:01:09.344996+0000) 2023-10-19T13:01:11.228 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:10 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:10.904+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:29.654587+0000 front 2023-10-19T13:00:29.654675+0000 (oldest deadline 2023-10-19T13:00:53.154854+0000) 2023-10-19T13:01:11.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:10 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:10.904+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:36.056505+0000 front 2023-10-19T13:00:36.056472+0000 (oldest deadline 2023-10-19T13:01:01.956648+0000) 2023-10-19T13:01:11.539 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:01:11 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T13:01:11.132+0000 7ff1ce306700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:29.065630+0000 front 2023-10-19T13:00:29.065546+0000 (oldest deadline 2023-10-19T13:00:54.365627+0000) 2023-10-19T13:01:11.539 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:01:11 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T13:01:11.132+0000 7ff1ce306700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:43.167422+0000 front 2023-10-19T13:00:43.167454+0000 (oldest deadline 2023-10-19T13:01:10.768080+0000) 2023-10-19T13:01:11.837 INFO:journalctl@ceph.osd.7.smithi157.stdout:Oct 19 13:01:11 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-7[155800]: 2023-10-19T13:01:11.459+0000 7fa0f9071700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:35.451625+0000 front 2023-10-19T13:00:35.451648+0000 (oldest deadline 2023-10-19T13:00:59.551942+0000) 2023-10-19T13:01:11.837 INFO:journalctl@ceph.osd.7.smithi157.stdout:Oct 19 13:01:11 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-7[155800]: 2023-10-19T13:01:11.459+0000 7fa0f9071700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:44.253063+0000 front 2023-10-19T13:00:44.253109+0000 (oldest deadline 2023-10-19T13:01:09.553096+0000) 2023-10-19T13:01:11.838 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:11 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:11.403+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:28.496192+0000 front 2023-10-19T13:00:28.496224+0000 (oldest deadline 2023-10-19T13:00:51.396132+0000) 2023-10-19T13:01:11.838 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:11 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:11.403+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:35.497430+0000 front 2023-10-19T13:00:35.497454+0000 (oldest deadline 2023-10-19T13:01:00.197598+0000) 2023-10-19T13:01:11.838 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:11 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:11.403+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:44.799397+0000 front 2023-10-19T13:00:44.799340+0000 (oldest deadline 2023-10-19T13:01:08.899496+0000) 2023-10-19T13:01:11.866 INFO:journalctl@ceph.osd.6.smithi046.stdout:Oct 19 13:01:11 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-6[133654]: 2023-10-19T13:01:11.521+0000 7f7c3a553700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:38.243596+0000 front 2023-10-19T13:00:38.243703+0000 (oldest deadline 2023-10-19T13:01:01.743611+0000) 2023-10-19T13:01:11.866 INFO:journalctl@ceph.osd.6.smithi046.stdout:Oct 19 13:01:11 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-6[133654]: 2023-10-19T13:01:11.521+0000 7f7c3a553700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:44.044985+0000 front 2023-10-19T13:00:44.044856+0000 (oldest deadline 2023-10-19T13:01:09.344996+0000) 2023-10-19T13:01:11.880 INFO:journalctl@ceph.osd.5.smithi195.stdout:Oct 19 13:01:11 smithi195 bash[178418]: ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-5 2023-10-19T13:01:11.880 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:11 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:11.728+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:27.021692+0000 front 2023-10-19T13:00:27.021669+0000 (oldest deadline 2023-10-19T13:00:52.921759+0000) 2023-10-19T13:01:11.880 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:11 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:11.728+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:38.624261+0000 front 2023-10-19T13:00:38.624276+0000 (oldest deadline 2023-10-19T13:01:03.324346+0000) 2023-10-19T13:01:11.881 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:11 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:11.728+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:43.324834+0000 front 2023-10-19T13:00:43.324935+0000 (oldest deadline 2023-10-19T13:01:08.624965+0000) 2023-10-19T13:01:12.228 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:11 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:11.863+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:29.654587+0000 front 2023-10-19T13:00:29.654675+0000 (oldest deadline 2023-10-19T13:00:53.154854+0000) 2023-10-19T13:01:12.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:11 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:11.863+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:36.056505+0000 front 2023-10-19T13:00:36.056472+0000 (oldest deadline 2023-10-19T13:01:01.956648+0000) 2023-10-19T13:01:12.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:11 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:11.863+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:46.058503+0000 front 2023-10-19T13:00:46.058479+0000 (oldest deadline 2023-10-19T13:01:11.358383+0000) 2023-10-19T13:01:12.624 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:01:12 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T13:01:12.139+0000 7ff1ce306700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:29.065630+0000 front 2023-10-19T13:00:29.065546+0000 (oldest deadline 2023-10-19T13:00:54.365627+0000) 2023-10-19T13:01:12.624 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:01:12 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T13:01:12.139+0000 7ff1ce306700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:43.167422+0000 front 2023-10-19T13:00:43.167454+0000 (oldest deadline 2023-10-19T13:01:10.768080+0000) 2023-10-19T13:01:12.837 INFO:journalctl@ceph.osd.7.smithi157.stdout:Oct 19 13:01:12 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-7[155800]: 2023-10-19T13:01:12.509+0000 7fa0f9071700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:35.451625+0000 front 2023-10-19T13:00:35.451648+0000 (oldest deadline 2023-10-19T13:00:59.551942+0000) 2023-10-19T13:01:12.837 INFO:journalctl@ceph.osd.7.smithi157.stdout:Oct 19 13:01:12 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-7[155800]: 2023-10-19T13:01:12.509+0000 7fa0f9071700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:44.253063+0000 front 2023-10-19T13:00:44.253109+0000 (oldest deadline 2023-10-19T13:01:09.553096+0000) 2023-10-19T13:01:12.838 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:12 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:12.431+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:28.496192+0000 front 2023-10-19T13:00:28.496224+0000 (oldest deadline 2023-10-19T13:00:51.396132+0000) 2023-10-19T13:01:12.838 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:12 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:12.431+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:35.497430+0000 front 2023-10-19T13:00:35.497454+0000 (oldest deadline 2023-10-19T13:01:00.197598+0000) 2023-10-19T13:01:12.838 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:12 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:12.431+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:44.799397+0000 front 2023-10-19T13:00:44.799340+0000 (oldest deadline 2023-10-19T13:01:08.899496+0000) 2023-10-19T13:01:12.880 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:12 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:12.754+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:27.021692+0000 front 2023-10-19T13:00:27.021669+0000 (oldest deadline 2023-10-19T13:00:52.921759+0000) 2023-10-19T13:01:12.880 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:12 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:12.754+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:38.624261+0000 front 2023-10-19T13:00:38.624276+0000 (oldest deadline 2023-10-19T13:01:03.324346+0000) 2023-10-19T13:01:12.880 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:12 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:12.754+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:43.324834+0000 front 2023-10-19T13:00:43.324935+0000 (oldest deadline 2023-10-19T13:01:08.624965+0000) 2023-10-19T13:01:12.882 INFO:journalctl@ceph.osd.6.smithi046.stdout:Oct 19 13:01:12 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-6[133654]: 2023-10-19T13:01:12.568+0000 7f7c3a553700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:38.243596+0000 front 2023-10-19T13:00:38.243703+0000 (oldest deadline 2023-10-19T13:01:01.743611+0000) 2023-10-19T13:01:12.882 INFO:journalctl@ceph.osd.6.smithi046.stdout:Oct 19 13:01:12 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-6[133654]: 2023-10-19T13:01:12.568+0000 7f7c3a553700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:44.044985+0000 front 2023-10-19T13:00:44.044856+0000 (oldest deadline 2023-10-19T13:01:09.344996+0000) 2023-10-19T13:01:12.961 DEBUG:teuthology.orchestra.run.smithi195:> sudo pkill -f 'journalctl -f -n 0 -u ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@osd.5.service' 2023-10-19T13:01:13.001 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-19T13:01:13.002 INFO:tasks.cephadm.osd.5:Stopped osd.5 2023-10-19T13:01:13.002 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2023-10-19T13:01:13.002 DEBUG:teuthology.orchestra.run.smithi046:> sudo systemctl stop ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@osd.6 2023-10-19T13:01:13.229 INFO:journalctl@ceph.osd.6.smithi046.stdout:Oct 19 13:01:13 smithi046 systemd[1]: Stopping Ceph osd.6 for 96a8be3c-6e7b-11ee-8db6-212e2dc638e7... 2023-10-19T13:01:13.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:12 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:12.880+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:29.654587+0000 front 2023-10-19T13:00:29.654675+0000 (oldest deadline 2023-10-19T13:00:53.154854+0000) 2023-10-19T13:01:13.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:12 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:12.880+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:36.056505+0000 front 2023-10-19T13:00:36.056472+0000 (oldest deadline 2023-10-19T13:01:01.956648+0000) 2023-10-19T13:01:13.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:12 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:12.880+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:46.058503+0000 front 2023-10-19T13:00:46.058479+0000 (oldest deadline 2023-10-19T13:01:11.358383+0000) 2023-10-19T13:01:13.380 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:01:13 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T13:01:13.121+0000 7ff1ce306700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:29.065630+0000 front 2023-10-19T13:00:29.065546+0000 (oldest deadline 2023-10-19T13:00:54.365627+0000) 2023-10-19T13:01:13.380 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:01:13 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T13:01:13.121+0000 7ff1ce306700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:43.167422+0000 front 2023-10-19T13:00:43.167454+0000 (oldest deadline 2023-10-19T13:01:10.768080+0000) 2023-10-19T13:01:13.837 INFO:journalctl@ceph.osd.7.smithi157.stdout:Oct 19 13:01:13 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-7[155800]: 2023-10-19T13:01:13.468+0000 7fa0f9071700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:35.451625+0000 front 2023-10-19T13:00:35.451648+0000 (oldest deadline 2023-10-19T13:00:59.551942+0000) 2023-10-19T13:01:13.838 INFO:journalctl@ceph.osd.7.smithi157.stdout:Oct 19 13:01:13 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-7[155800]: 2023-10-19T13:01:13.468+0000 7fa0f9071700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:44.253063+0000 front 2023-10-19T13:00:44.253109+0000 (oldest deadline 2023-10-19T13:01:09.553096+0000) 2023-10-19T13:01:13.838 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:13 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:13.461+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:28.496192+0000 front 2023-10-19T13:00:28.496224+0000 (oldest deadline 2023-10-19T13:00:51.396132+0000) 2023-10-19T13:01:13.838 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:13 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:13.461+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:35.497430+0000 front 2023-10-19T13:00:35.497454+0000 (oldest deadline 2023-10-19T13:01:00.197598+0000) 2023-10-19T13:01:13.839 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:13 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:13.461+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:44.799397+0000 front 2023-10-19T13:00:44.799340+0000 (oldest deadline 2023-10-19T13:01:08.899496+0000) 2023-10-19T13:01:13.911 INFO:journalctl@ceph.osd.6.smithi046.stdout:Oct 19 13:01:13 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-6[133654]: 2023-10-19T13:01:13.531+0000 7f7c3ff61700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-19T13:01:13.911 INFO:journalctl@ceph.osd.6.smithi046.stdout:Oct 19 13:01:13 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-6[133654]: 2023-10-19T13:01:13.531+0000 7f7c3ff61700 -1 osd.6 96 *** Got signal Terminated *** 2023-10-19T13:01:13.911 INFO:journalctl@ceph.osd.6.smithi046.stdout:Oct 19 13:01:13 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-6[133654]: 2023-10-19T13:01:13.531+0000 7f7c3ff61700 -1 osd.6 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-19T13:01:13.911 INFO:journalctl@ceph.osd.6.smithi046.stdout:Oct 19 13:01:13 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-6[133654]: 2023-10-19T13:01:13.553+0000 7f7c3a553700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:38.243596+0000 front 2023-10-19T13:00:38.243703+0000 (oldest deadline 2023-10-19T13:01:01.743611+0000) 2023-10-19T13:01:13.911 INFO:journalctl@ceph.osd.6.smithi046.stdout:Oct 19 13:01:13 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-6[133654]: 2023-10-19T13:01:13.553+0000 7f7c3a553700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:44.044985+0000 front 2023-10-19T13:00:44.044856+0000 (oldest deadline 2023-10-19T13:01:09.344996+0000) 2023-10-19T13:01:14.085 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:13 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:13.796+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:27.021692+0000 front 2023-10-19T13:00:27.021669+0000 (oldest deadline 2023-10-19T13:00:52.921759+0000) 2023-10-19T13:01:14.085 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:13 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:13.796+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:38.624261+0000 front 2023-10-19T13:00:38.624276+0000 (oldest deadline 2023-10-19T13:01:03.324346+0000) 2023-10-19T13:01:14.085 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:13 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:13.796+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:43.324834+0000 front 2023-10-19T13:00:43.324935+0000 (oldest deadline 2023-10-19T13:01:08.624965+0000) 2023-10-19T13:01:14.228 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:13 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:13.908+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:29.654587+0000 front 2023-10-19T13:00:29.654675+0000 (oldest deadline 2023-10-19T13:00:53.154854+0000) 2023-10-19T13:01:14.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:13 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:13.908+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:36.056505+0000 front 2023-10-19T13:00:36.056472+0000 (oldest deadline 2023-10-19T13:01:01.956648+0000) 2023-10-19T13:01:14.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:13 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:13.908+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:46.058503+0000 front 2023-10-19T13:00:46.058479+0000 (oldest deadline 2023-10-19T13:01:11.358383+0000) 2023-10-19T13:01:14.380 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:01:14 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T13:01:14.082+0000 7ff1ce306700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:29.065630+0000 front 2023-10-19T13:00:29.065546+0000 (oldest deadline 2023-10-19T13:00:54.365627+0000) 2023-10-19T13:01:14.380 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:01:14 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T13:01:14.082+0000 7ff1ce306700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:43.167422+0000 front 2023-10-19T13:00:43.167454+0000 (oldest deadline 2023-10-19T13:01:10.768080+0000) 2023-10-19T13:01:14.837 INFO:journalctl@ceph.osd.7.smithi157.stdout:Oct 19 13:01:14 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-7[155800]: 2023-10-19T13:01:14.518+0000 7fa0f9071700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:35.451625+0000 front 2023-10-19T13:00:35.451648+0000 (oldest deadline 2023-10-19T13:00:59.551942+0000) 2023-10-19T13:01:14.837 INFO:journalctl@ceph.osd.7.smithi157.stdout:Oct 19 13:01:14 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-7[155800]: 2023-10-19T13:01:14.518+0000 7fa0f9071700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:44.253063+0000 front 2023-10-19T13:00:44.253109+0000 (oldest deadline 2023-10-19T13:01:09.553096+0000) 2023-10-19T13:01:14.838 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:14 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:14.414+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:28.496192+0000 front 2023-10-19T13:00:28.496224+0000 (oldest deadline 2023-10-19T13:00:51.396132+0000) 2023-10-19T13:01:14.838 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:14 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:14.414+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:35.497430+0000 front 2023-10-19T13:00:35.497454+0000 (oldest deadline 2023-10-19T13:01:00.197598+0000) 2023-10-19T13:01:14.838 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:14 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:14.414+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:44.799397+0000 front 2023-10-19T13:00:44.799340+0000 (oldest deadline 2023-10-19T13:01:08.899496+0000) 2023-10-19T13:01:14.880 INFO:journalctl@ceph.osd.6.smithi046.stdout:Oct 19 13:01:14 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-6[133654]: 2023-10-19T13:01:14.563+0000 7f7c3a553700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:38.243596+0000 front 2023-10-19T13:00:38.243703+0000 (oldest deadline 2023-10-19T13:01:01.743611+0000) 2023-10-19T13:01:14.880 INFO:journalctl@ceph.osd.6.smithi046.stdout:Oct 19 13:01:14 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-6[133654]: 2023-10-19T13:01:14.563+0000 7f7c3a553700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:44.044985+0000 front 2023-10-19T13:00:44.044856+0000 (oldest deadline 2023-10-19T13:01:09.344996+0000) 2023-10-19T13:01:15.123 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:14 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:14.837+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:27.021692+0000 front 2023-10-19T13:00:27.021669+0000 (oldest deadline 2023-10-19T13:00:52.921759+0000) 2023-10-19T13:01:15.124 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:14 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:14.837+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:38.624261+0000 front 2023-10-19T13:00:38.624276+0000 (oldest deadline 2023-10-19T13:01:03.324346+0000) 2023-10-19T13:01:15.124 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:14 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:14.837+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:43.324834+0000 front 2023-10-19T13:00:43.324935+0000 (oldest deadline 2023-10-19T13:01:08.624965+0000) 2023-10-19T13:01:15.228 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:14 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:14.877+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:29.654587+0000 front 2023-10-19T13:00:29.654675+0000 (oldest deadline 2023-10-19T13:00:53.154854+0000) 2023-10-19T13:01:15.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:14 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:14.877+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:36.056505+0000 front 2023-10-19T13:00:36.056472+0000 (oldest deadline 2023-10-19T13:01:01.956648+0000) 2023-10-19T13:01:15.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:14 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:14.877+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:46.058503+0000 front 2023-10-19T13:00:46.058479+0000 (oldest deadline 2023-10-19T13:01:11.358383+0000) 2023-10-19T13:01:15.380 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:01:15 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T13:01:15.121+0000 7ff1ce306700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:29.065630+0000 front 2023-10-19T13:00:29.065546+0000 (oldest deadline 2023-10-19T13:00:54.365627+0000) 2023-10-19T13:01:15.380 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:01:15 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T13:01:15.121+0000 7ff1ce306700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:43.167422+0000 front 2023-10-19T13:00:43.167454+0000 (oldest deadline 2023-10-19T13:01:10.768080+0000) 2023-10-19T13:01:15.837 INFO:journalctl@ceph.osd.7.smithi157.stdout:Oct 19 13:01:15 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-7[155800]: 2023-10-19T13:01:15.568+0000 7fa0f9071700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:35.451625+0000 front 2023-10-19T13:00:35.451648+0000 (oldest deadline 2023-10-19T13:00:59.551942+0000) 2023-10-19T13:01:15.838 INFO:journalctl@ceph.osd.7.smithi157.stdout:Oct 19 13:01:15 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-7[155800]: 2023-10-19T13:01:15.568+0000 7fa0f9071700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:44.253063+0000 front 2023-10-19T13:00:44.253109+0000 (oldest deadline 2023-10-19T13:01:09.553096+0000) 2023-10-19T13:01:15.838 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:15 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:15.452+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:28.496192+0000 front 2023-10-19T13:00:28.496224+0000 (oldest deadline 2023-10-19T13:00:51.396132+0000) 2023-10-19T13:01:15.838 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:15 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:15.452+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:35.497430+0000 front 2023-10-19T13:00:35.497454+0000 (oldest deadline 2023-10-19T13:01:00.197598+0000) 2023-10-19T13:01:15.838 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:15 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:15.452+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:44.799397+0000 front 2023-10-19T13:00:44.799340+0000 (oldest deadline 2023-10-19T13:01:08.899496+0000) 2023-10-19T13:01:15.978 INFO:journalctl@ceph.osd.6.smithi046.stdout:Oct 19 13:01:15 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-6[133654]: 2023-10-19T13:01:15.613+0000 7f7c3a553700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:38.243596+0000 front 2023-10-19T13:00:38.243703+0000 (oldest deadline 2023-10-19T13:01:01.743611+0000) 2023-10-19T13:01:15.979 INFO:journalctl@ceph.osd.6.smithi046.stdout:Oct 19 13:01:15 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-6[133654]: 2023-10-19T13:01:15.613+0000 7f7c3a553700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:44.044985+0000 front 2023-10-19T13:00:44.044856+0000 (oldest deadline 2023-10-19T13:01:09.344996+0000) 2023-10-19T13:01:15.979 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:15 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:15.833+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:29.654587+0000 front 2023-10-19T13:00:29.654675+0000 (oldest deadline 2023-10-19T13:00:53.154854+0000) 2023-10-19T13:01:15.979 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:15 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:15.833+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:36.056505+0000 front 2023-10-19T13:00:36.056472+0000 (oldest deadline 2023-10-19T13:01:01.956648+0000) 2023-10-19T13:01:15.979 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:15 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:15.833+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:46.058503+0000 front 2023-10-19T13:00:46.058479+0000 (oldest deadline 2023-10-19T13:01:11.358383+0000) 2023-10-19T13:01:16.172 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:15 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:15.878+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:27.021692+0000 front 2023-10-19T13:00:27.021669+0000 (oldest deadline 2023-10-19T13:00:52.921759+0000) 2023-10-19T13:01:16.172 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:15 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:15.878+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:38.624261+0000 front 2023-10-19T13:00:38.624276+0000 (oldest deadline 2023-10-19T13:01:03.324346+0000) 2023-10-19T13:01:16.173 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:15 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:15.878+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:43.324834+0000 front 2023-10-19T13:00:43.324935+0000 (oldest deadline 2023-10-19T13:01:08.624965+0000) 2023-10-19T13:01:16.630 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:01:16 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T13:01:16.169+0000 7ff1ce306700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:29.065630+0000 front 2023-10-19T13:00:29.065546+0000 (oldest deadline 2023-10-19T13:00:54.365627+0000) 2023-10-19T13:01:16.630 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:01:16 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T13:01:16.169+0000 7ff1ce306700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:43.167422+0000 front 2023-10-19T13:00:43.167454+0000 (oldest deadline 2023-10-19T13:01:10.768080+0000) 2023-10-19T13:01:16.837 INFO:journalctl@ceph.osd.7.smithi157.stdout:Oct 19 13:01:16 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-7[155800]: 2023-10-19T13:01:16.571+0000 7fa0f9071700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:35.451625+0000 front 2023-10-19T13:00:35.451648+0000 (oldest deadline 2023-10-19T13:00:59.551942+0000) 2023-10-19T13:01:16.838 INFO:journalctl@ceph.osd.7.smithi157.stdout:Oct 19 13:01:16 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-7[155800]: 2023-10-19T13:01:16.571+0000 7fa0f9071700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:44.253063+0000 front 2023-10-19T13:00:44.253109+0000 (oldest deadline 2023-10-19T13:01:09.553096+0000) 2023-10-19T13:01:16.838 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:16 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:16.499+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:28.496192+0000 front 2023-10-19T13:00:28.496224+0000 (oldest deadline 2023-10-19T13:00:51.396132+0000) 2023-10-19T13:01:16.838 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:16 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:16.499+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:35.497430+0000 front 2023-10-19T13:00:35.497454+0000 (oldest deadline 2023-10-19T13:01:00.197598+0000) 2023-10-19T13:01:16.839 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:16 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:16.499+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:44.799397+0000 front 2023-10-19T13:00:44.799340+0000 (oldest deadline 2023-10-19T13:01:08.899496+0000) 2023-10-19T13:01:16.865 INFO:journalctl@ceph.osd.6.smithi046.stdout:Oct 19 13:01:16 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-6[133654]: 2023-10-19T13:01:16.609+0000 7f7c3a553700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:38.243596+0000 front 2023-10-19T13:00:38.243703+0000 (oldest deadline 2023-10-19T13:01:01.743611+0000) 2023-10-19T13:01:16.865 INFO:journalctl@ceph.osd.6.smithi046.stdout:Oct 19 13:01:16 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-6[133654]: 2023-10-19T13:01:16.609+0000 7f7c3a553700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:44.044985+0000 front 2023-10-19T13:00:44.044856+0000 (oldest deadline 2023-10-19T13:01:09.344996+0000) 2023-10-19T13:01:16.865 INFO:journalctl@ceph.osd.6.smithi046.stdout:Oct 19 13:01:16 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-6[133654]: 2023-10-19T13:01:16.609+0000 7f7c3a553700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2023-10-19T13:00:53.947554+0000 front 2023-10-19T13:00:53.947588+0000 (oldest deadline 2023-10-19T13:01:15.647758+0000) 2023-10-19T13:01:17.130 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:16 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:16.856+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:27.021692+0000 front 2023-10-19T13:00:27.021669+0000 (oldest deadline 2023-10-19T13:00:52.921759+0000) 2023-10-19T13:01:17.130 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:16 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:16.856+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:38.624261+0000 front 2023-10-19T13:00:38.624276+0000 (oldest deadline 2023-10-19T13:01:03.324346+0000) 2023-10-19T13:01:17.131 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:16 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:16.856+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:43.324834+0000 front 2023-10-19T13:00:43.324935+0000 (oldest deadline 2023-10-19T13:01:08.624965+0000) 2023-10-19T13:01:17.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:16 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:16.862+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:29.654587+0000 front 2023-10-19T13:00:29.654675+0000 (oldest deadline 2023-10-19T13:00:53.154854+0000) 2023-10-19T13:01:17.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:16 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:16.862+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:36.056505+0000 front 2023-10-19T13:00:36.056472+0000 (oldest deadline 2023-10-19T13:01:01.956648+0000) 2023-10-19T13:01:17.230 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:16 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:16.862+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:46.058503+0000 front 2023-10-19T13:00:46.058479+0000 (oldest deadline 2023-10-19T13:01:11.358383+0000) 2023-10-19T13:01:17.230 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:16 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:16.862+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2023-10-19T13:00:51.859079+0000 front 2023-10-19T13:00:51.859175+0000 (oldest deadline 2023-10-19T13:01:15.959126+0000) 2023-10-19T13:01:17.630 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:01:17 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T13:01:17.177+0000 7ff1ce306700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:29.065630+0000 front 2023-10-19T13:00:29.065546+0000 (oldest deadline 2023-10-19T13:00:54.365627+0000) 2023-10-19T13:01:17.631 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:01:17 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T13:01:17.177+0000 7ff1ce306700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:43.167422+0000 front 2023-10-19T13:00:43.167454+0000 (oldest deadline 2023-10-19T13:01:10.768080+0000) 2023-10-19T13:01:17.837 INFO:journalctl@ceph.osd.7.smithi157.stdout:Oct 19 13:01:17 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-7[155800]: 2023-10-19T13:01:17.605+0000 7fa0f9071700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:35.451625+0000 front 2023-10-19T13:00:35.451648+0000 (oldest deadline 2023-10-19T13:00:59.551942+0000) 2023-10-19T13:01:17.838 INFO:journalctl@ceph.osd.7.smithi157.stdout:Oct 19 13:01:17 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-7[155800]: 2023-10-19T13:01:17.605+0000 7fa0f9071700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:44.253063+0000 front 2023-10-19T13:00:44.253109+0000 (oldest deadline 2023-10-19T13:01:09.553096+0000) 2023-10-19T13:01:17.838 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:17 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:17.499+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:28.496192+0000 front 2023-10-19T13:00:28.496224+0000 (oldest deadline 2023-10-19T13:00:51.396132+0000) 2023-10-19T13:01:17.839 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:17 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:17.499+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:35.497430+0000 front 2023-10-19T13:00:35.497454+0000 (oldest deadline 2023-10-19T13:01:00.197598+0000) 2023-10-19T13:01:17.839 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:17 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:17.499+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:44.799397+0000 front 2023-10-19T13:00:44.799340+0000 (oldest deadline 2023-10-19T13:01:08.899496+0000) 2023-10-19T13:01:17.913 INFO:journalctl@ceph.osd.6.smithi046.stdout:Oct 19 13:01:17 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-6[133654]: 2023-10-19T13:01:17.642+0000 7f7c3a553700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:38.243596+0000 front 2023-10-19T13:00:38.243703+0000 (oldest deadline 2023-10-19T13:01:01.743611+0000) 2023-10-19T13:01:17.913 INFO:journalctl@ceph.osd.6.smithi046.stdout:Oct 19 13:01:17 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-6[133654]: 2023-10-19T13:01:17.642+0000 7f7c3a553700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:44.044985+0000 front 2023-10-19T13:00:44.044856+0000 (oldest deadline 2023-10-19T13:01:09.344996+0000) 2023-10-19T13:01:17.914 INFO:journalctl@ceph.osd.6.smithi046.stdout:Oct 19 13:01:17 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-6[133654]: 2023-10-19T13:01:17.642+0000 7f7c3a553700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2023-10-19T13:00:53.947554+0000 front 2023-10-19T13:00:53.947588+0000 (oldest deadline 2023-10-19T13:01:15.647758+0000) 2023-10-19T13:01:18.130 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:17 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:17.837+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:27.021692+0000 front 2023-10-19T13:00:27.021669+0000 (oldest deadline 2023-10-19T13:00:52.921759+0000) 2023-10-19T13:01:18.130 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:17 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:17.837+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:38.624261+0000 front 2023-10-19T13:00:38.624276+0000 (oldest deadline 2023-10-19T13:01:03.324346+0000) 2023-10-19T13:01:18.131 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:17 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:17.837+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:43.324834+0000 front 2023-10-19T13:00:43.324935+0000 (oldest deadline 2023-10-19T13:01:08.624965+0000) 2023-10-19T13:01:18.228 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:17 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:17.910+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:29.654587+0000 front 2023-10-19T13:00:29.654675+0000 (oldest deadline 2023-10-19T13:00:53.154854+0000) 2023-10-19T13:01:18.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:17 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:17.910+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:36.056505+0000 front 2023-10-19T13:00:36.056472+0000 (oldest deadline 2023-10-19T13:01:01.956648+0000) 2023-10-19T13:01:18.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:17 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:17.910+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:46.058503+0000 front 2023-10-19T13:00:46.058479+0000 (oldest deadline 2023-10-19T13:01:11.358383+0000) 2023-10-19T13:01:18.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:17 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:17.910+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2023-10-19T13:00:51.859079+0000 front 2023-10-19T13:00:51.859175+0000 (oldest deadline 2023-10-19T13:01:15.959126+0000) 2023-10-19T13:01:18.630 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:01:18 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T13:01:18.132+0000 7ff1ce306700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:29.065630+0000 front 2023-10-19T13:00:29.065546+0000 (oldest deadline 2023-10-19T13:00:54.365627+0000) 2023-10-19T13:01:18.630 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:01:18 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T13:01:18.132+0000 7ff1ce306700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:43.167422+0000 front 2023-10-19T13:00:43.167454+0000 (oldest deadline 2023-10-19T13:01:10.768080+0000) 2023-10-19T13:01:18.837 INFO:journalctl@ceph.osd.7.smithi157.stdout:Oct 19 13:01:18 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-7[155800]: 2023-10-19T13:01:18.634+0000 7fa0f9071700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:35.451625+0000 front 2023-10-19T13:00:35.451648+0000 (oldest deadline 2023-10-19T13:00:59.551942+0000) 2023-10-19T13:01:18.838 INFO:journalctl@ceph.osd.7.smithi157.stdout:Oct 19 13:01:18 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-7[155800]: 2023-10-19T13:01:18.634+0000 7fa0f9071700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:44.253063+0000 front 2023-10-19T13:00:44.253109+0000 (oldest deadline 2023-10-19T13:01:09.553096+0000) 2023-10-19T13:01:18.839 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:18 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:18.501+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:28.496192+0000 front 2023-10-19T13:00:28.496224+0000 (oldest deadline 2023-10-19T13:00:51.396132+0000) 2023-10-19T13:01:18.839 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:18 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:18.501+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:35.497430+0000 front 2023-10-19T13:00:35.497454+0000 (oldest deadline 2023-10-19T13:01:00.197598+0000) 2023-10-19T13:01:18.839 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:18 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:18.501+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:44.799397+0000 front 2023-10-19T13:00:44.799340+0000 (oldest deadline 2023-10-19T13:01:08.899496+0000) 2023-10-19T13:01:18.840 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:18 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:18.501+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2023-10-19T13:00:52.901361+0000 front 2023-10-19T13:00:52.901460+0000 (oldest deadline 2023-10-19T13:01:17.601455+0000) 2023-10-19T13:01:19.130 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:18 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:18.827+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:27.021692+0000 front 2023-10-19T13:00:27.021669+0000 (oldest deadline 2023-10-19T13:00:52.921759+0000) 2023-10-19T13:01:19.130 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:18 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:18.827+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:38.624261+0000 front 2023-10-19T13:00:38.624276+0000 (oldest deadline 2023-10-19T13:01:03.324346+0000) 2023-10-19T13:01:19.131 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:18 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:18.827+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:43.324834+0000 front 2023-10-19T13:00:43.324935+0000 (oldest deadline 2023-10-19T13:01:08.624965+0000) 2023-10-19T13:01:19.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:18 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:18.879+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:29.654587+0000 front 2023-10-19T13:00:29.654675+0000 (oldest deadline 2023-10-19T13:00:53.154854+0000) 2023-10-19T13:01:19.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:18 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:18.879+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:36.056505+0000 front 2023-10-19T13:00:36.056472+0000 (oldest deadline 2023-10-19T13:01:01.956648+0000) 2023-10-19T13:01:19.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:18 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:18.880+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:46.058503+0000 front 2023-10-19T13:00:46.058479+0000 (oldest deadline 2023-10-19T13:01:11.358383+0000) 2023-10-19T13:01:19.230 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:18 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:18.880+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2023-10-19T13:00:51.859079+0000 front 2023-10-19T13:00:51.859175+0000 (oldest deadline 2023-10-19T13:01:15.959126+0000) 2023-10-19T13:01:19.630 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:01:19 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T13:01:19.137+0000 7ff1ce306700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:29.065630+0000 front 2023-10-19T13:00:29.065546+0000 (oldest deadline 2023-10-19T13:00:54.365627+0000) 2023-10-19T13:01:19.630 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:01:19 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T13:01:19.137+0000 7ff1ce306700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:43.167422+0000 front 2023-10-19T13:00:43.167454+0000 (oldest deadline 2023-10-19T13:01:10.768080+0000) 2023-10-19T13:01:19.631 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:01:19 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T13:01:19.137+0000 7ff1ce306700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2023-10-19T13:00:54.269766+0000 front 2023-10-19T13:00:54.269658+0000 (oldest deadline 2023-10-19T13:01:18.270411+0000) 2023-10-19T13:01:19.728 INFO:journalctl@ceph.osd.6.smithi046.stdout:Oct 19 13:01:19 smithi046 bash[176635]: ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-6 2023-10-19T13:01:19.837 INFO:journalctl@ceph.osd.7.smithi157.stdout:Oct 19 13:01:19 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-7[155800]: 2023-10-19T13:01:19.606+0000 7fa0f9071700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:35.451625+0000 front 2023-10-19T13:00:35.451648+0000 (oldest deadline 2023-10-19T13:00:59.551942+0000) 2023-10-19T13:01:19.837 INFO:journalctl@ceph.osd.7.smithi157.stdout:Oct 19 13:01:19 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-7[155800]: 2023-10-19T13:01:19.606+0000 7fa0f9071700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:44.253063+0000 front 2023-10-19T13:00:44.253109+0000 (oldest deadline 2023-10-19T13:01:09.553096+0000) 2023-10-19T13:01:19.838 INFO:journalctl@ceph.osd.7.smithi157.stdout:Oct 19 13:01:19 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-7[155800]: 2023-10-19T13:01:19.606+0000 7fa0f9071700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2023-10-19T13:00:54.254332+0000 front 2023-10-19T13:00:54.254432+0000 (oldest deadline 2023-10-19T13:01:18.954418+0000) 2023-10-19T13:01:19.838 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:19 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:19.468+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:28.496192+0000 front 2023-10-19T13:00:28.496224+0000 (oldest deadline 2023-10-19T13:00:51.396132+0000) 2023-10-19T13:01:19.838 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:19 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:19.468+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:35.497430+0000 front 2023-10-19T13:00:35.497454+0000 (oldest deadline 2023-10-19T13:01:00.197598+0000) 2023-10-19T13:01:19.839 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:19 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:19.468+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:44.799397+0000 front 2023-10-19T13:00:44.799340+0000 (oldest deadline 2023-10-19T13:01:08.899496+0000) 2023-10-19T13:01:19.839 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:19 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:19.468+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2023-10-19T13:00:52.901361+0000 front 2023-10-19T13:00:52.901460+0000 (oldest deadline 2023-10-19T13:01:17.601455+0000) 2023-10-19T13:01:20.130 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:19 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:19.822+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:27.021692+0000 front 2023-10-19T13:00:27.021669+0000 (oldest deadline 2023-10-19T13:00:52.921759+0000) 2023-10-19T13:01:20.131 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:19 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:19.822+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:38.624261+0000 front 2023-10-19T13:00:38.624276+0000 (oldest deadline 2023-10-19T13:01:03.324346+0000) 2023-10-19T13:01:20.131 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:19 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:19.822+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:43.324834+0000 front 2023-10-19T13:00:43.324935+0000 (oldest deadline 2023-10-19T13:01:08.624965+0000) 2023-10-19T13:01:20.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:19 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:19.878+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:29.654587+0000 front 2023-10-19T13:00:29.654675+0000 (oldest deadline 2023-10-19T13:00:53.154854+0000) 2023-10-19T13:01:20.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:19 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:19.879+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:36.056505+0000 front 2023-10-19T13:00:36.056472+0000 (oldest deadline 2023-10-19T13:01:01.956648+0000) 2023-10-19T13:01:20.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:19 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:19.879+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:46.058503+0000 front 2023-10-19T13:00:46.058479+0000 (oldest deadline 2023-10-19T13:01:11.358383+0000) 2023-10-19T13:01:20.230 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:19 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:19.879+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2023-10-19T13:00:51.859079+0000 front 2023-10-19T13:00:51.859175+0000 (oldest deadline 2023-10-19T13:01:15.959126+0000) 2023-10-19T13:01:20.630 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:01:20 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T13:01:20.182+0000 7ff1ce306700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:29.065630+0000 front 2023-10-19T13:00:29.065546+0000 (oldest deadline 2023-10-19T13:00:54.365627+0000) 2023-10-19T13:01:20.630 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:01:20 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T13:01:20.182+0000 7ff1ce306700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:43.167422+0000 front 2023-10-19T13:00:43.167454+0000 (oldest deadline 2023-10-19T13:01:10.768080+0000) 2023-10-19T13:01:20.631 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:01:20 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T13:01:20.182+0000 7ff1ce306700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2023-10-19T13:00:54.269766+0000 front 2023-10-19T13:00:54.269658+0000 (oldest deadline 2023-10-19T13:01:18.270411+0000) 2023-10-19T13:01:20.837 INFO:journalctl@ceph.osd.7.smithi157.stdout:Oct 19 13:01:20 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-7[155800]: 2023-10-19T13:01:20.594+0000 7fa0f9071700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:35.451625+0000 front 2023-10-19T13:00:35.451648+0000 (oldest deadline 2023-10-19T13:00:59.551942+0000) 2023-10-19T13:01:20.838 INFO:journalctl@ceph.osd.7.smithi157.stdout:Oct 19 13:01:20 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-7[155800]: 2023-10-19T13:01:20.594+0000 7fa0f9071700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:44.253063+0000 front 2023-10-19T13:00:44.253109+0000 (oldest deadline 2023-10-19T13:01:09.553096+0000) 2023-10-19T13:01:20.838 INFO:journalctl@ceph.osd.7.smithi157.stdout:Oct 19 13:01:20 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-7[155800]: 2023-10-19T13:01:20.594+0000 7fa0f9071700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2023-10-19T13:00:54.254332+0000 front 2023-10-19T13:00:54.254432+0000 (oldest deadline 2023-10-19T13:01:18.954418+0000) 2023-10-19T13:01:20.838 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:20 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:20.450+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:28.496192+0000 front 2023-10-19T13:00:28.496224+0000 (oldest deadline 2023-10-19T13:00:51.396132+0000) 2023-10-19T13:01:20.838 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:20 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:20.450+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:35.497430+0000 front 2023-10-19T13:00:35.497454+0000 (oldest deadline 2023-10-19T13:01:00.197598+0000) 2023-10-19T13:01:20.839 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:20 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:20.450+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:44.799397+0000 front 2023-10-19T13:00:44.799340+0000 (oldest deadline 2023-10-19T13:01:08.899496+0000) 2023-10-19T13:01:20.839 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:20 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:20.450+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2023-10-19T13:00:52.901361+0000 front 2023-10-19T13:00:52.901460+0000 (oldest deadline 2023-10-19T13:01:17.601455+0000) 2023-10-19T13:01:21.130 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:20 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:20.867+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:27.021692+0000 front 2023-10-19T13:00:27.021669+0000 (oldest deadline 2023-10-19T13:00:52.921759+0000) 2023-10-19T13:01:21.130 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:20 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:20.867+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:38.624261+0000 front 2023-10-19T13:00:38.624276+0000 (oldest deadline 2023-10-19T13:01:03.324346+0000) 2023-10-19T13:01:21.130 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:20 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:20.867+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:43.324834+0000 front 2023-10-19T13:00:43.324935+0000 (oldest deadline 2023-10-19T13:01:08.624965+0000) 2023-10-19T13:01:21.228 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:20 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:20.929+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:29.654587+0000 front 2023-10-19T13:00:29.654675+0000 (oldest deadline 2023-10-19T13:00:53.154854+0000) 2023-10-19T13:01:21.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:20 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:20.929+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:36.056505+0000 front 2023-10-19T13:00:36.056472+0000 (oldest deadline 2023-10-19T13:01:01.956648+0000) 2023-10-19T13:01:21.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:20 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:20.929+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:46.058503+0000 front 2023-10-19T13:00:46.058479+0000 (oldest deadline 2023-10-19T13:01:11.358383+0000) 2023-10-19T13:01:21.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:20 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:20.929+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2023-10-19T13:00:51.859079+0000 front 2023-10-19T13:00:51.859175+0000 (oldest deadline 2023-10-19T13:01:15.959126+0000) 2023-10-19T13:01:21.350 DEBUG:teuthology.orchestra.run.smithi046:> sudo pkill -f 'journalctl -f -n 0 -u ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@osd.6.service' 2023-10-19T13:01:21.444 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-19T13:01:21.444 INFO:tasks.cephadm.osd.6:Stopped osd.6 2023-10-19T13:01:21.445 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2023-10-19T13:01:21.445 DEBUG:teuthology.orchestra.run.smithi157:> sudo systemctl stop ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@osd.7 2023-10-19T13:01:21.630 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:01:21 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T13:01:21.169+0000 7ff1ce306700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:29.065630+0000 front 2023-10-19T13:00:29.065546+0000 (oldest deadline 2023-10-19T13:00:54.365627+0000) 2023-10-19T13:01:21.630 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:01:21 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T13:01:21.169+0000 7ff1ce306700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:43.167422+0000 front 2023-10-19T13:00:43.167454+0000 (oldest deadline 2023-10-19T13:01:10.768080+0000) 2023-10-19T13:01:21.631 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:01:21 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T13:01:21.169+0000 7ff1ce306700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2023-10-19T13:00:54.269766+0000 front 2023-10-19T13:00:54.269658+0000 (oldest deadline 2023-10-19T13:01:18.270411+0000) 2023-10-19T13:01:21.806 INFO:journalctl@ceph.osd.7.smithi157.stdout:Oct 19 13:01:21 smithi157 systemd[1]: Stopping Ceph osd.7 for 96a8be3c-6e7b-11ee-8db6-212e2dc638e7... 2023-10-19T13:01:21.806 INFO:journalctl@ceph.osd.7.smithi157.stdout:Oct 19 13:01:21 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-7[155800]: 2023-10-19T13:01:21.612+0000 7fa0f9071700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:35.451625+0000 front 2023-10-19T13:00:35.451648+0000 (oldest deadline 2023-10-19T13:00:59.551942+0000) 2023-10-19T13:01:21.807 INFO:journalctl@ceph.osd.7.smithi157.stdout:Oct 19 13:01:21 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-7[155800]: 2023-10-19T13:01:21.612+0000 7fa0f9071700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:44.253063+0000 front 2023-10-19T13:00:44.253109+0000 (oldest deadline 2023-10-19T13:01:09.553096+0000) 2023-10-19T13:01:21.807 INFO:journalctl@ceph.osd.7.smithi157.stdout:Oct 19 13:01:21 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-7[155800]: 2023-10-19T13:01:21.612+0000 7fa0f9071700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2023-10-19T13:00:54.254332+0000 front 2023-10-19T13:00:54.254432+0000 (oldest deadline 2023-10-19T13:01:18.954418+0000) 2023-10-19T13:01:21.807 INFO:journalctl@ceph.osd.7.smithi157.stdout:Oct 19 13:01:21 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-7[155800]: 2023-10-19T13:01:21.802+0000 7fa0fe27e700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-19T13:01:21.807 INFO:journalctl@ceph.osd.7.smithi157.stdout:Oct 19 13:01:21 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-7[155800]: 2023-10-19T13:01:21.802+0000 7fa0fe27e700 -1 osd.7 96 *** Got signal Terminated *** 2023-10-19T13:01:21.808 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:21 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:21.476+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:28.496192+0000 front 2023-10-19T13:00:28.496224+0000 (oldest deadline 2023-10-19T13:00:51.396132+0000) 2023-10-19T13:01:21.808 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:21 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:21.476+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:35.497430+0000 front 2023-10-19T13:00:35.497454+0000 (oldest deadline 2023-10-19T13:01:00.197598+0000) 2023-10-19T13:01:21.808 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:21 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:21.476+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:44.799397+0000 front 2023-10-19T13:00:44.799340+0000 (oldest deadline 2023-10-19T13:01:08.899496+0000) 2023-10-19T13:01:21.808 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:21 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:21.476+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2023-10-19T13:00:52.901361+0000 front 2023-10-19T13:00:52.901460+0000 (oldest deadline 2023-10-19T13:01:17.601455+0000) 2023-10-19T13:01:22.087 INFO:journalctl@ceph.osd.7.smithi157.stdout:Oct 19 13:01:21 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-7[155800]: 2023-10-19T13:01:21.802+0000 7fa0fe27e700 -1 osd.7 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-19T13:01:22.130 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:21 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:21.824+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:27.021692+0000 front 2023-10-19T13:00:27.021669+0000 (oldest deadline 2023-10-19T13:00:52.921759+0000) 2023-10-19T13:01:22.130 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:21 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:21.824+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:38.624261+0000 front 2023-10-19T13:00:38.624276+0000 (oldest deadline 2023-10-19T13:01:03.324346+0000) 2023-10-19T13:01:22.131 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:21 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:21.824+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:43.324834+0000 front 2023-10-19T13:00:43.324935+0000 (oldest deadline 2023-10-19T13:01:08.624965+0000) 2023-10-19T13:01:22.228 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:21 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:21.956+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:29.654587+0000 front 2023-10-19T13:00:29.654675+0000 (oldest deadline 2023-10-19T13:00:53.154854+0000) 2023-10-19T13:01:22.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:21 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:21.956+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:36.056505+0000 front 2023-10-19T13:00:36.056472+0000 (oldest deadline 2023-10-19T13:01:01.956648+0000) 2023-10-19T13:01:22.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:21 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:21.956+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:46.058503+0000 front 2023-10-19T13:00:46.058479+0000 (oldest deadline 2023-10-19T13:01:11.358383+0000) 2023-10-19T13:01:22.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:21 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:21.956+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2023-10-19T13:00:51.859079+0000 front 2023-10-19T13:00:51.859175+0000 (oldest deadline 2023-10-19T13:01:15.959126+0000) 2023-10-19T13:01:22.630 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:01:22 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T13:01:22.131+0000 7ff1ce306700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:29.065630+0000 front 2023-10-19T13:00:29.065546+0000 (oldest deadline 2023-10-19T13:00:54.365627+0000) 2023-10-19T13:01:22.630 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:01:22 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T13:01:22.131+0000 7ff1ce306700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:43.167422+0000 front 2023-10-19T13:00:43.167454+0000 (oldest deadline 2023-10-19T13:01:10.768080+0000) 2023-10-19T13:01:22.631 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:01:22 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T13:01:22.131+0000 7ff1ce306700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2023-10-19T13:00:54.269766+0000 front 2023-10-19T13:00:54.269658+0000 (oldest deadline 2023-10-19T13:01:18.270411+0000) 2023-10-19T13:01:22.837 INFO:journalctl@ceph.osd.7.smithi157.stdout:Oct 19 13:01:22 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-7[155800]: 2023-10-19T13:01:22.612+0000 7fa0f9071700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:35.451625+0000 front 2023-10-19T13:00:35.451648+0000 (oldest deadline 2023-10-19T13:00:59.551942+0000) 2023-10-19T13:01:22.838 INFO:journalctl@ceph.osd.7.smithi157.stdout:Oct 19 13:01:22 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-7[155800]: 2023-10-19T13:01:22.612+0000 7fa0f9071700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:44.253063+0000 front 2023-10-19T13:00:44.253109+0000 (oldest deadline 2023-10-19T13:01:09.553096+0000) 2023-10-19T13:01:22.838 INFO:journalctl@ceph.osd.7.smithi157.stdout:Oct 19 13:01:22 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-7[155800]: 2023-10-19T13:01:22.612+0000 7fa0f9071700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2023-10-19T13:00:54.254332+0000 front 2023-10-19T13:00:54.254432+0000 (oldest deadline 2023-10-19T13:01:18.954418+0000) 2023-10-19T13:01:22.838 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:22 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:22.428+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:28.496192+0000 front 2023-10-19T13:00:28.496224+0000 (oldest deadline 2023-10-19T13:00:51.396132+0000) 2023-10-19T13:01:22.838 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:22 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:22.428+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:35.497430+0000 front 2023-10-19T13:00:35.497454+0000 (oldest deadline 2023-10-19T13:01:00.197598+0000) 2023-10-19T13:01:22.839 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:22 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:22.428+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:44.799397+0000 front 2023-10-19T13:00:44.799340+0000 (oldest deadline 2023-10-19T13:01:08.899496+0000) 2023-10-19T13:01:22.839 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:22 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:22.428+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2023-10-19T13:00:52.901361+0000 front 2023-10-19T13:00:52.901460+0000 (oldest deadline 2023-10-19T13:01:17.601455+0000) 2023-10-19T13:01:23.130 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:22 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:22.790+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:27.021692+0000 front 2023-10-19T13:00:27.021669+0000 (oldest deadline 2023-10-19T13:00:52.921759+0000) 2023-10-19T13:01:23.130 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:22 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:22.790+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:38.624261+0000 front 2023-10-19T13:00:38.624276+0000 (oldest deadline 2023-10-19T13:01:03.324346+0000) 2023-10-19T13:01:23.131 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:22 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:22.790+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:43.324834+0000 front 2023-10-19T13:00:43.324935+0000 (oldest deadline 2023-10-19T13:01:08.624965+0000) 2023-10-19T13:01:23.228 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:22 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:22.906+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:29.654587+0000 front 2023-10-19T13:00:29.654675+0000 (oldest deadline 2023-10-19T13:00:53.154854+0000) 2023-10-19T13:01:23.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:22 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:22.906+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:36.056505+0000 front 2023-10-19T13:00:36.056472+0000 (oldest deadline 2023-10-19T13:01:01.956648+0000) 2023-10-19T13:01:23.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:22 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:22.906+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:46.058503+0000 front 2023-10-19T13:00:46.058479+0000 (oldest deadline 2023-10-19T13:01:11.358383+0000) 2023-10-19T13:01:23.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:22 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:22.906+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2023-10-19T13:00:51.859079+0000 front 2023-10-19T13:00:51.859175+0000 (oldest deadline 2023-10-19T13:01:15.959126+0000) 2023-10-19T13:01:23.630 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:01:23 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T13:01:23.129+0000 7ff1ce306700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:29.065630+0000 front 2023-10-19T13:00:29.065546+0000 (oldest deadline 2023-10-19T13:00:54.365627+0000) 2023-10-19T13:01:23.630 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:01:23 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T13:01:23.129+0000 7ff1ce306700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:43.167422+0000 front 2023-10-19T13:00:43.167454+0000 (oldest deadline 2023-10-19T13:01:10.768080+0000) 2023-10-19T13:01:23.631 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:01:23 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T13:01:23.129+0000 7ff1ce306700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2023-10-19T13:00:54.269766+0000 front 2023-10-19T13:00:54.269658+0000 (oldest deadline 2023-10-19T13:01:18.270411+0000) 2023-10-19T13:01:23.837 INFO:journalctl@ceph.osd.7.smithi157.stdout:Oct 19 13:01:23 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-7[155800]: 2023-10-19T13:01:23.610+0000 7fa0f9071700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:35.451625+0000 front 2023-10-19T13:00:35.451648+0000 (oldest deadline 2023-10-19T13:00:59.551942+0000) 2023-10-19T13:01:23.838 INFO:journalctl@ceph.osd.7.smithi157.stdout:Oct 19 13:01:23 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-7[155800]: 2023-10-19T13:01:23.610+0000 7fa0f9071700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:44.253063+0000 front 2023-10-19T13:00:44.253109+0000 (oldest deadline 2023-10-19T13:01:09.553096+0000) 2023-10-19T13:01:23.838 INFO:journalctl@ceph.osd.7.smithi157.stdout:Oct 19 13:01:23 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-7[155800]: 2023-10-19T13:01:23.610+0000 7fa0f9071700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2023-10-19T13:00:54.254332+0000 front 2023-10-19T13:00:54.254432+0000 (oldest deadline 2023-10-19T13:01:18.954418+0000) 2023-10-19T13:01:23.838 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:23 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:23.392+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:28.496192+0000 front 2023-10-19T13:00:28.496224+0000 (oldest deadline 2023-10-19T13:00:51.396132+0000) 2023-10-19T13:01:23.839 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:23 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:23.392+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:35.497430+0000 front 2023-10-19T13:00:35.497454+0000 (oldest deadline 2023-10-19T13:01:00.197598+0000) 2023-10-19T13:01:23.839 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:23 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:23.392+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:44.799397+0000 front 2023-10-19T13:00:44.799340+0000 (oldest deadline 2023-10-19T13:01:08.899496+0000) 2023-10-19T13:01:23.839 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:23 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:23.392+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2023-10-19T13:00:52.901361+0000 front 2023-10-19T13:00:52.901460+0000 (oldest deadline 2023-10-19T13:01:17.601455+0000) 2023-10-19T13:01:24.130 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:23 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:23.830+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:27.021692+0000 front 2023-10-19T13:00:27.021669+0000 (oldest deadline 2023-10-19T13:00:52.921759+0000) 2023-10-19T13:01:24.130 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:23 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:23.830+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:38.624261+0000 front 2023-10-19T13:00:38.624276+0000 (oldest deadline 2023-10-19T13:01:03.324346+0000) 2023-10-19T13:01:24.130 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:23 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:23.830+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:43.324834+0000 front 2023-10-19T13:00:43.324935+0000 (oldest deadline 2023-10-19T13:01:08.624965+0000) 2023-10-19T13:01:24.131 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:23 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:23.830+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-10-19T13:00:58.928218+0000 front 2023-10-19T13:00:58.928315+0000 (oldest deadline 2023-10-19T13:01:23.628125+0000) 2023-10-19T13:01:24.228 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:23 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:23.912+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:29.654587+0000 front 2023-10-19T13:00:29.654675+0000 (oldest deadline 2023-10-19T13:00:53.154854+0000) 2023-10-19T13:01:24.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:23 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:23.912+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:36.056505+0000 front 2023-10-19T13:00:36.056472+0000 (oldest deadline 2023-10-19T13:01:01.956648+0000) 2023-10-19T13:01:24.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:23 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:23.912+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:46.058503+0000 front 2023-10-19T13:00:46.058479+0000 (oldest deadline 2023-10-19T13:01:11.358383+0000) 2023-10-19T13:01:24.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:23 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:23.912+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2023-10-19T13:00:51.859079+0000 front 2023-10-19T13:00:51.859175+0000 (oldest deadline 2023-10-19T13:01:15.959126+0000) 2023-10-19T13:01:24.631 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:01:24 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T13:01:24.156+0000 7ff1ce306700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:29.065630+0000 front 2023-10-19T13:00:29.065546+0000 (oldest deadline 2023-10-19T13:00:54.365627+0000) 2023-10-19T13:01:24.631 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:01:24 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T13:01:24.156+0000 7ff1ce306700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:43.167422+0000 front 2023-10-19T13:00:43.167454+0000 (oldest deadline 2023-10-19T13:01:10.768080+0000) 2023-10-19T13:01:24.631 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:01:24 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T13:01:24.156+0000 7ff1ce306700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2023-10-19T13:00:54.269766+0000 front 2023-10-19T13:00:54.269658+0000 (oldest deadline 2023-10-19T13:01:18.270411+0000) 2023-10-19T13:01:24.837 INFO:journalctl@ceph.osd.7.smithi157.stdout:Oct 19 13:01:24 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-7[155800]: 2023-10-19T13:01:24.618+0000 7fa0f9071700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:35.451625+0000 front 2023-10-19T13:00:35.451648+0000 (oldest deadline 2023-10-19T13:00:59.551942+0000) 2023-10-19T13:01:24.837 INFO:journalctl@ceph.osd.7.smithi157.stdout:Oct 19 13:01:24 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-7[155800]: 2023-10-19T13:01:24.618+0000 7fa0f9071700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:44.253063+0000 front 2023-10-19T13:00:44.253109+0000 (oldest deadline 2023-10-19T13:01:09.553096+0000) 2023-10-19T13:01:24.838 INFO:journalctl@ceph.osd.7.smithi157.stdout:Oct 19 13:01:24 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-7[155800]: 2023-10-19T13:01:24.618+0000 7fa0f9071700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2023-10-19T13:00:54.254332+0000 front 2023-10-19T13:00:54.254432+0000 (oldest deadline 2023-10-19T13:01:18.954418+0000) 2023-10-19T13:01:24.838 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:24 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:24.415+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:28.496192+0000 front 2023-10-19T13:00:28.496224+0000 (oldest deadline 2023-10-19T13:00:51.396132+0000) 2023-10-19T13:01:24.838 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:24 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:24.415+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:35.497430+0000 front 2023-10-19T13:00:35.497454+0000 (oldest deadline 2023-10-19T13:01:00.197598+0000) 2023-10-19T13:01:24.838 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:24 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:24.415+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:44.799397+0000 front 2023-10-19T13:00:44.799340+0000 (oldest deadline 2023-10-19T13:01:08.899496+0000) 2023-10-19T13:01:24.839 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:24 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:24.415+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2023-10-19T13:00:52.901361+0000 front 2023-10-19T13:00:52.901460+0000 (oldest deadline 2023-10-19T13:01:17.601455+0000) 2023-10-19T13:01:25.130 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:24 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:24.811+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:27.021692+0000 front 2023-10-19T13:00:27.021669+0000 (oldest deadline 2023-10-19T13:00:52.921759+0000) 2023-10-19T13:01:25.130 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:24 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:24.811+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:38.624261+0000 front 2023-10-19T13:00:38.624276+0000 (oldest deadline 2023-10-19T13:01:03.324346+0000) 2023-10-19T13:01:25.131 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:24 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:24.811+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:43.324834+0000 front 2023-10-19T13:00:43.324935+0000 (oldest deadline 2023-10-19T13:01:08.624965+0000) 2023-10-19T13:01:25.131 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:24 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:24.811+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-10-19T13:00:58.928218+0000 front 2023-10-19T13:00:58.928315+0000 (oldest deadline 2023-10-19T13:01:23.628125+0000) 2023-10-19T13:01:25.228 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:24 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:24.916+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:29.654587+0000 front 2023-10-19T13:00:29.654675+0000 (oldest deadline 2023-10-19T13:00:53.154854+0000) 2023-10-19T13:01:25.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:24 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:24.916+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:36.056505+0000 front 2023-10-19T13:00:36.056472+0000 (oldest deadline 2023-10-19T13:01:01.956648+0000) 2023-10-19T13:01:25.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:24 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:24.916+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:46.058503+0000 front 2023-10-19T13:00:46.058479+0000 (oldest deadline 2023-10-19T13:01:11.358383+0000) 2023-10-19T13:01:25.230 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:24 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:24.916+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2023-10-19T13:00:51.859079+0000 front 2023-10-19T13:00:51.859175+0000 (oldest deadline 2023-10-19T13:01:15.959126+0000) 2023-10-19T13:01:25.630 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:01:25 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T13:01:25.204+0000 7ff1ce306700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:29.065630+0000 front 2023-10-19T13:00:29.065546+0000 (oldest deadline 2023-10-19T13:00:54.365627+0000) 2023-10-19T13:01:25.630 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:01:25 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T13:01:25.204+0000 7ff1ce306700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:43.167422+0000 front 2023-10-19T13:00:43.167454+0000 (oldest deadline 2023-10-19T13:01:10.768080+0000) 2023-10-19T13:01:25.631 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:01:25 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T13:01:25.204+0000 7ff1ce306700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2023-10-19T13:00:54.269766+0000 front 2023-10-19T13:00:54.269658+0000 (oldest deadline 2023-10-19T13:01:18.270411+0000) 2023-10-19T13:01:25.837 INFO:journalctl@ceph.osd.7.smithi157.stdout:Oct 19 13:01:25 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-7[155800]: 2023-10-19T13:01:25.589+0000 7fa0f9071700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:35.451625+0000 front 2023-10-19T13:00:35.451648+0000 (oldest deadline 2023-10-19T13:00:59.551942+0000) 2023-10-19T13:01:25.838 INFO:journalctl@ceph.osd.7.smithi157.stdout:Oct 19 13:01:25 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-7[155800]: 2023-10-19T13:01:25.589+0000 7fa0f9071700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:44.253063+0000 front 2023-10-19T13:00:44.253109+0000 (oldest deadline 2023-10-19T13:01:09.553096+0000) 2023-10-19T13:01:25.838 INFO:journalctl@ceph.osd.7.smithi157.stdout:Oct 19 13:01:25 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-7[155800]: 2023-10-19T13:01:25.589+0000 7fa0f9071700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2023-10-19T13:00:54.254332+0000 front 2023-10-19T13:00:54.254432+0000 (oldest deadline 2023-10-19T13:01:18.954418+0000) 2023-10-19T13:01:25.838 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:25 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:25.444+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:28.496192+0000 front 2023-10-19T13:00:28.496224+0000 (oldest deadline 2023-10-19T13:00:51.396132+0000) 2023-10-19T13:01:25.839 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:25 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:25.444+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:35.497430+0000 front 2023-10-19T13:00:35.497454+0000 (oldest deadline 2023-10-19T13:01:00.197598+0000) 2023-10-19T13:01:25.839 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:25 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:25.444+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:44.799397+0000 front 2023-10-19T13:00:44.799340+0000 (oldest deadline 2023-10-19T13:01:08.899496+0000) 2023-10-19T13:01:25.839 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:25 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:25.444+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2023-10-19T13:00:52.901361+0000 front 2023-10-19T13:00:52.901460+0000 (oldest deadline 2023-10-19T13:01:17.601455+0000) 2023-10-19T13:01:26.130 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:25 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:25.844+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:27.021692+0000 front 2023-10-19T13:00:27.021669+0000 (oldest deadline 2023-10-19T13:00:52.921759+0000) 2023-10-19T13:01:26.131 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:25 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:25.844+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:38.624261+0000 front 2023-10-19T13:00:38.624276+0000 (oldest deadline 2023-10-19T13:01:03.324346+0000) 2023-10-19T13:01:26.131 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:25 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:25.844+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:43.324834+0000 front 2023-10-19T13:00:43.324935+0000 (oldest deadline 2023-10-19T13:01:08.624965+0000) 2023-10-19T13:01:26.131 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:25 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:25.844+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-10-19T13:00:58.928218+0000 front 2023-10-19T13:00:58.928315+0000 (oldest deadline 2023-10-19T13:01:23.628125+0000) 2023-10-19T13:01:26.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:25 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:25.908+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:29.654587+0000 front 2023-10-19T13:00:29.654675+0000 (oldest deadline 2023-10-19T13:00:53.154854+0000) 2023-10-19T13:01:26.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:25 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:25.908+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:36.056505+0000 front 2023-10-19T13:00:36.056472+0000 (oldest deadline 2023-10-19T13:01:01.956648+0000) 2023-10-19T13:01:26.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:25 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:25.908+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:46.058503+0000 front 2023-10-19T13:00:46.058479+0000 (oldest deadline 2023-10-19T13:01:11.358383+0000) 2023-10-19T13:01:26.230 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:25 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:25.908+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2023-10-19T13:00:51.859079+0000 front 2023-10-19T13:00:51.859175+0000 (oldest deadline 2023-10-19T13:01:15.959126+0000) 2023-10-19T13:01:26.630 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:01:26 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T13:01:26.248+0000 7ff1ce306700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:29.065630+0000 front 2023-10-19T13:00:29.065546+0000 (oldest deadline 2023-10-19T13:00:54.365627+0000) 2023-10-19T13:01:26.630 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:01:26 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T13:01:26.248+0000 7ff1ce306700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:43.167422+0000 front 2023-10-19T13:00:43.167454+0000 (oldest deadline 2023-10-19T13:01:10.768080+0000) 2023-10-19T13:01:26.631 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:01:26 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T13:01:26.248+0000 7ff1ce306700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2023-10-19T13:00:54.269766+0000 front 2023-10-19T13:00:54.269658+0000 (oldest deadline 2023-10-19T13:01:18.270411+0000) 2023-10-19T13:01:26.631 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:01:26 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T13:01:26.248+0000 7ff1ce306700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-10-19T13:00:59.972066+0000 front 2023-10-19T13:00:59.971898+0000 (oldest deadline 2023-10-19T13:01:25.271986+0000) 2023-10-19T13:01:26.837 INFO:journalctl@ceph.osd.7.smithi157.stdout:Oct 19 13:01:26 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-7[155800]: 2023-10-19T13:01:26.572+0000 7fa0f9071700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:35.451625+0000 front 2023-10-19T13:00:35.451648+0000 (oldest deadline 2023-10-19T13:00:59.551942+0000) 2023-10-19T13:01:26.838 INFO:journalctl@ceph.osd.7.smithi157.stdout:Oct 19 13:01:26 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-7[155800]: 2023-10-19T13:01:26.572+0000 7fa0f9071700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:44.253063+0000 front 2023-10-19T13:00:44.253109+0000 (oldest deadline 2023-10-19T13:01:09.553096+0000) 2023-10-19T13:01:26.838 INFO:journalctl@ceph.osd.7.smithi157.stdout:Oct 19 13:01:26 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-7[155800]: 2023-10-19T13:01:26.572+0000 7fa0f9071700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2023-10-19T13:00:54.254332+0000 front 2023-10-19T13:00:54.254432+0000 (oldest deadline 2023-10-19T13:01:18.954418+0000) 2023-10-19T13:01:26.838 INFO:journalctl@ceph.osd.7.smithi157.stdout:Oct 19 13:01:26 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-7[155800]: 2023-10-19T13:01:26.572+0000 7fa0f9071700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-10-19T13:01:02.455436+0000 front 2023-10-19T13:01:02.455462+0000 (oldest deadline 2023-10-19T13:01:26.555640+0000) 2023-10-19T13:01:26.838 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:26 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:26.475+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:28.496192+0000 front 2023-10-19T13:00:28.496224+0000 (oldest deadline 2023-10-19T13:00:51.396132+0000) 2023-10-19T13:01:26.839 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:26 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:26.475+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:35.497430+0000 front 2023-10-19T13:00:35.497454+0000 (oldest deadline 2023-10-19T13:01:00.197598+0000) 2023-10-19T13:01:26.839 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:26 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:26.475+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:44.799397+0000 front 2023-10-19T13:00:44.799340+0000 (oldest deadline 2023-10-19T13:01:08.899496+0000) 2023-10-19T13:01:26.839 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:26 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:26.475+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2023-10-19T13:00:52.901361+0000 front 2023-10-19T13:00:52.901460+0000 (oldest deadline 2023-10-19T13:01:17.601455+0000) 2023-10-19T13:01:27.130 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:26 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:26.817+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:27.021692+0000 front 2023-10-19T13:00:27.021669+0000 (oldest deadline 2023-10-19T13:00:52.921759+0000) 2023-10-19T13:01:27.130 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:26 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:26.817+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:38.624261+0000 front 2023-10-19T13:00:38.624276+0000 (oldest deadline 2023-10-19T13:01:03.324346+0000) 2023-10-19T13:01:27.131 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:26 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:26.817+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:43.324834+0000 front 2023-10-19T13:00:43.324935+0000 (oldest deadline 2023-10-19T13:01:08.624965+0000) 2023-10-19T13:01:27.131 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:26 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:26.817+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-10-19T13:00:58.928218+0000 front 2023-10-19T13:00:58.928315+0000 (oldest deadline 2023-10-19T13:01:23.628125+0000) 2023-10-19T13:01:27.228 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:26 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:26.895+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:29.654587+0000 front 2023-10-19T13:00:29.654675+0000 (oldest deadline 2023-10-19T13:00:53.154854+0000) 2023-10-19T13:01:27.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:26 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:26.895+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:36.056505+0000 front 2023-10-19T13:00:36.056472+0000 (oldest deadline 2023-10-19T13:01:01.956648+0000) 2023-10-19T13:01:27.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:26 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:26.895+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:46.058503+0000 front 2023-10-19T13:00:46.058479+0000 (oldest deadline 2023-10-19T13:01:11.358383+0000) 2023-10-19T13:01:27.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:26 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:26.895+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2023-10-19T13:00:51.859079+0000 front 2023-10-19T13:00:51.859175+0000 (oldest deadline 2023-10-19T13:01:15.959126+0000) 2023-10-19T13:01:27.630 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:01:27 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T13:01:27.201+0000 7ff1ce306700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:29.065630+0000 front 2023-10-19T13:00:29.065546+0000 (oldest deadline 2023-10-19T13:00:54.365627+0000) 2023-10-19T13:01:27.631 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:01:27 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T13:01:27.201+0000 7ff1ce306700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:43.167422+0000 front 2023-10-19T13:00:43.167454+0000 (oldest deadline 2023-10-19T13:01:10.768080+0000) 2023-10-19T13:01:27.631 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:01:27 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T13:01:27.201+0000 7ff1ce306700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2023-10-19T13:00:54.269766+0000 front 2023-10-19T13:00:54.269658+0000 (oldest deadline 2023-10-19T13:01:18.270411+0000) 2023-10-19T13:01:27.631 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:01:27 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T13:01:27.201+0000 7ff1ce306700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-10-19T13:00:59.972066+0000 front 2023-10-19T13:00:59.971898+0000 (oldest deadline 2023-10-19T13:01:25.271986+0000) 2023-10-19T13:01:27.784 INFO:journalctl@ceph.osd.7.smithi157.stdout:Oct 19 13:01:27 smithi157 bash[177710]: ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-7 2023-10-19T13:01:27.784 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:27 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:27.523+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:28.496192+0000 front 2023-10-19T13:00:28.496224+0000 (oldest deadline 2023-10-19T13:00:51.396132+0000) 2023-10-19T13:01:27.784 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:27 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:27.523+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:35.497430+0000 front 2023-10-19T13:00:35.497454+0000 (oldest deadline 2023-10-19T13:01:00.197598+0000) 2023-10-19T13:01:27.785 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:27 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:27.523+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:44.799397+0000 front 2023-10-19T13:00:44.799340+0000 (oldest deadline 2023-10-19T13:01:08.899496+0000) 2023-10-19T13:01:27.785 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:27 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:27.523+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2023-10-19T13:00:52.901361+0000 front 2023-10-19T13:00:52.901460+0000 (oldest deadline 2023-10-19T13:01:17.601455+0000) 2023-10-19T13:01:27.785 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:27 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:27.523+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-10-19T13:01:02.902795+0000 front 2023-10-19T13:01:02.902756+0000 (oldest deadline 2023-10-19T13:01:27.002954+0000) 2023-10-19T13:01:28.130 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:27 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:27.776+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:27.021692+0000 front 2023-10-19T13:00:27.021669+0000 (oldest deadline 2023-10-19T13:00:52.921759+0000) 2023-10-19T13:01:28.131 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:27 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:27.776+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:38.624261+0000 front 2023-10-19T13:00:38.624276+0000 (oldest deadline 2023-10-19T13:01:03.324346+0000) 2023-10-19T13:01:28.131 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:27 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:27.776+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:43.324834+0000 front 2023-10-19T13:00:43.324935+0000 (oldest deadline 2023-10-19T13:01:08.624965+0000) 2023-10-19T13:01:28.131 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:27 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:27.776+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-10-19T13:00:58.928218+0000 front 2023-10-19T13:00:58.928315+0000 (oldest deadline 2023-10-19T13:01:23.628125+0000) 2023-10-19T13:01:28.228 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:27 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:27.930+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:29.654587+0000 front 2023-10-19T13:00:29.654675+0000 (oldest deadline 2023-10-19T13:00:53.154854+0000) 2023-10-19T13:01:28.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:27 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:27.930+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:36.056505+0000 front 2023-10-19T13:00:36.056472+0000 (oldest deadline 2023-10-19T13:01:01.956648+0000) 2023-10-19T13:01:28.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:27 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:27.930+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:46.058503+0000 front 2023-10-19T13:00:46.058479+0000 (oldest deadline 2023-10-19T13:01:11.358383+0000) 2023-10-19T13:01:28.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:27 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:27.930+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2023-10-19T13:00:51.859079+0000 front 2023-10-19T13:00:51.859175+0000 (oldest deadline 2023-10-19T13:01:15.959126+0000) 2023-10-19T13:01:28.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:27 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:27.930+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-10-19T13:01:01.860365+0000 front 2023-10-19T13:01:01.860425+0000 (oldest deadline 2023-10-19T13:01:27.661115+0000) 2023-10-19T13:01:28.587 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:28 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:28.544+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:28.496192+0000 front 2023-10-19T13:00:28.496224+0000 (oldest deadline 2023-10-19T13:00:51.396132+0000) 2023-10-19T13:01:28.587 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:28 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:28.544+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:35.497430+0000 front 2023-10-19T13:00:35.497454+0000 (oldest deadline 2023-10-19T13:01:00.197598+0000) 2023-10-19T13:01:28.588 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:28 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:28.544+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:44.799397+0000 front 2023-10-19T13:00:44.799340+0000 (oldest deadline 2023-10-19T13:01:08.899496+0000) 2023-10-19T13:01:28.588 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:28 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:28.544+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2023-10-19T13:00:52.901361+0000 front 2023-10-19T13:00:52.901460+0000 (oldest deadline 2023-10-19T13:01:17.601455+0000) 2023-10-19T13:01:28.588 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:28 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:28.544+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-10-19T13:01:02.902795+0000 front 2023-10-19T13:01:02.902756+0000 (oldest deadline 2023-10-19T13:01:27.002954+0000) 2023-10-19T13:01:28.630 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:01:28 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T13:01:28.241+0000 7ff1ce306700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:29.065630+0000 front 2023-10-19T13:00:29.065546+0000 (oldest deadline 2023-10-19T13:00:54.365627+0000) 2023-10-19T13:01:28.630 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:01:28 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T13:01:28.241+0000 7ff1ce306700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:43.167422+0000 front 2023-10-19T13:00:43.167454+0000 (oldest deadline 2023-10-19T13:01:10.768080+0000) 2023-10-19T13:01:28.630 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:01:28 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T13:01:28.241+0000 7ff1ce306700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2023-10-19T13:00:54.269766+0000 front 2023-10-19T13:00:54.269658+0000 (oldest deadline 2023-10-19T13:01:18.270411+0000) 2023-10-19T13:01:28.631 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:01:28 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T13:01:28.241+0000 7ff1ce306700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-10-19T13:00:59.972066+0000 front 2023-10-19T13:00:59.971898+0000 (oldest deadline 2023-10-19T13:01:25.271986+0000) 2023-10-19T13:01:29.048 DEBUG:teuthology.orchestra.run.smithi157:> sudo pkill -f 'journalctl -f -n 0 -u ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@osd.7.service' 2023-10-19T13:01:29.088 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-19T13:01:29.088 INFO:tasks.cephadm.osd.7:Stopped osd.7 2023-10-19T13:01:29.089 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2023-10-19T13:01:29.089 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@osd.8 2023-10-19T13:01:29.120 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:28 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:28.803+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:27.021692+0000 front 2023-10-19T13:00:27.021669+0000 (oldest deadline 2023-10-19T13:00:52.921759+0000) 2023-10-19T13:01:29.120 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:28 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:28.803+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:38.624261+0000 front 2023-10-19T13:00:38.624276+0000 (oldest deadline 2023-10-19T13:01:03.324346+0000) 2023-10-19T13:01:29.120 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:28 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:28.803+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:43.324834+0000 front 2023-10-19T13:00:43.324935+0000 (oldest deadline 2023-10-19T13:01:08.624965+0000) 2023-10-19T13:01:29.120 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:28 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:28.803+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-10-19T13:00:58.928218+0000 front 2023-10-19T13:00:58.928315+0000 (oldest deadline 2023-10-19T13:01:23.628125+0000) 2023-10-19T13:01:29.228 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:28 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:28.917+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:29.654587+0000 front 2023-10-19T13:00:29.654675+0000 (oldest deadline 2023-10-19T13:00:53.154854+0000) 2023-10-19T13:01:29.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:28 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:28.917+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:36.056505+0000 front 2023-10-19T13:00:36.056472+0000 (oldest deadline 2023-10-19T13:01:01.956648+0000) 2023-10-19T13:01:29.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:28 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:28.917+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:46.058503+0000 front 2023-10-19T13:00:46.058479+0000 (oldest deadline 2023-10-19T13:01:11.358383+0000) 2023-10-19T13:01:29.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:28 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:28.917+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2023-10-19T13:00:51.859079+0000 front 2023-10-19T13:00:51.859175+0000 (oldest deadline 2023-10-19T13:01:15.959126+0000) 2023-10-19T13:01:29.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:28 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:28.917+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-10-19T13:01:01.860365+0000 front 2023-10-19T13:01:01.860425+0000 (oldest deadline 2023-10-19T13:01:27.661115+0000) 2023-10-19T13:01:29.380 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:01:29 smithi195 systemd[1]: Stopping Ceph osd.8 for 96a8be3c-6e7b-11ee-8db6-212e2dc638e7... 2023-10-19T13:01:29.380 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:01:29 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T13:01:29.208+0000 7ff1ce306700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:29.065630+0000 front 2023-10-19T13:00:29.065546+0000 (oldest deadline 2023-10-19T13:00:54.365627+0000) 2023-10-19T13:01:29.380 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:01:29 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T13:01:29.208+0000 7ff1ce306700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:43.167422+0000 front 2023-10-19T13:00:43.167454+0000 (oldest deadline 2023-10-19T13:01:10.768080+0000) 2023-10-19T13:01:29.380 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:01:29 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T13:01:29.208+0000 7ff1ce306700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2023-10-19T13:00:54.269766+0000 front 2023-10-19T13:00:54.269658+0000 (oldest deadline 2023-10-19T13:01:18.270411+0000) 2023-10-19T13:01:29.381 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:01:29 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T13:01:29.208+0000 7ff1ce306700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-10-19T13:00:59.972066+0000 front 2023-10-19T13:00:59.971898+0000 (oldest deadline 2023-10-19T13:01:25.271986+0000) 2023-10-19T13:01:29.832 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:01:29 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T13:01:29.442+0000 7ff1d4515700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-19T13:01:29.832 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:01:29 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T13:01:29.442+0000 7ff1d4515700 -1 osd.8 96 *** Got signal Terminated *** 2023-10-19T13:01:29.832 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:01:29 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T13:01:29.442+0000 7ff1d4515700 -1 osd.8 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-19T13:01:30.087 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:29 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:29.590+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:28.496192+0000 front 2023-10-19T13:00:28.496224+0000 (oldest deadline 2023-10-19T13:00:51.396132+0000) 2023-10-19T13:01:30.088 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:29 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:29.590+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:35.497430+0000 front 2023-10-19T13:00:35.497454+0000 (oldest deadline 2023-10-19T13:01:00.197598+0000) 2023-10-19T13:01:30.088 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:29 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:29.590+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:44.799397+0000 front 2023-10-19T13:00:44.799340+0000 (oldest deadline 2023-10-19T13:01:08.899496+0000) 2023-10-19T13:01:30.088 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:29 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:29.590+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2023-10-19T13:00:52.901361+0000 front 2023-10-19T13:00:52.901460+0000 (oldest deadline 2023-10-19T13:01:17.601455+0000) 2023-10-19T13:01:30.088 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:29 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:29.590+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-10-19T13:01:02.902795+0000 front 2023-10-19T13:01:02.902756+0000 (oldest deadline 2023-10-19T13:01:27.002954+0000) 2023-10-19T13:01:30.130 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:29 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:29.829+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:27.021692+0000 front 2023-10-19T13:00:27.021669+0000 (oldest deadline 2023-10-19T13:00:52.921759+0000) 2023-10-19T13:01:30.130 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:29 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:29.829+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:38.624261+0000 front 2023-10-19T13:00:38.624276+0000 (oldest deadline 2023-10-19T13:01:03.324346+0000) 2023-10-19T13:01:30.131 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:29 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:29.829+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:43.324834+0000 front 2023-10-19T13:00:43.324935+0000 (oldest deadline 2023-10-19T13:01:08.624965+0000) 2023-10-19T13:01:30.131 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:29 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:29.829+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-10-19T13:00:58.928218+0000 front 2023-10-19T13:00:58.928315+0000 (oldest deadline 2023-10-19T13:01:23.628125+0000) 2023-10-19T13:01:30.228 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:29 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:29.913+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:29.654587+0000 front 2023-10-19T13:00:29.654675+0000 (oldest deadline 2023-10-19T13:00:53.154854+0000) 2023-10-19T13:01:30.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:29 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:29.913+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:36.056505+0000 front 2023-10-19T13:00:36.056472+0000 (oldest deadline 2023-10-19T13:01:01.956648+0000) 2023-10-19T13:01:30.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:29 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:29.913+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:46.058503+0000 front 2023-10-19T13:00:46.058479+0000 (oldest deadline 2023-10-19T13:01:11.358383+0000) 2023-10-19T13:01:30.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:29 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:29.913+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2023-10-19T13:00:51.859079+0000 front 2023-10-19T13:00:51.859175+0000 (oldest deadline 2023-10-19T13:01:15.959126+0000) 2023-10-19T13:01:30.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:29 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:29.913+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-10-19T13:01:01.860365+0000 front 2023-10-19T13:01:01.860425+0000 (oldest deadline 2023-10-19T13:01:27.661115+0000) 2023-10-19T13:01:30.630 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:01:30 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T13:01:30.234+0000 7ff1ce306700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:29.065630+0000 front 2023-10-19T13:00:29.065546+0000 (oldest deadline 2023-10-19T13:00:54.365627+0000) 2023-10-19T13:01:30.630 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:01:30 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T13:01:30.234+0000 7ff1ce306700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:43.167422+0000 front 2023-10-19T13:00:43.167454+0000 (oldest deadline 2023-10-19T13:01:10.768080+0000) 2023-10-19T13:01:30.630 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:01:30 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T13:01:30.234+0000 7ff1ce306700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2023-10-19T13:00:54.269766+0000 front 2023-10-19T13:00:54.269658+0000 (oldest deadline 2023-10-19T13:01:18.270411+0000) 2023-10-19T13:01:30.631 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:01:30 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T13:01:30.234+0000 7ff1ce306700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-10-19T13:00:59.972066+0000 front 2023-10-19T13:00:59.971898+0000 (oldest deadline 2023-10-19T13:01:25.271986+0000) 2023-10-19T13:01:30.837 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:30 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:30.570+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:28.496192+0000 front 2023-10-19T13:00:28.496224+0000 (oldest deadline 2023-10-19T13:00:51.396132+0000) 2023-10-19T13:01:30.837 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:30 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:30.570+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:35.497430+0000 front 2023-10-19T13:00:35.497454+0000 (oldest deadline 2023-10-19T13:01:00.197598+0000) 2023-10-19T13:01:30.838 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:30 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:30.570+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:44.799397+0000 front 2023-10-19T13:00:44.799340+0000 (oldest deadline 2023-10-19T13:01:08.899496+0000) 2023-10-19T13:01:30.838 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:30 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:30.570+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2023-10-19T13:00:52.901361+0000 front 2023-10-19T13:00:52.901460+0000 (oldest deadline 2023-10-19T13:01:17.601455+0000) 2023-10-19T13:01:30.838 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:30 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:30.570+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-10-19T13:01:02.902795+0000 front 2023-10-19T13:01:02.902756+0000 (oldest deadline 2023-10-19T13:01:27.002954+0000) 2023-10-19T13:01:31.130 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:30 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:30.854+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:27.021692+0000 front 2023-10-19T13:00:27.021669+0000 (oldest deadline 2023-10-19T13:00:52.921759+0000) 2023-10-19T13:01:31.130 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:30 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:30.854+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:38.624261+0000 front 2023-10-19T13:00:38.624276+0000 (oldest deadline 2023-10-19T13:01:03.324346+0000) 2023-10-19T13:01:31.130 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:30 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:30.854+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:43.324834+0000 front 2023-10-19T13:00:43.324935+0000 (oldest deadline 2023-10-19T13:01:08.624965+0000) 2023-10-19T13:01:31.131 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:30 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:30.854+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-10-19T13:00:58.928218+0000 front 2023-10-19T13:00:58.928315+0000 (oldest deadline 2023-10-19T13:01:23.628125+0000) 2023-10-19T13:01:31.228 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:30 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:30.897+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:29.654587+0000 front 2023-10-19T13:00:29.654675+0000 (oldest deadline 2023-10-19T13:00:53.154854+0000) 2023-10-19T13:01:31.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:30 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:30.897+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:36.056505+0000 front 2023-10-19T13:00:36.056472+0000 (oldest deadline 2023-10-19T13:01:01.956648+0000) 2023-10-19T13:01:31.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:30 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:30.897+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:46.058503+0000 front 2023-10-19T13:00:46.058479+0000 (oldest deadline 2023-10-19T13:01:11.358383+0000) 2023-10-19T13:01:31.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:30 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:30.897+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2023-10-19T13:00:51.859079+0000 front 2023-10-19T13:00:51.859175+0000 (oldest deadline 2023-10-19T13:01:15.959126+0000) 2023-10-19T13:01:31.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:30 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:30.897+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-10-19T13:01:01.860365+0000 front 2023-10-19T13:01:01.860425+0000 (oldest deadline 2023-10-19T13:01:27.661115+0000) 2023-10-19T13:01:31.630 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:01:31 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T13:01:31.220+0000 7ff1ce306700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:29.065630+0000 front 2023-10-19T13:00:29.065546+0000 (oldest deadline 2023-10-19T13:00:54.365627+0000) 2023-10-19T13:01:31.630 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:01:31 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T13:01:31.220+0000 7ff1ce306700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:43.167422+0000 front 2023-10-19T13:00:43.167454+0000 (oldest deadline 2023-10-19T13:01:10.768080+0000) 2023-10-19T13:01:31.631 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:01:31 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T13:01:31.220+0000 7ff1ce306700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2023-10-19T13:00:54.269766+0000 front 2023-10-19T13:00:54.269658+0000 (oldest deadline 2023-10-19T13:01:18.270411+0000) 2023-10-19T13:01:31.631 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:01:31 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T13:01:31.220+0000 7ff1ce306700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-10-19T13:00:59.972066+0000 front 2023-10-19T13:00:59.971898+0000 (oldest deadline 2023-10-19T13:01:25.271986+0000) 2023-10-19T13:01:32.087 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:31 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:31.615+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:28.496192+0000 front 2023-10-19T13:00:28.496224+0000 (oldest deadline 2023-10-19T13:00:51.396132+0000) 2023-10-19T13:01:32.088 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:31 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:31.615+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:35.497430+0000 front 2023-10-19T13:00:35.497454+0000 (oldest deadline 2023-10-19T13:01:00.197598+0000) 2023-10-19T13:01:32.088 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:31 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:31.615+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:44.799397+0000 front 2023-10-19T13:00:44.799340+0000 (oldest deadline 2023-10-19T13:01:08.899496+0000) 2023-10-19T13:01:32.088 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:31 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:31.615+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2023-10-19T13:00:52.901361+0000 front 2023-10-19T13:00:52.901460+0000 (oldest deadline 2023-10-19T13:01:17.601455+0000) 2023-10-19T13:01:32.088 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:31 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:31.615+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-10-19T13:01:02.902795+0000 front 2023-10-19T13:01:02.902756+0000 (oldest deadline 2023-10-19T13:01:27.002954+0000) 2023-10-19T13:01:32.130 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:31 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:31.837+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:27.021692+0000 front 2023-10-19T13:00:27.021669+0000 (oldest deadline 2023-10-19T13:00:52.921759+0000) 2023-10-19T13:01:32.130 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:31 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:31.837+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:38.624261+0000 front 2023-10-19T13:00:38.624276+0000 (oldest deadline 2023-10-19T13:01:03.324346+0000) 2023-10-19T13:01:32.130 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:31 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:31.837+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:43.324834+0000 front 2023-10-19T13:00:43.324935+0000 (oldest deadline 2023-10-19T13:01:08.624965+0000) 2023-10-19T13:01:32.131 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:31 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:31.837+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-10-19T13:00:58.928218+0000 front 2023-10-19T13:00:58.928315+0000 (oldest deadline 2023-10-19T13:01:23.628125+0000) 2023-10-19T13:01:32.228 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:31 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:31.915+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:29.654587+0000 front 2023-10-19T13:00:29.654675+0000 (oldest deadline 2023-10-19T13:00:53.154854+0000) 2023-10-19T13:01:32.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:31 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:31.915+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:36.056505+0000 front 2023-10-19T13:00:36.056472+0000 (oldest deadline 2023-10-19T13:01:01.956648+0000) 2023-10-19T13:01:32.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:31 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:31.915+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:46.058503+0000 front 2023-10-19T13:00:46.058479+0000 (oldest deadline 2023-10-19T13:01:11.358383+0000) 2023-10-19T13:01:32.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:31 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:31.915+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2023-10-19T13:00:51.859079+0000 front 2023-10-19T13:00:51.859175+0000 (oldest deadline 2023-10-19T13:01:15.959126+0000) 2023-10-19T13:01:32.230 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:31 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:31.915+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-10-19T13:01:01.860365+0000 front 2023-10-19T13:01:01.860425+0000 (oldest deadline 2023-10-19T13:01:27.661115+0000) 2023-10-19T13:01:32.230 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:31 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:31.915+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-10-19T13:01:07.661664+0000 front 2023-10-19T13:01:07.661686+0000 (oldest deadline 2023-10-19T13:01:31.761798+0000) 2023-10-19T13:01:32.630 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:01:32 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T13:01:32.255+0000 7ff1ce306700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:29.065630+0000 front 2023-10-19T13:00:29.065546+0000 (oldest deadline 2023-10-19T13:00:54.365627+0000) 2023-10-19T13:01:32.630 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:01:32 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T13:01:32.255+0000 7ff1ce306700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:43.167422+0000 front 2023-10-19T13:00:43.167454+0000 (oldest deadline 2023-10-19T13:01:10.768080+0000) 2023-10-19T13:01:32.630 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:01:32 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T13:01:32.255+0000 7ff1ce306700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2023-10-19T13:00:54.269766+0000 front 2023-10-19T13:00:54.269658+0000 (oldest deadline 2023-10-19T13:01:18.270411+0000) 2023-10-19T13:01:32.631 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:01:32 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T13:01:32.255+0000 7ff1ce306700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-10-19T13:00:59.972066+0000 front 2023-10-19T13:00:59.971898+0000 (oldest deadline 2023-10-19T13:01:25.271986+0000) 2023-10-19T13:01:33.087 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:32 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:32.648+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:28.496192+0000 front 2023-10-19T13:00:28.496224+0000 (oldest deadline 2023-10-19T13:00:51.396132+0000) 2023-10-19T13:01:33.088 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:32 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:32.648+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:35.497430+0000 front 2023-10-19T13:00:35.497454+0000 (oldest deadline 2023-10-19T13:01:00.197598+0000) 2023-10-19T13:01:33.088 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:32 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:32.648+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:44.799397+0000 front 2023-10-19T13:00:44.799340+0000 (oldest deadline 2023-10-19T13:01:08.899496+0000) 2023-10-19T13:01:33.088 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:32 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:32.648+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2023-10-19T13:00:52.901361+0000 front 2023-10-19T13:00:52.901460+0000 (oldest deadline 2023-10-19T13:01:17.601455+0000) 2023-10-19T13:01:33.088 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:32 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:32.648+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-10-19T13:01:02.902795+0000 front 2023-10-19T13:01:02.902756+0000 (oldest deadline 2023-10-19T13:01:27.002954+0000) 2023-10-19T13:01:33.130 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:32 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:32.818+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:27.021692+0000 front 2023-10-19T13:00:27.021669+0000 (oldest deadline 2023-10-19T13:00:52.921759+0000) 2023-10-19T13:01:33.130 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:32 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:32.818+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:38.624261+0000 front 2023-10-19T13:00:38.624276+0000 (oldest deadline 2023-10-19T13:01:03.324346+0000) 2023-10-19T13:01:33.130 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:32 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:32.818+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:43.324834+0000 front 2023-10-19T13:00:43.324935+0000 (oldest deadline 2023-10-19T13:01:08.624965+0000) 2023-10-19T13:01:33.131 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:32 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:32.818+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-10-19T13:00:58.928218+0000 front 2023-10-19T13:00:58.928315+0000 (oldest deadline 2023-10-19T13:01:23.628125+0000) 2023-10-19T13:01:33.131 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:32 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:32.818+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-10-19T13:01:10.029480+0000 front 2023-10-19T13:01:10.029517+0000 (oldest deadline 2023-10-19T13:01:32.329563+0000) 2023-10-19T13:01:33.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:32 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:32.904+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:29.654587+0000 front 2023-10-19T13:00:29.654675+0000 (oldest deadline 2023-10-19T13:00:53.154854+0000) 2023-10-19T13:01:33.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:32 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:32.904+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:36.056505+0000 front 2023-10-19T13:00:36.056472+0000 (oldest deadline 2023-10-19T13:01:01.956648+0000) 2023-10-19T13:01:33.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:32 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:32.904+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:46.058503+0000 front 2023-10-19T13:00:46.058479+0000 (oldest deadline 2023-10-19T13:01:11.358383+0000) 2023-10-19T13:01:33.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:32 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:32.904+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2023-10-19T13:00:51.859079+0000 front 2023-10-19T13:00:51.859175+0000 (oldest deadline 2023-10-19T13:01:15.959126+0000) 2023-10-19T13:01:33.230 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:32 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:32.904+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-10-19T13:01:01.860365+0000 front 2023-10-19T13:01:01.860425+0000 (oldest deadline 2023-10-19T13:01:27.661115+0000) 2023-10-19T13:01:33.230 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:32 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:32.904+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-10-19T13:01:07.661664+0000 front 2023-10-19T13:01:07.661686+0000 (oldest deadline 2023-10-19T13:01:31.761798+0000) 2023-10-19T13:01:33.630 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:01:33 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T13:01:33.247+0000 7ff1ce306700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:29.065630+0000 front 2023-10-19T13:00:29.065546+0000 (oldest deadline 2023-10-19T13:00:54.365627+0000) 2023-10-19T13:01:33.630 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:01:33 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T13:01:33.247+0000 7ff1ce306700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:43.167422+0000 front 2023-10-19T13:00:43.167454+0000 (oldest deadline 2023-10-19T13:01:10.768080+0000) 2023-10-19T13:01:33.630 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:01:33 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T13:01:33.247+0000 7ff1ce306700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2023-10-19T13:00:54.269766+0000 front 2023-10-19T13:00:54.269658+0000 (oldest deadline 2023-10-19T13:01:18.270411+0000) 2023-10-19T13:01:33.631 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:01:33 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T13:01:33.247+0000 7ff1ce306700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-10-19T13:00:59.972066+0000 front 2023-10-19T13:00:59.971898+0000 (oldest deadline 2023-10-19T13:01:25.271986+0000) 2023-10-19T13:01:34.087 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:33 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:33.651+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:28.496192+0000 front 2023-10-19T13:00:28.496224+0000 (oldest deadline 2023-10-19T13:00:51.396132+0000) 2023-10-19T13:01:34.087 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:33 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:33.651+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:35.497430+0000 front 2023-10-19T13:00:35.497454+0000 (oldest deadline 2023-10-19T13:01:00.197598+0000) 2023-10-19T13:01:34.088 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:33 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:33.651+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:44.799397+0000 front 2023-10-19T13:00:44.799340+0000 (oldest deadline 2023-10-19T13:01:08.899496+0000) 2023-10-19T13:01:34.088 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:33 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:33.651+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2023-10-19T13:00:52.901361+0000 front 2023-10-19T13:00:52.901460+0000 (oldest deadline 2023-10-19T13:01:17.601455+0000) 2023-10-19T13:01:34.088 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:33 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:33.651+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-10-19T13:01:02.902795+0000 front 2023-10-19T13:01:02.902756+0000 (oldest deadline 2023-10-19T13:01:27.002954+0000) 2023-10-19T13:01:34.130 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:33 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:33.864+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:27.021692+0000 front 2023-10-19T13:00:27.021669+0000 (oldest deadline 2023-10-19T13:00:52.921759+0000) 2023-10-19T13:01:34.130 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:33 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:33.864+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:38.624261+0000 front 2023-10-19T13:00:38.624276+0000 (oldest deadline 2023-10-19T13:01:03.324346+0000) 2023-10-19T13:01:34.131 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:33 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:33.864+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:43.324834+0000 front 2023-10-19T13:00:43.324935+0000 (oldest deadline 2023-10-19T13:01:08.624965+0000) 2023-10-19T13:01:34.131 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:33 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:33.864+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-10-19T13:00:58.928218+0000 front 2023-10-19T13:00:58.928315+0000 (oldest deadline 2023-10-19T13:01:23.628125+0000) 2023-10-19T13:01:34.131 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:33 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:33.864+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-10-19T13:01:10.029480+0000 front 2023-10-19T13:01:10.029517+0000 (oldest deadline 2023-10-19T13:01:32.329563+0000) 2023-10-19T13:01:34.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:33 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:33.879+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:29.654587+0000 front 2023-10-19T13:00:29.654675+0000 (oldest deadline 2023-10-19T13:00:53.154854+0000) 2023-10-19T13:01:34.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:33 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:33.879+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:36.056505+0000 front 2023-10-19T13:00:36.056472+0000 (oldest deadline 2023-10-19T13:01:01.956648+0000) 2023-10-19T13:01:34.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:33 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:33.879+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:46.058503+0000 front 2023-10-19T13:00:46.058479+0000 (oldest deadline 2023-10-19T13:01:11.358383+0000) 2023-10-19T13:01:34.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:33 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:33.879+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2023-10-19T13:00:51.859079+0000 front 2023-10-19T13:00:51.859175+0000 (oldest deadline 2023-10-19T13:01:15.959126+0000) 2023-10-19T13:01:34.230 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:33 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:33.879+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-10-19T13:01:01.860365+0000 front 2023-10-19T13:01:01.860425+0000 (oldest deadline 2023-10-19T13:01:27.661115+0000) 2023-10-19T13:01:34.230 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:33 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:33.879+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-10-19T13:01:07.661664+0000 front 2023-10-19T13:01:07.661686+0000 (oldest deadline 2023-10-19T13:01:31.761798+0000) 2023-10-19T13:01:34.630 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:01:34 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T13:01:34.262+0000 7ff1ce306700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:29.065630+0000 front 2023-10-19T13:00:29.065546+0000 (oldest deadline 2023-10-19T13:00:54.365627+0000) 2023-10-19T13:01:34.630 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:01:34 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T13:01:34.262+0000 7ff1ce306700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:43.167422+0000 front 2023-10-19T13:00:43.167454+0000 (oldest deadline 2023-10-19T13:01:10.768080+0000) 2023-10-19T13:01:34.631 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:01:34 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T13:01:34.262+0000 7ff1ce306700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2023-10-19T13:00:54.269766+0000 front 2023-10-19T13:00:54.269658+0000 (oldest deadline 2023-10-19T13:01:18.270411+0000) 2023-10-19T13:01:34.631 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:01:34 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8[157033]: 2023-10-19T13:01:34.262+0000 7ff1ce306700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-10-19T13:00:59.972066+0000 front 2023-10-19T13:00:59.971898+0000 (oldest deadline 2023-10-19T13:01:25.271986+0000) 2023-10-19T13:01:35.088 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:34 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:34.612+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:28.496192+0000 front 2023-10-19T13:00:28.496224+0000 (oldest deadline 2023-10-19T13:00:51.396132+0000) 2023-10-19T13:01:35.088 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:34 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:34.612+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:35.497430+0000 front 2023-10-19T13:00:35.497454+0000 (oldest deadline 2023-10-19T13:01:00.197598+0000) 2023-10-19T13:01:35.088 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:34 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:34.612+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:44.799397+0000 front 2023-10-19T13:00:44.799340+0000 (oldest deadline 2023-10-19T13:01:08.899496+0000) 2023-10-19T13:01:35.088 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:34 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:34.612+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2023-10-19T13:00:52.901361+0000 front 2023-10-19T13:00:52.901460+0000 (oldest deadline 2023-10-19T13:01:17.601455+0000) 2023-10-19T13:01:35.089 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:34 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:34.612+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-10-19T13:01:02.902795+0000 front 2023-10-19T13:01:02.902756+0000 (oldest deadline 2023-10-19T13:01:27.002954+0000) 2023-10-19T13:01:35.089 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:34 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:34.612+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-10-19T13:01:07.003666+0000 front 2023-10-19T13:01:07.003758+0000 (oldest deadline 2023-10-19T13:01:34.004111+0000) 2023-10-19T13:01:35.141 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:34 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:34.885+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:27.021692+0000 front 2023-10-19T13:00:27.021669+0000 (oldest deadline 2023-10-19T13:00:52.921759+0000) 2023-10-19T13:01:35.141 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:34 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:34.885+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:38.624261+0000 front 2023-10-19T13:00:38.624276+0000 (oldest deadline 2023-10-19T13:01:03.324346+0000) 2023-10-19T13:01:35.141 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:34 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:34.885+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:43.324834+0000 front 2023-10-19T13:00:43.324935+0000 (oldest deadline 2023-10-19T13:01:08.624965+0000) 2023-10-19T13:01:35.142 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:34 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:34.885+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-10-19T13:00:58.928218+0000 front 2023-10-19T13:00:58.928315+0000 (oldest deadline 2023-10-19T13:01:23.628125+0000) 2023-10-19T13:01:35.142 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:34 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:34.885+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-10-19T13:01:10.029480+0000 front 2023-10-19T13:01:10.029517+0000 (oldest deadline 2023-10-19T13:01:32.329563+0000) 2023-10-19T13:01:35.228 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:34 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:34.839+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:29.654587+0000 front 2023-10-19T13:00:29.654675+0000 (oldest deadline 2023-10-19T13:00:53.154854+0000) 2023-10-19T13:01:35.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:34 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:34.839+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:36.056505+0000 front 2023-10-19T13:00:36.056472+0000 (oldest deadline 2023-10-19T13:01:01.956648+0000) 2023-10-19T13:01:35.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:34 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:34.839+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:46.058503+0000 front 2023-10-19T13:00:46.058479+0000 (oldest deadline 2023-10-19T13:01:11.358383+0000) 2023-10-19T13:01:35.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:34 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:34.839+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2023-10-19T13:00:51.859079+0000 front 2023-10-19T13:00:51.859175+0000 (oldest deadline 2023-10-19T13:01:15.959126+0000) 2023-10-19T13:01:35.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:34 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:34.839+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-10-19T13:01:01.860365+0000 front 2023-10-19T13:01:01.860425+0000 (oldest deadline 2023-10-19T13:01:27.661115+0000) 2023-10-19T13:01:35.230 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:34 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:34.839+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-10-19T13:01:07.661664+0000 front 2023-10-19T13:01:07.661686+0000 (oldest deadline 2023-10-19T13:01:31.761798+0000) 2023-10-19T13:01:35.630 INFO:journalctl@ceph.osd.8.smithi195.stdout:Oct 19 13:01:35 smithi195 bash[178688]: ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-8 2023-10-19T13:01:35.837 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:35 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:35.569+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:28.496192+0000 front 2023-10-19T13:00:28.496224+0000 (oldest deadline 2023-10-19T13:00:51.396132+0000) 2023-10-19T13:01:35.838 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:35 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:35.569+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:35.497430+0000 front 2023-10-19T13:00:35.497454+0000 (oldest deadline 2023-10-19T13:01:00.197598+0000) 2023-10-19T13:01:35.838 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:35 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:35.569+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:44.799397+0000 front 2023-10-19T13:00:44.799340+0000 (oldest deadline 2023-10-19T13:01:08.899496+0000) 2023-10-19T13:01:35.838 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:35 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:35.569+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2023-10-19T13:00:52.901361+0000 front 2023-10-19T13:00:52.901460+0000 (oldest deadline 2023-10-19T13:01:17.601455+0000) 2023-10-19T13:01:35.838 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:35 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:35.569+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-10-19T13:01:02.902795+0000 front 2023-10-19T13:01:02.902756+0000 (oldest deadline 2023-10-19T13:01:27.002954+0000) 2023-10-19T13:01:35.838 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:35 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:35.569+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-10-19T13:01:07.003666+0000 front 2023-10-19T13:01:07.003758+0000 (oldest deadline 2023-10-19T13:01:34.004111+0000) 2023-10-19T13:01:36.131 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:35 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:35.872+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:27.021692+0000 front 2023-10-19T13:00:27.021669+0000 (oldest deadline 2023-10-19T13:00:52.921759+0000) 2023-10-19T13:01:36.131 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:35 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:35.872+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:38.624261+0000 front 2023-10-19T13:00:38.624276+0000 (oldest deadline 2023-10-19T13:01:03.324346+0000) 2023-10-19T13:01:36.131 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:35 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:35.872+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:43.324834+0000 front 2023-10-19T13:00:43.324935+0000 (oldest deadline 2023-10-19T13:01:08.624965+0000) 2023-10-19T13:01:36.132 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:35 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:35.872+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-10-19T13:00:58.928218+0000 front 2023-10-19T13:00:58.928315+0000 (oldest deadline 2023-10-19T13:01:23.628125+0000) 2023-10-19T13:01:36.132 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:35 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:35.872+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-10-19T13:01:10.029480+0000 front 2023-10-19T13:01:10.029517+0000 (oldest deadline 2023-10-19T13:01:32.329563+0000) 2023-10-19T13:01:36.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:35 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:35.809+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:29.654587+0000 front 2023-10-19T13:00:29.654675+0000 (oldest deadline 2023-10-19T13:00:53.154854+0000) 2023-10-19T13:01:36.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:35 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:35.809+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:36.056505+0000 front 2023-10-19T13:00:36.056472+0000 (oldest deadline 2023-10-19T13:01:01.956648+0000) 2023-10-19T13:01:36.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:35 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:35.809+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:46.058503+0000 front 2023-10-19T13:00:46.058479+0000 (oldest deadline 2023-10-19T13:01:11.358383+0000) 2023-10-19T13:01:36.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:35 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:35.809+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2023-10-19T13:00:51.859079+0000 front 2023-10-19T13:00:51.859175+0000 (oldest deadline 2023-10-19T13:01:15.959126+0000) 2023-10-19T13:01:36.230 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:35 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:35.809+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-10-19T13:01:01.860365+0000 front 2023-10-19T13:01:01.860425+0000 (oldest deadline 2023-10-19T13:01:27.661115+0000) 2023-10-19T13:01:36.230 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:35 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:35.809+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-10-19T13:01:07.661664+0000 front 2023-10-19T13:01:07.661686+0000 (oldest deadline 2023-10-19T13:01:31.761798+0000) 2023-10-19T13:01:36.494 DEBUG:teuthology.orchestra.run.smithi195:> sudo pkill -f 'journalctl -f -n 0 -u ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@osd.8.service' 2023-10-19T13:01:36.574 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-19T13:01:36.574 INFO:tasks.cephadm.osd.8:Stopped osd.8 2023-10-19T13:01:36.575 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2023-10-19T13:01:36.575 DEBUG:teuthology.orchestra.run.smithi046:> sudo systemctl stop ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@osd.9 2023-10-19T13:01:36.979 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:36 smithi046 systemd[1]: Stopping Ceph osd.9 for 96a8be3c-6e7b-11ee-8db6-212e2dc638e7... 2023-10-19T13:01:36.979 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:36 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:36.850+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:29.654587+0000 front 2023-10-19T13:00:29.654675+0000 (oldest deadline 2023-10-19T13:00:53.154854+0000) 2023-10-19T13:01:36.980 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:36 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:36.850+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:36.056505+0000 front 2023-10-19T13:00:36.056472+0000 (oldest deadline 2023-10-19T13:01:01.956648+0000) 2023-10-19T13:01:36.980 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:36 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:36.850+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:46.058503+0000 front 2023-10-19T13:00:46.058479+0000 (oldest deadline 2023-10-19T13:01:11.358383+0000) 2023-10-19T13:01:36.980 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:36 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:36.850+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2023-10-19T13:00:51.859079+0000 front 2023-10-19T13:00:51.859175+0000 (oldest deadline 2023-10-19T13:01:15.959126+0000) 2023-10-19T13:01:36.980 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:36 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:36.850+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-10-19T13:01:01.860365+0000 front 2023-10-19T13:01:01.860425+0000 (oldest deadline 2023-10-19T13:01:27.661115+0000) 2023-10-19T13:01:36.980 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:36 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:36.850+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-10-19T13:01:07.661664+0000 front 2023-10-19T13:01:07.661686+0000 (oldest deadline 2023-10-19T13:01:31.761798+0000) 2023-10-19T13:01:37.089 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:36 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:36.586+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:28.496192+0000 front 2023-10-19T13:00:28.496224+0000 (oldest deadline 2023-10-19T13:00:51.396132+0000) 2023-10-19T13:01:37.090 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:36 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:36.586+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:35.497430+0000 front 2023-10-19T13:00:35.497454+0000 (oldest deadline 2023-10-19T13:01:00.197598+0000) 2023-10-19T13:01:37.090 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:36 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:36.586+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:44.799397+0000 front 2023-10-19T13:00:44.799340+0000 (oldest deadline 2023-10-19T13:01:08.899496+0000) 2023-10-19T13:01:37.090 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:36 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:36.586+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2023-10-19T13:00:52.901361+0000 front 2023-10-19T13:00:52.901460+0000 (oldest deadline 2023-10-19T13:01:17.601455+0000) 2023-10-19T13:01:37.090 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:36 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:36.586+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-10-19T13:01:02.902795+0000 front 2023-10-19T13:01:02.902756+0000 (oldest deadline 2023-10-19T13:01:27.002954+0000) 2023-10-19T13:01:37.091 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:36 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:36.586+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-10-19T13:01:07.003666+0000 front 2023-10-19T13:01:07.003758+0000 (oldest deadline 2023-10-19T13:01:34.004111+0000) 2023-10-19T13:01:37.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:36 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:36.896+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:27.021692+0000 front 2023-10-19T13:00:27.021669+0000 (oldest deadline 2023-10-19T13:00:52.921759+0000) 2023-10-19T13:01:37.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:36 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:36.896+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:38.624261+0000 front 2023-10-19T13:00:38.624276+0000 (oldest deadline 2023-10-19T13:01:03.324346+0000) 2023-10-19T13:01:37.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:36 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:36.896+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:43.324834+0000 front 2023-10-19T13:00:43.324935+0000 (oldest deadline 2023-10-19T13:01:08.624965+0000) 2023-10-19T13:01:37.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:36 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:36.896+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-10-19T13:00:58.928218+0000 front 2023-10-19T13:00:58.928315+0000 (oldest deadline 2023-10-19T13:01:23.628125+0000) 2023-10-19T13:01:37.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:36 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:36.896+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-10-19T13:01:10.029480+0000 front 2023-10-19T13:01:10.029517+0000 (oldest deadline 2023-10-19T13:01:32.329563+0000) 2023-10-19T13:01:37.478 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:37 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:37.211+0000 7fc9a68ab700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-19T13:01:37.479 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:37 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:37.211+0000 7fc9a68ab700 -1 osd.9 96 *** Got signal Terminated *** 2023-10-19T13:01:37.479 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:37 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:37.211+0000 7fc9a68ab700 -1 osd.9 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-19T13:01:38.087 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:37 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:37.627+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:28.496192+0000 front 2023-10-19T13:00:28.496224+0000 (oldest deadline 2023-10-19T13:00:51.396132+0000) 2023-10-19T13:01:38.088 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:37 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:37.627+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:35.497430+0000 front 2023-10-19T13:00:35.497454+0000 (oldest deadline 2023-10-19T13:01:00.197598+0000) 2023-10-19T13:01:38.088 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:37 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:37.627+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:44.799397+0000 front 2023-10-19T13:00:44.799340+0000 (oldest deadline 2023-10-19T13:01:08.899496+0000) 2023-10-19T13:01:38.088 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:37 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:37.627+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2023-10-19T13:00:52.901361+0000 front 2023-10-19T13:00:52.901460+0000 (oldest deadline 2023-10-19T13:01:17.601455+0000) 2023-10-19T13:01:38.088 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:37 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:37.627+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-10-19T13:01:02.902795+0000 front 2023-10-19T13:01:02.902756+0000 (oldest deadline 2023-10-19T13:01:27.002954+0000) 2023-10-19T13:01:38.089 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:37 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:37.627+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-10-19T13:01:07.003666+0000 front 2023-10-19T13:01:07.003758+0000 (oldest deadline 2023-10-19T13:01:34.004111+0000) 2023-10-19T13:01:38.228 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:37 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:37.827+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:29.654587+0000 front 2023-10-19T13:00:29.654675+0000 (oldest deadline 2023-10-19T13:00:53.154854+0000) 2023-10-19T13:01:38.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:37 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:37.827+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:36.056505+0000 front 2023-10-19T13:00:36.056472+0000 (oldest deadline 2023-10-19T13:01:01.956648+0000) 2023-10-19T13:01:38.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:37 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:37.827+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:46.058503+0000 front 2023-10-19T13:00:46.058479+0000 (oldest deadline 2023-10-19T13:01:11.358383+0000) 2023-10-19T13:01:38.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:37 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:37.827+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2023-10-19T13:00:51.859079+0000 front 2023-10-19T13:00:51.859175+0000 (oldest deadline 2023-10-19T13:01:15.959126+0000) 2023-10-19T13:01:38.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:37 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:37.827+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-10-19T13:01:01.860365+0000 front 2023-10-19T13:01:01.860425+0000 (oldest deadline 2023-10-19T13:01:27.661115+0000) 2023-10-19T13:01:38.230 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:37 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:37.827+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-10-19T13:01:07.661664+0000 front 2023-10-19T13:01:07.661686+0000 (oldest deadline 2023-10-19T13:01:31.761798+0000) 2023-10-19T13:01:38.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:37 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:37.923+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:27.021692+0000 front 2023-10-19T13:00:27.021669+0000 (oldest deadline 2023-10-19T13:00:52.921759+0000) 2023-10-19T13:01:38.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:37 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:37.923+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:38.624261+0000 front 2023-10-19T13:00:38.624276+0000 (oldest deadline 2023-10-19T13:01:03.324346+0000) 2023-10-19T13:01:38.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:37 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:37.923+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:43.324834+0000 front 2023-10-19T13:00:43.324935+0000 (oldest deadline 2023-10-19T13:01:08.624965+0000) 2023-10-19T13:01:38.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:37 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:37.923+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-10-19T13:00:58.928218+0000 front 2023-10-19T13:00:58.928315+0000 (oldest deadline 2023-10-19T13:01:23.628125+0000) 2023-10-19T13:01:38.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:37 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:37.923+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-10-19T13:01:10.029480+0000 front 2023-10-19T13:01:10.029517+0000 (oldest deadline 2023-10-19T13:01:32.329563+0000) 2023-10-19T13:01:39.087 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:38 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:38.630+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:28.496192+0000 front 2023-10-19T13:00:28.496224+0000 (oldest deadline 2023-10-19T13:00:51.396132+0000) 2023-10-19T13:01:39.087 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:38 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:38.630+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:35.497430+0000 front 2023-10-19T13:00:35.497454+0000 (oldest deadline 2023-10-19T13:01:00.197598+0000) 2023-10-19T13:01:39.088 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:38 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:38.630+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:44.799397+0000 front 2023-10-19T13:00:44.799340+0000 (oldest deadline 2023-10-19T13:01:08.899496+0000) 2023-10-19T13:01:39.088 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:38 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:38.630+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2023-10-19T13:00:52.901361+0000 front 2023-10-19T13:00:52.901460+0000 (oldest deadline 2023-10-19T13:01:17.601455+0000) 2023-10-19T13:01:39.088 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:38 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:38.630+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-10-19T13:01:02.902795+0000 front 2023-10-19T13:01:02.902756+0000 (oldest deadline 2023-10-19T13:01:27.002954+0000) 2023-10-19T13:01:39.088 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:38 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:38.630+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-10-19T13:01:07.003666+0000 front 2023-10-19T13:01:07.003758+0000 (oldest deadline 2023-10-19T13:01:34.004111+0000) 2023-10-19T13:01:39.228 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:38 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:38.859+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:29.654587+0000 front 2023-10-19T13:00:29.654675+0000 (oldest deadline 2023-10-19T13:00:53.154854+0000) 2023-10-19T13:01:39.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:38 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:38.859+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:36.056505+0000 front 2023-10-19T13:00:36.056472+0000 (oldest deadline 2023-10-19T13:01:01.956648+0000) 2023-10-19T13:01:39.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:38 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:38.859+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:46.058503+0000 front 2023-10-19T13:00:46.058479+0000 (oldest deadline 2023-10-19T13:01:11.358383+0000) 2023-10-19T13:01:39.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:38 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:38.859+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2023-10-19T13:00:51.859079+0000 front 2023-10-19T13:00:51.859175+0000 (oldest deadline 2023-10-19T13:01:15.959126+0000) 2023-10-19T13:01:39.230 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:38 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:38.859+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-10-19T13:01:01.860365+0000 front 2023-10-19T13:01:01.860425+0000 (oldest deadline 2023-10-19T13:01:27.661115+0000) 2023-10-19T13:01:39.230 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:38 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:38.859+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-10-19T13:01:07.661664+0000 front 2023-10-19T13:01:07.661686+0000 (oldest deadline 2023-10-19T13:01:31.761798+0000) 2023-10-19T13:01:39.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:38 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:38.949+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:27.021692+0000 front 2023-10-19T13:00:27.021669+0000 (oldest deadline 2023-10-19T13:00:52.921759+0000) 2023-10-19T13:01:39.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:38 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:38.949+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:38.624261+0000 front 2023-10-19T13:00:38.624276+0000 (oldest deadline 2023-10-19T13:01:03.324346+0000) 2023-10-19T13:01:39.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:38 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:38.949+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:43.324834+0000 front 2023-10-19T13:00:43.324935+0000 (oldest deadline 2023-10-19T13:01:08.624965+0000) 2023-10-19T13:01:39.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:38 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:38.949+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-10-19T13:00:58.928218+0000 front 2023-10-19T13:00:58.928315+0000 (oldest deadline 2023-10-19T13:01:23.628125+0000) 2023-10-19T13:01:39.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:38 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:38.949+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-10-19T13:01:10.029480+0000 front 2023-10-19T13:01:10.029517+0000 (oldest deadline 2023-10-19T13:01:32.329563+0000) 2023-10-19T13:01:40.087 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:39 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:39.672+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:28.496192+0000 front 2023-10-19T13:00:28.496224+0000 (oldest deadline 2023-10-19T13:00:51.396132+0000) 2023-10-19T13:01:40.087 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:39 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:39.672+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:35.497430+0000 front 2023-10-19T13:00:35.497454+0000 (oldest deadline 2023-10-19T13:01:00.197598+0000) 2023-10-19T13:01:40.088 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:39 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:39.672+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:44.799397+0000 front 2023-10-19T13:00:44.799340+0000 (oldest deadline 2023-10-19T13:01:08.899496+0000) 2023-10-19T13:01:40.088 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:39 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:39.672+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2023-10-19T13:00:52.901361+0000 front 2023-10-19T13:00:52.901460+0000 (oldest deadline 2023-10-19T13:01:17.601455+0000) 2023-10-19T13:01:40.088 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:39 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:39.672+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-10-19T13:01:02.902795+0000 front 2023-10-19T13:01:02.902756+0000 (oldest deadline 2023-10-19T13:01:27.002954+0000) 2023-10-19T13:01:40.088 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:39 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:39.672+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-10-19T13:01:07.003666+0000 front 2023-10-19T13:01:07.003758+0000 (oldest deadline 2023-10-19T13:01:34.004111+0000) 2023-10-19T13:01:40.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:39 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:39.879+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:29.654587+0000 front 2023-10-19T13:00:29.654675+0000 (oldest deadline 2023-10-19T13:00:53.154854+0000) 2023-10-19T13:01:40.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:39 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:39.879+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:36.056505+0000 front 2023-10-19T13:00:36.056472+0000 (oldest deadline 2023-10-19T13:01:01.956648+0000) 2023-10-19T13:01:40.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:39 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:39.879+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:46.058503+0000 front 2023-10-19T13:00:46.058479+0000 (oldest deadline 2023-10-19T13:01:11.358383+0000) 2023-10-19T13:01:40.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:39 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:39.879+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2023-10-19T13:00:51.859079+0000 front 2023-10-19T13:00:51.859175+0000 (oldest deadline 2023-10-19T13:01:15.959126+0000) 2023-10-19T13:01:40.230 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:39 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:39.879+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-10-19T13:01:01.860365+0000 front 2023-10-19T13:01:01.860425+0000 (oldest deadline 2023-10-19T13:01:27.661115+0000) 2023-10-19T13:01:40.230 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:39 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:39.879+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-10-19T13:01:07.661664+0000 front 2023-10-19T13:01:07.661686+0000 (oldest deadline 2023-10-19T13:01:31.761798+0000) 2023-10-19T13:01:40.230 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:39 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:39.879+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6822 osd.6 since back 2023-10-19T13:01:16.463118+0000 front 2023-10-19T13:01:16.463339+0000 (oldest deadline 2023-10-19T13:01:39.363308+0000) 2023-10-19T13:01:40.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:39 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:39.900+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:27.021692+0000 front 2023-10-19T13:00:27.021669+0000 (oldest deadline 2023-10-19T13:00:52.921759+0000) 2023-10-19T13:01:40.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:39 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:39.900+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:38.624261+0000 front 2023-10-19T13:00:38.624276+0000 (oldest deadline 2023-10-19T13:01:03.324346+0000) 2023-10-19T13:01:40.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:39 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:39.900+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:43.324834+0000 front 2023-10-19T13:00:43.324935+0000 (oldest deadline 2023-10-19T13:01:08.624965+0000) 2023-10-19T13:01:40.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:39 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:39.900+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-10-19T13:00:58.928218+0000 front 2023-10-19T13:00:58.928315+0000 (oldest deadline 2023-10-19T13:01:23.628125+0000) 2023-10-19T13:01:40.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:39 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:39.900+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-10-19T13:01:10.029480+0000 front 2023-10-19T13:01:10.029517+0000 (oldest deadline 2023-10-19T13:01:32.329563+0000) 2023-10-19T13:01:41.087 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:40 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:40.692+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:28.496192+0000 front 2023-10-19T13:00:28.496224+0000 (oldest deadline 2023-10-19T13:00:51.396132+0000) 2023-10-19T13:01:41.088 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:40 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:40.692+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:35.497430+0000 front 2023-10-19T13:00:35.497454+0000 (oldest deadline 2023-10-19T13:01:00.197598+0000) 2023-10-19T13:01:41.088 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:40 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:40.692+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:44.799397+0000 front 2023-10-19T13:00:44.799340+0000 (oldest deadline 2023-10-19T13:01:08.899496+0000) 2023-10-19T13:01:41.088 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:40 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:40.692+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2023-10-19T13:00:52.901361+0000 front 2023-10-19T13:00:52.901460+0000 (oldest deadline 2023-10-19T13:01:17.601455+0000) 2023-10-19T13:01:41.088 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:40 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:40.692+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-10-19T13:01:02.902795+0000 front 2023-10-19T13:01:02.902756+0000 (oldest deadline 2023-10-19T13:01:27.002954+0000) 2023-10-19T13:01:41.088 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:40 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:40.692+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-10-19T13:01:07.003666+0000 front 2023-10-19T13:01:07.003758+0000 (oldest deadline 2023-10-19T13:01:34.004111+0000) 2023-10-19T13:01:41.089 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:40 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:40.692+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6822 osd.6 since back 2023-10-19T13:01:15.105406+0000 front 2023-10-19T13:01:15.105354+0000 (oldest deadline 2023-10-19T13:01:39.705931+0000) 2023-10-19T13:01:41.130 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:40 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:40.871+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:27.021692+0000 front 2023-10-19T13:00:27.021669+0000 (oldest deadline 2023-10-19T13:00:52.921759+0000) 2023-10-19T13:01:41.130 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:40 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:40.871+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:38.624261+0000 front 2023-10-19T13:00:38.624276+0000 (oldest deadline 2023-10-19T13:01:03.324346+0000) 2023-10-19T13:01:41.130 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:40 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:40.871+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:43.324834+0000 front 2023-10-19T13:00:43.324935+0000 (oldest deadline 2023-10-19T13:01:08.624965+0000) 2023-10-19T13:01:41.130 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:40 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:40.871+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-10-19T13:00:58.928218+0000 front 2023-10-19T13:00:58.928315+0000 (oldest deadline 2023-10-19T13:01:23.628125+0000) 2023-10-19T13:01:41.131 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:40 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:40.871+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-10-19T13:01:10.029480+0000 front 2023-10-19T13:01:10.029517+0000 (oldest deadline 2023-10-19T13:01:32.329563+0000) 2023-10-19T13:01:41.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:40 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:40.835+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:29.654587+0000 front 2023-10-19T13:00:29.654675+0000 (oldest deadline 2023-10-19T13:00:53.154854+0000) 2023-10-19T13:01:41.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:40 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:40.835+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:36.056505+0000 front 2023-10-19T13:00:36.056472+0000 (oldest deadline 2023-10-19T13:01:01.956648+0000) 2023-10-19T13:01:41.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:40 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:40.835+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:46.058503+0000 front 2023-10-19T13:00:46.058479+0000 (oldest deadline 2023-10-19T13:01:11.358383+0000) 2023-10-19T13:01:41.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:40 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:40.836+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2023-10-19T13:00:51.859079+0000 front 2023-10-19T13:00:51.859175+0000 (oldest deadline 2023-10-19T13:01:15.959126+0000) 2023-10-19T13:01:41.230 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:40 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:40.836+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-10-19T13:01:01.860365+0000 front 2023-10-19T13:01:01.860425+0000 (oldest deadline 2023-10-19T13:01:27.661115+0000) 2023-10-19T13:01:41.230 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:40 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:40.836+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-10-19T13:01:07.661664+0000 front 2023-10-19T13:01:07.661686+0000 (oldest deadline 2023-10-19T13:01:31.761798+0000) 2023-10-19T13:01:41.230 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:40 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:40.836+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6822 osd.6 since back 2023-10-19T13:01:16.463118+0000 front 2023-10-19T13:01:16.463339+0000 (oldest deadline 2023-10-19T13:01:39.363308+0000) 2023-10-19T13:01:42.087 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:41 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:41.650+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:28.496192+0000 front 2023-10-19T13:00:28.496224+0000 (oldest deadline 2023-10-19T13:00:51.396132+0000) 2023-10-19T13:01:42.087 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:41 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:41.650+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:35.497430+0000 front 2023-10-19T13:00:35.497454+0000 (oldest deadline 2023-10-19T13:01:00.197598+0000) 2023-10-19T13:01:42.088 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:41 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:41.650+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:44.799397+0000 front 2023-10-19T13:00:44.799340+0000 (oldest deadline 2023-10-19T13:01:08.899496+0000) 2023-10-19T13:01:42.088 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:41 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:41.650+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2023-10-19T13:00:52.901361+0000 front 2023-10-19T13:00:52.901460+0000 (oldest deadline 2023-10-19T13:01:17.601455+0000) 2023-10-19T13:01:42.088 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:41 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:41.650+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-10-19T13:01:02.902795+0000 front 2023-10-19T13:01:02.902756+0000 (oldest deadline 2023-10-19T13:01:27.002954+0000) 2023-10-19T13:01:42.088 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:41 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:41.650+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-10-19T13:01:07.003666+0000 front 2023-10-19T13:01:07.003758+0000 (oldest deadline 2023-10-19T13:01:34.004111+0000) 2023-10-19T13:01:42.088 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:41 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:41.650+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6822 osd.6 since back 2023-10-19T13:01:15.105406+0000 front 2023-10-19T13:01:15.105354+0000 (oldest deadline 2023-10-19T13:01:39.705931+0000) 2023-10-19T13:01:42.228 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:41 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:41.852+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:29.654587+0000 front 2023-10-19T13:00:29.654675+0000 (oldest deadline 2023-10-19T13:00:53.154854+0000) 2023-10-19T13:01:42.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:41 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:41.852+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:36.056505+0000 front 2023-10-19T13:00:36.056472+0000 (oldest deadline 2023-10-19T13:01:01.956648+0000) 2023-10-19T13:01:42.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:41 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:41.852+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:46.058503+0000 front 2023-10-19T13:00:46.058479+0000 (oldest deadline 2023-10-19T13:01:11.358383+0000) 2023-10-19T13:01:42.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:41 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:41.852+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2023-10-19T13:00:51.859079+0000 front 2023-10-19T13:00:51.859175+0000 (oldest deadline 2023-10-19T13:01:15.959126+0000) 2023-10-19T13:01:42.229 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:41 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:41.852+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-10-19T13:01:01.860365+0000 front 2023-10-19T13:01:01.860425+0000 (oldest deadline 2023-10-19T13:01:27.661115+0000) 2023-10-19T13:01:42.230 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:41 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:41.852+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-10-19T13:01:07.661664+0000 front 2023-10-19T13:01:07.661686+0000 (oldest deadline 2023-10-19T13:01:31.761798+0000) 2023-10-19T13:01:42.230 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:41 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9[141657]: 2023-10-19T13:01:41.852+0000 7fc9a0e9d700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6822 osd.6 since back 2023-10-19T13:01:16.463118+0000 front 2023-10-19T13:01:16.463339+0000 (oldest deadline 2023-10-19T13:01:39.363308+0000) 2023-10-19T13:01:42.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:41 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:41.890+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:27.021692+0000 front 2023-10-19T13:00:27.021669+0000 (oldest deadline 2023-10-19T13:00:52.921759+0000) 2023-10-19T13:01:42.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:41 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:41.890+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:38.624261+0000 front 2023-10-19T13:00:38.624276+0000 (oldest deadline 2023-10-19T13:01:03.324346+0000) 2023-10-19T13:01:42.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:41 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:41.890+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:43.324834+0000 front 2023-10-19T13:00:43.324935+0000 (oldest deadline 2023-10-19T13:01:08.624965+0000) 2023-10-19T13:01:42.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:41 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:41.890+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-10-19T13:00:58.928218+0000 front 2023-10-19T13:00:58.928315+0000 (oldest deadline 2023-10-19T13:01:23.628125+0000) 2023-10-19T13:01:42.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:41 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:41.890+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-10-19T13:01:10.029480+0000 front 2023-10-19T13:01:10.029517+0000 (oldest deadline 2023-10-19T13:01:32.329563+0000) 2023-10-19T13:01:42.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:41 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:41.890+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6822 osd.6 since back 2023-10-19T13:01:17.531200+0000 front 2023-10-19T13:01:17.531135+0000 (oldest deadline 2023-10-19T13:01:41.030976+0000) 2023-10-19T13:01:43.087 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:42 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:42.611+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:28.496192+0000 front 2023-10-19T13:00:28.496224+0000 (oldest deadline 2023-10-19T13:00:51.396132+0000) 2023-10-19T13:01:43.087 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:42 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:42.611+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:35.497430+0000 front 2023-10-19T13:00:35.497454+0000 (oldest deadline 2023-10-19T13:01:00.197598+0000) 2023-10-19T13:01:43.088 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:42 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:42.611+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:44.799397+0000 front 2023-10-19T13:00:44.799340+0000 (oldest deadline 2023-10-19T13:01:08.899496+0000) 2023-10-19T13:01:43.088 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:42 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:42.611+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2023-10-19T13:00:52.901361+0000 front 2023-10-19T13:00:52.901460+0000 (oldest deadline 2023-10-19T13:01:17.601455+0000) 2023-10-19T13:01:43.088 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:42 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:42.611+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-10-19T13:01:02.902795+0000 front 2023-10-19T13:01:02.902756+0000 (oldest deadline 2023-10-19T13:01:27.002954+0000) 2023-10-19T13:01:43.088 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:42 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:42.611+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-10-19T13:01:07.003666+0000 front 2023-10-19T13:01:07.003758+0000 (oldest deadline 2023-10-19T13:01:34.004111+0000) 2023-10-19T13:01:43.089 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:42 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:42.611+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6822 osd.6 since back 2023-10-19T13:01:15.105406+0000 front 2023-10-19T13:01:15.105354+0000 (oldest deadline 2023-10-19T13:01:39.705931+0000) 2023-10-19T13:01:43.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:42 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:42.937+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:27.021692+0000 front 2023-10-19T13:00:27.021669+0000 (oldest deadline 2023-10-19T13:00:52.921759+0000) 2023-10-19T13:01:43.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:42 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:42.937+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:38.624261+0000 front 2023-10-19T13:00:38.624276+0000 (oldest deadline 2023-10-19T13:01:03.324346+0000) 2023-10-19T13:01:43.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:42 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:42.937+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:43.324834+0000 front 2023-10-19T13:00:43.324935+0000 (oldest deadline 2023-10-19T13:01:08.624965+0000) 2023-10-19T13:01:43.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:42 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:42.937+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-10-19T13:00:58.928218+0000 front 2023-10-19T13:00:58.928315+0000 (oldest deadline 2023-10-19T13:01:23.628125+0000) 2023-10-19T13:01:43.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:42 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:42.937+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-10-19T13:01:10.029480+0000 front 2023-10-19T13:01:10.029517+0000 (oldest deadline 2023-10-19T13:01:32.329563+0000) 2023-10-19T13:01:43.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:42 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:42.937+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6822 osd.6 since back 2023-10-19T13:01:17.531200+0000 front 2023-10-19T13:01:17.531135+0000 (oldest deadline 2023-10-19T13:01:41.030976+0000) 2023-10-19T13:01:43.478 INFO:journalctl@ceph.osd.9.smithi046.stdout:Oct 19 13:01:43 smithi046 bash[176916]: ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-9 2023-10-19T13:01:44.087 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:43 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:43.621+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:28.496192+0000 front 2023-10-19T13:00:28.496224+0000 (oldest deadline 2023-10-19T13:00:51.396132+0000) 2023-10-19T13:01:44.087 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:43 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:43.621+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:35.497430+0000 front 2023-10-19T13:00:35.497454+0000 (oldest deadline 2023-10-19T13:01:00.197598+0000) 2023-10-19T13:01:44.088 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:43 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:43.621+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:44.799397+0000 front 2023-10-19T13:00:44.799340+0000 (oldest deadline 2023-10-19T13:01:08.899496+0000) 2023-10-19T13:01:44.088 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:43 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:43.621+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2023-10-19T13:00:52.901361+0000 front 2023-10-19T13:00:52.901460+0000 (oldest deadline 2023-10-19T13:01:17.601455+0000) 2023-10-19T13:01:44.088 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:43 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:43.621+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-10-19T13:01:02.902795+0000 front 2023-10-19T13:01:02.902756+0000 (oldest deadline 2023-10-19T13:01:27.002954+0000) 2023-10-19T13:01:44.088 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:43 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:43.621+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-10-19T13:01:07.003666+0000 front 2023-10-19T13:01:07.003758+0000 (oldest deadline 2023-10-19T13:01:34.004111+0000) 2023-10-19T13:01:44.088 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:43 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:43.621+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6822 osd.6 since back 2023-10-19T13:01:15.105406+0000 front 2023-10-19T13:01:15.105354+0000 (oldest deadline 2023-10-19T13:01:39.705931+0000) 2023-10-19T13:01:44.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:43 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:43.975+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:27.021692+0000 front 2023-10-19T13:00:27.021669+0000 (oldest deadline 2023-10-19T13:00:52.921759+0000) 2023-10-19T13:01:44.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:43 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:43.975+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:38.624261+0000 front 2023-10-19T13:00:38.624276+0000 (oldest deadline 2023-10-19T13:01:03.324346+0000) 2023-10-19T13:01:44.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:43 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:43.975+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:43.324834+0000 front 2023-10-19T13:00:43.324935+0000 (oldest deadline 2023-10-19T13:01:08.624965+0000) 2023-10-19T13:01:44.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:43 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:43.975+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-10-19T13:00:58.928218+0000 front 2023-10-19T13:00:58.928315+0000 (oldest deadline 2023-10-19T13:01:23.628125+0000) 2023-10-19T13:01:44.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:43 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:43.975+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-10-19T13:01:10.029480+0000 front 2023-10-19T13:01:10.029517+0000 (oldest deadline 2023-10-19T13:01:32.329563+0000) 2023-10-19T13:01:44.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:43 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:43.975+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6822 osd.6 since back 2023-10-19T13:01:17.531200+0000 front 2023-10-19T13:01:17.531135+0000 (oldest deadline 2023-10-19T13:01:41.030976+0000) 2023-10-19T13:01:44.837 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:44 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:44.583+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:28.496192+0000 front 2023-10-19T13:00:28.496224+0000 (oldest deadline 2023-10-19T13:00:51.396132+0000) 2023-10-19T13:01:44.837 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:44 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:44.583+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:35.497430+0000 front 2023-10-19T13:00:35.497454+0000 (oldest deadline 2023-10-19T13:01:00.197598+0000) 2023-10-19T13:01:44.838 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:44 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:44.583+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:44.799397+0000 front 2023-10-19T13:00:44.799340+0000 (oldest deadline 2023-10-19T13:01:08.899496+0000) 2023-10-19T13:01:44.838 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:44 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:44.583+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2023-10-19T13:00:52.901361+0000 front 2023-10-19T13:00:52.901460+0000 (oldest deadline 2023-10-19T13:01:17.601455+0000) 2023-10-19T13:01:44.838 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:44 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:44.583+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-10-19T13:01:02.902795+0000 front 2023-10-19T13:01:02.902756+0000 (oldest deadline 2023-10-19T13:01:27.002954+0000) 2023-10-19T13:01:44.838 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:44 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:44.583+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-10-19T13:01:07.003666+0000 front 2023-10-19T13:01:07.003758+0000 (oldest deadline 2023-10-19T13:01:34.004111+0000) 2023-10-19T13:01:44.839 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:44 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:44.583+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6822 osd.6 since back 2023-10-19T13:01:15.105406+0000 front 2023-10-19T13:01:15.105354+0000 (oldest deadline 2023-10-19T13:01:39.705931+0000) 2023-10-19T13:01:44.892 DEBUG:teuthology.orchestra.run.smithi046:> sudo pkill -f 'journalctl -f -n 0 -u ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@osd.9.service' 2023-10-19T13:01:44.986 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-19T13:01:44.987 INFO:tasks.cephadm.osd.9:Stopped osd.9 2023-10-19T13:01:44.987 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2023-10-19T13:01:44.988 DEBUG:teuthology.orchestra.run.smithi157:> sudo systemctl stop ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@osd.10 2023-10-19T13:01:45.337 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:45 smithi157 systemd[1]: Stopping Ceph osd.10 for 96a8be3c-6e7b-11ee-8db6-212e2dc638e7... 2023-10-19T13:01:45.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:44 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:44.979+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:27.021692+0000 front 2023-10-19T13:00:27.021669+0000 (oldest deadline 2023-10-19T13:00:52.921759+0000) 2023-10-19T13:01:45.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:44 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:44.979+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:38.624261+0000 front 2023-10-19T13:00:38.624276+0000 (oldest deadline 2023-10-19T13:01:03.324346+0000) 2023-10-19T13:01:45.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:44 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:44.979+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:43.324834+0000 front 2023-10-19T13:00:43.324935+0000 (oldest deadline 2023-10-19T13:01:08.624965+0000) 2023-10-19T13:01:45.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:44 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:44.979+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-10-19T13:00:58.928218+0000 front 2023-10-19T13:00:58.928315+0000 (oldest deadline 2023-10-19T13:01:23.628125+0000) 2023-10-19T13:01:45.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:44 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:44.979+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-10-19T13:01:10.029480+0000 front 2023-10-19T13:01:10.029517+0000 (oldest deadline 2023-10-19T13:01:32.329563+0000) 2023-10-19T13:01:45.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:44 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:44.979+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6822 osd.6 since back 2023-10-19T13:01:17.531200+0000 front 2023-10-19T13:01:17.531135+0000 (oldest deadline 2023-10-19T13:01:41.030976+0000) 2023-10-19T13:01:45.837 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:45 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:45.341+0000 7fae30a9f700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-19T13:01:45.838 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:45 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:45.341+0000 7fae30a9f700 -1 osd.10 96 *** Got signal Terminated *** 2023-10-19T13:01:45.838 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:45 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:45.341+0000 7fae30a9f700 -1 osd.10 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-19T13:01:45.838 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:45 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:45.559+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:28.496192+0000 front 2023-10-19T13:00:28.496224+0000 (oldest deadline 2023-10-19T13:00:51.396132+0000) 2023-10-19T13:01:45.838 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:45 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:45.559+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:35.497430+0000 front 2023-10-19T13:00:35.497454+0000 (oldest deadline 2023-10-19T13:01:00.197598+0000) 2023-10-19T13:01:45.838 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:45 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:45.559+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:44.799397+0000 front 2023-10-19T13:00:44.799340+0000 (oldest deadline 2023-10-19T13:01:08.899496+0000) 2023-10-19T13:01:45.839 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:45 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:45.559+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2023-10-19T13:00:52.901361+0000 front 2023-10-19T13:00:52.901460+0000 (oldest deadline 2023-10-19T13:01:17.601455+0000) 2023-10-19T13:01:45.839 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:45 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:45.559+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-10-19T13:01:02.902795+0000 front 2023-10-19T13:01:02.902756+0000 (oldest deadline 2023-10-19T13:01:27.002954+0000) 2023-10-19T13:01:45.839 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:45 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:45.559+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-10-19T13:01:07.003666+0000 front 2023-10-19T13:01:07.003758+0000 (oldest deadline 2023-10-19T13:01:34.004111+0000) 2023-10-19T13:01:45.839 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:45 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:45.559+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6822 osd.6 since back 2023-10-19T13:01:15.105406+0000 front 2023-10-19T13:01:15.105354+0000 (oldest deadline 2023-10-19T13:01:39.705931+0000) 2023-10-19T13:01:46.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:45 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:45.995+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:27.021692+0000 front 2023-10-19T13:00:27.021669+0000 (oldest deadline 2023-10-19T13:00:52.921759+0000) 2023-10-19T13:01:46.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:45 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:45.995+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:38.624261+0000 front 2023-10-19T13:00:38.624276+0000 (oldest deadline 2023-10-19T13:01:03.324346+0000) 2023-10-19T13:01:46.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:45 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:45.995+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:43.324834+0000 front 2023-10-19T13:00:43.324935+0000 (oldest deadline 2023-10-19T13:01:08.624965+0000) 2023-10-19T13:01:46.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:45 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:45.995+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-10-19T13:00:58.928218+0000 front 2023-10-19T13:00:58.928315+0000 (oldest deadline 2023-10-19T13:01:23.628125+0000) 2023-10-19T13:01:46.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:45 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:45.995+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-10-19T13:01:10.029480+0000 front 2023-10-19T13:01:10.029517+0000 (oldest deadline 2023-10-19T13:01:32.329563+0000) 2023-10-19T13:01:46.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:45 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:45.995+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6822 osd.6 since back 2023-10-19T13:01:17.531200+0000 front 2023-10-19T13:01:17.531135+0000 (oldest deadline 2023-10-19T13:01:41.030976+0000) 2023-10-19T13:01:46.837 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:46 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:46.583+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:28.496192+0000 front 2023-10-19T13:00:28.496224+0000 (oldest deadline 2023-10-19T13:00:51.396132+0000) 2023-10-19T13:01:46.838 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:46 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:46.583+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:35.497430+0000 front 2023-10-19T13:00:35.497454+0000 (oldest deadline 2023-10-19T13:01:00.197598+0000) 2023-10-19T13:01:46.838 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:46 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:46.583+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:44.799397+0000 front 2023-10-19T13:00:44.799340+0000 (oldest deadline 2023-10-19T13:01:08.899496+0000) 2023-10-19T13:01:46.838 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:46 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:46.583+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2023-10-19T13:00:52.901361+0000 front 2023-10-19T13:00:52.901460+0000 (oldest deadline 2023-10-19T13:01:17.601455+0000) 2023-10-19T13:01:46.838 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:46 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:46.583+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-10-19T13:01:02.902795+0000 front 2023-10-19T13:01:02.902756+0000 (oldest deadline 2023-10-19T13:01:27.002954+0000) 2023-10-19T13:01:46.839 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:46 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:46.583+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-10-19T13:01:07.003666+0000 front 2023-10-19T13:01:07.003758+0000 (oldest deadline 2023-10-19T13:01:34.004111+0000) 2023-10-19T13:01:46.839 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:46 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:46.583+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6822 osd.6 since back 2023-10-19T13:01:15.105406+0000 front 2023-10-19T13:01:15.105354+0000 (oldest deadline 2023-10-19T13:01:39.705931+0000) 2023-10-19T13:01:47.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:46 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:46.980+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:27.021692+0000 front 2023-10-19T13:00:27.021669+0000 (oldest deadline 2023-10-19T13:00:52.921759+0000) 2023-10-19T13:01:47.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:46 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:46.980+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:38.624261+0000 front 2023-10-19T13:00:38.624276+0000 (oldest deadline 2023-10-19T13:01:03.324346+0000) 2023-10-19T13:01:47.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:46 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:46.980+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:43.324834+0000 front 2023-10-19T13:00:43.324935+0000 (oldest deadline 2023-10-19T13:01:08.624965+0000) 2023-10-19T13:01:47.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:46 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:46.980+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-10-19T13:00:58.928218+0000 front 2023-10-19T13:00:58.928315+0000 (oldest deadline 2023-10-19T13:01:23.628125+0000) 2023-10-19T13:01:47.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:46 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:46.980+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-10-19T13:01:10.029480+0000 front 2023-10-19T13:01:10.029517+0000 (oldest deadline 2023-10-19T13:01:32.329563+0000) 2023-10-19T13:01:47.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:46 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:46.980+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6822 osd.6 since back 2023-10-19T13:01:17.531200+0000 front 2023-10-19T13:01:17.531135+0000 (oldest deadline 2023-10-19T13:01:41.030976+0000) 2023-10-19T13:01:47.837 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:47 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:47.574+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:28.496192+0000 front 2023-10-19T13:00:28.496224+0000 (oldest deadline 2023-10-19T13:00:51.396132+0000) 2023-10-19T13:01:47.837 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:47 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:47.574+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:35.497430+0000 front 2023-10-19T13:00:35.497454+0000 (oldest deadline 2023-10-19T13:01:00.197598+0000) 2023-10-19T13:01:47.838 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:47 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:47.574+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:44.799397+0000 front 2023-10-19T13:00:44.799340+0000 (oldest deadline 2023-10-19T13:01:08.899496+0000) 2023-10-19T13:01:47.838 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:47 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:47.574+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2023-10-19T13:00:52.901361+0000 front 2023-10-19T13:00:52.901460+0000 (oldest deadline 2023-10-19T13:01:17.601455+0000) 2023-10-19T13:01:47.838 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:47 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:47.574+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-10-19T13:01:02.902795+0000 front 2023-10-19T13:01:02.902756+0000 (oldest deadline 2023-10-19T13:01:27.002954+0000) 2023-10-19T13:01:47.838 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:47 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:47.574+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-10-19T13:01:07.003666+0000 front 2023-10-19T13:01:07.003758+0000 (oldest deadline 2023-10-19T13:01:34.004111+0000) 2023-10-19T13:01:47.838 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:47 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:47.574+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6822 osd.6 since back 2023-10-19T13:01:15.105406+0000 front 2023-10-19T13:01:15.105354+0000 (oldest deadline 2023-10-19T13:01:39.705931+0000) 2023-10-19T13:01:48.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:47 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:47.966+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:27.021692+0000 front 2023-10-19T13:00:27.021669+0000 (oldest deadline 2023-10-19T13:00:52.921759+0000) 2023-10-19T13:01:48.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:47 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:47.966+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:38.624261+0000 front 2023-10-19T13:00:38.624276+0000 (oldest deadline 2023-10-19T13:01:03.324346+0000) 2023-10-19T13:01:48.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:47 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:47.966+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:43.324834+0000 front 2023-10-19T13:00:43.324935+0000 (oldest deadline 2023-10-19T13:01:08.624965+0000) 2023-10-19T13:01:48.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:47 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:47.966+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-10-19T13:00:58.928218+0000 front 2023-10-19T13:00:58.928315+0000 (oldest deadline 2023-10-19T13:01:23.628125+0000) 2023-10-19T13:01:48.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:47 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:47.966+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-10-19T13:01:10.029480+0000 front 2023-10-19T13:01:10.029517+0000 (oldest deadline 2023-10-19T13:01:32.329563+0000) 2023-10-19T13:01:48.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:47 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:47.966+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6822 osd.6 since back 2023-10-19T13:01:17.531200+0000 front 2023-10-19T13:01:17.531135+0000 (oldest deadline 2023-10-19T13:01:41.030976+0000) 2023-10-19T13:01:48.837 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:48 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:48.524+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:28.496192+0000 front 2023-10-19T13:00:28.496224+0000 (oldest deadline 2023-10-19T13:00:51.396132+0000) 2023-10-19T13:01:48.837 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:48 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:48.524+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:35.497430+0000 front 2023-10-19T13:00:35.497454+0000 (oldest deadline 2023-10-19T13:01:00.197598+0000) 2023-10-19T13:01:48.838 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:48 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:48.524+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:44.799397+0000 front 2023-10-19T13:00:44.799340+0000 (oldest deadline 2023-10-19T13:01:08.899496+0000) 2023-10-19T13:01:48.838 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:48 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:48.524+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2023-10-19T13:00:52.901361+0000 front 2023-10-19T13:00:52.901460+0000 (oldest deadline 2023-10-19T13:01:17.601455+0000) 2023-10-19T13:01:48.838 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:48 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:48.524+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-10-19T13:01:02.902795+0000 front 2023-10-19T13:01:02.902756+0000 (oldest deadline 2023-10-19T13:01:27.002954+0000) 2023-10-19T13:01:48.838 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:48 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:48.524+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-10-19T13:01:07.003666+0000 front 2023-10-19T13:01:07.003758+0000 (oldest deadline 2023-10-19T13:01:34.004111+0000) 2023-10-19T13:01:48.838 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:48 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:48.524+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6822 osd.6 since back 2023-10-19T13:01:15.105406+0000 front 2023-10-19T13:01:15.105354+0000 (oldest deadline 2023-10-19T13:01:39.705931+0000) 2023-10-19T13:01:49.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:49 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:49.009+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:27.021692+0000 front 2023-10-19T13:00:27.021669+0000 (oldest deadline 2023-10-19T13:00:52.921759+0000) 2023-10-19T13:01:49.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:49 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:49.009+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:38.624261+0000 front 2023-10-19T13:00:38.624276+0000 (oldest deadline 2023-10-19T13:01:03.324346+0000) 2023-10-19T13:01:49.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:49 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:49.009+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:43.324834+0000 front 2023-10-19T13:00:43.324935+0000 (oldest deadline 2023-10-19T13:01:08.624965+0000) 2023-10-19T13:01:49.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:49 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:49.009+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-10-19T13:00:58.928218+0000 front 2023-10-19T13:00:58.928315+0000 (oldest deadline 2023-10-19T13:01:23.628125+0000) 2023-10-19T13:01:49.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:49 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:49.009+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-10-19T13:01:10.029480+0000 front 2023-10-19T13:01:10.029517+0000 (oldest deadline 2023-10-19T13:01:32.329563+0000) 2023-10-19T13:01:49.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:49 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:49.009+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6822 osd.6 since back 2023-10-19T13:01:17.531200+0000 front 2023-10-19T13:01:17.531135+0000 (oldest deadline 2023-10-19T13:01:41.030976+0000) 2023-10-19T13:01:49.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:49 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:49.009+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6820 osd.7 since back 2023-10-19T13:01:26.332066+0000 front 2023-10-19T13:01:26.332032+0000 (oldest deadline 2023-10-19T13:01:48.631948+0000) 2023-10-19T13:01:49.837 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:49 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:49.530+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:28.496192+0000 front 2023-10-19T13:00:28.496224+0000 (oldest deadline 2023-10-19T13:00:51.396132+0000) 2023-10-19T13:01:49.838 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:49 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:49.530+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:35.497430+0000 front 2023-10-19T13:00:35.497454+0000 (oldest deadline 2023-10-19T13:01:00.197598+0000) 2023-10-19T13:01:49.838 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:49 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:49.530+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:44.799397+0000 front 2023-10-19T13:00:44.799340+0000 (oldest deadline 2023-10-19T13:01:08.899496+0000) 2023-10-19T13:01:49.838 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:49 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:49.530+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2023-10-19T13:00:52.901361+0000 front 2023-10-19T13:00:52.901460+0000 (oldest deadline 2023-10-19T13:01:17.601455+0000) 2023-10-19T13:01:49.838 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:49 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:49.530+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-10-19T13:01:02.902795+0000 front 2023-10-19T13:01:02.902756+0000 (oldest deadline 2023-10-19T13:01:27.002954+0000) 2023-10-19T13:01:49.838 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:49 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:49.530+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-10-19T13:01:07.003666+0000 front 2023-10-19T13:01:07.003758+0000 (oldest deadline 2023-10-19T13:01:34.004111+0000) 2023-10-19T13:01:49.839 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:49 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10[164562]: 2023-10-19T13:01:49.530+0000 7fae2908d700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6822 osd.6 since back 2023-10-19T13:01:15.105406+0000 front 2023-10-19T13:01:15.105354+0000 (oldest deadline 2023-10-19T13:01:39.705931+0000) 2023-10-19T13:01:50.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:49 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:49.994+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:27.021692+0000 front 2023-10-19T13:00:27.021669+0000 (oldest deadline 2023-10-19T13:00:52.921759+0000) 2023-10-19T13:01:50.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:49 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:49.994+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:38.624261+0000 front 2023-10-19T13:00:38.624276+0000 (oldest deadline 2023-10-19T13:01:03.324346+0000) 2023-10-19T13:01:50.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:49 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:49.994+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:43.324834+0000 front 2023-10-19T13:00:43.324935+0000 (oldest deadline 2023-10-19T13:01:08.624965+0000) 2023-10-19T13:01:50.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:49 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:49.994+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-10-19T13:00:58.928218+0000 front 2023-10-19T13:00:58.928315+0000 (oldest deadline 2023-10-19T13:01:23.628125+0000) 2023-10-19T13:01:50.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:49 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:49.994+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-10-19T13:01:10.029480+0000 front 2023-10-19T13:01:10.029517+0000 (oldest deadline 2023-10-19T13:01:32.329563+0000) 2023-10-19T13:01:50.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:49 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:49.994+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6822 osd.6 since back 2023-10-19T13:01:17.531200+0000 front 2023-10-19T13:01:17.531135+0000 (oldest deadline 2023-10-19T13:01:41.030976+0000) 2023-10-19T13:01:50.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:49 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:49.994+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6820 osd.7 since back 2023-10-19T13:01:26.332066+0000 front 2023-10-19T13:01:26.332032+0000 (oldest deadline 2023-10-19T13:01:48.631948+0000) 2023-10-19T13:01:51.337 INFO:journalctl@ceph.osd.10.smithi157.stdout:Oct 19 13:01:50 smithi157 bash[177977]: ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-10 2023-10-19T13:01:51.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:51 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:51.018+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:27.021692+0000 front 2023-10-19T13:00:27.021669+0000 (oldest deadline 2023-10-19T13:00:52.921759+0000) 2023-10-19T13:01:51.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:51 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:51.018+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:38.624261+0000 front 2023-10-19T13:00:38.624276+0000 (oldest deadline 2023-10-19T13:01:03.324346+0000) 2023-10-19T13:01:51.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:51 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:51.018+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:43.324834+0000 front 2023-10-19T13:00:43.324935+0000 (oldest deadline 2023-10-19T13:01:08.624965+0000) 2023-10-19T13:01:51.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:51 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:51.018+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-10-19T13:00:58.928218+0000 front 2023-10-19T13:00:58.928315+0000 (oldest deadline 2023-10-19T13:01:23.628125+0000) 2023-10-19T13:01:51.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:51 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:51.018+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-10-19T13:01:10.029480+0000 front 2023-10-19T13:01:10.029517+0000 (oldest deadline 2023-10-19T13:01:32.329563+0000) 2023-10-19T13:01:51.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:51 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:51.018+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6822 osd.6 since back 2023-10-19T13:01:17.531200+0000 front 2023-10-19T13:01:17.531135+0000 (oldest deadline 2023-10-19T13:01:41.030976+0000) 2023-10-19T13:01:51.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:51 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:51.018+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6820 osd.7 since back 2023-10-19T13:01:26.332066+0000 front 2023-10-19T13:01:26.332032+0000 (oldest deadline 2023-10-19T13:01:48.631948+0000) 2023-10-19T13:01:52.331 DEBUG:teuthology.orchestra.run.smithi157:> sudo pkill -f 'journalctl -f -n 0 -u ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@osd.10.service' 2023-10-19T13:01:52.370 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-19T13:01:52.370 INFO:tasks.cephadm.osd.10:Stopped osd.10 2023-10-19T13:01:52.370 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2023-10-19T13:01:52.371 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@osd.11 2023-10-19T13:01:52.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:52 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:52.042+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:27.021692+0000 front 2023-10-19T13:00:27.021669+0000 (oldest deadline 2023-10-19T13:00:52.921759+0000) 2023-10-19T13:01:52.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:52 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:52.042+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:38.624261+0000 front 2023-10-19T13:00:38.624276+0000 (oldest deadline 2023-10-19T13:01:03.324346+0000) 2023-10-19T13:01:52.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:52 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:52.042+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:43.324834+0000 front 2023-10-19T13:00:43.324935+0000 (oldest deadline 2023-10-19T13:01:08.624965+0000) 2023-10-19T13:01:52.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:52 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:52.042+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-10-19T13:00:58.928218+0000 front 2023-10-19T13:00:58.928315+0000 (oldest deadline 2023-10-19T13:01:23.628125+0000) 2023-10-19T13:01:52.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:52 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:52.042+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-10-19T13:01:10.029480+0000 front 2023-10-19T13:01:10.029517+0000 (oldest deadline 2023-10-19T13:01:32.329563+0000) 2023-10-19T13:01:52.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:52 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:52.042+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6822 osd.6 since back 2023-10-19T13:01:17.531200+0000 front 2023-10-19T13:01:17.531135+0000 (oldest deadline 2023-10-19T13:01:41.030976+0000) 2023-10-19T13:01:52.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:52 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:52.042+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6820 osd.7 since back 2023-10-19T13:01:26.332066+0000 front 2023-10-19T13:01:26.332032+0000 (oldest deadline 2023-10-19T13:01:48.631948+0000) 2023-10-19T13:01:52.730 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:52 smithi195 systemd[1]: Stopping Ceph osd.11 for 96a8be3c-6e7b-11ee-8db6-212e2dc638e7... 2023-10-19T13:01:53.082 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:52 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:52.727+0000 7f94afc6e700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-19T13:01:53.082 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:52 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:52.727+0000 7f94afc6e700 -1 osd.11 96 *** Got signal Terminated *** 2023-10-19T13:01:53.082 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:52 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:52.727+0000 7f94afc6e700 -1 osd.11 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-19T13:01:53.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:53 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:53.079+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:27.021692+0000 front 2023-10-19T13:00:27.021669+0000 (oldest deadline 2023-10-19T13:00:52.921759+0000) 2023-10-19T13:01:53.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:53 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:53.079+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:38.624261+0000 front 2023-10-19T13:00:38.624276+0000 (oldest deadline 2023-10-19T13:01:03.324346+0000) 2023-10-19T13:01:53.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:53 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:53.079+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:43.324834+0000 front 2023-10-19T13:00:43.324935+0000 (oldest deadline 2023-10-19T13:01:08.624965+0000) 2023-10-19T13:01:53.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:53 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:53.079+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-10-19T13:00:58.928218+0000 front 2023-10-19T13:00:58.928315+0000 (oldest deadline 2023-10-19T13:01:23.628125+0000) 2023-10-19T13:01:53.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:53 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:53.079+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-10-19T13:01:10.029480+0000 front 2023-10-19T13:01:10.029517+0000 (oldest deadline 2023-10-19T13:01:32.329563+0000) 2023-10-19T13:01:53.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:53 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:53.079+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6822 osd.6 since back 2023-10-19T13:01:17.531200+0000 front 2023-10-19T13:01:17.531135+0000 (oldest deadline 2023-10-19T13:01:41.030976+0000) 2023-10-19T13:01:53.382 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:53 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:53.079+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6820 osd.7 since back 2023-10-19T13:01:26.332066+0000 front 2023-10-19T13:01:26.332032+0000 (oldest deadline 2023-10-19T13:01:48.631948+0000) 2023-10-19T13:01:54.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:54 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:54.114+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:27.021692+0000 front 2023-10-19T13:00:27.021669+0000 (oldest deadline 2023-10-19T13:00:52.921759+0000) 2023-10-19T13:01:54.380 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:54 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:54.114+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:38.624261+0000 front 2023-10-19T13:00:38.624276+0000 (oldest deadline 2023-10-19T13:01:03.324346+0000) 2023-10-19T13:01:54.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:54 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:54.114+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:43.324834+0000 front 2023-10-19T13:00:43.324935+0000 (oldest deadline 2023-10-19T13:01:08.624965+0000) 2023-10-19T13:01:54.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:54 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:54.114+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-10-19T13:00:58.928218+0000 front 2023-10-19T13:00:58.928315+0000 (oldest deadline 2023-10-19T13:01:23.628125+0000) 2023-10-19T13:01:54.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:54 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:54.114+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-10-19T13:01:10.029480+0000 front 2023-10-19T13:01:10.029517+0000 (oldest deadline 2023-10-19T13:01:32.329563+0000) 2023-10-19T13:01:54.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:54 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:54.114+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6822 osd.6 since back 2023-10-19T13:01:17.531200+0000 front 2023-10-19T13:01:17.531135+0000 (oldest deadline 2023-10-19T13:01:41.030976+0000) 2023-10-19T13:01:54.381 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:54 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:54.114+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6820 osd.7 since back 2023-10-19T13:01:26.332066+0000 front 2023-10-19T13:01:26.332032+0000 (oldest deadline 2023-10-19T13:01:48.631948+0000) 2023-10-19T13:01:55.630 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:55 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:55.160+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:27.021692+0000 front 2023-10-19T13:00:27.021669+0000 (oldest deadline 2023-10-19T13:00:52.921759+0000) 2023-10-19T13:01:55.631 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:55 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:55.160+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:38.624261+0000 front 2023-10-19T13:00:38.624276+0000 (oldest deadline 2023-10-19T13:01:03.324346+0000) 2023-10-19T13:01:55.631 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:55 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:55.160+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:43.324834+0000 front 2023-10-19T13:00:43.324935+0000 (oldest deadline 2023-10-19T13:01:08.624965+0000) 2023-10-19T13:01:55.631 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:55 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:55.160+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-10-19T13:00:58.928218+0000 front 2023-10-19T13:00:58.928315+0000 (oldest deadline 2023-10-19T13:01:23.628125+0000) 2023-10-19T13:01:55.632 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:55 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:55.160+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-10-19T13:01:10.029480+0000 front 2023-10-19T13:01:10.029517+0000 (oldest deadline 2023-10-19T13:01:32.329563+0000) 2023-10-19T13:01:55.632 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:55 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:55.160+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6822 osd.6 since back 2023-10-19T13:01:17.531200+0000 front 2023-10-19T13:01:17.531135+0000 (oldest deadline 2023-10-19T13:01:41.030976+0000) 2023-10-19T13:01:55.632 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:55 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:55.160+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6820 osd.7 since back 2023-10-19T13:01:26.332066+0000 front 2023-10-19T13:01:26.332032+0000 (oldest deadline 2023-10-19T13:01:48.631948+0000) 2023-10-19T13:01:56.630 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:56 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:56.172+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:27.021692+0000 front 2023-10-19T13:00:27.021669+0000 (oldest deadline 2023-10-19T13:00:52.921759+0000) 2023-10-19T13:01:56.631 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:56 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:56.172+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:38.624261+0000 front 2023-10-19T13:00:38.624276+0000 (oldest deadline 2023-10-19T13:01:03.324346+0000) 2023-10-19T13:01:56.631 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:56 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:56.172+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:43.324834+0000 front 2023-10-19T13:00:43.324935+0000 (oldest deadline 2023-10-19T13:01:08.624965+0000) 2023-10-19T13:01:56.631 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:56 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:56.172+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-10-19T13:00:58.928218+0000 front 2023-10-19T13:00:58.928315+0000 (oldest deadline 2023-10-19T13:01:23.628125+0000) 2023-10-19T13:01:56.631 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:56 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:56.172+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-10-19T13:01:10.029480+0000 front 2023-10-19T13:01:10.029517+0000 (oldest deadline 2023-10-19T13:01:32.329563+0000) 2023-10-19T13:01:56.631 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:56 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:56.172+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6822 osd.6 since back 2023-10-19T13:01:17.531200+0000 front 2023-10-19T13:01:17.531135+0000 (oldest deadline 2023-10-19T13:01:41.030976+0000) 2023-10-19T13:01:56.632 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:56 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:56.172+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6820 osd.7 since back 2023-10-19T13:01:26.332066+0000 front 2023-10-19T13:01:26.332032+0000 (oldest deadline 2023-10-19T13:01:48.631948+0000) 2023-10-19T13:01:56.632 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:56 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:56.172+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.195:6820 osd.8 since back 2023-10-19T13:01:30.332965+0000 front 2023-10-19T13:01:30.332944+0000 (oldest deadline 2023-10-19T13:01:55.633038+0000) 2023-10-19T13:01:57.630 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:57 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:57.130+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2023-10-19T13:00:27.021692+0000 front 2023-10-19T13:00:27.021669+0000 (oldest deadline 2023-10-19T13:00:52.921759+0000) 2023-10-19T13:01:57.630 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:57 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:57.130+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6804 osd.1 since back 2023-10-19T13:00:38.624261+0000 front 2023-10-19T13:00:38.624276+0000 (oldest deadline 2023-10-19T13:01:03.324346+0000) 2023-10-19T13:01:57.631 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:57 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:57.130+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-10-19T13:00:43.324834+0000 front 2023-10-19T13:00:43.324935+0000 (oldest deadline 2023-10-19T13:01:08.624965+0000) 2023-10-19T13:01:57.631 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:57 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:57.130+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6812 osd.4 since back 2023-10-19T13:00:58.928218+0000 front 2023-10-19T13:00:58.928315+0000 (oldest deadline 2023-10-19T13:01:23.628125+0000) 2023-10-19T13:01:57.631 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:57 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:57.130+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-10-19T13:01:10.029480+0000 front 2023-10-19T13:01:10.029517+0000 (oldest deadline 2023-10-19T13:01:32.329563+0000) 2023-10-19T13:01:57.631 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:57 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:57.130+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6822 osd.6 since back 2023-10-19T13:01:17.531200+0000 front 2023-10-19T13:01:17.531135+0000 (oldest deadline 2023-10-19T13:01:41.030976+0000) 2023-10-19T13:01:57.631 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:57 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:57.130+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.157:6820 osd.7 since back 2023-10-19T13:01:26.332066+0000 front 2023-10-19T13:01:26.332032+0000 (oldest deadline 2023-10-19T13:01:48.631948+0000) 2023-10-19T13:01:57.632 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:57 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11[165038]: 2023-10-19T13:01:57.130+0000 7f94aa260700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.195:6820 osd.8 since back 2023-10-19T13:01:30.332965+0000 front 2023-10-19T13:01:30.332944+0000 (oldest deadline 2023-10-19T13:01:55.633038+0000) 2023-10-19T13:01:58.608 INFO:journalctl@ceph.osd.11.smithi195.stdout:Oct 19 13:01:58 smithi195 bash[178955]: ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-osd-11 2023-10-19T13:01:59.870 DEBUG:teuthology.orchestra.run.smithi195:> sudo pkill -f 'journalctl -f -n 0 -u ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@osd.11.service' 2023-10-19T13:01:59.950 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-19T13:01:59.951 INFO:tasks.cephadm.osd.11:Stopped osd.11 2023-10-19T13:01:59.951 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2023-10-19T13:01:59.952 DEBUG:teuthology.orchestra.run.smithi046:> sudo systemctl stop ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@mds.a 2023-10-19T13:02:00.470 INFO:journalctl@ceph.mds.a.smithi046.stdout:Oct 19 13:02:00 smithi046 systemd[1]: Stopping Ceph mds.a for 96a8be3c-6e7b-11ee-8db6-212e2dc638e7... 2023-10-19T13:02:00.728 INFO:journalctl@ceph.mds.a.smithi046.stdout:Oct 19 13:02:00 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mds-a[150002]: 2023-10-19T13:02:00.467+0000 7feaa4a3d700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-19T13:02:00.729 INFO:journalctl@ceph.mds.a.smithi046.stdout:Oct 19 13:02:00 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mds-a[150002]: 2023-10-19T13:02:00.467+0000 7feaa4a3d700 -1 mds.a *** got signal Terminated *** 2023-10-19T13:02:03.478 INFO:journalctl@ceph.mds.a.smithi046.stdout:Oct 19 13:02:03 smithi046 bash[177182]: ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mds-a 2023-10-19T13:02:03.631 DEBUG:teuthology.orchestra.run.smithi046:> sudo pkill -f 'journalctl -f -n 0 -u ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@mds.a.service' 2023-10-19T13:02:03.717 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-19T13:02:03.718 INFO:tasks.cephadm.mds.a:Stopped mds.a 2023-10-19T13:02:03.719 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2023-10-19T13:02:03.719 DEBUG:teuthology.orchestra.run.smithi046:> sudo systemctl stop ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@mds.d 2023-10-19T13:02:03.978 INFO:journalctl@ceph.mds.d.smithi046.stdout:Oct 19 13:02:03 smithi046 systemd[1]: Stopping Ceph mds.d for 96a8be3c-6e7b-11ee-8db6-212e2dc638e7... 2023-10-19T13:02:04.478 INFO:journalctl@ceph.mds.d.smithi046.stdout:Oct 19 13:02:04 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mds-d[148998]: 2023-10-19T13:02:04.207+0000 7f60635e7700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-19T13:02:04.479 INFO:journalctl@ceph.mds.d.smithi046.stdout:Oct 19 13:02:04 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mds-d[148998]: 2023-10-19T13:02:04.207+0000 7f60635e7700 -1 mds.d *** got signal Terminated *** 2023-10-19T13:02:08.953 INFO:journalctl@ceph.mds.d.smithi046.stdout:Oct 19 13:02:08 smithi046 bash[177329]: ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mds-d 2023-10-19T13:02:08.978 DEBUG:teuthology.orchestra.run.smithi046:> sudo pkill -f 'journalctl -f -n 0 -u ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@mds.d.service' 2023-10-19T13:02:09.064 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-19T13:02:09.064 INFO:tasks.cephadm.mds.d:Stopped mds.d 2023-10-19T13:02:09.064 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2023-10-19T13:02:09.065 DEBUG:teuthology.orchestra.run.smithi046:> sudo systemctl stop ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@mds.g 2023-10-19T13:02:09.229 INFO:journalctl@ceph.mds.g.smithi046.stdout:Oct 19 13:02:09 smithi046 systemd[1]: Stopping Ceph mds.g for 96a8be3c-6e7b-11ee-8db6-212e2dc638e7... 2023-10-19T13:02:09.978 INFO:journalctl@ceph.mds.g.smithi046.stdout:Oct 19 13:02:09 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mds-g[149610]: 2023-10-19T13:02:09.565+0000 7f24c5f4f700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-19T13:02:09.979 INFO:journalctl@ceph.mds.g.smithi046.stdout:Oct 19 13:02:09 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mds-g[149610]: 2023-10-19T13:02:09.565+0000 7f24c5f4f700 -1 mds.g *** got signal Terminated *** 2023-10-19T13:02:11.478 INFO:journalctl@ceph.mds.g.smithi046.stdout:Oct 19 13:02:11 smithi046 bash[177475]: ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mds-g 2023-10-19T13:02:11.591 DEBUG:teuthology.orchestra.run.smithi046:> sudo pkill -f 'journalctl -f -n 0 -u ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@mds.g.service' 2023-10-19T13:02:11.676 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-19T13:02:11.677 INFO:tasks.cephadm.mds.g:Stopped mds.g 2023-10-19T13:02:11.677 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2023-10-19T13:02:11.677 DEBUG:teuthology.orchestra.run.smithi046:> sudo systemctl stop ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@mds.j 2023-10-19T13:02:11.979 INFO:journalctl@ceph.mds.j.smithi046.stdout:Oct 19 13:02:11 smithi046 systemd[1]: Stopping Ceph mds.j for 96a8be3c-6e7b-11ee-8db6-212e2dc638e7... 2023-10-19T13:02:12.478 INFO:journalctl@ceph.mds.j.smithi046.stdout:Oct 19 13:02:12 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mds-j[148613]: 2023-10-19T13:02:12.198+0000 7f31029c3700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-19T13:02:12.479 INFO:journalctl@ceph.mds.j.smithi046.stdout:Oct 19 13:02:12 smithi046 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mds-j[148613]: 2023-10-19T13:02:12.198+0000 7f31029c3700 -1 mds.j *** got signal Terminated *** 2023-10-19T13:02:13.924 INFO:journalctl@ceph.mds.j.smithi046.stdout:Oct 19 13:02:13 smithi046 bash[177620]: ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mds-j 2023-10-19T13:02:14.109 DEBUG:teuthology.orchestra.run.smithi046:> sudo pkill -f 'journalctl -f -n 0 -u ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@mds.j.service' 2023-10-19T13:02:14.192 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-19T13:02:14.193 INFO:tasks.cephadm.mds.j:Stopped mds.j 2023-10-19T13:02:14.193 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2023-10-19T13:02:14.194 DEBUG:teuthology.orchestra.run.smithi157:> sudo systemctl stop ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@mds.b 2023-10-19T13:02:14.547 INFO:journalctl@ceph.mds.b.smithi157.stdout:Oct 19 13:02:14 smithi157 systemd[1]: Stopping Ceph mds.b for 96a8be3c-6e7b-11ee-8db6-212e2dc638e7... 2023-10-19T13:02:14.837 INFO:journalctl@ceph.mds.b.smithi157.stdout:Oct 19 13:02:14 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mds-b[170841]: 2023-10-19T13:02:14.543+0000 7f8817458700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-19T13:02:14.837 INFO:journalctl@ceph.mds.b.smithi157.stdout:Oct 19 13:02:14 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mds-b[170841]: 2023-10-19T13:02:14.543+0000 7f8817458700 -1 mds.b *** got signal Terminated *** 2023-10-19T13:02:19.087 INFO:journalctl@ceph.mds.b.smithi157.stdout:Oct 19 13:02:18 smithi157 bash[178254]: ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mds-b 2023-10-19T13:02:19.099 DEBUG:teuthology.orchestra.run.smithi157:> sudo pkill -f 'journalctl -f -n 0 -u ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@mds.b.service' 2023-10-19T13:02:19.136 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-19T13:02:19.136 INFO:tasks.cephadm.mds.b:Stopped mds.b 2023-10-19T13:02:19.137 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2023-10-19T13:02:19.137 DEBUG:teuthology.orchestra.run.smithi157:> sudo systemctl stop ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@mds.e 2023-10-19T13:02:19.520 INFO:journalctl@ceph.mds.e.smithi157.stdout:Oct 19 13:02:19 smithi157 systemd[1]: Stopping Ceph mds.e for 96a8be3c-6e7b-11ee-8db6-212e2dc638e7... 2023-10-19T13:02:19.837 INFO:journalctl@ceph.mds.e.smithi157.stdout:Oct 19 13:02:19 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mds-e[170160]: 2023-10-19T13:02:19.516+0000 7fc702a54700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-19T13:02:19.837 INFO:journalctl@ceph.mds.e.smithi157.stdout:Oct 19 13:02:19 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mds-e[170160]: 2023-10-19T13:02:19.516+0000 7fc702a54700 -1 mds.e *** got signal Terminated *** 2023-10-19T13:02:23.337 INFO:journalctl@ceph.mds.e.smithi157.stdout:Oct 19 13:02:23 smithi157 bash[178402]: ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mds-e 2023-10-19T13:02:23.478 DEBUG:teuthology.orchestra.run.smithi157:> sudo pkill -f 'journalctl -f -n 0 -u ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@mds.e.service' 2023-10-19T13:02:23.511 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-19T13:02:23.511 INFO:tasks.cephadm.mds.e:Stopped mds.e 2023-10-19T13:02:23.512 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2023-10-19T13:02:23.512 DEBUG:teuthology.orchestra.run.smithi157:> sudo systemctl stop ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@mds.h 2023-10-19T13:02:23.837 INFO:journalctl@ceph.mds.h.smithi157.stdout:Oct 19 13:02:23 smithi157 systemd[1]: Stopping Ceph mds.h for 96a8be3c-6e7b-11ee-8db6-212e2dc638e7... 2023-10-19T13:02:24.337 INFO:journalctl@ceph.mds.h.smithi157.stdout:Oct 19 13:02:23 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mds-h[170501]: 2023-10-19T13:02:23.891+0000 7f8dc3de4700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-19T13:02:24.337 INFO:journalctl@ceph.mds.h.smithi157.stdout:Oct 19 13:02:23 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mds-h[170501]: 2023-10-19T13:02:23.891+0000 7f8dc3de4700 -1 mds.h *** got signal Terminated *** 2023-10-19T13:02:27.480 INFO:journalctl@ceph.mds.h.smithi157.stdout:Oct 19 13:02:27 smithi157 bash[178544]: ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mds-h 2023-10-19T13:02:27.485 DEBUG:teuthology.orchestra.run.smithi157:> sudo pkill -f 'journalctl -f -n 0 -u ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@mds.h.service' 2023-10-19T13:02:27.518 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-19T13:02:27.519 INFO:tasks.cephadm.mds.h:Stopped mds.h 2023-10-19T13:02:27.519 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2023-10-19T13:02:27.520 DEBUG:teuthology.orchestra.run.smithi157:> sudo systemctl stop ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@mds.k 2023-10-19T13:02:27.837 INFO:journalctl@ceph.mds.k.smithi157.stdout:Oct 19 13:02:27 smithi157 systemd[1]: Stopping Ceph mds.k for 96a8be3c-6e7b-11ee-8db6-212e2dc638e7... 2023-10-19T13:02:28.337 INFO:journalctl@ceph.mds.k.smithi157.stdout:Oct 19 13:02:27 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mds-k[169815]: 2023-10-19T13:02:27.878+0000 7efd4a8ee700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-19T13:02:28.337 INFO:journalctl@ceph.mds.k.smithi157.stdout:Oct 19 13:02:27 smithi157 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mds-k[169815]: 2023-10-19T13:02:27.878+0000 7efd4a8ee700 -1 mds.k *** got signal Terminated *** 2023-10-19T13:02:31.337 INFO:journalctl@ceph.mds.k.smithi157.stdout:Oct 19 13:02:31 smithi157 bash[178686]: ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mds-k 2023-10-19T13:02:31.459 DEBUG:teuthology.orchestra.run.smithi157:> sudo pkill -f 'journalctl -f -n 0 -u ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@mds.k.service' 2023-10-19T13:02:31.494 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-19T13:02:31.495 INFO:tasks.cephadm.mds.k:Stopped mds.k 2023-10-19T13:02:31.495 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2023-10-19T13:02:31.495 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@mds.c 2023-10-19T13:02:31.859 INFO:journalctl@ceph.mds.c.smithi195.stdout:Oct 19 13:02:31 smithi195 systemd[1]: Stopping Ceph mds.c for 96a8be3c-6e7b-11ee-8db6-212e2dc638e7... 2023-10-19T13:02:32.130 INFO:journalctl@ceph.mds.c.smithi195.stdout:Oct 19 13:02:31 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mds-c[171737]: 2023-10-19T13:02:31.856+0000 7ff27d537700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-19T13:02:32.130 INFO:journalctl@ceph.mds.c.smithi195.stdout:Oct 19 13:02:31 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mds-c[171737]: 2023-10-19T13:02:31.856+0000 7ff27d537700 -1 mds.c *** got signal Terminated *** 2023-10-19T13:02:35.380 INFO:journalctl@ceph.mds.c.smithi195.stdout:Oct 19 13:02:35 smithi195 bash[179233]: ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mds-c 2023-10-19T13:02:35.410 DEBUG:teuthology.orchestra.run.smithi195:> sudo pkill -f 'journalctl -f -n 0 -u ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@mds.c.service' 2023-10-19T13:02:35.450 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-19T13:02:35.451 INFO:tasks.cephadm.mds.c:Stopped mds.c 2023-10-19T13:02:35.451 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2023-10-19T13:02:35.451 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@mds.f 2023-10-19T13:02:35.822 INFO:journalctl@ceph.mds.f.smithi195.stdout:Oct 19 13:02:35 smithi195 systemd[1]: Stopping Ceph mds.f for 96a8be3c-6e7b-11ee-8db6-212e2dc638e7... 2023-10-19T13:02:36.130 INFO:journalctl@ceph.mds.f.smithi195.stdout:Oct 19 13:02:35 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mds-f[171398]: 2023-10-19T13:02:35.819+0000 7f668f9c0700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-19T13:02:36.130 INFO:journalctl@ceph.mds.f.smithi195.stdout:Oct 19 13:02:35 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mds-f[171398]: 2023-10-19T13:02:35.819+0000 7f668f9c0700 -1 mds.f *** got signal Terminated *** 2023-10-19T13:02:39.198 INFO:journalctl@ceph.mds.f.smithi195.stdout:Oct 19 13:02:39 smithi195 bash[179379]: ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mds-f 2023-10-19T13:02:39.384 DEBUG:teuthology.orchestra.run.smithi195:> sudo pkill -f 'journalctl -f -n 0 -u ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@mds.f.service' 2023-10-19T13:02:39.419 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-19T13:02:39.419 INFO:tasks.cephadm.mds.f:Stopped mds.f 2023-10-19T13:02:39.419 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2023-10-19T13:02:39.420 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@mds.i 2023-10-19T13:02:39.798 INFO:journalctl@ceph.mds.i.smithi195.stdout:Oct 19 13:02:39 smithi195 systemd[1]: Stopping Ceph mds.i for 96a8be3c-6e7b-11ee-8db6-212e2dc638e7... 2023-10-19T13:02:40.130 INFO:journalctl@ceph.mds.i.smithi195.stdout:Oct 19 13:02:39 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mds-i[172086]: 2023-10-19T13:02:39.794+0000 7f2bf2089700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-19T13:02:40.130 INFO:journalctl@ceph.mds.i.smithi195.stdout:Oct 19 13:02:39 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mds-i[172086]: 2023-10-19T13:02:39.794+0000 7f2bf2089700 -1 mds.i *** got signal Terminated *** 2023-10-19T13:02:43.160 INFO:journalctl@ceph.mds.i.smithi195.stdout:Oct 19 13:02:43 smithi195 bash[179520]: ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mds-i 2023-10-19T13:02:43.347 DEBUG:teuthology.orchestra.run.smithi195:> sudo pkill -f 'journalctl -f -n 0 -u ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@mds.i.service' 2023-10-19T13:02:43.381 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-19T13:02:43.382 INFO:tasks.cephadm.mds.i:Stopped mds.i 2023-10-19T13:02:43.382 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2023-10-19T13:02:43.383 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@mds.l 2023-10-19T13:02:43.630 INFO:journalctl@ceph.mds.l.smithi195.stdout:Oct 19 13:02:43 smithi195 systemd[1]: Stopping Ceph mds.l for 96a8be3c-6e7b-11ee-8db6-212e2dc638e7... 2023-10-19T13:02:44.130 INFO:journalctl@ceph.mds.l.smithi195.stdout:Oct 19 13:02:43 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mds-l[171056]: 2023-10-19T13:02:43.769+0000 7f6cecd87700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-19T13:02:44.130 INFO:journalctl@ceph.mds.l.smithi195.stdout:Oct 19 13:02:43 smithi195 ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mds-l[171056]: 2023-10-19T13:02:43.769+0000 7f6cecd87700 -1 mds.l *** got signal Terminated *** 2023-10-19T13:02:47.354 INFO:journalctl@ceph.mds.l.smithi195.stdout:Oct 19 13:02:47 smithi195 bash[179659]: ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7-mds-l 2023-10-19T13:02:47.434 DEBUG:teuthology.orchestra.run.smithi195:> sudo pkill -f 'journalctl -f -n 0 -u ceph-96a8be3c-6e7b-11ee-8db6-212e2dc638e7@mds.l.service' 2023-10-19T13:02:47.467 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-19T13:02:47.468 INFO:tasks.cephadm.mds.l:Stopped mds.l 2023-10-19T13:02:47.468 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 --force --keep-logs 2023-10-19T13:02:47.881 INFO:teuthology.orchestra.run.smithi046.stdout:Deleting cluster with fsid: 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 2023-10-19T13:02:51.333 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 --force --keep-logs 2023-10-19T13:02:51.769 INFO:teuthology.orchestra.run.smithi157.stdout:Deleting cluster with fsid: 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 2023-10-19T13:02:53.355 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 --force --keep-logs 2023-10-19T13:02:53.657 INFO:teuthology.orchestra.run.smithi195.stdout:Deleting cluster with fsid: 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 2023-10-19T13:02:55.270 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-10-19T13:02:55.351 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-10-19T13:02:55.387 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-10-19T13:02:55.417 INFO:tasks.cephadm:Archiving crash dumps... 2023-10-19T13:02:55.419 DEBUG:teuthology.misc:Transferring archived files from smithi046:/var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/crash to /home/teuthworker/archive/pdonnell-2023-10-19_12:04:12-fs-wip-batrick-testing-20231016.203825-distro-default-smithi/7432284/remote/smithi046/crash 2023-10-19T13:02:55.420 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar c -f - -C /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/crash -- . 2023-10-19T13:02:55.504 INFO:teuthology.orchestra.run.smithi046.stderr:tar: /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/crash: Cannot open: No such file or directory 2023-10-19T13:02:55.504 INFO:teuthology.orchestra.run.smithi046.stderr:tar: Error is not recoverable: exiting now 2023-10-19T13:02:55.507 DEBUG:teuthology.misc:Transferring archived files from smithi157:/var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/crash to /home/teuthworker/archive/pdonnell-2023-10-19_12:04:12-fs-wip-batrick-testing-20231016.203825-distro-default-smithi/7432284/remote/smithi157/crash 2023-10-19T13:02:55.508 DEBUG:teuthology.orchestra.run.smithi157:> sudo tar c -f - -C /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/crash -- . 2023-10-19T13:02:55.565 INFO:teuthology.orchestra.run.smithi157.stderr:tar: /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/crash: Cannot open: No such file or directory 2023-10-19T13:02:55.566 INFO:teuthology.orchestra.run.smithi157.stderr:tar: Error is not recoverable: exiting now 2023-10-19T13:02:55.568 DEBUG:teuthology.misc:Transferring archived files from smithi195:/var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/crash to /home/teuthworker/archive/pdonnell-2023-10-19_12:04:12-fs-wip-batrick-testing-20231016.203825-distro-default-smithi/7432284/remote/smithi195/crash 2023-10-19T13:02:55.569 DEBUG:teuthology.orchestra.run.smithi195:> sudo tar c -f - -C /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/crash -- . 2023-10-19T13:02:55.623 INFO:teuthology.orchestra.run.smithi195.stderr:tar: /var/lib/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/crash: Cannot open: No such file or directory 2023-10-19T13:02:55.623 INFO:teuthology.orchestra.run.smithi195.stderr:tar: Error is not recoverable: exiting now 2023-10-19T13:02:55.624 INFO:tasks.cephadm:Checking cluster log for badness... 2023-10-19T13:02:55.625 DEBUG:teuthology.orchestra.run.smithi046:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2023-10-19T13:02:55.706 INFO:teuthology.orchestra.run.smithi046.stderr:grep: /var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph.log: No such file or directory 2023-10-19T13:02:55.711 INFO:tasks.cephadm:Compressing logs... 2023-10-19T13:02:55.712 DEBUG:teuthology.orchestra.run.smithi046:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-19T13:02:55.717 DEBUG:teuthology.orchestra.run.smithi157:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-19T13:02:55.719 DEBUG:teuthology.orchestra.run.smithi195:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-19T13:02:55.762 INFO:teuthology.orchestra.run.smithi157.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2023-10-19T13:02:55.763 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-osd.10.log 2023-10-19T13:02:55.768 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-mds.h.log 2023-10-19T13:02:55.769 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-mds.e.log 2023-10-19T13:02:55.770 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-osd.10.log: /var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-osd.4.log 2023-10-19T13:02:55.770 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-osd.1.log 2023-10-19T13:02:55.770 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-mds.k.log 2023-10-19T13:02:55.772 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-volume.log 2023-10-19T13:02:55.772 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-osd.7.log 2023-10-19T13:02:55.772 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-mon.b.log 2023-10-19T13:02:55.772 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-mds.b.log 2023-10-19T13:02:55.772 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-mgr.y.log 2023-10-19T13:02:55.773 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-10-19T13:02:55.774 INFO:teuthology.orchestra.run.smithi195.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2023-10-19T13:02:55.775 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-osd.5.log 2023-10-19T13:02:55.776 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-mgr.y.log: /var/log/ceph/cephadm.log: 93.1% -- replaced with /var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-mgr.y.log.gz 2023-10-19T13:02:55.777 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-osd.2.log 2023-10-19T13:02:55.777 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-osd.11.log 2023-10-19T13:02:55.780 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-osd.5.log: /var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-mgr.z.log 2023-10-19T13:02:55.780 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-osd.8.log 2023-10-19T13:02:55.780 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-mds.f.log 2023-10-19T13:02:55.781 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-mds.c.log 2023-10-19T13:02:55.781 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-mds.i.log 2023-10-19T13:02:55.781 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-mon.c.log 2023-10-19T13:02:55.781 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-mds.c.log: /var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-volume.log 2023-10-19T13:02:55.782 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-mds.l.log 2023-10-19T13:02:55.782 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-10-19T13:02:55.783 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-volume.log: /var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-mds.l.log: /var/log/ceph/cephadm.log: 93.1% -- replaced with /var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-mgr.z.log.gz 2023-10-19T13:02:55.787 INFO:teuthology.orchestra.run.smithi046.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-osd.0.log 2023-10-19T13:02:55.788 INFO:teuthology.orchestra.run.smithi046.stderr:: No such file or directory 2023-10-19T13:02:55.794 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-mds.g.log 2023-10-19T13:02:55.795 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-mds.a.log 2023-10-19T13:02:55.796 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-osd.6.log 2023-10-19T13:02:55.797 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-osd.3.log 2023-10-19T13:02:55.798 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-mds.d.log 2023-10-19T13:02:55.799 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-mgr.x.log 2023-10-19T13:02:55.800 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-osd.9.log 2023-10-19T13:02:55.801 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-volume.log 2023-10-19T13:02:55.802 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-mds.j.log 2023-10-19T13:02:55.803 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-mon.a.log 2023-10-19T13:02:55.805 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-10-19T13:02:55.805 INFO:teuthology.orchestra.run.smithi046.stderr: 94.3% -- replaced with /var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-mds.d.log.gz 2023-10-19T13:02:55.806 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.log 2023-10-19T13:02:55.810 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/cephadm.log: /var/log/ceph/ceph-client.admin.log: 94.3% -- replaced with /var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-mds.j.log.gz 2023-10-19T13:02:55.810 INFO:teuthology.orchestra.run.smithi046.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.log.gz 2023-10-19T13:02:55.818 INFO:teuthology.orchestra.run.smithi157.stderr: 91.9% -- replaced with /var/log/ceph/cephadm.log.gz 2023-10-19T13:02:55.878 INFO:teuthology.orchestra.run.smithi046.stderr: 90.9% -- replaced with /var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-volume.log.gz 2023-10-19T13:02:56.046 INFO:teuthology.orchestra.run.smithi195.stderr: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2023-10-19T13:02:56.370 INFO:teuthology.orchestra.run.smithi046.stderr: 93.5% -- replaced with /var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-mds.a.log.gz 2023-10-19T13:02:56.371 INFO:teuthology.orchestra.run.smithi046.stderr: 93.9% -- replaced with /var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-mds.g.log.gz 2023-10-19T13:02:56.415 INFO:teuthology.orchestra.run.smithi195.stderr: 94.8% -- replaced with /var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-mds.l.log.gz 2023-10-19T13:02:56.516 INFO:teuthology.orchestra.run.smithi195.stderr: 91.0% -- replaced with /var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-volume.log.gz 2023-10-19T13:02:56.650 INFO:teuthology.orchestra.run.smithi157.stderr: 93.5% -- replaced with /var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-mds.k.log.gz 2023-10-19T13:02:56.708 INFO:teuthology.orchestra.run.smithi046.stderr: 90.2% -- replaced with /var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-mgr.x.log.gz 2023-10-19T13:02:56.778 INFO:teuthology.orchestra.run.smithi046.stderr: 93.0% -- replaced with /var/log/ceph/cephadm.log.gz 2023-10-19T13:02:56.797 INFO:teuthology.orchestra.run.smithi157.stderr: 90.9% -- replaced with /var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-volume.log.gz 2023-10-19T13:02:56.997 INFO:teuthology.orchestra.run.smithi157.stderr: 94.4% -- replaced with /var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-mds.e.log.gz 2023-10-19T13:02:57.299 INFO:teuthology.orchestra.run.smithi195.stderr: 93.3% -- replaced with /var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-mds.f.log.gz 2023-10-19T13:02:57.989 INFO:teuthology.orchestra.run.smithi195.stderr: 91.9% -- replaced with /var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-mon.c.log.gz 2023-10-19T13:02:58.018 INFO:teuthology.orchestra.run.smithi157.stderr: 91.9% -- replaced with /var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-mon.b.log.gz 2023-10-19T13:02:58.777 INFO:teuthology.orchestra.run.smithi195.stderr: 93.9% -- replaced with /var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-mds.c.log.gz 2023-10-19T13:02:58.961 INFO:teuthology.orchestra.run.smithi046.stderr: 90.3% -- replaced with /var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-mon.a.log.gz 2023-10-19T13:02:59.765 INFO:teuthology.orchestra.run.smithi195.stderr: 93.7% -- replaced with /var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-mds.i.log.gz 2023-10-19T13:04:34.106 INFO:teuthology.orchestra.run.smithi195.stderr: 90.8% -- replaced with /var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-osd.11.log.gz 2023-10-19T13:04:42.027 INFO:teuthology.orchestra.run.smithi195.stderr: 90.6% -- replaced with /var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-osd.8.log.gz 2023-10-19T13:05:18.342 INFO:teuthology.orchestra.run.smithi195.stderr: 90.9% -- replaced with /var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-osd.2.log.gz 2023-10-19T13:05:41.436 INFO:teuthology.orchestra.run.smithi157.stderr: 90.5% -- replaced with /var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-osd.10.log.gz 2023-10-19T13:05:52.230 INFO:teuthology.orchestra.run.smithi157.stderr: 97.9% -- replaced with /var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-mds.h.log.gz 2023-10-19T13:05:52.459 INFO:teuthology.orchestra.run.smithi195.stderr: 90.6% -- replaced with /var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-osd.5.log.gz 2023-10-19T13:05:52.501 INFO:teuthology.orchestra.run.smithi195.stderr: 2023-10-19T13:05:52.501 INFO:teuthology.orchestra.run.smithi195.stderr:real 2m56.766s 2023-10-19T13:05:52.502 INFO:teuthology.orchestra.run.smithi195.stderr:user 5m16.961s 2023-10-19T13:05:52.502 INFO:teuthology.orchestra.run.smithi195.stderr:sys 0m11.023s 2023-10-19T13:06:15.593 INFO:teuthology.orchestra.run.smithi157.stderr: 90.6% -- replaced with /var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-osd.1.log.gz 2023-10-19T13:06:45.546 INFO:teuthology.orchestra.run.smithi046.stderr: 90.6% -- replaced with /var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-osd.0.log.gz 2023-10-19T13:06:51.447 INFO:teuthology.orchestra.run.smithi046.stderr: 90.6% -- replaced with /var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-osd.3.log.gz 2023-10-19T13:06:56.361 INFO:teuthology.orchestra.run.smithi046.stderr: 90.7% -- replaced with /var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-osd.6.log.gz 2023-10-19T13:07:06.152 INFO:teuthology.orchestra.run.smithi157.stderr: 90.6% -- replaced with /var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-osd.7.log.gz 2023-10-19T13:07:32.047 INFO:teuthology.orchestra.run.smithi157.stderr: 98.4% -- replaced with /var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-mds.b.log.gz 2023-10-19T13:07:32.648 INFO:teuthology.orchestra.run.smithi046.stderr: 90.6% -- replaced with /var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-osd.9.log.gz 2023-10-19T13:07:32.652 INFO:teuthology.orchestra.run.smithi046.stderr: 2023-10-19T13:07:32.652 INFO:teuthology.orchestra.run.smithi046.stderr:real 4m36.899s 2023-10-19T13:07:32.652 INFO:teuthology.orchestra.run.smithi046.stderr:user 7m20.555s 2023-10-19T13:07:32.653 INFO:teuthology.orchestra.run.smithi046.stderr:sys 0m50.472s 2023-10-19T13:08:11.158 INFO:teuthology.orchestra.run.smithi157.stderr: 91.1% -- replaced with /var/log/ceph/96a8be3c-6e7b-11ee-8db6-212e2dc638e7/ceph-osd.4.log.gz 2023-10-19T13:08:11.161 INFO:teuthology.orchestra.run.smithi157.stderr: 2023-10-19T13:08:11.161 INFO:teuthology.orchestra.run.smithi157.stderr:real 5m15.425s 2023-10-19T13:08:11.161 INFO:teuthology.orchestra.run.smithi157.stderr:user 7m4.850s 2023-10-19T13:08:11.162 INFO:teuthology.orchestra.run.smithi157.stderr:sys 0m18.222s 2023-10-19T13:08:11.162 INFO:tasks.cephadm:Archiving logs... 2023-10-19T13:08:11.163 DEBUG:teuthology.misc:Transferring archived files from smithi046:/var/log/ceph to /home/teuthworker/archive/pdonnell-2023-10-19_12:04:12-fs-wip-batrick-testing-20231016.203825-distro-default-smithi/7432284/remote/smithi046/log 2023-10-19T13:08:11.164 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-19T13:09:26.297 DEBUG:teuthology.misc:Transferring archived files from smithi157:/var/log/ceph to /home/teuthworker/archive/pdonnell-2023-10-19_12:04:12-fs-wip-batrick-testing-20231016.203825-distro-default-smithi/7432284/remote/smithi157/log 2023-10-19T13:09:26.298 DEBUG:teuthology.orchestra.run.smithi157:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-19T13:10:28.741 DEBUG:teuthology.misc:Transferring archived files from smithi195:/var/log/ceph to /home/teuthworker/archive/pdonnell-2023-10-19_12:04:12-fs-wip-batrick-testing-20231016.203825-distro-default-smithi/7432284/remote/smithi195/log 2023-10-19T13:10:28.742 DEBUG:teuthology.orchestra.run.smithi195:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-19T13:11:27.853 INFO:tasks.cephadm:Removing cluster... 2023-10-19T13:11:27.854 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 --force 2023-10-19T13:11:28.404 INFO:teuthology.orchestra.run.smithi046.stdout:Deleting cluster with fsid: 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 2023-10-19T13:11:30.569 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 --force 2023-10-19T13:11:31.315 INFO:teuthology.orchestra.run.smithi157.stdout:Deleting cluster with fsid: 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 2023-10-19T13:11:32.278 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 --force 2023-10-19T13:11:32.826 INFO:teuthology.orchestra.run.smithi195.stdout:Deleting cluster with fsid: 96a8be3c-6e7b-11ee-8db6-212e2dc638e7 2023-10-19T13:11:33.783 INFO:tasks.cephadm:Removing cephadm ... 2023-10-19T13:11:33.784 DEBUG:teuthology.orchestra.run.smithi046:> rm -rf /home/ubuntu/cephtest/cephadm 2023-10-19T13:11:33.837 DEBUG:teuthology.orchestra.run.smithi157:> rm -rf /home/ubuntu/cephtest/cephadm 2023-10-19T13:11:33.945 DEBUG:teuthology.orchestra.run.smithi195:> rm -rf /home/ubuntu/cephtest/cephadm 2023-10-19T13:11:33.971 INFO:tasks.cephadm:Teardown complete 2023-10-19T13:11:33.972 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-19T13:11:33.983 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-19T13:11:33.983 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-19T13:11:33.989 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-19T13:11:33.992 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-19T13:11:34.155 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-19T13:11:34.165 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-19T13:11:34.166 DEBUG:teuthology.orchestra.run.smithi046:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-19T13:11:34.171 DEBUG:teuthology.orchestra.run.smithi157:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-19T13:11:34.173 DEBUG:teuthology.orchestra.run.smithi195:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-19T13:11:34.189 INFO:teuthology.orchestra.run.smithi195.stderr:bash: ntpq: command not found 2023-10-19T13:11:34.190 INFO:teuthology.orchestra.run.smithi157.stderr:bash: ntpq: command not found 2023-10-19T13:11:34.208 INFO:teuthology.orchestra.run.smithi157.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-19T13:11:34.208 INFO:teuthology.orchestra.run.smithi157.stdout:=============================================================================== 2023-10-19T13:11:34.209 INFO:teuthology.orchestra.run.smithi157.stdout:^* hv01.front.sepia.ceph.com 3 6 377 48 +2859us[+2605us] +/- 53ms 2023-10-19T13:11:34.209 INFO:teuthology.orchestra.run.smithi157.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 50 -1733us[-1986us] +/- 49ms 2023-10-19T13:11:34.209 INFO:teuthology.orchestra.run.smithi157.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 48 -1380us[-1380us] +/- 73ms 2023-10-19T13:11:34.209 INFO:teuthology.orchestra.run.smithi157.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-10-19T13:11:34.210 INFO:teuthology.orchestra.run.smithi046.stderr:bash: ntpq: command not found 2023-10-19T13:11:34.212 INFO:teuthology.orchestra.run.smithi195.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-19T13:11:34.212 INFO:teuthology.orchestra.run.smithi195.stdout:=============================================================================== 2023-10-19T13:11:34.212 INFO:teuthology.orchestra.run.smithi195.stdout:^* hv01.front.sepia.ceph.com 3 6 377 47 +2876us[+2655us] +/- 53ms 2023-10-19T13:11:34.213 INFO:teuthology.orchestra.run.smithi195.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 51 -1703us[-1923us] +/- 49ms 2023-10-19T13:11:34.213 INFO:teuthology.orchestra.run.smithi195.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 47 -1353us[-1353us] +/- 73ms 2023-10-19T13:11:34.213 INFO:teuthology.orchestra.run.smithi195.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-10-19T13:11:34.234 INFO:teuthology.orchestra.run.smithi046.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-19T13:11:34.235 INFO:teuthology.orchestra.run.smithi046.stdout:=============================================================================== 2023-10-19T13:11:34.235 INFO:teuthology.orchestra.run.smithi046.stdout:^* hv01.front.sepia.ceph.com 3 6 377 47 +2863us[+2639us] +/- 53ms 2023-10-19T13:11:34.235 INFO:teuthology.orchestra.run.smithi046.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 49 -1728us[-1952us] +/- 49ms 2023-10-19T13:11:34.235 INFO:teuthology.orchestra.run.smithi046.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 51 -1388us[-1613us] +/- 73ms 2023-10-19T13:11:34.235 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-10-19T13:11:34.236 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-19T13:11:34.247 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-19T13:11:34.247 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-19T13:11:34.257 DEBUG:teuthology.orchestra.run.smithi046:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-19T13:11:34.560 DEBUG:teuthology.orchestra.run.smithi157:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-19T13:11:34.748 DEBUG:teuthology.orchestra.run.smithi195:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-19T13:11:34.886 DEBUG:teuthology.orchestra.run.smithi046:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-19T13:11:34.964 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-19T13:11:34.965 DEBUG:teuthology.orchestra.run.smithi157:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-19T13:11:35.000 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-19T13:11:35.001 DEBUG:teuthology.orchestra.run.smithi195:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-19T13:11:35.033 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-19T13:11:35.033 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-19T13:11:35.045 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-19T13:11:35.055 INFO:teuthology.task.internal:Duration was 3341.773782 seconds 2023-10-19T13:11:35.056 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-19T13:11:35.065 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-19T13:11:35.066 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-19T13:11:35.070 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-19T13:11:35.073 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-19T13:11:35.149 INFO:teuthology.orchestra.run.smithi195.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-19T13:11:35.170 INFO:teuthology.orchestra.run.smithi157.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-19T13:11:35.228 INFO:teuthology.orchestra.run.smithi046.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-19T13:11:35.784 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-19T13:11:35.784 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi046.front.sepia.ceph.com 2023-10-19T13:11:35.785 DEBUG:teuthology.orchestra.run.smithi046:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-19T13:11:35.855 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi157.front.sepia.ceph.com 2023-10-19T13:11:35.855 DEBUG:teuthology.orchestra.run.smithi157:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-19T13:11:35.892 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi195.front.sepia.ceph.com 2023-10-19T13:11:35.893 DEBUG:teuthology.orchestra.run.smithi195:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-19T13:11:35.930 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-19T13:11:35.930 DEBUG:teuthology.orchestra.run.smithi046:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-19T13:11:35.935 DEBUG:teuthology.orchestra.run.smithi157:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-19T13:11:35.938 DEBUG:teuthology.orchestra.run.smithi195:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-19T13:11:36.052 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-19T13:11:36.053 DEBUG:teuthology.orchestra.run.smithi046:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-19T13:11:36.057 DEBUG:teuthology.orchestra.run.smithi157:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-19T13:11:36.059 DEBUG:teuthology.orchestra.run.smithi195:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-19T13:11:36.229 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-19T13:11:36.241 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-19T13:11:36.242 DEBUG:teuthology.orchestra.run.smithi046:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-19T13:11:36.333 DEBUG:teuthology.orchestra.run.smithi157:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-19T13:11:36.362 DEBUG:teuthology.orchestra.run.smithi195:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-19T13:11:36.391 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-19T13:11:36.402 DEBUG:teuthology.orchestra.run.smithi046:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-19T13:11:36.407 DEBUG:teuthology.orchestra.run.smithi157:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-19T13:11:36.410 DEBUG:teuthology.orchestra.run.smithi195:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-19T13:11:36.446 INFO:teuthology.orchestra.run.smithi157.stdout:kernel.core_pattern = core 2023-10-19T13:11:36.471 INFO:teuthology.orchestra.run.smithi195.stdout:kernel.core_pattern = core 2023-10-19T13:11:36.488 INFO:teuthology.orchestra.run.smithi046.stdout:kernel.core_pattern = core 2023-10-19T13:11:36.526 DEBUG:teuthology.orchestra.run.smithi046:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-19T13:11:36.567 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-19T13:11:36.568 DEBUG:teuthology.orchestra.run.smithi157:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-19T13:11:36.584 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-19T13:11:36.585 DEBUG:teuthology.orchestra.run.smithi195:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-19T13:11:36.601 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-19T13:11:36.602 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-19T13:11:36.613 INFO:teuthology.task.internal:Transferring archived files... 2023-10-19T13:11:36.614 DEBUG:teuthology.misc:Transferring archived files from smithi046:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2023-10-19_12:04:12-fs-wip-batrick-testing-20231016.203825-distro-default-smithi/7432284/remote/smithi046 2023-10-19T13:11:36.614 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-19T13:11:36.700 DEBUG:teuthology.misc:Transferring archived files from smithi157:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2023-10-19_12:04:12-fs-wip-batrick-testing-20231016.203825-distro-default-smithi/7432284/remote/smithi157 2023-10-19T13:11:36.701 DEBUG:teuthology.orchestra.run.smithi157:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-19T13:11:36.742 DEBUG:teuthology.misc:Transferring archived files from smithi195:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2023-10-19_12:04:12-fs-wip-batrick-testing-20231016.203825-distro-default-smithi/7432284/remote/smithi195 2023-10-19T13:11:36.742 DEBUG:teuthology.orchestra.run.smithi195:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-19T13:11:36.782 INFO:teuthology.task.internal:Removing archive directory... 2023-10-19T13:11:36.782 DEBUG:teuthology.orchestra.run.smithi046:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-19T13:11:36.787 DEBUG:teuthology.orchestra.run.smithi157:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-19T13:11:36.789 DEBUG:teuthology.orchestra.run.smithi195:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-19T13:11:36.832 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-19T13:11:36.846 INFO:teuthology.task.internal:Not uploading archives. 2023-10-19T13:11:36.846 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-19T13:11:36.857 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-19T13:11:36.857 DEBUG:teuthology.orchestra.run.smithi046:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-19T13:11:36.871 DEBUG:teuthology.orchestra.run.smithi157:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-19T13:11:36.873 DEBUG:teuthology.orchestra.run.smithi195:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-19T13:11:36.887 INFO:teuthology.orchestra.run.smithi157.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 19 13:11 /home/ubuntu/cephtest 2023-10-19T13:11:36.889 INFO:teuthology.orchestra.run.smithi195.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 19 13:11 /home/ubuntu/cephtest 2023-10-19T13:11:36.910 INFO:teuthology.orchestra.run.smithi046.stdout: 524301 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 19 13:11 /home/ubuntu/cephtest 2023-10-19T13:11:36.914 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-19T13:11:36.925 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-19T13:11:36.948 INFO:teuthology.nuke:Checking targets against current locks 2023-10-19T13:11:36.974 DEBUG:teuthology.nuke:shortname: smithi046 2023-10-19T13:11:36.975 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-19T13:11:37.001 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi046.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-10-19_12:04:12-fs-wip-batrick-testing-20231016.203825-distro-default-smithi/7432284', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-19 12:06:56.544824', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-19T13:11:37.005 DEBUG:teuthology.nuke:shortname: smithi157 2023-10-19T13:11:37.005 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-19T13:11:37.026 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi157.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-10-19_12:04:12-fs-wip-batrick-testing-20231016.203825-distro-default-smithi/7432284', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-19 12:06:56.546259', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-19T13:11:37.031 DEBUG:teuthology.nuke:shortname: smithi195 2023-10-19T13:11:37.032 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-19T13:11:37.053 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi195.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-10-19_12:04:12-fs-wip-batrick-testing-20231016.203825-distro-default-smithi/7432284', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-19 12:06:56.547989', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-19T13:11:37.065 INFO:teuthology.orchestra.console.smithi046:Power off 2023-10-19T13:11:37.065 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-19T13:11:37.089 DEBUG:teuthology.orchestra.console.smithi046:power off output: Chassis Power Control: Down/Off 2023-10-19T13:11:37.090 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T13:11:37.107 INFO:teuthology.orchestra.console.smithi157:Power off 2023-10-19T13:11:37.107 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-19T13:11:37.120 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is on 2023-10-19T13:11:37.130 DEBUG:teuthology.orchestra.console.smithi157:power off output: Chassis Power Control: Down/Off 2023-10-19T13:11:37.130 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T13:11:37.147 INFO:teuthology.orchestra.console.smithi195:Power off 2023-10-19T13:11:37.148 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-19T13:11:37.157 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is on 2023-10-19T13:11:37.173 DEBUG:teuthology.orchestra.console.smithi195:power off output: Chassis Power Control: Down/Off 2023-10-19T13:11:37.174 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T13:11:37.196 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is on 2023-10-19T13:11:41.121 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T13:11:41.158 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T13:11:41.198 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T13:11:41.233 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is on 2023-10-19T13:11:41.269 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is on 2023-10-19T13:11:41.309 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is on 2023-10-19T13:11:45.238 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T13:11:45.270 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T13:11:45.310 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T13:11:45.349 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is off 2023-10-19T13:11:45.380 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off 2023-10-19T13:11:45.420 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is off 2023-10-19T13:11:45.450 INFO:teuthology.orchestra.console.smithi046:Power off completed 2023-10-19T13:11:45.481 INFO:teuthology.orchestra.console.smithi157:Power off completed 2023-10-19T13:11:45.521 INFO:teuthology.orchestra.console.smithi195:Power off completed 2023-10-19T13:11:45.627 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 47672119149b103ec7cec2cc65c063ccbb001ac7 description: fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-workunit/postgres}} duration: 3341.7737822532654 failure_reason: 'error during scrub thrashing: reached maximum tries (31) after waiting for 900 seconds' flavor: default owner: scheduled_pdonnell@teuthology status: fail success: false 2023-10-19T13:11:45.627 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T13:11:45.722 INFO:teuthology.run:FAIL